2024-04-01T06:35:57.824 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-04-01T06:35:57.825 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_teuthology@teuthology --name teuthology-2024-03-27_22:24:02-fs-reef-distro-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/fsstress}} --verbose --archive /home/teuthworker/archive/teuthology-2024-03-27_22:24:02-fs-reef-distro-default-smithi/7627463 -- /home/teuthworker/archive/teuthology-2024-03-27_22:24:02-fs-reef-distro-default-smithi/7627463/orig.config.yaml 2024-04-01T06:35:57.881 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T06:35:57.970 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-03-27_22:24:02-fs-reef-distro-default-smithi/7627463 branch: reef description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/fsstress}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7627463' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: teuthology-2024-03-27_22:24:02-fs-reef-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: reef ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow metadata IO - SLOW_OPS - slow request sha1: 9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 subvols: create: 2 subvol_options: --namespace-isolated --size 25000000000 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount install: ceph: flavor: default sha1: 9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=legacy - wsync syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: reef sha1: 5df3435b30085cc9abc1eb282ab0f20651c8a39a owner: scheduled_teuthology@teuthology priority: 930 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 7331 sha1: 9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 sleep_before_teardown: 0 subset: 89/512 suite: fs suite_branch: reef suite_path: /home/teuthworker/src/git.ceph.com_ceph_5df3435b30085cc9abc1eb282ab0f20651c8a39a/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 5df3435b30085cc9abc1eb282ab0f20651c8a39a syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi083.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAGyF08WtiWnGUBakqONA4TOCeh6PVpT0lJmG2rm3bNrsQPIetpD7OAVbiazDg3hRo6VYkFwwa/SY7oLHnshQpU= smithi145.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHj28tnHIvFd5C6CE3UCvX7UOj/3KFM58N9y/2CNusXrJ3PqRLVRaqMzrEba0sCz7TReoaw48hKmAXeAf/zZDIU= smithi153.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDC6r6S2VhmCQQ10q04+DpxUxLkvdoivR3GSJdraq4MXQ7gzT9dZiroNpqeZ8Fboj3MFB4VSnIeAH6QPwlcHa6w= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools:rhel8 --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph mgr module enable snap_schedule - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - suites/fsstress.sh timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-03-27_22:24:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-01T06:35:57.970 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_5df3435b30085cc9abc1eb282ab0f20651c8a39a/qa; will attempt to use it 2024-04-01T06:35:57.971 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_5df3435b30085cc9abc1eb282ab0f20651c8a39a/qa/tasks 2024-04-01T06:35:57.971 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-01T06:35:57.973 INFO:teuthology.task.internal:Checking packages... 2024-04-01T06:35:57.995 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12' 2024-04-01T06:35:57.995 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-01T06:35:57.995 INFO:teuthology.packaging:ref: None 2024-04-01T06:35:57.995 INFO:teuthology.packaging:tag: None 2024-04-01T06:35:57.995 INFO:teuthology.packaging:branch: reef 2024-04-01T06:35:57.996 INFO:teuthology.packaging:sha1: 9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 2024-04-01T06:35:57.996 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=reef 2024-04-01T06:35:58.247 INFO:teuthology.task.internal:Found packages for ceph version 18.2.2-1055.g6aa9aa6d 2024-04-01T06:35:58.249 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-01T06:35:58.255 INFO:teuthology.task.internal:no buildpackages task found 2024-04-01T06:35:58.256 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-01T06:35:58.289 INFO:teuthology.task.internal:Saving configuration 2024-04-01T06:35:58.310 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-01T06:35:58.316 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-01T06:35:58.342 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi083.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-03-27_22:24:02-fs-reef-distro-default-smithi/7627463', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-01 06:30:40.138253', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAGyF08WtiWnGUBakqONA4TOCeh6PVpT0lJmG2rm3bNrsQPIetpD7OAVbiazDg3hRo6VYkFwwa/SY7oLHnshQpU='} 2024-04-01T06:35:58.365 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi145.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-03-27_22:24:02-fs-reef-distro-default-smithi/7627463', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-01 06:30:40.136909', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHj28tnHIvFd5C6CE3UCvX7UOj/3KFM58N9y/2CNusXrJ3PqRLVRaqMzrEba0sCz7TReoaw48hKmAXeAf/zZDIU='} 2024-04-01T06:35:58.389 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-03-27_22:24:02-fs-reef-distro-default-smithi/7627463', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-01 06:30:40.139346', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDC6r6S2VhmCQQ10q04+DpxUxLkvdoivR3GSJdraq4MXQ7gzT9dZiroNpqeZ8Fboj3MFB4VSnIeAH6QPwlcHa6w='} 2024-04-01T06:35:58.389 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-01T06:35:58.435 INFO:teuthology.task.internal:roles: ubuntu@smithi083.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-04-01T06:35:58.436 INFO:teuthology.task.internal:roles: ubuntu@smithi145.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-04-01T06:35:58.436 INFO:teuthology.task.internal:roles: ubuntu@smithi153.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-04-01T06:35:58.436 INFO:teuthology.run_tasks:Running task console_log... 2024-04-01T06:35:58.582 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2e8377b160>, signals=[15]) 2024-04-01T06:35:58.582 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-01T06:35:58.588 INFO:teuthology.task.internal:Opening connections... 2024-04-01T06:35:58.588 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi083.front.sepia.ceph.com 2024-04-01T06:35:58.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T06:35:58.663 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi145.front.sepia.ceph.com 2024-04-01T06:35:58.664 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T06:35:58.738 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi153.front.sepia.ceph.com 2024-04-01T06:35:58.739 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T06:35:58.813 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-01T06:35:58.820 DEBUG:teuthology.orchestra.run.smithi083:> uname -m 2024-04-01T06:35:58.841 INFO:teuthology.orchestra.run.smithi083.stdout:x86_64 2024-04-01T06:35:58.841 DEBUG:teuthology.orchestra.run.smithi083:> cat /etc/os-release 2024-04-01T06:35:58.900 INFO:teuthology.orchestra.run.smithi083.stdout:NAME="Red Hat Enterprise Linux" 2024-04-01T06:35:58.901 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION="8.6 (Ootpa)" 2024-04-01T06:35:58.901 INFO:teuthology.orchestra.run.smithi083.stdout:ID="rhel" 2024-04-01T06:35:58.901 INFO:teuthology.orchestra.run.smithi083.stdout:ID_LIKE="fedora" 2024-04-01T06:35:58.901 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_ID="8.6" 2024-04-01T06:35:58.901 INFO:teuthology.orchestra.run.smithi083.stdout:PLATFORM_ID="platform:el8" 2024-04-01T06:35:58.901 INFO:teuthology.orchestra.run.smithi083.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-01T06:35:58.901 INFO:teuthology.orchestra.run.smithi083.stdout:ANSI_COLOR="0;31" 2024-04-01T06:35:58.901 INFO:teuthology.orchestra.run.smithi083.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-01T06:35:58.901 INFO:teuthology.orchestra.run.smithi083.stdout:HOME_URL="https://www.redhat.com/" 2024-04-01T06:35:58.901 INFO:teuthology.orchestra.run.smithi083.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-01T06:35:58.901 INFO:teuthology.orchestra.run.smithi083.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T06:35:58.902 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:35:58.902 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-01T06:35:58.902 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-01T06:35:58.902 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-01T06:35:58.902 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-01T06:35:58.902 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server 2024-04-01T06:35:58.921 DEBUG:teuthology.orchestra.run.smithi145:> uname -m 2024-04-01T06:35:58.943 INFO:teuthology.orchestra.run.smithi145.stdout:x86_64 2024-04-01T06:35:58.943 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release 2024-04-01T06:35:59.003 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="Red Hat Enterprise Linux" 2024-04-01T06:35:59.003 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="8.6 (Ootpa)" 2024-04-01T06:35:59.003 INFO:teuthology.orchestra.run.smithi145.stdout:ID="rhel" 2024-04-01T06:35:59.003 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="fedora" 2024-04-01T06:35:59.003 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="8.6" 2024-04-01T06:35:59.003 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el8" 2024-04-01T06:35:59.003 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-01T06:35:59.003 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31" 2024-04-01T06:35:59.004 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-01T06:35:59.004 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://www.redhat.com/" 2024-04-01T06:35:59.004 INFO:teuthology.orchestra.run.smithi145.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-01T06:35:59.004 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T06:35:59.004 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-01T06:35:59.004 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-01T06:35:59.004 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-01T06:35:59.004 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-01T06:35:59.004 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-01T06:35:59.004 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2024-04-01T06:35:59.029 DEBUG:teuthology.orchestra.run.smithi153:> uname -m 2024-04-01T06:35:59.049 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64 2024-04-01T06:35:59.050 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release 2024-04-01T06:35:59.109 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="Red Hat Enterprise Linux" 2024-04-01T06:35:59.109 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="8.6 (Ootpa)" 2024-04-01T06:35:59.109 INFO:teuthology.orchestra.run.smithi153.stdout:ID="rhel" 2024-04-01T06:35:59.109 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="fedora" 2024-04-01T06:35:59.109 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="8.6" 2024-04-01T06:35:59.109 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el8" 2024-04-01T06:35:59.109 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-01T06:35:59.109 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31" 2024-04-01T06:35:59.109 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-01T06:35:59.109 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://www.redhat.com/" 2024-04-01T06:35:59.109 INFO:teuthology.orchestra.run.smithi153.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-01T06:35:59.110 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T06:35:59.110 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-01T06:35:59.110 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-01T06:35:59.110 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-01T06:35:59.110 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-01T06:35:59.110 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-01T06:35:59.110 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2024-04-01T06:35:59.130 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-01T06:35:59.144 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-01T06:35:59.180 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-01T06:35:59.181 DEBUG:teuthology.orchestra.run.smithi083:> test '!' -e /home/ubuntu/cephtest 2024-04-01T06:35:59.184 DEBUG:teuthology.orchestra.run.smithi145:> test '!' -e /home/ubuntu/cephtest 2024-04-01T06:35:59.186 DEBUG:teuthology.orchestra.run.smithi153:> test '!' -e /home/ubuntu/cephtest 2024-04-01T06:35:59.204 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-01T06:35:59.210 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-01T06:35:59.210 DEBUG:teuthology.orchestra.run.smithi083:> test -z $(ls -A /var/lib/ceph) 2024-04-01T06:35:59.242 DEBUG:teuthology.orchestra.run.smithi145:> test -z $(ls -A /var/lib/ceph) 2024-04-01T06:35:59.245 DEBUG:teuthology.orchestra.run.smithi153:> test -z $(ls -A /var/lib/ceph) 2024-04-01T06:35:59.277 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-01T06:35:59.356 INFO:teuthology.run_tasks:Running task kernel... 2024-04-01T06:35:59.372 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2024-04-01T06:35:59.372 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-04-01T06:35:59.372 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-04-01T06:35:59.372 DEBUG:teuthology.orchestra.run.smithi083:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-01T06:35:59.391 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T06:35:59.391 DEBUG:teuthology.orchestra.run.smithi083:> uname -r 2024-04-01T06:35:59.452 INFO:teuthology.orchestra.run.smithi083.stdout:4.18.0-513.9.1.el8_9.x86_64 2024-04-01T06:35:59.453 INFO:teuthology.task.kernel:Running kernel on smithi083: 4.18.0-513.9.1.el8_9.x86_64 2024-04-01T06:35:59.453 DEBUG:teuthology.orchestra.run.smithi083:> sudo yum install -y kernel 2024-04-01T06:36:01.030 INFO:teuthology.orchestra.run.smithi083.stdout:Updating Subscription Management repositories. 2024-04-01T06:36:01.031 INFO:teuthology.orchestra.run.smithi083.stdout:Unable to read consumer identity 2024-04-01T06:36:01.145 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:36:01.145 INFO:teuthology.orchestra.run.smithi083.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-04-01T06:36:01.145 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:36:03.079 INFO:teuthology.orchestra.run.smithi083.stdout:Copr repo for python3-asyncssh owned by ceph 8.8 kB/s | 3.5 kB 00:00 2024-04-01T06:36:04.446 INFO:teuthology.orchestra.run.smithi083.stdout:Extra Packages for Enterprise Linux 12 MB/s | 16 MB 00:01 2024-04-01T06:36:08.047 INFO:teuthology.orchestra.run.smithi083.stdout:lab-extras 401 kB/s | 24 kB 00:00 2024-04-01T06:36:08.758 INFO:teuthology.orchestra.run.smithi083.stdout:Package kernel-4.18.0-513.9.1.el8_9.x86_64 is already installed. 2024-04-01T06:36:08.758 INFO:teuthology.orchestra.run.smithi083.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2024-04-01T06:36:08.843 INFO:teuthology.orchestra.run.smithi083.stdout:Dependencies resolved. 2024-04-01T06:36:08.844 INFO:teuthology.orchestra.run.smithi083.stdout:Nothing to do. 2024-04-01T06:36:08.844 INFO:teuthology.orchestra.run.smithi083.stdout:Complete! 2024-04-01T06:36:09.000 DEBUG:teuthology.orchestra.run.smithi083:> echo no | sudo yum reinstall kernel || true 2024-04-01T06:36:09.377 INFO:teuthology.orchestra.run.smithi083.stdout:Updating Subscription Management repositories. 2024-04-01T06:36:09.377 INFO:teuthology.orchestra.run.smithi083.stdout:Unable to read consumer identity 2024-04-01T06:36:09.445 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:36:09.445 INFO:teuthology.orchestra.run.smithi083.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-04-01T06:36:09.445 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:36:09.758 INFO:teuthology.orchestra.run.smithi083.stdout:Last metadata expiration check: 0:00:02 ago on Mon 01 Apr 2024 06:36:07 AM UTC. 2024-04-01T06:36:09.836 INFO:teuthology.orchestra.run.smithi083.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-04-01T06:36:09.837 INFO:teuthology.orchestra.run.smithi083.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-04-01T06:36:09.882 INFO:teuthology.orchestra.run.smithi083.stderr:Error: No packages marked for reinstall. 2024-04-01T06:36:09.929 DEBUG:teuthology.orchestra.run.smithi083:> sudo yum reinstall -y kernel || true 2024-04-01T06:36:10.263 INFO:teuthology.orchestra.run.smithi083.stdout:Updating Subscription Management repositories. 2024-04-01T06:36:10.264 INFO:teuthology.orchestra.run.smithi083.stdout:Unable to read consumer identity 2024-04-01T06:36:10.319 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:36:10.320 INFO:teuthology.orchestra.run.smithi083.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-04-01T06:36:10.320 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:36:10.624 INFO:teuthology.orchestra.run.smithi083.stdout:Last metadata expiration check: 0:00:03 ago on Mon 01 Apr 2024 06:36:07 AM UTC. 2024-04-01T06:36:10.692 INFO:teuthology.orchestra.run.smithi083.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-04-01T06:36:10.693 INFO:teuthology.orchestra.run.smithi083.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-04-01T06:36:10.731 INFO:teuthology.orchestra.run.smithi083.stderr:Error: No packages marked for reinstall. 2024-04-01T06:36:10.777 DEBUG:teuthology.orchestra.run.smithi083:> rpm -q kernel | sort -rV | head -n 1 2024-04-01T06:36:10.927 INFO:teuthology.orchestra.run.smithi083.stdout:kernel-4.18.0-513.9.1.el8_9.x86_64 2024-04-01T06:36:10.928 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-513.9.1.el8_9.x86_64 2024-04-01T06:36:10.928 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-01T06:36:10.928 DEBUG:teuthology.parallel:result is None 2024-04-01T06:36:10.928 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-01T06:36:10.935 INFO:teuthology.task.internal:Creating test directory... 2024-04-01T06:36:10.935 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-01T06:36:10.938 DEBUG:teuthology.orchestra.run.smithi145:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-01T06:36:10.940 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-01T06:36:10.962 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-01T06:36:10.970 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-01T06:36:10.987 INFO:teuthology.task.internal:Creating archive directory... 2024-04-01T06:36:10.988 DEBUG:teuthology.orchestra.run.smithi083:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-01T06:36:10.994 DEBUG:teuthology.orchestra.run.smithi145:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-01T06:36:11.001 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-01T06:36:11.034 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-01T06:36:11.041 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-01T06:36:11.041 DEBUG:teuthology.orchestra.run.smithi145:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-01T06:36:11.081 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T06:36:11.082 DEBUG:teuthology.orchestra.run.smithi153:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-01T06:36:11.100 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T06:36:11.101 DEBUG:teuthology.orchestra.run.smithi083:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-01T06:36:11.103 DEBUG:teuthology.orchestra.run.smithi145:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-01T06:36:11.124 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-01T06:36:11.129 INFO:teuthology.orchestra.run.smithi083.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-01T06:36:11.143 INFO:teuthology.orchestra.run.smithi083.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-01T06:36:11.156 INFO:teuthology.orchestra.run.smithi145.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-01T06:36:11.172 INFO:teuthology.orchestra.run.smithi145.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-01T06:36:11.189 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-01T06:36:11.213 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-01T06:36:11.213 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-01T06:36:11.221 INFO:teuthology.task.internal:Configuring sudo... 2024-04-01T06:36:11.221 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-01T06:36:11.223 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-01T06:36:11.225 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-01T06:36:11.255 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-01T06:36:11.264 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-01T06:36:11.264 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-01T06:36:11.291 DEBUG:teuthology.orchestra.run.smithi145:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-01T06:36:11.295 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-01T06:36:11.312 DEBUG:teuthology.orchestra.run.smithi083:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-01T06:36:11.392 DEBUG:teuthology.orchestra.run.smithi083:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-01T06:36:11.442 DEBUG:teuthology.orchestra.run.smithi083:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-01T06:36:11.528 DEBUG:teuthology.orchestra.run.smithi083:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-01T06:36:11.567 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-04-01T06:36:11.567 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-01T06:36:11.633 DEBUG:teuthology.orchestra.run.smithi145:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-01T06:36:11.677 DEBUG:teuthology.orchestra.run.smithi145:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-01T06:36:11.731 DEBUG:teuthology.orchestra.run.smithi145:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-01T06:36:11.818 DEBUG:teuthology.orchestra.run.smithi145:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-01T06:36:11.862 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-04-01T06:36:11.862 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-01T06:36:11.931 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-01T06:36:11.976 DEBUG:teuthology.orchestra.run.smithi153:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-01T06:36:12.027 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-01T06:36:12.110 DEBUG:teuthology.orchestra.run.smithi153:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-01T06:36:12.156 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-04-01T06:36:12.156 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-01T06:36:12.224 DEBUG:teuthology.orchestra.run.smithi083:> sudo service rsyslog restart 2024-04-01T06:36:12.226 DEBUG:teuthology.orchestra.run.smithi145:> sudo service rsyslog restart 2024-04-01T06:36:12.229 DEBUG:teuthology.orchestra.run.smithi153:> sudo service rsyslog restart 2024-04-01T06:36:12.267 INFO:teuthology.orchestra.run.smithi083.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-01T06:36:12.277 INFO:teuthology.orchestra.run.smithi145.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-01T06:36:12.317 INFO:teuthology.orchestra.run.smithi153.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-01T06:36:12.766 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-01T06:36:12.774 INFO:teuthology.task.internal:Starting timer... 2024-04-01T06:36:12.775 INFO:teuthology.run_tasks:Running task pcp... 2024-04-01T06:36:12.816 INFO:teuthology.run_tasks:Running task selinux... 2024-04-01T06:36:12.836 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2024-04-01T06:36:12.837 DEBUG:teuthology.orchestra.run.smithi083:> sudo service auditd rotate 2024-04-01T06:36:12.902 INFO:teuthology.orchestra.run.smithi083.stdout:Rotating logs: 2024-04-01T06:36:12.905 DEBUG:teuthology.orchestra.run.smithi145:> sudo service auditd rotate 2024-04-01T06:36:12.982 INFO:teuthology.orchestra.run.smithi145.stdout:Rotating logs: 2024-04-01T06:36:12.984 DEBUG:teuthology.orchestra.run.smithi153:> sudo service auditd rotate 2024-04-01T06:36:13.043 INFO:teuthology.orchestra.run.smithi153.stdout:Rotating logs: 2024-04-01T06:36:13.044 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-01T06:36:13.044 DEBUG:teuthology.orchestra.run.smithi083:> /usr/sbin/getenforce 2024-04-01T06:36:13.070 INFO:teuthology.orchestra.run.smithi083.stdout:Permissive 2024-04-01T06:36:13.071 DEBUG:teuthology.orchestra.run.smithi145:> /usr/sbin/getenforce 2024-04-01T06:36:13.095 INFO:teuthology.orchestra.run.smithi145.stdout:Permissive 2024-04-01T06:36:13.095 DEBUG:teuthology.orchestra.run.smithi153:> /usr/sbin/getenforce 2024-04-01T06:36:13.121 INFO:teuthology.orchestra.run.smithi153.stdout:Permissive 2024-04-01T06:36:13.121 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi083.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi145.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi153.front.sepia.ceph.com': 'permissive'} 2024-04-01T06:36:13.121 DEBUG:teuthology.orchestra.run.smithi083:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-01T06:36:13.150 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T06:36:13.151 DEBUG:teuthology.orchestra.run.smithi145:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-01T06:36:13.178 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T06:36:13.179 DEBUG:teuthology.orchestra.run.smithi153:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-01T06:36:13.205 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T06:36:13.206 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-01T06:36:13.206 DEBUG:teuthology.orchestra.run.smithi083:> sudo /usr/sbin/setenforce permissive 2024-04-01T06:36:13.236 DEBUG:teuthology.orchestra.run.smithi145:> sudo /usr/sbin/setenforce permissive 2024-04-01T06:36:13.271 DEBUG:teuthology.orchestra.run.smithi153:> sudo /usr/sbin/setenforce permissive 2024-04-01T06:36:13.307 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-01T06:36:13.317 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-01T06:36:13.323 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-01T06:36:13.461 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-01T06:36:13.476 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-01T06:36:13.477 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi083.front.sepia.ceph.com,smithi145.front.sepia.ceph.com,smithi153.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-01T06:44:34.865 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi083.front.sepia.ceph.com'), Remote(name='ubuntu@smithi145.front.sepia.ceph.com'), Remote(name='ubuntu@smithi153.front.sepia.ceph.com')] 2024-04-01T06:44:34.866 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2024-04-01T06:44:34.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T06:44:34.941 DEBUG:teuthology.orchestra.run.smithi083:> true 2024-04-01T06:44:35.007 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi083.front.sepia.ceph.com' 2024-04-01T06:44:35.007 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-04-01T06:44:35.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T06:44:35.080 DEBUG:teuthology.orchestra.run.smithi145:> true 2024-04-01T06:44:35.149 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-04-01T06:44:35.149 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-04-01T06:44:35.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T06:44:35.225 DEBUG:teuthology.orchestra.run.smithi153:> true 2024-04-01T06:44:35.292 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-04-01T06:44:35.292 INFO:teuthology.run_tasks:Running task clock... 2024-04-01T06:44:35.303 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-01T06:44:35.304 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-01T06:44:35.304 DEBUG:teuthology.orchestra.run.smithi083:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-01T06:44:35.306 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-01T06:44:35.306 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-01T06:44:35.308 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-01T06:44:35.308 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-01T06:44:35.336 INFO:teuthology.orchestra.run.smithi145.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-01T06:44:35.337 INFO:teuthology.orchestra.run.smithi083.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-01T06:44:35.351 INFO:teuthology.orchestra.run.smithi145.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-01T06:44:35.352 INFO:teuthology.orchestra.run.smithi083.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-01T06:44:35.365 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-01T06:44:35.381 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-01T06:44:35.420 INFO:teuthology.orchestra.run.smithi145.stderr:sudo: ntpd: command not found 2024-04-01T06:44:35.426 INFO:teuthology.orchestra.run.smithi083.stderr:sudo: ntpd: command not found 2024-04-01T06:44:35.433 INFO:teuthology.orchestra.run.smithi145.stdout:506 Cannot talk to daemon 2024-04-01T06:44:35.438 INFO:teuthology.orchestra.run.smithi083.stdout:506 Cannot talk to daemon 2024-04-01T06:44:35.447 INFO:teuthology.orchestra.run.smithi145.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-01T06:44:35.453 INFO:teuthology.orchestra.run.smithi083.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-01T06:44:35.456 INFO:teuthology.orchestra.run.smithi153.stderr:sudo: ntpd: command not found 2024-04-01T06:44:35.461 INFO:teuthology.orchestra.run.smithi145.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-01T06:44:35.467 INFO:teuthology.orchestra.run.smithi083.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-01T06:44:35.468 INFO:teuthology.orchestra.run.smithi153.stdout:506 Cannot talk to daemon 2024-04-01T06:44:35.483 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-01T06:44:35.497 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-01T06:44:35.526 INFO:teuthology.orchestra.run.smithi145.stderr:bash: ntpq: command not found 2024-04-01T06:44:35.529 INFO:teuthology.orchestra.run.smithi083.stderr:bash: ntpq: command not found 2024-04-01T06:44:35.530 INFO:teuthology.orchestra.run.smithi145.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-01T06:44:35.530 INFO:teuthology.orchestra.run.smithi145.stdout:=============================================================================== 2024-04-01T06:44:35.530 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T06:44:35.530 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T06:44:35.530 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T06:44:35.531 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T06:44:35.532 INFO:teuthology.orchestra.run.smithi083.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-01T06:44:35.532 INFO:teuthology.orchestra.run.smithi083.stdout:=============================================================================== 2024-04-01T06:44:35.532 INFO:teuthology.orchestra.run.smithi083.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T06:44:35.532 INFO:teuthology.orchestra.run.smithi083.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T06:44:35.532 INFO:teuthology.orchestra.run.smithi083.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T06:44:35.532 INFO:teuthology.orchestra.run.smithi083.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T06:44:35.578 INFO:teuthology.orchestra.run.smithi153.stderr:bash: ntpq: command not found 2024-04-01T06:44:35.582 INFO:teuthology.orchestra.run.smithi153.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-01T06:44:35.582 INFO:teuthology.orchestra.run.smithi153.stdout:=============================================================================== 2024-04-01T06:44:35.582 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T06:44:35.582 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T06:44:35.582 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T06:44:35.582 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T06:44:35.583 INFO:teuthology.run_tasks:Running task pexec... 2024-04-01T06:44:35.592 INFO:teuthology.task.pexec:Executing custom commands... 2024-04-01T06:44:35.593 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi083.front.sepia.ceph.com 2024-04-01T06:44:35.593 DEBUG:teuthology.orchestra.run.smithi083:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-04-01T06:44:35.593 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi145.front.sepia.ceph.com 2024-04-01T06:44:35.593 DEBUG:teuthology.orchestra.run.smithi145:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-04-01T06:44:35.594 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi153.front.sepia.ceph.com 2024-04-01T06:44:35.594 DEBUG:teuthology.orchestra.run.smithi153:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-04-01T06:44:35.971 INFO:teuthology.orchestra.run.smithi083.stdout:Updating Subscription Management repositories. 2024-04-01T06:44:35.975 INFO:teuthology.orchestra.run.smithi145.stdout:Updating Subscription Management repositories. 2024-04-01T06:44:36.001 INFO:teuthology.orchestra.run.smithi153.stdout:Updating Subscription Management repositories. 2024-04-01T06:44:36.787 INFO:teuthology.orchestra.run.smithi145.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 115 kB/s | 4.1 kB 00:00 2024-04-01T06:44:36.821 INFO:teuthology.orchestra.run.smithi083.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 102 kB/s | 4.1 kB 00:00 2024-04-01T06:44:36.828 INFO:teuthology.orchestra.run.smithi153.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 108 kB/s | 4.1 kB 00:00 2024-04-01T06:44:37.020 INFO:teuthology.orchestra.run.smithi145.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 128 kB/s | 4.5 kB 00:00 2024-04-01T06:44:37.059 INFO:teuthology.orchestra.run.smithi153.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 167 kB/s | 4.5 kB 00:00 2024-04-01T06:44:37.065 INFO:teuthology.orchestra.run.smithi083.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 131 kB/s | 4.5 kB 00:00 2024-04-01T06:44:39.958 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-04-01T06:44:39.959 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-04-01T06:44:39.959 INFO:teuthology.orchestra.run.smithi153.stdout: Package Architecture Version Repository Size 2024-04-01T06:44:39.959 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-04-01T06:44:39.959 INFO:teuthology.orchestra.run.smithi153.stdout:Resetting modules: 2024-04-01T06:44:39.959 INFO:teuthology.orchestra.run.smithi153.stdout: container-tools 2024-04-01T06:44:39.959 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-01T06:44:39.959 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-04-01T06:44:39.960 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-04-01T06:44:39.960 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-01T06:44:40.140 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-04-01T06:44:40.141 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-04-01T06:44:40.142 INFO:teuthology.orchestra.run.smithi145.stdout: Package Architecture Version Repository Size 2024-04-01T06:44:40.142 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-04-01T06:44:40.142 INFO:teuthology.orchestra.run.smithi145.stdout:Resetting modules: 2024-04-01T06:44:40.142 INFO:teuthology.orchestra.run.smithi145.stdout: container-tools 2024-04-01T06:44:40.142 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-01T06:44:40.142 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction Summary 2024-04-01T06:44:40.142 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-04-01T06:44:40.142 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-01T06:44:40.168 INFO:teuthology.orchestra.run.smithi083.stdout:Dependencies resolved. 2024-04-01T06:44:40.169 INFO:teuthology.orchestra.run.smithi083.stdout:================================================================================ 2024-04-01T06:44:40.169 INFO:teuthology.orchestra.run.smithi083.stdout: Package Architecture Version Repository Size 2024-04-01T06:44:40.169 INFO:teuthology.orchestra.run.smithi083.stdout:================================================================================ 2024-04-01T06:44:40.169 INFO:teuthology.orchestra.run.smithi083.stdout:Resetting modules: 2024-04-01T06:44:40.169 INFO:teuthology.orchestra.run.smithi083.stdout: container-tools 2024-04-01T06:44:40.169 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:44:40.169 INFO:teuthology.orchestra.run.smithi083.stdout:Transaction Summary 2024-04-01T06:44:40.169 INFO:teuthology.orchestra.run.smithi083.stdout:================================================================================ 2024-04-01T06:44:40.169 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:44:44.862 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-04-01T06:44:45.360 INFO:teuthology.orchestra.run.smithi153.stdout:Updating Subscription Management repositories. 2024-04-01T06:44:45.486 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-04-01T06:44:45.494 INFO:teuthology.orchestra.run.smithi083.stdout:Complete! 2024-04-01T06:44:45.961 INFO:teuthology.orchestra.run.smithi145.stdout:Updating Subscription Management repositories. 2024-04-01T06:44:45.961 INFO:teuthology.orchestra.run.smithi083.stdout:Updating Subscription Management repositories. 2024-04-01T06:44:46.326 INFO:teuthology.orchestra.run.smithi153.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 24 kB/s | 4.1 kB 00:00 2024-04-01T06:44:46.723 INFO:teuthology.orchestra.run.smithi153.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 25 kB/s | 4.5 kB 00:00 2024-04-01T06:44:47.803 INFO:teuthology.orchestra.run.smithi145.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 40 kB/s | 4.1 kB 00:00 2024-04-01T06:44:47.953 INFO:teuthology.orchestra.run.smithi083.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 25 kB/s | 4.1 kB 00:00 2024-04-01T06:44:48.182 INFO:teuthology.orchestra.run.smithi145.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 27 kB/s | 4.5 kB 00:00 2024-04-01T06:44:48.338 INFO:teuthology.orchestra.run.smithi083.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 26 kB/s | 4.5 kB 00:00 2024-04-01T06:44:49.807 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-04-01T06:44:49.969 INFO:teuthology.orchestra.run.smithi153.stdout:========================================================================================================== 2024-04-01T06:44:49.970 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2024-04-01T06:44:49.970 INFO:teuthology.orchestra.run.smithi153.stdout:========================================================================================================== 2024-04-01T06:44:49.970 INFO:teuthology.orchestra.run.smithi153.stdout:Installing group/module packages: 2024-04-01T06:44:49.970 INFO:teuthology.orchestra.run.smithi153.stdout: aardvark-dns x86_64 2:1.7.0-1.module+el8.9.0+21243+a586538b rhel-8-for-x86_64-appstream-rpms 1.0 M 2024-04-01T06:44:49.970 INFO:teuthology.orchestra.run.smithi153.stdout: buildah x86_64 1:1.31.3-3.module+el8.9.0+21243+a586538b rhel-8-for-x86_64-appstream-rpms 8.8 M 2024-04-01T06:44:49.970 INFO:teuthology.orchestra.run.smithi153.stdout: cockpit-podman noarch 75-1.module+el8.9.0+21243+a586538b rhel-8-for-x86_64-appstream-rpms 739 k 2024-04-01T06:44:49.970 INFO:teuthology.orchestra.run.smithi153.stdout: crun x86_64 1.8.7-1.module+el8.9.0+21243+a586538b rhel-8-for-x86_64-appstream-rpms 239 k 2024-04-01T06:44:49.970 INFO:teuthology.orchestra.run.smithi153.stdout: netavark x86_64 2:1.7.0-2.module+el8.9.0+21243+a586538b rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-04-01T06:44:49.970 INFO:teuthology.orchestra.run.smithi153.stdout: python3-podman noarch 4.6.0-2.module+el8.9.0+21243+a586538b rhel-8-for-x86_64-appstream-rpms 154 k 2024-04-01T06:44:49.970 INFO:teuthology.orchestra.run.smithi153.stdout: skopeo x86_64 2:1.13.3-3.module+el8.9.0+21243+a586538b rhel-8-for-x86_64-appstream-rpms 8.1 M 2024-04-01T06:44:49.970 INFO:teuthology.orchestra.run.smithi153.stdout: toolbox x86_64 0.0.99.4-5.module+el8.9.0+21243+a586538b rhel-8-for-x86_64-appstream-rpms 2.5 M 2024-04-01T06:44:49.970 INFO:teuthology.orchestra.run.smithi153.stdout: udica noarch 0.2.6-20.module+el8.9.0+21243+a586538b rhel-8-for-x86_64-appstream-rpms 49 k 2024-04-01T06:44:49.971 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2024-04-01T06:44:49.971 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2024-04-01T06:44:49.971 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2024-04-01T06:44:49.971 INFO:teuthology.orchestra.run.smithi153.stdout: yajl x86_64 2.1.0-12.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2024-04-01T06:44:49.971 INFO:teuthology.orchestra.run.smithi153.stdout:Installing weak dependencies: 2024-04-01T06:44:49.971 INFO:teuthology.orchestra.run.smithi153.stdout: criu-libs x86_64 3.18-4.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 39 k 2024-04-01T06:44:49.971 INFO:teuthology.orchestra.run.smithi153.stdout:Installing module profiles: 2024-04-01T06:44:49.971 INFO:teuthology.orchestra.run.smithi153.stdout: container-tools/common 2024-04-01T06:44:49.971 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-01T06:44:49.972 INFO:teuthology.orchestra.run.smithi153.stdout:Enabling module streams: 2024-04-01T06:44:49.972 INFO:teuthology.orchestra.run.smithi153.stdout: container-tools rhel8 2024-04-01T06:44:49.972 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-01T06:44:49.972 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-04-01T06:44:49.972 INFO:teuthology.orchestra.run.smithi153.stdout:========================================================================================================== 2024-04-01T06:44:49.972 INFO:teuthology.orchestra.run.smithi153.stdout:Install 13 Packages 2024-04-01T06:44:49.972 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-01T06:44:49.973 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 26 M 2024-04-01T06:44:49.973 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 87 M 2024-04-01T06:44:49.973 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-04-01T06:44:50.308 INFO:teuthology.orchestra.run.smithi153.stdout:(1/13): python3-pytoml-0.1.14-5.git7dea353.el8. 74 kB/s | 25 kB 00:00 2024-04-01T06:44:50.324 INFO:teuthology.orchestra.run.smithi153.stdout:(2/13): criu-libs-3.18-4.module+el8.9.0+20326+3 112 kB/s | 39 kB 00:00 2024-04-01T06:44:50.341 INFO:teuthology.orchestra.run.smithi153.stdout:(3/13): python3-pyxdg-0.25-16.el8.noarch.rpm 254 kB/s | 94 kB 00:00 2024-04-01T06:44:50.625 INFO:teuthology.orchestra.run.smithi153.stdout:(4/13): aardvark-dns-1.7.0-1.module+el8.9.0+212 3.4 MB/s | 1.0 MB 00:00 2024-04-01T06:44:50.642 INFO:teuthology.orchestra.run.smithi153.stdout:(5/13): yajl-2.1.0-12.el8.x86_64.rpm 123 kB/s | 41 kB 00:00 2024-04-01T06:44:50.909 INFO:teuthology.orchestra.run.smithi153.stdout:(6/13): buildah-1.31.3-3.module+el8.9.0+21243+a 16 MB/s | 8.8 MB 00:00 2024-04-01T06:44:50.942 INFO:teuthology.orchestra.run.smithi153.stdout:(7/13): crun-1.8.7-1.module+el8.9.0+21243+a5865 797 kB/s | 239 kB 00:00 2024-04-01T06:44:50.976 INFO:teuthology.orchestra.run.smithi153.stdout:(8/13): cockpit-podman-75-1.module+el8.9.0+2124 2.1 MB/s | 739 kB 00:00 2024-04-01T06:44:51.066 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-04-01T06:44:51.184 INFO:teuthology.orchestra.run.smithi153.stdout:(9/13): python3-podman-4.6.0-2.module+el8.9.0+2 635 kB/s | 154 kB 00:00 2024-04-01T06:44:51.227 INFO:teuthology.orchestra.run.smithi145.stdout:========================================================================================================== 2024-04-01T06:44:51.228 INFO:teuthology.orchestra.run.smithi145.stdout: Package Arch Version Repository Size 2024-04-01T06:44:51.228 INFO:teuthology.orchestra.run.smithi145.stdout:========================================================================================================== 2024-04-01T06:44:51.228 INFO:teuthology.orchestra.run.smithi145.stdout:Installing group/module packages: 2024-04-01T06:44:51.228 INFO:teuthology.orchestra.run.smithi145.stdout: aardvark-dns x86_64 2:1.7.0-1.module+el8.9.0+21243+a586538b rhel-8-for-x86_64-appstream-rpms 1.0 M 2024-04-01T06:44:51.228 INFO:teuthology.orchestra.run.smithi145.stdout: buildah x86_64 1:1.31.3-3.module+el8.9.0+21243+a586538b rhel-8-for-x86_64-appstream-rpms 8.8 M 2024-04-01T06:44:51.228 INFO:teuthology.orchestra.run.smithi145.stdout: cockpit-podman noarch 75-1.module+el8.9.0+21243+a586538b rhel-8-for-x86_64-appstream-rpms 739 k 2024-04-01T06:44:51.228 INFO:teuthology.orchestra.run.smithi145.stdout: crun x86_64 1.8.7-1.module+el8.9.0+21243+a586538b rhel-8-for-x86_64-appstream-rpms 239 k 2024-04-01T06:44:51.228 INFO:teuthology.orchestra.run.smithi145.stdout: netavark x86_64 2:1.7.0-2.module+el8.9.0+21243+a586538b rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-04-01T06:44:51.228 INFO:teuthology.orchestra.run.smithi145.stdout: python3-podman noarch 4.6.0-2.module+el8.9.0+21243+a586538b rhel-8-for-x86_64-appstream-rpms 154 k 2024-04-01T06:44:51.228 INFO:teuthology.orchestra.run.smithi145.stdout: skopeo x86_64 2:1.13.3-3.module+el8.9.0+21243+a586538b rhel-8-for-x86_64-appstream-rpms 8.1 M 2024-04-01T06:44:51.228 INFO:teuthology.orchestra.run.smithi145.stdout: toolbox x86_64 0.0.99.4-5.module+el8.9.0+21243+a586538b rhel-8-for-x86_64-appstream-rpms 2.5 M 2024-04-01T06:44:51.228 INFO:teuthology.orchestra.run.smithi145.stdout: udica noarch 0.2.6-20.module+el8.9.0+21243+a586538b rhel-8-for-x86_64-appstream-rpms 49 k 2024-04-01T06:44:51.228 INFO:teuthology.orchestra.run.smithi145.stdout:Installing dependencies: 2024-04-01T06:44:51.228 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2024-04-01T06:44:51.229 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2024-04-01T06:44:51.229 INFO:teuthology.orchestra.run.smithi145.stdout: yajl x86_64 2.1.0-12.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2024-04-01T06:44:51.229 INFO:teuthology.orchestra.run.smithi145.stdout:Installing weak dependencies: 2024-04-01T06:44:51.229 INFO:teuthology.orchestra.run.smithi145.stdout: criu-libs x86_64 3.18-4.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 39 k 2024-04-01T06:44:51.229 INFO:teuthology.orchestra.run.smithi145.stdout:Installing module profiles: 2024-04-01T06:44:51.229 INFO:teuthology.orchestra.run.smithi145.stdout: container-tools/common 2024-04-01T06:44:51.229 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-01T06:44:51.229 INFO:teuthology.orchestra.run.smithi145.stdout:Enabling module streams: 2024-04-01T06:44:51.229 INFO:teuthology.orchestra.run.smithi145.stdout: container-tools rhel8 2024-04-01T06:44:51.229 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-01T06:44:51.229 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction Summary 2024-04-01T06:44:51.229 INFO:teuthology.orchestra.run.smithi145.stdout:========================================================================================================== 2024-04-01T06:44:51.229 INFO:teuthology.orchestra.run.smithi145.stdout:Install 13 Packages 2024-04-01T06:44:51.229 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-01T06:44:51.230 INFO:teuthology.orchestra.run.smithi145.stdout:Total download size: 26 M 2024-04-01T06:44:51.230 INFO:teuthology.orchestra.run.smithi145.stdout:Installed size: 87 M 2024-04-01T06:44:51.230 INFO:teuthology.orchestra.run.smithi145.stdout:Downloading Packages: 2024-04-01T06:44:51.285 INFO:teuthology.orchestra.run.smithi153.stdout:(10/13): netavark-1.7.0-2.module+el8.9.0+21243+ 9.9 MB/s | 3.7 MB 00:00 2024-04-01T06:44:51.402 INFO:teuthology.orchestra.run.smithi145.stdout:(1/13): criu-libs-3.18-4.module+el8.9.0+20326+3 229 kB/s | 39 kB 00:00 2024-04-01T06:44:51.412 INFO:teuthology.orchestra.run.smithi083.stdout:Dependencies resolved. 2024-04-01T06:44:51.418 INFO:teuthology.orchestra.run.smithi153.stdout:(11/13): skopeo-1.13.3-3.module+el8.9.0+21243+a 18 MB/s | 8.1 MB 00:00 2024-04-01T06:44:51.453 INFO:teuthology.orchestra.run.smithi145.stdout:(2/13): python3-pytoml-0.1.14-5.git7dea353.el8. 111 kB/s | 25 kB 00:00 2024-04-01T06:44:51.478 INFO:teuthology.orchestra.run.smithi145.stdout:(3/13): python3-pyxdg-0.25-16.el8.noarch.rpm 379 kB/s | 94 kB 00:00 2024-04-01T06:44:51.485 INFO:teuthology.orchestra.run.smithi153.stdout:(12/13): toolbox-0.0.99.4-5.module+el8.9.0+2124 8.4 MB/s | 2.5 MB 00:00 2024-04-01T06:44:51.544 INFO:teuthology.orchestra.run.smithi153.stdout:(13/13): udica-0.2.6-20.module+el8.9.0+21243+a5 191 kB/s | 49 kB 00:00 2024-04-01T06:44:51.544 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-04-01T06:44:51.544 INFO:teuthology.orchestra.run.smithi153.stdout:Total 16 MB/s | 26 MB 00:01 2024-04-01T06:44:51.570 INFO:teuthology.orchestra.run.smithi083.stdout:========================================================================================================== 2024-04-01T06:44:51.570 INFO:teuthology.orchestra.run.smithi083.stdout: Package Arch Version Repository Size 2024-04-01T06:44:51.570 INFO:teuthology.orchestra.run.smithi083.stdout:========================================================================================================== 2024-04-01T06:44:51.570 INFO:teuthology.orchestra.run.smithi083.stdout:Installing group/module packages: 2024-04-01T06:44:51.570 INFO:teuthology.orchestra.run.smithi083.stdout: aardvark-dns x86_64 2:1.7.0-1.module+el8.9.0+21243+a586538b rhel-8-for-x86_64-appstream-rpms 1.0 M 2024-04-01T06:44:51.570 INFO:teuthology.orchestra.run.smithi083.stdout: buildah x86_64 1:1.31.3-3.module+el8.9.0+21243+a586538b rhel-8-for-x86_64-appstream-rpms 8.8 M 2024-04-01T06:44:51.570 INFO:teuthology.orchestra.run.smithi083.stdout: cockpit-podman noarch 75-1.module+el8.9.0+21243+a586538b rhel-8-for-x86_64-appstream-rpms 739 k 2024-04-01T06:44:51.570 INFO:teuthology.orchestra.run.smithi083.stdout: crun x86_64 1.8.7-1.module+el8.9.0+21243+a586538b rhel-8-for-x86_64-appstream-rpms 239 k 2024-04-01T06:44:51.570 INFO:teuthology.orchestra.run.smithi083.stdout: netavark x86_64 2:1.7.0-2.module+el8.9.0+21243+a586538b rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-04-01T06:44:51.570 INFO:teuthology.orchestra.run.smithi083.stdout: python3-podman noarch 4.6.0-2.module+el8.9.0+21243+a586538b rhel-8-for-x86_64-appstream-rpms 154 k 2024-04-01T06:44:51.571 INFO:teuthology.orchestra.run.smithi083.stdout: skopeo x86_64 2:1.13.3-3.module+el8.9.0+21243+a586538b rhel-8-for-x86_64-appstream-rpms 8.1 M 2024-04-01T06:44:51.571 INFO:teuthology.orchestra.run.smithi083.stdout: toolbox x86_64 0.0.99.4-5.module+el8.9.0+21243+a586538b rhel-8-for-x86_64-appstream-rpms 2.5 M 2024-04-01T06:44:51.571 INFO:teuthology.orchestra.run.smithi083.stdout: udica noarch 0.2.6-20.module+el8.9.0+21243+a586538b rhel-8-for-x86_64-appstream-rpms 49 k 2024-04-01T06:44:51.571 INFO:teuthology.orchestra.run.smithi083.stdout:Installing dependencies: 2024-04-01T06:44:51.571 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2024-04-01T06:44:51.571 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2024-04-01T06:44:51.571 INFO:teuthology.orchestra.run.smithi083.stdout: yajl x86_64 2.1.0-12.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2024-04-01T06:44:51.571 INFO:teuthology.orchestra.run.smithi083.stdout:Installing weak dependencies: 2024-04-01T06:44:51.571 INFO:teuthology.orchestra.run.smithi083.stdout: criu-libs x86_64 3.18-4.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 39 k 2024-04-01T06:44:51.571 INFO:teuthology.orchestra.run.smithi083.stdout:Installing module profiles: 2024-04-01T06:44:51.571 INFO:teuthology.orchestra.run.smithi083.stdout: container-tools/common 2024-04-01T06:44:51.571 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:44:51.571 INFO:teuthology.orchestra.run.smithi083.stdout:Enabling module streams: 2024-04-01T06:44:51.571 INFO:teuthology.orchestra.run.smithi083.stdout: container-tools rhel8 2024-04-01T06:44:51.571 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:44:51.572 INFO:teuthology.orchestra.run.smithi083.stdout:Transaction Summary 2024-04-01T06:44:51.572 INFO:teuthology.orchestra.run.smithi083.stdout:========================================================================================================== 2024-04-01T06:44:51.572 INFO:teuthology.orchestra.run.smithi083.stdout:Install 13 Packages 2024-04-01T06:44:51.572 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:44:51.572 INFO:teuthology.orchestra.run.smithi083.stdout:Total download size: 26 M 2024-04-01T06:44:51.572 INFO:teuthology.orchestra.run.smithi083.stdout:Installed size: 87 M 2024-04-01T06:44:51.573 INFO:teuthology.orchestra.run.smithi083.stdout:Downloading Packages: 2024-04-01T06:44:51.578 INFO:teuthology.orchestra.run.smithi145.stdout:(4/13): yajl-2.1.0-12.el8.x86_64.rpm 233 kB/s | 41 kB 00:00 2024-04-01T06:44:51.645 INFO:teuthology.orchestra.run.smithi145.stdout:(5/13): aardvark-dns-1.7.0-1.module+el8.9.0+212 5.2 MB/s | 1.0 MB 00:00 2024-04-01T06:44:51.724 INFO:teuthology.orchestra.run.smithi083.stdout:(1/13): criu-libs-3.18-4.module+el8.9.0+20326+3 261 kB/s | 39 kB 00:00 2024-04-01T06:44:51.729 INFO:teuthology.orchestra.run.smithi145.stdout:(6/13): cockpit-podman-75-1.module+el8.9.0+2124 4.8 MB/s | 739 kB 00:00 2024-04-01T06:44:51.749 INFO:teuthology.orchestra.run.smithi083.stdout:(2/13): python3-pytoml-0.1.14-5.git7dea353.el8. 141 kB/s | 25 kB 00:00 2024-04-01T06:44:51.754 INFO:teuthology.orchestra.run.smithi145.stdout:(7/13): crun-1.8.7-1.module+el8.9.0+21243+a5865 2.2 MB/s | 239 kB 00:00 2024-04-01T06:44:51.782 INFO:teuthology.orchestra.run.smithi083.stdout:(3/13): python3-pyxdg-0.25-16.el8.noarch.rpm 448 kB/s | 94 kB 00:00 2024-04-01T06:44:51.830 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-04-01T06:44:51.851 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-04-01T06:44:51.851 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-04-01T06:44:51.871 INFO:teuthology.orchestra.run.smithi145.stdout:(8/13): buildah-1.31.3-3.module+el8.9.0+21243+a 22 MB/s | 8.8 MB 00:00 2024-04-01T06:44:51.883 INFO:teuthology.orchestra.run.smithi083.stdout:(4/13): yajl-2.1.0-12.el8.x86_64.rpm 258 kB/s | 41 kB 00:00 2024-04-01T06:44:51.921 INFO:teuthology.orchestra.run.smithi145.stdout:(9/13): python3-podman-4.6.0-2.module+el8.9.0+2 920 kB/s | 154 kB 00:00 2024-04-01T06:44:51.983 INFO:teuthology.orchestra.run.smithi083.stdout:(5/13): aardvark-dns-1.7.0-1.module+el8.9.0+212 4.3 MB/s | 1.0 MB 00:00 2024-04-01T06:44:52.013 INFO:teuthology.orchestra.run.smithi145.stdout:(10/13): netavark-1.7.0-2.module+el8.9.0+21243+ 13 MB/s | 3.7 MB 00:00 2024-04-01T06:44:52.081 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-04-01T06:44:52.089 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-04-01T06:44:52.091 INFO:teuthology.orchestra.run.smithi083.stdout:(6/13): crun-1.8.7-1.module+el8.9.0+21243+a5865 2.2 MB/s | 239 kB 00:00 2024-04-01T06:44:52.133 INFO:teuthology.orchestra.run.smithi083.stdout:(7/13): cockpit-podman-75-1.module+el8.9.0+2124 2.9 MB/s | 739 kB 00:00 2024-04-01T06:44:52.147 INFO:teuthology.orchestra.run.smithi145.stdout:(11/13): toolbox-0.0.99.4-5.module+el8.9.0+2124 11 MB/s | 2.5 MB 00:00 2024-04-01T06:44:52.172 INFO:teuthology.orchestra.run.smithi145.stdout:(12/13): udica-0.2.6-20.module+el8.9.0+21243+a5 312 kB/s | 49 kB 00:00 2024-04-01T06:44:52.272 INFO:teuthology.orchestra.run.smithi145.stdout:(13/13): skopeo-1.13.3-3.module+el8.9.0+21243+a 20 MB/s | 8.1 MB 00:00 2024-04-01T06:44:52.273 INFO:teuthology.orchestra.run.smithi145.stdout:-------------------------------------------------------------------------------- 2024-04-01T06:44:52.273 INFO:teuthology.orchestra.run.smithi145.stdout:Total 24 MB/s | 26 MB 00:01 2024-04-01T06:44:52.284 INFO:teuthology.orchestra.run.smithi083.stdout:(8/13): buildah-1.31.3-3.module+el8.9.0+21243+a 18 MB/s | 8.8 MB 00:00 2024-04-01T06:44:52.334 INFO:teuthology.orchestra.run.smithi083.stdout:(9/13): python3-podman-4.6.0-2.module+el8.9.0+2 766 kB/s | 154 kB 00:00 2024-04-01T06:44:52.418 INFO:teuthology.orchestra.run.smithi083.stdout:(10/13): netavark-1.7.0-2.module+el8.9.0+21243+ 11 MB/s | 3.7 MB 00:00 2024-04-01T06:44:52.543 INFO:teuthology.orchestra.run.smithi083.stdout:(11/13): toolbox-0.0.99.4-5.module+el8.9.0+2124 12 MB/s | 2.5 MB 00:00 2024-04-01T06:44:52.557 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction check 2024-04-01T06:44:52.568 INFO:teuthology.orchestra.run.smithi083.stdout:(12/13): udica-0.2.6-20.module+el8.9.0+21243+a5 329 kB/s | 49 kB 00:00 2024-04-01T06:44:52.578 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction check succeeded. 2024-04-01T06:44:52.578 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction test 2024-04-01T06:44:52.697 INFO:teuthology.orchestra.run.smithi083.stdout:(13/13): skopeo-1.13.3-3.module+el8.9.0+21243+a 20 MB/s | 8.1 MB 00:00 2024-04-01T06:44:52.698 INFO:teuthology.orchestra.run.smithi083.stdout:-------------------------------------------------------------------------------- 2024-04-01T06:44:52.698 INFO:teuthology.orchestra.run.smithi083.stdout:Total 23 MB/s | 26 MB 00:01 2024-04-01T06:44:52.799 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-04-01T06:44:52.809 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction test succeeded. 2024-04-01T06:44:52.818 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction 2024-04-01T06:44:52.980 INFO:teuthology.orchestra.run.smithi083.stdout:Running transaction check 2024-04-01T06:44:53.001 INFO:teuthology.orchestra.run.smithi083.stdout:Transaction check succeeded. 2024-04-01T06:44:53.001 INFO:teuthology.orchestra.run.smithi083.stdout:Running transaction test 2024-04-01T06:44:53.230 INFO:teuthology.orchestra.run.smithi083.stdout:Transaction test succeeded. 2024-04-01T06:44:53.239 INFO:teuthology.orchestra.run.smithi083.stdout:Running transaction 2024-04-01T06:44:53.307 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : aardvark-dns-2:1.7.0-1.module+el8.9.0+21243+a58653 1/13 2024-04-01T06:44:53.503 INFO:teuthology.orchestra.run.smithi145.stdout: Preparing : 1/1 2024-04-01T06:44:53.544 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : netavark-2:1.7.0-2.module+el8.9.0+21243+a586538b.x 2/13 2024-04-01T06:44:53.747 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : yajl-2.1.0-12.el8.x86_64 3/13 2024-04-01T06:44:53.900 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 4/13 2024-04-01T06:44:53.932 INFO:teuthology.orchestra.run.smithi083.stdout: Preparing : 1/1 2024-04-01T06:44:53.995 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : aardvark-dns-2:1.7.0-1.module+el8.9.0+21243+a58653 1/13 2024-04-01T06:44:54.094 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 5/13 2024-04-01T06:44:54.171 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : netavark-2:1.7.0-2.module+el8.9.0+21243+a586538b.x 2/13 2024-04-01T06:44:54.296 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 6/13 2024-04-01T06:44:54.326 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : yajl-2.1.0-12.el8.x86_64 3/13 2024-04-01T06:44:54.419 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : aardvark-dns-2:1.7.0-1.module+el8.9.0+21243+a58653 1/13 2024-04-01T06:44:54.494 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 4/13 2024-04-01T06:44:54.547 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-podman-4.6.0-2.module+el8.9.0+21243+a58653 7/13 2024-04-01T06:44:54.595 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : netavark-2:1.7.0-2.module+el8.9.0+21243+a586538b.x 2/13 2024-04-01T06:44:54.707 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 5/13 2024-04-01T06:44:54.784 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : yajl-2.1.0-12.el8.x86_64 3/13 2024-04-01T06:44:54.891 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 6/13 2024-04-01T06:44:54.943 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 4/13 2024-04-01T06:44:55.109 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-podman-4.6.0-2.module+el8.9.0+21243+a58653 7/13 2024-04-01T06:44:55.138 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 5/13 2024-04-01T06:44:55.348 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 6/13 2024-04-01T06:44:55.439 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : crun-1.8.7-1.module+el8.9.0+21243+a586538b.x86_64 8/13 2024-04-01T06:44:55.617 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-podman-4.6.0-2.module+el8.9.0+21243+a58653 7/13 2024-04-01T06:44:55.682 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : buildah-1:1.31.3-3.module+el8.9.0+21243+a586538b.x 9/13 2024-04-01T06:44:56.003 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : crun-1.8.7-1.module+el8.9.0+21243+a586538b.x86_64 8/13 2024-04-01T06:44:56.056 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : udica-0.2.6-20.module+el8.9.0+21243+a586538b.noarc 10/13 2024-04-01T06:44:56.226 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : buildah-1:1.31.3-3.module+el8.9.0+21243+a586538b.x 9/13 2024-04-01T06:44:56.491 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : crun-1.8.7-1.module+el8.9.0+21243+a586538b.x86_64 8/13 2024-04-01T06:44:56.626 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : udica-0.2.6-20.module+el8.9.0+21243+a586538b.noarc 10/13 2024-04-01T06:44:56.733 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : buildah-1:1.31.3-3.module+el8.9.0+21243+a586538b.x 9/13 2024-04-01T06:44:56.938 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : toolbox-0.0.99.4-5.module+el8.9.0+21243+a586538b.x 11/13 2024-04-01T06:44:57.101 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : udica-0.2.6-20.module+el8.9.0+21243+a586538b.noarc 10/13 2024-04-01T06:44:57.192 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : skopeo-2:1.13.3-3.module+el8.9.0+21243+a586538b.x8 12/13 2024-04-01T06:44:57.367 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : cockpit-podman-75-1.module+el8.9.0+21243+a586538b. 13/13 2024-04-01T06:44:57.502 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : toolbox-0.0.99.4-5.module+el8.9.0+21243+a586538b.x 11/13 2024-04-01T06:44:57.722 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : skopeo-2:1.13.3-3.module+el8.9.0+21243+a586538b.x8 12/13 2024-04-01T06:44:57.811 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: cockpit-podman-75-1.module+el8.9.0+21243+a586538b. 13/13 2024-04-01T06:44:57.812 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/13 2024-04-01T06:44:57.812 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 2/13 2024-04-01T06:44:57.812 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 3/13 2024-04-01T06:44:57.812 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 4/13 2024-04-01T06:44:57.812 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : aardvark-dns-2:1.7.0-1.module+el8.9.0+21243+a58653 5/13 2024-04-01T06:44:57.812 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : buildah-1:1.31.3-3.module+el8.9.0+21243+a586538b.x 6/13 2024-04-01T06:44:57.812 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : cockpit-podman-75-1.module+el8.9.0+21243+a586538b. 7/13 2024-04-01T06:44:57.812 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : crun-1.8.7-1.module+el8.9.0+21243+a586538b.x86_64 8/13 2024-04-01T06:44:57.812 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : netavark-2:1.7.0-2.module+el8.9.0+21243+a586538b.x 9/13 2024-04-01T06:44:57.812 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-podman-4.6.0-2.module+el8.9.0+21243+a58653 10/13 2024-04-01T06:44:57.812 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : skopeo-2:1.13.3-3.module+el8.9.0+21243+a586538b.x8 11/13 2024-04-01T06:44:57.812 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : toolbox-0.0.99.4-5.module+el8.9.0+21243+a586538b.x 12/13 2024-04-01T06:44:57.913 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : cockpit-podman-75-1.module+el8.9.0+21243+a586538b. 13/13 2024-04-01T06:44:58.002 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : toolbox-0.0.99.4-5.module+el8.9.0+21243+a586538b.x 11/13 2024-04-01T06:44:58.246 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : skopeo-2:1.13.3-3.module+el8.9.0+21243+a586538b.x8 12/13 2024-04-01T06:44:58.343 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: cockpit-podman-75-1.module+el8.9.0+21243+a586538b. 13/13 2024-04-01T06:44:58.343 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/13 2024-04-01T06:44:58.343 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 2/13 2024-04-01T06:44:58.343 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 3/13 2024-04-01T06:44:58.343 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 4/13 2024-04-01T06:44:58.343 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : aardvark-dns-2:1.7.0-1.module+el8.9.0+21243+a58653 5/13 2024-04-01T06:44:58.344 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : buildah-1:1.31.3-3.module+el8.9.0+21243+a586538b.x 6/13 2024-04-01T06:44:58.344 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : cockpit-podman-75-1.module+el8.9.0+21243+a586538b. 7/13 2024-04-01T06:44:58.344 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : crun-1.8.7-1.module+el8.9.0+21243+a586538b.x86_64 8/13 2024-04-01T06:44:58.344 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : netavark-2:1.7.0-2.module+el8.9.0+21243+a586538b.x 9/13 2024-04-01T06:44:58.344 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-podman-4.6.0-2.module+el8.9.0+21243+a58653 10/13 2024-04-01T06:44:58.344 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : skopeo-2:1.13.3-3.module+el8.9.0+21243+a586538b.x8 11/13 2024-04-01T06:44:58.344 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : toolbox-0.0.99.4-5.module+el8.9.0+21243+a586538b.x 12/13 2024-04-01T06:44:58.412 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : cockpit-podman-75-1.module+el8.9.0+21243+a586538b. 13/13 2024-04-01T06:44:58.825 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: cockpit-podman-75-1.module+el8.9.0+21243+a586538b. 13/13 2024-04-01T06:44:58.825 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/13 2024-04-01T06:44:58.826 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 2/13 2024-04-01T06:44:58.826 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 3/13 2024-04-01T06:44:58.826 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 4/13 2024-04-01T06:44:58.826 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : aardvark-dns-2:1.7.0-1.module+el8.9.0+21243+a58653 5/13 2024-04-01T06:44:58.826 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : buildah-1:1.31.3-3.module+el8.9.0+21243+a586538b.x 6/13 2024-04-01T06:44:58.826 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : cockpit-podman-75-1.module+el8.9.0+21243+a586538b. 7/13 2024-04-01T06:44:58.826 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : crun-1.8.7-1.module+el8.9.0+21243+a586538b.x86_64 8/13 2024-04-01T06:44:58.827 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : netavark-2:1.7.0-2.module+el8.9.0+21243+a586538b.x 9/13 2024-04-01T06:44:58.827 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-podman-4.6.0-2.module+el8.9.0+21243+a58653 10/13 2024-04-01T06:44:58.827 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : skopeo-2:1.13.3-3.module+el8.9.0+21243+a586538b.x8 11/13 2024-04-01T06:44:58.827 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : toolbox-0.0.99.4-5.module+el8.9.0+21243+a586538b.x 12/13 2024-04-01T06:45:05.387 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : udica-0.2.6-20.module+el8.9.0+21243+a586538b.noarc 13/13 2024-04-01T06:45:05.387 INFO:teuthology.orchestra.run.smithi145.stdout:Installed products updated. 2024-04-01T06:45:05.970 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-01T06:45:05.970 INFO:teuthology.orchestra.run.smithi145.stdout:Installed: 2024-04-01T06:45:05.970 INFO:teuthology.orchestra.run.smithi145.stdout: aardvark-dns-2:1.7.0-1.module+el8.9.0+21243+a586538b.x86_64 2024-04-01T06:45:05.970 INFO:teuthology.orchestra.run.smithi145.stdout: buildah-1:1.31.3-3.module+el8.9.0+21243+a586538b.x86_64 2024-04-01T06:45:05.970 INFO:teuthology.orchestra.run.smithi145.stdout: cockpit-podman-75-1.module+el8.9.0+21243+a586538b.noarch 2024-04-01T06:45:05.970 INFO:teuthology.orchestra.run.smithi145.stdout: criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86_64 2024-04-01T06:45:05.970 INFO:teuthology.orchestra.run.smithi145.stdout: crun-1.8.7-1.module+el8.9.0+21243+a586538b.x86_64 2024-04-01T06:45:05.970 INFO:teuthology.orchestra.run.smithi145.stdout: netavark-2:1.7.0-2.module+el8.9.0+21243+a586538b.x86_64 2024-04-01T06:45:05.970 INFO:teuthology.orchestra.run.smithi145.stdout: python3-podman-4.6.0-2.module+el8.9.0+21243+a586538b.noarch 2024-04-01T06:45:05.971 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2024-04-01T06:45:05.971 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyxdg-0.25-16.el8.noarch 2024-04-01T06:45:05.971 INFO:teuthology.orchestra.run.smithi145.stdout: skopeo-2:1.13.3-3.module+el8.9.0+21243+a586538b.x86_64 2024-04-01T06:45:05.971 INFO:teuthology.orchestra.run.smithi145.stdout: toolbox-0.0.99.4-5.module+el8.9.0+21243+a586538b.x86_64 2024-04-01T06:45:05.971 INFO:teuthology.orchestra.run.smithi145.stdout: udica-0.2.6-20.module+el8.9.0+21243+a586538b.noarch 2024-04-01T06:45:05.971 INFO:teuthology.orchestra.run.smithi145.stdout: yajl-2.1.0-12.el8.x86_64 2024-04-01T06:45:05.971 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-01T06:45:05.971 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-04-01T06:45:06.116 DEBUG:teuthology.parallel:result is None 2024-04-01T06:45:06.327 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : udica-0.2.6-20.module+el8.9.0+21243+a586538b.noarc 13/13 2024-04-01T06:45:06.327 INFO:teuthology.orchestra.run.smithi083.stdout:Installed products updated. 2024-04-01T06:45:06.339 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : udica-0.2.6-20.module+el8.9.0+21243+a586538b.noarc 13/13 2024-04-01T06:45:06.339 INFO:teuthology.orchestra.run.smithi153.stdout:Installed products updated. 2024-04-01T06:45:06.881 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:45:06.881 INFO:teuthology.orchestra.run.smithi083.stdout:Installed: 2024-04-01T06:45:06.881 INFO:teuthology.orchestra.run.smithi083.stdout: aardvark-dns-2:1.7.0-1.module+el8.9.0+21243+a586538b.x86_64 2024-04-01T06:45:06.881 INFO:teuthology.orchestra.run.smithi083.stdout: buildah-1:1.31.3-3.module+el8.9.0+21243+a586538b.x86_64 2024-04-01T06:45:06.881 INFO:teuthology.orchestra.run.smithi083.stdout: cockpit-podman-75-1.module+el8.9.0+21243+a586538b.noarch 2024-04-01T06:45:06.881 INFO:teuthology.orchestra.run.smithi083.stdout: criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86_64 2024-04-01T06:45:06.881 INFO:teuthology.orchestra.run.smithi083.stdout: crun-1.8.7-1.module+el8.9.0+21243+a586538b.x86_64 2024-04-01T06:45:06.881 INFO:teuthology.orchestra.run.smithi083.stdout: netavark-2:1.7.0-2.module+el8.9.0+21243+a586538b.x86_64 2024-04-01T06:45:06.881 INFO:teuthology.orchestra.run.smithi083.stdout: python3-podman-4.6.0-2.module+el8.9.0+21243+a586538b.noarch 2024-04-01T06:45:06.881 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2024-04-01T06:45:06.882 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyxdg-0.25-16.el8.noarch 2024-04-01T06:45:06.882 INFO:teuthology.orchestra.run.smithi083.stdout: skopeo-2:1.13.3-3.module+el8.9.0+21243+a586538b.x86_64 2024-04-01T06:45:06.882 INFO:teuthology.orchestra.run.smithi083.stdout: toolbox-0.0.99.4-5.module+el8.9.0+21243+a586538b.x86_64 2024-04-01T06:45:06.882 INFO:teuthology.orchestra.run.smithi083.stdout: udica-0.2.6-20.module+el8.9.0+21243+a586538b.noarch 2024-04-01T06:45:06.882 INFO:teuthology.orchestra.run.smithi083.stdout: yajl-2.1.0-12.el8.x86_64 2024-04-01T06:45:06.882 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:45:06.882 INFO:teuthology.orchestra.run.smithi083.stdout:Complete! 2024-04-01T06:45:06.903 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-01T06:45:06.903 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-04-01T06:45:06.903 INFO:teuthology.orchestra.run.smithi153.stdout: aardvark-dns-2:1.7.0-1.module+el8.9.0+21243+a586538b.x86_64 2024-04-01T06:45:06.903 INFO:teuthology.orchestra.run.smithi153.stdout: buildah-1:1.31.3-3.module+el8.9.0+21243+a586538b.x86_64 2024-04-01T06:45:06.903 INFO:teuthology.orchestra.run.smithi153.stdout: cockpit-podman-75-1.module+el8.9.0+21243+a586538b.noarch 2024-04-01T06:45:06.903 INFO:teuthology.orchestra.run.smithi153.stdout: criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86_64 2024-04-01T06:45:06.904 INFO:teuthology.orchestra.run.smithi153.stdout: crun-1.8.7-1.module+el8.9.0+21243+a586538b.x86_64 2024-04-01T06:45:06.904 INFO:teuthology.orchestra.run.smithi153.stdout: netavark-2:1.7.0-2.module+el8.9.0+21243+a586538b.x86_64 2024-04-01T06:45:06.904 INFO:teuthology.orchestra.run.smithi153.stdout: python3-podman-4.6.0-2.module+el8.9.0+21243+a586538b.noarch 2024-04-01T06:45:06.904 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2024-04-01T06:45:06.904 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyxdg-0.25-16.el8.noarch 2024-04-01T06:45:06.904 INFO:teuthology.orchestra.run.smithi153.stdout: skopeo-2:1.13.3-3.module+el8.9.0+21243+a586538b.x86_64 2024-04-01T06:45:06.904 INFO:teuthology.orchestra.run.smithi153.stdout: toolbox-0.0.99.4-5.module+el8.9.0+21243+a586538b.x86_64 2024-04-01T06:45:06.904 INFO:teuthology.orchestra.run.smithi153.stdout: udica-0.2.6-20.module+el8.9.0+21243+a586538b.noarch 2024-04-01T06:45:06.904 INFO:teuthology.orchestra.run.smithi153.stdout: yajl-2.1.0-12.el8.x86_64 2024-04-01T06:45:06.904 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-01T06:45:06.904 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-04-01T06:45:07.035 DEBUG:teuthology.parallel:result is None 2024-04-01T06:45:07.047 DEBUG:teuthology.parallel:result is None 2024-04-01T06:45:07.047 INFO:teuthology.run_tasks:Running task install... 2024-04-01T06:45:07.062 DEBUG:teuthology.task.install:project ceph 2024-04-01T06:45:07.062 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12'}} 2024-04-01T06:45:07.062 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12'} 2024-04-01T06:45:07.062 INFO:teuthology.task.install:Using flavor: default 2024-04-01T06:45:07.076 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-01T06:45:07.077 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-04-01T06:45:07.077 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12', 'tag': None, 'wait_for_package': False} 2024-04-01T06:45:07.078 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 2024-04-01T06:45:07.081 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12', 'tag': None, 'wait_for_package': False} 2024-04-01T06:45:07.081 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 2024-04-01T06:45:07.082 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12', 'tag': None, 'wait_for_package': False} 2024-04-01T06:45:07.083 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 2024-04-01T06:45:07.240 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/reef/9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12/centos/8/flavors/default/ 2024-04-01T06:45:07.240 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1001.g9d2ee692 2024-04-01T06:45:07.250 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/reef/9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12/centos/8/flavors/default/ 2024-04-01T06:45:07.250 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1001.g9d2ee692 2024-04-01T06:45:07.255 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/reef/9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12/centos/8/flavors/default/ 2024-04-01T06:45:07.255 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1001.g9d2ee692 2024-04-01T06:45:07.361 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/reef/9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-01T06:45:07.362 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-04-01T06:45:07.362 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-01T06:45:07.396 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-01T06:45:07.396 DEBUG:teuthology.orchestra.run.smithi145:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-01T06:45:07.425 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/reef/9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-01T06:45:07.426 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-04-01T06:45:07.426 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-01T06:45:07.429 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/reef/9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-01T06:45:07.429 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-04-01T06:45:07.430 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-01T06:45:07.457 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-01T06:45:07.458 DEBUG:teuthology.orchestra.run.smithi083:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-01T06:45:07.459 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-01T06:45:07.459 DEBUG:teuthology.orchestra.run.smithi153:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-01T06:45:07.468 DEBUG:teuthology.orchestra.run.smithi145:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-01T06:45:07.525 DEBUG:teuthology.orchestra.run.smithi083:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-01T06:45:07.528 DEBUG:teuthology.orchestra.run.smithi153:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-01T06:45:07.548 DEBUG:teuthology.orchestra.run.smithi145:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-01T06:45:07.602 DEBUG:teuthology.orchestra.run.smithi083:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-01T06:45:07.606 DEBUG:teuthology.orchestra.run.smithi153:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-01T06:45:07.617 INFO:teuthology.orchestra.run.smithi145.stdout:check_obsoletes = 1 2024-04-01T06:45:07.618 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum clean all 2024-04-01T06:45:07.668 INFO:teuthology.orchestra.run.smithi083.stdout:check_obsoletes = 1 2024-04-01T06:45:07.669 DEBUG:teuthology.orchestra.run.smithi083:> sudo yum clean all 2024-04-01T06:45:07.672 INFO:teuthology.orchestra.run.smithi153.stdout:check_obsoletes = 1 2024-04-01T06:45:07.674 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum clean all 2024-04-01T06:45:07.998 INFO:teuthology.orchestra.run.smithi145.stdout:Updating Subscription Management repositories. 2024-04-01T06:45:08.047 INFO:teuthology.orchestra.run.smithi083.stdout:Updating Subscription Management repositories. 2024-04-01T06:45:08.051 INFO:teuthology.orchestra.run.smithi153.stdout:Updating Subscription Management repositories. 2024-04-01T06:45:09.273 INFO:teuthology.orchestra.run.smithi145.stdout:61 files removed 2024-04-01T06:45:09.326 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-01T06:45:09.383 INFO:teuthology.orchestra.run.smithi083.stdout:61 files removed 2024-04-01T06:45:09.400 INFO:teuthology.orchestra.run.smithi153.stdout:61 files removed 2024-04-01T06:45:09.435 DEBUG:teuthology.orchestra.run.smithi083:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-01T06:45:09.459 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-01T06:45:09.664 INFO:teuthology.orchestra.run.smithi145.stdout:Updating Subscription Management repositories. 2024-04-01T06:45:09.771 INFO:teuthology.orchestra.run.smithi083.stdout:Updating Subscription Management repositories. 2024-04-01T06:45:09.799 INFO:teuthology.orchestra.run.smithi153.stdout:Updating Subscription Management repositories. 2024-04-01T06:45:11.424 INFO:teuthology.orchestra.run.smithi153.stdout:ceph packages for x86_64 225 kB/s | 80 kB 00:00 2024-04-01T06:45:11.479 INFO:teuthology.orchestra.run.smithi145.stdout:ceph packages for x86_64 261 kB/s | 80 kB 00:00 2024-04-01T06:45:11.508 INFO:teuthology.orchestra.run.smithi083.stdout:ceph packages for x86_64 217 kB/s | 80 kB 00:00 2024-04-01T06:45:11.816 INFO:teuthology.orchestra.run.smithi153.stdout:ceph noarch packages 28 kB/s | 9.9 kB 00:00 2024-04-01T06:45:11.817 INFO:teuthology.orchestra.run.smithi083.stdout:ceph noarch packages 36 kB/s | 9.9 kB 00:00 2024-04-01T06:45:11.863 INFO:teuthology.orchestra.run.smithi145.stdout:ceph noarch packages 28 kB/s | 9.9 kB 00:00 2024-04-01T06:45:12.177 INFO:teuthology.orchestra.run.smithi083.stdout:ceph source packages 4.5 kB/s | 1.5 kB 00:00 2024-04-01T06:45:12.230 INFO:teuthology.orchestra.run.smithi145.stdout:ceph source packages 4.4 kB/s | 1.5 kB 00:00 2024-04-01T06:45:12.234 INFO:teuthology.orchestra.run.smithi153.stdout:ceph source packages 3.8 kB/s | 1.5 kB 00:00 2024-04-01T06:45:12.319 INFO:teuthology.orchestra.run.smithi083.stdout:Copr repo for python3-asyncssh owned by ceph 29 kB/s | 3.5 kB 00:00 2024-04-01T06:45:12.384 INFO:teuthology.orchestra.run.smithi153.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2024-04-01T06:45:12.389 INFO:teuthology.orchestra.run.smithi145.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2024-04-01T06:45:13.249 INFO:teuthology.orchestra.run.smithi145.stdout:Extra Packages for Enterprise Linux 19 MB/s | 16 MB 00:00 2024-04-01T06:45:13.447 INFO:teuthology.orchestra.run.smithi083.stdout:Extra Packages for Enterprise Linux 15 MB/s | 16 MB 00:01 2024-04-01T06:45:13.902 INFO:teuthology.orchestra.run.smithi153.stdout:Extra Packages for Enterprise Linux 11 MB/s | 16 MB 00:01 2024-04-01T06:45:16.898 INFO:teuthology.orchestra.run.smithi145.stdout:lab-extras 546 kB/s | 24 kB 00:00 2024-04-01T06:45:16.987 INFO:teuthology.orchestra.run.smithi083.stdout:lab-extras 442 kB/s | 24 kB 00:00 2024-04-01T06:45:17.469 INFO:teuthology.orchestra.run.smithi153.stdout:lab-extras 421 kB/s | 24 kB 00:00 2024-04-01T06:45:17.642 INFO:teuthology.orchestra.run.smithi145.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 13 MB/s | 8.8 MB 00:00 2024-04-01T06:45:17.789 INFO:teuthology.orchestra.run.smithi083.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 12 MB/s | 8.8 MB 00:00 2024-04-01T06:45:18.120 INFO:teuthology.orchestra.run.smithi153.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 15 MB/s | 8.8 MB 00:00 2024-04-01T06:45:20.718 INFO:teuthology.orchestra.run.smithi145.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 43 MB/s | 66 MB 00:01 2024-04-01T06:45:20.765 INFO:teuthology.orchestra.run.smithi083.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 46 MB/s | 66 MB 00:01 2024-04-01T06:45:20.980 INFO:teuthology.orchestra.run.smithi153.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 49 MB/s | 66 MB 00:01 2024-04-01T06:45:31.589 INFO:teuthology.orchestra.run.smithi153.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 48 MB/s | 60 MB 00:01 2024-04-01T06:45:31.719 INFO:teuthology.orchestra.run.smithi145.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 48 MB/s | 60 MB 00:01 2024-04-01T06:45:31.999 INFO:teuthology.orchestra.run.smithi083.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 60 MB/s | 60 MB 00:01 2024-04-01T06:45:47.085 INFO:teuthology.orchestra.run.smithi153.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-01T06:45:47.086 INFO:teuthology.orchestra.run.smithi153.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-01T06:45:47.105 INFO:teuthology.orchestra.run.smithi153.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2024-04-01T06:45:47.106 INFO:teuthology.orchestra.run.smithi153.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2024-04-01T06:45:47.108 INFO:teuthology.orchestra.run.smithi153.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2024-04-01T06:45:47.109 INFO:teuthology.orchestra.run.smithi153.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2024-04-01T06:45:47.112 INFO:teuthology.orchestra.run.smithi153.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2024-04-01T06:45:47.116 INFO:teuthology.orchestra.run.smithi153.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2024-04-01T06:45:47.118 INFO:teuthology.orchestra.run.smithi153.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2024-04-01T06:45:47.340 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-04-01T06:45:47.354 INFO:teuthology.orchestra.run.smithi153.stdout:=================================================================================================================================== 2024-04-01T06:45:47.355 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2024-04-01T06:45:47.355 INFO:teuthology.orchestra.run.smithi153.stdout:=================================================================================================================================== 2024-04-01T06:45:47.355 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-04-01T06:45:47.355 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-13.el8_9 rhel-8-for-x86_64-baseos-rpms 144 k 2024-04-01T06:45:47.355 INFO:teuthology.orchestra.run.smithi153.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2024-04-01T06:45:47.355 INFO:teuthology.orchestra.run.smithi153.stdout: ceph x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 6.4 k 2024-04-01T06:45:47.355 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-base x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 5.5 M 2024-04-01T06:45:47.355 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-fuse x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 854 k 2024-04-01T06:45:47.355 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 165 k 2024-04-01T06:45:47.355 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 1.6 M 2024-04-01T06:45:47.355 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1001.g9d2ee692.el8 ceph-noarch 138 k 2024-04-01T06:45:47.356 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1001.g9d2ee692.el8 ceph-noarch 1.8 M 2024-04-01T06:45:47.356 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1001.g9d2ee692.el8 ceph-noarch 7.4 M 2024-04-01T06:45:47.356 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-rook noarch 2:18.2.2-1001.g9d2ee692.el8 ceph-noarch 49 k 2024-04-01T06:45:47.356 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-radosgw x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 13 M 2024-04-01T06:45:47.356 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-test x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 47 M 2024-04-01T06:45:47.356 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-volume noarch 2:18.2.2-1001.g9d2ee692.el8 ceph-noarch 263 k 2024-04-01T06:45:47.356 INFO:teuthology.orchestra.run.smithi153.stdout: cephadm noarch 2:18.2.2-1001.g9d2ee692.el8 ceph-noarch 170 k 2024-04-01T06:45:47.356 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-mirror x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 261 k 2024-04-01T06:45:47.356 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-top noarch 2:18.2.2-1001.g9d2ee692.el8 ceph-noarch 18 k 2024-04-01T06:45:47.356 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2024-04-01T06:45:47.356 INFO:teuthology.orchestra.run.smithi153.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2024-04-01T06:45:47.356 INFO:teuthology.orchestra.run.smithi153.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2024-04-01T06:45:47.356 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs-devel x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 31 k 2024-04-01T06:45:47.357 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs2 x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 775 k 2024-04-01T06:45:47.357 INFO:teuthology.orchestra.run.smithi153.stdout: librados-devel x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 139 k 2024-04-01T06:45:47.357 INFO:teuthology.orchestra.run.smithi153.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2024-04-01T06:45:47.357 INFO:teuthology.orchestra.run.smithi153.stdout: libuuid-devel x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 100 k 2024-04-01T06:45:47.357 INFO:teuthology.orchestra.run.smithi153.stdout: openssl-devel x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 2.3 M 2024-04-01T06:45:47.357 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 1.5 M 2024-04-01T06:45:47.357 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-contrib x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 812 k 2024-04-01T06:45:47.357 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-server x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 5.1 M 2024-04-01T06:45:47.357 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cephfs x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 197 k 2024-04-01T06:45:47.357 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rados x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 370 k 2024-04-01T06:45:47.357 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rbd x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 364 k 2024-04-01T06:45:47.357 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rgw x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 106 k 2024-04-01T06:45:47.357 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-fuse x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 95 k 2024-04-01T06:45:47.357 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-mirror x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 3.5 M 2024-04-01T06:45:47.358 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-nbd x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 182 k 2024-04-01T06:45:47.358 INFO:teuthology.orchestra.run.smithi153.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2024-04-01T06:45:47.358 INFO:teuthology.orchestra.run.smithi153.stdout:Upgrading: 2024-04-01T06:45:47.358 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2024-04-01T06:45:47.358 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2024-04-01T06:45:47.358 INFO:teuthology.orchestra.run.smithi153.stdout: iproute x86_64 6.2.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 854 k 2024-04-01T06:45:47.358 INFO:teuthology.orchestra.run.smithi153.stdout: libblkid x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2024-04-01T06:45:47.358 INFO:teuthology.orchestra.run.smithi153.stdout: libfdisk x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 254 k 2024-04-01T06:45:47.362 INFO:teuthology.orchestra.run.smithi153.stdout: libmount x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 237 k 2024-04-01T06:45:47.362 INFO:teuthology.orchestra.run.smithi153.stdout: librados2 x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 3.7 M 2024-04-01T06:45:47.362 INFO:teuthology.orchestra.run.smithi153.stdout: librbd1 x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 3.6 M 2024-04-01T06:45:47.362 INFO:teuthology.orchestra.run.smithi153.stdout: libsmartcols x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 179 k 2024-04-01T06:45:47.363 INFO:teuthology.orchestra.run.smithi153.stdout: libuuid x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 99 k 2024-04-01T06:45:47.363 INFO:teuthology.orchestra.run.smithi153.stdout: openssl x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 711 k 2024-04-01T06:45:47.363 INFO:teuthology.orchestra.run.smithi153.stdout: openssl-libs x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 1.5 M 2024-04-01T06:45:47.363 INFO:teuthology.orchestra.run.smithi153.stdout: util-linux x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 2.5 M 2024-04-01T06:45:47.363 INFO:teuthology.orchestra.run.smithi153.stdout: util-linux-user x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 103 k 2024-04-01T06:45:47.363 INFO:teuthology.orchestra.run.smithi153.stdout: xfsdump x86_64 3.1.8-7.el8_9 rhel-8-for-x86_64-baseos-rpms 333 k 2024-04-01T06:45:47.363 INFO:teuthology.orchestra.run.smithi153.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2024-04-01T06:45:47.363 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2024-04-01T06:45:47.363 INFO:teuthology.orchestra.run.smithi153.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2024-04-01T06:45:47.363 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-common x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 22 M 2024-04-01T06:45:47.363 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1001.g9d2ee692.el8 ceph-noarch 23 k 2024-04-01T06:45:47.364 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mds x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 2.3 M 2024-04-01T06:45:47.364 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1001.g9d2ee692.el8 ceph-noarch 245 k 2024-04-01T06:45:47.364 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mon x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 4.8 M 2024-04-01T06:45:47.364 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-osd x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 18 M 2024-04-01T06:45:47.364 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1001.g9d2ee692.el8 ceph-noarch 15 k 2024-04-01T06:45:47.364 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-selinux x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 24 k 2024-04-01T06:45:47.364 INFO:teuthology.orchestra.run.smithi153.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2024-04-01T06:45:47.364 INFO:teuthology.orchestra.run.smithi153.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-04-01T06:45:47.364 INFO:teuthology.orchestra.run.smithi153.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2024-04-01T06:45:47.364 INFO:teuthology.orchestra.run.smithi153.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2024-04-01T06:45:47.364 INFO:teuthology.orchestra.run.smithi153.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2024-04-01T06:45:47.364 INFO:teuthology.orchestra.run.smithi153.stdout: libcephsqlite x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 142 k 2024-04-01T06:45:47.365 INFO:teuthology.orchestra.run.smithi153.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2024-04-01T06:45:47.365 INFO:teuthology.orchestra.run.smithi153.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2024-04-01T06:45:47.365 INFO:teuthology.orchestra.run.smithi153.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-04-01T06:45:47.365 INFO:teuthology.orchestra.run.smithi153.stdout: libpq x86_64 13.11-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2024-04-01T06:45:47.365 INFO:teuthology.orchestra.run.smithi153.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2024-04-01T06:45:47.365 INFO:teuthology.orchestra.run.smithi153.stdout: librabbitmq x86_64 0.9.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 47 k 2024-04-01T06:45:47.365 INFO:teuthology.orchestra.run.smithi153.stdout: libradosstriper1 x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 475 k 2024-04-01T06:45:47.365 INFO:teuthology.orchestra.run.smithi153.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2024-04-01T06:45:47.365 INFO:teuthology.orchestra.run.smithi153.stdout: librgw2 x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 6.5 M 2024-04-01T06:45:47.365 INFO:teuthology.orchestra.run.smithi153.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2024-04-01T06:45:47.365 INFO:teuthology.orchestra.run.smithi153.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2024-04-01T06:45:47.365 INFO:teuthology.orchestra.run.smithi153.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-04-01T06:45:47.365 INFO:teuthology.orchestra.run.smithi153.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2024-04-01T06:45:47.365 INFO:teuthology.orchestra.run.smithi153.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2024-04-01T06:45:47.366 INFO:teuthology.orchestra.run.smithi153.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2024-04-01T06:45:47.366 INFO:teuthology.orchestra.run.smithi153.stdout: oniguruma x86_64 6.8.2-2.1.el8_9 rhel-8-for-x86_64-appstream-rpms 188 k 2024-04-01T06:45:47.366 INFO:teuthology.orchestra.run.smithi153.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2024-04-01T06:45:47.366 INFO:teuthology.orchestra.run.smithi153.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2024-04-01T06:45:47.366 INFO:teuthology.orchestra.run.smithi153.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2024-04-01T06:45:47.366 INFO:teuthology.orchestra.run.smithi153.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2024-04-01T06:45:47.366 INFO:teuthology.orchestra.run.smithi153.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2024-04-01T06:45:47.366 INFO:teuthology.orchestra.run.smithi153.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-04-01T06:45:47.366 INFO:teuthology.orchestra.run.smithi153.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2024-04-01T06:45:47.366 INFO:teuthology.orchestra.run.smithi153.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-04-01T06:45:47.366 INFO:teuthology.orchestra.run.smithi153.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-04-01T06:45:47.366 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-04-01T06:45:47.366 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-argparse x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 45 k 2024-04-01T06:45:47.366 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-common x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 129 k 2024-04-01T06:45:47.367 INFO:teuthology.orchestra.run.smithi153.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-04-01T06:45:47.367 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2024-04-01T06:45:47.367 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-04-01T06:45:47.367 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-04-01T06:45:47.367 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cryptography x86_64 3.2.1-7.el8_9 rhel-8-for-x86_64-baseos-rpms 559 k 2024-04-01T06:45:47.367 INFO:teuthology.orchestra.run.smithi153.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-04-01T06:45:47.367 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-04-01T06:45:47.367 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-04-01T06:45:47.367 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2024-04-01T06:45:47.367 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2024-04-01T06:45:47.367 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2024-04-01T06:45:47.367 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-04-01T06:45:47.367 INFO:teuthology.orchestra.run.smithi153.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-04-01T06:45:47.367 INFO:teuthology.orchestra.run.smithi153.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-04-01T06:45:47.368 INFO:teuthology.orchestra.run.smithi153.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2024-04-01T06:45:47.368 INFO:teuthology.orchestra.run.smithi153.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2024-04-01T06:45:47.368 INFO:teuthology.orchestra.run.smithi153.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-04-01T06:45:47.368 INFO:teuthology.orchestra.run.smithi153.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-04-01T06:45:47.368 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-04-01T06:45:47.368 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2024-04-01T06:45:47.368 INFO:teuthology.orchestra.run.smithi153.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2024-04-01T06:45:47.368 INFO:teuthology.orchestra.run.smithi153.stdout: python3-packaging noarch 16.8-9.el8 codeready-builder-for-rhel-8-x86_64-rpms 48 k 2024-04-01T06:45:47.368 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-04-01T06:45:47.368 INFO:teuthology.orchestra.run.smithi153.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-04-01T06:45:47.368 INFO:teuthology.orchestra.run.smithi153.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2024-04-01T06:45:47.368 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2024-04-01T06:45:47.368 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2024-04-01T06:45:47.369 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2024-04-01T06:45:47.369 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2024-04-01T06:45:47.369 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2024-04-01T06:45:47.369 INFO:teuthology.orchestra.run.smithi153.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-04-01T06:45:47.369 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-04-01T06:45:47.369 INFO:teuthology.orchestra.run.smithi153.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-04-01T06:45:47.369 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-04-01T06:45:47.369 INFO:teuthology.orchestra.run.smithi153.stdout: python3-scipy x86_64 1.0.0-21.module+el8.9.0+20976+d3c38525 rhel-8-for-x86_64-appstream-rpms 14 M 2024-04-01T06:45:47.369 INFO:teuthology.orchestra.run.smithi153.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-04-01T06:45:47.369 INFO:teuthology.orchestra.run.smithi153.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-04-01T06:45:47.369 INFO:teuthology.orchestra.run.smithi153.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-04-01T06:45:47.369 INFO:teuthology.orchestra.run.smithi153.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-04-01T06:45:47.369 INFO:teuthology.orchestra.run.smithi153.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-04-01T06:45:47.369 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-04-01T06:45:47.369 INFO:teuthology.orchestra.run.smithi153.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-04-01T06:45:47.370 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-04-01T06:45:47.370 INFO:teuthology.orchestra.run.smithi153.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2024-04-01T06:45:47.370 INFO:teuthology.orchestra.run.smithi153.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-04-01T06:45:47.370 INFO:teuthology.orchestra.run.smithi153.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2024-04-01T06:45:47.370 INFO:teuthology.orchestra.run.smithi153.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-04-01T06:45:47.370 INFO:teuthology.orchestra.run.smithi153.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2024-04-01T06:45:47.370 INFO:teuthology.orchestra.run.smithi153.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2024-04-01T06:45:47.370 INFO:teuthology.orchestra.run.smithi153.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2024-04-01T06:45:47.370 INFO:teuthology.orchestra.run.smithi153.stdout:Enabling module streams: 2024-04-01T06:45:47.370 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql 10 2024-04-01T06:45:47.370 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-01T06:45:47.370 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-04-01T06:45:47.370 INFO:teuthology.orchestra.run.smithi153.stdout:=================================================================================================================================== 2024-04-01T06:45:47.370 INFO:teuthology.orchestra.run.smithi153.stdout:Install 130 Packages 2024-04-01T06:45:47.371 INFO:teuthology.orchestra.run.smithi153.stdout:Upgrade 16 Packages 2024-04-01T06:45:47.371 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-01T06:45:47.371 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 213 M 2024-04-01T06:45:47.371 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-04-01T06:45:47.547 INFO:teuthology.orchestra.run.smithi145.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-01T06:45:47.548 INFO:teuthology.orchestra.run.smithi145.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-01T06:45:47.569 INFO:teuthology.orchestra.run.smithi145.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2024-04-01T06:45:47.570 INFO:teuthology.orchestra.run.smithi145.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2024-04-01T06:45:47.571 INFO:teuthology.orchestra.run.smithi145.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2024-04-01T06:45:47.573 INFO:teuthology.orchestra.run.smithi145.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2024-04-01T06:45:47.576 INFO:teuthology.orchestra.run.smithi145.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2024-04-01T06:45:47.581 INFO:teuthology.orchestra.run.smithi145.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2024-04-01T06:45:47.582 INFO:teuthology.orchestra.run.smithi145.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2024-04-01T06:45:47.653 INFO:teuthology.orchestra.run.smithi083.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-01T06:45:47.654 INFO:teuthology.orchestra.run.smithi083.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-04-01T06:45:47.673 INFO:teuthology.orchestra.run.smithi083.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2024-04-01T06:45:47.674 INFO:teuthology.orchestra.run.smithi083.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2024-04-01T06:45:47.675 INFO:teuthology.orchestra.run.smithi083.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2024-04-01T06:45:47.677 INFO:teuthology.orchestra.run.smithi083.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2024-04-01T06:45:47.679 INFO:teuthology.orchestra.run.smithi083.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2024-04-01T06:45:47.683 INFO:teuthology.orchestra.run.smithi083.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2024-04-01T06:45:47.685 INFO:teuthology.orchestra.run.smithi083.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2024-04-01T06:45:47.802 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-04-01T06:45:47.814 INFO:teuthology.orchestra.run.smithi153.stdout:(1/146): ceph-18.2.2-1001.g9d2ee692.el8.x86_64. 20 kB/s | 6.4 kB 00:00 2024-04-01T06:45:47.816 INFO:teuthology.orchestra.run.smithi145.stdout:=================================================================================================================================== 2024-04-01T06:45:47.816 INFO:teuthology.orchestra.run.smithi145.stdout: Package Arch Version Repository Size 2024-04-01T06:45:47.816 INFO:teuthology.orchestra.run.smithi145.stdout:=================================================================================================================================== 2024-04-01T06:45:47.816 INFO:teuthology.orchestra.run.smithi145.stdout:Installing: 2024-04-01T06:45:47.816 INFO:teuthology.orchestra.run.smithi145.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-13.el8_9 rhel-8-for-x86_64-baseos-rpms 144 k 2024-04-01T06:45:47.817 INFO:teuthology.orchestra.run.smithi145.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2024-04-01T06:45:47.817 INFO:teuthology.orchestra.run.smithi145.stdout: ceph x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 6.4 k 2024-04-01T06:45:47.817 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-base x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 5.5 M 2024-04-01T06:45:47.817 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-fuse x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 854 k 2024-04-01T06:45:47.817 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 165 k 2024-04-01T06:45:47.817 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 1.6 M 2024-04-01T06:45:47.817 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1001.g9d2ee692.el8 ceph-noarch 138 k 2024-04-01T06:45:47.817 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1001.g9d2ee692.el8 ceph-noarch 1.8 M 2024-04-01T06:45:47.817 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1001.g9d2ee692.el8 ceph-noarch 7.4 M 2024-04-01T06:45:47.817 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-rook noarch 2:18.2.2-1001.g9d2ee692.el8 ceph-noarch 49 k 2024-04-01T06:45:47.817 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-radosgw x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 13 M 2024-04-01T06:45:47.817 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-test x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 47 M 2024-04-01T06:45:47.818 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-volume noarch 2:18.2.2-1001.g9d2ee692.el8 ceph-noarch 263 k 2024-04-01T06:45:47.818 INFO:teuthology.orchestra.run.smithi145.stdout: cephadm noarch 2:18.2.2-1001.g9d2ee692.el8 ceph-noarch 170 k 2024-04-01T06:45:47.818 INFO:teuthology.orchestra.run.smithi145.stdout: cephfs-mirror x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 261 k 2024-04-01T06:45:47.818 INFO:teuthology.orchestra.run.smithi145.stdout: cephfs-top noarch 2:18.2.2-1001.g9d2ee692.el8 ceph-noarch 18 k 2024-04-01T06:45:47.818 INFO:teuthology.orchestra.run.smithi145.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2024-04-01T06:45:47.818 INFO:teuthology.orchestra.run.smithi145.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2024-04-01T06:45:47.818 INFO:teuthology.orchestra.run.smithi145.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2024-04-01T06:45:47.818 INFO:teuthology.orchestra.run.smithi145.stdout: libcephfs-devel x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 31 k 2024-04-01T06:45:47.818 INFO:teuthology.orchestra.run.smithi145.stdout: libcephfs2 x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 775 k 2024-04-01T06:45:47.818 INFO:teuthology.orchestra.run.smithi145.stdout: librados-devel x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 139 k 2024-04-01T06:45:47.818 INFO:teuthology.orchestra.run.smithi145.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2024-04-01T06:45:47.818 INFO:teuthology.orchestra.run.smithi145.stdout: libuuid-devel x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 100 k 2024-04-01T06:45:47.819 INFO:teuthology.orchestra.run.smithi145.stdout: openssl-devel x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 2.3 M 2024-04-01T06:45:47.819 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 1.5 M 2024-04-01T06:45:47.819 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql-contrib x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 812 k 2024-04-01T06:45:47.819 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql-server x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 5.1 M 2024-04-01T06:45:47.819 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cephfs x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 197 k 2024-04-01T06:45:47.819 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rados x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 370 k 2024-04-01T06:45:47.819 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rbd x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 364 k 2024-04-01T06:45:47.819 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rgw x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 106 k 2024-04-01T06:45:47.819 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-fuse x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 95 k 2024-04-01T06:45:47.819 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-mirror x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 3.5 M 2024-04-01T06:45:47.819 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-nbd x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 182 k 2024-04-01T06:45:47.819 INFO:teuthology.orchestra.run.smithi145.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2024-04-01T06:45:47.820 INFO:teuthology.orchestra.run.smithi145.stdout:Upgrading: 2024-04-01T06:45:47.820 INFO:teuthology.orchestra.run.smithi145.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2024-04-01T06:45:47.820 INFO:teuthology.orchestra.run.smithi145.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2024-04-01T06:45:47.820 INFO:teuthology.orchestra.run.smithi145.stdout: iproute x86_64 6.2.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 854 k 2024-04-01T06:45:47.820 INFO:teuthology.orchestra.run.smithi145.stdout: libblkid x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2024-04-01T06:45:47.820 INFO:teuthology.orchestra.run.smithi145.stdout: libfdisk x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 254 k 2024-04-01T06:45:47.820 INFO:teuthology.orchestra.run.smithi145.stdout: libmount x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 237 k 2024-04-01T06:45:47.820 INFO:teuthology.orchestra.run.smithi145.stdout: librados2 x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 3.7 M 2024-04-01T06:45:47.820 INFO:teuthology.orchestra.run.smithi145.stdout: librbd1 x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 3.6 M 2024-04-01T06:45:47.820 INFO:teuthology.orchestra.run.smithi145.stdout: libsmartcols x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 179 k 2024-04-01T06:45:47.820 INFO:teuthology.orchestra.run.smithi145.stdout: libuuid x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 99 k 2024-04-01T06:45:47.820 INFO:teuthology.orchestra.run.smithi145.stdout: openssl x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 711 k 2024-04-01T06:45:47.820 INFO:teuthology.orchestra.run.smithi145.stdout: openssl-libs x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 1.5 M 2024-04-01T06:45:47.821 INFO:teuthology.orchestra.run.smithi145.stdout: util-linux x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 2.5 M 2024-04-01T06:45:47.821 INFO:teuthology.orchestra.run.smithi145.stdout: util-linux-user x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 103 k 2024-04-01T06:45:47.821 INFO:teuthology.orchestra.run.smithi145.stdout: xfsdump x86_64 3.1.8-7.el8_9 rhel-8-for-x86_64-baseos-rpms 333 k 2024-04-01T06:45:47.821 INFO:teuthology.orchestra.run.smithi145.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2024-04-01T06:45:47.821 INFO:teuthology.orchestra.run.smithi145.stdout:Installing dependencies: 2024-04-01T06:45:47.821 INFO:teuthology.orchestra.run.smithi145.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2024-04-01T06:45:47.821 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-common x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 22 M 2024-04-01T06:45:47.821 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1001.g9d2ee692.el8 ceph-noarch 23 k 2024-04-01T06:45:47.821 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mds x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 2.3 M 2024-04-01T06:45:47.821 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1001.g9d2ee692.el8 ceph-noarch 245 k 2024-04-01T06:45:47.821 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mon x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 4.8 M 2024-04-01T06:45:47.821 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-osd x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 18 M 2024-04-01T06:45:47.822 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1001.g9d2ee692.el8 ceph-noarch 15 k 2024-04-01T06:45:47.822 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-selinux x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 24 k 2024-04-01T06:45:47.822 INFO:teuthology.orchestra.run.smithi145.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2024-04-01T06:45:47.822 INFO:teuthology.orchestra.run.smithi145.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-04-01T06:45:47.822 INFO:teuthology.orchestra.run.smithi145.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2024-04-01T06:45:47.822 INFO:teuthology.orchestra.run.smithi145.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2024-04-01T06:45:47.822 INFO:teuthology.orchestra.run.smithi145.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2024-04-01T06:45:47.822 INFO:teuthology.orchestra.run.smithi145.stdout: libcephsqlite x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 142 k 2024-04-01T06:45:47.822 INFO:teuthology.orchestra.run.smithi145.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2024-04-01T06:45:47.822 INFO:teuthology.orchestra.run.smithi145.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2024-04-01T06:45:47.822 INFO:teuthology.orchestra.run.smithi145.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-04-01T06:45:47.823 INFO:teuthology.orchestra.run.smithi145.stdout: libpq x86_64 13.11-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2024-04-01T06:45:47.823 INFO:teuthology.orchestra.run.smithi145.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2024-04-01T06:45:47.823 INFO:teuthology.orchestra.run.smithi145.stdout: librabbitmq x86_64 0.9.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 47 k 2024-04-01T06:45:47.823 INFO:teuthology.orchestra.run.smithi145.stdout: libradosstriper1 x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 475 k 2024-04-01T06:45:47.823 INFO:teuthology.orchestra.run.smithi145.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2024-04-01T06:45:47.823 INFO:teuthology.orchestra.run.smithi145.stdout: librgw2 x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 6.5 M 2024-04-01T06:45:47.823 INFO:teuthology.orchestra.run.smithi145.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2024-04-01T06:45:47.823 INFO:teuthology.orchestra.run.smithi145.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2024-04-01T06:45:47.823 INFO:teuthology.orchestra.run.smithi145.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-04-01T06:45:47.823 INFO:teuthology.orchestra.run.smithi145.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2024-04-01T06:45:47.824 INFO:teuthology.orchestra.run.smithi145.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2024-04-01T06:45:47.824 INFO:teuthology.orchestra.run.smithi145.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2024-04-01T06:45:47.824 INFO:teuthology.orchestra.run.smithi145.stdout: oniguruma x86_64 6.8.2-2.1.el8_9 rhel-8-for-x86_64-appstream-rpms 188 k 2024-04-01T06:45:47.824 INFO:teuthology.orchestra.run.smithi145.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2024-04-01T06:45:47.824 INFO:teuthology.orchestra.run.smithi145.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2024-04-01T06:45:47.824 INFO:teuthology.orchestra.run.smithi145.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2024-04-01T06:45:47.824 INFO:teuthology.orchestra.run.smithi145.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2024-04-01T06:45:47.824 INFO:teuthology.orchestra.run.smithi145.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2024-04-01T06:45:47.824 INFO:teuthology.orchestra.run.smithi145.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-04-01T06:45:47.824 INFO:teuthology.orchestra.run.smithi145.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2024-04-01T06:45:47.824 INFO:teuthology.orchestra.run.smithi145.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-04-01T06:45:47.824 INFO:teuthology.orchestra.run.smithi145.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-04-01T06:45:47.825 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-04-01T06:45:47.825 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ceph-argparse x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 45 k 2024-04-01T06:45:47.825 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ceph-common x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 129 k 2024-04-01T06:45:47.825 INFO:teuthology.orchestra.run.smithi145.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-04-01T06:45:47.825 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2024-04-01T06:45:47.825 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-04-01T06:45:47.825 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-04-01T06:45:47.825 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cryptography x86_64 3.2.1-7.el8_9 rhel-8-for-x86_64-baseos-rpms 559 k 2024-04-01T06:45:47.825 INFO:teuthology.orchestra.run.smithi145.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-04-01T06:45:47.825 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-04-01T06:45:47.825 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-04-01T06:45:47.825 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2024-04-01T06:45:47.826 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2024-04-01T06:45:47.826 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2024-04-01T06:45:47.826 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-04-01T06:45:47.826 INFO:teuthology.orchestra.run.smithi145.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-04-01T06:45:47.826 INFO:teuthology.orchestra.run.smithi145.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-04-01T06:45:47.826 INFO:teuthology.orchestra.run.smithi145.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2024-04-01T06:45:47.826 INFO:teuthology.orchestra.run.smithi145.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2024-04-01T06:45:47.826 INFO:teuthology.orchestra.run.smithi145.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-04-01T06:45:47.826 INFO:teuthology.orchestra.run.smithi145.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-04-01T06:45:47.826 INFO:teuthology.orchestra.run.smithi145.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-04-01T06:45:47.826 INFO:teuthology.orchestra.run.smithi145.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2024-04-01T06:45:47.826 INFO:teuthology.orchestra.run.smithi145.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2024-04-01T06:45:47.827 INFO:teuthology.orchestra.run.smithi145.stdout: python3-packaging noarch 16.8-9.el8 codeready-builder-for-rhel-8-x86_64-rpms 48 k 2024-04-01T06:45:47.827 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-04-01T06:45:47.827 INFO:teuthology.orchestra.run.smithi145.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-04-01T06:45:47.827 INFO:teuthology.orchestra.run.smithi145.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2024-04-01T06:45:47.827 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2024-04-01T06:45:47.827 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2024-04-01T06:45:47.827 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2024-04-01T06:45:47.827 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2024-04-01T06:45:47.827 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2024-04-01T06:45:47.827 INFO:teuthology.orchestra.run.smithi145.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-04-01T06:45:47.827 INFO:teuthology.orchestra.run.smithi145.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-04-01T06:45:47.827 INFO:teuthology.orchestra.run.smithi145.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-04-01T06:45:47.828 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-04-01T06:45:47.828 INFO:teuthology.orchestra.run.smithi145.stdout: python3-scipy x86_64 1.0.0-21.module+el8.9.0+20976+d3c38525 rhel-8-for-x86_64-appstream-rpms 14 M 2024-04-01T06:45:47.828 INFO:teuthology.orchestra.run.smithi145.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-04-01T06:45:47.828 INFO:teuthology.orchestra.run.smithi145.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-04-01T06:45:47.828 INFO:teuthology.orchestra.run.smithi145.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-04-01T06:45:47.828 INFO:teuthology.orchestra.run.smithi145.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-04-01T06:45:47.828 INFO:teuthology.orchestra.run.smithi145.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-04-01T06:45:47.828 INFO:teuthology.orchestra.run.smithi145.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-04-01T06:45:47.828 INFO:teuthology.orchestra.run.smithi145.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-04-01T06:45:47.828 INFO:teuthology.orchestra.run.smithi145.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-04-01T06:45:47.828 INFO:teuthology.orchestra.run.smithi145.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2024-04-01T06:45:47.828 INFO:teuthology.orchestra.run.smithi145.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-04-01T06:45:47.829 INFO:teuthology.orchestra.run.smithi145.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2024-04-01T06:45:47.829 INFO:teuthology.orchestra.run.smithi145.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-04-01T06:45:47.829 INFO:teuthology.orchestra.run.smithi145.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2024-04-01T06:45:47.829 INFO:teuthology.orchestra.run.smithi145.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2024-04-01T06:45:47.829 INFO:teuthology.orchestra.run.smithi145.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2024-04-01T06:45:47.829 INFO:teuthology.orchestra.run.smithi145.stdout:Enabling module streams: 2024-04-01T06:45:47.829 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql 10 2024-04-01T06:45:47.829 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-01T06:45:47.829 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction Summary 2024-04-01T06:45:47.829 INFO:teuthology.orchestra.run.smithi145.stdout:=================================================================================================================================== 2024-04-01T06:45:47.829 INFO:teuthology.orchestra.run.smithi145.stdout:Install 130 Packages 2024-04-01T06:45:47.829 INFO:teuthology.orchestra.run.smithi145.stdout:Upgrade 16 Packages 2024-04-01T06:45:47.829 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-01T06:45:47.830 INFO:teuthology.orchestra.run.smithi145.stdout:Total download size: 213 M 2024-04-01T06:45:47.830 INFO:teuthology.orchestra.run.smithi145.stdout:Downloading Packages: 2024-04-01T06:45:47.914 INFO:teuthology.orchestra.run.smithi083.stdout:Dependencies resolved. 2024-04-01T06:45:47.928 INFO:teuthology.orchestra.run.smithi083.stdout:=================================================================================================================================== 2024-04-01T06:45:47.928 INFO:teuthology.orchestra.run.smithi083.stdout: Package Arch Version Repository Size 2024-04-01T06:45:47.928 INFO:teuthology.orchestra.run.smithi083.stdout:=================================================================================================================================== 2024-04-01T06:45:47.928 INFO:teuthology.orchestra.run.smithi083.stdout:Installing: 2024-04-01T06:45:47.928 INFO:teuthology.orchestra.run.smithi083.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-13.el8_9 rhel-8-for-x86_64-baseos-rpms 144 k 2024-04-01T06:45:47.928 INFO:teuthology.orchestra.run.smithi083.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2024-04-01T06:45:47.928 INFO:teuthology.orchestra.run.smithi083.stdout: ceph x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 6.4 k 2024-04-01T06:45:47.929 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-base x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 5.5 M 2024-04-01T06:45:47.929 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-fuse x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 854 k 2024-04-01T06:45:47.929 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 165 k 2024-04-01T06:45:47.929 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 1.6 M 2024-04-01T06:45:47.929 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1001.g9d2ee692.el8 ceph-noarch 138 k 2024-04-01T06:45:47.929 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1001.g9d2ee692.el8 ceph-noarch 1.8 M 2024-04-01T06:45:47.929 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1001.g9d2ee692.el8 ceph-noarch 7.4 M 2024-04-01T06:45:47.929 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-rook noarch 2:18.2.2-1001.g9d2ee692.el8 ceph-noarch 49 k 2024-04-01T06:45:47.929 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-radosgw x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 13 M 2024-04-01T06:45:47.929 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-test x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 47 M 2024-04-01T06:45:47.929 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-volume noarch 2:18.2.2-1001.g9d2ee692.el8 ceph-noarch 263 k 2024-04-01T06:45:47.929 INFO:teuthology.orchestra.run.smithi083.stdout: cephadm noarch 2:18.2.2-1001.g9d2ee692.el8 ceph-noarch 170 k 2024-04-01T06:45:47.929 INFO:teuthology.orchestra.run.smithi083.stdout: cephfs-mirror x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 261 k 2024-04-01T06:45:47.929 INFO:teuthology.orchestra.run.smithi083.stdout: cephfs-top noarch 2:18.2.2-1001.g9d2ee692.el8 ceph-noarch 18 k 2024-04-01T06:45:47.930 INFO:teuthology.orchestra.run.smithi083.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2024-04-01T06:45:47.930 INFO:teuthology.orchestra.run.smithi083.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2024-04-01T06:45:47.930 INFO:teuthology.orchestra.run.smithi083.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2024-04-01T06:45:47.930 INFO:teuthology.orchestra.run.smithi083.stdout: libcephfs-devel x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 31 k 2024-04-01T06:45:47.930 INFO:teuthology.orchestra.run.smithi083.stdout: libcephfs2 x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 775 k 2024-04-01T06:45:47.930 INFO:teuthology.orchestra.run.smithi083.stdout: librados-devel x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 139 k 2024-04-01T06:45:47.930 INFO:teuthology.orchestra.run.smithi083.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2024-04-01T06:45:47.930 INFO:teuthology.orchestra.run.smithi083.stdout: libuuid-devel x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 100 k 2024-04-01T06:45:47.930 INFO:teuthology.orchestra.run.smithi083.stdout: openssl-devel x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 2.3 M 2024-04-01T06:45:47.930 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 1.5 M 2024-04-01T06:45:47.930 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql-contrib x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 812 k 2024-04-01T06:45:47.930 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql-server x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 5.1 M 2024-04-01T06:45:47.931 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cephfs x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 197 k 2024-04-01T06:45:47.931 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rados x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 370 k 2024-04-01T06:45:47.931 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rbd x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 364 k 2024-04-01T06:45:47.931 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rgw x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 106 k 2024-04-01T06:45:47.931 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-fuse x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 95 k 2024-04-01T06:45:47.931 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-mirror x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 3.5 M 2024-04-01T06:45:47.931 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-nbd x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 182 k 2024-04-01T06:45:47.931 INFO:teuthology.orchestra.run.smithi083.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2024-04-01T06:45:47.932 INFO:teuthology.orchestra.run.smithi083.stdout:Upgrading: 2024-04-01T06:45:47.932 INFO:teuthology.orchestra.run.smithi083.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2024-04-01T06:45:47.932 INFO:teuthology.orchestra.run.smithi083.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2024-04-01T06:45:47.932 INFO:teuthology.orchestra.run.smithi083.stdout: iproute x86_64 6.2.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 854 k 2024-04-01T06:45:47.932 INFO:teuthology.orchestra.run.smithi083.stdout: libblkid x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2024-04-01T06:45:47.932 INFO:teuthology.orchestra.run.smithi083.stdout: libfdisk x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 254 k 2024-04-01T06:45:47.932 INFO:teuthology.orchestra.run.smithi083.stdout: libmount x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 237 k 2024-04-01T06:45:47.932 INFO:teuthology.orchestra.run.smithi083.stdout: librados2 x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 3.7 M 2024-04-01T06:45:47.933 INFO:teuthology.orchestra.run.smithi083.stdout: librbd1 x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 3.6 M 2024-04-01T06:45:47.933 INFO:teuthology.orchestra.run.smithi083.stdout: libsmartcols x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 179 k 2024-04-01T06:45:47.933 INFO:teuthology.orchestra.run.smithi083.stdout: libuuid x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 99 k 2024-04-01T06:45:47.933 INFO:teuthology.orchestra.run.smithi083.stdout: openssl x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 711 k 2024-04-01T06:45:47.933 INFO:teuthology.orchestra.run.smithi083.stdout: openssl-libs x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 1.5 M 2024-04-01T06:45:47.933 INFO:teuthology.orchestra.run.smithi083.stdout: util-linux x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 2.5 M 2024-04-01T06:45:47.933 INFO:teuthology.orchestra.run.smithi083.stdout: util-linux-user x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 103 k 2024-04-01T06:45:47.933 INFO:teuthology.orchestra.run.smithi083.stdout: xfsdump x86_64 3.1.8-7.el8_9 rhel-8-for-x86_64-baseos-rpms 333 k 2024-04-01T06:45:47.933 INFO:teuthology.orchestra.run.smithi083.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2024-04-01T06:45:47.933 INFO:teuthology.orchestra.run.smithi083.stdout:Installing dependencies: 2024-04-01T06:45:47.933 INFO:teuthology.orchestra.run.smithi083.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2024-04-01T06:45:47.933 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-common x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 22 M 2024-04-01T06:45:47.933 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1001.g9d2ee692.el8 ceph-noarch 23 k 2024-04-01T06:45:47.933 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mds x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 2.3 M 2024-04-01T06:45:47.934 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1001.g9d2ee692.el8 ceph-noarch 245 k 2024-04-01T06:45:47.934 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mon x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 4.8 M 2024-04-01T06:45:47.934 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-osd x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 18 M 2024-04-01T06:45:47.934 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1001.g9d2ee692.el8 ceph-noarch 15 k 2024-04-01T06:45:47.934 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-selinux x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 24 k 2024-04-01T06:45:47.934 INFO:teuthology.orchestra.run.smithi083.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2024-04-01T06:45:47.934 INFO:teuthology.orchestra.run.smithi083.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-04-01T06:45:47.934 INFO:teuthology.orchestra.run.smithi083.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2024-04-01T06:45:47.934 INFO:teuthology.orchestra.run.smithi083.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2024-04-01T06:45:47.934 INFO:teuthology.orchestra.run.smithi083.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2024-04-01T06:45:47.934 INFO:teuthology.orchestra.run.smithi083.stdout: libcephsqlite x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 142 k 2024-04-01T06:45:47.934 INFO:teuthology.orchestra.run.smithi083.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2024-04-01T06:45:47.935 INFO:teuthology.orchestra.run.smithi083.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2024-04-01T06:45:47.935 INFO:teuthology.orchestra.run.smithi083.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-04-01T06:45:47.935 INFO:teuthology.orchestra.run.smithi083.stdout: libpq x86_64 13.11-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2024-04-01T06:45:47.935 INFO:teuthology.orchestra.run.smithi083.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2024-04-01T06:45:47.935 INFO:teuthology.orchestra.run.smithi083.stdout: librabbitmq x86_64 0.9.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 47 k 2024-04-01T06:45:47.935 INFO:teuthology.orchestra.run.smithi083.stdout: libradosstriper1 x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 475 k 2024-04-01T06:45:47.935 INFO:teuthology.orchestra.run.smithi083.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2024-04-01T06:45:47.935 INFO:teuthology.orchestra.run.smithi083.stdout: librgw2 x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 6.5 M 2024-04-01T06:45:47.935 INFO:teuthology.orchestra.run.smithi083.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2024-04-01T06:45:47.935 INFO:teuthology.orchestra.run.smithi083.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2024-04-01T06:45:47.935 INFO:teuthology.orchestra.run.smithi083.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-04-01T06:45:47.935 INFO:teuthology.orchestra.run.smithi083.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2024-04-01T06:45:47.935 INFO:teuthology.orchestra.run.smithi083.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2024-04-01T06:45:47.935 INFO:teuthology.orchestra.run.smithi083.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2024-04-01T06:45:47.935 INFO:teuthology.orchestra.run.smithi083.stdout: oniguruma x86_64 6.8.2-2.1.el8_9 rhel-8-for-x86_64-appstream-rpms 188 k 2024-04-01T06:45:47.936 INFO:teuthology.orchestra.run.smithi083.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2024-04-01T06:45:47.936 INFO:teuthology.orchestra.run.smithi083.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2024-04-01T06:45:47.936 INFO:teuthology.orchestra.run.smithi083.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2024-04-01T06:45:47.936 INFO:teuthology.orchestra.run.smithi083.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2024-04-01T06:45:47.936 INFO:teuthology.orchestra.run.smithi083.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2024-04-01T06:45:47.936 INFO:teuthology.orchestra.run.smithi083.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-04-01T06:45:47.936 INFO:teuthology.orchestra.run.smithi083.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2024-04-01T06:45:47.936 INFO:teuthology.orchestra.run.smithi083.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-04-01T06:45:47.936 INFO:teuthology.orchestra.run.smithi083.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-04-01T06:45:47.936 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-04-01T06:45:47.936 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ceph-argparse x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 45 k 2024-04-01T06:45:47.936 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ceph-common x86_64 2:18.2.2-1001.g9d2ee692.el8 ceph 129 k 2024-04-01T06:45:47.936 INFO:teuthology.orchestra.run.smithi083.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-04-01T06:45:47.936 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2024-04-01T06:45:47.937 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-04-01T06:45:47.937 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-04-01T06:45:47.937 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cryptography x86_64 3.2.1-7.el8_9 rhel-8-for-x86_64-baseos-rpms 559 k 2024-04-01T06:45:47.937 INFO:teuthology.orchestra.run.smithi083.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-04-01T06:45:47.937 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-04-01T06:45:47.937 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-04-01T06:45:47.937 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2024-04-01T06:45:47.937 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2024-04-01T06:45:47.937 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2024-04-01T06:45:47.937 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-04-01T06:45:47.937 INFO:teuthology.orchestra.run.smithi083.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-04-01T06:45:47.937 INFO:teuthology.orchestra.run.smithi083.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-04-01T06:45:47.937 INFO:teuthology.orchestra.run.smithi083.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2024-04-01T06:45:47.937 INFO:teuthology.orchestra.run.smithi083.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2024-04-01T06:45:47.937 INFO:teuthology.orchestra.run.smithi083.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-04-01T06:45:47.938 INFO:teuthology.orchestra.run.smithi083.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-04-01T06:45:47.938 INFO:teuthology.orchestra.run.smithi083.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-04-01T06:45:47.938 INFO:teuthology.orchestra.run.smithi083.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2024-04-01T06:45:47.938 INFO:teuthology.orchestra.run.smithi083.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2024-04-01T06:45:47.938 INFO:teuthology.orchestra.run.smithi083.stdout: python3-packaging noarch 16.8-9.el8 codeready-builder-for-rhel-8-x86_64-rpms 48 k 2024-04-01T06:45:47.938 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-04-01T06:45:47.938 INFO:teuthology.orchestra.run.smithi083.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-04-01T06:45:47.938 INFO:teuthology.orchestra.run.smithi083.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2024-04-01T06:45:47.938 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2024-04-01T06:45:47.938 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2024-04-01T06:45:47.938 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2024-04-01T06:45:47.938 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2024-04-01T06:45:47.938 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2024-04-01T06:45:47.939 INFO:teuthology.orchestra.run.smithi083.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-04-01T06:45:47.939 INFO:teuthology.orchestra.run.smithi083.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-04-01T06:45:47.939 INFO:teuthology.orchestra.run.smithi083.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-04-01T06:45:47.939 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-04-01T06:45:47.939 INFO:teuthology.orchestra.run.smithi083.stdout: python3-scipy x86_64 1.0.0-21.module+el8.9.0+20976+d3c38525 rhel-8-for-x86_64-appstream-rpms 14 M 2024-04-01T06:45:47.939 INFO:teuthology.orchestra.run.smithi083.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-04-01T06:45:47.939 INFO:teuthology.orchestra.run.smithi083.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-04-01T06:45:47.939 INFO:teuthology.orchestra.run.smithi083.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-04-01T06:45:47.939 INFO:teuthology.orchestra.run.smithi083.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-04-01T06:45:47.939 INFO:teuthology.orchestra.run.smithi083.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-04-01T06:45:47.939 INFO:teuthology.orchestra.run.smithi083.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-04-01T06:45:47.939 INFO:teuthology.orchestra.run.smithi083.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-04-01T06:45:47.939 INFO:teuthology.orchestra.run.smithi083.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-04-01T06:45:47.939 INFO:teuthology.orchestra.run.smithi083.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2024-04-01T06:45:47.939 INFO:teuthology.orchestra.run.smithi083.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-04-01T06:45:47.940 INFO:teuthology.orchestra.run.smithi083.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2024-04-01T06:45:47.940 INFO:teuthology.orchestra.run.smithi083.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-04-01T06:45:47.940 INFO:teuthology.orchestra.run.smithi083.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2024-04-01T06:45:47.940 INFO:teuthology.orchestra.run.smithi083.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2024-04-01T06:45:47.940 INFO:teuthology.orchestra.run.smithi083.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2024-04-01T06:45:47.940 INFO:teuthology.orchestra.run.smithi083.stdout:Enabling module streams: 2024-04-01T06:45:47.940 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql 10 2024-04-01T06:45:47.940 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:45:47.940 INFO:teuthology.orchestra.run.smithi083.stdout:Transaction Summary 2024-04-01T06:45:47.940 INFO:teuthology.orchestra.run.smithi083.stdout:=================================================================================================================================== 2024-04-01T06:45:47.940 INFO:teuthology.orchestra.run.smithi083.stdout:Install 130 Packages 2024-04-01T06:45:47.940 INFO:teuthology.orchestra.run.smithi083.stdout:Upgrade 16 Packages 2024-04-01T06:45:47.940 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:45:47.941 INFO:teuthology.orchestra.run.smithi083.stdout:Total download size: 213 M 2024-04-01T06:45:47.941 INFO:teuthology.orchestra.run.smithi083.stdout:Downloading Packages: 2024-04-01T06:45:48.039 INFO:teuthology.orchestra.run.smithi153.stdout:(2/146): ceph-base-18.2.2-1001.g9d2ee692.el8.x8 10 MB/s | 5.5 MB 00:00 2024-04-01T06:45:48.123 INFO:teuthology.orchestra.run.smithi153.stdout:(3/146): ceph-immutable-object-cache-18.2.2-100 1.9 MB/s | 165 kB 00:00 2024-04-01T06:45:48.273 INFO:teuthology.orchestra.run.smithi153.stdout:(4/146): ceph-fuse-18.2.2-1001.g9d2ee692.el8.x8 1.8 MB/s | 854 kB 00:00 2024-04-01T06:45:48.282 INFO:teuthology.orchestra.run.smithi083.stdout:(1/146): ceph-18.2.2-1001.g9d2ee692.el8.x86_64. 30 kB/s | 6.4 kB 00:00 2024-04-01T06:45:48.343 INFO:teuthology.orchestra.run.smithi145.stdout:(1/146): ceph-18.2.2-1001.g9d2ee692.el8.x86_64. 35 kB/s | 6.4 kB 00:00 2024-04-01T06:45:48.856 INFO:teuthology.orchestra.run.smithi153.stdout:(5/146): ceph-mds-18.2.2-1001.g9d2ee692.el8.x86 3.1 MB/s | 2.3 MB 00:00 2024-04-01T06:45:49.190 INFO:teuthology.orchestra.run.smithi153.stdout:(6/146): ceph-mgr-18.2.2-1001.g9d2ee692.el8.x86 1.7 MB/s | 1.6 MB 00:00 2024-04-01T06:45:49.465 INFO:teuthology.orchestra.run.smithi153.stdout:(7/146): ceph-mon-18.2.2-1001.g9d2ee692.el8.x86 7.9 MB/s | 4.8 MB 00:00 2024-04-01T06:45:49.610 INFO:teuthology.orchestra.run.smithi145.stdout:(2/146): ceph-fuse-18.2.2-1001.g9d2ee692.el8.x8 674 kB/s | 854 kB 00:01 2024-04-01T06:45:49.683 INFO:teuthology.orchestra.run.smithi083.stdout:(2/146): ceph-fuse-18.2.2-1001.g9d2ee692.el8.x8 610 kB/s | 854 kB 00:01 2024-04-01T06:45:49.794 INFO:teuthology.orchestra.run.smithi145.stdout:(3/146): ceph-immutable-object-cache-18.2.2-100 905 kB/s | 165 kB 00:00 2024-04-01T06:45:50.042 INFO:teuthology.orchestra.run.smithi083.stdout:(3/146): ceph-immutable-object-cache-18.2.2-100 462 kB/s | 165 kB 00:00 2024-04-01T06:45:51.023 INFO:teuthology.orchestra.run.smithi153.stdout:(8/146): ceph-radosgw-18.2.2-1001.g9d2ee692.el8 8.4 MB/s | 13 MB 00:01 2024-04-01T06:45:51.124 INFO:teuthology.orchestra.run.smithi153.stdout:(9/146): ceph-selinux-18.2.2-1001.g9d2ee692.el8 243 kB/s | 24 kB 00:00 2024-04-01T06:45:51.349 INFO:teuthology.orchestra.run.smithi153.stdout:(10/146): ceph-common-18.2.2-1001.g9d2ee692.el8 5.6 MB/s | 22 MB 00:03 2024-04-01T06:45:51.599 INFO:teuthology.orchestra.run.smithi153.stdout:(11/146): cephfs-mirror-18.2.2-1001.g9d2ee692.e 1.0 MB/s | 261 kB 00:00 2024-04-01T06:45:51.749 INFO:teuthology.orchestra.run.smithi153.stdout:(12/146): libcephfs-devel-18.2.2-1001.g9d2ee692 206 kB/s | 31 kB 00:00 2024-04-01T06:45:52.150 INFO:teuthology.orchestra.run.smithi153.stdout:(13/146): libcephfs2-18.2.2-1001.g9d2ee692.el8. 1.9 MB/s | 775 kB 00:00 2024-04-01T06:45:52.442 INFO:teuthology.orchestra.run.smithi153.stdout:(14/146): libcephsqlite-18.2.2-1001.g9d2ee692.e 486 kB/s | 142 kB 00:00 2024-04-01T06:45:52.625 INFO:teuthology.orchestra.run.smithi083.stdout:(4/146): ceph-base-18.2.2-1001.g9d2ee692.el8.x8 1.2 MB/s | 5.5 MB 00:04 2024-04-01T06:45:52.644 INFO:teuthology.orchestra.run.smithi145.stdout:(4/146): ceph-mds-18.2.2-1001.g9d2ee692.el8.x86 823 kB/s | 2.3 MB 00:02 2024-04-01T06:45:52.843 INFO:teuthology.orchestra.run.smithi153.stdout:(15/146): librados-devel-18.2.2-1001.g9d2ee692. 348 kB/s | 139 kB 00:00 2024-04-01T06:45:53.000 INFO:teuthology.orchestra.run.smithi083.stdout:(5/146): ceph-common-18.2.2-1001.g9d2ee692.el8. 4.4 MB/s | 22 MB 00:04 2024-04-01T06:45:53.051 INFO:teuthology.orchestra.run.smithi083.stdout:(6/146): ceph-mds-18.2.2-1001.g9d2ee692.el8.x86 780 kB/s | 2.3 MB 00:03 2024-04-01T06:45:53.060 INFO:teuthology.orchestra.run.smithi145.stdout:(5/146): ceph-base-18.2.2-1001.g9d2ee692.el8.x8 1.1 MB/s | 5.5 MB 00:04 2024-04-01T06:45:53.092 INFO:teuthology.orchestra.run.smithi153.stdout:(16/146): libradosstriper1-18.2.2-1001.g9d2ee69 1.9 MB/s | 475 kB 00:00 2024-04-01T06:45:53.260 INFO:teuthology.orchestra.run.smithi153.stdout:(17/146): ceph-osd-18.2.2-1001.g9d2ee692.el8.x8 4.5 MB/s | 18 MB 00:04 2024-04-01T06:45:53.493 INFO:teuthology.orchestra.run.smithi153.stdout:(18/146): python3-ceph-argparse-18.2.2-1001.g9d 191 kB/s | 45 kB 00:00 2024-04-01T06:45:53.594 INFO:teuthology.orchestra.run.smithi145.stdout:(6/146): ceph-common-18.2.2-1001.g9d2ee692.el8. 4.0 MB/s | 22 MB 00:05 2024-04-01T06:45:53.643 INFO:teuthology.orchestra.run.smithi153.stdout:(19/146): python3-ceph-common-18.2.2-1001.g9d2e 858 kB/s | 129 kB 00:00 2024-04-01T06:45:53.692 INFO:teuthology.orchestra.run.smithi083.stdout:(7/146): ceph-mgr-18.2.2-1001.g9d2ee692.el8.x86 1.5 MB/s | 1.6 MB 00:01 2024-04-01T06:45:53.760 INFO:teuthology.orchestra.run.smithi153.stdout:(20/146): python3-cephfs-18.2.2-1001.g9d2ee692. 1.6 MB/s | 197 kB 00:00 2024-04-01T06:45:54.002 INFO:teuthology.orchestra.run.smithi153.stdout:(21/146): python3-rados-18.2.2-1001.g9d2ee692.e 1.5 MB/s | 370 kB 00:00 2024-04-01T06:45:54.144 INFO:teuthology.orchestra.run.smithi145.stdout:(7/146): ceph-mgr-18.2.2-1001.g9d2ee692.el8.x86 1.0 MB/s | 1.6 MB 00:01 2024-04-01T06:45:54.185 INFO:teuthology.orchestra.run.smithi153.stdout:(22/146): python3-rbd-18.2.2-1001.g9d2ee692.el8 1.9 MB/s | 364 kB 00:00 2024-04-01T06:45:54.226 INFO:teuthology.orchestra.run.smithi083.stdout:(8/146): ceph-mon-18.2.2-1001.g9d2ee692.el8.x86 3.9 MB/s | 4.8 MB 00:01 2024-04-01T06:45:54.310 INFO:teuthology.orchestra.run.smithi083.stdout:(9/146): ceph-selinux-18.2.2-1001.g9d2ee692.el8 293 kB/s | 24 kB 00:00 2024-04-01T06:45:54.311 INFO:teuthology.orchestra.run.smithi153.stdout:(23/146): python3-rgw-18.2.2-1001.g9d2ee692.el8 852 kB/s | 106 kB 00:00 2024-04-01T06:45:54.453 INFO:teuthology.orchestra.run.smithi153.stdout:(24/146): rbd-fuse-18.2.2-1001.g9d2ee692.el8.x8 672 kB/s | 95 kB 00:00 2024-04-01T06:45:55.245 INFO:teuthology.orchestra.run.smithi153.stdout:(25/146): rbd-mirror-18.2.2-1001.g9d2ee692.el8. 4.4 MB/s | 3.5 MB 00:00 2024-04-01T06:45:55.753 INFO:teuthology.orchestra.run.smithi153.stdout:(26/146): ceph-test-18.2.2-1001.g9d2ee692.el8.x 10 MB/s | 47 MB 00:04 2024-04-01T06:45:55.837 INFO:teuthology.orchestra.run.smithi153.stdout:(27/146): librgw2-18.2.2-1001.g9d2ee692.el8.x86 2.4 MB/s | 6.5 MB 00:02 2024-04-01T06:45:55.944 INFO:teuthology.orchestra.run.smithi145.stdout:(8/146): ceph-mon-18.2.2-1001.g9d2ee692.el8.x86 1.7 MB/s | 4.8 MB 00:02 2024-04-01T06:45:56.011 INFO:teuthology.orchestra.run.smithi145.stdout:(9/146): ceph-selinux-18.2.2-1001.g9d2ee692.el8 366 kB/s | 24 kB 00:00 2024-04-01T06:45:56.811 INFO:teuthology.orchestra.run.smithi145.stdout:(10/146): ceph-osd-18.2.2-1001.g9d2ee692.el8.x8 5.7 MB/s | 18 MB 00:03 2024-04-01T06:45:56.870 INFO:teuthology.orchestra.run.smithi145.stdout:(11/146): cephfs-mirror-18.2.2-1001.g9d2ee692.e 4.4 MB/s | 261 kB 00:00 2024-04-01T06:45:56.920 INFO:teuthology.orchestra.run.smithi145.stdout:(12/146): libcephfs-devel-18.2.2-1001.g9d2ee692 619 kB/s | 31 kB 00:00 2024-04-01T06:45:57.046 INFO:teuthology.orchestra.run.smithi145.stdout:(13/146): libcephfs2-18.2.2-1001.g9d2ee692.el8. 6.1 MB/s | 775 kB 00:00 2024-04-01T06:45:57.096 INFO:teuthology.orchestra.run.smithi145.stdout:(14/146): libcephsqlite-18.2.2-1001.g9d2ee692.e 2.8 MB/s | 142 kB 00:00 2024-04-01T06:45:57.146 INFO:teuthology.orchestra.run.smithi145.stdout:(15/146): librados-devel-18.2.2-1001.g9d2ee692. 2.7 MB/s | 139 kB 00:00 2024-04-01T06:45:57.230 INFO:teuthology.orchestra.run.smithi145.stdout:(16/146): libradosstriper1-18.2.2-1001.g9d2ee69 5.6 MB/s | 475 kB 00:00 2024-04-01T06:45:58.097 INFO:teuthology.orchestra.run.smithi145.stdout:(17/146): librgw2-18.2.2-1001.g9d2ee692.el8.x86 7.6 MB/s | 6.5 MB 00:00 2024-04-01T06:45:58.166 INFO:teuthology.orchestra.run.smithi145.stdout:(18/146): python3-ceph-argparse-18.2.2-1001.g9d 648 kB/s | 45 kB 00:00 2024-04-01T06:45:58.223 INFO:teuthology.orchestra.run.smithi145.stdout:(19/146): python3-ceph-common-18.2.2-1001.g9d2e 2.3 MB/s | 129 kB 00:00 2024-04-01T06:45:58.281 INFO:teuthology.orchestra.run.smithi145.stdout:(20/146): python3-cephfs-18.2.2-1001.g9d2ee692. 3.3 MB/s | 197 kB 00:00 2024-04-01T06:45:58.364 INFO:teuthology.orchestra.run.smithi145.stdout:(21/146): python3-rados-18.2.2-1001.g9d2ee692.e 4.4 MB/s | 370 kB 00:00 2024-04-01T06:45:58.456 INFO:teuthology.orchestra.run.smithi145.stdout:(22/146): python3-rbd-18.2.2-1001.g9d2ee692.el8 3.9 MB/s | 364 kB 00:00 2024-04-01T06:45:58.515 INFO:teuthology.orchestra.run.smithi145.stdout:(23/146): python3-rgw-18.2.2-1001.g9d2ee692.el8 1.8 MB/s | 106 kB 00:00 2024-04-01T06:45:58.551 INFO:teuthology.orchestra.run.smithi083.stdout:(10/146): ceph-radosgw-18.2.2-1001.g9d2ee692.el 2.7 MB/s | 13 MB 00:04 2024-04-01T06:45:58.565 INFO:teuthology.orchestra.run.smithi145.stdout:(24/146): rbd-fuse-18.2.2-1001.g9d2ee692.el8.x8 1.9 MB/s | 95 kB 00:00 2024-04-01T06:45:58.668 INFO:teuthology.orchestra.run.smithi083.stdout:(11/146): cephfs-mirror-18.2.2-1001.g9d2ee692.e 2.2 MB/s | 261 kB 00:00 2024-04-01T06:45:58.777 INFO:teuthology.orchestra.run.smithi083.stdout:(12/146): libcephfs-devel-18.2.2-1001.g9d2ee692 285 kB/s | 31 kB 00:00 2024-04-01T06:45:59.032 INFO:teuthology.orchestra.run.smithi145.stdout:(25/146): rbd-mirror-18.2.2-1001.g9d2ee692.el8. 7.4 MB/s | 3.5 MB 00:00 2024-04-01T06:45:59.060 INFO:teuthology.orchestra.run.smithi083.stdout:(13/146): libcephfs2-18.2.2-1001.g9d2ee692.el8. 2.7 MB/s | 775 kB 00:00 2024-04-01T06:45:59.799 INFO:teuthology.orchestra.run.smithi145.stdout:(26/146): ceph-radosgw-18.2.2-1001.g9d2ee692.el 2.3 MB/s | 13 MB 00:05 2024-04-01T06:45:59.882 INFO:teuthology.orchestra.run.smithi145.stdout:(27/146): ceph-grafana-dashboards-18.2.2-1001.g 280 kB/s | 23 kB 00:00 2024-04-01T06:45:59.958 INFO:teuthology.orchestra.run.smithi145.stdout:(28/146): ceph-mgr-cephadm-18.2.2-1001.g9d2ee69 1.8 MB/s | 138 kB 00:00 2024-04-01T06:46:00.450 INFO:teuthology.orchestra.run.smithi145.stdout:(29/146): ceph-mgr-dashboard-18.2.2-1001.g9d2ee 3.6 MB/s | 1.8 MB 00:00 2024-04-01T06:46:01.883 INFO:teuthology.orchestra.run.smithi145.stdout:(30/146): ceph-mgr-diskprediction-local-18.2.2- 5.2 MB/s | 7.4 MB 00:01 2024-04-01T06:46:02.225 INFO:teuthology.orchestra.run.smithi145.stdout:(31/146): rbd-nbd-18.2.2-1001.g9d2ee692.el8.x86 57 kB/s | 182 kB 00:03 2024-04-01T06:46:02.228 INFO:teuthology.orchestra.run.smithi153.stdout:(28/146): ceph-grafana-dashboards-18.2.2-1001.g 3.6 kB/s | 23 kB 00:06 2024-04-01T06:46:02.261 INFO:teuthology.orchestra.run.smithi153.stdout:(29/146): ceph-mgr-cephadm-18.2.2-1001.g9d2ee69 21 kB/s | 138 kB 00:06 2024-04-01T06:46:02.284 INFO:teuthology.orchestra.run.smithi145.stdout:(32/146): ceph-mgr-modules-core-18.2.2-1001.g9d 613 kB/s | 245 kB 00:00 2024-04-01T06:46:02.295 INFO:teuthology.orchestra.run.smithi153.stdout:(30/146): rbd-nbd-18.2.2-1001.g9d2ee692.el8.x86 26 kB/s | 182 kB 00:07 2024-04-01T06:46:02.327 INFO:teuthology.orchestra.run.smithi083.stdout:(14/146): libcephsqlite-18.2.2-1001.g9d2ee692.e 43 kB/s | 142 kB 00:03 2024-04-01T06:46:02.334 INFO:teuthology.orchestra.run.smithi145.stdout:(33/146): ceph-mgr-rook-18.2.2-1001.g9d2ee692.e 453 kB/s | 49 kB 00:00 2024-04-01T06:46:02.359 INFO:teuthology.orchestra.run.smithi145.stdout:(34/146): ceph-prometheus-alerts-18.2.2-1001.g9 196 kB/s | 15 kB 00:00 2024-04-01T06:46:02.402 INFO:teuthology.orchestra.run.smithi083.stdout:(15/146): librados-devel-18.2.2-1001.g9d2ee692. 1.8 MB/s | 139 kB 00:00 2024-04-01T06:46:02.446 INFO:teuthology.orchestra.run.smithi153.stdout:(31/146): ceph-mgr-modules-core-18.2.2-1001.g9d 1.6 MB/s | 245 kB 00:00 2024-04-01T06:46:02.485 INFO:teuthology.orchestra.run.smithi145.stdout:(35/146): cephadm-18.2.2-1001.g9d2ee692.el8.noa 1.3 MB/s | 170 kB 00:00 2024-04-01T06:46:02.518 INFO:teuthology.orchestra.run.smithi145.stdout:(36/146): ceph-volume-18.2.2-1001.g9d2ee692.el8 1.4 MB/s | 263 kB 00:00 2024-04-01T06:46:02.554 INFO:teuthology.orchestra.run.smithi153.stdout:(32/146): ceph-mgr-rook-18.2.2-1001.g9d2ee692.e 454 kB/s | 49 kB 00:00 2024-04-01T06:46:02.596 INFO:teuthology.orchestra.run.smithi153.stdout:(33/146): ceph-mgr-dashboard-18.2.2-1001.g9d2ee 4.9 MB/s | 1.8 MB 00:00 2024-04-01T06:46:02.602 INFO:teuthology.orchestra.run.smithi145.stdout:(37/146): cephfs-top-18.2.2-1001.g9d2ee692.el8. 155 kB/s | 18 kB 00:00 2024-04-01T06:46:02.629 INFO:teuthology.orchestra.run.smithi153.stdout:(34/146): ceph-prometheus-alerts-18.2.2-1001.g9 196 kB/s | 15 kB 00:00 2024-04-01T06:46:02.644 INFO:teuthology.orchestra.run.smithi083.stdout:(16/146): libradosstriper1-18.2.2-1001.g9d2ee69 1.9 MB/s | 475 kB 00:00 2024-04-01T06:46:02.663 INFO:teuthology.orchestra.run.smithi153.stdout:(35/146): ceph-volume-18.2.2-1001.g9d2ee692.el8 3.8 MB/s | 263 kB 00:00 2024-04-01T06:46:02.722 INFO:teuthology.orchestra.run.smithi153.stdout:(36/146): cephadm-18.2.2-1001.g9d2ee692.el8.noa 1.8 MB/s | 170 kB 00:00 2024-04-01T06:46:02.738 INFO:teuthology.orchestra.run.smithi153.stdout:(37/146): cephfs-top-18.2.2-1001.g9d2ee692.el8. 241 kB/s | 18 kB 00:00 2024-04-01T06:46:03.019 INFO:teuthology.orchestra.run.smithi145.stdout:(38/146): liboath-2.6.2-3.el8.x86_64.rpm 141 kB/s | 59 kB 00:00 2024-04-01T06:46:03.086 INFO:teuthology.orchestra.run.smithi083.stdout:(17/146): ceph-test-18.2.2-1001.g9d2ee692.el8.x 5.4 MB/s | 47 MB 00:08 2024-04-01T06:46:03.138 INFO:teuthology.orchestra.run.smithi083.stdout:(18/146): python3-ceph-argparse-18.2.2-1001.g9d 901 kB/s | 45 kB 00:00 2024-04-01T06:46:03.195 INFO:teuthology.orchestra.run.smithi083.stdout:(19/146): python3-ceph-common-18.2.2-1001.g9d2e 2.2 MB/s | 129 kB 00:00 2024-04-01T06:46:03.239 INFO:teuthology.orchestra.run.smithi153.stdout:(38/146): liboath-2.6.2-3.el8.x86_64.rpm 118 kB/s | 59 kB 00:00 2024-04-01T06:46:03.254 INFO:teuthology.orchestra.run.smithi083.stdout:(20/146): python3-cephfs-18.2.2-1001.g9d2ee692. 3.3 MB/s | 197 kB 00:00 2024-04-01T06:46:03.329 INFO:teuthology.orchestra.run.smithi083.stdout:(21/146): python3-rados-18.2.2-1001.g9d2ee692.e 4.8 MB/s | 370 kB 00:00 2024-04-01T06:46:03.336 INFO:teuthology.orchestra.run.smithi145.stdout:(39/146): gperftools-libs-2.7-9.el8.x86_64.rpm 375 kB/s | 306 kB 00:00 2024-04-01T06:46:03.361 INFO:teuthology.orchestra.run.smithi145.stdout:(40/146): libunwind-1.3.1-3.el8.x86_64.rpm 219 kB/s | 75 kB 00:00 2024-04-01T06:46:03.412 INFO:teuthology.orchestra.run.smithi083.stdout:(22/146): python3-rbd-18.2.2-1001.g9d2ee692.el8 4.3 MB/s | 364 kB 00:00 2024-04-01T06:46:03.447 INFO:teuthology.orchestra.run.smithi153.stdout:(39/146): ceph-mgr-diskprediction-local-18.2.2- 6.2 MB/s | 7.4 MB 00:01 2024-04-01T06:46:03.473 INFO:teuthology.orchestra.run.smithi153.stdout:(40/146): libunwind-1.3.1-3.el8.x86_64.rpm 322 kB/s | 75 kB 00:00 2024-04-01T06:46:03.479 INFO:teuthology.orchestra.run.smithi083.stdout:(23/146): python3-rgw-18.2.2-1001.g9d2ee692.el8 1.6 MB/s | 106 kB 00:00 2024-04-01T06:46:03.495 INFO:teuthology.orchestra.run.smithi145.stdout:(41/146): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 327 kB/s | 44 kB 00:00 2024-04-01T06:46:03.498 INFO:teuthology.orchestra.run.smithi153.stdout:(41/146): gperftools-libs-2.7-9.el8.x86_64.rpm 395 kB/s | 306 kB 00:00 2024-04-01T06:46:03.537 INFO:teuthology.orchestra.run.smithi145.stdout:(42/146): python3-asyncssh-2.7.0-2.el8.noarch.r 2.3 MB/s | 476 kB 00:00 2024-04-01T06:46:03.644 INFO:teuthology.orchestra.run.smithi153.stdout:(42/146): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 255 kB/s | 44 kB 00:00 2024-04-01T06:46:03.645 INFO:teuthology.orchestra.run.smithi145.stdout:(43/146): python3-cachetools-3.1.1-4.el8.noarch 305 kB/s | 33 kB 00:00 2024-04-01T06:46:03.665 INFO:teuthology.orchestra.run.smithi153.stdout:(43/146): python3-beautifulsoup4-4.6.3-2.el8.1. 1.1 MB/s | 185 kB 00:00 2024-04-01T06:46:03.679 INFO:teuthology.orchestra.run.smithi145.stdout:(44/146): python3-beautifulsoup4-4.6.3-2.el8.1. 1.0 MB/s | 185 kB 00:00 2024-04-01T06:46:03.705 INFO:teuthology.orchestra.run.smithi083.stdout:(24/146): ceph-osd-18.2.2-1001.g9d2ee692.el8.x8 1.7 MB/s | 18 MB 00:10 2024-04-01T06:46:03.730 INFO:teuthology.orchestra.run.smithi083.stdout:(25/146): rbd-fuse-18.2.2-1001.g9d2ee692.el8.x8 380 kB/s | 95 kB 00:00 2024-04-01T06:46:03.746 INFO:teuthology.orchestra.run.smithi145.stdout:(45/146): python3-certifi-2018.10.15-7.el8.noar 162 kB/s | 16 kB 00:00 2024-04-01T06:46:03.782 INFO:teuthology.orchestra.run.smithi153.stdout:(44/146): python3-certifi-2018.10.15-7.el8.noar 140 kB/s | 16 kB 00:00 2024-04-01T06:46:03.797 INFO:teuthology.orchestra.run.smithi083.stdout:(26/146): rbd-nbd-18.2.2-1001.g9d2ee692.el8.x86 2.7 MB/s | 182 kB 00:00 2024-04-01T06:46:03.804 INFO:teuthology.orchestra.run.smithi145.stdout:(46/146): python3-cheroot-8.5.2-1.el8.noarch.rp 1.3 MB/s | 173 kB 00:00 2024-04-01T06:46:03.807 INFO:teuthology.orchestra.run.smithi153.stdout:(45/146): python3-cachetools-3.1.1-4.el8.noarch 203 kB/s | 33 kB 00:00 2024-04-01T06:46:03.864 INFO:teuthology.orchestra.run.smithi083.stdout:(27/146): ceph-grafana-dashboards-18.2.2-1001.g 349 kB/s | 23 kB 00:00 2024-04-01T06:46:03.872 INFO:teuthology.orchestra.run.smithi145.stdout:(47/146): python3-cherrypy-18.4.0-1.el8.noarch. 3.0 MB/s | 384 kB 00:00 2024-04-01T06:46:03.905 INFO:teuthology.orchestra.run.smithi145.stdout:(48/146): python3-google-auth-1.1.1-10.el8.noar 810 kB/s | 81 kB 00:00 2024-04-01T06:46:03.922 INFO:teuthology.orchestra.run.smithi083.stdout:(28/146): ceph-mgr-cephadm-18.2.2-1001.g9d2ee69 2.3 MB/s | 138 kB 00:00 2024-04-01T06:46:03.947 INFO:teuthology.orchestra.run.smithi153.stdout:(46/146): python3-cheroot-8.5.2-1.el8.noarch.rp 1.0 MB/s | 173 kB 00:00 2024-04-01T06:46:03.964 INFO:teuthology.orchestra.run.smithi145.stdout:(49/146): python3-jaraco-6.2-6.el8.noarch.rpm 121 kB/s | 11 kB 00:00 2024-04-01T06:46:04.006 INFO:teuthology.orchestra.run.smithi145.stdout:(50/146): python3-jaraco-functools-2.0-4.el8.no 175 kB/s | 18 kB 00:00 2024-04-01T06:46:04.066 INFO:teuthology.orchestra.run.smithi153.stdout:(47/146): python3-google-auth-1.1.1-10.el8.noar 683 kB/s | 81 kB 00:00 2024-04-01T06:46:04.106 INFO:teuthology.orchestra.run.smithi145.stdout:(51/146): python3-logutils-0.3.5-11.el8.noarch. 487 kB/s | 49 kB 00:00 2024-04-01T06:46:04.108 INFO:teuthology.orchestra.run.smithi153.stdout:(48/146): python3-cherrypy-18.4.0-1.el8.noarch. 1.2 MB/s | 384 kB 00:00 2024-04-01T06:46:04.158 INFO:teuthology.orchestra.run.smithi145.stdout:(52/146): python3-kubernetes-11.0.0-6.el8.noarc 6.1 MB/s | 1.2 MB 00:00 2024-04-01T06:46:04.164 INFO:teuthology.orchestra.run.smithi083.stdout:(29/146): ceph-mgr-dashboard-18.2.2-1001.g9d2ee 7.4 MB/s | 1.8 MB 00:00 2024-04-01T06:46:04.167 INFO:teuthology.orchestra.run.smithi153.stdout:(49/146): python3-asyncssh-2.7.0-2.el8.noarch.r 662 kB/s | 476 kB 00:00 2024-04-01T06:46:04.192 INFO:teuthology.orchestra.run.smithi153.stdout:(50/146): python3-jaraco-6.2-6.el8.noarch.rpm 88 kB/s | 11 kB 00:00 2024-04-01T06:46:04.217 INFO:teuthology.orchestra.run.smithi153.stdout:(51/146): python3-jaraco-functools-2.0-4.el8.no 162 kB/s | 18 kB 00:00 2024-04-01T06:46:04.232 INFO:teuthology.orchestra.run.smithi145.stdout:(53/146): python3-more-itertools-7.2.0-3.el8.no 469 kB/s | 59 kB 00:00 2024-04-01T06:46:04.249 INFO:teuthology.orchestra.run.smithi145.stdout:(54/146): python3-natsort-7.1.1-2.el8.noarch.rp 656 kB/s | 60 kB 00:00 2024-04-01T06:46:04.309 INFO:teuthology.orchestra.run.smithi153.stdout:(52/146): python3-logutils-0.3.5-11.el8.noarch. 417 kB/s | 49 kB 00:00 2024-04-01T06:46:04.337 INFO:teuthology.orchestra.run.smithi153.stdout:(53/146): python3-more-itertools-7.2.0-3.el8.no 502 kB/s | 59 kB 00:00 2024-04-01T06:46:04.427 INFO:teuthology.orchestra.run.smithi153.stdout:(54/146): python3-natsort-7.1.1-2.el8.noarch.rp 516 kB/s | 60 kB 00:00 2024-04-01T06:46:04.477 INFO:teuthology.orchestra.run.smithi153.stdout:(55/146): python3-kubernetes-11.0.0-6.el8.noarc 3.8 MB/s | 1.2 MB 00:00 2024-04-01T06:46:04.502 INFO:teuthology.orchestra.run.smithi153.stdout:(56/146): python3-pecan-1.3.2-9.el8.noarch.rpm 1.7 MB/s | 283 kB 00:00 2024-04-01T06:46:04.561 INFO:teuthology.orchestra.run.smithi153.stdout:(57/146): python3-portend-2.6-1.el8.noarch.rpm 116 kB/s | 16 kB 00:00 2024-04-01T06:46:04.595 INFO:teuthology.orchestra.run.smithi153.stdout:(58/146): python3-repoze-lru-0.7-6.el8.noarch.r 287 kB/s | 34 kB 00:00 2024-04-01T06:46:04.628 INFO:teuthology.orchestra.run.smithi153.stdout:(59/146): python3-routes-2.4.1-12.el8.noarch.rp 1.5 MB/s | 196 kB 00:00 2024-04-01T06:46:04.658 INFO:teuthology.orchestra.run.smithi145.stdout:(55/146): ceph-test-18.2.2-1001.g9d2ee692.el8.x 5.5 MB/s | 47 MB 00:08 2024-04-01T06:46:04.678 INFO:teuthology.orchestra.run.smithi153.stdout:(60/146): python3-rsa-4.9-2.el8.noarch.rpm 551 kB/s | 64 kB 00:00 2024-04-01T06:46:04.682 INFO:teuthology.orchestra.run.smithi145.stdout:(56/146): python3-portend-2.6-1.el8.noarch.rpm 36 kB/s | 16 kB 00:00 2024-04-01T06:46:04.704 INFO:teuthology.orchestra.run.smithi153.stdout:(61/146): python3-simplegeneric-0.8.1-17.el8.no 172 kB/s | 19 kB 00:00 2024-04-01T06:46:04.716 INFO:teuthology.orchestra.run.smithi145.stdout:(57/146): python3-pecan-1.3.2-9.el8.noarch.rpm 584 kB/s | 283 kB 00:00 2024-04-01T06:46:04.737 INFO:teuthology.orchestra.run.smithi153.stdout:(62/146): python3-singledispatch-3.4.0.3-18.el8 220 kB/s | 24 kB 00:00 2024-04-01T06:46:04.753 INFO:teuthology.orchestra.run.smithi083.stdout:(30/146): librgw2-18.2.2-1001.g9d2ee692.el8.x86 3.1 MB/s | 6.5 MB 00:02 2024-04-01T06:46:04.766 INFO:teuthology.orchestra.run.smithi145.stdout:(58/146): python3-repoze-lru-0.7-6.el8.noarch.r 310 kB/s | 34 kB 00:00 2024-04-01T06:46:04.787 INFO:teuthology.orchestra.run.smithi153.stdout:(63/146): python3-tempora-1.14.1-5.el8.noarch.r 269 kB/s | 29 kB 00:00 2024-04-01T06:46:04.813 INFO:teuthology.orchestra.run.smithi153.stdout:(64/146): python3-trustme-0.6.0-4.el8.noarch.rp 253 kB/s | 27 kB 00:00 2024-04-01T06:46:04.817 INFO:teuthology.orchestra.run.smithi145.stdout:(59/146): python3-rsa-4.9-2.el8.noarch.rpm 640 kB/s | 64 kB 00:00 2024-04-01T06:46:04.823 INFO:teuthology.orchestra.run.smithi083.stdout:(31/146): rbd-mirror-18.2.2-1001.g9d2ee692.el8. 3.1 MB/s | 3.5 MB 00:01 2024-04-01T06:46:04.874 INFO:teuthology.orchestra.run.smithi083.stdout:(32/146): ceph-mgr-modules-core-18.2.2-1001.g9d 2.0 MB/s | 245 kB 00:00 2024-04-01T06:46:04.891 INFO:teuthology.orchestra.run.smithi083.stdout:(33/146): ceph-mgr-rook-18.2.2-1001.g9d2ee692.e 737 kB/s | 49 kB 00:00 2024-04-01T06:46:04.892 INFO:teuthology.orchestra.run.smithi145.stdout:(60/146): python3-simplegeneric-0.8.1-17.el8.no 149 kB/s | 19 kB 00:00 2024-04-01T06:46:04.896 INFO:teuthology.orchestra.run.smithi153.stdout:(65/146): python3-waitress-1.4.3-1.el8.noarch.r 1.6 MB/s | 255 kB 00:00 2024-04-01T06:46:04.917 INFO:teuthology.orchestra.run.smithi145.stdout:(61/146): python3-singledispatch-3.4.0.3-18.el8 238 kB/s | 24 kB 00:00 2024-04-01T06:46:04.921 INFO:teuthology.orchestra.run.smithi153.stdout:(66/146): python3-webob-1.8.5-1.el8.1.noarch.rp 1.8 MB/s | 251 kB 00:00 2024-04-01T06:46:04.924 INFO:teuthology.orchestra.run.smithi083.stdout:(34/146): ceph-prometheus-alerts-18.2.2-1001.g9 294 kB/s | 15 kB 00:00 2024-04-01T06:46:04.947 INFO:teuthology.orchestra.run.smithi153.stdout:(67/146): python3-websocket-client-0.56.0-5.el8 458 kB/s | 61 kB 00:00 2024-04-01T06:46:05.005 INFO:teuthology.orchestra.run.smithi153.stdout:(68/146): python3-webtest-2.0.33-1.el8.noarch.r 786 kB/s | 85 kB 00:00 2024-04-01T06:46:05.009 INFO:teuthology.orchestra.run.smithi145.stdout:(62/146): python3-tempora-1.14.1-5.el8.noarch.r 250 kB/s | 29 kB 00:00 2024-04-01T06:46:05.030 INFO:teuthology.orchestra.run.smithi153.stdout:(69/146): python3-zc-lockfile-2.0-2.el8.noarch. 211 kB/s | 23 kB 00:00 2024-04-01T06:46:05.035 INFO:teuthology.orchestra.run.smithi145.stdout:(63/146): python3-trustme-0.6.0-4.el8.noarch.rp 235 kB/s | 27 kB 00:00 2024-04-01T06:46:05.056 INFO:teuthology.orchestra.run.smithi153.stdout:(70/146): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 70 kB 00:00 2024-04-01T06:46:05.058 INFO:teuthology.orchestra.run.smithi083.stdout:(35/146): ceph-mgr-diskprediction-local-18.2.2- 8.3 MB/s | 7.4 MB 00:00 2024-04-01T06:46:05.106 INFO:teuthology.orchestra.run.smithi153.stdout:(71/146): python3-packaging-16.8-9.el8.noarch.r 641 kB/s | 48 kB 00:00 2024-04-01T06:46:05.108 INFO:teuthology.orchestra.run.smithi083.stdout:(36/146): cephadm-18.2.2-1001.g9d2ee692.el8.noa 927 kB/s | 170 kB 00:00 2024-04-01T06:46:05.125 INFO:teuthology.orchestra.run.smithi083.stdout:(37/146): cephfs-top-18.2.2-1001.g9d2ee692.el8. 271 kB/s | 18 kB 00:00 2024-04-01T06:46:05.126 INFO:teuthology.orchestra.run.smithi145.stdout:(64/146): python3-waitress-1.4.3-1.el8.noarch.r 2.1 MB/s | 255 kB 00:00 2024-04-01T06:46:05.131 INFO:teuthology.orchestra.run.smithi153.stdout:(72/146): libverto-devel-0.3.0-5.el8.x86_64.rpm 258 kB/s | 18 kB 00:00 2024-04-01T06:46:05.150 INFO:teuthology.orchestra.run.smithi083.stdout:(38/146): ceph-volume-18.2.2-1001.g9d2ee692.el8 1.0 MB/s | 263 kB 00:00 2024-04-01T06:46:05.152 INFO:teuthology.orchestra.run.smithi145.stdout:(65/146): python3-routes-2.4.1-12.el8.noarch.rp 419 kB/s | 196 kB 00:00 2024-04-01T06:46:05.175 INFO:teuthology.orchestra.run.smithi153.stdout:(73/146): python3-jwt-1.6.1-2.el8.noarch.rpm 619 kB/s | 43 kB 00:00 2024-04-01T06:46:05.185 INFO:teuthology.orchestra.run.smithi145.stdout:(66/146): python3-webob-1.8.5-1.el8.1.noarch.rp 1.6 MB/s | 251 kB 00:00 2024-04-01T06:46:05.207 INFO:teuthology.orchestra.run.smithi153.stdout:(74/146): python3-oauthlib-2.1.0-1.el8.noarch.r 2.0 MB/s | 155 kB 00:00 2024-04-01T06:46:05.219 INFO:teuthology.orchestra.run.smithi145.stdout:(67/146): python3-websocket-client-0.56.0-5.el8 665 kB/s | 61 kB 00:00 2024-04-01T06:46:05.232 INFO:teuthology.orchestra.run.smithi153.stdout:(75/146): python3-pycparser-2.14-14.el8.noarch. 1.9 MB/s | 109 kB 00:00 2024-04-01T06:46:05.257 INFO:teuthology.orchestra.run.smithi153.stdout:(76/146): python3-requests-oauthlib-1.0.0-1.el8 852 kB/s | 43 kB 00:00 2024-04-01T06:46:05.269 INFO:teuthology.orchestra.run.smithi145.stdout:(68/146): python3-webtest-2.0.33-1.el8.noarch.r 729 kB/s | 85 kB 00:00 2024-04-01T06:46:05.274 INFO:teuthology.orchestra.run.smithi153.stdout:(77/146): libaio-devel-0.3.112-1.el8.x86_64.rpm 447 kB/s | 19 kB 00:00 2024-04-01T06:46:05.286 INFO:teuthology.orchestra.run.smithi145.stdout:(69/146): python3-zc-lockfile-2.0-2.el8.noarch. 228 kB/s | 23 kB 00:00 2024-04-01T06:46:05.308 INFO:teuthology.orchestra.run.smithi153.stdout:(78/146): thrift-0.13.0-2.el8.x86_64.rpm 4.8 MB/s | 1.7 MB 00:00 2024-04-01T06:46:05.312 INFO:teuthology.orchestra.run.smithi145.stdout:(70/146): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.6 MB/s | 70 kB 00:00 2024-04-01T06:46:05.334 INFO:teuthology.orchestra.run.smithi153.stdout:(79/146): libzstd-devel-1.4.4-1.el8.x86_64.rpm 579 kB/s | 44 kB 00:00 2024-04-01T06:46:05.353 INFO:teuthology.orchestra.run.smithi145.stdout:(71/146): python3-packaging-16.8-9.el8.noarch.r 722 kB/s | 48 kB 00:00 2024-04-01T06:46:05.370 INFO:teuthology.orchestra.run.smithi145.stdout:(72/146): libverto-devel-0.3.0-5.el8.x86_64.rpm 339 kB/s | 18 kB 00:00 2024-04-01T06:46:05.385 INFO:teuthology.orchestra.run.smithi153.stdout:(80/146): pcre2-devel-10.32-2.el8.x86_64.rpm 5.4 MB/s | 605 kB 00:00 2024-04-01T06:46:05.409 INFO:teuthology.orchestra.run.smithi153.stdout:(81/146): pcre2-utf32-10.32-2.el8.x86_64.rpm 3.1 MB/s | 220 kB 00:00 2024-04-01T06:46:05.412 INFO:teuthology.orchestra.run.smithi145.stdout:(73/146): thrift-0.13.0-2.el8.x86_64.rpm 9.0 MB/s | 1.7 MB 00:00 2024-04-01T06:46:05.429 INFO:teuthology.orchestra.run.smithi145.stdout:(74/146): python3-jwt-1.6.1-2.el8.noarch.rpm 564 kB/s | 43 kB 00:00 2024-04-01T06:46:05.434 INFO:teuthology.orchestra.run.smithi153.stdout:(82/146): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.8 MB/s | 229 kB 00:00 2024-04-01T06:46:05.463 INFO:teuthology.orchestra.run.smithi145.stdout:(75/146): python3-oauthlib-2.1.0-1.el8.noarch.r 1.6 MB/s | 155 kB 00:00 2024-04-01T06:46:05.478 INFO:teuthology.orchestra.run.smithi153.stdout:(83/146): keyutils-libs-devel-1.5.10-9.el8.x86_ 696 kB/s | 48 kB 00:00 2024-04-01T06:46:05.480 INFO:teuthology.orchestra.run.smithi145.stdout:(76/146): python3-requests-oauthlib-1.0.0-1.el8 953 kB/s | 43 kB 00:00 2024-04-01T06:46:05.497 INFO:teuthology.orchestra.run.smithi145.stdout:(77/146): libaio-devel-0.3.112-1.el8.x86_64.rpm 558 kB/s | 19 kB 00:00 2024-04-01T06:46:05.510 INFO:teuthology.orchestra.run.smithi153.stdout:(84/146): libsepol-devel-2.9-3.el8.x86_64.rpm 1.1 MB/s | 87 kB 00:00 2024-04-01T06:46:05.531 INFO:teuthology.orchestra.run.smithi145.stdout:(78/146): python3-pycparser-2.14-14.el8.noarch. 925 kB/s | 109 kB 00:00 2024-04-01T06:46:05.535 INFO:teuthology.orchestra.run.smithi153.stdout:(85/146): libselinux-devel-2.9-5.el8.x86_64.rpm 1.3 MB/s | 200 kB 00:00 2024-04-01T06:46:05.556 INFO:teuthology.orchestra.run.smithi145.stdout:(79/146): libzstd-devel-1.4.4-1.el8.x86_64.rpm 579 kB/s | 44 kB 00:00 2024-04-01T06:46:05.560 INFO:teuthology.orchestra.run.smithi153.stdout:(86/146): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 709 kB/s | 58 kB 00:00 2024-04-01T06:46:05.573 INFO:teuthology.orchestra.run.smithi145.stdout:(80/146): pcre2-utf16-10.32-2.el8.x86_64.rpm 5.3 MB/s | 229 kB 00:00 2024-04-01T06:46:05.577 INFO:teuthology.orchestra.run.smithi153.stdout:(87/146): libcom_err-devel-1.45.6-4.el8.x86_64. 576 kB/s | 39 kB 00:00 2024-04-01T06:46:05.598 INFO:teuthology.orchestra.run.smithi145.stdout:(81/146): pcre2-utf32-10.32-2.el8.x86_64.rpm 5.1 MB/s | 220 kB 00:00 2024-04-01T06:46:05.602 INFO:teuthology.orchestra.run.smithi153.stdout:(88/146): fuse-2.9.7-17.el8.x86_64.rpm 1.2 MB/s | 83 kB 00:00 2024-04-01T06:46:05.619 INFO:teuthology.orchestra.run.smithi153.stdout:(89/146): libquadmath-8.5.0-20.el8.x86_64.rpm 4.0 MB/s | 172 kB 00:00 2024-04-01T06:46:05.632 INFO:teuthology.orchestra.run.smithi145.stdout:(82/146): pcre2-devel-10.32-2.el8.x86_64.rpm 4.4 MB/s | 605 kB 00:00 2024-04-01T06:46:05.653 INFO:teuthology.orchestra.run.smithi153.stdout:(90/146): libgfortran-8.5.0-20.el8.x86_64.rpm 6.8 MB/s | 645 kB 00:00 2024-04-01T06:46:05.657 INFO:teuthology.orchestra.run.smithi145.stdout:(83/146): keyutils-libs-devel-1.5.10-9.el8.x86_ 820 kB/s | 48 kB 00:00 2024-04-01T06:46:05.678 INFO:teuthology.orchestra.run.smithi153.stdout:(91/146): libuuid-devel-2.32.1-43.el8.x86_64.rp 1.3 MB/s | 100 kB 00:00 2024-04-01T06:46:05.682 INFO:teuthology.orchestra.run.smithi145.stdout:(84/146): libselinux-devel-2.9-5.el8.x86_64.rpm 1.8 MB/s | 200 kB 00:00 2024-04-01T06:46:05.704 INFO:teuthology.orchestra.run.smithi153.stdout:(92/146): python3-cffi-1.11.5-6.el8.x86_64.rpm 2.8 MB/s | 238 kB 00:00 2024-04-01T06:46:05.729 INFO:teuthology.orchestra.run.smithi153.stdout:(93/146): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 964 kB/s | 73 kB 00:00 2024-04-01T06:46:05.733 INFO:teuthology.orchestra.run.smithi145.stdout:(85/146): libsepol-devel-2.9-3.el8.x86_64.rpm 865 kB/s | 87 kB 00:00 2024-04-01T06:46:05.754 INFO:teuthology.orchestra.run.smithi153.stdout:(94/146): NetworkManager-initscripts-updown-1.4 1.9 MB/s | 144 kB 00:00 2024-04-01T06:46:05.758 INFO:teuthology.orchestra.run.smithi145.stdout:(86/146): libcom_err-devel-1.45.6-4.el8.x86_64. 513 kB/s | 39 kB 00:00 2024-04-01T06:46:05.783 INFO:teuthology.orchestra.run.smithi145.stdout:(87/146): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 459 kB/s | 58 kB 00:00 2024-04-01T06:46:05.800 INFO:teuthology.orchestra.run.smithi145.stdout:(88/146): fuse-2.9.7-17.el8.x86_64.rpm 1.2 MB/s | 83 kB 00:00 2024-04-01T06:46:05.813 INFO:teuthology.orchestra.run.smithi153.stdout:(95/146): elfutils-libelf-devel-0.189-3.el8.x86 567 kB/s | 62 kB 00:00 2024-04-01T06:46:05.817 INFO:teuthology.orchestra.run.smithi083.stdout:(39/146): liboath-2.6.2-3.el8.x86_64.rpm 85 kB/s | 59 kB 00:00 2024-04-01T06:46:05.826 INFO:teuthology.orchestra.run.smithi145.stdout:(89/146): libquadmath-8.5.0-20.el8.x86_64.rpm 4.0 MB/s | 172 kB 00:00 2024-04-01T06:46:05.846 INFO:teuthology.orchestra.run.smithi153.stdout:(96/146): krb5-devel-1.18.2-26.el8_9.x86_64.rpm 4.7 MB/s | 562 kB 00:00 2024-04-01T06:46:05.851 INFO:teuthology.orchestra.run.smithi145.stdout:(90/146): libuuid-devel-2.32.1-43.el8.x86_64.rp 1.9 MB/s | 100 kB 00:00 2024-04-01T06:46:05.872 INFO:teuthology.orchestra.run.smithi153.stdout:(97/146): librabbitmq-0.9.0-5.el8_9.x86_64.rpm 806 kB/s | 47 kB 00:00 2024-04-01T06:46:05.876 INFO:teuthology.orchestra.run.smithi145.stdout:(91/146): python3-cffi-1.11.5-6.el8.x86_64.rpm 4.6 MB/s | 238 kB 00:00 2024-04-01T06:46:05.901 INFO:teuthology.orchestra.run.smithi145.stdout:(92/146): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 1.4 MB/s | 73 kB 00:00 2024-04-01T06:46:05.905 INFO:teuthology.orchestra.run.smithi153.stdout:(98/146): python3-cryptography-3.2.1-7.el8_9.x8 9.4 MB/s | 559 kB 00:00 2024-04-01T06:46:05.927 INFO:teuthology.orchestra.run.smithi145.stdout:(93/146): libgfortran-8.5.0-20.el8.x86_64.rpm 3.7 MB/s | 645 kB 00:00 2024-04-01T06:46:05.930 INFO:teuthology.orchestra.run.smithi153.stdout:(99/146): python3-jsonpointer-1.10-11.el8.noarc 342 kB/s | 20 kB 00:00 2024-04-01T06:46:05.952 INFO:teuthology.orchestra.run.smithi145.stdout:(94/146): elfutils-libelf-devel-0.189-3.el8.x86 1.2 MB/s | 62 kB 00:00 2024-04-01T06:46:05.955 INFO:teuthology.orchestra.run.smithi153.stdout:(100/146): python3-prettytable-0.7.2-14.el8.noa 878 kB/s | 44 kB 00:00 2024-04-01T06:46:05.977 INFO:teuthology.orchestra.run.smithi145.stdout:(95/146): NetworkManager-initscripts-updown-1.4 1.4 MB/s | 144 kB 00:00 2024-04-01T06:46:05.981 INFO:teuthology.orchestra.run.smithi153.stdout:(101/146): python3-pyasn1-modules-0.3.7-6.el8.n 2.1 MB/s | 110 kB 00:00 2024-04-01T06:46:05.998 INFO:teuthology.orchestra.run.smithi153.stdout:(102/146): python3-jsonpatch-1.21-2.el8.noarch. 634 kB/s | 27 kB 00:00 2024-04-01T06:46:06.011 INFO:teuthology.orchestra.run.smithi145.stdout:(96/146): krb5-devel-1.18.2-26.el8_9.x86_64.rpm 6.6 MB/s | 562 kB 00:00 2024-04-01T06:46:06.023 INFO:teuthology.orchestra.run.smithi153.stdout:(103/146): python3-pyasn1-0.3.7-6.el8.noarch.rp 2.9 MB/s | 126 kB 00:00 2024-04-01T06:46:06.036 INFO:teuthology.orchestra.run.smithi145.stdout:(97/146): librabbitmq-0.9.0-5.el8_9.x86_64.rpm 803 kB/s | 47 kB 00:00 2024-04-01T06:46:06.056 INFO:teuthology.orchestra.run.smithi153.stdout:(104/146): python3-werkzeug-0.12.2-4.el8.noarch 7.6 MB/s | 457 kB 00:00 2024-04-01T06:46:06.070 INFO:teuthology.orchestra.run.smithi145.stdout:(98/146): python3-cryptography-3.2.1-7.el8_9.x8 9.3 MB/s | 559 kB 00:00 2024-04-01T06:46:06.095 INFO:teuthology.orchestra.run.smithi145.stdout:(99/146): python3-jsonpointer-1.10-11.el8.noarc 342 kB/s | 20 kB 00:00 2024-04-01T06:46:06.120 INFO:teuthology.orchestra.run.smithi145.stdout:(100/146): python3-prettytable-0.7.2-14.el8.noa 876 kB/s | 44 kB 00:00 2024-04-01T06:46:06.124 INFO:teuthology.orchestra.run.smithi153.stdout:(105/146): openssl-devel-1.1.1k-12.el8_9.x86_64 6.3 MB/s | 2.3 MB 00:00 2024-04-01T06:46:06.137 INFO:teuthology.orchestra.run.smithi145.stdout:(101/146): python3-pyasn1-modules-0.3.7-6.el8.n 2.6 MB/s | 110 kB 00:00 2024-04-01T06:46:06.157 INFO:teuthology.orchestra.run.smithi153.stdout:(106/146): bison-3.0.4-10.el8.x86_64.rpm 5.0 MB/s | 688 kB 00:00 2024-04-01T06:46:06.162 INFO:teuthology.orchestra.run.smithi145.stdout:(102/146): python3-jsonpatch-1.21-2.el8.noarch. 633 kB/s | 27 kB 00:00 2024-04-01T06:46:06.168 INFO:teuthology.orchestra.run.smithi083.stdout:(40/146): gperftools-libs-2.7-9.el8.x86_64.rpm 289 kB/s | 306 kB 00:01 2024-04-01T06:46:06.182 INFO:teuthology.orchestra.run.smithi153.stdout:(107/146): flex-2.6.1-9.el8.x86_64.rpm 2.5 MB/s | 320 kB 00:00 2024-04-01T06:46:06.187 INFO:teuthology.orchestra.run.smithi145.stdout:(103/146): python3-pyasn1-0.3.7-6.el8.noarch.rp 2.5 MB/s | 126 kB 00:00 2024-04-01T06:46:06.208 INFO:teuthology.orchestra.run.smithi153.stdout:(108/146): python3-markupsafe-0.23-19.el8.x86_6 773 kB/s | 39 kB 00:00 2024-04-01T06:46:06.221 INFO:teuthology.orchestra.run.smithi145.stdout:(104/146): python3-werkzeug-0.12.2-4.el8.noarch 7.6 MB/s | 457 kB 00:00 2024-04-01T06:46:06.233 INFO:teuthology.orchestra.run.smithi153.stdout:(109/146): lttng-ust-2.8.1-11.el8.x86_64.rpm 5.0 MB/s | 259 kB 00:00 2024-04-01T06:46:06.259 INFO:teuthology.orchestra.run.smithi153.stdout:(110/146): uuid-1.6.2-43.el8.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-04-01T06:46:06.263 INFO:teuthology.orchestra.run.smithi145.stdout:(105/146): openssl-devel-1.1.1k-12.el8_9.x86_64 7.5 MB/s | 2.3 MB 00:00 2024-04-01T06:46:06.292 INFO:teuthology.orchestra.run.smithi153.stdout:(111/146): libtool-2.4.6-25.el8.x86_64.rpm 4.1 MB/s | 709 kB 00:00 2024-04-01T06:46:06.305 INFO:teuthology.orchestra.run.smithi145.stdout:(106/146): bison-3.0.4-10.el8.x86_64.rpm 5.7 MB/s | 688 kB 00:00 2024-04-01T06:46:06.317 INFO:teuthology.orchestra.run.smithi153.stdout:(112/146): python3-pyOpenSSL-19.0.0-1.el8.noarc 1.2 MB/s | 103 kB 00:00 2024-04-01T06:46:06.331 INFO:teuthology.orchestra.run.smithi145.stdout:(107/146): flex-2.6.1-9.el8.x86_64.rpm 2.9 MB/s | 320 kB 00:00 2024-04-01T06:46:06.343 INFO:teuthology.orchestra.run.smithi083.stdout:(41/146): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 249 kB/s | 44 kB 00:00 2024-04-01T06:46:06.347 INFO:teuthology.orchestra.run.smithi145.stdout:(108/146): python3-markupsafe-0.23-19.el8.x86_6 925 kB/s | 39 kB 00:00 2024-04-01T06:46:06.351 INFO:teuthology.orchestra.run.smithi153.stdout:(113/146): python3-jinja2-2.10.1-3.el8.noarch.r 9.0 MB/s | 538 kB 00:00 2024-04-01T06:46:06.368 INFO:teuthology.orchestra.run.smithi083.stdout:(42/146): libunwind-1.3.1-3.el8.x86_64.rpm 62 kB/s | 75 kB 00:01 2024-04-01T06:46:06.373 INFO:teuthology.orchestra.run.smithi145.stdout:(109/146): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.1 MB/s | 259 kB 00:00 2024-04-01T06:46:06.398 INFO:teuthology.orchestra.run.smithi145.stdout:(110/146): uuid-1.6.2-43.el8.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-04-01T06:46:06.402 INFO:teuthology.orchestra.run.smithi083.stdout:(43/146): python3-asyncssh-2.7.0-2.el8.noarch.r 814 kB/s | 476 kB 00:00 2024-04-01T06:46:06.424 INFO:teuthology.orchestra.run.smithi145.stdout:(111/146): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.0 MB/s | 103 kB 00:00 2024-04-01T06:46:06.426 INFO:teuthology.orchestra.run.smithi153.stdout:(114/146): socat-1.7.4.1-1.el8.x86_64.rpm 4.2 MB/s | 323 kB 00:00 2024-04-01T06:46:06.457 INFO:teuthology.orchestra.run.smithi145.stdout:(112/146): libtool-2.4.6-25.el8.x86_64.rpm 3.6 MB/s | 709 kB 00:00 2024-04-01T06:46:06.476 INFO:teuthology.orchestra.run.smithi153.stdout:(115/146): python3-numpy-f2py-1.14.3-10.el8.x86 4.4 MB/s | 225 kB 00:00 2024-04-01T06:46:06.491 INFO:teuthology.orchestra.run.smithi145.stdout:(113/146): python3-jinja2-2.10.1-3.el8.noarch.r 7.9 MB/s | 538 kB 00:00 2024-04-01T06:46:06.518 INFO:teuthology.orchestra.run.smithi153.stdout:(116/146): librdkafka-0.11.4-3.el8.x86_64.rpm 8.3 MB/s | 354 kB 00:00 2024-04-01T06:46:06.565 INFO:teuthology.orchestra.run.smithi145.stdout:(114/146): socat-1.7.4.1-1.el8.x86_64.rpm 4.3 MB/s | 323 kB 00:00 2024-04-01T06:46:06.569 INFO:teuthology.orchestra.run.smithi083.stdout:(44/146): python3-beautifulsoup4-4.6.3-2.el8.1. 821 kB/s | 185 kB 00:00 2024-04-01T06:46:06.577 INFO:teuthology.orchestra.run.smithi153.stdout:(117/146): python3-numpy-1.14.3-10.el8.x86_64.r 14 MB/s | 3.7 MB 00:00 2024-04-01T06:46:06.594 INFO:teuthology.orchestra.run.smithi083.stdout:(45/146): python3-cachetools-3.1.1-4.el8.noarch 146 kB/s | 33 kB 00:00 2024-04-01T06:46:06.617 INFO:teuthology.orchestra.run.smithi145.stdout:(115/146): python3-numpy-f2py-1.14.3-10.el8.x86 4.3 MB/s | 225 kB 00:00 2024-04-01T06:46:06.652 INFO:teuthology.orchestra.run.smithi083.stdout:(46/146): python3-certifi-2018.10.15-7.el8.noar 65 kB/s | 16 kB 00:00 2024-04-01T06:46:06.653 INFO:teuthology.orchestra.run.smithi153.stdout:(118/146): python3-babel-2.5.1-7.el8.noarch.rpm 12 MB/s | 4.8 MB 00:00 2024-04-01T06:46:06.658 INFO:teuthology.orchestra.run.smithi145.stdout:(116/146): librdkafka-0.11.4-3.el8.x86_64.rpm 8.3 MB/s | 354 kB 00:00 2024-04-01T06:46:06.716 INFO:teuthology.orchestra.run.smithi153.stdout:(119/146): python3-mako-1.0.6-14.el8.noarch.rpm 1.1 MB/s | 157 kB 00:00 2024-04-01T06:46:06.717 INFO:teuthology.orchestra.run.smithi145.stdout:(117/146): python3-numpy-1.14.3-10.el8.x86_64.r 14 MB/s | 3.7 MB 00:00 2024-04-01T06:46:06.786 INFO:teuthology.orchestra.run.smithi153.stdout:(120/146): automake-1.16.1-8.el8.noarch.rpm 9.9 MB/s | 714 kB 00:00 2024-04-01T06:46:06.792 INFO:teuthology.orchestra.run.smithi145.stdout:(118/146): python3-babel-2.5.1-7.el8.noarch.rpm 12 MB/s | 4.8 MB 00:00 2024-04-01T06:46:06.794 INFO:teuthology.orchestra.run.smithi083.stdout:(47/146): python3-cheroot-8.5.2-1.el8.noarch.rp 766 kB/s | 173 kB 00:00 2024-04-01T06:46:06.818 INFO:teuthology.orchestra.run.smithi145.stdout:(119/146): python3-mako-1.0.6-14.el8.noarch.rpm 1.5 MB/s | 157 kB 00:00 2024-04-01T06:46:06.837 INFO:teuthology.orchestra.run.smithi153.stdout:(121/146): libpq-13.11-1.el8.x86_64.rpm 3.9 MB/s | 198 kB 00:00 2024-04-01T06:46:06.876 INFO:teuthology.orchestra.run.smithi145.stdout:(120/146): automake-1.16.1-8.el8.noarch.rpm 12 MB/s | 714 kB 00:00 2024-04-01T06:46:06.887 INFO:teuthology.orchestra.run.smithi083.stdout:(48/146): python3-cherrypy-18.4.0-1.el8.noarch. 1.6 MB/s | 384 kB 00:00 2024-04-01T06:46:06.910 INFO:teuthology.orchestra.run.smithi145.stdout:(121/146): libpq-13.11-1.el8.x86_64.rpm 5.8 MB/s | 198 kB 00:00 2024-04-01T06:46:06.911 INFO:teuthology.orchestra.run.smithi083.stdout:(49/146): python3-google-auth-1.1.1-10.el8.noar 314 kB/s | 81 kB 00:00 2024-04-01T06:46:06.912 INFO:teuthology.orchestra.run.smithi153.stdout:(122/146): openblas-threads-0.3.15-6.el8.x86_64 13 MB/s | 5.2 MB 00:00 2024-04-01T06:46:06.937 INFO:teuthology.orchestra.run.smithi153.stdout:(123/146): jq-1.6-7.el8.x86_64.rpm 2.0 MB/s | 202 kB 00:00 2024-04-01T06:46:06.952 INFO:teuthology.orchestra.run.smithi145.stdout:(122/146): jq-1.6-7.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2024-04-01T06:46:06.954 INFO:teuthology.orchestra.run.smithi083.stdout:(50/146): python3-jaraco-6.2-6.el8.noarch.rpm 70 kB/s | 11 kB 00:00 2024-04-01T06:46:06.962 INFO:teuthology.orchestra.run.smithi153.stdout:(124/146): python3-pytz-2017.2-11.el8.noarch.rp 1.1 MB/s | 54 kB 00:00 2024-04-01T06:46:06.985 INFO:teuthology.orchestra.run.smithi145.stdout:(123/146): python3-pytz-2017.2-11.el8.noarch.rp 1.6 MB/s | 54 kB 00:00 2024-04-01T06:46:07.046 INFO:teuthology.orchestra.run.smithi083.stdout:(51/146): python3-jaraco-functools-2.0-4.el8.no 111 kB/s | 18 kB 00:00 2024-04-01T06:46:07.054 INFO:teuthology.orchestra.run.smithi153.stdout:(125/146): openblas-0.3.15-6.el8.x86_64.rpm 13 MB/s | 5.0 MB 00:00 2024-04-01T06:46:07.061 INFO:teuthology.orchestra.run.smithi145.stdout:(124/146): openblas-threads-0.3.15-6.el8.x86_64 13 MB/s | 5.2 MB 00:00 2024-04-01T06:46:07.079 INFO:teuthology.orchestra.run.smithi153.stdout:(126/146): oniguruma-6.8.2-2.1.el8_9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-04-01T06:46:07.128 INFO:teuthology.orchestra.run.smithi145.stdout:(125/146): openblas-0.3.15-6.el8.x86_64.rpm 15 MB/s | 5.0 MB 00:00 2024-04-01T06:46:07.129 INFO:teuthology.orchestra.run.smithi083.stdout:(52/146): python3-logutils-0.3.5-11.el8.noarch. 278 kB/s | 49 kB 00:00 2024-04-01T06:46:07.138 INFO:teuthology.orchestra.run.smithi153.stdout:(127/146): postgresql-10.23-4.module+el8.9.0+21 18 MB/s | 1.5 MB 00:00 2024-04-01T06:46:07.153 INFO:teuthology.orchestra.run.smithi145.stdout:(126/146): oniguruma-6.8.2-2.1.el8_9.x86_64.rpm 2.0 MB/s | 188 kB 00:00 2024-04-01T06:46:07.180 INFO:teuthology.orchestra.run.smithi153.stdout:(128/146): postgresql-contrib-10.23-4.module+el 7.9 MB/s | 812 kB 00:00 2024-04-01T06:46:07.212 INFO:teuthology.orchestra.run.smithi145.stdout:(127/146): postgresql-10.23-4.module+el8.9.0+21 18 MB/s | 1.5 MB 00:00 2024-04-01T06:46:07.253 INFO:teuthology.orchestra.run.smithi145.stdout:(128/146): postgresql-contrib-10.23-4.module+el 7.9 MB/s | 812 kB 00:00 2024-04-01T06:46:07.313 INFO:teuthology.orchestra.run.smithi153.stdout:(129/146): postgresql-server-10.23-4.module+el8 29 MB/s | 5.1 MB 00:00 2024-04-01T06:46:07.355 INFO:teuthology.orchestra.run.smithi083.stdout:(53/146): python3-natsort-7.1.1-2.el8.noarch.rp 267 kB/s | 60 kB 00:00 2024-04-01T06:46:07.404 INFO:teuthology.orchestra.run.smithi145.stdout:(129/146): postgresql-server-10.23-4.module+el8 26 MB/s | 5.1 MB 00:00 2024-04-01T06:46:07.506 INFO:teuthology.orchestra.run.smithi153.stdout:(130/146): python3-scipy-1.0.0-21.module+el8.9. 24 MB/s | 14 MB 00:00 2024-04-01T06:46:07.555 INFO:teuthology.orchestra.run.smithi083.stdout:(54/146): python3-more-itertools-7.2.0-3.el8.no 115 kB/s | 59 kB 00:00 2024-04-01T06:46:07.555 INFO:teuthology.orchestra.run.smithi153.stdout:(131/146): elfutils-libelf-0.189-3.el8.x86_64.r 4.8 MB/s | 232 kB 00:00 2024-04-01T06:46:07.587 INFO:teuthology.orchestra.run.smithi145.stdout:(130/146): python3-scipy-1.0.0-21.module+el8.9. 23 MB/s | 14 MB 00:00 2024-04-01T06:46:07.588 INFO:teuthology.orchestra.run.smithi083.stdout:(55/146): python3-kubernetes-11.0.0-6.el8.noarc 1.7 MB/s | 1.2 MB 00:00 2024-04-01T06:46:07.606 INFO:teuthology.orchestra.run.smithi153.stdout:(132/146): elfutils-libs-0.189-3.el8.x86_64.rpm 5.9 MB/s | 303 kB 00:00 2024-04-01T06:46:07.614 INFO:teuthology.orchestra.run.smithi083.stdout:(56/146): python3-pecan-1.3.2-9.el8.noarch.rpm 1.1 MB/s | 283 kB 00:00 2024-04-01T06:46:07.629 INFO:teuthology.orchestra.run.smithi145.stdout:(131/146): elfutils-libelf-0.189-3.el8.x86_64.r 5.5 MB/s | 232 kB 00:00 2024-04-01T06:46:07.671 INFO:teuthology.orchestra.run.smithi145.stdout:(132/146): elfutils-libs-0.189-3.el8.x86_64.rpm 7.1 MB/s | 303 kB 00:00 2024-04-01T06:46:07.681 INFO:teuthology.orchestra.run.smithi153.stdout:(133/146): libmount-2.32.1-43.el8.x86_64.rpm 3.1 MB/s | 237 kB 00:00 2024-04-01T06:46:07.713 INFO:teuthology.orchestra.run.smithi145.stdout:(133/146): libmount-2.32.1-43.el8.x86_64.rpm 5.5 MB/s | 237 kB 00:00 2024-04-01T06:46:07.714 INFO:teuthology.orchestra.run.smithi083.stdout:(57/146): python3-portend-2.6-1.el8.noarch.rpm 98 kB/s | 16 kB 00:00 2024-04-01T06:46:07.731 INFO:teuthology.orchestra.run.smithi153.stdout:(134/146): libsmartcols-2.32.1-43.el8.x86_64.rp 3.5 MB/s | 179 kB 00:00 2024-04-01T06:46:07.746 INFO:teuthology.orchestra.run.smithi145.stdout:(134/146): libsmartcols-2.32.1-43.el8.x86_64.rp 5.3 MB/s | 179 kB 00:00 2024-04-01T06:46:07.764 INFO:teuthology.orchestra.run.smithi083.stdout:(58/146): python3-repoze-lru-0.7-6.el8.noarch.r 192 kB/s | 34 kB 00:00 2024-04-01T06:46:07.780 INFO:teuthology.orchestra.run.smithi145.stdout:(135/146): libuuid-2.32.1-43.el8.x86_64.rpm 2.9 MB/s | 99 kB 00:00 2024-04-01T06:46:07.781 INFO:teuthology.orchestra.run.smithi153.stdout:(135/146): libuuid-2.32.1-43.el8.x86_64.rpm 1.9 MB/s | 99 kB 00:00 2024-04-01T06:46:07.831 INFO:teuthology.orchestra.run.smithi083.stdout:(59/146): python3-routes-2.4.1-12.el8.noarch.rp 904 kB/s | 196 kB 00:00 2024-04-01T06:46:07.857 INFO:teuthology.orchestra.run.smithi153.stdout:(136/146): librbd1-18.2.2-1001.g9d2ee692.el8.x8 6.6 MB/s | 3.6 MB 00:00 2024-04-01T06:46:07.873 INFO:teuthology.orchestra.run.smithi083.stdout:(60/146): python3-rsa-4.9-2.el8.noarch.rpm 404 kB/s | 64 kB 00:00 2024-04-01T06:46:07.889 INFO:teuthology.orchestra.run.smithi145.stdout:(136/146): util-linux-2.32.1-43.el8.x86_64.rpm 23 MB/s | 2.5 MB 00:00 2024-04-01T06:46:07.915 INFO:teuthology.orchestra.run.smithi083.stdout:(61/146): python3-simplegeneric-0.8.1-17.el8.no 124 kB/s | 19 kB 00:00 2024-04-01T06:46:07.923 INFO:teuthology.orchestra.run.smithi145.stdout:(137/146): util-linux-user-2.32.1-43.el8.x86_64 3.0 MB/s | 103 kB 00:00 2024-04-01T06:46:07.957 INFO:teuthology.orchestra.run.smithi153.stdout:(137/146): util-linux-2.32.1-43.el8.x86_64.rpm 14 MB/s | 2.5 MB 00:00 2024-04-01T06:46:07.990 INFO:teuthology.orchestra.run.smithi145.stdout:(138/146): iproute-6.2.0-5.el8_9.x86_64.rpm 13 MB/s | 854 kB 00:00 2024-04-01T06:46:07.990 INFO:teuthology.orchestra.run.smithi083.stdout:(62/146): python3-singledispatch-3.4.0.3-18.el8 150 kB/s | 24 kB 00:00 2024-04-01T06:46:07.991 INFO:teuthology.orchestra.run.smithi153.stdout:(138/146): util-linux-user-2.32.1-43.el8.x86_64 770 kB/s | 103 kB 00:00 2024-04-01T06:46:08.032 INFO:teuthology.orchestra.run.smithi083.stdout:(63/146): python3-tempora-1.14.1-5.el8.noarch.r 184 kB/s | 29 kB 00:00 2024-04-01T06:46:08.041 INFO:teuthology.orchestra.run.smithi153.stdout:(139/146): librados2-18.2.2-1001.g9d2ee692.el8. 4.3 MB/s | 3.7 MB 00:00 2024-04-01T06:46:08.048 INFO:teuthology.orchestra.run.smithi145.stdout:(139/146): librbd1-18.2.2-1001.g9d2ee692.el8.x8 5.5 MB/s | 3.6 MB 00:00 2024-04-01T06:46:08.066 INFO:teuthology.orchestra.run.smithi083.stdout:(64/146): python3-trustme-0.6.0-4.el8.noarch.rp 183 kB/s | 27 kB 00:00 2024-04-01T06:46:08.073 INFO:teuthology.orchestra.run.smithi145.stdout:(140/146): libblkid-2.32.1-43.el8.x86_64.rpm 2.6 MB/s | 220 kB 00:00 2024-04-01T06:46:08.083 INFO:teuthology.orchestra.run.smithi153.stdout:(140/146): libblkid-2.32.1-43.el8.x86_64.rpm 2.3 MB/s | 220 kB 00:00 2024-04-01T06:46:08.107 INFO:teuthology.orchestra.run.smithi145.stdout:(141/146): libfdisk-2.32.1-43.el8.x86_64.rpm 4.2 MB/s | 254 kB 00:00 2024-04-01T06:46:08.108 INFO:teuthology.orchestra.run.smithi153.stdout:(141/146): libfdisk-2.32.1-43.el8.x86_64.rpm 3.7 MB/s | 254 kB 00:00 2024-04-01T06:46:08.141 INFO:teuthology.orchestra.run.smithi145.stdout:(142/146): openssl-1.1.1k-12.el8_9.x86_64.rpm 10 MB/s | 711 kB 00:00 2024-04-01T06:46:08.150 INFO:teuthology.orchestra.run.smithi153.stdout:(142/146): iproute-6.2.0-5.el8_9.x86_64.rpm 4.3 MB/s | 854 kB 00:00 2024-04-01T06:46:08.184 INFO:teuthology.orchestra.run.smithi153.stdout:(143/146): openssl-1.1.1k-12.el8_9.x86_64.rpm 6.9 MB/s | 711 kB 00:00 2024-04-01T06:46:08.209 INFO:teuthology.orchestra.run.smithi153.stdout:(144/146): xfsdump-3.1.8-7.el8_9.x86_64.rpm 5.6 MB/s | 333 kB 00:00 2024-04-01T06:46:08.225 INFO:teuthology.orchestra.run.smithi083.stdout:(65/146): python3-waitress-1.4.3-1.el8.noarch.r 1.1 MB/s | 255 kB 00:00 2024-04-01T06:46:08.233 INFO:teuthology.orchestra.run.smithi145.stdout:(143/146): librados2-18.2.2-1001.g9d2ee692.el8. 3.7 MB/s | 3.7 MB 00:00 2024-04-01T06:46:08.250 INFO:teuthology.orchestra.run.smithi083.stdout:(66/146): python3-webob-1.8.5-1.el8.1.noarch.rp 1.1 MB/s | 251 kB 00:00 2024-04-01T06:46:08.258 INFO:teuthology.orchestra.run.smithi145.stdout:(144/146): xfsdump-3.1.8-7.el8_9.x86_64.rpm 2.8 MB/s | 333 kB 00:00 2024-04-01T06:46:08.276 INFO:teuthology.orchestra.run.smithi153.stdout:(145/146): openssl-libs-1.1.1k-12.el8_9.x86_64. 8.8 MB/s | 1.5 MB 00:00 2024-04-01T06:46:08.292 INFO:teuthology.orchestra.run.smithi145.stdout:(145/146): openssl-libs-1.1.1k-12.el8_9.x86_64. 8.0 MB/s | 1.5 MB 00:00 2024-04-01T06:46:08.310 INFO:teuthology.orchestra.run.smithi153.stdout:(146/146): xfsprogs-5.0.0-12.el8.x86_64.rpm 8.5 MB/s | 1.1 MB 00:00 2024-04-01T06:46:08.313 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-04-01T06:46:08.313 INFO:teuthology.orchestra.run.smithi153.stdout:Total 10 MB/s | 213 MB 00:20 2024-04-01T06:46:08.325 INFO:teuthology.orchestra.run.smithi145.stdout:(146/146): xfsprogs-5.0.0-12.el8.x86_64.rpm 12 MB/s | 1.1 MB 00:00 2024-04-01T06:46:08.328 INFO:teuthology.orchestra.run.smithi145.stdout:-------------------------------------------------------------------------------- 2024-04-01T06:46:08.328 INFO:teuthology.orchestra.run.smithi145.stdout:Total 10 MB/s | 213 MB 00:20 2024-04-01T06:46:08.400 INFO:teuthology.orchestra.run.smithi083.stdout:(67/146): python3-webtest-2.0.33-1.el8.noarch.r 487 kB/s | 85 kB 00:00 2024-04-01T06:46:08.425 INFO:teuthology.orchestra.run.smithi083.stdout:(68/146): python3-zc-lockfile-2.0-2.el8.noarch. 131 kB/s | 23 kB 00:00 2024-04-01T06:46:08.451 INFO:teuthology.orchestra.run.smithi083.stdout:(69/146): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2024-04-01T06:46:08.501 INFO:teuthology.orchestra.run.smithi083.stdout:(70/146): python3-packaging-16.8-9.el8.noarch.r 965 kB/s | 48 kB 00:00 2024-04-01T06:46:08.535 INFO:teuthology.orchestra.run.smithi083.stdout:(71/146): libverto-devel-0.3.0-5.el8.x86_64.rpm 536 kB/s | 18 kB 00:00 2024-04-01T06:46:08.602 INFO:teuthology.orchestra.run.smithi083.stdout:(72/146): python3-jwt-1.6.1-2.el8.noarch.rpm 639 kB/s | 43 kB 00:00 2024-04-01T06:46:08.627 INFO:teuthology.orchestra.run.smithi083.stdout:(73/146): python3-websocket-client-0.56.0-5.el8 109 kB/s | 61 kB 00:00 2024-04-01T06:46:08.652 INFO:teuthology.orchestra.run.smithi083.stdout:(74/146): python3-oauthlib-2.1.0-1.el8.noarch.r 3.0 MB/s | 155 kB 00:00 2024-04-01T06:46:08.694 INFO:teuthology.orchestra.run.smithi083.stdout:(75/146): python3-requests-oauthlib-1.0.0-1.el8 1.2 MB/s | 43 kB 00:00 2024-04-01T06:46:08.719 INFO:teuthology.orchestra.run.smithi083.stdout:(76/146): python3-pycparser-2.14-14.el8.noarch. 1.2 MB/s | 109 kB 00:00 2024-04-01T06:46:08.745 INFO:teuthology.orchestra.run.smithi083.stdout:(77/146): libaio-devel-0.3.112-1.el8.x86_64.rpm 372 kB/s | 19 kB 00:00 2024-04-01T06:46:08.770 INFO:teuthology.orchestra.run.smithi083.stdout:(78/146): libzstd-devel-1.4.4-1.el8.x86_64.rpm 874 kB/s | 44 kB 00:00 2024-04-01T06:46:08.804 INFO:teuthology.orchestra.run.smithi083.stdout:(79/146): pcre2-devel-10.32-2.el8.x86_64.rpm 10 MB/s | 605 kB 00:00 2024-04-01T06:46:08.829 INFO:teuthology.orchestra.run.smithi083.stdout:(80/146): pcre2-utf16-10.32-2.el8.x86_64.rpm 3.8 MB/s | 229 kB 00:00 2024-04-01T06:46:08.862 INFO:teuthology.orchestra.run.smithi083.stdout:(81/146): pcre2-utf32-10.32-2.el8.x86_64.rpm 3.7 MB/s | 220 kB 00:00 2024-04-01T06:46:08.888 INFO:teuthology.orchestra.run.smithi083.stdout:(82/146): libselinux-devel-2.9-5.el8.x86_64.rpm 3.3 MB/s | 200 kB 00:00 2024-04-01T06:46:08.905 INFO:teuthology.orchestra.run.smithi083.stdout:(83/146): keyutils-libs-devel-1.5.10-9.el8.x86_ 1.1 MB/s | 48 kB 00:00 2024-04-01T06:46:08.962 INFO:teuthology.orchestra.run.smithi083.stdout:(84/146): libsepol-devel-2.9-3.el8.x86_64.rpm 1.2 MB/s | 87 kB 00:00 2024-04-01T06:46:08.989 INFO:teuthology.orchestra.run.smithi083.stdout:(85/146): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 691 kB/s | 58 kB 00:00 2024-04-01T06:46:09.006 INFO:teuthology.orchestra.run.smithi083.stdout:(86/146): libcom_err-devel-1.45.6-4.el8.x86_64. 890 kB/s | 39 kB 00:00 2024-04-01T06:46:09.031 INFO:teuthology.orchestra.run.smithi083.stdout:(87/146): fuse-2.9.7-17.el8.x86_64.rpm 1.9 MB/s | 83 kB 00:00 2024-04-01T06:46:09.073 INFO:teuthology.orchestra.run.smithi083.stdout:(88/146): libgfortran-8.5.0-20.el8.x86_64.rpm 9.4 MB/s | 645 kB 00:00 2024-04-01T06:46:09.098 INFO:teuthology.orchestra.run.smithi083.stdout:(89/146): libquadmath-8.5.0-20.el8.x86_64.rpm 2.5 MB/s | 172 kB 00:00 2024-04-01T06:46:09.123 INFO:teuthology.orchestra.run.smithi083.stdout:(90/146): libuuid-devel-2.32.1-43.el8.x86_64.rp 1.9 MB/s | 100 kB 00:00 2024-04-01T06:46:09.149 INFO:teuthology.orchestra.run.smithi083.stdout:(91/146): python3-cffi-1.11.5-6.el8.x86_64.rpm 4.6 MB/s | 238 kB 00:00 2024-04-01T06:46:09.174 INFO:teuthology.orchestra.run.smithi083.stdout:(92/146): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 1.4 MB/s | 73 kB 00:00 2024-04-01T06:46:09.199 INFO:teuthology.orchestra.run.smithi083.stdout:(93/146): NetworkManager-initscripts-updown-1.4 2.8 MB/s | 144 kB 00:00 2024-04-01T06:46:09.224 INFO:teuthology.orchestra.run.smithi083.stdout:(94/146): elfutils-libelf-devel-0.189-3.el8.x86 1.2 MB/s | 62 kB 00:00 2024-04-01T06:46:09.267 INFO:teuthology.orchestra.run.smithi083.stdout:(95/146): krb5-devel-1.18.2-26.el8_9.x86_64.rpm 8.2 MB/s | 562 kB 00:00 2024-04-01T06:46:09.300 INFO:teuthology.orchestra.run.smithi083.stdout:(96/146): librabbitmq-0.9.0-5.el8_9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-04-01T06:46:09.337 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-04-01T06:46:09.375 INFO:teuthology.orchestra.run.smithi083.stdout:(97/146): openssl-devel-1.1.1k-12.el8_9.x86_64. 15 MB/s | 2.3 MB 00:00 2024-04-01T06:46:09.401 INFO:teuthology.orchestra.run.smithi083.stdout:(98/146): python3-cryptography-3.2.1-7.el8_9.x8 5.4 MB/s | 559 kB 00:00 2024-04-01T06:46:09.404 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction check 2024-04-01T06:46:09.426 INFO:teuthology.orchestra.run.smithi083.stdout:(99/146): python3-jsonpointer-1.10-11.el8.noarc 397 kB/s | 20 kB 00:00 2024-04-01T06:46:09.451 INFO:teuthology.orchestra.run.smithi083.stdout:(100/146): python3-prettytable-0.7.2-14.el8.noa 874 kB/s | 44 kB 00:00 2024-04-01T06:46:09.477 INFO:teuthology.orchestra.run.smithi083.stdout:(101/146): python3-pyasn1-modules-0.3.7-6.el8.n 2.1 MB/s | 110 kB 00:00 2024-04-01T06:46:09.502 INFO:teuthology.orchestra.run.smithi083.stdout:(102/146): python3-jsonpatch-1.21-2.el8.noarch. 530 kB/s | 27 kB 00:00 2024-04-01T06:46:09.527 INFO:teuthology.orchestra.run.smithi083.stdout:(103/146): python3-pyasn1-0.3.7-6.el8.noarch.rp 2.5 MB/s | 126 kB 00:00 2024-04-01T06:46:09.561 INFO:teuthology.orchestra.run.smithi083.stdout:(104/146): python3-werkzeug-0.12.2-4.el8.noarch 7.6 MB/s | 457 kB 00:00 2024-04-01T06:46:09.594 INFO:teuthology.orchestra.run.smithi083.stdout:(105/146): bison-3.0.4-10.el8.x86_64.rpm 10 MB/s | 688 kB 00:00 2024-04-01T06:46:09.628 INFO:teuthology.orchestra.run.smithi083.stdout:(106/146): flex-2.6.1-9.el8.x86_64.rpm 4.7 MB/s | 320 kB 00:00 2024-04-01T06:46:09.662 INFO:teuthology.orchestra.run.smithi083.stdout:(107/146): thrift-0.13.0-2.el8.x86_64.rpm 1.4 MB/s | 1.7 MB 00:01 2024-04-01T06:46:09.687 INFO:teuthology.orchestra.run.smithi083.stdout:(108/146): python3-markupsafe-0.23-19.el8.x86_6 663 kB/s | 39 kB 00:00 2024-04-01T06:46:09.733 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-04-01T06:46:09.733 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-04-01T06:46:09.746 INFO:teuthology.orchestra.run.smithi083.stdout:(109/146): libtool-2.4.6-25.el8.x86_64.rpm 4.6 MB/s | 709 kB 00:00 2024-04-01T06:46:09.771 INFO:teuthology.orchestra.run.smithi083.stdout:(110/146): uuid-1.6.2-43.el8.x86_64.rpm 818 kB/s | 64 kB 00:00 2024-04-01T06:46:09.797 INFO:teuthology.orchestra.run.smithi083.stdout:(111/146): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.0 MB/s | 103 kB 00:00 2024-04-01T06:46:09.802 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction check succeeded. 2024-04-01T06:46:09.802 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction test 2024-04-01T06:46:09.822 INFO:teuthology.orchestra.run.smithi083.stdout:(112/146): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.6 MB/s | 259 kB 00:00 2024-04-01T06:46:09.856 INFO:teuthology.orchestra.run.smithi083.stdout:(113/146): python3-jinja2-2.10.1-3.el8.noarch.r 9.0 MB/s | 538 kB 00:00 2024-04-01T06:46:09.899 INFO:teuthology.orchestra.run.smithi083.stdout:(114/146): socat-1.7.4.1-1.el8.x86_64.rpm 7.6 MB/s | 323 kB 00:00 2024-04-01T06:46:09.952 INFO:teuthology.orchestra.run.smithi083.stdout:(115/146): python3-numpy-f2py-1.14.3-10.el8.x86 4.0 MB/s | 225 kB 00:00 2024-04-01T06:46:09.998 INFO:teuthology.orchestra.run.smithi083.stdout:(116/146): librdkafka-0.11.4-3.el8.x86_64.rpm 7.6 MB/s | 354 kB 00:00 2024-04-01T06:46:10.056 INFO:teuthology.orchestra.run.smithi083.stdout:(117/146): python3-numpy-1.14.3-10.el8.x86_64.r 16 MB/s | 3.7 MB 00:00 2024-04-01T06:46:10.165 INFO:teuthology.orchestra.run.smithi083.stdout:(118/146): python3-babel-2.5.1-7.el8.noarch.rpm 12 MB/s | 4.8 MB 00:00 2024-04-01T06:46:10.190 INFO:teuthology.orchestra.run.smithi083.stdout:(119/146): python3-mako-1.0.6-14.el8.noarch.rpm 1.1 MB/s | 157 kB 00:00 2024-04-01T06:46:10.241 INFO:teuthology.orchestra.run.smithi083.stdout:(120/146): automake-1.16.1-8.el8.noarch.rpm 14 MB/s | 714 kB 00:00 2024-04-01T06:46:10.283 INFO:teuthology.orchestra.run.smithi083.stdout:(121/146): libpq-13.11-1.el8.x86_64.rpm 4.7 MB/s | 198 kB 00:00 2024-04-01T06:46:10.316 INFO:teuthology.orchestra.run.smithi083.stdout:(122/146): jq-1.6-7.el8.x86_64.rpm 6.0 MB/s | 202 kB 00:00 2024-04-01T06:46:10.350 INFO:teuthology.orchestra.run.smithi083.stdout:(123/146): python3-pytz-2017.2-11.el8.noarch.rp 1.6 MB/s | 54 kB 00:00 2024-04-01T06:46:10.425 INFO:teuthology.orchestra.run.smithi083.stdout:(124/146): openblas-threads-0.3.15-6.el8.x86_64 12 MB/s | 5.2 MB 00:00 2024-04-01T06:46:10.534 INFO:teuthology.orchestra.run.smithi083.stdout:(125/146): openblas-0.3.15-6.el8.x86_64.rpm 14 MB/s | 5.0 MB 00:00 2024-04-01T06:46:10.559 INFO:teuthology.orchestra.run.smithi083.stdout:(126/146): oniguruma-6.8.2-2.1.el8_9.x86_64.rpm 1.4 MB/s | 188 kB 00:00 2024-04-01T06:46:10.618 INFO:teuthology.orchestra.run.smithi083.stdout:(127/146): postgresql-10.23-4.module+el8.9.0+21 18 MB/s | 1.5 MB 00:00 2024-04-01T06:46:10.643 INFO:teuthology.orchestra.run.smithi083.stdout:(128/146): postgresql-contrib-10.23-4.module+el 9.5 MB/s | 812 kB 00:00 2024-04-01T06:46:10.785 INFO:teuthology.orchestra.run.smithi083.stdout:(129/146): postgresql-server-10.23-4.module+el8 30 MB/s | 5.1 MB 00:00 2024-04-01T06:46:10.940 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-04-01T06:46:10.950 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-04-01T06:46:10.985 INFO:teuthology.orchestra.run.smithi083.stdout:(130/146): python3-scipy-1.0.0-21.module+el8.9. 22 MB/s | 14 MB 00:00 2024-04-01T06:46:11.002 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction test succeeded. 2024-04-01T06:46:11.012 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction 2024-04-01T06:46:11.027 INFO:teuthology.orchestra.run.smithi083.stdout:(131/146): elfutils-libelf-0.189-3.el8.x86_64.r 5.5 MB/s | 232 kB 00:00 2024-04-01T06:46:11.061 INFO:teuthology.orchestra.run.smithi083.stdout:(132/146): elfutils-libs-0.189-3.el8.x86_64.rpm 9.2 MB/s | 303 kB 00:00 2024-04-01T06:46:11.103 INFO:teuthology.orchestra.run.smithi083.stdout:(133/146): libmount-2.32.1-43.el8.x86_64.rpm 5.6 MB/s | 237 kB 00:00 2024-04-01T06:46:11.136 INFO:teuthology.orchestra.run.smithi083.stdout:(134/146): libsmartcols-2.32.1-43.el8.x86_64.rp 5.3 MB/s | 179 kB 00:00 2024-04-01T06:46:11.170 INFO:teuthology.orchestra.run.smithi083.stdout:(135/146): libuuid-2.32.1-43.el8.x86_64.rpm 2.9 MB/s | 99 kB 00:00 2024-04-01T06:46:11.276 INFO:teuthology.orchestra.run.smithi083.stdout:(136/146): util-linux-2.32.1-43.el8.x86_64.rpm 23 MB/s | 2.5 MB 00:00 2024-04-01T06:46:11.312 INFO:teuthology.orchestra.run.smithi083.stdout:(137/146): util-linux-user-2.32.1-43.el8.x86_64 2.8 MB/s | 103 kB 00:00 2024-04-01T06:46:11.362 INFO:teuthology.orchestra.run.smithi083.stdout:(138/146): iproute-6.2.0-5.el8_9.x86_64.rpm 17 MB/s | 854 kB 00:00 2024-04-01T06:46:11.421 INFO:teuthology.orchestra.run.smithi083.stdout:(139/146): librados2-18.2.2-1001.g9d2ee692.el8. 4.7 MB/s | 3.7 MB 00:00 2024-04-01T06:46:11.447 INFO:teuthology.orchestra.run.smithi083.stdout:(140/146): libblkid-2.32.1-43.el8.x86_64.rpm 2.6 MB/s | 220 kB 00:00 2024-04-01T06:46:11.472 INFO:teuthology.orchestra.run.smithi083.stdout:(141/146): libfdisk-2.32.1-43.el8.x86_64.rpm 4.9 MB/s | 254 kB 00:00 2024-04-01T06:46:11.514 INFO:teuthology.orchestra.run.smithi083.stdout:(142/146): openssl-1.1.1k-12.el8_9.x86_64.rpm 10 MB/s | 711 kB 00:00 2024-04-01T06:46:11.581 INFO:teuthology.orchestra.run.smithi083.stdout:(143/146): librbd1-18.2.2-1001.g9d2ee692.el8.x8 4.5 MB/s | 3.6 MB 00:00 2024-04-01T06:46:11.614 INFO:teuthology.orchestra.run.smithi083.stdout:(144/146): xfsdump-3.1.8-7.el8_9.x86_64.rpm 3.2 MB/s | 333 kB 00:00 2024-04-01T06:46:11.689 INFO:teuthology.orchestra.run.smithi083.stdout:(145/146): openssl-libs-1.1.1k-12.el8_9.x86_64. 6.8 MB/s | 1.5 MB 00:00 2024-04-01T06:46:11.723 INFO:teuthology.orchestra.run.smithi083.stdout:(146/146): xfsprogs-5.0.0-12.el8.x86_64.rpm 7.5 MB/s | 1.1 MB 00:00 2024-04-01T06:46:11.726 INFO:teuthology.orchestra.run.smithi083.stdout:-------------------------------------------------------------------------------- 2024-04-01T06:46:11.726 INFO:teuthology.orchestra.run.smithi083.stdout:Total 9.0 MB/s | 213 MB 00:23 2024-04-01T06:46:12.740 INFO:teuthology.orchestra.run.smithi083.stdout:Running transaction check 2024-04-01T06:46:13.132 INFO:teuthology.orchestra.run.smithi083.stdout:Transaction check succeeded. 2024-04-01T06:46:13.133 INFO:teuthology.orchestra.run.smithi083.stdout:Running transaction test 2024-04-01T06:46:14.337 INFO:teuthology.orchestra.run.smithi083.stdout:Transaction test succeeded. 2024-04-01T06:46:14.347 INFO:teuthology.orchestra.run.smithi083.stdout:Running transaction 2024-04-01T06:46:16.829 INFO:teuthology.orchestra.run.smithi145.stdout: Preparing : 1/1 2024-04-01T06:46:16.964 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/1 2024-04-01T06:46:17.070 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-04-01T06:46:17.204 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/1 2024-04-01T06:46:17.215 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-04-01T06:46:17.414 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-04-01T06:46:17.465 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-04-01T06:46:17.609 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/162 2024-04-01T06:46:17.682 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-04-01T06:46:17.791 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : libuuid-2.32.1-43.el8.x86_64 3/162 2024-04-01T06:46:17.851 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 3/162 2024-04-01T06:46:17.852 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/162 2024-04-01T06:46:18.033 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : libblkid-2.32.1-43.el8.x86_64 4/162 2024-04-01T06:46:18.038 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : libuuid-2.32.1-43.el8.x86_64 3/162 2024-04-01T06:46:18.088 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libblkid-2.32.1-43.el8.x86_64 4/162 2024-04-01T06:46:18.111 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 3/162 2024-04-01T06:46:18.305 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : libblkid-2.32.1-43.el8.x86_64 4/162 2024-04-01T06:46:18.328 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/162 2024-04-01T06:46:18.363 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libblkid-2.32.1-43.el8.x86_64 4/162 2024-04-01T06:46:18.535 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/162 2024-04-01T06:46:18.539 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : librabbitmq-0.9.0-5.el8_9.x86_64 6/162 2024-04-01T06:46:18.733 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 7/162 2024-04-01T06:46:18.753 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librabbitmq-0.9.0-5.el8_9.x86_64 6/162 2024-04-01T06:46:18.827 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 7/162 2024-04-01T06:46:18.963 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 7/162 2024-04-01T06:46:19.016 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-04-01T06:46:19.045 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 7/162 2024-04-01T06:46:19.246 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-04-01T06:46:19.408 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-04-01T06:46:19.616 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : librados2-2:18.2.2-1001.g9d2ee692.el8.x86_64 9/162 2024-04-01T06:46:19.653 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-04-01T06:46:19.871 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : librados2-2:18.2.2-1001.g9d2ee692.el8.x86_64 9/162 2024-04-01T06:46:19.992 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librados2-2:18.2.2-1001.g9d2ee692.el8.x86_64 9/162 2024-04-01T06:46:20.182 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : librbd1-2:18.2.2-1001.g9d2ee692.el8.x86_64 10/162 2024-04-01T06:46:20.262 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librados2-2:18.2.2-1001.g9d2ee692.el8.x86_64 9/162 2024-04-01T06:46:20.320 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librbd1-2:18.2.2-1001.g9d2ee692.el8.x86_64 10/162 2024-04-01T06:46:20.455 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : librbd1-2:18.2.2-1001.g9d2ee692.el8.x86_64 10/162 2024-04-01T06:46:20.512 INFO:teuthology.orchestra.run.smithi083.stdout: Preparing : 1/1 2024-04-01T06:46:20.538 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libcephfs2-2:18.2.2-1001.g9d2ee692.el8.x86_64 11/162 2024-04-01T06:46:20.579 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librbd1-2:18.2.2-1001.g9d2ee692.el8.x86_64 10/162 2024-04-01T06:46:20.634 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libcephfs2-2:18.2.2-1001.g9d2ee692.el8.x86_64 11/162 2024-04-01T06:46:20.646 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/1 2024-04-01T06:46:20.822 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephfs2-2:18.2.2-1001.g9d2ee692.el8.x86_64 11/162 2024-04-01T06:46:20.918 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libcephfs2-2:18.2.2-1001.g9d2ee692.el8.x86_64 11/162 2024-04-01T06:46:20.918 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-04-01T06:46:20.959 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-rados-2:18.2.2-1001.g9d2ee692.el8.x86_64 12/162 2024-04-01T06:46:21.155 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-04-01T06:46:21.190 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-04-01T06:46:21.240 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rados-2:18.2.2-1001.g9d2ee692.el8.x86_64 12/162 2024-04-01T06:46:21.274 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-04-01T06:46:21.332 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/162 2024-04-01T06:46:21.480 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libpq-13.11-1.el8.x86_64 14/162 2024-04-01T06:46:21.496 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-04-01T06:46:21.535 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : libuuid-2.32.1-43.el8.x86_64 3/162 2024-04-01T06:46:21.567 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-04-01T06:46:21.608 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 3/162 2024-04-01T06:46:21.735 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 15/162 2024-04-01T06:46:21.785 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libpq-13.11-1.el8.x86_64 14/162 2024-04-01T06:46:21.819 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : libblkid-2.32.1-43.el8.x86_64 4/162 2024-04-01T06:46:21.869 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libblkid-2.32.1-43.el8.x86_64 4/162 2024-04-01T06:46:21.910 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/162 2024-04-01T06:46:22.009 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 15/162 2024-04-01T06:46:22.048 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/162 2024-04-01T06:46:22.174 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/162 2024-04-01T06:46:22.266 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : librabbitmq-0.9.0-5.el8_9.x86_64 6/162 2024-04-01T06:46:22.293 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 17/162 2024-04-01T06:46:22.469 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 7/162 2024-04-01T06:46:22.544 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 18/162 2024-04-01T06:46:22.559 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 17/162 2024-04-01T06:46:22.600 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 7/162 2024-04-01T06:46:22.715 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libcephsqlite-2:18.2.2-1001.g9d2ee692.el8.x86_64 19/162 2024-04-01T06:46:22.785 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-04-01T06:46:22.808 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 18/162 2024-04-01T06:46:22.817 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1001.g9d2ee692.el8.x86_64 19/162 2024-04-01T06:46:22.979 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephsqlite-2:18.2.2-1001.g9d2ee692.el8.x86_64 19/162 2024-04-01T06:46:22.981 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libradosstriper1-2:18.2.2-1001.g9d2ee692.el8.x86 20/162 2024-04-01T06:46:23.057 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1001.g9d2ee692.el8.x86 20/162 2024-04-01T06:46:23.093 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1001.g9d2ee692.el8.x86_64 19/162 2024-04-01T06:46:23.192 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-04-01T06:46:23.262 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libradosstriper1-2:18.2.2-1001.g9d2ee692.el8.x86 20/162 2024-04-01T06:46:23.277 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 21/162 2024-04-01T06:46:23.341 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1001.g9d2ee692.el8.x86 20/162 2024-04-01T06:46:23.410 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : librados2-2:18.2.2-1001.g9d2ee692.el8.x86_64 9/162 2024-04-01T06:46:23.491 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 21/162 2024-04-01T06:46:23.531 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 22/162 2024-04-01T06:46:23.762 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 23/162 2024-04-01T06:46:23.763 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 22/162 2024-04-01T06:46:23.800 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librados2-2:18.2.2-1001.g9d2ee692.el8.x86_64 9/162 2024-04-01T06:46:23.906 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 24/162 2024-04-01T06:46:23.977 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : librbd1-2:18.2.2-1001.g9d2ee692.el8.x86_64 10/162 2024-04-01T06:46:24.022 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 24/162 2024-04-01T06:46:24.043 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 23/162 2024-04-01T06:46:24.102 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librbd1-2:18.2.2-1001.g9d2ee692.el8.x86_64 10/162 2024-04-01T06:46:24.187 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 24/162 2024-04-01T06:46:24.215 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 25/162 2024-04-01T06:46:24.303 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libcephfs2-2:18.2.2-1001.g9d2ee692.el8.x86_64 11/162 2024-04-01T06:46:24.351 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 24/162 2024-04-01T06:46:24.406 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libcephfs2-2:18.2.2-1001.g9d2ee692.el8.x86_64 11/162 2024-04-01T06:46:24.729 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-rados-2:18.2.2-1001.g9d2ee692.el8.x86_64 12/162 2024-04-01T06:46:24.754 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 25/162 2024-04-01T06:46:24.843 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 25/162 2024-04-01T06:46:25.018 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-04-01T06:46:25.040 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 26/162 2024-04-01T06:46:25.089 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-04-01T06:46:25.316 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libpq-13.11-1.el8.x86_64 14/162 2024-04-01T06:46:25.378 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 25/162 2024-04-01T06:46:25.547 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 15/162 2024-04-01T06:46:25.570 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 26/162 2024-04-01T06:46:25.641 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 26/162 2024-04-01T06:46:25.746 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/162 2024-04-01T06:46:25.856 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : openblas-0.3.15-6.el8.x86_64 27/162 2024-04-01T06:46:26.132 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 17/162 2024-04-01T06:46:26.175 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 26/162 2024-04-01T06:46:26.330 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 18/162 2024-04-01T06:46:26.345 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : openblas-0.3.15-6.el8.x86_64 27/162 2024-04-01T06:46:26.518 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libcephsqlite-2:18.2.2-1001.g9d2ee692.el8.x86_64 19/162 2024-04-01T06:46:26.527 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 27/162 2024-04-01T06:46:26.625 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1001.g9d2ee692.el8.x86_64 19/162 2024-04-01T06:46:26.785 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libradosstriper1-2:18.2.2-1001.g9d2ee692.el8.x86 20/162 2024-04-01T06:46:26.787 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 28/162 2024-04-01T06:46:26.889 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1001.g9d2ee692.el8.x86 20/162 2024-04-01T06:46:26.969 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 29/162 2024-04-01T06:46:27.067 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 27/162 2024-04-01T06:46:27.071 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 21/162 2024-04-01T06:46:27.216 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 30/162 2024-04-01T06:46:27.301 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 28/162 2024-04-01T06:46:27.360 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 22/162 2024-04-01T06:46:27.379 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-ceph-common-2:18.2.2-1001.g9d2ee692.el8. 31/162 2024-04-01T06:46:27.518 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 29/162 2024-04-01T06:46:27.550 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-ceph-argparse-2:18.2.2-1001.g9d2ee692.el 32/162 2024-04-01T06:46:27.656 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 23/162 2024-04-01T06:46:27.793 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 24/162 2024-04-01T06:46:27.793 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cephfs-2:18.2.2-1001.g9d2ee692.el8.x86_6 33/162 2024-04-01T06:46:27.796 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 30/162 2024-04-01T06:46:27.910 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 24/162 2024-04-01T06:46:27.952 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-ceph-common-2:18.2.2-1001.g9d2ee692.el8. 31/162 2024-04-01T06:46:27.972 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/162 2024-04-01T06:46:28.093 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 25/162 2024-04-01T06:46:28.131 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-ceph-argparse-2:18.2.2-1001.g9d2ee692.el 32/162 2024-04-01T06:46:28.399 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cephfs-2:18.2.2-1001.g9d2ee692.el8.x86_6 33/162 2024-04-01T06:46:28.611 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/162 2024-04-01T06:46:28.717 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 25/162 2024-04-01T06:46:28.901 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 26/162 2024-04-01T06:46:29.507 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 26/162 2024-04-01T06:46:29.676 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : openblas-0.3.15-6.el8.x86_64 27/162 2024-04-01T06:46:29.708 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/162 2024-04-01T06:46:30.074 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 35/162 2024-04-01T06:46:30.359 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/162 2024-04-01T06:46:30.359 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 27/162 2024-04-01T06:46:30.615 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 28/162 2024-04-01T06:46:30.697 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 35/162 2024-04-01T06:46:30.831 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 29/162 2024-04-01T06:46:31.014 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 36/162 2024-04-01T06:46:31.061 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 30/162 2024-04-01T06:46:31.240 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-ceph-common-2:18.2.2-1001.g9d2ee692.el8. 31/162 2024-04-01T06:46:31.335 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 37/162 2024-04-01T06:46:31.370 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-ceph-argparse-2:18.2.2-1001.g9d2ee692.el 32/162 2024-04-01T06:46:31.572 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 38/162 2024-04-01T06:46:31.646 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cephfs-2:18.2.2-1001.g9d2ee692.el8.x86_6 33/162 2024-04-01T06:46:31.680 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 36/162 2024-04-01T06:46:31.816 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-rsa-4.9-2.el8.noarch 39/162 2024-04-01T06:46:31.817 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/162 2024-04-01T06:46:32.001 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 37/162 2024-04-01T06:46:32.032 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 40/162 2024-04-01T06:46:32.228 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-rbd-2:18.2.2-1001.g9d2ee692.el8.x86_64 41/162 2024-04-01T06:46:32.228 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 38/162 2024-04-01T06:46:32.427 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : librados-devel-2:18.2.2-1001.g9d2ee692.el8.x86_6 42/162 2024-04-01T06:46:32.480 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rsa-4.9-2.el8.noarch 39/162 2024-04-01T06:46:32.646 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : libmount-2.32.1-43.el8.x86_64 43/162 2024-04-01T06:46:32.725 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libmount-2.32.1-43.el8.x86_64 43/162 2024-04-01T06:46:32.730 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 40/162 2024-04-01T06:46:32.930 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : libfdisk-2.32.1-43.el8.x86_64 44/162 2024-04-01T06:46:32.959 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rbd-2:18.2.2-1001.g9d2ee692.el8.x86_64 41/162 2024-04-01T06:46:32.984 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libfdisk-2.32.1-43.el8.x86_64 44/162 2024-04-01T06:46:33.101 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librados-devel-2:18.2.2-1001.g9d2ee692.el8.x86_6 42/162 2024-04-01T06:46:33.199 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libuuid-devel-2.32.1-43.el8.x86_64 45/162 2024-04-01T06:46:33.319 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : libmount-2.32.1-43.el8.x86_64 43/162 2024-04-01T06:46:33.398 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libmount-2.32.1-43.el8.x86_64 43/162 2024-04-01T06:46:33.440 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/162 2024-04-01T06:46:33.560 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/162 2024-04-01T06:46:33.619 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : libfdisk-2.32.1-43.el8.x86_64 44/162 2024-04-01T06:46:33.655 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : libsmartcols-2.32.1-43.el8.x86_64 47/162 2024-04-01T06:46:33.693 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libfdisk-2.32.1-43.el8.x86_64 44/162 2024-04-01T06:46:33.927 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 35/162 2024-04-01T06:46:33.957 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libuuid-devel-2.32.1-43.el8.x86_64 45/162 2024-04-01T06:46:34.086 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libsmartcols-2.32.1-43.el8.x86_64 47/162 2024-04-01T06:46:34.188 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/162 2024-04-01T06:46:34.361 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : libsmartcols-2.32.1-43.el8.x86_64 47/162 2024-04-01T06:46:34.388 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : util-linux-2.32.1-43.el8.x86_64 48/162 2024-04-01T06:46:34.416 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: util-linux-2.32.1-43.el8.x86_64 48/162 2024-04-01T06:46:34.580 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : oniguruma-6.8.2-2.1.el8_9.x86_64 49/162 2024-04-01T06:46:34.658 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: oniguruma-6.8.2-2.1.el8_9.x86_64 49/162 2024-04-01T06:46:34.795 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libsmartcols-2.32.1-43.el8.x86_64 47/162 2024-04-01T06:46:34.917 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : jq-1.6-7.el8.x86_64 50/162 2024-04-01T06:46:34.925 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 36/162 2024-04-01T06:46:35.146 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : automake-1.16.1-8.el8.noarch 51/162 2024-04-01T06:46:35.178 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : util-linux-2.32.1-43.el8.x86_64 48/162 2024-04-01T06:46:35.205 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: util-linux-2.32.1-43.el8.x86_64 48/162 2024-04-01T06:46:35.280 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 37/162 2024-04-01T06:46:35.313 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : uuid-1.6.2-43.el8.x86_64 52/162 2024-04-01T06:46:35.368 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 52/162 2024-04-01T06:46:35.400 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : oniguruma-6.8.2-2.1.el8_9.x86_64 49/162 2024-04-01T06:46:35.489 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: oniguruma-6.8.2-2.1.el8_9.x86_64 49/162 2024-04-01T06:46:35.534 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 38/162 2024-04-01T06:46:35.561 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 53/162 2024-04-01T06:46:35.729 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : jq-1.6-7.el8.x86_64 50/162 2024-04-01T06:46:35.738 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 54/162 2024-04-01T06:46:35.803 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-rsa-4.9-2.el8.noarch 39/162 2024-04-01T06:46:35.928 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : automake-1.16.1-8.el8.noarch 51/162 2024-04-01T06:46:35.955 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 55/162 2024-04-01T06:46:36.027 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 40/162 2024-04-01T06:46:36.094 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : uuid-1.6.2-43.el8.x86_64 52/162 2024-04-01T06:46:36.159 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : fuse-2.9.7-17.el8.x86_64 56/162 2024-04-01T06:46:36.166 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 52/162 2024-04-01T06:46:36.270 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-rbd-2:18.2.2-1001.g9d2ee692.el8.x86_64 41/162 2024-04-01T06:46:36.359 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 53/162 2024-04-01T06:46:36.367 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 57/162 2024-04-01T06:46:36.431 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : librados-devel-2:18.2.2-1001.g9d2ee692.el8.x86_6 42/162 2024-04-01T06:46:36.526 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 54/162 2024-04-01T06:46:36.558 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 58/162 2024-04-01T06:46:36.641 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : libmount-2.32.1-43.el8.x86_64 43/162 2024-04-01T06:46:36.701 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libmount-2.32.1-43.el8.x86_64 43/162 2024-04-01T06:46:36.753 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 55/162 2024-04-01T06:46:36.801 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 59/162 2024-04-01T06:46:36.931 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : fuse-2.9.7-17.el8.x86_64 56/162 2024-04-01T06:46:36.933 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : libfdisk-2.32.1-43.el8.x86_64 44/162 2024-04-01T06:46:36.974 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 60/162 2024-04-01T06:46:36.985 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libfdisk-2.32.1-43.el8.x86_64 44/162 2024-04-01T06:46:37.177 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 57/162 2024-04-01T06:46:37.222 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libuuid-devel-2.32.1-43.el8.x86_64 45/162 2024-04-01T06:46:37.248 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 61/162 2024-04-01T06:46:37.374 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 58/162 2024-04-01T06:46:37.436 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/162 2024-04-01T06:46:37.507 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 62/162 2024-04-01T06:46:37.566 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 59/162 2024-04-01T06:46:37.625 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : libsmartcols-2.32.1-43.el8.x86_64 47/162 2024-04-01T06:46:37.718 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 63/162 2024-04-01T06:46:37.756 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 60/162 2024-04-01T06:46:37.874 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 64/162 2024-04-01T06:46:38.074 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 61/162 2024-04-01T06:46:38.075 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libsmartcols-2.32.1-43.el8.x86_64 47/162 2024-04-01T06:46:38.080 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 65/162 2024-04-01T06:46:38.367 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : util-linux-2.32.1-43.el8.x86_64 48/162 2024-04-01T06:46:38.373 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 62/162 2024-04-01T06:46:38.394 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: util-linux-2.32.1-43.el8.x86_64 48/162 2024-04-01T06:46:38.401 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 66/162 2024-04-01T06:46:38.592 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : oniguruma-6.8.2-2.1.el8_9.x86_64 49/162 2024-04-01T06:46:38.598 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 63/162 2024-04-01T06:46:38.673 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cryptography-3.2.1-7.el8_9.x86_64 67/162 2024-04-01T06:46:38.674 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: oniguruma-6.8.2-2.1.el8_9.x86_64 49/162 2024-04-01T06:46:38.781 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 64/162 2024-04-01T06:46:38.910 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : jq-1.6-7.el8.x86_64 50/162 2024-04-01T06:46:38.930 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 68/162 2024-04-01T06:46:39.012 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 65/162 2024-04-01T06:46:39.117 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : automake-1.16.1-8.el8.noarch 51/162 2024-04-01T06:46:39.134 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 69/162 2024-04-01T06:46:39.296 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 70/162 2024-04-01T06:46:39.325 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : uuid-1.6.2-43.el8.x86_64 52/162 2024-04-01T06:46:39.358 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 66/162 2024-04-01T06:46:39.392 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 52/162 2024-04-01T06:46:39.555 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 71/162 2024-04-01T06:46:39.590 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 53/162 2024-04-01T06:46:39.646 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cryptography-3.2.1-7.el8_9.x86_64 67/162 2024-04-01T06:46:39.782 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 54/162 2024-04-01T06:46:39.782 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 72/162 2024-04-01T06:46:39.952 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 68/162 2024-04-01T06:46:39.959 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 55/162 2024-04-01T06:46:40.062 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 73/162 2024-04-01T06:46:40.179 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : fuse-2.9.7-17.el8.x86_64 56/162 2024-04-01T06:46:40.184 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 69/162 2024-04-01T06:46:40.256 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 74/162 2024-04-01T06:46:40.365 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 57/162 2024-04-01T06:46:40.403 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 70/162 2024-04-01T06:46:40.445 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 75/162 2024-04-01T06:46:40.555 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 58/162 2024-04-01T06:46:40.646 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 71/162 2024-04-01T06:46:40.699 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 76/162 2024-04-01T06:46:40.749 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 59/162 2024-04-01T06:46:40.881 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 72/162 2024-04-01T06:46:40.905 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-packaging-16.8-9.el8.noarch 77/162 2024-04-01T06:46:40.962 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 60/162 2024-04-01T06:46:41.063 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 78/162 2024-04-01T06:46:41.119 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 73/162 2024-04-01T06:46:41.225 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 79/162 2024-04-01T06:46:41.246 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 61/162 2024-04-01T06:46:41.295 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 74/162 2024-04-01T06:46:41.507 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 75/162 2024-04-01T06:46:41.523 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 62/162 2024-04-01T06:46:41.524 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 80/162 2024-04-01T06:46:41.763 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 63/162 2024-04-01T06:46:41.770 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 76/162 2024-04-01T06:46:41.810 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 81/162 2024-04-01T06:46:41.912 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 64/162 2024-04-01T06:46:41.936 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-packaging-16.8-9.el8.noarch 77/162 2024-04-01T06:46:41.974 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 82/162 2024-04-01T06:46:42.101 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 78/162 2024-04-01T06:46:42.148 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 83/162 2024-04-01T06:46:42.160 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 65/162 2024-04-01T06:46:42.272 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 79/162 2024-04-01T06:46:42.363 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 84/162 2024-04-01T06:46:42.499 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 66/162 2024-04-01T06:46:42.581 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 80/162 2024-04-01T06:46:42.599 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 85/162 2024-04-01T06:46:42.769 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cryptography-3.2.1-7.el8_9.x86_64 67/162 2024-04-01T06:46:42.808 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 81/162 2024-04-01T06:46:42.866 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 86/162 2024-04-01T06:46:43.005 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 82/162 2024-04-01T06:46:43.056 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 87/162 2024-04-01T06:46:43.082 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 68/162 2024-04-01T06:46:43.171 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 83/162 2024-04-01T06:46:43.217 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 88/162 2024-04-01T06:46:43.332 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 69/162 2024-04-01T06:46:43.392 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 84/162 2024-04-01T06:46:43.456 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 89/162 2024-04-01T06:46:43.500 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 70/162 2024-04-01T06:46:43.581 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 85/162 2024-04-01T06:46:43.669 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 90/162 2024-04-01T06:46:43.795 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 71/162 2024-04-01T06:46:43.817 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 91/162 2024-04-01T06:46:43.855 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 86/162 2024-04-01T06:46:44.029 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 87/162 2024-04-01T06:46:44.055 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-portend-2.6-1.el8.noarch 92/162 2024-04-01T06:46:44.066 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 72/162 2024-04-01T06:46:44.165 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 88/162 2024-04-01T06:46:44.300 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 73/162 2024-04-01T06:46:44.335 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 93/162 2024-04-01T06:46:44.414 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 89/162 2024-04-01T06:46:44.509 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 94/162 2024-04-01T06:46:44.526 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 74/162 2024-04-01T06:46:44.659 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 90/162 2024-04-01T06:46:44.713 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 75/162 2024-04-01T06:46:44.727 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 95/162 2024-04-01T06:46:44.823 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 91/162 2024-04-01T06:46:44.983 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 76/162 2024-04-01T06:46:45.080 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-portend-2.6-1.el8.noarch 92/162 2024-04-01T06:46:45.208 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-packaging-16.8-9.el8.noarch 77/162 2024-04-01T06:46:45.367 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 93/162 2024-04-01T06:46:45.374 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 78/162 2024-04-01T06:46:45.592 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 94/162 2024-04-01T06:46:45.595 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 79/162 2024-04-01T06:46:45.804 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 96/162 2024-04-01T06:46:45.859 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 95/162 2024-04-01T06:46:45.878 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 80/162 2024-04-01T06:46:46.139 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 97/162 2024-04-01T06:46:46.156 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 81/162 2024-04-01T06:46:46.351 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 98/162 2024-04-01T06:46:46.412 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 82/162 2024-04-01T06:46:46.577 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 83/162 2024-04-01T06:46:46.635 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 99/162 2024-04-01T06:46:46.813 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 84/162 2024-04-01T06:46:46.911 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 100/162 2024-04-01T06:46:46.926 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 96/162 2024-04-01T06:46:47.014 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 85/162 2024-04-01T06:46:47.135 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 101/162 2024-04-01T06:46:47.229 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 97/162 2024-04-01T06:46:47.298 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 86/162 2024-04-01T06:46:47.474 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 98/162 2024-04-01T06:46:47.477 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 87/162 2024-04-01T06:46:47.655 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 88/162 2024-04-01T06:46:47.792 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 99/162 2024-04-01T06:46:47.869 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 89/162 2024-04-01T06:46:47.918 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 102/162 2024-04-01T06:46:48.076 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 100/162 2024-04-01T06:46:48.118 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 90/162 2024-04-01T06:46:48.119 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : librgw2-2:18.2.2-1001.g9d2ee692.el8.x86_64 103/162 2024-04-01T06:46:48.193 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librgw2-2:18.2.2-1001.g9d2ee692.el8.x86_64 103/162 2024-04-01T06:46:48.279 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 91/162 2024-04-01T06:46:48.283 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 101/162 2024-04-01T06:46:48.361 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-rgw-2:18.2.2-1001.g9d2ee692.el8.x86_64 104/162 2024-04-01T06:46:48.561 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-portend-2.6-1.el8.noarch 92/162 2024-04-01T06:46:48.814 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 93/162 2024-04-01T06:46:48.989 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 94/162 2024-04-01T06:46:49.067 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 102/162 2024-04-01T06:46:49.248 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 95/162 2024-04-01T06:46:49.283 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librgw2-2:18.2.2-1001.g9d2ee692.el8.x86_64 103/162 2024-04-01T06:46:49.357 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librgw2-2:18.2.2-1001.g9d2ee692.el8.x86_64 103/162 2024-04-01T06:46:49.542 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rgw-2:18.2.2-1001.g9d2ee692.el8.x86_64 104/162 2024-04-01T06:46:50.339 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 96/162 2024-04-01T06:46:50.652 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 97/162 2024-04-01T06:46:50.898 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 98/162 2024-04-01T06:46:51.224 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 99/162 2024-04-01T06:46:51.649 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 100/162 2024-04-01T06:46:52.054 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-common-2:18.2.2-1001.g9d2ee692.el8.x86_64 105/162 2024-04-01T06:46:52.183 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 101/162 2024-04-01T06:46:52.268 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-common-2:18.2.2-1001.g9d2ee692.el8.x86_64 105/162 2024-04-01T06:46:52.861 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-common-2:18.2.2-1001.g9d2ee692.el8.x86_64 105/162 2024-04-01T06:46:52.982 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 102/162 2024-04-01T06:46:53.117 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-base-2:18.2.2-1001.g9d2ee692.el8.x86_64 106/162 2024-04-01T06:46:53.187 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-base-2:18.2.2-1001.g9d2ee692.el8.x86_64 106/162 2024-04-01T06:46:53.206 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : librgw2-2:18.2.2-1001.g9d2ee692.el8.x86_64 103/162 2024-04-01T06:46:53.283 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librgw2-2:18.2.2-1001.g9d2ee692.el8.x86_64 103/162 2024-04-01T06:46:53.335 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-selinux-2:18.2.2-1001.g9d2ee692.el8.x86_64 107/162 2024-04-01T06:46:53.490 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-rgw-2:18.2.2-1001.g9d2ee692.el8.x86_64 104/162 2024-04-01T06:46:53.984 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-common-2:18.2.2-1001.g9d2ee692.el8.x86_64 105/162 2024-04-01T06:46:54.249 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-common-2:18.2.2-1001.g9d2ee692.el8.x86_64 105/162 2024-04-01T06:46:54.840 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-common-2:18.2.2-1001.g9d2ee692.el8.x86_64 105/162 2024-04-01T06:46:55.126 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-base-2:18.2.2-1001.g9d2ee692.el8.x86_64 106/162 2024-04-01T06:46:55.209 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-base-2:18.2.2-1001.g9d2ee692.el8.x86_64 106/162 2024-04-01T06:46:55.357 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-selinux-2:18.2.2-1001.g9d2ee692.el8.x86_64 107/162 2024-04-01T06:46:57.313 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-common-2:18.2.2-1001.g9d2ee692.el8.x86_64 105/162 2024-04-01T06:46:57.872 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-common-2:18.2.2-1001.g9d2ee692.el8.x86_64 105/162 2024-04-01T06:46:58.466 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-common-2:18.2.2-1001.g9d2ee692.el8.x86_64 105/162 2024-04-01T06:46:58.755 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-base-2:18.2.2-1001.g9d2ee692.el8.x86_64 106/162 2024-04-01T06:46:58.828 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-base-2:18.2.2-1001.g9d2ee692.el8.x86_64 106/162 2024-04-01T06:46:59.030 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-selinux-2:18.2.2-1001.g9d2ee692.el8.x86_64 107/162 2024-04-01T06:47:12.610 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1001.g9d2ee692.el8.x86_64 107/162 2024-04-01T06:47:12.611 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /sys 2024-04-01T06:47:12.611 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /proc 2024-04-01T06:47:12.611 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /dev 2024-04-01T06:47:12.611 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /run 2024-04-01T06:47:12.611 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /mnt 2024-04-01T06:47:12.611 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /var/tmp 2024-04-01T06:47:12.611 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /home 2024-04-01T06:47:12.611 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /tmp 2024-04-01T06:47:12.611 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /dev 2024-04-01T06:47:12.611 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-01T06:47:12.956 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-volume-2:18.2.2-1001.g9d2ee692.el8.noarch 108/162 2024-04-01T06:47:14.587 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-volume-2:18.2.2-1001.g9d2ee692.el8.noarch 108/162 2024-04-01T06:47:14.772 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-osd-2:18.2.2-1001.g9d2ee692.el8.x86_64 109/162 2024-04-01T06:47:14.904 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1001.g9d2ee692.el8.x86_64 107/162 2024-04-01T06:47:14.904 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /sys 2024-04-01T06:47:14.904 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /proc 2024-04-01T06:47:14.904 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /dev 2024-04-01T06:47:14.904 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /run 2024-04-01T06:47:14.904 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /mnt 2024-04-01T06:47:14.904 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /var/tmp 2024-04-01T06:47:14.904 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /home 2024-04-01T06:47:14.905 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /tmp 2024-04-01T06:47:14.905 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /dev 2024-04-01T06:47:14.905 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-01T06:47:14.992 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-osd-2:18.2.2-1001.g9d2ee692.el8.x86_64 109/162 2024-04-01T06:47:15.156 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mds-2:18.2.2-1001.g9d2ee692.el8.x86_64 110/162 2024-04-01T06:47:15.288 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-volume-2:18.2.2-1001.g9d2ee692.el8.noarch 108/162 2024-04-01T06:47:15.632 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mds-2:18.2.2-1001.g9d2ee692.el8.x86_64 110/162 2024-04-01T06:47:15.797 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mon-2:18.2.2-1001.g9d2ee692.el8.x86_64 111/162 2024-04-01T06:47:15.815 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mon-2:18.2.2-1001.g9d2ee692.el8.x86_64 111/162 2024-04-01T06:47:16.922 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-volume-2:18.2.2-1001.g9d2ee692.el8.noarch 108/162 2024-04-01T06:47:17.089 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-osd-2:18.2.2-1001.g9d2ee692.el8.x86_64 109/162 2024-04-01T06:47:17.310 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-osd-2:18.2.2-1001.g9d2ee692.el8.x86_64 109/162 2024-04-01T06:47:17.446 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mds-2:18.2.2-1001.g9d2ee692.el8.x86_64 110/162 2024-04-01T06:47:17.542 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: cephadm-2:18.2.2-1001.g9d2ee692.el8.noarch 112/162 2024-04-01T06:47:17.699 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : cephadm-2:18.2.2-1001.g9d2ee692.el8.noarch 112/162 2024-04-01T06:47:17.811 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1001.g9d2ee692.e 113/162 2024-04-01T06:47:17.921 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mds-2:18.2.2-1001.g9d2ee692.el8.x86_64 110/162 2024-04-01T06:47:17.980 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1001.g9d2ee692. 114/162 2024-04-01T06:47:18.063 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mon-2:18.2.2-1001.g9d2ee692.el8.x86_64 111/162 2024-04-01T06:47:18.081 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mon-2:18.2.2-1001.g9d2ee692.el8.x86_64 111/162 2024-04-01T06:47:18.205 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1001.g9d2ee692.el8.noa 115/162 2024-04-01T06:47:18.434 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1001.g9d2ee692.el8.noa 115/162 2024-04-01T06:47:18.479 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1001.g9d2ee692.el8.x86_64 107/162 2024-04-01T06:47:18.479 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /sys 2024-04-01T06:47:18.479 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /proc 2024-04-01T06:47:18.479 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /dev 2024-04-01T06:47:18.479 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /run 2024-04-01T06:47:18.480 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /mnt 2024-04-01T06:47:18.480 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /var/tmp 2024-04-01T06:47:18.480 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /home 2024-04-01T06:47:18.480 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /tmp 2024-04-01T06:47:18.480 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /dev 2024-04-01T06:47:18.480 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:47:18.737 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1001.g9d2ee692.el8.n 116/162 2024-04-01T06:47:18.853 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-volume-2:18.2.2-1001.g9d2ee692.el8.noarch 108/162 2024-04-01T06:47:19.706 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1001.g9d2ee692.el8.n 116/162 2024-04-01T06:47:19.814 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: cephadm-2:18.2.2-1001.g9d2ee692.el8.noarch 112/162 2024-04-01T06:47:19.871 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1001.g9d2 117/162 2024-04-01T06:47:19.964 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1001.g9d2 117/162 2024-04-01T06:47:19.966 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : cephadm-2:18.2.2-1001.g9d2ee692.el8.noarch 112/162 2024-04-01T06:47:20.109 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1001.g9d2ee692.e 113/162 2024-04-01T06:47:20.262 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1001.g9d2ee692. 114/162 2024-04-01T06:47:20.340 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1001.g9d2ee692.el 118/162 2024-04-01T06:47:20.478 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1001.g9d2ee692.el8.noa 115/162 2024-04-01T06:47:20.486 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-volume-2:18.2.2-1001.g9d2ee692.el8.noarch 108/162 2024-04-01T06:47:20.537 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-2:18.2.2-1001.g9d2ee692.el8.x86_64 119/162 2024-04-01T06:47:20.575 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1001.g9d2ee692.el8.x86_64 119/162 2024-04-01T06:47:20.644 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-osd-2:18.2.2-1001.g9d2ee692.el8.x86_64 109/162 2024-04-01T06:47:20.706 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1001.g9d2ee692.el8.noa 115/162 2024-04-01T06:47:20.729 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-rook-2:18.2.2-1001.g9d2ee692.el8.noarch 120/162 2024-04-01T06:47:20.741 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1001.g9d2ee692.el8.noarch 120/162 2024-04-01T06:47:20.864 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-osd-2:18.2.2-1001.g9d2ee692.el8.x86_64 109/162 2024-04-01T06:47:21.013 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1001.g9d2ee692.el8.n 116/162 2024-04-01T06:47:21.028 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mds-2:18.2.2-1001.g9d2ee692.el8.x86_64 110/162 2024-04-01T06:47:21.506 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mds-2:18.2.2-1001.g9d2ee692.el8.x86_64 110/162 2024-04-01T06:47:21.678 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mon-2:18.2.2-1001.g9d2ee692.el8.x86_64 111/162 2024-04-01T06:47:21.695 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mon-2:18.2.2-1001.g9d2ee692.el8.x86_64 111/162 2024-04-01T06:47:21.981 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1001.g9d2ee692.el8.n 116/162 2024-04-01T06:47:22.007 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-2:18.2.2-1001.g9d2ee692.el8.x86_64 121/162 2024-04-01T06:47:22.136 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1001.g9d2 117/162 2024-04-01T06:47:22.231 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1001.g9d2 117/162 2024-04-01T06:47:22.254 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-radosgw-2:18.2.2-1001.g9d2ee692.el8.x86_64 122/162 2024-04-01T06:47:22.289 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1001.g9d2ee692.el8.x86_64 122/162 2024-04-01T06:47:22.437 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1001.g9d2ee 123/162 2024-04-01T06:47:22.480 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1001.g9d2ee 123/162 2024-04-01T06:47:22.585 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1001.g9d2ee692.el 118/162 2024-04-01T06:47:22.637 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : cephfs-mirror-2:18.2.2-1001.g9d2ee692.el8.x86_64 124/162 2024-04-01T06:47:22.755 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-2:18.2.2-1001.g9d2ee692.el8.x86_64 119/162 2024-04-01T06:47:22.793 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1001.g9d2ee692.el8.x86_64 119/162 2024-04-01T06:47:22.977 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-rook-2:18.2.2-1001.g9d2ee692.el8.noarch 120/162 2024-04-01T06:47:22.986 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: cephfs-mirror-2:18.2.2-1001.g9d2ee692.el8.x86_64 124/162 2024-04-01T06:47:22.989 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1001.g9d2ee692.el8.noarch 120/162 2024-04-01T06:47:23.196 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : rbd-mirror-2:18.2.2-1001.g9d2ee692.el8.x86_64 125/162 2024-04-01T06:47:23.481 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: cephadm-2:18.2.2-1001.g9d2ee692.el8.noarch 112/162 2024-04-01T06:47:23.662 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : cephadm-2:18.2.2-1001.g9d2ee692.el8.noarch 112/162 2024-04-01T06:47:23.791 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1001.g9d2ee692.e 113/162 2024-04-01T06:47:24.003 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1001.g9d2ee692. 114/162 2024-04-01T06:47:24.218 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1001.g9d2ee692.el8.noa 115/162 2024-04-01T06:47:24.291 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-2:18.2.2-1001.g9d2ee692.el8.x86_64 121/162 2024-04-01T06:47:24.448 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1001.g9d2ee692.el8.noa 115/162 2024-04-01T06:47:24.504 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-radosgw-2:18.2.2-1001.g9d2ee692.el8.x86_64 122/162 2024-04-01T06:47:24.539 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1001.g9d2ee692.el8.x86_64 122/162 2024-04-01T06:47:24.727 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1001.g9d2ee 123/162 2024-04-01T06:47:24.771 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1001.g9d2ee 123/162 2024-04-01T06:47:24.784 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1001.g9d2ee692.el8.n 116/162 2024-04-01T06:47:24.919 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : cephfs-mirror-2:18.2.2-1001.g9d2ee692.el8.x86_64 124/162 2024-04-01T06:47:25.266 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: cephfs-mirror-2:18.2.2-1001.g9d2ee692.el8.x86_64 124/162 2024-04-01T06:47:25.469 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-mirror-2:18.2.2-1001.g9d2ee692.el8.x86_64 125/162 2024-04-01T06:47:25.752 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1001.g9d2ee692.el8.n 116/162 2024-04-01T06:47:25.935 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1001.g9d2 117/162 2024-04-01T06:47:26.028 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1001.g9d2 117/162 2024-04-01T06:47:26.431 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1001.g9d2ee692.el 118/162 2024-04-01T06:47:26.593 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-2:18.2.2-1001.g9d2ee692.el8.x86_64 119/162 2024-04-01T06:47:26.631 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1001.g9d2ee692.el8.x86_64 119/162 2024-04-01T06:47:26.776 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-rook-2:18.2.2-1001.g9d2ee692.el8.noarch 120/162 2024-04-01T06:47:26.788 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1001.g9d2ee692.el8.noarch 120/162 2024-04-01T06:47:27.678 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1001.g9d2ee692.el8.x86_64 125/162 2024-04-01T06:47:28.050 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-2:18.2.2-1001.g9d2ee692.el8.x86_64 121/162 2024-04-01T06:47:28.292 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-radosgw-2:18.2.2-1001.g9d2ee692.el8.x86_64 122/162 2024-04-01T06:47:28.327 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1001.g9d2ee692.el8.x86_64 122/162 2024-04-01T06:47:28.510 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1001.g9d2ee 123/162 2024-04-01T06:47:28.553 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1001.g9d2ee 123/162 2024-04-01T06:47:28.615 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-test-2:18.2.2-1001.g9d2ee692.el8.x86_64 126/162 2024-04-01T06:47:28.751 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : cephfs-mirror-2:18.2.2-1001.g9d2ee692.el8.x86_64 124/162 2024-04-01T06:47:28.891 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : openssl-devel-1:1.1.1k-12.el8_9.x86_64 127/162 2024-04-01T06:47:29.100 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: cephfs-mirror-2:18.2.2-1001.g9d2ee692.el8.x86_64 124/162 2024-04-01T06:47:29.185 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 128/162 2024-04-01T06:47:29.276 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : rbd-mirror-2:18.2.2-1001.g9d2ee692.el8.x86_64 125/162 2024-04-01T06:47:29.535 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-fuse-2:18.2.2-1001.g9d2ee692.el8.x86_64 129/162 2024-04-01T06:47:29.855 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 130/162 2024-04-01T06:47:29.950 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1001.g9d2ee692.el8.x86_64 125/162 2024-04-01T06:47:30.097 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libtool-2.4.6-25.el8.x86_64 131/162 2024-04-01T06:47:30.110 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 131/162 2024-04-01T06:47:30.305 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : util-linux-user-2.32.1-43.el8.x86_64 132/162 2024-04-01T06:47:30.515 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/162 2024-04-01T06:47:30.712 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libcephfs-devel-2:18.2.2-1001.g9d2ee692.el8.x86_ 134/162 2024-04-01T06:47:30.919 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-test-2:18.2.2-1001.g9d2ee692.el8.x86_64 126/162 2024-04-01T06:47:31.231 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : openssl-devel-1:1.1.1k-12.el8_9.x86_64 127/162 2024-04-01T06:47:31.533 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 128/162 2024-04-01T06:47:31.887 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-fuse-2:18.2.2-1001.g9d2ee692.el8.x86_64 129/162 2024-04-01T06:47:32.212 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 130/162 2024-04-01T06:47:32.476 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libtool-2.4.6-25.el8.x86_64 131/162 2024-04-01T06:47:32.490 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 131/162 2024-04-01T06:47:32.746 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : util-linux-user-2.32.1-43.el8.x86_64 132/162 2024-04-01T06:47:32.937 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-04-01T06:47:32.956 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/162 2024-04-01T06:47:33.152 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephfs-devel-2:18.2.2-1001.g9d2ee692.el8.x86_ 134/162 2024-04-01T06:47:33.244 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-04-01T06:47:33.283 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-04-01T06:47:33.697 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 136/162 2024-04-01T06:47:33.760 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1001.g9d2ee692.el8.x86_64 125/162 2024-04-01T06:47:34.051 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : iproute-6.2.0-5.el8_9.x86_64 137/162 2024-04-01T06:47:34.256 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : xfsdump-3.1.8-7.el8_9.x86_64 138/162 2024-04-01T06:47:34.444 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : cephfs-top-2:18.2.2-1001.g9d2ee692.el8.noarch 139/162 2024-04-01T06:47:34.635 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : rbd-fuse-2:18.2.2-1001.g9d2ee692.el8.x86_64 140/162 2024-04-01T06:47:34.743 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-test-2:18.2.2-1001.g9d2ee692.el8.x86_64 126/162 2024-04-01T06:47:34.943 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : rbd-nbd-2:18.2.2-1001.g9d2ee692.el8.x86_64 141/162 2024-04-01T06:47:35.014 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : openssl-devel-1:1.1.1k-12.el8_9.x86_64 127/162 2024-04-01T06:47:35.195 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : openssl-1:1.1.1k-12.el8_9.x86_64 142/162 2024-04-01T06:47:35.308 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 128/162 2024-04-01T06:47:35.385 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : flex-2.6.1-9.el8.x86_64 143/162 2024-04-01T06:47:35.441 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-04-01T06:47:35.461 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 143/162 2024-04-01T06:47:35.677 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : bison-3.0.4-10.el8.x86_64 144/162 2024-04-01T06:47:35.690 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 144/162 2024-04-01T06:47:35.727 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-fuse-2:18.2.2-1001.g9d2ee692.el8.x86_64 129/162 2024-04-01T06:47:35.776 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-04-01T06:47:35.814 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-04-01T06:47:35.852 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : NetworkManager-initscripts-updown-1:1.40.16-13.e 145/162 2024-04-01T06:47:35.861 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-13.e 145/162 2024-04-01T06:47:35.987 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 146/162 2024-04-01T06:47:36.052 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 130/162 2024-04-01T06:47:36.146 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 147/162 2024-04-01T06:47:36.249 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 136/162 2024-04-01T06:47:36.253 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libtool-2.4.6-25.el8.x86_64 131/162 2024-04-01T06:47:36.267 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 131/162 2024-04-01T06:47:36.311 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 148/162 2024-04-01T06:47:36.512 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : util-linux-user-2.32.1-43.el8.x86_64 132/162 2024-04-01T06:47:36.521 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 149/162 2024-04-01T06:47:36.521 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-04-01T06:47:36.641 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : iproute-6.2.0-5.el8_9.x86_64 137/162 2024-04-01T06:47:36.763 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/162 2024-04-01T06:47:36.771 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-04-01T06:47:36.771 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-04-01T06:47:36.896 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : xfsdump-3.1.8-7.el8_9.x86_64 138/162 2024-04-01T06:47:36.926 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libcephfs-devel-2:18.2.2-1001.g9d2ee692.el8.x86_ 134/162 2024-04-01T06:47:36.988 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-04-01T06:47:36.988 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 152/162 2024-04-01T06:47:37.126 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : cephfs-top-2:18.2.2-1001.g9d2ee692.el8.noarch 139/162 2024-04-01T06:47:37.223 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 152/162 2024-04-01T06:47:37.333 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-fuse-2:18.2.2-1001.g9d2ee692.el8.x86_64 140/162 2024-04-01T06:47:37.453 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 153/162 2024-04-01T06:47:37.595 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 154/162 2024-04-01T06:47:37.647 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-nbd-2:18.2.2-1001.g9d2ee692.el8.x86_64 141/162 2024-04-01T06:47:37.828 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 155/162 2024-04-01T06:47:37.828 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 156/162 2024-04-01T06:47:37.938 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : openssl-1:1.1.1k-12.el8_9.x86_64 142/162 2024-04-01T06:47:38.079 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 156/162 2024-04-01T06:47:38.079 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 157/162 2024-04-01T06:47:38.158 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : flex-2.6.1-9.el8.x86_64 143/162 2024-04-01T06:47:38.238 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 143/162 2024-04-01T06:47:38.354 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 157/162 2024-04-01T06:47:38.354 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 158/162 2024-04-01T06:47:38.442 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : bison-3.0.4-10.el8.x86_64 144/162 2024-04-01T06:47:38.456 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 144/162 2024-04-01T06:47:38.570 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 158/162 2024-04-01T06:47:38.571 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 159/162 2024-04-01T06:47:38.659 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : NetworkManager-initscripts-updown-1:1.40.16-13.e 145/162 2024-04-01T06:47:38.669 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-13.e 145/162 2024-04-01T06:47:38.778 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 159/162 2024-04-01T06:47:38.779 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-04-01T06:47:38.811 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 146/162 2024-04-01T06:47:38.990 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 147/162 2024-04-01T06:47:38.995 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-04-01T06:47:39.160 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 148/162 2024-04-01T06:47:39.179 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 161/162 2024-04-01T06:47:39.179 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-04-01T06:47:39.294 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-04-01T06:47:39.346 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 149/162 2024-04-01T06:47:39.346 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-04-01T06:47:39.603 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-04-01T06:47:39.604 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-04-01T06:47:39.634 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-04-01T06:47:39.684 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-04-01T06:47:39.854 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-04-01T06:47:39.854 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 152/162 2024-04-01T06:47:40.072 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-04-01T06:47:40.072 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-2:18.2.2-1001.g9d2ee692.el8.x86_64 1/162 2024-04-01T06:47:40.072 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-base-2:18.2.2-1001.g9d2ee692.el8.x86_64 2/162 2024-04-01T06:47:40.072 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-common-2:18.2.2-1001.g9d2ee692.el8.x86_64 3/162 2024-04-01T06:47:40.072 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-fuse-2:18.2.2-1001.g9d2ee692.el8.x86_64 4/162 2024-04-01T06:47:40.072 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1001.g9d2ee 5/162 2024-04-01T06:47:40.072 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mds-2:18.2.2-1001.g9d2ee692.el8.x86_64 6/162 2024-04-01T06:47:40.072 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-2:18.2.2-1001.g9d2ee692.el8.x86_64 7/162 2024-04-01T06:47:40.072 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mon-2:18.2.2-1001.g9d2ee692.el8.x86_64 8/162 2024-04-01T06:47:40.073 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-osd-2:18.2.2-1001.g9d2ee692.el8.x86_64 9/162 2024-04-01T06:47:40.073 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-radosgw-2:18.2.2-1001.g9d2ee692.el8.x86_64 10/162 2024-04-01T06:47:40.073 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-selinux-2:18.2.2-1001.g9d2ee692.el8.x86_64 11/162 2024-04-01T06:47:40.073 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-test-2:18.2.2-1001.g9d2ee692.el8.x86_64 12/162 2024-04-01T06:47:40.073 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : cephfs-mirror-2:18.2.2-1001.g9d2ee692.el8.x86_64 13/162 2024-04-01T06:47:40.073 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libcephfs-devel-2:18.2.2-1001.g9d2ee692.el8.x86_ 14/162 2024-04-01T06:47:40.073 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libcephfs2-2:18.2.2-1001.g9d2ee692.el8.x86_64 15/162 2024-04-01T06:47:40.073 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libcephsqlite-2:18.2.2-1001.g9d2ee692.el8.x86_64 16/162 2024-04-01T06:47:40.073 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librados-devel-2:18.2.2-1001.g9d2ee692.el8.x86_6 17/162 2024-04-01T06:47:40.073 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libradosstriper1-2:18.2.2-1001.g9d2ee692.el8.x86 18/162 2024-04-01T06:47:40.073 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librgw2-2:18.2.2-1001.g9d2ee692.el8.x86_64 19/162 2024-04-01T06:47:40.073 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1001.g9d2ee692.el 20/162 2024-04-01T06:47:40.073 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-ceph-common-2:18.2.2-1001.g9d2ee692.el8. 21/162 2024-04-01T06:47:40.074 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cephfs-2:18.2.2-1001.g9d2ee692.el8.x86_6 22/162 2024-04-01T06:47:40.074 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-rados-2:18.2.2-1001.g9d2ee692.el8.x86_64 23/162 2024-04-01T06:47:40.074 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-rbd-2:18.2.2-1001.g9d2ee692.el8.x86_64 24/162 2024-04-01T06:47:40.074 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-rgw-2:18.2.2-1001.g9d2ee692.el8.x86_64 25/162 2024-04-01T06:47:40.074 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : rbd-fuse-2:18.2.2-1001.g9d2ee692.el8.x86_64 26/162 2024-04-01T06:47:40.074 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : rbd-mirror-2:18.2.2-1001.g9d2ee692.el8.x86_64 27/162 2024-04-01T06:47:40.074 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : rbd-nbd-2:18.2.2-1001.g9d2ee692.el8.x86_64 28/162 2024-04-01T06:47:40.074 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1001.g9d2ee692. 29/162 2024-04-01T06:47:40.074 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1001.g9d2ee692.el8.noa 30/162 2024-04-01T06:47:40.074 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1001.g9d2ee692.el8.n 31/162 2024-04-01T06:47:40.074 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1001.g9d2 32/162 2024-04-01T06:47:40.074 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1001.g9d2ee692.el 33/162 2024-04-01T06:47:40.074 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1001.g9d2ee692.el8.noarch 34/162 2024-04-01T06:47:40.075 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1001.g9d2ee692.e 35/162 2024-04-01T06:47:40.075 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-volume-2:18.2.2-1001.g9d2ee692.el8.noarch 36/162 2024-04-01T06:47:40.075 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : cephadm-2:18.2.2-1001.g9d2ee692.el8.noarch 37/162 2024-04-01T06:47:40.075 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : cephfs-top-2:18.2.2-1001.g9d2ee692.el8.noarch 38/162 2024-04-01T06:47:40.075 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/162 2024-04-01T06:47:40.075 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/162 2024-04-01T06:47:40.075 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/162 2024-04-01T06:47:40.075 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/162 2024-04-01T06:47:40.075 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/162 2024-04-01T06:47:40.075 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/162 2024-04-01T06:47:40.075 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/162 2024-04-01T06:47:40.075 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/162 2024-04-01T06:47:40.076 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/162 2024-04-01T06:47:40.076 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/162 2024-04-01T06:47:40.076 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/162 2024-04-01T06:47:40.076 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/162 2024-04-01T06:47:40.076 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/162 2024-04-01T06:47:40.076 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/162 2024-04-01T06:47:40.076 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/162 2024-04-01T06:47:40.076 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/162 2024-04-01T06:47:40.076 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/162 2024-04-01T06:47:40.076 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/162 2024-04-01T06:47:40.076 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/162 2024-04-01T06:47:40.076 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/162 2024-04-01T06:47:40.076 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/162 2024-04-01T06:47:40.077 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/162 2024-04-01T06:47:40.077 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/162 2024-04-01T06:47:40.077 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/162 2024-04-01T06:47:40.077 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/162 2024-04-01T06:47:40.077 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/162 2024-04-01T06:47:40.077 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/162 2024-04-01T06:47:40.077 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/162 2024-04-01T06:47:40.077 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/162 2024-04-01T06:47:40.077 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/162 2024-04-01T06:47:40.077 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/162 2024-04-01T06:47:40.077 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/162 2024-04-01T06:47:40.077 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/162 2024-04-01T06:47:40.077 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 72/162 2024-04-01T06:47:40.077 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 73/162 2024-04-01T06:47:40.077 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/162 2024-04-01T06:47:40.078 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 75/162 2024-04-01T06:47:40.078 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 76/162 2024-04-01T06:47:40.078 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 77/162 2024-04-01T06:47:40.078 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 78/162 2024-04-01T06:47:40.078 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 79/162 2024-04-01T06:47:40.078 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 80/162 2024-04-01T06:47:40.078 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 81/162 2024-04-01T06:47:40.078 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 82/162 2024-04-01T06:47:40.078 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 83/162 2024-04-01T06:47:40.079 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 84/162 2024-04-01T06:47:40.079 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 85/162 2024-04-01T06:47:40.079 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 86/162 2024-04-01T06:47:40.079 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 87/162 2024-04-01T06:47:40.079 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 88/162 2024-04-01T06:47:40.079 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 89/162 2024-04-01T06:47:40.079 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 90/162 2024-04-01T06:47:40.079 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libuuid-devel-2.32.1-43.el8.x86_64 91/162 2024-04-01T06:47:40.079 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 92/162 2024-04-01T06:47:40.079 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 93/162 2024-04-01T06:47:40.079 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-13.e 94/162 2024-04-01T06:47:40.079 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 95/162 2024-04-01T06:47:40.079 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 96/162 2024-04-01T06:47:40.079 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8_9.x86_64 97/162 2024-04-01T06:47:40.079 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librabbitmq-0.9.0-5.el8_9.x86_64 98/162 2024-04-01T06:47:40.080 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cryptography-3.2.1-7.el8_9.x86_64 99/162 2024-04-01T06:47:40.080 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 100/162 2024-04-01T06:47:40.080 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 101/162 2024-04-01T06:47:40.080 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 102/162 2024-04-01T06:47:40.080 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 103/162 2024-04-01T06:47:40.080 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 104/162 2024-04-01T06:47:40.080 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 105/162 2024-04-01T06:47:40.080 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : bison-3.0.4-10.el8.x86_64 106/162 2024-04-01T06:47:40.080 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : flex-2.6.1-9.el8.x86_64 107/162 2024-04-01T06:47:40.080 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 108/162 2024-04-01T06:47:40.080 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 109/162 2024-04-01T06:47:40.080 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 110/162 2024-04-01T06:47:40.080 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 111/162 2024-04-01T06:47:40.081 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 112/162 2024-04-01T06:47:40.081 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 113/162 2024-04-01T06:47:40.081 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 114/162 2024-04-01T06:47:40.081 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 115/162 2024-04-01T06:47:40.081 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 116/162 2024-04-01T06:47:40.081 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 117/162 2024-04-01T06:47:40.081 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 118/162 2024-04-01T06:47:40.081 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 119/162 2024-04-01T06:47:40.081 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 120/162 2024-04-01T06:47:40.081 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 121/162 2024-04-01T06:47:40.081 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : automake-1.16.1-8.el8.noarch 122/162 2024-04-01T06:47:40.081 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libpq-13.11-1.el8.x86_64 123/162 2024-04-01T06:47:40.081 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : jq-1.6-7.el8.x86_64 124/162 2024-04-01T06:47:40.081 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 125/162 2024-04-01T06:47:40.082 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 126/162 2024-04-01T06:47:40.082 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : oniguruma-6.8.2-2.1.el8_9.x86_64 127/162 2024-04-01T06:47:40.082 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 128/162 2024-04-01T06:47:40.082 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 129/162 2024-04-01T06:47:40.082 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : postgresql-server-10.23-4.module+el8.9.0+21317+d 130/162 2024-04-01T06:47:40.082 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librados2-2:18.2.2-1001.g9d2ee692.el8.x86_64 131/162 2024-04-01T06:47:40.082 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 132/162 2024-04-01T06:47:40.082 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librbd1-2:18.2.2-1001.g9d2ee692.el8.x86_64 133/162 2024-04-01T06:47:40.082 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 134/162 2024-04-01T06:47:40.082 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 135/162 2024-04-01T06:47:40.082 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 136/162 2024-04-01T06:47:40.082 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 137/162 2024-04-01T06:47:40.082 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 138/162 2024-04-01T06:47:40.082 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libmount-2.32.1-43.el8.x86_64 139/162 2024-04-01T06:47:40.083 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 140/162 2024-04-01T06:47:40.083 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libsmartcols-2.32.1-43.el8.x86_64 141/162 2024-04-01T06:47:40.083 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 142/162 2024-04-01T06:47:40.083 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libuuid-2.32.1-43.el8.x86_64 143/162 2024-04-01T06:47:40.083 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 144/162 2024-04-01T06:47:40.083 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : util-linux-2.32.1-43.el8.x86_64 145/162 2024-04-01T06:47:40.083 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 146/162 2024-04-01T06:47:40.083 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : util-linux-user-2.32.1-43.el8.x86_64 147/162 2024-04-01T06:47:40.083 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 148/162 2024-04-01T06:47:40.083 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : iproute-6.2.0-5.el8_9.x86_64 149/162 2024-04-01T06:47:40.083 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 150/162 2024-04-01T06:47:40.083 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libblkid-2.32.1-43.el8.x86_64 151/162 2024-04-01T06:47:40.083 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 152/162 2024-04-01T06:47:40.083 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libfdisk-2.32.1-43.el8.x86_64 153/162 2024-04-01T06:47:40.083 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 154/162 2024-04-01T06:47:40.084 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openssl-1:1.1.1k-12.el8_9.x86_64 155/162 2024-04-01T06:47:40.084 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 156/162 2024-04-01T06:47:40.084 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8_9.x86_64 157/162 2024-04-01T06:47:40.084 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 158/162 2024-04-01T06:47:40.084 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : xfsdump-3.1.8-7.el8_9.x86_64 159/162 2024-04-01T06:47:40.084 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 160/162 2024-04-01T06:47:40.084 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 161/162 2024-04-01T06:47:40.084 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 152/162 2024-04-01T06:47:40.111 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 136/162 2024-04-01T06:47:40.310 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 153/162 2024-04-01T06:47:40.499 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : iproute-6.2.0-5.el8_9.x86_64 137/162 2024-04-01T06:47:40.510 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 154/162 2024-04-01T06:47:40.718 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 155/162 2024-04-01T06:47:40.719 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 156/162 2024-04-01T06:47:40.729 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : xfsdump-3.1.8-7.el8_9.x86_64 138/162 2024-04-01T06:47:40.900 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : cephfs-top-2:18.2.2-1001.g9d2ee692.el8.noarch 139/162 2024-04-01T06:47:40.936 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 156/162 2024-04-01T06:47:40.936 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 157/162 2024-04-01T06:47:41.116 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : rbd-fuse-2:18.2.2-1001.g9d2ee692.el8.x86_64 140/162 2024-04-01T06:47:41.202 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 157/162 2024-04-01T06:47:41.203 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 158/162 2024-04-01T06:47:41.396 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : rbd-nbd-2:18.2.2-1001.g9d2ee692.el8.x86_64 141/162 2024-04-01T06:47:41.461 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 158/162 2024-04-01T06:47:41.461 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 159/162 2024-04-01T06:47:41.679 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : openssl-1:1.1.1k-12.el8_9.x86_64 142/162 2024-04-01T06:47:41.727 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 159/162 2024-04-01T06:47:41.728 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-04-01T06:47:41.899 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : flex-2.6.1-9.el8.x86_64 143/162 2024-04-01T06:47:41.944 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-04-01T06:47:41.981 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 143/162 2024-04-01T06:47:42.127 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 161/162 2024-04-01T06:47:42.128 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-04-01T06:47:42.224 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : bison-3.0.4-10.el8.x86_64 144/162 2024-04-01T06:47:42.239 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 144/162 2024-04-01T06:47:42.400 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : NetworkManager-initscripts-updown-1:1.40.16-13.e 145/162 2024-04-01T06:47:42.410 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-13.e 145/162 2024-04-01T06:47:42.577 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 146/162 2024-04-01T06:47:42.728 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 147/162 2024-04-01T06:47:42.935 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 148/162 2024-04-01T06:47:43.038 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-04-01T06:47:43.038 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-2:18.2.2-1001.g9d2ee692.el8.x86_64 1/162 2024-04-01T06:47:43.038 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-base-2:18.2.2-1001.g9d2ee692.el8.x86_64 2/162 2024-04-01T06:47:43.038 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-common-2:18.2.2-1001.g9d2ee692.el8.x86_64 3/162 2024-04-01T06:47:43.038 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-fuse-2:18.2.2-1001.g9d2ee692.el8.x86_64 4/162 2024-04-01T06:47:43.038 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1001.g9d2ee 5/162 2024-04-01T06:47:43.039 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mds-2:18.2.2-1001.g9d2ee692.el8.x86_64 6/162 2024-04-01T06:47:43.039 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-2:18.2.2-1001.g9d2ee692.el8.x86_64 7/162 2024-04-01T06:47:43.039 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mon-2:18.2.2-1001.g9d2ee692.el8.x86_64 8/162 2024-04-01T06:47:43.039 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-osd-2:18.2.2-1001.g9d2ee692.el8.x86_64 9/162 2024-04-01T06:47:43.039 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-radosgw-2:18.2.2-1001.g9d2ee692.el8.x86_64 10/162 2024-04-01T06:47:43.039 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-selinux-2:18.2.2-1001.g9d2ee692.el8.x86_64 11/162 2024-04-01T06:47:43.039 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-test-2:18.2.2-1001.g9d2ee692.el8.x86_64 12/162 2024-04-01T06:47:43.039 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : cephfs-mirror-2:18.2.2-1001.g9d2ee692.el8.x86_64 13/162 2024-04-01T06:47:43.039 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephfs-devel-2:18.2.2-1001.g9d2ee692.el8.x86_ 14/162 2024-04-01T06:47:43.039 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephfs2-2:18.2.2-1001.g9d2ee692.el8.x86_64 15/162 2024-04-01T06:47:43.039 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephsqlite-2:18.2.2-1001.g9d2ee692.el8.x86_64 16/162 2024-04-01T06:47:43.039 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados-devel-2:18.2.2-1001.g9d2ee692.el8.x86_6 17/162 2024-04-01T06:47:43.039 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libradosstriper1-2:18.2.2-1001.g9d2ee692.el8.x86 18/162 2024-04-01T06:47:43.039 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librgw2-2:18.2.2-1001.g9d2ee692.el8.x86_64 19/162 2024-04-01T06:47:43.039 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1001.g9d2ee692.el 20/162 2024-04-01T06:47:43.040 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-ceph-common-2:18.2.2-1001.g9d2ee692.el8. 21/162 2024-04-01T06:47:43.040 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cephfs-2:18.2.2-1001.g9d2ee692.el8.x86_6 22/162 2024-04-01T06:47:43.040 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rados-2:18.2.2-1001.g9d2ee692.el8.x86_64 23/162 2024-04-01T06:47:43.040 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rbd-2:18.2.2-1001.g9d2ee692.el8.x86_64 24/162 2024-04-01T06:47:43.040 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rgw-2:18.2.2-1001.g9d2ee692.el8.x86_64 25/162 2024-04-01T06:47:43.040 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-fuse-2:18.2.2-1001.g9d2ee692.el8.x86_64 26/162 2024-04-01T06:47:43.040 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-mirror-2:18.2.2-1001.g9d2ee692.el8.x86_64 27/162 2024-04-01T06:47:43.053 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-nbd-2:18.2.2-1001.g9d2ee692.el8.x86_64 28/162 2024-04-01T06:47:43.053 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1001.g9d2ee692. 29/162 2024-04-01T06:47:43.053 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1001.g9d2ee692.el8.noa 30/162 2024-04-01T06:47:43.053 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1001.g9d2ee692.el8.n 31/162 2024-04-01T06:47:43.053 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1001.g9d2 32/162 2024-04-01T06:47:43.053 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1001.g9d2ee692.el 33/162 2024-04-01T06:47:43.053 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1001.g9d2ee692.el8.noarch 34/162 2024-04-01T06:47:43.054 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1001.g9d2ee692.e 35/162 2024-04-01T06:47:43.054 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-volume-2:18.2.2-1001.g9d2ee692.el8.noarch 36/162 2024-04-01T06:47:43.054 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : cephadm-2:18.2.2-1001.g9d2ee692.el8.noarch 37/162 2024-04-01T06:47:43.054 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : cephfs-top-2:18.2.2-1001.g9d2ee692.el8.noarch 38/162 2024-04-01T06:47:43.054 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/162 2024-04-01T06:47:43.054 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/162 2024-04-01T06:47:43.054 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/162 2024-04-01T06:47:43.054 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/162 2024-04-01T06:47:43.054 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/162 2024-04-01T06:47:43.054 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/162 2024-04-01T06:47:43.054 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/162 2024-04-01T06:47:43.054 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/162 2024-04-01T06:47:43.054 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/162 2024-04-01T06:47:43.054 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/162 2024-04-01T06:47:43.055 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/162 2024-04-01T06:47:43.055 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/162 2024-04-01T06:47:43.055 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/162 2024-04-01T06:47:43.055 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/162 2024-04-01T06:47:43.055 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/162 2024-04-01T06:47:43.055 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/162 2024-04-01T06:47:43.055 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/162 2024-04-01T06:47:43.055 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/162 2024-04-01T06:47:43.055 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/162 2024-04-01T06:47:43.055 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/162 2024-04-01T06:47:43.055 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/162 2024-04-01T06:47:43.055 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/162 2024-04-01T06:47:43.055 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/162 2024-04-01T06:47:43.055 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/162 2024-04-01T06:47:43.056 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/162 2024-04-01T06:47:43.056 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/162 2024-04-01T06:47:43.056 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/162 2024-04-01T06:47:43.056 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/162 2024-04-01T06:47:43.056 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/162 2024-04-01T06:47:43.056 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/162 2024-04-01T06:47:43.056 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/162 2024-04-01T06:47:43.056 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/162 2024-04-01T06:47:43.056 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/162 2024-04-01T06:47:43.056 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 72/162 2024-04-01T06:47:43.056 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 73/162 2024-04-01T06:47:43.056 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/162 2024-04-01T06:47:43.056 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 75/162 2024-04-01T06:47:43.056 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 76/162 2024-04-01T06:47:43.056 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 77/162 2024-04-01T06:47:43.057 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 78/162 2024-04-01T06:47:43.057 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 79/162 2024-04-01T06:47:43.057 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 80/162 2024-04-01T06:47:43.057 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 81/162 2024-04-01T06:47:43.057 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 82/162 2024-04-01T06:47:43.057 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 83/162 2024-04-01T06:47:43.057 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 84/162 2024-04-01T06:47:43.057 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 85/162 2024-04-01T06:47:43.057 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 86/162 2024-04-01T06:47:43.057 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 87/162 2024-04-01T06:47:43.057 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 88/162 2024-04-01T06:47:43.057 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 89/162 2024-04-01T06:47:43.057 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 90/162 2024-04-01T06:47:43.057 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libuuid-devel-2.32.1-43.el8.x86_64 91/162 2024-04-01T06:47:43.057 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 92/162 2024-04-01T06:47:43.057 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 93/162 2024-04-01T06:47:43.058 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-13.e 94/162 2024-04-01T06:47:43.058 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 95/162 2024-04-01T06:47:43.058 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 96/162 2024-04-01T06:47:43.058 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8_9.x86_64 97/162 2024-04-01T06:47:43.058 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librabbitmq-0.9.0-5.el8_9.x86_64 98/162 2024-04-01T06:47:43.058 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cryptography-3.2.1-7.el8_9.x86_64 99/162 2024-04-01T06:47:43.058 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 100/162 2024-04-01T06:47:43.058 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 101/162 2024-04-01T06:47:43.058 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 102/162 2024-04-01T06:47:43.058 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 103/162 2024-04-01T06:47:43.058 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 104/162 2024-04-01T06:47:43.058 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 105/162 2024-04-01T06:47:43.058 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : bison-3.0.4-10.el8.x86_64 106/162 2024-04-01T06:47:43.058 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : flex-2.6.1-9.el8.x86_64 107/162 2024-04-01T06:47:43.058 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 108/162 2024-04-01T06:47:43.059 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 109/162 2024-04-01T06:47:43.059 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 110/162 2024-04-01T06:47:43.059 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 111/162 2024-04-01T06:47:43.059 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 112/162 2024-04-01T06:47:43.059 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 113/162 2024-04-01T06:47:43.059 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 114/162 2024-04-01T06:47:43.059 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 115/162 2024-04-01T06:47:43.059 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 116/162 2024-04-01T06:47:43.059 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 117/162 2024-04-01T06:47:43.059 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 118/162 2024-04-01T06:47:43.059 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 119/162 2024-04-01T06:47:43.059 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 120/162 2024-04-01T06:47:43.059 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 121/162 2024-04-01T06:47:43.059 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : automake-1.16.1-8.el8.noarch 122/162 2024-04-01T06:47:43.059 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libpq-13.11-1.el8.x86_64 123/162 2024-04-01T06:47:43.060 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : jq-1.6-7.el8.x86_64 124/162 2024-04-01T06:47:43.060 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 125/162 2024-04-01T06:47:43.060 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 126/162 2024-04-01T06:47:43.060 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : oniguruma-6.8.2-2.1.el8_9.x86_64 127/162 2024-04-01T06:47:43.060 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 128/162 2024-04-01T06:47:43.060 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 129/162 2024-04-01T06:47:43.060 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : postgresql-server-10.23-4.module+el8.9.0+21317+d 130/162 2024-04-01T06:47:43.060 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados2-2:18.2.2-1001.g9d2ee692.el8.x86_64 131/162 2024-04-01T06:47:43.060 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 132/162 2024-04-01T06:47:43.060 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librbd1-2:18.2.2-1001.g9d2ee692.el8.x86_64 133/162 2024-04-01T06:47:43.060 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 134/162 2024-04-01T06:47:43.060 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 135/162 2024-04-01T06:47:43.060 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 136/162 2024-04-01T06:47:43.060 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 137/162 2024-04-01T06:47:43.060 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 138/162 2024-04-01T06:47:43.060 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libmount-2.32.1-43.el8.x86_64 139/162 2024-04-01T06:47:43.061 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 140/162 2024-04-01T06:47:43.061 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libsmartcols-2.32.1-43.el8.x86_64 141/162 2024-04-01T06:47:43.061 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 142/162 2024-04-01T06:47:43.061 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libuuid-2.32.1-43.el8.x86_64 143/162 2024-04-01T06:47:43.061 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 144/162 2024-04-01T06:47:43.061 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : util-linux-2.32.1-43.el8.x86_64 145/162 2024-04-01T06:47:43.061 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 146/162 2024-04-01T06:47:43.061 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : util-linux-user-2.32.1-43.el8.x86_64 147/162 2024-04-01T06:47:43.061 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 148/162 2024-04-01T06:47:43.061 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : iproute-6.2.0-5.el8_9.x86_64 149/162 2024-04-01T06:47:43.061 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 150/162 2024-04-01T06:47:43.061 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libblkid-2.32.1-43.el8.x86_64 151/162 2024-04-01T06:47:43.061 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 152/162 2024-04-01T06:47:43.061 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libfdisk-2.32.1-43.el8.x86_64 153/162 2024-04-01T06:47:43.061 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 154/162 2024-04-01T06:47:43.062 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openssl-1:1.1.1k-12.el8_9.x86_64 155/162 2024-04-01T06:47:43.062 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 156/162 2024-04-01T06:47:43.062 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8_9.x86_64 157/162 2024-04-01T06:47:43.062 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 158/162 2024-04-01T06:47:43.062 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : xfsdump-3.1.8-7.el8_9.x86_64 159/162 2024-04-01T06:47:43.062 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 160/162 2024-04-01T06:47:43.062 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 161/162 2024-04-01T06:47:43.086 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 149/162 2024-04-01T06:47:43.087 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-04-01T06:47:43.369 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-04-01T06:47:43.370 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-04-01T06:47:43.603 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-04-01T06:47:43.603 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 152/162 2024-04-01T06:47:43.880 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 152/162 2024-04-01T06:47:44.118 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 153/162 2024-04-01T06:47:44.277 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 154/162 2024-04-01T06:47:44.501 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 155/162 2024-04-01T06:47:44.501 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 156/162 2024-04-01T06:47:44.735 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 156/162 2024-04-01T06:47:44.735 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 157/162 2024-04-01T06:47:44.968 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 157/162 2024-04-01T06:47:44.969 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 158/162 2024-04-01T06:47:45.177 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 158/162 2024-04-01T06:47:45.177 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 159/162 2024-04-01T06:47:45.435 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 159/162 2024-04-01T06:47:45.435 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-04-01T06:47:45.685 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-04-01T06:47:45.835 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 161/162 2024-04-01T06:47:45.835 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-04-01T06:47:46.359 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 162/162 2024-04-01T06:47:46.359 INFO:teuthology.orchestra.run.smithi145.stdout:Installed products updated. 2024-04-01T06:47:46.727 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-04-01T06:47:46.727 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-2:18.2.2-1001.g9d2ee692.el8.x86_64 1/162 2024-04-01T06:47:46.727 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-base-2:18.2.2-1001.g9d2ee692.el8.x86_64 2/162 2024-04-01T06:47:46.727 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-common-2:18.2.2-1001.g9d2ee692.el8.x86_64 3/162 2024-04-01T06:47:46.727 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-fuse-2:18.2.2-1001.g9d2ee692.el8.x86_64 4/162 2024-04-01T06:47:46.727 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1001.g9d2ee 5/162 2024-04-01T06:47:46.727 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mds-2:18.2.2-1001.g9d2ee692.el8.x86_64 6/162 2024-04-01T06:47:46.728 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-2:18.2.2-1001.g9d2ee692.el8.x86_64 7/162 2024-04-01T06:47:46.728 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mon-2:18.2.2-1001.g9d2ee692.el8.x86_64 8/162 2024-04-01T06:47:46.728 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-osd-2:18.2.2-1001.g9d2ee692.el8.x86_64 9/162 2024-04-01T06:47:46.728 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-radosgw-2:18.2.2-1001.g9d2ee692.el8.x86_64 10/162 2024-04-01T06:47:46.728 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-selinux-2:18.2.2-1001.g9d2ee692.el8.x86_64 11/162 2024-04-01T06:47:46.728 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-test-2:18.2.2-1001.g9d2ee692.el8.x86_64 12/162 2024-04-01T06:47:46.728 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : cephfs-mirror-2:18.2.2-1001.g9d2ee692.el8.x86_64 13/162 2024-04-01T06:47:46.728 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libcephfs-devel-2:18.2.2-1001.g9d2ee692.el8.x86_ 14/162 2024-04-01T06:47:46.728 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libcephfs2-2:18.2.2-1001.g9d2ee692.el8.x86_64 15/162 2024-04-01T06:47:46.728 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libcephsqlite-2:18.2.2-1001.g9d2ee692.el8.x86_64 16/162 2024-04-01T06:47:46.728 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librados-devel-2:18.2.2-1001.g9d2ee692.el8.x86_6 17/162 2024-04-01T06:47:46.728 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libradosstriper1-2:18.2.2-1001.g9d2ee692.el8.x86 18/162 2024-04-01T06:47:46.728 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librgw2-2:18.2.2-1001.g9d2ee692.el8.x86_64 19/162 2024-04-01T06:47:46.728 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1001.g9d2ee692.el 20/162 2024-04-01T06:47:46.729 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-ceph-common-2:18.2.2-1001.g9d2ee692.el8. 21/162 2024-04-01T06:47:46.729 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cephfs-2:18.2.2-1001.g9d2ee692.el8.x86_6 22/162 2024-04-01T06:47:46.729 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-rados-2:18.2.2-1001.g9d2ee692.el8.x86_64 23/162 2024-04-01T06:47:46.729 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-rbd-2:18.2.2-1001.g9d2ee692.el8.x86_64 24/162 2024-04-01T06:47:46.729 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-rgw-2:18.2.2-1001.g9d2ee692.el8.x86_64 25/162 2024-04-01T06:47:46.729 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : rbd-fuse-2:18.2.2-1001.g9d2ee692.el8.x86_64 26/162 2024-04-01T06:47:46.729 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : rbd-mirror-2:18.2.2-1001.g9d2ee692.el8.x86_64 27/162 2024-04-01T06:47:46.729 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : rbd-nbd-2:18.2.2-1001.g9d2ee692.el8.x86_64 28/162 2024-04-01T06:47:46.729 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1001.g9d2ee692. 29/162 2024-04-01T06:47:46.729 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1001.g9d2ee692.el8.noa 30/162 2024-04-01T06:47:46.729 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1001.g9d2ee692.el8.n 31/162 2024-04-01T06:47:46.729 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1001.g9d2 32/162 2024-04-01T06:47:46.729 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1001.g9d2ee692.el 33/162 2024-04-01T06:47:46.729 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1001.g9d2ee692.el8.noarch 34/162 2024-04-01T06:47:46.729 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1001.g9d2ee692.e 35/162 2024-04-01T06:47:46.730 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-volume-2:18.2.2-1001.g9d2ee692.el8.noarch 36/162 2024-04-01T06:47:46.730 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : cephadm-2:18.2.2-1001.g9d2ee692.el8.noarch 37/162 2024-04-01T06:47:46.730 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : cephfs-top-2:18.2.2-1001.g9d2ee692.el8.noarch 38/162 2024-04-01T06:47:46.730 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/162 2024-04-01T06:47:46.730 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/162 2024-04-01T06:47:46.730 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/162 2024-04-01T06:47:46.730 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/162 2024-04-01T06:47:46.730 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/162 2024-04-01T06:47:46.730 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/162 2024-04-01T06:47:46.730 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/162 2024-04-01T06:47:46.730 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/162 2024-04-01T06:47:46.730 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/162 2024-04-01T06:47:46.730 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/162 2024-04-01T06:47:46.730 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/162 2024-04-01T06:47:46.730 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/162 2024-04-01T06:47:46.731 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/162 2024-04-01T06:47:46.731 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/162 2024-04-01T06:47:46.731 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/162 2024-04-01T06:47:46.731 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/162 2024-04-01T06:47:46.731 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/162 2024-04-01T06:47:46.731 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/162 2024-04-01T06:47:46.731 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/162 2024-04-01T06:47:46.731 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/162 2024-04-01T06:47:46.731 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/162 2024-04-01T06:47:46.731 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/162 2024-04-01T06:47:46.731 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/162 2024-04-01T06:47:46.731 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/162 2024-04-01T06:47:46.731 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/162 2024-04-01T06:47:46.731 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/162 2024-04-01T06:47:46.732 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/162 2024-04-01T06:47:46.732 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/162 2024-04-01T06:47:46.732 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/162 2024-04-01T06:47:46.732 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/162 2024-04-01T06:47:46.732 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/162 2024-04-01T06:47:46.732 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/162 2024-04-01T06:47:46.732 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/162 2024-04-01T06:47:46.732 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 72/162 2024-04-01T06:47:46.732 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 73/162 2024-04-01T06:47:46.732 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/162 2024-04-01T06:47:46.732 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 75/162 2024-04-01T06:47:46.732 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 76/162 2024-04-01T06:47:46.732 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 77/162 2024-04-01T06:47:46.732 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 78/162 2024-04-01T06:47:46.732 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 79/162 2024-04-01T06:47:46.733 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 80/162 2024-04-01T06:47:46.733 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 81/162 2024-04-01T06:47:46.733 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 82/162 2024-04-01T06:47:46.733 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 83/162 2024-04-01T06:47:46.733 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 84/162 2024-04-01T06:47:46.733 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 85/162 2024-04-01T06:47:46.733 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 86/162 2024-04-01T06:47:46.733 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 87/162 2024-04-01T06:47:46.733 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 88/162 2024-04-01T06:47:46.733 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 89/162 2024-04-01T06:47:46.733 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 90/162 2024-04-01T06:47:46.733 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libuuid-devel-2.32.1-43.el8.x86_64 91/162 2024-04-01T06:47:46.733 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 92/162 2024-04-01T06:47:46.733 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 93/162 2024-04-01T06:47:46.734 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-13.e 94/162 2024-04-01T06:47:46.734 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 95/162 2024-04-01T06:47:46.734 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 96/162 2024-04-01T06:47:46.734 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8_9.x86_64 97/162 2024-04-01T06:47:46.734 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librabbitmq-0.9.0-5.el8_9.x86_64 98/162 2024-04-01T06:47:46.734 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cryptography-3.2.1-7.el8_9.x86_64 99/162 2024-04-01T06:47:46.734 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 100/162 2024-04-01T06:47:46.734 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 101/162 2024-04-01T06:47:46.734 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 102/162 2024-04-01T06:47:46.734 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 103/162 2024-04-01T06:47:46.734 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 104/162 2024-04-01T06:47:46.734 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 105/162 2024-04-01T06:47:46.734 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : bison-3.0.4-10.el8.x86_64 106/162 2024-04-01T06:47:46.734 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : flex-2.6.1-9.el8.x86_64 107/162 2024-04-01T06:47:46.734 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 108/162 2024-04-01T06:47:46.735 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 109/162 2024-04-01T06:47:46.735 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 110/162 2024-04-01T06:47:46.735 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 111/162 2024-04-01T06:47:46.735 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 112/162 2024-04-01T06:47:46.735 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 113/162 2024-04-01T06:47:46.735 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 114/162 2024-04-01T06:47:46.735 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 115/162 2024-04-01T06:47:46.735 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 116/162 2024-04-01T06:47:46.735 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 117/162 2024-04-01T06:47:46.735 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 118/162 2024-04-01T06:47:46.735 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 119/162 2024-04-01T06:47:46.735 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 120/162 2024-04-01T06:47:46.735 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 121/162 2024-04-01T06:47:46.735 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : automake-1.16.1-8.el8.noarch 122/162 2024-04-01T06:47:46.736 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libpq-13.11-1.el8.x86_64 123/162 2024-04-01T06:47:46.736 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : jq-1.6-7.el8.x86_64 124/162 2024-04-01T06:47:46.736 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 125/162 2024-04-01T06:47:46.736 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 126/162 2024-04-01T06:47:46.736 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : oniguruma-6.8.2-2.1.el8_9.x86_64 127/162 2024-04-01T06:47:46.736 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 128/162 2024-04-01T06:47:46.736 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 129/162 2024-04-01T06:47:46.736 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : postgresql-server-10.23-4.module+el8.9.0+21317+d 130/162 2024-04-01T06:47:46.736 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librados2-2:18.2.2-1001.g9d2ee692.el8.x86_64 131/162 2024-04-01T06:47:46.736 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 132/162 2024-04-01T06:47:46.736 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librbd1-2:18.2.2-1001.g9d2ee692.el8.x86_64 133/162 2024-04-01T06:47:46.736 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 134/162 2024-04-01T06:47:46.736 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 135/162 2024-04-01T06:47:46.736 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 136/162 2024-04-01T06:47:46.736 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 137/162 2024-04-01T06:47:46.737 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 138/162 2024-04-01T06:47:46.737 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libmount-2.32.1-43.el8.x86_64 139/162 2024-04-01T06:47:46.737 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 140/162 2024-04-01T06:47:46.737 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libsmartcols-2.32.1-43.el8.x86_64 141/162 2024-04-01T06:47:46.737 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 142/162 2024-04-01T06:47:46.737 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libuuid-2.32.1-43.el8.x86_64 143/162 2024-04-01T06:47:46.737 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 144/162 2024-04-01T06:47:46.737 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : util-linux-2.32.1-43.el8.x86_64 145/162 2024-04-01T06:47:46.737 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 146/162 2024-04-01T06:47:46.737 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : util-linux-user-2.32.1-43.el8.x86_64 147/162 2024-04-01T06:47:46.737 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 148/162 2024-04-01T06:47:46.737 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : iproute-6.2.0-5.el8_9.x86_64 149/162 2024-04-01T06:47:46.737 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 150/162 2024-04-01T06:47:46.737 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libblkid-2.32.1-43.el8.x86_64 151/162 2024-04-01T06:47:46.737 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 152/162 2024-04-01T06:47:46.738 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libfdisk-2.32.1-43.el8.x86_64 153/162 2024-04-01T06:47:46.738 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 154/162 2024-04-01T06:47:46.738 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : openssl-1:1.1.1k-12.el8_9.x86_64 155/162 2024-04-01T06:47:46.738 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 156/162 2024-04-01T06:47:46.738 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8_9.x86_64 157/162 2024-04-01T06:47:46.738 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 158/162 2024-04-01T06:47:46.738 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : xfsdump-3.1.8-7.el8_9.x86_64 159/162 2024-04-01T06:47:46.738 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 160/162 2024-04-01T06:47:46.738 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 161/162 2024-04-01T06:47:46.957 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-01T06:47:46.957 INFO:teuthology.orchestra.run.smithi145.stdout:Upgraded: 2024-04-01T06:47:46.957 INFO:teuthology.orchestra.run.smithi145.stdout: elfutils-libelf-0.189-3.el8.x86_64 2024-04-01T06:47:46.957 INFO:teuthology.orchestra.run.smithi145.stdout: elfutils-libs-0.189-3.el8.x86_64 2024-04-01T06:47:46.957 INFO:teuthology.orchestra.run.smithi145.stdout: iproute-6.2.0-5.el8_9.x86_64 2024-04-01T06:47:46.957 INFO:teuthology.orchestra.run.smithi145.stdout: libblkid-2.32.1-43.el8.x86_64 2024-04-01T06:47:46.957 INFO:teuthology.orchestra.run.smithi145.stdout: libfdisk-2.32.1-43.el8.x86_64 2024-04-01T06:47:46.957 INFO:teuthology.orchestra.run.smithi145.stdout: libmount-2.32.1-43.el8.x86_64 2024-04-01T06:47:46.957 INFO:teuthology.orchestra.run.smithi145.stdout: librados2-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:46.958 INFO:teuthology.orchestra.run.smithi145.stdout: librbd1-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:46.958 INFO:teuthology.orchestra.run.smithi145.stdout: libsmartcols-2.32.1-43.el8.x86_64 2024-04-01T06:47:46.958 INFO:teuthology.orchestra.run.smithi145.stdout: libuuid-2.32.1-43.el8.x86_64 2024-04-01T06:47:46.958 INFO:teuthology.orchestra.run.smithi145.stdout: openssl-1:1.1.1k-12.el8_9.x86_64 2024-04-01T06:47:46.958 INFO:teuthology.orchestra.run.smithi145.stdout: openssl-libs-1:1.1.1k-12.el8_9.x86_64 2024-04-01T06:47:46.958 INFO:teuthology.orchestra.run.smithi145.stdout: util-linux-2.32.1-43.el8.x86_64 2024-04-01T06:47:46.958 INFO:teuthology.orchestra.run.smithi145.stdout: util-linux-user-2.32.1-43.el8.x86_64 2024-04-01T06:47:46.958 INFO:teuthology.orchestra.run.smithi145.stdout: xfsdump-3.1.8-7.el8_9.x86_64 2024-04-01T06:47:46.958 INFO:teuthology.orchestra.run.smithi145.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-04-01T06:47:46.958 INFO:teuthology.orchestra.run.smithi145.stdout:Installed: 2024-04-01T06:47:46.958 INFO:teuthology.orchestra.run.smithi145.stdout: NetworkManager-initscripts-updown-1:1.40.16-13.el8_9.noarch 2024-04-01T06:47:46.958 INFO:teuthology.orchestra.run.smithi145.stdout: automake-1.16.1-8.el8.noarch 2024-04-01T06:47:46.958 INFO:teuthology.orchestra.run.smithi145.stdout: bison-3.0.4-10.el8.x86_64 2024-04-01T06:47:46.958 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:46.958 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-base-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:46.959 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-common-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:46.959 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-fuse-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:46.959 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-grafana-dashboards-2:18.2.2-1001.g9d2ee692.el8.noarch 2024-04-01T06:47:46.959 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-immutable-object-cache-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:46.959 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mds-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:46.959 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:46.959 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-cephadm-2:18.2.2-1001.g9d2ee692.el8.noarch 2024-04-01T06:47:46.959 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-dashboard-2:18.2.2-1001.g9d2ee692.el8.noarch 2024-04-01T06:47:46.959 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1001.g9d2ee692.el8.noarch 2024-04-01T06:47:46.959 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-modules-core-2:18.2.2-1001.g9d2ee692.el8.noarch 2024-04-01T06:47:46.959 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-rook-2:18.2.2-1001.g9d2ee692.el8.noarch 2024-04-01T06:47:46.959 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mon-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:46.959 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-osd-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:46.959 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-prometheus-alerts-2:18.2.2-1001.g9d2ee692.el8.noarch 2024-04-01T06:47:46.959 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-radosgw-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:46.960 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-selinux-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:46.960 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-test-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:46.960 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-volume-2:18.2.2-1001.g9d2ee692.el8.noarch 2024-04-01T06:47:46.960 INFO:teuthology.orchestra.run.smithi145.stdout: cephadm-2:18.2.2-1001.g9d2ee692.el8.noarch 2024-04-01T06:47:46.960 INFO:teuthology.orchestra.run.smithi145.stdout: cephfs-mirror-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:46.960 INFO:teuthology.orchestra.run.smithi145.stdout: cephfs-top-2:18.2.2-1001.g9d2ee692.el8.noarch 2024-04-01T06:47:46.960 INFO:teuthology.orchestra.run.smithi145.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2024-04-01T06:47:46.960 INFO:teuthology.orchestra.run.smithi145.stdout: flex-2.6.1-9.el8.x86_64 2024-04-01T06:47:46.960 INFO:teuthology.orchestra.run.smithi145.stdout: fuse-2.9.7-17.el8.x86_64 2024-04-01T06:47:46.960 INFO:teuthology.orchestra.run.smithi145.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-04-01T06:47:46.960 INFO:teuthology.orchestra.run.smithi145.stdout: jq-1.6-7.el8.x86_64 2024-04-01T06:47:46.960 INFO:teuthology.orchestra.run.smithi145.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-04-01T06:47:46.960 INFO:teuthology.orchestra.run.smithi145.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2024-04-01T06:47:46.960 INFO:teuthology.orchestra.run.smithi145.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-04-01T06:47:46.961 INFO:teuthology.orchestra.run.smithi145.stdout: libcephfs-devel-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:46.961 INFO:teuthology.orchestra.run.smithi145.stdout: libcephfs2-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:46.961 INFO:teuthology.orchestra.run.smithi145.stdout: libcephsqlite-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:46.961 INFO:teuthology.orchestra.run.smithi145.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2024-04-01T06:47:46.961 INFO:teuthology.orchestra.run.smithi145.stdout: libgfortran-8.5.0-20.el8.x86_64 2024-04-01T06:47:46.961 INFO:teuthology.orchestra.run.smithi145.stdout: liboath-2.6.2-3.el8.x86_64 2024-04-01T06:47:46.961 INFO:teuthology.orchestra.run.smithi145.stdout: libpq-13.11-1.el8.x86_64 2024-04-01T06:47:46.961 INFO:teuthology.orchestra.run.smithi145.stdout: libquadmath-8.5.0-20.el8.x86_64 2024-04-01T06:47:46.961 INFO:teuthology.orchestra.run.smithi145.stdout: librabbitmq-0.9.0-5.el8_9.x86_64 2024-04-01T06:47:46.961 INFO:teuthology.orchestra.run.smithi145.stdout: librados-devel-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:46.961 INFO:teuthology.orchestra.run.smithi145.stdout: libradosstriper1-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:46.961 INFO:teuthology.orchestra.run.smithi145.stdout: librdkafka-0.11.4-3.el8.x86_64 2024-04-01T06:47:46.961 INFO:teuthology.orchestra.run.smithi145.stdout: librgw2-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:46.961 INFO:teuthology.orchestra.run.smithi145.stdout: libselinux-devel-2.9-5.el8.x86_64 2024-04-01T06:47:46.961 INFO:teuthology.orchestra.run.smithi145.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-04-01T06:47:46.962 INFO:teuthology.orchestra.run.smithi145.stdout: libtool-2.4.6-25.el8.x86_64 2024-04-01T06:47:46.962 INFO:teuthology.orchestra.run.smithi145.stdout: libunwind-1.3.1-3.el8.x86_64 2024-04-01T06:47:46.962 INFO:teuthology.orchestra.run.smithi145.stdout: libuuid-devel-2.32.1-43.el8.x86_64 2024-04-01T06:47:46.962 INFO:teuthology.orchestra.run.smithi145.stdout: libverto-devel-0.3.0-5.el8.x86_64 2024-04-01T06:47:46.962 INFO:teuthology.orchestra.run.smithi145.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-04-01T06:47:46.962 INFO:teuthology.orchestra.run.smithi145.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-04-01T06:47:46.962 INFO:teuthology.orchestra.run.smithi145.stdout: oniguruma-6.8.2-2.1.el8_9.x86_64 2024-04-01T06:47:46.962 INFO:teuthology.orchestra.run.smithi145.stdout: openblas-0.3.15-6.el8.x86_64 2024-04-01T06:47:46.962 INFO:teuthology.orchestra.run.smithi145.stdout: openblas-threads-0.3.15-6.el8.x86_64 2024-04-01T06:47:46.962 INFO:teuthology.orchestra.run.smithi145.stdout: openssl-devel-1:1.1.1k-12.el8_9.x86_64 2024-04-01T06:47:46.962 INFO:teuthology.orchestra.run.smithi145.stdout: pcre2-devel-10.32-2.el8.x86_64 2024-04-01T06:47:46.962 INFO:teuthology.orchestra.run.smithi145.stdout: pcre2-utf16-10.32-2.el8.x86_64 2024-04-01T06:47:46.962 INFO:teuthology.orchestra.run.smithi145.stdout: pcre2-utf32-10.32-2.el8.x86_64 2024-04-01T06:47:46.963 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-04-01T06:47:46.963 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql-contrib-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-04-01T06:47:46.963 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql-server-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-04-01T06:47:46.963 INFO:teuthology.orchestra.run.smithi145.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-04-01T06:47:46.963 INFO:teuthology.orchestra.run.smithi145.stdout: python3-babel-2.5.1-7.el8.noarch 2024-04-01T06:47:46.963 INFO:teuthology.orchestra.run.smithi145.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-04-01T06:47:46.963 INFO:teuthology.orchestra.run.smithi145.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-04-01T06:47:46.963 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-04-01T06:47:46.963 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ceph-argparse-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:46.963 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ceph-common-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:46.963 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cephfs-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:46.963 INFO:teuthology.orchestra.run.smithi145.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-04-01T06:47:46.963 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-04-01T06:47:46.963 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-04-01T06:47:46.963 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-04-01T06:47:46.964 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cryptography-3.2.1-7.el8_9.x86_64 2024-04-01T06:47:46.964 INFO:teuthology.orchestra.run.smithi145.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-04-01T06:47:46.964 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-6.2-6.el8.noarch 2024-04-01T06:47:46.964 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-04-01T06:47:46.964 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jinja2-2.10.1-3.el8.noarch 2024-04-01T06:47:46.964 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-04-01T06:47:46.964 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-04-01T06:47:46.964 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-04-01T06:47:46.964 INFO:teuthology.orchestra.run.smithi145.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-04-01T06:47:46.964 INFO:teuthology.orchestra.run.smithi145.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-04-01T06:47:46.964 INFO:teuthology.orchestra.run.smithi145.stdout: python3-mako-1.0.6-14.el8.noarch 2024-04-01T06:47:46.964 INFO:teuthology.orchestra.run.smithi145.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-04-01T06:47:46.964 INFO:teuthology.orchestra.run.smithi145.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-04-01T06:47:46.964 INFO:teuthology.orchestra.run.smithi145.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-04-01T06:47:46.964 INFO:teuthology.orchestra.run.smithi145.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-04-01T06:47:46.965 INFO:teuthology.orchestra.run.smithi145.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-04-01T06:47:46.965 INFO:teuthology.orchestra.run.smithi145.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-04-01T06:47:46.965 INFO:teuthology.orchestra.run.smithi145.stdout: python3-packaging-16.8-9.el8.noarch 2024-04-01T06:47:46.965 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-04-01T06:47:46.965 INFO:teuthology.orchestra.run.smithi145.stdout: python3-portend-2.6-1.el8.noarch 2024-04-01T06:47:46.965 INFO:teuthology.orchestra.run.smithi145.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-04-01T06:47:46.965 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-04-01T06:47:46.965 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-04-01T06:47:46.965 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-04-01T06:47:46.965 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pycparser-2.14-14.el8.noarch 2024-04-01T06:47:46.965 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pytz-2017.2-11.el8.noarch 2024-04-01T06:47:46.965 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rados-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:46.965 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rbd-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:46.965 INFO:teuthology.orchestra.run.smithi145.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-04-01T06:47:46.966 INFO:teuthology.orchestra.run.smithi145.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-04-01T06:47:46.966 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rgw-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:46.966 INFO:teuthology.orchestra.run.smithi145.stdout: python3-routes-2.4.1-12.el8.noarch 2024-04-01T06:47:46.966 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rsa-4.9-2.el8.noarch 2024-04-01T06:47:46.966 INFO:teuthology.orchestra.run.smithi145.stdout: python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525.x86_64 2024-04-01T06:47:46.966 INFO:teuthology.orchestra.run.smithi145.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-04-01T06:47:46.966 INFO:teuthology.orchestra.run.smithi145.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-04-01T06:47:46.966 INFO:teuthology.orchestra.run.smithi145.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-04-01T06:47:46.966 INFO:teuthology.orchestra.run.smithi145.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-04-01T06:47:46.966 INFO:teuthology.orchestra.run.smithi145.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-04-01T06:47:46.966 INFO:teuthology.orchestra.run.smithi145.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-04-01T06:47:46.966 INFO:teuthology.orchestra.run.smithi145.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-04-01T06:47:46.966 INFO:teuthology.orchestra.run.smithi145.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-04-01T06:47:46.966 INFO:teuthology.orchestra.run.smithi145.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-04-01T06:47:46.966 INFO:teuthology.orchestra.run.smithi145.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-04-01T06:47:46.967 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-fuse-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:46.967 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-mirror-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:46.967 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-nbd-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:46.967 INFO:teuthology.orchestra.run.smithi145.stdout: socat-1.7.4.1-1.el8.x86_64 2024-04-01T06:47:46.967 INFO:teuthology.orchestra.run.smithi145.stdout: thrift-0.13.0-2.el8.x86_64 2024-04-01T06:47:46.967 INFO:teuthology.orchestra.run.smithi145.stdout: uuid-1.6.2-43.el8.x86_64 2024-04-01T06:47:46.967 INFO:teuthology.orchestra.run.smithi145.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-04-01T06:47:46.967 INFO:teuthology.orchestra.run.smithi145.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-04-01T06:47:46.967 INFO:teuthology.orchestra.run.smithi145.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2024-04-01T06:47:46.967 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-04-01T06:47:46.968 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-04-01T06:47:47.199 DEBUG:teuthology.parallel:result is None 2024-04-01T06:47:49.639 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 162/162 2024-04-01T06:47:49.640 INFO:teuthology.orchestra.run.smithi153.stdout:Installed products updated. 2024-04-01T06:47:50.949 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-01T06:47:50.949 INFO:teuthology.orchestra.run.smithi153.stdout:Upgraded: 2024-04-01T06:47:50.949 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-libelf-0.189-3.el8.x86_64 2024-04-01T06:47:50.950 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-libs-0.189-3.el8.x86_64 2024-04-01T06:47:50.950 INFO:teuthology.orchestra.run.smithi153.stdout: iproute-6.2.0-5.el8_9.x86_64 2024-04-01T06:47:50.950 INFO:teuthology.orchestra.run.smithi153.stdout: libblkid-2.32.1-43.el8.x86_64 2024-04-01T06:47:50.950 INFO:teuthology.orchestra.run.smithi153.stdout: libfdisk-2.32.1-43.el8.x86_64 2024-04-01T06:47:50.950 INFO:teuthology.orchestra.run.smithi153.stdout: libmount-2.32.1-43.el8.x86_64 2024-04-01T06:47:50.950 INFO:teuthology.orchestra.run.smithi153.stdout: librados2-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:50.950 INFO:teuthology.orchestra.run.smithi153.stdout: librbd1-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:50.950 INFO:teuthology.orchestra.run.smithi153.stdout: libsmartcols-2.32.1-43.el8.x86_64 2024-04-01T06:47:50.950 INFO:teuthology.orchestra.run.smithi153.stdout: libuuid-2.32.1-43.el8.x86_64 2024-04-01T06:47:50.950 INFO:teuthology.orchestra.run.smithi153.stdout: openssl-1:1.1.1k-12.el8_9.x86_64 2024-04-01T06:47:50.950 INFO:teuthology.orchestra.run.smithi153.stdout: openssl-libs-1:1.1.1k-12.el8_9.x86_64 2024-04-01T06:47:50.950 INFO:teuthology.orchestra.run.smithi153.stdout: util-linux-2.32.1-43.el8.x86_64 2024-04-01T06:47:50.953 INFO:teuthology.orchestra.run.smithi153.stdout: util-linux-user-2.32.1-43.el8.x86_64 2024-04-01T06:47:50.953 INFO:teuthology.orchestra.run.smithi153.stdout: xfsdump-3.1.8-7.el8_9.x86_64 2024-04-01T06:47:50.953 INFO:teuthology.orchestra.run.smithi153.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-04-01T06:47:50.953 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-04-01T06:47:50.953 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager-initscripts-updown-1:1.40.16-13.el8_9.noarch 2024-04-01T06:47:50.954 INFO:teuthology.orchestra.run.smithi153.stdout: automake-1.16.1-8.el8.noarch 2024-04-01T06:47:50.954 INFO:teuthology.orchestra.run.smithi153.stdout: bison-3.0.4-10.el8.x86_64 2024-04-01T06:47:50.954 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:50.954 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-base-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:50.954 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-common-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:50.954 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-fuse-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:50.954 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-grafana-dashboards-2:18.2.2-1001.g9d2ee692.el8.noarch 2024-04-01T06:47:50.954 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-immutable-object-cache-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:50.954 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mds-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:50.954 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:50.954 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-cephadm-2:18.2.2-1001.g9d2ee692.el8.noarch 2024-04-01T06:47:50.954 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-dashboard-2:18.2.2-1001.g9d2ee692.el8.noarch 2024-04-01T06:47:50.954 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1001.g9d2ee692.el8.noarch 2024-04-01T06:47:50.955 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-modules-core-2:18.2.2-1001.g9d2ee692.el8.noarch 2024-04-01T06:47:50.955 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-rook-2:18.2.2-1001.g9d2ee692.el8.noarch 2024-04-01T06:47:50.955 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mon-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:50.955 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-osd-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:50.955 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-prometheus-alerts-2:18.2.2-1001.g9d2ee692.el8.noarch 2024-04-01T06:47:50.955 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-radosgw-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:50.955 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-selinux-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:50.955 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-test-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:50.955 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-volume-2:18.2.2-1001.g9d2ee692.el8.noarch 2024-04-01T06:47:50.955 INFO:teuthology.orchestra.run.smithi153.stdout: cephadm-2:18.2.2-1001.g9d2ee692.el8.noarch 2024-04-01T06:47:50.955 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-mirror-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:50.955 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-top-2:18.2.2-1001.g9d2ee692.el8.noarch 2024-04-01T06:47:50.955 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2024-04-01T06:47:50.956 INFO:teuthology.orchestra.run.smithi153.stdout: flex-2.6.1-9.el8.x86_64 2024-04-01T06:47:50.956 INFO:teuthology.orchestra.run.smithi153.stdout: fuse-2.9.7-17.el8.x86_64 2024-04-01T06:47:50.956 INFO:teuthology.orchestra.run.smithi153.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-04-01T06:47:50.956 INFO:teuthology.orchestra.run.smithi153.stdout: jq-1.6-7.el8.x86_64 2024-04-01T06:47:50.956 INFO:teuthology.orchestra.run.smithi153.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-04-01T06:47:50.956 INFO:teuthology.orchestra.run.smithi153.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2024-04-01T06:47:50.956 INFO:teuthology.orchestra.run.smithi153.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-04-01T06:47:50.956 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs-devel-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:50.956 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs2-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:50.956 INFO:teuthology.orchestra.run.smithi153.stdout: libcephsqlite-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:50.956 INFO:teuthology.orchestra.run.smithi153.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2024-04-01T06:47:50.956 INFO:teuthology.orchestra.run.smithi153.stdout: libgfortran-8.5.0-20.el8.x86_64 2024-04-01T06:47:50.956 INFO:teuthology.orchestra.run.smithi153.stdout: liboath-2.6.2-3.el8.x86_64 2024-04-01T06:47:50.957 INFO:teuthology.orchestra.run.smithi153.stdout: libpq-13.11-1.el8.x86_64 2024-04-01T06:47:50.957 INFO:teuthology.orchestra.run.smithi153.stdout: libquadmath-8.5.0-20.el8.x86_64 2024-04-01T06:47:50.957 INFO:teuthology.orchestra.run.smithi153.stdout: librabbitmq-0.9.0-5.el8_9.x86_64 2024-04-01T06:47:50.957 INFO:teuthology.orchestra.run.smithi153.stdout: librados-devel-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:50.957 INFO:teuthology.orchestra.run.smithi153.stdout: libradosstriper1-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:50.957 INFO:teuthology.orchestra.run.smithi153.stdout: librdkafka-0.11.4-3.el8.x86_64 2024-04-01T06:47:50.957 INFO:teuthology.orchestra.run.smithi153.stdout: librgw2-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:50.957 INFO:teuthology.orchestra.run.smithi153.stdout: libselinux-devel-2.9-5.el8.x86_64 2024-04-01T06:47:50.957 INFO:teuthology.orchestra.run.smithi153.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-04-01T06:47:50.957 INFO:teuthology.orchestra.run.smithi153.stdout: libtool-2.4.6-25.el8.x86_64 2024-04-01T06:47:50.957 INFO:teuthology.orchestra.run.smithi153.stdout: libunwind-1.3.1-3.el8.x86_64 2024-04-01T06:47:50.957 INFO:teuthology.orchestra.run.smithi153.stdout: libuuid-devel-2.32.1-43.el8.x86_64 2024-04-01T06:47:50.957 INFO:teuthology.orchestra.run.smithi153.stdout: libverto-devel-0.3.0-5.el8.x86_64 2024-04-01T06:47:50.958 INFO:teuthology.orchestra.run.smithi153.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-04-01T06:47:50.958 INFO:teuthology.orchestra.run.smithi153.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-04-01T06:47:50.958 INFO:teuthology.orchestra.run.smithi153.stdout: oniguruma-6.8.2-2.1.el8_9.x86_64 2024-04-01T06:47:50.958 INFO:teuthology.orchestra.run.smithi153.stdout: openblas-0.3.15-6.el8.x86_64 2024-04-01T06:47:50.958 INFO:teuthology.orchestra.run.smithi153.stdout: openblas-threads-0.3.15-6.el8.x86_64 2024-04-01T06:47:50.958 INFO:teuthology.orchestra.run.smithi153.stdout: openssl-devel-1:1.1.1k-12.el8_9.x86_64 2024-04-01T06:47:50.958 INFO:teuthology.orchestra.run.smithi153.stdout: pcre2-devel-10.32-2.el8.x86_64 2024-04-01T06:47:50.958 INFO:teuthology.orchestra.run.smithi153.stdout: pcre2-utf16-10.32-2.el8.x86_64 2024-04-01T06:47:50.958 INFO:teuthology.orchestra.run.smithi153.stdout: pcre2-utf32-10.32-2.el8.x86_64 2024-04-01T06:47:50.958 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-04-01T06:47:50.958 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-contrib-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-04-01T06:47:50.958 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-server-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-04-01T06:47:50.958 INFO:teuthology.orchestra.run.smithi153.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-04-01T06:47:50.958 INFO:teuthology.orchestra.run.smithi153.stdout: python3-babel-2.5.1-7.el8.noarch 2024-04-01T06:47:50.959 INFO:teuthology.orchestra.run.smithi153.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-04-01T06:47:50.959 INFO:teuthology.orchestra.run.smithi153.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-04-01T06:47:50.959 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-04-01T06:47:50.959 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-argparse-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:50.959 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-common-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:50.959 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cephfs-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:50.959 INFO:teuthology.orchestra.run.smithi153.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-04-01T06:47:50.959 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-04-01T06:47:50.959 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-04-01T06:47:50.959 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-04-01T06:47:50.959 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cryptography-3.2.1-7.el8_9.x86_64 2024-04-01T06:47:50.959 INFO:teuthology.orchestra.run.smithi153.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-04-01T06:47:50.959 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-6.2-6.el8.noarch 2024-04-01T06:47:50.959 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-04-01T06:47:50.960 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jinja2-2.10.1-3.el8.noarch 2024-04-01T06:47:50.960 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-04-01T06:47:50.960 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-04-01T06:47:50.960 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-04-01T06:47:50.960 INFO:teuthology.orchestra.run.smithi153.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-04-01T06:47:50.960 INFO:teuthology.orchestra.run.smithi153.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-04-01T06:47:50.960 INFO:teuthology.orchestra.run.smithi153.stdout: python3-mako-1.0.6-14.el8.noarch 2024-04-01T06:47:50.960 INFO:teuthology.orchestra.run.smithi153.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-04-01T06:47:50.960 INFO:teuthology.orchestra.run.smithi153.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-04-01T06:47:50.960 INFO:teuthology.orchestra.run.smithi153.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-04-01T06:47:50.960 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-04-01T06:47:50.960 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-04-01T06:47:50.960 INFO:teuthology.orchestra.run.smithi153.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-04-01T06:47:50.961 INFO:teuthology.orchestra.run.smithi153.stdout: python3-packaging-16.8-9.el8.noarch 2024-04-01T06:47:50.961 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-04-01T06:47:50.961 INFO:teuthology.orchestra.run.smithi153.stdout: python3-portend-2.6-1.el8.noarch 2024-04-01T06:47:50.961 INFO:teuthology.orchestra.run.smithi153.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-04-01T06:47:50.961 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-04-01T06:47:50.961 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-04-01T06:47:50.961 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-04-01T06:47:50.961 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pycparser-2.14-14.el8.noarch 2024-04-01T06:47:50.961 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pytz-2017.2-11.el8.noarch 2024-04-01T06:47:50.961 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rados-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:50.961 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rbd-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:50.961 INFO:teuthology.orchestra.run.smithi153.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-04-01T06:47:50.961 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-04-01T06:47:50.961 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rgw-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:50.961 INFO:teuthology.orchestra.run.smithi153.stdout: python3-routes-2.4.1-12.el8.noarch 2024-04-01T06:47:50.962 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rsa-4.9-2.el8.noarch 2024-04-01T06:47:50.962 INFO:teuthology.orchestra.run.smithi153.stdout: python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525.x86_64 2024-04-01T06:47:50.962 INFO:teuthology.orchestra.run.smithi153.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-04-01T06:47:50.962 INFO:teuthology.orchestra.run.smithi153.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-04-01T06:47:50.962 INFO:teuthology.orchestra.run.smithi153.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-04-01T06:47:50.962 INFO:teuthology.orchestra.run.smithi153.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-04-01T06:47:50.962 INFO:teuthology.orchestra.run.smithi153.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-04-01T06:47:50.962 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-04-01T06:47:50.962 INFO:teuthology.orchestra.run.smithi153.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-04-01T06:47:50.962 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-04-01T06:47:50.962 INFO:teuthology.orchestra.run.smithi153.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-04-01T06:47:50.962 INFO:teuthology.orchestra.run.smithi153.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-04-01T06:47:50.962 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-fuse-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:50.963 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-mirror-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:50.963 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-nbd-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:50.963 INFO:teuthology.orchestra.run.smithi153.stdout: socat-1.7.4.1-1.el8.x86_64 2024-04-01T06:47:50.963 INFO:teuthology.orchestra.run.smithi153.stdout: thrift-0.13.0-2.el8.x86_64 2024-04-01T06:47:50.963 INFO:teuthology.orchestra.run.smithi153.stdout: uuid-1.6.2-43.el8.x86_64 2024-04-01T06:47:50.963 INFO:teuthology.orchestra.run.smithi153.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-04-01T06:47:50.963 INFO:teuthology.orchestra.run.smithi153.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-04-01T06:47:50.963 INFO:teuthology.orchestra.run.smithi153.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2024-04-01T06:47:50.964 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-01T06:47:50.964 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-04-01T06:47:51.175 DEBUG:teuthology.parallel:result is None 2024-04-01T06:47:56.294 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 162/162 2024-04-01T06:47:56.294 INFO:teuthology.orchestra.run.smithi083.stdout:Installed products updated. 2024-04-01T06:47:56.897 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:47:56.897 INFO:teuthology.orchestra.run.smithi083.stdout:Upgraded: 2024-04-01T06:47:56.897 INFO:teuthology.orchestra.run.smithi083.stdout: elfutils-libelf-0.189-3.el8.x86_64 2024-04-01T06:47:56.897 INFO:teuthology.orchestra.run.smithi083.stdout: elfutils-libs-0.189-3.el8.x86_64 2024-04-01T06:47:56.897 INFO:teuthology.orchestra.run.smithi083.stdout: iproute-6.2.0-5.el8_9.x86_64 2024-04-01T06:47:56.897 INFO:teuthology.orchestra.run.smithi083.stdout: libblkid-2.32.1-43.el8.x86_64 2024-04-01T06:47:56.897 INFO:teuthology.orchestra.run.smithi083.stdout: libfdisk-2.32.1-43.el8.x86_64 2024-04-01T06:47:56.897 INFO:teuthology.orchestra.run.smithi083.stdout: libmount-2.32.1-43.el8.x86_64 2024-04-01T06:47:56.897 INFO:teuthology.orchestra.run.smithi083.stdout: librados2-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:56.897 INFO:teuthology.orchestra.run.smithi083.stdout: librbd1-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:56.897 INFO:teuthology.orchestra.run.smithi083.stdout: libsmartcols-2.32.1-43.el8.x86_64 2024-04-01T06:47:56.897 INFO:teuthology.orchestra.run.smithi083.stdout: libuuid-2.32.1-43.el8.x86_64 2024-04-01T06:47:56.898 INFO:teuthology.orchestra.run.smithi083.stdout: openssl-1:1.1.1k-12.el8_9.x86_64 2024-04-01T06:47:56.898 INFO:teuthology.orchestra.run.smithi083.stdout: openssl-libs-1:1.1.1k-12.el8_9.x86_64 2024-04-01T06:47:56.898 INFO:teuthology.orchestra.run.smithi083.stdout: util-linux-2.32.1-43.el8.x86_64 2024-04-01T06:47:56.898 INFO:teuthology.orchestra.run.smithi083.stdout: util-linux-user-2.32.1-43.el8.x86_64 2024-04-01T06:47:56.898 INFO:teuthology.orchestra.run.smithi083.stdout: xfsdump-3.1.8-7.el8_9.x86_64 2024-04-01T06:47:56.898 INFO:teuthology.orchestra.run.smithi083.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-04-01T06:47:56.898 INFO:teuthology.orchestra.run.smithi083.stdout:Installed: 2024-04-01T06:47:56.898 INFO:teuthology.orchestra.run.smithi083.stdout: NetworkManager-initscripts-updown-1:1.40.16-13.el8_9.noarch 2024-04-01T06:47:56.898 INFO:teuthology.orchestra.run.smithi083.stdout: automake-1.16.1-8.el8.noarch 2024-04-01T06:47:56.898 INFO:teuthology.orchestra.run.smithi083.stdout: bison-3.0.4-10.el8.x86_64 2024-04-01T06:47:56.898 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:56.898 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-base-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:56.898 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-common-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:56.898 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-fuse-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:56.899 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-grafana-dashboards-2:18.2.2-1001.g9d2ee692.el8.noarch 2024-04-01T06:47:56.899 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-immutable-object-cache-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:56.899 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mds-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:56.899 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:56.899 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-cephadm-2:18.2.2-1001.g9d2ee692.el8.noarch 2024-04-01T06:47:56.899 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-dashboard-2:18.2.2-1001.g9d2ee692.el8.noarch 2024-04-01T06:47:56.899 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1001.g9d2ee692.el8.noarch 2024-04-01T06:47:56.899 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-modules-core-2:18.2.2-1001.g9d2ee692.el8.noarch 2024-04-01T06:47:56.899 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-rook-2:18.2.2-1001.g9d2ee692.el8.noarch 2024-04-01T06:47:56.899 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mon-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:56.899 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-osd-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:56.899 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-prometheus-alerts-2:18.2.2-1001.g9d2ee692.el8.noarch 2024-04-01T06:47:56.899 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-radosgw-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:56.899 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-selinux-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:56.899 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-test-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:56.900 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-volume-2:18.2.2-1001.g9d2ee692.el8.noarch 2024-04-01T06:47:56.900 INFO:teuthology.orchestra.run.smithi083.stdout: cephadm-2:18.2.2-1001.g9d2ee692.el8.noarch 2024-04-01T06:47:56.900 INFO:teuthology.orchestra.run.smithi083.stdout: cephfs-mirror-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:56.900 INFO:teuthology.orchestra.run.smithi083.stdout: cephfs-top-2:18.2.2-1001.g9d2ee692.el8.noarch 2024-04-01T06:47:56.900 INFO:teuthology.orchestra.run.smithi083.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2024-04-01T06:47:56.900 INFO:teuthology.orchestra.run.smithi083.stdout: flex-2.6.1-9.el8.x86_64 2024-04-01T06:47:56.900 INFO:teuthology.orchestra.run.smithi083.stdout: fuse-2.9.7-17.el8.x86_64 2024-04-01T06:47:56.900 INFO:teuthology.orchestra.run.smithi083.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-04-01T06:47:56.900 INFO:teuthology.orchestra.run.smithi083.stdout: jq-1.6-7.el8.x86_64 2024-04-01T06:47:56.900 INFO:teuthology.orchestra.run.smithi083.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-04-01T06:47:56.900 INFO:teuthology.orchestra.run.smithi083.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2024-04-01T06:47:56.900 INFO:teuthology.orchestra.run.smithi083.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-04-01T06:47:56.900 INFO:teuthology.orchestra.run.smithi083.stdout: libcephfs-devel-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:56.900 INFO:teuthology.orchestra.run.smithi083.stdout: libcephfs2-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:56.901 INFO:teuthology.orchestra.run.smithi083.stdout: libcephsqlite-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:56.901 INFO:teuthology.orchestra.run.smithi083.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2024-04-01T06:47:56.901 INFO:teuthology.orchestra.run.smithi083.stdout: libgfortran-8.5.0-20.el8.x86_64 2024-04-01T06:47:56.901 INFO:teuthology.orchestra.run.smithi083.stdout: liboath-2.6.2-3.el8.x86_64 2024-04-01T06:47:56.901 INFO:teuthology.orchestra.run.smithi083.stdout: libpq-13.11-1.el8.x86_64 2024-04-01T06:47:56.901 INFO:teuthology.orchestra.run.smithi083.stdout: libquadmath-8.5.0-20.el8.x86_64 2024-04-01T06:47:56.901 INFO:teuthology.orchestra.run.smithi083.stdout: librabbitmq-0.9.0-5.el8_9.x86_64 2024-04-01T06:47:56.901 INFO:teuthology.orchestra.run.smithi083.stdout: librados-devel-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:56.901 INFO:teuthology.orchestra.run.smithi083.stdout: libradosstriper1-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:56.901 INFO:teuthology.orchestra.run.smithi083.stdout: librdkafka-0.11.4-3.el8.x86_64 2024-04-01T06:47:56.901 INFO:teuthology.orchestra.run.smithi083.stdout: librgw2-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:56.901 INFO:teuthology.orchestra.run.smithi083.stdout: libselinux-devel-2.9-5.el8.x86_64 2024-04-01T06:47:56.901 INFO:teuthology.orchestra.run.smithi083.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-04-01T06:47:56.901 INFO:teuthology.orchestra.run.smithi083.stdout: libtool-2.4.6-25.el8.x86_64 2024-04-01T06:47:56.902 INFO:teuthology.orchestra.run.smithi083.stdout: libunwind-1.3.1-3.el8.x86_64 2024-04-01T06:47:56.902 INFO:teuthology.orchestra.run.smithi083.stdout: libuuid-devel-2.32.1-43.el8.x86_64 2024-04-01T06:47:56.902 INFO:teuthology.orchestra.run.smithi083.stdout: libverto-devel-0.3.0-5.el8.x86_64 2024-04-01T06:47:56.902 INFO:teuthology.orchestra.run.smithi083.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-04-01T06:47:56.902 INFO:teuthology.orchestra.run.smithi083.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-04-01T06:47:56.902 INFO:teuthology.orchestra.run.smithi083.stdout: oniguruma-6.8.2-2.1.el8_9.x86_64 2024-04-01T06:47:56.902 INFO:teuthology.orchestra.run.smithi083.stdout: openblas-0.3.15-6.el8.x86_64 2024-04-01T06:47:56.902 INFO:teuthology.orchestra.run.smithi083.stdout: openblas-threads-0.3.15-6.el8.x86_64 2024-04-01T06:47:56.902 INFO:teuthology.orchestra.run.smithi083.stdout: openssl-devel-1:1.1.1k-12.el8_9.x86_64 2024-04-01T06:47:56.902 INFO:teuthology.orchestra.run.smithi083.stdout: pcre2-devel-10.32-2.el8.x86_64 2024-04-01T06:47:56.902 INFO:teuthology.orchestra.run.smithi083.stdout: pcre2-utf16-10.32-2.el8.x86_64 2024-04-01T06:47:56.902 INFO:teuthology.orchestra.run.smithi083.stdout: pcre2-utf32-10.32-2.el8.x86_64 2024-04-01T06:47:56.902 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-04-01T06:47:56.903 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql-contrib-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-04-01T06:47:56.903 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql-server-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-04-01T06:47:56.903 INFO:teuthology.orchestra.run.smithi083.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-04-01T06:47:56.903 INFO:teuthology.orchestra.run.smithi083.stdout: python3-babel-2.5.1-7.el8.noarch 2024-04-01T06:47:56.903 INFO:teuthology.orchestra.run.smithi083.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-04-01T06:47:56.903 INFO:teuthology.orchestra.run.smithi083.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-04-01T06:47:56.903 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-04-01T06:47:56.903 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ceph-argparse-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:56.903 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ceph-common-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:56.903 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cephfs-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:56.903 INFO:teuthology.orchestra.run.smithi083.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-04-01T06:47:56.903 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-04-01T06:47:56.903 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-04-01T06:47:56.903 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-04-01T06:47:56.904 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cryptography-3.2.1-7.el8_9.x86_64 2024-04-01T06:47:56.904 INFO:teuthology.orchestra.run.smithi083.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-04-01T06:47:56.904 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-6.2-6.el8.noarch 2024-04-01T06:47:56.904 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-04-01T06:47:56.904 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jinja2-2.10.1-3.el8.noarch 2024-04-01T06:47:56.906 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-04-01T06:47:56.906 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-04-01T06:47:56.906 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-04-01T06:47:56.906 INFO:teuthology.orchestra.run.smithi083.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-04-01T06:47:56.906 INFO:teuthology.orchestra.run.smithi083.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-04-01T06:47:56.906 INFO:teuthology.orchestra.run.smithi083.stdout: python3-mako-1.0.6-14.el8.noarch 2024-04-01T06:47:56.906 INFO:teuthology.orchestra.run.smithi083.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-04-01T06:47:56.906 INFO:teuthology.orchestra.run.smithi083.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-04-01T06:47:56.906 INFO:teuthology.orchestra.run.smithi083.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-04-01T06:47:56.906 INFO:teuthology.orchestra.run.smithi083.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-04-01T06:47:56.906 INFO:teuthology.orchestra.run.smithi083.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-04-01T06:47:56.906 INFO:teuthology.orchestra.run.smithi083.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-04-01T06:47:56.907 INFO:teuthology.orchestra.run.smithi083.stdout: python3-packaging-16.8-9.el8.noarch 2024-04-01T06:47:56.907 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-04-01T06:47:56.907 INFO:teuthology.orchestra.run.smithi083.stdout: python3-portend-2.6-1.el8.noarch 2024-04-01T06:47:56.907 INFO:teuthology.orchestra.run.smithi083.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-04-01T06:47:56.907 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-04-01T06:47:56.907 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-04-01T06:47:56.907 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-04-01T06:47:56.907 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pycparser-2.14-14.el8.noarch 2024-04-01T06:47:56.907 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pytz-2017.2-11.el8.noarch 2024-04-01T06:47:56.907 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rados-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:56.907 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rbd-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:56.907 INFO:teuthology.orchestra.run.smithi083.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-04-01T06:47:56.907 INFO:teuthology.orchestra.run.smithi083.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-04-01T06:47:56.907 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rgw-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:56.908 INFO:teuthology.orchestra.run.smithi083.stdout: python3-routes-2.4.1-12.el8.noarch 2024-04-01T06:47:56.908 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rsa-4.9-2.el8.noarch 2024-04-01T06:47:56.908 INFO:teuthology.orchestra.run.smithi083.stdout: python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525.x86_64 2024-04-01T06:47:56.908 INFO:teuthology.orchestra.run.smithi083.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-04-01T06:47:56.908 INFO:teuthology.orchestra.run.smithi083.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-04-01T06:47:56.908 INFO:teuthology.orchestra.run.smithi083.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-04-01T06:47:56.908 INFO:teuthology.orchestra.run.smithi083.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-04-01T06:47:56.908 INFO:teuthology.orchestra.run.smithi083.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-04-01T06:47:56.908 INFO:teuthology.orchestra.run.smithi083.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-04-01T06:47:56.908 INFO:teuthology.orchestra.run.smithi083.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-04-01T06:47:56.909 INFO:teuthology.orchestra.run.smithi083.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-04-01T06:47:56.909 INFO:teuthology.orchestra.run.smithi083.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-04-01T06:47:56.909 INFO:teuthology.orchestra.run.smithi083.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-04-01T06:47:56.909 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-fuse-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:56.909 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-mirror-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:56.909 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-nbd-2:18.2.2-1001.g9d2ee692.el8.x86_64 2024-04-01T06:47:56.909 INFO:teuthology.orchestra.run.smithi083.stdout: socat-1.7.4.1-1.el8.x86_64 2024-04-01T06:47:56.909 INFO:teuthology.orchestra.run.smithi083.stdout: thrift-0.13.0-2.el8.x86_64 2024-04-01T06:47:56.909 INFO:teuthology.orchestra.run.smithi083.stdout: uuid-1.6.2-43.el8.x86_64 2024-04-01T06:47:56.909 INFO:teuthology.orchestra.run.smithi083.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-04-01T06:47:56.909 INFO:teuthology.orchestra.run.smithi083.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-04-01T06:47:56.910 INFO:teuthology.orchestra.run.smithi083.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2024-04-01T06:47:56.910 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:47:56.910 INFO:teuthology.orchestra.run.smithi083.stdout:Complete! 2024-04-01T06:47:57.113 DEBUG:teuthology.parallel:result is None 2024-04-01T06:47:57.114 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 2024-04-01T06:47:57.356 DEBUG:teuthology.orchestra.run.smithi083:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-01T06:47:57.380 INFO:teuthology.orchestra.run.smithi083.stdout:18.2.2-1001.g9d2ee692.el8 2024-04-01T06:47:57.381 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1001.g9d2ee692.el8 2024-04-01T06:47:57.381 INFO:teuthology.task.install:The correct ceph version 18.2.2-1001.g9d2ee692 is installed. 2024-04-01T06:47:57.383 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 2024-04-01T06:47:57.604 DEBUG:teuthology.orchestra.run.smithi145:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-01T06:47:57.633 INFO:teuthology.orchestra.run.smithi145.stdout:18.2.2-1001.g9d2ee692.el8 2024-04-01T06:47:57.633 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1001.g9d2ee692.el8 2024-04-01T06:47:57.633 INFO:teuthology.task.install:The correct ceph version 18.2.2-1001.g9d2ee692 is installed. 2024-04-01T06:47:57.635 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 2024-04-01T06:47:57.778 DEBUG:teuthology.orchestra.run.smithi153:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-01T06:47:57.807 INFO:teuthology.orchestra.run.smithi153.stdout:18.2.2-1001.g9d2ee692.el8 2024-04-01T06:47:57.808 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1001.g9d2ee692.el8 2024-04-01T06:47:57.808 INFO:teuthology.task.install:The correct ceph version 18.2.2-1001.g9d2ee692 is installed. 2024-04-01T06:47:57.809 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-01T06:47:57.810 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-04-01T06:47:57.810 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-01T06:47:57.852 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-04-01T06:47:57.853 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-01T06:47:57.902 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-04-01T06:47:57.902 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-01T06:47:57.951 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-01T06:47:57.951 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-04-01T06:47:57.951 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/usr/bin/daemon-helper 2024-04-01T06:47:57.979 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-01T06:47:58.045 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-04-01T06:47:58.046 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/usr/bin/daemon-helper 2024-04-01T06:47:58.077 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-01T06:47:58.149 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-04-01T06:47:58.150 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/daemon-helper 2024-04-01T06:47:58.182 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-01T06:47:58.252 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-01T06:47:58.252 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-04-01T06:47:58.252 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-01T06:47:58.279 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-01T06:47:58.346 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-04-01T06:47:58.346 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-01T06:47:58.378 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-01T06:47:58.449 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-04-01T06:47:58.449 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-01T06:47:58.481 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-01T06:47:58.551 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-01T06:47:58.552 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-04-01T06:47:58.552 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/usr/bin/stdin-killer 2024-04-01T06:47:58.579 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-01T06:47:58.645 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-04-01T06:47:58.645 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/usr/bin/stdin-killer 2024-04-01T06:47:58.677 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-01T06:47:58.750 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-04-01T06:47:58.751 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/stdin-killer 2024-04-01T06:47:58.782 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-01T06:47:58.853 INFO:teuthology.run_tasks:Running task cephadm... 2024-04-01T06:47:58.935 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-04-01T06:47:58.935 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 2024-04-01T06:47:58.935 INFO:tasks.cephadm:Cluster fsid is c6f8eff4-eff3-11ee-b647-cb9ed24678a4 2024-04-01T06:47:58.936 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-04-01T06:47:58.936 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.83', 'mon.b': '172.21.15.145', 'mon.c': '172.21.15.153'} 2024-04-01T06:47:58.936 INFO:tasks.cephadm:First mon is mon.a on smithi083 2024-04-01T06:47:58.936 INFO:tasks.cephadm:First mgr is x 2024-04-01T06:47:58.936 INFO:tasks.cephadm:Normalizing hostnames... 2024-04-01T06:47:58.936 DEBUG:teuthology.orchestra.run.smithi083:> sudo hostname $(hostname -s) 2024-04-01T06:47:58.964 DEBUG:teuthology.orchestra.run.smithi145:> sudo hostname $(hostname -s) 2024-04-01T06:47:58.997 DEBUG:teuthology.orchestra.run.smithi153:> sudo hostname $(hostname -s) 2024-04-01T06:47:59.027 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-04-01T06:47:59.027 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 2024-04-01T06:47:59.259 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic/54709/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.2.2-1001-g9d2ee692', 'node_name': '172.21.5.31+adami01', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic', 'package_manager_version': '18.2.2-1001.g9d2ee692'}, 'url': 'https://3.chacra.ceph.com/r/ceph/reef/9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12/centos/8/flavors/default/', 'distro_codename': None, 'modified': '2024-03-27 04:56:18.033487', 'distro_version': '8', 'project': 'ceph', 'flavor': 'default', 'ref': 'reef', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/reef/9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12/centos/8/flavors/default/', 'archs': ['arm64', 'x86_64', 'source'], 'distro': 'centos'}] 2024-04-01T06:47:59.402 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref reef, sha1 9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F8%2Fx86_64&flavor=default&sha1=9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 2024-04-01T06:47:59.404 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/reef/9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12/centos/8/x86_64/flavors/default/cephadm 2024-04-01T06:47:59.404 DEBUG:teuthology.orchestra.run.smithi083:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/reef/9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-01T06:47:59.873 INFO:teuthology.orchestra.run.smithi083.stdout:-rw-rw-r--. 1 ubuntu ubuntu 703022 Apr 1 06:47 /home/ubuntu/cephtest/cephadm 2024-04-01T06:47:59.874 DEBUG:teuthology.orchestra.run.smithi145:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/reef/9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-01T06:48:00.294 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-rw-r--. 1 ubuntu ubuntu 703022 Apr 1 06:48 /home/ubuntu/cephtest/cephadm 2024-04-01T06:48:00.295 DEBUG:teuthology.orchestra.run.smithi153:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/reef/9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-01T06:48:00.710 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-rw-r--. 1 ubuntu ubuntu 703022 Apr 1 06:48 /home/ubuntu/cephtest/cephadm 2024-04-01T06:48:00.710 DEBUG:teuthology.orchestra.run.smithi083:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-01T06:48:00.732 DEBUG:teuthology.orchestra.run.smithi145:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-01T06:48:00.754 DEBUG:teuthology.orchestra.run.smithi153:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-01T06:48:00.796 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 on all hosts... 2024-04-01T06:48:00.796 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 pull 2024-04-01T06:48:00.799 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 pull 2024-04-01T06:48:00.801 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 pull 2024-04-01T06:48:02.847 INFO:teuthology.orchestra.run.smithi145.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12... 2024-04-01T06:48:03.464 INFO:teuthology.orchestra.run.smithi153.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12... 2024-04-01T06:48:04.821 INFO:teuthology.orchestra.run.smithi083.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12... 2024-04-01T06:48:27.786 INFO:teuthology.orchestra.run.smithi145.stdout:{ 2024-04-01T06:48:27.786 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_version": "ceph version 18.2.2-1001-g9d2ee692 (9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12) reef (stable)", 2024-04-01T06:48:27.786 INFO:teuthology.orchestra.run.smithi145.stdout: "image_id": "37bf26e8388eb4e18da1da02610fc6fdbde9f81a57677338c736d7649a729632", 2024-04-01T06:48:27.787 INFO:teuthology.orchestra.run.smithi145.stdout: "repo_digests": [ 2024-04-01T06:48:27.787 INFO:teuthology.orchestra.run.smithi145.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:0ce8eb8c5040cd23b1d5a9c661255974d4168935b67ce5f9538fba80238c4dcd" 2024-04-01T06:48:27.787 INFO:teuthology.orchestra.run.smithi145.stdout: ] 2024-04-01T06:48:27.787 INFO:teuthology.orchestra.run.smithi145.stdout:} 2024-04-01T06:48:28.848 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-01T06:48:28.848 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_version": "ceph version 18.2.2-1001-g9d2ee692 (9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12) reef (stable)", 2024-04-01T06:48:28.848 INFO:teuthology.orchestra.run.smithi153.stdout: "image_id": "37bf26e8388eb4e18da1da02610fc6fdbde9f81a57677338c736d7649a729632", 2024-04-01T06:48:28.849 INFO:teuthology.orchestra.run.smithi153.stdout: "repo_digests": [ 2024-04-01T06:48:28.849 INFO:teuthology.orchestra.run.smithi153.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:0ce8eb8c5040cd23b1d5a9c661255974d4168935b67ce5f9538fba80238c4dcd" 2024-04-01T06:48:28.849 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-04-01T06:48:28.849 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-01T06:48:35.450 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-04-01T06:48:35.450 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_version": "ceph version 18.2.2-1001-g9d2ee692 (9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12) reef (stable)", 2024-04-01T06:48:35.450 INFO:teuthology.orchestra.run.smithi083.stdout: "image_id": "37bf26e8388eb4e18da1da02610fc6fdbde9f81a57677338c736d7649a729632", 2024-04-01T06:48:35.450 INFO:teuthology.orchestra.run.smithi083.stdout: "repo_digests": [ 2024-04-01T06:48:35.450 INFO:teuthology.orchestra.run.smithi083.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:0ce8eb8c5040cd23b1d5a9c661255974d4168935b67ce5f9538fba80238c4dcd" 2024-04-01T06:48:35.451 INFO:teuthology.orchestra.run.smithi083.stdout: ] 2024-04-01T06:48:35.451 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-04-01T06:48:35.470 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /etc/ceph 2024-04-01T06:48:35.501 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /etc/ceph 2024-04-01T06:48:35.539 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /etc/ceph 2024-04-01T06:48:35.578 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 777 /etc/ceph 2024-04-01T06:48:35.604 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 777 /etc/ceph 2024-04-01T06:48:35.637 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 777 /etc/ceph 2024-04-01T06:48:35.668 INFO:tasks.cephadm:Writing seed config... 2024-04-01T06:48:35.669 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-04-01T06:48:35.669 INFO:tasks.cephadm: override: [client] debug client = 20 2024-04-01T06:48:35.669 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-04-01T06:48:35.669 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-04-01T06:48:35.669 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-04-01T06:48:35.669 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-04-01T06:48:35.669 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-04-01T06:48:35.670 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-04-01T06:48:35.670 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-04-01T06:48:35.670 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-04-01T06:48:35.670 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-04-01T06:48:35.670 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-04-01T06:48:35.670 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-04-01T06:48:35.670 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-04-01T06:48:35.670 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-04-01T06:48:35.670 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-04-01T06:48:35.670 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-04-01T06:48:35.670 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-04-01T06:48:35.670 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-04-01T06:48:35.670 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-04-01T06:48:35.670 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-04-01T06:48:35.670 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-04-01T06:48:35.671 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-04-01T06:48:35.671 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-04-01T06:48:35.671 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-04-01T06:48:35.671 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-04-01T06:48:35.671 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-04-01T06:48:35.671 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-04-01T06:48:35.671 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-04-01T06:48:35.671 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-04-01T06:48:35.671 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-04-01T06:48:35.671 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-04-01T06:48:35.671 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-04-01T06:48:35.671 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-04-01T06:48:35.671 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-04-01T06:48:35.671 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-04-01T06:48:35.672 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-04-01T06:48:35.672 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-04-01T06:48:35.672 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-04-01T06:48:35.672 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-04-01T06:48:35.672 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-04-01T06:48:35.672 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-04-01T06:48:35.672 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-04-01T06:48:35.672 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-04-01T06:48:35.672 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-04-01T06:48:35.673 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-04-01T06:48:35.673 DEBUG:teuthology.orchestra.run.smithi083:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-04-01T06:48:35.690 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = c6f8eff4-eff3-11ee-b647-cb9ed24678a4 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-04-01T06:48:35.690 DEBUG:teuthology.orchestra.run.smithi083:mon.a> sudo journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mon.a.service 2024-04-01T06:48:35.733 DEBUG:teuthology.orchestra.run.smithi083:mgr.x> sudo journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mgr.x.service 2024-04-01T06:48:35.759 INFO:journalctl@ceph.mon.a.smithi083.stdout:-- Logs begin at Mon 2024-04-01 06:34:54 UTC. -- 2024-04-01T06:48:35.759 INFO:tasks.cephadm:Bootstrapping... 2024-04-01T06:48:35.759 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 -v bootstrap --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.83 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-04-01T06:48:35.785 INFO:journalctl@ceph.mgr.x.smithi083.stdout:-- Logs begin at Mon 2024-04-01 06:34:54 UTC. -- 2024-04-01T06:48:35.918 INFO:teuthology.orchestra.run.smithi083.stdout:-------------------------------------------------------------------------------- 2024-04-01T06:48:35.919 INFO:teuthology.orchestra.run.smithi083.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12', '-v', 'bootstrap', '--fsid', 'c6f8eff4-eff3-11ee-b647-cb9ed24678a4', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.83', '--skip-admin-label'] 2024-04-01T06:48:35.952 INFO:teuthology.orchestra.run.smithi083.stdout:/bin/podman: stdout 4.6.1 2024-04-01T06:48:35.952 INFO:teuthology.orchestra.run.smithi083.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-04-01T06:48:35.952 INFO:teuthology.orchestra.run.smithi083.stdout:Verifying podman|docker is present... 2024-04-01T06:48:35.982 INFO:teuthology.orchestra.run.smithi083.stdout:/bin/podman: stdout 4.6.1 2024-04-01T06:48:35.982 INFO:teuthology.orchestra.run.smithi083.stdout:Verifying lvm2 is present... 2024-04-01T06:48:35.982 INFO:teuthology.orchestra.run.smithi083.stdout:Verifying time synchronization is in place... 2024-04-01T06:48:35.989 INFO:teuthology.orchestra.run.smithi083.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-01T06:48:35.990 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-01T06:48:35.995 INFO:teuthology.orchestra.run.smithi083.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-01T06:48:35.995 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stdout inactive 2024-04-01T06:48:36.001 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stdout enabled 2024-04-01T06:48:36.007 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stdout active 2024-04-01T06:48:36.007 INFO:teuthology.orchestra.run.smithi083.stdout:Unit chronyd.service is enabled and running 2024-04-01T06:48:36.007 INFO:teuthology.orchestra.run.smithi083.stdout:Repeating the final host check... 2024-04-01T06:48:36.043 INFO:teuthology.orchestra.run.smithi083.stdout:/bin/podman: stdout 4.6.1 2024-04-01T06:48:36.043 INFO:teuthology.orchestra.run.smithi083.stdout:podman (/bin/podman) version 4.6.1 is present 2024-04-01T06:48:36.043 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl is present 2024-04-01T06:48:36.043 INFO:teuthology.orchestra.run.smithi083.stdout:lvcreate is present 2024-04-01T06:48:36.049 INFO:teuthology.orchestra.run.smithi083.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-01T06:48:36.049 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-01T06:48:36.055 INFO:teuthology.orchestra.run.smithi083.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-01T06:48:36.055 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stdout inactive 2024-04-01T06:48:36.061 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stdout enabled 2024-04-01T06:48:36.066 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stdout active 2024-04-01T06:48:36.067 INFO:teuthology.orchestra.run.smithi083.stdout:Unit chronyd.service is enabled and running 2024-04-01T06:48:36.067 INFO:teuthology.orchestra.run.smithi083.stdout:Host looks OK 2024-04-01T06:48:36.067 INFO:teuthology.orchestra.run.smithi083.stdout:Cluster fsid: c6f8eff4-eff3-11ee-b647-cb9ed24678a4 2024-04-01T06:48:36.067 INFO:teuthology.orchestra.run.smithi083.stdout:Acquiring lock 140608485394920 on /run/cephadm/c6f8eff4-eff3-11ee-b647-cb9ed24678a4.lock 2024-04-01T06:48:36.067 INFO:teuthology.orchestra.run.smithi083.stdout:Lock 140608485394920 acquired on /run/cephadm/c6f8eff4-eff3-11ee-b647-cb9ed24678a4.lock 2024-04-01T06:48:36.067 INFO:teuthology.orchestra.run.smithi083.stdout:Verifying IP 172.21.15.83 port 3300 ... 2024-04-01T06:48:36.067 INFO:teuthology.orchestra.run.smithi083.stdout:Verifying IP 172.21.15.83 port 6789 ... 2024-04-01T06:48:36.068 INFO:teuthology.orchestra.run.smithi083.stdout:Base mon IP(s) is [172.21.15.83:3300, 172.21.15.83:6789], mon addrv is [v2:172.21.15.83:3300,v1:172.21.15.83:6789] 2024-04-01T06:48:36.071 INFO:teuthology.orchestra.run.smithi083.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp metric 100 2024-04-01T06:48:36.071 INFO:teuthology.orchestra.run.smithi083.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.83 metric 100 2024-04-01T06:48:36.074 INFO:teuthology.orchestra.run.smithi083.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-04-01T06:48:36.074 INFO:teuthology.orchestra.run.smithi083.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-04-01T06:48:36.074 INFO:teuthology.orchestra.run.smithi083.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-04-01T06:48:36.076 INFO:teuthology.orchestra.run.smithi083.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-04-01T06:48:36.076 INFO:teuthology.orchestra.run.smithi083.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-04-01T06:48:36.077 INFO:teuthology.orchestra.run.smithi083.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-01T06:48:36.077 INFO:teuthology.orchestra.run.smithi083.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-04-01T06:48:36.077 INFO:teuthology.orchestra.run.smithi083.stdout:/sbin/ip: stdout inet6 fe80::f605:3ebc:3e93:c167/64 scope link noprefixroute 2024-04-01T06:48:36.077 INFO:teuthology.orchestra.run.smithi083.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-01T06:48:36.077 INFO:teuthology.orchestra.run.smithi083.stdout:Mon IP `172.21.15.83` is in CIDR network `172.21.0.0/20` 2024-04-01T06:48:36.077 INFO:teuthology.orchestra.run.smithi083.stdout:Mon IP `172.21.15.83` is in CIDR network `172.21.0.0/20` 2024-04-01T06:48:36.077 INFO:teuthology.orchestra.run.smithi083.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-04-01T06:48:36.078 INFO:teuthology.orchestra.run.smithi083.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-04-01T06:48:36.079 INFO:teuthology.orchestra.run.smithi083.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12... 2024-04-01T06:48:36.470 INFO:teuthology.orchestra.run.smithi083.stdout:/bin/podman: stdout 37bf26e8388eb4e18da1da02610fc6fdbde9f81a57677338c736d7649a729632 2024-04-01T06:48:36.470 INFO:teuthology.orchestra.run.smithi083.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12... 2024-04-01T06:48:36.470 INFO:teuthology.orchestra.run.smithi083.stdout:/bin/podman: stderr Getting image source signatures 2024-04-01T06:48:36.470 INFO:teuthology.orchestra.run.smithi083.stdout:/bin/podman: stderr Copying blob sha256:292476a82bba99cefd9dfb2a53a675fb6e7695ed846690eaa2d96981f48bbb0c 2024-04-01T06:48:36.470 INFO:teuthology.orchestra.run.smithi083.stdout:/bin/podman: stderr Copying blob sha256:11da15500eca1f826c328eb3265caa30b0a3730510e2a32023084d6fe9cee20c 2024-04-01T06:48:36.470 INFO:teuthology.orchestra.run.smithi083.stdout:/bin/podman: stderr Copying config sha256:37bf26e8388eb4e18da1da02610fc6fdbde9f81a57677338c736d7649a729632 2024-04-01T06:48:36.470 INFO:teuthology.orchestra.run.smithi083.stdout:/bin/podman: stderr Writing manifest to image destination 2024-04-01T06:48:37.197 INFO:teuthology.orchestra.run.smithi083.stdout:ceph: stdout ceph version 18.2.2-1001-g9d2ee692 (9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12) reef (stable) 2024-04-01T06:48:37.198 INFO:teuthology.orchestra.run.smithi083.stdout:Ceph version: ceph version 18.2.2-1001-g9d2ee692 (9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12) reef (stable) 2024-04-01T06:48:37.198 INFO:teuthology.orchestra.run.smithi083.stdout:Extracting ceph user uid/gid from container image... 2024-04-01T06:48:37.837 INFO:teuthology.orchestra.run.smithi083.stdout:stat: stdout 167 167 2024-04-01T06:48:37.837 INFO:teuthology.orchestra.run.smithi083.stdout:Creating initial keys... 2024-04-01T06:48:38.453 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph-authtool: stdout AQDGWApmUUyUBhAAT2nBAwVrhIgJQdBVt8rjIA== 2024-04-01T06:48:39.062 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph-authtool: stdout AQDGWApmcvc3KhAAtJpuVXCbI5l85sAGBPS0pA== 2024-04-01T06:48:39.683 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph-authtool: stdout AQDHWApmvnTZExAAKphIfu9CGDDR7T5I9aTW0Q== 2024-04-01T06:48:39.683 INFO:teuthology.orchestra.run.smithi083.stdout:Creating initial monmap... 2024-04-01T06:48:40.326 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-01T06:48:40.326 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2024-04-01T06:48:40.326 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to c6f8eff4-eff3-11ee-b647-cb9ed24678a4 2024-04-01T06:48:40.326 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-01T06:48:40.326 INFO:teuthology.orchestra.run.smithi083.stdout:monmaptool for a [v2:172.21.15.83:3300,v1:172.21.15.83:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-01T06:48:40.326 INFO:teuthology.orchestra.run.smithi083.stdout:setting min_mon_release = pacific 2024-04-01T06:48:40.326 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/monmaptool: set fsid to c6f8eff4-eff3-11ee-b647-cb9ed24678a4 2024-04-01T06:48:40.326 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-01T06:48:40.326 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:48:40.326 INFO:teuthology.orchestra.run.smithi083.stdout:Creating mon... 2024-04-01T06:48:40.980 INFO:teuthology.orchestra.run.smithi083.stdout:create mon.a on 2024-04-01T06:48:41.107 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2024-04-01T06:48:41.196 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-04-01T06:48:41.319 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4.target → /etc/systemd/system/ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4.target. 2024-04-01T06:48:41.320 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4.target → /etc/systemd/system/ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4.target. 2024-04-01T06:48:41.502 INFO:teuthology.orchestra.run.smithi083.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mon.a 2024-04-01T06:48:41.503 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stderr Failed to reset failed state of unit ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mon.a.service: Unit ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mon.a.service not loaded. 2024-04-01T06:48:41.590 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4.target.wants/ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mon.a.service → /etc/systemd/system/ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@.service. 2024-04-01T06:48:42.018 INFO:teuthology.orchestra.run.smithi083.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-01T06:48:42.018 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stdout disabled 2024-04-01T06:48:42.026 INFO:teuthology.orchestra.run.smithi083.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-01T06:48:42.026 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stdout inactive 2024-04-01T06:48:42.026 INFO:teuthology.orchestra.run.smithi083.stdout:firewalld.service is not enabled 2024-04-01T06:48:42.026 INFO:teuthology.orchestra.run.smithi083.stdout:Not possible to enable service . firewalld.service is not available 2024-04-01T06:48:42.026 INFO:teuthology.orchestra.run.smithi083.stdout:Waiting for mon to start... 2024-04-01T06:48:42.026 INFO:teuthology.orchestra.run.smithi083.stdout:Waiting for mon... 2024-04-01T06:48:42.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:42 smithi083 ceph-mon[42939]: mon.a is new leader, mons a in quorum (ranks 0) 2024-04-01T06:48:42.896 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout cluster: 2024-04-01T06:48:42.896 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout id: c6f8eff4-eff3-11ee-b647-cb9ed24678a4 2024-04-01T06:48:42.896 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-04-01T06:48:42.896 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout 2024-04-01T06:48:42.896 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout services: 2024-04-01T06:48:42.896 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.501058s) 2024-04-01T06:48:42.896 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-04-01T06:48:42.896 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-04-01T06:48:42.896 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout 2024-04-01T06:48:42.896 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout data: 2024-04-01T06:48:42.896 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-04-01T06:48:42.897 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-04-01T06:48:42.897 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-04-01T06:48:42.897 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout pgs: 2024-04-01T06:48:42.897 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout 2024-04-01T06:48:42.897 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:42.456+0000 7f092c0bb700 1 Processor -- start 2024-04-01T06:48:42.897 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:42.456+0000 7f092c0bb700 1 -- start start 2024-04-01T06:48:42.897 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:42.456+0000 7f092c0bb700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0924105470 0x7f0924105890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:48:42.897 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:42.456+0000 7f092c0bb700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0924105e60 con 0x7f0924105470 2024-04-01T06:48:42.897 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:42.457+0000 7f0929e57700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0924105470 0x7f0924105890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:48:42.897 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:42.457+0000 7f0929e57700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0924105470 0x7f0924105890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37272/0 (socket says 172.21.15.83:37272) 2024-04-01T06:48:42.897 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:42.457+0000 7f0929e57700 1 -- 172.21.15.83:0/244789307 learned_addr learned my addr 172.21.15.83:0/244789307 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:48:42.897 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:42.457+0000 7f0929e57700 1 -- 172.21.15.83:0/244789307 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0924106670 con 0x7f0924105470 2024-04-01T06:48:42.897 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:42.457+0000 7f0929e57700 1 --2- 172.21.15.83:0/244789307 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0924105470 0x7f0924105890 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f09140098a0 tx=0x7f0914009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83a445cd1d3666d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:48:42.897 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:42.457+0000 7f0928e55700 1 -- 172.21.15.83:0/244789307 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0914004160 con 0x7f0924105470 2024-04-01T06:48:42.898 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:42.458+0000 7f0928e55700 1 -- 172.21.15.83:0/244789307 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09140042c0 con 0x7f0924105470 2024-04-01T06:48:42.898 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:42.458+0000 7f0928e55700 1 -- 172.21.15.83:0/244789307 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f09140045a0 con 0x7f0924105470 2024-04-01T06:48:42.898 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:42.458+0000 7f092c0bb700 1 -- 172.21.15.83:0/244789307 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0924105470 msgr2=0x7f0924105890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:48:42.898 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:42.458+0000 7f092c0bb700 1 --2- 172.21.15.83:0/244789307 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0924105470 0x7f0924105890 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f09140098a0 tx=0x7f0914009bb0 comp rx=0 tx=0).stop 2024-04-01T06:48:42.898 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:42.458+0000 7f092c0bb700 1 -- 172.21.15.83:0/244789307 shutdown_connections 2024-04-01T06:48:42.898 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:42.458+0000 7f092c0bb700 1 --2- 172.21.15.83:0/244789307 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0924105470 0x7f0924105890 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:48:42.898 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:42.458+0000 7f092c0bb700 1 -- 172.21.15.83:0/244789307 >> 172.21.15.83:0/244789307 conn(0x7f0924100a50 msgr2=0x7f0924102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:48:42.898 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:42.458+0000 7f092c0bb700 1 -- 172.21.15.83:0/244789307 shutdown_connections 2024-04-01T06:48:42.898 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:42.458+0000 7f092c0bb700 1 -- 172.21.15.83:0/244789307 wait complete. 2024-04-01T06:48:42.898 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:42.459+0000 7f092c0bb700 1 Processor -- start 2024-04-01T06:48:42.898 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:42.459+0000 7f092c0bb700 1 -- start start 2024-04-01T06:48:42.898 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:42.459+0000 7f092c0bb700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0924105470 0x7f0924079a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:48:42.899 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:42.459+0000 7f092c0bb700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0924079f40 con 0x7f0924105470 2024-04-01T06:48:42.899 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:42.459+0000 7f0929e57700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0924105470 0x7f0924079a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:48:42.899 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:42.459+0000 7f0929e57700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0924105470 0x7f0924079a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37278/0 (socket says 172.21.15.83:37278) 2024-04-01T06:48:42.899 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:42.459+0000 7f0929e57700 1 -- 172.21.15.83:0/4106966477 learned_addr learned my addr 172.21.15.83:0/4106966477 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:48:42.899 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:42.460+0000 7f0929e57700 1 -- 172.21.15.83:0/4106966477 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0914009550 con 0x7f0924105470 2024-04-01T06:48:42.899 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:42.460+0000 7f0929e57700 1 --2- 172.21.15.83:0/4106966477 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0924105470 0x7f0924079a00 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f0914004000 tx=0x7f0914004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:48:42.899 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:42.460+0000 7f091affd700 1 -- 172.21.15.83:0/4106966477 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0914011630 con 0x7f0924105470 2024-04-01T06:48:42.899 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:42.460+0000 7f091affd700 1 -- 172.21.15.83:0/4106966477 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0914011790 con 0x7f0924105470 2024-04-01T06:48:42.899 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:42.460+0000 7f092c0bb700 1 -- 172.21.15.83:0/4106966477 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f092419c7d0 con 0x7f0924105470 2024-04-01T06:48:42.899 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:42.460+0000 7f091affd700 1 -- 172.21.15.83:0/4106966477 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0914011a30 con 0x7f0924105470 2024-04-01T06:48:42.899 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:42.460+0000 7f092c0bb700 1 -- 172.21.15.83:0/4106966477 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f092419cc10 con 0x7f0924105470 2024-04-01T06:48:42.899 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:42.460+0000 7f091affd700 1 -- 172.21.15.83:0/4106966477 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0914022070 con 0x7f0924105470 2024-04-01T06:48:42.899 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:42.460+0000 7f091affd700 1 -- 172.21.15.83:0/4106966477 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f091401c450 con 0x7f0924105470 2024-04-01T06:48:42.900 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:42.461+0000 7f092c0bb700 1 -- 172.21.15.83:0/4106966477 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0924192630 con 0x7f0924105470 2024-04-01T06:48:42.900 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:42.463+0000 7f091affd700 1 -- 172.21.15.83:0/4106966477 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f091401b450 con 0x7f0924105470 2024-04-01T06:48:42.900 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:42.532+0000 7f092c0bb700 1 -- 172.21.15.83:0/4106966477 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f0924106b90 con 0x7f0924105470 2024-04-01T06:48:42.900 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:42.532+0000 7f091affd700 1 -- 172.21.15.83:0/4106966477 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+317 (secure 0 0 0) 0x7f091401b5f0 con 0x7f0924105470 2024-04-01T06:48:42.900 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:42.533+0000 7f092c0bb700 1 -- 172.21.15.83:0/4106966477 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0924105470 msgr2=0x7f0924079a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:48:42.900 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:42.533+0000 7f092c0bb700 1 --2- 172.21.15.83:0/4106966477 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0924105470 0x7f0924079a00 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f0914004000 tx=0x7f0914004750 comp rx=0 tx=0).stop 2024-04-01T06:48:42.900 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:42.533+0000 7f092c0bb700 1 -- 172.21.15.83:0/4106966477 shutdown_connections 2024-04-01T06:48:42.900 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:42.533+0000 7f092c0bb700 1 --2- 172.21.15.83:0/4106966477 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0924105470 0x7f0924079a00 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:48:42.900 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:42.533+0000 7f092c0bb700 1 -- 172.21.15.83:0/4106966477 >> 172.21.15.83:0/4106966477 conn(0x7f0924100a50 msgr2=0x7f092418f770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:48:42.900 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:42.533+0000 7f092c0bb700 1 -- 172.21.15.83:0/4106966477 shutdown_connections 2024-04-01T06:48:42.900 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:42.533+0000 7f092c0bb700 1 -- 172.21.15.83:0/4106966477 wait complete. 2024-04-01T06:48:42.900 INFO:teuthology.orchestra.run.smithi083.stdout:mon is available 2024-04-01T06:48:42.900 INFO:teuthology.orchestra.run.smithi083.stdout:Assimilating anything we can from ceph.conf... 2024-04-01T06:48:43.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:43 smithi083 ceph-mon[42939]: mon.a is new leader, mons a in quorum (ranks 0) 2024-04-01T06:48:43.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:43 smithi083 ceph-mon[42939]: monmap e1: 1 mons at {a=[v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-01T06:48:43.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:43 smithi083 ceph-mon[42939]: fsmap 2024-04-01T06:48:43.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:43 smithi083 ceph-mon[42939]: osdmap e1: 0 total, 0 up, 0 in 2024-04-01T06:48:43.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:43 smithi083 ceph-mon[42939]: mgrmap e1: no daemons active 2024-04-01T06:48:43.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:43 smithi083 ceph-mon[42939]: from='client.? 172.21.15.83:0/4106966477' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-04-01T06:48:43.754 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout 2024-04-01T06:48:43.755 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout [global] 2024-04-01T06:48:43.755 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout fsid = c6f8eff4-eff3-11ee-b647-cb9ed24678a4 2024-04-01T06:48:43.755 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.83:3300,v1:172.21.15.83:6789] 2024-04-01T06:48:43.755 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-01T06:48:43.755 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-01T06:48:43.755 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-01T06:48:43.755 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-01T06:48:43.755 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout 2024-04-01T06:48:43.755 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-01T06:48:43.755 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-01T06:48:43.755 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout 2024-04-01T06:48:43.755 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout [osd] 2024-04-01T06:48:43.756 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-01T06:48:43.756 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-01T06:48:43.756 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-01T06:48:43.756 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-01T06:48:43.756 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-01T06:48:43.756 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:43.271+0000 7f6eb82b7700 1 Processor -- start 2024-04-01T06:48:43.756 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:43.271+0000 7f6eb82b7700 1 -- start start 2024-04-01T06:48:43.756 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:43.271+0000 7f6eb82b7700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6eb0106580 0x7f6eb01069a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:48:43.756 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:43.271+0000 7f6eb82b7700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb0106f70 con 0x7f6eb0106580 2024-04-01T06:48:43.756 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:43.272+0000 7f6eb6053700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6eb0106580 0x7f6eb01069a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:48:43.756 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:43.272+0000 7f6eb6053700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6eb0106580 0x7f6eb01069a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:49174/0 (socket says 172.21.15.83:49174) 2024-04-01T06:48:43.756 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:43.272+0000 7f6eb6053700 1 -- 172.21.15.83:0/3474788274 learned_addr learned my addr 172.21.15.83:0/3474788274 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:48:43.756 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:43.272+0000 7f6eb6053700 1 -- 172.21.15.83:0/3474788274 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb0107730 con 0x7f6eb0106580 2024-04-01T06:48:43.756 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:43.272+0000 7f6eb6053700 1 --2- 172.21.15.83:0/3474788274 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6eb0106580 0x7f6eb01069a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f6ea40098a0 tx=0x7f6ea4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a874345e288ae49 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:48:43.757 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:43.272+0000 7f6eb5051700 1 -- 172.21.15.83:0/3474788274 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ea4004160 con 0x7f6eb0106580 2024-04-01T06:48:43.757 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:43.272+0000 7f6eb5051700 1 -- 172.21.15.83:0/3474788274 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ea40042c0 con 0x7f6eb0106580 2024-04-01T06:48:43.757 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:43.272+0000 7f6eb5051700 1 -- 172.21.15.83:0/3474788274 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ea40045a0 con 0x7f6eb0106580 2024-04-01T06:48:43.757 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:43.273+0000 7f6eb82b7700 1 -- 172.21.15.83:0/3474788274 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6eb0106580 msgr2=0x7f6eb01069a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:48:43.757 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:43.273+0000 7f6eb82b7700 1 --2- 172.21.15.83:0/3474788274 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6eb0106580 0x7f6eb01069a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f6ea40098a0 tx=0x7f6ea4009bb0 comp rx=0 tx=0).stop 2024-04-01T06:48:43.757 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:43.273+0000 7f6eb82b7700 1 -- 172.21.15.83:0/3474788274 shutdown_connections 2024-04-01T06:48:43.757 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:43.273+0000 7f6eb82b7700 1 --2- 172.21.15.83:0/3474788274 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6eb0106580 0x7f6eb01069a0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:48:43.757 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:43.273+0000 7f6eb82b7700 1 -- 172.21.15.83:0/3474788274 >> 172.21.15.83:0/3474788274 conn(0x7f6eb0101b00 msgr2=0x7f6eb0103f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:48:43.757 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:43.273+0000 7f6eb82b7700 1 -- 172.21.15.83:0/3474788274 shutdown_connections 2024-04-01T06:48:43.757 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:43.273+0000 7f6eb82b7700 1 -- 172.21.15.83:0/3474788274 wait complete. 2024-04-01T06:48:43.757 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:43.273+0000 7f6eb82b7700 1 Processor -- start 2024-04-01T06:48:43.757 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:43.273+0000 7f6eb82b7700 1 -- start start 2024-04-01T06:48:43.757 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:43.274+0000 7f6eb82b7700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6eb0106580 0x7f6eb0199a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:48:43.758 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:43.274+0000 7f6eb82b7700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb0199f40 con 0x7f6eb0106580 2024-04-01T06:48:43.758 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:43.274+0000 7f6eb6053700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6eb0106580 0x7f6eb0199a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:48:43.758 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:43.274+0000 7f6eb6053700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6eb0106580 0x7f6eb0199a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:49176/0 (socket says 172.21.15.83:49176) 2024-04-01T06:48:43.758 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:43.274+0000 7f6eb6053700 1 -- 172.21.15.83:0/98904821 learned_addr learned my addr 172.21.15.83:0/98904821 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:48:43.758 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:43.274+0000 7f6eb6053700 1 -- 172.21.15.83:0/98904821 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea4009550 con 0x7f6eb0106580 2024-04-01T06:48:43.758 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:43.274+0000 7f6eb6053700 1 --2- 172.21.15.83:0/98904821 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6eb0106580 0x7f6eb0199a00 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4004000 tx=0x7f6ea4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:48:43.758 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:43.274+0000 7f6ea37fe700 1 -- 172.21.15.83:0/98904821 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ea4011630 con 0x7f6eb0106580 2024-04-01T06:48:43.758 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:43.274+0000 7f6ea37fe700 1 -- 172.21.15.83:0/98904821 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ea4011790 con 0x7f6eb0106580 2024-04-01T06:48:43.758 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:43.274+0000 7f6eb82b7700 1 -- 172.21.15.83:0/98904821 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eb019a140 con 0x7f6eb0106580 2024-04-01T06:48:43.758 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:43.274+0000 7f6ea37fe700 1 -- 172.21.15.83:0/98904821 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ea4011a30 con 0x7f6eb0106580 2024-04-01T06:48:43.758 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:43.274+0000 7f6eb82b7700 1 -- 172.21.15.83:0/98904821 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eb019a5e0 con 0x7f6eb0106580 2024-04-01T06:48:43.758 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:43.275+0000 7f6ea37fe700 1 -- 172.21.15.83:0/98904821 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6ea4022070 con 0x7f6eb0106580 2024-04-01T06:48:43.758 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:43.275+0000 7f6ea37fe700 1 -- 172.21.15.83:0/98904821 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f6ea401c450 con 0x7f6eb0106580 2024-04-01T06:48:43.758 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:43.275+0000 7f6eb82b7700 1 -- 172.21.15.83:0/98904821 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eb0193750 con 0x7f6eb0106580 2024-04-01T06:48:43.759 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:43.277+0000 7f6ea37fe700 1 -- 172.21.15.83:0/98904821 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f6ea401b450 con 0x7f6eb0106580 2024-04-01T06:48:43.759 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:43.343+0000 7f6eb82b7700 1 -- 172.21.15.83:0/98904821 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f6eb0107aa0 con 0x7f6eb0106580 2024-04-01T06:48:43.759 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:43.347+0000 7f6ea37fe700 1 -- 172.21.15.83:0/98904821 <== mon.0 v2:172.21.15.83:3300/0 7 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6ea401b5f0 con 0x7f6eb0106580 2024-04-01T06:48:43.759 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:43.347+0000 7f6ea37fe700 1 -- 172.21.15.83:0/98904821 <== mon.0 v2:172.21.15.83:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7f6ea4024630 con 0x7f6eb0106580 2024-04-01T06:48:43.759 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:43.348+0000 7f6eb82b7700 1 -- 172.21.15.83:0/98904821 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6eb0106580 msgr2=0x7f6eb0199a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:48:43.759 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:43.348+0000 7f6eb82b7700 1 --2- 172.21.15.83:0/98904821 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6eb0106580 0x7f6eb0199a00 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4004000 tx=0x7f6ea4004750 comp rx=0 tx=0).stop 2024-04-01T06:48:43.759 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:43.348+0000 7f6eb82b7700 1 -- 172.21.15.83:0/98904821 shutdown_connections 2024-04-01T06:48:43.759 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:43.348+0000 7f6eb82b7700 1 --2- 172.21.15.83:0/98904821 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6eb0106580 0x7f6eb0199a00 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:48:43.759 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:43.348+0000 7f6eb82b7700 1 -- 172.21.15.83:0/98904821 >> 172.21.15.83:0/98904821 conn(0x7f6eb0101b00 msgr2=0x7f6eb0190890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:48:43.759 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:43.348+0000 7f6eb82b7700 1 -- 172.21.15.83:0/98904821 shutdown_connections 2024-04-01T06:48:43.759 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:43.348+0000 7f6eb82b7700 1 -- 172.21.15.83:0/98904821 wait complete. 2024-04-01T06:48:43.759 INFO:teuthology.orchestra.run.smithi083.stdout:Generating new minimal ceph.conf... 2024-04-01T06:48:44.363 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:44 smithi083 ceph-mon[42939]: from='client.? 172.21.15.83:0/98904821' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-01T06:48:44.363 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:44 smithi083 ceph-mon[42939]: from='client.? 172.21.15.83:0/98904821' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-04-01T06:48:44.569 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:44.104+0000 7fb42990c700 1 Processor -- start 2024-04-01T06:48:44.569 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:44.104+0000 7fb42990c700 1 -- start start 2024-04-01T06:48:44.569 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:44.104+0000 7fb42990c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb424105470 0x7fb424105890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:48:44.569 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:44.104+0000 7fb42990c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb424105e60 con 0x7fb424105470 2024-04-01T06:48:44.569 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:44.104+0000 7fb422ffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb424105470 0x7fb424105890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:48:44.569 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:44.104+0000 7fb422ffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb424105470 0x7fb424105890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:49192/0 (socket says 172.21.15.83:49192) 2024-04-01T06:48:44.569 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:44.104+0000 7fb422ffd700 1 -- 172.21.15.83:0/1206592800 learned_addr learned my addr 172.21.15.83:0/1206592800 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:48:44.570 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:44.105+0000 7fb422ffd700 1 -- 172.21.15.83:0/1206592800 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb424106670 con 0x7fb424105470 2024-04-01T06:48:44.570 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:44.105+0000 7fb422ffd700 1 --2- 172.21.15.83:0/1206592800 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb424105470 0x7fb424105890 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fb4180098a0 tx=0x7fb418009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61a61165b4e9a43f server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:48:44.570 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:44.105+0000 7fb421ffb700 1 -- 172.21.15.83:0/1206592800 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb418004160 con 0x7fb424105470 2024-04-01T06:48:44.570 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:44.105+0000 7fb421ffb700 1 -- 172.21.15.83:0/1206592800 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb4180042c0 con 0x7fb424105470 2024-04-01T06:48:44.570 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:44.105+0000 7fb421ffb700 1 -- 172.21.15.83:0/1206592800 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb418011a00 con 0x7fb424105470 2024-04-01T06:48:44.570 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:44.105+0000 7fb42990c700 1 -- 172.21.15.83:0/1206592800 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb424105470 msgr2=0x7fb424105890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:48:44.570 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:44.105+0000 7fb42990c700 1 --2- 172.21.15.83:0/1206592800 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb424105470 0x7fb424105890 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fb4180098a0 tx=0x7fb418009bb0 comp rx=0 tx=0).stop 2024-04-01T06:48:44.570 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:44.106+0000 7fb42990c700 1 -- 172.21.15.83:0/1206592800 shutdown_connections 2024-04-01T06:48:44.570 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:44.106+0000 7fb42990c700 1 --2- 172.21.15.83:0/1206592800 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb424105470 0x7fb424105890 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:48:44.570 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:44.106+0000 7fb42990c700 1 -- 172.21.15.83:0/1206592800 >> 172.21.15.83:0/1206592800 conn(0x7fb424100a50 msgr2=0x7fb424102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:48:44.570 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:44.106+0000 7fb42990c700 1 -- 172.21.15.83:0/1206592800 shutdown_connections 2024-04-01T06:48:44.570 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:44.106+0000 7fb42990c700 1 -- 172.21.15.83:0/1206592800 wait complete. 2024-04-01T06:48:44.571 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:44.106+0000 7fb42990c700 1 Processor -- start 2024-04-01T06:48:44.571 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:44.107+0000 7fb42990c700 1 -- start start 2024-04-01T06:48:44.571 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:44.107+0000 7fb42990c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb424105470 0x7fb424079a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:48:44.571 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:44.107+0000 7fb42990c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb424079f60 con 0x7fb424105470 2024-04-01T06:48:44.571 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:44.107+0000 7fb422ffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb424105470 0x7fb424079a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:48:44.571 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:44.107+0000 7fb422ffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb424105470 0x7fb424079a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:49206/0 (socket says 172.21.15.83:49206) 2024-04-01T06:48:44.571 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:44.107+0000 7fb422ffd700 1 -- 172.21.15.83:0/194451959 learned_addr learned my addr 172.21.15.83:0/194451959 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:48:44.571 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:44.107+0000 7fb422ffd700 1 -- 172.21.15.83:0/194451959 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb418009550 con 0x7fb424105470 2024-04-01T06:48:44.571 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:44.107+0000 7fb422ffd700 1 --2- 172.21.15.83:0/194451959 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb424105470 0x7fb424079a20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb418009fb0 tx=0x7fb418011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:48:44.571 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:44.107+0000 7fb42890a700 1 -- 172.21.15.83:0/194451959 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb418003a40 con 0x7fb424105470 2024-04-01T06:48:44.571 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:44.107+0000 7fb42990c700 1 -- 172.21.15.83:0/194451959 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb42419cff0 con 0x7fb424105470 2024-04-01T06:48:44.571 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:44.107+0000 7fb42890a700 1 -- 172.21.15.83:0/194451959 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb418003ba0 con 0x7fb424105470 2024-04-01T06:48:44.571 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:44.107+0000 7fb42890a700 1 -- 172.21.15.83:0/194451959 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb41801a750 con 0x7fb424105470 2024-04-01T06:48:44.572 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:44.108+0000 7fb42990c700 1 -- 172.21.15.83:0/194451959 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb42419d490 con 0x7fb424105470 2024-04-01T06:48:44.572 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:44.108+0000 7fb42890a700 1 -- 172.21.15.83:0/194451959 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb41801acd0 con 0x7fb424105470 2024-04-01T06:48:44.572 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:44.108+0000 7fb42890a700 1 -- 172.21.15.83:0/194451959 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb4180193c0 con 0x7fb424105470 2024-04-01T06:48:44.572 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:44.108+0000 7fb42990c700 1 -- 172.21.15.83:0/194451959 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4240623e0 con 0x7fb424105470 2024-04-01T06:48:44.572 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:44.111+0000 7fb42890a700 1 -- 172.21.15.83:0/194451959 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7fb418024b60 con 0x7fb424105470 2024-04-01T06:48:44.572 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:44.178+0000 7fb42990c700 1 -- 172.21.15.83:0/194451959 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fb424109870 con 0x7fb424105470 2024-04-01T06:48:44.572 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:44.178+0000 7fb42890a700 1 -- 172.21.15.83:0/194451959 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7fb418024d00 con 0x7fb424105470 2024-04-01T06:48:44.572 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:44.179+0000 7fb42990c700 1 -- 172.21.15.83:0/194451959 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb424105470 msgr2=0x7fb424079a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:48:44.572 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:44.179+0000 7fb42990c700 1 --2- 172.21.15.83:0/194451959 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb424105470 0x7fb424079a20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb418009fb0 tx=0x7fb418011ad0 comp rx=0 tx=0).stop 2024-04-01T06:48:44.572 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:44.179+0000 7fb42990c700 1 -- 172.21.15.83:0/194451959 shutdown_connections 2024-04-01T06:48:44.572 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:44.179+0000 7fb42990c700 1 --2- 172.21.15.83:0/194451959 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb424105470 0x7fb424079a20 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:48:44.572 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:44.179+0000 7fb42990c700 1 -- 172.21.15.83:0/194451959 >> 172.21.15.83:0/194451959 conn(0x7fb424100a50 msgr2=0x7fb4241015d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:48:44.572 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:44.179+0000 7fb42990c700 1 -- 172.21.15.83:0/194451959 shutdown_connections 2024-04-01T06:48:44.572 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:44.179+0000 7fb42990c700 1 -- 172.21.15.83:0/194451959 wait complete. 2024-04-01T06:48:44.572 INFO:teuthology.orchestra.run.smithi083.stdout:Restarting the monitor... 2024-04-01T06:48:44.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:44 smithi083 systemd[1]: Stopping Ceph mon.a for c6f8eff4-eff3-11ee-b647-cb9ed24678a4... 2024-04-01T06:48:45.096 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:44 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mon-a[42917]: 2024-04-01T06:48:44.767+0000 7f4df2533700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-01T06:48:45.097 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:44 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mon-a[42917]: 2024-04-01T06:48:44.767+0000 7f4df2533700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-04-01T06:48:45.097 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:44 smithi083 bash[43271]: ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mon-a 2024-04-01T06:48:45.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 systemd[1]: ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mon.a.service: Succeeded. 2024-04-01T06:48:45.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 systemd[1]: Stopped Ceph mon.a for c6f8eff4-eff3-11ee-b647-cb9ed24678a4. 2024-04-01T06:48:45.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 systemd[1]: Starting Ceph mon.a for c6f8eff4-eff3-11ee-b647-cb9ed24678a4... 2024-04-01T06:48:45.583 INFO:teuthology.orchestra.run.smithi083.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-04-01T06:48:45.583 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 bash[43392]: fc010074d32bbf7b24a06b2553b657b4f189e2f31e28dad3b49db4409b4b479f 2024-04-01T06:48:45.583 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 systemd[1]: Started Ceph mon.a for c6f8eff4-eff3-11ee-b647-cb9ed24678a4. 2024-04-01T06:48:45.583 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: set uid:gid to 167:167 (ceph:ceph) 2024-04-01T06:48:46.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: ceph version 18.2.2-1001-g9d2ee692 (9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12) reef (stable), process ceph-mon, pid 7 2024-04-01T06:48:46.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: pidfile_write: ignore empty --pid-file 2024-04-01T06:48:46.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: load: jerasure load: lrc 2024-04-01T06:48:46.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: RocksDB version: 7.9.2 2024-04-01T06:48:46.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Git sha 0 2024-04-01T06:48:46.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Compile date 2024-03-27 03:54:40 2024-04-01T06:48:46.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: DB SUMMARY 2024-04-01T06:48:46.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: DB Session ID: 9XZ5XPME49QJXLKWNHOF 2024-04-01T06:48:46.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: CURRENT file: CURRENT 2024-04-01T06:48:46.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: IDENTITY file: IDENTITY 2024-04-01T06:48:46.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-04-01T06:48:46.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-04-01T06:48:46.015 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 97988 ; 2024-04-01T06:48:46.015 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.error_if_exists: 0 2024-04-01T06:48:46.015 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.create_if_missing: 0 2024-04-01T06:48:46.015 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.paranoid_checks: 1 2024-04-01T06:48:46.015 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-01T06:48:46.015 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-01T06:48:46.015 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-01T06:48:46.015 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.env: 0x56054ea94720 2024-04-01T06:48:46.015 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.fs: PosixFileSystem 2024-04-01T06:48:46.015 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.info_log: 0x560550a974e0 2024-04-01T06:48:46.015 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.max_file_opening_threads: 16 2024-04-01T06:48:46.015 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.statistics: (nil) 2024-04-01T06:48:46.015 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.use_fsync: 0 2024-04-01T06:48:46.016 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.max_log_file_size: 0 2024-04-01T06:48:46.016 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-01T06:48:46.016 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-01T06:48:46.016 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.keep_log_file_num: 1000 2024-04-01T06:48:46.016 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.recycle_log_file_num: 0 2024-04-01T06:48:46.016 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.allow_fallocate: 1 2024-04-01T06:48:46.016 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.allow_mmap_reads: 0 2024-04-01T06:48:46.016 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.allow_mmap_writes: 0 2024-04-01T06:48:46.016 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.use_direct_reads: 0 2024-04-01T06:48:46.016 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-01T06:48:46.016 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.create_missing_column_families: 0 2024-04-01T06:48:46.017 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.db_log_dir: 2024-04-01T06:48:46.017 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.wal_dir: 2024-04-01T06:48:46.017 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-01T06:48:46.017 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-01T06:48:46.017 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-01T06:48:46.017 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-01T06:48:46.017 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-01T06:48:46.017 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-01T06:48:46.017 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.advise_random_on_open: 1 2024-04-01T06:48:46.017 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.db_write_buffer_size: 0 2024-04-01T06:48:46.017 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.write_buffer_manager: 0x56054fd2e320 2024-04-01T06:48:46.017 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-01T06:48:46.017 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-01T06:48:46.017 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-01T06:48:46.017 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.rate_limiter: (nil) 2024-04-01T06:48:46.018 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-01T06:48:46.018 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.wal_recovery_mode: 2 2024-04-01T06:48:46.018 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.enable_thread_tracking: 0 2024-04-01T06:48:46.018 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.enable_pipelined_write: 0 2024-04-01T06:48:46.018 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.unordered_write: 0 2024-04-01T06:48:46.018 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-01T06:48:46.018 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-01T06:48:46.018 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-01T06:48:46.018 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-01T06:48:46.018 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.row_cache: None 2024-04-01T06:48:46.018 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.wal_filter: None 2024-04-01T06:48:46.018 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-01T06:48:46.018 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.allow_ingest_behind: 0 2024-04-01T06:48:46.018 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.two_write_queues: 0 2024-04-01T06:48:46.018 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.manual_wal_flush: 0 2024-04-01T06:48:46.019 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.wal_compression: 0 2024-04-01T06:48:46.019 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.atomic_flush: 0 2024-04-01T06:48:46.019 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-01T06:48:46.019 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-01T06:48:46.019 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-01T06:48:46.019 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.log_readahead_size: 0 2024-04-01T06:48:46.019 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-01T06:48:46.019 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.best_efforts_recovery: 0 2024-04-01T06:48:46.019 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-01T06:48:46.019 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-01T06:48:46.019 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.allow_data_in_errors: 0 2024-04-01T06:48:46.019 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.db_host_id: __hostname__ 2024-04-01T06:48:46.019 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-01T06:48:46.019 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.max_background_jobs: 2 2024-04-01T06:48:46.019 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.max_background_compactions: -1 2024-04-01T06:48:46.020 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.max_subcompactions: 1 2024-04-01T06:48:46.020 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-01T06:48:46.020 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-01T06:48:46.020 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-01T06:48:46.020 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.max_total_wal_size: 0 2024-04-01T06:48:46.020 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-01T06:48:46.020 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-01T06:48:46.020 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-01T06:48:46.020 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-01T06:48:46.020 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.max_open_files: -1 2024-04-01T06:48:46.020 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.bytes_per_sync: 0 2024-04-01T06:48:46.020 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-01T06:48:46.020 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-01T06:48:46.020 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.compaction_readahead_size: 0 2024-04-01T06:48:46.021 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.max_background_flushes: -1 2024-04-01T06:48:46.021 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Compression algorithms supported: 2024-04-01T06:48:46.021 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-01T06:48:46.021 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: kZSTD supported: 0 2024-04-01T06:48:46.021 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: kXpressCompression supported: 0 2024-04-01T06:48:46.021 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: kLZ4HCCompression supported: 1 2024-04-01T06:48:46.021 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: kZlibCompression supported: 1 2024-04-01T06:48:46.021 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: kSnappyCompression supported: 1 2024-04-01T06:48:46.021 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: kLZ4Compression supported: 1 2024-04-01T06:48:46.021 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: kBZip2Compression supported: 0 2024-04-01T06:48:46.021 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-01T06:48:46.021 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-01T06:48:46.021 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-04-01T06:48:46.021 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-01T06:48:46.021 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-01T06:48:46.022 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.merge_operator: 2024-04-01T06:48:46.022 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.compaction_filter: None 2024-04-01T06:48:46.022 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.compaction_filter_factory: None 2024-04-01T06:48:46.022 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.sst_partitioner_factory: None 2024-04-01T06:48:46.022 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-01T06:48:46.022 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-01T06:48:46.022 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x560550a975e0) 2024-04-01T06:48:46.022 INFO:journalctl@ceph.mon.a.smithi083.stdout: cache_index_and_filter_blocks: 1 2024-04-01T06:48:46.022 INFO:journalctl@ceph.mon.a.smithi083.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-01T06:48:46.023 INFO:journalctl@ceph.mon.a.smithi083.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-01T06:48:46.023 INFO:journalctl@ceph.mon.a.smithi083.stdout: pin_top_level_index_and_filter: 1 2024-04-01T06:48:46.023 INFO:journalctl@ceph.mon.a.smithi083.stdout: index_type: 0 2024-04-01T06:48:46.023 INFO:journalctl@ceph.mon.a.smithi083.stdout: data_block_index_type: 0 2024-04-01T06:48:46.023 INFO:journalctl@ceph.mon.a.smithi083.stdout: index_shortening: 1 2024-04-01T06:48:46.023 INFO:journalctl@ceph.mon.a.smithi083.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-01T06:48:46.023 INFO:journalctl@ceph.mon.a.smithi083.stdout: checksum: 4 2024-04-01T06:48:46.023 INFO:journalctl@ceph.mon.a.smithi083.stdout: no_block_cache: 0 2024-04-01T06:48:46.023 INFO:journalctl@ceph.mon.a.smithi083.stdout: block_cache: 0x56054fdaf1f0 2024-04-01T06:48:46.023 INFO:journalctl@ceph.mon.a.smithi083.stdout: block_cache_name: BinnedLRUCache 2024-04-01T06:48:46.023 INFO:journalctl@ceph.mon.a.smithi083.stdout: block_cache_options: 2024-04-01T06:48:46.023 INFO:journalctl@ceph.mon.a.smithi083.stdout: capacity : 536870912 2024-04-01T06:48:46.023 INFO:journalctl@ceph.mon.a.smithi083.stdout: num_shard_bits : 4 2024-04-01T06:48:46.023 INFO:journalctl@ceph.mon.a.smithi083.stdout: strict_capacity_limit : 0 2024-04-01T06:48:46.023 INFO:journalctl@ceph.mon.a.smithi083.stdout: high_pri_pool_ratio: 0.000 2024-04-01T06:48:46.024 INFO:journalctl@ceph.mon.a.smithi083.stdout: block_cache_compressed: (nil) 2024-04-01T06:48:46.024 INFO:journalctl@ceph.mon.a.smithi083.stdout: persistent_cache: (nil) 2024-04-01T06:48:46.024 INFO:journalctl@ceph.mon.a.smithi083.stdout: block_size: 4096 2024-04-01T06:48:46.024 INFO:journalctl@ceph.mon.a.smithi083.stdout: block_size_deviation: 10 2024-04-01T06:48:46.024 INFO:journalctl@ceph.mon.a.smithi083.stdout: block_restart_interval: 16 2024-04-01T06:48:46.024 INFO:journalctl@ceph.mon.a.smithi083.stdout: index_block_restart_interval: 1 2024-04-01T06:48:46.024 INFO:journalctl@ceph.mon.a.smithi083.stdout: metadata_block_size: 4096 2024-04-01T06:48:46.024 INFO:journalctl@ceph.mon.a.smithi083.stdout: partition_filters: 0 2024-04-01T06:48:46.024 INFO:journalctl@ceph.mon.a.smithi083.stdout: use_delta_encoding: 1 2024-04-01T06:48:46.024 INFO:journalctl@ceph.mon.a.smithi083.stdout: filter_policy: bloomfilter 2024-04-01T06:48:46.024 INFO:journalctl@ceph.mon.a.smithi083.stdout: whole_key_filtering: 1 2024-04-01T06:48:46.024 INFO:journalctl@ceph.mon.a.smithi083.stdout: verify_compression: 0 2024-04-01T06:48:46.024 INFO:journalctl@ceph.mon.a.smithi083.stdout: read_amp_bytes_per_bit: 0 2024-04-01T06:48:46.024 INFO:journalctl@ceph.mon.a.smithi083.stdout: format_version: 5 2024-04-01T06:48:46.024 INFO:journalctl@ceph.mon.a.smithi083.stdout: enable_index_compression: 1 2024-04-01T06:48:46.025 INFO:journalctl@ceph.mon.a.smithi083.stdout: block_align: 0 2024-04-01T06:48:46.025 INFO:journalctl@ceph.mon.a.smithi083.stdout: max_auto_readahead_size: 262144 2024-04-01T06:48:46.025 INFO:journalctl@ceph.mon.a.smithi083.stdout: prepopulate_block_cache: 0 2024-04-01T06:48:46.025 INFO:journalctl@ceph.mon.a.smithi083.stdout: initial_auto_readahead_size: 8192 2024-04-01T06:48:46.025 INFO:journalctl@ceph.mon.a.smithi083.stdout: num_file_reads_for_auto_readahead: 2 2024-04-01T06:48:46.025 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.write_buffer_size: 33554432 2024-04-01T06:48:46.025 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.max_write_buffer_number: 2 2024-04-01T06:48:46.025 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.compression: NoCompression 2024-04-01T06:48:46.025 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.bottommost_compression: Disabled 2024-04-01T06:48:46.025 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.prefix_extractor: nullptr 2024-04-01T06:48:46.025 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-01T06:48:46.025 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.num_levels: 7 2024-04-01T06:48:46.025 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-01T06:48:46.025 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-01T06:48:46.025 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-01T06:48:46.026 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-01T06:48:46.026 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-01T06:48:46.026 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-01T06:48:46.026 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-01T06:48:46.026 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-01T06:48:46.026 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-01T06:48:46.026 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-01T06:48:46.026 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-01T06:48:46.026 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-01T06:48:46.026 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-01T06:48:46.026 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.compression_opts.level: 32767 2024-04-01T06:48:46.026 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.compression_opts.strategy: 0 2024-04-01T06:48:46.026 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-01T06:48:46.026 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-01T06:48:46.026 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-01T06:48:46.027 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-01T06:48:46.027 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.compression_opts.enabled: false 2024-04-01T06:48:46.027 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-01T06:48:46.027 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-01T06:48:46.027 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-01T06:48:46.027 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-01T06:48:46.027 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.target_file_size_base: 67108864 2024-04-01T06:48:46.027 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-01T06:48:46.027 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-01T06:48:46.027 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-01T06:48:46.027 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-01T06:48:46.027 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-01T06:48:46.027 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-01T06:48:46.027 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-01T06:48:46.028 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-01T06:48:46.028 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-01T06:48:46.028 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-01T06:48:46.028 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-01T06:48:46.028 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-01T06:48:46.028 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-01T06:48:46.028 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-01T06:48:46.028 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.arena_block_size: 1048576 2024-04-01T06:48:46.028 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-01T06:48:46.028 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-01T06:48:46.028 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.disable_auto_compactions: 0 2024-04-01T06:48:46.028 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-01T06:48:46.028 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-01T06:48:46.028 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-01T06:48:46.028 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-01T06:48:46.029 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-01T06:48:46.029 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-01T06:48:46.029 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-01T06:48:46.029 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-01T06:48:46.029 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-01T06:48:46.029 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-01T06:48:46.029 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.table_properties_collectors: 2024-04-01T06:48:46.029 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.inplace_update_support: 0 2024-04-01T06:48:46.029 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-01T06:48:46.029 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-01T06:48:46.029 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-01T06:48:46.029 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-01T06:48:46.029 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.bloom_locality: 0 2024-04-01T06:48:46.029 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.max_successive_merges: 0 2024-04-01T06:48:46.029 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-01T06:48:46.030 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.paranoid_file_checks: 0 2024-04-01T06:48:46.030 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.force_consistency_checks: 1 2024-04-01T06:48:46.030 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.report_bg_io_stats: 0 2024-04-01T06:48:46.030 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.ttl: 2592000 2024-04-01T06:48:46.030 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-01T06:48:46.030 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-01T06:48:46.030 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-01T06:48:46.030 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.enable_blob_files: false 2024-04-01T06:48:46.030 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.min_blob_size: 0 2024-04-01T06:48:46.030 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.blob_file_size: 268435456 2024-04-01T06:48:46.030 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-01T06:48:46.030 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-01T06:48:46.030 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-01T06:48:46.030 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-01T06:48:46.031 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-01T06:48:46.031 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.blob_file_starting_level: 0 2024-04-01T06:48:46.031 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-01T06:48:46.031 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-04-01T06:48:46.031 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-04-01T06:48:46.031 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 535cc960-4aec-4f1b-81b4-d92d64af6916 2024-04-01T06:48:46.031 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711954125591077, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-04-01T06:48:46.031 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-04-01T06:48:46.031 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711954125592127, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 93352, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 309, "table_properties": {"data_size": 91350, "index_size": 284, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13717, "raw_average_key_size": 50, "raw_value_size": 83879, "raw_average_value_size": 308, "num_data_blocks": 11, "num_entries": 272, "num_filter_entries": 272, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1711954125, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "535cc960-4aec-4f1b-81b4-d92d64af6916", "db_session_id": "9XZ5XPME49QJXLKWNHOF", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-04-01T06:48:46.031 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711954125592197, "job": 1, "event": "recovery_finished"} 2024-04-01T06:48:46.031 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-04-01T06:48:46.031 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-01T06:48:46.031 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56054fe4c000 2024-04-01T06:48:46.031 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: DB pointer 0x56054fe3a000 2024-04-01T06:48:46.031 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-01T06:48:46.032 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-01T06:48:46.032 INFO:journalctl@ceph.mon.a.smithi083.stdout: ** DB Stats ** 2024-04-01T06:48:46.032 INFO:journalctl@ceph.mon.a.smithi083.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-01T06:48:46.032 INFO:journalctl@ceph.mon.a.smithi083.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-01T06:48:46.032 INFO:journalctl@ceph.mon.a.smithi083.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-01T06:48:46.032 INFO:journalctl@ceph.mon.a.smithi083.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-01T06:48:46.032 INFO:journalctl@ceph.mon.a.smithi083.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-01T06:48:46.032 INFO:journalctl@ceph.mon.a.smithi083.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-01T06:48:46.032 INFO:journalctl@ceph.mon.a.smithi083.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-01T06:48:46.032 INFO:journalctl@ceph.mon.a.smithi083.stdout: 2024-04-01T06:48:46.032 INFO:journalctl@ceph.mon.a.smithi083.stdout: ** Compaction Stats [default] ** 2024-04-01T06:48:46.032 INFO:journalctl@ceph.mon.a.smithi083.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-01T06:48:46.032 INFO:journalctl@ceph.mon.a.smithi083.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-01T06:48:46.032 INFO:journalctl@ceph.mon.a.smithi083.stdout: L0 2/0 93.00 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 132.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-01T06:48:46.033 INFO:journalctl@ceph.mon.a.smithi083.stdout: Sum 2/0 93.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 132.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-01T06:48:46.033 INFO:journalctl@ceph.mon.a.smithi083.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 132.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-01T06:48:46.033 INFO:journalctl@ceph.mon.a.smithi083.stdout: 2024-04-01T06:48:46.033 INFO:journalctl@ceph.mon.a.smithi083.stdout: ** Compaction Stats [default] ** 2024-04-01T06:48:46.033 INFO:journalctl@ceph.mon.a.smithi083.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-01T06:48:46.033 INFO:journalctl@ceph.mon.a.smithi083.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-01T06:48:46.033 INFO:journalctl@ceph.mon.a.smithi083.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 132.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-01T06:48:46.033 INFO:journalctl@ceph.mon.a.smithi083.stdout: 2024-04-01T06:48:46.033 INFO:journalctl@ceph.mon.a.smithi083.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-01T06:48:46.033 INFO:journalctl@ceph.mon.a.smithi083.stdout: 2024-04-01T06:48:46.033 INFO:journalctl@ceph.mon.a.smithi083.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-01T06:48:46.033 INFO:journalctl@ceph.mon.a.smithi083.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-01T06:48:46.033 INFO:journalctl@ceph.mon.a.smithi083.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-01T06:48:46.033 INFO:journalctl@ceph.mon.a.smithi083.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-01T06:48:46.033 INFO:journalctl@ceph.mon.a.smithi083.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-01T06:48:46.034 INFO:journalctl@ceph.mon.a.smithi083.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-01T06:48:46.034 INFO:journalctl@ceph.mon.a.smithi083.stdout: Cumulative compaction: 0.00 GB write, 27.56 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-01T06:48:46.034 INFO:journalctl@ceph.mon.a.smithi083.stdout: Interval compaction: 0.00 GB write, 27.56 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-01T06:48:46.034 INFO:journalctl@ceph.mon.a.smithi083.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-01T06:48:46.034 INFO:journalctl@ceph.mon.a.smithi083.stdout: Block cache BinnedLRUCache@0x56054fdaf1f0#7 capacity: 512.00 MB usage: 1.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.3e-05 secs_since: 0 2024-04-01T06:48:46.034 INFO:journalctl@ceph.mon.a.smithi083.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-04-01T06:48:46.034 INFO:journalctl@ceph.mon.a.smithi083.stdout: 2024-04-01T06:48:46.034 INFO:journalctl@ceph.mon.a.smithi083.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-01T06:48:46.034 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: starting mon.a rank 0 at public addrs [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] at bind addrs [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 2024-04-01T06:48:46.034 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: mon.a@-1(???) e1 preinit fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 2024-04-01T06:48:46.034 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: mon.a@-1(???).mds e1 new map 2024-04-01T06:48:46.034 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: mon.a@-1(???).mds e1 print_map 2024-04-01T06:48:46.034 INFO:journalctl@ceph.mon.a.smithi083.stdout: e1 2024-04-01T06:48:46.034 INFO:journalctl@ceph.mon.a.smithi083.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-01T06:48:46.034 INFO:journalctl@ceph.mon.a.smithi083.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-01T06:48:46.035 INFO:journalctl@ceph.mon.a.smithi083.stdout: legacy client fscid: -1 2024-04-01T06:48:46.035 INFO:journalctl@ceph.mon.a.smithi083.stdout: 2024-04-01T06:48:46.035 INFO:journalctl@ceph.mon.a.smithi083.stdout: No filesystems configured 2024-04-01T06:48:46.035 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-01T06:48:46.035 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-01T06:48:46.035 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-01T06:48:46.035 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-01T06:48:46.035 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-04-01T06:48:46.035 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: mon.a is new leader, mons a in quorum (ranks 0) 2024-04-01T06:48:46.035 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: monmap e1: 1 mons at {a=[v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-01T06:48:46.035 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: fsmap 2024-04-01T06:48:46.035 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: osdmap e1: 0 total, 0 up, 0 in 2024-04-01T06:48:46.035 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:45 smithi083 ceph-mon[43429]: mgrmap e1: no daemons active 2024-04-01T06:48:47.884 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:46.646+0000 7fc5f19aa700 1 Processor -- start 2024-04-01T06:48:47.885 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:46.646+0000 7fc5f19aa700 1 -- start start 2024-04-01T06:48:47.885 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:46.646+0000 7fc5f19aa700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5ec106580 0x7fc5ec1069a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:48:47.885 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:46.646+0000 7fc5f19aa700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ec106f70 con 0x7fc5ec106580 2024-04-01T06:48:47.885 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:46.646+0000 7fc5eaffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5ec106580 0x7fc5ec1069a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:48:47.885 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:46.647+0000 7fc5eaffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5ec106580 0x7fc5ec1069a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:49216/0 (socket says 172.21.15.83:49216) 2024-04-01T06:48:47.885 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:46.647+0000 7fc5eaffd700 1 -- 172.21.15.83:0/158655953 learned_addr learned my addr 172.21.15.83:0/158655953 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:48:47.885 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:46.647+0000 7fc5eaffd700 1 -- 172.21.15.83:0/158655953 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5ec107730 con 0x7fc5ec106580 2024-04-01T06:48:47.885 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:46.647+0000 7fc5eaffd700 1 --2- 172.21.15.83:0/158655953 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5ec106580 0x7fc5ec1069a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fc5e00098a0 tx=0x7fc5e0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6550618f6b5fa91 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:48:47.885 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:46.647+0000 7fc5e9ffb700 1 -- 172.21.15.83:0/158655953 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc5e0004160 con 0x7fc5ec106580 2024-04-01T06:48:47.885 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:46.647+0000 7fc5e9ffb700 1 -- 172.21.15.83:0/158655953 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc5e00042c0 con 0x7fc5ec106580 2024-04-01T06:48:47.885 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:46.647+0000 7fc5e9ffb700 1 -- 172.21.15.83:0/158655953 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc5e0011a00 con 0x7fc5ec106580 2024-04-01T06:48:47.885 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:46.648+0000 7fc5f19aa700 1 -- 172.21.15.83:0/158655953 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5ec106580 msgr2=0x7fc5ec1069a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:48:47.885 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:46.648+0000 7fc5f19aa700 1 --2- 172.21.15.83:0/158655953 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5ec106580 0x7fc5ec1069a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fc5e00098a0 tx=0x7fc5e0009bb0 comp rx=0 tx=0).stop 2024-04-01T06:48:47.886 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:46.648+0000 7fc5f19aa700 1 -- 172.21.15.83:0/158655953 shutdown_connections 2024-04-01T06:48:47.886 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:46.648+0000 7fc5f19aa700 1 --2- 172.21.15.83:0/158655953 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5ec106580 0x7fc5ec1069a0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:48:47.886 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:46.648+0000 7fc5f19aa700 1 -- 172.21.15.83:0/158655953 >> 172.21.15.83:0/158655953 conn(0x7fc5ec101b60 msgr2=0x7fc5ec103f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:48:47.886 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:46.648+0000 7fc5f19aa700 1 -- 172.21.15.83:0/158655953 shutdown_connections 2024-04-01T06:48:47.886 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:46.648+0000 7fc5f19aa700 1 -- 172.21.15.83:0/158655953 wait complete. 2024-04-01T06:48:47.886 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:46.648+0000 7fc5f19aa700 1 Processor -- start 2024-04-01T06:48:47.886 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:46.649+0000 7fc5f19aa700 1 -- start start 2024-04-01T06:48:47.886 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:46.649+0000 7fc5f19aa700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5ec106580 0x7fc5ec19a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:48:47.886 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:46.649+0000 7fc5f19aa700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ec19a7c0 con 0x7fc5ec106580 2024-04-01T06:48:47.886 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:46.649+0000 7fc5eaffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5ec106580 0x7fc5ec19a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:48:47.886 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:46.649+0000 7fc5eaffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5ec106580 0x7fc5ec19a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:49228/0 (socket says 172.21.15.83:49228) 2024-04-01T06:48:47.886 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:46.649+0000 7fc5eaffd700 1 -- 172.21.15.83:0/4238089925 learned_addr learned my addr 172.21.15.83:0/4238089925 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:48:47.886 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:46.649+0000 7fc5eaffd700 1 -- 172.21.15.83:0/4238089925 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e0009550 con 0x7fc5ec106580 2024-04-01T06:48:47.887 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:46.649+0000 7fc5eaffd700 1 --2- 172.21.15.83:0/4238089925 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5ec106580 0x7fc5ec19a280 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fc5e0009130 tx=0x7fc5e0011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:48:47.887 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:46.649+0000 7fc5f09a8700 1 -- 172.21.15.83:0/4238089925 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc5e0003ab0 con 0x7fc5ec106580 2024-04-01T06:48:47.887 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:46.649+0000 7fc5f09a8700 1 -- 172.21.15.83:0/4238089925 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc5e0003c10 con 0x7fc5ec106580 2024-04-01T06:48:47.887 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:46.649+0000 7fc5f09a8700 1 -- 172.21.15.83:0/4238089925 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc5e00247d0 con 0x7fc5ec106580 2024-04-01T06:48:47.887 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:46.649+0000 7fc5f19aa700 1 -- 172.21.15.83:0/4238089925 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5ec19a9c0 con 0x7fc5ec106580 2024-04-01T06:48:47.887 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:46.650+0000 7fc5f19aa700 1 -- 172.21.15.83:0/4238089925 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5ec19ae60 con 0x7fc5ec106580 2024-04-01T06:48:47.887 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:46.650+0000 7fc5f09a8700 1 -- 172.21.15.83:0/4238089925 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc5e0024d50 con 0x7fc5ec106580 2024-04-01T06:48:47.887 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:46.650+0000 7fc5f09a8700 1 -- 172.21.15.83:0/4238089925 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fc5e00193c0 con 0x7fc5ec106580 2024-04-01T06:48:47.887 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:46.650+0000 7fc5f19aa700 1 -- 172.21.15.83:0/4238089925 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5ec0623e0 con 0x7fc5ec106580 2024-04-01T06:48:47.887 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:47 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/4238089925' entity='client.admin' 2024-04-01T06:48:47.888 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:46.653+0000 7fc5f09a8700 1 -- 172.21.15.83:0/4238089925 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7fc5e001abb0 con 0x7fc5ec106580 2024-04-01T06:48:47.889 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:46.721+0000 7fc5f19aa700 1 -- 172.21.15.83:0/4238089925 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7fc5ec19d6f0 con 0x7fc5ec106580 2024-04-01T06:48:47.889 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:46.723+0000 7fc5f09a8700 1 -- 172.21.15.83:0/4238089925 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7fc5e001ad50 con 0x7fc5ec106580 2024-04-01T06:48:47.889 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:46.724+0000 7fc5f19aa700 1 -- 172.21.15.83:0/4238089925 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5ec106580 msgr2=0x7fc5ec19a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:48:47.889 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:46.724+0000 7fc5f19aa700 1 --2- 172.21.15.83:0/4238089925 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5ec106580 0x7fc5ec19a280 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fc5e0009130 tx=0x7fc5e0011ad0 comp rx=0 tx=0).stop 2024-04-01T06:48:47.889 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:46.724+0000 7fc5f19aa700 1 -- 172.21.15.83:0/4238089925 shutdown_connections 2024-04-01T06:48:47.889 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:46.724+0000 7fc5f19aa700 1 --2- 172.21.15.83:0/4238089925 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5ec106580 0x7fc5ec19a280 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:48:47.889 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:46.724+0000 7fc5f19aa700 1 -- 172.21.15.83:0/4238089925 >> 172.21.15.83:0/4238089925 conn(0x7fc5ec101b60 msgr2=0x7fc5ec1026e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:48:47.889 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:46.724+0000 7fc5f19aa700 1 -- 172.21.15.83:0/4238089925 shutdown_connections 2024-04-01T06:48:47.889 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:46.724+0000 7fc5f19aa700 1 -- 172.21.15.83:0/4238089925 wait complete. 2024-04-01T06:48:47.889 INFO:teuthology.orchestra.run.smithi083.stdout:Wrote config to /etc/ceph/ceph.conf 2024-04-01T06:48:47.916 INFO:teuthology.orchestra.run.smithi083.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-04-01T06:48:47.916 INFO:teuthology.orchestra.run.smithi083.stdout:Creating mgr... 2024-04-01T06:48:47.917 INFO:teuthology.orchestra.run.smithi083.stdout:Verifying port 0.0.0.0:9283 ... 2024-04-01T06:48:47.917 INFO:teuthology.orchestra.run.smithi083.stdout:Verifying port 0.0.0.0:8765 ... 2024-04-01T06:48:48.108 INFO:teuthology.orchestra.run.smithi083.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mgr.x 2024-04-01T06:48:48.108 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stderr Failed to reset failed state of unit ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mgr.x.service: Unit ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mgr.x.service not loaded. 2024-04-01T06:48:48.200 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4.target.wants/ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mgr.x.service → /etc/systemd/system/ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@.service. 2024-04-01T06:48:48.206 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:48:48 smithi083 systemd[1]: Starting Ceph mgr.x for c6f8eff4-eff3-11ee-b647-cb9ed24678a4... 2024-04-01T06:48:48.610 INFO:teuthology.orchestra.run.smithi083.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-01T06:48:48.610 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stdout disabled 2024-04-01T06:48:48.618 INFO:teuthology.orchestra.run.smithi083.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-01T06:48:48.618 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stdout inactive 2024-04-01T06:48:48.618 INFO:teuthology.orchestra.run.smithi083.stdout:firewalld.service is not enabled 2024-04-01T06:48:48.618 INFO:teuthology.orchestra.run.smithi083.stdout:Not possible to enable service . firewalld.service is not available 2024-04-01T06:48:48.626 INFO:teuthology.orchestra.run.smithi083.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-01T06:48:48.626 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stdout disabled 2024-04-01T06:48:48.634 INFO:teuthology.orchestra.run.smithi083.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-01T06:48:48.634 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stdout inactive 2024-04-01T06:48:48.634 INFO:teuthology.orchestra.run.smithi083.stdout:firewalld.service is not enabled 2024-04-01T06:48:48.634 INFO:teuthology.orchestra.run.smithi083.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-04-01T06:48:48.634 INFO:teuthology.orchestra.run.smithi083.stdout:Waiting for mgr to start... 2024-04-01T06:48:48.634 INFO:teuthology.orchestra.run.smithi083.stdout:Waiting for mgr... 2024-04-01T06:48:48.981 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:48:48 smithi083 bash[43663]: 030867c29d83769d2d36fd749a2889cc361484f4465c94609650a72b7b863c07 2024-04-01T06:48:48.982 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:48:48 smithi083 systemd[1]: Started Ceph mgr.x for c6f8eff4-eff3-11ee-b647-cb9ed24678a4. 2024-04-01T06:48:49.255 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:49 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/1481784485' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-01T06:48:49.255 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:48:48 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:48:48.981+0000 7f654a9ab200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-01T06:48:49.255 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:48:49 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:48:49.077+0000 7f654a9ab200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-01T06:48:49.255 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:48:49 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:48:49.172+0000 7f654a9ab200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-01T06:48:49.440 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout 2024-04-01T06:48:49.441 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout { 2024-04-01T06:48:49.441 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "fsid": "c6f8eff4-eff3-11ee-b647-cb9ed24678a4", 2024-04-01T06:48:49.441 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "health": { 2024-04-01T06:48:49.441 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-01T06:48:49.441 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-01T06:48:49.441 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-01T06:48:49.441 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-04-01T06:48:49.441 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-01T06:48:49.441 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-01T06:48:49.441 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout 0 2024-04-01T06:48:49.441 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout ], 2024-04-01T06:48:49.441 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-01T06:48:49.441 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "a" 2024-04-01T06:48:49.441 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout ], 2024-04-01T06:48:49.442 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-04-01T06:48:49.442 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-01T06:48:49.442 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-01T06:48:49.442 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-04-01T06:48:49.442 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-01T06:48:49.442 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-04-01T06:48:49.442 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-01T06:48:49.442 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-01T06:48:49.442 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-01T06:48:49.450 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-01T06:48:49.450 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-01T06:48:49.450 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-01T06:48:49.450 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-01T06:48:49.450 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-01T06:48:49.450 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-04-01T06:48:49.450 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-01T06:48:49.450 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-01T06:48:49.450 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-01T06:48:49.450 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-01T06:48:49.451 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-01T06:48:49.451 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-01T06:48:49.451 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-01T06:48:49.451 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-01T06:48:49.451 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-01T06:48:49.451 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-04-01T06:48:49.451 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-01T06:48:49.451 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-01T06:48:49.451 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-01T06:48:49.451 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-01T06:48:49.451 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-04-01T06:48:49.451 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-01T06:48:49.451 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-01T06:48:49.451 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-01T06:48:49.451 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-01T06:48:49.452 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-01T06:48:49.452 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-01T06:48:49.452 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "restful" 2024-04-01T06:48:49.452 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout ], 2024-04-01T06:48:49.452 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-01T06:48:49.452 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-04-01T06:48:49.452 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-01T06:48:49.452 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-01T06:48:49.452 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "modified": "2024-04-01T06:48:42.033951+0000", 2024-04-01T06:48:49.452 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-01T06:48:49.452 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-04-01T06:48:49.452 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-01T06:48:49.452 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout } 2024-04-01T06:48:49.452 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:49.008+0000 7f959234d700 1 Processor -- start 2024-04-01T06:48:49.452 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:49.008+0000 7f959234d700 1 -- start start 2024-04-01T06:48:49.453 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:49.009+0000 7f959234d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f958c105480 0x7f958c1058a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:48:49.453 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:49.009+0000 7f959234d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f958c105e70 con 0x7f958c105480 2024-04-01T06:48:49.453 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:49.009+0000 7f958bfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f958c105480 0x7f958c1058a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:48:49.453 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:49.009+0000 7f958bfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f958c105480 0x7f958c1058a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:49268/0 (socket says 172.21.15.83:49268) 2024-04-01T06:48:49.453 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:49.009+0000 7f958bfff700 1 -- 172.21.15.83:0/3926740294 learned_addr learned my addr 172.21.15.83:0/3926740294 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:48:49.453 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:49.009+0000 7f958bfff700 1 -- 172.21.15.83:0/3926740294 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f958c106680 con 0x7f958c105480 2024-04-01T06:48:49.453 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:49.010+0000 7f958bfff700 1 --2- 172.21.15.83:0/3926740294 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f958c105480 0x7f958c1058a0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f957c0098a0 tx=0x7f957c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccd35313589c60ba server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:48:49.453 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:49.010+0000 7f958affd700 1 -- 172.21.15.83:0/3926740294 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f957c004160 con 0x7f958c105480 2024-04-01T06:48:49.453 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:49.010+0000 7f958affd700 1 -- 172.21.15.83:0/3926740294 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f957c0042c0 con 0x7f958c105480 2024-04-01T06:48:49.453 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:49.010+0000 7f958affd700 1 -- 172.21.15.83:0/3926740294 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f957c011a00 con 0x7f958c105480 2024-04-01T06:48:49.453 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:49.010+0000 7f959234d700 1 -- 172.21.15.83:0/3926740294 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f958c105480 msgr2=0x7f958c1058a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:48:49.453 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:49.010+0000 7f959234d700 1 --2- 172.21.15.83:0/3926740294 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f958c105480 0x7f958c1058a0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f957c0098a0 tx=0x7f957c009bb0 comp rx=0 tx=0).stop 2024-04-01T06:48:49.453 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:49.010+0000 7f959234d700 1 -- 172.21.15.83:0/3926740294 shutdown_connections 2024-04-01T06:48:49.453 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:49.010+0000 7f959234d700 1 --2- 172.21.15.83:0/3926740294 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f958c105480 0x7f958c1058a0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:48:49.454 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:49.010+0000 7f959234d700 1 -- 172.21.15.83:0/3926740294 >> 172.21.15.83:0/3926740294 conn(0x7f958c100a40 msgr2=0x7f958c102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:48:49.454 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:49.011+0000 7f959234d700 1 -- 172.21.15.83:0/3926740294 shutdown_connections 2024-04-01T06:48:49.454 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:49.011+0000 7f959234d700 1 -- 172.21.15.83:0/3926740294 wait complete. 2024-04-01T06:48:49.454 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:49.011+0000 7f959234d700 1 Processor -- start 2024-04-01T06:48:49.454 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:49.011+0000 7f959234d700 1 -- start start 2024-04-01T06:48:49.454 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:49.011+0000 7f959234d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f958c105480 0x7f958c1904e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:48:49.454 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:49.011+0000 7f959234d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f958c190a20 con 0x7f958c105480 2024-04-01T06:48:49.454 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:49.012+0000 7f958bfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f958c105480 0x7f958c1904e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:48:49.454 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:49.012+0000 7f958bfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f958c105480 0x7f958c1904e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:49276/0 (socket says 172.21.15.83:49276) 2024-04-01T06:48:49.454 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:49.012+0000 7f958bfff700 1 -- 172.21.15.83:0/1481784485 learned_addr learned my addr 172.21.15.83:0/1481784485 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:48:49.454 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:49.012+0000 7f958bfff700 1 -- 172.21.15.83:0/1481784485 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f957c009550 con 0x7f958c105480 2024-04-01T06:48:49.454 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:49.012+0000 7f958bfff700 1 --2- 172.21.15.83:0/1481784485 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f958c105480 0x7f958c1904e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f957c009130 tx=0x7f957c011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:48:49.454 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:49.012+0000 7f95897fa700 1 -- 172.21.15.83:0/1481784485 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f957c003ab0 con 0x7f958c105480 2024-04-01T06:48:49.454 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:49.012+0000 7f959234d700 1 -- 172.21.15.83:0/1481784485 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f958c18ec60 con 0x7f958c105480 2024-04-01T06:48:49.455 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:49.012+0000 7f95897fa700 1 -- 172.21.15.83:0/1481784485 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f957c003c10 con 0x7f958c105480 2024-04-01T06:48:49.455 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:49.012+0000 7f95897fa700 1 -- 172.21.15.83:0/1481784485 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f957c0247d0 con 0x7f958c105480 2024-04-01T06:48:49.455 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:49.012+0000 7f959234d700 1 -- 172.21.15.83:0/1481784485 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f958c18f100 con 0x7f958c105480 2024-04-01T06:48:49.455 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:49.012+0000 7f95897fa700 1 -- 172.21.15.83:0/1481784485 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f957c024d50 con 0x7f958c105480 2024-04-01T06:48:49.455 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:49.012+0000 7f95897fa700 1 -- 172.21.15.83:0/1481784485 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f957c0193c0 con 0x7f958c105480 2024-04-01T06:48:49.455 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:49.013+0000 7f959234d700 1 -- 172.21.15.83:0/1481784485 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f958c18fb10 con 0x7f958c105480 2024-04-01T06:48:49.455 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:49.015+0000 7f95897fa700 1 -- 172.21.15.83:0/1481784485 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f957c01abb0 con 0x7f958c105480 2024-04-01T06:48:49.455 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:49.087+0000 7f959234d700 1 -- 172.21.15.83:0/1481784485 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f958c1098b0 con 0x7f958c105480 2024-04-01T06:48:49.455 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:49.088+0000 7f95897fa700 1 -- 172.21.15.83:0/1481784485 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f957c01ad50 con 0x7f958c105480 2024-04-01T06:48:49.455 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:49.088+0000 7f959234d700 1 -- 172.21.15.83:0/1481784485 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f958c105480 msgr2=0x7f958c1904e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:48:49.455 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:49.088+0000 7f959234d700 1 --2- 172.21.15.83:0/1481784485 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f958c105480 0x7f958c1904e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f957c009130 tx=0x7f957c011ad0 comp rx=0 tx=0).stop 2024-04-01T06:48:49.455 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:49.089+0000 7f959234d700 1 -- 172.21.15.83:0/1481784485 shutdown_connections 2024-04-01T06:48:49.455 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:49.089+0000 7f959234d700 1 --2- 172.21.15.83:0/1481784485 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f958c105480 0x7f958c1904e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:48:49.455 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:49.089+0000 7f959234d700 1 -- 172.21.15.83:0/1481784485 >> 172.21.15.83:0/1481784485 conn(0x7f958c100a40 msgr2=0x7f958c101940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:48:49.455 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:49.089+0000 7f959234d700 1 -- 172.21.15.83:0/1481784485 shutdown_connections 2024-04-01T06:48:49.455 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:49.089+0000 7f959234d700 1 -- 172.21.15.83:0/1481784485 wait complete. 2024-04-01T06:48:49.456 INFO:teuthology.orchestra.run.smithi083.stdout:mgr not available, waiting (1/15)... 2024-04-01T06:48:49.512 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:48:49 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:48:49.257+0000 7f654a9ab200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-01T06:48:50.218 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:48:49 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:48:49.891+0000 7f654a9ab200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-01T06:48:50.219 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:48:50 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:48:50.136+0000 7f654a9ab200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-01T06:48:50.478 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:48:50 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:48:50.219+0000 7f654a9ab200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-01T06:48:50.478 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:48:50 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:48:50.325+0000 7f654a9ab200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-01T06:48:50.762 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:48:50 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:48:50.479+0000 7f654a9ab200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-01T06:48:50.762 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:48:50 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:48:50.603+0000 7f654a9ab200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-01T06:48:50.762 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:48:50 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:48:50.686+0000 7f654a9ab200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-01T06:48:51.429 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:48:51 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:48:51.051+0000 7f654a9ab200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-01T06:48:51.727 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:48:51 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:48:51.429+0000 7f654a9ab200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-01T06:48:51.727 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:48:51 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:48:51.632+0000 7f654a9ab200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-01T06:48:52.012 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:48:51 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:48:51.728+0000 7f654a9ab200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-01T06:48:52.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:51 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/3429903012' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-01T06:48:52.240 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout 2024-04-01T06:48:52.241 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout { 2024-04-01T06:48:52.241 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "fsid": "c6f8eff4-eff3-11ee-b647-cb9ed24678a4", 2024-04-01T06:48:52.241 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "health": { 2024-04-01T06:48:52.241 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-01T06:48:52.241 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-01T06:48:52.241 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-01T06:48:52.241 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-04-01T06:48:52.241 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-01T06:48:52.241 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-01T06:48:52.241 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout 0 2024-04-01T06:48:52.241 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout ], 2024-04-01T06:48:52.241 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-01T06:48:52.241 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "a" 2024-04-01T06:48:52.242 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout ], 2024-04-01T06:48:52.242 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-04-01T06:48:52.242 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-01T06:48:52.242 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-01T06:48:52.242 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-04-01T06:48:52.242 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-01T06:48:52.242 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-04-01T06:48:52.242 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-01T06:48:52.242 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-01T06:48:52.242 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-01T06:48:52.242 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-01T06:48:52.242 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-01T06:48:52.250 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-01T06:48:52.250 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-01T06:48:52.250 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-01T06:48:52.250 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-04-01T06:48:52.250 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-01T06:48:52.250 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-01T06:48:52.250 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-01T06:48:52.250 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-01T06:48:52.251 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-01T06:48:52.251 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-01T06:48:52.251 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-01T06:48:52.251 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-01T06:48:52.251 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-01T06:48:52.251 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-04-01T06:48:52.251 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-01T06:48:52.251 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-01T06:48:52.251 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-01T06:48:52.251 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-01T06:48:52.251 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-04-01T06:48:52.251 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-01T06:48:52.251 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-01T06:48:52.251 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-01T06:48:52.251 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-01T06:48:52.251 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-01T06:48:52.252 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-01T06:48:52.252 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "restful" 2024-04-01T06:48:52.252 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout ], 2024-04-01T06:48:52.252 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-01T06:48:52.252 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-04-01T06:48:52.253 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-01T06:48:52.253 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-01T06:48:52.253 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "modified": "2024-04-01T06:48:42.033951+0000", 2024-04-01T06:48:52.253 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-01T06:48:52.254 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-04-01T06:48:52.254 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-01T06:48:52.254 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout } 2024-04-01T06:48:52.254 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:51.805+0000 7fc46a4f4700 1 Processor -- start 2024-04-01T06:48:52.254 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:51.805+0000 7fc46a4f4700 1 -- start start 2024-04-01T06:48:52.254 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:51.805+0000 7fc46a4f4700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc464106ff0 0x7fc4641093e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:48:52.254 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:51.805+0000 7fc46a4f4700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc464079eb0 con 0x7fc464106ff0 2024-04-01T06:48:52.254 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:51.805+0000 7fc463fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc464106ff0 0x7fc4641093e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:48:52.254 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:51.805+0000 7fc463fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc464106ff0 0x7fc4641093e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:49284/0 (socket says 172.21.15.83:49284) 2024-04-01T06:48:52.254 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:51.805+0000 7fc463fff700 1 -- 172.21.15.83:0/243247685 learned_addr learned my addr 172.21.15.83:0/243247685 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:48:52.254 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:51.806+0000 7fc463fff700 1 -- 172.21.15.83:0/243247685 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc464109920 con 0x7fc464106ff0 2024-04-01T06:48:52.254 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:51.806+0000 7fc463fff700 1 --2- 172.21.15.83:0/243247685 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc464106ff0 0x7fc4641093e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc4540098a0 tx=0x7fc454009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99fba9d3caa8fcc6 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:48:52.254 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:51.806+0000 7fc462ffd700 1 -- 172.21.15.83:0/243247685 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc454004160 con 0x7fc464106ff0 2024-04-01T06:48:52.254 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:51.806+0000 7fc462ffd700 1 -- 172.21.15.83:0/243247685 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc4540042c0 con 0x7fc464106ff0 2024-04-01T06:48:52.255 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:51.806+0000 7fc462ffd700 1 -- 172.21.15.83:0/243247685 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc454011a00 con 0x7fc464106ff0 2024-04-01T06:48:52.255 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:51.807+0000 7fc46a4f4700 1 -- 172.21.15.83:0/243247685 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc464106ff0 msgr2=0x7fc4641093e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:48:52.255 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:51.807+0000 7fc46a4f4700 1 --2- 172.21.15.83:0/243247685 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc464106ff0 0x7fc4641093e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc4540098a0 tx=0x7fc454009bb0 comp rx=0 tx=0).stop 2024-04-01T06:48:52.255 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:51.807+0000 7fc46a4f4700 1 -- 172.21.15.83:0/243247685 shutdown_connections 2024-04-01T06:48:52.255 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:51.807+0000 7fc46a4f4700 1 --2- 172.21.15.83:0/243247685 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc464106ff0 0x7fc4641093e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:48:52.255 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:51.807+0000 7fc46a4f4700 1 -- 172.21.15.83:0/243247685 >> 172.21.15.83:0/243247685 conn(0x7fc464100a40 msgr2=0x7fc464102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:48:52.255 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:51.807+0000 7fc46a4f4700 1 -- 172.21.15.83:0/243247685 shutdown_connections 2024-04-01T06:48:52.255 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:51.807+0000 7fc46a4f4700 1 -- 172.21.15.83:0/243247685 wait complete. 2024-04-01T06:48:52.255 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:51.808+0000 7fc46a4f4700 1 Processor -- start 2024-04-01T06:48:52.255 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:51.808+0000 7fc46a4f4700 1 -- start start 2024-04-01T06:48:52.255 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:51.808+0000 7fc46a4f4700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc464106ff0 0x7fc46419a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:48:52.255 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:51.808+0000 7fc46a4f4700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc46419a7d0 con 0x7fc464106ff0 2024-04-01T06:48:52.255 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:51.808+0000 7fc463fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc464106ff0 0x7fc46419a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:48:52.255 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:51.808+0000 7fc463fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc464106ff0 0x7fc46419a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:49288/0 (socket says 172.21.15.83:49288) 2024-04-01T06:48:52.255 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:51.808+0000 7fc463fff700 1 -- 172.21.15.83:0/3429903012 learned_addr learned my addr 172.21.15.83:0/3429903012 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:48:52.256 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:51.808+0000 7fc463fff700 1 -- 172.21.15.83:0/3429903012 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc454009550 con 0x7fc464106ff0 2024-04-01T06:48:52.256 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:51.809+0000 7fc463fff700 1 --2- 172.21.15.83:0/3429903012 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc464106ff0 0x7fc46419a290 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc454009fb0 tx=0x7fc454011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:48:52.256 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:51.809+0000 7fc4617fa700 1 -- 172.21.15.83:0/3429903012 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc454003a40 con 0x7fc464106ff0 2024-04-01T06:48:52.256 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:51.809+0000 7fc4617fa700 1 -- 172.21.15.83:0/3429903012 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc454003ba0 con 0x7fc464106ff0 2024-04-01T06:48:52.256 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:51.809+0000 7fc4617fa700 1 -- 172.21.15.83:0/3429903012 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc45401a750 con 0x7fc464106ff0 2024-04-01T06:48:52.256 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:51.809+0000 7fc46a4f4700 1 -- 172.21.15.83:0/3429903012 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc46419a9d0 con 0x7fc464106ff0 2024-04-01T06:48:52.256 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:51.809+0000 7fc46a4f4700 1 -- 172.21.15.83:0/3429903012 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc46419ae70 con 0x7fc464106ff0 2024-04-01T06:48:52.256 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:51.809+0000 7fc4617fa700 1 -- 172.21.15.83:0/3429903012 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc45401acd0 con 0x7fc464106ff0 2024-04-01T06:48:52.256 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:51.809+0000 7fc4617fa700 1 -- 172.21.15.83:0/3429903012 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fc4540193c0 con 0x7fc464106ff0 2024-04-01T06:48:52.256 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:51.810+0000 7fc44affd700 1 -- 172.21.15.83:0/3429903012 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4440052f0 con 0x7fc464106ff0 2024-04-01T06:48:52.256 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:51.812+0000 7fc4617fa700 1 -- 172.21.15.83:0/3429903012 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7fc454024b60 con 0x7fc464106ff0 2024-04-01T06:48:52.256 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:51.884+0000 7fc44affd700 1 -- 172.21.15.83:0/3429903012 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fc444005160 con 0x7fc464106ff0 2024-04-01T06:48:52.256 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:51.885+0000 7fc4617fa700 1 -- 172.21.15.83:0/3429903012 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7fc454024d00 con 0x7fc464106ff0 2024-04-01T06:48:52.256 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:51.885+0000 7fc44affd700 1 -- 172.21.15.83:0/3429903012 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc464106ff0 msgr2=0x7fc46419a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:48:52.256 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:51.885+0000 7fc44affd700 1 --2- 172.21.15.83:0/3429903012 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc464106ff0 0x7fc46419a290 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc454009fb0 tx=0x7fc454011ad0 comp rx=0 tx=0).stop 2024-04-01T06:48:52.257 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:51.885+0000 7fc44affd700 1 -- 172.21.15.83:0/3429903012 shutdown_connections 2024-04-01T06:48:52.257 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:51.886+0000 7fc44affd700 1 --2- 172.21.15.83:0/3429903012 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc464106ff0 0x7fc46419a290 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:48:52.257 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:51.886+0000 7fc44affd700 1 -- 172.21.15.83:0/3429903012 >> 172.21.15.83:0/3429903012 conn(0x7fc464100a40 msgr2=0x7fc464101550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:48:52.257 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:51.886+0000 7fc44affd700 1 -- 172.21.15.83:0/3429903012 shutdown_connections 2024-04-01T06:48:52.257 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:51.886+0000 7fc44affd700 1 -- 172.21.15.83:0/3429903012 wait complete. 2024-04-01T06:48:52.257 INFO:teuthology.orchestra.run.smithi083.stdout:mgr not available, waiting (2/15)... 2024-04-01T06:48:52.762 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:48:52 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:48:52.508+0000 7f654a9ab200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-01T06:48:52.762 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:48:52 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:48:52.605+0000 7f654a9ab200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-01T06:48:52.762 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:48:52 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:48:52.750+0000 7f654a9ab200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-01T06:48:53.730 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:48:53 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:48:53.363+0000 7f654a9ab200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-01T06:48:53.730 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:48:53 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:48:53.540+0000 7f654a9ab200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-01T06:48:54.012 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:48:53 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:48:53.730+0000 7f654a9ab200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-01T06:48:54.960 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:54 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/162442589' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-01T06:48:54.961 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:48:54 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:48:54.667+0000 7f654a9ab200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-01T06:48:55.065 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout 2024-04-01T06:48:55.065 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout { 2024-04-01T06:48:55.065 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "fsid": "c6f8eff4-eff3-11ee-b647-cb9ed24678a4", 2024-04-01T06:48:55.065 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "health": { 2024-04-01T06:48:55.065 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-01T06:48:55.065 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-01T06:48:55.065 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-01T06:48:55.066 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-04-01T06:48:55.066 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-01T06:48:55.066 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-01T06:48:55.066 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout 0 2024-04-01T06:48:55.066 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout ], 2024-04-01T06:48:55.066 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-01T06:48:55.066 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "a" 2024-04-01T06:48:55.066 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout ], 2024-04-01T06:48:55.066 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-04-01T06:48:55.066 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-01T06:48:55.066 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-01T06:48:55.066 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-04-01T06:48:55.067 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-01T06:48:55.067 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-04-01T06:48:55.067 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-01T06:48:55.067 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-01T06:48:55.067 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-01T06:48:55.067 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-01T06:48:55.075 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-01T06:48:55.076 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-01T06:48:55.076 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-01T06:48:55.076 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-01T06:48:55.076 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-04-01T06:48:55.076 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-01T06:48:55.076 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-01T06:48:55.076 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-01T06:48:55.076 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-01T06:48:55.076 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-01T06:48:55.076 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-01T06:48:55.076 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-01T06:48:55.076 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-01T06:48:55.076 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-01T06:48:55.076 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-04-01T06:48:55.077 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-01T06:48:55.077 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-01T06:48:55.077 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-01T06:48:55.077 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-01T06:48:55.077 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-04-01T06:48:55.077 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-01T06:48:55.077 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-01T06:48:55.077 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-01T06:48:55.077 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-01T06:48:55.077 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-01T06:48:55.077 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-01T06:48:55.077 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "restful" 2024-04-01T06:48:55.077 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout ], 2024-04-01T06:48:55.077 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-01T06:48:55.077 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-04-01T06:48:55.077 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-01T06:48:55.077 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-01T06:48:55.078 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "modified": "2024-04-01T06:48:42.033951+0000", 2024-04-01T06:48:55.078 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-01T06:48:55.078 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-04-01T06:48:55.078 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-01T06:48:55.078 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout } 2024-04-01T06:48:55.078 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:54.603+0000 7f27e1ae7700 1 Processor -- start 2024-04-01T06:48:55.078 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:54.603+0000 7f27e1ae7700 1 -- start start 2024-04-01T06:48:55.078 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:54.603+0000 7f27e1ae7700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27dc106580 0x7f27dc1069a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:48:55.078 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:54.603+0000 7f27e1ae7700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27dc106f70 con 0x7f27dc106580 2024-04-01T06:48:55.078 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:54.603+0000 7f27db7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27dc106580 0x7f27dc1069a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:48:55.078 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:54.603+0000 7f27db7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27dc106580 0x7f27dc1069a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55856/0 (socket says 172.21.15.83:55856) 2024-04-01T06:48:55.079 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:54.603+0000 7f27db7fe700 1 -- 172.21.15.83:0/3768457701 learned_addr learned my addr 172.21.15.83:0/3768457701 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:48:55.079 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:54.604+0000 7f27db7fe700 1 -- 172.21.15.83:0/3768457701 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27dc107730 con 0x7f27dc106580 2024-04-01T06:48:55.079 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:54.604+0000 7f27db7fe700 1 --2- 172.21.15.83:0/3768457701 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27dc106580 0x7f27dc1069a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f27cc0098a0 tx=0x7f27cc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6d50089f8dc2255 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:48:55.079 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:54.604+0000 7f27da7fc700 1 -- 172.21.15.83:0/3768457701 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f27cc004160 con 0x7f27dc106580 2024-04-01T06:48:55.079 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:54.604+0000 7f27da7fc700 1 -- 172.21.15.83:0/3768457701 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f27cc0042c0 con 0x7f27dc106580 2024-04-01T06:48:55.079 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:54.604+0000 7f27da7fc700 1 -- 172.21.15.83:0/3768457701 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f27cc011a00 con 0x7f27dc106580 2024-04-01T06:48:55.079 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:54.604+0000 7f27e1ae7700 1 -- 172.21.15.83:0/3768457701 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27dc106580 msgr2=0x7f27dc1069a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:48:55.079 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:54.604+0000 7f27e1ae7700 1 --2- 172.21.15.83:0/3768457701 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27dc106580 0x7f27dc1069a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f27cc0098a0 tx=0x7f27cc009bb0 comp rx=0 tx=0).stop 2024-04-01T06:48:55.079 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:54.605+0000 7f27e1ae7700 1 -- 172.21.15.83:0/3768457701 shutdown_connections 2024-04-01T06:48:55.079 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:54.605+0000 7f27e1ae7700 1 --2- 172.21.15.83:0/3768457701 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27dc106580 0x7f27dc1069a0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:48:55.079 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:54.605+0000 7f27e1ae7700 1 -- 172.21.15.83:0/3768457701 >> 172.21.15.83:0/3768457701 conn(0x7f27dc101b00 msgr2=0x7f27dc103f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:48:55.079 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:54.605+0000 7f27e1ae7700 1 -- 172.21.15.83:0/3768457701 shutdown_connections 2024-04-01T06:48:55.080 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:54.605+0000 7f27e1ae7700 1 -- 172.21.15.83:0/3768457701 wait complete. 2024-04-01T06:48:55.080 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:54.605+0000 7f27e1ae7700 1 Processor -- start 2024-04-01T06:48:55.080 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:54.606+0000 7f27e1ae7700 1 -- start start 2024-04-01T06:48:55.080 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:54.606+0000 7f27e1ae7700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27dc106580 0x7f27dc19a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:48:55.080 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:54.606+0000 7f27e1ae7700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27dc19a7c0 con 0x7f27dc106580 2024-04-01T06:48:55.080 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:54.606+0000 7f27db7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27dc106580 0x7f27dc19a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:48:55.080 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:54.606+0000 7f27db7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27dc106580 0x7f27dc19a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55866/0 (socket says 172.21.15.83:55866) 2024-04-01T06:48:55.080 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:54.606+0000 7f27db7fe700 1 -- 172.21.15.83:0/162442589 learned_addr learned my addr 172.21.15.83:0/162442589 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:48:55.080 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:54.606+0000 7f27db7fe700 1 -- 172.21.15.83:0/162442589 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27cc009550 con 0x7f27dc106580 2024-04-01T06:48:55.080 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:54.606+0000 7f27db7fe700 1 --2- 172.21.15.83:0/162442589 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27dc106580 0x7f27dc19a280 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f27cc009fb0 tx=0x7f27cc011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:48:55.080 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:54.606+0000 7f27d8ff9700 1 -- 172.21.15.83:0/162442589 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f27cc003a40 con 0x7f27dc106580 2024-04-01T06:48:55.080 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:54.606+0000 7f27d8ff9700 1 -- 172.21.15.83:0/162442589 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f27cc003ba0 con 0x7f27dc106580 2024-04-01T06:48:55.080 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:54.606+0000 7f27e1ae7700 1 -- 172.21.15.83:0/162442589 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27dc19a9c0 con 0x7f27dc106580 2024-04-01T06:48:55.080 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:54.606+0000 7f27d8ff9700 1 -- 172.21.15.83:0/162442589 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f27cc01a750 con 0x7f27dc106580 2024-04-01T06:48:55.080 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:54.607+0000 7f27e1ae7700 1 -- 172.21.15.83:0/162442589 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27dc19ae60 con 0x7f27dc106580 2024-04-01T06:48:55.081 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:54.607+0000 7f27d8ff9700 1 -- 172.21.15.83:0/162442589 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f27cc01acd0 con 0x7f27dc106580 2024-04-01T06:48:55.081 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:54.607+0000 7f27d8ff9700 1 -- 172.21.15.83:0/162442589 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f27cc0193c0 con 0x7f27dc106580 2024-04-01T06:48:55.081 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:54.608+0000 7f27e1ae7700 1 -- 172.21.15.83:0/162442589 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27dc0623e0 con 0x7f27dc106580 2024-04-01T06:48:55.081 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:54.610+0000 7f27d8ff9700 1 -- 172.21.15.83:0/162442589 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f27cc024b60 con 0x7f27dc106580 2024-04-01T06:48:55.081 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:54.681+0000 7f27e1ae7700 1 -- 172.21.15.83:0/162442589 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f27dc10a8d0 con 0x7f27dc106580 2024-04-01T06:48:55.081 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:54.682+0000 7f27d8ff9700 1 -- 172.21.15.83:0/162442589 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f27cc024d00 con 0x7f27dc106580 2024-04-01T06:48:55.081 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:54.683+0000 7f27e1ae7700 1 -- 172.21.15.83:0/162442589 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27dc106580 msgr2=0x7f27dc19a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:48:55.081 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:54.683+0000 7f27e1ae7700 1 --2- 172.21.15.83:0/162442589 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27dc106580 0x7f27dc19a280 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f27cc009fb0 tx=0x7f27cc011ad0 comp rx=0 tx=0).stop 2024-04-01T06:48:55.081 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:54.683+0000 7f27e1ae7700 1 -- 172.21.15.83:0/162442589 shutdown_connections 2024-04-01T06:48:55.081 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:54.683+0000 7f27e1ae7700 1 --2- 172.21.15.83:0/162442589 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27dc106580 0x7f27dc19a280 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:48:55.081 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:54.683+0000 7f27e1ae7700 1 -- 172.21.15.83:0/162442589 >> 172.21.15.83:0/162442589 conn(0x7f27dc101b00 msgr2=0x7f27dc1026a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:48:55.081 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:54.683+0000 7f27e1ae7700 1 -- 172.21.15.83:0/162442589 shutdown_connections 2024-04-01T06:48:55.081 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:54.683+0000 7f27e1ae7700 1 -- 172.21.15.83:0/162442589 wait complete. 2024-04-01T06:48:55.081 INFO:teuthology.orchestra.run.smithi083.stdout:mgr not available, waiting (3/15)... 2024-04-01T06:48:55.241 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:48:54 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:48:54.961+0000 7f654a9ab200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-01T06:48:55.241 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:48:55 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:48:55.050+0000 7f654a9ab200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-01T06:48:55.512 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:48:55 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:48:55.242+0000 7f654a9ab200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-01T06:48:56.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:55 smithi083 ceph-mon[43429]: Activating manager daemon x 2024-04-01T06:48:56.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:55 smithi083 ceph-mon[43429]: mgrmap e2: x(active, starting, since 0.00301563s) 2024-04-01T06:48:56.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:55 smithi083 ceph-mon[43429]: from='mgr.14100 172.21.15.83:0/2953138699' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-01T06:48:56.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:55 smithi083 ceph-mon[43429]: from='mgr.14100 172.21.15.83:0/2953138699' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-01T06:48:56.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:55 smithi083 ceph-mon[43429]: from='mgr.14100 172.21.15.83:0/2953138699' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-01T06:48:56.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:55 smithi083 ceph-mon[43429]: from='mgr.14100 172.21.15.83:0/2953138699' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T06:48:56.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:55 smithi083 ceph-mon[43429]: from='mgr.14100 172.21.15.83:0/2953138699' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-01T06:48:56.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:55 smithi083 ceph-mon[43429]: Manager daemon x is now available 2024-04-01T06:48:56.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:55 smithi083 ceph-mon[43429]: from='mgr.14100 172.21.15.83:0/2953138699' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-01T06:48:56.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:55 smithi083 ceph-mon[43429]: from='mgr.14100 172.21.15.83:0/2953138699' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-01T06:48:56.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:55 smithi083 ceph-mon[43429]: from='mgr.14100 172.21.15.83:0/2953138699' entity='mgr.x' 2024-04-01T06:48:56.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:55 smithi083 ceph-mon[43429]: from='mgr.14100 172.21.15.83:0/2953138699' entity='mgr.x' 2024-04-01T06:48:56.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:55 smithi083 ceph-mon[43429]: from='mgr.14100 172.21.15.83:0/2953138699' entity='mgr.x' 2024-04-01T06:48:57.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:57 smithi083 ceph-mon[43429]: mgrmap e3: x(active, since 1.00669s) 2024-04-01T06:48:58.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:58 smithi083 ceph-mon[43429]: mgrmap e4: x(active, since 2s) 2024-04-01T06:48:58.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:48:58 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/2064515813' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-01T06:48:59.666 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout 2024-04-01T06:48:59.666 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout { 2024-04-01T06:48:59.666 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "fsid": "c6f8eff4-eff3-11ee-b647-cb9ed24678a4", 2024-04-01T06:48:59.666 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "health": { 2024-04-01T06:48:59.666 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-01T06:48:59.666 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-01T06:48:59.666 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-01T06:48:59.666 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-04-01T06:48:59.667 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-01T06:48:59.667 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-01T06:48:59.667 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout 0 2024-04-01T06:48:59.667 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout ], 2024-04-01T06:48:59.667 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-01T06:48:59.667 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "a" 2024-04-01T06:48:59.667 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout ], 2024-04-01T06:48:59.667 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "quorum_age": 12, 2024-04-01T06:48:59.667 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-01T06:48:59.667 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-01T06:48:59.667 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-04-01T06:48:59.667 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-01T06:48:59.668 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-04-01T06:48:59.668 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-01T06:48:59.668 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-01T06:48:59.668 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-01T06:48:59.668 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-01T06:48:59.668 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-01T06:48:59.678 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-01T06:48:59.678 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-01T06:48:59.678 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-01T06:48:59.678 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-04-01T06:48:59.678 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-01T06:48:59.678 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-01T06:48:59.678 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-01T06:48:59.678 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-01T06:48:59.678 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-01T06:48:59.679 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-01T06:48:59.679 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-01T06:48:59.679 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-01T06:48:59.679 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-01T06:48:59.680 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-04-01T06:48:59.680 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-01T06:48:59.680 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-01T06:48:59.680 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-01T06:48:59.680 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-01T06:48:59.680 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-04-01T06:48:59.680 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-01T06:48:59.680 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-01T06:48:59.680 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-01T06:48:59.680 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-01T06:48:59.680 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-01T06:48:59.680 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-01T06:48:59.680 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "restful" 2024-04-01T06:48:59.680 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout ], 2024-04-01T06:48:59.680 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-01T06:48:59.681 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-04-01T06:48:59.681 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-01T06:48:59.681 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-01T06:48:59.681 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "modified": "2024-04-01T06:48:42.033951+0000", 2024-04-01T06:48:59.681 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-01T06:48:59.681 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-04-01T06:48:59.681 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-01T06:48:59.681 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout } 2024-04-01T06:48:59.681 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:57.430+0000 7f87c4eec700 1 Processor -- start 2024-04-01T06:48:59.681 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:57.430+0000 7f87c4eec700 1 -- start start 2024-04-01T06:48:59.682 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:57.430+0000 7f87c4eec700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87c0107010 0x7f87c0109400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:48:59.682 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:57.430+0000 7f87c4eec700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c0079e50 con 0x7f87c0107010 2024-04-01T06:48:59.682 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:57.431+0000 7f87be59c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87c0107010 0x7f87c0109400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:48:59.682 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:57.431+0000 7f87be59c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87c0107010 0x7f87c0109400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55920/0 (socket says 172.21.15.83:55920) 2024-04-01T06:48:59.682 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:57.431+0000 7f87be59c700 1 -- 172.21.15.83:0/1493069038 learned_addr learned my addr 172.21.15.83:0/1493069038 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:48:59.682 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:57.431+0000 7f87be59c700 1 -- 172.21.15.83:0/1493069038 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c0109940 con 0x7f87c0107010 2024-04-01T06:48:59.682 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:57.431+0000 7f87be59c700 1 --2- 172.21.15.83:0/1493069038 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87c0107010 0x7f87c0109400 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f87b00098a0 tx=0x7f87b0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c08a010846aabd server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:48:59.682 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:57.431+0000 7f87bd59a700 1 -- 172.21.15.83:0/1493069038 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f87b0004160 con 0x7f87c0107010 2024-04-01T06:48:59.682 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:57.431+0000 7f87bd59a700 1 -- 172.21.15.83:0/1493069038 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f87b00042c0 con 0x7f87c0107010 2024-04-01T06:48:59.682 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:57.431+0000 7f87bd59a700 1 -- 172.21.15.83:0/1493069038 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f87b0011a00 con 0x7f87c0107010 2024-04-01T06:48:59.682 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:57.432+0000 7f87c4eec700 1 -- 172.21.15.83:0/1493069038 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87c0107010 msgr2=0x7f87c0109400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:48:59.683 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:57.432+0000 7f87c4eec700 1 --2- 172.21.15.83:0/1493069038 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87c0107010 0x7f87c0109400 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f87b00098a0 tx=0x7f87b0009bb0 comp rx=0 tx=0).stop 2024-04-01T06:48:59.683 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:57.432+0000 7f87c4eec700 1 -- 172.21.15.83:0/1493069038 shutdown_connections 2024-04-01T06:48:59.683 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:57.432+0000 7f87c4eec700 1 --2- 172.21.15.83:0/1493069038 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87c0107010 0x7f87c0109400 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:48:59.683 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:57.432+0000 7f87c4eec700 1 -- 172.21.15.83:0/1493069038 >> 172.21.15.83:0/1493069038 conn(0x7f87c0100a00 msgr2=0x7f87c0102e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:48:59.683 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:57.432+0000 7f87c4eec700 1 -- 172.21.15.83:0/1493069038 shutdown_connections 2024-04-01T06:48:59.683 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:57.432+0000 7f87c4eec700 1 -- 172.21.15.83:0/1493069038 wait complete. 2024-04-01T06:48:59.683 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:57.433+0000 7f87c4eec700 1 Processor -- start 2024-04-01T06:48:59.683 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:57.433+0000 7f87c4eec700 1 -- start start 2024-04-01T06:48:59.683 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:57.433+0000 7f87c4eec700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87c0107010 0x7f87c019c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:48:59.683 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:57.433+0000 7f87c4eec700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c019c9d0 con 0x7f87c0107010 2024-04-01T06:48:59.683 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:57.434+0000 7f87be59c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87c0107010 0x7f87c019c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:48:59.683 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:57.434+0000 7f87be59c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87c0107010 0x7f87c019c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55926/0 (socket says 172.21.15.83:55926) 2024-04-01T06:48:59.683 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:57.434+0000 7f87be59c700 1 -- 172.21.15.83:0/2064515813 learned_addr learned my addr 172.21.15.83:0/2064515813 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:48:59.683 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:57.434+0000 7f87be59c700 1 -- 172.21.15.83:0/2064515813 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b0009550 con 0x7f87c0107010 2024-04-01T06:48:59.684 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:57.434+0000 7f87be59c700 1 --2- 172.21.15.83:0/2064515813 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87c0107010 0x7f87c019c490 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f87b0009130 tx=0x7f87b0011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:48:59.684 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:57.434+0000 7f87af7fe700 1 -- 172.21.15.83:0/2064515813 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f87b0003b70 con 0x7f87c0107010 2024-04-01T06:48:59.684 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:57.434+0000 7f87af7fe700 1 -- 172.21.15.83:0/2064515813 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f87b0003cd0 con 0x7f87c0107010 2024-04-01T06:48:59.684 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:57.434+0000 7f87c4eec700 1 -- 172.21.15.83:0/2064515813 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87c019cbd0 con 0x7f87c0107010 2024-04-01T06:48:59.684 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:57.434+0000 7f87af7fe700 1 -- 172.21.15.83:0/2064515813 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f87b00197d0 con 0x7f87c0107010 2024-04-01T06:48:59.684 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:57.434+0000 7f87c4eec700 1 -- 172.21.15.83:0/2064515813 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87c019d070 con 0x7f87c0107010 2024-04-01T06:48:59.684 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:57.435+0000 7f87c4eec700 1 -- 172.21.15.83:0/2064515813 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87c010a6e0 con 0x7f87c0107010 2024-04-01T06:48:59.684 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:57.436+0000 7f87af7fe700 1 -- 172.21.15.83:0/2064515813 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 4) v1 ==== 45522+0+0 (secure 0 0 0) 0x7f87b001abb0 con 0x7f87c0107010 2024-04-01T06:48:59.684 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:57.436+0000 7f87af7fe700 1 --2- 172.21.15.83:0/2064515813 >> [v2:172.21.15.83:6800/1644397953,v1:172.21.15.83:6801/1644397953] conn(0x7f87a8038750 0x7f87a803ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:48:59.684 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:57.436+0000 7f87af7fe700 1 -- 172.21.15.83:0/2064515813 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f87b004cdc0 con 0x7f87c0107010 2024-04-01T06:48:59.684 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:57.437+0000 7f87bdd9b700 1 --2- 172.21.15.83:0/2064515813 >> [v2:172.21.15.83:6800/1644397953,v1:172.21.15.83:6801/1644397953] conn(0x7f87a8038750 0x7f87a803ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:48:59.684 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:57.437+0000 7f87bdd9b700 1 --2- 172.21.15.83:0/2064515813 >> [v2:172.21.15.83:6800/1644397953,v1:172.21.15.83:6801/1644397953] conn(0x7f87a8038750 0x7f87a803ac10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f87b4006fd0 tx=0x7f87b4006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:48:59.684 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:57.441+0000 7f87af7fe700 1 -- 172.21.15.83:0/2064515813 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f87b0023370 con 0x7f87c0107010 2024-04-01T06:48:59.684 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:57.722+0000 7f87c4eec700 1 -- 172.21.15.83:0/2064515813 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f87c019f900 con 0x7f87c0107010 2024-04-01T06:48:59.685 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:57.723+0000 7f87af7fe700 1 -- 172.21.15.83:0/2064515813 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f87b002a030 con 0x7f87c0107010 2024-04-01T06:48:59.685 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:57.726+0000 7f87c4eec700 1 -- 172.21.15.83:0/2064515813 >> [v2:172.21.15.83:6800/1644397953,v1:172.21.15.83:6801/1644397953] conn(0x7f87a8038750 msgr2=0x7f87a803ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:48:59.685 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:57.726+0000 7f87c4eec700 1 --2- 172.21.15.83:0/2064515813 >> [v2:172.21.15.83:6800/1644397953,v1:172.21.15.83:6801/1644397953] conn(0x7f87a8038750 0x7f87a803ac10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f87b4006fd0 tx=0x7f87b4006e40 comp rx=0 tx=0).stop 2024-04-01T06:48:59.685 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:57.727+0000 7f87c4eec700 1 -- 172.21.15.83:0/2064515813 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87c0107010 msgr2=0x7f87c019c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:48:59.685 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:57.727+0000 7f87c4eec700 1 --2- 172.21.15.83:0/2064515813 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87c0107010 0x7f87c019c490 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f87b0009130 tx=0x7f87b0011ad0 comp rx=0 tx=0).stop 2024-04-01T06:48:59.685 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:57.727+0000 7f87c4eec700 1 -- 172.21.15.83:0/2064515813 shutdown_connections 2024-04-01T06:48:59.685 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:57.727+0000 7f87c4eec700 1 --2- 172.21.15.83:0/2064515813 >> [v2:172.21.15.83:6800/1644397953,v1:172.21.15.83:6801/1644397953] conn(0x7f87a8038750 0x7f87a803ac10 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:48:59.685 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:57.727+0000 7f87c4eec700 1 --2- 172.21.15.83:0/2064515813 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87c0107010 0x7f87c019c490 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:48:59.685 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:57.727+0000 7f87c4eec700 1 -- 172.21.15.83:0/2064515813 >> 172.21.15.83:0/2064515813 conn(0x7f87c0100a00 msgr2=0x7f87c0101520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:48:59.685 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:57.727+0000 7f87c4eec700 1 -- 172.21.15.83:0/2064515813 shutdown_connections 2024-04-01T06:48:59.685 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:48:57.727+0000 7f87c4eec700 1 -- 172.21.15.83:0/2064515813 wait complete. 2024-04-01T06:48:59.685 INFO:teuthology.orchestra.run.smithi083.stdout:mgr is available 2024-04-01T06:49:02.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:01 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/1113784555' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-01T06:49:03.778 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout 2024-04-01T06:49:03.778 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout [global] 2024-04-01T06:49:03.778 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout fsid = c6f8eff4-eff3-11ee-b647-cb9ed24678a4 2024-04-01T06:49:03.778 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-01T06:49:03.778 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-01T06:49:03.778 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-01T06:49:03.778 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-01T06:49:03.779 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout 2024-04-01T06:49:03.779 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-01T06:49:03.779 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-01T06:49:03.779 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout 2024-04-01T06:49:03.779 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout [osd] 2024-04-01T06:49:03.779 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-01T06:49:03.779 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-01T06:49:03.779 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-01T06:49:03.779 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-01T06:49:03.779 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-01T06:49:03.779 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:01.049+0000 7f9caa478700 1 Processor -- start 2024-04-01T06:49:03.779 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:01.050+0000 7f9caa478700 1 -- start start 2024-04-01T06:49:03.779 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:01.050+0000 7f9caa478700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ca41070d0 0x7f9ca41094c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:03.779 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:01.050+0000 7f9caa478700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca4079dd0 con 0x7f9ca41070d0 2024-04-01T06:49:03.779 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:01.050+0000 7f9ca3fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ca41070d0 0x7f9ca41094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:03.780 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:01.050+0000 7f9ca3fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ca41070d0 0x7f9ca41094c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55938/0 (socket says 172.21.15.83:55938) 2024-04-01T06:49:03.780 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:01.050+0000 7f9ca3fff700 1 -- 172.21.15.83:0/192261932 learned_addr learned my addr 172.21.15.83:0/192261932 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:49:03.780 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:01.050+0000 7f9ca3fff700 1 -- 172.21.15.83:0/192261932 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca4079f10 con 0x7f9ca41070d0 2024-04-01T06:49:03.780 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:01.050+0000 7f9ca3fff700 1 --2- 172.21.15.83:0/192261932 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ca41070d0 0x7f9ca41094c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9c940098a0 tx=0x7f9c94009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=331a0d499a552b76 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:03.780 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:01.051+0000 7f9ca2ffd700 1 -- 172.21.15.83:0/192261932 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c94004160 con 0x7f9ca41070d0 2024-04-01T06:49:03.780 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:01.051+0000 7f9ca2ffd700 1 -- 172.21.15.83:0/192261932 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9c940042c0 con 0x7f9ca41070d0 2024-04-01T06:49:03.780 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:01.051+0000 7f9ca2ffd700 1 -- 172.21.15.83:0/192261932 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c94011a00 con 0x7f9ca41070d0 2024-04-01T06:49:03.780 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:01.051+0000 7f9caa478700 1 -- 172.21.15.83:0/192261932 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ca41070d0 msgr2=0x7f9ca41094c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:03.780 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:01.051+0000 7f9caa478700 1 --2- 172.21.15.83:0/192261932 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ca41070d0 0x7f9ca41094c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9c940098a0 tx=0x7f9c94009bb0 comp rx=0 tx=0).stop 2024-04-01T06:49:03.780 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:01.052+0000 7f9caa478700 1 -- 172.21.15.83:0/192261932 shutdown_connections 2024-04-01T06:49:03.780 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:01.052+0000 7f9caa478700 1 --2- 172.21.15.83:0/192261932 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ca41070d0 0x7f9ca41094c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:03.780 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:01.052+0000 7f9caa478700 1 -- 172.21.15.83:0/192261932 >> 172.21.15.83:0/192261932 conn(0x7f9ca4100a40 msgr2=0x7f9ca4102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:49:03.780 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:01.052+0000 7f9caa478700 1 -- 172.21.15.83:0/192261932 shutdown_connections 2024-04-01T06:49:03.780 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:01.052+0000 7f9caa478700 1 -- 172.21.15.83:0/192261932 wait complete. 2024-04-01T06:49:03.781 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:01.052+0000 7f9caa478700 1 Processor -- start 2024-04-01T06:49:03.781 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:01.053+0000 7f9caa478700 1 -- start start 2024-04-01T06:49:03.781 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:01.053+0000 7f9caa478700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ca41070d0 0x7f9ca419a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:03.781 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:01.053+0000 7f9caa478700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca419a7b0 con 0x7f9ca41070d0 2024-04-01T06:49:03.781 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:01.053+0000 7f9ca3fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ca41070d0 0x7f9ca419a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:03.781 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:01.053+0000 7f9ca3fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ca41070d0 0x7f9ca419a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55952/0 (socket says 172.21.15.83:55952) 2024-04-01T06:49:03.781 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:01.053+0000 7f9ca3fff700 1 -- 172.21.15.83:0/1113784555 learned_addr learned my addr 172.21.15.83:0/1113784555 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:49:03.781 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:01.053+0000 7f9ca3fff700 1 -- 172.21.15.83:0/1113784555 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c94009550 con 0x7f9ca41070d0 2024-04-01T06:49:03.781 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:01.053+0000 7f9ca3fff700 1 --2- 172.21.15.83:0/1113784555 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ca41070d0 0x7f9ca419a270 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9c94009fb0 tx=0x7f9c94011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:03.781 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:01.054+0000 7f9ca17fa700 1 -- 172.21.15.83:0/1113784555 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c94003a40 con 0x7f9ca41070d0 2024-04-01T06:49:03.781 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:01.054+0000 7f9caa478700 1 -- 172.21.15.83:0/1113784555 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ca419a9b0 con 0x7f9ca41070d0 2024-04-01T06:49:03.781 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:01.054+0000 7f9ca17fa700 1 -- 172.21.15.83:0/1113784555 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9c94003ba0 con 0x7f9ca41070d0 2024-04-01T06:49:03.781 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:01.054+0000 7f9ca17fa700 1 -- 172.21.15.83:0/1113784555 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c9401a750 con 0x7f9ca41070d0 2024-04-01T06:49:03.781 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:01.054+0000 7f9caa478700 1 -- 172.21.15.83:0/1113784555 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ca419ae50 con 0x7f9ca41070d0 2024-04-01T06:49:03.781 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:01.054+0000 7f9ca17fa700 1 -- 172.21.15.83:0/1113784555 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 4) v1 ==== 45522+0+0 (secure 0 0 0) 0x7f9c9401a9d0 con 0x7f9ca41070d0 2024-04-01T06:49:03.782 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:01.055+0000 7f9ca17fa700 1 --2- 172.21.15.83:0/1113784555 >> [v2:172.21.15.83:6800/1644397953,v1:172.21.15.83:6801/1644397953] conn(0x7f9c8c038660 0x7f9c8c03ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:03.782 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:01.055+0000 7f9ca17fa700 1 -- 172.21.15.83:0/1113784555 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f9c9404c3f0 con 0x7f9ca41070d0 2024-04-01T06:49:03.782 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:01.055+0000 7f9ca37fe700 1 --2- 172.21.15.83:0/1113784555 >> [v2:172.21.15.83:6800/1644397953,v1:172.21.15.83:6801/1644397953] conn(0x7f9c8c038660 0x7f9c8c03ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:03.782 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:01.055+0000 7f9caa478700 1 -- 172.21.15.83:0/1113784555 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ca40623e0 con 0x7f9ca41070d0 2024-04-01T06:49:03.782 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:01.055+0000 7f9ca37fe700 1 --2- 172.21.15.83:0/1113784555 >> [v2:172.21.15.83:6800/1644397953,v1:172.21.15.83:6801/1644397953] conn(0x7f9c8c038660 0x7f9c8c03ab20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9c98006fd0 tx=0x7f9c98006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:03.782 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:01.060+0000 7f9ca17fa700 1 -- 172.21.15.83:0/1113784555 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f9c94018db0 con 0x7f9ca41070d0 2024-04-01T06:49:03.782 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:01.262+0000 7f9caa478700 1 -- 172.21.15.83:0/1113784555 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f9ca410a730 con 0x7f9ca41070d0 2024-04-01T06:49:03.782 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:01.263+0000 7f9ca17fa700 1 -- 172.21.15.83:0/1113784555 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f9c94018350 con 0x7f9ca41070d0 2024-04-01T06:49:03.782 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:01.265+0000 7f9caa478700 1 -- 172.21.15.83:0/1113784555 >> [v2:172.21.15.83:6800/1644397953,v1:172.21.15.83:6801/1644397953] conn(0x7f9c8c038660 msgr2=0x7f9c8c03ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:03.782 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:01.265+0000 7f9caa478700 1 --2- 172.21.15.83:0/1113784555 >> [v2:172.21.15.83:6800/1644397953,v1:172.21.15.83:6801/1644397953] conn(0x7f9c8c038660 0x7f9c8c03ab20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9c98006fd0 tx=0x7f9c98006e40 comp rx=0 tx=0).stop 2024-04-01T06:49:03.782 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:01.265+0000 7f9caa478700 1 -- 172.21.15.83:0/1113784555 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ca41070d0 msgr2=0x7f9ca419a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:03.782 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:01.265+0000 7f9caa478700 1 --2- 172.21.15.83:0/1113784555 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ca41070d0 0x7f9ca419a270 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9c94009fb0 tx=0x7f9c94011ad0 comp rx=0 tx=0).stop 2024-04-01T06:49:03.783 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:01.265+0000 7f9caa478700 1 -- 172.21.15.83:0/1113784555 shutdown_connections 2024-04-01T06:49:03.783 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:01.265+0000 7f9caa478700 1 --2- 172.21.15.83:0/1113784555 >> [v2:172.21.15.83:6800/1644397953,v1:172.21.15.83:6801/1644397953] conn(0x7f9c8c038660 0x7f9c8c03ab20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:03.783 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:01.265+0000 7f9caa478700 1 --2- 172.21.15.83:0/1113784555 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ca41070d0 0x7f9ca419a270 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:03.783 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:01.265+0000 7f9caa478700 1 -- 172.21.15.83:0/1113784555 >> 172.21.15.83:0/1113784555 conn(0x7f9ca4100a40 msgr2=0x7f9ca4101510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:49:03.783 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:01.265+0000 7f9caa478700 1 -- 172.21.15.83:0/1113784555 shutdown_connections 2024-04-01T06:49:03.783 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:01.265+0000 7f9caa478700 1 -- 172.21.15.83:0/1113784555 wait complete. 2024-04-01T06:49:03.783 INFO:teuthology.orchestra.run.smithi083.stdout:Enabling cephadm module... 2024-04-01T06:49:06.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:06 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/2390360473' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-04-01T06:49:06.763 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:06 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: ignoring --setuser ceph since I am not root 2024-04-01T06:49:06.763 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:06 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: ignoring --setgroup ceph since I am not root 2024-04-01T06:49:07.335 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:07 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:49:07.064+0000 7fda3b62c200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-01T06:49:07.335 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:07 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:49:07.159+0000 7fda3b62c200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-01T06:49:07.335 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:07 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:49:07.249+0000 7fda3b62c200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-01T06:49:07.335 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:07 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:49:07.336+0000 7fda3b62c200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-01T06:49:07.980 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:07 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/2390360473' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-04-01T06:49:07.980 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:07 smithi083 ceph-mon[43429]: mgrmap e5: x(active, since 11s) 2024-04-01T06:49:08.239 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:07 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:49:07.981+0000 7fda3b62c200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-01T06:49:08.343 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:05.349+0000 7fbbc788b700 1 Processor -- start 2024-04-01T06:49:08.343 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:05.349+0000 7fbbc788b700 1 -- start start 2024-04-01T06:49:08.343 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:05.349+0000 7fbbc788b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbbc0107000 0x7fbbc01093f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:08.343 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:05.349+0000 7fbbc788b700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc0079e50 con 0x7fbbc0107000 2024-04-01T06:49:08.343 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:05.350+0000 7fbbc5627700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbbc0107000 0x7fbbc01093f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:08.343 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:05.350+0000 7fbbc5627700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbbc0107000 0x7fbbc01093f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:32832/0 (socket says 172.21.15.83:32832) 2024-04-01T06:49:08.343 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:05.350+0000 7fbbc5627700 1 -- 172.21.15.83:0/2245029632 learned_addr learned my addr 172.21.15.83:0/2245029632 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:49:08.344 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:05.350+0000 7fbbc5627700 1 -- 172.21.15.83:0/2245029632 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc0109930 con 0x7fbbc0107000 2024-04-01T06:49:08.344 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:05.350+0000 7fbbc5627700 1 --2- 172.21.15.83:0/2245029632 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbbc0107000 0x7fbbc01093f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc0098a0 tx=0x7fbbbc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ad811ea73a1e320 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:08.344 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:05.350+0000 7fbbb7fff700 1 -- 172.21.15.83:0/2245029632 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbbbc004160 con 0x7fbbc0107000 2024-04-01T06:49:08.344 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:05.350+0000 7fbbb7fff700 1 -- 172.21.15.83:0/2245029632 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbbbc0042c0 con 0x7fbbc0107000 2024-04-01T06:49:08.344 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:05.350+0000 7fbbb7fff700 1 -- 172.21.15.83:0/2245029632 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbbbc011a00 con 0x7fbbc0107000 2024-04-01T06:49:08.344 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:05.351+0000 7fbbc788b700 1 -- 172.21.15.83:0/2245029632 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbbc0107000 msgr2=0x7fbbc01093f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:08.344 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:05.351+0000 7fbbc788b700 1 --2- 172.21.15.83:0/2245029632 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbbc0107000 0x7fbbc01093f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc0098a0 tx=0x7fbbbc009bb0 comp rx=0 tx=0).stop 2024-04-01T06:49:08.345 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:05.351+0000 7fbbc788b700 1 -- 172.21.15.83:0/2245029632 shutdown_connections 2024-04-01T06:49:08.345 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:05.351+0000 7fbbc788b700 1 --2- 172.21.15.83:0/2245029632 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbbc0107000 0x7fbbc01093f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:08.345 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:05.351+0000 7fbbc788b700 1 -- 172.21.15.83:0/2245029632 >> 172.21.15.83:0/2245029632 conn(0x7fbbc01009f0 msgr2=0x7fbbc0102e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:49:08.345 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:05.351+0000 7fbbc788b700 1 -- 172.21.15.83:0/2245029632 shutdown_connections 2024-04-01T06:49:08.345 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:05.351+0000 7fbbc788b700 1 -- 172.21.15.83:0/2245029632 wait complete. 2024-04-01T06:49:08.345 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:05.351+0000 7fbbc788b700 1 Processor -- start 2024-04-01T06:49:08.345 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:05.351+0000 7fbbc788b700 1 -- start start 2024-04-01T06:49:08.345 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:05.351+0000 7fbbc788b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbbc0107000 0x7fbbc0106830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:08.345 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:05.352+0000 7fbbc788b700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc0106d70 con 0x7fbbc0107000 2024-04-01T06:49:08.345 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:05.352+0000 7fbbc5627700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbbc0107000 0x7fbbc0106830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:08.345 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:05.352+0000 7fbbc5627700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbbc0107000 0x7fbbc0106830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:32840/0 (socket says 172.21.15.83:32840) 2024-04-01T06:49:08.345 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:05.352+0000 7fbbc5627700 1 -- 172.21.15.83:0/2390360473 learned_addr learned my addr 172.21.15.83:0/2390360473 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:49:08.346 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:05.352+0000 7fbbc5627700 1 -- 172.21.15.83:0/2390360473 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbbc009550 con 0x7fbbc0107000 2024-04-01T06:49:08.346 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:05.352+0000 7fbbc5627700 1 --2- 172.21.15.83:0/2390360473 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbbc0107000 0x7fbbc0106830 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc009fb0 tx=0x7fbbbc011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:08.346 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:05.352+0000 7fbbb67fc700 1 -- 172.21.15.83:0/2390360473 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbbbc003a40 con 0x7fbbc0107000 2024-04-01T06:49:08.346 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:05.352+0000 7fbbc788b700 1 -- 172.21.15.83:0/2390360473 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbc0104fb0 con 0x7fbbc0107000 2024-04-01T06:49:08.346 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:05.352+0000 7fbbb67fc700 1 -- 172.21.15.83:0/2390360473 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbbbc003ba0 con 0x7fbbc0107000 2024-04-01T06:49:08.346 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:05.352+0000 7fbbb67fc700 1 -- 172.21.15.83:0/2390360473 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbbbc01a750 con 0x7fbbc0107000 2024-04-01T06:49:08.346 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:05.352+0000 7fbbc788b700 1 -- 172.21.15.83:0/2390360473 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbc0105450 con 0x7fbbc0107000 2024-04-01T06:49:08.346 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:05.353+0000 7fbbc788b700 1 -- 172.21.15.83:0/2390360473 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbc010a6d0 con 0x7fbbc0107000 2024-04-01T06:49:08.346 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:05.354+0000 7fbbb67fc700 1 -- 172.21.15.83:0/2390360473 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 4) v1 ==== 45522+0+0 (secure 0 0 0) 0x7fbbbc024b60 con 0x7fbbc0107000 2024-04-01T06:49:08.346 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:05.354+0000 7fbbb67fc700 1 --2- 172.21.15.83:0/2390360473 >> [v2:172.21.15.83:6800/1644397953,v1:172.21.15.83:6801/1644397953] conn(0x7fbbac038660 0x7fbbac03ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:08.346 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:05.354+0000 7fbbb67fc700 1 -- 172.21.15.83:0/2390360473 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fbbbc04c730 con 0x7fbbc0107000 2024-04-01T06:49:08.346 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:05.354+0000 7fbbc4e26700 1 --2- 172.21.15.83:0/2390360473 >> [v2:172.21.15.83:6800/1644397953,v1:172.21.15.83:6801/1644397953] conn(0x7fbbac038660 0x7fbbac03ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:08.347 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:05.355+0000 7fbbc4e26700 1 --2- 172.21.15.83:0/2390360473 >> [v2:172.21.15.83:6800/1644397953,v1:172.21.15.83:6801/1644397953] conn(0x7fbbac038660 0x7fbbac03ab20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0006fd0 tx=0x7fbbb0006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:08.347 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:05.359+0000 7fbbb67fc700 1 -- 172.21.15.83:0/2390360473 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7fbbbc023390 con 0x7fbbc0107000 2024-04-01T06:49:08.347 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:05.607+0000 7fbbc788b700 1 -- 172.21.15.83:0/2390360473 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7fbbc010a910 con 0x7fbbc0107000 2024-04-01T06:49:08.347 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:06.605+0000 7fbbb67fc700 1 -- 172.21.15.83:0/2390360473 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mgrmap(e 5) v1 ==== 45533+0+0 (secure 0 0 0) 0x7fbbbc04b8b0 con 0x7fbbc0107000 2024-04-01T06:49:08.347 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:06.607+0000 7fbbb67fc700 1 -- 172.21.15.83:0/2390360473 <== mon.0 v2:172.21.15.83:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7fbbbc04bc30 con 0x7fbbc0107000 2024-04-01T06:49:08.347 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:06.610+0000 7fbbc788b700 1 -- 172.21.15.83:0/2390360473 >> [v2:172.21.15.83:6800/1644397953,v1:172.21.15.83:6801/1644397953] conn(0x7fbbac038660 msgr2=0x7fbbac03ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:08.347 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:06.610+0000 7fbbc788b700 1 --2- 172.21.15.83:0/2390360473 >> [v2:172.21.15.83:6800/1644397953,v1:172.21.15.83:6801/1644397953] conn(0x7fbbac038660 0x7fbbac03ab20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0006fd0 tx=0x7fbbb0006e40 comp rx=0 tx=0).stop 2024-04-01T06:49:08.347 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:06.610+0000 7fbbc788b700 1 -- 172.21.15.83:0/2390360473 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbbc0107000 msgr2=0x7fbbc0106830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:08.348 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:06.610+0000 7fbbc788b700 1 --2- 172.21.15.83:0/2390360473 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbbc0107000 0x7fbbc0106830 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc009fb0 tx=0x7fbbbc011ad0 comp rx=0 tx=0).stop 2024-04-01T06:49:08.348 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:06.610+0000 7fbbc788b700 1 -- 172.21.15.83:0/2390360473 shutdown_connections 2024-04-01T06:49:08.348 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:06.610+0000 7fbbc788b700 1 --2- 172.21.15.83:0/2390360473 >> [v2:172.21.15.83:6800/1644397953,v1:172.21.15.83:6801/1644397953] conn(0x7fbbac038660 0x7fbbac03ab20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:08.348 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:06.610+0000 7fbbc788b700 1 --2- 172.21.15.83:0/2390360473 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbbc0107000 0x7fbbc0106830 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:08.348 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:06.610+0000 7fbbc788b700 1 -- 172.21.15.83:0/2390360473 >> 172.21.15.83:0/2390360473 conn(0x7fbbc01009f0 msgr2=0x7fbbc0101520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:49:08.348 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:06.610+0000 7fbbc788b700 1 -- 172.21.15.83:0/2390360473 shutdown_connections 2024-04-01T06:49:08.348 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:06.610+0000 7fbbc788b700 1 -- 172.21.15.83:0/2390360473 wait complete. 2024-04-01T06:49:08.512 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:08 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:49:08.239+0000 7fda3b62c200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-01T06:49:08.512 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:08 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:49:08.327+0000 7fda3b62c200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-01T06:49:08.512 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:08 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:49:08.460+0000 7fda3b62c200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-01T06:49:08.978 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:08 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:49:08.626+0000 7fda3b62c200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-01T06:49:08.978 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:08 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:49:08.759+0000 7fda3b62c200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-01T06:49:08.978 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:08 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:49:08.847+0000 7fda3b62c200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-01T06:49:09.243 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:09 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/1781738435' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-01T06:49:09.350 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout { 2024-04-01T06:49:09.350 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-04-01T06:49:09.350 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-01T06:49:09.350 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-04-01T06:49:09.350 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-01T06:49:09.351 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout } 2024-04-01T06:49:09.351 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:08.688+0000 7f421aa18700 1 Processor -- start 2024-04-01T06:49:09.351 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:08.688+0000 7f421aa18700 1 -- start start 2024-04-01T06:49:09.351 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:08.688+0000 7f421aa18700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4214105980 0x7f4214105da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:09.351 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:08.688+0000 7f421aa18700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4214106370 con 0x7f4214105980 2024-04-01T06:49:09.351 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:08.689+0000 7f4213fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4214105980 0x7f4214105da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:09.351 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:08.689+0000 7f4213fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4214105980 0x7f4214105da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:32862/0 (socket says 172.21.15.83:32862) 2024-04-01T06:49:09.351 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:08.689+0000 7f4213fff700 1 -- 172.21.15.83:0/922624455 learned_addr learned my addr 172.21.15.83:0/922624455 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:49:09.351 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:08.689+0000 7f4213fff700 1 -- 172.21.15.83:0/922624455 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42141066a0 con 0x7f4214105980 2024-04-01T06:49:09.351 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:08.689+0000 7f4213fff700 1 --2- 172.21.15.83:0/922624455 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4214105980 0x7f4214105da0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f420400bb40 tx=0x7f420400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=347f912ef42bbdbc server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:09.351 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:08.689+0000 7f4212ffd700 1 -- 172.21.15.83:0/922624455 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f420400dbe0 con 0x7f4214105980 2024-04-01T06:49:09.352 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:08.689+0000 7f4212ffd700 1 -- 172.21.15.83:0/922624455 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f42040044d0 con 0x7f4214105980 2024-04-01T06:49:09.352 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:08.689+0000 7f4212ffd700 1 -- 172.21.15.83:0/922624455 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4204010470 con 0x7f4214105980 2024-04-01T06:49:09.352 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:08.690+0000 7f421aa18700 1 -- 172.21.15.83:0/922624455 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4214105980 msgr2=0x7f4214105da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:09.352 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:08.690+0000 7f421aa18700 1 --2- 172.21.15.83:0/922624455 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4214105980 0x7f4214105da0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f420400bb40 tx=0x7f420400be50 comp rx=0 tx=0).stop 2024-04-01T06:49:09.352 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:08.690+0000 7f421aa18700 1 -- 172.21.15.83:0/922624455 shutdown_connections 2024-04-01T06:49:09.352 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:08.690+0000 7f421aa18700 1 --2- 172.21.15.83:0/922624455 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4214105980 0x7f4214105da0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:09.352 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:08.690+0000 7f421aa18700 1 -- 172.21.15.83:0/922624455 >> 172.21.15.83:0/922624455 conn(0x7f42141001a0 msgr2=0x7f42141025e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:49:09.352 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:08.690+0000 7f421aa18700 1 -- 172.21.15.83:0/922624455 shutdown_connections 2024-04-01T06:49:09.352 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:08.690+0000 7f421aa18700 1 -- 172.21.15.83:0/922624455 wait complete. 2024-04-01T06:49:09.352 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:08.691+0000 7f421aa18700 1 Processor -- start 2024-04-01T06:49:09.352 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:08.691+0000 7f421aa18700 1 -- start start 2024-04-01T06:49:09.352 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:08.691+0000 7f421aa18700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4214105980 0x7f4214198080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:09.352 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:08.691+0000 7f421aa18700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42141985c0 con 0x7f4214105980 2024-04-01T06:49:09.352 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:08.691+0000 7f4213fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4214105980 0x7f4214198080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:09.353 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:08.691+0000 7f4213fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4214105980 0x7f4214198080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:32878/0 (socket says 172.21.15.83:32878) 2024-04-01T06:49:09.353 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:08.691+0000 7f4213fff700 1 -- 172.21.15.83:0/1781738435 learned_addr learned my addr 172.21.15.83:0/1781738435 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:49:09.353 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:08.692+0000 7f4213fff700 1 -- 172.21.15.83:0/1781738435 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f420400b7f0 con 0x7f4214105980 2024-04-01T06:49:09.353 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:08.692+0000 7f4213fff700 1 --2- 172.21.15.83:0/1781738435 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4214105980 0x7f4214198080 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4204003c60 tx=0x7f4204003980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:09.353 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:08.692+0000 7f42117fa700 1 -- 172.21.15.83:0/1781738435 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f420401e070 con 0x7f4214105980 2024-04-01T06:49:09.353 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:08.692+0000 7f42117fa700 1 -- 172.21.15.83:0/1781738435 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4204004300 con 0x7f4214105980 2024-04-01T06:49:09.353 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:08.692+0000 7f42117fa700 1 -- 172.21.15.83:0/1781738435 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4204022ac0 con 0x7f4214105980 2024-04-01T06:49:09.353 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:08.692+0000 7f421aa18700 1 -- 172.21.15.83:0/1781738435 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42141987c0 con 0x7f4214105980 2024-04-01T06:49:09.353 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:08.692+0000 7f421aa18700 1 -- 172.21.15.83:0/1781738435 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4214198c60 con 0x7f4214105980 2024-04-01T06:49:09.353 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:08.693+0000 7f42117fa700 1 -- 172.21.15.83:0/1781738435 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) v1 ==== 45533+0+0 (secure 0 0 0) 0x7f420402c440 con 0x7f4214105980 2024-04-01T06:49:09.353 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:08.693+0000 7f42117fa700 1 --2- 172.21.15.83:0/1781738435 >> [v2:172.21.15.83:6800/1644397953,v1:172.21.15.83:6801/1644397953] conn(0x7f41fc038750 0x7f41fc03ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:09.353 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:08.693+0000 7f42117fa700 1 -- 172.21.15.83:0/1781738435 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f420404fa20 con 0x7f4214105980 2024-04-01T06:49:09.353 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:08.693+0000 7f42137fe700 1 -- 172.21.15.83:0/1781738435 >> [v2:172.21.15.83:6800/1644397953,v1:172.21.15.83:6801/1644397953] conn(0x7f41fc038750 msgr2=0x7f41fc03ac10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.83:6800/1644397953 2024-04-01T06:49:09.354 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:08.693+0000 7f42137fe700 1 --2- 172.21.15.83:0/1781738435 >> [v2:172.21.15.83:6800/1644397953,v1:172.21.15.83:6801/1644397953] conn(0x7f41fc038750 0x7f41fc03ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-01T06:49:09.354 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:08.693+0000 7f421aa18700 1 -- 172.21.15.83:0/1781738435 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42140623e0 con 0x7f4214105980 2024-04-01T06:49:09.354 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:08.698+0000 7f42117fa700 1 -- 172.21.15.83:0/1781738435 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f4204027030 con 0x7f4214105980 2024-04-01T06:49:09.354 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:08.894+0000 7f42137fe700 1 -- 172.21.15.83:0/1781738435 >> [v2:172.21.15.83:6800/1644397953,v1:172.21.15.83:6801/1644397953] conn(0x7f41fc038750 msgr2=0x7f41fc03ac10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.83:6800/1644397953 2024-04-01T06:49:09.354 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:08.894+0000 7f42137fe700 1 --2- 172.21.15.83:0/1781738435 >> [v2:172.21.15.83:6800/1644397953,v1:172.21.15.83:6801/1644397953] conn(0x7f41fc038750 0x7f41fc03ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-01T06:49:09.354 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:08.952+0000 7f421aa18700 1 -- 172.21.15.83:0/1781738435 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f42141917c0 con 0x7f4214105980 2024-04-01T06:49:09.354 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:08.952+0000 7f42117fa700 1 -- 172.21.15.83:0/1781738435 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+88 (secure 0 0 0) 0x7f420404d070 con 0x7f4214105980 2024-04-01T06:49:09.354 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:08.954+0000 7f421aa18700 1 -- 172.21.15.83:0/1781738435 >> [v2:172.21.15.83:6800/1644397953,v1:172.21.15.83:6801/1644397953] conn(0x7f41fc038750 msgr2=0x7f41fc03ac10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-01T06:49:09.354 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:08.954+0000 7f421aa18700 1 --2- 172.21.15.83:0/1781738435 >> [v2:172.21.15.83:6800/1644397953,v1:172.21.15.83:6801/1644397953] conn(0x7f41fc038750 0x7f41fc03ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:09.354 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:08.954+0000 7f421aa18700 1 -- 172.21.15.83:0/1781738435 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4214105980 msgr2=0x7f4214198080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:09.354 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:08.954+0000 7f421aa18700 1 --2- 172.21.15.83:0/1781738435 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4214105980 0x7f4214198080 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4204003c60 tx=0x7f4204003980 comp rx=0 tx=0).stop 2024-04-01T06:49:09.355 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:08.955+0000 7f421aa18700 1 -- 172.21.15.83:0/1781738435 shutdown_connections 2024-04-01T06:49:09.355 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:08.955+0000 7f421aa18700 1 --2- 172.21.15.83:0/1781738435 >> [v2:172.21.15.83:6800/1644397953,v1:172.21.15.83:6801/1644397953] conn(0x7f41fc038750 0x7f41fc03ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:09.355 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:08.955+0000 7f421aa18700 1 --2- 172.21.15.83:0/1781738435 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4214105980 0x7f4214198080 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:09.355 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:08.955+0000 7f421aa18700 1 -- 172.21.15.83:0/1781738435 >> 172.21.15.83:0/1781738435 conn(0x7f42141001a0 msgr2=0x7f421418e880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:49:09.355 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:08.955+0000 7f421aa18700 1 -- 172.21.15.83:0/1781738435 shutdown_connections 2024-04-01T06:49:09.355 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:08.955+0000 7f421aa18700 1 -- 172.21.15.83:0/1781738435 wait complete. 2024-04-01T06:49:09.355 INFO:teuthology.orchestra.run.smithi083.stdout:Waiting for the mgr to restart... 2024-04-01T06:49:09.355 INFO:teuthology.orchestra.run.smithi083.stdout:Waiting for mgr epoch 5... 2024-04-01T06:49:09.503 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:09 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:49:09.243+0000 7fda3b62c200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-01T06:49:09.946 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:09 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:49:09.654+0000 7fda3b62c200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-01T06:49:09.947 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:09 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:49:09.853+0000 7fda3b62c200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-01T06:49:10.262 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:09 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:49:09.947+0000 7fda3b62c200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-01T06:49:11.012 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:10 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:49:10.721+0000 7fda3b62c200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-01T06:49:11.012 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:10 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:49:10.818+0000 7fda3b62c200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-01T06:49:11.012 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:10 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:49:10.968+0000 7fda3b62c200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-01T06:49:11.762 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:11 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:49:11.594+0000 7fda3b62c200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-01T06:49:12.262 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:11 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:49:11.773+0000 7fda3b62c200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-01T06:49:12.262 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:11 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:49:11.964+0000 7fda3b62c200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-01T06:49:13.165 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:12 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:49:12.882+0000 7fda3b62c200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-01T06:49:13.441 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:13 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:49:13.165+0000 7fda3b62c200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-01T06:49:13.441 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:13 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:49:13.253+0000 7fda3b62c200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-01T06:49:13.762 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:13 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:49:13.442+0000 7fda3b62c200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-01T06:49:13.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:13 smithi083 ceph-mon[43429]: Active manager daemon x restarted 2024-04-01T06:49:13.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:13 smithi083 ceph-mon[43429]: Activating manager daemon x 2024-04-01T06:49:13.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:13 smithi083 ceph-mon[43429]: osdmap e2: 0 total, 0 up, 0 in 2024-04-01T06:49:13.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:13 smithi083 ceph-mon[43429]: mgrmap e6: x(active, starting, since 0.00339396s) 2024-04-01T06:49:13.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:13 smithi083 ceph-mon[43429]: from='mgr.14120 172.21.15.83:0/2619006165' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T06:49:13.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:13 smithi083 ceph-mon[43429]: from='mgr.14120 172.21.15.83:0/2619006165' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-01T06:49:13.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:13 smithi083 ceph-mon[43429]: from='mgr.14120 172.21.15.83:0/2619006165' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-01T06:49:13.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:13 smithi083 ceph-mon[43429]: from='mgr.14120 172.21.15.83:0/2619006165' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-01T06:49:13.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:13 smithi083 ceph-mon[43429]: from='mgr.14120 172.21.15.83:0/2619006165' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-01T06:49:13.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:13 smithi083 ceph-mon[43429]: Manager daemon x is now available 2024-04-01T06:49:13.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:13 smithi083 ceph-mon[43429]: from='mgr.14120 172.21.15.83:0/2619006165' entity='mgr.x' 2024-04-01T06:49:13.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:13 smithi083 ceph-mon[43429]: from='mgr.14120 172.21.15.83:0/2619006165' entity='mgr.x' 2024-04-01T06:49:13.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:13 smithi083 ceph-mon[43429]: from='mgr.14120 172.21.15.83:0/2619006165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:49:13.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:13 smithi083 ceph-mon[43429]: from='mgr.14120 172.21.15.83:0/2619006165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:49:14.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:14 smithi083 ceph-mon[43429]: Found migration_current of "None". Setting to last migration. 2024-04-01T06:49:14.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:14 smithi083 ceph-mon[43429]: from='mgr.14120 172.21.15.83:0/2619006165' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-01T06:49:14.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:14 smithi083 ceph-mon[43429]: from='mgr.14120 172.21.15.83:0/2619006165' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-01T06:49:14.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:14 smithi083 ceph-mon[43429]: from='mgr.14120 172.21.15.83:0/2619006165' entity='mgr.x' 2024-04-01T06:49:14.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:14 smithi083 ceph-mon[43429]: from='mgr.14120 172.21.15.83:0/2619006165' entity='mgr.x' 2024-04-01T06:49:14.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:14 smithi083 ceph-mon[43429]: mgrmap e7: x(active, since 1.0056s) 2024-04-01T06:49:14.835 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout { 2024-04-01T06:49:14.842 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-04-01T06:49:14.843 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-01T06:49:14.843 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout } 2024-04-01T06:49:14.843 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:09.689+0000 7f6b1000b700 1 Processor -- start 2024-04-01T06:49:14.843 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:09.690+0000 7f6b1000b700 1 -- start start 2024-04-01T06:49:14.843 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:09.690+0000 7f6b1000b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6b08105470 0x7f6b08105890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:14.843 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:09.690+0000 7f6b1000b700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b08105e60 con 0x7f6b08105470 2024-04-01T06:49:14.843 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:09.690+0000 7f6b0dda7700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6b08105470 0x7f6b08105890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:14.843 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:09.690+0000 7f6b0dda7700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6b08105470 0x7f6b08105890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:32884/0 (socket says 172.21.15.83:32884) 2024-04-01T06:49:14.843 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:09.690+0000 7f6b0dda7700 1 -- 172.21.15.83:0/4090312077 learned_addr learned my addr 172.21.15.83:0/4090312077 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:49:14.843 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:09.691+0000 7f6b0dda7700 1 -- 172.21.15.83:0/4090312077 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b08106670 con 0x7f6b08105470 2024-04-01T06:49:14.844 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:09.691+0000 7f6b0dda7700 1 --2- 172.21.15.83:0/4090312077 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6b08105470 0x7f6b08105890 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6b040098a0 tx=0x7f6b04009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41b7634a56d2db65 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:14.844 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:09.691+0000 7f6b0cda5700 1 -- 172.21.15.83:0/4090312077 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6b04004160 con 0x7f6b08105470 2024-04-01T06:49:14.844 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:09.691+0000 7f6b0cda5700 1 -- 172.21.15.83:0/4090312077 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6b040042c0 con 0x7f6b08105470 2024-04-01T06:49:14.844 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:09.691+0000 7f6b0cda5700 1 -- 172.21.15.83:0/4090312077 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6b04011a00 con 0x7f6b08105470 2024-04-01T06:49:14.844 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:09.692+0000 7f6b1000b700 1 -- 172.21.15.83:0/4090312077 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6b08105470 msgr2=0x7f6b08105890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:14.844 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:09.692+0000 7f6b1000b700 1 --2- 172.21.15.83:0/4090312077 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6b08105470 0x7f6b08105890 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6b040098a0 tx=0x7f6b04009bb0 comp rx=0 tx=0).stop 2024-04-01T06:49:14.844 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:09.692+0000 7f6b1000b700 1 -- 172.21.15.83:0/4090312077 shutdown_connections 2024-04-01T06:49:14.844 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:09.692+0000 7f6b1000b700 1 --2- 172.21.15.83:0/4090312077 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6b08105470 0x7f6b08105890 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:14.844 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:09.692+0000 7f6b1000b700 1 -- 172.21.15.83:0/4090312077 >> 172.21.15.83:0/4090312077 conn(0x7f6b08100a50 msgr2=0x7f6b08102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:49:14.844 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:09.692+0000 7f6b1000b700 1 -- 172.21.15.83:0/4090312077 shutdown_connections 2024-04-01T06:49:14.844 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:09.692+0000 7f6b1000b700 1 -- 172.21.15.83:0/4090312077 wait complete. 2024-04-01T06:49:14.844 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:09.692+0000 7f6b1000b700 1 Processor -- start 2024-04-01T06:49:14.844 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:09.692+0000 7f6b1000b700 1 -- start start 2024-04-01T06:49:14.844 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:09.693+0000 7f6b1000b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6b08105470 0x7f6b08198080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:14.845 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:09.693+0000 7f6b1000b700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b081985c0 con 0x7f6b08105470 2024-04-01T06:49:14.845 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:09.693+0000 7f6b0dda7700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6b08105470 0x7f6b08198080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:14.845 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:09.693+0000 7f6b0dda7700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6b08105470 0x7f6b08198080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:32898/0 (socket says 172.21.15.83:32898) 2024-04-01T06:49:14.845 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:09.693+0000 7f6b0dda7700 1 -- 172.21.15.83:0/3859885551 learned_addr learned my addr 172.21.15.83:0/3859885551 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:49:14.845 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:09.693+0000 7f6b0dda7700 1 -- 172.21.15.83:0/3859885551 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b04009550 con 0x7f6b08105470 2024-04-01T06:49:14.845 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:09.693+0000 7f6b0dda7700 1 --2- 172.21.15.83:0/3859885551 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6b08105470 0x7f6b08198080 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6b04009fb0 tx=0x7f6b04011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:14.845 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:09.693+0000 7f6afeffd700 1 -- 172.21.15.83:0/3859885551 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6b04003a40 con 0x7f6b08105470 2024-04-01T06:49:14.845 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:09.693+0000 7f6afeffd700 1 -- 172.21.15.83:0/3859885551 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6b04003ba0 con 0x7f6b08105470 2024-04-01T06:49:14.845 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:09.693+0000 7f6b1000b700 1 -- 172.21.15.83:0/3859885551 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b081987c0 con 0x7f6b08105470 2024-04-01T06:49:14.845 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:09.694+0000 7f6afeffd700 1 -- 172.21.15.83:0/3859885551 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6b0401a750 con 0x7f6b08105470 2024-04-01T06:49:14.845 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:09.694+0000 7f6b1000b700 1 -- 172.21.15.83:0/3859885551 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b08198c60 con 0x7f6b08105470 2024-04-01T06:49:14.845 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:09.694+0000 7f6afeffd700 1 -- 172.21.15.83:0/3859885551 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) v1 ==== 45533+0+0 (secure 0 0 0) 0x7f6b0401a9d0 con 0x7f6b08105470 2024-04-01T06:49:14.845 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:09.695+0000 7f6afeffd700 1 --2- 172.21.15.83:0/3859885551 >> [v2:172.21.15.83:6800/1644397953,v1:172.21.15.83:6801/1644397953] conn(0x7f6af403a8b0 0x7f6af403cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:14.845 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:09.695+0000 7f6afeffd700 1 -- 172.21.15.83:0/3859885551 --> [v2:172.21.15.83:6800/1644397953,v1:172.21.15.83:6801/1644397953] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6af403d480 con 0x7f6af403a8b0 2024-04-01T06:49:14.845 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:09.695+0000 7f6afeffd700 1 -- 172.21.15.83:0/3859885551 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f6b0404c3f0 con 0x7f6b08105470 2024-04-01T06:49:14.846 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:09.695+0000 7f6b0d5a6700 1 -- 172.21.15.83:0/3859885551 >> [v2:172.21.15.83:6800/1644397953,v1:172.21.15.83:6801/1644397953] conn(0x7f6af403a8b0 msgr2=0x7f6af403cd70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.83:6800/1644397953 2024-04-01T06:49:14.846 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:09.695+0000 7f6b0d5a6700 1 --2- 172.21.15.83:0/3859885551 >> [v2:172.21.15.83:6800/1644397953,v1:172.21.15.83:6801/1644397953] conn(0x7f6af403a8b0 0x7f6af403cd70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-01T06:49:14.846 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:09.896+0000 7f6b0d5a6700 1 -- 172.21.15.83:0/3859885551 >> [v2:172.21.15.83:6800/1644397953,v1:172.21.15.83:6801/1644397953] conn(0x7f6af403a8b0 msgr2=0x7f6af403cd70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.83:6800/1644397953 2024-04-01T06:49:14.846 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:09.896+0000 7f6b0d5a6700 1 --2- 172.21.15.83:0/3859885551 >> [v2:172.21.15.83:6800/1644397953,v1:172.21.15.83:6801/1644397953] conn(0x7f6af403a8b0 0x7f6af403cd70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-01T06:49:14.846 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:10.297+0000 7f6b0d5a6700 1 -- 172.21.15.83:0/3859885551 >> [v2:172.21.15.83:6800/1644397953,v1:172.21.15.83:6801/1644397953] conn(0x7f6af403a8b0 msgr2=0x7f6af403cd70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.83:6800/1644397953 2024-04-01T06:49:14.846 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:10.297+0000 7f6b0d5a6700 1 --2- 172.21.15.83:0/3859885551 >> [v2:172.21.15.83:6800/1644397953,v1:172.21.15.83:6801/1644397953] conn(0x7f6af403a8b0 0x7f6af403cd70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-01T06:49:14.846 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:11.098+0000 7f6b0d5a6700 1 -- 172.21.15.83:0/3859885551 >> [v2:172.21.15.83:6800/1644397953,v1:172.21.15.83:6801/1644397953] conn(0x7f6af403a8b0 msgr2=0x7f6af403cd70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.83:6800/1644397953 2024-04-01T06:49:14.846 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:11.098+0000 7f6b0d5a6700 1 --2- 172.21.15.83:0/3859885551 >> [v2:172.21.15.83:6800/1644397953,v1:172.21.15.83:6801/1644397953] conn(0x7f6af403a8b0 0x7f6af403cd70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-01T06:49:14.846 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:12.699+0000 7f6b0d5a6700 1 -- 172.21.15.83:0/3859885551 >> [v2:172.21.15.83:6800/1644397953,v1:172.21.15.83:6801/1644397953] conn(0x7f6af403a8b0 msgr2=0x7f6af403cd70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.83:6800/1644397953 2024-04-01T06:49:14.846 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:12.699+0000 7f6b0d5a6700 1 --2- 172.21.15.83:0/3859885551 >> [v2:172.21.15.83:6800/1644397953,v1:172.21.15.83:6801/1644397953] conn(0x7f6af403a8b0 0x7f6af403cd70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-01T06:49:14.846 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:13.457+0000 7f6afeffd700 1 -- 172.21.15.83:0/3859885551 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mgrmap(e 6) v1 ==== 45300+0+0 (secure 0 0 0) 0x7f6b0402da50 con 0x7f6b08105470 2024-04-01T06:49:14.846 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:13.457+0000 7f6afeffd700 1 -- 172.21.15.83:0/3859885551 >> [v2:172.21.15.83:6800/1644397953,v1:172.21.15.83:6801/1644397953] conn(0x7f6af403a8b0 msgr2=0x7f6af403cd70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-01T06:49:14.846 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:13.457+0000 7f6afeffd700 1 --2- 172.21.15.83:0/3859885551 >> [v2:172.21.15.83:6800/1644397953,v1:172.21.15.83:6801/1644397953] conn(0x7f6af403a8b0 0x7f6af403cd70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:14.847 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:14.458+0000 7f6afeffd700 1 -- 172.21.15.83:0/3859885551 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mgrmap(e 7) v1 ==== 45427+0+0 (secure 0 0 0) 0x7f6b0404e020 con 0x7f6b08105470 2024-04-01T06:49:14.847 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:14.458+0000 7f6afeffd700 1 --2- 172.21.15.83:0/3859885551 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f6af403dfc0 0x7f6af40403b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:14.847 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:14.458+0000 7f6afeffd700 1 -- 172.21.15.83:0/3859885551 --> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6af403d480 con 0x7f6af403dfc0 2024-04-01T06:49:14.847 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:14.459+0000 7f6b0d5a6700 1 --2- 172.21.15.83:0/3859885551 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f6af403dfc0 0x7f6af40403b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:14.847 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:14.459+0000 7f6b0d5a6700 1 --2- 172.21.15.83:0/3859885551 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f6af403dfc0 0x7f6af40403b0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f6af8003a10 tx=0x7f6af8009290 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:14.847 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:14.460+0000 7f6afeffd700 1 -- 172.21.15.83:0/3859885551 <== mgr.14120 v2:172.21.15.83:6800/1867137261 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7f6af403d480 con 0x7f6af403dfc0 2024-04-01T06:49:14.847 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:14.470+0000 7f6afcff9700 1 -- 172.21.15.83:0/3859885551 --> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f6af0002600 con 0x7f6af403dfc0 2024-04-01T06:49:14.847 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:14.471+0000 7f6afeffd700 1 -- 172.21.15.83:0/3859885551 <== mgr.14120 v2:172.21.15.83:6800/1867137261 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f6af0002600 con 0x7f6af403dfc0 2024-04-01T06:49:14.847 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:14.471+0000 7f6afcff9700 1 -- 172.21.15.83:0/3859885551 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f6af403dfc0 msgr2=0x7f6af40403b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:14.847 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:14.471+0000 7f6afcff9700 1 --2- 172.21.15.83:0/3859885551 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f6af403dfc0 0x7f6af40403b0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f6af8003a10 tx=0x7f6af8009290 comp rx=0 tx=0).stop 2024-04-01T06:49:14.847 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:14.471+0000 7f6afcff9700 1 -- 172.21.15.83:0/3859885551 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6b08105470 msgr2=0x7f6b08198080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:14.847 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:14.471+0000 7f6afcff9700 1 --2- 172.21.15.83:0/3859885551 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6b08105470 0x7f6b08198080 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6b04009fb0 tx=0x7f6b04011ad0 comp rx=0 tx=0).stop 2024-04-01T06:49:14.847 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:14.471+0000 7f6afcff9700 1 -- 172.21.15.83:0/3859885551 shutdown_connections 2024-04-01T06:49:14.847 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:14.471+0000 7f6afcff9700 1 --2- 172.21.15.83:0/3859885551 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f6af403dfc0 0x7f6af40403b0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:14.847 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:14.471+0000 7f6afcff9700 1 --2- 172.21.15.83:0/3859885551 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6b08105470 0x7f6b08198080 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:14.848 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:14.471+0000 7f6afcff9700 1 --2- 172.21.15.83:0/3859885551 >> [v2:172.21.15.83:6800/1644397953,v1:172.21.15.83:6801/1644397953] conn(0x7f6af403a8b0 0x7f6af403cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:14.848 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:14.471+0000 7f6afcff9700 1 -- 172.21.15.83:0/3859885551 >> 172.21.15.83:0/3859885551 conn(0x7f6b08100a50 msgr2=0x7f6b0818ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:49:14.848 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:14.471+0000 7f6afcff9700 1 -- 172.21.15.83:0/3859885551 shutdown_connections 2024-04-01T06:49:14.848 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:14.471+0000 7f6afcff9700 1 -- 172.21.15.83:0/3859885551 wait complete. 2024-04-01T06:49:14.848 INFO:teuthology.orchestra.run.smithi083.stdout:mgr epoch 5 is available 2024-04-01T06:49:14.848 INFO:teuthology.orchestra.run.smithi083.stdout:Setting orchestrator backend to cephadm... 2024-04-01T06:49:15.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:15 smithi083 ceph-mon[43429]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-01T06:49:15.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:15 smithi083 ceph-mon[43429]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-01T06:49:15.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:15 smithi083 ceph-mon[43429]: from='mgr.14120 172.21.15.83:0/2619006165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:49:15.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:15 smithi083 ceph-mon[43429]: from='mgr.14120 172.21.15.83:0/2619006165' entity='mgr.x' 2024-04-01T06:49:15.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:15 smithi083 ceph-mon[43429]: from='mgr.14120 172.21.15.83:0/2619006165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:49:15.778 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:15.168+0000 7f525102b700 1 Processor -- start 2024-04-01T06:49:15.778 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:15.168+0000 7f525102b700 1 -- start start 2024-04-01T06:49:15.778 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:15.168+0000 7f525102b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f524c07be50 0x7f524c07a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:15.778 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:15.168+0000 7f525102b700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524c07a8d0 con 0x7f524c07be50 2024-04-01T06:49:15.778 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:15.168+0000 7f524ad9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f524c07be50 0x7f524c07a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:15.778 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:15.168+0000 7f524ad9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f524c07be50 0x7f524c07a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33126/0 (socket says 172.21.15.83:33126) 2024-04-01T06:49:15.778 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:15.168+0000 7f524ad9d700 1 -- 172.21.15.83:0/648452772 learned_addr learned my addr 172.21.15.83:0/648452772 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:49:15.778 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:15.168+0000 7f524ad9d700 1 -- 172.21.15.83:0/648452772 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f524c07aa10 con 0x7f524c07be50 2024-04-01T06:49:15.778 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:15.169+0000 7f524ad9d700 1 --2- 172.21.15.83:0/648452772 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f524c07be50 0x7f524c07a300 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f523c0098a0 tx=0x7f523c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3783fcb9967ab65d server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:15.778 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:15.169+0000 7f5249d9b700 1 -- 172.21.15.83:0/648452772 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f523c004160 con 0x7f524c07be50 2024-04-01T06:49:15.778 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:15.169+0000 7f5249d9b700 1 -- 172.21.15.83:0/648452772 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f523c0042c0 con 0x7f524c07be50 2024-04-01T06:49:15.778 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:15.169+0000 7f5249d9b700 1 -- 172.21.15.83:0/648452772 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f523c011a00 con 0x7f524c07be50 2024-04-01T06:49:15.779 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:15.169+0000 7f525102b700 1 -- 172.21.15.83:0/648452772 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f524c07be50 msgr2=0x7f524c07a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:15.779 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:15.169+0000 7f525102b700 1 --2- 172.21.15.83:0/648452772 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f524c07be50 0x7f524c07a300 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f523c0098a0 tx=0x7f523c009bb0 comp rx=0 tx=0).stop 2024-04-01T06:49:15.779 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:15.169+0000 7f525102b700 1 -- 172.21.15.83:0/648452772 shutdown_connections 2024-04-01T06:49:15.779 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:15.169+0000 7f525102b700 1 --2- 172.21.15.83:0/648452772 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f524c07be50 0x7f524c07a300 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:15.779 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:15.169+0000 7f525102b700 1 -- 172.21.15.83:0/648452772 >> 172.21.15.83:0/648452772 conn(0x7f524c101b60 msgr2=0x7f524c103f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:49:15.779 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:15.169+0000 7f525102b700 1 -- 172.21.15.83:0/648452772 shutdown_connections 2024-04-01T06:49:15.779 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:15.169+0000 7f525102b700 1 -- 172.21.15.83:0/648452772 wait complete. 2024-04-01T06:49:15.779 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:15.170+0000 7f525102b700 1 Processor -- start 2024-04-01T06:49:15.779 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:15.170+0000 7f525102b700 1 -- start start 2024-04-01T06:49:15.779 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:15.170+0000 7f525102b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f524c07be50 0x7f524c19c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:15.779 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:15.170+0000 7f525102b700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524c19c9d0 con 0x7f524c07be50 2024-04-01T06:49:15.779 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:15.171+0000 7f524ad9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f524c07be50 0x7f524c19c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:15.779 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:15.171+0000 7f524ad9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f524c07be50 0x7f524c19c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33142/0 (socket says 172.21.15.83:33142) 2024-04-01T06:49:15.779 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:15.171+0000 7f524ad9d700 1 -- 172.21.15.83:0/4160311083 learned_addr learned my addr 172.21.15.83:0/4160311083 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:49:15.780 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:15.171+0000 7f524ad9d700 1 -- 172.21.15.83:0/4160311083 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f523c009550 con 0x7f524c07be50 2024-04-01T06:49:15.780 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:15.171+0000 7f524ad9d700 1 --2- 172.21.15.83:0/4160311083 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f524c07be50 0x7f524c19c490 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f523c009130 tx=0x7f523c011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:15.780 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:15.171+0000 7f5233fff700 1 -- 172.21.15.83:0/4160311083 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f523c003b70 con 0x7f524c07be50 2024-04-01T06:49:15.780 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:15.171+0000 7f5233fff700 1 -- 172.21.15.83:0/4160311083 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f523c003cd0 con 0x7f524c07be50 2024-04-01T06:49:15.780 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:15.171+0000 7f5233fff700 1 -- 172.21.15.83:0/4160311083 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f523c0197d0 con 0x7f524c07be50 2024-04-01T06:49:15.780 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:15.171+0000 7f525102b700 1 -- 172.21.15.83:0/4160311083 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f524c19cbd0 con 0x7f524c07be50 2024-04-01T06:49:15.780 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:15.171+0000 7f525102b700 1 -- 172.21.15.83:0/4160311083 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f524c19d070 con 0x7f524c07be50 2024-04-01T06:49:15.780 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:15.172+0000 7f5233fff700 1 -- 172.21.15.83:0/4160311083 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 7) v1 ==== 45427+0+0 (secure 0 0 0) 0x7f523c0199c0 con 0x7f524c07be50 2024-04-01T06:49:15.780 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:15.172+0000 7f5233fff700 1 --2- 172.21.15.83:0/4160311083 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f5234038620 0x7f523403aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:15.780 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:15.172+0000 7f525102b700 1 -- 172.21.15.83:0/4160311083 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f524c10c910 con 0x7f524c07be50 2024-04-01T06:49:15.780 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:15.172+0000 7f5233fff700 1 -- 172.21.15.83:0/4160311083 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f523c04c710 con 0x7f524c07be50 2024-04-01T06:49:15.780 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:15.173+0000 7f524a59c700 1 --2- 172.21.15.83:0/4160311083 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f5234038620 0x7f523403aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:15.781 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:15.173+0000 7f524a59c700 1 --2- 172.21.15.83:0/4160311083 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f5234038620 0x7f523403aae0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5240006fd0 tx=0x7f5240006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:15.781 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:15.177+0000 7f5233fff700 1 -- 172.21.15.83:0/4160311083 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f523c018db0 con 0x7f524c07be50 2024-04-01T06:49:15.781 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:15.385+0000 7f525102b700 1 -- 172.21.15.83:0/4160311083 --> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f524c102e20 con 0x7f5234038620 2024-04-01T06:49:15.781 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:15.394+0000 7f5233fff700 1 -- 172.21.15.83:0/4160311083 <== mgr.14120 v2:172.21.15.83:6800/1867137261 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f524c102e20 con 0x7f5234038620 2024-04-01T06:49:15.781 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:15.396+0000 7f525102b700 1 -- 172.21.15.83:0/4160311083 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f5234038620 msgr2=0x7f523403aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:15.781 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:15.396+0000 7f525102b700 1 --2- 172.21.15.83:0/4160311083 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f5234038620 0x7f523403aae0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5240006fd0 tx=0x7f5240006e40 comp rx=0 tx=0).stop 2024-04-01T06:49:15.781 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:15.396+0000 7f525102b700 1 -- 172.21.15.83:0/4160311083 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f524c07be50 msgr2=0x7f524c19c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:15.781 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:15.396+0000 7f525102b700 1 --2- 172.21.15.83:0/4160311083 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f524c07be50 0x7f524c19c490 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f523c009130 tx=0x7f523c011ad0 comp rx=0 tx=0).stop 2024-04-01T06:49:15.781 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:15.396+0000 7f525102b700 1 -- 172.21.15.83:0/4160311083 shutdown_connections 2024-04-01T06:49:15.781 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:15.396+0000 7f525102b700 1 --2- 172.21.15.83:0/4160311083 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f5234038620 0x7f523403aae0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:15.781 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:15.396+0000 7f525102b700 1 --2- 172.21.15.83:0/4160311083 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f524c07be50 0x7f524c19c490 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:15.781 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:15.396+0000 7f525102b700 1 -- 172.21.15.83:0/4160311083 >> 172.21.15.83:0/4160311083 conn(0x7f524c101b60 msgr2=0x7f524c102710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:49:15.781 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:15.397+0000 7f525102b700 1 -- 172.21.15.83:0/4160311083 shutdown_connections 2024-04-01T06:49:15.782 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:15.397+0000 7f525102b700 1 -- 172.21.15.83:0/4160311083 wait complete. 2024-04-01T06:49:16.715 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout value unchanged 2024-04-01T06:49:16.715 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:16.142+0000 7f23e76e6700 1 Processor -- start 2024-04-01T06:49:16.715 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:16.142+0000 7f23e76e6700 1 -- start start 2024-04-01T06:49:16.715 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:16.142+0000 7f23e76e6700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f23e0104e40 0x7f23e0105260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:16.715 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:16.142+0000 7f23e76e6700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e0079e10 con 0x7f23e0104e40 2024-04-01T06:49:16.715 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:16.143+0000 7f23e5482700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f23e0104e40 0x7f23e0105260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:16.715 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:16.143+0000 7f23e5482700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f23e0104e40 0x7f23e0105260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33150/0 (socket says 172.21.15.83:33150) 2024-04-01T06:49:16.716 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:16.143+0000 7f23e5482700 1 -- 172.21.15.83:0/3404159058 learned_addr learned my addr 172.21.15.83:0/3404159058 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:49:16.716 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:16.143+0000 7f23e5482700 1 -- 172.21.15.83:0/3404159058 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e0079f50 con 0x7f23e0104e40 2024-04-01T06:49:16.716 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:16.143+0000 7f23e5482700 1 --2- 172.21.15.83:0/3404159058 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f23e0104e40 0x7f23e0105260 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f23d00098a0 tx=0x7f23d0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c90883a9f7d96bd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:16.716 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:16.143+0000 7f23d7fff700 1 -- 172.21.15.83:0/3404159058 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f23d0004160 con 0x7f23e0104e40 2024-04-01T06:49:16.716 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:16.143+0000 7f23d7fff700 1 -- 172.21.15.83:0/3404159058 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f23d00042c0 con 0x7f23e0104e40 2024-04-01T06:49:16.716 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:16.143+0000 7f23d7fff700 1 -- 172.21.15.83:0/3404159058 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f23d0011a00 con 0x7f23e0104e40 2024-04-01T06:49:16.716 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:16.144+0000 7f23e76e6700 1 -- 172.21.15.83:0/3404159058 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f23e0104e40 msgr2=0x7f23e0105260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:16.716 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:16.144+0000 7f23e76e6700 1 --2- 172.21.15.83:0/3404159058 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f23e0104e40 0x7f23e0105260 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f23d00098a0 tx=0x7f23d0009bb0 comp rx=0 tx=0).stop 2024-04-01T06:49:16.716 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:16.144+0000 7f23e76e6700 1 -- 172.21.15.83:0/3404159058 shutdown_connections 2024-04-01T06:49:16.716 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:16.144+0000 7f23e76e6700 1 --2- 172.21.15.83:0/3404159058 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f23e0104e40 0x7f23e0105260 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:16.716 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:16.144+0000 7f23e76e6700 1 -- 172.21.15.83:0/3404159058 >> 172.21.15.83:0/3404159058 conn(0x7f23e0100a00 msgr2=0x7f23e0102e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:49:16.716 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:16.144+0000 7f23e76e6700 1 -- 172.21.15.83:0/3404159058 shutdown_connections 2024-04-01T06:49:16.716 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:16.144+0000 7f23e76e6700 1 -- 172.21.15.83:0/3404159058 wait complete. 2024-04-01T06:49:16.716 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:16.144+0000 7f23e76e6700 1 Processor -- start 2024-04-01T06:49:16.717 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:16.144+0000 7f23e76e6700 1 -- start start 2024-04-01T06:49:16.717 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:16.145+0000 7f23e76e6700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f23e0104e40 0x7f23e019c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:16.717 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:16.145+0000 7f23e76e6700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e019c980 con 0x7f23e0104e40 2024-04-01T06:49:16.717 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:16.145+0000 7f23e5482700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f23e0104e40 0x7f23e019c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:16.717 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:16.145+0000 7f23e5482700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f23e0104e40 0x7f23e019c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33158/0 (socket says 172.21.15.83:33158) 2024-04-01T06:49:16.717 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:16.145+0000 7f23e5482700 1 -- 172.21.15.83:0/3246076721 learned_addr learned my addr 172.21.15.83:0/3246076721 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:49:16.717 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:16.145+0000 7f23e5482700 1 -- 172.21.15.83:0/3246076721 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d0009550 con 0x7f23e0104e40 2024-04-01T06:49:16.717 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:16.145+0000 7f23e5482700 1 --2- 172.21.15.83:0/3246076721 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f23e0104e40 0x7f23e019c440 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f23d0009fb0 tx=0x7f23d0011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:16.717 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:16.145+0000 7f23d67fc700 1 -- 172.21.15.83:0/3246076721 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f23d0003a40 con 0x7f23e0104e40 2024-04-01T06:49:16.717 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:16.145+0000 7f23d67fc700 1 -- 172.21.15.83:0/3246076721 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f23d0003ba0 con 0x7f23e0104e40 2024-04-01T06:49:16.717 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:16.145+0000 7f23d67fc700 1 -- 172.21.15.83:0/3246076721 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f23d001a750 con 0x7f23e0104e40 2024-04-01T06:49:16.717 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:16.145+0000 7f23e76e6700 1 -- 172.21.15.83:0/3246076721 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23e019cb80 con 0x7f23e0104e40 2024-04-01T06:49:16.717 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:16.145+0000 7f23e76e6700 1 -- 172.21.15.83:0/3246076721 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23e019d020 con 0x7f23e0104e40 2024-04-01T06:49:16.717 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:16.146+0000 7f23d67fc700 1 -- 172.21.15.83:0/3246076721 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 7) v1 ==== 45427+0+0 (secure 0 0 0) 0x7f23d0024430 con 0x7f23e0104e40 2024-04-01T06:49:16.717 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:16.146+0000 7f23e76e6700 1 -- 172.21.15.83:0/3246076721 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23e0196120 con 0x7f23e0104e40 2024-04-01T06:49:16.718 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:16.146+0000 7f23d67fc700 1 --2- 172.21.15.83:0/3246076721 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f23cc0385e0 0x7f23cc03aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:16.718 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:16.146+0000 7f23d67fc700 1 -- 172.21.15.83:0/3246076721 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f23d004c510 con 0x7f23e0104e40 2024-04-01T06:49:16.718 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:16.146+0000 7f23e4c81700 1 --2- 172.21.15.83:0/3246076721 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f23cc0385e0 0x7f23cc03aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:16.718 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:16.147+0000 7f23e4c81700 1 --2- 172.21.15.83:0/3246076721 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f23cc0385e0 0x7f23cc03aaa0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f23dc006fd0 tx=0x7f23dc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:16.718 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:16.151+0000 7f23d67fc700 1 -- 172.21.15.83:0/3246076721 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f23d0018350 con 0x7f23e0104e40 2024-04-01T06:49:16.718 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:16.342+0000 7f23e76e6700 1 -- 172.21.15.83:0/3246076721 --> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f23e002cf20 con 0x7f23cc0385e0 2024-04-01T06:49:16.718 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:16.343+0000 7f23d67fc700 1 -- 172.21.15.83:0/3246076721 <== mgr.14120 v2:172.21.15.83:6800/1867137261 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f23e002cf20 con 0x7f23cc0385e0 2024-04-01T06:49:16.718 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:16.345+0000 7f23e76e6700 1 -- 172.21.15.83:0/3246076721 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f23cc0385e0 msgr2=0x7f23cc03aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:16.718 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:16.345+0000 7f23e76e6700 1 --2- 172.21.15.83:0/3246076721 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f23cc0385e0 0x7f23cc03aaa0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f23dc006fd0 tx=0x7f23dc006e40 comp rx=0 tx=0).stop 2024-04-01T06:49:16.718 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:16.345+0000 7f23e76e6700 1 -- 172.21.15.83:0/3246076721 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f23e0104e40 msgr2=0x7f23e019c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:16.718 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:16.345+0000 7f23e76e6700 1 --2- 172.21.15.83:0/3246076721 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f23e0104e40 0x7f23e019c440 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f23d0009fb0 tx=0x7f23d0011ad0 comp rx=0 tx=0).stop 2024-04-01T06:49:16.718 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:16.345+0000 7f23e76e6700 1 -- 172.21.15.83:0/3246076721 shutdown_connections 2024-04-01T06:49:16.718 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:16.345+0000 7f23e76e6700 1 --2- 172.21.15.83:0/3246076721 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f23cc0385e0 0x7f23cc03aaa0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:16.718 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:16.345+0000 7f23e76e6700 1 --2- 172.21.15.83:0/3246076721 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f23e0104e40 0x7f23e019c440 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:16.719 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:16.345+0000 7f23e76e6700 1 -- 172.21.15.83:0/3246076721 >> 172.21.15.83:0/3246076721 conn(0x7f23e0100a00 msgr2=0x7f23e0193260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:49:16.719 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:16.345+0000 7f23e76e6700 1 -- 172.21.15.83:0/3246076721 shutdown_connections 2024-04-01T06:49:16.719 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:16.345+0000 7f23e76e6700 1 -- 172.21.15.83:0/3246076721 wait complete. 2024-04-01T06:49:16.719 INFO:teuthology.orchestra.run.smithi083.stdout:Generating ssh key... 2024-04-01T06:49:16.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:16 smithi083 ceph-mon[43429]: [01/Apr/2024:06:49:14] ENGINE Bus STARTING 2024-04-01T06:49:16.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:16 smithi083 ceph-mon[43429]: [01/Apr/2024:06:49:15] ENGINE Serving on https://172.21.15.83:7150 2024-04-01T06:49:16.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:16 smithi083 ceph-mon[43429]: [01/Apr/2024:06:49:15] ENGINE Serving on http://172.21.15.83:8765 2024-04-01T06:49:16.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:16 smithi083 ceph-mon[43429]: [01/Apr/2024:06:49:15] ENGINE Bus STARTED 2024-04-01T06:49:16.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:16 smithi083 ceph-mon[43429]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:49:16.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:16 smithi083 ceph-mon[43429]: mgrmap e8: x(active, since 2s) 2024-04-01T06:49:17.695 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:17 smithi083 ceph-mon[43429]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:49:17.695 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:17 smithi083 ceph-mon[43429]: from='mgr.14120 172.21.15.83:0/2619006165' entity='mgr.x' 2024-04-01T06:49:17.695 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:17 smithi083 ceph-mon[43429]: from='mgr.14120 172.21.15.83:0/2619006165' entity='mgr.x' 2024-04-01T06:49:17.696 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:17 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: Generating public/private rsa key pair. 2024-04-01T06:49:17.696 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:17 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: Your identification has been saved in /tmp/tmp73j2skrw/key. 2024-04-01T06:49:17.696 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:17 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: Your public key has been saved in /tmp/tmp73j2skrw/key.pub. 2024-04-01T06:49:17.696 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:17 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: The key fingerprint is: 2024-04-01T06:49:17.696 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:17 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: SHA256:9HgbbnbfCewI6bez1beAt1VYRvtQOmG1m8rU9gazUk0 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4 2024-04-01T06:49:17.696 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:17 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: The key's randomart image is: 2024-04-01T06:49:17.696 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:17 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: +---[RSA 3072]----+ 2024-04-01T06:49:17.696 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:17 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: | o.+| 2024-04-01T06:49:17.696 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:17 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: | . =o| 2024-04-01T06:49:17.696 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:17 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: | . +oE| 2024-04-01T06:49:17.696 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:17 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: | . o .O+| 2024-04-01T06:49:17.696 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:17 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: | S + .==+| 2024-04-01T06:49:17.697 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:17 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: | o.o=.++o| 2024-04-01T06:49:17.697 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:17 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: | o=.oO.o+| 2024-04-01T06:49:17.697 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:17 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: | .o.+=o=o+| 2024-04-01T06:49:17.697 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:17 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: | ..++o.o.| 2024-04-01T06:49:17.697 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:17 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: +----[SHA256]-----+ 2024-04-01T06:49:17.790 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:17.040+0000 7f86884a5700 1 Processor -- start 2024-04-01T06:49:17.791 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:17.040+0000 7f86884a5700 1 -- start start 2024-04-01T06:49:17.791 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:17.040+0000 7f86884a5700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f868007be30 0x7f868007a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:17.791 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:17.040+0000 7f86884a5700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868007a820 con 0x7f868007be30 2024-04-01T06:49:17.791 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:17.040+0000 7f8686241700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f868007be30 0x7f868007a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:17.791 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:17.040+0000 7f8686241700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f868007be30 0x7f868007a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33170/0 (socket says 172.21.15.83:33170) 2024-04-01T06:49:17.791 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:17.040+0000 7f8686241700 1 -- 172.21.15.83:0/1262484436 learned_addr learned my addr 172.21.15.83:0/1262484436 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:49:17.791 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:17.041+0000 7f8686241700 1 -- 172.21.15.83:0/1262484436 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f868007a960 con 0x7f868007be30 2024-04-01T06:49:17.791 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:17.041+0000 7f8686241700 1 --2- 172.21.15.83:0/1262484436 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f868007be30 0x7f868007a2e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f867c0098a0 tx=0x7f867c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a5c11fa9bd3806 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:17.791 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:17.041+0000 7f868523f700 1 -- 172.21.15.83:0/1262484436 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f867c004160 con 0x7f868007be30 2024-04-01T06:49:17.791 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:17.041+0000 7f868523f700 1 -- 172.21.15.83:0/1262484436 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f867c0042c0 con 0x7f868007be30 2024-04-01T06:49:17.791 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:17.041+0000 7f868523f700 1 -- 172.21.15.83:0/1262484436 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f867c011a00 con 0x7f868007be30 2024-04-01T06:49:17.791 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:17.041+0000 7f86884a5700 1 -- 172.21.15.83:0/1262484436 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f868007be30 msgr2=0x7f868007a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:17.791 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:17.041+0000 7f86884a5700 1 --2- 172.21.15.83:0/1262484436 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f868007be30 0x7f868007a2e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f867c0098a0 tx=0x7f867c009bb0 comp rx=0 tx=0).stop 2024-04-01T06:49:17.792 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:17.042+0000 7f86884a5700 1 -- 172.21.15.83:0/1262484436 shutdown_connections 2024-04-01T06:49:17.792 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:17.042+0000 7f86884a5700 1 --2- 172.21.15.83:0/1262484436 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f868007be30 0x7f868007a2e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:17.792 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:17.042+0000 7f86884a5700 1 -- 172.21.15.83:0/1262484436 >> 172.21.15.83:0/1262484436 conn(0x7f8680101b30 msgr2=0x7f8680103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:49:17.792 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:17.042+0000 7f86884a5700 1 -- 172.21.15.83:0/1262484436 shutdown_connections 2024-04-01T06:49:17.792 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:17.042+0000 7f86884a5700 1 -- 172.21.15.83:0/1262484436 wait complete. 2024-04-01T06:49:17.792 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:17.042+0000 7f86884a5700 1 Processor -- start 2024-04-01T06:49:17.792 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:17.042+0000 7f86884a5700 1 -- start start 2024-04-01T06:49:17.792 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:17.043+0000 7f86884a5700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f868007be30 0x7f868019c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:17.792 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:17.043+0000 7f86884a5700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868019c9a0 con 0x7f868007be30 2024-04-01T06:49:17.792 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:17.043+0000 7f8686241700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f868007be30 0x7f868019c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:17.792 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:17.043+0000 7f8686241700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f868007be30 0x7f868019c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33178/0 (socket says 172.21.15.83:33178) 2024-04-01T06:49:17.792 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:17.043+0000 7f8686241700 1 -- 172.21.15.83:0/1638914091 learned_addr learned my addr 172.21.15.83:0/1638914091 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:49:17.792 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:17.043+0000 7f8686241700 1 -- 172.21.15.83:0/1638914091 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f867c009550 con 0x7f868007be30 2024-04-01T06:49:17.792 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:17.043+0000 7f8686241700 1 --2- 172.21.15.83:0/1638914091 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f868007be30 0x7f868019c460 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f867c009fb0 tx=0x7f867c011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:17.792 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:17.043+0000 7f86777fe700 1 -- 172.21.15.83:0/1638914091 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f867c003a40 con 0x7f868007be30 2024-04-01T06:49:17.793 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:17.043+0000 7f86884a5700 1 -- 172.21.15.83:0/1638914091 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f868019cba0 con 0x7f868007be30 2024-04-01T06:49:17.793 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:17.043+0000 7f86777fe700 1 -- 172.21.15.83:0/1638914091 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f867c003ba0 con 0x7f868007be30 2024-04-01T06:49:17.793 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:17.043+0000 7f86777fe700 1 -- 172.21.15.83:0/1638914091 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f867c01a750 con 0x7f868007be30 2024-04-01T06:49:17.793 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:17.043+0000 7f86884a5700 1 -- 172.21.15.83:0/1638914091 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f868019d040 con 0x7f868007be30 2024-04-01T06:49:17.793 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:17.044+0000 7f86777fe700 1 -- 172.21.15.83:0/1638914091 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 8) v1 ==== 45533+0+0 (secure 0 0 0) 0x7f867c01a9d0 con 0x7f868007be30 2024-04-01T06:49:17.793 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:17.044+0000 7f86884a5700 1 -- 172.21.15.83:0/1638914091 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f868010c8c0 con 0x7f868007be30 2024-04-01T06:49:17.793 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:17.044+0000 7f86777fe700 1 --2- 172.21.15.83:0/1638914091 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f866c0386b0 0x7f866c03ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:17.793 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:17.044+0000 7f86777fe700 1 -- 172.21.15.83:0/1638914091 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f867c04c8a0 con 0x7f868007be30 2024-04-01T06:49:17.793 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:17.045+0000 7f8685a40700 1 --2- 172.21.15.83:0/1638914091 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f866c0386b0 0x7f866c03ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:17.793 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:17.045+0000 7f8685a40700 1 --2- 172.21.15.83:0/1638914091 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f866c0386b0 0x7f866c03ab70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8670006fd0 tx=0x7f8670006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:17.793 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:17.049+0000 7f86777fe700 1 -- 172.21.15.83:0/1638914091 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f867c024610 con 0x7f868007be30 2024-04-01T06:49:17.793 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:17.240+0000 7f86884a5700 1 -- 172.21.15.83:0/1638914091 --> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f8680102dd0 con 0x7f866c0386b0 2024-04-01T06:49:17.793 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:17.421+0000 7f86777fe700 1 -- 172.21.15.83:0/1638914091 <== mgr.14120 v2:172.21.15.83:6800/1867137261 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f8680102dd0 con 0x7f866c0386b0 2024-04-01T06:49:17.793 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:17.423+0000 7f86884a5700 1 -- 172.21.15.83:0/1638914091 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f866c0386b0 msgr2=0x7f866c03ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:17.794 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:17.423+0000 7f86884a5700 1 --2- 172.21.15.83:0/1638914091 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f866c0386b0 0x7f866c03ab70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8670006fd0 tx=0x7f8670006e40 comp rx=0 tx=0).stop 2024-04-01T06:49:17.794 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:17.423+0000 7f86884a5700 1 -- 172.21.15.83:0/1638914091 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f868007be30 msgr2=0x7f868019c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:17.794 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:17.423+0000 7f86884a5700 1 --2- 172.21.15.83:0/1638914091 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f868007be30 0x7f868019c460 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f867c009fb0 tx=0x7f867c011ad0 comp rx=0 tx=0).stop 2024-04-01T06:49:17.794 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:17.423+0000 7f86884a5700 1 -- 172.21.15.83:0/1638914091 shutdown_connections 2024-04-01T06:49:17.794 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:17.423+0000 7f86884a5700 1 --2- 172.21.15.83:0/1638914091 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f866c0386b0 0x7f866c03ab70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:17.794 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:17.423+0000 7f86884a5700 1 --2- 172.21.15.83:0/1638914091 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f868007be30 0x7f868019c460 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:17.794 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:17.423+0000 7f86884a5700 1 -- 172.21.15.83:0/1638914091 >> 172.21.15.83:0/1638914091 conn(0x7f8680101b30 msgr2=0x7f86801026c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:49:17.794 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:17.423+0000 7f86884a5700 1 -- 172.21.15.83:0/1638914091 shutdown_connections 2024-04-01T06:49:17.794 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:17.423+0000 7f86884a5700 1 -- 172.21.15.83:0/1638914091 wait complete. 2024-04-01T06:49:18.640 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDRZewNwzfbm1DechZhdt3SGepeth/+LIOGoloKply+q1fMxXyBgf6CfAbngIloidGNWi+rFS1LvUSRbSl4ambov54xC5IF/HjGiHMmcw/kJgYru9go6YGFNB8iuyaxht9PLx2ZJmPa6a96QmmM5jZJLcKA9ZclzSid6xjxdELl7DYxF3M/FXS4kUByTL0O9DTUo4QJyXSKasCGbHyyAM7z4R2woQEZ7yWVXTP18Rsq0CDM5Sw1ff1Mq5VbeDCZMFE3d2l+O18H3c6DT9wrgCLNZVGSw+vRpMKTs1xK7lwncSy4QA1gnNfOlxC48EXLiotDTScaNtkxL8u+e4Dcj4S99C0LcjZTRuXgPU6z0bsMA5MPglhOhfvs32FUYZ+xYTDDy0eID9vaC1UWO09stWKDzQ8MCASLVu/hnjEzQDrZcrj5UZC7ZBZYxKC4JsvXN+E8/VOJE0lLxkiK0ZrSKjejgENtmaX6VkHEY29J3J5KX8x6WpGUn9riNx1TIgIXqX0= ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4 2024-04-01T06:49:18.640 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.133+0000 7f6eb0809700 1 Processor -- start 2024-04-01T06:49:18.640 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.133+0000 7f6eb0809700 1 -- start start 2024-04-01T06:49:18.640 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.133+0000 7f6eb0809700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6eac104e50 0x7f6eac105270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:18.640 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.133+0000 7f6eb0809700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac079e30 con 0x7f6eac104e50 2024-04-01T06:49:18.640 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.133+0000 7f6eaa59c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6eac104e50 0x7f6eac105270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:18.640 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.134+0000 7f6eaa59c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6eac104e50 0x7f6eac105270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33184/0 (socket says 172.21.15.83:33184) 2024-04-01T06:49:18.640 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.134+0000 7f6eaa59c700 1 -- 172.21.15.83:0/2346703747 learned_addr learned my addr 172.21.15.83:0/2346703747 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:49:18.640 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.134+0000 7f6eaa59c700 1 -- 172.21.15.83:0/2346703747 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eac1057b0 con 0x7f6eac104e50 2024-04-01T06:49:18.640 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.134+0000 7f6eaa59c700 1 --2- 172.21.15.83:0/2346703747 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6eac104e50 0x7f6eac105270 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6ea00098a0 tx=0x7f6ea0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f955c7a077f6a7c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:18.641 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.134+0000 7f6ea959a700 1 -- 172.21.15.83:0/2346703747 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ea0004160 con 0x7f6eac104e50 2024-04-01T06:49:18.641 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.134+0000 7f6ea959a700 1 -- 172.21.15.83:0/2346703747 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6ea00042c0 con 0x7f6eac104e50 2024-04-01T06:49:18.641 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.134+0000 7f6ea959a700 1 -- 172.21.15.83:0/2346703747 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ea0011a00 con 0x7f6eac104e50 2024-04-01T06:49:18.641 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.135+0000 7f6eb0809700 1 -- 172.21.15.83:0/2346703747 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6eac104e50 msgr2=0x7f6eac105270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:18.641 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.135+0000 7f6eb0809700 1 --2- 172.21.15.83:0/2346703747 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6eac104e50 0x7f6eac105270 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6ea00098a0 tx=0x7f6ea0009bb0 comp rx=0 tx=0).stop 2024-04-01T06:49:18.641 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.135+0000 7f6eb0809700 1 -- 172.21.15.83:0/2346703747 shutdown_connections 2024-04-01T06:49:18.641 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.135+0000 7f6eb0809700 1 --2- 172.21.15.83:0/2346703747 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6eac104e50 0x7f6eac105270 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:18.641 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.135+0000 7f6eb0809700 1 -- 172.21.15.83:0/2346703747 >> 172.21.15.83:0/2346703747 conn(0x7f6eac100a50 msgr2=0x7f6eac102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:49:18.641 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.135+0000 7f6eb0809700 1 -- 172.21.15.83:0/2346703747 shutdown_connections 2024-04-01T06:49:18.641 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.135+0000 7f6eb0809700 1 -- 172.21.15.83:0/2346703747 wait complete. 2024-04-01T06:49:18.641 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.135+0000 7f6eb0809700 1 Processor -- start 2024-04-01T06:49:18.641 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.136+0000 7f6eb0809700 1 -- start start 2024-04-01T06:49:18.641 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.136+0000 7f6eb0809700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6eac104e50 0x7f6eac19c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:18.642 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.136+0000 7f6eb0809700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac19c9f0 con 0x7f6eac104e50 2024-04-01T06:49:18.642 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.136+0000 7f6eaa59c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6eac104e50 0x7f6eac19c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:18.642 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.136+0000 7f6eaa59c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6eac104e50 0x7f6eac19c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33198/0 (socket says 172.21.15.83:33198) 2024-04-01T06:49:18.642 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.136+0000 7f6eaa59c700 1 -- 172.21.15.83:0/627437863 learned_addr learned my addr 172.21.15.83:0/627437863 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:49:18.642 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.136+0000 7f6eaa59c700 1 -- 172.21.15.83:0/627437863 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea0009550 con 0x7f6eac104e50 2024-04-01T06:49:18.642 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.136+0000 7f6eaa59c700 1 --2- 172.21.15.83:0/627437863 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6eac104e50 0x7f6eac19c4b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6ea0009fb0 tx=0x7f6ea0011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:18.642 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.136+0000 7f6e9b7fe700 1 -- 172.21.15.83:0/627437863 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ea0003a40 con 0x7f6eac104e50 2024-04-01T06:49:18.642 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.136+0000 7f6eb0809700 1 -- 172.21.15.83:0/627437863 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eac19cbf0 con 0x7f6eac104e50 2024-04-01T06:49:18.642 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.136+0000 7f6e9b7fe700 1 -- 172.21.15.83:0/627437863 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6ea0003ba0 con 0x7f6eac104e50 2024-04-01T06:49:18.642 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.136+0000 7f6e9b7fe700 1 -- 172.21.15.83:0/627437863 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ea001a750 con 0x7f6eac104e50 2024-04-01T06:49:18.642 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.136+0000 7f6eb0809700 1 -- 172.21.15.83:0/627437863 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eac19d090 con 0x7f6eac104e50 2024-04-01T06:49:18.642 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.137+0000 7f6e9b7fe700 1 -- 172.21.15.83:0/627437863 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 8) v1 ==== 45533+0+0 (secure 0 0 0) 0x7f6ea001a9d0 con 0x7f6eac104e50 2024-04-01T06:49:18.642 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.137+0000 7f6e9b7fe700 1 --2- 172.21.15.83:0/627437863 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f6e940386b0 0x7f6e9403ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:18.642 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.137+0000 7f6e9b7fe700 1 -- 172.21.15.83:0/627437863 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f6ea004c780 con 0x7f6eac104e50 2024-04-01T06:49:18.643 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.137+0000 7f6ea9d9b700 1 --2- 172.21.15.83:0/627437863 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f6e940386b0 0x7f6e9403ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:18.643 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.138+0000 7f6eb0809700 1 -- 172.21.15.83:0/627437863 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eac196180 con 0x7f6eac104e50 2024-04-01T06:49:18.643 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.138+0000 7f6ea9d9b700 1 --2- 172.21.15.83:0/627437863 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f6e940386b0 0x7f6e9403ab70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c006fd0 tx=0x7f6e9c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:18.643 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.143+0000 7f6e9b7fe700 1 -- 172.21.15.83:0/627437863 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f6ea0018db0 con 0x7f6eac104e50 2024-04-01T06:49:18.643 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.332+0000 7f6eb0809700 1 -- 172.21.15.83:0/627437863 --> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f6eac02cd50 con 0x7f6e940386b0 2024-04-01T06:49:18.643 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.332+0000 7f6e9b7fe700 1 -- 172.21.15.83:0/627437863 <== mgr.14120 v2:172.21.15.83:6800/1867137261 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f6eac02cd50 con 0x7f6e940386b0 2024-04-01T06:49:18.643 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.334+0000 7f6eb0809700 1 -- 172.21.15.83:0/627437863 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f6e940386b0 msgr2=0x7f6e9403ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:18.643 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.334+0000 7f6eb0809700 1 --2- 172.21.15.83:0/627437863 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f6e940386b0 0x7f6e9403ab70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c006fd0 tx=0x7f6e9c006e40 comp rx=0 tx=0).stop 2024-04-01T06:49:18.643 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.334+0000 7f6eb0809700 1 -- 172.21.15.83:0/627437863 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6eac104e50 msgr2=0x7f6eac19c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:18.643 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.334+0000 7f6eb0809700 1 --2- 172.21.15.83:0/627437863 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6eac104e50 0x7f6eac19c4b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6ea0009fb0 tx=0x7f6ea0011ad0 comp rx=0 tx=0).stop 2024-04-01T06:49:18.643 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.334+0000 7f6eb0809700 1 -- 172.21.15.83:0/627437863 shutdown_connections 2024-04-01T06:49:18.643 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.334+0000 7f6eb0809700 1 --2- 172.21.15.83:0/627437863 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f6e940386b0 0x7f6e9403ab70 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:18.643 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.334+0000 7f6eb0809700 1 --2- 172.21.15.83:0/627437863 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6eac104e50 0x7f6eac19c4b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:18.643 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.334+0000 7f6eb0809700 1 -- 172.21.15.83:0/627437863 >> 172.21.15.83:0/627437863 conn(0x7f6eac100a50 msgr2=0x7f6eac1932c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:49:18.643 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.334+0000 7f6eb0809700 1 -- 172.21.15.83:0/627437863 shutdown_connections 2024-04-01T06:49:18.644 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.334+0000 7f6eb0809700 1 -- 172.21.15.83:0/627437863 wait complete. 2024-04-01T06:49:18.644 INFO:teuthology.orchestra.run.smithi083.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-04-01T06:49:18.644 INFO:teuthology.orchestra.run.smithi083.stdout:Adding key to root@localhost authorized_keys... 2024-04-01T06:49:18.644 INFO:teuthology.orchestra.run.smithi083.stdout:Adding host smithi083... 2024-04-01T06:49:18.876 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:18 smithi083 ceph-mon[43429]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:49:18.877 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:18 smithi083 ceph-mon[43429]: Generating ssh key... 2024-04-01T06:49:19.706 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:19 smithi083 ceph-mon[43429]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:49:20.870 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:20 smithi083 ceph-mon[43429]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi083", "addr": "172.21.15.83", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:49:21.594 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout Added host 'smithi083' with addr '172.21.15.83' 2024-04-01T06:49:21.594 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.952+0000 7f57865cf700 1 Processor -- start 2024-04-01T06:49:21.595 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.952+0000 7f57865cf700 1 -- start start 2024-04-01T06:49:21.595 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.952+0000 7f57865cf700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5780104e10 0x7f5780105230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:21.595 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.952+0000 7f57865cf700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5780079e30 con 0x7f5780104e10 2024-04-01T06:49:21.595 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.952+0000 7f577ffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5780104e10 0x7f5780105230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:21.595 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.952+0000 7f577ffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5780104e10 0x7f5780105230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33210/0 (socket says 172.21.15.83:33210) 2024-04-01T06:49:21.595 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.952+0000 7f577ffff700 1 -- 172.21.15.83:0/3863302212 learned_addr learned my addr 172.21.15.83:0/3863302212 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:49:21.595 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.952+0000 7f577ffff700 1 -- 172.21.15.83:0/3863302212 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5780105770 con 0x7f5780104e10 2024-04-01T06:49:21.595 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.953+0000 7f577ffff700 1 --2- 172.21.15.83:0/3863302212 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5780104e10 0x7f5780105230 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f57700098a0 tx=0x7f5770009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=121e3ca0b5c3fc21 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:21.595 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.953+0000 7f577effd700 1 -- 172.21.15.83:0/3863302212 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5770004160 con 0x7f5780104e10 2024-04-01T06:49:21.595 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.953+0000 7f577effd700 1 -- 172.21.15.83:0/3863302212 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f57700042c0 con 0x7f5780104e10 2024-04-01T06:49:21.595 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.953+0000 7f577effd700 1 -- 172.21.15.83:0/3863302212 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5770011a00 con 0x7f5780104e10 2024-04-01T06:49:21.595 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.953+0000 7f57865cf700 1 -- 172.21.15.83:0/3863302212 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5780104e10 msgr2=0x7f5780105230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:21.595 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.953+0000 7f57865cf700 1 --2- 172.21.15.83:0/3863302212 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5780104e10 0x7f5780105230 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f57700098a0 tx=0x7f5770009bb0 comp rx=0 tx=0).stop 2024-04-01T06:49:21.596 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.953+0000 7f57865cf700 1 -- 172.21.15.83:0/3863302212 shutdown_connections 2024-04-01T06:49:21.596 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.953+0000 7f57865cf700 1 --2- 172.21.15.83:0/3863302212 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5780104e10 0x7f5780105230 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:21.596 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.953+0000 7f57865cf700 1 -- 172.21.15.83:0/3863302212 >> 172.21.15.83:0/3863302212 conn(0x7f57801009f0 msgr2=0x7f5780102e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:49:21.596 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.953+0000 7f57865cf700 1 -- 172.21.15.83:0/3863302212 shutdown_connections 2024-04-01T06:49:21.596 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.953+0000 7f57865cf700 1 -- 172.21.15.83:0/3863302212 wait complete. 2024-04-01T06:49:21.596 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.954+0000 7f57865cf700 1 Processor -- start 2024-04-01T06:49:21.596 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.954+0000 7f57865cf700 1 -- start start 2024-04-01T06:49:21.596 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.954+0000 7f57865cf700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5780104e10 0x7f578019c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:21.596 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.954+0000 7f57865cf700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f578019c980 con 0x7f5780104e10 2024-04-01T06:49:21.596 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.954+0000 7f577ffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5780104e10 0x7f578019c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:21.596 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.954+0000 7f577ffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5780104e10 0x7f578019c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33224/0 (socket says 172.21.15.83:33224) 2024-04-01T06:49:21.596 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.954+0000 7f577ffff700 1 -- 172.21.15.83:0/742615542 learned_addr learned my addr 172.21.15.83:0/742615542 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:49:21.596 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.955+0000 7f577ffff700 1 -- 172.21.15.83:0/742615542 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5770009550 con 0x7f5780104e10 2024-04-01T06:49:21.596 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.955+0000 7f577ffff700 1 --2- 172.21.15.83:0/742615542 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5780104e10 0x7f578019c440 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5770009130 tx=0x7f5770011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:21.597 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.955+0000 7f577d7fa700 1 -- 172.21.15.83:0/742615542 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5770003b70 con 0x7f5780104e10 2024-04-01T06:49:21.597 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.955+0000 7f577d7fa700 1 -- 172.21.15.83:0/742615542 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5770003cd0 con 0x7f5780104e10 2024-04-01T06:49:21.597 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.955+0000 7f577d7fa700 1 -- 172.21.15.83:0/742615542 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f57700197d0 con 0x7f5780104e10 2024-04-01T06:49:21.597 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.955+0000 7f57865cf700 1 -- 172.21.15.83:0/742615542 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f578019cb80 con 0x7f5780104e10 2024-04-01T06:49:21.597 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.955+0000 7f57865cf700 1 -- 172.21.15.83:0/742615542 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f578019d020 con 0x7f5780104e10 2024-04-01T06:49:21.597 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.956+0000 7f57865cf700 1 -- 172.21.15.83:0/742615542 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5780196190 con 0x7f5780104e10 2024-04-01T06:49:21.597 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.956+0000 7f577d7fa700 1 -- 172.21.15.83:0/742615542 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 8) v1 ==== 45533+0+0 (secure 0 0 0) 0x7f577001abb0 con 0x7f5780104e10 2024-04-01T06:49:21.597 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.956+0000 7f577d7fa700 1 --2- 172.21.15.83:0/742615542 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f5768038750 0x7f576803ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:21.597 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.956+0000 7f577d7fa700 1 -- 172.21.15.83:0/742615542 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f577004cab0 con 0x7f5780104e10 2024-04-01T06:49:21.597 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.957+0000 7f577f7fe700 1 --2- 172.21.15.83:0/742615542 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f5768038750 0x7f576803ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:21.597 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.957+0000 7f577f7fe700 1 --2- 172.21.15.83:0/742615542 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f5768038750 0x7f576803ac10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5774006fd0 tx=0x7f5774006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:21.597 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:18.961+0000 7f577d7fa700 1 -- 172.21.15.83:0/742615542 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f577001a430 con 0x7f5780104e10 2024-04-01T06:49:21.597 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:19.159+0000 7f57865cf700 1 -- 172.21.15.83:0/742615542 --> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi083", "addr": "172.21.15.83", "target": ["mon-mgr", ""]}) v1 -- 0x7f578002cf20 con 0x7f5768038750 2024-04-01T06:49:21.597 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:21.291+0000 7f577d7fa700 1 -- 172.21.15.83:0/742615542 <== mgr.14120 v2:172.21.15.83:6800/1867137261 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f578002cf20 con 0x7f5768038750 2024-04-01T06:49:21.598 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:21.294+0000 7f57865cf700 1 -- 172.21.15.83:0/742615542 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f5768038750 msgr2=0x7f576803ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:21.598 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:21.294+0000 7f57865cf700 1 --2- 172.21.15.83:0/742615542 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f5768038750 0x7f576803ac10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5774006fd0 tx=0x7f5774006e40 comp rx=0 tx=0).stop 2024-04-01T06:49:21.598 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:21.294+0000 7f57865cf700 1 -- 172.21.15.83:0/742615542 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5780104e10 msgr2=0x7f578019c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:21.598 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:21.294+0000 7f57865cf700 1 --2- 172.21.15.83:0/742615542 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5780104e10 0x7f578019c440 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5770009130 tx=0x7f5770011ad0 comp rx=0 tx=0).stop 2024-04-01T06:49:21.598 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:21.294+0000 7f57865cf700 1 -- 172.21.15.83:0/742615542 shutdown_connections 2024-04-01T06:49:21.598 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:21.294+0000 7f57865cf700 1 --2- 172.21.15.83:0/742615542 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f5768038750 0x7f576803ac10 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:21.598 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:21.294+0000 7f57865cf700 1 --2- 172.21.15.83:0/742615542 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5780104e10 0x7f578019c440 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:21.598 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:21.294+0000 7f57865cf700 1 -- 172.21.15.83:0/742615542 >> 172.21.15.83:0/742615542 conn(0x7f57801009f0 msgr2=0x7f57801932d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:49:21.598 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:21.294+0000 7f57865cf700 1 -- 172.21.15.83:0/742615542 shutdown_connections 2024-04-01T06:49:21.598 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:21.294+0000 7f57865cf700 1 -- 172.21.15.83:0/742615542 wait complete. 2024-04-01T06:49:21.598 INFO:teuthology.orchestra.run.smithi083.stdout:Deploying unmanaged mon service... 2024-04-01T06:49:21.847 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:21 smithi083 ceph-mon[43429]: Deploying cephadm binary to smithi083 2024-04-01T06:49:21.847 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:21 smithi083 ceph-mon[43429]: from='mgr.14120 172.21.15.83:0/2619006165' entity='mgr.x' 2024-04-01T06:49:21.847 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:21 smithi083 ceph-mon[43429]: from='mgr.14120 172.21.15.83:0/2619006165' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:49:22.645 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:22 smithi083 ceph-mon[43429]: Added host smithi083 2024-04-01T06:49:22.645 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:22 smithi083 ceph-mon[43429]: from='mgr.14120 172.21.15.83:0/2619006165' entity='mgr.x' 2024-04-01T06:49:22.740 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-04-01T06:49:22.740 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:21.991+0000 7f61c0147700 1 Processor -- start 2024-04-01T06:49:22.740 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:21.991+0000 7f61c0147700 1 -- start start 2024-04-01T06:49:22.740 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:21.991+0000 7f61c0147700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61b807be70 0x7f61b807a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:22.741 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:21.991+0000 7f61c0147700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b807a8f0 con 0x7f61b807be70 2024-04-01T06:49:22.741 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:21.992+0000 7f61bdee3700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61b807be70 0x7f61b807a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:22.741 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:21.992+0000 7f61bdee3700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61b807be70 0x7f61b807a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33240/0 (socket says 172.21.15.83:33240) 2024-04-01T06:49:22.741 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:21.992+0000 7f61bdee3700 1 -- 172.21.15.83:0/2415658650 learned_addr learned my addr 172.21.15.83:0/2415658650 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:49:22.741 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:21.992+0000 7f61bdee3700 1 -- 172.21.15.83:0/2415658650 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b807aa30 con 0x7f61b807be70 2024-04-01T06:49:22.741 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:21.992+0000 7f61bdee3700 1 --2- 172.21.15.83:0/2415658650 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61b807be70 0x7f61b807a320 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f61b40098a0 tx=0x7f61b4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=646f7adb14194392 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:22.741 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:21.992+0000 7f61bcee1700 1 -- 172.21.15.83:0/2415658650 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61b4004160 con 0x7f61b807be70 2024-04-01T06:49:22.741 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:21.993+0000 7f61bcee1700 1 -- 172.21.15.83:0/2415658650 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f61b40042c0 con 0x7f61b807be70 2024-04-01T06:49:22.741 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:21.993+0000 7f61bcee1700 1 -- 172.21.15.83:0/2415658650 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61b4011a00 con 0x7f61b807be70 2024-04-01T06:49:22.741 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:21.993+0000 7f61c0147700 1 -- 172.21.15.83:0/2415658650 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61b807be70 msgr2=0x7f61b807a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:22.741 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:21.993+0000 7f61c0147700 1 --2- 172.21.15.83:0/2415658650 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61b807be70 0x7f61b807a320 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f61b40098a0 tx=0x7f61b4009bb0 comp rx=0 tx=0).stop 2024-04-01T06:49:22.741 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:21.993+0000 7f61c0147700 1 -- 172.21.15.83:0/2415658650 shutdown_connections 2024-04-01T06:49:22.741 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:21.993+0000 7f61c0147700 1 --2- 172.21.15.83:0/2415658650 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61b807be70 0x7f61b807a320 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:22.741 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:21.993+0000 7f61c0147700 1 -- 172.21.15.83:0/2415658650 >> 172.21.15.83:0/2415658650 conn(0x7f61b8101b60 msgr2=0x7f61b8103f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:49:22.742 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:21.993+0000 7f61c0147700 1 -- 172.21.15.83:0/2415658650 shutdown_connections 2024-04-01T06:49:22.742 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:21.993+0000 7f61c0147700 1 -- 172.21.15.83:0/2415658650 wait complete. 2024-04-01T06:49:22.742 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:21.994+0000 7f61c0147700 1 Processor -- start 2024-04-01T06:49:22.742 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:21.994+0000 7f61c0147700 1 -- start start 2024-04-01T06:49:22.742 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:21.994+0000 7f61c0147700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61b807be70 0x7f61b819c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:22.742 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:21.994+0000 7f61c0147700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b819c9b0 con 0x7f61b807be70 2024-04-01T06:49:22.742 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:21.994+0000 7f61bdee3700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61b807be70 0x7f61b819c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:22.742 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:21.994+0000 7f61bdee3700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61b807be70 0x7f61b819c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33244/0 (socket says 172.21.15.83:33244) 2024-04-01T06:49:22.742 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:21.994+0000 7f61bdee3700 1 -- 172.21.15.83:0/504251633 learned_addr learned my addr 172.21.15.83:0/504251633 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:49:22.742 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:21.995+0000 7f61bdee3700 1 -- 172.21.15.83:0/504251633 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b4009550 con 0x7f61b807be70 2024-04-01T06:49:22.742 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:21.995+0000 7f61bdee3700 1 --2- 172.21.15.83:0/504251633 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61b807be70 0x7f61b819c470 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f61b4009fb0 tx=0x7f61b4011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:22.742 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:21.995+0000 7f61aeffd700 1 -- 172.21.15.83:0/504251633 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61b4003a40 con 0x7f61b807be70 2024-04-01T06:49:22.743 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:21.995+0000 7f61aeffd700 1 -- 172.21.15.83:0/504251633 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f61b4003ba0 con 0x7f61b807be70 2024-04-01T06:49:22.743 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:21.995+0000 7f61aeffd700 1 -- 172.21.15.83:0/504251633 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61b401a750 con 0x7f61b807be70 2024-04-01T06:49:22.743 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:21.995+0000 7f61c0147700 1 -- 172.21.15.83:0/504251633 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61b819cbb0 con 0x7f61b807be70 2024-04-01T06:49:22.743 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:21.995+0000 7f61c0147700 1 -- 172.21.15.83:0/504251633 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61b819d050 con 0x7f61b807be70 2024-04-01T06:49:22.743 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:21.996+0000 7f61aeffd700 1 -- 172.21.15.83:0/504251633 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 8) v1 ==== 45533+0+0 (secure 0 0 0) 0x7f61b401a9d0 con 0x7f61b807be70 2024-04-01T06:49:22.743 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:21.996+0000 7f61aeffd700 1 --2- 172.21.15.83:0/504251633 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f61a40386b0 0x7f61a403ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:22.743 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:21.996+0000 7f61c0147700 1 -- 172.21.15.83:0/504251633 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61b810c8d0 con 0x7f61b807be70 2024-04-01T06:49:22.743 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:21.996+0000 7f61aeffd700 1 -- 172.21.15.83:0/504251633 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f61b404c8c0 con 0x7f61b807be70 2024-04-01T06:49:22.743 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:21.996+0000 7f61bd6e2700 1 --2- 172.21.15.83:0/504251633 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f61a40386b0 0x7f61a403ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:22.743 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:21.997+0000 7f61bd6e2700 1 --2- 172.21.15.83:0/504251633 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f61a40386b0 0x7f61a403ab70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f61a8006fd0 tx=0x7f61a8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:22.743 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:22.001+0000 7f61aeffd700 1 -- 172.21.15.83:0/504251633 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f61b4018530 con 0x7f61b807be70 2024-04-01T06:49:22.743 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:22.214+0000 7f61c0147700 1 -- 172.21.15.83:0/504251633 --> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f61b8102e20 con 0x7f61a40386b0 2024-04-01T06:49:22.743 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:22.218+0000 7f61aeffd700 1 -- 172.21.15.83:0/504251633 <== mgr.14120 v2:172.21.15.83:6800/1867137261 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f61b8102e20 con 0x7f61a40386b0 2024-04-01T06:49:22.743 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:22.220+0000 7f61c0147700 1 -- 172.21.15.83:0/504251633 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f61a40386b0 msgr2=0x7f61a403ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:22.743 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:22.220+0000 7f61c0147700 1 --2- 172.21.15.83:0/504251633 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f61a40386b0 0x7f61a403ab70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f61a8006fd0 tx=0x7f61a8006e40 comp rx=0 tx=0).stop 2024-04-01T06:49:22.744 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:22.220+0000 7f61c0147700 1 -- 172.21.15.83:0/504251633 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61b807be70 msgr2=0x7f61b819c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:22.744 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:22.220+0000 7f61c0147700 1 --2- 172.21.15.83:0/504251633 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61b807be70 0x7f61b819c470 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f61b4009fb0 tx=0x7f61b4011ad0 comp rx=0 tx=0).stop 2024-04-01T06:49:22.744 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:22.220+0000 7f61c0147700 1 -- 172.21.15.83:0/504251633 shutdown_connections 2024-04-01T06:49:22.744 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:22.220+0000 7f61c0147700 1 --2- 172.21.15.83:0/504251633 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f61a40386b0 0x7f61a403ab70 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:22.744 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:22.221+0000 7f61c0147700 1 --2- 172.21.15.83:0/504251633 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f61b807be70 0x7f61b819c470 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:22.744 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:22.221+0000 7f61c0147700 1 -- 172.21.15.83:0/504251633 >> 172.21.15.83:0/504251633 conn(0x7f61b8101b60 msgr2=0x7f61b8102710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:49:22.744 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:22.221+0000 7f61c0147700 1 -- 172.21.15.83:0/504251633 shutdown_connections 2024-04-01T06:49:22.744 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:22.221+0000 7f61c0147700 1 -- 172.21.15.83:0/504251633 wait complete. 2024-04-01T06:49:22.744 INFO:teuthology.orchestra.run.smithi083.stdout:Deploying unmanaged mgr service... 2024-04-01T06:49:23.695 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:23 smithi083 ceph-mon[43429]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:49:23.695 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:23 smithi083 ceph-mon[43429]: Saving service mon spec with placement count:5 2024-04-01T06:49:23.695 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:23 smithi083 ceph-mon[43429]: from='mgr.14120 172.21.15.83:0/2619006165' entity='mgr.x' 2024-04-01T06:49:23.696 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:23 smithi083 ceph-mon[43429]: from='mgr.14120 172.21.15.83:0/2619006165' entity='mgr.x' 2024-04-01T06:49:23.696 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:23 smithi083 ceph-mon[43429]: from='mgr.14120 172.21.15.83:0/2619006165' entity='mgr.x' 2024-04-01T06:49:23.915 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-04-01T06:49:23.915 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:23.099+0000 7f67533f3700 1 Processor -- start 2024-04-01T06:49:23.915 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:23.099+0000 7f67533f3700 1 -- start start 2024-04-01T06:49:23.916 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:23.099+0000 7f67533f3700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f674c106fa0 0x7f674c109390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:23.916 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:23.099+0000 7f67533f3700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f674c079eb0 con 0x7f674c106fa0 2024-04-01T06:49:23.916 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:23.100+0000 7f675118f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f674c106fa0 0x7f674c109390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:23.916 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:23.100+0000 7f675118f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f674c106fa0 0x7f674c109390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33246/0 (socket says 172.21.15.83:33246) 2024-04-01T06:49:23.916 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:23.100+0000 7f675118f700 1 -- 172.21.15.83:0/1007890042 learned_addr learned my addr 172.21.15.83:0/1007890042 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:49:23.916 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:23.100+0000 7f675118f700 1 -- 172.21.15.83:0/1007890042 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f674c1098d0 con 0x7f674c106fa0 2024-04-01T06:49:23.916 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:23.100+0000 7f675118f700 1 --2- 172.21.15.83:0/1007890042 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f674c106fa0 0x7f674c109390 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f67480098a0 tx=0x7f6748009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57ca935c09f80d3e server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:23.916 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:23.100+0000 7f6743fff700 1 -- 172.21.15.83:0/1007890042 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6748004160 con 0x7f674c106fa0 2024-04-01T06:49:23.916 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:23.100+0000 7f6743fff700 1 -- 172.21.15.83:0/1007890042 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f67480042c0 con 0x7f674c106fa0 2024-04-01T06:49:23.917 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:23.100+0000 7f6743fff700 1 -- 172.21.15.83:0/1007890042 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f67480119b0 con 0x7f674c106fa0 2024-04-01T06:49:23.917 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:23.101+0000 7f67533f3700 1 -- 172.21.15.83:0/1007890042 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f674c106fa0 msgr2=0x7f674c109390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:23.917 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:23.101+0000 7f67533f3700 1 --2- 172.21.15.83:0/1007890042 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f674c106fa0 0x7f674c109390 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f67480098a0 tx=0x7f6748009bb0 comp rx=0 tx=0).stop 2024-04-01T06:49:23.917 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:23.101+0000 7f67533f3700 1 -- 172.21.15.83:0/1007890042 shutdown_connections 2024-04-01T06:49:23.917 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:23.101+0000 7f67533f3700 1 --2- 172.21.15.83:0/1007890042 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f674c106fa0 0x7f674c109390 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:23.917 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:23.101+0000 7f67533f3700 1 -- 172.21.15.83:0/1007890042 >> 172.21.15.83:0/1007890042 conn(0x7f674c1009f0 msgr2=0x7f674c102e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:49:23.917 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:23.101+0000 7f67533f3700 1 -- 172.21.15.83:0/1007890042 shutdown_connections 2024-04-01T06:49:23.917 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:23.101+0000 7f67533f3700 1 -- 172.21.15.83:0/1007890042 wait complete. 2024-04-01T06:49:23.917 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:23.102+0000 7f67533f3700 1 Processor -- start 2024-04-01T06:49:23.917 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:23.102+0000 7f67533f3700 1 -- start start 2024-04-01T06:49:23.917 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:23.102+0000 7f67533f3700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f674c106fa0 0x7f674c19a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:23.917 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:23.102+0000 7f67533f3700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f674c19a7a0 con 0x7f674c106fa0 2024-04-01T06:49:23.917 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:23.102+0000 7f675118f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f674c106fa0 0x7f674c19a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:23.918 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:23.102+0000 7f675118f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f674c106fa0 0x7f674c19a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33260/0 (socket says 172.21.15.83:33260) 2024-04-01T06:49:23.918 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:23.102+0000 7f675118f700 1 -- 172.21.15.83:0/1593102458 learned_addr learned my addr 172.21.15.83:0/1593102458 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:49:23.918 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:23.103+0000 7f675118f700 1 -- 172.21.15.83:0/1593102458 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6748009550 con 0x7f674c106fa0 2024-04-01T06:49:23.918 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:23.103+0000 7f675118f700 1 --2- 172.21.15.83:0/1593102458 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f674c106fa0 0x7f674c19a260 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6748011670 tx=0x7f6748011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:23.918 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:23.103+0000 7f67427fc700 1 -- 172.21.15.83:0/1593102458 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6748003b20 con 0x7f674c106fa0 2024-04-01T06:49:23.918 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:23.103+0000 7f67427fc700 1 -- 172.21.15.83:0/1593102458 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6748003c80 con 0x7f674c106fa0 2024-04-01T06:49:23.918 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:23.103+0000 7f67533f3700 1 -- 172.21.15.83:0/1593102458 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f674c19a9a0 con 0x7f674c106fa0 2024-04-01T06:49:23.918 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:23.103+0000 7f67427fc700 1 -- 172.21.15.83:0/1593102458 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6748019770 con 0x7f674c106fa0 2024-04-01T06:49:23.918 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:23.103+0000 7f67533f3700 1 -- 172.21.15.83:0/1593102458 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f674c19ae40 con 0x7f674c106fa0 2024-04-01T06:49:23.918 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:23.104+0000 7f67427fc700 1 -- 172.21.15.83:0/1593102458 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 8) v1 ==== 45533+0+0 (secure 0 0 0) 0x7f6748019a90 con 0x7f674c106fa0 2024-04-01T06:49:23.918 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:23.104+0000 7f67427fc700 1 --2- 172.21.15.83:0/1593102458 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f6738038700 0x7f673803abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:23.918 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:23.104+0000 7f67533f3700 1 -- 172.21.15.83:0/1593102458 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f674c10a710 con 0x7f674c106fa0 2024-04-01T06:49:23.918 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:23.104+0000 7f67427fc700 1 -- 172.21.15.83:0/1593102458 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f674804c980 con 0x7f674c106fa0 2024-04-01T06:49:23.919 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:23.104+0000 7f675098e700 1 --2- 172.21.15.83:0/1593102458 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f6738038700 0x7f673803abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:23.919 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:23.105+0000 7f675098e700 1 --2- 172.21.15.83:0/1593102458 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f6738038700 0x7f673803abc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f673c006fd0 tx=0x7f673c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:23.919 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:23.109+0000 7f67427fc700 1 -- 172.21.15.83:0/1593102458 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f6748018db0 con 0x7f674c106fa0 2024-04-01T06:49:23.919 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:23.330+0000 7f67533f3700 1 -- 172.21.15.83:0/1593102458 --> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f674c19d6d0 con 0x7f6738038700 2024-04-01T06:49:23.919 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:23.337+0000 7f67427fc700 1 -- 172.21.15.83:0/1593102458 <== mgr.14120 v2:172.21.15.83:6800/1867137261 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f674c19d6d0 con 0x7f6738038700 2024-04-01T06:49:23.919 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:23.339+0000 7f67533f3700 1 -- 172.21.15.83:0/1593102458 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f6738038700 msgr2=0x7f673803abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:23.919 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:23.339+0000 7f67533f3700 1 --2- 172.21.15.83:0/1593102458 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f6738038700 0x7f673803abc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f673c006fd0 tx=0x7f673c006e40 comp rx=0 tx=0).stop 2024-04-01T06:49:23.919 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:23.339+0000 7f67533f3700 1 -- 172.21.15.83:0/1593102458 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f674c106fa0 msgr2=0x7f674c19a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:23.919 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:23.339+0000 7f67533f3700 1 --2- 172.21.15.83:0/1593102458 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f674c106fa0 0x7f674c19a260 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6748011670 tx=0x7f6748011a30 comp rx=0 tx=0).stop 2024-04-01T06:49:23.919 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:23.340+0000 7f67533f3700 1 -- 172.21.15.83:0/1593102458 shutdown_connections 2024-04-01T06:49:23.919 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:23.340+0000 7f67533f3700 1 --2- 172.21.15.83:0/1593102458 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f6738038700 0x7f673803abc0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:23.919 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:23.340+0000 7f67533f3700 1 --2- 172.21.15.83:0/1593102458 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f674c106fa0 0x7f674c19a260 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:23.919 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:23.340+0000 7f67533f3700 1 -- 172.21.15.83:0/1593102458 >> 172.21.15.83:0/1593102458 conn(0x7f674c1009f0 msgr2=0x7f674c101560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:49:23.920 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:23.340+0000 7f67533f3700 1 -- 172.21.15.83:0/1593102458 shutdown_connections 2024-04-01T06:49:23.920 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:23.340+0000 7f67533f3700 1 -- 172.21.15.83:0/1593102458 wait complete. 2024-04-01T06:49:24.869 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:24 smithi083 ceph-mon[43429]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:49:24.869 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:24 smithi083 ceph-mon[43429]: Saving service mgr spec with placement count:2 2024-04-01T06:49:24.869 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:24 smithi083 ceph-mon[43429]: from='mgr.14120 172.21.15.83:0/2619006165' entity='mgr.x' 2024-04-01T06:49:24.869 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:24 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/2506148749' entity='client.admin' 2024-04-01T06:49:24.906 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:24.331+0000 7f66301a8700 1 Processor -- start 2024-04-01T06:49:24.906 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:24.331+0000 7f66301a8700 1 -- start start 2024-04-01T06:49:24.906 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:24.331+0000 7f66301a8700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6628105480 0x7f66281058a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:24.906 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:24.331+0000 7f66301a8700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6628105e70 con 0x7f6628105480 2024-04-01T06:49:24.906 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:24.332+0000 7f662df44700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6628105480 0x7f66281058a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:24.906 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:24.332+0000 7f662df44700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6628105480 0x7f66281058a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55548/0 (socket says 172.21.15.83:55548) 2024-04-01T06:49:24.906 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:24.332+0000 7f662df44700 1 -- 172.21.15.83:0/386654913 learned_addr learned my addr 172.21.15.83:0/386654913 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:49:24.906 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:24.332+0000 7f662df44700 1 -- 172.21.15.83:0/386654913 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6628106680 con 0x7f6628105480 2024-04-01T06:49:24.906 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:24.332+0000 7f662df44700 1 --2- 172.21.15.83:0/386654913 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6628105480 0x7f66281058a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f66240098a0 tx=0x7f6624009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1850cad85f2b5dd server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:24.906 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:24.332+0000 7f662cf42700 1 -- 172.21.15.83:0/386654913 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6624004160 con 0x7f6628105480 2024-04-01T06:49:24.906 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:24.332+0000 7f662cf42700 1 -- 172.21.15.83:0/386654913 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f66240042c0 con 0x7f6628105480 2024-04-01T06:49:24.906 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:24.332+0000 7f662cf42700 1 -- 172.21.15.83:0/386654913 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f66240119b0 con 0x7f6628105480 2024-04-01T06:49:24.906 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:24.333+0000 7f66301a8700 1 -- 172.21.15.83:0/386654913 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6628105480 msgr2=0x7f66281058a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:24.907 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:24.333+0000 7f66301a8700 1 --2- 172.21.15.83:0/386654913 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6628105480 0x7f66281058a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f66240098a0 tx=0x7f6624009bb0 comp rx=0 tx=0).stop 2024-04-01T06:49:24.907 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:24.333+0000 7f66301a8700 1 -- 172.21.15.83:0/386654913 shutdown_connections 2024-04-01T06:49:24.907 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:24.333+0000 7f66301a8700 1 --2- 172.21.15.83:0/386654913 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6628105480 0x7f66281058a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:24.907 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:24.333+0000 7f66301a8700 1 -- 172.21.15.83:0/386654913 >> 172.21.15.83:0/386654913 conn(0x7f6628100a40 msgr2=0x7f6628102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:49:24.907 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:24.333+0000 7f66301a8700 1 -- 172.21.15.83:0/386654913 shutdown_connections 2024-04-01T06:49:24.907 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:24.333+0000 7f66301a8700 1 -- 172.21.15.83:0/386654913 wait complete. 2024-04-01T06:49:24.907 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:24.334+0000 7f66301a8700 1 Processor -- start 2024-04-01T06:49:24.907 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:24.334+0000 7f66301a8700 1 -- start start 2024-04-01T06:49:24.907 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:24.334+0000 7f66301a8700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6628105480 0x7f6628079a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:24.907 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:24.334+0000 7f66301a8700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6628079f40 con 0x7f6628105480 2024-04-01T06:49:24.907 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:24.334+0000 7f662df44700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6628105480 0x7f6628079a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:24.907 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:24.334+0000 7f662df44700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6628105480 0x7f6628079a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55558/0 (socket says 172.21.15.83:55558) 2024-04-01T06:49:24.908 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:24.334+0000 7f662df44700 1 -- 172.21.15.83:0/2506148749 learned_addr learned my addr 172.21.15.83:0/2506148749 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:49:24.908 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:24.334+0000 7f662df44700 1 -- 172.21.15.83:0/2506148749 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6624009550 con 0x7f6628105480 2024-04-01T06:49:24.908 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:24.335+0000 7f662df44700 1 --2- 172.21.15.83:0/2506148749 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6628105480 0x7f6628079a00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6624003e60 tx=0x7f6624011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:24.908 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:24.335+0000 7f661effd700 1 -- 172.21.15.83:0/2506148749 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6624003a60 con 0x7f6628105480 2024-04-01T06:49:24.908 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:24.335+0000 7f661effd700 1 -- 172.21.15.83:0/2506148749 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6624003bc0 con 0x7f6628105480 2024-04-01T06:49:24.908 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:24.335+0000 7f66301a8700 1 -- 172.21.15.83:0/2506148749 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f662819cfe0 con 0x7f6628105480 2024-04-01T06:49:24.908 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:24.335+0000 7f661effd700 1 -- 172.21.15.83:0/2506148749 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f66240196c0 con 0x7f6628105480 2024-04-01T06:49:24.908 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:24.335+0000 7f66301a8700 1 -- 172.21.15.83:0/2506148749 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f662819d420 con 0x7f6628105480 2024-04-01T06:49:24.908 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:24.336+0000 7f661effd700 1 -- 172.21.15.83:0/2506148749 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 8) v1 ==== 45533+0+0 (secure 0 0 0) 0x7f6624019980 con 0x7f6628105480 2024-04-01T06:49:24.908 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:24.336+0000 7f66301a8700 1 -- 172.21.15.83:0/2506148749 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66281098b0 con 0x7f6628105480 2024-04-01T06:49:24.908 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:24.336+0000 7f661effd700 1 --2- 172.21.15.83:0/2506148749 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f66140386e0 0x7f661403aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:24.908 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:24.336+0000 7f661effd700 1 -- 172.21.15.83:0/2506148749 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f662404ca80 con 0x7f6628105480 2024-04-01T06:49:24.908 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:24.336+0000 7f662d743700 1 --2- 172.21.15.83:0/2506148749 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f66140386e0 0x7f661403aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:24.908 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:24.336+0000 7f662d743700 1 --2- 172.21.15.83:0/2506148749 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f66140386e0 0x7f661403aba0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6618006fd0 tx=0x7f6618006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:24.909 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:24.340+0000 7f661effd700 1 -- 172.21.15.83:0/2506148749 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f6624010bb0 con 0x7f6628105480 2024-04-01T06:49:24.909 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:24.551+0000 7f66301a8700 1 -- 172.21.15.83:0/2506148749 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f6628109ac0 con 0x7f6628105480 2024-04-01T06:49:24.909 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:24.554+0000 7f661effd700 1 -- 172.21.15.83:0/2506148749 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f6624010380 con 0x7f6628105480 2024-04-01T06:49:24.909 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:24.556+0000 7f66301a8700 1 -- 172.21.15.83:0/2506148749 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f66140386e0 msgr2=0x7f661403aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:24.909 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:24.556+0000 7f66301a8700 1 --2- 172.21.15.83:0/2506148749 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f66140386e0 0x7f661403aba0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6618006fd0 tx=0x7f6618006e40 comp rx=0 tx=0).stop 2024-04-01T06:49:24.909 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:24.556+0000 7f66301a8700 1 -- 172.21.15.83:0/2506148749 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6628105480 msgr2=0x7f6628079a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:24.909 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:24.556+0000 7f66301a8700 1 --2- 172.21.15.83:0/2506148749 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6628105480 0x7f6628079a00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6624003e60 tx=0x7f6624011a30 comp rx=0 tx=0).stop 2024-04-01T06:49:24.909 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:24.556+0000 7f66301a8700 1 -- 172.21.15.83:0/2506148749 shutdown_connections 2024-04-01T06:49:24.909 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:24.556+0000 7f66301a8700 1 --2- 172.21.15.83:0/2506148749 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f66140386e0 0x7f661403aba0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:24.909 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:24.556+0000 7f66301a8700 1 --2- 172.21.15.83:0/2506148749 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6628105480 0x7f6628079a00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:24.909 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:24.556+0000 7f66301a8700 1 -- 172.21.15.83:0/2506148749 >> 172.21.15.83:0/2506148749 conn(0x7f6628100a40 msgr2=0x7f6628101530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:49:24.909 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:24.557+0000 7f66301a8700 1 -- 172.21.15.83:0/2506148749 shutdown_connections 2024-04-01T06:49:24.909 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:24.557+0000 7f66301a8700 1 -- 172.21.15.83:0/2506148749 wait complete. 2024-04-01T06:49:26.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:25 smithi083 ceph-mon[43429]: from='mgr.14120 172.21.15.83:0/2619006165' entity='mgr.x' 2024-04-01T06:49:26.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:25 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/211393766' entity='client.admin' 2024-04-01T06:49:26.197 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:25.279+0000 7f613d244700 1 Processor -- start 2024-04-01T06:49:26.198 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:25.279+0000 7f613d244700 1 -- start start 2024-04-01T06:49:26.198 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:25.280+0000 7f613d244700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6138105430 0x7f6138105850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:26.198 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:25.280+0000 7f613d244700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6138105e20 con 0x7f6138105430 2024-04-01T06:49:26.198 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:25.280+0000 7f6136d9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6138105430 0x7f6138105850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:26.198 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:25.280+0000 7f6136d9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6138105430 0x7f6138105850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55572/0 (socket says 172.21.15.83:55572) 2024-04-01T06:49:26.198 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:25.280+0000 7f6136d9d700 1 -- 172.21.15.83:0/1787919464 learned_addr learned my addr 172.21.15.83:0/1787919464 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:49:26.198 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:25.280+0000 7f6136d9d700 1 -- 172.21.15.83:0/1787919464 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6138106630 con 0x7f6138105430 2024-04-01T06:49:26.198 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:25.280+0000 7f6136d9d700 1 --2- 172.21.15.83:0/1787919464 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6138105430 0x7f6138105850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f61200098a0 tx=0x7f6120009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5373b7b65676da74 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:26.198 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:25.280+0000 7f6135d9b700 1 -- 172.21.15.83:0/1787919464 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6120004160 con 0x7f6138105430 2024-04-01T06:49:26.198 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:25.280+0000 7f6135d9b700 1 -- 172.21.15.83:0/1787919464 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f61200042c0 con 0x7f6138105430 2024-04-01T06:49:26.198 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:25.280+0000 7f6135d9b700 1 -- 172.21.15.83:0/1787919464 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61200119b0 con 0x7f6138105430 2024-04-01T06:49:26.199 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:25.281+0000 7f613d244700 1 -- 172.21.15.83:0/1787919464 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6138105430 msgr2=0x7f6138105850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:26.199 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:25.281+0000 7f613d244700 1 --2- 172.21.15.83:0/1787919464 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6138105430 0x7f6138105850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f61200098a0 tx=0x7f6120009bb0 comp rx=0 tx=0).stop 2024-04-01T06:49:26.199 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:25.281+0000 7f613d244700 1 -- 172.21.15.83:0/1787919464 shutdown_connections 2024-04-01T06:49:26.199 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:25.281+0000 7f613d244700 1 --2- 172.21.15.83:0/1787919464 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6138105430 0x7f6138105850 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:26.199 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:25.281+0000 7f613d244700 1 -- 172.21.15.83:0/1787919464 >> 172.21.15.83:0/1787919464 conn(0x7f61381009f0 msgr2=0x7f6138102e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:49:26.199 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:25.281+0000 7f613d244700 1 -- 172.21.15.83:0/1787919464 shutdown_connections 2024-04-01T06:49:26.199 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:25.281+0000 7f613d244700 1 -- 172.21.15.83:0/1787919464 wait complete. 2024-04-01T06:49:26.199 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:25.282+0000 7f613d244700 1 Processor -- start 2024-04-01T06:49:26.199 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:25.282+0000 7f613d244700 1 -- start start 2024-04-01T06:49:26.199 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:25.282+0000 7f613d244700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6138105430 0x7f6138079a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:26.199 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:25.282+0000 7f613d244700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6138079f60 con 0x7f6138105430 2024-04-01T06:49:26.199 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:25.282+0000 7f6136d9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6138105430 0x7f6138079a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:26.200 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:25.282+0000 7f6136d9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6138105430 0x7f6138079a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55586/0 (socket says 172.21.15.83:55586) 2024-04-01T06:49:26.200 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:25.282+0000 7f6136d9d700 1 -- 172.21.15.83:0/211393766 learned_addr learned my addr 172.21.15.83:0/211393766 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:49:26.200 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:25.282+0000 7f6136d9d700 1 -- 172.21.15.83:0/211393766 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6120009550 con 0x7f6138105430 2024-04-01T06:49:26.200 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:25.283+0000 7f6136d9d700 1 --2- 172.21.15.83:0/211393766 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6138105430 0x7f6138079a20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6120006af0 tx=0x7f6120011a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:26.200 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:25.283+0000 7f612ffff700 1 -- 172.21.15.83:0/211393766 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6120003a40 con 0x7f6138105430 2024-04-01T06:49:26.200 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:25.283+0000 7f613d244700 1 -- 172.21.15.83:0/211393766 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f613819cff0 con 0x7f6138105430 2024-04-01T06:49:26.200 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:25.283+0000 7f612ffff700 1 -- 172.21.15.83:0/211393766 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6120003ba0 con 0x7f6138105430 2024-04-01T06:49:26.200 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:25.283+0000 7f612ffff700 1 -- 172.21.15.83:0/211393766 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6120019690 con 0x7f6138105430 2024-04-01T06:49:26.200 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:25.283+0000 7f613d244700 1 -- 172.21.15.83:0/211393766 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f613819d490 con 0x7f6138105430 2024-04-01T06:49:26.200 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:25.284+0000 7f612ffff700 1 -- 172.21.15.83:0/211393766 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 8) v1 ==== 45533+0+0 (secure 0 0 0) 0x7f6120019950 con 0x7f6138105430 2024-04-01T06:49:26.200 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:25.284+0000 7f613d244700 1 -- 172.21.15.83:0/211393766 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6138109820 con 0x7f6138105430 2024-04-01T06:49:26.200 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:25.284+0000 7f612ffff700 1 --2- 172.21.15.83:0/211393766 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f61240386b0 0x7f612403ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:26.200 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:25.284+0000 7f612ffff700 1 -- 172.21.15.83:0/211393766 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f612004c690 con 0x7f6138105430 2024-04-01T06:49:26.200 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:25.284+0000 7f613659c700 1 --2- 172.21.15.83:0/211393766 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f61240386b0 0x7f612403ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:26.201 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:25.284+0000 7f613659c700 1 --2- 172.21.15.83:0/211393766 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f61240386b0 0x7f612403ab70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6128006fd0 tx=0x7f6128006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:26.201 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:25.288+0000 7f612ffff700 1 -- 172.21.15.83:0/211393766 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f6120023b40 con 0x7f6138105430 2024-04-01T06:49:26.201 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:25.491+0000 7f613d244700 1 -- 172.21.15.83:0/211393766 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f6138109a60 con 0x7f6138105430 2024-04-01T06:49:26.201 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:25.495+0000 7f612ffff700 1 -- 172.21.15.83:0/211393766 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f6120023b40 con 0x7f6138105430 2024-04-01T06:49:26.201 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:25.498+0000 7f613d244700 1 -- 172.21.15.83:0/211393766 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f61240386b0 msgr2=0x7f612403ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:26.201 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:25.498+0000 7f613d244700 1 --2- 172.21.15.83:0/211393766 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f61240386b0 0x7f612403ab70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6128006fd0 tx=0x7f6128006e40 comp rx=0 tx=0).stop 2024-04-01T06:49:26.201 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:25.498+0000 7f613d244700 1 -- 172.21.15.83:0/211393766 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6138105430 msgr2=0x7f6138079a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:26.201 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:25.498+0000 7f613d244700 1 --2- 172.21.15.83:0/211393766 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6138105430 0x7f6138079a20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6120006af0 tx=0x7f6120011a10 comp rx=0 tx=0).stop 2024-04-01T06:49:26.201 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:25.498+0000 7f613d244700 1 -- 172.21.15.83:0/211393766 shutdown_connections 2024-04-01T06:49:26.201 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:25.498+0000 7f613d244700 1 --2- 172.21.15.83:0/211393766 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f61240386b0 0x7f612403ab70 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:26.201 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:25.498+0000 7f613d244700 1 --2- 172.21.15.83:0/211393766 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6138105430 0x7f6138079a20 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:26.201 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:25.498+0000 7f613d244700 1 -- 172.21.15.83:0/211393766 >> 172.21.15.83:0/211393766 conn(0x7f61381009f0 msgr2=0x7f61381015c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:49:26.201 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:25.498+0000 7f613d244700 1 -- 172.21.15.83:0/211393766 shutdown_connections 2024-04-01T06:49:26.201 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:25.498+0000 7f613d244700 1 -- 172.21.15.83:0/211393766 wait complete. 2024-04-01T06:49:26.202 INFO:teuthology.orchestra.run.smithi083.stdout:Enabling the dashboard module... 2024-04-01T06:49:27.136 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:26 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/1448471619' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-04-01T06:49:27.137 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:26 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: ignoring --setuser ceph since I am not root 2024-04-01T06:49:27.137 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:26 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: ignoring --setgroup ceph since I am not root 2024-04-01T06:49:27.247 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:26.554+0000 7f4b7fd06700 1 Processor -- start 2024-04-01T06:49:27.247 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:26.554+0000 7f4b7fd06700 1 -- start start 2024-04-01T06:49:27.247 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:26.554+0000 7f4b7fd06700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b78107060 0x7f4b78109450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:27.247 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:26.554+0000 7f4b7fd06700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b78079df0 con 0x7f4b78107060 2024-04-01T06:49:27.247 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:26.554+0000 7f4b7daa2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b78107060 0x7f4b78109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:27.248 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:26.554+0000 7f4b7daa2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b78107060 0x7f4b78109450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55592/0 (socket says 172.21.15.83:55592) 2024-04-01T06:49:27.248 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:26.554+0000 7f4b7daa2700 1 -- 172.21.15.83:0/3872100512 learned_addr learned my addr 172.21.15.83:0/3872100512 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:49:27.248 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:26.555+0000 7f4b7daa2700 1 -- 172.21.15.83:0/3872100512 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b78079f30 con 0x7f4b78107060 2024-04-01T06:49:27.248 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:26.555+0000 7f4b7daa2700 1 --2- 172.21.15.83:0/3872100512 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b78107060 0x7f4b78109450 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4b740098a0 tx=0x7f4b74009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfe564db9aef31bf server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:27.248 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:26.555+0000 7f4b7caa0700 1 -- 172.21.15.83:0/3872100512 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b74004160 con 0x7f4b78107060 2024-04-01T06:49:27.248 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:26.555+0000 7f4b7caa0700 1 -- 172.21.15.83:0/3872100512 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4b740042c0 con 0x7f4b78107060 2024-04-01T06:49:27.248 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:26.555+0000 7f4b7caa0700 1 -- 172.21.15.83:0/3872100512 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b740119b0 con 0x7f4b78107060 2024-04-01T06:49:27.248 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:26.555+0000 7f4b7fd06700 1 -- 172.21.15.83:0/3872100512 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b78107060 msgr2=0x7f4b78109450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:27.248 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:26.555+0000 7f4b7fd06700 1 --2- 172.21.15.83:0/3872100512 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b78107060 0x7f4b78109450 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4b740098a0 tx=0x7f4b74009bb0 comp rx=0 tx=0).stop 2024-04-01T06:49:27.248 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:26.555+0000 7f4b7fd06700 1 -- 172.21.15.83:0/3872100512 shutdown_connections 2024-04-01T06:49:27.248 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:26.555+0000 7f4b7fd06700 1 --2- 172.21.15.83:0/3872100512 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b78107060 0x7f4b78109450 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:27.248 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:26.555+0000 7f4b7fd06700 1 -- 172.21.15.83:0/3872100512 >> 172.21.15.83:0/3872100512 conn(0x7f4b781009f0 msgr2=0x7f4b78102e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:49:27.248 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:26.556+0000 7f4b7fd06700 1 -- 172.21.15.83:0/3872100512 shutdown_connections 2024-04-01T06:49:27.248 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:26.556+0000 7f4b7fd06700 1 -- 172.21.15.83:0/3872100512 wait complete. 2024-04-01T06:49:27.249 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:26.556+0000 7f4b7fd06700 1 Processor -- start 2024-04-01T06:49:27.249 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:26.556+0000 7f4b7fd06700 1 -- start start 2024-04-01T06:49:27.249 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:26.556+0000 7f4b7fd06700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b78107060 0x7f4b78106890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:27.249 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:26.556+0000 7f4b7fd06700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b78106dd0 con 0x7f4b78107060 2024-04-01T06:49:27.249 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:26.556+0000 7f4b7daa2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b78107060 0x7f4b78106890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:27.249 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:26.556+0000 7f4b7daa2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b78107060 0x7f4b78106890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55606/0 (socket says 172.21.15.83:55606) 2024-04-01T06:49:27.249 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:26.556+0000 7f4b7daa2700 1 -- 172.21.15.83:0/1448471619 learned_addr learned my addr 172.21.15.83:0/1448471619 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:49:27.249 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:26.557+0000 7f4b7daa2700 1 -- 172.21.15.83:0/1448471619 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b74009550 con 0x7f4b78107060 2024-04-01T06:49:27.249 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:26.557+0000 7f4b7daa2700 1 --2- 172.21.15.83:0/1448471619 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b78107060 0x7f4b78106890 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4b74011670 tx=0x7f4b74011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:27.249 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:26.557+0000 7f4b6effd700 1 -- 172.21.15.83:0/1448471619 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b74003b20 con 0x7f4b78107060 2024-04-01T06:49:27.249 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:26.557+0000 7f4b6effd700 1 -- 172.21.15.83:0/1448471619 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4b74003c80 con 0x7f4b78107060 2024-04-01T06:49:27.249 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:26.557+0000 7f4b7fd06700 1 -- 172.21.15.83:0/1448471619 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b78105010 con 0x7f4b78107060 2024-04-01T06:49:27.249 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:26.557+0000 7f4b6effd700 1 -- 172.21.15.83:0/1448471619 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b74019770 con 0x7f4b78107060 2024-04-01T06:49:27.249 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:26.557+0000 7f4b7fd06700 1 -- 172.21.15.83:0/1448471619 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b781054b0 con 0x7f4b78107060 2024-04-01T06:49:27.249 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:26.558+0000 7f4b6effd700 1 -- 172.21.15.83:0/1448471619 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 8) v1 ==== 45533+0+0 (secure 0 0 0) 0x7f4b740199e0 con 0x7f4b78107060 2024-04-01T06:49:27.250 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:26.558+0000 7f4b7fd06700 1 -- 172.21.15.83:0/1448471619 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b7810a700 con 0x7f4b78107060 2024-04-01T06:49:27.250 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:26.558+0000 7f4b6effd700 1 --2- 172.21.15.83:0/1448471619 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f4b64038750 0x7f4b6403ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:27.250 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:26.558+0000 7f4b6effd700 1 -- 172.21.15.83:0/1448471619 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f4b7404cb20 con 0x7f4b78107060 2024-04-01T06:49:27.250 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:26.558+0000 7f4b7d2a1700 1 --2- 172.21.15.83:0/1448471619 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f4b64038750 0x7f4b6403ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:27.250 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:26.558+0000 7f4b7d2a1700 1 --2- 172.21.15.83:0/1448471619 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f4b64038750 0x7f4b6403ac10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4b68006fd0 tx=0x7f4b68006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:27.250 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:26.563+0000 7f4b6effd700 1 -- 172.21.15.83:0/1448471619 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f4b740189a0 con 0x7f4b78107060 2024-04-01T06:49:27.250 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:26.811+0000 7f4b7fd06700 1 -- 172.21.15.83:0/1448471619 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f4b7810a940 con 0x7f4b78107060 2024-04-01T06:49:27.250 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:26.871+0000 7f4b6effd700 1 -- 172.21.15.83:0/1448471619 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mgrmap(e 9) v1 ==== 45546+0+0 (secure 0 0 0) 0x7f4b7400b900 con 0x7f4b78107060 2024-04-01T06:49:27.250 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:26.872+0000 7f4b6effd700 1 -- 172.21.15.83:0/1448471619 <== mon.0 v2:172.21.15.83:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f4b7402d8d0 con 0x7f4b78107060 2024-04-01T06:49:27.250 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:26.874+0000 7f4b7fd06700 1 -- 172.21.15.83:0/1448471619 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f4b64038750 msgr2=0x7f4b6403ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:27.250 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:26.874+0000 7f4b7fd06700 1 --2- 172.21.15.83:0/1448471619 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f4b64038750 0x7f4b6403ac10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4b68006fd0 tx=0x7f4b68006e40 comp rx=0 tx=0).stop 2024-04-01T06:49:27.250 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:26.874+0000 7f4b7fd06700 1 -- 172.21.15.83:0/1448471619 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b78107060 msgr2=0x7f4b78106890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:27.251 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:26.874+0000 7f4b7fd06700 1 --2- 172.21.15.83:0/1448471619 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b78107060 0x7f4b78106890 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4b74011670 tx=0x7f4b74011a30 comp rx=0 tx=0).stop 2024-04-01T06:49:27.251 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:26.874+0000 7f4b7fd06700 1 -- 172.21.15.83:0/1448471619 shutdown_connections 2024-04-01T06:49:27.251 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:26.874+0000 7f4b7fd06700 1 --2- 172.21.15.83:0/1448471619 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7f4b64038750 0x7f4b6403ac10 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:27.251 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:26.874+0000 7f4b7fd06700 1 --2- 172.21.15.83:0/1448471619 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b78107060 0x7f4b78106890 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:27.251 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:26.874+0000 7f4b7fd06700 1 -- 172.21.15.83:0/1448471619 >> 172.21.15.83:0/1448471619 conn(0x7f4b781009f0 msgr2=0x7f4b78101550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:49:27.251 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:26.874+0000 7f4b7fd06700 1 -- 172.21.15.83:0/1448471619 shutdown_connections 2024-04-01T06:49:27.251 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:26.874+0000 7f4b7fd06700 1 -- 172.21.15.83:0/1448471619 wait complete. 2024-04-01T06:49:27.405 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:27 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:49:27.322+0000 7f62d9de7200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-01T06:49:27.762 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:27 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:49:27.422+0000 7f62d9de7200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-01T06:49:27.762 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:27 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:49:27.511+0000 7f62d9de7200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-01T06:49:27.762 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:27 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:49:27.599+0000 7f62d9de7200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-01T06:49:28.194 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:27 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/1448471619' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-04-01T06:49:28.194 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:27 smithi083 ceph-mon[43429]: mgrmap e9: x(active, since 13s) 2024-04-01T06:49:28.290 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout { 2024-04-01T06:49:28.290 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-04-01T06:49:28.290 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-01T06:49:28.290 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-04-01T06:49:28.290 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-01T06:49:28.290 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout } 2024-04-01T06:49:28.290 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:27.627+0000 7ff585a7c700 1 Processor -- start 2024-04-01T06:49:28.290 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:27.627+0000 7ff585a7c700 1 -- start start 2024-04-01T06:49:28.290 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:27.627+0000 7ff585a7c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff580106530 0x7ff580106950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:28.290 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:27.627+0000 7ff585a7c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff580106f20 con 0x7ff580106530 2024-04-01T06:49:28.290 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:27.628+0000 7ff57f7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff580106530 0x7ff580106950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:28.291 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:27.628+0000 7ff57f7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff580106530 0x7ff580106950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55622/0 (socket says 172.21.15.83:55622) 2024-04-01T06:49:28.291 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:27.628+0000 7ff57f7fe700 1 -- 172.21.15.83:0/1494487599 learned_addr learned my addr 172.21.15.83:0/1494487599 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:49:28.291 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:27.628+0000 7ff57f7fe700 1 -- 172.21.15.83:0/1494487599 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff580107730 con 0x7ff580106530 2024-04-01T06:49:28.291 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:27.628+0000 7ff57f7fe700 1 --2- 172.21.15.83:0/1494487599 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff580106530 0x7ff580106950 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff5700098a0 tx=0x7ff570009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceefc23e81b78652 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:28.291 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:27.628+0000 7ff57e7fc700 1 -- 172.21.15.83:0/1494487599 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff570004160 con 0x7ff580106530 2024-04-01T06:49:28.291 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:27.628+0000 7ff57e7fc700 1 -- 172.21.15.83:0/1494487599 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff5700042c0 con 0x7ff580106530 2024-04-01T06:49:28.291 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:27.628+0000 7ff57e7fc700 1 -- 172.21.15.83:0/1494487599 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5700119b0 con 0x7ff580106530 2024-04-01T06:49:28.291 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:27.629+0000 7ff585a7c700 1 -- 172.21.15.83:0/1494487599 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff580106530 msgr2=0x7ff580106950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:28.291 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:27.629+0000 7ff585a7c700 1 --2- 172.21.15.83:0/1494487599 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff580106530 0x7ff580106950 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff5700098a0 tx=0x7ff570009bb0 comp rx=0 tx=0).stop 2024-04-01T06:49:28.291 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:27.629+0000 7ff585a7c700 1 -- 172.21.15.83:0/1494487599 shutdown_connections 2024-04-01T06:49:28.291 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:27.629+0000 7ff585a7c700 1 --2- 172.21.15.83:0/1494487599 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff580106530 0x7ff580106950 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:28.291 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:27.629+0000 7ff585a7c700 1 -- 172.21.15.83:0/1494487599 >> 172.21.15.83:0/1494487599 conn(0x7ff580101b30 msgr2=0x7ff580103f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:49:28.291 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:27.629+0000 7ff585a7c700 1 -- 172.21.15.83:0/1494487599 shutdown_connections 2024-04-01T06:49:28.292 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:27.630+0000 7ff585a7c700 1 -- 172.21.15.83:0/1494487599 wait complete. 2024-04-01T06:49:28.292 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:27.630+0000 7ff585a7c700 1 Processor -- start 2024-04-01T06:49:28.292 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:27.631+0000 7ff585a7c700 1 -- start start 2024-04-01T06:49:28.292 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:27.631+0000 7ff585a7c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff580106530 0x7ff58019a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:28.292 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:27.631+0000 7ff585a7c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58019a7e0 con 0x7ff580106530 2024-04-01T06:49:28.292 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:27.631+0000 7ff57f7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff580106530 0x7ff58019a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:28.292 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:27.631+0000 7ff57f7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff580106530 0x7ff58019a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55634/0 (socket says 172.21.15.83:55634) 2024-04-01T06:49:28.292 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:27.631+0000 7ff57f7fe700 1 -- 172.21.15.83:0/2154508707 learned_addr learned my addr 172.21.15.83:0/2154508707 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:49:28.292 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:27.631+0000 7ff57f7fe700 1 -- 172.21.15.83:0/2154508707 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff570009550 con 0x7ff580106530 2024-04-01T06:49:28.292 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:27.631+0000 7ff57f7fe700 1 --2- 172.21.15.83:0/2154508707 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff580106530 0x7ff58019a2a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff570006af0 tx=0x7ff570011a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:28.292 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:27.631+0000 7ff57cff9700 1 -- 172.21.15.83:0/2154508707 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff570003a40 con 0x7ff580106530 2024-04-01T06:49:28.292 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:27.631+0000 7ff57cff9700 1 -- 172.21.15.83:0/2154508707 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff570003ba0 con 0x7ff580106530 2024-04-01T06:49:28.292 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:27.631+0000 7ff585a7c700 1 -- 172.21.15.83:0/2154508707 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff58019a9e0 con 0x7ff580106530 2024-04-01T06:49:28.292 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:27.631+0000 7ff57cff9700 1 -- 172.21.15.83:0/2154508707 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff570019690 con 0x7ff580106530 2024-04-01T06:49:28.293 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:27.632+0000 7ff585a7c700 1 -- 172.21.15.83:0/2154508707 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff58019ae80 con 0x7ff580106530 2024-04-01T06:49:28.293 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:27.632+0000 7ff57cff9700 1 -- 172.21.15.83:0/2154508707 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 9) v1 ==== 45546+0+0 (secure 0 0 0) 0x7ff570019900 con 0x7ff580106530 2024-04-01T06:49:28.293 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:27.633+0000 7ff57cff9700 1 --2- 172.21.15.83:0/2154508707 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7ff568038750 0x7ff56803ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:28.293 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:27.633+0000 7ff57cff9700 1 -- 172.21.15.83:0/2154508707 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7ff57004c740 con 0x7ff580106530 2024-04-01T06:49:28.293 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:27.633+0000 7ff585a7c700 1 -- 172.21.15.83:0/2154508707 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff58010a960 con 0x7ff580106530 2024-04-01T06:49:28.293 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:27.633+0000 7ff57effd700 1 -- 172.21.15.83:0/2154508707 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7ff568038750 msgr2=0x7ff56803ac10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.83:6800/1867137261 2024-04-01T06:49:28.293 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:27.633+0000 7ff57effd700 1 --2- 172.21.15.83:0/2154508707 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7ff568038750 0x7ff56803ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-01T06:49:28.293 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:27.637+0000 7ff57cff9700 1 -- 172.21.15.83:0/2154508707 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7ff5700243f0 con 0x7ff580106530 2024-04-01T06:49:28.293 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:27.834+0000 7ff57effd700 1 -- 172.21.15.83:0/2154508707 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7ff568038750 msgr2=0x7ff56803ac10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.83:6800/1867137261 2024-04-01T06:49:28.293 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:27.834+0000 7ff57effd700 1 --2- 172.21.15.83:0/2154508707 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7ff568038750 0x7ff56803ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-01T06:49:28.293 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:27.894+0000 7ff585a7c700 1 -- 172.21.15.83:0/2154508707 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7ff58019d710 con 0x7ff580106530 2024-04-01T06:49:28.293 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:27.894+0000 7ff57cff9700 1 -- 172.21.15.83:0/2154508707 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+88 (secure 0 0 0) 0x7ff570023390 con 0x7ff580106530 2024-04-01T06:49:28.293 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:27.896+0000 7ff585a7c700 1 -- 172.21.15.83:0/2154508707 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7ff568038750 msgr2=0x7ff56803ac10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-01T06:49:28.293 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:27.896+0000 7ff585a7c700 1 --2- 172.21.15.83:0/2154508707 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7ff568038750 0x7ff56803ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:28.294 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:27.896+0000 7ff585a7c700 1 -- 172.21.15.83:0/2154508707 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff580106530 msgr2=0x7ff58019a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:28.294 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:27.896+0000 7ff585a7c700 1 --2- 172.21.15.83:0/2154508707 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff580106530 0x7ff58019a2a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff570006af0 tx=0x7ff570011a10 comp rx=0 tx=0).stop 2024-04-01T06:49:28.294 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:27.897+0000 7ff585a7c700 1 -- 172.21.15.83:0/2154508707 shutdown_connections 2024-04-01T06:49:28.294 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:27.897+0000 7ff585a7c700 1 --2- 172.21.15.83:0/2154508707 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7ff568038750 0x7ff56803ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:28.294 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:27.897+0000 7ff585a7c700 1 --2- 172.21.15.83:0/2154508707 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff580106530 0x7ff58019a2a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:28.294 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:27.897+0000 7ff585a7c700 1 -- 172.21.15.83:0/2154508707 >> 172.21.15.83:0/2154508707 conn(0x7ff580101b30 msgr2=0x7ff5801026e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:49:28.294 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:27.897+0000 7ff585a7c700 1 -- 172.21.15.83:0/2154508707 shutdown_connections 2024-04-01T06:49:28.294 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:27.897+0000 7ff585a7c700 1 -- 172.21.15.83:0/2154508707 wait complete. 2024-04-01T06:49:28.294 INFO:teuthology.orchestra.run.smithi083.stdout:Waiting for the mgr to restart... 2024-04-01T06:49:28.294 INFO:teuthology.orchestra.run.smithi083.stdout:Waiting for mgr epoch 9... 2024-04-01T06:49:28.512 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:28 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:49:28.250+0000 7f62d9de7200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-01T06:49:28.870 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:28 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:49:28.516+0000 7f62d9de7200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-01T06:49:28.931 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:28 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:49:28.608+0000 7f62d9de7200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-01T06:49:28.931 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:28 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:49:28.720+0000 7f62d9de7200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-01T06:49:29.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:28 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/2154508707' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-01T06:49:29.262 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:28 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:49:28.878+0000 7f62d9de7200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-01T06:49:29.263 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:29 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:49:29.004+0000 7f62d9de7200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-01T06:49:29.263 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:29 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:49:29.089+0000 7f62d9de7200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-01T06:49:29.762 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:29 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:49:29.465+0000 7f62d9de7200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-01T06:49:30.136 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:29 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:49:29.850+0000 7f62d9de7200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-01T06:49:30.137 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:30 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:49:30.044+0000 7f62d9de7200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-01T06:49:30.137 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:30 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:49:30.137+0000 7f62d9de7200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-01T06:49:31.262 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:30 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:49:30.896+0000 7f62d9de7200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-01T06:49:31.262 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:30 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:49:30.994+0000 7f62d9de7200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-01T06:49:31.262 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:31 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:49:31.142+0000 7f62d9de7200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-01T06:49:32.143 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:31 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:49:31.767+0000 7f62d9de7200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-01T06:49:32.143 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:31 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:49:31.948+0000 7f62d9de7200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-01T06:49:32.143 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:32 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:49:32.143+0000 7f62d9de7200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-01T06:49:33.361 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:33 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:49:33.072+0000 7f62d9de7200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-01T06:49:33.641 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:33 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:49:33.362+0000 7f62d9de7200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-01T06:49:33.641 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:33 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:49:33.450+0000 7f62d9de7200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-01T06:49:34.012 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:49:33 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:49:33.641+0000 7f62d9de7200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-01T06:49:34.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:33 smithi083 ceph-mon[43429]: Active manager daemon x restarted 2024-04-01T06:49:34.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:33 smithi083 ceph-mon[43429]: Activating manager daemon x 2024-04-01T06:49:34.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:33 smithi083 ceph-mon[43429]: osdmap e3: 0 total, 0 up, 0 in 2024-04-01T06:49:34.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:33 smithi083 ceph-mon[43429]: mgrmap e10: x(active, starting, since 0.00321114s) 2024-04-01T06:49:34.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:33 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T06:49:34.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:33 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-01T06:49:34.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:33 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-01T06:49:34.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:33 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-01T06:49:34.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:33 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-01T06:49:34.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:33 smithi083 ceph-mon[43429]: Manager daemon x is now available 2024-04-01T06:49:34.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:33 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:49:35.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:34 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-01T06:49:35.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:34 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-01T06:49:35.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:34 smithi083 ceph-mon[43429]: [01/Apr/2024:06:49:33] ENGINE Bus STARTING 2024-04-01T06:49:35.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:34 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:49:35.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:34 smithi083 ceph-mon[43429]: mgrmap e11: x(active, since 1.00772s) 2024-04-01T06:49:35.198 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout { 2024-04-01T06:49:35.198 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-04-01T06:49:35.198 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-01T06:49:35.198 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout } 2024-04-01T06:49:35.198 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:28.645+0000 7fb1a3e5a700 1 Processor -- start 2024-04-01T06:49:35.198 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:28.645+0000 7fb1a3e5a700 1 -- start start 2024-04-01T06:49:35.199 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:28.645+0000 7fb1a3e5a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb19c105480 0x7fb19c1058a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:35.199 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:28.645+0000 7fb1a3e5a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19c105e70 con 0x7fb19c105480 2024-04-01T06:49:35.199 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:28.645+0000 7fb1a1bf6700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb19c105480 0x7fb19c1058a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:35.199 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:28.646+0000 7fb1a1bf6700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb19c105480 0x7fb19c1058a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55636/0 (socket says 172.21.15.83:55636) 2024-04-01T06:49:35.199 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:28.646+0000 7fb1a1bf6700 1 -- 172.21.15.83:0/1785558813 learned_addr learned my addr 172.21.15.83:0/1785558813 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:49:35.199 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:28.646+0000 7fb1a1bf6700 1 -- 172.21.15.83:0/1785558813 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb19c106680 con 0x7fb19c105480 2024-04-01T06:49:35.199 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:28.646+0000 7fb1a1bf6700 1 --2- 172.21.15.83:0/1785558813 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb19c105480 0x7fb19c1058a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb1980098a0 tx=0x7fb198009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdd686b8a6f772fd server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:35.199 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:28.646+0000 7fb1a0bf4700 1 -- 172.21.15.83:0/1785558813 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb198004160 con 0x7fb19c105480 2024-04-01T06:49:35.199 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:28.646+0000 7fb1a0bf4700 1 -- 172.21.15.83:0/1785558813 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb1980042c0 con 0x7fb19c105480 2024-04-01T06:49:35.199 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:28.646+0000 7fb1a0bf4700 1 -- 172.21.15.83:0/1785558813 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb1980119b0 con 0x7fb19c105480 2024-04-01T06:49:35.199 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:28.647+0000 7fb1a3e5a700 1 -- 172.21.15.83:0/1785558813 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb19c105480 msgr2=0x7fb19c1058a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:35.199 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:28.647+0000 7fb1a3e5a700 1 --2- 172.21.15.83:0/1785558813 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb19c105480 0x7fb19c1058a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb1980098a0 tx=0x7fb198009bb0 comp rx=0 tx=0).stop 2024-04-01T06:49:35.199 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:28.647+0000 7fb1a3e5a700 1 -- 172.21.15.83:0/1785558813 shutdown_connections 2024-04-01T06:49:35.200 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:28.647+0000 7fb1a3e5a700 1 --2- 172.21.15.83:0/1785558813 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb19c105480 0x7fb19c1058a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:35.200 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:28.647+0000 7fb1a3e5a700 1 -- 172.21.15.83:0/1785558813 >> 172.21.15.83:0/1785558813 conn(0x7fb19c100a40 msgr2=0x7fb19c102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:49:35.200 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:28.647+0000 7fb1a3e5a700 1 -- 172.21.15.83:0/1785558813 shutdown_connections 2024-04-01T06:49:35.200 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:28.647+0000 7fb1a3e5a700 1 -- 172.21.15.83:0/1785558813 wait complete. 2024-04-01T06:49:35.200 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:28.648+0000 7fb1a3e5a700 1 Processor -- start 2024-04-01T06:49:35.200 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:28.648+0000 7fb1a3e5a700 1 -- start start 2024-04-01T06:49:35.200 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:28.648+0000 7fb1a3e5a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb19c105480 0x7fb19c1991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:35.200 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:28.648+0000 7fb1a3e5a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19c199710 con 0x7fb19c105480 2024-04-01T06:49:35.200 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:28.648+0000 7fb1a1bf6700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb19c105480 0x7fb19c1991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:35.200 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:28.648+0000 7fb1a1bf6700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb19c105480 0x7fb19c1991d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55646/0 (socket says 172.21.15.83:55646) 2024-04-01T06:49:35.200 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:28.648+0000 7fb1a1bf6700 1 -- 172.21.15.83:0/895542504 learned_addr learned my addr 172.21.15.83:0/895542504 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:49:35.200 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:28.648+0000 7fb1a1bf6700 1 -- 172.21.15.83:0/895542504 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb198009550 con 0x7fb19c105480 2024-04-01T06:49:35.201 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:28.649+0000 7fb1a1bf6700 1 --2- 172.21.15.83:0/895542504 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb19c105480 0x7fb19c1991d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb198006af0 tx=0x7fb198011a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:35.201 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:28.649+0000 7fb192ffd700 1 -- 172.21.15.83:0/895542504 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb198003a40 con 0x7fb19c105480 2024-04-01T06:49:35.201 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:28.649+0000 7fb1a3e5a700 1 -- 172.21.15.83:0/895542504 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb19c199910 con 0x7fb19c105480 2024-04-01T06:49:35.201 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:28.649+0000 7fb192ffd700 1 -- 172.21.15.83:0/895542504 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb198003ba0 con 0x7fb19c105480 2024-04-01T06:49:35.201 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:28.649+0000 7fb192ffd700 1 -- 172.21.15.83:0/895542504 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb198019690 con 0x7fb19c105480 2024-04-01T06:49:35.201 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:28.649+0000 7fb1a3e5a700 1 -- 172.21.15.83:0/895542504 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb19c199db0 con 0x7fb19c105480 2024-04-01T06:49:35.201 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:28.649+0000 7fb192ffd700 1 -- 172.21.15.83:0/895542504 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 9) v1 ==== 45546+0+0 (secure 0 0 0) 0x7fb198019950 con 0x7fb19c105480 2024-04-01T06:49:35.201 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:28.650+0000 7fb192ffd700 1 --2- 172.21.15.83:0/895542504 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7fb188038700 0x7fb18803abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:35.201 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:28.650+0000 7fb1a3e5a700 1 -- 172.21.15.83:0/895542504 --> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb19c1098b0 con 0x7fb188038700 2024-04-01T06:49:35.201 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:28.650+0000 7fb192ffd700 1 -- 172.21.15.83:0/895542504 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fb19801a430 con 0x7fb19c105480 2024-04-01T06:49:35.201 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:28.650+0000 7fb1a13f5700 1 -- 172.21.15.83:0/895542504 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7fb188038700 msgr2=0x7fb18803abc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.83:6800/1867137261 2024-04-01T06:49:35.201 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:28.650+0000 7fb1a13f5700 1 --2- 172.21.15.83:0/895542504 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7fb188038700 0x7fb18803abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-01T06:49:35.201 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:28.851+0000 7fb1a13f5700 1 -- 172.21.15.83:0/895542504 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7fb188038700 msgr2=0x7fb18803abc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.83:6800/1867137261 2024-04-01T06:49:35.201 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:28.851+0000 7fb1a13f5700 1 --2- 172.21.15.83:0/895542504 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7fb188038700 0x7fb18803abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-01T06:49:35.202 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:29.252+0000 7fb1a13f5700 1 -- 172.21.15.83:0/895542504 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7fb188038700 msgr2=0x7fb18803abc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.83:6800/1867137261 2024-04-01T06:49:35.202 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:29.252+0000 7fb1a13f5700 1 --2- 172.21.15.83:0/895542504 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7fb188038700 0x7fb18803abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-01T06:49:35.202 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:30.053+0000 7fb1a13f5700 1 -- 172.21.15.83:0/895542504 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7fb188038700 msgr2=0x7fb18803abc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.83:6800/1867137261 2024-04-01T06:49:35.202 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:30.053+0000 7fb1a13f5700 1 --2- 172.21.15.83:0/895542504 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7fb188038700 0x7fb18803abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-01T06:49:35.202 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:31.655+0000 7fb1a13f5700 1 -- 172.21.15.83:0/895542504 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7fb188038700 msgr2=0x7fb18803abc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.83:6800/1867137261 2024-04-01T06:49:35.202 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:31.655+0000 7fb1a13f5700 1 --2- 172.21.15.83:0/895542504 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7fb188038700 0x7fb18803abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-01T06:49:35.202 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:33.657+0000 7fb192ffd700 1 -- 172.21.15.83:0/895542504 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mgrmap(e 10) v1 ==== 45313+0+0 (secure 0 0 0) 0x7fb198019cf0 con 0x7fb19c105480 2024-04-01T06:49:35.202 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:33.657+0000 7fb192ffd700 1 -- 172.21.15.83:0/895542504 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7fb188038700 msgr2=0x7fb18803abc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-01T06:49:35.203 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:33.657+0000 7fb192ffd700 1 --2- 172.21.15.83:0/895542504 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7fb188038700 0x7fb18803abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:35.203 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:34.661+0000 7fb192ffd700 1 -- 172.21.15.83:0/895542504 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mgrmap(e 11) v1 ==== 45440+0+0 (secure 0 0 0) 0x7fb19802dcd0 con 0x7fb19c105480 2024-04-01T06:49:35.203 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:34.661+0000 7fb192ffd700 1 --2- 172.21.15.83:0/895542504 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fb18803bfc0 0x7fb18803e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:35.203 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:34.661+0000 7fb192ffd700 1 -- 172.21.15.83:0/895542504 --> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb19c1098b0 con 0x7fb18803bfc0 2024-04-01T06:49:35.203 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:34.661+0000 7fb1a13f5700 1 --2- 172.21.15.83:0/895542504 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fb18803bfc0 0x7fb18803e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:35.203 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:34.662+0000 7fb1a13f5700 1 --2- 172.21.15.83:0/895542504 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fb18803bfc0 0x7fb18803e3b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fb18c003a10 tx=0x7fb18c0092b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:35.203 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:34.662+0000 7fb192ffd700 1 -- 172.21.15.83:0/895542504 <== mgr.14152 v2:172.21.15.83:6800/3375372052 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7fb19c1098b0 con 0x7fb18803bfc0 2024-04-01T06:49:35.203 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:34.668+0000 7fb1a3e5a700 1 -- 172.21.15.83:0/895542504 --> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fb19c109a20 con 0x7fb18803bfc0 2024-04-01T06:49:35.203 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:34.669+0000 7fb192ffd700 1 -- 172.21.15.83:0/895542504 <== mgr.14152 v2:172.21.15.83:6800/3375372052 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7fb19c109a20 con 0x7fb18803bfc0 2024-04-01T06:49:35.203 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:34.669+0000 7fb1a3e5a700 1 -- 172.21.15.83:0/895542504 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fb18803bfc0 msgr2=0x7fb18803e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:35.203 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:34.669+0000 7fb1a3e5a700 1 --2- 172.21.15.83:0/895542504 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fb18803bfc0 0x7fb18803e3b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fb18c003a10 tx=0x7fb18c0092b0 comp rx=0 tx=0).stop 2024-04-01T06:49:35.203 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:34.669+0000 7fb1a3e5a700 1 -- 172.21.15.83:0/895542504 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb19c105480 msgr2=0x7fb19c1991d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:35.204 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:34.669+0000 7fb1a3e5a700 1 --2- 172.21.15.83:0/895542504 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb19c105480 0x7fb19c1991d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb198006af0 tx=0x7fb198011a10 comp rx=0 tx=0).stop 2024-04-01T06:49:35.204 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:34.669+0000 7fb1a3e5a700 1 -- 172.21.15.83:0/895542504 shutdown_connections 2024-04-01T06:49:35.204 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:34.669+0000 7fb1a3e5a700 1 --2- 172.21.15.83:0/895542504 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fb18803bfc0 0x7fb18803e3b0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:35.204 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:34.669+0000 7fb1a3e5a700 1 --2- 172.21.15.83:0/895542504 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb19c105480 0x7fb19c1991d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:35.204 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:34.669+0000 7fb1a3e5a700 1 --2- 172.21.15.83:0/895542504 >> [v2:172.21.15.83:6800/1867137261,v1:172.21.15.83:6801/1867137261] conn(0x7fb188038700 0x7fb18803abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:35.204 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:34.669+0000 7fb1a3e5a700 1 -- 172.21.15.83:0/895542504 >> 172.21.15.83:0/895542504 conn(0x7fb19c100a40 msgr2=0x7fb19c1015a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:49:35.204 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:34.669+0000 7fb1a3e5a700 1 -- 172.21.15.83:0/895542504 shutdown_connections 2024-04-01T06:49:35.204 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:34.669+0000 7fb1a3e5a700 1 -- 172.21.15.83:0/895542504 wait complete. 2024-04-01T06:49:35.204 INFO:teuthology.orchestra.run.smithi083.stdout:mgr epoch 9 is available 2024-04-01T06:49:35.204 INFO:teuthology.orchestra.run.smithi083.stdout:Generating a dashboard self-signed certificate... 2024-04-01T06:49:35.940 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:35 smithi083 ceph-mon[43429]: [01/Apr/2024:06:49:34] ENGINE Serving on https://172.21.15.83:7150 2024-04-01T06:49:35.940 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:35 smithi083 ceph-mon[43429]: [01/Apr/2024:06:49:34] ENGINE Serving on http://172.21.15.83:8765 2024-04-01T06:49:35.940 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:35 smithi083 ceph-mon[43429]: [01/Apr/2024:06:49:34] ENGINE Bus STARTED 2024-04-01T06:49:35.940 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:35 smithi083 ceph-mon[43429]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-01T06:49:35.940 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:35 smithi083 ceph-mon[43429]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-01T06:49:35.940 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:35 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:49:36.421 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-04-01T06:49:36.421 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:35.545+0000 7f454bd28700 1 Processor -- start 2024-04-01T06:49:36.421 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:35.545+0000 7f454bd28700 1 -- start start 2024-04-01T06:49:36.421 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:35.546+0000 7f454bd28700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4544107020 0x7f4544109410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:36.422 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:35.546+0000 7f454bd28700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4544079e70 con 0x7f4544107020 2024-04-01T06:49:36.422 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:35.546+0000 7f4549ac4700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4544107020 0x7f4544109410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:36.422 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:35.546+0000 7f4549ac4700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4544107020 0x7f4544109410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:45686/0 (socket says 172.21.15.83:45686) 2024-04-01T06:49:36.422 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:35.546+0000 7f4549ac4700 1 -- 172.21.15.83:0/449234174 learned_addr learned my addr 172.21.15.83:0/449234174 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:49:36.422 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:35.546+0000 7f4549ac4700 1 -- 172.21.15.83:0/449234174 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4544109950 con 0x7f4544107020 2024-04-01T06:49:36.422 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:35.546+0000 7f4549ac4700 1 --2- 172.21.15.83:0/449234174 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4544107020 0x7f4544109410 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f45400098a0 tx=0x7f4540009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91b5b94a1c5ace65 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:36.422 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:35.546+0000 7f4548ac2700 1 -- 172.21.15.83:0/449234174 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4540004160 con 0x7f4544107020 2024-04-01T06:49:36.422 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:35.546+0000 7f4548ac2700 1 -- 172.21.15.83:0/449234174 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f45400042c0 con 0x7f4544107020 2024-04-01T06:49:36.422 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:35.546+0000 7f4548ac2700 1 -- 172.21.15.83:0/449234174 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45400119b0 con 0x7f4544107020 2024-04-01T06:49:36.422 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:35.547+0000 7f454bd28700 1 -- 172.21.15.83:0/449234174 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4544107020 msgr2=0x7f4544109410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:36.422 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:35.547+0000 7f454bd28700 1 --2- 172.21.15.83:0/449234174 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4544107020 0x7f4544109410 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f45400098a0 tx=0x7f4540009bb0 comp rx=0 tx=0).stop 2024-04-01T06:49:36.422 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:35.547+0000 7f454bd28700 1 -- 172.21.15.83:0/449234174 shutdown_connections 2024-04-01T06:49:36.422 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:35.547+0000 7f454bd28700 1 --2- 172.21.15.83:0/449234174 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4544107020 0x7f4544109410 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:36.422 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:35.547+0000 7f454bd28700 1 -- 172.21.15.83:0/449234174 >> 172.21.15.83:0/449234174 conn(0x7f4544100a50 msgr2=0x7f4544102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:49:36.423 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:35.547+0000 7f454bd28700 1 -- 172.21.15.83:0/449234174 shutdown_connections 2024-04-01T06:49:36.423 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:35.547+0000 7f454bd28700 1 -- 172.21.15.83:0/449234174 wait complete. 2024-04-01T06:49:36.423 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:35.548+0000 7f454bd28700 1 Processor -- start 2024-04-01T06:49:36.423 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:35.548+0000 7f454bd28700 1 -- start start 2024-04-01T06:49:36.423 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:35.548+0000 7f454bd28700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4544107020 0x7f45441980d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:36.423 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:35.548+0000 7f454bd28700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4544198610 con 0x7f4544107020 2024-04-01T06:49:36.423 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:35.548+0000 7f4549ac4700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4544107020 0x7f45441980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:36.423 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:35.548+0000 7f4549ac4700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4544107020 0x7f45441980d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:45700/0 (socket says 172.21.15.83:45700) 2024-04-01T06:49:36.423 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:35.548+0000 7f4549ac4700 1 -- 172.21.15.83:0/446279556 learned_addr learned my addr 172.21.15.83:0/446279556 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:49:36.423 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:35.549+0000 7f4549ac4700 1 -- 172.21.15.83:0/446279556 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4540009550 con 0x7f4544107020 2024-04-01T06:49:36.423 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:35.549+0000 7f4549ac4700 1 --2- 172.21.15.83:0/446279556 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4544107020 0x7f45441980d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4540006af0 tx=0x7f4540011a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:36.423 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:35.549+0000 7f453affd700 1 -- 172.21.15.83:0/446279556 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4540003a40 con 0x7f4544107020 2024-04-01T06:49:36.423 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:35.549+0000 7f453affd700 1 -- 172.21.15.83:0/446279556 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4540003ba0 con 0x7f4544107020 2024-04-01T06:49:36.424 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:35.549+0000 7f454bd28700 1 -- 172.21.15.83:0/446279556 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4544198810 con 0x7f4544107020 2024-04-01T06:49:36.424 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:35.549+0000 7f453affd700 1 -- 172.21.15.83:0/446279556 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45400196c0 con 0x7f4544107020 2024-04-01T06:49:36.424 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:35.549+0000 7f454bd28700 1 -- 172.21.15.83:0/446279556 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4544198cb0 con 0x7f4544107020 2024-04-01T06:49:36.424 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:35.550+0000 7f453affd700 1 -- 172.21.15.83:0/446279556 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 11) v1 ==== 45440+0+0 (secure 0 0 0) 0x7f4540019980 con 0x7f4544107020 2024-04-01T06:49:36.424 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:35.550+0000 7f454bd28700 1 -- 172.21.15.83:0/446279556 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f454410a730 con 0x7f4544107020 2024-04-01T06:49:36.424 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:35.551+0000 7f453affd700 1 --2- 172.21.15.83:0/446279556 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f4530038630 0x7f453003aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:36.424 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:35.551+0000 7f453affd700 1 -- 172.21.15.83:0/446279556 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f454004d8f0 con 0x7f4544107020 2024-04-01T06:49:36.424 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:35.551+0000 7f45492c3700 1 --2- 172.21.15.83:0/446279556 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f4530038630 0x7f453003aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:36.424 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:35.551+0000 7f45492c3700 1 --2- 172.21.15.83:0/446279556 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f4530038630 0x7f453003aaf0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4534006fd0 tx=0x7f4534006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:36.424 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:35.555+0000 7f453affd700 1 -- 172.21.15.83:0/446279556 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f4540018760 con 0x7f4544107020 2024-04-01T06:49:36.424 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:35.767+0000 7f454bd28700 1 -- 172.21.15.83:0/446279556 --> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f4544101c00 con 0x7f4530038630 2024-04-01T06:49:36.424 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:35.914+0000 7f453affd700 1 -- 172.21.15.83:0/446279556 <== mgr.14152 v2:172.21.15.83:6800/3375372052 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f4544101c00 con 0x7f4530038630 2024-04-01T06:49:36.424 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:35.916+0000 7f454bd28700 1 -- 172.21.15.83:0/446279556 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f4530038630 msgr2=0x7f453003aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:36.424 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:35.916+0000 7f454bd28700 1 --2- 172.21.15.83:0/446279556 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f4530038630 0x7f453003aaf0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4534006fd0 tx=0x7f4534006e40 comp rx=0 tx=0).stop 2024-04-01T06:49:36.424 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:35.916+0000 7f454bd28700 1 -- 172.21.15.83:0/446279556 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4544107020 msgr2=0x7f45441980d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:36.425 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:35.916+0000 7f454bd28700 1 --2- 172.21.15.83:0/446279556 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4544107020 0x7f45441980d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4540006af0 tx=0x7f4540011a10 comp rx=0 tx=0).stop 2024-04-01T06:49:36.425 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:35.916+0000 7f454bd28700 1 -- 172.21.15.83:0/446279556 shutdown_connections 2024-04-01T06:49:36.425 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:35.916+0000 7f454bd28700 1 --2- 172.21.15.83:0/446279556 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f4530038630 0x7f453003aaf0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:36.425 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:35.916+0000 7f454bd28700 1 --2- 172.21.15.83:0/446279556 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4544107020 0x7f45441980d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:36.425 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:35.916+0000 7f454bd28700 1 -- 172.21.15.83:0/446279556 >> 172.21.15.83:0/446279556 conn(0x7f4544100a50 msgr2=0x7f45441014f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:49:36.425 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:35.916+0000 7f454bd28700 1 -- 172.21.15.83:0/446279556 shutdown_connections 2024-04-01T06:49:36.425 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:35.916+0000 7f454bd28700 1 -- 172.21.15.83:0/446279556 wait complete. 2024-04-01T06:49:36.425 INFO:teuthology.orchestra.run.smithi083.stdout:Creating initial admin user... 2024-04-01T06:49:37.253 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:36 smithi083 ceph-mon[43429]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:49:37.253 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:36 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:49:37.253 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:36 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:49:37.253 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:36 smithi083 ceph-mon[43429]: mgrmap e12: x(active, since 2s) 2024-04-01T06:49:37.613 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$BfUFFbeYfG9t.eMxAdYzkORDdqC4um.vanE7AzCSDg/JEEFxTms2q", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1711954177, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-04-01T06:49:37.613 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:36.793+0000 7efc0b387700 1 Processor -- start 2024-04-01T06:49:37.613 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:36.793+0000 7efc0b387700 1 -- start start 2024-04-01T06:49:37.613 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:36.793+0000 7efc0b387700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc04104e30 0x7efc04105250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:37.613 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:36.793+0000 7efc0b387700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc04079e50 con 0x7efc04104e30 2024-04-01T06:49:37.613 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:36.793+0000 7efc09123700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc04104e30 0x7efc04105250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:37.613 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:36.793+0000 7efc09123700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc04104e30 0x7efc04105250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:45716/0 (socket says 172.21.15.83:45716) 2024-04-01T06:49:37.613 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:36.793+0000 7efc09123700 1 -- 172.21.15.83:0/478718542 learned_addr learned my addr 172.21.15.83:0/478718542 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:49:37.614 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:36.794+0000 7efc09123700 1 -- 172.21.15.83:0/478718542 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc04105790 con 0x7efc04104e30 2024-04-01T06:49:37.614 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:36.794+0000 7efc09123700 1 --2- 172.21.15.83:0/478718542 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc04104e30 0x7efc04105250 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efc000098a0 tx=0x7efc00009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85e5a2d536b66575 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:37.614 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:36.794+0000 7efbfbfff700 1 -- 172.21.15.83:0/478718542 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efc00004160 con 0x7efc04104e30 2024-04-01T06:49:37.614 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:36.794+0000 7efbfbfff700 1 -- 172.21.15.83:0/478718542 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efc000042c0 con 0x7efc04104e30 2024-04-01T06:49:37.614 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:36.794+0000 7efbfbfff700 1 -- 172.21.15.83:0/478718542 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efc000119b0 con 0x7efc04104e30 2024-04-01T06:49:37.614 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:36.794+0000 7efc0b387700 1 -- 172.21.15.83:0/478718542 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc04104e30 msgr2=0x7efc04105250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:37.614 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:36.794+0000 7efc0b387700 1 --2- 172.21.15.83:0/478718542 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc04104e30 0x7efc04105250 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efc000098a0 tx=0x7efc00009bb0 comp rx=0 tx=0).stop 2024-04-01T06:49:37.614 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:36.795+0000 7efc0b387700 1 -- 172.21.15.83:0/478718542 shutdown_connections 2024-04-01T06:49:37.614 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:36.795+0000 7efc0b387700 1 --2- 172.21.15.83:0/478718542 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc04104e30 0x7efc04105250 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:37.614 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:36.795+0000 7efc0b387700 1 -- 172.21.15.83:0/478718542 >> 172.21.15.83:0/478718542 conn(0x7efc04100a50 msgr2=0x7efc04102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:49:37.614 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:36.795+0000 7efc0b387700 1 -- 172.21.15.83:0/478718542 shutdown_connections 2024-04-01T06:49:37.614 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:36.795+0000 7efc0b387700 1 -- 172.21.15.83:0/478718542 wait complete. 2024-04-01T06:49:37.615 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:36.795+0000 7efc0b387700 1 Processor -- start 2024-04-01T06:49:37.615 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:36.795+0000 7efc0b387700 1 -- start start 2024-04-01T06:49:37.615 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:36.795+0000 7efc0b387700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc04104e30 0x7efc0419c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:37.615 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:36.795+0000 7efc0b387700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc0419c9b0 con 0x7efc04104e30 2024-04-01T06:49:37.615 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:36.795+0000 7efc09123700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc04104e30 0x7efc0419c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:37.615 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:36.795+0000 7efc09123700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc04104e30 0x7efc0419c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:45722/0 (socket says 172.21.15.83:45722) 2024-04-01T06:49:37.615 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:36.796+0000 7efc09123700 1 -- 172.21.15.83:0/1118881493 learned_addr learned my addr 172.21.15.83:0/1118881493 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:49:37.615 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:36.796+0000 7efc09123700 1 -- 172.21.15.83:0/1118881493 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc00009550 con 0x7efc04104e30 2024-04-01T06:49:37.615 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:36.796+0000 7efc09123700 1 --2- 172.21.15.83:0/1118881493 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc04104e30 0x7efc0419c470 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efc00006af0 tx=0x7efc00011a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:37.615 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:36.796+0000 7efbfa7fc700 1 -- 172.21.15.83:0/1118881493 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efc00003a40 con 0x7efc04104e30 2024-04-01T06:49:37.615 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:36.796+0000 7efbfa7fc700 1 -- 172.21.15.83:0/1118881493 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efc00003ba0 con 0x7efc04104e30 2024-04-01T06:49:37.615 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:36.796+0000 7efc0b387700 1 -- 172.21.15.83:0/1118881493 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc0419cbb0 con 0x7efc04104e30 2024-04-01T06:49:37.615 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:36.796+0000 7efbfa7fc700 1 -- 172.21.15.83:0/1118881493 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efc000196c0 con 0x7efc04104e30 2024-04-01T06:49:37.615 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:36.796+0000 7efc0b387700 1 -- 172.21.15.83:0/1118881493 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc0419d050 con 0x7efc04104e30 2024-04-01T06:49:37.616 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:36.797+0000 7efbfa7fc700 1 -- 172.21.15.83:0/1118881493 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 12) v1 ==== 45546+0+0 (secure 0 0 0) 0x7efc0001a430 con 0x7efc04104e30 2024-04-01T06:49:37.616 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:36.797+0000 7efbfa7fc700 1 --2- 172.21.15.83:0/1118881493 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7efbf0038750 0x7efbf003ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:37.616 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:36.797+0000 7efc0b387700 1 -- 172.21.15.83:0/1118881493 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc04196200 con 0x7efc04104e30 2024-04-01T06:49:37.616 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:36.797+0000 7efbfa7fc700 1 -- 172.21.15.83:0/1118881493 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7efc0004cae0 con 0x7efc04104e30 2024-04-01T06:49:37.616 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:36.797+0000 7efc08922700 1 --2- 172.21.15.83:0/1118881493 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7efbf0038750 0x7efbf003ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:37.616 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:36.797+0000 7efc08922700 1 --2- 172.21.15.83:0/1118881493 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7efbf0038750 0x7efbf003ac10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efbf4006fd0 tx=0x7efbf4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:37.616 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:36.802+0000 7efbfa7fc700 1 -- 172.21.15.83:0/1118881493 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7efc0002d430 con 0x7efc04104e30 2024-04-01T06:49:37.616 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:37.010+0000 7efc0b387700 1 -- 172.21.15.83:0/1118881493 --> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7efc04106700 con 0x7efbf0038750 2024-04-01T06:49:37.616 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:37.232+0000 7efbfa7fc700 1 -- 172.21.15.83:0/1118881493 <== mgr.14152 v2:172.21.15.83:6800/3375372052 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7efc04106700 con 0x7efbf0038750 2024-04-01T06:49:37.616 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:37.234+0000 7efc0b387700 1 -- 172.21.15.83:0/1118881493 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7efbf0038750 msgr2=0x7efbf003ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:37.616 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:37.234+0000 7efc0b387700 1 --2- 172.21.15.83:0/1118881493 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7efbf0038750 0x7efbf003ac10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efbf4006fd0 tx=0x7efbf4006e40 comp rx=0 tx=0).stop 2024-04-01T06:49:37.616 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:37.234+0000 7efc0b387700 1 -- 172.21.15.83:0/1118881493 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc04104e30 msgr2=0x7efc0419c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:37.616 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:37.234+0000 7efc0b387700 1 --2- 172.21.15.83:0/1118881493 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc04104e30 0x7efc0419c470 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efc00006af0 tx=0x7efc00011a10 comp rx=0 tx=0).stop 2024-04-01T06:49:37.617 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:37.234+0000 7efc0b387700 1 -- 172.21.15.83:0/1118881493 shutdown_connections 2024-04-01T06:49:37.617 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:37.234+0000 7efc0b387700 1 --2- 172.21.15.83:0/1118881493 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7efbf0038750 0x7efbf003ac10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:37.617 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:37.234+0000 7efc0b387700 1 --2- 172.21.15.83:0/1118881493 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc04104e30 0x7efc0419c470 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:37.617 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:37.234+0000 7efc0b387700 1 -- 172.21.15.83:0/1118881493 >> 172.21.15.83:0/1118881493 conn(0x7efc04100a50 msgr2=0x7efc04193340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:49:37.617 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:37.234+0000 7efc0b387700 1 -- 172.21.15.83:0/1118881493 shutdown_connections 2024-04-01T06:49:37.617 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:37.234+0000 7efc0b387700 1 -- 172.21.15.83:0/1118881493 wait complete. 2024-04-01T06:49:37.617 INFO:teuthology.orchestra.run.smithi083.stdout:Fetching dashboard port number... 2024-04-01T06:49:38.483 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:38 smithi083 ceph-mon[43429]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:49:38.483 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:38 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:49:38.483 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:38 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/2827251651' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-04-01T06:49:38.574 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout 8443 2024-04-01T06:49:38.579 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.023+0000 7f51b78e3700 1 Processor -- start 2024-04-01T06:49:38.580 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.023+0000 7f51b78e3700 1 -- start start 2024-04-01T06:49:38.580 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.023+0000 7f51b78e3700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51b0107020 0x7f51b0109410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:38.580 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.023+0000 7f51b78e3700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b0079e30 con 0x7f51b0107020 2024-04-01T06:49:38.580 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.024+0000 7f51b567f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51b0107020 0x7f51b0109410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:38.580 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.024+0000 7f51b567f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51b0107020 0x7f51b0109410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:45736/0 (socket says 172.21.15.83:45736) 2024-04-01T06:49:38.580 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.024+0000 7f51b567f700 1 -- 172.21.15.83:0/793955000 learned_addr learned my addr 172.21.15.83:0/793955000 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:49:38.580 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.024+0000 7f51b567f700 1 -- 172.21.15.83:0/793955000 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b0109950 con 0x7f51b0107020 2024-04-01T06:49:38.580 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.024+0000 7f51b567f700 1 --2- 172.21.15.83:0/793955000 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51b0107020 0x7f51b0109410 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f51ac0098a0 tx=0x7f51ac009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91035759a0ac6ca9 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:38.580 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.024+0000 7f51a7fff700 1 -- 172.21.15.83:0/793955000 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f51ac004160 con 0x7f51b0107020 2024-04-01T06:49:38.580 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.024+0000 7f51a7fff700 1 -- 172.21.15.83:0/793955000 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f51ac0042c0 con 0x7f51b0107020 2024-04-01T06:49:38.580 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.024+0000 7f51a7fff700 1 -- 172.21.15.83:0/793955000 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f51ac0119b0 con 0x7f51b0107020 2024-04-01T06:49:38.580 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.025+0000 7f51b78e3700 1 -- 172.21.15.83:0/793955000 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51b0107020 msgr2=0x7f51b0109410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:38.580 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.025+0000 7f51b78e3700 1 --2- 172.21.15.83:0/793955000 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51b0107020 0x7f51b0109410 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f51ac0098a0 tx=0x7f51ac009bb0 comp rx=0 tx=0).stop 2024-04-01T06:49:38.580 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.025+0000 7f51b78e3700 1 -- 172.21.15.83:0/793955000 shutdown_connections 2024-04-01T06:49:38.581 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.025+0000 7f51b78e3700 1 --2- 172.21.15.83:0/793955000 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51b0107020 0x7f51b0109410 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:38.581 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.025+0000 7f51b78e3700 1 -- 172.21.15.83:0/793955000 >> 172.21.15.83:0/793955000 conn(0x7f51b01009f0 msgr2=0x7f51b0102e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:49:38.581 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.025+0000 7f51b78e3700 1 -- 172.21.15.83:0/793955000 shutdown_connections 2024-04-01T06:49:38.581 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.025+0000 7f51b78e3700 1 -- 172.21.15.83:0/793955000 wait complete. 2024-04-01T06:49:38.581 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.025+0000 7f51b78e3700 1 Processor -- start 2024-04-01T06:49:38.581 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.026+0000 7f51b78e3700 1 -- start start 2024-04-01T06:49:38.581 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.026+0000 7f51b78e3700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51b0107020 0x7f51b019a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:38.581 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.026+0000 7f51b78e3700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b019a780 con 0x7f51b0107020 2024-04-01T06:49:38.581 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.026+0000 7f51b567f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51b0107020 0x7f51b019a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:38.581 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.026+0000 7f51b567f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51b0107020 0x7f51b019a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:45742/0 (socket says 172.21.15.83:45742) 2024-04-01T06:49:38.581 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.026+0000 7f51b567f700 1 -- 172.21.15.83:0/2827251651 learned_addr learned my addr 172.21.15.83:0/2827251651 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:49:38.581 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.026+0000 7f51b567f700 1 -- 172.21.15.83:0/2827251651 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ac009550 con 0x7f51b0107020 2024-04-01T06:49:38.581 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.026+0000 7f51b567f700 1 --2- 172.21.15.83:0/2827251651 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51b0107020 0x7f51b019a240 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f51ac006af0 tx=0x7f51ac011a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:38.581 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.026+0000 7f51a67fc700 1 -- 172.21.15.83:0/2827251651 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f51ac003a40 con 0x7f51b0107020 2024-04-01T06:49:38.581 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.026+0000 7f51a67fc700 1 -- 172.21.15.83:0/2827251651 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f51ac003ba0 con 0x7f51b0107020 2024-04-01T06:49:38.582 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.026+0000 7f51b78e3700 1 -- 172.21.15.83:0/2827251651 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51b019a980 con 0x7f51b0107020 2024-04-01T06:49:38.582 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.026+0000 7f51a67fc700 1 -- 172.21.15.83:0/2827251651 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f51ac0196c0 con 0x7f51b0107020 2024-04-01T06:49:38.582 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.026+0000 7f51b78e3700 1 -- 172.21.15.83:0/2827251651 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51b019ae20 con 0x7f51b0107020 2024-04-01T06:49:38.582 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.027+0000 7f51b78e3700 1 -- 172.21.15.83:0/2827251651 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51b010a6e0 con 0x7f51b0107020 2024-04-01T06:49:38.582 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.027+0000 7f51a67fc700 1 -- 172.21.15.83:0/2827251651 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 12) v1 ==== 45546+0+0 (secure 0 0 0) 0x7f51ac01aa80 con 0x7f51b0107020 2024-04-01T06:49:38.582 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.028+0000 7f51a67fc700 1 --2- 172.21.15.83:0/2827251651 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f519c038700 0x7f519c03abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:38.582 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.028+0000 7f51a67fc700 1 -- 172.21.15.83:0/2827251651 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f51ac04cc80 con 0x7f51b0107020 2024-04-01T06:49:38.582 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.028+0000 7f51b4e7e700 1 --2- 172.21.15.83:0/2827251651 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f519c038700 0x7f519c03abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:38.582 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.028+0000 7f51b4e7e700 1 --2- 172.21.15.83:0/2827251651 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f519c038700 0x7f519c03abc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f51a0006fd0 tx=0x7f51a0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:38.582 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.032+0000 7f51a67fc700 1 -- 172.21.15.83:0/2827251651 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f51ac01a430 con 0x7f51b0107020 2024-04-01T06:49:38.582 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.221+0000 7f51b78e3700 1 -- 172.21.15.83:0/2827251651 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f51b019d6b0 con 0x7f51b0107020 2024-04-01T06:49:38.582 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.221+0000 7f51a67fc700 1 -- 172.21.15.83:0/2827251651 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f51ac023390 con 0x7f51b0107020 2024-04-01T06:49:38.582 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.223+0000 7f51b78e3700 1 -- 172.21.15.83:0/2827251651 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f519c038700 msgr2=0x7f519c03abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:38.583 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.223+0000 7f51b78e3700 1 --2- 172.21.15.83:0/2827251651 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f519c038700 0x7f519c03abc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f51a0006fd0 tx=0x7f51a0006e40 comp rx=0 tx=0).stop 2024-04-01T06:49:38.583 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.223+0000 7f51b78e3700 1 -- 172.21.15.83:0/2827251651 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51b0107020 msgr2=0x7f51b019a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:38.583 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.223+0000 7f51b78e3700 1 --2- 172.21.15.83:0/2827251651 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51b0107020 0x7f51b019a240 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f51ac006af0 tx=0x7f51ac011a10 comp rx=0 tx=0).stop 2024-04-01T06:49:38.583 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.223+0000 7f51b78e3700 1 -- 172.21.15.83:0/2827251651 shutdown_connections 2024-04-01T06:49:38.583 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.223+0000 7f51b78e3700 1 --2- 172.21.15.83:0/2827251651 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f519c038700 0x7f519c03abc0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:38.583 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.224+0000 7f51b78e3700 1 --2- 172.21.15.83:0/2827251651 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f51b0107020 0x7f51b019a240 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:38.583 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.224+0000 7f51b78e3700 1 -- 172.21.15.83:0/2827251651 >> 172.21.15.83:0/2827251651 conn(0x7f51b01009f0 msgr2=0x7f51b0101560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:49:38.583 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.224+0000 7f51b78e3700 1 -- 172.21.15.83:0/2827251651 shutdown_connections 2024-04-01T06:49:38.583 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.224+0000 7f51b78e3700 1 -- 172.21.15.83:0/2827251651 wait complete. 2024-04-01T06:49:38.586 INFO:teuthology.orchestra.run.smithi083.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-01T06:49:38.586 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stdout disabled 2024-04-01T06:49:38.593 INFO:teuthology.orchestra.run.smithi083.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-01T06:49:38.593 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stdout inactive 2024-04-01T06:49:38.593 INFO:teuthology.orchestra.run.smithi083.stdout:firewalld.service is not enabled 2024-04-01T06:49:38.593 INFO:teuthology.orchestra.run.smithi083.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-04-01T06:49:38.595 INFO:teuthology.orchestra.run.smithi083.stdout:Ceph Dashboard is now available at: 2024-04-01T06:49:38.595 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:49:38.595 INFO:teuthology.orchestra.run.smithi083.stdout: URL: https://smithi083:8443/ 2024-04-01T06:49:38.595 INFO:teuthology.orchestra.run.smithi083.stdout: User: admin 2024-04-01T06:49:38.595 INFO:teuthology.orchestra.run.smithi083.stdout: Password: okp577i2yf 2024-04-01T06:49:38.595 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:49:38.596 INFO:teuthology.orchestra.run.smithi083.stdout:Saving cluster configuration to /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/config directory 2024-04-01T06:49:38.596 INFO:teuthology.orchestra.run.smithi083.stdout:Enabling autotune for osd_memory_target 2024-04-01T06:49:39.570 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.969+0000 7f008b6d3700 1 Processor -- start 2024-04-01T06:49:39.570 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.969+0000 7f008b6d3700 1 -- start start 2024-04-01T06:49:39.571 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.969+0000 7f008b6d3700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f00841065a0 0x7f00841069c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:39.571 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.969+0000 7f008b6d3700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0084106f90 con 0x7f00841065a0 2024-04-01T06:49:39.571 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.969+0000 7f008946f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f00841065a0 0x7f00841069c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:39.571 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.969+0000 7f008946f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f00841065a0 0x7f00841069c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:45756/0 (socket says 172.21.15.83:45756) 2024-04-01T06:49:39.571 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.969+0000 7f008946f700 1 -- 172.21.15.83:0/1781020956 learned_addr learned my addr 172.21.15.83:0/1781020956 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:49:39.571 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.969+0000 7f008946f700 1 -- 172.21.15.83:0/1781020956 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0084107750 con 0x7f00841065a0 2024-04-01T06:49:39.571 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.970+0000 7f008946f700 1 --2- 172.21.15.83:0/1781020956 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f00841065a0 0x7f00841069c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f00800098a0 tx=0x7f0080009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f0de5a8d68ba86c server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:39.571 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.970+0000 7f007bfff700 1 -- 172.21.15.83:0/1781020956 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0080004160 con 0x7f00841065a0 2024-04-01T06:49:39.571 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.970+0000 7f007bfff700 1 -- 172.21.15.83:0/1781020956 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f00800042c0 con 0x7f00841065a0 2024-04-01T06:49:39.571 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.970+0000 7f007bfff700 1 -- 172.21.15.83:0/1781020956 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f00800119b0 con 0x7f00841065a0 2024-04-01T06:49:39.571 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.970+0000 7f008b6d3700 1 -- 172.21.15.83:0/1781020956 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f00841065a0 msgr2=0x7f00841069c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:39.571 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.970+0000 7f008b6d3700 1 --2- 172.21.15.83:0/1781020956 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f00841065a0 0x7f00841069c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f00800098a0 tx=0x7f0080009bb0 comp rx=0 tx=0).stop 2024-04-01T06:49:39.571 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.970+0000 7f008b6d3700 1 -- 172.21.15.83:0/1781020956 shutdown_connections 2024-04-01T06:49:39.571 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.970+0000 7f008b6d3700 1 --2- 172.21.15.83:0/1781020956 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f00841065a0 0x7f00841069c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:39.571 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.970+0000 7f008b6d3700 1 -- 172.21.15.83:0/1781020956 >> 172.21.15.83:0/1781020956 conn(0x7f0084101b60 msgr2=0x7f0084103f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:49:39.572 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.970+0000 7f008b6d3700 1 -- 172.21.15.83:0/1781020956 shutdown_connections 2024-04-01T06:49:39.572 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.970+0000 7f008b6d3700 1 -- 172.21.15.83:0/1781020956 wait complete. 2024-04-01T06:49:39.572 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.971+0000 7f008b6d3700 1 Processor -- start 2024-04-01T06:49:39.572 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.971+0000 7f008b6d3700 1 -- start start 2024-04-01T06:49:39.572 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.971+0000 7f008b6d3700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f00841065a0 0x7f008407bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:39.572 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.971+0000 7f008b6d3700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008407c060 con 0x7f00841065a0 2024-04-01T06:49:39.572 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.971+0000 7f008946f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f00841065a0 0x7f008407bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:39.572 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.971+0000 7f008946f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f00841065a0 0x7f008407bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:45760/0 (socket says 172.21.15.83:45760) 2024-04-01T06:49:39.572 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.971+0000 7f008946f700 1 -- 172.21.15.83:0/3083284259 learned_addr learned my addr 172.21.15.83:0/3083284259 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:49:39.572 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.972+0000 7f008946f700 1 -- 172.21.15.83:0/3083284259 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0080009550 con 0x7f00841065a0 2024-04-01T06:49:39.572 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.972+0000 7f008946f700 1 --2- 172.21.15.83:0/3083284259 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f00841065a0 0x7f008407bb20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0080006af0 tx=0x7f0080011a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:39.572 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.972+0000 7f007a7fc700 1 -- 172.21.15.83:0/3083284259 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0080003a40 con 0x7f00841065a0 2024-04-01T06:49:39.572 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.972+0000 7f007a7fc700 1 -- 172.21.15.83:0/3083284259 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0080003ba0 con 0x7f00841065a0 2024-04-01T06:49:39.572 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.972+0000 7f007a7fc700 1 -- 172.21.15.83:0/3083284259 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0080019690 con 0x7f00841065a0 2024-04-01T06:49:39.572 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.972+0000 7f008b6d3700 1 -- 172.21.15.83:0/3083284259 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f008407a2a0 con 0x7f00841065a0 2024-04-01T06:49:39.573 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.972+0000 7f008b6d3700 1 -- 172.21.15.83:0/3083284259 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f008407a740 con 0x7f00841065a0 2024-04-01T06:49:39.573 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.973+0000 7f007a7fc700 1 -- 172.21.15.83:0/3083284259 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 12) v1 ==== 45546+0+0 (secure 0 0 0) 0x7f008001a430 con 0x7f00841065a0 2024-04-01T06:49:39.573 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.973+0000 7f008b6d3700 1 -- 172.21.15.83:0/3083284259 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f008410a980 con 0x7f00841065a0 2024-04-01T06:49:39.573 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.973+0000 7f007a7fc700 1 --2- 172.21.15.83:0/3083284259 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f0070038700 0x7f007003abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:39.573 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.973+0000 7f007a7fc700 1 -- 172.21.15.83:0/3083284259 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f008004cb20 con 0x7f00841065a0 2024-04-01T06:49:39.573 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.973+0000 7f0088c6e700 1 --2- 172.21.15.83:0/3083284259 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f0070038700 0x7f007003abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:39.573 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.973+0000 7f0088c6e700 1 --2- 172.21.15.83:0/3083284259 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f0070038700 0x7f007003abc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0074006fd0 tx=0x7f0074006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:39.573 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:38.978+0000 7f007a7fc700 1 -- 172.21.15.83:0/3083284259 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f0080023570 con 0x7f00841065a0 2024-04-01T06:49:39.573 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:39.166+0000 7f008b6d3700 1 -- 172.21.15.83:0/3083284259 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f008410abc0 con 0x7f00841065a0 2024-04-01T06:49:39.573 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:39.167+0000 7f007a7fc700 1 -- 172.21.15.83:0/3083284259 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f0080023390 con 0x7f00841065a0 2024-04-01T06:49:39.573 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:39.169+0000 7f008b6d3700 1 -- 172.21.15.83:0/3083284259 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f0070038700 msgr2=0x7f007003abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:39.573 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:39.169+0000 7f008b6d3700 1 --2- 172.21.15.83:0/3083284259 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f0070038700 0x7f007003abc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0074006fd0 tx=0x7f0074006e40 comp rx=0 tx=0).stop 2024-04-01T06:49:39.573 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:39.169+0000 7f008b6d3700 1 -- 172.21.15.83:0/3083284259 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f00841065a0 msgr2=0x7f008407bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:39.573 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:39.169+0000 7f008b6d3700 1 --2- 172.21.15.83:0/3083284259 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f00841065a0 0x7f008407bb20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0080006af0 tx=0x7f0080011a10 comp rx=0 tx=0).stop 2024-04-01T06:49:39.573 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:39.169+0000 7f008b6d3700 1 -- 172.21.15.83:0/3083284259 shutdown_connections 2024-04-01T06:49:39.574 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:39.169+0000 7f008b6d3700 1 --2- 172.21.15.83:0/3083284259 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f0070038700 0x7f007003abc0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:39.574 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:39.169+0000 7f008b6d3700 1 --2- 172.21.15.83:0/3083284259 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f00841065a0 0x7f008407bb20 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:39.574 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:39.169+0000 7f008b6d3700 1 -- 172.21.15.83:0/3083284259 >> 172.21.15.83:0/3083284259 conn(0x7f0084101b60 msgr2=0x7f0084102760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:49:39.574 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:39.169+0000 7f008b6d3700 1 -- 172.21.15.83:0/3083284259 shutdown_connections 2024-04-01T06:49:39.574 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:39.169+0000 7f008b6d3700 1 -- 172.21.15.83:0/3083284259 wait complete. 2024-04-01T06:49:40.762 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:39.965+0000 7fd45e359700 1 Processor -- start 2024-04-01T06:49:40.762 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:39.965+0000 7fd45e359700 1 -- start start 2024-04-01T06:49:40.763 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:39.965+0000 7fd45e359700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd458106580 0x7fd4581069a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:40.763 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:39.965+0000 7fd45e359700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd458106f70 con 0x7fd458106580 2024-04-01T06:49:40.763 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:39.966+0000 7fd457fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd458106580 0x7fd4581069a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:40.763 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:39.966+0000 7fd457fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd458106580 0x7fd4581069a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:45774/0 (socket says 172.21.15.83:45774) 2024-04-01T06:49:40.763 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:39.966+0000 7fd457fff700 1 -- 172.21.15.83:0/774305397 learned_addr learned my addr 172.21.15.83:0/774305397 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:49:40.763 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:39.966+0000 7fd457fff700 1 -- 172.21.15.83:0/774305397 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd458107730 con 0x7fd458106580 2024-04-01T06:49:40.763 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:39.966+0000 7fd457fff700 1 --2- 172.21.15.83:0/774305397 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd458106580 0x7fd4581069a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd44c0098a0 tx=0x7fd44c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a957261c8bba3a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:40.763 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:39.966+0000 7fd456ffd700 1 -- 172.21.15.83:0/774305397 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd44c004160 con 0x7fd458106580 2024-04-01T06:49:40.763 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:39.966+0000 7fd456ffd700 1 -- 172.21.15.83:0/774305397 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd44c0042c0 con 0x7fd458106580 2024-04-01T06:49:40.763 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:39.966+0000 7fd456ffd700 1 -- 172.21.15.83:0/774305397 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd44c0119b0 con 0x7fd458106580 2024-04-01T06:49:40.763 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:39.967+0000 7fd45e359700 1 -- 172.21.15.83:0/774305397 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd458106580 msgr2=0x7fd4581069a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:40.763 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:39.967+0000 7fd45e359700 1 --2- 172.21.15.83:0/774305397 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd458106580 0x7fd4581069a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd44c0098a0 tx=0x7fd44c009bb0 comp rx=0 tx=0).stop 2024-04-01T06:49:40.763 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:39.967+0000 7fd45e359700 1 -- 172.21.15.83:0/774305397 shutdown_connections 2024-04-01T06:49:40.763 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:39.967+0000 7fd45e359700 1 --2- 172.21.15.83:0/774305397 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd458106580 0x7fd4581069a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:40.763 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:39.967+0000 7fd45e359700 1 -- 172.21.15.83:0/774305397 >> 172.21.15.83:0/774305397 conn(0x7fd458101b60 msgr2=0x7fd458103f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:49:40.764 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:39.967+0000 7fd45e359700 1 -- 172.21.15.83:0/774305397 shutdown_connections 2024-04-01T06:49:40.764 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:39.967+0000 7fd45e359700 1 -- 172.21.15.83:0/774305397 wait complete. 2024-04-01T06:49:40.764 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:39.967+0000 7fd45e359700 1 Processor -- start 2024-04-01T06:49:40.764 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:39.967+0000 7fd45e359700 1 -- start start 2024-04-01T06:49:40.764 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:39.968+0000 7fd45e359700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd458106580 0x7fd45819a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:40.764 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:39.968+0000 7fd45e359700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45819a7e0 con 0x7fd458106580 2024-04-01T06:49:40.764 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:39.968+0000 7fd457fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd458106580 0x7fd45819a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:40.764 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:39.968+0000 7fd457fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd458106580 0x7fd45819a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:45786/0 (socket says 172.21.15.83:45786) 2024-04-01T06:49:40.764 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:39.968+0000 7fd457fff700 1 -- 172.21.15.83:0/476597056 learned_addr learned my addr 172.21.15.83:0/476597056 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:49:40.764 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:39.968+0000 7fd457fff700 1 -- 172.21.15.83:0/476597056 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd44c009550 con 0x7fd458106580 2024-04-01T06:49:40.764 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:39.968+0000 7fd457fff700 1 --2- 172.21.15.83:0/476597056 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd458106580 0x7fd45819a2a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd44c006af0 tx=0x7fd44c011a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:40.764 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:39.968+0000 7fd4557fa700 1 -- 172.21.15.83:0/476597056 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd44c003a40 con 0x7fd458106580 2024-04-01T06:49:40.764 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:39.968+0000 7fd4557fa700 1 -- 172.21.15.83:0/476597056 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd44c003ba0 con 0x7fd458106580 2024-04-01T06:49:40.764 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:39.968+0000 7fd45e359700 1 -- 172.21.15.83:0/476597056 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd45819a9e0 con 0x7fd458106580 2024-04-01T06:49:40.765 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:39.968+0000 7fd4557fa700 1 -- 172.21.15.83:0/476597056 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd44c019690 con 0x7fd458106580 2024-04-01T06:49:40.765 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:39.968+0000 7fd45e359700 1 -- 172.21.15.83:0/476597056 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd45819ae80 con 0x7fd458106580 2024-04-01T06:49:40.765 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:39.969+0000 7fd45e359700 1 -- 172.21.15.83:0/476597056 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd45810a960 con 0x7fd458106580 2024-04-01T06:49:40.765 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:39.969+0000 7fd4557fa700 1 -- 172.21.15.83:0/476597056 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 13) v1 ==== 45589+0+0 (secure 0 0 0) 0x7fd44c01aa60 con 0x7fd458106580 2024-04-01T06:49:40.765 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:39.970+0000 7fd4557fa700 1 --2- 172.21.15.83:0/476597056 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd4400387f0 0x7fd44003acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:40.765 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:39.970+0000 7fd4557fa700 1 -- 172.21.15.83:0/476597056 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fd44c04cb00 con 0x7fd458106580 2024-04-01T06:49:40.765 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:39.970+0000 7fd4577fe700 1 --2- 172.21.15.83:0/476597056 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd4400387f0 0x7fd44003acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:40.765 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:39.970+0000 7fd4577fe700 1 --2- 172.21.15.83:0/476597056 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd4400387f0 0x7fd44003acb0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd448006fd0 tx=0x7fd448006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:40.765 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:39.974+0000 7fd4557fa700 1 -- 172.21.15.83:0/476597056 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7fd44c023780 con 0x7fd458106580 2024-04-01T06:49:40.765 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:40.272+0000 7fd45e359700 1 -- 172.21.15.83:0/476597056 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7fd45819d710 con 0x7fd458106580 2024-04-01T06:49:40.765 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:40.275+0000 7fd4557fa700 1 -- 172.21.15.83:0/476597056 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) v1 ==== 153+0+0 (secure 0 0 0) 0x7fd44c023390 con 0x7fd458106580 2024-04-01T06:49:40.765 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:40.277+0000 7fd45e359700 1 -- 172.21.15.83:0/476597056 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd4400387f0 msgr2=0x7fd44003acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:40.765 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:40.277+0000 7fd45e359700 1 --2- 172.21.15.83:0/476597056 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd4400387f0 0x7fd44003acb0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd448006fd0 tx=0x7fd448006e40 comp rx=0 tx=0).stop 2024-04-01T06:49:40.765 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:40.277+0000 7fd45e359700 1 -- 172.21.15.83:0/476597056 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd458106580 msgr2=0x7fd45819a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:40.765 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:40.277+0000 7fd45e359700 1 --2- 172.21.15.83:0/476597056 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd458106580 0x7fd45819a2a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd44c006af0 tx=0x7fd44c011a10 comp rx=0 tx=0).stop 2024-04-01T06:49:40.766 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:40.277+0000 7fd45e359700 1 -- 172.21.15.83:0/476597056 shutdown_connections 2024-04-01T06:49:40.766 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:40.277+0000 7fd45e359700 1 --2- 172.21.15.83:0/476597056 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd4400387f0 0x7fd44003acb0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:40.766 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:40.277+0000 7fd45e359700 1 --2- 172.21.15.83:0/476597056 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd458106580 0x7fd45819a2a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:40.766 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:40.277+0000 7fd45e359700 1 -- 172.21.15.83:0/476597056 >> 172.21.15.83:0/476597056 conn(0x7fd458101b60 msgr2=0x7fd4581026e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:49:40.766 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:40.277+0000 7fd45e359700 1 -- 172.21.15.83:0/476597056 shutdown_connections 2024-04-01T06:49:40.766 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr 2024-04-01T06:49:40.277+0000 7fd45e359700 1 -- 172.21.15.83:0/476597056 wait complete. 2024-04-01T06:49:40.766 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-04-01T06:49:40.766 INFO:teuthology.orchestra.run.smithi083.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-04-01T06:49:40.766 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:49:40.766 INFO:teuthology.orchestra.run.smithi083.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-04-01T06:49:40.766 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:49:40.766 INFO:teuthology.orchestra.run.smithi083.stdout:Or, if you are only running a single cluster on this host: 2024-04-01T06:49:40.766 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:49:40.766 INFO:teuthology.orchestra.run.smithi083.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-04-01T06:49:40.767 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:49:40.767 INFO:teuthology.orchestra.run.smithi083.stdout:Please consider enabling telemetry to help improve Ceph: 2024-04-01T06:49:40.767 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:49:40.767 INFO:teuthology.orchestra.run.smithi083.stdout: ceph telemetry on 2024-04-01T06:49:40.767 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:49:40.767 INFO:teuthology.orchestra.run.smithi083.stdout:For more information see: 2024-04-01T06:49:40.767 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:49:40.767 INFO:teuthology.orchestra.run.smithi083.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-04-01T06:49:40.767 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:49:40.767 INFO:teuthology.orchestra.run.smithi083.stdout:Bootstrap complete. 2024-04-01T06:49:40.796 INFO:tasks.cephadm:Fetching config... 2024-04-01T06:49:40.796 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-04-01T06:49:40.796 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-04-01T06:49:40.813 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-04-01T06:49:40.814 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-04-01T06:49:40.814 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-04-01T06:49:40.871 INFO:tasks.cephadm:Fetching mon keyring... 2024-04-01T06:49:40.871 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-04-01T06:49:40.871 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/keyring of=/dev/stdout 2024-04-01T06:49:40.936 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:40 smithi083 ceph-mon[43429]: mgrmap e13: x(active, since 6s) 2024-04-01T06:49:40.936 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:40 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/476597056' entity='client.admin' 2024-04-01T06:49:40.940 INFO:tasks.cephadm:Fetching pub ssh key... 2024-04-01T06:49:40.940 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-04-01T06:49:40.940 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-04-01T06:49:40.998 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-04-01T06:49:40.998 DEBUG:teuthology.orchestra.run.smithi083:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDRZewNwzfbm1DechZhdt3SGepeth/+LIOGoloKply+q1fMxXyBgf6CfAbngIloidGNWi+rFS1LvUSRbSl4ambov54xC5IF/HjGiHMmcw/kJgYru9go6YGFNB8iuyaxht9PLx2ZJmPa6a96QmmM5jZJLcKA9ZclzSid6xjxdELl7DYxF3M/FXS4kUByTL0O9DTUo4QJyXSKasCGbHyyAM7z4R2woQEZ7yWVXTP18Rsq0CDM5Sw1ff1Mq5VbeDCZMFE3d2l+O18H3c6DT9wrgCLNZVGSw+vRpMKTs1xK7lwncSy4QA1gnNfOlxC48EXLiotDTScaNtkxL8u+e4Dcj4S99C0LcjZTRuXgPU6z0bsMA5MPglhOhfvs32FUYZ+xYTDDy0eID9vaC1UWO09stWKDzQ8MCASLVu/hnjEzQDrZcrj5UZC7ZBZYxKC4JsvXN+E8/VOJE0lLxkiK0ZrSKjejgENtmaX6VkHEY29J3J5KX8x6WpGUn9riNx1TIgIXqX0= ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-01T06:49:41.076 INFO:teuthology.orchestra.run.smithi083.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDRZewNwzfbm1DechZhdt3SGepeth/+LIOGoloKply+q1fMxXyBgf6CfAbngIloidGNWi+rFS1LvUSRbSl4ambov54xC5IF/HjGiHMmcw/kJgYru9go6YGFNB8iuyaxht9PLx2ZJmPa6a96QmmM5jZJLcKA9ZclzSid6xjxdELl7DYxF3M/FXS4kUByTL0O9DTUo4QJyXSKasCGbHyyAM7z4R2woQEZ7yWVXTP18Rsq0CDM5Sw1ff1Mq5VbeDCZMFE3d2l+O18H3c6DT9wrgCLNZVGSw+vRpMKTs1xK7lwncSy4QA1gnNfOlxC48EXLiotDTScaNtkxL8u+e4Dcj4S99C0LcjZTRuXgPU6z0bsMA5MPglhOhfvs32FUYZ+xYTDDy0eID9vaC1UWO09stWKDzQ8MCASLVu/hnjEzQDrZcrj5UZC7ZBZYxKC4JsvXN+E8/VOJE0lLxkiK0ZrSKjejgENtmaX6VkHEY29J3J5KX8x6WpGUn9riNx1TIgIXqX0= ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4 2024-04-01T06:49:41.088 DEBUG:teuthology.orchestra.run.smithi145:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDRZewNwzfbm1DechZhdt3SGepeth/+LIOGoloKply+q1fMxXyBgf6CfAbngIloidGNWi+rFS1LvUSRbSl4ambov54xC5IF/HjGiHMmcw/kJgYru9go6YGFNB8iuyaxht9PLx2ZJmPa6a96QmmM5jZJLcKA9ZclzSid6xjxdELl7DYxF3M/FXS4kUByTL0O9DTUo4QJyXSKasCGbHyyAM7z4R2woQEZ7yWVXTP18Rsq0CDM5Sw1ff1Mq5VbeDCZMFE3d2l+O18H3c6DT9wrgCLNZVGSw+vRpMKTs1xK7lwncSy4QA1gnNfOlxC48EXLiotDTScaNtkxL8u+e4Dcj4S99C0LcjZTRuXgPU6z0bsMA5MPglhOhfvs32FUYZ+xYTDDy0eID9vaC1UWO09stWKDzQ8MCASLVu/hnjEzQDrZcrj5UZC7ZBZYxKC4JsvXN+E8/VOJE0lLxkiK0ZrSKjejgENtmaX6VkHEY29J3J5KX8x6WpGUn9riNx1TIgIXqX0= ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-01T06:49:41.136 INFO:teuthology.orchestra.run.smithi145.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDRZewNwzfbm1DechZhdt3SGepeth/+LIOGoloKply+q1fMxXyBgf6CfAbngIloidGNWi+rFS1LvUSRbSl4ambov54xC5IF/HjGiHMmcw/kJgYru9go6YGFNB8iuyaxht9PLx2ZJmPa6a96QmmM5jZJLcKA9ZclzSid6xjxdELl7DYxF3M/FXS4kUByTL0O9DTUo4QJyXSKasCGbHyyAM7z4R2woQEZ7yWVXTP18Rsq0CDM5Sw1ff1Mq5VbeDCZMFE3d2l+O18H3c6DT9wrgCLNZVGSw+vRpMKTs1xK7lwncSy4QA1gnNfOlxC48EXLiotDTScaNtkxL8u+e4Dcj4S99C0LcjZTRuXgPU6z0bsMA5MPglhOhfvs32FUYZ+xYTDDy0eID9vaC1UWO09stWKDzQ8MCASLVu/hnjEzQDrZcrj5UZC7ZBZYxKC4JsvXN+E8/VOJE0lLxkiK0ZrSKjejgENtmaX6VkHEY29J3J5KX8x6WpGUn9riNx1TIgIXqX0= ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4 2024-04-01T06:49:41.152 DEBUG:teuthology.orchestra.run.smithi153:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDRZewNwzfbm1DechZhdt3SGepeth/+LIOGoloKply+q1fMxXyBgf6CfAbngIloidGNWi+rFS1LvUSRbSl4ambov54xC5IF/HjGiHMmcw/kJgYru9go6YGFNB8iuyaxht9PLx2ZJmPa6a96QmmM5jZJLcKA9ZclzSid6xjxdELl7DYxF3M/FXS4kUByTL0O9DTUo4QJyXSKasCGbHyyAM7z4R2woQEZ7yWVXTP18Rsq0CDM5Sw1ff1Mq5VbeDCZMFE3d2l+O18H3c6DT9wrgCLNZVGSw+vRpMKTs1xK7lwncSy4QA1gnNfOlxC48EXLiotDTScaNtkxL8u+e4Dcj4S99C0LcjZTRuXgPU6z0bsMA5MPglhOhfvs32FUYZ+xYTDDy0eID9vaC1UWO09stWKDzQ8MCASLVu/hnjEzQDrZcrj5UZC7ZBZYxKC4JsvXN+E8/VOJE0lLxkiK0ZrSKjejgENtmaX6VkHEY29J3J5KX8x6WpGUn9riNx1TIgIXqX0= ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-01T06:49:41.197 INFO:teuthology.orchestra.run.smithi153.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDRZewNwzfbm1DechZhdt3SGepeth/+LIOGoloKply+q1fMxXyBgf6CfAbngIloidGNWi+rFS1LvUSRbSl4ambov54xC5IF/HjGiHMmcw/kJgYru9go6YGFNB8iuyaxht9PLx2ZJmPa6a96QmmM5jZJLcKA9ZclzSid6xjxdELl7DYxF3M/FXS4kUByTL0O9DTUo4QJyXSKasCGbHyyAM7z4R2woQEZ7yWVXTP18Rsq0CDM5Sw1ff1Mq5VbeDCZMFE3d2l+O18H3c6DT9wrgCLNZVGSw+vRpMKTs1xK7lwncSy4QA1gnNfOlxC48EXLiotDTScaNtkxL8u+e4Dcj4S99C0LcjZTRuXgPU6z0bsMA5MPglhOhfvs32FUYZ+xYTDDy0eID9vaC1UWO09stWKDzQ8MCASLVu/hnjEzQDrZcrj5UZC7ZBZYxKC4JsvXN+E8/VOJE0lLxkiK0ZrSKjejgENtmaX6VkHEY29J3J5KX8x6WpGUn9riNx1TIgIXqX0= ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4 2024-04-01T06:49:41.210 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-04-01T06:49:41.431 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:49:42.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:42.513+0000 7f2e3c4b6700 1 -- 172.21.15.83:0/3497423656 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e341011c0 msgr2=0x7f2e341035b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:42.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:42.513+0000 7f2e3c4b6700 1 --2- 172.21.15.83:0/3497423656 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e341011c0 0x7f2e341035b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2e2400b0a0 tx=0x7f2e2400b3b0 comp rx=0 tx=0).stop 2024-04-01T06:49:42.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:42.513+0000 7f2e3c4b6700 1 -- 172.21.15.83:0/3497423656 shutdown_connections 2024-04-01T06:49:42.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:42.513+0000 7f2e3c4b6700 1 --2- 172.21.15.83:0/3497423656 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e341011c0 0x7f2e341035b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:42.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:42.513+0000 7f2e3c4b6700 1 -- 172.21.15.83:0/3497423656 >> 172.21.15.83:0/3497423656 conn(0x7f2e340fabd0 msgr2=0x7f2e340fd010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:49:42.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:42.513+0000 7f2e3c4b6700 1 -- 172.21.15.83:0/3497423656 shutdown_connections 2024-04-01T06:49:42.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:42.513+0000 7f2e3c4b6700 1 -- 172.21.15.83:0/3497423656 wait complete. 2024-04-01T06:49:42.515 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:42.514+0000 7f2e3c4b6700 1 Processor -- start 2024-04-01T06:49:42.515 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:42.514+0000 7f2e3c4b6700 1 -- start start 2024-04-01T06:49:42.515 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:42.514+0000 7f2e3c4b6700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e341011c0 0x7f2e341009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:42.515 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:42.514+0000 7f2e3c4b6700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e34100ee0 con 0x7f2e341011c0 2024-04-01T06:49:42.515 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:42.514+0000 7f2e3a252700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e341011c0 0x7f2e341009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:42.515 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:42.514+0000 7f2e3a252700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e341011c0 0x7f2e341009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:45810/0 (socket says 172.21.15.83:45810) 2024-04-01T06:49:42.515 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:42.514+0000 7f2e3a252700 1 -- 172.21.15.83:0/2480716845 learned_addr learned my addr 172.21.15.83:0/2480716845 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:49:42.515 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:42.514+0000 7f2e3a252700 1 -- 172.21.15.83:0/2480716845 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e24009d00 con 0x7f2e341011c0 2024-04-01T06:49:42.515 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:42.515+0000 7f2e3a252700 1 --2- 172.21.15.83:0/2480716845 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e341011c0 0x7f2e341009a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2e24015040 tx=0x7f2e2400bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:42.515 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:42.515+0000 7f2e337fe700 1 -- 172.21.15.83:0/2480716845 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2e2400e040 con 0x7f2e341011c0 2024-04-01T06:49:42.515 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:42.515+0000 7f2e3c4b6700 1 -- 172.21.15.83:0/2480716845 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e340ff170 con 0x7f2e341011c0 2024-04-01T06:49:42.515 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:42.515+0000 7f2e3c4b6700 1 -- 172.21.15.83:0/2480716845 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e340ff610 con 0x7f2e341011c0 2024-04-01T06:49:42.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:42.515+0000 7f2e337fe700 1 -- 172.21.15.83:0/2480716845 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e24003d40 con 0x7f2e341011c0 2024-04-01T06:49:42.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:42.515+0000 7f2e337fe700 1 -- 172.21.15.83:0/2480716845 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2e2401d600 con 0x7f2e341011c0 2024-04-01T06:49:42.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:42.516+0000 7f2e337fe700 1 -- 172.21.15.83:0/2480716845 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 13) v1 ==== 45589+0+0 (secure 0 0 0) 0x7f2e24019070 con 0x7f2e341011c0 2024-04-01T06:49:42.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:42.516+0000 7f2e3c4b6700 1 -- 172.21.15.83:0/2480716845 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e20005320 con 0x7f2e341011c0 2024-04-01T06:49:42.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:42.516+0000 7f2e337fe700 1 --2- 172.21.15.83:0/2480716845 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f2e1c0387a0 0x7f2e1c03ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:42.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:42.516+0000 7f2e337fe700 1 -- 172.21.15.83:0/2480716845 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f2e2404c810 con 0x7f2e341011c0 2024-04-01T06:49:42.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:42.516+0000 7f2e39a51700 1 --2- 172.21.15.83:0/2480716845 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f2e1c0387a0 0x7f2e1c03ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:42.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:42.517+0000 7f2e39a51700 1 --2- 172.21.15.83:0/2480716845 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f2e1c0387a0 0x7f2e1c03ac60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2e28006fd0 tx=0x7f2e28006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:42.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:42.525+0000 7f2e337fe700 1 -- 172.21.15.83:0/2480716845 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f2e2401c5b0 con 0x7f2e341011c0 2024-04-01T06:49:42.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:42.726+0000 7f2e3c4b6700 1 -- 172.21.15.83:0/2480716845 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f2e20005b50 con 0x7f2e341011c0 2024-04-01T06:49:42.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:42.729+0000 7f2e337fe700 1 -- 172.21.15.83:0/2480716845 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f2e24017030 con 0x7f2e341011c0 2024-04-01T06:49:42.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:42.731+0000 7f2e3c4b6700 1 -- 172.21.15.83:0/2480716845 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f2e1c0387a0 msgr2=0x7f2e1c03ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:42.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:42.731+0000 7f2e3c4b6700 1 --2- 172.21.15.83:0/2480716845 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f2e1c0387a0 0x7f2e1c03ac60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2e28006fd0 tx=0x7f2e28006e40 comp rx=0 tx=0).stop 2024-04-01T06:49:42.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:42.731+0000 7f2e3c4b6700 1 -- 172.21.15.83:0/2480716845 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e341011c0 msgr2=0x7f2e341009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:42.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:42.731+0000 7f2e3c4b6700 1 --2- 172.21.15.83:0/2480716845 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e341011c0 0x7f2e341009a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2e24015040 tx=0x7f2e2400bd40 comp rx=0 tx=0).stop 2024-04-01T06:49:42.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:42.731+0000 7f2e3c4b6700 1 -- 172.21.15.83:0/2480716845 shutdown_connections 2024-04-01T06:49:42.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:42.731+0000 7f2e3c4b6700 1 --2- 172.21.15.83:0/2480716845 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f2e1c0387a0 0x7f2e1c03ac60 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:42.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:42.731+0000 7f2e3c4b6700 1 --2- 172.21.15.83:0/2480716845 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e341011c0 0x7f2e341009a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:42.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:42.731+0000 7f2e3c4b6700 1 -- 172.21.15.83:0/2480716845 >> 172.21.15.83:0/2480716845 conn(0x7f2e340fabd0 msgr2=0x7f2e340fb720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:49:42.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:42.732+0000 7f2e3c4b6700 1 -- 172.21.15.83:0/2480716845 shutdown_connections 2024-04-01T06:49:42.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:42.732+0000 7f2e3c4b6700 1 -- 172.21.15.83:0/2480716845 wait complete. 2024-04-01T06:49:43.122 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-04-01T06:49:43.123 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-04-01T06:49:43.348 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:49:43.449 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:43 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:49:43.449 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:43 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:49:43.449 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:43 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi083", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:49:43.449 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:43 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:49:43.449 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:43 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:49:43.449 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:43 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:49:43.449 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:43 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/2480716845' entity='client.admin' 2024-04-01T06:49:43.449 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:43 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:49:43.449 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:43 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:49:44.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:44.422+0000 7f521804e700 1 -- 172.21.15.83:0/3585411299 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52100ff620 msgr2=0x7f52100ffa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:44.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:44.422+0000 7f521804e700 1 --2- 172.21.15.83:0/3585411299 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52100ff620 0x7f52100ffa40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f520c009910 tx=0x7f520c009c20 comp rx=0 tx=0).stop 2024-04-01T06:49:44.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:44.422+0000 7f521804e700 1 -- 172.21.15.83:0/3585411299 shutdown_connections 2024-04-01T06:49:44.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:44.422+0000 7f521804e700 1 --2- 172.21.15.83:0/3585411299 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52100ff620 0x7f52100ffa40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:44.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:44.422+0000 7f521804e700 1 -- 172.21.15.83:0/3585411299 >> 172.21.15.83:0/3585411299 conn(0x7f52100fabc0 msgr2=0x7f52100fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:49:44.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:44.422+0000 7f521804e700 1 -- 172.21.15.83:0/3585411299 shutdown_connections 2024-04-01T06:49:44.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:44.422+0000 7f521804e700 1 -- 172.21.15.83:0/3585411299 wait complete. 2024-04-01T06:49:44.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:44.423+0000 7f521804e700 1 Processor -- start 2024-04-01T06:49:44.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:44.423+0000 7f521804e700 1 -- start start 2024-04-01T06:49:44.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:44.423+0000 7f521804e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52100ff620 0x7f5210069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:44.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:44.423+0000 7f521804e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5210069ad0 con 0x7f52100ff620 2024-04-01T06:49:44.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:44.423+0000 7f5215dea700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52100ff620 0x7f5210069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:44.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:44.423+0000 7f5215dea700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52100ff620 0x7f5210069590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33194/0 (socket says 172.21.15.83:33194) 2024-04-01T06:49:44.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:44.423+0000 7f5215dea700 1 -- 172.21.15.83:0/3110689725 learned_addr learned my addr 172.21.15.83:0/3110689725 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:49:44.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:44.423+0000 7f5215dea700 1 -- 172.21.15.83:0/3110689725 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f520c0095f0 con 0x7f52100ff620 2024-04-01T06:49:44.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:44.424+0000 7f5215dea700 1 --2- 172.21.15.83:0/3110689725 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52100ff620 0x7f5210069590 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f520c004f70 tx=0x7f520c004fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:44.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:44.424+0000 7f5206ffd700 1 -- 172.21.15.83:0/3110689725 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f520c01d070 con 0x7f52100ff620 2024-04-01T06:49:44.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:44.424+0000 7f5206ffd700 1 -- 172.21.15.83:0/3110689725 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f520c00be20 con 0x7f52100ff620 2024-04-01T06:49:44.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:44.424+0000 7f521804e700 1 -- 172.21.15.83:0/3110689725 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52101988d0 con 0x7f52100ff620 2024-04-01T06:49:44.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:44.424+0000 7f5206ffd700 1 -- 172.21.15.83:0/3110689725 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f520c022df0 con 0x7f52100ff620 2024-04-01T06:49:44.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:44.424+0000 7f521804e700 1 -- 172.21.15.83:0/3110689725 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5210198d70 con 0x7f52100ff620 2024-04-01T06:49:44.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:44.425+0000 7f5206ffd700 1 -- 172.21.15.83:0/3110689725 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 13) v1 ==== 45589+0+0 (secure 0 0 0) 0x7f520c00f4b0 con 0x7f52100ff620 2024-04-01T06:49:44.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:44.425+0000 7f521804e700 1 -- 172.21.15.83:0/3110689725 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f521018e340 con 0x7f52100ff620 2024-04-01T06:49:44.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:44.425+0000 7f5206ffd700 1 --2- 172.21.15.83:0/3110689725 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f51fc038780 0x7f51fc03ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:44.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:44.425+0000 7f5206ffd700 1 -- 172.21.15.83:0/3110689725 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f520c04ca60 con 0x7f52100ff620 2024-04-01T06:49:44.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:44.425+0000 7f52155e9700 1 --2- 172.21.15.83:0/3110689725 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f51fc038780 0x7f51fc03ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:44.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:44.425+0000 7f52155e9700 1 --2- 172.21.15.83:0/3110689725 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f51fc038780 0x7f51fc03ac40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5200006fd0 tx=0x7f5200006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:44.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:44.430+0000 7f5206ffd700 1 -- 172.21.15.83:0/3110689725 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f520c020940 con 0x7f52100ff620 2024-04-01T06:49:44.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:44.628+0000 7f521804e700 1 -- 172.21.15.83:0/3110689725 --> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f52100611f0 con 0x7f51fc038780 2024-04-01T06:49:44.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:44.631+0000 7f5206ffd700 1 -- 172.21.15.83:0/3110689725 <== mgr.14152 v2:172.21.15.83:6800/3375372052 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f52100611f0 con 0x7f51fc038780 2024-04-01T06:49:44.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:44.633+0000 7f521804e700 1 -- 172.21.15.83:0/3110689725 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f51fc038780 msgr2=0x7f51fc03ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:44.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:44.633+0000 7f521804e700 1 --2- 172.21.15.83:0/3110689725 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f51fc038780 0x7f51fc03ac40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5200006fd0 tx=0x7f5200006e40 comp rx=0 tx=0).stop 2024-04-01T06:49:44.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:44.633+0000 7f521804e700 1 -- 172.21.15.83:0/3110689725 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52100ff620 msgr2=0x7f5210069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:44.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:44.633+0000 7f521804e700 1 --2- 172.21.15.83:0/3110689725 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52100ff620 0x7f5210069590 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f520c004f70 tx=0x7f520c004fa0 comp rx=0 tx=0).stop 2024-04-01T06:49:44.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:44.633+0000 7f521804e700 1 -- 172.21.15.83:0/3110689725 shutdown_connections 2024-04-01T06:49:44.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:44.633+0000 7f521804e700 1 --2- 172.21.15.83:0/3110689725 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f51fc038780 0x7f51fc03ac40 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:44.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:44.633+0000 7f521804e700 1 --2- 172.21.15.83:0/3110689725 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f52100ff620 0x7f5210069590 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:44.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:44.633+0000 7f521804e700 1 -- 172.21.15.83:0/3110689725 >> 172.21.15.83:0/3110689725 conn(0x7f52100fabc0 msgr2=0x7f52100fb760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:49:44.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:44.634+0000 7f521804e700 1 -- 172.21.15.83:0/3110689725 shutdown_connections 2024-04-01T06:49:44.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:44.634+0000 7f521804e700 1 -- 172.21.15.83:0/3110689725 wait complete. 2024-04-01T06:49:44.977 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi145 2024-04-01T06:49:44.977 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-04-01T06:49:44.977 DEBUG:teuthology.orchestra.run.smithi145:> dd of=/etc/ceph/ceph.conf 2024-04-01T06:49:44.998 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-04-01T06:49:44.998 DEBUG:teuthology.orchestra.run.smithi145:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-01T06:49:45.057 INFO:tasks.cephadm:Adding host smithi145 to orchestrator... 2024-04-01T06:49:45.057 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph orch host add smithi145 2024-04-01T06:49:45.292 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:49:45.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:45 smithi083 ceph-mon[43429]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:49:45.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:45 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:49:45.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:45 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:49:45.713 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:45 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:49:45.714 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:45 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:49:45.714 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:45 smithi083 ceph-mon[43429]: Updating smithi083:/etc/ceph/ceph.conf 2024-04-01T06:49:45.714 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:45 smithi083 ceph-mon[43429]: Updating smithi083:/var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-04-01T06:49:45.714 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:45 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:49:45.714 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:45 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:49:45.714 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:45 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:49:46.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:46.242+0000 7f0906262700 1 -- 172.21.15.83:0/794832754 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0900101880 msgr2=0x7f0900101c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:46.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:46.242+0000 7f0906262700 1 --2- 172.21.15.83:0/794832754 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0900101880 0x7f0900101c60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f08f000b0a0 tx=0x7f08f000b3b0 comp rx=0 tx=0).stop 2024-04-01T06:49:46.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:46.242+0000 7f0906262700 1 -- 172.21.15.83:0/794832754 shutdown_connections 2024-04-01T06:49:46.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:46.242+0000 7f0906262700 1 --2- 172.21.15.83:0/794832754 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0900101880 0x7f0900101c60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:46.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:46.242+0000 7f0906262700 1 -- 172.21.15.83:0/794832754 >> 172.21.15.83:0/794832754 conn(0x7f09000fb110 msgr2=0x7f09000fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:49:46.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:46.242+0000 7f0906262700 1 -- 172.21.15.83:0/794832754 shutdown_connections 2024-04-01T06:49:46.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:46.242+0000 7f0906262700 1 -- 172.21.15.83:0/794832754 wait complete. 2024-04-01T06:49:46.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:46.243+0000 7f0906262700 1 Processor -- start 2024-04-01T06:49:46.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:46.243+0000 7f0906262700 1 -- start start 2024-04-01T06:49:46.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:46.243+0000 7f0906262700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0900101880 0x7f09000ff4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:46.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:46.243+0000 7f0906262700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09001013a0 con 0x7f0900101880 2024-04-01T06:49:46.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:46.244+0000 7f08ff7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0900101880 0x7f09000ff4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:46.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:46.244+0000 7f08ff7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0900101880 0x7f09000ff4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33220/0 (socket says 172.21.15.83:33220) 2024-04-01T06:49:46.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:46.244+0000 7f08ff7fe700 1 -- 172.21.15.83:0/3481677369 learned_addr learned my addr 172.21.15.83:0/3481677369 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:49:46.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:46.244+0000 7f08ff7fe700 1 -- 172.21.15.83:0/3481677369 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f0009d00 con 0x7f0900101880 2024-04-01T06:49:46.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:46.244+0000 7f08ff7fe700 1 --2- 172.21.15.83:0/3481677369 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0900101880 0x7f09000ff4e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f08f0015040 tx=0x7f08f00096e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:46.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:46.244+0000 7f08fcff9700 1 -- 172.21.15.83:0/3481677369 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f08f000e040 con 0x7f0900101880 2024-04-01T06:49:46.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:46.244+0000 7f08fcff9700 1 -- 172.21.15.83:0/3481677369 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f08f0004040 con 0x7f0900101880 2024-04-01T06:49:46.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:46.244+0000 7f08fcff9700 1 -- 172.21.15.83:0/3481677369 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f08f001d610 con 0x7f0900101880 2024-04-01T06:49:46.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:46.244+0000 7f0906262700 1 -- 172.21.15.83:0/3481677369 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09000ffa20 con 0x7f0900101880 2024-04-01T06:49:46.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:46.244+0000 7f0906262700 1 -- 172.21.15.83:0/3481677369 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09000ffe40 con 0x7f0900101880 2024-04-01T06:49:46.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:46.245+0000 7f08fcff9700 1 -- 172.21.15.83:0/3481677369 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 13) v1 ==== 45589+0+0 (secure 0 0 0) 0x7f08f0007b10 con 0x7f0900101880 2024-04-01T06:49:46.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:46.245+0000 7f08fcff9700 1 --2- 172.21.15.83:0/3481677369 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f08e80387f0 0x7f08e803acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:46.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:46.245+0000 7f0906262700 1 -- 172.21.15.83:0/3481677369 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0900069400 con 0x7f0900101880 2024-04-01T06:49:46.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:46.245+0000 7f08fcff9700 1 -- 172.21.15.83:0/3481677369 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f08f004c8b0 con 0x7f0900101880 2024-04-01T06:49:46.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:46.245+0000 7f08feffd700 1 --2- 172.21.15.83:0/3481677369 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f08e80387f0 0x7f08e803acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:46.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:46.246+0000 7f08feffd700 1 --2- 172.21.15.83:0/3481677369 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f08e80387f0 0x7f08e803acb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f08f4006fd0 tx=0x7f08f4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:46.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:46.250+0000 7f08fcff9700 1 -- 172.21.15.83:0/3481677369 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f08f004b020 con 0x7f0900101880 2024-04-01T06:49:46.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:46.446+0000 7f0906262700 1 -- 172.21.15.83:0/3481677369 --> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi145", "target": ["mon-mgr", ""]}) v1 -- 0x7f0900100080 con 0x7f08e80387f0 2024-04-01T06:49:47.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:46 smithi083 ceph-mon[43429]: Updating smithi083:/etc/ceph/ceph.client.admin.keyring 2024-04-01T06:49:47.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:46 smithi083 ceph-mon[43429]: Updating smithi083:/var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-01T06:49:48.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:47 smithi083 ceph-mon[43429]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi145", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:49:48.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:48.667+0000 7f08fcff9700 1 -- 172.21.15.83:0/3481677369 <== mgr.14152 v2:172.21.15.83:6800/3375372052 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f0900100080 con 0x7f08e80387f0 2024-04-01T06:49:48.667 INFO:teuthology.orchestra.run.smithi083.stdout:Added host 'smithi145' with addr '172.21.15.145' 2024-04-01T06:49:48.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:48.669+0000 7f0906262700 1 -- 172.21.15.83:0/3481677369 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f08e80387f0 msgr2=0x7f08e803acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:48.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:48.669+0000 7f0906262700 1 --2- 172.21.15.83:0/3481677369 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f08e80387f0 0x7f08e803acb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f08f4006fd0 tx=0x7f08f4006e40 comp rx=0 tx=0).stop 2024-04-01T06:49:48.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:48.669+0000 7f0906262700 1 -- 172.21.15.83:0/3481677369 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0900101880 msgr2=0x7f09000ff4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:48.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:48.669+0000 7f0906262700 1 --2- 172.21.15.83:0/3481677369 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0900101880 0x7f09000ff4e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f08f0015040 tx=0x7f08f00096e0 comp rx=0 tx=0).stop 2024-04-01T06:49:48.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:48.669+0000 7f0906262700 1 -- 172.21.15.83:0/3481677369 shutdown_connections 2024-04-01T06:49:48.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:48.669+0000 7f0906262700 1 --2- 172.21.15.83:0/3481677369 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f08e80387f0 0x7f08e803acb0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:48.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:48.669+0000 7f0906262700 1 --2- 172.21.15.83:0/3481677369 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0900101880 0x7f09000ff4e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:48.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:48.669+0000 7f0906262700 1 -- 172.21.15.83:0/3481677369 >> 172.21.15.83:0/3481677369 conn(0x7f09000fb110 msgr2=0x7f0900104640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:49:48.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:48.670+0000 7f0906262700 1 -- 172.21.15.83:0/3481677369 shutdown_connections 2024-04-01T06:49:48.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:48.670+0000 7f0906262700 1 -- 172.21.15.83:0/3481677369 wait complete. 2024-04-01T06:49:48.991 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:48 smithi083 ceph-mon[43429]: Deploying cephadm binary to smithi145 2024-04-01T06:49:49.043 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph orch host ls --format=json 2024-04-01T06:49:49.256 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:49:50.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:49 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:49:50.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:49 smithi083 ceph-mon[43429]: Added host smithi145 2024-04-01T06:49:50.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:49 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:49:50.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:49 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:49:50.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:49 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:49:50.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:50.190+0000 7fbd034e6700 1 -- 172.21.15.83:0/495101512 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbcfc1066c0 msgr2=0x7fbcfc106aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:50.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:50.190+0000 7fbd034e6700 1 --2- 172.21.15.83:0/495101512 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbcfc1066c0 0x7fbcfc106aa0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbcf4009910 tx=0x7fbcf4009c20 comp rx=0 tx=0).stop 2024-04-01T06:49:50.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:50.190+0000 7fbd034e6700 1 -- 172.21.15.83:0/495101512 shutdown_connections 2024-04-01T06:49:50.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:50.190+0000 7fbd034e6700 1 --2- 172.21.15.83:0/495101512 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbcfc1066c0 0x7fbcfc106aa0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:50.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:50.190+0000 7fbd034e6700 1 -- 172.21.15.83:0/495101512 >> 172.21.15.83:0/495101512 conn(0x7fbcfc0fc1d0 msgr2=0x7fbcfc0fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:49:50.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:50.190+0000 7fbd034e6700 1 -- 172.21.15.83:0/495101512 shutdown_connections 2024-04-01T06:49:50.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:50.190+0000 7fbd034e6700 1 -- 172.21.15.83:0/495101512 wait complete. 2024-04-01T06:49:50.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:50.191+0000 7fbd034e6700 1 Processor -- start 2024-04-01T06:49:50.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:50.191+0000 7fbd034e6700 1 -- start start 2024-04-01T06:49:50.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:50.191+0000 7fbd034e6700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbcfc1066c0 0x7fbcfc195f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:50.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:50.191+0000 7fbd034e6700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcfc196480 con 0x7fbcfc1066c0 2024-04-01T06:49:50.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:50.191+0000 7fbd01282700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbcfc1066c0 0x7fbcfc195f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:50.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:50.191+0000 7fbd01282700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbcfc1066c0 0x7fbcfc195f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33238/0 (socket says 172.21.15.83:33238) 2024-04-01T06:49:50.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:50.191+0000 7fbd01282700 1 -- 172.21.15.83:0/4258025147 learned_addr learned my addr 172.21.15.83:0/4258025147 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:49:50.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:50.191+0000 7fbd01282700 1 -- 172.21.15.83:0/4258025147 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf40095f0 con 0x7fbcfc1066c0 2024-04-01T06:49:50.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:50.191+0000 7fbd01282700 1 --2- 172.21.15.83:0/4258025147 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbcfc1066c0 0x7fbcfc195f40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbcf4004f40 tx=0x7fbcf4005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:50.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:50.192+0000 7fbcfa7fc700 1 -- 172.21.15.83:0/4258025147 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbcf401d070 con 0x7fbcfc1066c0 2024-04-01T06:49:50.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:50.192+0000 7fbcfa7fc700 1 -- 172.21.15.83:0/4258025147 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbcf400bbb0 con 0x7fbcfc1066c0 2024-04-01T06:49:50.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:50.192+0000 7fbd034e6700 1 -- 172.21.15.83:0/4258025147 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcfc1966e0 con 0x7fbcfc1066c0 2024-04-01T06:49:50.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:50.192+0000 7fbcfa7fc700 1 -- 172.21.15.83:0/4258025147 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbcf4003810 con 0x7fbcfc1066c0 2024-04-01T06:49:50.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:50.192+0000 7fbd034e6700 1 -- 172.21.15.83:0/4258025147 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcfc196b60 con 0x7fbcfc1066c0 2024-04-01T06:49:50.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:50.193+0000 7fbcfa7fc700 1 -- 172.21.15.83:0/4258025147 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 13) v1 ==== 45589+0+0 (secure 0 0 0) 0x7fbcf4003a90 con 0x7fbcfc1066c0 2024-04-01T06:49:50.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:50.193+0000 7fbd034e6700 1 -- 172.21.15.83:0/4258025147 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcfc101e00 con 0x7fbcfc1066c0 2024-04-01T06:49:50.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:50.193+0000 7fbcfa7fc700 1 --2- 172.21.15.83:0/4258025147 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fbce40387a0 0x7fbce403ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:50.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:50.193+0000 7fbcfa7fc700 1 -- 172.21.15.83:0/4258025147 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fbcf404c4e0 con 0x7fbcfc1066c0 2024-04-01T06:49:50.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:50.193+0000 7fbd00a81700 1 --2- 172.21.15.83:0/4258025147 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fbce40387a0 0x7fbce403ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:50.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:50.193+0000 7fbd00a81700 1 --2- 172.21.15.83:0/4258025147 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fbce40387a0 0x7fbce403ac60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbcf0006fd0 tx=0x7fbcf0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:50.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:50.198+0000 7fbcfa7fc700 1 -- 172.21.15.83:0/4258025147 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7fbcf402aa00 con 0x7fbcfc1066c0 2024-04-01T06:49:50.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:50.394+0000 7fbd034e6700 1 -- 172.21.15.83:0/4258025147 --> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbcfc10a9c0 con 0x7fbce40387a0 2024-04-01T06:49:50.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:50.395+0000 7fbcfa7fc700 1 -- 172.21.15.83:0/4258025147 <== mgr.14152 v2:172.21.15.83:6800/3375372052 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+160 (secure 0 0 0) 0x7fbcfc10a9c0 con 0x7fbce40387a0 2024-04-01T06:49:50.395 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:49:50.395 INFO:teuthology.orchestra.run.smithi083.stdout:[{"addr": "172.21.15.83", "hostname": "smithi083", "labels": [], "status": ""}, {"addr": "172.21.15.145", "hostname": "smithi145", "labels": [], "status": ""}] 2024-04-01T06:49:50.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:50.397+0000 7fbd034e6700 1 -- 172.21.15.83:0/4258025147 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fbce40387a0 msgr2=0x7fbce403ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:50.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:50.397+0000 7fbd034e6700 1 --2- 172.21.15.83:0/4258025147 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fbce40387a0 0x7fbce403ac60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbcf0006fd0 tx=0x7fbcf0006e40 comp rx=0 tx=0).stop 2024-04-01T06:49:50.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:50.397+0000 7fbd034e6700 1 -- 172.21.15.83:0/4258025147 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbcfc1066c0 msgr2=0x7fbcfc195f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:50.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:50.397+0000 7fbd034e6700 1 --2- 172.21.15.83:0/4258025147 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbcfc1066c0 0x7fbcfc195f40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbcf4004f40 tx=0x7fbcf4005020 comp rx=0 tx=0).stop 2024-04-01T06:49:50.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:50.397+0000 7fbd034e6700 1 -- 172.21.15.83:0/4258025147 shutdown_connections 2024-04-01T06:49:50.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:50.397+0000 7fbd034e6700 1 --2- 172.21.15.83:0/4258025147 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fbce40387a0 0x7fbce403ac60 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:50.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:50.397+0000 7fbd034e6700 1 --2- 172.21.15.83:0/4258025147 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbcfc1066c0 0x7fbcfc195f40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:50.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:50.397+0000 7fbd034e6700 1 -- 172.21.15.83:0/4258025147 >> 172.21.15.83:0/4258025147 conn(0x7fbcfc0fc1d0 msgr2=0x7fbcfc1082f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:49:50.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:50.398+0000 7fbd034e6700 1 -- 172.21.15.83:0/4258025147 shutdown_connections 2024-04-01T06:49:50.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:50.398+0000 7fbd034e6700 1 -- 172.21.15.83:0/4258025147 wait complete. 2024-04-01T06:49:50.786 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi153 2024-04-01T06:49:50.786 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-04-01T06:49:50.786 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/etc/ceph/ceph.conf 2024-04-01T06:49:50.811 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-04-01T06:49:50.811 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-01T06:49:50.872 INFO:tasks.cephadm:Adding host smithi153 to orchestrator... 2024-04-01T06:49:50.872 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph orch host add smithi153 2024-04-01T06:49:51.089 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:49:51.349 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:51 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:49:51.349 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:51 smithi083 ceph-mon[43429]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T06:49:52.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:52.032+0000 7f74cd4a3700 1 -- 172.21.15.83:0/2846036485 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f74c8105620 msgr2=0x7f74c8105a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:52.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:52.032+0000 7f74cd4a3700 1 --2- 172.21.15.83:0/2846036485 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f74c8105620 0x7f74c8105a00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f74bc009910 tx=0x7f74bc009c20 comp rx=0 tx=0).stop 2024-04-01T06:49:52.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:52.032+0000 7f74cd4a3700 1 -- 172.21.15.83:0/2846036485 shutdown_connections 2024-04-01T06:49:52.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:52.032+0000 7f74cd4a3700 1 --2- 172.21.15.83:0/2846036485 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f74c8105620 0x7f74c8105a00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:52.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:52.032+0000 7f74cd4a3700 1 -- 172.21.15.83:0/2846036485 >> 172.21.15.83:0/2846036485 conn(0x7f74c80fb060 msgr2=0x7f74c80fd480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:49:52.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:52.032+0000 7f74cd4a3700 1 -- 172.21.15.83:0/2846036485 shutdown_connections 2024-04-01T06:49:52.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:52.032+0000 7f74cd4a3700 1 -- 172.21.15.83:0/2846036485 wait complete. 2024-04-01T06:49:52.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:52.033+0000 7f74cd4a3700 1 Processor -- start 2024-04-01T06:49:52.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:52.033+0000 7f74cd4a3700 1 -- start start 2024-04-01T06:49:52.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:52.033+0000 7f74cd4a3700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f74c8105620 0x7f74c8196c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:52.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:52.033+0000 7f74cd4a3700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c8069aa0 con 0x7f74c8105620 2024-04-01T06:49:52.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:52.033+0000 7f74c6ffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f74c8105620 0x7f74c8196c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:52.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:52.033+0000 7f74c6ffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f74c8105620 0x7f74c8196c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33252/0 (socket says 172.21.15.83:33252) 2024-04-01T06:49:52.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:52.033+0000 7f74c6ffd700 1 -- 172.21.15.83:0/161406736 learned_addr learned my addr 172.21.15.83:0/161406736 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:49:52.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:52.034+0000 7f74c6ffd700 1 -- 172.21.15.83:0/161406736 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74bc0095f0 con 0x7f74c8105620 2024-04-01T06:49:52.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:52.034+0000 7f74c6ffd700 1 --2- 172.21.15.83:0/161406736 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f74c8105620 0x7f74c8196c80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f74bc004f40 tx=0x7f74bc005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:52.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:52.034+0000 7f74affff700 1 -- 172.21.15.83:0/161406736 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f74bc01d070 con 0x7f74c8105620 2024-04-01T06:49:52.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:52.034+0000 7f74cd4a3700 1 -- 172.21.15.83:0/161406736 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74c8197220 con 0x7f74c8105620 2024-04-01T06:49:52.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:52.034+0000 7f74affff700 1 -- 172.21.15.83:0/161406736 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f74bc00bc10 con 0x7f74c8105620 2024-04-01T06:49:52.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:52.034+0000 7f74affff700 1 -- 172.21.15.83:0/161406736 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f74bc0037d0 con 0x7f74c8105620 2024-04-01T06:49:52.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:52.034+0000 7f74cd4a3700 1 -- 172.21.15.83:0/161406736 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74c8197720 con 0x7f74c8105620 2024-04-01T06:49:52.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:52.035+0000 7f74affff700 1 -- 172.21.15.83:0/161406736 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 13) v1 ==== 45589+0+0 (secure 0 0 0) 0x7f74bc003a90 con 0x7f74c8105620 2024-04-01T06:49:52.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:52.035+0000 7f74cd4a3700 1 -- 172.21.15.83:0/161406736 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74c80fb6a0 con 0x7f74c8105620 2024-04-01T06:49:52.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:52.035+0000 7f74affff700 1 --2- 172.21.15.83:0/161406736 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f74b00387a0 0x7f74b003ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:52.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:52.035+0000 7f74affff700 1 -- 172.21.15.83:0/161406736 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f74bc04c4d0 con 0x7f74c8105620 2024-04-01T06:49:52.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:52.035+0000 7f74c67fc700 1 --2- 172.21.15.83:0/161406736 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f74b00387a0 0x7f74b003ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:52.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:52.035+0000 7f74c67fc700 1 --2- 172.21.15.83:0/161406736 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f74b00387a0 0x7f74b003ac60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f74b8006fd0 tx=0x7f74b8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:52.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:52.040+0000 7f74affff700 1 -- 172.21.15.83:0/161406736 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f74bc02a7c0 con 0x7f74c8105620 2024-04-01T06:49:52.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:52.239+0000 7f74cd4a3700 1 -- 172.21.15.83:0/161406736 --> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi153", "target": ["mon-mgr", ""]}) v1 -- 0x7f74c8197a20 con 0x7f74b00387a0 2024-04-01T06:49:53.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:53 smithi083 ceph-mon[43429]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi153", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:49:53.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:53 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:49:53.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:53 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:49:53.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:53 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:49:53.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:53 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:49:53.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:53 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi145", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:49:53.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:53 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:49:53.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:53 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:49:53.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:53 smithi083 ceph-mon[43429]: Updating smithi145:/etc/ceph/ceph.conf 2024-04-01T06:49:53.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:53 smithi083 ceph-mon[43429]: Updating smithi145:/var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-04-01T06:49:53.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:53 smithi083 ceph-mon[43429]: Deploying cephadm binary to smithi153 2024-04-01T06:49:53.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:53 smithi083 ceph-mon[43429]: Updating smithi145:/etc/ceph/ceph.client.admin.keyring 2024-04-01T06:49:54.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:54.461+0000 7f74affff700 1 -- 172.21.15.83:0/161406736 <== mgr.14152 v2:172.21.15.83:6800/3375372052 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f74c8197a20 con 0x7f74b00387a0 2024-04-01T06:49:54.461 INFO:teuthology.orchestra.run.smithi083.stdout:Added host 'smithi153' with addr '172.21.15.153' 2024-04-01T06:49:54.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:54.464+0000 7f74cd4a3700 1 -- 172.21.15.83:0/161406736 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f74b00387a0 msgr2=0x7f74b003ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:54.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:54.464+0000 7f74cd4a3700 1 --2- 172.21.15.83:0/161406736 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f74b00387a0 0x7f74b003ac60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f74b8006fd0 tx=0x7f74b8006e40 comp rx=0 tx=0).stop 2024-04-01T06:49:54.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:54.464+0000 7f74cd4a3700 1 -- 172.21.15.83:0/161406736 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f74c8105620 msgr2=0x7f74c8196c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:54.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:54.464+0000 7f74cd4a3700 1 --2- 172.21.15.83:0/161406736 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f74c8105620 0x7f74c8196c80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f74bc004f40 tx=0x7f74bc005020 comp rx=0 tx=0).stop 2024-04-01T06:49:54.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:54.464+0000 7f74cd4a3700 1 -- 172.21.15.83:0/161406736 shutdown_connections 2024-04-01T06:49:54.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:54.464+0000 7f74cd4a3700 1 --2- 172.21.15.83:0/161406736 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f74b00387a0 0x7f74b003ac60 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:54.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:54.464+0000 7f74cd4a3700 1 --2- 172.21.15.83:0/161406736 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f74c8105620 0x7f74c8196c80 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:54.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:54.464+0000 7f74cd4a3700 1 -- 172.21.15.83:0/161406736 >> 172.21.15.83:0/161406736 conn(0x7f74c80fb060 msgr2=0x7f74c80fc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:49:54.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:54.464+0000 7f74cd4a3700 1 -- 172.21.15.83:0/161406736 shutdown_connections 2024-04-01T06:49:54.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:54.464+0000 7f74cd4a3700 1 -- 172.21.15.83:0/161406736 wait complete. 2024-04-01T06:49:54.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:54 smithi083 ceph-mon[43429]: Updating smithi145:/var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-01T06:49:54.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:54 smithi083 ceph-mon[43429]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:49:54.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:54 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:49:54.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:54 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:49:54.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:54 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:49:54.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:54 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:49:54.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:54 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:49:54.835 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph orch host ls --format=json 2024-04-01T06:49:55.051 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:49:55.846 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:55 smithi083 ceph-mon[43429]: Added host smithi153 2024-04-01T06:49:55.846 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:55 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:49:55.846 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:55 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:49:56.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:56.031+0000 7f3e02067700 1 -- 172.21.15.83:0/1778995522 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dfc1066c0 msgr2=0x7f3dfc106aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:56.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:56.031+0000 7f3e02067700 1 --2- 172.21.15.83:0/1778995522 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dfc1066c0 0x7f3dfc106aa0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3dec009910 tx=0x7f3dec009c20 comp rx=0 tx=0).stop 2024-04-01T06:49:56.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:56.031+0000 7f3e02067700 1 -- 172.21.15.83:0/1778995522 shutdown_connections 2024-04-01T06:49:56.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:56.031+0000 7f3e02067700 1 --2- 172.21.15.83:0/1778995522 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dfc1066c0 0x7f3dfc106aa0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:56.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:56.031+0000 7f3e02067700 1 -- 172.21.15.83:0/1778995522 >> 172.21.15.83:0/1778995522 conn(0x7f3dfc0fc1d0 msgr2=0x7f3dfc0fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:49:56.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:56.031+0000 7f3e02067700 1 -- 172.21.15.83:0/1778995522 shutdown_connections 2024-04-01T06:49:56.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:56.031+0000 7f3e02067700 1 -- 172.21.15.83:0/1778995522 wait complete. 2024-04-01T06:49:56.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:56.032+0000 7f3e02067700 1 Processor -- start 2024-04-01T06:49:56.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:56.032+0000 7f3e02067700 1 -- start start 2024-04-01T06:49:56.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:56.032+0000 7f3e02067700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dfc1066c0 0x7f3dfc0730b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:56.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:56.032+0000 7f3e02067700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dfc074f70 con 0x7f3dfc1066c0 2024-04-01T06:49:56.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:56.032+0000 7f3dfb7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dfc1066c0 0x7f3dfc0730b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:56.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:56.032+0000 7f3dfb7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dfc1066c0 0x7f3dfc0730b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58750/0 (socket says 172.21.15.83:58750) 2024-04-01T06:49:56.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:56.032+0000 7f3dfb7fe700 1 -- 172.21.15.83:0/234791371 learned_addr learned my addr 172.21.15.83:0/234791371 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:49:56.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:56.032+0000 7f3dfb7fe700 1 -- 172.21.15.83:0/234791371 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dec0095f0 con 0x7f3dfc1066c0 2024-04-01T06:49:56.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:56.033+0000 7f3dfb7fe700 1 --2- 172.21.15.83:0/234791371 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dfc1066c0 0x7f3dfc0730b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3dec004f40 tx=0x7f3dec005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:56.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:56.033+0000 7f3df8ff9700 1 -- 172.21.15.83:0/234791371 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3dec01d070 con 0x7f3dfc1066c0 2024-04-01T06:49:56.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:56.033+0000 7f3df8ff9700 1 -- 172.21.15.83:0/234791371 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3dec00bbb0 con 0x7f3dfc1066c0 2024-04-01T06:49:56.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:56.033+0000 7f3e02067700 1 -- 172.21.15.83:0/234791371 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dfc0735f0 con 0x7f3dfc1066c0 2024-04-01T06:49:56.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:56.033+0000 7f3df8ff9700 1 -- 172.21.15.83:0/234791371 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3dec003810 con 0x7f3dfc1066c0 2024-04-01T06:49:56.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:56.033+0000 7f3e02067700 1 -- 172.21.15.83:0/234791371 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dfc073a70 con 0x7f3dfc1066c0 2024-04-01T06:49:56.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:56.034+0000 7f3df8ff9700 1 -- 172.21.15.83:0/234791371 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 13) v1 ==== 45589+0+0 (secure 0 0 0) 0x7f3dec003a40 con 0x7f3dfc1066c0 2024-04-01T06:49:56.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:56.034+0000 7f3e02067700 1 -- 172.21.15.83:0/234791371 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dfc101e00 con 0x7f3dfc1066c0 2024-04-01T06:49:56.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:56.034+0000 7f3df8ff9700 1 --2- 172.21.15.83:0/234791371 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f3de80387f0 0x7f3de803acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:56.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:56.034+0000 7f3df8ff9700 1 -- 172.21.15.83:0/234791371 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f3dec04c550 con 0x7f3dfc1066c0 2024-04-01T06:49:56.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:56.034+0000 7f3dfaffd700 1 --2- 172.21.15.83:0/234791371 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f3de80387f0 0x7f3de803acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:56.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:56.034+0000 7f3dfaffd700 1 --2- 172.21.15.83:0/234791371 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f3de80387f0 0x7f3de803acb0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3de4006fd0 tx=0x7f3de4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:56.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:56.039+0000 7f3df8ff9700 1 -- 172.21.15.83:0/234791371 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f3dec00b6f0 con 0x7f3dfc1066c0 2024-04-01T06:49:56.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:56.234+0000 7f3e02067700 1 -- 172.21.15.83:0/234791371 --> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3dfc073cb0 con 0x7f3de80387f0 2024-04-01T06:49:56.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:56.235+0000 7f3df8ff9700 1 -- 172.21.15.83:0/234791371 <== mgr.14152 v2:172.21.15.83:6800/3375372052 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+240 (secure 0 0 0) 0x7f3dfc073cb0 con 0x7f3de80387f0 2024-04-01T06:49:56.235 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:49:56.235 INFO:teuthology.orchestra.run.smithi083.stdout:[{"addr": "172.21.15.83", "hostname": "smithi083", "labels": [], "status": ""}, {"addr": "172.21.15.145", "hostname": "smithi145", "labels": [], "status": ""}, {"addr": "172.21.15.153", "hostname": "smithi153", "labels": [], "status": ""}] 2024-04-01T06:49:56.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:56.237+0000 7f3e02067700 1 -- 172.21.15.83:0/234791371 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f3de80387f0 msgr2=0x7f3de803acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:56.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:56.237+0000 7f3e02067700 1 --2- 172.21.15.83:0/234791371 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f3de80387f0 0x7f3de803acb0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3de4006fd0 tx=0x7f3de4006e40 comp rx=0 tx=0).stop 2024-04-01T06:49:56.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:56.237+0000 7f3e02067700 1 -- 172.21.15.83:0/234791371 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dfc1066c0 msgr2=0x7f3dfc0730b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:56.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:56.237+0000 7f3e02067700 1 --2- 172.21.15.83:0/234791371 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dfc1066c0 0x7f3dfc0730b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3dec004f40 tx=0x7f3dec005020 comp rx=0 tx=0).stop 2024-04-01T06:49:56.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:56.237+0000 7f3e02067700 1 -- 172.21.15.83:0/234791371 shutdown_connections 2024-04-01T06:49:56.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:56.237+0000 7f3e02067700 1 --2- 172.21.15.83:0/234791371 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f3de80387f0 0x7f3de803acb0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:56.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:56.237+0000 7f3e02067700 1 --2- 172.21.15.83:0/234791371 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dfc1066c0 0x7f3dfc0730b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:56.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:56.237+0000 7f3e02067700 1 -- 172.21.15.83:0/234791371 >> 172.21.15.83:0/234791371 conn(0x7f3dfc0fc1d0 msgr2=0x7f3dfc1082f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:49:56.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:56.237+0000 7f3e02067700 1 -- 172.21.15.83:0/234791371 shutdown_connections 2024-04-01T06:49:56.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:56.237+0000 7f3e02067700 1 -- 172.21.15.83:0/234791371 wait complete. 2024-04-01T06:49:56.616 INFO:tasks.cephadm:Setting crush tunables to default 2024-04-01T06:49:56.617 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph osd crush tunables default 2024-04-01T06:49:56.832 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:49:56.927 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:56 smithi083 ceph-mon[43429]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:49:56.927 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:56 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:49:57.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:57.746+0000 7f3d3b3e5700 1 -- 172.21.15.83:0/874885381 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d34105630 msgr2=0x7f3d34105a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:57.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:57.746+0000 7f3d3b3e5700 1 --2- 172.21.15.83:0/874885381 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d34105630 0x7f3d34105a10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3d30009910 tx=0x7f3d30009c20 comp rx=0 tx=0).stop 2024-04-01T06:49:57.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:57.747+0000 7f3d3b3e5700 1 -- 172.21.15.83:0/874885381 shutdown_connections 2024-04-01T06:49:57.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:57.747+0000 7f3d3b3e5700 1 --2- 172.21.15.83:0/874885381 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d34105630 0x7f3d34105a10 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:57.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:57.747+0000 7f3d3b3e5700 1 -- 172.21.15.83:0/874885381 >> 172.21.15.83:0/874885381 conn(0x7f3d34075110 msgr2=0x7f3d34075520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:49:57.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:57.747+0000 7f3d3b3e5700 1 -- 172.21.15.83:0/874885381 shutdown_connections 2024-04-01T06:49:57.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:57.747+0000 7f3d3b3e5700 1 -- 172.21.15.83:0/874885381 wait complete. 2024-04-01T06:49:57.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:57.747+0000 7f3d3b3e5700 1 Processor -- start 2024-04-01T06:49:57.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:57.747+0000 7f3d3b3e5700 1 -- start start 2024-04-01T06:49:57.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:57.747+0000 7f3d3b3e5700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d34105630 0x7f3d34194e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:57.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:57.747+0000 7f3d3b3e5700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d34195360 con 0x7f3d34105630 2024-04-01T06:49:57.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:57.748+0000 7f3d39181700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d34105630 0x7f3d34194e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:57.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:57.748+0000 7f3d39181700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d34105630 0x7f3d34194e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58778/0 (socket says 172.21.15.83:58778) 2024-04-01T06:49:57.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:57.748+0000 7f3d39181700 1 -- 172.21.15.83:0/3041272336 learned_addr learned my addr 172.21.15.83:0/3041272336 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:49:57.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:57.748+0000 7f3d39181700 1 -- 172.21.15.83:0/3041272336 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d300095f0 con 0x7f3d34105630 2024-04-01T06:49:57.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:57.748+0000 7f3d39181700 1 --2- 172.21.15.83:0/3041272336 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d34105630 0x7f3d34194e20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3d30006010 tx=0x7f3d30004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:57.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:57.748+0000 7f3d2a7fc700 1 -- 172.21.15.83:0/3041272336 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d3001d070 con 0x7f3d34105630 2024-04-01T06:49:57.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:57.748+0000 7f3d2a7fc700 1 -- 172.21.15.83:0/3041272336 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3d3000bc10 con 0x7f3d34105630 2024-04-01T06:49:57.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:57.748+0000 7f3d3b3e5700 1 -- 172.21.15.83:0/3041272336 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d34195560 con 0x7f3d34105630 2024-04-01T06:49:57.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:57.748+0000 7f3d2a7fc700 1 -- 172.21.15.83:0/3041272336 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d300038a0 con 0x7f3d34105630 2024-04-01T06:49:57.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:57.748+0000 7f3d3b3e5700 1 -- 172.21.15.83:0/3041272336 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d34195a00 con 0x7f3d34105630 2024-04-01T06:49:57.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:57.749+0000 7f3d2a7fc700 1 -- 172.21.15.83:0/3041272336 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 13) v1 ==== 45589+0+0 (secure 0 0 0) 0x7f3d30003ad0 con 0x7f3d34105630 2024-04-01T06:49:57.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:57.749+0000 7f3d3b3e5700 1 -- 172.21.15.83:0/3041272336 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d34107e80 con 0x7f3d34105630 2024-04-01T06:49:57.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:57.749+0000 7f3d2a7fc700 1 --2- 172.21.15.83:0/3041272336 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f3d200387a0 0x7f3d2003ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:49:57.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:57.749+0000 7f3d2a7fc700 1 -- 172.21.15.83:0/3041272336 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f3d3004c610 con 0x7f3d34105630 2024-04-01T06:49:57.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:57.749+0000 7f3d38980700 1 --2- 172.21.15.83:0/3041272336 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f3d200387a0 0x7f3d2003ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:49:57.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:57.750+0000 7f3d38980700 1 --2- 172.21.15.83:0/3041272336 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f3d200387a0 0x7f3d2003ac60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3d24006fd0 tx=0x7f3d24006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:49:57.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:57.754+0000 7f3d2a7fc700 1 -- 172.21.15.83:0/3041272336 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f3d30029950 con 0x7f3d34105630 2024-04-01T06:49:57.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:57.949+0000 7f3d3b3e5700 1 -- 172.21.15.83:0/3041272336 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f3d34100d00 con 0x7f3d34105630 2024-04-01T06:49:58.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:57 smithi083 ceph-mon[43429]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T06:49:58.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:58.826+0000 7f3d2a7fc700 1 -- 172.21.15.83:0/3041272336 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f3d30026070 con 0x7f3d34105630 2024-04-01T06:49:58.827 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:58.828+0000 7f3d3b3e5700 1 -- 172.21.15.83:0/3041272336 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f3d200387a0 msgr2=0x7f3d2003ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:58.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:58.828+0000 7f3d3b3e5700 1 --2- 172.21.15.83:0/3041272336 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f3d200387a0 0x7f3d2003ac60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3d24006fd0 tx=0x7f3d24006e40 comp rx=0 tx=0).stop 2024-04-01T06:49:58.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:58.828+0000 7f3d3b3e5700 1 -- 172.21.15.83:0/3041272336 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d34105630 msgr2=0x7f3d34194e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:49:58.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:58.828+0000 7f3d3b3e5700 1 --2- 172.21.15.83:0/3041272336 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d34105630 0x7f3d34194e20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3d30006010 tx=0x7f3d30004ff0 comp rx=0 tx=0).stop 2024-04-01T06:49:58.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:58.828+0000 7f3d3b3e5700 1 -- 172.21.15.83:0/3041272336 shutdown_connections 2024-04-01T06:49:58.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:58.828+0000 7f3d3b3e5700 1 --2- 172.21.15.83:0/3041272336 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f3d200387a0 0x7f3d2003ac60 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:58.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:58.828+0000 7f3d3b3e5700 1 --2- 172.21.15.83:0/3041272336 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d34105630 0x7f3d34194e20 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:49:58.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:58.828+0000 7f3d3b3e5700 1 -- 172.21.15.83:0/3041272336 >> 172.21.15.83:0/3041272336 conn(0x7f3d34075110 msgr2=0x7f3d340fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:49:58.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:58.828+0000 7f3d3b3e5700 1 -- 172.21.15.83:0/3041272336 shutdown_connections 2024-04-01T06:49:58.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:49:58.828+0000 7f3d3b3e5700 1 -- 172.21.15.83:0/3041272336 wait complete. 2024-04-01T06:49:58.828 INFO:teuthology.orchestra.run.smithi083.stderr:adjusted tunables profile to default 2024-04-01T06:49:59.106 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:58 smithi083 ceph-mon[43429]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:49:59.106 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:58 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/3041272336' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-01T06:49:59.107 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:58 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:49:59.107 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:58 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:49:59.107 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:58 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:49:59.107 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:58 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:49:59.107 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:58 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi153", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:49:59.107 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:58 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:49:59.107 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:58 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:49:59.174 INFO:tasks.cephadm:Adding mon.a on smithi083 2024-04-01T06:49:59.174 INFO:tasks.cephadm:Adding mon.b on smithi145 2024-04-01T06:49:59.175 INFO:tasks.cephadm:Adding mon.c on smithi153 2024-04-01T06:49:59.175 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph orch apply mon '3;smithi083:172.21.15.83=a;smithi145:172.21.15.145=b;smithi153:172.21.15.153=c' 2024-04-01T06:49:59.414 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-04-01T06:50:00.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:59 smithi083 ceph-mon[43429]: Updating smithi153:/etc/ceph/ceph.conf 2024-04-01T06:50:00.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:59 smithi083 ceph-mon[43429]: Updating smithi153:/var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-04-01T06:50:00.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:59 smithi083 ceph-mon[43429]: Updating smithi153:/etc/ceph/ceph.client.admin.keyring 2024-04-01T06:50:00.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:59 smithi083 ceph-mon[43429]: Updating smithi153:/var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-01T06:50:00.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:59 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/3041272336' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-01T06:50:00.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:59 smithi083 ceph-mon[43429]: osdmap e4: 0 total, 0 up, 0 in 2024-04-01T06:50:00.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:59 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:00.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:59 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:00.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:49:59 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:00.368 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:00.368+0000 7f86102ec700 1 -- 172.21.15.153:0/3547900928 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86081066d0 msgr2=0x7f8608106ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:50:00.368 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:00.368+0000 7f86102ec700 1 --2- 172.21.15.153:0/3547900928 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86081066d0 0x7f8608106ab0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f85f8009910 tx=0x7f85f8009c20 comp rx=0 tx=0).stop 2024-04-01T06:50:00.368 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:00.368+0000 7f86102ec700 1 -- 172.21.15.153:0/3547900928 shutdown_connections 2024-04-01T06:50:00.368 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:00.368+0000 7f86102ec700 1 --2- 172.21.15.153:0/3547900928 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86081066d0 0x7f8608106ab0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:50:00.368 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:00.368+0000 7f86102ec700 1 -- 172.21.15.153:0/3547900928 >> 172.21.15.153:0/3547900928 conn(0x7f8608075110 msgr2=0x7f8608075520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:50:00.368 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:00.368+0000 7f86102ec700 1 -- 172.21.15.153:0/3547900928 shutdown_connections 2024-04-01T06:50:00.368 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:00.368+0000 7f86102ec700 1 -- 172.21.15.153:0/3547900928 wait complete. 2024-04-01T06:50:00.368 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:00.369+0000 7f86102ec700 1 Processor -- start 2024-04-01T06:50:00.368 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:00.369+0000 7f86102ec700 1 -- start start 2024-04-01T06:50:00.369 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:00.369+0000 7f86102ec700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86081066d0 0x7f8608195fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:50:00.369 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:00.369+0000 7f86102ec700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86081964f0 con 0x7f86081066d0 2024-04-01T06:50:00.369 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:00.369+0000 7f860e088700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86081066d0 0x7f8608195fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:50:00.369 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:00.369+0000 7f860e088700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86081066d0 0x7f8608195fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.153:43402/0 (socket says 172.21.15.153:43402) 2024-04-01T06:50:00.369 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:00.369+0000 7f860e088700 1 -- 172.21.15.153:0/3710448513 learned_addr learned my addr 172.21.15.153:0/3710448513 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-04-01T06:50:00.369 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:00.369+0000 7f860e088700 1 -- 172.21.15.153:0/3710448513 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f80095f0 con 0x7f86081066d0 2024-04-01T06:50:00.370 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:00.370+0000 7f860e088700 1 --2- 172.21.15.153:0/3710448513 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86081066d0 0x7f8608195fb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f85f8004f40 tx=0x7f85f8005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:50:00.370 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:00.370+0000 7f85ff7fe700 1 -- 172.21.15.153:0/3710448513 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f85f801d070 con 0x7f86081066d0 2024-04-01T06:50:00.371 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:00.370+0000 7f86102ec700 1 -- 172.21.15.153:0/3710448513 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8608196750 con 0x7f86081066d0 2024-04-01T06:50:00.371 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:00.370+0000 7f85ff7fe700 1 -- 172.21.15.153:0/3710448513 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f85f800bbb0 con 0x7f86081066d0 2024-04-01T06:50:00.371 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:00.370+0000 7f85ff7fe700 1 -- 172.21.15.153:0/3710448513 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f85f8003810 con 0x7f86081066d0 2024-04-01T06:50:00.371 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:00.370+0000 7f86102ec700 1 -- 172.21.15.153:0/3710448513 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8608196bd0 con 0x7f86081066d0 2024-04-01T06:50:00.371 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:00.371+0000 7f86102ec700 1 -- 172.21.15.153:0/3710448513 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8608101e10 con 0x7f86081066d0 2024-04-01T06:50:00.371 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:00.371+0000 7f85ff7fe700 1 -- 172.21.15.153:0/3710448513 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 13) v1 ==== 45589+0+0 (secure 0 0 0) 0x7f85f800bd20 con 0x7f86081066d0 2024-04-01T06:50:00.371 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:00.371+0000 7f85ff7fe700 1 --2- 172.21.15.153:0/3710448513 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f85f40387a0 0x7f85f403ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:50:00.371 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:00.371+0000 7f85ff7fe700 1 -- 172.21.15.153:0/3710448513 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f85f804c480 con 0x7f86081066d0 2024-04-01T06:50:00.371 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:00.371+0000 7f860d887700 1 --2- 172.21.15.153:0/3710448513 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f85f40387a0 0x7f85f403ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:50:00.371 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:00.372+0000 7f860d887700 1 --2- 172.21.15.153:0/3710448513 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f85f40387a0 0x7f85f403ac60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8604006fd0 tx=0x7f8604006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:50:00.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:00.376+0000 7f85ff7fe700 1 -- 172.21.15.153:0/3710448513 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f85f802ab60 con 0x7f86081066d0 2024-04-01T06:50:00.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:00.575+0000 7f86102ec700 1 -- 172.21.15.153:0/3710448513 --> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi083:172.21.15.83=a;smithi145:172.21.15.145=b;smithi153:172.21.15.153=c", "target": ["mon-mgr", ""]}) v1 -- 0x7f860810aa70 con 0x7f85f40387a0 2024-04-01T06:50:00.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:00.582+0000 7f85ff7fe700 1 -- 172.21.15.153:0/3710448513 <== mgr.14152 v2:172.21.15.83:6800/3375372052 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f860810aa70 con 0x7f85f40387a0 2024-04-01T06:50:00.580 INFO:teuthology.orchestra.run.smithi153.stdout:Scheduled mon update... 2024-04-01T06:50:00.582 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:00.584+0000 7f86102ec700 1 -- 172.21.15.153:0/3710448513 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f85f40387a0 msgr2=0x7f85f403ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:50:00.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:00.584+0000 7f86102ec700 1 --2- 172.21.15.153:0/3710448513 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f85f40387a0 0x7f85f403ac60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8604006fd0 tx=0x7f8604006e40 comp rx=0 tx=0).stop 2024-04-01T06:50:00.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:00.584+0000 7f86102ec700 1 -- 172.21.15.153:0/3710448513 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86081066d0 msgr2=0x7f8608195fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:50:00.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:00.584+0000 7f86102ec700 1 --2- 172.21.15.153:0/3710448513 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86081066d0 0x7f8608195fb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f85f8004f40 tx=0x7f85f8005020 comp rx=0 tx=0).stop 2024-04-01T06:50:00.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:00.584+0000 7f86102ec700 1 -- 172.21.15.153:0/3710448513 shutdown_connections 2024-04-01T06:50:00.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:00.584+0000 7f86102ec700 1 --2- 172.21.15.153:0/3710448513 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f85f40387a0 0x7f85f403ac60 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:50:00.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:00.584+0000 7f86102ec700 1 --2- 172.21.15.153:0/3710448513 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86081066d0 0x7f8608195fb0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:50:00.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:00.584+0000 7f86102ec700 1 -- 172.21.15.153:0/3710448513 >> 172.21.15.153:0/3710448513 conn(0x7f8608075110 msgr2=0x7f86080fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:50:00.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:00.584+0000 7f86102ec700 1 -- 172.21.15.153:0/3710448513 shutdown_connections 2024-04-01T06:50:00.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:00.584+0000 7f86102ec700 1 -- 172.21.15.153:0/3710448513 wait complete. 2024-04-01T06:50:00.957 DEBUG:teuthology.orchestra.run.smithi145:mon.b> sudo journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mon.b.service 2024-04-01T06:50:00.960 DEBUG:teuthology.orchestra.run.smithi153:mon.c> sudo journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mon.c.service 2024-04-01T06:50:00.962 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-01T06:50:00.962 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph mon dump -f json 2024-04-01T06:50:00.992 INFO:journalctl@ceph.mon.c.smithi153.stdout:-- Logs begin at Mon 2024-04-01 06:35:09 UTC. -- 2024-04-01T06:50:00.996 INFO:journalctl@ceph.mon.b.smithi145.stdout:-- Logs begin at Mon 2024-04-01 06:34:41 UTC. -- 2024-04-01T06:50:01.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:00 smithi083 ceph-mon[43429]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:01.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:00 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:01.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:00 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:50:01.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:00 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:01.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:00 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:50:01.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:00 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:01.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:00 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-01T06:50:01.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:00 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:01.397 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-04-01T06:50:02.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:01 smithi083 ceph-mon[43429]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi083:172.21.15.83=a;smithi145:172.21.15.145=b;smithi153:172.21.15.153=c", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:50:02.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:01 smithi083 ceph-mon[43429]: Saving service mon spec with placement smithi083:172.21.15.83=a;smithi145:172.21.15.145=b;smithi153:172.21.15.153=c;count:3 2024-04-01T06:50:02.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:01 smithi083 ceph-mon[43429]: Deploying daemon mon.c on smithi153 2024-04-01T06:50:02.692 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:02.693+0000 7ff0155df700 1 -- 172.21.15.153:0/901287556 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff0101066c0 msgr2=0x7ff010106aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:50:02.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:02.693+0000 7ff0155df700 1 --2- 172.21.15.153:0/901287556 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff0101066c0 0x7ff010106aa0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff000009910 tx=0x7ff000009c20 comp rx=0 tx=0).stop 2024-04-01T06:50:02.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:02.693+0000 7ff0155df700 1 -- 172.21.15.153:0/901287556 shutdown_connections 2024-04-01T06:50:02.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:02.693+0000 7ff0155df700 1 --2- 172.21.15.153:0/901287556 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff0101066c0 0x7ff010106aa0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:50:02.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:02.693+0000 7ff0155df700 1 -- 172.21.15.153:0/901287556 >> 172.21.15.153:0/901287556 conn(0x7ff0100fc1d0 msgr2=0x7ff0100fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:50:02.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:02.693+0000 7ff0155df700 1 -- 172.21.15.153:0/901287556 shutdown_connections 2024-04-01T06:50:02.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:02.693+0000 7ff0155df700 1 -- 172.21.15.153:0/901287556 wait complete. 2024-04-01T06:50:02.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:02.693+0000 7ff0155df700 1 Processor -- start 2024-04-01T06:50:02.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:02.694+0000 7ff0155df700 1 -- start start 2024-04-01T06:50:02.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:02.694+0000 7ff0155df700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff0101066c0 0x7ff010195f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:50:02.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:02.694+0000 7ff0155df700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0101964b0 con 0x7ff0101066c0 2024-04-01T06:50:02.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:02.694+0000 7ff00effd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff0101066c0 0x7ff010195f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:50:02.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:02.694+0000 7ff00effd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff0101066c0 0x7ff010195f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.153:43428/0 (socket says 172.21.15.153:43428) 2024-04-01T06:50:02.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:02.694+0000 7ff00effd700 1 -- 172.21.15.153:0/2211432113 learned_addr learned my addr 172.21.15.153:0/2211432113 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-04-01T06:50:02.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:02.694+0000 7ff00effd700 1 -- 172.21.15.153:0/2211432113 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0000095f0 con 0x7ff0101066c0 2024-04-01T06:50:02.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:02.695+0000 7ff00effd700 1 --2- 172.21.15.153:0/2211432113 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff0101066c0 0x7ff010195f70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff000004f40 tx=0x7ff000005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:50:02.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:02.695+0000 7feff7fff700 1 -- 172.21.15.153:0/2211432113 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff00001d070 con 0x7ff0101066c0 2024-04-01T06:50:02.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:02.695+0000 7ff0155df700 1 -- 172.21.15.153:0/2211432113 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff010196710 con 0x7ff0101066c0 2024-04-01T06:50:02.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:02.695+0000 7feff7fff700 1 -- 172.21.15.153:0/2211432113 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff00000bbb0 con 0x7ff0101066c0 2024-04-01T06:50:02.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:02.695+0000 7feff7fff700 1 -- 172.21.15.153:0/2211432113 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff000003810 con 0x7ff0101066c0 2024-04-01T06:50:02.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:02.695+0000 7ff0155df700 1 -- 172.21.15.153:0/2211432113 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff010196b90 con 0x7ff0101066c0 2024-04-01T06:50:02.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:02.696+0000 7feff7fff700 1 -- 172.21.15.153:0/2211432113 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 13) v1 ==== 45589+0+0 (secure 0 0 0) 0x7ff00000b6f0 con 0x7ff0101066c0 2024-04-01T06:50:02.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:02.696+0000 7ff0155df700 1 -- 172.21.15.153:0/2211432113 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0101045c0 con 0x7ff0101066c0 2024-04-01T06:50:02.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:02.696+0000 7feff7fff700 1 --2- 172.21.15.153:0/2211432113 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7feff80387f0 0x7feff803acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:50:02.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:02.696+0000 7feff7fff700 1 -- 172.21.15.153:0/2211432113 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7ff00004c420 con 0x7ff0101066c0 2024-04-01T06:50:02.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:02.696+0000 7ff00e7fc700 1 --2- 172.21.15.153:0/2211432113 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7feff80387f0 0x7feff803acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:50:02.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:02.697+0000 7ff00e7fc700 1 --2- 172.21.15.153:0/2211432113 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7feff80387f0 0x7feff803acb0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff004006fd0 tx=0x7ff004006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:50:02.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:02.701+0000 7feff7fff700 1 -- 172.21.15.153:0/2211432113 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7ff000029540 con 0x7ff0101066c0 2024-04-01T06:50:02.986 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:02.986+0000 7ff0155df700 1 -- 172.21.15.153:0/2211432113 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff010101e00 con 0x7ff0101066c0 2024-04-01T06:50:02.986 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:02.987+0000 7feff7fff700 1 -- 172.21.15.153:0/2211432113 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+736 (secure 0 0 0) 0x7ff000026070 con 0x7ff0101066c0 2024-04-01T06:50:02.986 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-01T06:50:02.986 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":1,"fsid":"c6f8eff4-eff3-11ee-b647-cb9ed24678a4","modified":"2024-04-01T06:48:39.939958Z","created":"2024-04-01T06:48:39.939958Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:3300","nonce":0},{"type":"v1","addr":"172.21.15.83:6789","nonce":0}]},"addr":"172.21.15.83:6789/0","public_addr":"172.21.15.83:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-01T06:50:02.990 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:02.990+0000 7ff0155df700 1 -- 172.21.15.153:0/2211432113 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7feff80387f0 msgr2=0x7feff803acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:50:02.990 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:02.990+0000 7ff0155df700 1 --2- 172.21.15.153:0/2211432113 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7feff80387f0 0x7feff803acb0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff004006fd0 tx=0x7ff004006e40 comp rx=0 tx=0).stop 2024-04-01T06:50:02.990 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:02.990+0000 7ff0155df700 1 -- 172.21.15.153:0/2211432113 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff0101066c0 msgr2=0x7ff010195f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:50:02.990 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:02.990+0000 7ff0155df700 1 --2- 172.21.15.153:0/2211432113 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff0101066c0 0x7ff010195f70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff000004f40 tx=0x7ff000005020 comp rx=0 tx=0).stop 2024-04-01T06:50:02.990 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:02.990+0000 7ff0155df700 1 -- 172.21.15.153:0/2211432113 shutdown_connections 2024-04-01T06:50:02.990 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:02.990+0000 7ff0155df700 1 --2- 172.21.15.153:0/2211432113 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7feff80387f0 0x7feff803acb0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:50:02.990 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:02.990+0000 7ff0155df700 1 --2- 172.21.15.153:0/2211432113 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff0101066c0 0x7ff010195f70 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:50:02.990 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:02.990+0000 7ff0155df700 1 -- 172.21.15.153:0/2211432113 >> 172.21.15.153:0/2211432113 conn(0x7ff0100fc1d0 msgr2=0x7ff010108370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:50:02.990 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:02.990+0000 7ff0155df700 1 -- 172.21.15.153:0/2211432113 shutdown_connections 2024-04-01T06:50:02.990 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:02.990+0000 7ff0155df700 1 -- 172.21.15.153:0/2211432113 wait complete. 2024-04-01T06:50:02.990 INFO:teuthology.orchestra.run.smithi153.stderr:dumped monmap epoch 1 2024-04-01T06:50:03.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:02 smithi083 ceph-mon[43429]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:03.580 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 systemd[1]: Starting Ceph mon.c for c6f8eff4-eff3-11ee-b647-cb9ed24678a4... 2024-04-01T06:50:04.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:03 smithi083 ceph-mon[43429]: from='client.? 172.21.15.153:0/2211432113' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-01T06:50:04.349 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-01T06:50:04.349 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph mon dump -f json 2024-04-01T06:50:04.381 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: set uid:gid to 167:167 (ceph:ceph) 2024-04-01T06:50:04.381 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: ceph version 18.2.2-1001-g9d2ee692 (9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12) reef (stable), process ceph-mon, pid 7 2024-04-01T06:50:04.381 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: pidfile_write: ignore empty --pid-file 2024-04-01T06:50:04.382 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: load: jerasure load: lrc 2024-04-01T06:50:04.382 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 bash[48149]: 6dba70c267b79fc9d54b716d34ac86382e403cf1af0ba08505006ab13eb2d9d4 2024-04-01T06:50:04.382 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: RocksDB version: 7.9.2 2024-04-01T06:50:04.382 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Git sha 0 2024-04-01T06:50:04.382 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Compile date 2024-03-27 03:54:40 2024-04-01T06:50:04.382 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: DB SUMMARY 2024-04-01T06:50:04.382 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: DB Session ID: 50SDD70S75RW26DBG10J 2024-04-01T06:50:04.382 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: CURRENT file: CURRENT 2024-04-01T06:50:04.382 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: IDENTITY file: IDENTITY 2024-04-01T06:50:04.383 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-04-01T06:50:04.383 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-04-01T06:50:04.383 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-04-01T06:50:04.383 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.error_if_exists: 0 2024-04-01T06:50:04.383 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.create_if_missing: 0 2024-04-01T06:50:04.383 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.paranoid_checks: 1 2024-04-01T06:50:04.383 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-01T06:50:04.383 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-01T06:50:04.383 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-01T06:50:04.383 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.env: 0x559a665db720 2024-04-01T06:50:04.383 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.fs: PosixFileSystem 2024-04-01T06:50:04.383 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.info_log: 0x559a67f1d4e0 2024-04-01T06:50:04.383 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.max_file_opening_threads: 16 2024-04-01T06:50:04.384 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.statistics: (nil) 2024-04-01T06:50:04.384 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.use_fsync: 0 2024-04-01T06:50:04.384 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.max_log_file_size: 0 2024-04-01T06:50:04.384 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-01T06:50:04.384 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-01T06:50:04.384 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.keep_log_file_num: 1000 2024-04-01T06:50:04.384 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.recycle_log_file_num: 0 2024-04-01T06:50:04.384 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.allow_fallocate: 1 2024-04-01T06:50:04.384 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.allow_mmap_reads: 0 2024-04-01T06:50:04.384 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.allow_mmap_writes: 0 2024-04-01T06:50:04.384 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.use_direct_reads: 0 2024-04-01T06:50:04.384 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-01T06:50:04.384 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.create_missing_column_families: 0 2024-04-01T06:50:04.385 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.db_log_dir: 2024-04-01T06:50:04.385 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.wal_dir: 2024-04-01T06:50:04.385 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-01T06:50:04.385 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-01T06:50:04.385 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-01T06:50:04.385 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-01T06:50:04.385 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-01T06:50:04.385 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-01T06:50:04.385 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.advise_random_on_open: 1 2024-04-01T06:50:04.385 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.db_write_buffer_size: 0 2024-04-01T06:50:04.385 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.write_buffer_manager: 0x559a671b4320 2024-04-01T06:50:04.385 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-01T06:50:04.385 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-01T06:50:04.385 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-01T06:50:04.386 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.rate_limiter: (nil) 2024-04-01T06:50:04.386 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-01T06:50:04.386 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.wal_recovery_mode: 2 2024-04-01T06:50:04.386 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.enable_thread_tracking: 0 2024-04-01T06:50:04.386 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.enable_pipelined_write: 0 2024-04-01T06:50:04.386 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.unordered_write: 0 2024-04-01T06:50:04.386 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-01T06:50:04.386 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-01T06:50:04.386 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-01T06:50:04.386 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-01T06:50:04.386 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.row_cache: None 2024-04-01T06:50:04.386 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.wal_filter: None 2024-04-01T06:50:04.387 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-01T06:50:04.387 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.allow_ingest_behind: 0 2024-04-01T06:50:04.387 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.two_write_queues: 0 2024-04-01T06:50:04.387 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.manual_wal_flush: 0 2024-04-01T06:50:04.387 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.wal_compression: 0 2024-04-01T06:50:04.387 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.atomic_flush: 0 2024-04-01T06:50:04.387 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-01T06:50:04.387 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-01T06:50:04.387 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-01T06:50:04.387 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.log_readahead_size: 0 2024-04-01T06:50:04.387 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-01T06:50:04.387 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.best_efforts_recovery: 0 2024-04-01T06:50:04.387 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-01T06:50:04.387 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-01T06:50:04.387 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.allow_data_in_errors: 0 2024-04-01T06:50:04.387 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.db_host_id: __hostname__ 2024-04-01T06:50:04.388 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-01T06:50:04.388 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.max_background_jobs: 2 2024-04-01T06:50:04.388 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.max_background_compactions: -1 2024-04-01T06:50:04.388 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.max_subcompactions: 1 2024-04-01T06:50:04.388 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-01T06:50:04.388 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-01T06:50:04.388 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-01T06:50:04.388 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.max_total_wal_size: 0 2024-04-01T06:50:04.388 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-01T06:50:04.388 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-01T06:50:04.388 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-01T06:50:04.388 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-01T06:50:04.388 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.max_open_files: -1 2024-04-01T06:50:04.388 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.bytes_per_sync: 0 2024-04-01T06:50:04.389 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-01T06:50:04.389 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-01T06:50:04.389 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.compaction_readahead_size: 0 2024-04-01T06:50:04.389 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.max_background_flushes: -1 2024-04-01T06:50:04.389 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Compression algorithms supported: 2024-04-01T06:50:04.389 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-01T06:50:04.389 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: kZSTD supported: 0 2024-04-01T06:50:04.389 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: kXpressCompression supported: 0 2024-04-01T06:50:04.389 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: kLZ4HCCompression supported: 1 2024-04-01T06:50:04.389 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: kZlibCompression supported: 1 2024-04-01T06:50:04.389 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: kSnappyCompression supported: 1 2024-04-01T06:50:04.389 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: kLZ4Compression supported: 1 2024-04-01T06:50:04.389 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: kBZip2Compression supported: 0 2024-04-01T06:50:04.389 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-01T06:50:04.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-01T06:50:04.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-04-01T06:50:04.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-01T06:50:04.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-01T06:50:04.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.merge_operator: 2024-04-01T06:50:04.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.compaction_filter: None 2024-04-01T06:50:04.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.compaction_filter_factory: None 2024-04-01T06:50:04.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.sst_partitioner_factory: None 2024-04-01T06:50:04.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-01T06:50:04.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-01T06:50:04.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x559a67f1d5e0) 2024-04-01T06:50:04.391 INFO:journalctl@ceph.mon.c.smithi153.stdout: cache_index_and_filter_blocks: 1 2024-04-01T06:50:04.391 INFO:journalctl@ceph.mon.c.smithi153.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-01T06:50:04.391 INFO:journalctl@ceph.mon.c.smithi153.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-01T06:50:04.391 INFO:journalctl@ceph.mon.c.smithi153.stdout: pin_top_level_index_and_filter: 1 2024-04-01T06:50:04.391 INFO:journalctl@ceph.mon.c.smithi153.stdout: index_type: 0 2024-04-01T06:50:04.391 INFO:journalctl@ceph.mon.c.smithi153.stdout: data_block_index_type: 0 2024-04-01T06:50:04.391 INFO:journalctl@ceph.mon.c.smithi153.stdout: index_shortening: 1 2024-04-01T06:50:04.391 INFO:journalctl@ceph.mon.c.smithi153.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-01T06:50:04.391 INFO:journalctl@ceph.mon.c.smithi153.stdout: checksum: 4 2024-04-01T06:50:04.391 INFO:journalctl@ceph.mon.c.smithi153.stdout: no_block_cache: 0 2024-04-01T06:50:04.391 INFO:journalctl@ceph.mon.c.smithi153.stdout: block_cache: 0x559a672351f0 2024-04-01T06:50:04.392 INFO:journalctl@ceph.mon.c.smithi153.stdout: block_cache_name: BinnedLRUCache 2024-04-01T06:50:04.392 INFO:journalctl@ceph.mon.c.smithi153.stdout: block_cache_options: 2024-04-01T06:50:04.392 INFO:journalctl@ceph.mon.c.smithi153.stdout: capacity : 536870912 2024-04-01T06:50:04.392 INFO:journalctl@ceph.mon.c.smithi153.stdout: num_shard_bits : 4 2024-04-01T06:50:04.392 INFO:journalctl@ceph.mon.c.smithi153.stdout: strict_capacity_limit : 0 2024-04-01T06:50:04.392 INFO:journalctl@ceph.mon.c.smithi153.stdout: high_pri_pool_ratio: 0.000 2024-04-01T06:50:04.392 INFO:journalctl@ceph.mon.c.smithi153.stdout: block_cache_compressed: (nil) 2024-04-01T06:50:04.392 INFO:journalctl@ceph.mon.c.smithi153.stdout: persistent_cache: (nil) 2024-04-01T06:50:04.392 INFO:journalctl@ceph.mon.c.smithi153.stdout: block_size: 4096 2024-04-01T06:50:04.392 INFO:journalctl@ceph.mon.c.smithi153.stdout: block_size_deviation: 10 2024-04-01T06:50:04.392 INFO:journalctl@ceph.mon.c.smithi153.stdout: block_restart_interval: 16 2024-04-01T06:50:04.392 INFO:journalctl@ceph.mon.c.smithi153.stdout: index_block_restart_interval: 1 2024-04-01T06:50:04.392 INFO:journalctl@ceph.mon.c.smithi153.stdout: metadata_block_size: 4096 2024-04-01T06:50:04.392 INFO:journalctl@ceph.mon.c.smithi153.stdout: partition_filters: 0 2024-04-01T06:50:04.393 INFO:journalctl@ceph.mon.c.smithi153.stdout: use_delta_encoding: 1 2024-04-01T06:50:04.393 INFO:journalctl@ceph.mon.c.smithi153.stdout: filter_policy: bloomfilter 2024-04-01T06:50:04.393 INFO:journalctl@ceph.mon.c.smithi153.stdout: whole_key_filtering: 1 2024-04-01T06:50:04.393 INFO:journalctl@ceph.mon.c.smithi153.stdout: verify_compression: 0 2024-04-01T06:50:04.393 INFO:journalctl@ceph.mon.c.smithi153.stdout: read_amp_bytes_per_bit: 0 2024-04-01T06:50:04.393 INFO:journalctl@ceph.mon.c.smithi153.stdout: format_version: 5 2024-04-01T06:50:04.393 INFO:journalctl@ceph.mon.c.smithi153.stdout: enable_index_compression: 1 2024-04-01T06:50:04.393 INFO:journalctl@ceph.mon.c.smithi153.stdout: block_align: 0 2024-04-01T06:50:04.393 INFO:journalctl@ceph.mon.c.smithi153.stdout: max_auto_readahead_size: 262144 2024-04-01T06:50:04.393 INFO:journalctl@ceph.mon.c.smithi153.stdout: prepopulate_block_cache: 0 2024-04-01T06:50:04.393 INFO:journalctl@ceph.mon.c.smithi153.stdout: initial_auto_readahead_size: 8192 2024-04-01T06:50:04.393 INFO:journalctl@ceph.mon.c.smithi153.stdout: num_file_reads_for_auto_readahead: 2 2024-04-01T06:50:04.393 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.write_buffer_size: 33554432 2024-04-01T06:50:04.394 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.max_write_buffer_number: 2 2024-04-01T06:50:04.394 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.compression: NoCompression 2024-04-01T06:50:04.394 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.bottommost_compression: Disabled 2024-04-01T06:50:04.394 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.prefix_extractor: nullptr 2024-04-01T06:50:04.394 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-01T06:50:04.394 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.num_levels: 7 2024-04-01T06:50:04.394 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-01T06:50:04.394 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-01T06:50:04.394 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-01T06:50:04.394 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-01T06:50:04.394 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-01T06:50:04.395 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-01T06:50:04.395 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-01T06:50:04.395 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-01T06:50:04.395 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-01T06:50:04.395 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-01T06:50:04.395 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-01T06:50:04.395 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-01T06:50:04.395 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-01T06:50:04.395 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.compression_opts.level: 32767 2024-04-01T06:50:04.395 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.compression_opts.strategy: 0 2024-04-01T06:50:04.395 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-01T06:50:04.395 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-01T06:50:04.395 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-01T06:50:04.395 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-01T06:50:04.395 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.compression_opts.enabled: false 2024-04-01T06:50:04.395 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-01T06:50:04.396 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-01T06:50:04.396 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-01T06:50:04.396 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-01T06:50:04.396 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.target_file_size_base: 67108864 2024-04-01T06:50:04.396 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-01T06:50:04.396 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-01T06:50:04.396 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-01T06:50:04.396 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-01T06:50:04.396 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-01T06:50:04.396 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-01T06:50:04.396 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-01T06:50:04.396 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-01T06:50:04.396 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-01T06:50:04.396 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-01T06:50:04.396 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-01T06:50:04.397 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-01T06:50:04.397 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-01T06:50:04.397 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-01T06:50:04.397 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.arena_block_size: 1048576 2024-04-01T06:50:04.397 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-01T06:50:04.397 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-01T06:50:04.397 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.disable_auto_compactions: 0 2024-04-01T06:50:04.397 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-01T06:50:04.397 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-01T06:50:04.398 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-01T06:50:04.398 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-01T06:50:04.398 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-01T06:50:04.398 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-01T06:50:04.398 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-01T06:50:04.399 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-01T06:50:04.399 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-01T06:50:04.399 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-01T06:50:04.399 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.table_properties_collectors: 2024-04-01T06:50:04.399 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.inplace_update_support: 0 2024-04-01T06:50:04.399 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-01T06:50:04.399 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-01T06:50:04.399 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-01T06:50:04.399 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-01T06:50:04.399 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.bloom_locality: 0 2024-04-01T06:50:04.399 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.max_successive_merges: 0 2024-04-01T06:50:04.399 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-01T06:50:04.399 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.paranoid_file_checks: 0 2024-04-01T06:50:04.399 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.force_consistency_checks: 1 2024-04-01T06:50:04.399 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.report_bg_io_stats: 0 2024-04-01T06:50:04.400 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.ttl: 2592000 2024-04-01T06:50:04.400 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-01T06:50:04.400 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-01T06:50:04.400 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-01T06:50:04.400 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.enable_blob_files: false 2024-04-01T06:50:04.400 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.min_blob_size: 0 2024-04-01T06:50:04.400 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.blob_file_size: 268435456 2024-04-01T06:50:04.400 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-01T06:50:04.400 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-01T06:50:04.400 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-01T06:50:04.401 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-01T06:50:04.401 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-01T06:50:04.401 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.blob_file_starting_level: 0 2024-04-01T06:50:04.401 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-01T06:50:04.401 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-01T06:50:04.401 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-04-01T06:50:04.401 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 1823a929-2c89-4665-b8b5-c3098173744f 2024-04-01T06:50:04.401 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711954203906839, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-04-01T06:50:04.401 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-04-01T06:50:04.401 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 systemd[1]: Started Ceph mon.c for c6f8eff4-eff3-11ee-b647-cb9ed24678a4. 2024-04-01T06:50:04.401 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711954203907261, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1711954203, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "1823a929-2c89-4665-b8b5-c3098173744f", "db_session_id": "50SDD70S75RW26DBG10J", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-04-01T06:50:04.401 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711954203907334, "job": 1, "event": "recovery_finished"} 2024-04-01T06:50:04.401 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-04-01T06:50:04.401 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-01T06:50:04.401 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x559a672d2000 2024-04-01T06:50:04.402 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: DB pointer 0x559a672c0000 2024-04-01T06:50:04.402 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-01T06:50:04.402 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-01T06:50:04.402 INFO:journalctl@ceph.mon.c.smithi153.stdout: ** DB Stats ** 2024-04-01T06:50:04.402 INFO:journalctl@ceph.mon.c.smithi153.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-01T06:50:04.402 INFO:journalctl@ceph.mon.c.smithi153.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-01T06:50:04.402 INFO:journalctl@ceph.mon.c.smithi153.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-01T06:50:04.402 INFO:journalctl@ceph.mon.c.smithi153.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-01T06:50:04.402 INFO:journalctl@ceph.mon.c.smithi153.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-01T06:50:04.402 INFO:journalctl@ceph.mon.c.smithi153.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-01T06:50:04.402 INFO:journalctl@ceph.mon.c.smithi153.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-01T06:50:04.402 INFO:journalctl@ceph.mon.c.smithi153.stdout: 2024-04-01T06:50:04.402 INFO:journalctl@ceph.mon.c.smithi153.stdout: ** Compaction Stats [default] ** 2024-04-01T06:50:04.402 INFO:journalctl@ceph.mon.c.smithi153.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-01T06:50:04.403 INFO:journalctl@ceph.mon.c.smithi153.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-01T06:50:04.403 INFO:journalctl@ceph.mon.c.smithi153.stdout: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-01T06:50:04.403 INFO:journalctl@ceph.mon.c.smithi153.stdout: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-01T06:50:04.403 INFO:journalctl@ceph.mon.c.smithi153.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-01T06:50:04.403 INFO:journalctl@ceph.mon.c.smithi153.stdout: 2024-04-01T06:50:04.403 INFO:journalctl@ceph.mon.c.smithi153.stdout: ** Compaction Stats [default] ** 2024-04-01T06:50:04.403 INFO:journalctl@ceph.mon.c.smithi153.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-01T06:50:04.403 INFO:journalctl@ceph.mon.c.smithi153.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-01T06:50:04.403 INFO:journalctl@ceph.mon.c.smithi153.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-01T06:50:04.403 INFO:journalctl@ceph.mon.c.smithi153.stdout: 2024-04-01T06:50:04.403 INFO:journalctl@ceph.mon.c.smithi153.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-01T06:50:04.404 INFO:journalctl@ceph.mon.c.smithi153.stdout: 2024-04-01T06:50:04.404 INFO:journalctl@ceph.mon.c.smithi153.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-01T06:50:04.404 INFO:journalctl@ceph.mon.c.smithi153.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-01T06:50:04.404 INFO:journalctl@ceph.mon.c.smithi153.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-01T06:50:04.404 INFO:journalctl@ceph.mon.c.smithi153.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-01T06:50:04.404 INFO:journalctl@ceph.mon.c.smithi153.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-01T06:50:04.404 INFO:journalctl@ceph.mon.c.smithi153.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-01T06:50:04.404 INFO:journalctl@ceph.mon.c.smithi153.stdout: Cumulative compaction: 0.00 GB write, 0.49 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-01T06:50:04.404 INFO:journalctl@ceph.mon.c.smithi153.stdout: Interval compaction: 0.00 GB write, 0.49 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-01T06:50:04.404 INFO:journalctl@ceph.mon.c.smithi153.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-01T06:50:04.404 INFO:journalctl@ceph.mon.c.smithi153.stdout: Block cache BinnedLRUCache@0x559a672351f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-04-01T06:50:04.404 INFO:journalctl@ceph.mon.c.smithi153.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-04-01T06:50:04.404 INFO:journalctl@ceph.mon.c.smithi153.stdout: 2024-04-01T06:50:04.405 INFO:journalctl@ceph.mon.c.smithi153.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-01T06:50:04.405 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-04-01T06:50:04.405 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: using public_addr v2:172.21.15.153:0/0 -> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-04-01T06:50:04.405 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: starting mon.c rank -1 at public addrs [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] at bind addrs [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 2024-04-01T06:50:04.405 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: mon.c@-1(???) e0 preinit fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 2024-04-01T06:50:04.405 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: mon.c@-1(synchronizing).mds e1 new map 2024-04-01T06:50:04.405 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: mon.c@-1(synchronizing).mds e1 print_map 2024-04-01T06:50:04.405 INFO:journalctl@ceph.mon.c.smithi153.stdout: e1 2024-04-01T06:50:04.405 INFO:journalctl@ceph.mon.c.smithi153.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-01T06:50:04.405 INFO:journalctl@ceph.mon.c.smithi153.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-01T06:50:04.405 INFO:journalctl@ceph.mon.c.smithi153.stdout: legacy client fscid: -1 2024-04-01T06:50:04.405 INFO:journalctl@ceph.mon.c.smithi153.stdout: 2024-04-01T06:50:04.405 INFO:journalctl@ceph.mon.c.smithi153.stdout: No filesystems configured 2024-04-01T06:50:04.405 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-04-01T06:50:04.406 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-04-01T06:50:04.406 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-04-01T06:50:04.406 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-04-01T06:50:04.406 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-04-01T06:50:04.406 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-04-01T06:50:04.406 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-01T06:50:04.406 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-01T06:50:04.406 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-01T06:50:04.406 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-01T06:50:04.406 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: Updating smithi153:/etc/ceph/ceph.conf 2024-04-01T06:50:04.406 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: Updating smithi153:/var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-04-01T06:50:04.406 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: Updating smithi153:/etc/ceph/ceph.client.admin.keyring 2024-04-01T06:50:04.407 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: Updating smithi153:/var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-01T06:50:04.407 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/3041272336' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-01T06:50:04.407 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: osdmap e4: 0 total, 0 up, 0 in 2024-04-01T06:50:04.407 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:04.407 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:04.407 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:04.407 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:04.407 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:04.407 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:50:04.407 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:04.407 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:50:04.407 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:04.407 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-01T06:50:04.407 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:04.407 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi083:172.21.15.83=a;smithi145:172.21.15.145=b;smithi153:172.21.15.153=c", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:50:04.408 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: Saving service mon spec with placement smithi083:172.21.15.83=a;smithi145:172.21.15.145=b;smithi153:172.21.15.153=c;count:3 2024-04-01T06:50:04.408 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: Deploying daemon mon.c on smithi153 2024-04-01T06:50:04.408 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:04.408 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: from='client.? 172.21.15.153:0/2211432113' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-01T06:50:04.408 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:03 smithi153 ceph-mon[48187]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-04-01T06:50:04.575 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T06:50:09.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:09.166+0000 7f125a2d1700 1 -- 172.21.15.153:0/205556158 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f123c0035c0 msgr2=0x7f123c005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:50:09.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:09.166+0000 7f125a2d1700 1 --2- 172.21.15.153:0/205556158 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f123c0035c0 0x7f123c005a50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1254100720 tx=0x7f1244014ec0 comp rx=0 tx=0).stop 2024-04-01T06:50:09.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:09.166+0000 7f125a2d1700 1 -- 172.21.15.153:0/205556158 shutdown_connections 2024-04-01T06:50:09.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:09.166+0000 7f125a2d1700 1 --2- 172.21.15.153:0/205556158 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f123c0035c0 0x7f123c005a50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:50:09.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:09.166+0000 7f125a2d1700 1 -- 172.21.15.153:0/205556158 >> 172.21.15.153:0/205556158 conn(0x7f12540fc300 msgr2=0x7f12540fe720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:50:09.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:09.166+0000 7f125a2d1700 1 -- 172.21.15.153:0/205556158 shutdown_connections 2024-04-01T06:50:09.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:09.166+0000 7f125a2d1700 1 -- 172.21.15.153:0/205556158 wait complete. 2024-04-01T06:50:09.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:09.167+0000 7f125a2d1700 1 Processor -- start 2024-04-01T06:50:09.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:09.167+0000 7f125a2d1700 1 -- start start 2024-04-01T06:50:09.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:09.167+0000 7f125a2d1700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f123c0035c0 0x7f12541982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:50:09.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:09.167+0000 7f125a2d1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12541987f0 0x7f125419cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:50:09.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:09.167+0000 7f125a2d1700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1254198d80 con 0x7f123c0035c0 2024-04-01T06:50:09.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:09.167+0000 7f125a2d1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1254198ef0 con 0x7f12541987f0 2024-04-01T06:50:09.170 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:09.167+0000 7f12537fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12541987f0 0x7f125419cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:50:09.170 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:09.168+0000 7f12537fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12541987f0 0x7f125419cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35772/0 (socket says 172.21.15.153:35772) 2024-04-01T06:50:09.170 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:09.168+0000 7f12537fe700 1 -- 172.21.15.153:0/221291742 learned_addr learned my addr 172.21.15.153:0/221291742 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-04-01T06:50:09.170 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:09.168+0000 7f1253fff700 1 --2- 172.21.15.153:0/221291742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f123c0035c0 0x7f12541982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:50:09.170 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:09.168+0000 7f12537fe700 1 -- 172.21.15.153:0/221291742 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12541987f0 msgr2=0x7f125419cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-01T06:50:09.170 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:09.168+0000 7f12537fe700 1 -- 172.21.15.153:0/221291742 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12541987f0 msgr2=0x7f125419cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-01T06:50:09.170 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:09.168+0000 7f12537fe700 1 --2- 172.21.15.153:0/221291742 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12541987f0 0x7f125419cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-01T06:50:09.170 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:09.168+0000 7f12537fe700 1 --2- 172.21.15.153:0/221291742 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12541987f0 0x7f125419cb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-01T06:50:09.170 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:09.168+0000 7f1253fff700 1 -- 172.21.15.153:0/221291742 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12541987f0 msgr2=0x7f125419cb30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-01T06:50:09.170 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:09.168+0000 7f1253fff700 1 --2- 172.21.15.153:0/221291742 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12541987f0 0x7f125419cb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:50:09.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:09.168+0000 7f1253fff700 1 -- 172.21.15.153:0/221291742 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1244014910 con 0x7f123c0035c0 2024-04-01T06:50:09.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:09.168+0000 7f1253fff700 1 --2- 172.21.15.153:0/221291742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f123c0035c0 0x7f12541982b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1244001eb0 tx=0x7f1244004a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:50:09.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:09.168+0000 7f12517fa700 1 -- 172.21.15.153:0/221291742 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f1244023070 con 0x7f123c0035c0 2024-04-01T06:50:09.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:09.168+0000 7f12517fa700 1 -- 172.21.15.153:0/221291742 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f124401e470 con 0x7f123c0035c0 2024-04-01T06:50:09.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:09.168+0000 7f12517fa700 1 -- 172.21.15.153:0/221291742 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f1244019040 con 0x7f123c0035c0 2024-04-01T06:50:09.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:09.169+0000 7f125a2d1700 1 -- 172.21.15.153:0/221291742 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f125419d0d0 con 0x7f123c0035c0 2024-04-01T06:50:09.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:09.169+0000 7f125a2d1700 1 -- 172.21.15.153:0/221291742 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f125419d620 con 0x7f123c0035c0 2024-04-01T06:50:09.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:09.169+0000 7f12517fa700 1 -- 172.21.15.153:0/221291742 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 13) v1 ==== 45589+0+0 (secure 0 0 0) 0x7f1244012650 con 0x7f123c0035c0 2024-04-01T06:50:09.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:09.170+0000 7f12517fa700 1 --2- 172.21.15.153:0/221291742 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f12400385e0 0x7f124003aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:50:09.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:09.170+0000 7f12517fa700 1 -- 172.21.15.153:0/221291742 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f1244000e40 con 0x7f123c0035c0 2024-04-01T06:50:09.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:09.170+0000 7f125a2d1700 1 -- 172.21.15.153:0/221291742 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1254104aa0 con 0x7f123c0035c0 2024-04-01T06:50:09.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:09.170+0000 7f12537fe700 1 --2- 172.21.15.153:0/221291742 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f12400385e0 0x7f124003aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:50:09.172 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:09.170+0000 7f12537fe700 1 --2- 172.21.15.153:0/221291742 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f12400385e0 0x7f124003aaa0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1248009180 tx=0x7f1248008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:50:09.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:09.175+0000 7f12517fa700 1 -- 172.21.15.153:0/221291742 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f124401d3d0 con 0x7f123c0035c0 2024-04-01T06:50:09.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:09 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T06:50:09.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:09 smithi153 ceph-mon[48187]: mon.a calling monitor election 2024-04-01T06:50:09.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:09 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T06:50:09.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:09 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T06:50:09.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:09 smithi153 ceph-mon[48187]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:09.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:09 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T06:50:09.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:09 smithi153 ceph-mon[48187]: mon.c calling monitor election 2024-04-01T06:50:09.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:09 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T06:50:09.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:09 smithi153 ceph-mon[48187]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:09.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:09 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T06:50:09.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:09 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T06:50:09.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:09 smithi153 ceph-mon[48187]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-01T06:50:09.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:09 smithi153 ceph-mon[48187]: monmap e2: 2 mons at {a=[v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0],c=[v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-01T06:50:09.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:09 smithi153 ceph-mon[48187]: fsmap 2024-04-01T06:50:09.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:09 smithi153 ceph-mon[48187]: osdmap e4: 0 total, 0 up, 0 in 2024-04-01T06:50:09.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:09 smithi153 ceph-mon[48187]: mgrmap e13: x(active, since 35s) 2024-04-01T06:50:09.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:09 smithi153 ceph-mon[48187]: overall HEALTH_OK 2024-04-01T06:50:09.392 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:09 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:09.392 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:09 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:09.392 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:09 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:09.392 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:09 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-01T06:50:09.392 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:09 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:09.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:09.448+0000 7f125a2d1700 1 -- 172.21.15.153:0/221291742 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f125419d8f0 con 0x7f123c0035c0 2024-04-01T06:50:09.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:09.449+0000 7f12517fa700 1 -- 172.21.15.153:0/221291742 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1006 (secure 0 0 0) 0x7f124401cb60 con 0x7f123c0035c0 2024-04-01T06:50:09.449 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-01T06:50:09.449 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":2,"fsid":"c6f8eff4-eff3-11ee-b647-cb9ed24678a4","modified":"2024-04-01T06:50:03.939774Z","created":"2024-04-01T06:48:39.939958Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:3300","nonce":0},{"type":"v1","addr":"172.21.15.83:6789","nonce":0}]},"addr":"172.21.15.83:6789/0","public_addr":"172.21.15.83:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:3300","nonce":0},{"type":"v1","addr":"172.21.15.153:6789","nonce":0}]},"addr":"172.21.15.153:6789/0","public_addr":"172.21.15.153:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-04-01T06:50:09.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:09.451+0000 7f125a2d1700 1 -- 172.21.15.153:0/221291742 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f12400385e0 msgr2=0x7f124003aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:50:09.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:09.451+0000 7f125a2d1700 1 --2- 172.21.15.153:0/221291742 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f12400385e0 0x7f124003aaa0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1248009180 tx=0x7f1248008040 comp rx=0 tx=0).stop 2024-04-01T06:50:09.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:09.451+0000 7f125a2d1700 1 -- 172.21.15.153:0/221291742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f123c0035c0 msgr2=0x7f12541982b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:50:09.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:09.451+0000 7f125a2d1700 1 --2- 172.21.15.153:0/221291742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f123c0035c0 0x7f12541982b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1244001eb0 tx=0x7f1244004a20 comp rx=0 tx=0).stop 2024-04-01T06:50:09.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:09.451+0000 7f125a2d1700 1 -- 172.21.15.153:0/221291742 shutdown_connections 2024-04-01T06:50:09.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:09.451+0000 7f125a2d1700 1 --2- 172.21.15.153:0/221291742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f123c0035c0 0x7f12541982b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:50:09.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:09.451+0000 7f125a2d1700 1 --2- 172.21.15.153:0/221291742 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f12400385e0 0x7f124003aaa0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:50:09.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:09.451+0000 7f125a2d1700 1 --2- 172.21.15.153:0/221291742 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12541987f0 0x7f125419cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:50:09.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:09.451+0000 7f125a2d1700 1 -- 172.21.15.153:0/221291742 >> 172.21.15.153:0/221291742 conn(0x7f12540fc300 msgr2=0x7f12540fe670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:50:09.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:09.451+0000 7f125a2d1700 1 -- 172.21.15.153:0/221291742 shutdown_connections 2024-04-01T06:50:09.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:09.451+0000 7f125a2d1700 1 -- 172.21.15.153:0/221291742 wait complete. 2024-04-01T06:50:09.452 INFO:teuthology.orchestra.run.smithi153.stderr:dumped monmap epoch 2 2024-04-01T06:50:09.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:09 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T06:50:09.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:09 smithi083 ceph-mon[43429]: mon.a calling monitor election 2024-04-01T06:50:09.513 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:09 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T06:50:09.513 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:09 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T06:50:09.513 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:09 smithi083 ceph-mon[43429]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:09.513 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:09 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T06:50:09.513 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:09 smithi083 ceph-mon[43429]: mon.c calling monitor election 2024-04-01T06:50:09.513 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:09 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T06:50:09.513 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:09 smithi083 ceph-mon[43429]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:09.513 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:09 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T06:50:09.513 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:09 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T06:50:09.513 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:09 smithi083 ceph-mon[43429]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-01T06:50:09.513 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:09 smithi083 ceph-mon[43429]: monmap e2: 2 mons at {a=[v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0],c=[v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-01T06:50:09.513 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:09 smithi083 ceph-mon[43429]: fsmap 2024-04-01T06:50:09.513 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:09 smithi083 ceph-mon[43429]: osdmap e4: 0 total, 0 up, 0 in 2024-04-01T06:50:09.513 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:09 smithi083 ceph-mon[43429]: mgrmap e13: x(active, since 35s) 2024-04-01T06:50:09.514 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:09 smithi083 ceph-mon[43429]: overall HEALTH_OK 2024-04-01T06:50:09.514 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:09 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:09.514 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:09 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:09.514 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:09 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:09.514 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:09 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-01T06:50:09.514 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:09 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:10.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:10 smithi153 ceph-mon[48187]: Deploying daemon mon.b on smithi145 2024-04-01T06:50:10.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:10 smithi153 ceph-mon[48187]: from='client.? 172.21.15.153:0/221291742' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-01T06:50:10.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:10 smithi153 ceph-mon[48187]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:10.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:10 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T06:50:10.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:10 smithi083 ceph-mon[43429]: Deploying daemon mon.b on smithi145 2024-04-01T06:50:10.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:10 smithi083 ceph-mon[43429]: from='client.? 172.21.15.153:0/221291742' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-01T06:50:10.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:10 smithi083 ceph-mon[43429]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:10.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:10 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T06:50:10.786 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-01T06:50:10.786 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph mon dump -f json 2024-04-01T06:50:11.014 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T06:50:12.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 systemd[1]: Started Ceph mon.b for c6f8eff4-eff3-11ee-b647-cb9ed24678a4. 2024-04-01T06:50:12.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.max_write_buffer_number: 2 2024-04-01T06:50:12.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.compression: NoCompression 2024-04-01T06:50:12.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.bottommost_compression: Disabled 2024-04-01T06:50:12.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.prefix_extractor: nullptr 2024-04-01T06:50:12.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-01T06:50:12.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.num_levels: 7 2024-04-01T06:50:12.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-01T06:50:12.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-01T06:50:12.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-01T06:50:12.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-01T06:50:12.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-01T06:50:12.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-01T06:50:12.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-01T06:50:12.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-01T06:50:12.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-01T06:50:12.005 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-01T06:50:12.005 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-01T06:50:12.005 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-01T06:50:12.005 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-01T06:50:12.005 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.compression_opts.level: 32767 2024-04-01T06:50:12.005 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.compression_opts.strategy: 0 2024-04-01T06:50:12.005 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-01T06:50:12.005 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-01T06:50:12.005 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-01T06:50:12.005 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-01T06:50:12.005 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.compression_opts.enabled: false 2024-04-01T06:50:12.005 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-01T06:50:12.005 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-01T06:50:12.005 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-01T06:50:12.005 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-01T06:50:12.006 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.target_file_size_base: 67108864 2024-04-01T06:50:12.006 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-01T06:50:12.006 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-01T06:50:12.006 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-01T06:50:12.006 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-01T06:50:12.006 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-01T06:50:12.006 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-01T06:50:12.006 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-01T06:50:12.006 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-01T06:50:12.006 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-01T06:50:12.006 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-01T06:50:12.006 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-01T06:50:12.006 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-01T06:50:12.006 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-01T06:50:12.007 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-01T06:50:12.007 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.arena_block_size: 1048576 2024-04-01T06:50:12.007 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-01T06:50:12.007 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-01T06:50:12.007 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.disable_auto_compactions: 0 2024-04-01T06:50:12.007 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-01T06:50:12.007 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-01T06:50:12.007 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-01T06:50:12.007 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-01T06:50:12.007 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-01T06:50:12.007 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-01T06:50:12.007 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-01T06:50:12.007 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-01T06:50:12.007 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-01T06:50:12.007 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-01T06:50:12.008 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.table_properties_collectors: 2024-04-01T06:50:12.008 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.inplace_update_support: 0 2024-04-01T06:50:12.008 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-01T06:50:12.008 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-01T06:50:12.008 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-01T06:50:12.008 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-01T06:50:12.008 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.bloom_locality: 0 2024-04-01T06:50:12.008 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.max_successive_merges: 0 2024-04-01T06:50:12.008 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-01T06:50:12.008 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.paranoid_file_checks: 0 2024-04-01T06:50:12.008 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.force_consistency_checks: 1 2024-04-01T06:50:12.008 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.report_bg_io_stats: 0 2024-04-01T06:50:12.008 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.ttl: 2592000 2024-04-01T06:50:12.008 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-01T06:50:12.008 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-01T06:50:12.008 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-01T06:50:12.009 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.enable_blob_files: false 2024-04-01T06:50:12.009 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.min_blob_size: 0 2024-04-01T06:50:12.009 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.blob_file_size: 268435456 2024-04-01T06:50:12.009 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-01T06:50:12.009 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-01T06:50:12.009 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-01T06:50:12.009 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-01T06:50:12.009 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-01T06:50:12.009 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.blob_file_starting_level: 0 2024-04-01T06:50:12.009 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-01T06:50:12.009 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-01T06:50:12.009 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-04-01T06:50:12.009 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: a609b445-e823-4a0b-9aed-725b6c61f93a 2024-04-01T06:50:12.009 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711954211541712, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-04-01T06:50:12.010 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-04-01T06:50:12.010 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711954211542248, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1747, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1711954211, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "a609b445-e823-4a0b-9aed-725b6c61f93a", "db_session_id": "7E7ECA5UEWCI46BYJ5H7", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-04-01T06:50:12.010 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711954211542347, "job": 1, "event": "recovery_finished"} 2024-04-01T06:50:12.010 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-04-01T06:50:12.010 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-01T06:50:12.010 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55ee22248000 2024-04-01T06:50:12.010 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: DB pointer 0x55ee22236000 2024-04-01T06:50:12.010 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-01T06:50:12.010 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-01T06:50:12.010 INFO:journalctl@ceph.mon.b.smithi145.stdout: ** DB Stats ** 2024-04-01T06:50:12.010 INFO:journalctl@ceph.mon.b.smithi145.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-01T06:50:12.010 INFO:journalctl@ceph.mon.b.smithi145.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-01T06:50:12.010 INFO:journalctl@ceph.mon.b.smithi145.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-01T06:50:12.010 INFO:journalctl@ceph.mon.b.smithi145.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-01T06:50:12.011 INFO:journalctl@ceph.mon.b.smithi145.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-01T06:50:12.011 INFO:journalctl@ceph.mon.b.smithi145.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-01T06:50:12.011 INFO:journalctl@ceph.mon.b.smithi145.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-01T06:50:12.011 INFO:journalctl@ceph.mon.b.smithi145.stdout: 2024-04-01T06:50:12.011 INFO:journalctl@ceph.mon.b.smithi145.stdout: ** Compaction Stats [default] ** 2024-04-01T06:50:12.011 INFO:journalctl@ceph.mon.b.smithi145.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-01T06:50:12.011 INFO:journalctl@ceph.mon.b.smithi145.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-01T06:50:12.011 INFO:journalctl@ceph.mon.b.smithi145.stdout: L0 1/0 1.71 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-01T06:50:12.011 INFO:journalctl@ceph.mon.b.smithi145.stdout: Sum 1/0 1.71 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-01T06:50:12.011 INFO:journalctl@ceph.mon.b.smithi145.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-01T06:50:12.011 INFO:journalctl@ceph.mon.b.smithi145.stdout: 2024-04-01T06:50:12.011 INFO:journalctl@ceph.mon.b.smithi145.stdout: ** Compaction Stats [default] ** 2024-04-01T06:50:12.011 INFO:journalctl@ceph.mon.b.smithi145.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-01T06:50:12.011 INFO:journalctl@ceph.mon.b.smithi145.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-01T06:50:12.011 INFO:journalctl@ceph.mon.b.smithi145.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-01T06:50:12.012 INFO:journalctl@ceph.mon.b.smithi145.stdout: 2024-04-01T06:50:12.012 INFO:journalctl@ceph.mon.b.smithi145.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-01T06:50:12.012 INFO:journalctl@ceph.mon.b.smithi145.stdout: 2024-04-01T06:50:12.012 INFO:journalctl@ceph.mon.b.smithi145.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-01T06:50:12.012 INFO:journalctl@ceph.mon.b.smithi145.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-01T06:50:12.012 INFO:journalctl@ceph.mon.b.smithi145.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-01T06:50:12.012 INFO:journalctl@ceph.mon.b.smithi145.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-01T06:50:12.012 INFO:journalctl@ceph.mon.b.smithi145.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-01T06:50:12.012 INFO:journalctl@ceph.mon.b.smithi145.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-01T06:50:12.012 INFO:journalctl@ceph.mon.b.smithi145.stdout: Cumulative compaction: 0.00 GB write, 0.49 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-01T06:50:12.012 INFO:journalctl@ceph.mon.b.smithi145.stdout: Interval compaction: 0.00 GB write, 0.49 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-01T06:50:12.012 INFO:journalctl@ceph.mon.b.smithi145.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-01T06:50:12.012 INFO:journalctl@ceph.mon.b.smithi145.stdout: Block cache BinnedLRUCache@0x55ee221ab1f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-04-01T06:50:12.012 INFO:journalctl@ceph.mon.b.smithi145.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-04-01T06:50:12.012 INFO:journalctl@ceph.mon.b.smithi145.stdout: 2024-04-01T06:50:12.013 INFO:journalctl@ceph.mon.b.smithi145.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-01T06:50:12.013 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-04-01T06:50:12.013 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: using public_addr v2:172.21.15.145:0/0 -> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] 2024-04-01T06:50:12.013 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: starting mon.b rank -1 at public addrs [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] at bind addrs [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 2024-04-01T06:50:12.013 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: mon.b@-1(???) e0 preinit fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 2024-04-01T06:50:12.013 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: mon.b@-1(synchronizing).mds e1 new map 2024-04-01T06:50:12.013 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: mon.b@-1(synchronizing).mds e1 print_map 2024-04-01T06:50:12.013 INFO:journalctl@ceph.mon.b.smithi145.stdout: e1 2024-04-01T06:50:12.013 INFO:journalctl@ceph.mon.b.smithi145.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-01T06:50:12.013 INFO:journalctl@ceph.mon.b.smithi145.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-01T06:50:12.013 INFO:journalctl@ceph.mon.b.smithi145.stdout: legacy client fscid: -1 2024-04-01T06:50:12.013 INFO:journalctl@ceph.mon.b.smithi145.stdout: 2024-04-01T06:50:12.013 INFO:journalctl@ceph.mon.b.smithi145.stdout: No filesystems configured 2024-04-01T06:50:12.013 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-04-01T06:50:12.014 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-04-01T06:50:12.014 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-04-01T06:50:12.014 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-04-01T06:50:12.014 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-04-01T06:50:12.014 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-04-01T06:50:12.014 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-01T06:50:12.014 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-01T06:50:12.014 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-01T06:50:12.014 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-01T06:50:12.014 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: Updating smithi153:/etc/ceph/ceph.conf 2024-04-01T06:50:12.014 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: Updating smithi153:/var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-04-01T06:50:12.014 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: Updating smithi153:/etc/ceph/ceph.client.admin.keyring 2024-04-01T06:50:12.014 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: Updating smithi153:/var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-01T06:50:12.015 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/3041272336' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-01T06:50:12.015 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: osdmap e4: 0 total, 0 up, 0 in 2024-04-01T06:50:12.015 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:12.015 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:12.015 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:12.015 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:12.015 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:12.015 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:50:12.015 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:12.015 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:50:12.015 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:12.015 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-01T06:50:12.015 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:12.016 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi083:172.21.15.83=a;smithi145:172.21.15.145=b;smithi153:172.21.15.153=c", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:50:12.016 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: Saving service mon spec with placement smithi083:172.21.15.83=a;smithi145:172.21.15.145=b;smithi153:172.21.15.153=c;count:3 2024-04-01T06:50:12.016 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: Deploying daemon mon.c on smithi153 2024-04-01T06:50:12.016 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:12.016 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: from='client.? 172.21.15.153:0/2211432113' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-01T06:50:12.016 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T06:50:12.016 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: mon.a calling monitor election 2024-04-01T06:50:12.016 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T06:50:12.016 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T06:50:12.016 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:12.016 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T06:50:12.016 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: mon.c calling monitor election 2024-04-01T06:50:12.016 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T06:50:12.016 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:12.017 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T06:50:12.017 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T06:50:12.017 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-01T06:50:12.017 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: monmap e2: 2 mons at {a=[v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0],c=[v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-01T06:50:12.017 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: fsmap 2024-04-01T06:50:12.017 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: osdmap e4: 0 total, 0 up, 0 in 2024-04-01T06:50:12.017 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: mgrmap e13: x(active, since 35s) 2024-04-01T06:50:12.017 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: overall HEALTH_OK 2024-04-01T06:50:12.017 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:12.017 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:12.017 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:12.017 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-01T06:50:12.017 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:12.017 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: Deploying daemon mon.b on smithi145 2024-04-01T06:50:12.018 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: from='client.? 172.21.15.153:0/221291742' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-01T06:50:12.018 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:12.018 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T06:50:12.018 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:11 smithi145 ceph-mon[47816]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-04-01T06:50:17.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:16 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T06:50:17.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:16 smithi083 ceph-mon[43429]: mon.c calling monitor election 2024-04-01T06:50:17.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:16 smithi083 ceph-mon[43429]: mon.a calling monitor election 2024-04-01T06:50:17.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:16 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T06:50:17.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:16 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T06:50:17.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:16 smithi083 ceph-mon[43429]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:17.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:16 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T06:50:17.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:16 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T06:50:17.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:16 smithi083 ceph-mon[43429]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:17.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:16 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T06:50:17.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:16 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T06:50:17.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:16 smithi083 ceph-mon[43429]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:17.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:16 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T06:50:17.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:16 smithi083 ceph-mon[43429]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-01T06:50:17.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:16 smithi083 ceph-mon[43429]: monmap e3: 3 mons at {a=[v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0],b=[v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0],c=[v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-01T06:50:17.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:16 smithi083 ceph-mon[43429]: fsmap 2024-04-01T06:50:17.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:16 smithi083 ceph-mon[43429]: osdmap e4: 0 total, 0 up, 0 in 2024-04-01T06:50:17.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:16 smithi083 ceph-mon[43429]: mgrmap e13: x(active, since 42s) 2024-04-01T06:50:17.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:16 smithi083 ceph-mon[43429]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-04-01T06:50:17.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:16 smithi083 ceph-mon[43429]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-04-01T06:50:17.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:16 smithi083 ceph-mon[43429]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-04-01T06:50:17.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:16 smithi083 ceph-mon[43429]: mon.b (rank 2) addr [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] is down (out of quorum) 2024-04-01T06:50:17.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:16 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:17.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:16 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:17.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:16 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T06:50:17.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:16 smithi153 ceph-mon[48187]: mon.c calling monitor election 2024-04-01T06:50:17.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:16 smithi153 ceph-mon[48187]: mon.a calling monitor election 2024-04-01T06:50:17.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:16 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T06:50:17.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:16 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T06:50:17.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:16 smithi153 ceph-mon[48187]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:17.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:16 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T06:50:17.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:16 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T06:50:17.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:16 smithi153 ceph-mon[48187]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:17.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:16 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T06:50:17.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:16 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T06:50:17.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:16 smithi153 ceph-mon[48187]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:17.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:16 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T06:50:17.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:16 smithi153 ceph-mon[48187]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-01T06:50:17.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:16 smithi153 ceph-mon[48187]: monmap e3: 3 mons at {a=[v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0],b=[v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0],c=[v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-01T06:50:17.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:16 smithi153 ceph-mon[48187]: fsmap 2024-04-01T06:50:17.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:16 smithi153 ceph-mon[48187]: osdmap e4: 0 total, 0 up, 0 in 2024-04-01T06:50:17.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:16 smithi153 ceph-mon[48187]: mgrmap e13: x(active, since 42s) 2024-04-01T06:50:17.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:16 smithi153 ceph-mon[48187]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-04-01T06:50:17.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:16 smithi153 ceph-mon[48187]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-04-01T06:50:17.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:16 smithi153 ceph-mon[48187]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-04-01T06:50:17.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:16 smithi153 ceph-mon[48187]: mon.b (rank 2) addr [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] is down (out of quorum) 2024-04-01T06:50:17.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:16 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:17.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:16 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:17.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:17.962+0000 7f59321d3700 1 -- 172.21.15.153:0/1472144822 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5918007ea0 msgr2=0x7f591800a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:50:17.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:17.962+0000 7f59321d3700 1 --2- 172.21.15.153:0/1472144822 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5918007ea0 0x7f591800a2d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f592c100b80 tx=0x7f591400ff20 comp rx=0 tx=0).stop 2024-04-01T06:50:17.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:17.963+0000 7f59321d3700 1 -- 172.21.15.153:0/1472144822 shutdown_connections 2024-04-01T06:50:17.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:17.963+0000 7f59321d3700 1 --2- 172.21.15.153:0/1472144822 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5918007ea0 0x7f591800a2d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:50:17.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:17.963+0000 7f59321d3700 1 -- 172.21.15.153:0/1472144822 >> 172.21.15.153:0/1472144822 conn(0x7f592c076390 msgr2=0x7f592c0fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:50:17.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:17.963+0000 7f59321d3700 1 -- 172.21.15.153:0/1472144822 shutdown_connections 2024-04-01T06:50:17.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:17.963+0000 7f59321d3700 1 -- 172.21.15.153:0/1472144822 wait complete. 2024-04-01T06:50:17.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:17.963+0000 7f59321d3700 1 Processor -- start 2024-04-01T06:50:17.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:17.963+0000 7f59321d3700 1 -- start start 2024-04-01T06:50:17.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:17.964+0000 7f59321d3700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5918007ea0 0x7f592c1984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:50:17.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:17.964+0000 7f59321d3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f592c198a00 0x7f592c19cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:50:17.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:17.964+0000 7f59321d3700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f592c19d2f0 0x7f592c19d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:50:17.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:17.964+0000 7f59321d3700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592c1990f0 con 0x7f592c19d2f0 2024-04-01T06:50:17.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:17.964+0000 7f59321d3700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592c1a5060 con 0x7f5918007ea0 2024-04-01T06:50:17.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:17.964+0000 7f59321d3700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592c1a51a0 con 0x7f592c198a00 2024-04-01T06:50:17.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:17.964+0000 7f592affd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f592c198a00 0x7f592c19cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:50:17.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:17.964+0000 7f592affd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f592c198a00 0x7f592c19cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35776/0 (socket says 172.21.15.153:35776) 2024-04-01T06:50:17.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:17.964+0000 7f592affd700 1 -- 172.21.15.153:0/2075726193 learned_addr learned my addr 172.21.15.153:0/2075726193 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-04-01T06:50:17.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:17.964+0000 7f592bfff700 1 --2- 172.21.15.153:0/2075726193 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f592c19d2f0 0x7f592c19d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:50:17.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:17.964+0000 7f592b7fe700 1 --2- 172.21.15.153:0/2075726193 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5918007ea0 0x7f592c1984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:50:17.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:17.964+0000 7f592affd700 1 -- 172.21.15.153:0/2075726193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f592c198a00 msgr2=0x7f592c19cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-01T06:50:17.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:17.964+0000 7f592affd700 1 -- 172.21.15.153:0/2075726193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f592c198a00 msgr2=0x7f592c19cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-01T06:50:17.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:17.964+0000 7f592affd700 1 --2- 172.21.15.153:0/2075726193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f592c198a00 0x7f592c19cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-01T06:50:17.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:17.964+0000 7f592b7fe700 1 -- 172.21.15.153:0/2075726193 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5918007ea0 msgr2=0x7f592c1984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-04-01T06:50:17.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:17.964+0000 7f592b7fe700 1 -- 172.21.15.153:0/2075726193 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5918007ea0 msgr2=0x7f592c1984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-01T06:50:17.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:17.964+0000 7f592b7fe700 1 --2- 172.21.15.153:0/2075726193 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5918007ea0 0x7f592c1984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-01T06:50:17.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:17.964+0000 7f592affd700 1 --2- 172.21.15.153:0/2075726193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f592c198a00 0x7f592c19cdb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-01T06:50:17.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:17.964+0000 7f592b7fe700 1 --2- 172.21.15.153:0/2075726193 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5918007ea0 0x7f592c1984c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-01T06:50:17.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:17.964+0000 7f592bfff700 1 -- 172.21.15.153:0/2075726193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f592c198a00 msgr2=0x7f592c19cdb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-01T06:50:17.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:17.964+0000 7f592bfff700 1 --2- 172.21.15.153:0/2075726193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f592c198a00 0x7f592c19cdb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:50:17.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:17.964+0000 7f592bfff700 1 -- 172.21.15.153:0/2075726193 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5918007ea0 msgr2=0x7f592c1984c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-01T06:50:17.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:17.964+0000 7f592bfff700 1 --2- 172.21.15.153:0/2075726193 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5918007ea0 0x7f592c1984c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:50:17.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:17.964+0000 7f592bfff700 1 -- 172.21.15.153:0/2075726193 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f591400f970 con 0x7f592c19d2f0 2024-04-01T06:50:17.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:17.965+0000 7f592bfff700 1 --2- 172.21.15.153:0/2075726193 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f592c19d2f0 0x7f592c19d7a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f592400bd50 tx=0x7f592400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:50:17.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:17.965+0000 7f5928ff9700 1 -- 172.21.15.153:0/2075726193 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592400cd10 con 0x7f592c19d2f0 2024-04-01T06:50:17.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:17.965+0000 7f5928ff9700 1 -- 172.21.15.153:0/2075726193 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f592400ce70 con 0x7f592c19d2f0 2024-04-01T06:50:17.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:17.965+0000 7f59321d3700 1 -- 172.21.15.153:0/2075726193 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f592c1a5480 con 0x7f592c19d2f0 2024-04-01T06:50:17.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:17.965+0000 7f5928ff9700 1 -- 172.21.15.153:0/2075726193 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5924012840 con 0x7f592c19d2f0 2024-04-01T06:50:17.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:17.965+0000 7f59321d3700 1 -- 172.21.15.153:0/2075726193 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f592c1a59d0 con 0x7f592c19d2f0 2024-04-01T06:50:17.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:17.966+0000 7f5928ff9700 1 -- 172.21.15.153:0/2075726193 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 13) v1 ==== 45589+0+0 (secure 0 0 0) 0x7f59240129a0 con 0x7f592c19d2f0 2024-04-01T06:50:17.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:17.966+0000 7f59321d3700 1 -- 172.21.15.153:0/2075726193 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f592c18dcb0 con 0x7f592c19d2f0 2024-04-01T06:50:17.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:17.966+0000 7f5928ff9700 1 --2- 172.21.15.153:0/2075726193 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f590c038c70 0x7f590c03b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:50:17.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:17.966+0000 7f5928ff9700 1 -- 172.21.15.153:0/2075726193 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f592404adc0 con 0x7f592c19d2f0 2024-04-01T06:50:17.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:17.966+0000 7f592b7fe700 1 --2- 172.21.15.153:0/2075726193 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f590c038c70 0x7f590c03b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:50:17.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:17.967+0000 7f592b7fe700 1 --2- 172.21.15.153:0/2075726193 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f590c038c70 0x7f590c03b130 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f591400f550 tx=0x7f591400f4a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:50:17.971 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:17.972+0000 7f5928ff9700 1 -- 172.21.15.153:0/2075726193 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f592401d3b0 con 0x7f592c19d2f0 2024-04-01T06:50:18.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:17 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:18.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:17 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:18.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:17 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:50:18.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:17 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:18.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:17 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:18.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:17 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:18.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:17 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:18.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:17 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:18.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:17 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:50:18.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:17 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T06:50:18.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:17 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:18.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:17 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:18.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:17 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:50:18.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:17 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:18.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:17 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:18.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:17 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:18.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:17 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:18.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:17 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:18.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:17 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:50:18.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:17 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T06:50:18.248 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:18.248+0000 7f59321d3700 1 -- 172.21.15.153:0/2075726193 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f592c1997d0 con 0x7f592c19d2f0 2024-04-01T06:50:18.249 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:18.249+0000 7f5928ff9700 1 -- 172.21.15.153:0/2075726193 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) v1 ==== 95+0+1274 (secure 0 0 0) 0x7f59240112a0 con 0x7f592c19d2f0 2024-04-01T06:50:18.249 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-01T06:50:18.249 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":3,"fsid":"c6f8eff4-eff3-11ee-b647-cb9ed24678a4","modified":"2024-04-01T06:50:11.571937Z","created":"2024-04-01T06:48:39.939958Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:3300","nonce":0},{"type":"v1","addr":"172.21.15.83:6789","nonce":0}]},"addr":"172.21.15.83:6789/0","public_addr":"172.21.15.83:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:3300","nonce":0},{"type":"v1","addr":"172.21.15.153:6789","nonce":0}]},"addr":"172.21.15.153:6789/0","public_addr":"172.21.15.153:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:3300","nonce":0},{"type":"v1","addr":"172.21.15.145:6789","nonce":0}]},"addr":"172.21.15.145:6789/0","public_addr":"172.21.15.145:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-04-01T06:50:18.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:18.251+0000 7f59321d3700 1 -- 172.21.15.153:0/2075726193 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f590c038c70 msgr2=0x7f590c03b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:50:18.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:18.251+0000 7f59321d3700 1 --2- 172.21.15.153:0/2075726193 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f590c038c70 0x7f590c03b130 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f591400f550 tx=0x7f591400f4a0 comp rx=0 tx=0).stop 2024-04-01T06:50:18.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:18.251+0000 7f59321d3700 1 -- 172.21.15.153:0/2075726193 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f592c19d2f0 msgr2=0x7f592c19d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:50:18.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:18.251+0000 7f59321d3700 1 --2- 172.21.15.153:0/2075726193 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f592c19d2f0 0x7f592c19d7a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f592400bd50 tx=0x7f592400be30 comp rx=0 tx=0).stop 2024-04-01T06:50:18.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:18.251+0000 7f59321d3700 1 -- 172.21.15.153:0/2075726193 shutdown_connections 2024-04-01T06:50:18.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:18.251+0000 7f59321d3700 1 --2- 172.21.15.153:0/2075726193 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f592c19d2f0 0x7f592c19d7a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:50:18.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:18.251+0000 7f59321d3700 1 --2- 172.21.15.153:0/2075726193 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f590c038c70 0x7f590c03b130 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:50:18.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:18.251+0000 7f59321d3700 1 --2- 172.21.15.153:0/2075726193 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5918007ea0 0x7f592c1984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:50:18.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:18.251+0000 7f59321d3700 1 --2- 172.21.15.153:0/2075726193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f592c198a00 0x7f592c19cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:50:18.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:18.251+0000 7f59321d3700 1 -- 172.21.15.153:0/2075726193 >> 172.21.15.153:0/2075726193 conn(0x7f592c076390 msgr2=0x7f592c104b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:50:18.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:18.251+0000 7f59321d3700 1 -- 172.21.15.153:0/2075726193 shutdown_connections 2024-04-01T06:50:18.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:18.251+0000 7f59321d3700 1 -- 172.21.15.153:0/2075726193 wait complete. 2024-04-01T06:50:18.252 INFO:teuthology.orchestra.run.smithi153.stderr:dumped monmap epoch 3 2024-04-01T06:50:18.608 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-04-01T06:50:18.608 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph config generate-minimal-conf 2024-04-01T06:50:18.831 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:50:19.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:18 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T06:50:19.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:18 smithi145 ceph-mon[47816]: mon.c calling monitor election 2024-04-01T06:50:19.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:18 smithi145 ceph-mon[47816]: mon.a calling monitor election 2024-04-01T06:50:19.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:18 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T06:50:19.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:18 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T06:50:19.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:18 smithi145 ceph-mon[47816]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:19.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:18 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T06:50:19.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:18 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T06:50:19.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:18 smithi145 ceph-mon[47816]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:19.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:18 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T06:50:19.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:18 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T06:50:19.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:18 smithi145 ceph-mon[47816]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:19.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:18 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T06:50:19.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:18 smithi145 ceph-mon[47816]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-01T06:50:19.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:18 smithi145 ceph-mon[47816]: monmap e3: 3 mons at {a=[v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0],b=[v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0],c=[v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-01T06:50:19.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:18 smithi145 ceph-mon[47816]: fsmap 2024-04-01T06:50:19.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:18 smithi145 ceph-mon[47816]: osdmap e4: 0 total, 0 up, 0 in 2024-04-01T06:50:19.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:18 smithi145 ceph-mon[47816]: mgrmap e13: x(active, since 42s) 2024-04-01T06:50:19.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:18 smithi145 ceph-mon[47816]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-04-01T06:50:19.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:18 smithi145 ceph-mon[47816]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-04-01T06:50:19.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:18 smithi145 ceph-mon[47816]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-04-01T06:50:19.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:18 smithi145 ceph-mon[47816]: mon.b (rank 2) addr [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] is down (out of quorum) 2024-04-01T06:50:19.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:18 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:19.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:18 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:19.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:18 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:19.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:18 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:19.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:18 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:50:19.005 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:18 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:19.005 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:18 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:19.005 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:18 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:19.005 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:18 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:19.005 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:18 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:19.005 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:18 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:50:19.005 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:18 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T06:50:19.452 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:19 smithi083 ceph-mon[43429]: mon.b calling monitor election 2024-04-01T06:50:19.452 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:19 smithi083 ceph-mon[43429]: Reconfiguring mon.a (unknown last config time)... 2024-04-01T06:50:19.452 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:19 smithi083 ceph-mon[43429]: Reconfiguring daemon mon.a on smithi083 2024-04-01T06:50:19.452 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:19 smithi083 ceph-mon[43429]: mon.b calling monitor election 2024-04-01T06:50:19.452 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:19 smithi083 ceph-mon[43429]: mon.c calling monitor election 2024-04-01T06:50:19.453 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:19 smithi083 ceph-mon[43429]: mon.a calling monitor election 2024-04-01T06:50:19.453 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:19 smithi083 ceph-mon[43429]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-04-01T06:50:19.453 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:19 smithi083 ceph-mon[43429]: monmap e3: 3 mons at {a=[v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0],b=[v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0],c=[v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-01T06:50:19.453 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:19 smithi083 ceph-mon[43429]: fsmap 2024-04-01T06:50:19.453 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:19 smithi083 ceph-mon[43429]: osdmap e4: 0 total, 0 up, 0 in 2024-04-01T06:50:19.453 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:19 smithi083 ceph-mon[43429]: mgrmap e13: x(active, since 44s) 2024-04-01T06:50:19.453 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:19 smithi083 ceph-mon[43429]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-04-01T06:50:19.453 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:19 smithi083 ceph-mon[43429]: Cluster is now healthy 2024-04-01T06:50:19.453 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:19 smithi083 ceph-mon[43429]: overall HEALTH_OK 2024-04-01T06:50:19.453 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:19 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:19.453 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:19 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:19.453 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:19 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:19.453 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:19 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-01T06:50:19.453 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:19 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-01T06:50:19.454 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:19 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:19.454 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:19 smithi145 ceph-mon[47816]: mon.b calling monitor election 2024-04-01T06:50:19.454 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:19 smithi145 ceph-mon[47816]: Reconfiguring mon.a (unknown last config time)... 2024-04-01T06:50:19.454 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:19 smithi145 ceph-mon[47816]: Reconfiguring daemon mon.a on smithi083 2024-04-01T06:50:19.454 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:19 smithi145 ceph-mon[47816]: mon.b calling monitor election 2024-04-01T06:50:19.454 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:19 smithi145 ceph-mon[47816]: mon.c calling monitor election 2024-04-01T06:50:19.454 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:19 smithi145 ceph-mon[47816]: mon.a calling monitor election 2024-04-01T06:50:19.454 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:19 smithi145 ceph-mon[47816]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-04-01T06:50:19.454 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:19 smithi145 ceph-mon[47816]: monmap e3: 3 mons at {a=[v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0],b=[v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0],c=[v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-01T06:50:19.454 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:19 smithi145 ceph-mon[47816]: fsmap 2024-04-01T06:50:19.455 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:19 smithi145 ceph-mon[47816]: osdmap e4: 0 total, 0 up, 0 in 2024-04-01T06:50:19.455 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:19 smithi145 ceph-mon[47816]: mgrmap e13: x(active, since 44s) 2024-04-01T06:50:19.455 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:19 smithi145 ceph-mon[47816]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-04-01T06:50:19.455 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:19 smithi145 ceph-mon[47816]: Cluster is now healthy 2024-04-01T06:50:19.455 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:19 smithi145 ceph-mon[47816]: overall HEALTH_OK 2024-04-01T06:50:19.455 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:19 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:19.455 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:19 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:19.455 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:19 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:19.455 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:19 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-01T06:50:19.455 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:19 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-01T06:50:19.455 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:19 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:19.640 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:19 smithi153 ceph-mon[48187]: mon.b calling monitor election 2024-04-01T06:50:19.640 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:19 smithi153 ceph-mon[48187]: Reconfiguring mon.a (unknown last config time)... 2024-04-01T06:50:19.641 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:19 smithi153 ceph-mon[48187]: Reconfiguring daemon mon.a on smithi083 2024-04-01T06:50:19.641 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:19 smithi153 ceph-mon[48187]: mon.b calling monitor election 2024-04-01T06:50:19.641 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:19 smithi153 ceph-mon[48187]: mon.c calling monitor election 2024-04-01T06:50:19.641 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:19 smithi153 ceph-mon[48187]: mon.a calling monitor election 2024-04-01T06:50:19.641 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:19 smithi153 ceph-mon[48187]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-04-01T06:50:19.641 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:19 smithi153 ceph-mon[48187]: monmap e3: 3 mons at {a=[v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0],b=[v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0],c=[v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-01T06:50:19.641 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:19 smithi153 ceph-mon[48187]: fsmap 2024-04-01T06:50:19.641 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:19 smithi153 ceph-mon[48187]: osdmap e4: 0 total, 0 up, 0 in 2024-04-01T06:50:19.641 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:19 smithi153 ceph-mon[48187]: mgrmap e13: x(active, since 44s) 2024-04-01T06:50:19.641 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:19 smithi153 ceph-mon[48187]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-04-01T06:50:19.641 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:19 smithi153 ceph-mon[48187]: Cluster is now healthy 2024-04-01T06:50:19.641 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:19 smithi153 ceph-mon[48187]: overall HEALTH_OK 2024-04-01T06:50:19.641 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:19 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:19.641 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:19 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:19.641 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:19 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:19.642 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:19 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-01T06:50:19.642 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:19 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-01T06:50:19.642 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:19 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:19.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:19.937+0000 7f3a01496700 1 -- 172.21.15.83:0/572858142 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f39fc104f90 msgr2=0x7f39fc10cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:50:19.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:19.937+0000 7f3a01496700 1 --2- 172.21.15.83:0/572858142 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f39fc104f90 0x7f39fc10cb60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f39f400b0a0 tx=0x7f39f400b3b0 comp rx=0 tx=0).stop 2024-04-01T06:50:19.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:19.937+0000 7f3a01496700 1 -- 172.21.15.83:0/572858142 shutdown_connections 2024-04-01T06:50:19.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:19.937+0000 7f3a01496700 1 --2- 172.21.15.83:0/572858142 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f39fc104f90 0x7f39fc10cb60 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:50:19.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:19.937+0000 7f3a01496700 1 --2- 172.21.15.83:0/572858142 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39fc0fff70 0x7f39fc100350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:50:19.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:19.937+0000 7f3a01496700 1 --2- 172.21.15.83:0/572858142 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f39fc100920 0x7f39fc1048b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:50:19.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:19.937+0000 7f3a01496700 1 -- 172.21.15.83:0/572858142 >> 172.21.15.83:0/572858142 conn(0x7f39fc075d90 msgr2=0x7f39fc0761a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:50:19.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:19.937+0000 7f3a01496700 1 -- 172.21.15.83:0/572858142 shutdown_connections 2024-04-01T06:50:19.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:19.937+0000 7f3a01496700 1 -- 172.21.15.83:0/572858142 wait complete. 2024-04-01T06:50:19.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:19.937+0000 7f3a01496700 1 Processor -- start 2024-04-01T06:50:19.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:19.938+0000 7f3a01496700 1 -- start start 2024-04-01T06:50:19.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:19.938+0000 7f3a01496700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f39fc0fff70 0x7f39fc101950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:50:19.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:19.938+0000 7f3a01496700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39fc100920 0x7f39fc101e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:50:19.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:19.938+0000 7f3a01496700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f39fc104f90 0x7f39fc1023d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:50:19.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:19.938+0000 7f3a01496700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39fc1a55e0 con 0x7f39fc0fff70 2024-04-01T06:50:19.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:19.938+0000 7f3a01496700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39fc1a5750 con 0x7f39fc104f90 2024-04-01T06:50:19.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:19.938+0000 7f3a01496700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39fc1a5910 con 0x7f39fc100920 2024-04-01T06:50:19.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:19.938+0000 7f39faffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f39fc0fff70 0x7f39fc101950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:50:19.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:19.938+0000 7f39faffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f39fc0fff70 0x7f39fc101950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:45480/0 (socket says 172.21.15.83:45480) 2024-04-01T06:50:19.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:19.938+0000 7f39faffd700 1 -- 172.21.15.83:0/386399923 learned_addr learned my addr 172.21.15.83:0/386399923 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:50:19.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:19.938+0000 7f39fb7fe700 1 --2- 172.21.15.83:0/386399923 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f39fc104f90 0x7f39fc1023d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:50:19.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:19.938+0000 7f39fa7fc700 1 --2- 172.21.15.83:0/386399923 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39fc100920 0x7f39fc101e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:50:19.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:19.938+0000 7f39faffd700 1 -- 172.21.15.83:0/386399923 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39fc100920 msgr2=0x7f39fc101e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:50:19.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:19.938+0000 7f39faffd700 1 --2- 172.21.15.83:0/386399923 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39fc100920 0x7f39fc101e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:50:19.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:19.938+0000 7f39faffd700 1 -- 172.21.15.83:0/386399923 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f39fc104f90 msgr2=0x7f39fc1023d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:50:19.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:19.938+0000 7f39faffd700 1 --2- 172.21.15.83:0/386399923 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f39fc104f90 0x7f39fc1023d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:50:19.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:19.938+0000 7f39faffd700 1 -- 172.21.15.83:0/386399923 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f4009d00 con 0x7f39fc0fff70 2024-04-01T06:50:19.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:19.939+0000 7f39faffd700 1 --2- 172.21.15.83:0/386399923 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f39fc0fff70 0x7f39fc101950 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f39ec00d950 tx=0x7f39ec00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:50:19.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:19.939+0000 7f39e3fff700 1 -- 172.21.15.83:0/386399923 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ec00f890 con 0x7f39fc0fff70 2024-04-01T06:50:19.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:19.939+0000 7f3a01496700 1 -- 172.21.15.83:0/386399923 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39fc1a5bf0 con 0x7f39fc0fff70 2024-04-01T06:50:19.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:19.939+0000 7f39e3fff700 1 -- 172.21.15.83:0/386399923 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f39ec010460 con 0x7f39fc0fff70 2024-04-01T06:50:19.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:19.939+0000 7f39e3fff700 1 -- 172.21.15.83:0/386399923 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ec00e610 con 0x7f39fc0fff70 2024-04-01T06:50:19.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:19.939+0000 7f3a01496700 1 -- 172.21.15.83:0/386399923 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39fc1a6140 con 0x7f39fc0fff70 2024-04-01T06:50:19.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:19.939+0000 7f39e3fff700 1 -- 172.21.15.83:0/386399923 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 13) v1 ==== 45589+0+0 (secure 0 0 0) 0x7f39ec00e770 con 0x7f39fc0fff70 2024-04-01T06:50:19.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:19.940+0000 7f39e3fff700 1 --2- 172.21.15.83:0/386399923 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f39e40389d0 0x7f39e403ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:50:19.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:19.940+0000 7f39e3fff700 1 -- 172.21.15.83:0/386399923 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f39ec00fba0 con 0x7f39fc0fff70 2024-04-01T06:50:19.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:19.940+0000 7f39fa7fc700 1 --2- 172.21.15.83:0/386399923 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f39e40389d0 0x7f39e403ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:50:19.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:19.940+0000 7f3a01496700 1 -- 172.21.15.83:0/386399923 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39fc1092c0 con 0x7f39fc0fff70 2024-04-01T06:50:19.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:19.940+0000 7f39fa7fc700 1 --2- 172.21.15.83:0/386399923 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f39e40389d0 0x7f39e403ae90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f39fc103080 tx=0x7f39f0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:50:19.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:19.945+0000 7f39e3fff700 1 -- 172.21.15.83:0/386399923 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f39ec0228f0 con 0x7f39fc0fff70 2024-04-01T06:50:20.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:20.150+0000 7f3a01496700 1 -- 172.21.15.83:0/386399923 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f39fc102e30 con 0x7f39fc0fff70 2024-04-01T06:50:20.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:20.150+0000 7f39e3fff700 1 -- 172.21.15.83:0/386399923 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) v1 ==== 76+0+275 (secure 0 0 0) 0x7f39ec022300 con 0x7f39fc0fff70 2024-04-01T06:50:20.150 INFO:teuthology.orchestra.run.smithi083.stdout:# minimal ceph.conf for c6f8eff4-eff3-11ee-b647-cb9ed24678a4 2024-04-01T06:50:20.150 INFO:teuthology.orchestra.run.smithi083.stdout:[global] 2024-04-01T06:50:20.150 INFO:teuthology.orchestra.run.smithi083.stdout: fsid = c6f8eff4-eff3-11ee-b647-cb9ed24678a4 2024-04-01T06:50:20.150 INFO:teuthology.orchestra.run.smithi083.stdout: mon_host = [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-04-01T06:50:20.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:20.152+0000 7f3a01496700 1 -- 172.21.15.83:0/386399923 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f39e40389d0 msgr2=0x7f39e403ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:50:20.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:20.152+0000 7f3a01496700 1 --2- 172.21.15.83:0/386399923 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f39e40389d0 0x7f39e403ae90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f39fc103080 tx=0x7f39f0009260 comp rx=0 tx=0).stop 2024-04-01T06:50:20.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:20.152+0000 7f3a01496700 1 -- 172.21.15.83:0/386399923 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f39fc0fff70 msgr2=0x7f39fc101950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:50:20.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:20.152+0000 7f3a01496700 1 --2- 172.21.15.83:0/386399923 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f39fc0fff70 0x7f39fc101950 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f39ec00d950 tx=0x7f39ec00dc60 comp rx=0 tx=0).stop 2024-04-01T06:50:20.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:20.152+0000 7f3a01496700 1 -- 172.21.15.83:0/386399923 shutdown_connections 2024-04-01T06:50:20.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:20.152+0000 7f3a01496700 1 --2- 172.21.15.83:0/386399923 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f39fc0fff70 0x7f39fc101950 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:50:20.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:20.152+0000 7f3a01496700 1 --2- 172.21.15.83:0/386399923 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f39e40389d0 0x7f39e403ae90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:50:20.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:20.152+0000 7f3a01496700 1 --2- 172.21.15.83:0/386399923 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f39fc104f90 0x7f39fc1023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:50:20.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:20.152+0000 7f3a01496700 1 --2- 172.21.15.83:0/386399923 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39fc100920 0x7f39fc101e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:50:20.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:20.152+0000 7f3a01496700 1 -- 172.21.15.83:0/386399923 >> 172.21.15.83:0/386399923 conn(0x7f39fc075d90 msgr2=0x7f39fc069740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:50:20.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:20.152+0000 7f3a01496700 1 -- 172.21.15.83:0/386399923 shutdown_connections 2024-04-01T06:50:20.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:20.152+0000 7f3a01496700 1 -- 172.21.15.83:0/386399923 wait complete. 2024-04-01T06:50:20.461 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:20 smithi153 ceph-mon[48187]: Reconfiguring mon.b (monmap changed)... 2024-04-01T06:50:20.462 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:20 smithi153 ceph-mon[48187]: Reconfiguring daemon mon.b on smithi145 2024-04-01T06:50:20.462 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:20 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T06:50:20.462 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:20 smithi153 ceph-mon[48187]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:20.462 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:20 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:20.462 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:20 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:20.462 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:20 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-01T06:50:20.462 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:20 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-01T06:50:20.462 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:20 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:20.462 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:20 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/386399923' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:20.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:20 smithi145 ceph-mon[47816]: Reconfiguring mon.b (monmap changed)... 2024-04-01T06:50:20.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:20 smithi145 ceph-mon[47816]: Reconfiguring daemon mon.b on smithi145 2024-04-01T06:50:20.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:20 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T06:50:20.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:20 smithi145 ceph-mon[47816]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:20.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:20 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:20.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:20 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:20.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:20 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-01T06:50:20.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:20 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-01T06:50:20.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:20 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:20.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:20 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/386399923' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:20.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:20 smithi083 ceph-mon[43429]: Reconfiguring mon.b (monmap changed)... 2024-04-01T06:50:20.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:20 smithi083 ceph-mon[43429]: Reconfiguring daemon mon.b on smithi145 2024-04-01T06:50:20.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:20 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T06:50:20.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:20 smithi083 ceph-mon[43429]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:20.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:20 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:20.513 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:20 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:20.513 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:20 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-01T06:50:20.513 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:20 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-01T06:50:20.513 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:20 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:20.513 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:20 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/386399923' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:20.529 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-04-01T06:50:20.530 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-04-01T06:50:20.530 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/etc/ceph/ceph.conf 2024-04-01T06:50:20.560 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-04-01T06:50:20.560 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-01T06:50:20.628 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-04-01T06:50:20.628 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/ceph/ceph.conf 2024-04-01T06:50:20.662 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-04-01T06:50:20.662 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-01T06:50:20.731 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-04-01T06:50:20.731 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/ceph/ceph.conf 2024-04-01T06:50:20.762 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-04-01T06:50:20.762 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-01T06:50:20.831 INFO:tasks.cephadm:Adding mgr.x on smithi083 2024-04-01T06:50:20.831 INFO:tasks.cephadm:Adding mgr.y on smithi145 2024-04-01T06:50:20.832 INFO:tasks.cephadm:Adding mgr.z on smithi153 2024-04-01T06:50:20.832 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph orch apply mgr '3;smithi083=x;smithi145=y;smithi153=z' 2024-04-01T06:50:21.085 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T06:50:22.048 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:22.046+0000 7fdda84cd700 1 -- 172.21.15.153:0/713781762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdda0106ae0 msgr2=0x7fdda0108f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:50:22.048 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:22.046+0000 7fdda84cd700 1 --2- 172.21.15.153:0/713781762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdda0106ae0 0x7fdda0108f50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fdd98009f90 tx=0x7fdd9800b330 comp rx=0 tx=0).stop 2024-04-01T06:50:22.049 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:22.046+0000 7fdda84cd700 1 -- 172.21.15.153:0/713781762 shutdown_connections 2024-04-01T06:50:22.049 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:22.046+0000 7fdda84cd700 1 --2- 172.21.15.153:0/713781762 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdda0101880 0x7fdda0103c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:50:22.049 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:22.046+0000 7fdda84cd700 1 --2- 172.21.15.153:0/713781762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdda0106ae0 0x7fdda0108f50 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:50:22.049 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:22.046+0000 7fdda84cd700 1 --2- 172.21.15.153:0/713781762 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdda01041b0 0x7fdda01065a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:50:22.049 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:22.046+0000 7fdda84cd700 1 -- 172.21.15.153:0/713781762 >> 172.21.15.153:0/713781762 conn(0x7fdda00fb2b0 msgr2=0x7fdda00fd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:50:22.049 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:22.046+0000 7fdda84cd700 1 -- 172.21.15.153:0/713781762 shutdown_connections 2024-04-01T06:50:22.049 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:22.046+0000 7fdda84cd700 1 -- 172.21.15.153:0/713781762 wait complete. 2024-04-01T06:50:22.049 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:22.047+0000 7fdda84cd700 1 Processor -- start 2024-04-01T06:50:22.049 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:22.047+0000 7fdda84cd700 1 -- start start 2024-04-01T06:50:22.049 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:22.047+0000 7fdda84cd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdda0101880 0x7fdda0196dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:50:22.049 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:22.047+0000 7fdda84cd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdda01041b0 0x7fdda0197310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:50:22.049 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:22.047+0000 7fdda84cd700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdda0106ae0 0x7fdda019e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:50:22.049 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:22.047+0000 7fdda84cd700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda019e8c0 con 0x7fdda0101880 2024-04-01T06:50:22.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:22.047+0000 7fdda84cd700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda019ea00 con 0x7fdda0106ae0 2024-04-01T06:50:22.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:22.047+0000 7fdda84cd700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda019eb90 con 0x7fdda01041b0 2024-04-01T06:50:22.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:22.047+0000 7fdda5a68700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdda01041b0 0x7fdda0197310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:50:22.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:22.047+0000 7fdda5a68700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdda01041b0 0x7fdda0197310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44420/0 (socket says 172.21.15.153:44420) 2024-04-01T06:50:22.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:22.047+0000 7fdda5a68700 1 -- 172.21.15.153:0/3740353627 learned_addr learned my addr 172.21.15.153:0/3740353627 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-04-01T06:50:22.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:22.047+0000 7fdda6269700 1 --2- 172.21.15.153:0/3740353627 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdda0101880 0x7fdda0196dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:50:22.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:22.047+0000 7fdda6a6a700 1 --2- 172.21.15.153:0/3740353627 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdda0106ae0 0x7fdda019e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:50:22.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:22.048+0000 7fdda5a68700 1 -- 172.21.15.153:0/3740353627 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdda0106ae0 msgr2=0x7fdda019e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:50:22.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:22.048+0000 7fdda5a68700 1 --2- 172.21.15.153:0/3740353627 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdda0106ae0 0x7fdda019e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:50:22.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:22.048+0000 7fdda5a68700 1 -- 172.21.15.153:0/3740353627 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdda0101880 msgr2=0x7fdda0196dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:50:22.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:22.048+0000 7fdda5a68700 1 --2- 172.21.15.153:0/3740353627 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdda0101880 0x7fdda0196dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:50:22.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:22.048+0000 7fdda5a68700 1 -- 172.21.15.153:0/3740353627 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd98009c40 con 0x7fdda01041b0 2024-04-01T06:50:22.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:22.048+0000 7fdda5a68700 1 --2- 172.21.15.153:0/3740353627 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdda01041b0 0x7fdda0197310 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c00e9d0 tx=0x7fdd9c00ed90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:50:22.051 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:22.048+0000 7fdd977fe700 1 -- 172.21.15.153:0/3740353627 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c009790 con 0x7fdda01041b0 2024-04-01T06:50:22.051 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:22.048+0000 7fdda84cd700 1 -- 172.21.15.153:0/3740353627 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdda019ee70 con 0x7fdda01041b0 2024-04-01T06:50:22.051 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:22.048+0000 7fdd977fe700 1 -- 172.21.15.153:0/3740353627 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdd9c00cbd0 con 0x7fdda01041b0 2024-04-01T06:50:22.051 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:22.048+0000 7fdd977fe700 1 -- 172.21.15.153:0/3740353627 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c018680 con 0x7fdda01041b0 2024-04-01T06:50:22.051 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:22.048+0000 7fdda84cd700 1 -- 172.21.15.153:0/3740353627 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdda019f2e0 con 0x7fdda01041b0 2024-04-01T06:50:22.052 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:22.049+0000 7fdd977fe700 1 -- 172.21.15.153:0/3740353627 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 13) v1 ==== 45589+0+0 (secure 0 0 0) 0x7fdd9c0187e0 con 0x7fdda01041b0 2024-04-01T06:50:22.052 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:22.049+0000 7fdd977fe700 1 --2- 172.21.15.153:0/3740353627 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fdd8c0389d0 0x7fdd8c03ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:50:22.052 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:22.049+0000 7fdd977fe700 1 -- 172.21.15.153:0/3740353627 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fdd9c014070 con 0x7fdda01041b0 2024-04-01T06:50:22.052 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:22.049+0000 7fdda84cd700 1 -- 172.21.15.153:0/3740353627 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdda00fce30 con 0x7fdda01041b0 2024-04-01T06:50:22.052 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:22.049+0000 7fdda6269700 1 --2- 172.21.15.153:0/3740353627 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fdd8c0389d0 0x7fdd8c03ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:50:22.052 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:22.050+0000 7fdda6269700 1 --2- 172.21.15.153:0/3740353627 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fdd8c0389d0 0x7fdd8c03ae90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdd90005fd0 tx=0x7fdd90009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:50:22.054 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:22.054+0000 7fdd977fe700 1 -- 172.21.15.153:0/3740353627 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7fdd9c01fd30 con 0x7fdda01041b0 2024-04-01T06:50:22.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:21 smithi153 ceph-mon[48187]: Reconfiguring mon.c (monmap changed)... 2024-04-01T06:50:22.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:21 smithi153 ceph-mon[48187]: Reconfiguring daemon mon.c on smithi153 2024-04-01T06:50:22.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:21 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:22.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:21 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:22.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:21 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:50:22.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:21 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:22.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:21 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:50:22.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:21 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:22.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:21 smithi145 ceph-mon[47816]: Reconfiguring mon.c (monmap changed)... 2024-04-01T06:50:22.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:21 smithi145 ceph-mon[47816]: Reconfiguring daemon mon.c on smithi153 2024-04-01T06:50:22.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:21 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:22.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:21 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:22.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:21 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:50:22.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:21 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:22.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:21 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:50:22.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:21 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:22.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:22.255+0000 7fdda84cd700 1 -- 172.21.15.153:0/3740353627 --> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi083=x;smithi145=y;smithi153=z", "target": ["mon-mgr", ""]}) v1 -- 0x7fdda002cd20 con 0x7fdd8c0389d0 2024-04-01T06:50:22.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:21 smithi083 ceph-mon[43429]: Reconfiguring mon.c (monmap changed)... 2024-04-01T06:50:22.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:21 smithi083 ceph-mon[43429]: Reconfiguring daemon mon.c on smithi153 2024-04-01T06:50:22.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:21 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:22.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:21 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:22.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:21 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:50:22.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:21 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:22.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:21 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:50:22.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:21 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:22.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:22.262+0000 7fdd977fe700 1 -- 172.21.15.153:0/3740353627 <== mgr.14152 v2:172.21.15.83:6800/3375372052 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fdda002cd20 con 0x7fdd8c0389d0 2024-04-01T06:50:22.263 INFO:teuthology.orchestra.run.smithi153.stdout:Scheduled mgr update... 2024-04-01T06:50:22.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:22.264+0000 7fdda84cd700 1 -- 172.21.15.153:0/3740353627 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fdd8c0389d0 msgr2=0x7fdd8c03ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:50:22.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:22.264+0000 7fdda84cd700 1 --2- 172.21.15.153:0/3740353627 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fdd8c0389d0 0x7fdd8c03ae90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdd90005fd0 tx=0x7fdd90009310 comp rx=0 tx=0).stop 2024-04-01T06:50:22.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:22.264+0000 7fdda84cd700 1 -- 172.21.15.153:0/3740353627 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdda01041b0 msgr2=0x7fdda0197310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:50:22.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:22.264+0000 7fdda84cd700 1 --2- 172.21.15.153:0/3740353627 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdda01041b0 0x7fdda0197310 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c00e9d0 tx=0x7fdd9c00ed90 comp rx=0 tx=0).stop 2024-04-01T06:50:22.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:22.264+0000 7fdda84cd700 1 -- 172.21.15.153:0/3740353627 shutdown_connections 2024-04-01T06:50:22.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:22.264+0000 7fdda84cd700 1 --2- 172.21.15.153:0/3740353627 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdda0101880 0x7fdda0196dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:50:22.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:22.264+0000 7fdda84cd700 1 --2- 172.21.15.153:0/3740353627 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fdd8c0389d0 0x7fdd8c03ae90 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:50:22.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:22.264+0000 7fdda84cd700 1 --2- 172.21.15.153:0/3740353627 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdda0106ae0 0x7fdda019e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:50:22.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:22.264+0000 7fdda84cd700 1 --2- 172.21.15.153:0/3740353627 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdda01041b0 0x7fdda0197310 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:50:22.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:22.264+0000 7fdda84cd700 1 -- 172.21.15.153:0/3740353627 >> 172.21.15.153:0/3740353627 conn(0x7fdda00fb2b0 msgr2=0x7fdda01021c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:50:22.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:22.264+0000 7fdda84cd700 1 -- 172.21.15.153:0/3740353627 shutdown_connections 2024-04-01T06:50:22.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:50:22.264+0000 7fdda84cd700 1 -- 172.21.15.153:0/3740353627 wait complete. 2024-04-01T06:50:22.633 DEBUG:teuthology.orchestra.run.smithi145:mgr.y> sudo journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mgr.y.service 2024-04-01T06:50:22.636 DEBUG:teuthology.orchestra.run.smithi153:mgr.z> sudo journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mgr.z.service 2024-04-01T06:50:22.638 INFO:tasks.cephadm:Deploying OSDs... 2024-04-01T06:50:22.638 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-04-01T06:50:22.638 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/scratch_devs of=/dev/stdout 2024-04-01T06:50:22.660 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-01T06:50:22.660 DEBUG:teuthology.orchestra.run.smithi083:> stat /dev/vg_nvme/lv_1 2024-04-01T06:50:22.667 INFO:journalctl@ceph.mgr.z.smithi153.stdout:-- Logs begin at Mon 2024-04-01 06:35:09 UTC. -- 2024-04-01T06:50:22.668 INFO:journalctl@ceph.mgr.y.smithi145.stdout:-- Logs begin at Mon 2024-04-01 06:34:41 UTC. -- 2024-04-01T06:50:22.721 INFO:teuthology.orchestra.run.smithi083.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-01T06:50:22.721 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-01T06:50:22.721 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 6h/6d Inode: 182362 Links: 1 2024-04-01T06:50:22.721 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T06:50:22.721 INFO:teuthology.orchestra.run.smithi083.stdout:Context: system_u:object_r:device_t:s0 2024-04-01T06:50:22.721 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2024-04-01 06:49:43.116720368 +0000 2024-04-01T06:50:22.722 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2024-04-01 06:43:28.379127286 +0000 2024-04-01T06:50:22.722 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2024-04-01 06:43:28.379127286 +0000 2024-04-01T06:50:22.722 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: - 2024-04-01T06:50:22.722 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-01T06:50:22.794 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records in 2024-04-01T06:50:22.794 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records out 2024-04-01T06:50:22.794 INFO:teuthology.orchestra.run.smithi083.stderr:512 bytes copied, 0.000284123 s, 1.8 MB/s 2024-04-01T06:50:22.795 DEBUG:teuthology.orchestra.run.smithi083:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-01T06:50:22.856 DEBUG:teuthology.orchestra.run.smithi083:> stat /dev/vg_nvme/lv_2 2024-04-01T06:50:22.917 INFO:teuthology.orchestra.run.smithi083.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-01T06:50:22.918 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-01T06:50:22.918 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 6h/6d Inode: 178702 Links: 1 2024-04-01T06:50:22.918 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T06:50:22.918 INFO:teuthology.orchestra.run.smithi083.stdout:Context: system_u:object_r:device_t:s0 2024-04-01T06:50:22.918 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2024-04-01 06:49:43.173718961 +0000 2024-04-01T06:50:22.918 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2024-04-01 06:43:28.733118532 +0000 2024-04-01T06:50:22.918 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2024-04-01 06:43:28.733118532 +0000 2024-04-01T06:50:22.918 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: - 2024-04-01T06:50:22.918 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-01T06:50:22.988 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records in 2024-04-01T06:50:22.989 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records out 2024-04-01T06:50:22.989 INFO:teuthology.orchestra.run.smithi083.stderr:512 bytes copied, 0.000266041 s, 1.9 MB/s 2024-04-01T06:50:22.990 DEBUG:teuthology.orchestra.run.smithi083:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-01T06:50:23.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:22 smithi145 ceph-mon[47816]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:23.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:22 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:23.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:22 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:50:23.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:22 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:23.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:22 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:50:23.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:22 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:23.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:22 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-01T06:50:23.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:22 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-01T06:50:23.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:22 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-01T06:50:23.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:22 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:23.052 DEBUG:teuthology.orchestra.run.smithi083:> stat /dev/vg_nvme/lv_3 2024-04-01T06:50:23.112 INFO:teuthology.orchestra.run.smithi083.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-01T06:50:23.112 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-01T06:50:23.112 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 6h/6d Inode: 181505 Links: 1 2024-04-01T06:50:23.112 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T06:50:23.112 INFO:teuthology.orchestra.run.smithi083.stdout:Context: system_u:object_r:device_t:s0 2024-04-01T06:50:23.113 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2024-04-01 06:49:43.222717751 +0000 2024-04-01T06:50:23.113 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2024-04-01 06:43:29.099109482 +0000 2024-04-01T06:50:23.113 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2024-04-01 06:43:29.099109482 +0000 2024-04-01T06:50:23.113 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: - 2024-04-01T06:50:23.113 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-01T06:50:23.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:22 smithi153 ceph-mon[48187]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:23.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:22 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:23.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:22 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:50:23.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:22 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:23.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:22 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:50:23.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:22 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:23.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:22 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-01T06:50:23.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:22 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-01T06:50:23.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:22 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-01T06:50:23.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:22 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:23.178 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:22 smithi083 ceph-mon[43429]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:23.178 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:22 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:23.179 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:22 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:50:23.179 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:22 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:23.179 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:22 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:50:23.179 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:22 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:23.179 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:22 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-01T06:50:23.179 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:22 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-01T06:50:23.179 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:22 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-01T06:50:23.179 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:22 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:23.181 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records in 2024-04-01T06:50:23.181 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records out 2024-04-01T06:50:23.181 INFO:teuthology.orchestra.run.smithi083.stderr:512 bytes copied, 0.000208273 s, 2.5 MB/s 2024-04-01T06:50:23.182 DEBUG:teuthology.orchestra.run.smithi083:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-01T06:50:23.242 DEBUG:teuthology.orchestra.run.smithi083:> stat /dev/vg_nvme/lv_4 2024-04-01T06:50:23.301 INFO:teuthology.orchestra.run.smithi083.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-01T06:50:23.301 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-01T06:50:23.301 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 6h/6d Inode: 178021 Links: 1 2024-04-01T06:50:23.301 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T06:50:23.301 INFO:teuthology.orchestra.run.smithi083.stdout:Context: system_u:object_r:device_t:s0 2024-04-01T06:50:23.301 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2024-04-01 06:49:43.274716467 +0000 2024-04-01T06:50:23.301 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2024-04-01 06:43:29.488099863 +0000 2024-04-01T06:50:23.301 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2024-04-01 06:43:29.488099863 +0000 2024-04-01T06:50:23.301 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: - 2024-04-01T06:50:23.302 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-01T06:50:23.368 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records in 2024-04-01T06:50:23.369 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records out 2024-04-01T06:50:23.369 INFO:teuthology.orchestra.run.smithi083.stderr:512 bytes copied, 0.000227438 s, 2.3 MB/s 2024-04-01T06:50:23.370 DEBUG:teuthology.orchestra.run.smithi083:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-01T06:50:23.429 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-04-01T06:50:23.429 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/scratch_devs of=/dev/stdout 2024-04-01T06:50:23.451 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-01T06:50:23.451 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_1 2024-04-01T06:50:23.511 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-01T06:50:23.512 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-01T06:50:23.512 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 6h/6d Inode: 177614 Links: 1 2024-04-01T06:50:23.512 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T06:50:23.512 INFO:teuthology.orchestra.run.smithi145.stdout:Context: system_u:object_r:device_t:s0 2024-04-01T06:50:23.512 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2024-04-01 06:50:11.147496703 +0000 2024-04-01T06:50:23.512 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2024-04-01 06:43:47.838952762 +0000 2024-04-01T06:50:23.512 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2024-04-01 06:43:47.838952762 +0000 2024-04-01T06:50:23.512 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: - 2024-04-01T06:50:23.512 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-01T06:50:23.582 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2024-04-01T06:50:23.582 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2024-04-01T06:50:23.582 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.00020068 s, 2.6 MB/s 2024-04-01T06:50:23.583 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-01T06:50:23.640 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 06:50:23 smithi153 systemd[1]: Starting Ceph mgr.z for c6f8eff4-eff3-11ee-b647-cb9ed24678a4... 2024-04-01T06:50:23.643 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_2 2024-04-01T06:50:23.703 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-01T06:50:23.703 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-01T06:50:23.703 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 6h/6d Inode: 176733 Links: 1 2024-04-01T06:50:23.703 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T06:50:23.703 INFO:teuthology.orchestra.run.smithi145.stdout:Context: system_u:object_r:device_t:s0 2024-04-01T06:50:23.703 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2024-04-01 06:50:11.147496703 +0000 2024-04-01T06:50:23.703 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2024-04-01 06:43:48.211944839 +0000 2024-04-01T06:50:23.703 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2024-04-01 06:43:48.211944839 +0000 2024-04-01T06:50:23.703 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: - 2024-04-01T06:50:23.704 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-01T06:50:23.770 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2024-04-01T06:50:23.770 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2024-04-01T06:50:23.770 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.000242079 s, 2.1 MB/s 2024-04-01T06:50:23.771 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-01T06:50:23.831 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_3 2024-04-01T06:50:23.890 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-01T06:50:23.891 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-01T06:50:23.891 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 6h/6d Inode: 176053 Links: 1 2024-04-01T06:50:23.891 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T06:50:23.891 INFO:teuthology.orchestra.run.smithi145.stdout:Context: system_u:object_r:device_t:s0 2024-04-01T06:50:23.891 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2024-04-01 06:50:11.147496703 +0000 2024-04-01T06:50:23.891 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2024-04-01 06:43:48.561937404 +0000 2024-04-01T06:50:23.891 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2024-04-01 06:43:48.561937404 +0000 2024-04-01T06:50:23.891 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: - 2024-04-01T06:50:23.891 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-01T06:50:23.958 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2024-04-01T06:50:23.958 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2024-04-01T06:50:23.958 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.000211787 s, 2.4 MB/s 2024-04-01T06:50:23.959 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-01T06:50:24.019 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_4 2024-04-01T06:50:24.077 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-01T06:50:24.077 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-01T06:50:24.077 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 6h/6d Inode: 179127 Links: 1 2024-04-01T06:50:24.077 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T06:50:24.077 INFO:teuthology.orchestra.run.smithi145.stdout:Context: system_u:object_r:device_t:s0 2024-04-01T06:50:24.077 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2024-04-01 06:50:11.147496703 +0000 2024-04-01T06:50:24.077 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2024-04-01 06:43:48.906930075 +0000 2024-04-01T06:50:24.077 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2024-04-01 06:43:48.906930075 +0000 2024-04-01T06:50:24.078 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: - 2024-04-01T06:50:24.078 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-01T06:50:24.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:23 smithi153 ceph-mon[48187]: from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi083=x;smithi145=y;smithi153=z", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:50:24.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:23 smithi153 ceph-mon[48187]: Saving service mgr spec with placement smithi083=x;smithi145=y;smithi153=z;count:3 2024-04-01T06:50:24.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:23 smithi153 ceph-mon[48187]: Deploying daemon mgr.z on smithi153 2024-04-01T06:50:24.141 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 06:50:23 smithi153 ceph-mgr[50077]: -- 172.21.15.153:0/2750872817 <== mon.1 v2:172.21.15.153:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x561394c681a0 con 0x561394c3f000 2024-04-01T06:50:24.141 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 06:50:23 smithi153 bash[50039]: d2e4c2a79fc7e35c1a46f53e57feafa517b87ba7c0a49381e4b1963c6c977c4e 2024-04-01T06:50:24.141 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 06:50:23 smithi153 systemd[1]: Started Ceph mgr.z for c6f8eff4-eff3-11ee-b647-cb9ed24678a4. 2024-04-01T06:50:24.142 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2024-04-01T06:50:24.142 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2024-04-01T06:50:24.142 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.000229612 s, 2.2 MB/s 2024-04-01T06:50:24.143 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-01T06:50:24.200 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-04-01T06:50:24.200 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/scratch_devs of=/dev/stdout 2024-04-01T06:50:24.219 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-01T06:50:24.219 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_1 2024-04-01T06:50:24.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:23 smithi145 ceph-mon[47816]: from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi083=x;smithi145=y;smithi153=z", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:50:24.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:23 smithi145 ceph-mon[47816]: Saving service mgr spec with placement smithi083=x;smithi145=y;smithi153=z;count:3 2024-04-01T06:50:24.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:23 smithi145 ceph-mon[47816]: Deploying daemon mgr.z on smithi153 2024-04-01T06:50:24.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:23 smithi083 ceph-mon[43429]: from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi083=x;smithi145=y;smithi153=z", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:50:24.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:23 smithi083 ceph-mon[43429]: Saving service mgr spec with placement smithi083=x;smithi145=y;smithi153=z;count:3 2024-04-01T06:50:24.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:23 smithi083 ceph-mon[43429]: Deploying daemon mgr.z on smithi153 2024-04-01T06:50:24.277 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-01T06:50:24.277 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-01T06:50:24.277 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 6h/6d Inode: 176900 Links: 1 2024-04-01T06:50:24.277 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T06:50:24.277 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2024-04-01T06:50:24.277 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-04-01 06:50:23.531731774 +0000 2024-04-01T06:50:24.277 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-04-01 06:43:58.508305979 +0000 2024-04-01T06:50:24.278 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-04-01 06:43:58.508305979 +0000 2024-04-01T06:50:24.278 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: - 2024-04-01T06:50:24.278 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-01T06:50:24.346 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 06:50:24 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-z[50054]: 2024-04-01T06:50:24.336+0000 7fcbd015d200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-01T06:50:24.349 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-04-01T06:50:24.349 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-04-01T06:50:24.350 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000205195 s, 2.5 MB/s 2024-04-01T06:50:24.351 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-01T06:50:24.409 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_2 2024-04-01T06:50:24.467 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-01T06:50:24.467 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-01T06:50:24.467 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 6h/6d Inode: 181430 Links: 1 2024-04-01T06:50:24.467 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T06:50:24.467 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2024-04-01T06:50:24.467 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-04-01 06:50:23.531731774 +0000 2024-04-01T06:50:24.467 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-04-01 06:43:58.845299978 +0000 2024-04-01T06:50:24.467 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-04-01 06:43:58.845299978 +0000 2024-04-01T06:50:24.467 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: - 2024-04-01T06:50:24.468 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-01T06:50:24.534 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-04-01T06:50:24.534 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-04-01T06:50:24.534 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000364261 s, 1.4 MB/s 2024-04-01T06:50:24.535 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-01T06:50:24.594 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_3 2024-04-01T06:50:24.616 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 06:50:24 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-z[50054]: 2024-04-01T06:50:24.436+0000 7fcbd015d200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-01T06:50:24.616 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 06:50:24 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-z[50054]: 2024-04-01T06:50:24.527+0000 7fcbd015d200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-01T06:50:24.616 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 06:50:24 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-z[50054]: 2024-04-01T06:50:24.616+0000 7fcbd015d200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-01T06:50:24.633 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-01T06:50:24.633 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-01T06:50:24.633 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 6h/6d Inode: 170720 Links: 1 2024-04-01T06:50:24.633 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T06:50:24.633 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2024-04-01T06:50:24.633 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-04-01 06:50:23.531731774 +0000 2024-04-01T06:50:24.633 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-04-01 06:43:59.201293638 +0000 2024-04-01T06:50:24.633 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-04-01 06:43:59.201293638 +0000 2024-04-01T06:50:24.634 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: - 2024-04-01T06:50:24.634 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-01T06:50:24.700 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-04-01T06:50:24.700 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-04-01T06:50:24.700 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000203732 s, 2.5 MB/s 2024-04-01T06:50:24.701 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-01T06:50:24.759 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_4 2024-04-01T06:50:24.817 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-01T06:50:24.818 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-01T06:50:24.818 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 6h/6d Inode: 177044 Links: 1 2024-04-01T06:50:24.818 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T06:50:24.818 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2024-04-01T06:50:24.818 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-04-01 06:50:23.531731774 +0000 2024-04-01T06:50:24.818 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-04-01 06:43:59.557287299 +0000 2024-04-01T06:50:24.818 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-04-01 06:43:59.557287299 +0000 2024-04-01T06:50:24.818 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: - 2024-04-01T06:50:24.818 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-01T06:50:24.884 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-04-01T06:50:24.884 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-04-01T06:50:24.884 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000227341 s, 2.3 MB/s 2024-04-01T06:50:24.885 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-01T06:50:24.943 INFO:tasks.cephadm:Deploying osd.0 on smithi083 with /dev/vg_nvme/lv_4... 2024-04-01T06:50:24.944 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-01T06:50:25.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:24 smithi145 ceph-mon[47816]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:25.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:24 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:25.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:24 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:25.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:24 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:25.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:24 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-01T06:50:25.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:24 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-01T06:50:25.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:24 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-01T06:50:25.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:24 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:25.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:24 smithi153 ceph-mon[48187]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:25.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:24 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:25.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:24 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:25.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:24 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:25.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:24 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-01T06:50:25.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:24 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-01T06:50:25.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:24 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-01T06:50:25.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:24 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:25.170 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:50:25.249 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:24 smithi083 ceph-mon[43429]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:25.249 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:24 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:25.249 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:24 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:25.249 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:24 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:25.249 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:24 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-01T06:50:25.249 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:24 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-01T06:50:25.249 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:24 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-01T06:50:25.249 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:24 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:25.501 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:50:25 smithi145 systemd[1]: Starting Ceph mgr.y for c6f8eff4-eff3-11ee-b647-cb9ed24678a4... 2024-04-01T06:50:25.603 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 06:50:25 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-z[50054]: 2024-04-01T06:50:25.270+0000 7fcbd015d200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-01T06:50:25.604 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 06:50:25 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-z[50054]: 2024-04-01T06:50:25.519+0000 7fcbd015d200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-01T06:50:25.876 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 06:50:25 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-z[50054]: 2024-04-01T06:50:25.604+0000 7fcbd015d200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-01T06:50:25.876 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 06:50:25 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-z[50054]: 2024-04-01T06:50:25.713+0000 7fcbd015d200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-01T06:50:25.876 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 06:50:25 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-z[50054]: 2024-04-01T06:50:25.875+0000 7fcbd015d200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-01T06:50:25.898 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:50:25 smithi145 ceph-mgr[49317]: -- 172.21.15.145:0/445036928 <== mon.2 v2:172.21.15.145:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55b3f5b801a0 con 0x55b3f5b56c00 2024-04-01T06:50:25.898 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:50:25 smithi145 bash[49279]: 8fb1d003406a43891a54842ec456b4ee2bbe0412354a0cc999f20e9792f023e5 2024-04-01T06:50:25.898 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:50:25 smithi145 systemd[1]: Started Ceph mgr.y for c6f8eff4-eff3-11ee-b647-cb9ed24678a4. 2024-04-01T06:50:25.899 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:25 smithi145 ceph-mon[47816]: Deploying daemon mgr.y on smithi145 2024-04-01T06:50:25.899 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:25 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:25.899 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:25 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:25.899 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:25 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:25.899 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:25 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:26.140 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 06:50:26 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-z[50054]: 2024-04-01T06:50:26.021+0000 7fcbd015d200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-01T06:50:26.141 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 06:50:26 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-z[50054]: 2024-04-01T06:50:26.113+0000 7fcbd015d200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-01T06:50:26.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:25 smithi153 ceph-mon[48187]: Deploying daemon mgr.y on smithi145 2024-04-01T06:50:26.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:25 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:26.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:25 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:26.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:25 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:26.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:25 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:26.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:25 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:50:26.155 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:25 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:50:26.156 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:50:26 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-y[49294]: 2024-04-01T06:50:26.054+0000 7f905f182200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-01T06:50:26.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:25 smithi083 ceph-mon[43429]: Deploying daemon mgr.y on smithi145 2024-04-01T06:50:26.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:25 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:26.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:25 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:26.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:25 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:26.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:25 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:26.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:25 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:50:26.418 INFO:teuthology.orchestra.run.smithi083.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-01T06:50:26.418 INFO:teuthology.orchestra.run.smithi083.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-01T06:50:26.419 INFO:teuthology.orchestra.run.smithi083.stderr: stderr: 10+0 records in 2024-04-01T06:50:26.419 INFO:teuthology.orchestra.run.smithi083.stderr:10+0 records out 2024-04-01T06:50:26.419 INFO:teuthology.orchestra.run.smithi083.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0115849 s, 905 MB/s 2024-04-01T06:50:26.419 INFO:teuthology.orchestra.run.smithi083.stderr:--> Zapping successful for: 2024-04-01T06:50:26.502 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:50:26 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-y[49294]: 2024-04-01T06:50:26.156+0000 7f905f182200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-01T06:50:26.503 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:50:26 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-y[49294]: 2024-04-01T06:50:26.255+0000 7f905f182200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-01T06:50:26.503 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:50:26 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-y[49294]: 2024-04-01T06:50:26.340+0000 7f905f182200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-01T06:50:26.780 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi083:vg_nvme/lv_4 2024-04-01T06:50:26.890 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 06:50:26 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-z[50054]: 2024-04-01T06:50:26.524+0000 7fcbd015d200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-01T06:50:27.014 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:50:27.158 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:26 smithi083 ceph-mon[43429]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:27.158 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:26 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:27.158 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:26 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:27.159 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:26 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:27.159 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:26 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:27.159 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:26 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:27.159 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:26 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:50:27.159 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:26 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:27.159 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:26 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-01T06:50:27.159 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:26 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-01T06:50:27.159 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:26 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:27.212 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 06:50:26 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-z[50054]: 2024-04-01T06:50:26.928+0000 7fcbd015d200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-01T06:50:27.213 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 06:50:27 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-z[50054]: 2024-04-01T06:50:27.120+0000 7fcbd015d200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-01T06:50:27.213 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:26 smithi153 ceph-mon[48187]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:27.213 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:26 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:27.213 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:26 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:27.213 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:26 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:27.213 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:26 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:27.213 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:26 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:27.213 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:26 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:50:27.213 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:26 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:27.214 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:26 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-01T06:50:27.214 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:26 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-01T06:50:27.214 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:26 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:27.249 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:50:27 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-y[49294]: 2024-04-01T06:50:27.001+0000 7f905f182200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-01T06:50:27.249 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:26 smithi145 ceph-mon[47816]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:27.249 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:26 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:27.249 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:26 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:27.249 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:26 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:27.249 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:26 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:27.250 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:26 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:27.250 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:26 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:50:27.250 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:26 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:27.250 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:26 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-01T06:50:27.250 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:26 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-01T06:50:27.250 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:26 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:27.502 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:50:27 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-y[49294]: 2024-04-01T06:50:27.249+0000 7f905f182200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-01T06:50:27.502 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:50:27 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-y[49294]: 2024-04-01T06:50:27.334+0000 7f905f182200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-01T06:50:27.503 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:50:27 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-y[49294]: 2024-04-01T06:50:27.440+0000 7f905f182200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-01T06:50:27.640 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 06:50:27 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-z[50054]: 2024-04-01T06:50:27.212+0000 7fcbd015d200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-01T06:50:27.900 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:50:27 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-y[49294]: 2024-04-01T06:50:27.598+0000 7f905f182200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-01T06:50:27.901 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:50:27 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-y[49294]: 2024-04-01T06:50:27.724+0000 7f905f182200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-01T06:50:27.901 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:50:27 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-y[49294]: 2024-04-01T06:50:27.808+0000 7f905f182200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-01T06:50:28.126 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:27 smithi083 ceph-mon[43429]: Reconfiguring mgr.x (unknown last config time)... 2024-04-01T06:50:28.126 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:27 smithi083 ceph-mon[43429]: Reconfiguring daemon mgr.x on smithi083 2024-04-01T06:50:28.179 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:27 smithi145 ceph-mon[47816]: Reconfiguring mgr.x (unknown last config time)... 2024-04-01T06:50:28.179 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:27 smithi145 ceph-mon[47816]: Reconfiguring daemon mgr.x on smithi083 2024-04-01T06:50:28.218 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:27 smithi153 ceph-mon[48187]: Reconfiguring mgr.x (unknown last config time)... 2024-04-01T06:50:28.218 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:27 smithi153 ceph-mon[48187]: Reconfiguring daemon mgr.x on smithi083 2024-04-01T06:50:28.219 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 06:50:27 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-z[50054]: 2024-04-01T06:50:27.974+0000 7fcbd015d200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-01T06:50:28.219 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 06:50:28 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-z[50054]: 2024-04-01T06:50:28.070+0000 7fcbd015d200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-01T06:50:28.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:28.289+0000 7f708397c700 1 -- 172.21.15.83:0/4104978552 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f707c0ffcf0 msgr2=0x7f707c100110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:50:28.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:28.289+0000 7f708397c700 1 --2- 172.21.15.83:0/4104978552 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f707c0ffcf0 0x7f707c100110 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f706c0099c0 tx=0x7f706c009cd0 comp rx=0 tx=0).stop 2024-04-01T06:50:28.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:28.289+0000 7f708397c700 1 -- 172.21.15.83:0/4104978552 shutdown_connections 2024-04-01T06:50:28.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:28.289+0000 7f708397c700 1 --2- 172.21.15.83:0/4104978552 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f707c0ffcf0 0x7f707c100110 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:50:28.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:28.289+0000 7f708397c700 1 --2- 172.21.15.83:0/4104978552 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f707c101890 0x7f707c108140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:50:28.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:28.289+0000 7f708397c700 1 --2- 172.21.15.83:0/4104978552 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f707c100ef0 0x7f707c101350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:50:28.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:28.289+0000 7f708397c700 1 -- 172.21.15.83:0/4104978552 >> 172.21.15.83:0/4104978552 conn(0x7f707c0fb2b0 msgr2=0x7f707c0fd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:50:28.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:28.289+0000 7f708397c700 1 -- 172.21.15.83:0/4104978552 shutdown_connections 2024-04-01T06:50:28.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:28.289+0000 7f708397c700 1 -- 172.21.15.83:0/4104978552 wait complete. 2024-04-01T06:50:28.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:28.290+0000 7f708397c700 1 Processor -- start 2024-04-01T06:50:28.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:28.290+0000 7f708397c700 1 -- start start 2024-04-01T06:50:28.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:28.290+0000 7f708397c700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f707c0ffcf0 0x7f707c196dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:50:28.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:28.290+0000 7f708397c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f707c100ef0 0x7f707c197310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:50:28.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:28.290+0000 7f708397c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f707c101890 0x7f707c19e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:50:28.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:28.290+0000 7f708397c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f707c19e880 con 0x7f707c101890 2024-04-01T06:50:28.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:28.290+0000 7f708397c700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f707c19e9c0 con 0x7f707c0ffcf0 2024-04-01T06:50:28.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:28.290+0000 7f708397c700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f707c19eb80 con 0x7f707c100ef0 2024-04-01T06:50:28.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:28.290+0000 7f7081f19700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f707c101890 0x7f707c19e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:50:28.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:28.290+0000 7f7081718700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f707c0ffcf0 0x7f707c196dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:50:28.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:28.290+0000 7f7081f19700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f707c101890 0x7f707c19e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:53330/0 (socket says 172.21.15.83:53330) 2024-04-01T06:50:28.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:28.290+0000 7f7081718700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f707c0ffcf0 0x7f707c196dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.83:41518/0 (socket says 172.21.15.83:41518) 2024-04-01T06:50:28.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:28.290+0000 7f7081f19700 1 -- 172.21.15.83:0/688047523 learned_addr learned my addr 172.21.15.83:0/688047523 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:50:28.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:28.290+0000 7f7080f17700 1 --2- 172.21.15.83:0/688047523 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f707c100ef0 0x7f707c197310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:50:28.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:28.291+0000 7f7081f19700 1 -- 172.21.15.83:0/688047523 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f707c100ef0 msgr2=0x7f707c197310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:50:28.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:28.291+0000 7f7081f19700 1 --2- 172.21.15.83:0/688047523 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f707c100ef0 0x7f707c197310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:50:28.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:28.291+0000 7f7081f19700 1 -- 172.21.15.83:0/688047523 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f707c0ffcf0 msgr2=0x7f707c196dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:50:28.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:28.291+0000 7f7081f19700 1 --2- 172.21.15.83:0/688047523 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f707c0ffcf0 0x7f707c196dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:50:28.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:28.291+0000 7f7081f19700 1 -- 172.21.15.83:0/688047523 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f706c0095f0 con 0x7f707c101890 2024-04-01T06:50:28.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:28.291+0000 7f7081718700 1 --2- 172.21.15.83:0/688047523 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f707c0ffcf0 0x7f707c196dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T06:50:28.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:28.291+0000 7f7081f19700 1 --2- 172.21.15.83:0/688047523 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f707c101890 0x7f707c19e2b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7074007ee0 tx=0x7f707400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:50:28.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:28.291+0000 7f70727fc700 1 -- 172.21.15.83:0/688047523 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707400dd20 con 0x7f707c101890 2024-04-01T06:50:28.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:28.291+0000 7f70727fc700 1 -- 172.21.15.83:0/688047523 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f707400f040 con 0x7f707c101890 2024-04-01T06:50:28.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:28.291+0000 7f70727fc700 1 -- 172.21.15.83:0/688047523 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70740048a0 con 0x7f707c101890 2024-04-01T06:50:28.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:28.291+0000 7f708397c700 1 -- 172.21.15.83:0/688047523 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f707c19ee60 con 0x7f707c101890 2024-04-01T06:50:28.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:28.291+0000 7f708397c700 1 -- 172.21.15.83:0/688047523 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f707c19f220 con 0x7f707c101890 2024-04-01T06:50:28.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:28.292+0000 7f70727fc700 1 -- 172.21.15.83:0/688047523 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 13) v1 ==== 45589+0+0 (secure 0 0 0) 0x7f7074003a00 con 0x7f707c101890 2024-04-01T06:50:28.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:28.292+0000 7f708397c700 1 -- 172.21.15.83:0/688047523 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f707c04ea80 con 0x7f707c101890 2024-04-01T06:50:28.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:28.292+0000 7f70727fc700 1 --2- 172.21.15.83:0/688047523 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f70680389d0 0x7f706803ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:50:28.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:28.292+0000 7f70727fc700 1 -- 172.21.15.83:0/688047523 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f707404aa70 con 0x7f707c101890 2024-04-01T06:50:28.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:28.292+0000 7f7081718700 1 --2- 172.21.15.83:0/688047523 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f70680389d0 0x7f706803ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:50:28.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:28.292+0000 7f7081718700 1 --2- 172.21.15.83:0/688047523 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f70680389d0 0x7f706803ae90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f706c009f50 tx=0x7f706c000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:50:28.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:28.297+0000 7f70727fc700 1 -- 172.21.15.83:0/688047523 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f7074004020 con 0x7f707c101890 2024-04-01T06:50:28.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:28.498+0000 7f708397c700 1 -- 172.21.15.83:0/688047523 --> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f707c068e60 con 0x7f70680389d0 2024-04-01T06:50:28.502 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:50:28 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-y[49294]: 2024-04-01T06:50:28.180+0000 7f905f182200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-01T06:50:28.642 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 06:50:28 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-z[50054]: 2024-04-01T06:50:28.218+0000 7fcbd015d200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-01T06:50:28.855 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:50:28 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-y[49294]: 2024-04-01T06:50:28.572+0000 7f905f182200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-01T06:50:28.856 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:50:28 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-y[49294]: 2024-04-01T06:50:28.764+0000 7f905f182200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-01T06:50:28.856 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:50:28 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-y[49294]: 2024-04-01T06:50:28.856+0000 7f905f182200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-01T06:50:29.140 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 06:50:28 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-z[50054]: 2024-04-01T06:50:28.849+0000 7fcbd015d200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-01T06:50:29.140 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 06:50:29 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-z[50054]: 2024-04-01T06:50:29.030+0000 7fcbd015d200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-01T06:50:29.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:28 smithi153 ceph-mon[48187]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:29.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:28 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:29.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:28 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:29.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:28 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:50:29.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:28 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:29.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:28 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:50:29.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:28 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:29.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:28 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T06:50:29.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:28 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T06:50:29.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:28 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:29.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:28 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:29.158 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:28 smithi083 ceph-mon[43429]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:29.158 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:28 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:29.158 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:28 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:29.158 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:28 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:50:29.158 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:28 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:29.158 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:28 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:50:29.158 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:28 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:29.158 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:28 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T06:50:29.158 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:28 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T06:50:29.158 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:28 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:29.159 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:28 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:29.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:28 smithi145 ceph-mon[47816]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:29.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:28 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:29.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:28 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:29.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:28 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:50:29.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:28 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:29.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:28 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:50:29.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:28 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:29.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:28 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T06:50:29.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:28 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T06:50:29.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:28 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:29.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:28 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:29.640 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 06:50:29 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-z[50054]: 2024-04-01T06:50:29.226+0000 7fcbd015d200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-01T06:50:29.909 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:50:29 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-y[49294]: 2024-04-01T06:50:29.615+0000 7f905f182200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-01T06:50:29.909 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:50:29 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-y[49294]: 2024-04-01T06:50:29.710+0000 7f905f182200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-01T06:50:29.909 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:50:29 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-y[49294]: 2024-04-01T06:50:29.857+0000 7f905f182200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-01T06:50:30.158 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:29 smithi153 ceph-mon[48187]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:50:30.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:29 smithi145 ceph-mon[47816]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:50:30.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:29 smithi083 ceph-mon[43429]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:50:30.443 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 06:50:30 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-z[50054]: 2024-04-01T06:50:30.158+0000 7fcbd015d200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-01T06:50:30.720 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 06:50:30 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-z[50054]: 2024-04-01T06:50:30.443+0000 7fcbd015d200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-01T06:50:30.721 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 06:50:30 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-z[50054]: 2024-04-01T06:50:30.531+0000 7fcbd015d200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-01T06:50:30.752 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:50:30 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-y[49294]: 2024-04-01T06:50:30.480+0000 7f905f182200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-01T06:50:30.752 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:50:30 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-y[49294]: 2024-04-01T06:50:30.660+0000 7f905f182200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-01T06:50:31.140 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 06:50:30 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-z[50054]: 2024-04-01T06:50:30.720+0000 7fcbd015d200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-01T06:50:31.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:30 smithi153 ceph-mon[48187]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:31.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:30 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/4059393413' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "90b761b0-b06c-4142-854d-38ee42aa6052"}]: dispatch 2024-04-01T06:50:31.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:30 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/4059393413' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "90b761b0-b06c-4142-854d-38ee42aa6052"}]': finished 2024-04-01T06:50:31.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:30 smithi153 ceph-mon[48187]: osdmap e5: 1 total, 0 up, 1 in 2024-04-01T06:50:31.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:30 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-01T06:50:31.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:30 smithi153 ceph-mon[48187]: Standby manager daemon z started 2024-04-01T06:50:31.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:30 smithi153 ceph-mon[48187]: from='mgr.? 172.21.15.153:0/2447229018' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-01T06:50:31.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:30 smithi153 ceph-mon[48187]: from='mgr.? 172.21.15.153:0/2447229018' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-01T06:50:31.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:30 smithi153 ceph-mon[48187]: from='mgr.? 172.21.15.153:0/2447229018' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-01T06:50:31.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:30 smithi153 ceph-mon[48187]: from='mgr.? 172.21.15.153:0/2447229018' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-01T06:50:31.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:30 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/3417431556' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T06:50:31.252 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:50:30 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-y[49294]: 2024-04-01T06:50:30.851+0000 7f905f182200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-01T06:50:31.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:30 smithi145 ceph-mon[47816]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:31.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:30 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/4059393413' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "90b761b0-b06c-4142-854d-38ee42aa6052"}]: dispatch 2024-04-01T06:50:31.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:30 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/4059393413' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "90b761b0-b06c-4142-854d-38ee42aa6052"}]': finished 2024-04-01T06:50:31.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:30 smithi145 ceph-mon[47816]: osdmap e5: 1 total, 0 up, 1 in 2024-04-01T06:50:31.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:30 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-01T06:50:31.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:30 smithi145 ceph-mon[47816]: Standby manager daemon z started 2024-04-01T06:50:31.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:30 smithi145 ceph-mon[47816]: from='mgr.? 172.21.15.153:0/2447229018' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-01T06:50:31.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:30 smithi145 ceph-mon[47816]: from='mgr.? 172.21.15.153:0/2447229018' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-01T06:50:31.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:30 smithi145 ceph-mon[47816]: from='mgr.? 172.21.15.153:0/2447229018' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-01T06:50:31.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:30 smithi145 ceph-mon[47816]: from='mgr.? 172.21.15.153:0/2447229018' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-01T06:50:31.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:30 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/3417431556' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T06:50:31.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:30 smithi083 ceph-mon[43429]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:31.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:30 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/4059393413' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "90b761b0-b06c-4142-854d-38ee42aa6052"}]: dispatch 2024-04-01T06:50:31.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:30 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/4059393413' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "90b761b0-b06c-4142-854d-38ee42aa6052"}]': finished 2024-04-01T06:50:31.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:30 smithi083 ceph-mon[43429]: osdmap e5: 1 total, 0 up, 1 in 2024-04-01T06:50:31.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:30 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-01T06:50:31.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:30 smithi083 ceph-mon[43429]: Standby manager daemon z started 2024-04-01T06:50:31.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:30 smithi083 ceph-mon[43429]: from='mgr.? 172.21.15.153:0/2447229018' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-01T06:50:31.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:30 smithi083 ceph-mon[43429]: from='mgr.? 172.21.15.153:0/2447229018' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-01T06:50:31.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:30 smithi083 ceph-mon[43429]: from='mgr.? 172.21.15.153:0/2447229018' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-01T06:50:31.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:30 smithi083 ceph-mon[43429]: from='mgr.? 172.21.15.153:0/2447229018' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-01T06:50:31.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:30 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/3417431556' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T06:50:31.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:31.622+0000 7f70727fc700 1 -- 172.21.15.83:0/688047523 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mgrmap(e 14) v1 ==== 90699+0+0 (secure 0 0 0) 0x7f7074015400 con 0x7f707c101890 2024-04-01T06:50:32.058 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:50:31 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-y[49294]: 2024-04-01T06:50:31.777+0000 7f905f182200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-01T06:50:32.058 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:50:32 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-y[49294]: 2024-04-01T06:50:32.059+0000 7f905f182200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-01T06:50:32.335 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:50:32 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-y[49294]: 2024-04-01T06:50:32.146+0000 7f905f182200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-01T06:50:32.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:32.632+0000 7f70727fc700 1 -- 172.21.15.83:0/688047523 <== mon.0 v2:172.21.15.83:3300/0 8 ==== mgrmap(e 15) v1 ==== 135809+0+0 (secure 0 0 0) 0x7f70740191c0 con 0x7f707c101890 2024-04-01T06:50:32.890 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:32 smithi153 ceph-mon[48187]: mgrmap e14: x(active, since 57s), standbys: z 2024-04-01T06:50:32.890 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:32 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-01T06:50:32.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:32 smithi153 ceph-mon[48187]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:32.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:32 smithi153 ceph-mon[48187]: Standby manager daemon y started 2024-04-01T06:50:32.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:32 smithi153 ceph-mon[48187]: from='mgr.? 172.21.15.145:0/3847546152' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-01T06:50:32.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:32 smithi153 ceph-mon[48187]: from='mgr.? 172.21.15.145:0/3847546152' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-01T06:50:32.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:32 smithi153 ceph-mon[48187]: from='mgr.? 172.21.15.145:0/3847546152' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-01T06:50:32.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:32 smithi153 ceph-mon[48187]: from='mgr.? 172.21.15.145:0/3847546152' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-01T06:50:33.002 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:50:32 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-y[49294]: 2024-04-01T06:50:32.336+0000 7f905f182200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-01T06:50:33.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:32 smithi145 ceph-mon[47816]: mgrmap e14: x(active, since 57s), standbys: z 2024-04-01T06:50:33.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:32 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-01T06:50:33.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:32 smithi145 ceph-mon[47816]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:33.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:32 smithi145 ceph-mon[47816]: Standby manager daemon y started 2024-04-01T06:50:33.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:32 smithi145 ceph-mon[47816]: from='mgr.? 172.21.15.145:0/3847546152' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-01T06:50:33.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:32 smithi145 ceph-mon[47816]: from='mgr.? 172.21.15.145:0/3847546152' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-01T06:50:33.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:32 smithi145 ceph-mon[47816]: from='mgr.? 172.21.15.145:0/3847546152' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-01T06:50:33.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:32 smithi145 ceph-mon[47816]: from='mgr.? 172.21.15.145:0/3847546152' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-01T06:50:33.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:32 smithi083 ceph-mon[43429]: mgrmap e14: x(active, since 57s), standbys: z 2024-04-01T06:50:33.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:32 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-01T06:50:33.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:32 smithi083 ceph-mon[43429]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:33.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:32 smithi083 ceph-mon[43429]: Standby manager daemon y started 2024-04-01T06:50:33.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:32 smithi083 ceph-mon[43429]: from='mgr.? 172.21.15.145:0/3847546152' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-01T06:50:33.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:32 smithi083 ceph-mon[43429]: from='mgr.? 172.21.15.145:0/3847546152' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-01T06:50:33.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:32 smithi083 ceph-mon[43429]: from='mgr.? 172.21.15.145:0/3847546152' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-01T06:50:33.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:32 smithi083 ceph-mon[43429]: from='mgr.? 172.21.15.145:0/3847546152' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-01T06:50:33.890 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:33 smithi153 ceph-mon[48187]: mgrmap e15: x(active, since 58s), standbys: z, y 2024-04-01T06:50:33.890 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:33 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-01T06:50:33.928 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:33 smithi083 ceph-mon[43429]: mgrmap e15: x(active, since 58s), standbys: z, y 2024-04-01T06:50:33.928 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:33 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-01T06:50:34.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:33 smithi145 ceph-mon[47816]: mgrmap e15: x(active, since 58s), standbys: z, y 2024-04-01T06:50:34.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:33 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-01T06:50:34.890 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:34 smithi153 ceph-mon[48187]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:34.940 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:34 smithi083 ceph-mon[43429]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:35.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:34 smithi145 ceph-mon[47816]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:36.706 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:36 smithi083 ceph-mon[43429]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:36.707 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:36 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-01T06:50:36.707 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:36 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:36.890 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:36 smithi153 ceph-mon[48187]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:36.890 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:36 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-01T06:50:36.890 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:36 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:37.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:36 smithi145 ceph-mon[47816]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:37.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:36 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-01T06:50:37.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:36 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:37.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:37 smithi083 ceph-mon[43429]: Deploying daemon osd.0 on smithi083 2024-04-01T06:50:37.890 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:37 smithi153 ceph-mon[48187]: Deploying daemon osd.0 on smithi083 2024-04-01T06:50:38.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:37 smithi145 ceph-mon[47816]: Deploying daemon osd.0 on smithi083 2024-04-01T06:50:38.890 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:38 smithi153 ceph-mon[48187]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:38.909 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:38 smithi083 ceph-mon[43429]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:39.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:38 smithi145 ceph-mon[47816]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:40.753 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:40 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:40.753 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:40 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:40.753 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:40 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:50:40.753 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:40 smithi145 ceph-mon[47816]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:40.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:40 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:40.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:40 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:40.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:40 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:50:40.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:40 smithi083 ceph-mon[43429]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:40.890 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:40 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:40.890 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:40 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:40.890 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:40 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:50:40.890 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:40 smithi153 ceph-mon[48187]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:41.798 INFO:teuthology.orchestra.run.smithi083.stdout:Created osd(s) 0 on host 'smithi083' 2024-04-01T06:50:41.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:41.798+0000 7f70727fc700 1 -- 172.21.15.83:0/688047523 <== mgr.14152 v2:172.21.15.83:6800/3375372052 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f707c068e60 con 0x7f70680389d0 2024-04-01T06:50:41.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:41.800+0000 7f708397c700 1 -- 172.21.15.83:0/688047523 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f70680389d0 msgr2=0x7f706803ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:50:41.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:41.800+0000 7f708397c700 1 --2- 172.21.15.83:0/688047523 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f70680389d0 0x7f706803ae90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f706c009f50 tx=0x7f706c000bc0 comp rx=0 tx=0).stop 2024-04-01T06:50:41.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:41.800+0000 7f708397c700 1 -- 172.21.15.83:0/688047523 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f707c101890 msgr2=0x7f707c19e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:50:41.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:41.800+0000 7f708397c700 1 --2- 172.21.15.83:0/688047523 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f707c101890 0x7f707c19e2b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7074007ee0 tx=0x7f707400d3b0 comp rx=0 tx=0).stop 2024-04-01T06:50:41.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:41.800+0000 7f708397c700 1 -- 172.21.15.83:0/688047523 shutdown_connections 2024-04-01T06:50:41.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:41.800+0000 7f708397c700 1 --2- 172.21.15.83:0/688047523 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f707c101890 0x7f707c19e2b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:50:41.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:41.800+0000 7f708397c700 1 --2- 172.21.15.83:0/688047523 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f70680389d0 0x7f706803ae90 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:50:41.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:41.800+0000 7f708397c700 1 --2- 172.21.15.83:0/688047523 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f707c0ffcf0 0x7f707c196dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:50:41.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:41.800+0000 7f708397c700 1 --2- 172.21.15.83:0/688047523 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f707c100ef0 0x7f707c197310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:50:41.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:41.800+0000 7f708397c700 1 -- 172.21.15.83:0/688047523 >> 172.21.15.83:0/688047523 conn(0x7f707c0fb2b0 msgr2=0x7f707c068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:50:41.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:41.801+0000 7f708397c700 1 -- 172.21.15.83:0/688047523 shutdown_connections 2024-04-01T06:50:41.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:50:41.801+0000 7f708397c700 1 -- 172.21.15.83:0/688047523 wait complete. 2024-04-01T06:50:41.981 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:41 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:41.981 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:41 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:41.981 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:41 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:41.981 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:41 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:50:41.981 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:41 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:41.981 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:41 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:41.981 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:41 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:42.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:41 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:42.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:41 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:42.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:41 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:42.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:41 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:50:42.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:41 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:42.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:41 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:42.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:41 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:42.182 DEBUG:teuthology.orchestra.run.smithi083:osd.0> sudo journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@osd.0.service 2024-04-01T06:50:42.185 INFO:tasks.cephadm:Deploying osd.1 on smithi145 with /dev/vg_nvme/lv_4... 2024-04-01T06:50:42.185 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-01T06:50:42.218 INFO:journalctl@ceph.osd.0.smithi083.stdout:-- Logs begin at Mon 2024-04-01 06:34:54 UTC. -- 2024-04-01T06:50:42.219 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:41 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:42.219 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:41 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:42.219 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:41 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:42.219 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:41 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:50:42.219 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:41 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:42.219 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:41 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:42.219 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:41 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:42.413 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T06:50:42.776 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:42 smithi145 ceph-mon[47816]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:42.777 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:42 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:50:42.939 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:42 smithi083 ceph-mon[43429]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:42.939 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:42 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:50:43.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:42 smithi153 ceph-mon[48187]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:43.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:42 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:50:43.705 INFO:teuthology.orchestra.run.smithi145.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-01T06:50:43.705 INFO:teuthology.orchestra.run.smithi145.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-01T06:50:43.705 INFO:teuthology.orchestra.run.smithi145.stderr: stderr: 10+0 records in 2024-04-01T06:50:43.705 INFO:teuthology.orchestra.run.smithi145.stderr:10+0 records out 2024-04-01T06:50:43.705 INFO:teuthology.orchestra.run.smithi145.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113028 s, 928 MB/s 2024-04-01T06:50:43.705 INFO:teuthology.orchestra.run.smithi145.stderr:--> Zapping successful for: 2024-04-01T06:50:43.782 INFO:journalctl@ceph.osd.0.smithi083.stdout:Apr 01 06:50:43 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-0[62084]: 2024-04-01T06:50:43.512+0000 7f9160bcc640 -1 osd.0 0 log_to_monitors true 2024-04-01T06:50:44.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:43 smithi145 ceph-mon[47816]: from='osd.0 [v2:172.21.15.83:6802/3253845390,v1:172.21.15.83:6803/3253845390]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-01T06:50:44.042 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi145:vg_nvme/lv_4 2024-04-01T06:50:44.084 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:43 smithi083 ceph-mon[43429]: from='osd.0 [v2:172.21.15.83:6802/3253845390,v1:172.21.15.83:6803/3253845390]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-01T06:50:44.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:43 smithi153 ceph-mon[48187]: from='osd.0 [v2:172.21.15.83:6802/3253845390,v1:172.21.15.83:6803/3253845390]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-01T06:50:44.301 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T06:50:45.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:44 smithi145 ceph-mon[47816]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:45.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:44 smithi145 ceph-mon[47816]: from='osd.0 [v2:172.21.15.83:6802/3253845390,v1:172.21.15.83:6803/3253845390]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-01T06:50:45.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:44 smithi145 ceph-mon[47816]: osdmap e6: 1 total, 0 up, 1 in 2024-04-01T06:50:45.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:44 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-01T06:50:45.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:44 smithi145 ceph-mon[47816]: from='osd.0 [v2:172.21.15.83:6802/3253845390,v1:172.21.15.83:6803/3253845390]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]: dispatch 2024-04-01T06:50:45.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:44 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:45.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:44 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:45.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:44 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:50:45.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:44 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:45.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:44 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:45.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:44 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:50:45.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:44 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:45.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:44 smithi153 ceph-mon[48187]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:45.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:44 smithi153 ceph-mon[48187]: from='osd.0 [v2:172.21.15.83:6802/3253845390,v1:172.21.15.83:6803/3253845390]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-01T06:50:45.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:44 smithi153 ceph-mon[48187]: osdmap e6: 1 total, 0 up, 1 in 2024-04-01T06:50:45.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:44 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-01T06:50:45.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:44 smithi153 ceph-mon[48187]: from='osd.0 [v2:172.21.15.83:6802/3253845390,v1:172.21.15.83:6803/3253845390]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]: dispatch 2024-04-01T06:50:45.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:44 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:45.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:44 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:45.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:44 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:50:45.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:44 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:45.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:44 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:45.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:44 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:50:45.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:44 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:45.262 INFO:journalctl@ceph.osd.0.smithi083.stdout:Apr 01 06:50:44 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-0[62084]: 2024-04-01T06:50:44.790+0000 7f9156230700 -1 osd.0 0 waiting for initial osdmap 2024-04-01T06:50:45.262 INFO:journalctl@ceph.osd.0.smithi083.stdout:Apr 01 06:50:44 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-0[62084]: 2024-04-01T06:50:44.797+0000 7f9152025700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T06:50:45.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:44 smithi083 ceph-mon[43429]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:45.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:44 smithi083 ceph-mon[43429]: from='osd.0 [v2:172.21.15.83:6802/3253845390,v1:172.21.15.83:6803/3253845390]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-01T06:50:45.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:44 smithi083 ceph-mon[43429]: osdmap e6: 1 total, 0 up, 1 in 2024-04-01T06:50:45.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:44 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-01T06:50:45.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:44 smithi083 ceph-mon[43429]: from='osd.0 [v2:172.21.15.83:6802/3253845390,v1:172.21.15.83:6803/3253845390]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]: dispatch 2024-04-01T06:50:45.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:44 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:45.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:44 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:45.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:44 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:50:45.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:44 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:45.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:44 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:45.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:44 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:50:45.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:44 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:45.311 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:50:45.310+0000 7fb1bbe4c700 1 -- 172.21.15.145:0/3653861741 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb1b4100ef0 msgr2=0x7fb1b4101350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:50:45.311 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:50:45.311+0000 7fb1bbe4c700 1 --2- 172.21.15.145:0/3653861741 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb1b4100ef0 0x7fb1b4101350 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb1b00099c0 tx=0x7fb1b0009cd0 comp rx=0 tx=0).stop 2024-04-01T06:50:45.311 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:50:45.311+0000 7fb1bbe4c700 1 -- 172.21.15.145:0/3653861741 shutdown_connections 2024-04-01T06:50:45.311 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:50:45.311+0000 7fb1bbe4c700 1 --2- 172.21.15.145:0/3653861741 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb1b40ffcf0 0x7fb1b4100110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:50:45.311 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:50:45.311+0000 7fb1bbe4c700 1 --2- 172.21.15.145:0/3653861741 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb1b4101890 0x7fb1b4108140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:50:45.311 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:50:45.311+0000 7fb1bbe4c700 1 --2- 172.21.15.145:0/3653861741 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb1b4100ef0 0x7fb1b4101350 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:50:45.311 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:50:45.311+0000 7fb1bbe4c700 1 -- 172.21.15.145:0/3653861741 >> 172.21.15.145:0/3653861741 conn(0x7fb1b40fb2b0 msgr2=0x7fb1b40fd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:50:45.311 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:50:45.311+0000 7fb1bbe4c700 1 -- 172.21.15.145:0/3653861741 shutdown_connections 2024-04-01T06:50:45.311 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:50:45.311+0000 7fb1bbe4c700 1 -- 172.21.15.145:0/3653861741 wait complete. 2024-04-01T06:50:45.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:50:45.311+0000 7fb1bbe4c700 1 Processor -- start 2024-04-01T06:50:45.314 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:50:45.312+0000 7fb1bbe4c700 1 -- start start 2024-04-01T06:50:45.314 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:50:45.312+0000 7fb1bbe4c700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb1b40ffcf0 0x7fb1b4194ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:50:45.314 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:50:45.312+0000 7fb1bbe4c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb1b4100ef0 0x7fb1b4195000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:50:45.314 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:50:45.312+0000 7fb1bbe4c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb1b4101890 0x7fb1b419c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:50:45.314 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:50:45.312+0000 7fb1bbe4c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b419c600 con 0x7fb1b4100ef0 2024-04-01T06:50:45.314 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:50:45.312+0000 7fb1bbe4c700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b419c740 con 0x7fb1b40ffcf0 2024-04-01T06:50:45.314 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:50:45.312+0000 7fb1bbe4c700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b419c8d0 con 0x7fb1b4101890 2024-04-01T06:50:45.314 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:50:45.312+0000 7fb1b9be8700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb1b40ffcf0 0x7fb1b4194ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:50:45.314 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:50:45.312+0000 7fb1b9be8700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb1b40ffcf0 0x7fb1b4194ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:60436/0 (socket says 172.21.15.145:60436) 2024-04-01T06:50:45.314 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:50:45.312+0000 7fb1b9be8700 1 -- 172.21.15.145:0/1664670909 learned_addr learned my addr 172.21.15.145:0/1664670909 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-04-01T06:50:45.314 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:50:45.312+0000 7fb1b93e7700 1 --2- 172.21.15.145:0/1664670909 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb1b4100ef0 0x7fb1b4195000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:50:45.314 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:50:45.312+0000 7fb1ba3e9700 1 --2- 172.21.15.145:0/1664670909 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb1b4101890 0x7fb1b419c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:50:45.315 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:50:45.312+0000 7fb1b9be8700 1 -- 172.21.15.145:0/1664670909 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb1b4101890 msgr2=0x7fb1b419c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:50:45.315 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:50:45.312+0000 7fb1b9be8700 1 --2- 172.21.15.145:0/1664670909 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb1b4101890 0x7fb1b419c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:50:45.315 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:50:45.312+0000 7fb1b9be8700 1 -- 172.21.15.145:0/1664670909 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb1b4100ef0 msgr2=0x7fb1b4195000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:50:45.315 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:50:45.312+0000 7fb1b9be8700 1 --2- 172.21.15.145:0/1664670909 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb1b4100ef0 0x7fb1b4195000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:50:45.315 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:50:45.312+0000 7fb1b9be8700 1 -- 172.21.15.145:0/1664670909 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b00095f0 con 0x7fb1b40ffcf0 2024-04-01T06:50:45.315 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:50:45.312+0000 7fb1b93e7700 1 --2- 172.21.15.145:0/1664670909 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb1b4100ef0 0x7fb1b4195000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:50:45.315 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:50:45.312+0000 7fb1b9be8700 1 --2- 172.21.15.145:0/1664670909 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb1b40ffcf0 0x7fb1b4194ac0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8010b50 tx=0x7fb1a8010f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:50:45.315 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:50:45.312+0000 7fb1a6ffd700 1 -- 172.21.15.145:0/1664670909 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a800b9a0 con 0x7fb1b40ffcf0 2024-04-01T06:50:45.315 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:50:45.312+0000 7fb1a6ffd700 1 -- 172.21.15.145:0/1664670909 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb1a8011040 con 0x7fb1b40ffcf0 2024-04-01T06:50:45.315 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:50:45.313+0000 7fb1bbe4c700 1 -- 172.21.15.145:0/1664670909 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1b419cbb0 con 0x7fb1b40ffcf0 2024-04-01T06:50:45.315 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:50:45.313+0000 7fb1a6ffd700 1 -- 172.21.15.145:0/1664670909 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a8003970 con 0x7fb1b40ffcf0 2024-04-01T06:50:45.315 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:50:45.313+0000 7fb1bbe4c700 1 -- 172.21.15.145:0/1664670909 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1b419d100 con 0x7fb1b40ffcf0 2024-04-01T06:50:45.315 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:50:45.313+0000 7fb1bbe4c700 1 -- 172.21.15.145:0/1664670909 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1b41070b0 con 0x7fb1b40ffcf0 2024-04-01T06:50:45.316 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:50:45.315+0000 7fb1a6ffd700 1 -- 172.21.15.145:0/1664670909 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 15) v1 ==== 135809+0+0 (secure 0 0 0) 0x7fb1a800e950 con 0x7fb1b40ffcf0 2024-04-01T06:50:45.316 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:50:45.315+0000 7fb1a6ffd700 1 --2- 172.21.15.145:0/1664670909 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fb1a00a1110 0x7fb1a00a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:50:45.316 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:50:45.315+0000 7fb1a6ffd700 1 -- 172.21.15.145:0/1664670909 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1487+0+0 (secure 0 0 0) 0x7fb1a80cd270 con 0x7fb1b40ffcf0 2024-04-01T06:50:45.316 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:50:45.316+0000 7fb1b93e7700 1 --2- 172.21.15.145:0/1664670909 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fb1a00a1110 0x7fb1a00a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:50:45.316 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:50:45.316+0000 7fb1b93e7700 1 --2- 172.21.15.145:0/1664670909 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fb1a00a1110 0x7fb1a00a35d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb1b000b580 tx=0x7fb1b001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:50:45.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:50:45.319+0000 7fb1a6ffd700 1 -- 172.21.15.145:0/1664670909 <== mon.2 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7fb1a8098590 con 0x7fb1b40ffcf0 2024-04-01T06:50:45.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:50:45.517+0000 7fb1bbe4c700 1 -- 172.21.15.145:0/1664670909 --> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fb1b402cdc0 con 0x7fb1a00a1110 2024-04-01T06:50:46.109 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:45 smithi145 ceph-mon[47816]: Detected new or changed devices on smithi083 2024-04-01T06:50:46.110 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:45 smithi145 ceph-mon[47816]: Adjusting osd_memory_target on smithi083 to 17114M 2024-04-01T06:50:46.110 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:45 smithi145 ceph-mon[47816]: from='osd.0 [v2:172.21.15.83:6802/3253845390,v1:172.21.15.83:6803/3253845390]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]': finished 2024-04-01T06:50:46.110 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:45 smithi145 ceph-mon[47816]: osdmap e7: 1 total, 0 up, 1 in 2024-04-01T06:50:46.110 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:45 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-01T06:50:46.110 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:45 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-01T06:50:46.110 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:45 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T06:50:46.110 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:45 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T06:50:46.110 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:45 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:46.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:45 smithi153 ceph-mon[48187]: Detected new or changed devices on smithi083 2024-04-01T06:50:46.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:45 smithi153 ceph-mon[48187]: Adjusting osd_memory_target on smithi083 to 17114M 2024-04-01T06:50:46.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:45 smithi153 ceph-mon[48187]: from='osd.0 [v2:172.21.15.83:6802/3253845390,v1:172.21.15.83:6803/3253845390]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]': finished 2024-04-01T06:50:46.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:45 smithi153 ceph-mon[48187]: osdmap e7: 1 total, 0 up, 1 in 2024-04-01T06:50:46.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:45 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-01T06:50:46.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:45 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-01T06:50:46.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:45 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T06:50:46.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:45 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T06:50:46.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:45 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:46.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:45 smithi083 ceph-mon[43429]: Detected new or changed devices on smithi083 2024-04-01T06:50:46.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:45 smithi083 ceph-mon[43429]: Adjusting osd_memory_target on smithi083 to 17114M 2024-04-01T06:50:46.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:45 smithi083 ceph-mon[43429]: from='osd.0 [v2:172.21.15.83:6802/3253845390,v1:172.21.15.83:6803/3253845390]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]': finished 2024-04-01T06:50:46.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:45 smithi083 ceph-mon[43429]: osdmap e7: 1 total, 0 up, 1 in 2024-04-01T06:50:46.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:45 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-01T06:50:46.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:45 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-01T06:50:46.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:45 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T06:50:46.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:45 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T06:50:46.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:45 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:47.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:46 smithi153 ceph-mon[48187]: purged_snaps scrub starts 2024-04-01T06:50:47.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:46 smithi153 ceph-mon[48187]: purged_snaps scrub ok 2024-04-01T06:50:47.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:46 smithi153 ceph-mon[48187]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:50:47.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:46 smithi153 ceph-mon[48187]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:47.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:46 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-01T06:50:47.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:46 smithi153 ceph-mon[48187]: osd.0 [v2:172.21.15.83:6802/3253845390,v1:172.21.15.83:6803/3253845390] boot 2024-04-01T06:50:47.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:46 smithi153 ceph-mon[48187]: osdmap e8: 1 total, 1 up, 1 in 2024-04-01T06:50:47.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:46 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-01T06:50:47.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:46 smithi145 ceph-mon[47816]: purged_snaps scrub starts 2024-04-01T06:50:47.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:46 smithi145 ceph-mon[47816]: purged_snaps scrub ok 2024-04-01T06:50:47.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:46 smithi145 ceph-mon[47816]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:50:47.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:46 smithi145 ceph-mon[47816]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:47.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:46 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-01T06:50:47.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:46 smithi145 ceph-mon[47816]: osd.0 [v2:172.21.15.83:6802/3253845390,v1:172.21.15.83:6803/3253845390] boot 2024-04-01T06:50:47.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:46 smithi145 ceph-mon[47816]: osdmap e8: 1 total, 1 up, 1 in 2024-04-01T06:50:47.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:46 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-01T06:50:47.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:46 smithi083 ceph-mon[43429]: purged_snaps scrub starts 2024-04-01T06:50:47.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:46 smithi083 ceph-mon[43429]: purged_snaps scrub ok 2024-04-01T06:50:47.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:46 smithi083 ceph-mon[43429]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:50:47.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:46 smithi083 ceph-mon[43429]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-01T06:50:47.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:46 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-01T06:50:47.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:46 smithi083 ceph-mon[43429]: osd.0 [v2:172.21.15.83:6802/3253845390,v1:172.21.15.83:6803/3253845390] boot 2024-04-01T06:50:47.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:46 smithi083 ceph-mon[43429]: osdmap e8: 1 total, 1 up, 1 in 2024-04-01T06:50:47.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:46 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-01T06:50:48.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:47 smithi153 ceph-mon[48187]: osdmap e9: 1 total, 1 up, 1 in 2024-04-01T06:50:48.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:47 smithi153 ceph-mon[48187]: from='client.? 172.21.15.145:0/78467570' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4d6ab85b-7088-451e-a829-c9119f35dee0"}]: dispatch 2024-04-01T06:50:48.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:47 smithi153 ceph-mon[48187]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4d6ab85b-7088-451e-a829-c9119f35dee0"}]: dispatch 2024-04-01T06:50:48.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:47 smithi153 ceph-mon[48187]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4d6ab85b-7088-451e-a829-c9119f35dee0"}]': finished 2024-04-01T06:50:48.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:47 smithi153 ceph-mon[48187]: osdmap e10: 2 total, 1 up, 2 in 2024-04-01T06:50:48.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:47 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-01T06:50:48.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:47 smithi145 ceph-mon[47816]: osdmap e9: 1 total, 1 up, 1 in 2024-04-01T06:50:48.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:47 smithi145 ceph-mon[47816]: from='client.? 172.21.15.145:0/78467570' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4d6ab85b-7088-451e-a829-c9119f35dee0"}]: dispatch 2024-04-01T06:50:48.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:47 smithi145 ceph-mon[47816]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4d6ab85b-7088-451e-a829-c9119f35dee0"}]: dispatch 2024-04-01T06:50:48.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:47 smithi145 ceph-mon[47816]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4d6ab85b-7088-451e-a829-c9119f35dee0"}]': finished 2024-04-01T06:50:48.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:47 smithi145 ceph-mon[47816]: osdmap e10: 2 total, 1 up, 2 in 2024-04-01T06:50:48.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:47 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-01T06:50:48.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:47 smithi083 ceph-mon[43429]: osdmap e9: 1 total, 1 up, 1 in 2024-04-01T06:50:48.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:47 smithi083 ceph-mon[43429]: from='client.? 172.21.15.145:0/78467570' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4d6ab85b-7088-451e-a829-c9119f35dee0"}]: dispatch 2024-04-01T06:50:48.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:47 smithi083 ceph-mon[43429]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4d6ab85b-7088-451e-a829-c9119f35dee0"}]: dispatch 2024-04-01T06:50:48.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:47 smithi083 ceph-mon[43429]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4d6ab85b-7088-451e-a829-c9119f35dee0"}]': finished 2024-04-01T06:50:48.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:47 smithi083 ceph-mon[43429]: osdmap e10: 2 total, 1 up, 2 in 2024-04-01T06:50:48.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:47 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-01T06:50:49.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:48 smithi153 ceph-mon[48187]: pgmap v37: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T06:50:49.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:48 smithi153 ceph-mon[48187]: from='client.? 172.21.15.145:0/3092206383' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T06:50:49.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:48 smithi145 ceph-mon[47816]: pgmap v37: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T06:50:49.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:48 smithi145 ceph-mon[47816]: from='client.? 172.21.15.145:0/3092206383' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T06:50:49.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:48 smithi083 ceph-mon[43429]: pgmap v37: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T06:50:49.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:48 smithi083 ceph-mon[43429]: from='client.? 172.21.15.145:0/3092206383' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T06:50:51.102 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:50 smithi145 ceph-mon[47816]: pgmap v38: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T06:50:51.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:50 smithi153 ceph-mon[48187]: pgmap v38: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T06:50:51.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:50 smithi083 ceph-mon[43429]: pgmap v38: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T06:50:53.089 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:52 smithi145 ceph-mon[47816]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T06:50:53.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:52 smithi153 ceph-mon[48187]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T06:50:53.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:52 smithi083 ceph-mon[43429]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T06:50:53.980 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:53 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-01T06:50:53.980 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:53 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:54.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:53 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-01T06:50:54.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:53 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:54.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:53 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-01T06:50:54.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:53 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:55.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:54 smithi145 ceph-mon[47816]: Deploying daemon osd.1 on smithi145 2024-04-01T06:50:55.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:54 smithi145 ceph-mon[47816]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T06:50:55.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:54 smithi153 ceph-mon[48187]: Deploying daemon osd.1 on smithi145 2024-04-01T06:50:55.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:54 smithi153 ceph-mon[48187]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T06:50:55.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:54 smithi083 ceph-mon[43429]: Deploying daemon osd.1 on smithi145 2024-04-01T06:50:55.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:54 smithi083 ceph-mon[43429]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T06:50:56.890 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:56 smithi153 ceph-mon[48187]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T06:50:56.904 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:56 smithi145 ceph-mon[47816]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T06:50:57.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:56 smithi083 ceph-mon[43429]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T06:50:58.230 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:57 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:58.231 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:57 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:58.231 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:57 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:50:58.231 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:57 smithi145 ceph-mon[47816]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T06:50:58.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:57 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:58.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:57 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:58.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:57 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:50:58.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:57 smithi083 ceph-mon[43429]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T06:50:58.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:57 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:58.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:57 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:58.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:57 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:50:58.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:57 smithi153 ceph-mon[48187]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T06:50:59.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:58 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:59.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:58 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:59.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:58 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:59.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:58 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:50:59.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:50:58 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:59.120 INFO:teuthology.orchestra.run.smithi145.stdout:Created osd(s) 1 on host 'smithi145' 2024-04-01T06:50:59.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:50:59.120+0000 7fb1a6ffd700 1 -- 172.21.15.145:0/1664670909 <== mgr.14152 v2:172.21.15.83:6800/3375372052 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fb1b402cdc0 con 0x7fb1a00a1110 2024-04-01T06:50:59.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:50:59.123+0000 7fb1bbe4c700 1 -- 172.21.15.145:0/1664670909 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fb1a00a1110 msgr2=0x7fb1a00a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:50:59.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:50:59.123+0000 7fb1bbe4c700 1 --2- 172.21.15.145:0/1664670909 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fb1a00a1110 0x7fb1a00a35d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb1b000b580 tx=0x7fb1b001a040 comp rx=0 tx=0).stop 2024-04-01T06:50:59.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:50:59.123+0000 7fb1bbe4c700 1 -- 172.21.15.145:0/1664670909 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb1b40ffcf0 msgr2=0x7fb1b4194ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:50:59.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:50:59.123+0000 7fb1bbe4c700 1 --2- 172.21.15.145:0/1664670909 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb1b40ffcf0 0x7fb1b4194ac0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8010b50 tx=0x7fb1a8010f10 comp rx=0 tx=0).stop 2024-04-01T06:50:59.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:50:59.123+0000 7fb1bbe4c700 1 -- 172.21.15.145:0/1664670909 shutdown_connections 2024-04-01T06:50:59.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:50:59.123+0000 7fb1bbe4c700 1 --2- 172.21.15.145:0/1664670909 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fb1a00a1110 0x7fb1a00a35d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:50:59.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:50:59.123+0000 7fb1bbe4c700 1 --2- 172.21.15.145:0/1664670909 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb1b4101890 0x7fb1b419c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:50:59.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:50:59.123+0000 7fb1bbe4c700 1 --2- 172.21.15.145:0/1664670909 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb1b40ffcf0 0x7fb1b4194ac0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:50:59.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:50:59.123+0000 7fb1bbe4c700 1 --2- 172.21.15.145:0/1664670909 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb1b4100ef0 0x7fb1b4195000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:50:59.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:50:59.123+0000 7fb1bbe4c700 1 -- 172.21.15.145:0/1664670909 >> 172.21.15.145:0/1664670909 conn(0x7fb1b40fb2b0 msgr2=0x7fb1b41041f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:50:59.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:50:59.123+0000 7fb1bbe4c700 1 -- 172.21.15.145:0/1664670909 shutdown_connections 2024-04-01T06:50:59.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:50:59.123+0000 7fb1bbe4c700 1 -- 172.21.15.145:0/1664670909 wait complete. 2024-04-01T06:50:59.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:58 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:59.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:58 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:59.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:58 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:59.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:58 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:50:59.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:50:58 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:59.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:58 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:59.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:58 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:59.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:58 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:50:59.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:58 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:50:59.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:50:58 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:50:59.519 DEBUG:teuthology.orchestra.run.smithi145:osd.1> sudo journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@osd.1.service 2024-04-01T06:50:59.521 INFO:tasks.cephadm:Deploying osd.2 on smithi153 with /dev/vg_nvme/lv_4... 2024-04-01T06:50:59.521 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-01T06:50:59.553 INFO:journalctl@ceph.osd.1.smithi145.stdout:-- Logs begin at Mon 2024-04-01 06:34:41 UTC. -- 2024-04-01T06:50:59.749 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T06:51:00.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:00 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:00.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:00 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:51:00.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:00 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:00.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:00 smithi145 ceph-mon[47816]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T06:51:00.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:00 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:00.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:00 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:51:00.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:00 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:00.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:00 smithi153 ceph-mon[48187]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T06:51:00.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:00 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:00.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:00 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:51:00.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:00 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:00.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:00 smithi083 ceph-mon[43429]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T06:51:01.038 INFO:teuthology.orchestra.run.smithi153.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-01T06:51:01.038 INFO:teuthology.orchestra.run.smithi153.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-01T06:51:01.038 INFO:teuthology.orchestra.run.smithi153.stderr: stderr: 10+0 records in 2024-04-01T06:51:01.038 INFO:teuthology.orchestra.run.smithi153.stderr:10+0 records out 2024-04-01T06:51:01.038 INFO:teuthology.orchestra.run.smithi153.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0119111 s, 880 MB/s 2024-04-01T06:51:01.038 INFO:teuthology.orchestra.run.smithi153.stderr:--> Zapping successful for: 2024-04-01T06:51:01.252 INFO:journalctl@ceph.osd.1.smithi145.stdout:Apr 01 06:51:00 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-1[52825]: 2024-04-01T06:51:00.947+0000 7f35c133a640 -1 osd.1 0 log_to_monitors true 2024-04-01T06:51:01.380 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi153:vg_nvme/lv_4 2024-04-01T06:51:01.597 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T06:51:01.890 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:01 smithi153 ceph-mon[48187]: from='osd.1 [v2:172.21.15.145:6800/515889759,v1:172.21.15.145:6801/515889759]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-01T06:51:01.890 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:01 smithi153 ceph-mon[48187]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-01T06:51:02.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:01 smithi145 ceph-mon[47816]: from='osd.1 [v2:172.21.15.145:6800/515889759,v1:172.21.15.145:6801/515889759]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-01T06:51:02.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:01 smithi145 ceph-mon[47816]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-01T06:51:02.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:01 smithi083 ceph-mon[43429]: from='osd.1 [v2:172.21.15.145:6800/515889759,v1:172.21.15.145:6801/515889759]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-01T06:51:02.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:01 smithi083 ceph-mon[43429]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-01T06:51:02.626 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:02.625+0000 7fe25f517700 1 -- 172.21.15.153:0/2395664337 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2580ffce0 msgr2=0x7fe258100100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:51:02.626 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:02.625+0000 7fe25f517700 1 --2- 172.21.15.153:0/2395664337 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2580ffce0 0x7fe258100100 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe24c009990 tx=0x7fe24c009ca0 comp rx=0 tx=0).stop 2024-04-01T06:51:02.626 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:02.625+0000 7fe25f517700 1 -- 172.21.15.153:0/2395664337 shutdown_connections 2024-04-01T06:51:02.626 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:02.625+0000 7fe25f517700 1 --2- 172.21.15.153:0/2395664337 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe258101880 0x7fe258108130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:51:02.626 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:02.625+0000 7fe25f517700 1 --2- 172.21.15.153:0/2395664337 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2580ffce0 0x7fe258100100 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:51:02.626 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:02.625+0000 7fe25f517700 1 --2- 172.21.15.153:0/2395664337 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe258100ee0 0x7fe258101340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:51:02.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:02.625+0000 7fe25f517700 1 -- 172.21.15.153:0/2395664337 >> 172.21.15.153:0/2395664337 conn(0x7fe2580fb2a0 msgr2=0x7fe2580fd6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:51:02.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:02.625+0000 7fe25f517700 1 -- 172.21.15.153:0/2395664337 shutdown_connections 2024-04-01T06:51:02.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:02.625+0000 7fe25f517700 1 -- 172.21.15.153:0/2395664337 wait complete. 2024-04-01T06:51:02.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:02.626+0000 7fe25f517700 1 Processor -- start 2024-04-01T06:51:02.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:02.626+0000 7fe25f517700 1 -- start start 2024-04-01T06:51:02.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:02.626+0000 7fe25f517700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2580ffce0 0x7fe258196d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:51:02.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:02.626+0000 7fe25f517700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe258100ee0 0x7fe258197270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:51:02.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:02.626+0000 7fe25f517700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe258101880 0x7fe25819e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:51:02.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:02.626+0000 7fe25f517700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe25819e830 con 0x7fe258101880 2024-04-01T06:51:02.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:02.626+0000 7fe25f517700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe25819e970 con 0x7fe258100ee0 2024-04-01T06:51:02.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:02.626+0000 7fe25f517700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe25819eb30 con 0x7fe2580ffce0 2024-04-01T06:51:02.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:02.626+0000 7fe25d2b3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2580ffce0 0x7fe258196d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:51:02.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:02.626+0000 7fe25d2b3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2580ffce0 0x7fe258196d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58396/0 (socket says 172.21.15.153:58396) 2024-04-01T06:51:02.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:02.626+0000 7fe25d2b3700 1 -- 172.21.15.153:0/1924050491 learned_addr learned my addr 172.21.15.153:0/1924050491 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-04-01T06:51:02.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:02.626+0000 7fe25cab2700 1 --2- 172.21.15.153:0/1924050491 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe258100ee0 0x7fe258197270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:51:02.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:02.626+0000 7fe25dab4700 1 --2- 172.21.15.153:0/1924050491 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe258101880 0x7fe25819e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:51:02.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:02.626+0000 7fe25d2b3700 1 -- 172.21.15.153:0/1924050491 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe258100ee0 msgr2=0x7fe258197270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:51:02.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:02.626+0000 7fe25d2b3700 1 --2- 172.21.15.153:0/1924050491 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe258100ee0 0x7fe258197270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:51:02.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:02.627+0000 7fe25d2b3700 1 -- 172.21.15.153:0/1924050491 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe258101880 msgr2=0x7fe25819e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:51:02.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:02.627+0000 7fe25d2b3700 1 --2- 172.21.15.153:0/1924050491 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe258101880 0x7fe25819e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:51:02.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:02.627+0000 7fe25d2b3700 1 -- 172.21.15.153:0/1924050491 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe24c0095f0 con 0x7fe2580ffce0 2024-04-01T06:51:02.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:02.627+0000 7fe25d2b3700 1 --2- 172.21.15.153:0/1924050491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2580ffce0 0x7fe258196d30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe24c0038c0 tx=0x7fe24c00f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:51:02.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:02.627+0000 7fe24a7fc700 1 -- 172.21.15.153:0/1924050491 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24c01d070 con 0x7fe2580ffce0 2024-04-01T06:51:02.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:02.627+0000 7fe24a7fc700 1 -- 172.21.15.153:0/1924050491 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe24c003960 con 0x7fe2580ffce0 2024-04-01T06:51:02.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:02.627+0000 7fe24a7fc700 1 -- 172.21.15.153:0/1924050491 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24c0054f0 con 0x7fe2580ffce0 2024-04-01T06:51:02.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:02.627+0000 7fe25f517700 1 -- 172.21.15.153:0/1924050491 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe25819edb0 con 0x7fe2580ffce0 2024-04-01T06:51:02.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:02.627+0000 7fe25f517700 1 -- 172.21.15.153:0/1924050491 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe25819f1c0 con 0x7fe2580ffce0 2024-04-01T06:51:02.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:02.628+0000 7fe25f517700 1 -- 172.21.15.153:0/1924050491 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe25804ea80 con 0x7fe2580ffce0 2024-04-01T06:51:02.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:02.630+0000 7fe24a7fc700 1 -- 172.21.15.153:0/1924050491 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 15) v1 ==== 135809+0+0 (secure 0 0 0) 0x7fe24c00fad0 con 0x7fe2580ffce0 2024-04-01T06:51:02.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:02.630+0000 7fe24a7fc700 1 --2- 172.21.15.153:0/1924050491 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fe2440a1110 0x7fe2440a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:51:02.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:02.630+0000 7fe24a7fc700 1 -- 172.21.15.153:0/1924050491 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 1903+0+0 (secure 0 0 0) 0x7fe24c0cc280 con 0x7fe2580ffce0 2024-04-01T06:51:02.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:02.630+0000 7fe25cab2700 1 --2- 172.21.15.153:0/1924050491 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fe2440a1110 0x7fe2440a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:51:02.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:02.631+0000 7fe25cab2700 1 --2- 172.21.15.153:0/1924050491 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fe2440a1110 0x7fe2440a35d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe254007c60 tx=0x7fe2540073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:51:02.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:02.634+0000 7fe24a7fc700 1 -- 172.21.15.153:0/1924050491 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7fe24c097490 con 0x7fe2580ffce0 2024-04-01T06:51:02.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:02.832+0000 7fe25f517700 1 -- 172.21.15.153:0/1924050491 --> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fe258069b20 con 0x7fe2440a1110 2024-04-01T06:51:02.890 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:02 smithi153 ceph-mon[48187]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-01T06:51:02.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:02 smithi153 ceph-mon[48187]: osdmap e11: 2 total, 1 up, 2 in 2024-04-01T06:51:02.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:02 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-01T06:51:02.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:02 smithi153 ceph-mon[48187]: from='osd.1 [v2:172.21.15.145:6800/515889759,v1:172.21.15.145:6801/515889759]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-04-01T06:51:02.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:02 smithi153 ceph-mon[48187]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-04-01T06:51:02.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:02 smithi153 ceph-mon[48187]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T06:51:02.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:02 smithi153 ceph-mon[48187]: Detected new or changed devices on smithi145 2024-04-01T06:51:02.892 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:02 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:02.892 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:02 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:02.892 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:02 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:51:02.892 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:02 smithi153 ceph-mon[48187]: Adjusting osd_memory_target on smithi145 to 17113M 2024-04-01T06:51:02.892 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:02 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:02.892 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:02 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:51:02.893 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:02 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:51:02.893 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:02 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:03.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:02 smithi145 ceph-mon[47816]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-01T06:51:03.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:02 smithi145 ceph-mon[47816]: osdmap e11: 2 total, 1 up, 2 in 2024-04-01T06:51:03.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:02 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-01T06:51:03.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:02 smithi145 ceph-mon[47816]: from='osd.1 [v2:172.21.15.145:6800/515889759,v1:172.21.15.145:6801/515889759]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-04-01T06:51:03.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:02 smithi145 ceph-mon[47816]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-04-01T06:51:03.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:02 smithi145 ceph-mon[47816]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T06:51:03.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:02 smithi145 ceph-mon[47816]: Detected new or changed devices on smithi145 2024-04-01T06:51:03.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:02 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:03.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:02 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:03.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:02 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:51:03.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:02 smithi145 ceph-mon[47816]: Adjusting osd_memory_target on smithi145 to 17113M 2024-04-01T06:51:03.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:02 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:03.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:02 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:51:03.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:02 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:51:03.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:02 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:03.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:02 smithi083 ceph-mon[43429]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-01T06:51:03.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:02 smithi083 ceph-mon[43429]: osdmap e11: 2 total, 1 up, 2 in 2024-04-01T06:51:03.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:02 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-01T06:51:03.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:02 smithi083 ceph-mon[43429]: from='osd.1 [v2:172.21.15.145:6800/515889759,v1:172.21.15.145:6801/515889759]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-04-01T06:51:03.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:02 smithi083 ceph-mon[43429]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-04-01T06:51:03.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:02 smithi083 ceph-mon[43429]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T06:51:03.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:02 smithi083 ceph-mon[43429]: Detected new or changed devices on smithi145 2024-04-01T06:51:03.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:02 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:03.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:02 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:03.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:02 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:51:03.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:02 smithi083 ceph-mon[43429]: Adjusting osd_memory_target on smithi145 to 17113M 2024-04-01T06:51:03.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:02 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:03.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:02 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:51:03.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:02 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:51:03.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:02 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:03.502 INFO:journalctl@ceph.osd.1.smithi145.stdout:Apr 01 06:51:03 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-1[52825]: 2024-04-01T06:51:03.112+0000 7f35b699e700 -1 osd.1 0 waiting for initial osdmap 2024-04-01T06:51:03.503 INFO:journalctl@ceph.osd.1.smithi145.stdout:Apr 01 06:51:03 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-1[52825]: 2024-04-01T06:51:03.118+0000 7f35ae78b700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T06:51:03.861 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:03 smithi153 ceph-mon[48187]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-04-01T06:51:03.861 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:03 smithi153 ceph-mon[48187]: osdmap e12: 2 total, 1 up, 2 in 2024-04-01T06:51:03.861 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:03 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-01T06:51:03.861 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:03 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-01T06:51:03.861 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:03 smithi153 ceph-mon[48187]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:51:03.861 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:03 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T06:51:03.861 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:03 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T06:51:03.861 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:03 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:51:03.861 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:03 smithi153 ceph-mon[48187]: from='osd.1 ' entity='osd.1' 2024-04-01T06:51:04.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:03 smithi145 ceph-mon[47816]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-04-01T06:51:04.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:03 smithi145 ceph-mon[47816]: osdmap e12: 2 total, 1 up, 2 in 2024-04-01T06:51:04.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:03 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-01T06:51:04.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:03 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-01T06:51:04.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:03 smithi145 ceph-mon[47816]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:51:04.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:03 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T06:51:04.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:03 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T06:51:04.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:03 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:51:04.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:03 smithi145 ceph-mon[47816]: from='osd.1 ' entity='osd.1' 2024-04-01T06:51:04.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:03 smithi083 ceph-mon[43429]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-04-01T06:51:04.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:03 smithi083 ceph-mon[43429]: osdmap e12: 2 total, 1 up, 2 in 2024-04-01T06:51:04.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:03 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-01T06:51:04.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:03 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-01T06:51:04.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:03 smithi083 ceph-mon[43429]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:51:04.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:03 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T06:51:04.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:03 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T06:51:04.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:03 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:51:04.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:03 smithi083 ceph-mon[43429]: from='osd.1 ' entity='osd.1' 2024-04-01T06:51:05.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:04 smithi145 ceph-mon[47816]: purged_snaps scrub starts 2024-04-01T06:51:05.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:04 smithi145 ceph-mon[47816]: purged_snaps scrub ok 2024-04-01T06:51:05.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:04 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-01T06:51:05.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:04 smithi145 ceph-mon[47816]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T06:51:05.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:04 smithi145 ceph-mon[47816]: osd.1 [v2:172.21.15.145:6800/515889759,v1:172.21.15.145:6801/515889759] boot 2024-04-01T06:51:05.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:04 smithi145 ceph-mon[47816]: osdmap e13: 2 total, 2 up, 2 in 2024-04-01T06:51:05.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:04 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-01T06:51:05.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:04 smithi083 ceph-mon[43429]: purged_snaps scrub starts 2024-04-01T06:51:05.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:04 smithi083 ceph-mon[43429]: purged_snaps scrub ok 2024-04-01T06:51:05.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:04 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-01T06:51:05.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:04 smithi083 ceph-mon[43429]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T06:51:05.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:04 smithi083 ceph-mon[43429]: osd.1 [v2:172.21.15.145:6800/515889759,v1:172.21.15.145:6801/515889759] boot 2024-04-01T06:51:05.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:04 smithi083 ceph-mon[43429]: osdmap e13: 2 total, 2 up, 2 in 2024-04-01T06:51:05.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:04 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-01T06:51:05.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:04 smithi153 ceph-mon[48187]: purged_snaps scrub starts 2024-04-01T06:51:05.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:04 smithi153 ceph-mon[48187]: purged_snaps scrub ok 2024-04-01T06:51:05.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:04 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-01T06:51:05.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:04 smithi153 ceph-mon[48187]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-04-01T06:51:05.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:04 smithi153 ceph-mon[48187]: osd.1 [v2:172.21.15.145:6800/515889759,v1:172.21.15.145:6801/515889759] boot 2024-04-01T06:51:05.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:04 smithi153 ceph-mon[48187]: osdmap e13: 2 total, 2 up, 2 in 2024-04-01T06:51:05.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:04 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-01T06:51:06.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:05 smithi145 ceph-mon[47816]: from='client.? 172.21.15.153:0/2561911631' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d04c27f3-4972-4061-8bfb-5060645e3883"}]: dispatch 2024-04-01T06:51:06.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:05 smithi145 ceph-mon[47816]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d04c27f3-4972-4061-8bfb-5060645e3883"}]: dispatch 2024-04-01T06:51:06.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:05 smithi145 ceph-mon[47816]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d04c27f3-4972-4061-8bfb-5060645e3883"}]': finished 2024-04-01T06:51:06.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:05 smithi145 ceph-mon[47816]: osdmap e14: 3 total, 2 up, 3 in 2024-04-01T06:51:06.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:05 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-01T06:51:06.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:05 smithi145 ceph-mon[47816]: from='client.? 172.21.15.153:0/691979094' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T06:51:06.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:05 smithi083 ceph-mon[43429]: from='client.? 172.21.15.153:0/2561911631' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d04c27f3-4972-4061-8bfb-5060645e3883"}]: dispatch 2024-04-01T06:51:06.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:05 smithi083 ceph-mon[43429]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d04c27f3-4972-4061-8bfb-5060645e3883"}]: dispatch 2024-04-01T06:51:06.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:05 smithi083 ceph-mon[43429]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d04c27f3-4972-4061-8bfb-5060645e3883"}]': finished 2024-04-01T06:51:06.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:05 smithi083 ceph-mon[43429]: osdmap e14: 3 total, 2 up, 3 in 2024-04-01T06:51:06.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:05 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-01T06:51:06.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:05 smithi083 ceph-mon[43429]: from='client.? 172.21.15.153:0/691979094' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T06:51:06.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:05 smithi153 ceph-mon[48187]: from='client.? 172.21.15.153:0/2561911631' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d04c27f3-4972-4061-8bfb-5060645e3883"}]: dispatch 2024-04-01T06:51:06.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:05 smithi153 ceph-mon[48187]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d04c27f3-4972-4061-8bfb-5060645e3883"}]: dispatch 2024-04-01T06:51:06.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:05 smithi153 ceph-mon[48187]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d04c27f3-4972-4061-8bfb-5060645e3883"}]': finished 2024-04-01T06:51:06.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:05 smithi153 ceph-mon[48187]: osdmap e14: 3 total, 2 up, 3 in 2024-04-01T06:51:06.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:05 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-01T06:51:06.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:05 smithi153 ceph-mon[48187]: from='client.? 172.21.15.153:0/691979094' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T06:51:07.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:06 smithi145 ceph-mon[47816]: pgmap v51: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-01T06:51:07.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:06 smithi145 ceph-mon[47816]: osdmap e15: 3 total, 2 up, 3 in 2024-04-01T06:51:07.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:06 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-01T06:51:07.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:06 smithi083 ceph-mon[43429]: pgmap v51: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-01T06:51:07.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:06 smithi083 ceph-mon[43429]: osdmap e15: 3 total, 2 up, 3 in 2024-04-01T06:51:07.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:06 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-01T06:51:07.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:06 smithi153 ceph-mon[48187]: pgmap v51: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-01T06:51:07.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:06 smithi153 ceph-mon[48187]: osdmap e15: 3 total, 2 up, 3 in 2024-04-01T06:51:07.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:06 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-01T06:51:09.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:08 smithi145 ceph-mon[47816]: pgmap v52: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-01T06:51:09.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:08 smithi083 ceph-mon[43429]: pgmap v52: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-01T06:51:09.025 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:08 smithi153 ceph-mon[48187]: pgmap v52: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-01T06:51:10.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:10 smithi153 ceph-mon[48187]: pgmap v53: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-01T06:51:10.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:10 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-01T06:51:10.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:10 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:51:11.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:10 smithi145 ceph-mon[47816]: pgmap v53: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-01T06:51:11.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:10 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-01T06:51:11.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:10 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:51:11.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:10 smithi083 ceph-mon[43429]: pgmap v53: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-01T06:51:11.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:10 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-01T06:51:11.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:10 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:51:11.890 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:11 smithi153 ceph-mon[48187]: Deploying daemon osd.2 on smithi153 2024-04-01T06:51:12.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:11 smithi145 ceph-mon[47816]: Deploying daemon osd.2 on smithi153 2024-04-01T06:51:12.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:11 smithi083 ceph-mon[43429]: Deploying daemon osd.2 on smithi153 2024-04-01T06:51:13.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:12 smithi145 ceph-mon[47816]: pgmap v54: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-01T06:51:13.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:12 smithi083 ceph-mon[43429]: pgmap v54: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-01T06:51:13.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:12 smithi153 ceph-mon[48187]: pgmap v54: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-01T06:51:15.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:14 smithi145 ceph-mon[47816]: pgmap v55: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-01T06:51:15.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:14 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:15.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:14 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:15.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:14 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:51:15.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:14 smithi083 ceph-mon[43429]: pgmap v55: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-01T06:51:15.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:14 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:15.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:14 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:15.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:14 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:51:15.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:14 smithi153 ceph-mon[48187]: pgmap v55: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-01T06:51:15.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:14 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:15.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:14 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:15.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:14 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:51:16.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:16.332+0000 7fe24a7fc700 1 -- 172.21.15.153:0/1924050491 <== mgr.14152 v2:172.21.15.83:6800/3375372052 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fe258069b20 con 0x7fe2440a1110 2024-04-01T06:51:16.333 INFO:teuthology.orchestra.run.smithi153.stdout:Created osd(s) 2 on host 'smithi153' 2024-04-01T06:51:16.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:16.335+0000 7fe25f517700 1 -- 172.21.15.153:0/1924050491 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fe2440a1110 msgr2=0x7fe2440a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:51:16.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:16.335+0000 7fe25f517700 1 --2- 172.21.15.153:0/1924050491 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fe2440a1110 0x7fe2440a35d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe254007c60 tx=0x7fe2540073d0 comp rx=0 tx=0).stop 2024-04-01T06:51:16.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:16.335+0000 7fe25f517700 1 -- 172.21.15.153:0/1924050491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2580ffce0 msgr2=0x7fe258196d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:51:16.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:16.335+0000 7fe25f517700 1 --2- 172.21.15.153:0/1924050491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2580ffce0 0x7fe258196d30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe24c0038c0 tx=0x7fe24c00f690 comp rx=0 tx=0).stop 2024-04-01T06:51:16.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:16.335+0000 7fe25f517700 1 -- 172.21.15.153:0/1924050491 shutdown_connections 2024-04-01T06:51:16.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:16.335+0000 7fe25f517700 1 --2- 172.21.15.153:0/1924050491 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe258101880 0x7fe25819e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:51:16.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:16.335+0000 7fe25f517700 1 --2- 172.21.15.153:0/1924050491 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fe2440a1110 0x7fe2440a35d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:51:16.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:16.335+0000 7fe25f517700 1 --2- 172.21.15.153:0/1924050491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2580ffce0 0x7fe258196d30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:51:16.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:16.335+0000 7fe25f517700 1 --2- 172.21.15.153:0/1924050491 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe258100ee0 0x7fe258197270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:51:16.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:16.335+0000 7fe25f517700 1 -- 172.21.15.153:0/1924050491 >> 172.21.15.153:0/1924050491 conn(0x7fe2580fb2a0 msgr2=0x7fe258069410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:51:16.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:16.335+0000 7fe25f517700 1 -- 172.21.15.153:0/1924050491 shutdown_connections 2024-04-01T06:51:16.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:16.335+0000 7fe25f517700 1 -- 172.21.15.153:0/1924050491 wait complete. 2024-04-01T06:51:16.492 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:16 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:16.492 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:16 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:16.492 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:16 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:51:16.492 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:16 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:51:16.492 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:16 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:16.493 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:16 smithi153 ceph-mon[48187]: pgmap v56: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-01T06:51:16.493 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:16 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:16.493 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:16 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:16.493 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:16 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:51:16.711 DEBUG:teuthology.orchestra.run.smithi153:osd.2> sudo journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@osd.2.service 2024-04-01T06:51:16.713 INFO:tasks.cephadm:Deploying osd.3 on smithi083 with /dev/vg_nvme/lv_3... 2024-04-01T06:51:16.713 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-01T06:51:16.743 INFO:journalctl@ceph.osd.2.smithi153.stdout:-- Logs begin at Mon 2024-04-01 06:35:09 UTC. -- 2024-04-01T06:51:16.747 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:16 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:16.747 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:16 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:16.747 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:16 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:51:16.747 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:16 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:51:16.747 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:16 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:16.747 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:16 smithi083 ceph-mon[43429]: pgmap v56: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-01T06:51:16.747 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:16 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:16.747 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:16 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:16.748 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:16 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:51:16.752 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:16 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:16.752 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:16 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:16.752 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:16 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:51:16.752 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:16 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:51:16.753 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:16 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:16.753 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:16 smithi145 ceph-mon[47816]: pgmap v56: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-01T06:51:16.753 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:16 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:16.753 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:16 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:16.753 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:16 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:51:16.946 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:51:18.221 INFO:teuthology.orchestra.run.smithi083.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-01T06:51:18.221 INFO:teuthology.orchestra.run.smithi083.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-01T06:51:18.221 INFO:teuthology.orchestra.run.smithi083.stderr: stderr: 10+0 records in 2024-04-01T06:51:18.222 INFO:teuthology.orchestra.run.smithi083.stderr:10+0 records out 2024-04-01T06:51:18.222 INFO:teuthology.orchestra.run.smithi083.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0113298 s, 926 MB/s 2024-04-01T06:51:18.222 INFO:teuthology.orchestra.run.smithi083.stderr:--> Zapping successful for: 2024-04-01T06:51:18.390 INFO:journalctl@ceph.osd.2.smithi153.stdout:Apr 01 06:51:18 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-2[53974]: 2024-04-01T06:51:18.046+0000 7f53adee5640 -1 osd.2 0 log_to_monitors true 2024-04-01T06:51:18.596 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi083:vg_nvme/lv_3 2024-04-01T06:51:18.863 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:51:18.984 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:18 smithi083 ceph-mon[43429]: pgmap v57: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-01T06:51:18.984 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:18 smithi083 ceph-mon[43429]: from='osd.2 [v2:172.21.15.153:6800/3318516728,v1:172.21.15.153:6801/3318516728]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-01T06:51:18.984 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:18 smithi083 ceph-mon[43429]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-01T06:51:19.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:18 smithi145 ceph-mon[47816]: pgmap v57: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-01T06:51:19.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:18 smithi145 ceph-mon[47816]: from='osd.2 [v2:172.21.15.153:6800/3318516728,v1:172.21.15.153:6801/3318516728]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-01T06:51:19.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:18 smithi145 ceph-mon[47816]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-01T06:51:19.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:18 smithi153 ceph-mon[48187]: pgmap v57: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-01T06:51:19.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:18 smithi153 ceph-mon[48187]: from='osd.2 [v2:172.21.15.153:6800/3318516728,v1:172.21.15.153:6801/3318516728]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-01T06:51:19.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:18 smithi153 ceph-mon[48187]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-01T06:51:19.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:51:19.864+0000 7f8ac7207700 1 -- 172.21.15.83:0/1774487664 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ac00fee50 msgr2=0x7f8ac00ff2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:51:19.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:51:19.864+0000 7f8ac7207700 1 --2- 172.21.15.83:0/1774487664 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ac00fee50 0x7f8ac00ff2b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8aac009990 tx=0x7f8aac009ca0 comp rx=0 tx=0).stop 2024-04-01T06:51:19.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:51:19.864+0000 7f8ac7207700 1 -- 172.21.15.83:0/1774487664 shutdown_connections 2024-04-01T06:51:19.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:51:19.864+0000 7f8ac7207700 1 --2- 172.21.15.83:0/1774487664 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8ac00ff7f0 0x7f8ac01093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:51:19.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:51:19.864+0000 7f8ac7207700 1 --2- 172.21.15.83:0/1774487664 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ac01023d0 0x7f8ac01027f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:51:19.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:51:19.864+0000 7f8ac7207700 1 --2- 172.21.15.83:0/1774487664 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ac00fee50 0x7f8ac00ff2b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:51:19.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:51:19.864+0000 7f8ac7207700 1 -- 172.21.15.83:0/1774487664 >> 172.21.15.83:0/1774487664 conn(0x7f8ac00faa10 msgr2=0x7f8ac00fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:51:19.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:51:19.864+0000 7f8ac7207700 1 -- 172.21.15.83:0/1774487664 shutdown_connections 2024-04-01T06:51:19.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:51:19.864+0000 7f8ac7207700 1 -- 172.21.15.83:0/1774487664 wait complete. 2024-04-01T06:51:19.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:51:19.865+0000 7f8ac7207700 1 Processor -- start 2024-04-01T06:51:19.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:51:19.865+0000 7f8ac7207700 1 -- start start 2024-04-01T06:51:19.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:51:19.865+0000 7f8ac7207700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ac00fee50 0x7f8ac0196d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:51:19.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:51:19.865+0000 7f8ac7207700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8ac00ff7f0 0x7f8ac0197270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:51:19.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:51:19.865+0000 7f8ac7207700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ac01023d0 0x7f8ac019e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:51:19.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:51:19.865+0000 7f8ac7207700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac019e830 con 0x7f8ac01023d0 2024-04-01T06:51:19.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:51:19.865+0000 7f8ac7207700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac019e970 con 0x7f8ac00ff7f0 2024-04-01T06:51:19.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:51:19.865+0000 7f8ac7207700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac019eb30 con 0x7f8ac00fee50 2024-04-01T06:51:19.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:51:19.865+0000 7f8ac57a4700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ac01023d0 0x7f8ac019e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:51:19.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:51:19.865+0000 7f8ac57a4700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ac01023d0 0x7f8ac019e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:35184/0 (socket says 172.21.15.83:35184) 2024-04-01T06:51:19.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:51:19.865+0000 7f8ac57a4700 1 -- 172.21.15.83:0/1141985944 learned_addr learned my addr 172.21.15.83:0/1141985944 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:51:19.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:51:19.865+0000 7f8abffff700 1 --2- 172.21.15.83:0/1141985944 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8ac00ff7f0 0x7f8ac0197270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:51:19.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:51:19.865+0000 7f8ac4fa3700 1 --2- 172.21.15.83:0/1141985944 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ac00fee50 0x7f8ac0196d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:51:19.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:51:19.865+0000 7f8ac57a4700 1 -- 172.21.15.83:0/1141985944 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ac00fee50 msgr2=0x7f8ac0196d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:51:19.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:51:19.865+0000 7f8ac57a4700 1 --2- 172.21.15.83:0/1141985944 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ac00fee50 0x7f8ac0196d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:51:19.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:51:19.865+0000 7f8ac57a4700 1 -- 172.21.15.83:0/1141985944 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8ac00ff7f0 msgr2=0x7f8ac0197270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:51:19.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:51:19.865+0000 7f8ac57a4700 1 --2- 172.21.15.83:0/1141985944 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8ac00ff7f0 0x7f8ac0197270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:51:19.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:51:19.865+0000 7f8ac57a4700 1 -- 172.21.15.83:0/1141985944 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aac0095f0 con 0x7f8ac01023d0 2024-04-01T06:51:19.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:51:19.866+0000 7f8ac57a4700 1 --2- 172.21.15.83:0/1141985944 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ac01023d0 0x7f8ac019e260 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8007d70 tx=0x7f8ab800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:51:19.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:51:19.866+0000 7f8abdffb700 1 -- 172.21.15.83:0/1141985944 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab800ac90 con 0x7f8ac01023d0 2024-04-01T06:51:19.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:51:19.866+0000 7f8ac7207700 1 -- 172.21.15.83:0/1141985944 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ac019ee10 con 0x7f8ac01023d0 2024-04-01T06:51:19.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:51:19.866+0000 7f8abdffb700 1 -- 172.21.15.83:0/1141985944 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8ab800adf0 con 0x7f8ac01023d0 2024-04-01T06:51:19.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:51:19.866+0000 7f8abdffb700 1 -- 172.21.15.83:0/1141985944 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab80115e0 con 0x7f8ac01023d0 2024-04-01T06:51:19.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:51:19.866+0000 7f8ac7207700 1 -- 172.21.15.83:0/1141985944 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ac019f220 con 0x7f8ac01023d0 2024-04-01T06:51:19.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:51:19.867+0000 7f8ac7207700 1 -- 172.21.15.83:0/1141985944 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ac0108380 con 0x7f8ac01023d0 2024-04-01T06:51:19.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:51:19.868+0000 7f8abdffb700 1 -- 172.21.15.83:0/1141985944 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 15) v1 ==== 135809+0+0 (secure 0 0 0) 0x7f8ab8012420 con 0x7f8ac01023d0 2024-04-01T06:51:19.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:51:19.868+0000 7f8abdffb700 1 --2- 172.21.15.83:0/1141985944 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f8ab00a1090 0x7f8ab00a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:51:19.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:51:19.868+0000 7f8ac4fa3700 1 --2- 172.21.15.83:0/1141985944 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f8ab00a1090 0x7f8ab00a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:51:19.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:51:19.869+0000 7f8abdffb700 1 -- 172.21.15.83:0/1141985944 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 2571+0+0 (secure 0 0 0) 0x7f8ab80cb3b0 con 0x7f8ac01023d0 2024-04-01T06:51:19.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:51:19.869+0000 7f8ac4fa3700 1 --2- 172.21.15.83:0/1141985944 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f8ab00a1090 0x7f8ab00a3550 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8ac01981c0 tx=0x7f8ab4009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:51:19.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:51:19.873+0000 7f8abdffb700 1 -- 172.21.15.83:0/1141985944 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f8ab80961f0 con 0x7f8ac01023d0 2024-04-01T06:51:20.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:19 smithi145 ceph-mon[47816]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-01T06:51:20.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:19 smithi145 ceph-mon[47816]: osdmap e16: 3 total, 2 up, 3 in 2024-04-01T06:51:20.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:19 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-01T06:51:20.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:19 smithi145 ceph-mon[47816]: from='osd.2 [v2:172.21.15.153:6800/3318516728,v1:172.21.15.153:6801/3318516728]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-04-01T06:51:20.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:19 smithi145 ceph-mon[47816]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-04-01T06:51:20.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:19 smithi145 ceph-mon[47816]: Detected new or changed devices on smithi153 2024-04-01T06:51:20.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:19 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:20.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:19 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:20.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:19 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:51:20.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:19 smithi145 ceph-mon[47816]: Adjusting osd_memory_target on smithi153 to 17114M 2024-04-01T06:51:20.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:19 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:20.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:19 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:51:20.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:19 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:51:20.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:19 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:20.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:19 smithi083 ceph-mon[43429]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-01T06:51:20.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:19 smithi083 ceph-mon[43429]: osdmap e16: 3 total, 2 up, 3 in 2024-04-01T06:51:20.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:19 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-01T06:51:20.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:19 smithi083 ceph-mon[43429]: from='osd.2 [v2:172.21.15.153:6800/3318516728,v1:172.21.15.153:6801/3318516728]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-04-01T06:51:20.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:19 smithi083 ceph-mon[43429]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-04-01T06:51:20.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:19 smithi083 ceph-mon[43429]: Detected new or changed devices on smithi153 2024-04-01T06:51:20.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:19 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:20.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:19 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:20.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:19 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:51:20.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:19 smithi083 ceph-mon[43429]: Adjusting osd_memory_target on smithi153 to 17114M 2024-04-01T06:51:20.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:19 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:20.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:19 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:51:20.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:19 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:51:20.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:19 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:20.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:51:20.073+0000 7f8ac7207700 1 -- 172.21.15.83:0/1141985944 --> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f8ac002cd20 con 0x7f8ab00a1090 2024-04-01T06:51:20.140 INFO:journalctl@ceph.osd.2.smithi153.stdout:Apr 01 06:51:19 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-2[53974]: 2024-04-01T06:51:19.744+0000 7f53a3549700 -1 osd.2 0 waiting for initial osdmap 2024-04-01T06:51:20.140 INFO:journalctl@ceph.osd.2.smithi153.stdout:Apr 01 06:51:19 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-2[53974]: 2024-04-01T06:51:19.749+0000 7f539f33e700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T06:51:20.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:19 smithi153 ceph-mon[48187]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-01T06:51:20.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:19 smithi153 ceph-mon[48187]: osdmap e16: 3 total, 2 up, 3 in 2024-04-01T06:51:20.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:19 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-01T06:51:20.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:19 smithi153 ceph-mon[48187]: from='osd.2 [v2:172.21.15.153:6800/3318516728,v1:172.21.15.153:6801/3318516728]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-04-01T06:51:20.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:19 smithi153 ceph-mon[48187]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-04-01T06:51:20.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:19 smithi153 ceph-mon[48187]: Detected new or changed devices on smithi153 2024-04-01T06:51:20.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:19 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:20.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:19 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:20.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:19 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:51:20.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:19 smithi153 ceph-mon[48187]: Adjusting osd_memory_target on smithi153 to 17114M 2024-04-01T06:51:20.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:19 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:20.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:19 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:51:20.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:19 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:51:20.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:19 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:21.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:20 smithi145 ceph-mon[47816]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-01T06:51:21.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:20 smithi145 ceph-mon[47816]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-04-01T06:51:21.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:20 smithi145 ceph-mon[47816]: osdmap e17: 3 total, 2 up, 3 in 2024-04-01T06:51:21.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:20 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-01T06:51:21.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:20 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-01T06:51:21.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:20 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T06:51:21.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:20 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T06:51:21.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:20 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:51:21.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:20 smithi083 ceph-mon[43429]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-01T06:51:21.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:20 smithi083 ceph-mon[43429]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-04-01T06:51:21.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:20 smithi083 ceph-mon[43429]: osdmap e17: 3 total, 2 up, 3 in 2024-04-01T06:51:21.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:20 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-01T06:51:21.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:20 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-01T06:51:21.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:20 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T06:51:21.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:20 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T06:51:21.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:20 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:51:21.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:20 smithi153 ceph-mon[48187]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-01T06:51:21.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:20 smithi153 ceph-mon[48187]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-04-01T06:51:21.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:20 smithi153 ceph-mon[48187]: osdmap e17: 3 total, 2 up, 3 in 2024-04-01T06:51:21.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:20 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-01T06:51:21.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:20 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-01T06:51:21.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:20 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T06:51:21.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:20 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T06:51:21.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:20 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:51:22.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:21 smithi145 ceph-mon[47816]: purged_snaps scrub starts 2024-04-01T06:51:22.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:21 smithi145 ceph-mon[47816]: purged_snaps scrub ok 2024-04-01T06:51:22.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:21 smithi145 ceph-mon[47816]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:51:22.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:21 smithi145 ceph-mon[47816]: osd.2 [v2:172.21.15.153:6800/3318516728,v1:172.21.15.153:6801/3318516728] boot 2024-04-01T06:51:22.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:21 smithi145 ceph-mon[47816]: osdmap e18: 3 total, 3 up, 3 in 2024-04-01T06:51:22.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:21 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-01T06:51:22.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:21 smithi083 ceph-mon[43429]: purged_snaps scrub starts 2024-04-01T06:51:22.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:21 smithi083 ceph-mon[43429]: purged_snaps scrub ok 2024-04-01T06:51:22.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:21 smithi083 ceph-mon[43429]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:51:22.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:21 smithi083 ceph-mon[43429]: osd.2 [v2:172.21.15.153:6800/3318516728,v1:172.21.15.153:6801/3318516728] boot 2024-04-01T06:51:22.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:21 smithi083 ceph-mon[43429]: osdmap e18: 3 total, 3 up, 3 in 2024-04-01T06:51:22.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:21 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-01T06:51:22.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:21 smithi153 ceph-mon[48187]: purged_snaps scrub starts 2024-04-01T06:51:22.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:21 smithi153 ceph-mon[48187]: purged_snaps scrub ok 2024-04-01T06:51:22.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:21 smithi153 ceph-mon[48187]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:51:22.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:21 smithi153 ceph-mon[48187]: osd.2 [v2:172.21.15.153:6800/3318516728,v1:172.21.15.153:6801/3318516728] boot 2024-04-01T06:51:22.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:21 smithi153 ceph-mon[48187]: osdmap e18: 3 total, 3 up, 3 in 2024-04-01T06:51:22.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:21 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-01T06:51:23.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:22 smithi145 ceph-mon[47816]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-01T06:51:23.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:22 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-01T06:51:23.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:22 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/3465127857' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "899b6c90-8f2f-44dd-b807-49594aadb443"}]: dispatch 2024-04-01T06:51:23.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:22 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-01T06:51:23.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:22 smithi145 ceph-mon[47816]: osdmap e19: 3 total, 3 up, 3 in 2024-04-01T06:51:23.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:22 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/3465127857' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "899b6c90-8f2f-44dd-b807-49594aadb443"}]': finished 2024-04-01T06:51:23.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:22 smithi145 ceph-mon[47816]: osdmap e20: 4 total, 3 up, 4 in 2024-04-01T06:51:23.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:22 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-01T06:51:23.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:22 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-01T06:51:23.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:22 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/468055506' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T06:51:23.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:22 smithi083 ceph-mon[43429]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-01T06:51:23.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:22 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-01T06:51:23.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:22 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/3465127857' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "899b6c90-8f2f-44dd-b807-49594aadb443"}]: dispatch 2024-04-01T06:51:23.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:22 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-01T06:51:23.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:22 smithi083 ceph-mon[43429]: osdmap e19: 3 total, 3 up, 3 in 2024-04-01T06:51:23.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:22 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/3465127857' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "899b6c90-8f2f-44dd-b807-49594aadb443"}]': finished 2024-04-01T06:51:23.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:22 smithi083 ceph-mon[43429]: osdmap e20: 4 total, 3 up, 4 in 2024-04-01T06:51:23.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:22 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-01T06:51:23.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:22 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-01T06:51:23.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:22 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/468055506' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T06:51:23.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:22 smithi153 ceph-mon[48187]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-01T06:51:23.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:22 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-01T06:51:23.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:22 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/3465127857' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "899b6c90-8f2f-44dd-b807-49594aadb443"}]: dispatch 2024-04-01T06:51:23.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:22 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-01T06:51:23.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:22 smithi153 ceph-mon[48187]: osdmap e19: 3 total, 3 up, 3 in 2024-04-01T06:51:23.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:22 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/3465127857' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "899b6c90-8f2f-44dd-b807-49594aadb443"}]': finished 2024-04-01T06:51:23.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:22 smithi153 ceph-mon[48187]: osdmap e20: 4 total, 3 up, 4 in 2024-04-01T06:51:23.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:22 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-01T06:51:23.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:22 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-01T06:51:23.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:22 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/468055506' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T06:51:23.570 INFO:journalctl@ceph.osd.0.smithi083.stdout:Apr 01 06:51:23 smithi083 sudo[68200]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-01T06:51:23.570 INFO:journalctl@ceph.osd.0.smithi083.stdout:Apr 01 06:51:23 smithi083 sudo[68200]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-01T06:51:23.570 INFO:journalctl@ceph.osd.0.smithi083.stdout:Apr 01 06:51:23 smithi083 sudo[68200]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-01T06:51:23.570 INFO:journalctl@ceph.osd.0.smithi083.stdout:Apr 01 06:51:23 smithi083 sudo[68200]: pam_unix(sudo:session): session closed for user root 2024-04-01T06:51:23.975 INFO:journalctl@ceph.osd.0.smithi083.stdout:Apr 01 06:51:23 smithi083 sudo[68387]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-01T06:51:23.975 INFO:journalctl@ceph.osd.0.smithi083.stdout:Apr 01 06:51:23 smithi083 sudo[68387]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-01T06:51:23.975 INFO:journalctl@ceph.osd.0.smithi083.stdout:Apr 01 06:51:23 smithi083 sudo[68387]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-01T06:51:23.975 INFO:journalctl@ceph.osd.0.smithi083.stdout:Apr 01 06:51:23 smithi083 sudo[68387]: pam_unix(sudo:session): session closed for user root 2024-04-01T06:51:24.081 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:23 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-01T06:51:24.082 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:23 smithi145 ceph-mon[47816]: osdmap e21: 4 total, 3 up, 4 in 2024-04-01T06:51:24.082 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:23 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-01T06:51:24.082 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:23 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:24.082 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:23 smithi145 ceph-mon[47816]: pgmap v66: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-01T06:51:24.082 INFO:journalctl@ceph.osd.1.smithi145.stdout:Apr 01 06:51:23 smithi145 sudo[58426]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-01T06:51:24.082 INFO:journalctl@ceph.osd.1.smithi145.stdout:Apr 01 06:51:23 smithi145 sudo[58426]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-01T06:51:24.082 INFO:journalctl@ceph.osd.1.smithi145.stdout:Apr 01 06:51:23 smithi145 sudo[58426]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-01T06:51:24.082 INFO:journalctl@ceph.osd.1.smithi145.stdout:Apr 01 06:51:23 smithi145 sudo[58426]: pam_unix(sudo:session): session closed for user root 2024-04-01T06:51:24.082 INFO:journalctl@ceph.osd.1.smithi145.stdout:Apr 01 06:51:24 smithi145 sudo[58429]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-01T06:51:24.082 INFO:journalctl@ceph.osd.1.smithi145.stdout:Apr 01 06:51:24 smithi145 sudo[58429]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-01T06:51:24.082 INFO:journalctl@ceph.osd.1.smithi145.stdout:Apr 01 06:51:24 smithi145 sudo[58429]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-01T06:51:24.082 INFO:journalctl@ceph.osd.1.smithi145.stdout:Apr 01 06:51:24 smithi145 sudo[58429]: pam_unix(sudo:session): session closed for user root 2024-04-01T06:51:24.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:23 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-01T06:51:24.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:23 smithi083 ceph-mon[43429]: osdmap e21: 4 total, 3 up, 4 in 2024-04-01T06:51:24.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:23 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-01T06:51:24.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:23 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:24.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:23 smithi083 ceph-mon[43429]: pgmap v66: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-01T06:51:24.344 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:23 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-01T06:51:24.344 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:23 smithi153 ceph-mon[48187]: osdmap e21: 4 total, 3 up, 4 in 2024-04-01T06:51:24.344 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:23 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-01T06:51:24.344 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:23 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:24.344 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:23 smithi153 ceph-mon[48187]: pgmap v66: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-01T06:51:24.640 INFO:journalctl@ceph.osd.2.smithi153.stdout:Apr 01 06:51:24 smithi153 sudo[59262]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-01T06:51:24.640 INFO:journalctl@ceph.osd.2.smithi153.stdout:Apr 01 06:51:24 smithi153 sudo[59262]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-01T06:51:24.640 INFO:journalctl@ceph.osd.2.smithi153.stdout:Apr 01 06:51:24 smithi153 sudo[59262]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-01T06:51:24.641 INFO:journalctl@ceph.osd.2.smithi153.stdout:Apr 01 06:51:24 smithi153 sudo[59262]: pam_unix(sudo:session): session closed for user root 2024-04-01T06:51:24.641 INFO:journalctl@ceph.osd.2.smithi153.stdout:Apr 01 06:51:24 smithi153 sudo[59265]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-01T06:51:24.641 INFO:journalctl@ceph.osd.2.smithi153.stdout:Apr 01 06:51:24 smithi153 sudo[59265]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-01T06:51:24.641 INFO:journalctl@ceph.osd.2.smithi153.stdout:Apr 01 06:51:24 smithi153 sudo[59265]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-01T06:51:24.641 INFO:journalctl@ceph.osd.2.smithi153.stdout:Apr 01 06:51:24 smithi153 sudo[59265]: pam_unix(sudo:session): session closed for user root 2024-04-01T06:51:25.101 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:24 smithi083 sudo[68947]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-01T06:51:25.101 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:24 smithi083 sudo[68947]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-01T06:51:25.101 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:24 smithi083 sudo[68947]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-01T06:51:25.101 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:24 smithi083 sudo[68947]: pam_unix(sudo:session): session closed for user root 2024-04-01T06:51:25.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:25 smithi153 ceph-mon[48187]: osdmap e22: 4 total, 3 up, 4 in 2024-04-01T06:51:25.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:25 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-01T06:51:25.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:25 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:25.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:25 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:25.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:25 smithi153 ceph-mon[48187]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-01T06:51:25.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:25 smithi153 sudo[59268]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-01T06:51:25.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:25 smithi153 sudo[59268]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-01T06:51:25.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:25 smithi153 sudo[59268]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-01T06:51:25.392 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:25 smithi153 sudo[59268]: pam_unix(sudo:session): session closed for user root 2024-04-01T06:51:25.502 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:25 smithi145 ceph-mon[47816]: osdmap e22: 4 total, 3 up, 4 in 2024-04-01T06:51:25.502 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:25 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-01T06:51:25.502 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:25 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:25.502 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:25 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:25.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:25 smithi145 ceph-mon[47816]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-01T06:51:25.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:25 smithi083 sudo[69142]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-01T06:51:25.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:25 smithi083 sudo[69142]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-01T06:51:25.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:25 smithi083 sudo[69142]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-01T06:51:25.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:25 smithi083 sudo[69142]: pam_unix(sudo:session): session closed for user root 2024-04-01T06:51:25.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:25 smithi083 ceph-mon[43429]: osdmap e22: 4 total, 3 up, 4 in 2024-04-01T06:51:25.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:25 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-01T06:51:25.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:25 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:25.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:25 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:25.513 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:25 smithi083 ceph-mon[43429]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-01T06:51:25.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:51:25.599+0000 7f8abdffb700 1 -- 172.21.15.83:0/1141985944 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mgrmap(e 16) v1 ==== 135865+0+0 (secure 0 0 0) 0x7f8ab80965c0 con 0x7f8ac01023d0 2024-04-01T06:51:25.890 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:25 smithi153 sudo[59271]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-01T06:51:25.890 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:25 smithi153 sudo[59271]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-01T06:51:25.890 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:25 smithi153 sudo[59271]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-01T06:51:25.890 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:25 smithi153 sudo[59271]: pam_unix(sudo:session): session closed for user root 2024-04-01T06:51:26.107 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:25 smithi145 sudo[58432]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-01T06:51:26.107 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:25 smithi145 sudo[58432]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-01T06:51:26.108 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:25 smithi145 sudo[58432]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-01T06:51:26.108 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:25 smithi145 sudo[58432]: pam_unix(sudo:session): session closed for user root 2024-04-01T06:51:26.108 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:26 smithi145 sudo[58435]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-01T06:51:26.108 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:26 smithi145 sudo[58435]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-01T06:51:26.108 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:26 smithi145 sudo[58435]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-01T06:51:26.108 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:26 smithi145 sudo[58435]: pam_unix(sudo:session): session closed for user root 2024-04-01T06:51:26.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:26 smithi153 ceph-mon[48187]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-01T06:51:26.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:26 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T06:51:26.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:26 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T06:51:26.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:26 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T06:51:26.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:26 smithi153 ceph-mon[48187]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-01T06:51:26.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:26 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T06:51:26.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:26 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T06:51:26.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:26 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T06:51:26.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:26 smithi153 ceph-mon[48187]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-01T06:51:26.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:26 smithi153 ceph-mon[48187]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-01T06:51:26.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:26 smithi153 ceph-mon[48187]: mgrmap e16: x(active, since 111s), standbys: z, y 2024-04-01T06:51:26.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:26 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T06:51:26.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:26 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T06:51:26.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:26 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T06:51:26.392 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:26 smithi153 ceph-mon[48187]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-01T06:51:26.392 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:26 smithi153 ceph-mon[48187]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-01T06:51:26.399 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:26 smithi083 ceph-mon[43429]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-01T06:51:26.399 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:26 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T06:51:26.399 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:26 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T06:51:26.399 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:26 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T06:51:26.399 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:26 smithi083 ceph-mon[43429]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-01T06:51:26.399 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:26 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T06:51:26.399 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:26 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T06:51:26.399 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:26 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T06:51:26.399 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:26 smithi083 ceph-mon[43429]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-01T06:51:26.400 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:26 smithi083 ceph-mon[43429]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-01T06:51:26.400 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:26 smithi083 ceph-mon[43429]: mgrmap e16: x(active, since 111s), standbys: z, y 2024-04-01T06:51:26.400 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:26 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T06:51:26.400 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:26 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T06:51:26.400 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:26 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T06:51:26.400 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:26 smithi083 ceph-mon[43429]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-01T06:51:26.400 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:26 smithi083 ceph-mon[43429]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-01T06:51:26.502 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:26 smithi145 ceph-mon[47816]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-01T06:51:26.502 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:26 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T06:51:26.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:26 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T06:51:26.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:26 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T06:51:26.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:26 smithi145 ceph-mon[47816]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-01T06:51:26.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:26 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T06:51:26.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:26 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T06:51:26.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:26 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T06:51:26.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:26 smithi145 ceph-mon[47816]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-01T06:51:26.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:26 smithi145 ceph-mon[47816]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-01T06:51:26.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:26 smithi145 ceph-mon[47816]: mgrmap e16: x(active, since 111s), standbys: z, y 2024-04-01T06:51:26.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:26 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T06:51:26.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:26 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T06:51:26.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:26 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T06:51:26.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:26 smithi145 ceph-mon[47816]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-01T06:51:26.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:26 smithi145 ceph-mon[47816]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-01T06:51:29.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:28 smithi145 ceph-mon[47816]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-01T06:51:29.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:28 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-01T06:51:29.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:28 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:51:29.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:28 smithi145 ceph-mon[47816]: Deploying daemon osd.3 on smithi083 2024-04-01T06:51:29.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:28 smithi083 ceph-mon[43429]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-01T06:51:29.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:28 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-01T06:51:29.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:28 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:51:29.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:28 smithi083 ceph-mon[43429]: Deploying daemon osd.3 on smithi083 2024-04-01T06:51:29.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:28 smithi153 ceph-mon[48187]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-01T06:51:29.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:28 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-01T06:51:29.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:28 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:51:29.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:28 smithi153 ceph-mon[48187]: Deploying daemon osd.3 on smithi083 2024-04-01T06:51:31.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:30 smithi145 ceph-mon[47816]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2024-04-01T06:51:31.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:30 smithi083 ceph-mon[43429]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2024-04-01T06:51:31.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:30 smithi153 ceph-mon[48187]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2024-04-01T06:51:32.890 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:32 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:32.890 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:32 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:32.890 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:32 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:51:32.890 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:32 smithi153 ceph-mon[48187]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-04-01T06:51:32.966 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:32 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:32.966 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:32 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:32.966 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:32 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:51:32.966 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:32 smithi083 ceph-mon[43429]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-04-01T06:51:33.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:32 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:33.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:32 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:33.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:32 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:51:33.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:32 smithi145 ceph-mon[47816]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-04-01T06:51:33.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:51:33.915+0000 7f8abdffb700 1 -- 172.21.15.83:0/1141985944 <== mgr.14152 v2:172.21.15.83:6800/3375372052 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f8ac002cd20 con 0x7f8ab00a1090 2024-04-01T06:51:33.915 INFO:teuthology.orchestra.run.smithi083.stdout:Created osd(s) 3 on host 'smithi083' 2024-04-01T06:51:33.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:51:33.917+0000 7f8ac7207700 1 -- 172.21.15.83:0/1141985944 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f8ab00a1090 msgr2=0x7f8ab00a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:51:33.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:51:33.917+0000 7f8ac7207700 1 --2- 172.21.15.83:0/1141985944 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f8ab00a1090 0x7f8ab00a3550 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8ac01981c0 tx=0x7f8ab4009190 comp rx=0 tx=0).stop 2024-04-01T06:51:33.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:51:33.917+0000 7f8ac7207700 1 -- 172.21.15.83:0/1141985944 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ac01023d0 msgr2=0x7f8ac019e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:51:33.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:51:33.917+0000 7f8ac7207700 1 --2- 172.21.15.83:0/1141985944 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ac01023d0 0x7f8ac019e260 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8007d70 tx=0x7f8ab800a340 comp rx=0 tx=0).stop 2024-04-01T06:51:33.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:51:33.917+0000 7f8ac7207700 1 -- 172.21.15.83:0/1141985944 shutdown_connections 2024-04-01T06:51:33.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:51:33.917+0000 7f8ac7207700 1 --2- 172.21.15.83:0/1141985944 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ac01023d0 0x7f8ac019e260 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:51:33.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:51:33.917+0000 7f8ac7207700 1 --2- 172.21.15.83:0/1141985944 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f8ab00a1090 0x7f8ab00a3550 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:51:33.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:51:33.917+0000 7f8ac7207700 1 --2- 172.21.15.83:0/1141985944 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ac00fee50 0x7f8ac0196d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:51:33.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:51:33.917+0000 7f8ac7207700 1 --2- 172.21.15.83:0/1141985944 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8ac00ff7f0 0x7f8ac0197270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:51:33.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:51:33.917+0000 7f8ac7207700 1 -- 172.21.15.83:0/1141985944 >> 172.21.15.83:0/1141985944 conn(0x7f8ac00faa10 msgr2=0x7f8ac01054c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:51:33.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:51:33.917+0000 7f8ac7207700 1 -- 172.21.15.83:0/1141985944 shutdown_connections 2024-04-01T06:51:33.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:51:33.917+0000 7f8ac7207700 1 -- 172.21.15.83:0/1141985944 wait complete. 2024-04-01T06:51:34.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:33 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:34.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:33 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:34.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:33 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:51:34.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:33 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:51:34.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:33 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:34.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:33 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:34.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:33 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:34.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:33 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:34.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:33 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:34.143 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:33 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:51:34.143 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:33 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:51:34.143 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:33 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:34.143 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:33 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:34.143 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:33 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:34.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:33 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:34.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:33 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:34.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:33 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:51:34.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:33 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:51:34.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:33 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:34.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:33 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:34.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:33 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:34.306 DEBUG:teuthology.orchestra.run.smithi083:osd.3> sudo journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@osd.3.service 2024-04-01T06:51:34.309 INFO:tasks.cephadm:Deploying osd.4 on smithi145 with /dev/vg_nvme/lv_3... 2024-04-01T06:51:34.309 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-01T06:51:34.341 INFO:journalctl@ceph.osd.3.smithi083.stdout:-- Logs begin at Mon 2024-04-01 06:34:54 UTC. -- 2024-04-01T06:51:34.540 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T06:51:34.973 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:34 smithi145 ceph-mon[47816]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-04-01T06:51:34.973 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:34 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:51:35.041 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:34 smithi083 ceph-mon[43429]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-04-01T06:51:35.041 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:34 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:51:35.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:34 smithi153 ceph-mon[48187]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-04-01T06:51:35.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:34 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:51:35.851 INFO:teuthology.orchestra.run.smithi145.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-01T06:51:35.851 INFO:teuthology.orchestra.run.smithi145.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-01T06:51:35.851 INFO:teuthology.orchestra.run.smithi145.stderr: stderr: 10+0 records in 2024-04-01T06:51:35.851 INFO:teuthology.orchestra.run.smithi145.stderr:10+0 records out 2024-04-01T06:51:35.851 INFO:teuthology.orchestra.run.smithi145.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0125088 s, 838 MB/s 2024-04-01T06:51:35.851 INFO:teuthology.orchestra.run.smithi145.stderr:--> Zapping successful for: 2024-04-01T06:51:35.892 INFO:journalctl@ceph.osd.3.smithi083.stdout:Apr 01 06:51:35 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-3[70184]: 2024-04-01T06:51:35.585+0000 7f0d1f3b7640 -1 osd.3 0 log_to_monitors true 2024-04-01T06:51:36.195 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:35 smithi145 ceph-mon[47816]: from='osd.3 [v2:172.21.15.83:6810/504690234,v1:172.21.15.83:6811/504690234]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-01T06:51:36.196 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi145:vg_nvme/lv_3 2024-04-01T06:51:36.260 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:35 smithi083 ceph-mon[43429]: from='osd.3 [v2:172.21.15.83:6810/504690234,v1:172.21.15.83:6811/504690234]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-01T06:51:36.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:35 smithi153 ceph-mon[48187]: from='osd.3 [v2:172.21.15.83:6810/504690234,v1:172.21.15.83:6811/504690234]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-01T06:51:36.413 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T06:51:37.223 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:36 smithi145 ceph-mon[47816]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-04-01T06:51:37.223 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:36 smithi145 ceph-mon[47816]: from='osd.3 [v2:172.21.15.83:6810/504690234,v1:172.21.15.83:6811/504690234]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-01T06:51:37.223 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:36 smithi145 ceph-mon[47816]: osdmap e23: 4 total, 3 up, 4 in 2024-04-01T06:51:37.223 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:36 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-01T06:51:37.223 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:36 smithi145 ceph-mon[47816]: from='osd.3 [v2:172.21.15.83:6810/504690234,v1:172.21.15.83:6811/504690234]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]: dispatch 2024-04-01T06:51:37.223 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:36 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:37.223 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:36 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:37.224 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:36 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:51:37.224 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:36 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:51:37.224 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:36 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:37.224 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:36 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:51:37.224 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:36 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:51:37.224 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:36 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:37.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:36 smithi083 ceph-mon[43429]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-04-01T06:51:37.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:36 smithi083 ceph-mon[43429]: from='osd.3 [v2:172.21.15.83:6810/504690234,v1:172.21.15.83:6811/504690234]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-01T06:51:37.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:36 smithi083 ceph-mon[43429]: osdmap e23: 4 total, 3 up, 4 in 2024-04-01T06:51:37.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:36 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-01T06:51:37.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:36 smithi083 ceph-mon[43429]: from='osd.3 [v2:172.21.15.83:6810/504690234,v1:172.21.15.83:6811/504690234]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]: dispatch 2024-04-01T06:51:37.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:36 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:37.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:36 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:37.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:36 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:51:37.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:36 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:51:37.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:36 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:37.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:36 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:51:37.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:36 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:51:37.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:36 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:37.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:36 smithi153 ceph-mon[48187]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-04-01T06:51:37.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:36 smithi153 ceph-mon[48187]: from='osd.3 [v2:172.21.15.83:6810/504690234,v1:172.21.15.83:6811/504690234]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-01T06:51:37.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:36 smithi153 ceph-mon[48187]: osdmap e23: 4 total, 3 up, 4 in 2024-04-01T06:51:37.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:36 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-01T06:51:37.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:36 smithi153 ceph-mon[48187]: from='osd.3 [v2:172.21.15.83:6810/504690234,v1:172.21.15.83:6811/504690234]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]: dispatch 2024-04-01T06:51:37.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:36 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:37.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:36 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:37.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:36 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:51:37.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:36 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:51:37.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:36 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:37.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:36 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:51:37.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:36 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:51:37.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:36 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:37.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:51:37.400+0000 7feba868c700 1 -- 172.21.15.145:0/643863700 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feba0100ef0 msgr2=0x7feba0101350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:51:37.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:51:37.400+0000 7feba868c700 1 --2- 172.21.15.145:0/643863700 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feba0100ef0 0x7feba0101350 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7feb940099c0 tx=0x7feb94009cd0 comp rx=0 tx=0).stop 2024-04-01T06:51:37.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:51:37.400+0000 7feba868c700 1 -- 172.21.15.145:0/643863700 shutdown_connections 2024-04-01T06:51:37.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:51:37.400+0000 7feba868c700 1 --2- 172.21.15.145:0/643863700 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feba0101890 0x7feba0108140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:51:37.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:51:37.400+0000 7feba868c700 1 --2- 172.21.15.145:0/643863700 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feba00ffcf0 0x7feba0100110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:51:37.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:51:37.400+0000 7feba868c700 1 --2- 172.21.15.145:0/643863700 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feba0100ef0 0x7feba0101350 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:51:37.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:51:37.400+0000 7feba868c700 1 -- 172.21.15.145:0/643863700 >> 172.21.15.145:0/643863700 conn(0x7feba00fb2b0 msgr2=0x7feba00fd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:51:37.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:51:37.401+0000 7feba868c700 1 -- 172.21.15.145:0/643863700 shutdown_connections 2024-04-01T06:51:37.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:51:37.401+0000 7feba868c700 1 -- 172.21.15.145:0/643863700 wait complete. 2024-04-01T06:51:37.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:51:37.401+0000 7feba868c700 1 Processor -- start 2024-04-01T06:51:37.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:51:37.401+0000 7feba868c700 1 -- start start 2024-04-01T06:51:37.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:51:37.401+0000 7feba868c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feba00ffcf0 0x7feba0196de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:51:37.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:51:37.401+0000 7feba868c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feba0100ef0 0x7feba0197320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:51:37.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:51:37.401+0000 7feba868c700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feba0101890 0x7feba019e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:51:37.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:51:37.401+0000 7feba868c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba019e8e0 con 0x7feba00ffcf0 2024-04-01T06:51:37.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:51:37.401+0000 7feba868c700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba019ea20 con 0x7feba0101890 2024-04-01T06:51:37.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:51:37.401+0000 7feba868c700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba019ebe0 con 0x7feba0100ef0 2024-04-01T06:51:37.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:51:37.401+0000 7feba6c29700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feba0101890 0x7feba019e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:51:37.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:51:37.401+0000 7feba6c29700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feba0101890 0x7feba019e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:40500/0 (socket says 172.21.15.145:40500) 2024-04-01T06:51:37.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:51:37.401+0000 7feba6c29700 1 -- 172.21.15.145:0/399883937 learned_addr learned my addr 172.21.15.145:0/399883937 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-04-01T06:51:37.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:51:37.401+0000 7feba6428700 1 --2- 172.21.15.145:0/399883937 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feba00ffcf0 0x7feba0196de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:51:37.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:51:37.401+0000 7feba5c27700 1 --2- 172.21.15.145:0/399883937 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feba0100ef0 0x7feba0197320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:51:37.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:51:37.402+0000 7feba6c29700 1 -- 172.21.15.145:0/399883937 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feba0100ef0 msgr2=0x7feba0197320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:51:37.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:51:37.402+0000 7feba6c29700 1 --2- 172.21.15.145:0/399883937 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feba0100ef0 0x7feba0197320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:51:37.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:51:37.402+0000 7feba6c29700 1 -- 172.21.15.145:0/399883937 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feba00ffcf0 msgr2=0x7feba0196de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:51:37.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:51:37.402+0000 7feba6c29700 1 --2- 172.21.15.145:0/399883937 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feba00ffcf0 0x7feba0196de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:51:37.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:51:37.402+0000 7feba6c29700 1 -- 172.21.15.145:0/399883937 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb940095f0 con 0x7feba0101890 2024-04-01T06:51:37.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:51:37.402+0000 7feba6c29700 1 --2- 172.21.15.145:0/399883937 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feba0101890 0x7feba019e310 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7feb9800ef30 tx=0x7feb9800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:51:37.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:51:37.402+0000 7feb937fe700 1 -- 172.21.15.145:0/399883937 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb98018070 con 0x7feba0101890 2024-04-01T06:51:37.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:51:37.402+0000 7feba868c700 1 -- 172.21.15.145:0/399883937 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feba019ee60 con 0x7feba0101890 2024-04-01T06:51:37.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:51:37.402+0000 7feb937fe700 1 -- 172.21.15.145:0/399883937 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feb9800f040 con 0x7feba0101890 2024-04-01T06:51:37.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:51:37.402+0000 7feb937fe700 1 -- 172.21.15.145:0/399883937 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9800cd00 con 0x7feba0101890 2024-04-01T06:51:37.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:51:37.402+0000 7feba868c700 1 -- 172.21.15.145:0/399883937 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feba019f270 con 0x7feba0101890 2024-04-01T06:51:37.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:51:37.403+0000 7feba868c700 1 -- 172.21.15.145:0/399883937 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feba004ea80 con 0x7feba0101890 2024-04-01T06:51:37.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:51:37.404+0000 7feb937fe700 1 -- 172.21.15.145:0/399883937 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 16) v1 ==== 135865+0+0 (secure 0 0 0) 0x7feb98003a00 con 0x7feba0101890 2024-04-01T06:51:37.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:51:37.405+0000 7feb937fe700 1 --2- 172.21.15.145:0/399883937 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7feb8c0a1120 0x7feb8c0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:51:37.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:51:37.405+0000 7feb937fe700 1 -- 172.21.15.145:0/399883937 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 3389+0+0 (secure 0 0 0) 0x7feb980cbac0 con 0x7feba0101890 2024-04-01T06:51:37.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:51:37.405+0000 7feba6428700 1 --2- 172.21.15.145:0/399883937 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7feb8c0a1120 0x7feb8c0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:51:37.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:51:37.405+0000 7feba6428700 1 --2- 172.21.15.145:0/399883937 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7feb8c0a1120 0x7feb8c0a35e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7feba0198270 tx=0x7feb9c009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:51:37.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:51:37.408+0000 7feb937fe700 1 -- 172.21.15.145:0/399883937 <== mon.2 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7feb98096620 con 0x7feba0101890 2024-04-01T06:51:37.609 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:51:37.608+0000 7feba868c700 1 -- 172.21.15.145:0/399883937 --> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7feba00fd4e0 con 0x7feb8c0a1120 2024-04-01T06:51:37.762 INFO:journalctl@ceph.osd.3.smithi083.stdout:Apr 01 06:51:37 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-3[70184]: 2024-04-01T06:51:37.335+0000 7f0d1521c700 -1 osd.3 0 waiting for initial osdmap 2024-04-01T06:51:37.762 INFO:journalctl@ceph.osd.3.smithi083.stdout:Apr 01 06:51:37 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-3[70184]: 2024-04-01T06:51:37.341+0000 7f0d0c808700 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T06:51:38.247 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:37 smithi145 ceph-mon[47816]: Detected new or changed devices on smithi083 2024-04-01T06:51:38.248 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:37 smithi145 ceph-mon[47816]: Adjusting osd_memory_target on smithi083 to 8557M 2024-04-01T06:51:38.248 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:37 smithi145 ceph-mon[47816]: from='osd.3 [v2:172.21.15.83:6810/504690234,v1:172.21.15.83:6811/504690234]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]': finished 2024-04-01T06:51:38.248 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:37 smithi145 ceph-mon[47816]: osdmap e24: 4 total, 3 up, 4 in 2024-04-01T06:51:38.248 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:37 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-01T06:51:38.248 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:37 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-01T06:51:38.248 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:37 smithi145 ceph-mon[47816]: from='osd.3 [v2:172.21.15.83:6810/504690234,v1:172.21.15.83:6811/504690234]' entity='osd.3' 2024-04-01T06:51:38.248 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:37 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T06:51:38.248 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:37 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T06:51:38.248 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:37 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:51:38.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:37 smithi083 ceph-mon[43429]: Detected new or changed devices on smithi083 2024-04-01T06:51:38.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:37 smithi083 ceph-mon[43429]: Adjusting osd_memory_target on smithi083 to 8557M 2024-04-01T06:51:38.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:37 smithi083 ceph-mon[43429]: from='osd.3 [v2:172.21.15.83:6810/504690234,v1:172.21.15.83:6811/504690234]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]': finished 2024-04-01T06:51:38.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:37 smithi083 ceph-mon[43429]: osdmap e24: 4 total, 3 up, 4 in 2024-04-01T06:51:38.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:37 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-01T06:51:38.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:37 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-01T06:51:38.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:37 smithi083 ceph-mon[43429]: from='osd.3 [v2:172.21.15.83:6810/504690234,v1:172.21.15.83:6811/504690234]' entity='osd.3' 2024-04-01T06:51:38.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:37 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T06:51:38.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:37 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T06:51:38.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:37 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:51:38.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:37 smithi153 ceph-mon[48187]: Detected new or changed devices on smithi083 2024-04-01T06:51:38.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:37 smithi153 ceph-mon[48187]: Adjusting osd_memory_target on smithi083 to 8557M 2024-04-01T06:51:38.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:37 smithi153 ceph-mon[48187]: from='osd.3 [v2:172.21.15.83:6810/504690234,v1:172.21.15.83:6811/504690234]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]': finished 2024-04-01T06:51:38.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:37 smithi153 ceph-mon[48187]: osdmap e24: 4 total, 3 up, 4 in 2024-04-01T06:51:38.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:37 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-01T06:51:38.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:37 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-01T06:51:38.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:37 smithi153 ceph-mon[48187]: from='osd.3 [v2:172.21.15.83:6810/504690234,v1:172.21.15.83:6811/504690234]' entity='osd.3' 2024-04-01T06:51:38.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:37 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T06:51:38.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:37 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T06:51:38.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:37 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:51:39.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:38 smithi145 ceph-mon[47816]: purged_snaps scrub starts 2024-04-01T06:51:39.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:38 smithi145 ceph-mon[47816]: purged_snaps scrub ok 2024-04-01T06:51:39.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:38 smithi145 ceph-mon[47816]: from='client.24212 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:51:39.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:38 smithi145 ceph-mon[47816]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-01T06:51:39.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:38 smithi145 ceph-mon[47816]: osd.3 [v2:172.21.15.83:6810/504690234,v1:172.21.15.83:6811/504690234] boot 2024-04-01T06:51:39.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:38 smithi145 ceph-mon[47816]: osdmap e25: 4 total, 4 up, 4 in 2024-04-01T06:51:39.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:38 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-01T06:51:39.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:38 smithi083 ceph-mon[43429]: purged_snaps scrub starts 2024-04-01T06:51:39.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:38 smithi083 ceph-mon[43429]: purged_snaps scrub ok 2024-04-01T06:51:39.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:38 smithi083 ceph-mon[43429]: from='client.24212 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:51:39.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:38 smithi083 ceph-mon[43429]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-01T06:51:39.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:38 smithi083 ceph-mon[43429]: osd.3 [v2:172.21.15.83:6810/504690234,v1:172.21.15.83:6811/504690234] boot 2024-04-01T06:51:39.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:38 smithi083 ceph-mon[43429]: osdmap e25: 4 total, 4 up, 4 in 2024-04-01T06:51:39.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:38 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-01T06:51:39.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:38 smithi153 ceph-mon[48187]: purged_snaps scrub starts 2024-04-01T06:51:39.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:38 smithi153 ceph-mon[48187]: purged_snaps scrub ok 2024-04-01T06:51:39.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:38 smithi153 ceph-mon[48187]: from='client.24212 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:51:39.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:38 smithi153 ceph-mon[48187]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-04-01T06:51:39.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:38 smithi153 ceph-mon[48187]: osd.3 [v2:172.21.15.83:6810/504690234,v1:172.21.15.83:6811/504690234] boot 2024-04-01T06:51:39.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:38 smithi153 ceph-mon[48187]: osdmap e25: 4 total, 4 up, 4 in 2024-04-01T06:51:39.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:38 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-01T06:51:40.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:39 smithi145 ceph-mon[47816]: osdmap e26: 4 total, 4 up, 4 in 2024-04-01T06:51:40.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:39 smithi145 ceph-mon[47816]: from='client.? 172.21.15.145:0/2188778389' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5071dd81-804e-4358-bfb6-11e718e9cf4e"}]: dispatch 2024-04-01T06:51:40.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:39 smithi145 ceph-mon[47816]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5071dd81-804e-4358-bfb6-11e718e9cf4e"}]: dispatch 2024-04-01T06:51:40.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:39 smithi145 ceph-mon[47816]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5071dd81-804e-4358-bfb6-11e718e9cf4e"}]': finished 2024-04-01T06:51:40.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:39 smithi145 ceph-mon[47816]: osdmap e27: 5 total, 4 up, 5 in 2024-04-01T06:51:40.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:39 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-01T06:51:40.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:39 smithi083 ceph-mon[43429]: osdmap e26: 4 total, 4 up, 4 in 2024-04-01T06:51:40.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:39 smithi083 ceph-mon[43429]: from='client.? 172.21.15.145:0/2188778389' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5071dd81-804e-4358-bfb6-11e718e9cf4e"}]: dispatch 2024-04-01T06:51:40.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:39 smithi083 ceph-mon[43429]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5071dd81-804e-4358-bfb6-11e718e9cf4e"}]: dispatch 2024-04-01T06:51:40.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:39 smithi083 ceph-mon[43429]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5071dd81-804e-4358-bfb6-11e718e9cf4e"}]': finished 2024-04-01T06:51:40.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:39 smithi083 ceph-mon[43429]: osdmap e27: 5 total, 4 up, 5 in 2024-04-01T06:51:40.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:39 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-01T06:51:40.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:39 smithi153 ceph-mon[48187]: osdmap e26: 4 total, 4 up, 4 in 2024-04-01T06:51:40.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:39 smithi153 ceph-mon[48187]: from='client.? 172.21.15.145:0/2188778389' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5071dd81-804e-4358-bfb6-11e718e9cf4e"}]: dispatch 2024-04-01T06:51:40.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:39 smithi153 ceph-mon[48187]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5071dd81-804e-4358-bfb6-11e718e9cf4e"}]: dispatch 2024-04-01T06:51:40.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:39 smithi153 ceph-mon[48187]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5071dd81-804e-4358-bfb6-11e718e9cf4e"}]': finished 2024-04-01T06:51:40.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:39 smithi153 ceph-mon[48187]: osdmap e27: 5 total, 4 up, 5 in 2024-04-01T06:51:40.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:39 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-01T06:51:41.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:40 smithi145 ceph-mon[47816]: pgmap v80: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 152 KiB/s, 0 objects/s recovering 2024-04-01T06:51:41.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:40 smithi145 ceph-mon[47816]: from='client.? 172.21.15.145:0/2012525732' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T06:51:41.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:40 smithi145 ceph-mon[47816]: osdmap e28: 5 total, 4 up, 5 in 2024-04-01T06:51:41.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:40 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-01T06:51:41.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:40 smithi083 ceph-mon[43429]: pgmap v80: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 152 KiB/s, 0 objects/s recovering 2024-04-01T06:51:41.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:40 smithi083 ceph-mon[43429]: from='client.? 172.21.15.145:0/2012525732' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T06:51:41.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:40 smithi083 ceph-mon[43429]: osdmap e28: 5 total, 4 up, 5 in 2024-04-01T06:51:41.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:40 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-01T06:51:41.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:40 smithi153 ceph-mon[48187]: pgmap v80: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 152 KiB/s, 0 objects/s recovering 2024-04-01T06:51:41.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:40 smithi153 ceph-mon[48187]: from='client.? 172.21.15.145:0/2012525732' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T06:51:41.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:40 smithi153 ceph-mon[48187]: osdmap e28: 5 total, 4 up, 5 in 2024-04-01T06:51:41.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:40 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-01T06:51:42.752 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:42 smithi145 ceph-mon[47816]: osdmap e29: 5 total, 4 up, 5 in 2024-04-01T06:51:42.753 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:42 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-01T06:51:42.753 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:42 smithi145 ceph-mon[47816]: pgmap v83: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 153 KiB/s, 0 objects/s recovering 2024-04-01T06:51:42.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:42 smithi083 ceph-mon[43429]: osdmap e29: 5 total, 4 up, 5 in 2024-04-01T06:51:42.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:42 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-01T06:51:42.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:42 smithi083 ceph-mon[43429]: pgmap v83: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 153 KiB/s, 0 objects/s recovering 2024-04-01T06:51:42.890 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:42 smithi153 ceph-mon[48187]: osdmap e29: 5 total, 4 up, 5 in 2024-04-01T06:51:42.890 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:42 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-01T06:51:42.890 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:42 smithi153 ceph-mon[48187]: pgmap v83: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 153 KiB/s, 0 objects/s recovering 2024-04-01T06:51:45.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:44 smithi145 ceph-mon[47816]: pgmap v84: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 121 KiB/s, 0 objects/s recovering 2024-04-01T06:51:45.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:44 smithi083 ceph-mon[43429]: pgmap v84: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 121 KiB/s, 0 objects/s recovering 2024-04-01T06:51:45.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:44 smithi153 ceph-mon[48187]: pgmap v84: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 121 KiB/s, 0 objects/s recovering 2024-04-01T06:51:45.904 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:45 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-01T06:51:45.904 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:45 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:51:46.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:45 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-01T06:51:46.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:45 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:51:46.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:45 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-01T06:51:46.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:45 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:51:46.933 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:46 smithi145 ceph-mon[47816]: Deploying daemon osd.4 on smithi145 2024-04-01T06:51:46.933 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:46 smithi145 ceph-mon[47816]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-04-01T06:51:47.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:46 smithi083 ceph-mon[43429]: Deploying daemon osd.4 on smithi145 2024-04-01T06:51:47.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:46 smithi083 ceph-mon[43429]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-04-01T06:51:47.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:46 smithi153 ceph-mon[48187]: Deploying daemon osd.4 on smithi145 2024-04-01T06:51:47.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:46 smithi153 ceph-mon[48187]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-04-01T06:51:49.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:48 smithi145 ceph-mon[47816]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-01T06:51:49.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:48 smithi083 ceph-mon[43429]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-01T06:51:49.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:48 smithi153 ceph-mon[48187]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-01T06:51:50.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:49 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:50.138 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:49 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:50.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:49 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:51:50.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:49 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:50.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:49 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:50.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:49 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:51:50.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:49 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:50.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:49 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:50.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:49 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:51:50.916 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:50 smithi145 ceph-mon[47816]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-01T06:51:50.916 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:50 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:50.916 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:50 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:50.916 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:50 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:51:50.916 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:50 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:51:50.916 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:50 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:51.061 INFO:teuthology.orchestra.run.smithi145.stdout:Created osd(s) 4 on host 'smithi145' 2024-04-01T06:51:51.061 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:51:51.061+0000 7feb937fe700 1 -- 172.21.15.145:0/399883937 <== mgr.14152 v2:172.21.15.83:6800/3375372052 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7feba00fd4e0 con 0x7feb8c0a1120 2024-04-01T06:51:51.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:51:51.064+0000 7feba868c700 1 -- 172.21.15.145:0/399883937 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7feb8c0a1120 msgr2=0x7feb8c0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:51:51.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:51:51.064+0000 7feba868c700 1 --2- 172.21.15.145:0/399883937 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7feb8c0a1120 0x7feb8c0a35e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7feba0198270 tx=0x7feb9c009190 comp rx=0 tx=0).stop 2024-04-01T06:51:51.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:51:51.064+0000 7feba868c700 1 -- 172.21.15.145:0/399883937 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feba0101890 msgr2=0x7feba019e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:51:51.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:51:51.064+0000 7feba868c700 1 --2- 172.21.15.145:0/399883937 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feba0101890 0x7feba019e310 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7feb9800ef30 tx=0x7feb9800c3a0 comp rx=0 tx=0).stop 2024-04-01T06:51:51.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:51:51.064+0000 7feba868c700 1 -- 172.21.15.145:0/399883937 shutdown_connections 2024-04-01T06:51:51.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:51:51.064+0000 7feba868c700 1 --2- 172.21.15.145:0/399883937 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feba00ffcf0 0x7feba0196de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:51:51.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:51:51.064+0000 7feba868c700 1 --2- 172.21.15.145:0/399883937 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7feb8c0a1120 0x7feb8c0a35e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:51:51.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:51:51.064+0000 7feba868c700 1 --2- 172.21.15.145:0/399883937 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feba0101890 0x7feba019e310 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:51:51.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:51:51.064+0000 7feba868c700 1 --2- 172.21.15.145:0/399883937 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feba0100ef0 0x7feba0197320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:51:51.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:51:51.064+0000 7feba868c700 1 -- 172.21.15.145:0/399883937 >> 172.21.15.145:0/399883937 conn(0x7feba00fb2b0 msgr2=0x7feba00fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:51:51.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:51:51.064+0000 7feba868c700 1 -- 172.21.15.145:0/399883937 shutdown_connections 2024-04-01T06:51:51.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:51:51.064+0000 7feba868c700 1 -- 172.21.15.145:0/399883937 wait complete. 2024-04-01T06:51:51.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:50 smithi153 ceph-mon[48187]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-01T06:51:51.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:50 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:51.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:50 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:51.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:50 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:51:51.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:50 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:51:51.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:50 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:51.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:50 smithi083 ceph-mon[43429]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-01T06:51:51.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:50 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:51.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:50 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:51.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:50 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:51:51.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:50 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:51:51.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:50 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:51.468 DEBUG:teuthology.orchestra.run.smithi145:osd.4> sudo journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@osd.4.service 2024-04-01T06:51:51.470 INFO:tasks.cephadm:Deploying osd.5 on smithi153 with /dev/vg_nvme/lv_3... 2024-04-01T06:51:51.470 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-01T06:51:51.499 INFO:journalctl@ceph.osd.4.smithi145.stdout:-- Logs begin at Mon 2024-04-01 06:34:41 UTC. -- 2024-04-01T06:51:51.702 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T06:51:52.111 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:52 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:52.112 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:52 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:52.112 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:52 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:51:52.112 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:52 smithi153 ceph-mon[48187]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-01T06:51:52.196 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:52 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:52.196 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:52 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:52.196 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:52 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:51:52.196 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:52 smithi145 ceph-mon[47816]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-01T06:51:52.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:52 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:52.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:52 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:52.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:52 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:51:52.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:52 smithi083 ceph-mon[43429]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-01T06:51:52.970 INFO:teuthology.orchestra.run.smithi153.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-01T06:51:52.970 INFO:teuthology.orchestra.run.smithi153.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-01T06:51:52.970 INFO:teuthology.orchestra.run.smithi153.stderr: stderr: 10+0 records in 2024-04-01T06:51:52.970 INFO:teuthology.orchestra.run.smithi153.stderr:10+0 records out 2024-04-01T06:51:52.970 INFO:teuthology.orchestra.run.smithi153.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0163808 s, 640 MB/s 2024-04-01T06:51:52.971 INFO:teuthology.orchestra.run.smithi153.stderr:--> Zapping successful for: 2024-04-01T06:51:53.180 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:53 smithi145 ceph-mon[47816]: from='osd.4 [v2:172.21.15.145:6808/2099824730,v1:172.21.15.145:6809/2099824730]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-01T06:51:53.180 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:53 smithi145 ceph-mon[47816]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-01T06:51:53.180 INFO:journalctl@ceph.osd.4.smithi145.stdout:Apr 01 06:51:52 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-4[61529]: 2024-04-01T06:51:52.856+0000 7f166067f640 -1 osd.4 0 log_to_monitors true 2024-04-01T06:51:53.273 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:53 smithi153 ceph-mon[48187]: from='osd.4 [v2:172.21.15.145:6808/2099824730,v1:172.21.15.145:6809/2099824730]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-01T06:51:53.274 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:53 smithi153 ceph-mon[48187]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-01T06:51:53.341 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi153:vg_nvme/lv_3 2024-04-01T06:51:53.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:53 smithi083 ceph-mon[43429]: from='osd.4 [v2:172.21.15.145:6808/2099824730,v1:172.21.15.145:6809/2099824730]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-01T06:51:53.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:53 smithi083 ceph-mon[43429]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-01T06:51:53.560 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T06:51:54.312 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:54 smithi153 ceph-mon[48187]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-01T06:51:54.312 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:54 smithi153 ceph-mon[48187]: osdmap e30: 5 total, 4 up, 5 in 2024-04-01T06:51:54.312 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:54 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-01T06:51:54.312 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:54 smithi153 ceph-mon[48187]: from='osd.4 [v2:172.21.15.145:6808/2099824730,v1:172.21.15.145:6809/2099824730]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-04-01T06:51:54.313 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:54 smithi153 ceph-mon[48187]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-04-01T06:51:54.313 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:54 smithi153 ceph-mon[48187]: Detected new or changed devices on smithi145 2024-04-01T06:51:54.313 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:54 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:54.313 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:54 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:54.313 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:54 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:51:54.313 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:54 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:51:54.313 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:54 smithi153 ceph-mon[48187]: Adjusting osd_memory_target on smithi145 to 8556M 2024-04-01T06:51:54.313 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:54 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:54.313 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:54 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:51:54.313 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:54 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:51:54.313 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:54 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:54.313 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:54 smithi153 ceph-mon[48187]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-01T06:51:54.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:54.473+0000 7fa45c697700 1 -- 172.21.15.153:0/2362899006 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4540ffd10 msgr2=0x7fa454100130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:51:54.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:54.473+0000 7fa45c697700 1 --2- 172.21.15.153:0/2362899006 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4540ffd10 0x7fa454100130 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa450009990 tx=0x7fa450009ca0 comp rx=0 tx=0).stop 2024-04-01T06:51:54.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:54.473+0000 7fa45c697700 1 -- 172.21.15.153:0/2362899006 shutdown_connections 2024-04-01T06:51:54.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:54.473+0000 7fa45c697700 1 --2- 172.21.15.153:0/2362899006 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa4541018b0 0x7fa454108160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:51:54.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:54.473+0000 7fa45c697700 1 --2- 172.21.15.153:0/2362899006 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4540ffd10 0x7fa454100130 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:51:54.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:54.473+0000 7fa45c697700 1 --2- 172.21.15.153:0/2362899006 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa454100f10 0x7fa454101370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:51:54.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:54.473+0000 7fa45c697700 1 -- 172.21.15.153:0/2362899006 >> 172.21.15.153:0/2362899006 conn(0x7fa4540fb2b0 msgr2=0x7fa4540fd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:51:54.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:54.473+0000 7fa45c697700 1 -- 172.21.15.153:0/2362899006 shutdown_connections 2024-04-01T06:51:54.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:54.473+0000 7fa45c697700 1 -- 172.21.15.153:0/2362899006 wait complete. 2024-04-01T06:51:54.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:54.474+0000 7fa45c697700 1 Processor -- start 2024-04-01T06:51:54.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:54.474+0000 7fa45c697700 1 -- start start 2024-04-01T06:51:54.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:54.474+0000 7fa45c697700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa4540ffd10 0x7fa454069ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:51:54.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:54.474+0000 7fa45c697700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa454100f10 0x7fa45419baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:51:54.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:54.474+0000 7fa45c697700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa4541018b0 0x7fa45419e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:51:54.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:54.474+0000 7fa45c697700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa45419e820 con 0x7fa4540ffd10 2024-04-01T06:51:54.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:54.474+0000 7fa45c697700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa45419e990 con 0x7fa4541018b0 2024-04-01T06:51:54.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:54.474+0000 7fa45c697700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa45419eb50 con 0x7fa454100f10 2024-04-01T06:51:54.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:54.474+0000 7fa459c32700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa454100f10 0x7fa45419baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:51:54.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:54.474+0000 7fa459c32700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa454100f10 0x7fa45419baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33972/0 (socket says 172.21.15.153:33972) 2024-04-01T06:51:54.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:54.474+0000 7fa459c32700 1 -- 172.21.15.153:0/497664536 learned_addr learned my addr 172.21.15.153:0/497664536 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-04-01T06:51:54.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:54.474+0000 7fa45ac34700 1 --2- 172.21.15.153:0/497664536 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa4541018b0 0x7fa45419e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:51:54.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:54.474+0000 7fa45a433700 1 --2- 172.21.15.153:0/497664536 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa4540ffd10 0x7fa454069ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:51:54.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:54.474+0000 7fa459c32700 1 -- 172.21.15.153:0/497664536 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa4541018b0 msgr2=0x7fa45419e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:51:54.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:54.474+0000 7fa459c32700 1 --2- 172.21.15.153:0/497664536 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa4541018b0 0x7fa45419e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:51:54.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:54.474+0000 7fa459c32700 1 -- 172.21.15.153:0/497664536 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa4540ffd10 msgr2=0x7fa454069ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:51:54.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:54.474+0000 7fa459c32700 1 --2- 172.21.15.153:0/497664536 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa4540ffd10 0x7fa454069ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:51:54.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:54.474+0000 7fa459c32700 1 -- 172.21.15.153:0/497664536 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4500095f0 con 0x7fa454100f10 2024-04-01T06:51:54.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:54.474+0000 7fa459c32700 1 --2- 172.21.15.153:0/497664536 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa454100f10 0x7fa45419baf0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa44400c920 tx=0x7fa44400cc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:51:54.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:54.475+0000 7fa44b7fe700 1 -- 172.21.15.153:0/497664536 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa444007b00 con 0x7fa454100f10 2024-04-01T06:51:54.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:54.475+0000 7fa44b7fe700 1 -- 172.21.15.153:0/497664536 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa44400ce70 con 0x7fa454100f10 2024-04-01T06:51:54.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:54.475+0000 7fa45c697700 1 -- 172.21.15.153:0/497664536 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa45419ee30 con 0x7fa454100f10 2024-04-01T06:51:54.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:54.475+0000 7fa44b7fe700 1 -- 172.21.15.153:0/497664536 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4440054e0 con 0x7fa454100f10 2024-04-01T06:51:54.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:54.475+0000 7fa45c697700 1 -- 172.21.15.153:0/497664536 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa45419f2f0 con 0x7fa454100f10 2024-04-01T06:51:54.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:54.476+0000 7fa45c697700 1 -- 172.21.15.153:0/497664536 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4541071e0 con 0x7fa454100f10 2024-04-01T06:51:54.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:54.477+0000 7fa44b7fe700 1 -- 172.21.15.153:0/497664536 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 16) v1 ==== 135865+0+0 (secure 0 0 0) 0x7fa444004750 con 0x7fa454100f10 2024-04-01T06:51:54.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:54.477+0000 7fa44b7fe700 1 --2- 172.21.15.153:0/497664536 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fa4400a1120 0x7fa4400a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:51:54.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:54.477+0000 7fa44b7fe700 1 -- 172.21.15.153:0/497664536 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 3821+0+0 (secure 0 0 0) 0x7fa4440cb690 con 0x7fa454100f10 2024-04-01T06:51:54.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:54.478+0000 7fa45a433700 1 --2- 172.21.15.153:0/497664536 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fa4400a1120 0x7fa4400a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:51:54.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:54.478+0000 7fa45a433700 1 --2- 172.21.15.153:0/497664536 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fa4400a1120 0x7fa4400a35e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa4500038c0 tx=0x7fa450005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:51:54.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:54.481+0000 7fa44b7fe700 1 -- 172.21.15.153:0/497664536 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7fa444095fb0 con 0x7fa454100f10 2024-04-01T06:51:54.502 INFO:journalctl@ceph.osd.4.smithi145.stdout:Apr 01 06:51:54 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-4[61529]: 2024-04-01T06:51:54.046+0000 7f1655ce3700 -1 osd.4 0 waiting for initial osdmap 2024-04-01T06:51:54.502 INFO:journalctl@ceph.osd.4.smithi145.stdout:Apr 01 06:51:54 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-4[61529]: 2024-04-01T06:51:54.052+0000 7f1651ad8700 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T06:51:54.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:54 smithi145 ceph-mon[47816]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-01T06:51:54.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:54 smithi145 ceph-mon[47816]: osdmap e30: 5 total, 4 up, 5 in 2024-04-01T06:51:54.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:54 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-01T06:51:54.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:54 smithi145 ceph-mon[47816]: from='osd.4 [v2:172.21.15.145:6808/2099824730,v1:172.21.15.145:6809/2099824730]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-04-01T06:51:54.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:54 smithi145 ceph-mon[47816]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-04-01T06:51:54.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:54 smithi145 ceph-mon[47816]: Detected new or changed devices on smithi145 2024-04-01T06:51:54.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:54 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:54.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:54 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:54.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:54 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:51:54.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:54 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:51:54.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:54 smithi145 ceph-mon[47816]: Adjusting osd_memory_target on smithi145 to 8556M 2024-04-01T06:51:54.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:54 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:54.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:54 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:51:54.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:54 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:51:54.504 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:54 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:54.504 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:54 smithi145 ceph-mon[47816]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-01T06:51:54.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:54 smithi083 ceph-mon[43429]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-01T06:51:54.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:54 smithi083 ceph-mon[43429]: osdmap e30: 5 total, 4 up, 5 in 2024-04-01T06:51:54.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:54 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-01T06:51:54.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:54 smithi083 ceph-mon[43429]: from='osd.4 [v2:172.21.15.145:6808/2099824730,v1:172.21.15.145:6809/2099824730]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-04-01T06:51:54.513 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:54 smithi083 ceph-mon[43429]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-04-01T06:51:54.513 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:54 smithi083 ceph-mon[43429]: Detected new or changed devices on smithi145 2024-04-01T06:51:54.513 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:54 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:54.513 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:54 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:54.513 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:54 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:51:54.513 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:54 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:51:54.513 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:54 smithi083 ceph-mon[43429]: Adjusting osd_memory_target on smithi145 to 8556M 2024-04-01T06:51:54.513 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:54 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:54.513 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:54 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:51:54.513 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:54 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:51:54.513 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:54 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:51:54.513 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:54 smithi083 ceph-mon[43429]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-01T06:51:54.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:51:54.682+0000 7fa45c697700 1 -- 172.21.15.153:0/497664536 --> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fa45402cd20 con 0x7fa4400a1120 2024-04-01T06:51:55.319 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:55 smithi153 ceph-mon[48187]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-04-01T06:51:55.319 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:55 smithi153 ceph-mon[48187]: osdmap e31: 5 total, 4 up, 5 in 2024-04-01T06:51:55.319 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:55 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-01T06:51:55.320 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:55 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-01T06:51:55.320 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:55 smithi153 ceph-mon[48187]: from='client.24229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:51:55.320 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:55 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T06:51:55.320 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:55 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T06:51:55.320 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:55 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:51:55.502 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:55 smithi145 ceph-mon[47816]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-04-01T06:51:55.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:55 smithi145 ceph-mon[47816]: osdmap e31: 5 total, 4 up, 5 in 2024-04-01T06:51:55.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:55 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-01T06:51:55.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:55 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-01T06:51:55.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:55 smithi145 ceph-mon[47816]: from='client.24229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:51:55.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:55 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T06:51:55.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:55 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T06:51:55.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:55 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:51:55.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:55 smithi083 ceph-mon[43429]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-04-01T06:51:55.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:55 smithi083 ceph-mon[43429]: osdmap e31: 5 total, 4 up, 5 in 2024-04-01T06:51:55.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:55 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-01T06:51:55.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:55 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-01T06:51:55.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:55 smithi083 ceph-mon[43429]: from='client.24229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:51:55.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:55 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T06:51:55.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:55 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T06:51:55.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:55 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:51:56.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:56 smithi153 ceph-mon[48187]: purged_snaps scrub starts 2024-04-01T06:51:56.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:56 smithi153 ceph-mon[48187]: purged_snaps scrub ok 2024-04-01T06:51:56.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:56 smithi153 ceph-mon[48187]: osd.4 [v2:172.21.15.145:6808/2099824730,v1:172.21.15.145:6809/2099824730] boot 2024-04-01T06:51:56.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:56 smithi153 ceph-mon[48187]: osdmap e32: 5 total, 5 up, 5 in 2024-04-01T06:51:56.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:56 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-01T06:51:56.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:56 smithi153 ceph-mon[48187]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-01T06:51:56.502 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:56 smithi145 ceph-mon[47816]: purged_snaps scrub starts 2024-04-01T06:51:56.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:56 smithi145 ceph-mon[47816]: purged_snaps scrub ok 2024-04-01T06:51:56.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:56 smithi145 ceph-mon[47816]: osd.4 [v2:172.21.15.145:6808/2099824730,v1:172.21.15.145:6809/2099824730] boot 2024-04-01T06:51:56.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:56 smithi145 ceph-mon[47816]: osdmap e32: 5 total, 5 up, 5 in 2024-04-01T06:51:56.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:56 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-01T06:51:56.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:56 smithi145 ceph-mon[47816]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-01T06:51:56.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:56 smithi083 ceph-mon[43429]: purged_snaps scrub starts 2024-04-01T06:51:56.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:56 smithi083 ceph-mon[43429]: purged_snaps scrub ok 2024-04-01T06:51:56.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:56 smithi083 ceph-mon[43429]: osd.4 [v2:172.21.15.145:6808/2099824730,v1:172.21.15.145:6809/2099824730] boot 2024-04-01T06:51:56.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:56 smithi083 ceph-mon[43429]: osdmap e32: 5 total, 5 up, 5 in 2024-04-01T06:51:56.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:56 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-01T06:51:56.513 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:56 smithi083 ceph-mon[43429]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-01T06:51:57.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:57 smithi153 ceph-mon[48187]: from='client.? 172.21.15.153:0/87007852' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b8442b71-c26e-467f-b0c3-ea9f636f5a00"}]: dispatch 2024-04-01T06:51:57.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:57 smithi153 ceph-mon[48187]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b8442b71-c26e-467f-b0c3-ea9f636f5a00"}]: dispatch 2024-04-01T06:51:57.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:57 smithi153 ceph-mon[48187]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b8442b71-c26e-467f-b0c3-ea9f636f5a00"}]': finished 2024-04-01T06:51:57.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:57 smithi153 ceph-mon[48187]: osdmap e33: 6 total, 5 up, 6 in 2024-04-01T06:51:57.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:57 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-01T06:51:57.502 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:57 smithi145 ceph-mon[47816]: from='client.? 172.21.15.153:0/87007852' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b8442b71-c26e-467f-b0c3-ea9f636f5a00"}]: dispatch 2024-04-01T06:51:57.502 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:57 smithi145 ceph-mon[47816]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b8442b71-c26e-467f-b0c3-ea9f636f5a00"}]: dispatch 2024-04-01T06:51:57.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:57 smithi145 ceph-mon[47816]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b8442b71-c26e-467f-b0c3-ea9f636f5a00"}]': finished 2024-04-01T06:51:57.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:57 smithi145 ceph-mon[47816]: osdmap e33: 6 total, 5 up, 6 in 2024-04-01T06:51:57.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:57 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-01T06:51:57.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:57 smithi083 ceph-mon[43429]: from='client.? 172.21.15.153:0/87007852' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b8442b71-c26e-467f-b0c3-ea9f636f5a00"}]: dispatch 2024-04-01T06:51:57.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:57 smithi083 ceph-mon[43429]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b8442b71-c26e-467f-b0c3-ea9f636f5a00"}]: dispatch 2024-04-01T06:51:57.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:57 smithi083 ceph-mon[43429]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b8442b71-c26e-467f-b0c3-ea9f636f5a00"}]': finished 2024-04-01T06:51:57.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:57 smithi083 ceph-mon[43429]: osdmap e33: 6 total, 5 up, 6 in 2024-04-01T06:51:57.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:57 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-01T06:51:58.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:58 smithi153 ceph-mon[48187]: from='client.? 172.21.15.153:0/1512620962' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T06:51:58.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:51:58 smithi153 ceph-mon[48187]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-04-01T06:51:58.502 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:58 smithi145 ceph-mon[47816]: from='client.? 172.21.15.153:0/1512620962' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T06:51:58.502 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:51:58 smithi145 ceph-mon[47816]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-04-01T06:51:58.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:58 smithi083 ceph-mon[43429]: from='client.? 172.21.15.153:0/1512620962' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T06:51:58.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:51:58 smithi083 ceph-mon[43429]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-04-01T06:52:01.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:00 smithi145 ceph-mon[47816]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-04-01T06:52:01.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:00 smithi083 ceph-mon[43429]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-04-01T06:52:01.027 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:00 smithi153 ceph-mon[48187]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-04-01T06:52:03.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:02 smithi145 ceph-mon[47816]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-04-01T06:52:03.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:02 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-01T06:52:03.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:02 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:52:03.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:02 smithi083 ceph-mon[43429]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-04-01T06:52:03.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:02 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-01T06:52:03.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:02 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:52:03.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:02 smithi153 ceph-mon[48187]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-04-01T06:52:03.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:02 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-01T06:52:03.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:02 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:52:03.890 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:03 smithi153 ceph-mon[48187]: Deploying daemon osd.5 on smithi153 2024-04-01T06:52:04.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:03 smithi145 ceph-mon[47816]: Deploying daemon osd.5 on smithi153 2024-04-01T06:52:04.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:03 smithi083 ceph-mon[43429]: Deploying daemon osd.5 on smithi153 2024-04-01T06:52:05.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:04 smithi145 ceph-mon[47816]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-04-01T06:52:05.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:04 smithi083 ceph-mon[43429]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-04-01T06:52:05.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:04 smithi153 ceph-mon[48187]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-04-01T06:52:06.890 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:06 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:06.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:06 smithi153 ceph-mon[48187]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-04-01T06:52:06.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:06 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:06.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:06 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:52:07.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:06 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:07.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:06 smithi145 ceph-mon[47816]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-04-01T06:52:07.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:06 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:07.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:06 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:52:07.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:06 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:07.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:06 smithi083 ceph-mon[43429]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-04-01T06:52:07.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:06 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:07.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:06 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:52:07.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:07.889+0000 7fa44b7fe700 1 -- 172.21.15.153:0/497664536 <== mgr.14152 v2:172.21.15.83:6800/3375372052 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fa45402cd20 con 0x7fa4400a1120 2024-04-01T06:52:07.890 INFO:teuthology.orchestra.run.smithi153.stdout:Created osd(s) 5 on host 'smithi153' 2024-04-01T06:52:07.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:07.891+0000 7fa45c697700 1 -- 172.21.15.153:0/497664536 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fa4400a1120 msgr2=0x7fa4400a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:52:07.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:07.891+0000 7fa45c697700 1 --2- 172.21.15.153:0/497664536 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fa4400a1120 0x7fa4400a35e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa4500038c0 tx=0x7fa450005fb0 comp rx=0 tx=0).stop 2024-04-01T06:52:07.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:07.891+0000 7fa45c697700 1 -- 172.21.15.153:0/497664536 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa454100f10 msgr2=0x7fa45419baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:52:07.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:07.891+0000 7fa45c697700 1 --2- 172.21.15.153:0/497664536 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa454100f10 0x7fa45419baf0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa44400c920 tx=0x7fa44400cc30 comp rx=0 tx=0).stop 2024-04-01T06:52:07.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:07.892+0000 7fa45c697700 1 -- 172.21.15.153:0/497664536 shutdown_connections 2024-04-01T06:52:07.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:07.892+0000 7fa45c697700 1 --2- 172.21.15.153:0/497664536 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa4540ffd10 0x7fa454069ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:52:07.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:07.892+0000 7fa45c697700 1 --2- 172.21.15.153:0/497664536 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fa4400a1120 0x7fa4400a35e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:52:07.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:07.892+0000 7fa45c697700 1 --2- 172.21.15.153:0/497664536 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa4541018b0 0x7fa45419e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:52:07.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:07.892+0000 7fa45c697700 1 --2- 172.21.15.153:0/497664536 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa454100f10 0x7fa45419baf0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:52:07.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:07.892+0000 7fa45c697700 1 -- 172.21.15.153:0/497664536 >> 172.21.15.153:0/497664536 conn(0x7fa4540fb2b0 msgr2=0x7fa454104320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:52:07.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:07.892+0000 7fa45c697700 1 -- 172.21.15.153:0/497664536 shutdown_connections 2024-04-01T06:52:07.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:07.892+0000 7fa45c697700 1 -- 172.21.15.153:0/497664536 wait complete. 2024-04-01T06:52:08.185 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:08 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:08.185 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:08 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:08.185 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:08 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:52:08.185 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:08 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:52:08.185 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:08 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:08.185 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:08 smithi153 ceph-mon[48187]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-04-01T06:52:08.185 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:08 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:08.185 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:08 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:52:08.185 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:08 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:08.277 DEBUG:teuthology.orchestra.run.smithi153:osd.5> sudo journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@osd.5.service 2024-04-01T06:52:08.279 INFO:tasks.cephadm:Deploying osd.6 on smithi083 with /dev/vg_nvme/lv_2... 2024-04-01T06:52:08.280 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-01T06:52:08.310 INFO:journalctl@ceph.osd.5.smithi153.stdout:-- Logs begin at Mon 2024-04-01 06:35:09 UTC. -- 2024-04-01T06:52:08.502 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:08 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:08.502 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:08 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:08.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:08 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:52:08.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:08 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:52:08.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:08 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:08.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:08 smithi145 ceph-mon[47816]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-04-01T06:52:08.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:08 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:08.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:08 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:52:08.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:08 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:08.510 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:52:08.514 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:08 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:08.514 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:08 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:08.514 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:08 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:52:08.514 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:08 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:52:08.514 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:08 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:08.514 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:08 smithi083 ceph-mon[43429]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-04-01T06:52:08.514 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:08 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:08.514 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:08 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:52:08.515 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:08 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:09.789 INFO:teuthology.orchestra.run.smithi083.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-01T06:52:09.789 INFO:teuthology.orchestra.run.smithi083.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-01T06:52:09.789 INFO:teuthology.orchestra.run.smithi083.stderr: stderr: 10+0 records in 2024-04-01T06:52:09.789 INFO:teuthology.orchestra.run.smithi083.stderr:10+0 records out 2024-04-01T06:52:09.789 INFO:teuthology.orchestra.run.smithi083.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0154775 s, 677 MB/s 2024-04-01T06:52:09.790 INFO:teuthology.orchestra.run.smithi083.stderr:--> Zapping successful for: 2024-04-01T06:52:10.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:09 smithi145 ceph-mon[47816]: from='osd.5 [v2:172.21.15.153:6808/3340941443,v1:172.21.15.153:6809/3340941443]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-01T06:52:10.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:09 smithi145 ceph-mon[47816]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-01T06:52:10.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:09 smithi083 ceph-mon[43429]: from='osd.5 [v2:172.21.15.153:6808/3340941443,v1:172.21.15.153:6809/3340941443]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-01T06:52:10.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:09 smithi083 ceph-mon[43429]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-01T06:52:10.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:09 smithi153 ceph-mon[48187]: from='osd.5 [v2:172.21.15.153:6808/3340941443,v1:172.21.15.153:6809/3340941443]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-01T06:52:10.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:09 smithi153 ceph-mon[48187]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-01T06:52:10.141 INFO:journalctl@ceph.osd.5.smithi153.stdout:Apr 01 06:52:09 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-5[62405]: 2024-04-01T06:52:09.688+0000 7fbc51510640 -1 osd.5 0 log_to_monitors true 2024-04-01T06:52:10.173 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi083:vg_nvme/lv_2 2024-04-01T06:52:10.390 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:52:11.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:10 smithi083 ceph-mon[43429]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-04-01T06:52:11.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:10 smithi083 ceph-mon[43429]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-01T06:52:11.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:10 smithi083 ceph-mon[43429]: osdmap e34: 6 total, 5 up, 6 in 2024-04-01T06:52:11.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:10 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-01T06:52:11.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:10 smithi083 ceph-mon[43429]: from='osd.5 [v2:172.21.15.153:6808/3340941443,v1:172.21.15.153:6809/3340941443]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-04-01T06:52:11.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:10 smithi083 ceph-mon[43429]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-04-01T06:52:11.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:10 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:11.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:10 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:11.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:10 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:52:11.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:10 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:52:11.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:10 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:11.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:10 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:52:11.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:10 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:52:11.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:10 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:11.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:10 smithi153 ceph-mon[48187]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-04-01T06:52:11.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:10 smithi153 ceph-mon[48187]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-01T06:52:11.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:10 smithi153 ceph-mon[48187]: osdmap e34: 6 total, 5 up, 6 in 2024-04-01T06:52:11.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:10 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-01T06:52:11.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:10 smithi153 ceph-mon[48187]: from='osd.5 [v2:172.21.15.153:6808/3340941443,v1:172.21.15.153:6809/3340941443]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-04-01T06:52:11.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:10 smithi153 ceph-mon[48187]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-04-01T06:52:11.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:10 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:11.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:10 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:11.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:10 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:52:11.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:10 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:52:11.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:10 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:11.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:10 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:52:11.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:10 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:52:11.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:10 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:11.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:10 smithi145 ceph-mon[47816]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-04-01T06:52:11.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:10 smithi145 ceph-mon[47816]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-01T06:52:11.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:10 smithi145 ceph-mon[47816]: osdmap e34: 6 total, 5 up, 6 in 2024-04-01T06:52:11.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:10 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-01T06:52:11.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:10 smithi145 ceph-mon[47816]: from='osd.5 [v2:172.21.15.153:6808/3340941443,v1:172.21.15.153:6809/3340941443]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-04-01T06:52:11.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:10 smithi145 ceph-mon[47816]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-04-01T06:52:11.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:10 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:11.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:10 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:11.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:10 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:52:11.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:10 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:52:11.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:10 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:11.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:10 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:52:11.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:10 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:52:11.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:10 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:11.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:52:11.332+0000 7f86bbd50700 1 -- 172.21.15.83:0/3422320961 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86b4102090 msgr2=0x7f86b41024f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:52:11.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:52:11.332+0000 7f86bbd50700 1 --2- 172.21.15.83:0/3422320961 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86b4102090 0x7f86b41024f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f86b0009990 tx=0x7f86b0009ca0 comp rx=0 tx=0).stop 2024-04-01T06:52:11.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:52:11.332+0000 7f86bbd50700 1 -- 172.21.15.83:0/3422320961 shutdown_connections 2024-04-01T06:52:11.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:52:11.332+0000 7f86bbd50700 1 --2- 172.21.15.83:0/3422320961 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86b4102a30 0x7f86b41092e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:52:11.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:52:11.332+0000 7f86bbd50700 1 --2- 172.21.15.83:0/3422320961 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f86b40ff0b0 0x7f86b40ff4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:52:11.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:52:11.332+0000 7f86bbd50700 1 --2- 172.21.15.83:0/3422320961 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86b4102090 0x7f86b41024f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:52:11.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:52:11.332+0000 7f86bbd50700 1 -- 172.21.15.83:0/3422320961 >> 172.21.15.83:0/3422320961 conn(0x7f86b40faa10 msgr2=0x7f86b40fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:52:11.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:52:11.332+0000 7f86bbd50700 1 -- 172.21.15.83:0/3422320961 shutdown_connections 2024-04-01T06:52:11.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:52:11.332+0000 7f86bbd50700 1 -- 172.21.15.83:0/3422320961 wait complete. 2024-04-01T06:52:11.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:52:11.333+0000 7f86bbd50700 1 Processor -- start 2024-04-01T06:52:11.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:52:11.333+0000 7f86bbd50700 1 -- start start 2024-04-01T06:52:11.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:52:11.333+0000 7f86bbd50700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86b40ff0b0 0x7f86b4196d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:52:11.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:52:11.333+0000 7f86bbd50700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f86b4102090 0x7f86b41972c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:52:11.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:52:11.333+0000 7f86bbd50700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86b4102a30 0x7f86b419e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:52:11.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:52:11.333+0000 7f86bbd50700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b419e880 con 0x7f86b4102a30 2024-04-01T06:52:11.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:52:11.333+0000 7f86bbd50700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b419e9c0 con 0x7f86b4102090 2024-04-01T06:52:11.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:52:11.333+0000 7f86bbd50700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b419eb80 con 0x7f86b40ff0b0 2024-04-01T06:52:11.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:52:11.333+0000 7f86ba2ed700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86b4102a30 0x7f86b419e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:52:11.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:52:11.333+0000 7f86ba2ed700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86b4102a30 0x7f86b419e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43154/0 (socket says 172.21.15.83:43154) 2024-04-01T06:52:11.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:52:11.333+0000 7f86ba2ed700 1 -- 172.21.15.83:0/2577752317 learned_addr learned my addr 172.21.15.83:0/2577752317 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:52:11.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:52:11.333+0000 7f86b9aec700 1 --2- 172.21.15.83:0/2577752317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86b40ff0b0 0x7f86b4196d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:52:11.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:52:11.333+0000 7f86b92eb700 1 --2- 172.21.15.83:0/2577752317 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f86b4102090 0x7f86b41972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:52:11.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:52:11.334+0000 7f86ba2ed700 1 -- 172.21.15.83:0/2577752317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86b40ff0b0 msgr2=0x7f86b4196d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:52:11.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:52:11.334+0000 7f86ba2ed700 1 --2- 172.21.15.83:0/2577752317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86b40ff0b0 0x7f86b4196d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:52:11.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:52:11.334+0000 7f86ba2ed700 1 -- 172.21.15.83:0/2577752317 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f86b4102090 msgr2=0x7f86b41972c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:52:11.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:52:11.334+0000 7f86ba2ed700 1 --2- 172.21.15.83:0/2577752317 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f86b4102090 0x7f86b41972c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:52:11.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:52:11.334+0000 7f86ba2ed700 1 -- 172.21.15.83:0/2577752317 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b00095f0 con 0x7f86b4102a30 2024-04-01T06:52:11.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:52:11.334+0000 7f86ba2ed700 1 --2- 172.21.15.83:0/2577752317 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86b4102a30 0x7f86b419e2b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f86ac00ef30 tx=0x7f86ac00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:52:11.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:52:11.334+0000 7f86a6ffd700 1 -- 172.21.15.83:0/2577752317 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ac018070 con 0x7f86b4102a30 2024-04-01T06:52:11.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:52:11.334+0000 7f86bbd50700 1 -- 172.21.15.83:0/2577752317 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86b419ee00 con 0x7f86b4102a30 2024-04-01T06:52:11.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:52:11.334+0000 7f86a6ffd700 1 -- 172.21.15.83:0/2577752317 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f86ac00f040 con 0x7f86b4102a30 2024-04-01T06:52:11.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:52:11.334+0000 7f86a6ffd700 1 -- 172.21.15.83:0/2577752317 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ac00cd00 con 0x7f86b4102a30 2024-04-01T06:52:11.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:52:11.334+0000 7f86bbd50700 1 -- 172.21.15.83:0/2577752317 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86b419f220 con 0x7f86b4102a30 2024-04-01T06:52:11.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:52:11.335+0000 7f86bbd50700 1 -- 172.21.15.83:0/2577752317 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86b4108310 con 0x7f86b4102a30 2024-04-01T06:52:11.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:52:11.336+0000 7f86a6ffd700 1 -- 172.21.15.83:0/2577752317 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) v1 ==== 135865+0+0 (secure 0 0 0) 0x7f86ac003a00 con 0x7f86b4102a30 2024-04-01T06:52:11.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:52:11.336+0000 7f86a6ffd700 1 --2- 172.21.15.83:0/2577752317 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f86a00a1120 0x7f86a00a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:52:11.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:52:11.337+0000 7f86b9aec700 1 --2- 172.21.15.83:0/2577752317 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f86a00a1120 0x7f86a00a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:52:11.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:52:11.337+0000 7f86a6ffd700 1 -- 172.21.15.83:0/2577752317 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4253+0+0 (secure 0 0 0) 0x7f86ac0cb4d0 con 0x7f86b4102a30 2024-04-01T06:52:11.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:52:11.337+0000 7f86b9aec700 1 --2- 172.21.15.83:0/2577752317 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f86a00a1120 0x7f86a00a35e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f86b4198210 tx=0x7f86a8009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:52:11.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:52:11.341+0000 7f86a6ffd700 1 -- 172.21.15.83:0/2577752317 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f86ac095c30 con 0x7f86b4102a30 2024-04-01T06:52:11.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:52:11.541+0000 7f86bbd50700 1 -- 172.21.15.83:0/2577752317 --> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f86b402ce10 con 0x7f86a00a1120 2024-04-01T06:52:11.640 INFO:journalctl@ceph.osd.5.smithi153.stdout:Apr 01 06:52:11 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-5[62405]: 2024-04-01T06:52:11.240+0000 7fbc46b74700 -1 osd.5 0 waiting for initial osdmap 2024-04-01T06:52:11.640 INFO:journalctl@ceph.osd.5.smithi153.stdout:Apr 01 06:52:11 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-5[62405]: 2024-04-01T06:52:11.246+0000 7fbc3e961700 -1 osd.5 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T06:52:12.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:11 smithi083 ceph-mon[43429]: Detected new or changed devices on smithi153 2024-04-01T06:52:12.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:11 smithi083 ceph-mon[43429]: Adjusting osd_memory_target on smithi153 to 8557M 2024-04-01T06:52:12.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:11 smithi083 ceph-mon[43429]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-04-01T06:52:12.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:11 smithi083 ceph-mon[43429]: osdmap e35: 6 total, 5 up, 6 in 2024-04-01T06:52:12.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:11 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-01T06:52:12.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:11 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-01T06:52:12.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:11 smithi083 ceph-mon[43429]: from='osd.5 ' entity='osd.5' 2024-04-01T06:52:12.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:11 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T06:52:12.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:11 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T06:52:12.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:11 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:52:12.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:11 smithi153 ceph-mon[48187]: Detected new or changed devices on smithi153 2024-04-01T06:52:12.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:11 smithi153 ceph-mon[48187]: Adjusting osd_memory_target on smithi153 to 8557M 2024-04-01T06:52:12.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:11 smithi153 ceph-mon[48187]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-04-01T06:52:12.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:11 smithi153 ceph-mon[48187]: osdmap e35: 6 total, 5 up, 6 in 2024-04-01T06:52:12.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:11 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-01T06:52:12.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:11 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-01T06:52:12.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:11 smithi153 ceph-mon[48187]: from='osd.5 ' entity='osd.5' 2024-04-01T06:52:12.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:11 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T06:52:12.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:11 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T06:52:12.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:11 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:52:12.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:11 smithi145 ceph-mon[47816]: Detected new or changed devices on smithi153 2024-04-01T06:52:12.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:11 smithi145 ceph-mon[47816]: Adjusting osd_memory_target on smithi153 to 8557M 2024-04-01T06:52:12.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:11 smithi145 ceph-mon[47816]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-04-01T06:52:12.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:11 smithi145 ceph-mon[47816]: osdmap e35: 6 total, 5 up, 6 in 2024-04-01T06:52:12.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:11 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-01T06:52:12.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:11 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-01T06:52:12.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:11 smithi145 ceph-mon[47816]: from='osd.5 ' entity='osd.5' 2024-04-01T06:52:12.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:11 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T06:52:12.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:11 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T06:52:12.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:11 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:52:13.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:12 smithi083 ceph-mon[43429]: purged_snaps scrub starts 2024-04-01T06:52:13.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:12 smithi083 ceph-mon[43429]: purged_snaps scrub ok 2024-04-01T06:52:13.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:12 smithi083 ceph-mon[43429]: from='client.14367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:52:13.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:12 smithi083 ceph-mon[43429]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-04-01T06:52:13.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:12 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-01T06:52:13.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:12 smithi083 ceph-mon[43429]: osd.5 [v2:172.21.15.153:6808/3340941443,v1:172.21.15.153:6809/3340941443] boot 2024-04-01T06:52:13.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:12 smithi083 ceph-mon[43429]: osdmap e36: 6 total, 6 up, 6 in 2024-04-01T06:52:13.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:12 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-01T06:52:13.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:12 smithi153 ceph-mon[48187]: purged_snaps scrub starts 2024-04-01T06:52:13.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:12 smithi153 ceph-mon[48187]: purged_snaps scrub ok 2024-04-01T06:52:13.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:12 smithi153 ceph-mon[48187]: from='client.14367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:52:13.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:12 smithi153 ceph-mon[48187]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-04-01T06:52:13.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:12 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-01T06:52:13.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:12 smithi153 ceph-mon[48187]: osd.5 [v2:172.21.15.153:6808/3340941443,v1:172.21.15.153:6809/3340941443] boot 2024-04-01T06:52:13.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:12 smithi153 ceph-mon[48187]: osdmap e36: 6 total, 6 up, 6 in 2024-04-01T06:52:13.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:12 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-01T06:52:13.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:12 smithi145 ceph-mon[47816]: purged_snaps scrub starts 2024-04-01T06:52:13.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:12 smithi145 ceph-mon[47816]: purged_snaps scrub ok 2024-04-01T06:52:13.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:12 smithi145 ceph-mon[47816]: from='client.14367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:52:13.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:12 smithi145 ceph-mon[47816]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-04-01T06:52:13.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:12 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-01T06:52:13.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:12 smithi145 ceph-mon[47816]: osd.5 [v2:172.21.15.153:6808/3340941443,v1:172.21.15.153:6809/3340941443] boot 2024-04-01T06:52:13.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:12 smithi145 ceph-mon[47816]: osdmap e36: 6 total, 6 up, 6 in 2024-04-01T06:52:13.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:12 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-01T06:52:14.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:13 smithi153 ceph-mon[48187]: osdmap e37: 6 total, 6 up, 6 in 2024-04-01T06:52:14.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:13 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/1491412536' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c26bb8cb-ccee-4bfc-91eb-14e1ad8e04df"}]: dispatch 2024-04-01T06:52:14.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:13 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/1491412536' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c26bb8cb-ccee-4bfc-91eb-14e1ad8e04df"}]': finished 2024-04-01T06:52:14.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:13 smithi153 ceph-mon[48187]: osdmap e38: 7 total, 6 up, 7 in 2024-04-01T06:52:14.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:13 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-01T06:52:14.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:13 smithi145 ceph-mon[47816]: osdmap e37: 6 total, 6 up, 6 in 2024-04-01T06:52:14.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:13 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/1491412536' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c26bb8cb-ccee-4bfc-91eb-14e1ad8e04df"}]: dispatch 2024-04-01T06:52:14.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:13 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/1491412536' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c26bb8cb-ccee-4bfc-91eb-14e1ad8e04df"}]': finished 2024-04-01T06:52:14.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:13 smithi145 ceph-mon[47816]: osdmap e38: 7 total, 6 up, 7 in 2024-04-01T06:52:14.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:13 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-01T06:52:14.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:13 smithi083 ceph-mon[43429]: osdmap e37: 6 total, 6 up, 6 in 2024-04-01T06:52:14.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:13 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/1491412536' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c26bb8cb-ccee-4bfc-91eb-14e1ad8e04df"}]: dispatch 2024-04-01T06:52:14.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:13 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/1491412536' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c26bb8cb-ccee-4bfc-91eb-14e1ad8e04df"}]': finished 2024-04-01T06:52:14.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:13 smithi083 ceph-mon[43429]: osdmap e38: 7 total, 6 up, 7 in 2024-04-01T06:52:14.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:13 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-01T06:52:15.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:14 smithi153 ceph-mon[48187]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail 2024-04-01T06:52:15.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:14 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/485718743' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T06:52:15.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:14 smithi153 ceph-mon[48187]: osdmap e39: 7 total, 6 up, 7 in 2024-04-01T06:52:15.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:14 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-01T06:52:15.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:14 smithi145 ceph-mon[47816]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail 2024-04-01T06:52:15.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:14 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/485718743' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T06:52:15.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:14 smithi145 ceph-mon[47816]: osdmap e39: 7 total, 6 up, 7 in 2024-04-01T06:52:15.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:14 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-01T06:52:15.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:14 smithi083 ceph-mon[43429]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail 2024-04-01T06:52:15.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:14 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/485718743' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T06:52:15.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:14 smithi083 ceph-mon[43429]: osdmap e39: 7 total, 6 up, 7 in 2024-04-01T06:52:15.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:14 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-01T06:52:16.640 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:16 smithi153 ceph-mon[48187]: osdmap e40: 7 total, 6 up, 7 in 2024-04-01T06:52:16.641 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:16 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-01T06:52:16.641 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:16 smithi153 ceph-mon[48187]: pgmap v111: 1 pgs: 1 peering; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail; 147 KiB/s, 0 objects/s recovering 2024-04-01T06:52:16.752 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:16 smithi145 ceph-mon[47816]: osdmap e40: 7 total, 6 up, 7 in 2024-04-01T06:52:16.752 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:16 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-01T06:52:16.753 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:16 smithi145 ceph-mon[47816]: pgmap v111: 1 pgs: 1 peering; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail; 147 KiB/s, 0 objects/s recovering 2024-04-01T06:52:16.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:16 smithi083 ceph-mon[43429]: osdmap e40: 7 total, 6 up, 7 in 2024-04-01T06:52:16.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:16 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-01T06:52:16.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:16 smithi083 ceph-mon[43429]: pgmap v111: 1 pgs: 1 peering; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail; 147 KiB/s, 0 objects/s recovering 2024-04-01T06:52:18.993 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:18 smithi083 ceph-mon[43429]: pgmap v112: 1 pgs: 1 peering; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-04-01T06:52:19.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:18 smithi145 ceph-mon[47816]: pgmap v112: 1 pgs: 1 peering; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-04-01T06:52:19.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:18 smithi153 ceph-mon[48187]: pgmap v112: 1 pgs: 1 peering; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-04-01T06:52:19.890 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:19 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-04-01T06:52:19.890 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:19 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:52:20.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:19 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-04-01T06:52:20.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:19 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:52:20.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:19 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-04-01T06:52:20.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:19 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:52:21.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:20 smithi145 ceph-mon[47816]: Deploying daemon osd.6 on smithi083 2024-04-01T06:52:21.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:20 smithi145 ceph-mon[47816]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-04-01T06:52:21.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:20 smithi083 ceph-mon[43429]: Deploying daemon osd.6 on smithi083 2024-04-01T06:52:21.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:20 smithi083 ceph-mon[43429]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-04-01T06:52:21.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:20 smithi153 ceph-mon[48187]: Deploying daemon osd.6 on smithi083 2024-04-01T06:52:21.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:20 smithi153 ceph-mon[48187]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-04-01T06:52:23.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:22 smithi145 ceph-mon[47816]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-01T06:52:23.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:22 smithi083 ceph-mon[43429]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-01T06:52:23.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:22 smithi153 ceph-mon[48187]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-01T06:52:24.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:23 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:24.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:23 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:24.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:23 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:52:24.151 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:23 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:24.151 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:23 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:24.151 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:23 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:52:24.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:23 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:24.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:23 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:24.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:23 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:52:24.953 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:24 smithi083 ceph-mon[43429]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-04-01T06:52:24.953 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:24 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:24.953 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:24 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:24.953 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:24 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:52:24.953 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:24 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:52:24.954 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:24 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:25.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:52:25.034+0000 7f86a6ffd700 1 -- 172.21.15.83:0/2577752317 <== mgr.14152 v2:172.21.15.83:6800/3375372052 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f86b402ce10 con 0x7f86a00a1120 2024-04-01T06:52:25.034 INFO:teuthology.orchestra.run.smithi083.stdout:Created osd(s) 6 on host 'smithi083' 2024-04-01T06:52:25.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:52:25.036+0000 7f86bbd50700 1 -- 172.21.15.83:0/2577752317 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f86a00a1120 msgr2=0x7f86a00a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:52:25.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:52:25.036+0000 7f86bbd50700 1 --2- 172.21.15.83:0/2577752317 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f86a00a1120 0x7f86a00a35e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f86b4198210 tx=0x7f86a8009190 comp rx=0 tx=0).stop 2024-04-01T06:52:25.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:52:25.036+0000 7f86bbd50700 1 -- 172.21.15.83:0/2577752317 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86b4102a30 msgr2=0x7f86b419e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:52:25.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:52:25.036+0000 7f86bbd50700 1 --2- 172.21.15.83:0/2577752317 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86b4102a30 0x7f86b419e2b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f86ac00ef30 tx=0x7f86ac00c3a0 comp rx=0 tx=0).stop 2024-04-01T06:52:25.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:52:25.036+0000 7f86bbd50700 1 -- 172.21.15.83:0/2577752317 shutdown_connections 2024-04-01T06:52:25.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:52:25.036+0000 7f86bbd50700 1 --2- 172.21.15.83:0/2577752317 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86b4102a30 0x7f86b419e2b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:52:25.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:52:25.036+0000 7f86bbd50700 1 --2- 172.21.15.83:0/2577752317 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f86a00a1120 0x7f86a00a35e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:52:25.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:52:25.036+0000 7f86bbd50700 1 --2- 172.21.15.83:0/2577752317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86b40ff0b0 0x7f86b4196d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:52:25.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:52:25.036+0000 7f86bbd50700 1 --2- 172.21.15.83:0/2577752317 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f86b4102090 0x7f86b41972c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:52:25.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:52:25.036+0000 7f86bbd50700 1 -- 172.21.15.83:0/2577752317 >> 172.21.15.83:0/2577752317 conn(0x7f86b40faa10 msgr2=0x7f86b4105450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:52:25.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:52:25.036+0000 7f86bbd50700 1 -- 172.21.15.83:0/2577752317 shutdown_connections 2024-04-01T06:52:25.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:52:25.036+0000 7f86bbd50700 1 -- 172.21.15.83:0/2577752317 wait complete. 2024-04-01T06:52:25.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:24 smithi153 ceph-mon[48187]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-04-01T06:52:25.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:24 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:25.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:24 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:25.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:24 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:52:25.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:24 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:52:25.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:24 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:25.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:24 smithi145 ceph-mon[47816]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-04-01T06:52:25.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:24 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:25.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:24 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:25.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:24 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:52:25.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:24 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:52:25.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:24 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:25.425 DEBUG:teuthology.orchestra.run.smithi083:osd.6> sudo journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@osd.6.service 2024-04-01T06:52:25.428 INFO:tasks.cephadm:Deploying osd.7 on smithi145 with /dev/vg_nvme/lv_2... 2024-04-01T06:52:25.428 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-01T06:52:25.462 INFO:journalctl@ceph.osd.6.smithi083.stdout:-- Logs begin at Mon 2024-04-01 06:34:54 UTC. -- 2024-04-01T06:52:25.658 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T06:52:26.147 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:26 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:26.147 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:26 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:26.147 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:26 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:52:26.147 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:26 smithi145 ceph-mon[47816]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-04-01T06:52:26.234 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:26 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:26.235 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:26 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:26.235 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:26 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:52:26.235 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:26 smithi083 ceph-mon[43429]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-04-01T06:52:26.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:26 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:26.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:26 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:26.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:26 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:52:26.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:26 smithi153 ceph-mon[48187]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-04-01T06:52:27.034 INFO:teuthology.orchestra.run.smithi145.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-01T06:52:27.034 INFO:teuthology.orchestra.run.smithi145.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-01T06:52:27.034 INFO:teuthology.orchestra.run.smithi145.stderr: stderr: 10+0 records in 2024-04-01T06:52:27.034 INFO:teuthology.orchestra.run.smithi145.stderr:10+0 records out 2024-04-01T06:52:27.034 INFO:teuthology.orchestra.run.smithi145.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0140675 s, 745 MB/s 2024-04-01T06:52:27.034 INFO:teuthology.orchestra.run.smithi145.stderr: stderr: 2024-04-01T06:52:27.035 INFO:teuthology.orchestra.run.smithi145.stderr:--> Zapping successful for: 2024-04-01T06:52:27.109 INFO:journalctl@ceph.osd.6.smithi083.stdout:Apr 01 06:52:26 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-6[78927]: 2024-04-01T06:52:26.834+0000 7fac3eb10640 -1 osd.6 0 log_to_monitors true 2024-04-01T06:52:27.366 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi145:vg_nvme/lv_2 2024-04-01T06:52:27.584 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T06:52:28.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:27 smithi145 ceph-mon[47816]: from='osd.6 [v2:172.21.15.83:6818/2005485079,v1:172.21.15.83:6819/2005485079]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-01T06:52:28.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:27 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:28.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:27 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:28.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:27 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:52:28.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:27 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:52:28.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:27 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:52:28.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:27 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:28.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:27 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:52:28.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:27 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:52:28.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:27 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:28.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:27 smithi083 ceph-mon[43429]: from='osd.6 [v2:172.21.15.83:6818/2005485079,v1:172.21.15.83:6819/2005485079]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-01T06:52:28.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:27 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:28.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:27 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:28.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:27 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:52:28.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:27 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:52:28.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:27 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:52:28.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:27 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:28.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:27 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:52:28.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:27 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:52:28.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:27 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:28.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:27 smithi153 ceph-mon[48187]: from='osd.6 [v2:172.21.15.83:6818/2005485079,v1:172.21.15.83:6819/2005485079]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-01T06:52:28.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:27 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:28.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:27 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:28.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:27 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:52:28.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:27 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:52:28.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:27 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:52:28.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:27 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:28.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:27 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:52:28.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:27 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:52:28.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:27 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:28.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:52:28.603+0000 7f43d38b3700 1 -- 172.21.15.145:0/4078007391 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f43cc100ef0 msgr2=0x7f43cc101350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:52:28.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:52:28.603+0000 7f43d38b3700 1 --2- 172.21.15.145:0/4078007391 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f43cc100ef0 0x7f43cc101350 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f43bc009920 tx=0x7f43bc009c30 comp rx=0 tx=0).stop 2024-04-01T06:52:28.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:52:28.603+0000 7f43d38b3700 1 -- 172.21.15.145:0/4078007391 shutdown_connections 2024-04-01T06:52:28.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:52:28.603+0000 7f43d38b3700 1 --2- 172.21.15.145:0/4078007391 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f43cc0ffcf0 0x7f43cc100110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:52:28.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:52:28.603+0000 7f43d38b3700 1 --2- 172.21.15.145:0/4078007391 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43cc101890 0x7f43cc108140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:52:28.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:52:28.603+0000 7f43d38b3700 1 --2- 172.21.15.145:0/4078007391 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f43cc100ef0 0x7f43cc101350 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:52:28.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:52:28.603+0000 7f43d38b3700 1 -- 172.21.15.145:0/4078007391 >> 172.21.15.145:0/4078007391 conn(0x7f43cc0fb2b0 msgr2=0x7f43cc0fd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:52:28.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:52:28.603+0000 7f43d38b3700 1 -- 172.21.15.145:0/4078007391 shutdown_connections 2024-04-01T06:52:28.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:52:28.603+0000 7f43d38b3700 1 -- 172.21.15.145:0/4078007391 wait complete. 2024-04-01T06:52:28.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:52:28.604+0000 7f43d38b3700 1 Processor -- start 2024-04-01T06:52:28.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:52:28.604+0000 7f43d38b3700 1 -- start start 2024-04-01T06:52:28.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:52:28.604+0000 7f43d38b3700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f43cc0ffcf0 0x7f43cc103c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:52:28.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:52:28.604+0000 7f43d38b3700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f43cc100ef0 0x7f43cc1022d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:52:28.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:52:28.604+0000 7f43d38b3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43cc101890 0x7f43cc102810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:52:28.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:52:28.604+0000 7f43d38b3700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc102fb0 con 0x7f43cc0ffcf0 2024-04-01T06:52:28.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:52:28.604+0000 7f43d38b3700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc103120 con 0x7f43cc100ef0 2024-04-01T06:52:28.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:52:28.604+0000 7f43d38b3700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc1a0e30 con 0x7f43cc101890 2024-04-01T06:52:28.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:52:28.604+0000 7f43d0e4e700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f43cc100ef0 0x7f43cc1022d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:52:28.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:52:28.604+0000 7f43d0e4e700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f43cc100ef0 0x7f43cc1022d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:51424/0 (socket says 172.21.15.145:51424) 2024-04-01T06:52:28.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:52:28.604+0000 7f43d0e4e700 1 -- 172.21.15.145:0/3196097798 learned_addr learned my addr 172.21.15.145:0/3196097798 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-04-01T06:52:28.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:52:28.604+0000 7f43d164f700 1 --2- 172.21.15.145:0/3196097798 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f43cc0ffcf0 0x7f43cc103c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:52:28.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:52:28.604+0000 7f43d1e50700 1 --2- 172.21.15.145:0/3196097798 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43cc101890 0x7f43cc102810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:52:28.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:52:28.604+0000 7f43d0e4e700 1 -- 172.21.15.145:0/3196097798 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43cc101890 msgr2=0x7f43cc102810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:52:28.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:52:28.604+0000 7f43d0e4e700 1 --2- 172.21.15.145:0/3196097798 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43cc101890 0x7f43cc102810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:52:28.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:52:28.604+0000 7f43d0e4e700 1 -- 172.21.15.145:0/3196097798 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f43cc0ffcf0 msgr2=0x7f43cc103c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:52:28.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:52:28.604+0000 7f43d0e4e700 1 --2- 172.21.15.145:0/3196097798 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f43cc0ffcf0 0x7f43cc103c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:52:28.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:52:28.604+0000 7f43d0e4e700 1 -- 172.21.15.145:0/3196097798 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43bc009520 con 0x7f43cc100ef0 2024-04-01T06:52:28.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:52:28.604+0000 7f43d1e50700 1 --2- 172.21.15.145:0/3196097798 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43cc101890 0x7f43cc102810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:52:28.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:52:28.605+0000 7f43d0e4e700 1 --2- 172.21.15.145:0/3196097798 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f43cc100ef0 0x7f43cc1022d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f43bc005e90 tx=0x7f43bc00b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:52:28.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:52:28.605+0000 7f43c27fc700 1 -- 172.21.15.145:0/3196097798 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43bc01c070 con 0x7f43cc100ef0 2024-04-01T06:52:28.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:52:28.605+0000 7f43c27fc700 1 -- 172.21.15.145:0/3196097798 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f43bc00f7f0 con 0x7f43cc100ef0 2024-04-01T06:52:28.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:52:28.605+0000 7f43d38b3700 1 -- 172.21.15.145:0/3196097798 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43cc1a1060 con 0x7f43cc100ef0 2024-04-01T06:52:28.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:52:28.605+0000 7f43c27fc700 1 -- 172.21.15.145:0/3196097798 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43bc003cf0 con 0x7f43cc100ef0 2024-04-01T06:52:28.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:52:28.605+0000 7f43d38b3700 1 -- 172.21.15.145:0/3196097798 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43cc1a14d0 con 0x7f43cc100ef0 2024-04-01T06:52:28.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:52:28.606+0000 7f43d38b3700 1 -- 172.21.15.145:0/3196097798 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43cc04ea80 con 0x7f43cc100ef0 2024-04-01T06:52:28.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:52:28.607+0000 7f43c27fc700 1 -- 172.21.15.145:0/3196097798 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 16) v1 ==== 135865+0+0 (secure 0 0 0) 0x7f43bc005040 con 0x7f43cc100ef0 2024-04-01T06:52:28.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:52:28.608+0000 7f43c27fc700 1 --2- 172.21.15.145:0/3196097798 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f43b80a11a0 0x7f43b80a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:52:28.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:52:28.608+0000 7f43c27fc700 1 -- 172.21.15.145:0/3196097798 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4669+0+0 (secure 0 0 0) 0x7f43bc0ccbe0 con 0x7f43cc100ef0 2024-04-01T06:52:28.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:52:28.608+0000 7f43d164f700 1 --2- 172.21.15.145:0/3196097798 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f43b80a11a0 0x7f43b80a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:52:28.609 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:52:28.609+0000 7f43d164f700 1 --2- 172.21.15.145:0/3196097798 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f43b80a11a0 0x7f43b80a3660 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f43cc100d50 tx=0x7f43c8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:52:28.610 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:52:28.611+0000 7f43c27fc700 1 -- 172.21.15.145:0/3196097798 <== mon.2 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f43bc0971a0 con 0x7f43cc100ef0 2024-04-01T06:52:28.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:52:28.813+0000 7f43d38b3700 1 -- 172.21.15.145:0/3196097798 --> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f43cc068e90 con 0x7f43b80a11a0 2024-04-01T06:52:29.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:28 smithi145 ceph-mon[47816]: Detected new or changed devices on smithi083 2024-04-01T06:52:29.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:28 smithi145 ceph-mon[47816]: Adjusting osd_memory_target on smithi083 to 5704M 2024-04-01T06:52:29.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:28 smithi145 ceph-mon[47816]: from='osd.6 [v2:172.21.15.83:6818/2005485079,v1:172.21.15.83:6819/2005485079]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-01T06:52:29.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:28 smithi145 ceph-mon[47816]: osdmap e41: 7 total, 6 up, 7 in 2024-04-01T06:52:29.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:28 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-01T06:52:29.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:28 smithi145 ceph-mon[47816]: from='osd.6 [v2:172.21.15.83:6818/2005485079,v1:172.21.15.83:6819/2005485079]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]: dispatch 2024-04-01T06:52:29.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:28 smithi145 ceph-mon[47816]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-04-01T06:52:29.012 INFO:journalctl@ceph.osd.6.smithi083.stdout:Apr 01 06:52:28 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-6[78927]: 2024-04-01T06:52:28.674+0000 7fac34174700 -1 osd.6 0 waiting for initial osdmap 2024-04-01T06:52:29.012 INFO:journalctl@ceph.osd.6.smithi083.stdout:Apr 01 06:52:28 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-6[78927]: 2024-04-01T06:52:28.685+0000 7fac2ff69700 -1 osd.6 42 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T06:52:29.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:28 smithi083 ceph-mon[43429]: Detected new or changed devices on smithi083 2024-04-01T06:52:29.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:28 smithi083 ceph-mon[43429]: Adjusting osd_memory_target on smithi083 to 5704M 2024-04-01T06:52:29.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:28 smithi083 ceph-mon[43429]: from='osd.6 [v2:172.21.15.83:6818/2005485079,v1:172.21.15.83:6819/2005485079]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-01T06:52:29.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:28 smithi083 ceph-mon[43429]: osdmap e41: 7 total, 6 up, 7 in 2024-04-01T06:52:29.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:28 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-01T06:52:29.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:28 smithi083 ceph-mon[43429]: from='osd.6 [v2:172.21.15.83:6818/2005485079,v1:172.21.15.83:6819/2005485079]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]: dispatch 2024-04-01T06:52:29.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:28 smithi083 ceph-mon[43429]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-04-01T06:52:29.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:28 smithi153 ceph-mon[48187]: Detected new or changed devices on smithi083 2024-04-01T06:52:29.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:28 smithi153 ceph-mon[48187]: Adjusting osd_memory_target on smithi083 to 5704M 2024-04-01T06:52:29.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:28 smithi153 ceph-mon[48187]: from='osd.6 [v2:172.21.15.83:6818/2005485079,v1:172.21.15.83:6819/2005485079]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-01T06:52:29.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:28 smithi153 ceph-mon[48187]: osdmap e41: 7 total, 6 up, 7 in 2024-04-01T06:52:29.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:28 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-01T06:52:29.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:28 smithi153 ceph-mon[48187]: from='osd.6 [v2:172.21.15.83:6818/2005485079,v1:172.21.15.83:6819/2005485079]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]: dispatch 2024-04-01T06:52:29.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:28 smithi153 ceph-mon[48187]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-04-01T06:52:29.930 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:29 smithi145 ceph-mon[47816]: from='osd.6 [v2:172.21.15.83:6818/2005485079,v1:172.21.15.83:6819/2005485079]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]': finished 2024-04-01T06:52:29.930 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:29 smithi145 ceph-mon[47816]: osdmap e42: 7 total, 6 up, 7 in 2024-04-01T06:52:29.930 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:29 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-01T06:52:29.930 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:29 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-01T06:52:29.930 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:29 smithi145 ceph-mon[47816]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:52:29.930 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:29 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T06:52:29.931 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:29 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T06:52:29.931 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:29 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:52:30.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:29 smithi083 ceph-mon[43429]: from='osd.6 [v2:172.21.15.83:6818/2005485079,v1:172.21.15.83:6819/2005485079]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]': finished 2024-04-01T06:52:30.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:29 smithi083 ceph-mon[43429]: osdmap e42: 7 total, 6 up, 7 in 2024-04-01T06:52:30.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:29 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-01T06:52:30.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:29 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-01T06:52:30.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:29 smithi083 ceph-mon[43429]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:52:30.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:29 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T06:52:30.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:29 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T06:52:30.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:29 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:52:30.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:29 smithi153 ceph-mon[48187]: from='osd.6 [v2:172.21.15.83:6818/2005485079,v1:172.21.15.83:6819/2005485079]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]': finished 2024-04-01T06:52:30.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:29 smithi153 ceph-mon[48187]: osdmap e42: 7 total, 6 up, 7 in 2024-04-01T06:52:30.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:29 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-01T06:52:30.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:29 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-01T06:52:30.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:29 smithi153 ceph-mon[48187]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:52:30.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:29 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T06:52:30.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:29 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T06:52:30.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:29 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:52:31.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:30 smithi145 ceph-mon[47816]: purged_snaps scrub starts 2024-04-01T06:52:31.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:30 smithi145 ceph-mon[47816]: purged_snaps scrub ok 2024-04-01T06:52:31.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:30 smithi145 ceph-mon[47816]: osd.6 [v2:172.21.15.83:6818/2005485079,v1:172.21.15.83:6819/2005485079] boot 2024-04-01T06:52:31.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:30 smithi145 ceph-mon[47816]: osdmap e43: 7 total, 7 up, 7 in 2024-04-01T06:52:31.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:30 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-01T06:52:31.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:30 smithi145 ceph-mon[47816]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 626 GiB / 626 GiB avail 2024-04-01T06:52:31.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:30 smithi083 ceph-mon[43429]: purged_snaps scrub starts 2024-04-01T06:52:31.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:30 smithi083 ceph-mon[43429]: purged_snaps scrub ok 2024-04-01T06:52:31.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:30 smithi083 ceph-mon[43429]: osd.6 [v2:172.21.15.83:6818/2005485079,v1:172.21.15.83:6819/2005485079] boot 2024-04-01T06:52:31.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:30 smithi083 ceph-mon[43429]: osdmap e43: 7 total, 7 up, 7 in 2024-04-01T06:52:31.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:30 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-01T06:52:31.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:30 smithi083 ceph-mon[43429]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 626 GiB / 626 GiB avail 2024-04-01T06:52:31.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:30 smithi153 ceph-mon[48187]: purged_snaps scrub starts 2024-04-01T06:52:31.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:30 smithi153 ceph-mon[48187]: purged_snaps scrub ok 2024-04-01T06:52:31.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:30 smithi153 ceph-mon[48187]: osd.6 [v2:172.21.15.83:6818/2005485079,v1:172.21.15.83:6819/2005485079] boot 2024-04-01T06:52:31.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:30 smithi153 ceph-mon[48187]: osdmap e43: 7 total, 7 up, 7 in 2024-04-01T06:52:31.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:30 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-01T06:52:31.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:30 smithi153 ceph-mon[48187]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 626 GiB / 626 GiB avail 2024-04-01T06:52:32.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:31 smithi145 ceph-mon[47816]: osdmap e44: 7 total, 7 up, 7 in 2024-04-01T06:52:32.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:31 smithi145 ceph-mon[47816]: from='client.? 172.21.15.145:0/4127995373' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a8940da2-0e79-4606-8d1e-d425afbf5753"}]: dispatch 2024-04-01T06:52:32.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:31 smithi145 ceph-mon[47816]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a8940da2-0e79-4606-8d1e-d425afbf5753"}]: dispatch 2024-04-01T06:52:32.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:31 smithi145 ceph-mon[47816]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a8940da2-0e79-4606-8d1e-d425afbf5753"}]': finished 2024-04-01T06:52:32.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:31 smithi145 ceph-mon[47816]: osdmap e45: 8 total, 7 up, 8 in 2024-04-01T06:52:32.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:31 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-01T06:52:32.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:31 smithi145 ceph-mon[47816]: from='client.? 172.21.15.145:0/2465058015' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T06:52:32.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:31 smithi083 ceph-mon[43429]: osdmap e44: 7 total, 7 up, 7 in 2024-04-01T06:52:32.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:31 smithi083 ceph-mon[43429]: from='client.? 172.21.15.145:0/4127995373' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a8940da2-0e79-4606-8d1e-d425afbf5753"}]: dispatch 2024-04-01T06:52:32.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:31 smithi083 ceph-mon[43429]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a8940da2-0e79-4606-8d1e-d425afbf5753"}]: dispatch 2024-04-01T06:52:32.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:31 smithi083 ceph-mon[43429]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a8940da2-0e79-4606-8d1e-d425afbf5753"}]': finished 2024-04-01T06:52:32.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:31 smithi083 ceph-mon[43429]: osdmap e45: 8 total, 7 up, 8 in 2024-04-01T06:52:32.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:31 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-01T06:52:32.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:31 smithi083 ceph-mon[43429]: from='client.? 172.21.15.145:0/2465058015' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T06:52:32.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:31 smithi153 ceph-mon[48187]: osdmap e44: 7 total, 7 up, 7 in 2024-04-01T06:52:32.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:31 smithi153 ceph-mon[48187]: from='client.? 172.21.15.145:0/4127995373' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a8940da2-0e79-4606-8d1e-d425afbf5753"}]: dispatch 2024-04-01T06:52:32.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:31 smithi153 ceph-mon[48187]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a8940da2-0e79-4606-8d1e-d425afbf5753"}]: dispatch 2024-04-01T06:52:32.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:31 smithi153 ceph-mon[48187]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a8940da2-0e79-4606-8d1e-d425afbf5753"}]': finished 2024-04-01T06:52:32.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:31 smithi153 ceph-mon[48187]: osdmap e45: 8 total, 7 up, 8 in 2024-04-01T06:52:32.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:31 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-01T06:52:32.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:31 smithi153 ceph-mon[48187]: from='client.? 172.21.15.145:0/2465058015' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T06:52:33.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:32 smithi145 ceph-mon[47816]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 626 GiB / 626 GiB avail 2024-04-01T06:52:33.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:32 smithi083 ceph-mon[43429]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 626 GiB / 626 GiB avail 2024-04-01T06:52:33.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:32 smithi153 ceph-mon[48187]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 199 MiB used, 626 GiB / 626 GiB avail 2024-04-01T06:52:35.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:34 smithi145 ceph-mon[47816]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-01T06:52:35.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:34 smithi083 ceph-mon[43429]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-01T06:52:35.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:34 smithi153 ceph-mon[48187]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-01T06:52:37.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:36 smithi145 ceph-mon[47816]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-01T06:52:37.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:36 smithi083 ceph-mon[43429]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-01T06:52:37.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:36 smithi153 ceph-mon[48187]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-01T06:52:37.752 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:37 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-04-01T06:52:37.752 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:37 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:52:37.753 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:37 smithi145 ceph-mon[47816]: Deploying daemon osd.7 on smithi145 2024-04-01T06:52:38.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:37 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-04-01T06:52:38.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:37 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:52:38.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:37 smithi083 ceph-mon[43429]: Deploying daemon osd.7 on smithi145 2024-04-01T06:52:38.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:37 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-04-01T06:52:38.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:37 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:52:38.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:37 smithi153 ceph-mon[48187]: Deploying daemon osd.7 on smithi145 2024-04-01T06:52:39.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:38 smithi145 ceph-mon[47816]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-01T06:52:39.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:38 smithi083 ceph-mon[43429]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-01T06:52:39.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:38 smithi153 ceph-mon[48187]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-01T06:52:41.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:40 smithi145 ceph-mon[47816]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-01T06:52:41.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:40 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:41.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:40 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:41.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:40 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:52:41.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:40 smithi083 ceph-mon[43429]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-01T06:52:41.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:40 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:41.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:40 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:41.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:40 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:52:41.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:40 smithi153 ceph-mon[48187]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-01T06:52:41.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:40 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:41.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:40 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:41.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:40 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:52:42.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:52:42.518+0000 7f43c27fc700 1 -- 172.21.15.145:0/3196097798 <== mgr.14152 v2:172.21.15.83:6800/3375372052 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f43cc068e90 con 0x7f43b80a11a0 2024-04-01T06:52:42.517 INFO:teuthology.orchestra.run.smithi145.stdout:Created osd(s) 7 on host 'smithi145' 2024-04-01T06:52:42.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:52:42.520+0000 7f43d38b3700 1 -- 172.21.15.145:0/3196097798 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f43b80a11a0 msgr2=0x7f43b80a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:52:42.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:52:42.520+0000 7f43d38b3700 1 --2- 172.21.15.145:0/3196097798 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f43b80a11a0 0x7f43b80a3660 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f43cc100d50 tx=0x7f43c8009260 comp rx=0 tx=0).stop 2024-04-01T06:52:42.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:52:42.520+0000 7f43d38b3700 1 -- 172.21.15.145:0/3196097798 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f43cc100ef0 msgr2=0x7f43cc1022d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:52:42.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:52:42.520+0000 7f43d38b3700 1 --2- 172.21.15.145:0/3196097798 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f43cc100ef0 0x7f43cc1022d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f43bc005e90 tx=0x7f43bc00b790 comp rx=0 tx=0).stop 2024-04-01T06:52:42.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:52:42.520+0000 7f43d38b3700 1 -- 172.21.15.145:0/3196097798 shutdown_connections 2024-04-01T06:52:42.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:52:42.520+0000 7f43d38b3700 1 --2- 172.21.15.145:0/3196097798 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f43cc0ffcf0 0x7f43cc103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:52:42.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:52:42.520+0000 7f43d38b3700 1 --2- 172.21.15.145:0/3196097798 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f43b80a11a0 0x7f43b80a3660 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:52:42.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:52:42.520+0000 7f43d38b3700 1 --2- 172.21.15.145:0/3196097798 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43cc101890 0x7f43cc102810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:52:42.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:52:42.520+0000 7f43d38b3700 1 --2- 172.21.15.145:0/3196097798 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f43cc100ef0 0x7f43cc1022d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:52:42.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:52:42.520+0000 7f43d38b3700 1 -- 172.21.15.145:0/3196097798 >> 172.21.15.145:0/3196097798 conn(0x7f43cc0fb2b0 msgr2=0x7f43cc068780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:52:42.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:52:42.520+0000 7f43d38b3700 1 -- 172.21.15.145:0/3196097798 shutdown_connections 2024-04-01T06:52:42.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:52:42.520+0000 7f43d38b3700 1 -- 172.21.15.145:0/3196097798 wait complete. 2024-04-01T06:52:42.898 DEBUG:teuthology.orchestra.run.smithi145:osd.7> sudo journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@osd.7.service 2024-04-01T06:52:42.900 INFO:tasks.cephadm:Deploying osd.8 on smithi153 with /dev/vg_nvme/lv_2... 2024-04-01T06:52:42.900 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-01T06:52:42.932 INFO:journalctl@ceph.osd.7.smithi145.stdout:-- Logs begin at Mon 2024-04-01 06:34:41 UTC. -- 2024-04-01T06:52:43.134 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T06:52:43.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:42 smithi153 ceph-mon[48187]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-01T06:52:43.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:42 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:43.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:42 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:43.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:42 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:52:43.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:42 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:52:43.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:42 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:43.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:42 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:43.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:42 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:43.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:42 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:52:43.148 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:42 smithi145 ceph-mon[47816]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-01T06:52:43.149 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:42 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:43.149 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:42 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:43.149 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:42 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:52:43.149 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:42 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:52:43.149 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:42 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:43.149 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:42 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:43.149 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:42 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:43.149 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:42 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:52:43.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:42 smithi083 ceph-mon[43429]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-01T06:52:43.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:42 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:43.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:42 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:43.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:42 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:52:43.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:42 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:52:43.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:42 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:43.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:42 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:43.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:42 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:43.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:42 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:52:44.351 INFO:teuthology.orchestra.run.smithi153.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-01T06:52:44.351 INFO:teuthology.orchestra.run.smithi153.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-01T06:52:44.351 INFO:teuthology.orchestra.run.smithi153.stderr: stderr: 10+0 records in 2024-04-01T06:52:44.351 INFO:teuthology.orchestra.run.smithi153.stderr:10+0 records out 2024-04-01T06:52:44.351 INFO:teuthology.orchestra.run.smithi153.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0119238 s, 879 MB/s 2024-04-01T06:52:44.351 INFO:teuthology.orchestra.run.smithi153.stderr:--> Zapping successful for: 2024-04-01T06:52:44.592 INFO:journalctl@ceph.osd.7.smithi145.stdout:Apr 01 06:52:44 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-7[70262]: 2024-04-01T06:52:44.312+0000 7f734c1a6640 -1 osd.7 0 log_to_monitors true 2024-04-01T06:52:44.732 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi153:vg_nvme/lv_2 2024-04-01T06:52:44.880 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:44 smithi145 ceph-mon[47816]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-01T06:52:44.880 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:44 smithi145 ceph-mon[47816]: from='osd.7 [v2:172.21.15.145:6816/3737505059,v1:172.21.15.145:6817/3737505059]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-01T06:52:44.880 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:44 smithi145 ceph-mon[47816]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-01T06:52:44.890 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:44 smithi153 ceph-mon[48187]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-01T06:52:44.890 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:44 smithi153 ceph-mon[48187]: from='osd.7 [v2:172.21.15.145:6816/3737505059,v1:172.21.15.145:6817/3737505059]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-01T06:52:44.890 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:44 smithi153 ceph-mon[48187]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-01T06:52:44.952 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T06:52:45.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:44 smithi083 ceph-mon[43429]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-01T06:52:45.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:44 smithi083 ceph-mon[43429]: from='osd.7 [v2:172.21.15.145:6816/3737505059,v1:172.21.15.145:6817/3737505059]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-01T06:52:45.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:44 smithi083 ceph-mon[43429]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-01T06:52:45.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:45.893+0000 7f5197c36700 1 -- 172.21.15.153:0/1716706452 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51901020b0 msgr2=0x7f5190102510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:52:45.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:45.893+0000 7f5197c36700 1 --2- 172.21.15.153:0/1716706452 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51901020b0 0x7f5190102510 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f518c009990 tx=0x7f518c009ca0 comp rx=0 tx=0).stop 2024-04-01T06:52:45.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:45.893+0000 7f5197c36700 1 -- 172.21.15.153:0/1716706452 shutdown_connections 2024-04-01T06:52:45.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:45.893+0000 7f5197c36700 1 --2- 172.21.15.153:0/1716706452 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5190102a50 0x7f5190109300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:52:45.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:45.893+0000 7f5197c36700 1 --2- 172.21.15.153:0/1716706452 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f51900ff0d0 0x7f51900ff4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:52:45.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:45.893+0000 7f5197c36700 1 --2- 172.21.15.153:0/1716706452 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51901020b0 0x7f5190102510 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:52:45.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:45.893+0000 7f5197c36700 1 -- 172.21.15.153:0/1716706452 >> 172.21.15.153:0/1716706452 conn(0x7f51900faa50 msgr2=0x7f51900fce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:52:45.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:45.894+0000 7f5197c36700 1 -- 172.21.15.153:0/1716706452 shutdown_connections 2024-04-01T06:52:45.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:45.894+0000 7f5197c36700 1 -- 172.21.15.153:0/1716706452 wait complete. 2024-04-01T06:52:45.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:45.894+0000 7f5197c36700 1 Processor -- start 2024-04-01T06:52:45.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:45.894+0000 7f5197c36700 1 -- start start 2024-04-01T06:52:45.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:45.894+0000 7f5197c36700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51900ff0d0 0x7f5190196d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:52:45.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:45.894+0000 7f5197c36700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f51901020b0 0x7f5190197250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:52:45.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:45.894+0000 7f5197c36700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5190102a50 0x7f519019e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:52:45.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:45.894+0000 7f5197c36700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f519019e7f0 con 0x7f5190102a50 2024-04-01T06:52:45.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:45.894+0000 7f5197c36700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f519019e930 con 0x7f51901020b0 2024-04-01T06:52:45.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:45.894+0000 7f5197c36700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f519019eaf0 con 0x7f51900ff0d0 2024-04-01T06:52:45.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:45.894+0000 7f51959d2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51900ff0d0 0x7f5190196d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:52:45.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:45.895+0000 7f51959d2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51900ff0d0 0x7f5190196d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37034/0 (socket says 172.21.15.153:37034) 2024-04-01T06:52:45.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:45.895+0000 7f51959d2700 1 -- 172.21.15.153:0/2575429536 learned_addr learned my addr 172.21.15.153:0/2575429536 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-04-01T06:52:45.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:45.895+0000 7f51951d1700 1 --2- 172.21.15.153:0/2575429536 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f51901020b0 0x7f5190197250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:52:45.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:45.895+0000 7f51961d3700 1 --2- 172.21.15.153:0/2575429536 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5190102a50 0x7f519019e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:52:45.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:45.895+0000 7f51959d2700 1 -- 172.21.15.153:0/2575429536 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f51901020b0 msgr2=0x7f5190197250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:52:45.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:45.895+0000 7f51959d2700 1 --2- 172.21.15.153:0/2575429536 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f51901020b0 0x7f5190197250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:52:45.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:45.895+0000 7f51959d2700 1 -- 172.21.15.153:0/2575429536 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5190102a50 msgr2=0x7f519019e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:52:45.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:45.895+0000 7f51959d2700 1 --2- 172.21.15.153:0/2575429536 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5190102a50 0x7f519019e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:52:45.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:45.895+0000 7f51959d2700 1 -- 172.21.15.153:0/2575429536 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f518c0095f0 con 0x7f51900ff0d0 2024-04-01T06:52:45.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:45.895+0000 7f51961d3700 1 --2- 172.21.15.153:0/2575429536 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5190102a50 0x7f519019e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:52:45.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:45.895+0000 7f51959d2700 1 --2- 172.21.15.153:0/2575429536 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51900ff0d0 0x7f5190196d10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f518000e970 tx=0x7f518000ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:52:45.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:45.895+0000 7f5186ffd700 1 -- 172.21.15.153:0/2575429536 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5180009790 con 0x7f51900ff0d0 2024-04-01T06:52:45.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:45.895+0000 7f5186ffd700 1 -- 172.21.15.153:0/2575429536 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f518000eec0 con 0x7f51900ff0d0 2024-04-01T06:52:45.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:45.895+0000 7f5197c36700 1 -- 172.21.15.153:0/2575429536 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f519019edd0 con 0x7f51900ff0d0 2024-04-01T06:52:45.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:45.895+0000 7f5186ffd700 1 -- 172.21.15.153:0/2575429536 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5180003cf0 con 0x7f51900ff0d0 2024-04-01T06:52:45.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:45.895+0000 7f5197c36700 1 -- 172.21.15.153:0/2575429536 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f519019f1e0 con 0x7f51900ff0d0 2024-04-01T06:52:45.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:45.896+0000 7f5197c36700 1 -- 172.21.15.153:0/2575429536 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5190108430 con 0x7f51900ff0d0 2024-04-01T06:52:45.899 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:45.897+0000 7f5186ffd700 1 -- 172.21.15.153:0/2575429536 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 16) v1 ==== 135865+0+0 (secure 0 0 0) 0x7f518000ccd0 con 0x7f51900ff0d0 2024-04-01T06:52:45.899 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:45.898+0000 7f5186ffd700 1 --2- 172.21.15.153:0/2575429536 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f517c0a1120 0x7f517c0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:52:45.899 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:45.898+0000 7f5186ffd700 1 -- 172.21.15.153:0/2575429536 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5117+0+0 (secure 0 0 0) 0x7f5180014070 con 0x7f51900ff0d0 2024-04-01T06:52:45.899 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:45.898+0000 7f51951d1700 1 --2- 172.21.15.153:0/2575429536 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f517c0a1120 0x7f517c0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:52:45.899 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:45.898+0000 7f51951d1700 1 --2- 172.21.15.153:0/2575429536 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f517c0a1120 0x7f517c0a35e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f518c00b2e0 tx=0x7f518c005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:52:45.900 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:45.901+0000 7f5186ffd700 1 -- 172.21.15.153:0/2575429536 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f5180096450 con 0x7f51900ff0d0 2024-04-01T06:52:46.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:46.100+0000 7f5197c36700 1 -- 172.21.15.153:0/2575429536 --> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f519002cdc0 con 0x7f517c0a1120 2024-04-01T06:52:46.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:45 smithi153 ceph-mon[48187]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-04-01T06:52:46.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:45 smithi153 ceph-mon[48187]: osdmap e46: 8 total, 7 up, 8 in 2024-04-01T06:52:46.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:45 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-01T06:52:46.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:45 smithi153 ceph-mon[48187]: from='osd.7 [v2:172.21.15.145:6816/3737505059,v1:172.21.15.145:6817/3737505059]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-04-01T06:52:46.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:45 smithi153 ceph-mon[48187]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-04-01T06:52:46.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:45 smithi153 ceph-mon[48187]: Detected new or changed devices on smithi145 2024-04-01T06:52:46.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:45 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:46.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:45 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:46.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:45 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:52:46.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:45 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:52:46.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:45 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:52:46.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:45 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:46.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:45 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:52:46.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:45 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:52:46.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:45 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:46.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:45 smithi145 ceph-mon[47816]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-04-01T06:52:46.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:45 smithi145 ceph-mon[47816]: osdmap e46: 8 total, 7 up, 8 in 2024-04-01T06:52:46.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:45 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-01T06:52:46.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:45 smithi145 ceph-mon[47816]: from='osd.7 [v2:172.21.15.145:6816/3737505059,v1:172.21.15.145:6817/3737505059]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-04-01T06:52:46.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:45 smithi145 ceph-mon[47816]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-04-01T06:52:46.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:45 smithi145 ceph-mon[47816]: Detected new or changed devices on smithi145 2024-04-01T06:52:46.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:45 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:46.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:45 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:46.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:45 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:52:46.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:45 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:52:46.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:45 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:52:46.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:45 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:46.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:45 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:52:46.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:45 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:52:46.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:45 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:46.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:45 smithi083 ceph-mon[43429]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-04-01T06:52:46.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:45 smithi083 ceph-mon[43429]: osdmap e46: 8 total, 7 up, 8 in 2024-04-01T06:52:46.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:45 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-01T06:52:46.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:45 smithi083 ceph-mon[43429]: from='osd.7 [v2:172.21.15.145:6816/3737505059,v1:172.21.15.145:6817/3737505059]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-04-01T06:52:46.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:45 smithi083 ceph-mon[43429]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-04-01T06:52:46.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:45 smithi083 ceph-mon[43429]: Detected new or changed devices on smithi145 2024-04-01T06:52:46.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:45 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:46.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:45 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:46.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:45 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:52:46.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:45 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:52:46.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:45 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:52:46.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:45 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:46.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:45 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:52:46.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:45 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:52:46.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:45 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:46.753 INFO:journalctl@ceph.osd.7.smithi145.stdout:Apr 01 06:52:46 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-7[70262]: 2024-04-01T06:52:46.285+0000 7f734180a700 -1 osd.7 0 waiting for initial osdmap 2024-04-01T06:52:46.753 INFO:journalctl@ceph.osd.7.smithi145.stdout:Apr 01 06:52:46 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-7[70262]: 2024-04-01T06:52:46.295+0000 7f73395f7700 -1 osd.7 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T06:52:47.053 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:46 smithi153 ceph-mon[48187]: Adjusting osd_memory_target on smithi145 to 5704M 2024-04-01T06:52:47.053 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:46 smithi153 ceph-mon[48187]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-01T06:52:47.053 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:46 smithi153 ceph-mon[48187]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-04-01T06:52:47.053 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:46 smithi153 ceph-mon[48187]: osdmap e47: 8 total, 7 up, 8 in 2024-04-01T06:52:47.053 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:46 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-01T06:52:47.053 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:46 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-01T06:52:47.053 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:46 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T06:52:47.053 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:46 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T06:52:47.053 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:46 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:52:47.053 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:46 smithi153 ceph-mon[48187]: from='osd.7 ' entity='osd.7' 2024-04-01T06:52:47.053 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:46 smithi153 ceph-mon[48187]: osd.7 [v2:172.21.15.145:6816/3737505059,v1:172.21.15.145:6817/3737505059] boot 2024-04-01T06:52:47.053 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:46 smithi153 ceph-mon[48187]: osdmap e48: 8 total, 8 up, 8 in 2024-04-01T06:52:47.054 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:46 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-01T06:52:47.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:46 smithi145 ceph-mon[47816]: Adjusting osd_memory_target on smithi145 to 5704M 2024-04-01T06:52:47.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:46 smithi145 ceph-mon[47816]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-01T06:52:47.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:46 smithi145 ceph-mon[47816]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-04-01T06:52:47.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:46 smithi145 ceph-mon[47816]: osdmap e47: 8 total, 7 up, 8 in 2024-04-01T06:52:47.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:46 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-01T06:52:47.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:46 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-01T06:52:47.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:46 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T06:52:47.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:46 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T06:52:47.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:46 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:52:47.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:46 smithi145 ceph-mon[47816]: from='osd.7 ' entity='osd.7' 2024-04-01T06:52:47.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:46 smithi145 ceph-mon[47816]: osd.7 [v2:172.21.15.145:6816/3737505059,v1:172.21.15.145:6817/3737505059] boot 2024-04-01T06:52:47.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:46 smithi145 ceph-mon[47816]: osdmap e48: 8 total, 8 up, 8 in 2024-04-01T06:52:47.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:46 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-01T06:52:47.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:46 smithi083 ceph-mon[43429]: Adjusting osd_memory_target on smithi145 to 5704M 2024-04-01T06:52:47.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:46 smithi083 ceph-mon[43429]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-04-01T06:52:47.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:46 smithi083 ceph-mon[43429]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-04-01T06:52:47.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:46 smithi083 ceph-mon[43429]: osdmap e47: 8 total, 7 up, 8 in 2024-04-01T06:52:47.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:46 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-01T06:52:47.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:46 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-01T06:52:47.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:46 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T06:52:47.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:46 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T06:52:47.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:46 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:52:47.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:46 smithi083 ceph-mon[43429]: from='osd.7 ' entity='osd.7' 2024-04-01T06:52:47.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:46 smithi083 ceph-mon[43429]: osd.7 [v2:172.21.15.145:6816/3737505059,v1:172.21.15.145:6817/3737505059] boot 2024-04-01T06:52:47.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:46 smithi083 ceph-mon[43429]: osdmap e48: 8 total, 8 up, 8 in 2024-04-01T06:52:47.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:46 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-01T06:52:48.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:47 smithi153 ceph-mon[48187]: purged_snaps scrub starts 2024-04-01T06:52:48.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:47 smithi153 ceph-mon[48187]: purged_snaps scrub ok 2024-04-01T06:52:48.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:47 smithi153 ceph-mon[48187]: from='client.24295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:52:48.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:47 smithi153 ceph-mon[48187]: osdmap e49: 8 total, 8 up, 8 in 2024-04-01T06:52:48.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:47 smithi145 ceph-mon[47816]: purged_snaps scrub starts 2024-04-01T06:52:48.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:47 smithi145 ceph-mon[47816]: purged_snaps scrub ok 2024-04-01T06:52:48.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:47 smithi145 ceph-mon[47816]: from='client.24295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:52:48.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:47 smithi145 ceph-mon[47816]: osdmap e49: 8 total, 8 up, 8 in 2024-04-01T06:52:48.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:47 smithi083 ceph-mon[43429]: purged_snaps scrub starts 2024-04-01T06:52:48.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:47 smithi083 ceph-mon[43429]: purged_snaps scrub ok 2024-04-01T06:52:48.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:47 smithi083 ceph-mon[43429]: from='client.24295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:52:48.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:47 smithi083 ceph-mon[43429]: osdmap e49: 8 total, 8 up, 8 in 2024-04-01T06:52:49.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:48 smithi153 ceph-mon[48187]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-04-01T06:52:49.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:48 smithi153 ceph-mon[48187]: from='client.? 172.21.15.153:0/3304796617' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "602d43ac-a189-4da3-9e38-7025d14e0dd4"}]: dispatch 2024-04-01T06:52:49.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:48 smithi153 ceph-mon[48187]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "602d43ac-a189-4da3-9e38-7025d14e0dd4"}]: dispatch 2024-04-01T06:52:49.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:48 smithi153 ceph-mon[48187]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "602d43ac-a189-4da3-9e38-7025d14e0dd4"}]': finished 2024-04-01T06:52:49.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:48 smithi153 ceph-mon[48187]: osdmap e50: 9 total, 8 up, 9 in 2024-04-01T06:52:49.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:48 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-01T06:52:49.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:48 smithi153 ceph-mon[48187]: from='client.? 172.21.15.153:0/3443997985' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T06:52:49.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:48 smithi145 ceph-mon[47816]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-04-01T06:52:49.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:48 smithi145 ceph-mon[47816]: from='client.? 172.21.15.153:0/3304796617' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "602d43ac-a189-4da3-9e38-7025d14e0dd4"}]: dispatch 2024-04-01T06:52:49.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:48 smithi145 ceph-mon[47816]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "602d43ac-a189-4da3-9e38-7025d14e0dd4"}]: dispatch 2024-04-01T06:52:49.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:48 smithi145 ceph-mon[47816]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "602d43ac-a189-4da3-9e38-7025d14e0dd4"}]': finished 2024-04-01T06:52:49.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:48 smithi145 ceph-mon[47816]: osdmap e50: 9 total, 8 up, 9 in 2024-04-01T06:52:49.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:48 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-01T06:52:49.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:48 smithi145 ceph-mon[47816]: from='client.? 172.21.15.153:0/3443997985' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T06:52:49.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:48 smithi083 ceph-mon[43429]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-04-01T06:52:49.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:48 smithi083 ceph-mon[43429]: from='client.? 172.21.15.153:0/3304796617' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "602d43ac-a189-4da3-9e38-7025d14e0dd4"}]: dispatch 2024-04-01T06:52:49.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:48 smithi083 ceph-mon[43429]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "602d43ac-a189-4da3-9e38-7025d14e0dd4"}]: dispatch 2024-04-01T06:52:49.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:48 smithi083 ceph-mon[43429]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "602d43ac-a189-4da3-9e38-7025d14e0dd4"}]': finished 2024-04-01T06:52:49.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:48 smithi083 ceph-mon[43429]: osdmap e50: 9 total, 8 up, 9 in 2024-04-01T06:52:49.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:48 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-01T06:52:49.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:48 smithi083 ceph-mon[43429]: from='client.? 172.21.15.153:0/3443997985' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T06:52:50.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:49 smithi153 ceph-mon[48187]: osdmap e51: 9 total, 8 up, 9 in 2024-04-01T06:52:50.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:49 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-01T06:52:50.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:49 smithi145 ceph-mon[47816]: osdmap e51: 9 total, 8 up, 9 in 2024-04-01T06:52:50.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:49 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-01T06:52:50.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:49 smithi083 ceph-mon[43429]: osdmap e51: 9 total, 8 up, 9 in 2024-04-01T06:52:50.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:49 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-01T06:52:51.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:50 smithi153 ceph-mon[48187]: pgmap v139: 1 pgs: 1 remapped; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-04-01T06:52:51.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:50 smithi153 ceph-mon[48187]: osdmap e52: 9 total, 8 up, 9 in 2024-04-01T06:52:51.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:50 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-01T06:52:51.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:50 smithi145 ceph-mon[47816]: pgmap v139: 1 pgs: 1 remapped; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-04-01T06:52:51.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:50 smithi145 ceph-mon[47816]: osdmap e52: 9 total, 8 up, 9 in 2024-04-01T06:52:51.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:50 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-01T06:52:51.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:50 smithi083 ceph-mon[43429]: pgmap v139: 1 pgs: 1 remapped; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-04-01T06:52:51.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:50 smithi083 ceph-mon[43429]: osdmap e52: 9 total, 8 up, 9 in 2024-04-01T06:52:51.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:50 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-01T06:52:53.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:52 smithi153 ceph-mon[48187]: pgmap v141: 1 pgs: 1 remapped; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-04-01T06:52:53.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:52 smithi145 ceph-mon[47816]: pgmap v141: 1 pgs: 1 remapped; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-04-01T06:52:53.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:52 smithi083 ceph-mon[43429]: pgmap v141: 1 pgs: 1 remapped; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-04-01T06:52:54.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:53 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-04-01T06:52:54.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:53 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:52:54.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:53 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-04-01T06:52:54.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:53 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:52:54.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:53 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-04-01T06:52:54.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:53 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:52:55.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:54 smithi153 ceph-mon[48187]: Deploying daemon osd.8 on smithi153 2024-04-01T06:52:55.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:54 smithi153 ceph-mon[48187]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-04-01T06:52:55.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:54 smithi145 ceph-mon[47816]: Deploying daemon osd.8 on smithi153 2024-04-01T06:52:55.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:54 smithi145 ceph-mon[47816]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-04-01T06:52:55.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:54 smithi083 ceph-mon[43429]: Deploying daemon osd.8 on smithi153 2024-04-01T06:52:55.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:54 smithi083 ceph-mon[43429]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-04-01T06:52:56.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:56 smithi153 ceph-mon[48187]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-04-01T06:52:57.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:56 smithi145 ceph-mon[47816]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-04-01T06:52:57.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:56 smithi083 ceph-mon[43429]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-04-01T06:52:58.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:58 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:58.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:58 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:58.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:58 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:52:58.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:58 smithi153 ceph-mon[48187]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-04-01T06:52:58.502 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:58 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:58.502 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:58 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:58.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:58 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:52:58.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:58 smithi145 ceph-mon[47816]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-04-01T06:52:58.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:58 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:58.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:58 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:58.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:58 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:52:58.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:58 smithi083 ceph-mon[43429]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-04-01T06:52:59.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:59.403+0000 7f5186ffd700 1 -- 172.21.15.153:0/2575429536 <== mgr.14152 v2:172.21.15.83:6800/3375372052 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f519002cdc0 con 0x7f517c0a1120 2024-04-01T06:52:59.403 INFO:teuthology.orchestra.run.smithi153.stdout:Created osd(s) 8 on host 'smithi153' 2024-04-01T06:52:59.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:59.405+0000 7f5197c36700 1 -- 172.21.15.153:0/2575429536 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f517c0a1120 msgr2=0x7f517c0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:52:59.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:59.405+0000 7f5197c36700 1 --2- 172.21.15.153:0/2575429536 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f517c0a1120 0x7f517c0a35e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f518c00b2e0 tx=0x7f518c005fd0 comp rx=0 tx=0).stop 2024-04-01T06:52:59.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:59.405+0000 7f5197c36700 1 -- 172.21.15.153:0/2575429536 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51900ff0d0 msgr2=0x7f5190196d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:52:59.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:59.405+0000 7f5197c36700 1 --2- 172.21.15.153:0/2575429536 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51900ff0d0 0x7f5190196d10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f518000e970 tx=0x7f518000ec80 comp rx=0 tx=0).stop 2024-04-01T06:52:59.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:59.405+0000 7f5197c36700 1 -- 172.21.15.153:0/2575429536 shutdown_connections 2024-04-01T06:52:59.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:59.405+0000 7f5197c36700 1 --2- 172.21.15.153:0/2575429536 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5190102a50 0x7f519019e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:52:59.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:59.405+0000 7f5197c36700 1 --2- 172.21.15.153:0/2575429536 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f517c0a1120 0x7f517c0a35e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:52:59.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:59.405+0000 7f5197c36700 1 --2- 172.21.15.153:0/2575429536 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51900ff0d0 0x7f5190196d10 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:52:59.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:59.405+0000 7f5197c36700 1 --2- 172.21.15.153:0/2575429536 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f51901020b0 0x7f5190197250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:52:59.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:59.405+0000 7f5197c36700 1 -- 172.21.15.153:0/2575429536 >> 172.21.15.153:0/2575429536 conn(0x7f51900faa50 msgr2=0x7f5190105570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:52:59.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:59.405+0000 7f5197c36700 1 -- 172.21.15.153:0/2575429536 shutdown_connections 2024-04-01T06:52:59.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:52:59.405+0000 7f5197c36700 1 -- 172.21.15.153:0/2575429536 wait complete. 2024-04-01T06:52:59.592 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:59 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:59.592 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:59 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:59.592 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:59 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:52:59.592 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:59 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:52:59.592 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:59 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:59.592 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:59 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:59.593 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:59 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:59.593 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:52:59 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:52:59.752 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:59 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:59.752 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:59 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:59.753 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:59 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:52:59.753 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:59 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:52:59.753 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:59 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:59.753 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:59 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:59.753 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:59 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:59.753 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:52:59 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:52:59.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:59 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:59.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:59 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:59.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:59 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:52:59.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:59 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:52:59.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:59 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:59.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:59 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:59.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:59 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:52:59.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:52:59 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:52:59.812 DEBUG:teuthology.orchestra.run.smithi153:osd.8> sudo journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@osd.8.service 2024-04-01T06:52:59.814 INFO:tasks.cephadm:Deploying osd.9 on smithi083 with /dev/vg_nvme/lv_1... 2024-04-01T06:52:59.814 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-04-01T06:52:59.858 INFO:journalctl@ceph.osd.8.smithi153.stdout:-- Logs begin at Mon 2024-04-01 06:35:09 UTC. -- 2024-04-01T06:53:00.058 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:53:00.752 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:00 smithi145 ceph-mon[47816]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-04-01T06:53:00.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:00 smithi083 ceph-mon[43429]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-04-01T06:53:00.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:00 smithi153 ceph-mon[48187]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-04-01T06:53:01.330 INFO:teuthology.orchestra.run.smithi083.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-04-01T06:53:01.330 INFO:teuthology.orchestra.run.smithi083.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-04-01T06:53:01.330 INFO:teuthology.orchestra.run.smithi083.stderr: stderr: 10+0 records in 2024-04-01T06:53:01.330 INFO:teuthology.orchestra.run.smithi083.stderr:10+0 records out 2024-04-01T06:53:01.330 INFO:teuthology.orchestra.run.smithi083.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0112575 s, 931 MB/s 2024-04-01T06:53:01.330 INFO:teuthology.orchestra.run.smithi083.stderr:--> Zapping successful for: 2024-04-01T06:53:01.500 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 06:53:01 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T06:53:01.245+0000 7f8047a2b640 -1 osd.8 0 log_to_monitors true 2024-04-01T06:53:01.693 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi083:vg_nvme/lv_1 2024-04-01T06:53:01.890 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:01 smithi153 ceph-mon[48187]: from='osd.8 [v2:172.21.15.153:6816/1031545791,v1:172.21.15.153:6817/1031545791]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-01T06:53:01.890 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:01 smithi153 ceph-mon[48187]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-01T06:53:01.917 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:53:02.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:01 smithi145 ceph-mon[47816]: from='osd.8 [v2:172.21.15.153:6816/1031545791,v1:172.21.15.153:6817/1031545791]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-01T06:53:02.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:01 smithi145 ceph-mon[47816]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-01T06:53:02.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:01 smithi083 ceph-mon[43429]: from='osd.8 [v2:172.21.15.153:6816/1031545791,v1:172.21.15.153:6817/1031545791]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-01T06:53:02.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:01 smithi083 ceph-mon[43429]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-01T06:53:02.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:02.907+0000 7fd7f1171700 1 -- 172.21.15.83:0/395787092 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd7ec102990 msgr2=0x7fd7ec109240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:53:02.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:02.907+0000 7fd7f1171700 1 --2- 172.21.15.83:0/395787092 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd7ec102990 0x7fd7ec109240 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd7e400b0d0 tx=0x7fd7e400b3e0 comp rx=0 tx=0).stop 2024-04-01T06:53:02.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:02.907+0000 7fd7f1171700 1 -- 172.21.15.83:0/395787092 shutdown_connections 2024-04-01T06:53:02.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:02.907+0000 7fd7f1171700 1 --2- 172.21.15.83:0/395787092 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd7ec102990 0x7fd7ec109240 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:02.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:02.907+0000 7fd7f1171700 1 --2- 172.21.15.83:0/395787092 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7ec100df0 0x7fd7ec101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:02.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:02.907+0000 7fd7f1171700 1 --2- 172.21.15.83:0/395787092 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd7ec101ff0 0x7fd7ec102450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:02.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:02.907+0000 7fd7f1171700 1 -- 172.21.15.83:0/395787092 >> 172.21.15.83:0/395787092 conn(0x7fd7ec0fc390 msgr2=0x7fd7ec0fe7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:53:02.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:02.907+0000 7fd7f1171700 1 -- 172.21.15.83:0/395787092 shutdown_connections 2024-04-01T06:53:02.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:02.907+0000 7fd7f1171700 1 -- 172.21.15.83:0/395787092 wait complete. 2024-04-01T06:53:02.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:02.908+0000 7fd7f1171700 1 Processor -- start 2024-04-01T06:53:02.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:02.908+0000 7fd7f1171700 1 -- start start 2024-04-01T06:53:02.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:02.908+0000 7fd7f1171700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd7ec100df0 0x7fd7ec196e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:53:02.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:02.909+0000 7fd7f1171700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7ec101ff0 0x7fd7ec197340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:53:02.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:02.909+0000 7fd7f1171700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd7ec102990 0x7fd7ec19e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:53:02.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:02.909+0000 7fd7f1171700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec19e900 con 0x7fd7ec102990 2024-04-01T06:53:02.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:02.909+0000 7fd7f1171700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec19ea40 con 0x7fd7ec100df0 2024-04-01T06:53:02.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:02.909+0000 7fd7f1171700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec19ec00 con 0x7fd7ec101ff0 2024-04-01T06:53:02.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:02.909+0000 7fd7eb59e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd7ec102990 0x7fd7ec19e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:53:02.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:02.909+0000 7fd7eb59e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd7ec102990 0x7fd7ec19e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33912/0 (socket says 172.21.15.83:33912) 2024-04-01T06:53:02.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:02.909+0000 7fd7ea59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7ec101ff0 0x7fd7ec197340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:53:02.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:02.909+0000 7fd7eb59e700 1 -- 172.21.15.83:0/3516855224 learned_addr learned my addr 172.21.15.83:0/3516855224 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:53:02.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:02.909+0000 7fd7ead9d700 1 --2- 172.21.15.83:0/3516855224 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd7ec100df0 0x7fd7ec196e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:53:02.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:02.909+0000 7fd7eb59e700 1 -- 172.21.15.83:0/3516855224 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7ec101ff0 msgr2=0x7fd7ec197340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:53:02.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:02.909+0000 7fd7eb59e700 1 --2- 172.21.15.83:0/3516855224 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7ec101ff0 0x7fd7ec197340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:02.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:02.909+0000 7fd7eb59e700 1 -- 172.21.15.83:0/3516855224 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd7ec100df0 msgr2=0x7fd7ec196e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:53:02.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:02.909+0000 7fd7eb59e700 1 --2- 172.21.15.83:0/3516855224 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd7ec100df0 0x7fd7ec196e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:02.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:02.909+0000 7fd7eb59e700 1 -- 172.21.15.83:0/3516855224 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e4009d00 con 0x7fd7ec102990 2024-04-01T06:53:02.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:02.909+0000 7fd7ead9d700 1 --2- 172.21.15.83:0/3516855224 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd7ec100df0 0x7fd7ec196e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:53:02.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:02.909+0000 7fd7eb59e700 1 --2- 172.21.15.83:0/3516855224 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd7ec102990 0x7fd7ec19e330 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4007b60 tx=0x7fd7e4008ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:53:02.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:02.909+0000 7fd7d3fff700 1 -- 172.21.15.83:0/3516855224 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e400e040 con 0x7fd7ec102990 2024-04-01T06:53:02.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:02.909+0000 7fd7d3fff700 1 -- 172.21.15.83:0/3516855224 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd7e400be30 con 0x7fd7ec102990 2024-04-01T06:53:02.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:02.909+0000 7fd7f1171700 1 -- 172.21.15.83:0/3516855224 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7ec19ee80 con 0x7fd7ec102990 2024-04-01T06:53:02.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:02.909+0000 7fd7d3fff700 1 -- 172.21.15.83:0/3516855224 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e401bad0 con 0x7fd7ec102990 2024-04-01T06:53:02.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:02.909+0000 7fd7f1171700 1 -- 172.21.15.83:0/3516855224 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7ec19f240 con 0x7fd7ec102990 2024-04-01T06:53:02.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:02.910+0000 7fd7f1171700 1 -- 172.21.15.83:0/3516855224 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7ec1081d0 con 0x7fd7ec102990 2024-04-01T06:53:02.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:02.911+0000 7fd7d3fff700 1 -- 172.21.15.83:0/3516855224 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) v1 ==== 135865+0+0 (secure 0 0 0) 0x7fd7e401d670 con 0x7fd7ec102990 2024-04-01T06:53:02.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:02.912+0000 7fd7d3fff700 1 --2- 172.21.15.83:0/3516855224 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd7d40a1120 0x7fd7d40a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:53:02.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:02.912+0000 7fd7ead9d700 1 --2- 172.21.15.83:0/3516855224 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd7d40a1120 0x7fd7d40a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:53:02.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:02.912+0000 7fd7d3fff700 1 -- 172.21.15.83:0/3516855224 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5549+0+0 (secure 0 0 0) 0x7fd7e40cdaf0 con 0x7fd7ec102990 2024-04-01T06:53:02.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:02.912+0000 7fd7ead9d700 1 --2- 172.21.15.83:0/3516855224 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd7d40a1120 0x7fd7d40a35e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec198290 tx=0x7fd7dc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:53:02.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:02.915+0000 7fd7d3fff700 1 -- 172.21.15.83:0/3516855224 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7fd7e4097de0 con 0x7fd7ec102990 2024-04-01T06:53:03.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:02 smithi145 ceph-mon[47816]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-04-01T06:53:03.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:02 smithi145 ceph-mon[47816]: osdmap e53: 9 total, 8 up, 9 in 2024-04-01T06:53:03.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:02 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-01T06:53:03.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:02 smithi145 ceph-mon[47816]: from='osd.8 [v2:172.21.15.153:6816/1031545791,v1:172.21.15.153:6817/1031545791]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-04-01T06:53:03.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:02 smithi145 ceph-mon[47816]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-04-01T06:53:03.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:02 smithi145 ceph-mon[47816]: Detected new or changed devices on smithi153 2024-04-01T06:53:03.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:02 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:03.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:02 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:03.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:02 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:53:03.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:02 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:53:03.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:02 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:53:03.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:02 smithi145 ceph-mon[47816]: Adjusting osd_memory_target on smithi153 to 5704M 2024-04-01T06:53:03.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:02 smithi145 ceph-mon[47816]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-04-01T06:53:03.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:02 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:03.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:02 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:53:03.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:02 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:53:03.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:02 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:03.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:02 smithi083 ceph-mon[43429]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-04-01T06:53:03.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:02 smithi083 ceph-mon[43429]: osdmap e53: 9 total, 8 up, 9 in 2024-04-01T06:53:03.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:02 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-01T06:53:03.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:02 smithi083 ceph-mon[43429]: from='osd.8 [v2:172.21.15.153:6816/1031545791,v1:172.21.15.153:6817/1031545791]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-04-01T06:53:03.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:02 smithi083 ceph-mon[43429]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-04-01T06:53:03.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:02 smithi083 ceph-mon[43429]: Detected new or changed devices on smithi153 2024-04-01T06:53:03.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:02 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:03.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:02 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:03.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:02 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:53:03.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:02 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:53:03.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:02 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:53:03.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:02 smithi083 ceph-mon[43429]: Adjusting osd_memory_target on smithi153 to 5704M 2024-04-01T06:53:03.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:02 smithi083 ceph-mon[43429]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-04-01T06:53:03.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:02 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:03.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:02 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:53:03.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:02 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:53:03.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:02 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:03.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:03.120+0000 7fd7f1171700 1 -- 172.21.15.83:0/3516855224 --> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fd7ec02cdc0 con 0x7fd7d40a1120 2024-04-01T06:53:03.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:02 smithi153 ceph-mon[48187]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-04-01T06:53:03.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:02 smithi153 ceph-mon[48187]: osdmap e53: 9 total, 8 up, 9 in 2024-04-01T06:53:03.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:02 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-01T06:53:03.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:02 smithi153 ceph-mon[48187]: from='osd.8 [v2:172.21.15.153:6816/1031545791,v1:172.21.15.153:6817/1031545791]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-04-01T06:53:03.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:02 smithi153 ceph-mon[48187]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-04-01T06:53:03.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:02 smithi153 ceph-mon[48187]: Detected new or changed devices on smithi153 2024-04-01T06:53:03.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:02 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:03.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:02 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:03.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:02 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:53:03.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:02 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:53:03.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:02 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:53:03.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:02 smithi153 ceph-mon[48187]: Adjusting osd_memory_target on smithi153 to 5704M 2024-04-01T06:53:03.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:02 smithi153 ceph-mon[48187]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-04-01T06:53:03.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:02 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:03.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:02 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:53:03.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:02 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:53:03.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:02 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:03.640 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 06:53:03 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T06:53:03.145+0000 7f803d08f700 -1 osd.8 0 waiting for initial osdmap 2024-04-01T06:53:03.641 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 06:53:03 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T06:53:03.155+0000 7f8034e7c700 -1 osd.8 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T06:53:03.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:03 smithi083 ceph-mon[43429]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-04-01T06:53:03.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:03 smithi083 ceph-mon[43429]: osdmap e54: 9 total, 8 up, 9 in 2024-04-01T06:53:03.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:03 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-01T06:53:03.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:03 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-01T06:53:03.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:03 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T06:53:03.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:03 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T06:53:03.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:03 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:53:03.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:03 smithi083 ceph-mon[43429]: from='osd.8 ' entity='osd.8' 2024-04-01T06:53:03.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:03 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-01T06:53:04.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:03 smithi145 ceph-mon[47816]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-04-01T06:53:04.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:03 smithi145 ceph-mon[47816]: osdmap e54: 9 total, 8 up, 9 in 2024-04-01T06:53:04.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:03 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-01T06:53:04.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:03 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-01T06:53:04.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:03 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T06:53:04.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:03 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T06:53:04.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:03 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:53:04.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:03 smithi145 ceph-mon[47816]: from='osd.8 ' entity='osd.8' 2024-04-01T06:53:04.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:03 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-01T06:53:04.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:03 smithi153 ceph-mon[48187]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-04-01T06:53:04.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:03 smithi153 ceph-mon[48187]: osdmap e54: 9 total, 8 up, 9 in 2024-04-01T06:53:04.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:03 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-01T06:53:04.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:03 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-01T06:53:04.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:03 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T06:53:04.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:03 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T06:53:04.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:03 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:53:04.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:03 smithi153 ceph-mon[48187]: from='osd.8 ' entity='osd.8' 2024-04-01T06:53:04.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:03 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-01T06:53:05.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:04 smithi145 ceph-mon[47816]: purged_snaps scrub starts 2024-04-01T06:53:05.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:04 smithi145 ceph-mon[47816]: purged_snaps scrub ok 2024-04-01T06:53:05.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:04 smithi145 ceph-mon[47816]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:53:05.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:04 smithi145 ceph-mon[47816]: osd.8 [v2:172.21.15.153:6816/1031545791,v1:172.21.15.153:6817/1031545791] boot 2024-04-01T06:53:05.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:04 smithi145 ceph-mon[47816]: osdmap e55: 9 total, 9 up, 9 in 2024-04-01T06:53:05.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:04 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-01T06:53:05.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:04 smithi145 ceph-mon[47816]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-04-01T06:53:05.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:04 smithi083 ceph-mon[43429]: purged_snaps scrub starts 2024-04-01T06:53:05.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:04 smithi083 ceph-mon[43429]: purged_snaps scrub ok 2024-04-01T06:53:05.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:04 smithi083 ceph-mon[43429]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:53:05.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:04 smithi083 ceph-mon[43429]: osd.8 [v2:172.21.15.153:6816/1031545791,v1:172.21.15.153:6817/1031545791] boot 2024-04-01T06:53:05.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:04 smithi083 ceph-mon[43429]: osdmap e55: 9 total, 9 up, 9 in 2024-04-01T06:53:05.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:04 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-01T06:53:05.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:04 smithi083 ceph-mon[43429]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-04-01T06:53:05.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:04 smithi153 ceph-mon[48187]: purged_snaps scrub starts 2024-04-01T06:53:05.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:04 smithi153 ceph-mon[48187]: purged_snaps scrub ok 2024-04-01T06:53:05.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:04 smithi153 ceph-mon[48187]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:53:05.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:04 smithi153 ceph-mon[48187]: osd.8 [v2:172.21.15.153:6816/1031545791,v1:172.21.15.153:6817/1031545791] boot 2024-04-01T06:53:05.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:04 smithi153 ceph-mon[48187]: osdmap e55: 9 total, 9 up, 9 in 2024-04-01T06:53:05.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:04 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-01T06:53:05.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:04 smithi153 ceph-mon[48187]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-04-01T06:53:06.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:05 smithi145 ceph-mon[47816]: osdmap e56: 9 total, 9 up, 9 in 2024-04-01T06:53:06.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:05 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/1564422504' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "08b12d27-1247-45e4-9d09-cacc0fce4bd2"}]: dispatch 2024-04-01T06:53:06.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:05 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/1564422504' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "08b12d27-1247-45e4-9d09-cacc0fce4bd2"}]': finished 2024-04-01T06:53:06.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:05 smithi145 ceph-mon[47816]: osdmap e57: 10 total, 9 up, 10 in 2024-04-01T06:53:06.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:05 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-01T06:53:06.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:05 smithi145 ceph-mon[47816]: osdmap e58: 10 total, 9 up, 10 in 2024-04-01T06:53:06.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:05 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-01T06:53:06.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:05 smithi083 ceph-mon[43429]: osdmap e56: 9 total, 9 up, 9 in 2024-04-01T06:53:06.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:05 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/1564422504' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "08b12d27-1247-45e4-9d09-cacc0fce4bd2"}]: dispatch 2024-04-01T06:53:06.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:05 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/1564422504' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "08b12d27-1247-45e4-9d09-cacc0fce4bd2"}]': finished 2024-04-01T06:53:06.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:05 smithi083 ceph-mon[43429]: osdmap e57: 10 total, 9 up, 10 in 2024-04-01T06:53:06.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:05 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-01T06:53:06.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:05 smithi083 ceph-mon[43429]: osdmap e58: 10 total, 9 up, 10 in 2024-04-01T06:53:06.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:05 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-01T06:53:06.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:05 smithi153 ceph-mon[48187]: osdmap e56: 9 total, 9 up, 9 in 2024-04-01T06:53:06.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:05 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/1564422504' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "08b12d27-1247-45e4-9d09-cacc0fce4bd2"}]: dispatch 2024-04-01T06:53:06.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:05 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/1564422504' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "08b12d27-1247-45e4-9d09-cacc0fce4bd2"}]': finished 2024-04-01T06:53:06.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:05 smithi153 ceph-mon[48187]: osdmap e57: 10 total, 9 up, 10 in 2024-04-01T06:53:06.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:05 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-01T06:53:06.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:05 smithi153 ceph-mon[48187]: osdmap e58: 10 total, 9 up, 10 in 2024-04-01T06:53:06.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:05 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-01T06:53:07.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:06 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/3705649489' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T06:53:07.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:06 smithi145 ceph-mon[47816]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 804 GiB / 805 GiB avail 2024-04-01T06:53:07.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:06 smithi145 ceph-mon[47816]: osdmap e59: 10 total, 9 up, 10 in 2024-04-01T06:53:07.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:06 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-01T06:53:07.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:06 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/3705649489' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T06:53:07.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:06 smithi083 ceph-mon[43429]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 804 GiB / 805 GiB avail 2024-04-01T06:53:07.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:06 smithi083 ceph-mon[43429]: osdmap e59: 10 total, 9 up, 10 in 2024-04-01T06:53:07.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:06 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-01T06:53:07.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:06 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/3705649489' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T06:53:07.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:06 smithi153 ceph-mon[48187]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 804 GiB / 805 GiB avail 2024-04-01T06:53:07.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:06 smithi153 ceph-mon[48187]: osdmap e59: 10 total, 9 up, 10 in 2024-04-01T06:53:07.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:06 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-01T06:53:09.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:08 smithi145 ceph-mon[47816]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-01T06:53:09.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:08 smithi083 ceph-mon[43429]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-01T06:53:09.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:08 smithi153 ceph-mon[48187]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 262 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-01T06:53:11.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:10 smithi145 ceph-mon[47816]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-04-01T06:53:11.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:10 smithi083 ceph-mon[43429]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-04-01T06:53:11.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:10 smithi153 ceph-mon[48187]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-04-01T06:53:12.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:11 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-04-01T06:53:12.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:11 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:53:12.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:11 smithi083 ceph-mon[43429]: Deploying daemon osd.9 on smithi083 2024-04-01T06:53:12.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:11 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-04-01T06:53:12.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:11 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:53:12.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:11 smithi153 ceph-mon[48187]: Deploying daemon osd.9 on smithi083 2024-04-01T06:53:12.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:11 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-04-01T06:53:12.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:11 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:53:12.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:11 smithi145 ceph-mon[47816]: Deploying daemon osd.9 on smithi083 2024-04-01T06:53:12.931 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:12 smithi083 ceph-mon[43429]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-04-01T06:53:13.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:12 smithi153 ceph-mon[48187]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-04-01T06:53:13.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:12 smithi145 ceph-mon[47816]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-04-01T06:53:15.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:14 smithi153 ceph-mon[48187]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-01T06:53:15.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:14 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:53:15.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:14 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:15.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:14 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:15.155 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:14 smithi083 ceph-mon[43429]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-01T06:53:15.155 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:14 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:53:15.155 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:14 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:15.155 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:14 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:15.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:14 smithi145 ceph-mon[47816]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-01T06:53:15.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:14 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:53:15.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:14 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:15.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:14 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:16.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:16.670+0000 7fd7d3fff700 1 -- 172.21.15.83:0/3516855224 <== mgr.14152 v2:172.21.15.83:6800/3375372052 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fd7ec02cdc0 con 0x7fd7d40a1120 2024-04-01T06:53:16.669 INFO:teuthology.orchestra.run.smithi083.stdout:Created osd(s) 9 on host 'smithi083' 2024-04-01T06:53:16.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:16.672+0000 7fd7f1171700 1 -- 172.21.15.83:0/3516855224 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd7d40a1120 msgr2=0x7fd7d40a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:53:16.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:16.672+0000 7fd7f1171700 1 --2- 172.21.15.83:0/3516855224 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd7d40a1120 0x7fd7d40a35e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec198290 tx=0x7fd7dc009260 comp rx=0 tx=0).stop 2024-04-01T06:53:16.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:16.672+0000 7fd7f1171700 1 -- 172.21.15.83:0/3516855224 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd7ec102990 msgr2=0x7fd7ec19e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:53:16.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:16.672+0000 7fd7f1171700 1 --2- 172.21.15.83:0/3516855224 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd7ec102990 0x7fd7ec19e330 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4007b60 tx=0x7fd7e4008ec0 comp rx=0 tx=0).stop 2024-04-01T06:53:16.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:16.672+0000 7fd7f1171700 1 -- 172.21.15.83:0/3516855224 shutdown_connections 2024-04-01T06:53:16.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:16.672+0000 7fd7f1171700 1 --2- 172.21.15.83:0/3516855224 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd7ec102990 0x7fd7ec19e330 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:16.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:16.672+0000 7fd7f1171700 1 --2- 172.21.15.83:0/3516855224 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd7d40a1120 0x7fd7d40a35e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:16.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:16.672+0000 7fd7f1171700 1 --2- 172.21.15.83:0/3516855224 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd7ec100df0 0x7fd7ec196e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:16.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:16.672+0000 7fd7f1171700 1 --2- 172.21.15.83:0/3516855224 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7ec101ff0 0x7fd7ec197340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:16.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:16.672+0000 7fd7f1171700 1 -- 172.21.15.83:0/3516855224 >> 172.21.15.83:0/3516855224 conn(0x7fd7ec0fc390 msgr2=0x7fd7ec105310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:53:16.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:16.672+0000 7fd7f1171700 1 -- 172.21.15.83:0/3516855224 shutdown_connections 2024-04-01T06:53:16.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:16.672+0000 7fd7f1171700 1 -- 172.21.15.83:0/3516855224 wait complete. 2024-04-01T06:53:16.935 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:16 smithi083 ceph-mon[43429]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-01T06:53:16.935 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:16 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:16.935 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:16 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:16.935 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:16 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:53:16.935 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:16 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:53:16.935 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:16 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:16.935 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:16 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:17.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:16 smithi145 ceph-mon[47816]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-01T06:53:17.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:16 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:17.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:16 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:17.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:16 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:53:17.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:16 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:53:17.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:16 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:17.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:16 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:17.080 DEBUG:teuthology.orchestra.run.smithi083:osd.9> sudo journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@osd.9.service 2024-04-01T06:53:17.082 INFO:tasks.cephadm:Deploying osd.10 on smithi145 with /dev/vg_nvme/lv_1... 2024-04-01T06:53:17.083 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-04-01T06:53:17.114 INFO:journalctl@ceph.osd.9.smithi083.stdout:-- Logs begin at Mon 2024-04-01 06:34:54 UTC. -- 2024-04-01T06:53:17.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:16 smithi153 ceph-mon[48187]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-01T06:53:17.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:16 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:17.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:16 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:17.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:16 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:53:17.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:16 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:53:17.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:16 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:17.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:16 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:17.325 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T06:53:17.752 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:17 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:17.752 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:17 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:53:17.919 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:17 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:17.919 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:17 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:53:18.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:17 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:18.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:17 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:53:18.643 INFO:teuthology.orchestra.run.smithi145.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-04-01T06:53:18.643 INFO:teuthology.orchestra.run.smithi145.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-04-01T06:53:18.643 INFO:teuthology.orchestra.run.smithi145.stderr: stderr: 10+0 records in 2024-04-01T06:53:18.643 INFO:teuthology.orchestra.run.smithi145.stderr:10+0 records out 2024-04-01T06:53:18.643 INFO:teuthology.orchestra.run.smithi145.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0112377 s, 933 MB/s 2024-04-01T06:53:18.643 INFO:teuthology.orchestra.run.smithi145.stderr:--> Zapping successful for: 2024-04-01T06:53:18.923 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:18 smithi083 ceph-mon[43429]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-04-01T06:53:18.923 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:18 smithi083 ceph-mon[43429]: from='osd.9 [v2:172.21.15.83:6826/3720996673,v1:172.21.15.83:6827/3720996673]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-01T06:53:18.924 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 06:53:18 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T06:53:18.563+0000 7fa72b390640 -1 osd.9 0 log_to_monitors true 2024-04-01T06:53:18.932 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:18 smithi145 ceph-mon[47816]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-04-01T06:53:18.932 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:18 smithi145 ceph-mon[47816]: from='osd.9 [v2:172.21.15.83:6826/3720996673,v1:172.21.15.83:6827/3720996673]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-01T06:53:19.058 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi145:vg_nvme/lv_1 2024-04-01T06:53:19.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:18 smithi153 ceph-mon[48187]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-04-01T06:53:19.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:18 smithi153 ceph-mon[48187]: from='osd.9 [v2:172.21.15.83:6826/3720996673,v1:172.21.15.83:6827/3720996673]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-01T06:53:19.276 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T06:53:20.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:19 smithi145 ceph-mon[47816]: from='osd.9 [v2:172.21.15.83:6826/3720996673,v1:172.21.15.83:6827/3720996673]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-04-01T06:53:20.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:19 smithi145 ceph-mon[47816]: osdmap e60: 10 total, 9 up, 10 in 2024-04-01T06:53:20.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:19 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-01T06:53:20.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:19 smithi145 ceph-mon[47816]: from='osd.9 [v2:172.21.15.83:6826/3720996673,v1:172.21.15.83:6827/3720996673]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]: dispatch 2024-04-01T06:53:20.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:19 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:20.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:19 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:20.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:19 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:53:20.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:19 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:53:20.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:19 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:53:20.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:19 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:53:20.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:19 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:20.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:19 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:53:20.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:19 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:53:20.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:19 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:20.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:19 smithi145 ceph-mon[47816]: from='osd.9 [v2:172.21.15.83:6826/3720996673,v1:172.21.15.83:6827/3720996673]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]': finished 2024-04-01T06:53:20.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:19 smithi145 ceph-mon[47816]: osdmap e61: 10 total, 9 up, 10 in 2024-04-01T06:53:20.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:19 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-01T06:53:20.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:19 smithi083 ceph-mon[43429]: from='osd.9 [v2:172.21.15.83:6826/3720996673,v1:172.21.15.83:6827/3720996673]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-04-01T06:53:20.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:19 smithi083 ceph-mon[43429]: osdmap e60: 10 total, 9 up, 10 in 2024-04-01T06:53:20.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:19 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-01T06:53:20.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:19 smithi083 ceph-mon[43429]: from='osd.9 [v2:172.21.15.83:6826/3720996673,v1:172.21.15.83:6827/3720996673]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]: dispatch 2024-04-01T06:53:20.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:19 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:20.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:19 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:20.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:19 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:53:20.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:19 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:53:20.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:19 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:53:20.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:19 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:53:20.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:19 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:20.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:19 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:53:20.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:19 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:53:20.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:19 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:20.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:19 smithi083 ceph-mon[43429]: from='osd.9 [v2:172.21.15.83:6826/3720996673,v1:172.21.15.83:6827/3720996673]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]': finished 2024-04-01T06:53:20.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:19 smithi083 ceph-mon[43429]: osdmap e61: 10 total, 9 up, 10 in 2024-04-01T06:53:20.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:19 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-01T06:53:20.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:19 smithi153 ceph-mon[48187]: from='osd.9 [v2:172.21.15.83:6826/3720996673,v1:172.21.15.83:6827/3720996673]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-04-01T06:53:20.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:19 smithi153 ceph-mon[48187]: osdmap e60: 10 total, 9 up, 10 in 2024-04-01T06:53:20.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:19 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-01T06:53:20.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:19 smithi153 ceph-mon[48187]: from='osd.9 [v2:172.21.15.83:6826/3720996673,v1:172.21.15.83:6827/3720996673]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]: dispatch 2024-04-01T06:53:20.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:19 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:20.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:19 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:20.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:19 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:53:20.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:19 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:53:20.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:19 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:53:20.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:19 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:53:20.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:19 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:20.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:19 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:53:20.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:19 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:53:20.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:19 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:20.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:19 smithi153 ceph-mon[48187]: from='osd.9 [v2:172.21.15.83:6826/3720996673,v1:172.21.15.83:6827/3720996673]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]': finished 2024-04-01T06:53:20.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:19 smithi153 ceph-mon[48187]: osdmap e61: 10 total, 9 up, 10 in 2024-04-01T06:53:20.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:19 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-01T06:53:20.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:53:20.293+0000 7f75b88ef700 1 -- 172.21.15.145:0/957748724 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f75b4101f60 msgr2=0x7f75b41023e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:53:20.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:53:20.293+0000 7f75b88ef700 1 --2- 172.21.15.145:0/957748724 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f75b4101f60 0x7f75b41023e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f75a4009990 tx=0x7f75a4009ca0 comp rx=0 tx=0).stop 2024-04-01T06:53:20.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:53:20.293+0000 7f75b88ef700 1 -- 172.21.15.145:0/957748724 shutdown_connections 2024-04-01T06:53:20.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:53:20.293+0000 7f75b88ef700 1 --2- 172.21.15.145:0/957748724 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f75b4100e00 0x7f75b4101220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:20.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:53:20.293+0000 7f75b88ef700 1 --2- 172.21.15.145:0/957748724 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75b4102920 0x7f75b4109240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:20.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:53:20.293+0000 7f75b88ef700 1 --2- 172.21.15.145:0/957748724 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f75b4101f60 0x7f75b41023e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:20.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:53:20.293+0000 7f75b88ef700 1 -- 172.21.15.145:0/957748724 >> 172.21.15.145:0/957748724 conn(0x7f75b40fc3c0 msgr2=0x7f75b40fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:53:20.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:53:20.293+0000 7f75b88ef700 1 -- 172.21.15.145:0/957748724 shutdown_connections 2024-04-01T06:53:20.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:53:20.293+0000 7f75b88ef700 1 -- 172.21.15.145:0/957748724 wait complete. 2024-04-01T06:53:20.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:53:20.294+0000 7f75b88ef700 1 Processor -- start 2024-04-01T06:53:20.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:53:20.294+0000 7f75b88ef700 1 -- start start 2024-04-01T06:53:20.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:53:20.294+0000 7f75b88ef700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f75b4100e00 0x7f75b4196ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:53:20.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:53:20.294+0000 7f75b88ef700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75b4101f60 0x7f75b4197220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:53:20.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:53:20.294+0000 7f75b88ef700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f75b4102920 0x7f75b419e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:53:20.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:53:20.294+0000 7f75b88ef700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b419e810 con 0x7f75b4102920 2024-04-01T06:53:20.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:53:20.294+0000 7f75b88ef700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b419e950 con 0x7f75b4100e00 2024-04-01T06:53:20.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:53:20.294+0000 7f75b88ef700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b419eb10 con 0x7f75b4101f60 2024-04-01T06:53:20.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:53:20.295+0000 7f75b259c700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f75b4100e00 0x7f75b4196ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:53:20.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:53:20.295+0000 7f75b259c700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f75b4100e00 0x7f75b4196ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:56736/0 (socket says 172.21.15.145:56736) 2024-04-01T06:53:20.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:53:20.295+0000 7f75b259c700 1 -- 172.21.15.145:0/4012022172 learned_addr learned my addr 172.21.15.145:0/4012022172 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-04-01T06:53:20.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:53:20.295+0000 7f75b1d9b700 1 --2- 172.21.15.145:0/4012022172 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75b4101f60 0x7f75b4197220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:53:20.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:53:20.295+0000 7f75b2d9d700 1 --2- 172.21.15.145:0/4012022172 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f75b4102920 0x7f75b419e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:53:20.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:53:20.295+0000 7f75b259c700 1 -- 172.21.15.145:0/4012022172 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75b4101f60 msgr2=0x7f75b4197220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:53:20.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:53:20.295+0000 7f75b259c700 1 --2- 172.21.15.145:0/4012022172 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75b4101f60 0x7f75b4197220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:20.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:53:20.295+0000 7f75b259c700 1 -- 172.21.15.145:0/4012022172 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f75b4102920 msgr2=0x7f75b419e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:53:20.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:53:20.295+0000 7f75b259c700 1 --2- 172.21.15.145:0/4012022172 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f75b4102920 0x7f75b419e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:20.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:53:20.295+0000 7f75b259c700 1 -- 172.21.15.145:0/4012022172 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a40095f0 con 0x7f75b4100e00 2024-04-01T06:53:20.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:53:20.295+0000 7f75b259c700 1 --2- 172.21.15.145:0/4012022172 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f75b4100e00 0x7f75b4196ce0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f75a800d980 tx=0x7f75a800dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:53:20.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:53:20.295+0000 7f75a37fe700 1 -- 172.21.15.145:0/4012022172 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a8004220 con 0x7f75b4100e00 2024-04-01T06:53:20.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:53:20.295+0000 7f75a37fe700 1 -- 172.21.15.145:0/4012022172 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f75a8007640 con 0x7f75b4100e00 2024-04-01T06:53:20.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:53:20.295+0000 7f75b88ef700 1 -- 172.21.15.145:0/4012022172 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75b419edf0 con 0x7f75b4100e00 2024-04-01T06:53:20.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:53:20.295+0000 7f75a37fe700 1 -- 172.21.15.145:0/4012022172 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a8005610 con 0x7f75b4100e00 2024-04-01T06:53:20.297 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:53:20.295+0000 7f75b88ef700 1 -- 172.21.15.145:0/4012022172 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75b419f200 con 0x7f75b4100e00 2024-04-01T06:53:20.297 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:53:20.297+0000 7f75b88ef700 1 -- 172.21.15.145:0/4012022172 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75b4108280 con 0x7f75b4100e00 2024-04-01T06:53:20.297 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:53:20.297+0000 7f75a37fe700 1 -- 172.21.15.145:0/4012022172 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 16) v1 ==== 135865+0+0 (secure 0 0 0) 0x7f75a8004750 con 0x7f75b4100e00 2024-04-01T06:53:20.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:53:20.298+0000 7f75a37fe700 1 --2- 172.21.15.145:0/4012022172 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f759c0a1120 0x7f759c0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:53:20.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:53:20.298+0000 7f75a37fe700 1 -- 172.21.15.145:0/4012022172 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5981+0+0 (secure 0 0 0) 0x7f75a80cbe90 con 0x7f75b4100e00 2024-04-01T06:53:20.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:53:20.298+0000 7f75b1d9b700 1 --2- 172.21.15.145:0/4012022172 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f759c0a1120 0x7f759c0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:53:20.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:53:20.298+0000 7f75b1d9b700 1 --2- 172.21.15.145:0/4012022172 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f759c0a1120 0x7f759c0a35e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f75b41981a0 tx=0x7f75a4003790 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:53:20.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:53:20.302+0000 7f75a37fe700 1 -- 172.21.15.145:0/4012022172 <== mon.2 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f75a8095f40 con 0x7f75b4100e00 2024-04-01T06:53:20.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:53:20.501+0000 7f75b88ef700 1 -- 172.21.15.145:0/4012022172 --> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f75b402cd20 con 0x7f759c0a1120 2024-04-01T06:53:20.512 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 06:53:20 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T06:53:20.107+0000 7fa7211f5700 -1 osd.9 0 waiting for initial osdmap 2024-04-01T06:53:20.512 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 06:53:20 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T06:53:20.119+0000 7fa7187e1700 -1 osd.9 61 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T06:53:21.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:20 smithi145 ceph-mon[47816]: Detected new or changed devices on smithi083 2024-04-01T06:53:21.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:20 smithi145 ceph-mon[47816]: Adjusting osd_memory_target on smithi083 to 4278M 2024-04-01T06:53:21.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:20 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-01T06:53:21.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:20 smithi145 ceph-mon[47816]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-04-01T06:53:21.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:20 smithi145 ceph-mon[47816]: from='osd.9 [v2:172.21.15.83:6826/3720996673,v1:172.21.15.83:6827/3720996673]' entity='osd.9' 2024-04-01T06:53:21.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:20 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T06:53:21.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:20 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T06:53:21.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:20 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:53:21.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:20 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-01T06:53:21.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:20 smithi083 ceph-mon[43429]: Detected new or changed devices on smithi083 2024-04-01T06:53:21.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:20 smithi083 ceph-mon[43429]: Adjusting osd_memory_target on smithi083 to 4278M 2024-04-01T06:53:21.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:20 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-01T06:53:21.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:20 smithi083 ceph-mon[43429]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-04-01T06:53:21.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:20 smithi083 ceph-mon[43429]: from='osd.9 [v2:172.21.15.83:6826/3720996673,v1:172.21.15.83:6827/3720996673]' entity='osd.9' 2024-04-01T06:53:21.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:20 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T06:53:21.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:20 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T06:53:21.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:20 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:53:21.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:20 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-01T06:53:21.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:20 smithi153 ceph-mon[48187]: Detected new or changed devices on smithi083 2024-04-01T06:53:21.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:20 smithi153 ceph-mon[48187]: Adjusting osd_memory_target on smithi083 to 4278M 2024-04-01T06:53:21.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:20 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-01T06:53:21.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:20 smithi153 ceph-mon[48187]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-04-01T06:53:21.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:20 smithi153 ceph-mon[48187]: from='osd.9 [v2:172.21.15.83:6826/3720996673,v1:172.21.15.83:6827/3720996673]' entity='osd.9' 2024-04-01T06:53:21.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:20 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T06:53:21.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:20 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T06:53:21.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:20 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:53:21.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:20 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-01T06:53:22.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:21 smithi145 ceph-mon[47816]: purged_snaps scrub starts 2024-04-01T06:53:22.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:21 smithi145 ceph-mon[47816]: purged_snaps scrub ok 2024-04-01T06:53:22.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:21 smithi145 ceph-mon[47816]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:53:22.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:21 smithi145 ceph-mon[47816]: osd.9 [v2:172.21.15.83:6826/3720996673,v1:172.21.15.83:6827/3720996673] boot 2024-04-01T06:53:22.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:21 smithi145 ceph-mon[47816]: osdmap e62: 10 total, 10 up, 10 in 2024-04-01T06:53:22.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:21 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-01T06:53:22.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:21 smithi083 ceph-mon[43429]: purged_snaps scrub starts 2024-04-01T06:53:22.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:21 smithi083 ceph-mon[43429]: purged_snaps scrub ok 2024-04-01T06:53:22.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:21 smithi083 ceph-mon[43429]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:53:22.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:21 smithi083 ceph-mon[43429]: osd.9 [v2:172.21.15.83:6826/3720996673,v1:172.21.15.83:6827/3720996673] boot 2024-04-01T06:53:22.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:21 smithi083 ceph-mon[43429]: osdmap e62: 10 total, 10 up, 10 in 2024-04-01T06:53:22.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:21 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-01T06:53:22.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:21 smithi153 ceph-mon[48187]: purged_snaps scrub starts 2024-04-01T06:53:22.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:21 smithi153 ceph-mon[48187]: purged_snaps scrub ok 2024-04-01T06:53:22.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:21 smithi153 ceph-mon[48187]: from='client.24359 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:53:22.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:21 smithi153 ceph-mon[48187]: osd.9 [v2:172.21.15.83:6826/3720996673,v1:172.21.15.83:6827/3720996673] boot 2024-04-01T06:53:22.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:21 smithi153 ceph-mon[48187]: osdmap e62: 10 total, 10 up, 10 in 2024-04-01T06:53:22.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:21 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-01T06:53:23.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:22 smithi145 ceph-mon[47816]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-04-01T06:53:23.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:22 smithi145 ceph-mon[47816]: osdmap e63: 10 total, 10 up, 10 in 2024-04-01T06:53:23.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:22 smithi145 ceph-mon[47816]: from='client.? 172.21.15.145:0/3941695909' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dd986b50-d68f-446c-9c66-261535880879"}]: dispatch 2024-04-01T06:53:23.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:22 smithi145 ceph-mon[47816]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dd986b50-d68f-446c-9c66-261535880879"}]: dispatch 2024-04-01T06:53:23.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:22 smithi145 ceph-mon[47816]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dd986b50-d68f-446c-9c66-261535880879"}]': finished 2024-04-01T06:53:23.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:22 smithi145 ceph-mon[47816]: osdmap e64: 11 total, 10 up, 11 in 2024-04-01T06:53:23.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:22 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-01T06:53:23.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:22 smithi083 ceph-mon[43429]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-04-01T06:53:23.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:22 smithi083 ceph-mon[43429]: osdmap e63: 10 total, 10 up, 10 in 2024-04-01T06:53:23.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:22 smithi083 ceph-mon[43429]: from='client.? 172.21.15.145:0/3941695909' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dd986b50-d68f-446c-9c66-261535880879"}]: dispatch 2024-04-01T06:53:23.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:22 smithi083 ceph-mon[43429]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dd986b50-d68f-446c-9c66-261535880879"}]: dispatch 2024-04-01T06:53:23.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:22 smithi083 ceph-mon[43429]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dd986b50-d68f-446c-9c66-261535880879"}]': finished 2024-04-01T06:53:23.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:22 smithi083 ceph-mon[43429]: osdmap e64: 11 total, 10 up, 11 in 2024-04-01T06:53:23.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:22 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-01T06:53:23.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:22 smithi153 ceph-mon[48187]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-04-01T06:53:23.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:22 smithi153 ceph-mon[48187]: osdmap e63: 10 total, 10 up, 10 in 2024-04-01T06:53:23.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:22 smithi153 ceph-mon[48187]: from='client.? 172.21.15.145:0/3941695909' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dd986b50-d68f-446c-9c66-261535880879"}]: dispatch 2024-04-01T06:53:23.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:22 smithi153 ceph-mon[48187]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dd986b50-d68f-446c-9c66-261535880879"}]: dispatch 2024-04-01T06:53:23.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:22 smithi153 ceph-mon[48187]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dd986b50-d68f-446c-9c66-261535880879"}]': finished 2024-04-01T06:53:23.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:22 smithi153 ceph-mon[48187]: osdmap e64: 11 total, 10 up, 11 in 2024-04-01T06:53:23.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:22 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-01T06:53:24.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:23 smithi145 ceph-mon[47816]: from='client.? 172.21.15.145:0/2169050596' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T06:53:24.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:23 smithi083 ceph-mon[43429]: from='client.? 172.21.15.145:0/2169050596' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T06:53:24.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:23 smithi153 ceph-mon[48187]: from='client.? 172.21.15.145:0/2169050596' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T06:53:25.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:24 smithi145 ceph-mon[47816]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-04-01T06:53:25.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:24 smithi083 ceph-mon[43429]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-04-01T06:53:25.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:24 smithi153 ceph-mon[48187]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-04-01T06:53:27.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:26 smithi145 ceph-mon[47816]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-04-01T06:53:27.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:26 smithi083 ceph-mon[43429]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-04-01T06:53:27.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:26 smithi153 ceph-mon[48187]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-04-01T06:53:29.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:28 smithi145 ceph-mon[47816]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-04-01T06:53:29.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:28 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-04-01T06:53:29.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:28 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:53:29.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:28 smithi083 ceph-mon[43429]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-04-01T06:53:29.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:28 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-04-01T06:53:29.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:28 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:53:29.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:28 smithi153 ceph-mon[48187]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-04-01T06:53:29.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:28 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-04-01T06:53:29.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:28 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:53:30.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:29 smithi083 ceph-mon[43429]: Deploying daemon osd.10 on smithi145 2024-04-01T06:53:30.072 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:29 smithi145 ceph-mon[47816]: Deploying daemon osd.10 on smithi145 2024-04-01T06:53:30.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:29 smithi153 ceph-mon[48187]: Deploying daemon osd.10 on smithi145 2024-04-01T06:53:31.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:30 smithi153 ceph-mon[48187]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-04-01T06:53:31.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:30 smithi145 ceph-mon[47816]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-04-01T06:53:31.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:30 smithi083 ceph-mon[43429]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-04-01T06:53:32.943 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:32 smithi145 ceph-mon[47816]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-04-01T06:53:32.943 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:32 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:32.943 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:32 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:32.943 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:32 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:53:33.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:32 smithi153 ceph-mon[48187]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-04-01T06:53:33.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:32 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:33.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:32 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:33.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:32 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:53:33.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:32 smithi083 ceph-mon[43429]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-04-01T06:53:33.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:32 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:33.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:32 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:33.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:32 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:53:34.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:53:34.403+0000 7f75a37fe700 1 -- 172.21.15.145:0/4012022172 <== mgr.14152 v2:172.21.15.83:6800/3375372052 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f75b402cd20 con 0x7f759c0a1120 2024-04-01T06:53:34.403 INFO:teuthology.orchestra.run.smithi145.stdout:Created osd(s) 10 on host 'smithi145' 2024-04-01T06:53:34.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:53:34.406+0000 7f75b88ef700 1 -- 172.21.15.145:0/4012022172 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f759c0a1120 msgr2=0x7f759c0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:53:34.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:53:34.406+0000 7f75b88ef700 1 --2- 172.21.15.145:0/4012022172 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f759c0a1120 0x7f759c0a35e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f75b41981a0 tx=0x7f75a4003790 comp rx=0 tx=0).stop 2024-04-01T06:53:34.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:53:34.406+0000 7f75b88ef700 1 -- 172.21.15.145:0/4012022172 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f75b4100e00 msgr2=0x7f75b4196ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:53:34.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:53:34.406+0000 7f75b88ef700 1 --2- 172.21.15.145:0/4012022172 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f75b4100e00 0x7f75b4196ce0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f75a800d980 tx=0x7f75a800dc90 comp rx=0 tx=0).stop 2024-04-01T06:53:34.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:53:34.406+0000 7f75b88ef700 1 -- 172.21.15.145:0/4012022172 shutdown_connections 2024-04-01T06:53:34.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:53:34.406+0000 7f75b88ef700 1 --2- 172.21.15.145:0/4012022172 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f75b4102920 0x7f75b419e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:34.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:53:34.406+0000 7f75b88ef700 1 --2- 172.21.15.145:0/4012022172 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f759c0a1120 0x7f759c0a35e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:34.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:53:34.406+0000 7f75b88ef700 1 --2- 172.21.15.145:0/4012022172 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f75b4100e00 0x7f75b4196ce0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:34.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:53:34.406+0000 7f75b88ef700 1 --2- 172.21.15.145:0/4012022172 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75b4101f60 0x7f75b4197220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:34.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:53:34.406+0000 7f75b88ef700 1 -- 172.21.15.145:0/4012022172 >> 172.21.15.145:0/4012022172 conn(0x7f75b40fc3c0 msgr2=0x7f75b41053c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:53:34.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:53:34.406+0000 7f75b88ef700 1 -- 172.21.15.145:0/4012022172 shutdown_connections 2024-04-01T06:53:34.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-04-01T06:53:34.406+0000 7f75b88ef700 1 -- 172.21.15.145:0/4012022172 wait complete. 2024-04-01T06:53:34.776 DEBUG:teuthology.orchestra.run.smithi145:osd.10> sudo journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@osd.10.service 2024-04-01T06:53:34.778 INFO:tasks.cephadm:Deploying osd.11 on smithi153 with /dev/vg_nvme/lv_1... 2024-04-01T06:53:34.778 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-04-01T06:53:34.810 INFO:journalctl@ceph.osd.10.smithi145.stdout:-- Logs begin at Mon 2024-04-01 06:34:41 UTC. -- 2024-04-01T06:53:34.883 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:34 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:34.883 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:34 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:34.883 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:34 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:53:34.883 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:34 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:53:34.883 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:34 smithi145 ceph-mon[47816]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-04-01T06:53:34.883 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:34 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:34.883 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:34 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:34.883 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:34 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:34.883 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:34 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:53:35.008 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T06:53:35.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:34 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:35.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:34 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:35.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:34 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:53:35.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:34 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:53:35.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:34 smithi083 ceph-mon[43429]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-04-01T06:53:35.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:34 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:35.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:34 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:35.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:34 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:35.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:34 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:53:35.103 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:34 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:35.104 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:34 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:35.104 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:34 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:53:35.104 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:34 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:53:35.104 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:34 smithi153 ceph-mon[48187]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-04-01T06:53:35.104 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:34 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:35.104 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:34 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:35.104 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:34 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:35.104 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:34 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:53:36.263 INFO:teuthology.orchestra.run.smithi153.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-04-01T06:53:36.263 INFO:teuthology.orchestra.run.smithi153.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-04-01T06:53:36.263 INFO:teuthology.orchestra.run.smithi153.stderr: stderr: 10+0 records in 2024-04-01T06:53:36.263 INFO:teuthology.orchestra.run.smithi153.stderr:10+0 records out 2024-04-01T06:53:36.263 INFO:teuthology.orchestra.run.smithi153.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113291 s, 926 MB/s 2024-04-01T06:53:36.263 INFO:teuthology.orchestra.run.smithi153.stderr:--> Zapping successful for: 2024-04-01T06:53:36.435 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 06:53:36 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T06:53:36.078+0000 7fcf61809640 -1 osd.10 0 log_to_monitors true 2024-04-01T06:53:36.648 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph orch daemon add osd smithi153:vg_nvme/lv_1 2024-04-01T06:53:36.695 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:36 smithi145 ceph-mon[47816]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-04-01T06:53:36.696 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:36 smithi145 ceph-mon[47816]: from='osd.10 [v2:172.21.15.145:6824/2671529479,v1:172.21.15.145:6825/2671529479]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-01T06:53:36.696 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:36 smithi145 ceph-mon[47816]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-01T06:53:36.872 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T06:53:36.890 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:36 smithi153 ceph-mon[48187]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-04-01T06:53:36.890 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:36 smithi153 ceph-mon[48187]: from='osd.10 [v2:172.21.15.145:6824/2671529479,v1:172.21.15.145:6825/2671529479]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-01T06:53:36.890 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:36 smithi153 ceph-mon[48187]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-01T06:53:37.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:36 smithi083 ceph-mon[43429]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-04-01T06:53:37.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:36 smithi083 ceph-mon[43429]: from='osd.10 [v2:172.21.15.145:6824/2671529479,v1:172.21.15.145:6825/2671529479]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-01T06:53:37.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:36 smithi083 ceph-mon[43429]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-01T06:53:37.768 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:53:37.766+0000 7f6bed54c700 1 -- 172.21.15.153:0/3325965372 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6be8100e00 msgr2=0x7f6be8101220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:53:37.768 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:53:37.766+0000 7f6bed54c700 1 --2- 172.21.15.153:0/3325965372 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6be8100e00 0x7f6be8101220 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8009990 tx=0x7f6bd8009ca0 comp rx=0 tx=0).stop 2024-04-01T06:53:37.768 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:53:37.766+0000 7f6bed54c700 1 -- 172.21.15.153:0/3325965372 shutdown_connections 2024-04-01T06:53:37.768 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:53:37.766+0000 7f6bed54c700 1 --2- 172.21.15.153:0/3325965372 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6be8102920 0x7f6be8109240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:37.768 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:53:37.766+0000 7f6bed54c700 1 --2- 172.21.15.153:0/3325965372 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6be8100e00 0x7f6be8101220 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:37.768 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:53:37.766+0000 7f6bed54c700 1 --2- 172.21.15.153:0/3325965372 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6be8101f60 0x7f6be81023e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:37.768 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:53:37.766+0000 7f6bed54c700 1 -- 172.21.15.153:0/3325965372 >> 172.21.15.153:0/3325965372 conn(0x7f6be80fc3c0 msgr2=0x7f6be80fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:53:37.768 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:53:37.766+0000 7f6bed54c700 1 -- 172.21.15.153:0/3325965372 shutdown_connections 2024-04-01T06:53:37.768 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:53:37.766+0000 7f6bed54c700 1 -- 172.21.15.153:0/3325965372 wait complete. 2024-04-01T06:53:37.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:53:37.767+0000 7f6bed54c700 1 Processor -- start 2024-04-01T06:53:37.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:53:37.767+0000 7f6bed54c700 1 -- start start 2024-04-01T06:53:37.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:53:37.767+0000 7f6bed54c700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6be8100e00 0x7f6be8196bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:53:37.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:53:37.767+0000 7f6bed54c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6be8101f60 0x7f6be8197130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:53:37.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:53:37.767+0000 7f6bed54c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6be8102920 0x7f6be819e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:53:37.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:53:37.767+0000 7f6bed54c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be819e730 con 0x7f6be8102920 2024-04-01T06:53:37.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:53:37.767+0000 7f6bed54c700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be819e870 con 0x7f6be8100e00 2024-04-01T06:53:37.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:53:37.767+0000 7f6bed54c700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be819ea00 con 0x7f6be8101f60 2024-04-01T06:53:37.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:53:37.767+0000 7f6be67fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6be8101f60 0x7f6be8197130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:53:37.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:53:37.767+0000 7f6be67fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6be8101f60 0x7f6be8197130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:34090/0 (socket says 172.21.15.153:34090) 2024-04-01T06:53:37.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:53:37.767+0000 7f6be67fc700 1 -- 172.21.15.153:0/2690297896 learned_addr learned my addr 172.21.15.153:0/2690297896 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-04-01T06:53:37.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:53:37.767+0000 7f6be6ffd700 1 --2- 172.21.15.153:0/2690297896 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6be8100e00 0x7f6be8196bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:53:37.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:53:37.767+0000 7f6be77fe700 1 --2- 172.21.15.153:0/2690297896 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6be8102920 0x7f6be819e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:53:37.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:53:37.767+0000 7f6be67fc700 1 -- 172.21.15.153:0/2690297896 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6be8100e00 msgr2=0x7f6be8196bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:53:37.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:53:37.767+0000 7f6be67fc700 1 --2- 172.21.15.153:0/2690297896 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6be8100e00 0x7f6be8196bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:37.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:53:37.767+0000 7f6be67fc700 1 -- 172.21.15.153:0/2690297896 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6be8102920 msgr2=0x7f6be819e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:53:37.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:53:37.767+0000 7f6be67fc700 1 --2- 172.21.15.153:0/2690297896 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6be8102920 0x7f6be819e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:37.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:53:37.768+0000 7f6be67fc700 1 -- 172.21.15.153:0/2690297896 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd80095f0 con 0x7f6be8101f60 2024-04-01T06:53:37.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:53:37.768+0000 7f6be67fc700 1 --2- 172.21.15.153:0/2690297896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6be8101f60 0x7f6be8197130 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6bd000d980 tx=0x7f6bd000dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:53:37.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:53:37.768+0000 7f6bdffff700 1 -- 172.21.15.153:0/2690297896 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd0009b40 con 0x7f6be8101f60 2024-04-01T06:53:37.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:53:37.768+0000 7f6bdffff700 1 -- 172.21.15.153:0/2690297896 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6bd000b6e0 con 0x7f6be8101f60 2024-04-01T06:53:37.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:53:37.768+0000 7f6bed54c700 1 -- 172.21.15.153:0/2690297896 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6be819ece0 con 0x7f6be8101f60 2024-04-01T06:53:37.770 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:53:37.768+0000 7f6bdffff700 1 -- 172.21.15.153:0/2690297896 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd000f620 con 0x7f6be8101f60 2024-04-01T06:53:37.771 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:53:37.768+0000 7f6bed54c700 1 -- 172.21.15.153:0/2690297896 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6be819f190 con 0x7f6be8101f60 2024-04-01T06:53:37.771 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:53:37.769+0000 7f6bed54c700 1 -- 172.21.15.153:0/2690297896 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6be8108280 con 0x7f6be8101f60 2024-04-01T06:53:37.771 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:53:37.770+0000 7f6bdffff700 1 -- 172.21.15.153:0/2690297896 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 16) v1 ==== 135865+0+0 (secure 0 0 0) 0x7f6bd0010460 con 0x7f6be8101f60 2024-04-01T06:53:37.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:53:37.770+0000 7f6bdffff700 1 --2- 172.21.15.153:0/2690297896 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f6bd40a1120 0x7f6bd40a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:53:37.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:53:37.771+0000 7f6bdffff700 1 -- 172.21.15.153:0/2690297896 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f6bd00cc3d0 con 0x7f6be8101f60 2024-04-01T06:53:37.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:53:37.771+0000 7f6be6ffd700 1 --2- 172.21.15.153:0/2690297896 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f6bd40a1120 0x7f6bd40a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:53:37.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:53:37.771+0000 7f6be6ffd700 1 --2- 172.21.15.153:0/2690297896 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f6bd40a1120 0x7f6bd40a35e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6bd800b5c0 tx=0x7f6bd8003790 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:53:37.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:53:37.775+0000 7f6bdffff700 1 -- 172.21.15.153:0/2690297896 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f6bd00962d0 con 0x7f6be8101f60 2024-04-01T06:53:37.890 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:37 smithi153 ceph-mon[48187]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-04-01T06:53:37.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:37 smithi153 ceph-mon[48187]: osdmap e65: 11 total, 10 up, 11 in 2024-04-01T06:53:37.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:37 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-01T06:53:37.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:37 smithi153 ceph-mon[48187]: from='osd.10 [v2:172.21.15.145:6824/2671529479,v1:172.21.15.145:6825/2671529479]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-04-01T06:53:37.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:37 smithi153 ceph-mon[48187]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-04-01T06:53:37.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:37 smithi153 ceph-mon[48187]: Detected new or changed devices on smithi145 2024-04-01T06:53:37.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:37 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:37.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:37 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:37.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:37 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:53:37.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:37 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:53:37.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:37 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:53:37.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:37 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:53:37.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:37 smithi153 ceph-mon[48187]: Adjusting osd_memory_target on smithi145 to 4278M 2024-04-01T06:53:37.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:37 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:37.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:37 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:53:37.892 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:37 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:53:37.892 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:37 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:37.976 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:53:37.977+0000 7f6bed54c700 1 -- 172.21.15.153:0/2690297896 --> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f6be802cd70 con 0x7f6bd40a1120 2024-04-01T06:53:38.002 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 06:53:37 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T06:53:37.679+0000 7fcf56e6d700 -1 osd.10 0 waiting for initial osdmap 2024-04-01T06:53:38.002 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 06:53:37 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T06:53:37.697+0000 7fcf52c62700 -1 osd.10 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T06:53:38.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:37 smithi145 ceph-mon[47816]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-04-01T06:53:38.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:37 smithi145 ceph-mon[47816]: osdmap e65: 11 total, 10 up, 11 in 2024-04-01T06:53:38.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:37 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-01T06:53:38.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:37 smithi145 ceph-mon[47816]: from='osd.10 [v2:172.21.15.145:6824/2671529479,v1:172.21.15.145:6825/2671529479]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-04-01T06:53:38.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:37 smithi145 ceph-mon[47816]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-04-01T06:53:38.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:37 smithi145 ceph-mon[47816]: Detected new or changed devices on smithi145 2024-04-01T06:53:38.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:37 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:38.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:37 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:38.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:37 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:53:38.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:37 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:53:38.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:37 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:53:38.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:37 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:53:38.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:37 smithi145 ceph-mon[47816]: Adjusting osd_memory_target on smithi145 to 4278M 2024-04-01T06:53:38.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:37 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:38.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:37 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:53:38.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:37 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:53:38.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:37 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:38.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:37 smithi083 ceph-mon[43429]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-04-01T06:53:38.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:37 smithi083 ceph-mon[43429]: osdmap e65: 11 total, 10 up, 11 in 2024-04-01T06:53:38.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:37 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-01T06:53:38.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:37 smithi083 ceph-mon[43429]: from='osd.10 [v2:172.21.15.145:6824/2671529479,v1:172.21.15.145:6825/2671529479]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-04-01T06:53:38.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:37 smithi083 ceph-mon[43429]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-04-01T06:53:38.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:37 smithi083 ceph-mon[43429]: Detected new or changed devices on smithi145 2024-04-01T06:53:38.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:37 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:38.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:37 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:38.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:37 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:53:38.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:37 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:53:38.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:37 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:53:38.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:37 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:53:38.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:37 smithi083 ceph-mon[43429]: Adjusting osd_memory_target on smithi145 to 4278M 2024-04-01T06:53:38.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:37 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:38.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:37 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:53:38.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:37 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:53:38.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:37 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:39.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:38 smithi145 ceph-mon[47816]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-04-01T06:53:39.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:38 smithi145 ceph-mon[47816]: osdmap e66: 11 total, 10 up, 11 in 2024-04-01T06:53:39.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:38 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-01T06:53:39.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:38 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-01T06:53:39.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:38 smithi145 ceph-mon[47816]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-04-01T06:53:39.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:38 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T06:53:39.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:38 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T06:53:39.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:38 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:53:39.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:38 smithi145 ceph-mon[47816]: osd.10 [v2:172.21.15.145:6824/2671529479,v1:172.21.15.145:6825/2671529479] boot 2024-04-01T06:53:39.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:38 smithi145 ceph-mon[47816]: osdmap e67: 11 total, 11 up, 11 in 2024-04-01T06:53:39.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:38 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-01T06:53:39.004 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:38 smithi153 ceph-mon[48187]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-04-01T06:53:39.004 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:38 smithi153 ceph-mon[48187]: osdmap e66: 11 total, 10 up, 11 in 2024-04-01T06:53:39.004 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:38 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-01T06:53:39.004 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:38 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-01T06:53:39.004 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:38 smithi153 ceph-mon[48187]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-04-01T06:53:39.004 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:38 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T06:53:39.004 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:38 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T06:53:39.004 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:38 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:53:39.004 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:38 smithi153 ceph-mon[48187]: osd.10 [v2:172.21.15.145:6824/2671529479,v1:172.21.15.145:6825/2671529479] boot 2024-04-01T06:53:39.004 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:38 smithi153 ceph-mon[48187]: osdmap e67: 11 total, 11 up, 11 in 2024-04-01T06:53:39.005 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:38 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-01T06:53:39.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:38 smithi083 ceph-mon[43429]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-04-01T06:53:39.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:38 smithi083 ceph-mon[43429]: osdmap e66: 11 total, 10 up, 11 in 2024-04-01T06:53:39.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:38 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-01T06:53:39.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:38 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-01T06:53:39.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:38 smithi083 ceph-mon[43429]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-04-01T06:53:39.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:38 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-01T06:53:39.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:38 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-01T06:53:39.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:38 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:53:39.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:38 smithi083 ceph-mon[43429]: osd.10 [v2:172.21.15.145:6824/2671529479,v1:172.21.15.145:6825/2671529479] boot 2024-04-01T06:53:39.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:38 smithi083 ceph-mon[43429]: osdmap e67: 11 total, 11 up, 11 in 2024-04-01T06:53:39.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:38 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-01T06:53:40.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:39 smithi145 ceph-mon[47816]: purged_snaps scrub starts 2024-04-01T06:53:40.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:39 smithi145 ceph-mon[47816]: purged_snaps scrub ok 2024-04-01T06:53:40.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:39 smithi145 ceph-mon[47816]: from='client.24358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:53:40.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:39 smithi083 ceph-mon[43429]: purged_snaps scrub starts 2024-04-01T06:53:40.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:39 smithi083 ceph-mon[43429]: purged_snaps scrub ok 2024-04-01T06:53:40.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:39 smithi083 ceph-mon[43429]: from='client.24358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:53:40.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:39 smithi153 ceph-mon[48187]: purged_snaps scrub starts 2024-04-01T06:53:40.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:39 smithi153 ceph-mon[48187]: purged_snaps scrub ok 2024-04-01T06:53:40.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:39 smithi153 ceph-mon[48187]: from='client.24358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:53:41.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:40 smithi145 ceph-mon[47816]: osdmap e68: 11 total, 11 up, 11 in 2024-04-01T06:53:41.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:40 smithi145 ceph-mon[47816]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-04-01T06:53:41.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:40 smithi145 ceph-mon[47816]: from='client.? 172.21.15.153:0/1872388535' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d20a49cd-6224-4424-8375-46da791d9931"}]: dispatch 2024-04-01T06:53:41.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:40 smithi145 ceph-mon[47816]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d20a49cd-6224-4424-8375-46da791d9931"}]: dispatch 2024-04-01T06:53:41.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:40 smithi145 ceph-mon[47816]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d20a49cd-6224-4424-8375-46da791d9931"}]': finished 2024-04-01T06:53:41.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:40 smithi145 ceph-mon[47816]: osdmap e69: 12 total, 11 up, 12 in 2024-04-01T06:53:41.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:40 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-01T06:53:41.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:40 smithi145 ceph-mon[47816]: from='client.? 172.21.15.153:0/1537781227' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T06:53:41.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:40 smithi145 ceph-mon[47816]: osdmap e70: 12 total, 11 up, 12 in 2024-04-01T06:53:41.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:40 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-01T06:53:41.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:40 smithi083 ceph-mon[43429]: osdmap e68: 11 total, 11 up, 11 in 2024-04-01T06:53:41.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:40 smithi083 ceph-mon[43429]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-04-01T06:53:41.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:40 smithi083 ceph-mon[43429]: from='client.? 172.21.15.153:0/1872388535' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d20a49cd-6224-4424-8375-46da791d9931"}]: dispatch 2024-04-01T06:53:41.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:40 smithi083 ceph-mon[43429]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d20a49cd-6224-4424-8375-46da791d9931"}]: dispatch 2024-04-01T06:53:41.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:40 smithi083 ceph-mon[43429]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d20a49cd-6224-4424-8375-46da791d9931"}]': finished 2024-04-01T06:53:41.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:40 smithi083 ceph-mon[43429]: osdmap e69: 12 total, 11 up, 12 in 2024-04-01T06:53:41.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:40 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-01T06:53:41.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:40 smithi083 ceph-mon[43429]: from='client.? 172.21.15.153:0/1537781227' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T06:53:41.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:40 smithi083 ceph-mon[43429]: osdmap e70: 12 total, 11 up, 12 in 2024-04-01T06:53:41.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:40 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-01T06:53:41.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:40 smithi153 ceph-mon[48187]: osdmap e68: 11 total, 11 up, 11 in 2024-04-01T06:53:41.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:40 smithi153 ceph-mon[48187]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-04-01T06:53:41.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:40 smithi153 ceph-mon[48187]: from='client.? 172.21.15.153:0/1872388535' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d20a49cd-6224-4424-8375-46da791d9931"}]: dispatch 2024-04-01T06:53:41.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:40 smithi153 ceph-mon[48187]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d20a49cd-6224-4424-8375-46da791d9931"}]: dispatch 2024-04-01T06:53:41.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:40 smithi153 ceph-mon[48187]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d20a49cd-6224-4424-8375-46da791d9931"}]': finished 2024-04-01T06:53:41.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:40 smithi153 ceph-mon[48187]: osdmap e69: 12 total, 11 up, 12 in 2024-04-01T06:53:41.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:40 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-01T06:53:41.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:40 smithi153 ceph-mon[48187]: from='client.? 172.21.15.153:0/1537781227' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-01T06:53:41.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:40 smithi153 ceph-mon[48187]: osdmap e70: 12 total, 11 up, 12 in 2024-04-01T06:53:41.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:40 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-01T06:53:43.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:42 smithi145 ceph-mon[47816]: osdmap e71: 12 total, 11 up, 12 in 2024-04-01T06:53:43.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:42 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-01T06:53:43.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:42 smithi145 ceph-mon[47816]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-04-01T06:53:43.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:42 smithi083 ceph-mon[43429]: osdmap e71: 12 total, 11 up, 12 in 2024-04-01T06:53:43.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:42 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-01T06:53:43.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:42 smithi083 ceph-mon[43429]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-04-01T06:53:43.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:42 smithi153 ceph-mon[48187]: osdmap e71: 12 total, 11 up, 12 in 2024-04-01T06:53:43.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:42 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-01T06:53:43.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:42 smithi153 ceph-mon[48187]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-04-01T06:53:44.884 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:44 smithi153 ceph-mon[48187]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 143 KiB/s, 0 objects/s recovering 2024-04-01T06:53:45.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:44 smithi083 ceph-mon[43429]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 143 KiB/s, 0 objects/s recovering 2024-04-01T06:53:45.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:44 smithi145 ceph-mon[47816]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 143 KiB/s, 0 objects/s recovering 2024-04-01T06:53:47.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:46 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-04-01T06:53:47.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:46 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:53:47.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:46 smithi145 ceph-mon[47816]: Deploying daemon osd.11 on smithi153 2024-04-01T06:53:47.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:46 smithi145 ceph-mon[47816]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-01T06:53:47.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:46 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-04-01T06:53:47.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:46 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:53:47.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:46 smithi083 ceph-mon[43429]: Deploying daemon osd.11 on smithi153 2024-04-01T06:53:47.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:46 smithi083 ceph-mon[43429]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-01T06:53:47.032 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:46 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-04-01T06:53:47.032 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:46 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:53:47.032 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:46 smithi153 ceph-mon[48187]: Deploying daemon osd.11 on smithi153 2024-04-01T06:53:47.032 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:46 smithi153 ceph-mon[48187]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-01T06:53:48.894 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:48 smithi153 ceph-mon[48187]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-04-01T06:53:49.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:48 smithi083 ceph-mon[43429]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-04-01T06:53:49.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:48 smithi145 ceph-mon[47816]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-04-01T06:53:50.502 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:50 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:50.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:50 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:50.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:50 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:53:50.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:50 smithi145 ceph-mon[47816]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-04-01T06:53:50.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:50 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:50.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:50 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:50.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:50 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:53:50.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:50 smithi083 ceph-mon[43429]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-04-01T06:53:50.518 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:50 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:50.518 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:50 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:50.518 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:50 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:53:50.518 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:50 smithi153 ceph-mon[48187]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-04-01T06:53:51.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:53:51.430+0000 7f6bdffff700 1 -- 172.21.15.153:0/2690297896 <== mgr.14152 v2:172.21.15.83:6800/3375372052 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f6be802cd70 con 0x7f6bd40a1120 2024-04-01T06:53:51.430 INFO:teuthology.orchestra.run.smithi153.stdout:Created osd(s) 11 on host 'smithi153' 2024-04-01T06:53:51.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:53:51.432+0000 7f6bed54c700 1 -- 172.21.15.153:0/2690297896 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f6bd40a1120 msgr2=0x7f6bd40a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:53:51.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:53:51.432+0000 7f6bed54c700 1 --2- 172.21.15.153:0/2690297896 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f6bd40a1120 0x7f6bd40a35e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6bd800b5c0 tx=0x7f6bd8003790 comp rx=0 tx=0).stop 2024-04-01T06:53:51.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:53:51.432+0000 7f6bed54c700 1 -- 172.21.15.153:0/2690297896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6be8101f60 msgr2=0x7f6be8197130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:53:51.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:53:51.432+0000 7f6bed54c700 1 --2- 172.21.15.153:0/2690297896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6be8101f60 0x7f6be8197130 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6bd000d980 tx=0x7f6bd000dc90 comp rx=0 tx=0).stop 2024-04-01T06:53:51.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:53:51.432+0000 7f6bed54c700 1 -- 172.21.15.153:0/2690297896 shutdown_connections 2024-04-01T06:53:51.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:53:51.432+0000 7f6bed54c700 1 --2- 172.21.15.153:0/2690297896 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6be8102920 0x7f6be819e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:51.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:53:51.432+0000 7f6bed54c700 1 --2- 172.21.15.153:0/2690297896 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f6bd40a1120 0x7f6bd40a35e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:51.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:53:51.432+0000 7f6bed54c700 1 --2- 172.21.15.153:0/2690297896 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6be8100e00 0x7f6be8196bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:51.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:53:51.432+0000 7f6bed54c700 1 --2- 172.21.15.153:0/2690297896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6be8101f60 0x7f6be8197130 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:51.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:53:51.432+0000 7f6bed54c700 1 -- 172.21.15.153:0/2690297896 >> 172.21.15.153:0/2690297896 conn(0x7f6be80fc3c0 msgr2=0x7f6be81053c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:53:51.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:53:51.433+0000 7f6bed54c700 1 -- 172.21.15.153:0/2690297896 shutdown_connections 2024-04-01T06:53:51.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:53:51.433+0000 7f6bed54c700 1 -- 172.21.15.153:0/2690297896 wait complete. 2024-04-01T06:53:51.890 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:51 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:51.890 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:51 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:51.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:51 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:53:51.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:51 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:53:51.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:51 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:51.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:51 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:51.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:51 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:53:51.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:51 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:51.921 DEBUG:teuthology.orchestra.run.smithi153:osd.11> sudo journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@osd.11.service 2024-04-01T06:53:51.924 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-04-01T06:53:51.924 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph osd stat -f json 2024-04-01T06:53:51.955 INFO:journalctl@ceph.osd.11.smithi153.stdout:-- Logs begin at Mon 2024-04-01 06:35:09 UTC. -- 2024-04-01T06:53:52.159 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:53:52.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:51 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:52.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:51 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:52.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:51 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:53:52.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:51 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:53:52.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:51 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:52.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:51 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:52.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:51 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:53:52.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:51 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:52.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:51 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:52.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:51 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:52.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:51 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:53:52.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:51 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:53:52.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:51 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:52.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:51 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:52.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:51 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:53:52.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:51 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:52.964 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:52 smithi083 ceph-mon[43429]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-04-01T06:53:53.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:53.131+0000 7f79ad307700 1 -- 172.21.15.83:0/1695085959 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79a8101940 msgr2=0x7f79a8103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:53:53.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:53.131+0000 7f79ad307700 1 --2- 172.21.15.83:0/1695085959 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79a8101940 0x7f79a8103d30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7998009990 tx=0x7f7998009ca0 comp rx=0 tx=0).stop 2024-04-01T06:53:53.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:53.132+0000 7f79ad307700 1 -- 172.21.15.83:0/1695085959 shutdown_connections 2024-04-01T06:53:53.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:53.132+0000 7f79ad307700 1 --2- 172.21.15.83:0/1695085959 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79a8101940 0x7f79a8103d30 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:53.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:53.132+0000 7f79ad307700 1 --2- 172.21.15.83:0/1695085959 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f79a8106ba0 0x7f79a8108fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:53.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:53.132+0000 7f79ad307700 1 --2- 172.21.15.83:0/1695085959 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79a8104270 0x7f79a8106660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:53.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:53.132+0000 7f79ad307700 1 -- 172.21.15.83:0/1695085959 >> 172.21.15.83:0/1695085959 conn(0x7f79a80fb310 msgr2=0x7f79a80fd730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:53:53.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:53.132+0000 7f79ad307700 1 -- 172.21.15.83:0/1695085959 shutdown_connections 2024-04-01T06:53:53.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:53.132+0000 7f79ad307700 1 -- 172.21.15.83:0/1695085959 wait complete. 2024-04-01T06:53:53.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:53.132+0000 7f79ad307700 1 Processor -- start 2024-04-01T06:53:53.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:53.132+0000 7f79ad307700 1 -- start start 2024-04-01T06:53:53.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:53.133+0000 7f79ad307700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79a8101940 0x7f79a8101200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:53:53.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:53.133+0000 7f79ad307700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f79a8104270 0x7f79a80ff8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:53:53.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:53.133+0000 7f79ad307700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79a8106ba0 0x7f79a80ffe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:53:53.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:53.133+0000 7f79ad307700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a8100510 con 0x7f79a8101940 2024-04-01T06:53:53.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:53.133+0000 7f79ad307700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a8100680 con 0x7f79a8104270 2024-04-01T06:53:53.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:53.133+0000 7f79ad307700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a81a0df0 con 0x7f79a8106ba0 2024-04-01T06:53:53.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:53.133+0000 7f79a6ffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79a8101940 0x7f79a8101200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:53:53.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:53.133+0000 7f79a6ffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79a8101940 0x7f79a8101200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:60700/0 (socket says 172.21.15.83:60700) 2024-04-01T06:53:53.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:53.133+0000 7f79a6ffd700 1 -- 172.21.15.83:0/1952566508 learned_addr learned my addr 172.21.15.83:0/1952566508 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:53:53.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:53.133+0000 7f79a77fe700 1 --2- 172.21.15.83:0/1952566508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79a8106ba0 0x7f79a80ffe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:53:53.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:53.133+0000 7f79a67fc700 1 --2- 172.21.15.83:0/1952566508 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f79a8104270 0x7f79a80ff8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:53:53.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:53.133+0000 7f79a6ffd700 1 -- 172.21.15.83:0/1952566508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79a8106ba0 msgr2=0x7f79a80ffe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:53:53.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:53.133+0000 7f79a6ffd700 1 --2- 172.21.15.83:0/1952566508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79a8106ba0 0x7f79a80ffe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:53.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:53.133+0000 7f79a6ffd700 1 -- 172.21.15.83:0/1952566508 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f79a8104270 msgr2=0x7f79a80ff8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:53:53.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:53.133+0000 7f79a6ffd700 1 --2- 172.21.15.83:0/1952566508 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f79a8104270 0x7f79a80ff8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:53.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:53.133+0000 7f79a6ffd700 1 -- 172.21.15.83:0/1952566508 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79980095f0 con 0x7f79a8101940 2024-04-01T06:53:53.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:53.133+0000 7f79a6ffd700 1 --2- 172.21.15.83:0/1952566508 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79a8101940 0x7f79a8101200 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7998000c00 tx=0x7f7998004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:53:53.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:53.133+0000 7f798ffff700 1 -- 172.21.15.83:0/1952566508 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799801d070 con 0x7f79a8101940 2024-04-01T06:53:53.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:53.133+0000 7f798ffff700 1 -- 172.21.15.83:0/1952566508 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f79980054f0 con 0x7f79a8101940 2024-04-01T06:53:53.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:53.133+0000 7f79ad307700 1 -- 172.21.15.83:0/1952566508 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79a81a0ff0 con 0x7f79a8101940 2024-04-01T06:53:53.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:53.133+0000 7f798ffff700 1 -- 172.21.15.83:0/1952566508 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7998004cd0 con 0x7f79a8101940 2024-04-01T06:53:53.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:53.133+0000 7f79ad307700 1 -- 172.21.15.83:0/1952566508 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79a81a1350 con 0x7f79a8101940 2024-04-01T06:53:53.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:53.134+0000 7f79ad307700 1 -- 172.21.15.83:0/1952566508 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79a804eaf0 con 0x7f79a8101940 2024-04-01T06:53:53.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:53.135+0000 7f798ffff700 1 -- 172.21.15.83:0/1952566508 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) v1 ==== 135865+0+0 (secure 0 0 0) 0x7f799800fc40 con 0x7f79a8101940 2024-04-01T06:53:53.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:53.136+0000 7f798ffff700 1 --2- 172.21.15.83:0/1952566508 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f79900a1120 0x7f79900a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:53:53.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:53.136+0000 7f79a67fc700 1 --2- 172.21.15.83:0/1952566508 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f79900a1120 0x7f79900a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:53:53.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:53.136+0000 7f798ffff700 1 -- 172.21.15.83:0/1952566508 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f79980cd4f0 con 0x7f79a8101940 2024-04-01T06:53:53.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:53.136+0000 7f79a67fc700 1 --2- 172.21.15.83:0/1952566508 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f79900a1120 0x7f79900a35e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f799c009bf0 tx=0x7f799c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:53:53.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:53.139+0000 7f798ffff700 1 -- 172.21.15.83:0/1952566508 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f79980972f0 con 0x7f79a8101940 2024-04-01T06:53:53.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:52 smithi153 ceph-mon[48187]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-04-01T06:53:53.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:52 smithi145 ceph-mon[47816]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-04-01T06:53:53.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:53.332+0000 7f79ad307700 1 -- 172.21.15.83:0/1952566508 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f79a810c670 con 0x7f79a8101940 2024-04-01T06:53:53.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:53.333+0000 7f798ffff700 1 -- 172.21.15.83:0/1952566508 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v71) v1 ==== 74+0+133 (secure 0 0 0) 0x7f799809a910 con 0x7f79a8101940 2024-04-01T06:53:53.333 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:53:53.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:53.335+0000 7f79ad307700 1 -- 172.21.15.83:0/1952566508 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f79900a1120 msgr2=0x7f79900a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:53:53.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:53.335+0000 7f79ad307700 1 --2- 172.21.15.83:0/1952566508 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f79900a1120 0x7f79900a35e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f799c009bf0 tx=0x7f799c009260 comp rx=0 tx=0).stop 2024-04-01T06:53:53.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:53.335+0000 7f79ad307700 1 -- 172.21.15.83:0/1952566508 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79a8101940 msgr2=0x7f79a8101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:53:53.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:53.335+0000 7f79ad307700 1 --2- 172.21.15.83:0/1952566508 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79a8101940 0x7f79a8101200 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7998000c00 tx=0x7f7998004730 comp rx=0 tx=0).stop 2024-04-01T06:53:53.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:53.335+0000 7f79ad307700 1 -- 172.21.15.83:0/1952566508 shutdown_connections 2024-04-01T06:53:53.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:53.335+0000 7f79ad307700 1 --2- 172.21.15.83:0/1952566508 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f79a8101940 0x7f79a8101200 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:53.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:53.335+0000 7f79ad307700 1 --2- 172.21.15.83:0/1952566508 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f79900a1120 0x7f79900a35e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:53.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:53.335+0000 7f79ad307700 1 --2- 172.21.15.83:0/1952566508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79a8106ba0 0x7f79a80ffe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:53.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:53.335+0000 7f79ad307700 1 --2- 172.21.15.83:0/1952566508 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f79a8104270 0x7f79a80ff8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:53.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:53.335+0000 7f79ad307700 1 -- 172.21.15.83:0/1952566508 >> 172.21.15.83:0/1952566508 conn(0x7f79a80fb310 msgr2=0x7f79a8102200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:53:53.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:53.335+0000 7f79ad307700 1 -- 172.21.15.83:0/1952566508 shutdown_connections 2024-04-01T06:53:53.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:53.335+0000 7f79ad307700 1 -- 172.21.15.83:0/1952566508 wait complete. 2024-04-01T06:53:53.596 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 06:53:53 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T06:53:53.195+0000 7f5218cb2640 -1 osd.11 0 log_to_monitors true 2024-04-01T06:53:53.692 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":71,"num_osds":12,"num_up_osds":11,"osd_up_since":1711954418,"num_in_osds":12,"osd_in_since":1711954419,"num_remapped_pgs":0} 2024-04-01T06:53:53.853 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:53 smithi153 ceph-mon[48187]: from='osd.11 [v2:172.21.15.153:6824/2342548429,v1:172.21.15.153:6825/2342548429]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-01T06:53:53.853 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:53 smithi153 ceph-mon[48187]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-01T06:53:53.853 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:53 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/1952566508' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-01T06:53:54.016 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:53 smithi083 ceph-mon[43429]: from='osd.11 [v2:172.21.15.153:6824/2342548429,v1:172.21.15.153:6825/2342548429]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-01T06:53:54.016 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:53 smithi083 ceph-mon[43429]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-01T06:53:54.016 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:53 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/1952566508' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-01T06:53:54.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:53 smithi145 ceph-mon[47816]: from='osd.11 [v2:172.21.15.153:6824/2342548429,v1:172.21.15.153:6825/2342548429]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-01T06:53:54.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:53 smithi145 ceph-mon[47816]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-01T06:53:54.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:53 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/1952566508' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-01T06:53:54.693 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph osd stat -f json 2024-04-01T06:53:54.918 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:53:55.011 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:54 smithi083 ceph-mon[43429]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-04-01T06:53:55.011 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:54 smithi083 ceph-mon[43429]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-04-01T06:53:55.011 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:54 smithi083 ceph-mon[43429]: osdmap e72: 12 total, 11 up, 12 in 2024-04-01T06:53:55.011 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:54 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-01T06:53:55.011 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:54 smithi083 ceph-mon[43429]: from='osd.11 [v2:172.21.15.153:6824/2342548429,v1:172.21.15.153:6825/2342548429]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-04-01T06:53:55.011 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:54 smithi083 ceph-mon[43429]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-04-01T06:53:55.011 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:54 smithi083 ceph-mon[43429]: Detected new or changed devices on smithi153 2024-04-01T06:53:55.011 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:54 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:55.011 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:54 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:55.011 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:54 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:53:55.011 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:54 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:53:55.011 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:54 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:53:55.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:54 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:53:55.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:54 smithi083 ceph-mon[43429]: Adjusting osd_memory_target on smithi153 to 4278M 2024-04-01T06:53:55.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:54 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:55.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:54 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:53:55.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:54 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:53:55.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:54 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:55.141 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 06:53:54 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T06:53:54.793+0000 7f520e316700 -1 osd.11 0 waiting for initial osdmap 2024-04-01T06:53:55.142 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 06:53:54 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T06:53:54.808+0000 7f520a10b700 -1 osd.11 73 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-01T06:53:55.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:54 smithi153 ceph-mon[48187]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-04-01T06:53:55.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:54 smithi153 ceph-mon[48187]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-04-01T06:53:55.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:54 smithi153 ceph-mon[48187]: osdmap e72: 12 total, 11 up, 12 in 2024-04-01T06:53:55.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:54 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-01T06:53:55.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:54 smithi153 ceph-mon[48187]: from='osd.11 [v2:172.21.15.153:6824/2342548429,v1:172.21.15.153:6825/2342548429]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-04-01T06:53:55.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:54 smithi153 ceph-mon[48187]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-04-01T06:53:55.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:54 smithi153 ceph-mon[48187]: Detected new or changed devices on smithi153 2024-04-01T06:53:55.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:54 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:55.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:54 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:55.143 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:54 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:53:55.143 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:54 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:53:55.143 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:54 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:53:55.143 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:54 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:53:55.143 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:54 smithi153 ceph-mon[48187]: Adjusting osd_memory_target on smithi153 to 4278M 2024-04-01T06:53:55.143 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:54 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:55.143 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:54 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:53:55.143 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:54 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:53:55.143 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:54 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:55.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:54 smithi145 ceph-mon[47816]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-04-01T06:53:55.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:54 smithi145 ceph-mon[47816]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-04-01T06:53:55.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:54 smithi145 ceph-mon[47816]: osdmap e72: 12 total, 11 up, 12 in 2024-04-01T06:53:55.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:54 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-01T06:53:55.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:54 smithi145 ceph-mon[47816]: from='osd.11 [v2:172.21.15.153:6824/2342548429,v1:172.21.15.153:6825/2342548429]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-04-01T06:53:55.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:54 smithi145 ceph-mon[47816]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-04-01T06:53:55.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:54 smithi145 ceph-mon[47816]: Detected new or changed devices on smithi153 2024-04-01T06:53:55.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:54 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:55.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:54 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:55.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:54 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:53:55.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:54 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:53:55.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:54 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:53:55.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:54 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:53:55.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:54 smithi145 ceph-mon[47816]: Adjusting osd_memory_target on smithi153 to 4278M 2024-04-01T06:53:55.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:54 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:55.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:54 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:53:55.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:54 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:53:55.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:54 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:53:55.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:55.865+0000 7fabf9015700 1 -- 172.21.15.83:0/3067008377 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fabf4100ef0 msgr2=0x7fabf4101350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:53:55.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:55.865+0000 7fabf9015700 1 --2- 172.21.15.83:0/3067008377 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fabf4100ef0 0x7fabf4101350 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fabe80099c0 tx=0x7fabe8009cd0 comp rx=0 tx=0).stop 2024-04-01T06:53:55.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:55.865+0000 7fabf9015700 1 -- 172.21.15.83:0/3067008377 shutdown_connections 2024-04-01T06:53:55.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:55.865+0000 7fabf9015700 1 --2- 172.21.15.83:0/3067008377 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fabf4101890 0x7fabf4108140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:55.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:55.865+0000 7fabf9015700 1 --2- 172.21.15.83:0/3067008377 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabf40ffcf0 0x7fabf4100110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:55.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:55.865+0000 7fabf9015700 1 --2- 172.21.15.83:0/3067008377 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fabf4100ef0 0x7fabf4101350 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:55.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:55.865+0000 7fabf9015700 1 -- 172.21.15.83:0/3067008377 >> 172.21.15.83:0/3067008377 conn(0x7fabf40fb2b0 msgr2=0x7fabf40fd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:53:55.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:55.865+0000 7fabf9015700 1 -- 172.21.15.83:0/3067008377 shutdown_connections 2024-04-01T06:53:55.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:55.865+0000 7fabf9015700 1 -- 172.21.15.83:0/3067008377 wait complete. 2024-04-01T06:53:55.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:55.866+0000 7fabf9015700 1 Processor -- start 2024-04-01T06:53:55.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:55.866+0000 7fabf9015700 1 -- start start 2024-04-01T06:53:55.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:55.866+0000 7fabf9015700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fabf40ffcf0 0x7fabf4196ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:53:55.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:55.866+0000 7fabf9015700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabf4100ef0 0x7fabf4197220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:53:55.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:55.866+0000 7fabf9015700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fabf4101890 0x7fabf419e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:53:55.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:55.866+0000 7fabf9015700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf419e810 con 0x7fabf4101890 2024-04-01T06:53:55.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:55.866+0000 7fabf9015700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf419e950 con 0x7fabf40ffcf0 2024-04-01T06:53:55.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:55.866+0000 7fabf9015700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf419eb10 con 0x7fabf4100ef0 2024-04-01T06:53:55.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:55.867+0000 7fabf359e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fabf4101890 0x7fabf419e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:53:55.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:55.867+0000 7fabf359e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fabf4101890 0x7fabf419e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:48962/0 (socket says 172.21.15.83:48962) 2024-04-01T06:53:55.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:55.867+0000 7fabf359e700 1 -- 172.21.15.83:0/3888420887 learned_addr learned my addr 172.21.15.83:0/3888420887 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:53:55.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:55.867+0000 7fabf2d9d700 1 --2- 172.21.15.83:0/3888420887 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fabf40ffcf0 0x7fabf4196ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:53:55.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:55.867+0000 7fabf259c700 1 --2- 172.21.15.83:0/3888420887 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabf4100ef0 0x7fabf4197220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:53:55.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:55.867+0000 7fabf359e700 1 -- 172.21.15.83:0/3888420887 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabf4100ef0 msgr2=0x7fabf4197220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:53:55.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:55.867+0000 7fabf359e700 1 --2- 172.21.15.83:0/3888420887 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabf4100ef0 0x7fabf4197220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:55.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:55.867+0000 7fabf359e700 1 -- 172.21.15.83:0/3888420887 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fabf40ffcf0 msgr2=0x7fabf4196ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:53:55.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:55.867+0000 7fabf359e700 1 --2- 172.21.15.83:0/3888420887 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fabf40ffcf0 0x7fabf4196ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:55.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:55.867+0000 7fabf359e700 1 -- 172.21.15.83:0/3888420887 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe80095f0 con 0x7fabf4101890 2024-04-01T06:53:55.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:55.867+0000 7fabf359e700 1 --2- 172.21.15.83:0/3888420887 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fabf4101890 0x7fabf419e240 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fabec00ada0 tx=0x7fabec00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:53:55.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:55.867+0000 7fabdbfff700 1 -- 172.21.15.83:0/3888420887 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabec00f070 con 0x7fabf4101890 2024-04-01T06:53:55.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:55.867+0000 7fabf9015700 1 -- 172.21.15.83:0/3888420887 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabf419edf0 con 0x7fabf4101890 2024-04-01T06:53:55.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:55.867+0000 7fabdbfff700 1 -- 172.21.15.83:0/3888420887 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fabec007b30 con 0x7fabf4101890 2024-04-01T06:53:55.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:55.867+0000 7fabdbfff700 1 -- 172.21.15.83:0/3888420887 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabec0053e0 con 0x7fabf4101890 2024-04-01T06:53:55.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:55.867+0000 7fabf9015700 1 -- 172.21.15.83:0/3888420887 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabf419f270 con 0x7fabf4101890 2024-04-01T06:53:55.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:55.868+0000 7fabf9015700 1 -- 172.21.15.83:0/3888420887 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabf404ea80 con 0x7fabf4101890 2024-04-01T06:53:55.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:55.870+0000 7fabdbfff700 1 -- 172.21.15.83:0/3888420887 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) v1 ==== 135865+0+0 (secure 0 0 0) 0x7fabec00c980 con 0x7fabf4101890 2024-04-01T06:53:55.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:55.870+0000 7fabdbfff700 1 --2- 172.21.15.83:0/3888420887 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fabdc0a1120 0x7fabdc0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:53:55.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:55.871+0000 7fabf2d9d700 1 --2- 172.21.15.83:0/3888420887 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fabdc0a1120 0x7fabdc0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:53:55.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:55.871+0000 7fabdbfff700 1 -- 172.21.15.83:0/3888420887 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fabec0cc010 con 0x7fabf4101890 2024-04-01T06:53:55.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:55.871+0000 7fabf2d9d700 1 --2- 172.21.15.83:0/3888420887 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fabdc0a1120 0x7fabdc0a35e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fabf40fdb40 tx=0x7fabe4007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:53:55.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:55.874+0000 7fabdbfff700 1 -- 172.21.15.83:0/3888420887 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7fabec095c30 con 0x7fabf4101890 2024-04-01T06:53:56.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:55 smithi083 ceph-mon[43429]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-04-01T06:53:56.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:55 smithi083 ceph-mon[43429]: osdmap e73: 12 total, 11 up, 12 in 2024-04-01T06:53:56.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:55 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-01T06:53:56.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:55 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-01T06:53:56.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:56.070+0000 7fabf9015700 1 -- 172.21.15.83:0/3888420887 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fabf410b4f0 con 0x7fabf4101890 2024-04-01T06:53:56.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:56.070+0000 7fabdbfff700 1 -- 172.21.15.83:0/3888420887 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v74) v1 ==== 74+0+133 (secure 0 0 0) 0x7fabec099250 con 0x7fabf4101890 2024-04-01T06:53:56.070 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:53:56.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:56.072+0000 7fabf9015700 1 -- 172.21.15.83:0/3888420887 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fabdc0a1120 msgr2=0x7fabdc0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:53:56.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:56.072+0000 7fabf9015700 1 --2- 172.21.15.83:0/3888420887 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fabdc0a1120 0x7fabdc0a35e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fabf40fdb40 tx=0x7fabe4007400 comp rx=0 tx=0).stop 2024-04-01T06:53:56.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:56.072+0000 7fabf9015700 1 -- 172.21.15.83:0/3888420887 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fabf4101890 msgr2=0x7fabf419e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:53:56.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:56.072+0000 7fabf9015700 1 --2- 172.21.15.83:0/3888420887 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fabf4101890 0x7fabf419e240 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fabec00ada0 tx=0x7fabec00c330 comp rx=0 tx=0).stop 2024-04-01T06:53:56.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:56.072+0000 7fabf9015700 1 -- 172.21.15.83:0/3888420887 shutdown_connections 2024-04-01T06:53:56.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:56.072+0000 7fabf9015700 1 --2- 172.21.15.83:0/3888420887 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fabf4101890 0x7fabf419e240 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:56.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:56.072+0000 7fabf9015700 1 --2- 172.21.15.83:0/3888420887 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fabdc0a1120 0x7fabdc0a35e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:56.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:56.072+0000 7fabf9015700 1 --2- 172.21.15.83:0/3888420887 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fabf40ffcf0 0x7fabf4196ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:56.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:56.072+0000 7fabf9015700 1 --2- 172.21.15.83:0/3888420887 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fabf4100ef0 0x7fabf4197220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:56.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:56.072+0000 7fabf9015700 1 -- 172.21.15.83:0/3888420887 >> 172.21.15.83:0/3888420887 conn(0x7fabf40fb2b0 msgr2=0x7fabf4068780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:53:56.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:56.072+0000 7fabf9015700 1 -- 172.21.15.83:0/3888420887 shutdown_connections 2024-04-01T06:53:56.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:56.072+0000 7fabf9015700 1 -- 172.21.15.83:0/3888420887 wait complete. 2024-04-01T06:53:56.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:55 smithi153 ceph-mon[48187]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-04-01T06:53:56.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:55 smithi153 ceph-mon[48187]: osdmap e73: 12 total, 11 up, 12 in 2024-04-01T06:53:56.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:55 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-01T06:53:56.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:55 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-01T06:53:56.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:55 smithi145 ceph-mon[47816]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-04-01T06:53:56.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:55 smithi145 ceph-mon[47816]: osdmap e73: 12 total, 11 up, 12 in 2024-04-01T06:53:56.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:55 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-01T06:53:56.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:55 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-01T06:53:56.450 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":74,"num_osds":12,"num_up_osds":12,"osd_up_since":1711954435,"num_in_osds":12,"osd_in_since":1711954419,"num_remapped_pgs":0} 2024-04-01T06:53:56.450 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph osd dump --format=json 2024-04-01T06:53:56.667 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:53:57.095 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:56 smithi083 ceph-mon[43429]: purged_snaps scrub starts 2024-04-01T06:53:57.096 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:56 smithi083 ceph-mon[43429]: purged_snaps scrub ok 2024-04-01T06:53:57.096 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:56 smithi083 ceph-mon[43429]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-04-01T06:53:57.096 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:56 smithi083 ceph-mon[43429]: osd.11 [v2:172.21.15.153:6824/2342548429,v1:172.21.15.153:6825/2342548429] boot 2024-04-01T06:53:57.096 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:56 smithi083 ceph-mon[43429]: osdmap e74: 12 total, 12 up, 12 in 2024-04-01T06:53:57.096 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:56 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-01T06:53:57.096 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:56 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/3888420887' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-01T06:53:57.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:56 smithi153 ceph-mon[48187]: purged_snaps scrub starts 2024-04-01T06:53:57.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:56 smithi153 ceph-mon[48187]: purged_snaps scrub ok 2024-04-01T06:53:57.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:56 smithi153 ceph-mon[48187]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-04-01T06:53:57.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:56 smithi153 ceph-mon[48187]: osd.11 [v2:172.21.15.153:6824/2342548429,v1:172.21.15.153:6825/2342548429] boot 2024-04-01T06:53:57.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:56 smithi153 ceph-mon[48187]: osdmap e74: 12 total, 12 up, 12 in 2024-04-01T06:53:57.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:56 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-01T06:53:57.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:56 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/3888420887' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-01T06:53:57.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:56 smithi145 ceph-mon[47816]: purged_snaps scrub starts 2024-04-01T06:53:57.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:56 smithi145 ceph-mon[47816]: purged_snaps scrub ok 2024-04-01T06:53:57.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:56 smithi145 ceph-mon[47816]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-04-01T06:53:57.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:56 smithi145 ceph-mon[47816]: osd.11 [v2:172.21.15.153:6824/2342548429,v1:172.21.15.153:6825/2342548429] boot 2024-04-01T06:53:57.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:56 smithi145 ceph-mon[47816]: osdmap e74: 12 total, 12 up, 12 in 2024-04-01T06:53:57.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:56 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-01T06:53:57.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:56 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/3888420887' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-01T06:53:57.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:57.588+0000 7fa257bd3700 1 -- 172.21.15.83:0/3676294536 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa250100920 msgr2=0x7fa2501048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:53:57.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:57.588+0000 7fa257bd3700 1 --2- 172.21.15.83:0/3676294536 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa250100920 0x7fa2501048d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa240009990 tx=0x7fa240009ca0 comp rx=0 tx=0).stop 2024-04-01T06:53:57.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:57.588+0000 7fa257bd3700 1 -- 172.21.15.83:0/3676294536 shutdown_connections 2024-04-01T06:53:57.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:57.588+0000 7fa257bd3700 1 --2- 172.21.15.83:0/3676294536 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa250104fb0 0x7fa25010cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:57.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:57.588+0000 7fa257bd3700 1 --2- 172.21.15.83:0/3676294536 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2500fff70 0x7fa250100350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:57.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:57.588+0000 7fa257bd3700 1 --2- 172.21.15.83:0/3676294536 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa250100920 0x7fa2501048d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:57.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:57.588+0000 7fa257bd3700 1 -- 172.21.15.83:0/3676294536 >> 172.21.15.83:0/3676294536 conn(0x7fa250075d50 msgr2=0x7fa250076160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:53:57.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:57.588+0000 7fa257bd3700 1 -- 172.21.15.83:0/3676294536 shutdown_connections 2024-04-01T06:53:57.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:57.588+0000 7fa257bd3700 1 -- 172.21.15.83:0/3676294536 wait complete. 2024-04-01T06:53:57.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:57.589+0000 7fa257bd3700 1 Processor -- start 2024-04-01T06:53:57.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:57.589+0000 7fa257bd3700 1 -- start start 2024-04-01T06:53:57.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:57.589+0000 7fa257bd3700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2500fff70 0x7fa250198090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:53:57.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:57.589+0000 7fa257bd3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa250100920 0x7fa2501985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:53:57.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:57.589+0000 7fa257bd3700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa250104fb0 0x7fa2501a3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:53:57.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:57.589+0000 7fa257bd3700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa250198e20 con 0x7fa250104fb0 2024-04-01T06:53:57.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:57.589+0000 7fa257bd3700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2501a3650 con 0x7fa2500fff70 2024-04-01T06:53:57.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:57.589+0000 7fa257bd3700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2501a3790 con 0x7fa250100920 2024-04-01T06:53:57.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:57.589+0000 7fa256170700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa250104fb0 0x7fa2501a3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:53:57.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:57.589+0000 7fa256170700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa250104fb0 0x7fa2501a3110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:48980/0 (socket says 172.21.15.83:48980) 2024-04-01T06:53:57.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:57.589+0000 7fa256170700 1 -- 172.21.15.83:0/576459835 learned_addr learned my addr 172.21.15.83:0/576459835 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:53:57.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:57.589+0000 7fa25596f700 1 --2- 172.21.15.83:0/576459835 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2500fff70 0x7fa250198090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:53:57.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:57.589+0000 7fa25516e700 1 --2- 172.21.15.83:0/576459835 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa250100920 0x7fa2501985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:53:57.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:57.589+0000 7fa256170700 1 -- 172.21.15.83:0/576459835 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa250100920 msgr2=0x7fa2501985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:53:57.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:57.589+0000 7fa256170700 1 --2- 172.21.15.83:0/576459835 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa250100920 0x7fa2501985d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:57.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:57.589+0000 7fa256170700 1 -- 172.21.15.83:0/576459835 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2500fff70 msgr2=0x7fa250198090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:53:57.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:57.589+0000 7fa256170700 1 --2- 172.21.15.83:0/576459835 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2500fff70 0x7fa250198090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:57.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:57.589+0000 7fa256170700 1 -- 172.21.15.83:0/576459835 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2400095f0 con 0x7fa250104fb0 2024-04-01T06:53:57.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:57.589+0000 7fa25596f700 1 --2- 172.21.15.83:0/576459835 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2500fff70 0x7fa250198090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:53:57.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:57.589+0000 7fa256170700 1 --2- 172.21.15.83:0/576459835 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa250104fb0 0x7fa2501a3110 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa248007f10 tx=0x7fa24800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:53:57.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:57.589+0000 7fa246ffd700 1 -- 172.21.15.83:0/576459835 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa248017070 con 0x7fa250104fb0 2024-04-01T06:53:57.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:57.589+0000 7fa246ffd700 1 -- 172.21.15.83:0/576459835 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa24800f040 con 0x7fa250104fb0 2024-04-01T06:53:57.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:57.589+0000 7fa246ffd700 1 -- 172.21.15.83:0/576459835 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa248005740 con 0x7fa250104fb0 2024-04-01T06:53:57.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:57.590+0000 7fa257bd3700 1 -- 172.21.15.83:0/576459835 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2501a39f0 con 0x7fa250104fb0 2024-04-01T06:53:57.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:57.590+0000 7fa257bd3700 1 -- 172.21.15.83:0/576459835 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2501a3ef0 con 0x7fa250104fb0 2024-04-01T06:53:57.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:57.590+0000 7fa257bd3700 1 -- 172.21.15.83:0/576459835 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2501082d0 con 0x7fa250104fb0 2024-04-01T06:53:57.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:57.592+0000 7fa246ffd700 1 -- 172.21.15.83:0/576459835 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) v1 ==== 135865+0+0 (secure 0 0 0) 0x7fa2480058a0 con 0x7fa250104fb0 2024-04-01T06:53:57.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:57.592+0000 7fa246ffd700 1 --2- 172.21.15.83:0/576459835 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fa23c0a11a0 0x7fa23c0a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:53:57.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:57.593+0000 7fa25596f700 1 --2- 172.21.15.83:0/576459835 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fa23c0a11a0 0x7fa23c0a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:53:57.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:57.593+0000 7fa246ffd700 1 -- 172.21.15.83:0/576459835 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fa2480cc240 con 0x7fa250104fb0 2024-04-01T06:53:57.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:57.593+0000 7fa25596f700 1 --2- 172.21.15.83:0/576459835 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fa23c0a11a0 0x7fa23c0a3660 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa24c005d90 tx=0x7fa24c005d00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:53:57.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:57.596+0000 7fa246ffd700 1 -- 172.21.15.83:0/576459835 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7fa248095e70 con 0x7fa250104fb0 2024-04-01T06:53:57.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:57.792+0000 7fa257bd3700 1 -- 172.21.15.83:0/576459835 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2501013b0 con 0x7fa250104fb0 2024-04-01T06:53:57.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:57.793+0000 7fa246ffd700 1 -- 172.21.15.83:0/576459835 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+18434 (secure 0 0 0) 0x7fa248099490 con 0x7fa250104fb0 2024-04-01T06:53:57.793 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:53:57.793 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":75,"fsid":"c6f8eff4-eff3-11ee-b647-cb9ed24678a4","created":"2024-04-01T06:48:42.033382+0000","modified":"2024-04-01T06:53:56.797141+0000","last_up_change":"2024-04-01T06:53:55.791339+0000","last_in_change":"2024-04-01T06:53:39.777214+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T06:51:21.963996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"90b761b0-b06c-4142-854d-38ee42aa6052","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6803","nonce":3253845390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6805","nonce":3253845390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6809","nonce":3253845390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6807","nonce":3253845390}]},"public_addr":"172.21.15.83:6803/3253845390","cluster_addr":"172.21.15.83:6805/3253845390","heartbeat_back_addr":"172.21.15.83:6809/3253845390","heartbeat_front_addr":"172.21.15.83:6807/3253845390","state":["exists","up"]},{"osd":1,"uuid":"4d6ab85b-7088-451e-a829-c9119f35dee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6801","nonce":515889759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6803","nonce":515889759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6807","nonce":515889759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6805","nonce":515889759}]},"public_addr":"172.21.15.145:6801/515889759","cluster_addr":"172.21.15.145:6803/515889759","heartbeat_back_addr":"172.21.15.145:6807/515889759","heartbeat_front_addr":"172.21.15.145:6805/515889759","state":["exists","up"]},{"osd":2,"uuid":"d04c27f3-4972-4061-8bfb-5060645e3883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6801","nonce":3318516728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6803","nonce":3318516728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6807","nonce":3318516728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6805","nonce":3318516728}]},"public_addr":"172.21.15.153:6801/3318516728","cluster_addr":"172.21.15.153:6803/3318516728","heartbeat_back_addr":"172.21.15.153:6807/3318516728","heartbeat_front_addr":"172.21.15.153:6805/3318516728","state":["exists","up"]},{"osd":3,"uuid":"899b6c90-8f2f-44dd-b807-49594aadb443","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6811","nonce":504690234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6813","nonce":504690234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6817","nonce":504690234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6815","nonce":504690234}]},"public_addr":"172.21.15.83:6811/504690234","cluster_addr":"172.21.15.83:6813/504690234","heartbeat_back_addr":"172.21.15.83:6817/504690234","heartbeat_front_addr":"172.21.15.83:6815/504690234","state":["exists","up"]},{"osd":4,"uuid":"5071dd81-804e-4358-bfb6-11e718e9cf4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6809","nonce":2099824730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6811","nonce":2099824730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6815","nonce":2099824730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6813","nonce":2099824730}]},"public_addr":"172.21.15.145:6809/2099824730","cluster_addr":"172.21.15.145:6811/2099824730","heartbeat_back_addr":"172.21.15.145:6815/2099824730","heartbeat_front_addr":"172.21.15.145:6813/2099824730","state":["exists","up"]},{"osd":5,"uuid":"b8442b71-c26e-467f-b0c3-ea9f636f5a00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6809","nonce":3340941443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6811","nonce":3340941443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6815","nonce":3340941443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6813","nonce":3340941443}]},"public_addr":"172.21.15.153:6809/3340941443","cluster_addr":"172.21.15.153:6811/3340941443","heartbeat_back_addr":"172.21.15.153:6815/3340941443","heartbeat_front_addr":"172.21.15.153:6813/3340941443","state":["exists","up"]},{"osd":6,"uuid":"c26bb8cb-ccee-4bfc-91eb-14e1ad8e04df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6819","nonce":2005485079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6821","nonce":2005485079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6825","nonce":2005485079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6823","nonce":2005485079}]},"public_addr":"172.21.15.83:6819/2005485079","cluster_addr":"172.21.15.83:6821/2005485079","heartbeat_back_addr":"172.21.15.83:6825/2005485079","heartbeat_front_addr":"172.21.15.83:6823/2005485079","state":["exists","up"]},{"osd":7,"uuid":"a8940da2-0e79-4606-8d1e-d425afbf5753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6817","nonce":3737505059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6819","nonce":3737505059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6823","nonce":3737505059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6821","nonce":3737505059}]},"public_addr":"172.21.15.145:6817/3737505059","cluster_addr":"172.21.15.145:6819/3737505059","heartbeat_back_addr":"172.21.15.145:6823/3737505059","heartbeat_front_addr":"172.21.15.145:6821/3737505059","state":["exists","up"]},{"osd":8,"uuid":"602d43ac-a189-4da3-9e38-7025d14e0dd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6817","nonce":1031545791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6819","nonce":1031545791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6823","nonce":1031545791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6821","nonce":1031545791}]},"public_addr":"172.21.15.153:6817/1031545791","cluster_addr":"172.21.15.153:6819/1031545791","heartbeat_back_addr":"172.21.15.153:6823/1031545791","heartbeat_front_addr":"172.21.15.153:6821/1031545791","state":["exists","up"]},{"osd":9,"uuid":"08b12d27-1247-45e4-9d09-cacc0fce4bd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6827","nonce":3720996673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6829","nonce":3720996673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6833","nonce":3720996673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6831","nonce":3720996673}]},"public_addr":"172.21.15.83:6827/3720996673","cluster_addr":"172.21.15.83:6829/3720996673","heartbeat_back_addr":"172.21.15.83:6833/3720996673","heartbeat_front_addr":"172.21.15.83:6831/3720996673","state":["exists","up"]},{"osd":10,"uuid":"dd986b50-d68f-446c-9c66-261535880879","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6825","nonce":2671529479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6827","nonce":2671529479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6831","nonce":2671529479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6829","nonce":2671529479}]},"public_addr":"172.21.15.145:6825/2671529479","cluster_addr":"172.21.15.145:6827/2671529479","heartbeat_back_addr":"172.21.15.145:6831/2671529479","heartbeat_front_addr":"172.21.15.145:6829/2671529479","state":["exists","up"]},{"osd":11,"uuid":"d20a49cd-6224-4424-8375-46da791d9931","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6825","nonce":2342548429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6827","nonce":2342548429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6831","nonce":2342548429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6829","nonce":2342548429}]},"public_addr":"172.21.15.153:6825/2342548429","cluster_addr":"172.21.15.153:6827/2342548429","heartbeat_back_addr":"172.21.15.153:6831/2342548429","heartbeat_front_addr":"172.21.15.153:6829/2342548429","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:50:44.539932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:01.990470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:19.054426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:36.616393+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:53.896705+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:10.667502+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:27.880849+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:45.276308+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:02.280615+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:19.555547+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:37.062881+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:54.191589+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.83:6801/1867137261":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/2596683931":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/2125339627":"2024-04-02T06:49:33.656125+0000","172.21.15.83:6800/1644397953":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/690500472":"2024-04-02T06:49:13.456026+0000","172.21.15.83:6801/1644397953":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/785958951":"2024-04-02T06:49:33.656125+0000","172.21.15.83:6800/1867137261":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/2222527447":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/2071592157":"2024-04-02T06:49:13.456026+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T06:53:57.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:57.795+0000 7fa257bd3700 1 -- 172.21.15.83:0/576459835 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fa23c0a11a0 msgr2=0x7fa23c0a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:53:57.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:57.795+0000 7fa257bd3700 1 --2- 172.21.15.83:0/576459835 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fa23c0a11a0 0x7fa23c0a3660 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa24c005d90 tx=0x7fa24c005d00 comp rx=0 tx=0).stop 2024-04-01T06:53:57.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:57.795+0000 7fa257bd3700 1 -- 172.21.15.83:0/576459835 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa250104fb0 msgr2=0x7fa2501a3110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:53:57.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:57.795+0000 7fa257bd3700 1 --2- 172.21.15.83:0/576459835 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa250104fb0 0x7fa2501a3110 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa248007f10 tx=0x7fa24800d3b0 comp rx=0 tx=0).stop 2024-04-01T06:53:57.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:57.795+0000 7fa257bd3700 1 -- 172.21.15.83:0/576459835 shutdown_connections 2024-04-01T06:53:57.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:57.795+0000 7fa257bd3700 1 --2- 172.21.15.83:0/576459835 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa250104fb0 0x7fa2501a3110 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:57.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:57.795+0000 7fa257bd3700 1 --2- 172.21.15.83:0/576459835 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fa23c0a11a0 0x7fa23c0a3660 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:57.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:57.795+0000 7fa257bd3700 1 --2- 172.21.15.83:0/576459835 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2500fff70 0x7fa250198090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:57.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:57.795+0000 7fa257bd3700 1 --2- 172.21.15.83:0/576459835 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa250100920 0x7fa2501985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:57.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:57.795+0000 7fa257bd3700 1 -- 172.21.15.83:0/576459835 >> 172.21.15.83:0/576459835 conn(0x7fa250075d50 msgr2=0x7fa250106180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:53:57.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:57.795+0000 7fa257bd3700 1 -- 172.21.15.83:0/576459835 shutdown_connections 2024-04-01T06:53:57.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:57.795+0000 7fa257bd3700 1 -- 172.21.15.83:0/576459835 wait complete. 2024-04-01T06:53:58.099 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:57 smithi083 ceph-mon[43429]: osdmap e75: 12 total, 12 up, 12 in 2024-04-01T06:53:58.099 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:57 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/576459835' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T06:53:58.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:57 smithi153 ceph-mon[48187]: osdmap e75: 12 total, 12 up, 12 in 2024-04-01T06:53:58.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:57 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/576459835' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T06:53:58.195 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-01T06:51:21.963996+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-01T06:53:58.195 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph osd pool get .mgr pg_num 2024-04-01T06:53:58.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:57 smithi145 ceph-mon[47816]: osdmap e75: 12 total, 12 up, 12 in 2024-04-01T06:53:58.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:57 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/576459835' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T06:53:58.412 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:53:59.129 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:58 smithi083 ceph-mon[43429]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T06:53:59.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:58 smithi153 ceph-mon[48187]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T06:53:59.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:58 smithi145 ceph-mon[47816]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T06:53:59.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:59.290+0000 7fa15707e700 1 -- 172.21.15.83:0/1592001956 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa150068750 msgr2=0x7fa150068bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:53:59.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:59.290+0000 7fa15707e700 1 --2- 172.21.15.83:0/1592001956 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa150068750 0x7fa150068bb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa144009990 tx=0x7fa144009ca0 comp rx=0 tx=0).stop 2024-04-01T06:53:59.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:59.290+0000 7fa15707e700 1 -- 172.21.15.83:0/1592001956 shutdown_connections 2024-04-01T06:53:59.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:59.290+0000 7fa15707e700 1 --2- 172.21.15.83:0/1592001956 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1500690f0 0x7fa15010dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:59.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:59.290+0000 7fa15707e700 1 --2- 172.21.15.83:0/1592001956 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa150106df0 0x7fa1501071d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:59.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:59.290+0000 7fa15707e700 1 --2- 172.21.15.83:0/1592001956 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa150068750 0x7fa150068bb0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:59.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:59.290+0000 7fa15707e700 1 -- 172.21.15.83:0/1592001956 >> 172.21.15.83:0/1592001956 conn(0x7fa150075d50 msgr2=0x7fa150076160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:53:59.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:59.290+0000 7fa15707e700 1 -- 172.21.15.83:0/1592001956 shutdown_connections 2024-04-01T06:53:59.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:59.290+0000 7fa15707e700 1 -- 172.21.15.83:0/1592001956 wait complete. 2024-04-01T06:53:59.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:59.291+0000 7fa15707e700 1 Processor -- start 2024-04-01T06:53:59.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:59.291+0000 7fa15707e700 1 -- start start 2024-04-01T06:53:59.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:59.292+0000 7fa15707e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa150068750 0x7fa150197210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:53:59.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:59.292+0000 7fa15707e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1500690f0 0x7fa150197750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:53:59.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:59.292+0000 7fa15707e700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa150106df0 0x7fa15019bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:53:59.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:59.292+0000 7fa15707e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa15019c110 con 0x7fa150068750 2024-04-01T06:53:59.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:59.292+0000 7fa15707e700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa15019c280 con 0x7fa150106df0 2024-04-01T06:53:59.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:59.292+0000 7fa15707e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa15019c440 con 0x7fa1500690f0 2024-04-01T06:53:59.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:59.292+0000 7fa154e1a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa150068750 0x7fa150197210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:53:59.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:59.292+0000 7fa154e1a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa150068750 0x7fa150197210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:48998/0 (socket says 172.21.15.83:48998) 2024-04-01T06:53:59.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:59.292+0000 7fa154e1a700 1 -- 172.21.15.83:0/938586917 learned_addr learned my addr 172.21.15.83:0/938586917 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:53:59.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:59.292+0000 7fa15561b700 1 --2- 172.21.15.83:0/938586917 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa150106df0 0x7fa15019bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:53:59.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:59.292+0000 7fa14ffff700 1 --2- 172.21.15.83:0/938586917 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1500690f0 0x7fa150197750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:53:59.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:59.292+0000 7fa154e1a700 1 -- 172.21.15.83:0/938586917 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1500690f0 msgr2=0x7fa150197750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:53:59.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:59.292+0000 7fa154e1a700 1 --2- 172.21.15.83:0/938586917 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1500690f0 0x7fa150197750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:59.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:59.292+0000 7fa154e1a700 1 -- 172.21.15.83:0/938586917 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa150106df0 msgr2=0x7fa15019bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:53:59.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:59.292+0000 7fa154e1a700 1 --2- 172.21.15.83:0/938586917 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa150106df0 0x7fa15019bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:59.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:59.292+0000 7fa154e1a700 1 -- 172.21.15.83:0/938586917 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1440095f0 con 0x7fa150068750 2024-04-01T06:53:59.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:59.292+0000 7fa14ffff700 1 --2- 172.21.15.83:0/938586917 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1500690f0 0x7fa150197750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:53:59.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:59.292+0000 7fa154e1a700 1 --2- 172.21.15.83:0/938586917 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa150068750 0x7fa150197210 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa14000d950 tx=0x7fa14000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:53:59.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:59.292+0000 7fa14dffb700 1 -- 172.21.15.83:0/938586917 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa140009940 con 0x7fa150068750 2024-04-01T06:53:59.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:59.292+0000 7fa14dffb700 1 -- 172.21.15.83:0/938586917 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa140010460 con 0x7fa150068750 2024-04-01T06:53:59.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:59.292+0000 7fa15707e700 1 -- 172.21.15.83:0/938586917 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa15019c720 con 0x7fa150068750 2024-04-01T06:53:59.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:59.292+0000 7fa14dffb700 1 -- 172.21.15.83:0/938586917 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14000f620 con 0x7fa150068750 2024-04-01T06:53:59.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:59.293+0000 7fa15707e700 1 -- 172.21.15.83:0/938586917 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1501a3f80 con 0x7fa150068750 2024-04-01T06:53:59.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:59.293+0000 7fa15707e700 1 -- 172.21.15.83:0/938586917 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa150109310 con 0x7fa150068750 2024-04-01T06:53:59.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:59.294+0000 7fa14dffb700 1 -- 172.21.15.83:0/938586917 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) v1 ==== 135865+0+0 (secure 0 0 0) 0x7fa1400108d0 con 0x7fa150068750 2024-04-01T06:53:59.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:59.295+0000 7fa14dffb700 1 --2- 172.21.15.83:0/938586917 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fa1380a1120 0x7fa1380a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:53:59.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:59.295+0000 7fa14ffff700 1 --2- 172.21.15.83:0/938586917 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fa1380a1120 0x7fa1380a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:53:59.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:59.295+0000 7fa14dffb700 1 -- 172.21.15.83:0/938586917 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fa1400cc210 con 0x7fa150068750 2024-04-01T06:53:59.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:59.295+0000 7fa14ffff700 1 --2- 172.21.15.83:0/938586917 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fa1380a1120 0x7fa1380a35e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa14400b5c0 tx=0x7fa144005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:53:59.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:59.299+0000 7fa14dffb700 1 -- 172.21.15.83:0/938586917 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7fa140095e40 con 0x7fa150068750 2024-04-01T06:53:59.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:59.489+0000 7fa15707e700 1 -- 172.21.15.83:0/938586917 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa1501024a0 con 0x7fa150068750 2024-04-01T06:53:59.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:59.490+0000 7fa14dffb700 1 -- 172.21.15.83:0/938586917 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa140099460 con 0x7fa150068750 2024-04-01T06:53:59.490 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 1 2024-04-01T06:53:59.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:59.492+0000 7fa15707e700 1 -- 172.21.15.83:0/938586917 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fa1380a1120 msgr2=0x7fa1380a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:53:59.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:59.492+0000 7fa15707e700 1 --2- 172.21.15.83:0/938586917 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fa1380a1120 0x7fa1380a35e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa14400b5c0 tx=0x7fa144005fb0 comp rx=0 tx=0).stop 2024-04-01T06:53:59.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:59.492+0000 7fa15707e700 1 -- 172.21.15.83:0/938586917 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa150068750 msgr2=0x7fa150197210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:53:59.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:59.492+0000 7fa15707e700 1 --2- 172.21.15.83:0/938586917 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa150068750 0x7fa150197210 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa14000d950 tx=0x7fa14000dc60 comp rx=0 tx=0).stop 2024-04-01T06:53:59.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:59.492+0000 7fa15707e700 1 -- 172.21.15.83:0/938586917 shutdown_connections 2024-04-01T06:53:59.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:59.492+0000 7fa15707e700 1 --2- 172.21.15.83:0/938586917 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa150068750 0x7fa150197210 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:59.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:59.492+0000 7fa15707e700 1 --2- 172.21.15.83:0/938586917 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fa1380a1120 0x7fa1380a35e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:59.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:59.492+0000 7fa15707e700 1 --2- 172.21.15.83:0/938586917 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa150106df0 0x7fa15019bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:59.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:59.492+0000 7fa15707e700 1 --2- 172.21.15.83:0/938586917 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1500690f0 0x7fa150197750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:53:59.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:59.492+0000 7fa15707e700 1 -- 172.21.15.83:0/938586917 >> 172.21.15.83:0/938586917 conn(0x7fa150075d50 msgr2=0x7fa1500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:53:59.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:59.492+0000 7fa15707e700 1 -- 172.21.15.83:0/938586917 shutdown_connections 2024-04-01T06:53:59.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:53:59.492+0000 7fa15707e700 1 -- 172.21.15.83:0/938586917 wait complete. 2024-04-01T06:53:59.858 INFO:tasks.cephadm:Adding mds.a on smithi083 2024-04-01T06:53:59.858 INFO:tasks.cephadm:Adding mds.d on smithi083 2024-04-01T06:53:59.858 INFO:tasks.cephadm:Adding mds.g on smithi083 2024-04-01T06:53:59.858 INFO:tasks.cephadm:Adding mds.j on smithi083 2024-04-01T06:53:59.858 INFO:tasks.cephadm:Adding mds.b on smithi145 2024-04-01T06:53:59.858 INFO:tasks.cephadm:Adding mds.e on smithi145 2024-04-01T06:53:59.858 INFO:tasks.cephadm:Adding mds.h on smithi145 2024-04-01T06:53:59.858 INFO:tasks.cephadm:Adding mds.k on smithi145 2024-04-01T06:53:59.858 INFO:tasks.cephadm:Adding mds.c on smithi153 2024-04-01T06:53:59.859 INFO:tasks.cephadm:Adding mds.f on smithi153 2024-04-01T06:53:59.859 INFO:tasks.cephadm:Adding mds.i on smithi153 2024-04-01T06:53:59.859 INFO:tasks.cephadm:Adding mds.l on smithi153 2024-04-01T06:53:59.859 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph orch apply mds all '12;smithi083=a;smithi083=d;smithi083=g;smithi083=j;smithi145=b;smithi145=e;smithi145=h;smithi145=k;smithi153=c;smithi153=f;smithi153=i;smithi153=l' 2024-04-01T06:54:00.095 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T06:54:00.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:53:59 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/938586917' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-01T06:54:00.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:53:59 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/938586917' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-01T06:54:00.276 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:53:59 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/938586917' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-01T06:54:01.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:54:01.028+0000 7fc6e5c83700 1 -- 172.21.15.153:0/2055477820 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6e00ffcf0 msgr2=0x7fc6e0100110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:01.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:54:01.028+0000 7fc6e5c83700 1 --2- 172.21.15.153:0/2055477820 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6e00ffcf0 0x7fc6e0100110 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc009990 tx=0x7fc6cc009ca0 comp rx=0 tx=0).stop 2024-04-01T06:54:01.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:54:01.028+0000 7fc6e5c83700 1 -- 172.21.15.153:0/2055477820 shutdown_connections 2024-04-01T06:54:01.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:54:01.028+0000 7fc6e5c83700 1 --2- 172.21.15.153:0/2055477820 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc6e0101890 0x7fc6e0108140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:01.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:54:01.028+0000 7fc6e5c83700 1 --2- 172.21.15.153:0/2055477820 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6e00ffcf0 0x7fc6e0100110 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:01.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:54:01.028+0000 7fc6e5c83700 1 --2- 172.21.15.153:0/2055477820 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc6e0100ef0 0x7fc6e0101350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:01.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:54:01.028+0000 7fc6e5c83700 1 -- 172.21.15.153:0/2055477820 >> 172.21.15.153:0/2055477820 conn(0x7fc6e00fb2b0 msgr2=0x7fc6e00fd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:01.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:54:01.028+0000 7fc6e5c83700 1 -- 172.21.15.153:0/2055477820 shutdown_connections 2024-04-01T06:54:01.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:54:01.028+0000 7fc6e5c83700 1 -- 172.21.15.153:0/2055477820 wait complete. 2024-04-01T06:54:01.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:54:01.029+0000 7fc6e5c83700 1 Processor -- start 2024-04-01T06:54:01.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:54:01.029+0000 7fc6e5c83700 1 -- start start 2024-04-01T06:54:01.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:54:01.029+0000 7fc6e5c83700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6e00ffcf0 0x7fc6e0069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:01.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:54:01.029+0000 7fc6e5c83700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc6e0100ef0 0x7fc6e019bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:01.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:54:01.029+0000 7fc6e5c83700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc6e0101890 0x7fc6e019e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:01.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:54:01.029+0000 7fc6e5c83700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e019e860 con 0x7fc6e0101890 2024-04-01T06:54:01.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:54:01.029+0000 7fc6e5c83700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e019e9d0 con 0x7fc6e0100ef0 2024-04-01T06:54:01.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:54:01.029+0000 7fc6e5c83700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e019eb90 con 0x7fc6e00ffcf0 2024-04-01T06:54:01.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:54:01.029+0000 7fc6df7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6e00ffcf0 0x7fc6e0069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:01.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:54:01.029+0000 7fc6df7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6e00ffcf0 0x7fc6e0069280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33342/0 (socket says 172.21.15.153:33342) 2024-04-01T06:54:01.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:54:01.029+0000 7fc6df7fe700 1 -- 172.21.15.153:0/2330447898 learned_addr learned my addr 172.21.15.153:0/2330447898 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-04-01T06:54:01.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:54:01.030+0000 7fc6deffd700 1 --2- 172.21.15.153:0/2330447898 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc6e0100ef0 0x7fc6e019bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:01.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:54:01.030+0000 7fc6dffff700 1 --2- 172.21.15.153:0/2330447898 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc6e0101890 0x7fc6e019e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:01.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:54:01.030+0000 7fc6df7fe700 1 -- 172.21.15.153:0/2330447898 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc6e0100ef0 msgr2=0x7fc6e019bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:01.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:54:01.030+0000 7fc6df7fe700 1 --2- 172.21.15.153:0/2330447898 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc6e0100ef0 0x7fc6e019bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:01.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:54:01.030+0000 7fc6df7fe700 1 -- 172.21.15.153:0/2330447898 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc6e0101890 msgr2=0x7fc6e019e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:01.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:54:01.030+0000 7fc6df7fe700 1 --2- 172.21.15.153:0/2330447898 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc6e0101890 0x7fc6e019e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:01.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:54:01.030+0000 7fc6df7fe700 1 -- 172.21.15.153:0/2330447898 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6cc0095f0 con 0x7fc6e00ffcf0 2024-04-01T06:54:01.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:54:01.030+0000 7fc6deffd700 1 --2- 172.21.15.153:0/2330447898 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc6e0100ef0 0x7fc6e019bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:54:01.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:54:01.030+0000 7fc6df7fe700 1 --2- 172.21.15.153:0/2330447898 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6e00ffcf0 0x7fc6e0069280 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc0038c0 tx=0x7fc6cc00f740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:01.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:54:01.030+0000 7fc6dcff9700 1 -- 172.21.15.153:0/2330447898 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6cc01d070 con 0x7fc6e00ffcf0 2024-04-01T06:54:01.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:54:01.030+0000 7fc6dcff9700 1 -- 172.21.15.153:0/2330447898 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc6cc003e20 con 0x7fc6e00ffcf0 2024-04-01T06:54:01.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:54:01.030+0000 7fc6e5c83700 1 -- 172.21.15.153:0/2330447898 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6e019ee10 con 0x7fc6e00ffcf0 2024-04-01T06:54:01.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:54:01.030+0000 7fc6dcff9700 1 -- 172.21.15.153:0/2330447898 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6cc0056c0 con 0x7fc6e00ffcf0 2024-04-01T06:54:01.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:54:01.030+0000 7fc6e5c83700 1 -- 172.21.15.153:0/2330447898 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6e019f170 con 0x7fc6e00ffcf0 2024-04-01T06:54:01.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:54:01.031+0000 7fc6e5c83700 1 -- 172.21.15.153:0/2330447898 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6e004eaf0 con 0x7fc6e00ffcf0 2024-04-01T06:54:01.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:54:01.032+0000 7fc6dcff9700 1 -- 172.21.15.153:0/2330447898 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 16) v1 ==== 135865+0+0 (secure 0 0 0) 0x7fc6cc00fc30 con 0x7fc6e00ffcf0 2024-04-01T06:54:01.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:54:01.033+0000 7fc6dcff9700 1 --2- 172.21.15.153:0/2330447898 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fc6c40a1120 0x7fc6c40a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:01.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:54:01.033+0000 7fc6dcff9700 1 -- 172.21.15.153:0/2330447898 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fc6cc0cd560 con 0x7fc6e00ffcf0 2024-04-01T06:54:01.034 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:54:01.034+0000 7fc6deffd700 1 --2- 172.21.15.153:0/2330447898 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fc6c40a1120 0x7fc6c40a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:01.034 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:54:01.034+0000 7fc6deffd700 1 --2- 172.21.15.153:0/2330447898 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fc6c40a1120 0x7fc6c40a35e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc6d00099d0 tx=0x7fc6d0008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:01.036 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:54:01.036+0000 7fc6dcff9700 1 -- 172.21.15.153:0/2330447898 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7fc6cc0971c0 con 0x7fc6e00ffcf0 2024-04-01T06:54:01.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:00 smithi153 ceph-mon[48187]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T06:54:01.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:54:01.238+0000 7fc6e5c83700 1 -- 172.21.15.153:0/2330447898 --> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi083=a;smithi083=d;smithi083=g;smithi083=j;smithi145=b;smithi145=e;smithi145=h;smithi145=k;smithi153=c;smithi153=f;smithi153=i;smithi153=l", "target": ["mon-mgr", ""]}) v1 -- 0x7fc6e002cec0 con 0x7fc6c40a1120 2024-04-01T06:54:01.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:54:01.247+0000 7fc6dcff9700 1 -- 172.21.15.153:0/2330447898 <== mgr.14152 v2:172.21.15.83:6800/3375372052 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7fc6e002cec0 con 0x7fc6c40a1120 2024-04-01T06:54:01.247 INFO:teuthology.orchestra.run.smithi153.stdout:Scheduled mds.all update... 2024-04-01T06:54:01.250 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:54:01.250+0000 7fc6e5c83700 1 -- 172.21.15.153:0/2330447898 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fc6c40a1120 msgr2=0x7fc6c40a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:01.250 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:54:01.250+0000 7fc6e5c83700 1 --2- 172.21.15.153:0/2330447898 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fc6c40a1120 0x7fc6c40a35e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc6d00099d0 tx=0x7fc6d0008040 comp rx=0 tx=0).stop 2024-04-01T06:54:01.250 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:54:01.250+0000 7fc6e5c83700 1 -- 172.21.15.153:0/2330447898 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6e00ffcf0 msgr2=0x7fc6e0069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:01.250 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:54:01.250+0000 7fc6e5c83700 1 --2- 172.21.15.153:0/2330447898 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6e00ffcf0 0x7fc6e0069280 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc0038c0 tx=0x7fc6cc00f740 comp rx=0 tx=0).stop 2024-04-01T06:54:01.250 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:54:01.250+0000 7fc6e5c83700 1 -- 172.21.15.153:0/2330447898 shutdown_connections 2024-04-01T06:54:01.250 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:54:01.250+0000 7fc6e5c83700 1 --2- 172.21.15.153:0/2330447898 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc6e0101890 0x7fc6e019e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:01.250 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:54:01.250+0000 7fc6e5c83700 1 --2- 172.21.15.153:0/2330447898 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fc6c40a1120 0x7fc6c40a35e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:01.250 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:54:01.250+0000 7fc6e5c83700 1 --2- 172.21.15.153:0/2330447898 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6e00ffcf0 0x7fc6e0069280 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:01.250 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:54:01.250+0000 7fc6e5c83700 1 --2- 172.21.15.153:0/2330447898 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc6e0100ef0 0x7fc6e019bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:01.250 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:54:01.250+0000 7fc6e5c83700 1 -- 172.21.15.153:0/2330447898 >> 172.21.15.153:0/2330447898 conn(0x7fc6e00fb2b0 msgr2=0x7fc6e0104310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:01.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:54:01.250+0000 7fc6e5c83700 1 -- 172.21.15.153:0/2330447898 shutdown_connections 2024-04-01T06:54:01.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-04-01T06:54:01.250+0000 7fc6e5c83700 1 -- 172.21.15.153:0/2330447898 wait complete. 2024-04-01T06:54:01.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:00 smithi145 ceph-mon[47816]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T06:54:01.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:00 smithi083 ceph-mon[43429]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T06:54:01.648 DEBUG:teuthology.orchestra.run.smithi083:mds.a> sudo journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mds.a.service 2024-04-01T06:54:01.651 DEBUG:teuthology.orchestra.run.smithi083:mds.d> sudo journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mds.d.service 2024-04-01T06:54:01.680 INFO:journalctl@ceph.mds.a.smithi083.stdout:-- Logs begin at Mon 2024-04-01 06:34:54 UTC. -- 2024-04-01T06:54:01.681 DEBUG:teuthology.orchestra.run.smithi083:mds.g> sudo journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mds.g.service 2024-04-01T06:54:01.707 INFO:journalctl@ceph.mds.d.smithi083.stdout:-- Logs begin at Mon 2024-04-01 06:34:54 UTC. -- 2024-04-01T06:54:01.709 DEBUG:teuthology.orchestra.run.smithi083:mds.j> sudo journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mds.j.service 2024-04-01T06:54:01.734 INFO:journalctl@ceph.mds.g.smithi083.stdout:-- Logs begin at Mon 2024-04-01 06:34:54 UTC. -- 2024-04-01T06:54:01.735 DEBUG:teuthology.orchestra.run.smithi145:mds.b> sudo journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mds.b.service 2024-04-01T06:54:01.737 DEBUG:teuthology.orchestra.run.smithi145:mds.e> sudo journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mds.e.service 2024-04-01T06:54:01.761 INFO:journalctl@ceph.mds.j.smithi083.stdout:-- Logs begin at Mon 2024-04-01 06:34:54 UTC. -- 2024-04-01T06:54:01.775 INFO:journalctl@ceph.mds.b.smithi145.stdout:-- Logs begin at Mon 2024-04-01 06:34:41 UTC. -- 2024-04-01T06:54:01.777 DEBUG:teuthology.orchestra.run.smithi145:mds.h> sudo journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mds.h.service 2024-04-01T06:54:01.806 INFO:journalctl@ceph.mds.e.smithi145.stdout:-- Logs begin at Mon 2024-04-01 06:34:41 UTC. -- 2024-04-01T06:54:01.807 DEBUG:teuthology.orchestra.run.smithi145:mds.k> sudo journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mds.k.service 2024-04-01T06:54:01.835 INFO:journalctl@ceph.mds.h.smithi145.stdout:-- Logs begin at Mon 2024-04-01 06:34:41 UTC. -- 2024-04-01T06:54:01.836 DEBUG:teuthology.orchestra.run.smithi153:mds.c> sudo journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mds.c.service 2024-04-01T06:54:01.839 DEBUG:teuthology.orchestra.run.smithi153:mds.f> sudo journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mds.f.service 2024-04-01T06:54:01.863 INFO:journalctl@ceph.mds.k.smithi145.stdout:-- Logs begin at Mon 2024-04-01 06:34:41 UTC. -- 2024-04-01T06:54:01.870 INFO:journalctl@ceph.mds.c.smithi153.stdout:-- Logs begin at Mon 2024-04-01 06:35:09 UTC. -- 2024-04-01T06:54:01.872 DEBUG:teuthology.orchestra.run.smithi153:mds.i> sudo journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mds.i.service 2024-04-01T06:54:01.900 INFO:journalctl@ceph.mds.f.smithi153.stdout:-- Logs begin at Mon 2024-04-01 06:35:09 UTC. -- 2024-04-01T06:54:01.901 DEBUG:teuthology.orchestra.run.smithi153:mds.l> sudo journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mds.l.service 2024-04-01T06:54:01.929 INFO:journalctl@ceph.mds.i.smithi153.stdout:-- Logs begin at Mon 2024-04-01 06:35:09 UTC. -- 2024-04-01T06:54:01.930 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-04-01T06:54:01.930 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T06:54:01.956 INFO:journalctl@ceph.mds.l.smithi153.stdout:-- Logs begin at Mon 2024-04-01 06:35:09 UTC. -- 2024-04-01T06:54:02.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.065+0000 7fb33dfe0700 1 -- 172.21.15.83:0/3095914677 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb338102250 msgr2=0x7fb338102670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:02.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.065+0000 7fb33dfe0700 1 --2- 172.21.15.83:0/3095914677 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb338102250 0x7fb338102670 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb3280099c0 tx=0x7fb328009cd0 comp rx=0 tx=0).stop 2024-04-01T06:54:02.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.065+0000 7fb33dfe0700 1 -- 172.21.15.83:0/3095914677 shutdown_connections 2024-04-01T06:54:02.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.065+0000 7fb33dfe0700 1 --2- 172.21.15.83:0/3095914677 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb338102250 0x7fb338102670 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:02.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.065+0000 7fb33dfe0700 1 --2- 172.21.15.83:0/3095914677 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb3380ff660 0x7fb338109230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:02.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.065+0000 7fb33dfe0700 1 --2- 172.21.15.83:0/3095914677 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3380fecc0 0x7fb3380ff120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:02.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.065+0000 7fb33dfe0700 1 -- 172.21.15.83:0/3095914677 >> 172.21.15.83:0/3095914677 conn(0x7fb3380fa880 msgr2=0x7fb3380fcca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:02.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.065+0000 7fb33dfe0700 1 -- 172.21.15.83:0/3095914677 shutdown_connections 2024-04-01T06:54:02.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.065+0000 7fb33dfe0700 1 -- 172.21.15.83:0/3095914677 wait complete. 2024-04-01T06:54:02.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.066+0000 7fb33dfe0700 1 Processor -- start 2024-04-01T06:54:02.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.066+0000 7fb33dfe0700 1 -- start start 2024-04-01T06:54:02.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.066+0000 7fb33dfe0700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3380fecc0 0x7fb338196bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:02.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.066+0000 7fb33dfe0700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb3380ff660 0x7fb338197110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:02.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.066+0000 7fb33dfe0700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb338102250 0x7fb33819e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:02.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.066+0000 7fb33dfe0700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb33819e700 con 0x7fb338102250 2024-04-01T06:54:02.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.066+0000 7fb33dfe0700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb33819e840 con 0x7fb3380ff660 2024-04-01T06:54:02.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.066+0000 7fb33dfe0700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb33819e9d0 con 0x7fb3380fecc0 2024-04-01T06:54:02.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.066+0000 7fb337fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb338102250 0x7fb33819e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:02.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.066+0000 7fb337fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb338102250 0x7fb33819e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:49024/0 (socket says 172.21.15.83:49024) 2024-04-01T06:54:02.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.066+0000 7fb337fff700 1 -- 172.21.15.83:0/1580765429 learned_addr learned my addr 172.21.15.83:0/1580765429 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:54:02.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.066+0000 7fb3377fe700 1 --2- 172.21.15.83:0/1580765429 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3380fecc0 0x7fb338196bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:02.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.066+0000 7fb336ffd700 1 --2- 172.21.15.83:0/1580765429 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb3380ff660 0x7fb338197110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:02.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.067+0000 7fb337fff700 1 -- 172.21.15.83:0/1580765429 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3380fecc0 msgr2=0x7fb338196bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:02.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.067+0000 7fb337fff700 1 --2- 172.21.15.83:0/1580765429 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3380fecc0 0x7fb338196bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:02.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.067+0000 7fb337fff700 1 -- 172.21.15.83:0/1580765429 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb3380ff660 msgr2=0x7fb338197110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:02.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.067+0000 7fb337fff700 1 --2- 172.21.15.83:0/1580765429 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb3380ff660 0x7fb338197110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:02.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.067+0000 7fb337fff700 1 -- 172.21.15.83:0/1580765429 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3280095f0 con 0x7fb338102250 2024-04-01T06:54:02.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.067+0000 7fb336ffd700 1 --2- 172.21.15.83:0/1580765429 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb3380ff660 0x7fb338197110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:54:02.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.067+0000 7fb337fff700 1 --2- 172.21.15.83:0/1580765429 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb338102250 0x7fb33819e130 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb330007ee0 tx=0x7fb33000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:02.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.067+0000 7fb334ff9700 1 -- 172.21.15.83:0/1580765429 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb330017070 con 0x7fb338102250 2024-04-01T06:54:02.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.067+0000 7fb334ff9700 1 -- 172.21.15.83:0/1580765429 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb33000f040 con 0x7fb338102250 2024-04-01T06:54:02.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.067+0000 7fb33dfe0700 1 -- 172.21.15.83:0/1580765429 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb33819ecb0 con 0x7fb338102250 2024-04-01T06:54:02.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.067+0000 7fb334ff9700 1 -- 172.21.15.83:0/1580765429 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb330005740 con 0x7fb338102250 2024-04-01T06:54:02.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.067+0000 7fb33dfe0700 1 -- 172.21.15.83:0/1580765429 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb33819f170 con 0x7fb338102250 2024-04-01T06:54:02.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.068+0000 7fb33dfe0700 1 -- 172.21.15.83:0/1580765429 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3381082c0 con 0x7fb338102250 2024-04-01T06:54:02.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.069+0000 7fb334ff9700 1 -- 172.21.15.83:0/1580765429 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) v1 ==== 135865+0+0 (secure 0 0 0) 0x7fb33000dc60 con 0x7fb338102250 2024-04-01T06:54:02.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.069+0000 7fb334ff9700 1 --2- 172.21.15.83:0/1580765429 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fb3240a1120 0x7fb3240a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:02.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.070+0000 7fb334ff9700 1 -- 172.21.15.83:0/1580765429 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fb3300cc260 con 0x7fb338102250 2024-04-01T06:54:02.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.070+0000 7fb3377fe700 1 --2- 172.21.15.83:0/1580765429 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fb3240a1120 0x7fb3240a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:02.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.070+0000 7fb3377fe700 1 --2- 172.21.15.83:0/1580765429 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fb3240a1120 0x7fb3240a35e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb328003730 tx=0x7fb328000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:02.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.073+0000 7fb334ff9700 1 -- 172.21.15.83:0/1580765429 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7fb330095e90 con 0x7fb338102250 2024-04-01T06:54:02.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.279+0000 7fb33dfe0700 1 -- 172.21.15.83:0/1580765429 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb338067180 con 0x7fb338102250 2024-04-01T06:54:02.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.280+0000 7fb334ff9700 1 -- 172.21.15.83:0/1580765429 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+18434 (secure 0 0 0) 0x7fb3300994b0 con 0x7fb338102250 2024-04-01T06:54:02.280 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:54:02.280 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":75,"fsid":"c6f8eff4-eff3-11ee-b647-cb9ed24678a4","created":"2024-04-01T06:48:42.033382+0000","modified":"2024-04-01T06:53:56.797141+0000","last_up_change":"2024-04-01T06:53:55.791339+0000","last_in_change":"2024-04-01T06:53:39.777214+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T06:51:21.963996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"90b761b0-b06c-4142-854d-38ee42aa6052","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6803","nonce":3253845390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6805","nonce":3253845390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6809","nonce":3253845390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6807","nonce":3253845390}]},"public_addr":"172.21.15.83:6803/3253845390","cluster_addr":"172.21.15.83:6805/3253845390","heartbeat_back_addr":"172.21.15.83:6809/3253845390","heartbeat_front_addr":"172.21.15.83:6807/3253845390","state":["exists","up"]},{"osd":1,"uuid":"4d6ab85b-7088-451e-a829-c9119f35dee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6801","nonce":515889759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6803","nonce":515889759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6807","nonce":515889759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6805","nonce":515889759}]},"public_addr":"172.21.15.145:6801/515889759","cluster_addr":"172.21.15.145:6803/515889759","heartbeat_back_addr":"172.21.15.145:6807/515889759","heartbeat_front_addr":"172.21.15.145:6805/515889759","state":["exists","up"]},{"osd":2,"uuid":"d04c27f3-4972-4061-8bfb-5060645e3883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6801","nonce":3318516728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6803","nonce":3318516728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6807","nonce":3318516728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6805","nonce":3318516728}]},"public_addr":"172.21.15.153:6801/3318516728","cluster_addr":"172.21.15.153:6803/3318516728","heartbeat_back_addr":"172.21.15.153:6807/3318516728","heartbeat_front_addr":"172.21.15.153:6805/3318516728","state":["exists","up"]},{"osd":3,"uuid":"899b6c90-8f2f-44dd-b807-49594aadb443","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6811","nonce":504690234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6813","nonce":504690234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6817","nonce":504690234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6815","nonce":504690234}]},"public_addr":"172.21.15.83:6811/504690234","cluster_addr":"172.21.15.83:6813/504690234","heartbeat_back_addr":"172.21.15.83:6817/504690234","heartbeat_front_addr":"172.21.15.83:6815/504690234","state":["exists","up"]},{"osd":4,"uuid":"5071dd81-804e-4358-bfb6-11e718e9cf4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6809","nonce":2099824730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6811","nonce":2099824730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6815","nonce":2099824730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6813","nonce":2099824730}]},"public_addr":"172.21.15.145:6809/2099824730","cluster_addr":"172.21.15.145:6811/2099824730","heartbeat_back_addr":"172.21.15.145:6815/2099824730","heartbeat_front_addr":"172.21.15.145:6813/2099824730","state":["exists","up"]},{"osd":5,"uuid":"b8442b71-c26e-467f-b0c3-ea9f636f5a00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6809","nonce":3340941443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6811","nonce":3340941443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6815","nonce":3340941443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6813","nonce":3340941443}]},"public_addr":"172.21.15.153:6809/3340941443","cluster_addr":"172.21.15.153:6811/3340941443","heartbeat_back_addr":"172.21.15.153:6815/3340941443","heartbeat_front_addr":"172.21.15.153:6813/3340941443","state":["exists","up"]},{"osd":6,"uuid":"c26bb8cb-ccee-4bfc-91eb-14e1ad8e04df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6819","nonce":2005485079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6821","nonce":2005485079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6825","nonce":2005485079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6823","nonce":2005485079}]},"public_addr":"172.21.15.83:6819/2005485079","cluster_addr":"172.21.15.83:6821/2005485079","heartbeat_back_addr":"172.21.15.83:6825/2005485079","heartbeat_front_addr":"172.21.15.83:6823/2005485079","state":["exists","up"]},{"osd":7,"uuid":"a8940da2-0e79-4606-8d1e-d425afbf5753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6817","nonce":3737505059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6819","nonce":3737505059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6823","nonce":3737505059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6821","nonce":3737505059}]},"public_addr":"172.21.15.145:6817/3737505059","cluster_addr":"172.21.15.145:6819/3737505059","heartbeat_back_addr":"172.21.15.145:6823/3737505059","heartbeat_front_addr":"172.21.15.145:6821/3737505059","state":["exists","up"]},{"osd":8,"uuid":"602d43ac-a189-4da3-9e38-7025d14e0dd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6817","nonce":1031545791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6819","nonce":1031545791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6823","nonce":1031545791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6821","nonce":1031545791}]},"public_addr":"172.21.15.153:6817/1031545791","cluster_addr":"172.21.15.153:6819/1031545791","heartbeat_back_addr":"172.21.15.153:6823/1031545791","heartbeat_front_addr":"172.21.15.153:6821/1031545791","state":["exists","up"]},{"osd":9,"uuid":"08b12d27-1247-45e4-9d09-cacc0fce4bd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6827","nonce":3720996673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6829","nonce":3720996673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6833","nonce":3720996673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6831","nonce":3720996673}]},"public_addr":"172.21.15.83:6827/3720996673","cluster_addr":"172.21.15.83:6829/3720996673","heartbeat_back_addr":"172.21.15.83:6833/3720996673","heartbeat_front_addr":"172.21.15.83:6831/3720996673","state":["exists","up"]},{"osd":10,"uuid":"dd986b50-d68f-446c-9c66-261535880879","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6825","nonce":2671529479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6827","nonce":2671529479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6831","nonce":2671529479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6829","nonce":2671529479}]},"public_addr":"172.21.15.145:6825/2671529479","cluster_addr":"172.21.15.145:6827/2671529479","heartbeat_back_addr":"172.21.15.145:6831/2671529479","heartbeat_front_addr":"172.21.15.145:6829/2671529479","state":["exists","up"]},{"osd":11,"uuid":"d20a49cd-6224-4424-8375-46da791d9931","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6825","nonce":2342548429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6827","nonce":2342548429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6831","nonce":2342548429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6829","nonce":2342548429}]},"public_addr":"172.21.15.153:6825/2342548429","cluster_addr":"172.21.15.153:6827/2342548429","heartbeat_back_addr":"172.21.15.153:6831/2342548429","heartbeat_front_addr":"172.21.15.153:6829/2342548429","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:50:44.539932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:01.990470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:19.054426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:36.616393+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:53.896705+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:10.667502+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:27.880849+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:45.276308+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:02.280615+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:19.555547+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:37.062881+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:54.191589+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.83:6801/1867137261":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/2596683931":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/2125339627":"2024-04-02T06:49:33.656125+0000","172.21.15.83:6800/1644397953":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/690500472":"2024-04-02T06:49:13.456026+0000","172.21.15.83:6801/1644397953":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/785958951":"2024-04-02T06:49:33.656125+0000","172.21.15.83:6800/1867137261":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/2222527447":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/2071592157":"2024-04-02T06:49:13.456026+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T06:54:02.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.282+0000 7fb33dfe0700 1 -- 172.21.15.83:0/1580765429 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fb3240a1120 msgr2=0x7fb3240a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:02.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.282+0000 7fb33dfe0700 1 --2- 172.21.15.83:0/1580765429 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fb3240a1120 0x7fb3240a35e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb328003730 tx=0x7fb328000bc0 comp rx=0 tx=0).stop 2024-04-01T06:54:02.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.282+0000 7fb33dfe0700 1 -- 172.21.15.83:0/1580765429 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb338102250 msgr2=0x7fb33819e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:02.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.282+0000 7fb33dfe0700 1 --2- 172.21.15.83:0/1580765429 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb338102250 0x7fb33819e130 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb330007ee0 tx=0x7fb33000d3b0 comp rx=0 tx=0).stop 2024-04-01T06:54:02.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.282+0000 7fb33dfe0700 1 -- 172.21.15.83:0/1580765429 shutdown_connections 2024-04-01T06:54:02.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.282+0000 7fb33dfe0700 1 --2- 172.21.15.83:0/1580765429 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb338102250 0x7fb33819e130 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:02.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.282+0000 7fb33dfe0700 1 --2- 172.21.15.83:0/1580765429 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fb3240a1120 0x7fb3240a35e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:02.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.282+0000 7fb33dfe0700 1 --2- 172.21.15.83:0/1580765429 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3380fecc0 0x7fb338196bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:02.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.282+0000 7fb33dfe0700 1 --2- 172.21.15.83:0/1580765429 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb3380ff660 0x7fb338197110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:02.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.282+0000 7fb33dfe0700 1 -- 172.21.15.83:0/1580765429 >> 172.21.15.83:0/1580765429 conn(0x7fb3380fa880 msgr2=0x7fb338105400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:02.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.282+0000 7fb33dfe0700 1 -- 172.21.15.83:0/1580765429 shutdown_connections 2024-04-01T06:54:02.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.282+0000 7fb33dfe0700 1 -- 172.21.15.83:0/1580765429 wait complete. 2024-04-01T06:54:02.294 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-01T06:51:21.963996+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-01T06:54:02.295 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-01T06:54:02.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.420+0000 7f986e229700 1 -- 172.21.15.83:0/1737061326 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f98681017f0 msgr2=0x7f98681080a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:02.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.420+0000 7f986e229700 1 --2- 172.21.15.83:0/1737061326 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f98681017f0 0x7f98681080a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f986000b0d0 tx=0x7f986000b3e0 comp rx=0 tx=0).stop 2024-04-01T06:54:02.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.420+0000 7f986e229700 1 -- 172.21.15.83:0/1737061326 shutdown_connections 2024-04-01T06:54:02.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.420+0000 7f986e229700 1 --2- 172.21.15.83:0/1737061326 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f98681017f0 0x7f98681080a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:02.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.420+0000 7f986e229700 1 --2- 172.21.15.83:0/1737061326 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f98680ffc60 0x7f9868100080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:02.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.420+0000 7f986e229700 1 --2- 172.21.15.83:0/1737061326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9868100e50 0x7f98681012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:02.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.420+0000 7f986e229700 1 -- 172.21.15.83:0/1737061326 >> 172.21.15.83:0/1737061326 conn(0x7f98680fb1d0 msgr2=0x7f98680fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:02.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.420+0000 7f986e229700 1 -- 172.21.15.83:0/1737061326 shutdown_connections 2024-04-01T06:54:02.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.420+0000 7f986e229700 1 -- 172.21.15.83:0/1737061326 wait complete. 2024-04-01T06:54:02.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.421+0000 7f986e229700 1 Processor -- start 2024-04-01T06:54:02.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.421+0000 7f986e229700 1 -- start start 2024-04-01T06:54:02.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.421+0000 7f986e229700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f98680ffc60 0x7f9868068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:02.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.421+0000 7f986e229700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9868100e50 0x7f986819ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:02.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.421+0000 7f986e229700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98681017f0 0x7f986819e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:02.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.421+0000 7f986e229700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986819e860 con 0x7f9868100e50 2024-04-01T06:54:02.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.421+0000 7f986e229700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986819e9d0 con 0x7f98680ffc60 2024-04-01T06:54:02.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.421+0000 7f986e229700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986819eb90 con 0x7f98681017f0 2024-04-01T06:54:02.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.421+0000 7f9866ffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9868100e50 0x7f986819ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:02.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.421+0000 7f9866ffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9868100e50 0x7f986819ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:49038/0 (socket says 172.21.15.83:49038) 2024-04-01T06:54:02.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.421+0000 7f9866ffd700 1 -- 172.21.15.83:0/2944478653 learned_addr learned my addr 172.21.15.83:0/2944478653 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:54:02.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.421+0000 7f9867fff700 1 --2- 172.21.15.83:0/2944478653 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98681017f0 0x7f986819e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:02.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.421+0000 7f98677fe700 1 --2- 172.21.15.83:0/2944478653 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f98680ffc60 0x7f9868068970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:02.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.422+0000 7f9866ffd700 1 -- 172.21.15.83:0/2944478653 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98681017f0 msgr2=0x7f986819e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:02.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.422+0000 7f9866ffd700 1 --2- 172.21.15.83:0/2944478653 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98681017f0 0x7f986819e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:02.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.422+0000 7f9866ffd700 1 -- 172.21.15.83:0/2944478653 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f98680ffc60 msgr2=0x7f9868068970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:02.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.422+0000 7f9866ffd700 1 --2- 172.21.15.83:0/2944478653 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f98680ffc60 0x7f9868068970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:02.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.422+0000 7f9866ffd700 1 -- 172.21.15.83:0/2944478653 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9860009d00 con 0x7f9868100e50 2024-04-01T06:54:02.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.422+0000 7f9866ffd700 1 --2- 172.21.15.83:0/2944478653 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9868100e50 0x7f986819ba70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f985800e9a0 tx=0x7f985800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:02.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.422+0000 7f9864ff9700 1 -- 172.21.15.83:0/2944478653 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9858009790 con 0x7f9868100e50 2024-04-01T06:54:02.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.422+0000 7f9864ff9700 1 -- 172.21.15.83:0/2944478653 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9858010430 con 0x7f9868100e50 2024-04-01T06:54:02.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.422+0000 7f986e229700 1 -- 172.21.15.83:0/2944478653 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f986819ee70 con 0x7f9868100e50 2024-04-01T06:54:02.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.422+0000 7f9864ff9700 1 -- 172.21.15.83:0/2944478653 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9858018680 con 0x7f9868100e50 2024-04-01T06:54:02.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.422+0000 7f986e229700 1 -- 172.21.15.83:0/2944478653 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f986819f2f0 con 0x7f9868100e50 2024-04-01T06:54:02.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.423+0000 7f986e229700 1 -- 172.21.15.83:0/2944478653 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9868107010 con 0x7f9868100e50 2024-04-01T06:54:02.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.424+0000 7f9864ff9700 1 -- 172.21.15.83:0/2944478653 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) v1 ==== 135865+0+0 (secure 0 0 0) 0x7f98580105a0 con 0x7f9868100e50 2024-04-01T06:54:02.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.425+0000 7f9864ff9700 1 --2- 172.21.15.83:0/2944478653 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f98500a1120 0x7f98500a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:02.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.425+0000 7f9864ff9700 1 -- 172.21.15.83:0/2944478653 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f9858014070 con 0x7f9868100e50 2024-04-01T06:54:02.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.425+0000 7f98677fe700 1 --2- 172.21.15.83:0/2944478653 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f98500a1120 0x7f98500a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:02.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.425+0000 7f98677fe700 1 --2- 172.21.15.83:0/2944478653 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f98500a1120 0x7f98500a35e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9868100cb0 tx=0x7f985c00a3b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:02.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.428+0000 7f9864ff9700 1 -- 172.21.15.83:0/2944478653 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f9858096450 con 0x7f9868100e50 2024-04-01T06:54:02.493 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:02 smithi153 ceph-mon[48187]: from='client.24403 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi083=a;smithi083=d;smithi083=g;smithi083=j;smithi145=b;smithi145=e;smithi145=h;smithi145=k;smithi153=c;smithi153=f;smithi153=i;smithi153=l", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:54:02.494 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:02 smithi153 ceph-mon[48187]: Saving service mds.all spec with placement smithi083=a;smithi083=d;smithi083=g;smithi083=j;smithi145=b;smithi145=e;smithi145=h;smithi145=k;smithi153=c;smithi153=f;smithi153=i;smithi153=l;count:12 2024-04-01T06:54:02.494 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:02 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:02.494 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:02 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:54:02.494 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:02 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:54:02.494 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:02 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:54:02.494 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:02 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:02.494 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:02 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-01T06:54:02.494 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:02 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-01T06:54:02.494 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:02 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:54:02.494 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:02 smithi153 ceph-mon[48187]: Deploying daemon mds.l on smithi153 2024-04-01T06:54:02.494 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:02 smithi153 ceph-mon[48187]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T06:54:02.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:02 smithi145 ceph-mon[47816]: from='client.24403 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi083=a;smithi083=d;smithi083=g;smithi083=j;smithi145=b;smithi145=e;smithi145=h;smithi145=k;smithi153=c;smithi153=f;smithi153=i;smithi153=l", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:54:02.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:02 smithi145 ceph-mon[47816]: Saving service mds.all spec with placement smithi083=a;smithi083=d;smithi083=g;smithi083=j;smithi145=b;smithi145=e;smithi145=h;smithi145=k;smithi153=c;smithi153=f;smithi153=i;smithi153=l;count:12 2024-04-01T06:54:02.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:02 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:02.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:02 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:54:02.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:02 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:54:02.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:02 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:54:02.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:02 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:02.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:02 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-01T06:54:02.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:02 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-01T06:54:02.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:02 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:54:02.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:02 smithi145 ceph-mon[47816]: Deploying daemon mds.l on smithi153 2024-04-01T06:54:02.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:02 smithi145 ceph-mon[47816]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T06:54:02.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:02 smithi083 ceph-mon[43429]: from='client.24403 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi083=a;smithi083=d;smithi083=g;smithi083=j;smithi145=b;smithi145=e;smithi145=h;smithi145=k;smithi153=c;smithi153=f;smithi153=i;smithi153=l", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:54:02.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:02 smithi083 ceph-mon[43429]: Saving service mds.all spec with placement smithi083=a;smithi083=d;smithi083=g;smithi083=j;smithi145=b;smithi145=e;smithi145=h;smithi145=k;smithi153=c;smithi153=f;smithi153=i;smithi153=l;count:12 2024-04-01T06:54:02.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:02 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:02.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:02 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:54:02.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:02 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:54:02.513 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:02 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:54:02.513 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:02 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:02.513 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:02 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-01T06:54:02.513 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:02 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-01T06:54:02.513 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:02 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:54:02.513 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:02 smithi083 ceph-mon[43429]: Deploying daemon mds.l on smithi153 2024-04-01T06:54:02.513 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:02 smithi083 ceph-mon[43429]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T06:54:02.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.624+0000 7f986e229700 1 -- 172.21.15.83:0/2944478653 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f986810b480 con 0x7f9868100e50 2024-04-01T06:54:02.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.625+0000 7f9864ff9700 1 -- 172.21.15.83:0/2944478653 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9858099a70 con 0x7f9868100e50 2024-04-01T06:54:02.625 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 1 2024-04-01T06:54:02.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.627+0000 7f986e229700 1 -- 172.21.15.83:0/2944478653 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f98500a1120 msgr2=0x7f98500a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:02.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.627+0000 7f986e229700 1 --2- 172.21.15.83:0/2944478653 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f98500a1120 0x7f98500a35e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9868100cb0 tx=0x7f985c00a3b0 comp rx=0 tx=0).stop 2024-04-01T06:54:02.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.627+0000 7f986e229700 1 -- 172.21.15.83:0/2944478653 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9868100e50 msgr2=0x7f986819ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:02.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.627+0000 7f986e229700 1 --2- 172.21.15.83:0/2944478653 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9868100e50 0x7f986819ba70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f985800e9a0 tx=0x7f985800ecb0 comp rx=0 tx=0).stop 2024-04-01T06:54:02.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.627+0000 7f986e229700 1 -- 172.21.15.83:0/2944478653 shutdown_connections 2024-04-01T06:54:02.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.627+0000 7f986e229700 1 --2- 172.21.15.83:0/2944478653 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f98500a1120 0x7f98500a35e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:02.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.627+0000 7f986e229700 1 --2- 172.21.15.83:0/2944478653 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98681017f0 0x7f986819e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:02.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.627+0000 7f986e229700 1 --2- 172.21.15.83:0/2944478653 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f98680ffc60 0x7f9868068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:02.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.627+0000 7f986e229700 1 --2- 172.21.15.83:0/2944478653 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9868100e50 0x7f986819ba70 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:02.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.627+0000 7f986e229700 1 -- 172.21.15.83:0/2944478653 >> 172.21.15.83:0/2944478653 conn(0x7f98680fb1d0 msgr2=0x7f9868104150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:02.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.627+0000 7f986e229700 1 -- 172.21.15.83:0/2944478653 shutdown_connections 2024-04-01T06:54:02.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.627+0000 7f986e229700 1 -- 172.21.15.83:0/2944478653 wait complete. 2024-04-01T06:54:02.639 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T06:54:02.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.761+0000 7f862e8d3700 1 -- 172.21.15.83:0/2899318829 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8628106940 msgr2=0x7f8628108db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:02.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.761+0000 7f862e8d3700 1 --2- 172.21.15.83:0/2899318829 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8628106940 0x7f8628108db0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f862000b0a0 tx=0x7f862000b3b0 comp rx=0 tx=0).stop 2024-04-01T06:54:02.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.761+0000 7f862e8d3700 1 -- 172.21.15.83:0/2899318829 shutdown_connections 2024-04-01T06:54:02.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.761+0000 7f862e8d3700 1 --2- 172.21.15.83:0/2899318829 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8628106940 0x7f8628108db0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:02.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.761+0000 7f862e8d3700 1 --2- 172.21.15.83:0/2899318829 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f86281016e0 0x7f8628103ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:02.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.761+0000 7f862e8d3700 1 --2- 172.21.15.83:0/2899318829 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8628104010 0x7f8628106400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:02.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.761+0000 7f862e8d3700 1 -- 172.21.15.83:0/2899318829 >> 172.21.15.83:0/2899318829 conn(0x7f86280fb0d0 msgr2=0x7f86280fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:02.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.761+0000 7f862e8d3700 1 -- 172.21.15.83:0/2899318829 shutdown_connections 2024-04-01T06:54:02.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.761+0000 7f862e8d3700 1 -- 172.21.15.83:0/2899318829 wait complete. 2024-04-01T06:54:02.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.762+0000 7f862e8d3700 1 Processor -- start 2024-04-01T06:54:02.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.762+0000 7f862e8d3700 1 -- start start 2024-04-01T06:54:02.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.762+0000 7f862e8d3700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f86281016e0 0x7f8628196cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:02.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.762+0000 7f862e8d3700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8628104010 0x7f8628197210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:02.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.762+0000 7f862e8d3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8628106940 0x7f862819e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:02.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.762+0000 7f862e8d3700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f862819e7c0 con 0x7f8628104010 2024-04-01T06:54:02.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.762+0000 7f862e8d3700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f862819e930 con 0x7f86281016e0 2024-04-01T06:54:02.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.762+0000 7f862e8d3700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f862819eaf0 con 0x7f8628106940 2024-04-01T06:54:02.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.762+0000 7f86277fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8628104010 0x7f8628197210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:02.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.762+0000 7f86277fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8628104010 0x7f8628197210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:49062/0 (socket says 172.21.15.83:49062) 2024-04-01T06:54:02.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.762+0000 7f86277fe700 1 -- 172.21.15.83:0/954930436 learned_addr learned my addr 172.21.15.83:0/954930436 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:54:02.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.762+0000 7f8627fff700 1 --2- 172.21.15.83:0/954930436 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f86281016e0 0x7f8628196cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:02.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.763+0000 7f862ce70700 1 --2- 172.21.15.83:0/954930436 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8628106940 0x7f862819e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:02.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.763+0000 7f86277fe700 1 -- 172.21.15.83:0/954930436 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8628106940 msgr2=0x7f862819e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:02.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.763+0000 7f86277fe700 1 --2- 172.21.15.83:0/954930436 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8628106940 0x7f862819e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:02.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.763+0000 7f86277fe700 1 -- 172.21.15.83:0/954930436 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f86281016e0 msgr2=0x7f8628196cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:02.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.763+0000 7f86277fe700 1 --2- 172.21.15.83:0/954930436 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f86281016e0 0x7f8628196cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:02.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.763+0000 7f86277fe700 1 -- 172.21.15.83:0/954930436 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8620009d00 con 0x7f8628104010 2024-04-01T06:54:02.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.763+0000 7f86277fe700 1 --2- 172.21.15.83:0/954930436 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8628104010 0x7f8628197210 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f861c00d950 tx=0x7f861c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:02.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.763+0000 7f86257fa700 1 -- 172.21.15.83:0/954930436 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861c00f890 con 0x7f8628104010 2024-04-01T06:54:02.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.763+0000 7f86257fa700 1 -- 172.21.15.83:0/954930436 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f861c010460 con 0x7f8628104010 2024-04-01T06:54:02.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.763+0000 7f862e8d3700 1 -- 172.21.15.83:0/954930436 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f862819edd0 con 0x7f8628104010 2024-04-01T06:54:02.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.763+0000 7f86257fa700 1 -- 172.21.15.83:0/954930436 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861c00e610 con 0x7f8628104010 2024-04-01T06:54:02.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.763+0000 7f862e8d3700 1 -- 172.21.15.83:0/954930436 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f862819f220 con 0x7f8628104010 2024-04-01T06:54:02.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.764+0000 7f862e8d3700 1 -- 172.21.15.83:0/954930436 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86280fcc50 con 0x7f8628104010 2024-04-01T06:54:02.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.765+0000 7f86257fa700 1 -- 172.21.15.83:0/954930436 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) v1 ==== 135865+0+0 (secure 0 0 0) 0x7f861c0108d0 con 0x7f8628104010 2024-04-01T06:54:02.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.766+0000 7f86257fa700 1 --2- 172.21.15.83:0/954930436 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f86100a1120 0x7f86100a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:02.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.766+0000 7f86257fa700 1 -- 172.21.15.83:0/954930436 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f861c0cc1e0 con 0x7f8628104010 2024-04-01T06:54:02.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.766+0000 7f8627fff700 1 --2- 172.21.15.83:0/954930436 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f86100a1120 0x7f86100a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:02.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.766+0000 7f8627fff700 1 --2- 172.21.15.83:0/954930436 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f86100a1120 0x7f86100a35e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8628198150 tx=0x7f861800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:02.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:02.769+0000 7f86257fa700 1 -- 172.21.15.83:0/954930436 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f861c095e10 con 0x7f8628104010 2024-04-01T06:54:03.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:03.009+0000 7f862e8d3700 1 -- 172.21.15.83:0/954930436 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8628067a10 con 0x7f8628104010 2024-04-01T06:54:03.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:03.009+0000 7f86257fa700 1 -- 172.21.15.83:0/954930436 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+501 (secure 0 0 0) 0x7f861c016210 con 0x7f8628104010 2024-04-01T06:54:03.009 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:54:03.009 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-04-01T06:54:03.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:03.012+0000 7f862e8d3700 1 -- 172.21.15.83:0/954930436 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f86100a1120 msgr2=0x7f86100a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:03.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:03.012+0000 7f862e8d3700 1 --2- 172.21.15.83:0/954930436 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f86100a1120 0x7f86100a35e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8628198150 tx=0x7f861800b410 comp rx=0 tx=0).stop 2024-04-01T06:54:03.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:03.012+0000 7f862e8d3700 1 -- 172.21.15.83:0/954930436 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8628104010 msgr2=0x7f8628197210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:03.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:03.012+0000 7f862e8d3700 1 --2- 172.21.15.83:0/954930436 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8628104010 0x7f8628197210 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f861c00d950 tx=0x7f861c00dc60 comp rx=0 tx=0).stop 2024-04-01T06:54:03.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:03.012+0000 7f862e8d3700 1 -- 172.21.15.83:0/954930436 shutdown_connections 2024-04-01T06:54:03.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:03.012+0000 7f862e8d3700 1 --2- 172.21.15.83:0/954930436 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f86100a1120 0x7f86100a35e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:03.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:03.012+0000 7f862e8d3700 1 --2- 172.21.15.83:0/954930436 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8628106940 0x7f862819e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:03.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:03.012+0000 7f862e8d3700 1 --2- 172.21.15.83:0/954930436 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f86281016e0 0x7f8628196cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:03.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:03.012+0000 7f862e8d3700 1 --2- 172.21.15.83:0/954930436 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8628104010 0x7f8628197210 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:03.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:03.012+0000 7f862e8d3700 1 -- 172.21.15.83:0/954930436 >> 172.21.15.83:0/954930436 conn(0x7f86280fb0d0 msgr2=0x7f8628102020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:03.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:03.012+0000 7f862e8d3700 1 -- 172.21.15.83:0/954930436 shutdown_connections 2024-04-01T06:54:03.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:03.012+0000 7f862e8d3700 1 -- 172.21.15.83:0/954930436 wait complete. 2024-04-01T06:54:03.013 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 1 2024-04-01T06:54:03.141 INFO:journalctl@ceph.mds.l.smithi153.stdout:Apr 01 06:54:02 smithi153 systemd[1]: Starting Ceph mds.l for c6f8eff4-eff3-11ee-b647-cb9ed24678a4... 2024-04-01T06:54:03.502 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:03 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/1580765429' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T06:54:03.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:03 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/2944478653' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-01T06:54:03.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:03 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/954930436' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:54:03.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:03 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/1580765429' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T06:54:03.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:03 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/2944478653' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-01T06:54:03.512 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:03 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/954930436' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:54:03.640 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:03 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/1580765429' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T06:54:03.640 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:03 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/2944478653' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-01T06:54:03.641 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:03 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/954930436' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:54:03.641 INFO:journalctl@ceph.mds.l.smithi153.stdout:Apr 01 06:54:03 smithi153 ceph-mds[84687]: -- 172.21.15.153:0/2477529704 <== mon.1 v2:172.21.15.153:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55af671641a0 con 0x55af6713a800 2024-04-01T06:54:03.641 INFO:journalctl@ceph.mds.l.smithi153.stdout:Apr 01 06:54:03 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-l[84664]: starting mds.l at 2024-04-01T06:54:03.641 INFO:journalctl@ceph.mds.l.smithi153.stdout:Apr 01 06:54:03 smithi153 bash[84649]: b7b76f56d34431733421d9839ccad8f390aab0d465acb55303b7b8c8334f72d2 2024-04-01T06:54:03.641 INFO:journalctl@ceph.mds.l.smithi153.stdout:Apr 01 06:54:03 smithi153 systemd[1]: Started Ceph mds.l for c6f8eff4-eff3-11ee-b647-cb9ed24678a4. 2024-04-01T06:54:04.363 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:04 smithi145 ceph-mon[47816]: mds.? [v2:172.21.15.153:6832/2467459028,v1:172.21.15.153:6833/2467459028] up:boot 2024-04-01T06:54:04.363 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:04 smithi145 ceph-mon[47816]: fsmap 1 up:standby 2024-04-01T06:54:04.364 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:04 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-01T06:54:04.364 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:04 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:04.364 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:04 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:04.364 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:04 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:04.364 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:04 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-01T06:54:04.364 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:04 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-01T06:54:04.364 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:04 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:54:04.364 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:04 smithi145 ceph-mon[47816]: Deploying daemon mds.k on smithi145 2024-04-01T06:54:04.364 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:04 smithi145 ceph-mon[47816]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T06:54:04.640 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:04 smithi153 ceph-mon[48187]: mds.? [v2:172.21.15.153:6832/2467459028,v1:172.21.15.153:6833/2467459028] up:boot 2024-04-01T06:54:04.641 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:04 smithi153 ceph-mon[48187]: fsmap 1 up:standby 2024-04-01T06:54:04.641 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:04 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-01T06:54:04.641 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:04 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:04.641 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:04 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:04.641 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:04 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:04.641 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:04 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-01T06:54:04.641 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:04 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-01T06:54:04.641 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:04 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:54:04.641 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:04 smithi153 ceph-mon[48187]: Deploying daemon mds.k on smithi145 2024-04-01T06:54:04.641 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:04 smithi153 ceph-mon[48187]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T06:54:04.753 INFO:journalctl@ceph.mds.k.smithi145.stdout:Apr 01 06:54:04 smithi145 systemd[1]: Starting Ceph mds.k for c6f8eff4-eff3-11ee-b647-cb9ed24678a4... 2024-04-01T06:54:04.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:04 smithi083 ceph-mon[43429]: mds.? [v2:172.21.15.153:6832/2467459028,v1:172.21.15.153:6833/2467459028] up:boot 2024-04-01T06:54:04.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:04 smithi083 ceph-mon[43429]: fsmap 1 up:standby 2024-04-01T06:54:04.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:04 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-01T06:54:04.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:04 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:04.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:04 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:04.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:04 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:04.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:04 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-01T06:54:04.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:04 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-01T06:54:04.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:04 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:54:04.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:04 smithi083 ceph-mon[43429]: Deploying daemon mds.k on smithi145 2024-04-01T06:54:04.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:04 smithi083 ceph-mon[43429]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T06:54:05.025 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T06:54:05.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:05.166+0000 7f297b5f9700 1 -- 172.21.15.83:0/3155482960 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2974106940 msgr2=0x7f2974108db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:05.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:05.166+0000 7f297b5f9700 1 --2- 172.21.15.83:0/3155482960 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2974106940 0x7f2974108db0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f296c00b0a0 tx=0x7f296c00b3b0 comp rx=0 tx=0).stop 2024-04-01T06:54:05.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:05.166+0000 7f297b5f9700 1 -- 172.21.15.83:0/3155482960 shutdown_connections 2024-04-01T06:54:05.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:05.166+0000 7f297b5f9700 1 --2- 172.21.15.83:0/3155482960 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2974106940 0x7f2974108db0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:05.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:05.166+0000 7f297b5f9700 1 --2- 172.21.15.83:0/3155482960 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29741016e0 0x7f2974103ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:05.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:05.166+0000 7f297b5f9700 1 --2- 172.21.15.83:0/3155482960 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2974104010 0x7f2974106400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:05.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:05.166+0000 7f297b5f9700 1 -- 172.21.15.83:0/3155482960 >> 172.21.15.83:0/3155482960 conn(0x7f29740fb0d0 msgr2=0x7f29740fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:05.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:05.166+0000 7f297b5f9700 1 -- 172.21.15.83:0/3155482960 shutdown_connections 2024-04-01T06:54:05.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:05.166+0000 7f297b5f9700 1 -- 172.21.15.83:0/3155482960 wait complete. 2024-04-01T06:54:05.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:05.167+0000 7f297b5f9700 1 Processor -- start 2024-04-01T06:54:05.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:05.167+0000 7f297b5f9700 1 -- start start 2024-04-01T06:54:05.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:05.167+0000 7f297b5f9700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f29741016e0 0x7f2974101000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:05.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:05.167+0000 7f297b5f9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2974104010 0x7f29740ff690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:05.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:05.167+0000 7f297b5f9700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2974106940 0x7f29740ffbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:05.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:05.167+0000 7f297b5f9700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2974100370 con 0x7f29741016e0 2024-04-01T06:54:05.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:05.167+0000 7f297b5f9700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29741004e0 con 0x7f2974106940 2024-04-01T06:54:05.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:05.167+0000 7f297b5f9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29741a0cd0 con 0x7f2974104010 2024-04-01T06:54:05.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:05.167+0000 7f2979395700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f29741016e0 0x7f2974101000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:05.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:05.167+0000 7f2979395700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f29741016e0 0x7f2974101000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58204/0 (socket says 172.21.15.83:58204) 2024-04-01T06:54:05.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:05.167+0000 7f2979395700 1 -- 172.21.15.83:0/296578686 learned_addr learned my addr 172.21.15.83:0/296578686 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:54:05.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:05.167+0000 7f2978b94700 1 --2- 172.21.15.83:0/296578686 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2974104010 0x7f29740ff690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:05.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:05.167+0000 7f2979b96700 1 --2- 172.21.15.83:0/296578686 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2974106940 0x7f29740ffbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:05.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:05.168+0000 7f2979395700 1 -- 172.21.15.83:0/296578686 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2974104010 msgr2=0x7f29740ff690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:05.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:05.168+0000 7f2979395700 1 --2- 172.21.15.83:0/296578686 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2974104010 0x7f29740ff690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:05.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:05.168+0000 7f2979395700 1 -- 172.21.15.83:0/296578686 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2974106940 msgr2=0x7f29740ffbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:05.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:05.168+0000 7f2979395700 1 --2- 172.21.15.83:0/296578686 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2974106940 0x7f29740ffbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:05.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:05.168+0000 7f2979395700 1 -- 172.21.15.83:0/296578686 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f296c009d00 con 0x7f29741016e0 2024-04-01T06:54:05.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:05.168+0000 7f2979395700 1 --2- 172.21.15.83:0/296578686 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f29741016e0 0x7f2974101000 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f297000c920 tx=0x7f297000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:05.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:05.168+0000 7f296a7fc700 1 -- 172.21.15.83:0/296578686 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2970004a30 con 0x7f29741016e0 2024-04-01T06:54:05.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:05.168+0000 7f296a7fc700 1 -- 172.21.15.83:0/296578686 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f29700054e0 con 0x7f29741016e0 2024-04-01T06:54:05.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:05.168+0000 7f297b5f9700 1 -- 172.21.15.83:0/296578686 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29741a0f60 con 0x7f29741016e0 2024-04-01T06:54:05.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:05.168+0000 7f296a7fc700 1 -- 172.21.15.83:0/296578686 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297000eb80 con 0x7f29741016e0 2024-04-01T06:54:05.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:05.168+0000 7f297b5f9700 1 -- 172.21.15.83:0/296578686 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29741a1380 con 0x7f29741016e0 2024-04-01T06:54:05.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:05.169+0000 7f297b5f9700 1 -- 172.21.15.83:0/296578686 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29740fcc50 con 0x7f29741016e0 2024-04-01T06:54:05.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:05.170+0000 7f296a7fc700 1 -- 172.21.15.83:0/296578686 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) v1 ==== 135865+0+0 (secure 0 0 0) 0x7f297000ed00 con 0x7f29741016e0 2024-04-01T06:54:05.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:05.171+0000 7f296a7fc700 1 --2- 172.21.15.83:0/296578686 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f29600a1120 0x7f29600a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:05.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:05.171+0000 7f296a7fc700 1 -- 172.21.15.83:0/296578686 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f29700cc2e0 con 0x7f29741016e0 2024-04-01T06:54:05.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:05.171+0000 7f2978b94700 1 --2- 172.21.15.83:0/296578686 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f29600a1120 0x7f29600a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:05.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:05.171+0000 7f2978b94700 1 --2- 172.21.15.83:0/296578686 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f29600a1120 0x7f29600a35e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2964005950 tx=0x7f296400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:05.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:05.174+0000 7f296a7fc700 1 -- 172.21.15.83:0/296578686 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f2970095f10 con 0x7f29741016e0 2024-04-01T06:54:05.252 INFO:journalctl@ceph.mds.k.smithi145.stdout:Apr 01 06:54:04 smithi145 ceph-mds[83537]: -- 172.21.15.145:0/3316892003 <== mon.2 v2:172.21.15.145:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e7b52ea1a0 con 0x55e7b52c0800 2024-04-01T06:54:05.252 INFO:journalctl@ceph.mds.k.smithi145.stdout:Apr 01 06:54:04 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-k[83514]: starting mds.k at 2024-04-01T06:54:05.252 INFO:journalctl@ceph.mds.k.smithi145.stdout:Apr 01 06:54:05 smithi145 bash[83499]: 959366083bc481242b129ca0f86c43b0f8f166a607eec7aaf8dab6124be95dd8 2024-04-01T06:54:05.252 INFO:journalctl@ceph.mds.k.smithi145.stdout:Apr 01 06:54:05 smithi145 systemd[1]: Started Ceph mds.k for c6f8eff4-eff3-11ee-b647-cb9ed24678a4. 2024-04-01T06:54:05.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:05.457+0000 7f297b5f9700 1 -- 172.21.15.83:0/296578686 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f297410c720 con 0x7f29741016e0 2024-04-01T06:54:05.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:05.457+0000 7f296a7fc700 1 -- 172.21.15.83:0/296578686 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2017 (secure 0 0 0) 0x7f297001d800 con 0x7f29741016e0 2024-04-01T06:54:05.457 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:54:05.457 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2467459028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2467459028},{"type":"v1","addr":"172.21.15.153:6833","nonce":2467459028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24449,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/647005844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":647005844},{"type":"v1","addr":"172.21.15.145:6833","nonce":647005844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-04-01T06:54:05.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:05.459+0000 7f297b5f9700 1 -- 172.21.15.83:0/296578686 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f29600a1120 msgr2=0x7f29600a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:05.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:05.459+0000 7f297b5f9700 1 --2- 172.21.15.83:0/296578686 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f29600a1120 0x7f29600a35e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2964005950 tx=0x7f296400b410 comp rx=0 tx=0).stop 2024-04-01T06:54:05.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:05.459+0000 7f297b5f9700 1 -- 172.21.15.83:0/296578686 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f29741016e0 msgr2=0x7f2974101000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:05.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:05.459+0000 7f297b5f9700 1 --2- 172.21.15.83:0/296578686 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f29741016e0 0x7f2974101000 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f297000c920 tx=0x7f297000cc30 comp rx=0 tx=0).stop 2024-04-01T06:54:05.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:05.459+0000 7f297b5f9700 1 -- 172.21.15.83:0/296578686 shutdown_connections 2024-04-01T06:54:05.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:05.459+0000 7f297b5f9700 1 --2- 172.21.15.83:0/296578686 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f29741016e0 0x7f2974101000 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:05.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:05.459+0000 7f297b5f9700 1 --2- 172.21.15.83:0/296578686 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f29600a1120 0x7f29600a35e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:05.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:05.459+0000 7f297b5f9700 1 --2- 172.21.15.83:0/296578686 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2974106940 0x7f29740ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:05.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:05.459+0000 7f297b5f9700 1 --2- 172.21.15.83:0/296578686 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2974104010 0x7f29740ff690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:05.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:05.459+0000 7f297b5f9700 1 -- 172.21.15.83:0/296578686 >> 172.21.15.83:0/296578686 conn(0x7f29740fb0d0 msgr2=0x7f2974102020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:05.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:05.460+0000 7f297b5f9700 1 -- 172.21.15.83:0/296578686 shutdown_connections 2024-04-01T06:54:05.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:05.460+0000 7f297b5f9700 1 -- 172.21.15.83:0/296578686 wait complete. 2024-04-01T06:54:05.460 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 3 2024-04-01T06:54:06.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:06 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:06.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:06 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:06.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:06 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:06.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:06 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-01T06:54:06.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:06 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-01T06:54:06.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:06 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:54:06.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:06 smithi153 ceph-mon[48187]: Deploying daemon mds.j on smithi083 2024-04-01T06:54:06.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:06 smithi153 ceph-mon[48187]: mds.? [v2:172.21.15.145:6832/647005844,v1:172.21.15.145:6833/647005844] up:boot 2024-04-01T06:54:06.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:06 smithi153 ceph-mon[48187]: fsmap 2 up:standby 2024-04-01T06:54:06.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:06 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-01T06:54:06.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:06 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/296578686' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:54:06.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:06 smithi153 ceph-mon[48187]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T06:54:06.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:06 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:06.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:06 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:06.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:06 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:06.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:06 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-01T06:54:06.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:06 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-01T06:54:06.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:06 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:54:06.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:06 smithi145 ceph-mon[47816]: Deploying daemon mds.j on smithi083 2024-04-01T06:54:06.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:06 smithi145 ceph-mon[47816]: mds.? [v2:172.21.15.145:6832/647005844,v1:172.21.15.145:6833/647005844] up:boot 2024-04-01T06:54:06.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:06 smithi145 ceph-mon[47816]: fsmap 2 up:standby 2024-04-01T06:54:06.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:06 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-01T06:54:06.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:06 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/296578686' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:54:06.504 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:06 smithi145 ceph-mon[47816]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T06:54:06.512 INFO:journalctl@ceph.mds.j.smithi083.stdout:Apr 01 06:54:06 smithi083 systemd[1]: Starting Ceph mds.j for c6f8eff4-eff3-11ee-b647-cb9ed24678a4... 2024-04-01T06:54:06.513 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:06 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:06.513 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:06 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:06.513 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:06 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:06.513 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:06 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-01T06:54:06.513 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:06 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-01T06:54:06.513 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:06 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:54:06.513 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:06 smithi083 ceph-mon[43429]: Deploying daemon mds.j on smithi083 2024-04-01T06:54:06.513 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:06 smithi083 ceph-mon[43429]: mds.? [v2:172.21.15.145:6832/647005844,v1:172.21.15.145:6833/647005844] up:boot 2024-04-01T06:54:06.513 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:06 smithi083 ceph-mon[43429]: fsmap 2 up:standby 2024-04-01T06:54:06.513 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:06 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-01T06:54:06.513 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:06 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/296578686' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:54:06.513 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:06 smithi083 ceph-mon[43429]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T06:54:07.012 INFO:journalctl@ceph.mds.j.smithi083.stdout:Apr 01 06:54:06 smithi083 ceph-mds[94139]: -- 172.21.15.83:0/20493715 <== mon.0 v2:172.21.15.83:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x564ba15161a0 con 0x564ba14ec800 2024-04-01T06:54:07.013 INFO:journalctl@ceph.mds.j.smithi083.stdout:Apr 01 06:54:06 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-j[94116]: starting mds.j at 2024-04-01T06:54:07.013 INFO:journalctl@ceph.mds.j.smithi083.stdout:Apr 01 06:54:06 smithi083 bash[94101]: ce05b05332c58d4d9eae0711961cfafcdc61bfbe52c20746a561b70237190ee2 2024-04-01T06:54:07.013 INFO:journalctl@ceph.mds.j.smithi083.stdout:Apr 01 06:54:06 smithi083 systemd[1]: Started Ceph mds.j for c6f8eff4-eff3-11ee-b647-cb9ed24678a4. 2024-04-01T06:54:07.472 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T06:54:07.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:07.600+0000 7f4145171700 1 -- 172.21.15.83:0/3886038701 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4140106950 msgr2=0x7f4140108dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:07.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:07.600+0000 7f4145171700 1 --2- 172.21.15.83:0/3886038701 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4140106950 0x7f4140108dc0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f413800b0a0 tx=0x7f413800b3b0 comp rx=0 tx=0).stop 2024-04-01T06:54:07.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:07.600+0000 7f4145171700 1 -- 172.21.15.83:0/3886038701 shutdown_connections 2024-04-01T06:54:07.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:07.600+0000 7f4145171700 1 --2- 172.21.15.83:0/3886038701 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4140106950 0x7f4140108dc0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:07.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:07.600+0000 7f4145171700 1 --2- 172.21.15.83:0/3886038701 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f41401016f0 0x7f4140103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:07.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:07.600+0000 7f4145171700 1 --2- 172.21.15.83:0/3886038701 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4140104020 0x7f4140106410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:07.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:07.600+0000 7f4145171700 1 -- 172.21.15.83:0/3886038701 >> 172.21.15.83:0/3886038701 conn(0x7f41400fb100 msgr2=0x7f41400fd520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:07.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:07.600+0000 7f4145171700 1 -- 172.21.15.83:0/3886038701 shutdown_connections 2024-04-01T06:54:07.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:07.600+0000 7f4145171700 1 -- 172.21.15.83:0/3886038701 wait complete. 2024-04-01T06:54:07.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:07.601+0000 7f4145171700 1 Processor -- start 2024-04-01T06:54:07.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:07.601+0000 7f4145171700 1 -- start start 2024-04-01T06:54:07.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:07.601+0000 7f4145171700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41401016f0 0x7f4140196cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:07.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:07.601+0000 7f4145171700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4140104020 0x7f4140197210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:07.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:07.601+0000 7f4145171700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4140106950 0x7f414019e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:07.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:07.601+0000 7f4145171700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414019e7c0 con 0x7f4140106950 2024-04-01T06:54:07.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:07.601+0000 7f4145171700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414019e930 con 0x7f4140104020 2024-04-01T06:54:07.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:07.601+0000 7f4145171700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414019eaf0 con 0x7f41401016f0 2024-04-01T06:54:07.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:07.601+0000 7f413f59e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4140106950 0x7f414019e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:07.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:07.601+0000 7f413f59e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4140106950 0x7f414019e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58234/0 (socket says 172.21.15.83:58234) 2024-04-01T06:54:07.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:07.601+0000 7f413f59e700 1 -- 172.21.15.83:0/1522677796 learned_addr learned my addr 172.21.15.83:0/1522677796 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:54:07.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:07.602+0000 7f413e59c700 1 --2- 172.21.15.83:0/1522677796 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4140104020 0x7f4140197210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:07.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:07.602+0000 7f413ed9d700 1 --2- 172.21.15.83:0/1522677796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41401016f0 0x7f4140196cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:07.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:07.602+0000 7f413f59e700 1 -- 172.21.15.83:0/1522677796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41401016f0 msgr2=0x7f4140196cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:07.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:07.602+0000 7f413f59e700 1 --2- 172.21.15.83:0/1522677796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41401016f0 0x7f4140196cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:07.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:07.602+0000 7f413f59e700 1 -- 172.21.15.83:0/1522677796 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4140104020 msgr2=0x7f4140197210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:07.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:07.602+0000 7f413f59e700 1 --2- 172.21.15.83:0/1522677796 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4140104020 0x7f4140197210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:07.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:07.602+0000 7f413f59e700 1 -- 172.21.15.83:0/1522677796 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4138009d00 con 0x7f4140106950 2024-04-01T06:54:07.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:07.602+0000 7f413e59c700 1 --2- 172.21.15.83:0/1522677796 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4140104020 0x7f4140197210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:54:07.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:07.602+0000 7f413ed9d700 1 --2- 172.21.15.83:0/1522677796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41401016f0 0x7f4140196cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:54:07.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:07.602+0000 7f413f59e700 1 --2- 172.21.15.83:0/1522677796 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4140106950 0x7f414019e1f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4138007ab0 tx=0x7f4138004d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:07.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:07.602+0000 7f4137fff700 1 -- 172.21.15.83:0/1522677796 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413800e040 con 0x7f4140106950 2024-04-01T06:54:07.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:07.602+0000 7f4137fff700 1 -- 172.21.15.83:0/1522677796 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4138005710 con 0x7f4140106950 2024-04-01T06:54:07.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:07.602+0000 7f4145171700 1 -- 172.21.15.83:0/1522677796 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f414019ed70 con 0x7f4140106950 2024-04-01T06:54:07.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:07.602+0000 7f4137fff700 1 -- 172.21.15.83:0/1522677796 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413801dbb0 con 0x7f4140106950 2024-04-01T06:54:07.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:07.602+0000 7f4145171700 1 -- 172.21.15.83:0/1522677796 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f414019f190 con 0x7f4140106950 2024-04-01T06:54:07.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:07.603+0000 7f4145171700 1 -- 172.21.15.83:0/1522677796 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41400fcc80 con 0x7f4140106950 2024-04-01T06:54:07.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:07.604+0000 7f4137fff700 1 -- 172.21.15.83:0/1522677796 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) v1 ==== 135865+0+0 (secure 0 0 0) 0x7f4138005880 con 0x7f4140106950 2024-04-01T06:54:07.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:07.604+0000 7f4137fff700 1 --2- 172.21.15.83:0/1522677796 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f412c0a1120 0x7f412c0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:07.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:07.605+0000 7f413ed9d700 1 --2- 172.21.15.83:0/1522677796 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f412c0a1120 0x7f412c0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:07.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:07.605+0000 7f4137fff700 1 -- 172.21.15.83:0/1522677796 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f41380cdd70 con 0x7f4140106950 2024-04-01T06:54:07.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:07.605+0000 7f413ed9d700 1 --2- 172.21.15.83:0/1522677796 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f412c0a1120 0x7f412c0a35e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4128005fd0 tx=0x7f4128005f00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:07.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:07.609+0000 7f4137fff700 1 -- 172.21.15.83:0/1522677796 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f4138097990 con 0x7f4140106950 2024-04-01T06:54:07.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:07 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:07.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:07 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:07.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:07 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:07.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:07 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-01T06:54:07.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:07 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-01T06:54:07.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:07 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:54:07.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:07 smithi083 ceph-mon[43429]: Deploying daemon mds.d on smithi083 2024-04-01T06:54:07.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:07 smithi083 ceph-mon[43429]: mds.? [v2:172.21.15.83:6834/1271130478,v1:172.21.15.83:6835/1271130478] up:boot 2024-04-01T06:54:07.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:07 smithi083 ceph-mon[43429]: fsmap 3 up:standby 2024-04-01T06:54:07.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:07 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-01T06:54:07.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:07.880+0000 7f4145171700 1 -- 172.21.15.83:0/1522677796 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4140067180 con 0x7f4140106950 2024-04-01T06:54:07.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:07.881+0000 7f4137fff700 1 -- 172.21.15.83:0/1522677796 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+2774 (secure 0 0 0) 0x7f413809afb0 con 0x7f4140106950 2024-04-01T06:54:07.880 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:54:07.881 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1271130478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1271130478},{"type":"v1","addr":"172.21.15.83:6835","nonce":1271130478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2467459028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2467459028},{"type":"v1","addr":"172.21.15.153:6833","nonce":2467459028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24449,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/647005844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":647005844},{"type":"v1","addr":"172.21.15.145:6833","nonce":647005844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-04-01T06:54:07.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:07.883+0000 7f4145171700 1 -- 172.21.15.83:0/1522677796 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f412c0a1120 msgr2=0x7f412c0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:07.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:07.883+0000 7f4145171700 1 --2- 172.21.15.83:0/1522677796 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f412c0a1120 0x7f412c0a35e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4128005fd0 tx=0x7f4128005f00 comp rx=0 tx=0).stop 2024-04-01T06:54:07.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:07.883+0000 7f4145171700 1 -- 172.21.15.83:0/1522677796 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4140106950 msgr2=0x7f414019e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:07.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:07.883+0000 7f4145171700 1 --2- 172.21.15.83:0/1522677796 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4140106950 0x7f414019e1f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4138007ab0 tx=0x7f4138004d30 comp rx=0 tx=0).stop 2024-04-01T06:54:07.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:07.883+0000 7f4145171700 1 -- 172.21.15.83:0/1522677796 shutdown_connections 2024-04-01T06:54:07.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:07.883+0000 7f4145171700 1 --2- 172.21.15.83:0/1522677796 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4140106950 0x7f414019e1f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:07.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:07.883+0000 7f4145171700 1 --2- 172.21.15.83:0/1522677796 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f412c0a1120 0x7f412c0a35e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:07.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:07.883+0000 7f4145171700 1 --2- 172.21.15.83:0/1522677796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41401016f0 0x7f4140196cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:07.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:07.883+0000 7f4145171700 1 --2- 172.21.15.83:0/1522677796 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4140104020 0x7f4140197210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:07.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:07.883+0000 7f4145171700 1 -- 172.21.15.83:0/1522677796 >> 172.21.15.83:0/1522677796 conn(0x7f41400fb100 msgr2=0x7f4140102030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:07.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:07.883+0000 7f4145171700 1 -- 172.21.15.83:0/1522677796 shutdown_connections 2024-04-01T06:54:07.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:07.883+0000 7f4145171700 1 -- 172.21.15.83:0/1522677796 wait complete. 2024-04-01T06:54:07.884 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 4 2024-04-01T06:54:08.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:07 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:08.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:07 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:08.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:07 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:08.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:07 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-01T06:54:08.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:07 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-01T06:54:08.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:07 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:54:08.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:07 smithi145 ceph-mon[47816]: Deploying daemon mds.d on smithi083 2024-04-01T06:54:08.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:07 smithi145 ceph-mon[47816]: mds.? [v2:172.21.15.83:6834/1271130478,v1:172.21.15.83:6835/1271130478] up:boot 2024-04-01T06:54:08.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:07 smithi145 ceph-mon[47816]: fsmap 3 up:standby 2024-04-01T06:54:08.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:07 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-01T06:54:08.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:07 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:08.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:07 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:08.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:07 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:08.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:07 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-01T06:54:08.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:07 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-01T06:54:08.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:07 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:54:08.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:07 smithi153 ceph-mon[48187]: Deploying daemon mds.d on smithi083 2024-04-01T06:54:08.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:07 smithi153 ceph-mon[48187]: mds.? [v2:172.21.15.83:6834/1271130478,v1:172.21.15.83:6835/1271130478] up:boot 2024-04-01T06:54:08.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:07 smithi153 ceph-mon[48187]: fsmap 3 up:standby 2024-04-01T06:54:08.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:07 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-01T06:54:08.263 INFO:journalctl@ceph.mds.d.smithi083.stdout:Apr 01 06:54:08 smithi083 systemd[1]: Starting Ceph mds.d for c6f8eff4-eff3-11ee-b647-cb9ed24678a4... 2024-04-01T06:54:08.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:08 smithi083 ceph-mon[43429]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T06:54:08.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:08 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/1522677796' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:54:08.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:08 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:08.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:08 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:08.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:08 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:08.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:08 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-01T06:54:08.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:08 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-01T06:54:08.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:08 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:54:08.763 INFO:journalctl@ceph.mds.d.smithi083.stdout:Apr 01 06:54:08 smithi083 ceph-mds[94527]: -- 172.21.15.83:0/3346255716 <== mon.0 v2:172.21.15.83:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5620646121a0 con 0x5620645e8800 2024-04-01T06:54:08.763 INFO:journalctl@ceph.mds.d.smithi083.stdout:Apr 01 06:54:08 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-d[94504]: starting mds.d at 2024-04-01T06:54:08.763 INFO:journalctl@ceph.mds.d.smithi083.stdout:Apr 01 06:54:08 smithi083 bash[94489]: 57f5644d0f69a5a1f6521aa64b86aa65a19ccb519a77004a1f375ecb4b8ef481 2024-04-01T06:54:08.764 INFO:journalctl@ceph.mds.d.smithi083.stdout:Apr 01 06:54:08 smithi083 systemd[1]: Started Ceph mds.d for c6f8eff4-eff3-11ee-b647-cb9ed24678a4. 2024-04-01T06:54:08.978 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:08 smithi145 ceph-mon[47816]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T06:54:08.978 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:08 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/1522677796' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:54:08.978 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:08 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:08.978 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:08 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:08.978 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:08 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:08.978 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:08 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-01T06:54:08.978 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:08 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-01T06:54:08.978 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:08 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:54:09.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:08 smithi153 ceph-mon[48187]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T06:54:09.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:08 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/1522677796' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:54:09.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:08 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:09.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:08 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:09.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:08 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:09.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:08 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-01T06:54:09.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:08 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-01T06:54:09.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:08 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:54:09.896 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T06:54:10.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:09 smithi145 ceph-mon[47816]: Deploying daemon mds.e on smithi145 2024-04-01T06:54:10.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:09 smithi145 ceph-mon[47816]: mds.? [v2:172.21.15.83:6836/2412682983,v1:172.21.15.83:6837/2412682983] up:boot 2024-04-01T06:54:10.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:09 smithi145 ceph-mon[47816]: fsmap 4 up:standby 2024-04-01T06:54:10.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:09 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-01T06:54:10.004 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:54:09 smithi145 systemd[1]: Starting Ceph mds.e for c6f8eff4-eff3-11ee-b647-cb9ed24678a4... 2024-04-01T06:54:10.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:09 smithi083 ceph-mon[43429]: Deploying daemon mds.e on smithi145 2024-04-01T06:54:10.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:09 smithi083 ceph-mon[43429]: mds.? [v2:172.21.15.83:6836/2412682983,v1:172.21.15.83:6837/2412682983] up:boot 2024-04-01T06:54:10.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:09 smithi083 ceph-mon[43429]: fsmap 4 up:standby 2024-04-01T06:54:10.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:09 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-01T06:54:10.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:10.037+0000 7fdfb66f6700 1 -- 172.21.15.83:0/1785020126 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfb00ffb60 msgr2=0x7fdfb00fff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:10.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:10.037+0000 7fdfb66f6700 1 --2- 172.21.15.83:0/1785020126 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfb00ffb60 0x7fdfb00fff80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdf980099c0 tx=0x7fdf98009cd0 comp rx=0 tx=0).stop 2024-04-01T06:54:10.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:10.037+0000 7fdfb66f6700 1 -- 172.21.15.83:0/1785020126 shutdown_connections 2024-04-01T06:54:10.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:10.037+0000 7fdfb66f6700 1 --2- 172.21.15.83:0/1785020126 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfb00ffb60 0x7fdfb00fff80 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:10.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:10.037+0000 7fdfb66f6700 1 --2- 172.21.15.83:0/1785020126 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdfb01016f0 0x7fdfb0107fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:10.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:10.037+0000 7fdfb66f6700 1 --2- 172.21.15.83:0/1785020126 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfb0100d50 0x7fdfb01011b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:10.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:10.037+0000 7fdfb66f6700 1 -- 172.21.15.83:0/1785020126 >> 172.21.15.83:0/1785020126 conn(0x7fdfb00fb0d0 msgr2=0x7fdfb00fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:10.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:10.037+0000 7fdfb66f6700 1 -- 172.21.15.83:0/1785020126 shutdown_connections 2024-04-01T06:54:10.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:10.037+0000 7fdfb66f6700 1 -- 172.21.15.83:0/1785020126 wait complete. 2024-04-01T06:54:10.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:10.038+0000 7fdfb66f6700 1 Processor -- start 2024-04-01T06:54:10.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:10.038+0000 7fdfb66f6700 1 -- start start 2024-04-01T06:54:10.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:10.038+0000 7fdfb66f6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfb00ffb60 0x7fdfb0196cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:10.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:10.038+0000 7fdfb66f6700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdfb0100d50 0x7fdfb0197200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:10.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:10.038+0000 7fdfb66f6700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfb01016f0 0x7fdfb019e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:10.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:10.038+0000 7fdfb66f6700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb019e7e0 con 0x7fdfb01016f0 2024-04-01T06:54:10.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:10.038+0000 7fdfb66f6700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb019e950 con 0x7fdfb0100d50 2024-04-01T06:54:10.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:10.038+0000 7fdfb66f6700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb019eb10 con 0x7fdfb00ffb60 2024-04-01T06:54:10.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:10.039+0000 7fdfb4c93700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfb01016f0 0x7fdfb019e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:10.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:10.039+0000 7fdfaf7fe700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdfb0100d50 0x7fdfb0197200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:10.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:10.039+0000 7fdfb4c93700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfb01016f0 0x7fdfb019e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58286/0 (socket says 172.21.15.83:58286) 2024-04-01T06:54:10.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:10.039+0000 7fdfb4c93700 1 -- 172.21.15.83:0/1926758581 learned_addr learned my addr 172.21.15.83:0/1926758581 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:54:10.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:10.039+0000 7fdfaffff700 1 --2- 172.21.15.83:0/1926758581 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfb00ffb60 0x7fdfb0196cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:10.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:10.039+0000 7fdfb4c93700 1 -- 172.21.15.83:0/1926758581 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfb00ffb60 msgr2=0x7fdfb0196cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:10.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:10.039+0000 7fdfb4c93700 1 --2- 172.21.15.83:0/1926758581 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfb00ffb60 0x7fdfb0196cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:10.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:10.039+0000 7fdfb4c93700 1 -- 172.21.15.83:0/1926758581 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdfb0100d50 msgr2=0x7fdfb0197200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:10.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:10.039+0000 7fdfb4c93700 1 --2- 172.21.15.83:0/1926758581 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdfb0100d50 0x7fdfb0197200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:10.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:10.039+0000 7fdfb4c93700 1 -- 172.21.15.83:0/1926758581 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf980095f0 con 0x7fdfb01016f0 2024-04-01T06:54:10.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:10.039+0000 7fdfb4c93700 1 --2- 172.21.15.83:0/1926758581 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfb01016f0 0x7fdfb019e210 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdfa800b970 tx=0x7fdfa800bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:10.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:10.039+0000 7fdfad7fa700 1 -- 172.21.15.83:0/1926758581 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa800c930 con 0x7fdfb01016f0 2024-04-01T06:54:10.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:10.039+0000 7fdfad7fa700 1 -- 172.21.15.83:0/1926758581 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdfa8014440 con 0x7fdfb01016f0 2024-04-01T06:54:10.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:10.039+0000 7fdfb66f6700 1 -- 172.21.15.83:0/1926758581 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfb019edf0 con 0x7fdfb01016f0 2024-04-01T06:54:10.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:10.039+0000 7fdfad7fa700 1 -- 172.21.15.83:0/1926758581 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa80075d0 con 0x7fdfb01016f0 2024-04-01T06:54:10.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:10.039+0000 7fdfb66f6700 1 -- 172.21.15.83:0/1926758581 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfb019f2a0 con 0x7fdfb01016f0 2024-04-01T06:54:10.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:10.040+0000 7fdfb66f6700 1 -- 172.21.15.83:0/1926758581 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfb0067a10 con 0x7fdfb01016f0 2024-04-01T06:54:10.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:10.041+0000 7fdfad7fa700 1 -- 172.21.15.83:0/1926758581 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) v1 ==== 135865+0+0 (secure 0 0 0) 0x7fdfa80145b0 con 0x7fdfb01016f0 2024-04-01T06:54:10.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:10.042+0000 7fdfad7fa700 1 --2- 172.21.15.83:0/1926758581 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fdf9c0a1120 0x7fdf9c0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:10.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:10.042+0000 7fdfaffff700 1 --2- 172.21.15.83:0/1926758581 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fdf9c0a1120 0x7fdf9c0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:10.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:10.042+0000 7fdfad7fa700 1 -- 172.21.15.83:0/1926758581 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fdfa8006e40 con 0x7fdfb01016f0 2024-04-01T06:54:10.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:10.042+0000 7fdfaffff700 1 --2- 172.21.15.83:0/1926758581 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fdf9c0a1120 0x7fdf9c0a35e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdf98009990 tx=0x7fdf98005c00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:10.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:10.045+0000 7fdfad7fa700 1 -- 172.21.15.83:0/1926758581 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7fdfa8095b50 con 0x7fdfb01016f0 2024-04-01T06:54:10.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:09 smithi153 ceph-mon[48187]: Deploying daemon mds.e on smithi145 2024-04-01T06:54:10.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:09 smithi153 ceph-mon[48187]: mds.? [v2:172.21.15.83:6836/2412682983,v1:172.21.15.83:6837/2412682983] up:boot 2024-04-01T06:54:10.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:09 smithi153 ceph-mon[48187]: fsmap 4 up:standby 2024-04-01T06:54:10.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:09 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-01T06:54:10.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:10.288+0000 7fdfb66f6700 1 -- 172.21.15.83:0/1926758581 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdfb010b470 con 0x7fdfb01016f0 2024-04-01T06:54:10.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:10.289+0000 7fdfad7fa700 1 -- 172.21.15.83:0/1926758581 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+3531 (secure 0 0 0) 0x7fdfa8023de0 con 0x7fdfb01016f0 2024-04-01T06:54:10.289 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:54:10.289 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1271130478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1271130478},{"type":"v1","addr":"172.21.15.83:6835","nonce":1271130478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2412682983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2412682983},{"type":"v1","addr":"172.21.15.83:6837","nonce":2412682983}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2467459028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2467459028},{"type":"v1","addr":"172.21.15.153:6833","nonce":2467459028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24449,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/647005844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":647005844},{"type":"v1","addr":"172.21.15.145:6833","nonce":647005844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-04-01T06:54:10.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:10.291+0000 7fdfb66f6700 1 -- 172.21.15.83:0/1926758581 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fdf9c0a1120 msgr2=0x7fdf9c0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:10.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:10.291+0000 7fdfb66f6700 1 --2- 172.21.15.83:0/1926758581 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fdf9c0a1120 0x7fdf9c0a35e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdf98009990 tx=0x7fdf98005c00 comp rx=0 tx=0).stop 2024-04-01T06:54:10.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:10.291+0000 7fdfb66f6700 1 -- 172.21.15.83:0/1926758581 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfb01016f0 msgr2=0x7fdfb019e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:10.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:10.291+0000 7fdfb66f6700 1 --2- 172.21.15.83:0/1926758581 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfb01016f0 0x7fdfb019e210 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdfa800b970 tx=0x7fdfa800bc80 comp rx=0 tx=0).stop 2024-04-01T06:54:10.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:10.291+0000 7fdfb66f6700 1 -- 172.21.15.83:0/1926758581 shutdown_connections 2024-04-01T06:54:10.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:10.291+0000 7fdfb66f6700 1 --2- 172.21.15.83:0/1926758581 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfb01016f0 0x7fdfb019e210 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:10.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:10.291+0000 7fdfb66f6700 1 --2- 172.21.15.83:0/1926758581 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fdf9c0a1120 0x7fdf9c0a35e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:10.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:10.291+0000 7fdfb66f6700 1 --2- 172.21.15.83:0/1926758581 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfb00ffb60 0x7fdfb0196cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:10.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:10.291+0000 7fdfb66f6700 1 --2- 172.21.15.83:0/1926758581 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdfb0100d50 0x7fdfb0197200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:10.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:10.291+0000 7fdfb66f6700 1 -- 172.21.15.83:0/1926758581 >> 172.21.15.83:0/1926758581 conn(0x7fdfb00fb0d0 msgr2=0x7fdfb0067e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:10.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:10.291+0000 7fdfb66f6700 1 -- 172.21.15.83:0/1926758581 shutdown_connections 2024-04-01T06:54:10.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:10.291+0000 7fdfb66f6700 1 -- 172.21.15.83:0/1926758581 wait complete. 2024-04-01T06:54:10.292 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 5 2024-04-01T06:54:10.503 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:54:10 smithi145 ceph-mds[83883]: -- 172.21.15.145:0/2662988311 <== mon.2 v2:172.21.15.145:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56288dee41a0 con 0x56288deba800 2024-04-01T06:54:10.503 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:54:10 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: starting mds.e at 2024-04-01T06:54:10.503 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:54:10 smithi145 bash[83845]: ec35efdca3214b12d304becfca982611b9a2fa5b2ab59e84c103af21a5e9d349 2024-04-01T06:54:10.503 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:54:10 smithi145 systemd[1]: Started Ceph mds.e for c6f8eff4-eff3-11ee-b647-cb9ed24678a4. 2024-04-01T06:54:10.989 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:10 smithi153 ceph-mon[48187]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T06:54:10.989 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:10 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:10.989 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:10 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:10.989 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:10 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/1926758581' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:54:10.989 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:10 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:10.989 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:10 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-01T06:54:10.989 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:10 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-01T06:54:10.989 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:10 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:54:11.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:10 smithi145 ceph-mon[47816]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T06:54:11.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:10 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:11.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:10 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:11.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:10 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/1926758581' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:54:11.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:10 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:11.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:10 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-01T06:54:11.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:10 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-01T06:54:11.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:10 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:54:11.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:10 smithi083 ceph-mon[43429]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T06:54:11.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:10 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:11.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:10 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:11.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:10 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/1926758581' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:54:11.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:10 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:11.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:10 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-01T06:54:11.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:10 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-01T06:54:11.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:10 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:54:11.538 INFO:journalctl@ceph.mds.f.smithi153.stdout:Apr 01 06:54:11 smithi153 systemd[1]: Starting Ceph mds.f for c6f8eff4-eff3-11ee-b647-cb9ed24678a4... 2024-04-01T06:54:11.809 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:11 smithi153 ceph-mon[48187]: Deploying daemon mds.f on smithi153 2024-04-01T06:54:11.809 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:11 smithi153 ceph-mon[48187]: mds.? [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] up:boot 2024-04-01T06:54:11.809 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:11 smithi153 ceph-mon[48187]: fsmap 5 up:standby 2024-04-01T06:54:11.809 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:11 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-01T06:54:12.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:11 smithi145 ceph-mon[47816]: Deploying daemon mds.f on smithi153 2024-04-01T06:54:12.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:11 smithi145 ceph-mon[47816]: mds.? [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] up:boot 2024-04-01T06:54:12.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:11 smithi145 ceph-mon[47816]: fsmap 5 up:standby 2024-04-01T06:54:12.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:11 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-01T06:54:12.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:11 smithi083 ceph-mon[43429]: Deploying daemon mds.f on smithi153 2024-04-01T06:54:12.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:11 smithi083 ceph-mon[43429]: mds.? [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] up:boot 2024-04-01T06:54:12.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:11 smithi083 ceph-mon[43429]: fsmap 5 up:standby 2024-04-01T06:54:12.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:11 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-01T06:54:12.304 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T06:54:12.389 INFO:journalctl@ceph.mds.f.smithi153.stdout:Apr 01 06:54:11 smithi153 ceph-mds[85026]: -- 172.21.15.153:0/3209644052 <== mon.1 v2:172.21.15.153:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x564291cfe1a0 con 0x564291cd4800 2024-04-01T06:54:12.389 INFO:journalctl@ceph.mds.f.smithi153.stdout:Apr 01 06:54:11 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-f[85003]: starting mds.f at 2024-04-01T06:54:12.389 INFO:journalctl@ceph.mds.f.smithi153.stdout:Apr 01 06:54:11 smithi153 bash[84988]: 76c1d22d863e38440959f090ea98e3279775d7089ebf660fa03e646051917990 2024-04-01T06:54:12.389 INFO:journalctl@ceph.mds.f.smithi153.stdout:Apr 01 06:54:11 smithi153 systemd[1]: Started Ceph mds.f for c6f8eff4-eff3-11ee-b647-cb9ed24678a4. 2024-04-01T06:54:12.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:12.439+0000 7fe41897e700 1 -- 172.21.15.83:0/976350289 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe4141000b0 msgr2=0x7fe4141004d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:12.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:12.439+0000 7fe41897e700 1 --2- 172.21.15.83:0/976350289 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe4141000b0 0x7fe4141004d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe408009990 tx=0x7fe408009ca0 comp rx=0 tx=0).stop 2024-04-01T06:54:12.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:12.439+0000 7fe41897e700 1 -- 172.21.15.83:0/976350289 shutdown_connections 2024-04-01T06:54:12.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:12.439+0000 7fe41897e700 1 --2- 172.21.15.83:0/976350289 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe4141000b0 0x7fe4141004d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:12.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:12.439+0000 7fe41897e700 1 --2- 172.21.15.83:0/976350289 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe414101780 0x7fe414108010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:12.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:12.439+0000 7fe41897e700 1 --2- 172.21.15.83:0/976350289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe414100dc0 0x7fe414101240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:12.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:12.439+0000 7fe41897e700 1 -- 172.21.15.83:0/976350289 >> 172.21.15.83:0/976350289 conn(0x7fe4140fa880 msgr2=0x7fe4140fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:12.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:12.439+0000 7fe41897e700 1 -- 172.21.15.83:0/976350289 shutdown_connections 2024-04-01T06:54:12.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:12.439+0000 7fe41897e700 1 -- 172.21.15.83:0/976350289 wait complete. 2024-04-01T06:54:12.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:12.440+0000 7fe41897e700 1 Processor -- start 2024-04-01T06:54:12.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:12.440+0000 7fe41897e700 1 -- start start 2024-04-01T06:54:12.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:12.440+0000 7fe41897e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4141000b0 0x7fe414196ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:12.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:12.440+0000 7fe41897e700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe414100dc0 0x7fe4141970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:12.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:12.440+0000 7fe41897e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe414101780 0x7fe41419e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:12.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:12.440+0000 7fe41897e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41419e6d0 con 0x7fe414101780 2024-04-01T06:54:12.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:12.440+0000 7fe41897e700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41419e810 con 0x7fe414100dc0 2024-04-01T06:54:12.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:12.440+0000 7fe41897e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41419e9a0 con 0x7fe4141000b0 2024-04-01T06:54:12.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:12.440+0000 7fe412d9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe414101780 0x7fe41419e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:12.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:12.440+0000 7fe412d9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe414101780 0x7fe41419e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58304/0 (socket says 172.21.15.83:58304) 2024-04-01T06:54:12.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:12.440+0000 7fe412d9d700 1 -- 172.21.15.83:0/2445995868 learned_addr learned my addr 172.21.15.83:0/2445995868 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:54:12.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:12.440+0000 7fe41259c700 1 --2- 172.21.15.83:0/2445995868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4141000b0 0x7fe414196ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:12.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:12.440+0000 7fe411d9b700 1 --2- 172.21.15.83:0/2445995868 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe414100dc0 0x7fe4141970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:12.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:12.440+0000 7fe412d9d700 1 -- 172.21.15.83:0/2445995868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4141000b0 msgr2=0x7fe414196ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:12.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:12.440+0000 7fe412d9d700 1 --2- 172.21.15.83:0/2445995868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4141000b0 0x7fe414196ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:12.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:12.440+0000 7fe412d9d700 1 -- 172.21.15.83:0/2445995868 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe414100dc0 msgr2=0x7fe4141970e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:12.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:12.440+0000 7fe412d9d700 1 --2- 172.21.15.83:0/2445995868 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe414100dc0 0x7fe4141970e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:12.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:12.440+0000 7fe412d9d700 1 -- 172.21.15.83:0/2445995868 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4080095f0 con 0x7fe414101780 2024-04-01T06:54:12.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:12.440+0000 7fe41259c700 1 --2- 172.21.15.83:0/2445995868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4141000b0 0x7fe414196ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:54:12.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:12.440+0000 7fe411d9b700 1 --2- 172.21.15.83:0/2445995868 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe414100dc0 0x7fe4141970e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:54:12.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:12.440+0000 7fe412d9d700 1 --2- 172.21.15.83:0/2445995868 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe414101780 0x7fe41419e100 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe40c00ef30 tx=0x7fe40c00c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:12.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:12.440+0000 7fe4037fe700 1 -- 172.21.15.83:0/2445995868 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c018070 con 0x7fe414101780 2024-04-01T06:54:12.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:12.440+0000 7fe4037fe700 1 -- 172.21.15.83:0/2445995868 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe40c00f040 con 0x7fe414101780 2024-04-01T06:54:12.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:12.440+0000 7fe4037fe700 1 -- 172.21.15.83:0/2445995868 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c003dc0 con 0x7fe414101780 2024-04-01T06:54:12.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:12.440+0000 7fe41897e700 1 -- 172.21.15.83:0/2445995868 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe41419ec20 con 0x7fe414101780 2024-04-01T06:54:12.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:12.441+0000 7fe41897e700 1 -- 172.21.15.83:0/2445995868 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe41419f0e0 con 0x7fe414101780 2024-04-01T06:54:12.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:12.441+0000 7fe41897e700 1 -- 172.21.15.83:0/2445995868 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe414067e60 con 0x7fe414101780 2024-04-01T06:54:12.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:12.443+0000 7fe4037fe700 1 -- 172.21.15.83:0/2445995868 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) v1 ==== 135865+0+0 (secure 0 0 0) 0x7fe40c00caa0 con 0x7fe414101780 2024-04-01T06:54:12.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:12.444+0000 7fe4037fe700 1 --2- 172.21.15.83:0/2445995868 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fe3fc0a1120 0x7fe3fc0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:12.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:12.444+0000 7fe41259c700 1 --2- 172.21.15.83:0/2445995868 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fe3fc0a1120 0x7fe3fc0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:12.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:12.444+0000 7fe4037fe700 1 -- 172.21.15.83:0/2445995868 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fe40c0ccb20 con 0x7fe414101780 2024-04-01T06:54:12.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:12.444+0000 7fe41259c700 1 --2- 172.21.15.83:0/2445995868 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fe3fc0a1120 0x7fe3fc0a35e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe40800b2e0 tx=0x7fe408005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:12.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:12.447+0000 7fe4037fe700 1 -- 172.21.15.83:0/2445995868 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7fe40c096740 con 0x7fe414101780 2024-04-01T06:54:12.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:12.687+0000 7fe41897e700 1 -- 172.21.15.83:0/2445995868 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe41410b680 con 0x7fe414101780 2024-04-01T06:54:12.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:12.688+0000 7fe4037fe700 1 -- 172.21.15.83:0/2445995868 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4291 (secure 0 0 0) 0x7fe40c099d60 con 0x7fe414101780 2024-04-01T06:54:12.688 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:54:12.688 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1271130478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1271130478},{"type":"v1","addr":"172.21.15.83:6835","nonce":1271130478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2412682983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2412682983},{"type":"v1","addr":"172.21.15.83:6837","nonce":2412682983}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2467459028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2467459028},{"type":"v1","addr":"172.21.15.153:6833","nonce":2467459028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24449,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/647005844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":647005844},{"type":"v1","addr":"172.21.15.145:6833","nonce":647005844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/3104241497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":3104241497},{"type":"v1","addr":"172.21.15.145:6835","nonce":3104241497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[]} 2024-04-01T06:54:12.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:12.690+0000 7fe41897e700 1 -- 172.21.15.83:0/2445995868 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fe3fc0a1120 msgr2=0x7fe3fc0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:12.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:12.690+0000 7fe41897e700 1 --2- 172.21.15.83:0/2445995868 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fe3fc0a1120 0x7fe3fc0a35e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe40800b2e0 tx=0x7fe408005fb0 comp rx=0 tx=0).stop 2024-04-01T06:54:12.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:12.690+0000 7fe41897e700 1 -- 172.21.15.83:0/2445995868 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe414101780 msgr2=0x7fe41419e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:12.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:12.690+0000 7fe41897e700 1 --2- 172.21.15.83:0/2445995868 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe414101780 0x7fe41419e100 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe40c00ef30 tx=0x7fe40c00c450 comp rx=0 tx=0).stop 2024-04-01T06:54:12.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:12.690+0000 7fe41897e700 1 -- 172.21.15.83:0/2445995868 shutdown_connections 2024-04-01T06:54:12.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:12.690+0000 7fe41897e700 1 --2- 172.21.15.83:0/2445995868 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe414101780 0x7fe41419e100 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:12.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:12.690+0000 7fe41897e700 1 --2- 172.21.15.83:0/2445995868 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fe3fc0a1120 0x7fe3fc0a35e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:12.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:12.690+0000 7fe41897e700 1 --2- 172.21.15.83:0/2445995868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4141000b0 0x7fe414196ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:12.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:12.690+0000 7fe41897e700 1 --2- 172.21.15.83:0/2445995868 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe414100dc0 0x7fe4141970e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:12.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:12.690+0000 7fe41897e700 1 -- 172.21.15.83:0/2445995868 >> 172.21.15.83:0/2445995868 conn(0x7fe4140fa880 msgr2=0x7fe4140fc310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:12.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:12.690+0000 7fe41897e700 1 -- 172.21.15.83:0/2445995868 shutdown_connections 2024-04-01T06:54:12.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:12.690+0000 7fe41897e700 1 -- 172.21.15.83:0/2445995868 wait complete. 2024-04-01T06:54:12.691 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 6 2024-04-01T06:54:13.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:12 smithi145 ceph-mon[47816]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T06:54:13.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:12 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:13.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:12 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:13.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:12 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:13.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:12 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-01T06:54:13.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:12 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-01T06:54:13.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:12 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:54:13.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:12 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/2445995868' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:54:13.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:12 smithi083 ceph-mon[43429]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T06:54:13.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:12 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:13.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:12 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:13.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:12 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:13.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:12 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-01T06:54:13.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:12 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-01T06:54:13.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:12 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:54:13.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:12 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/2445995868' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:54:13.060 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:12 smithi153 ceph-mon[48187]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T06:54:13.060 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:12 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:13.060 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:12 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:13.060 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:12 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:13.060 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:12 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-01T06:54:13.060 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:12 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-01T06:54:13.060 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:12 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:54:13.060 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:12 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/2445995868' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:54:13.390 INFO:journalctl@ceph.mds.c.smithi153.stdout:Apr 01 06:54:13 smithi153 systemd[1]: Starting Ceph mds.c for c6f8eff4-eff3-11ee-b647-cb9ed24678a4... 2024-04-01T06:54:13.737 INFO:journalctl@ceph.mds.c.smithi153.stdout:Apr 01 06:54:13 smithi153 ceph-mds[85365]: -- 172.21.15.153:0/3911594808 <== mon.1 v2:172.21.15.153:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55aa0ec381a0 con 0x55aa0ec0ec00 2024-04-01T06:54:13.737 INFO:journalctl@ceph.mds.c.smithi153.stdout:Apr 01 06:54:13 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-c[85342]: starting mds.c at 2024-04-01T06:54:13.737 INFO:journalctl@ceph.mds.c.smithi153.stdout:Apr 01 06:54:13 smithi153 bash[85327]: 34bd58749f25c095f374d801f3bb1332b8f1f02edab79ff9917ebac9d2096700 2024-04-01T06:54:13.737 INFO:journalctl@ceph.mds.c.smithi153.stdout:Apr 01 06:54:13 smithi153 systemd[1]: Started Ceph mds.c for c6f8eff4-eff3-11ee-b647-cb9ed24678a4. 2024-04-01T06:54:14.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:13 smithi145 ceph-mon[47816]: Deploying daemon mds.c on smithi153 2024-04-01T06:54:14.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:13 smithi145 ceph-mon[47816]: mds.? [v2:172.21.15.153:6834/4092629042,v1:172.21.15.153:6835/4092629042] up:boot 2024-04-01T06:54:14.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:13 smithi145 ceph-mon[47816]: fsmap 6 up:standby 2024-04-01T06:54:14.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:13 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-01T06:54:14.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:13 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:14.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:13 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:14.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:13 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:14.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:13 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-01T06:54:14.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:13 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-01T06:54:14.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:13 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:54:14.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:13 smithi083 ceph-mon[43429]: Deploying daemon mds.c on smithi153 2024-04-01T06:54:14.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:13 smithi083 ceph-mon[43429]: mds.? [v2:172.21.15.153:6834/4092629042,v1:172.21.15.153:6835/4092629042] up:boot 2024-04-01T06:54:14.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:13 smithi083 ceph-mon[43429]: fsmap 6 up:standby 2024-04-01T06:54:14.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:13 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-01T06:54:14.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:13 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:14.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:13 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:14.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:13 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:14.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:13 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-01T06:54:14.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:13 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-01T06:54:14.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:13 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:54:14.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:13 smithi153 ceph-mon[48187]: Deploying daemon mds.c on smithi153 2024-04-01T06:54:14.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:13 smithi153 ceph-mon[48187]: mds.? [v2:172.21.15.153:6834/4092629042,v1:172.21.15.153:6835/4092629042] up:boot 2024-04-01T06:54:14.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:13 smithi153 ceph-mon[48187]: fsmap 6 up:standby 2024-04-01T06:54:14.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:13 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-01T06:54:14.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:13 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:14.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:13 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:14.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:13 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:14.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:13 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-01T06:54:14.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:13 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-01T06:54:14.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:13 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:54:14.703 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T06:54:14.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:14.840+0000 7fca0fb47700 1 -- 172.21.15.83:0/3495029623 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca08101700 msgr2=0x7fca08107fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:14.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:14.840+0000 7fca0fb47700 1 --2- 172.21.15.83:0/3495029623 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca08101700 0x7fca08107fb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fca0000b0d0 tx=0x7fca0000b3e0 comp rx=0 tx=0).stop 2024-04-01T06:54:14.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:14.840+0000 7fca0fb47700 1 -- 172.21.15.83:0/3495029623 shutdown_connections 2024-04-01T06:54:14.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:14.840+0000 7fca0fb47700 1 --2- 172.21.15.83:0/3495029623 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca08101700 0x7fca08107fb0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:14.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:14.840+0000 7fca0fb47700 1 --2- 172.21.15.83:0/3495029623 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fca080ffb70 0x7fca080fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:14.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:14.840+0000 7fca0fb47700 1 --2- 172.21.15.83:0/3495029623 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca08100d60 0x7fca081011c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:14.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:14.840+0000 7fca0fb47700 1 -- 172.21.15.83:0/3495029623 >> 172.21.15.83:0/3495029623 conn(0x7fca080fb100 msgr2=0x7fca080fd520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:14.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:14.840+0000 7fca0fb47700 1 -- 172.21.15.83:0/3495029623 shutdown_connections 2024-04-01T06:54:14.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:14.840+0000 7fca0fb47700 1 -- 172.21.15.83:0/3495029623 wait complete. 2024-04-01T06:54:14.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:14.841+0000 7fca0fb47700 1 Processor -- start 2024-04-01T06:54:14.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:14.841+0000 7fca0fb47700 1 -- start start 2024-04-01T06:54:14.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:14.841+0000 7fca0fb47700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca080ffb70 0x7fca08196ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:14.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:14.841+0000 7fca0fb47700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fca08100d60 0x7fca08197220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:14.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:14.841+0000 7fca0fb47700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca08101700 0x7fca0819e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:14.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:14.841+0000 7fca0fb47700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca0819e800 con 0x7fca080ffb70 2024-04-01T06:54:14.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:14.841+0000 7fca0fb47700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca0819e970 con 0x7fca08100d60 2024-04-01T06:54:14.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:14.841+0000 7fca0fb47700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca0819eb30 con 0x7fca08101700 2024-04-01T06:54:14.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:14.841+0000 7fca0d8e3700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca080ffb70 0x7fca08196ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:14.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:14.841+0000 7fca0d8e3700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca080ffb70 0x7fca08196ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37890/0 (socket says 172.21.15.83:37890) 2024-04-01T06:54:14.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:14.841+0000 7fca0d8e3700 1 -- 172.21.15.83:0/3987640633 learned_addr learned my addr 172.21.15.83:0/3987640633 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:54:14.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:14.841+0000 7fca0d0e2700 1 --2- 172.21.15.83:0/3987640633 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fca08100d60 0x7fca08197220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:14.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:14.841+0000 7fca0e0e4700 1 --2- 172.21.15.83:0/3987640633 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca08101700 0x7fca0819e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:14.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:14.841+0000 7fca0d8e3700 1 -- 172.21.15.83:0/3987640633 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca08101700 msgr2=0x7fca0819e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:14.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:14.841+0000 7fca0d8e3700 1 --2- 172.21.15.83:0/3987640633 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca08101700 0x7fca0819e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:14.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:14.841+0000 7fca0d8e3700 1 -- 172.21.15.83:0/3987640633 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fca08100d60 msgr2=0x7fca08197220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:14.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:14.841+0000 7fca0d8e3700 1 --2- 172.21.15.83:0/3987640633 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fca08100d60 0x7fca08197220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:14.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:14.841+0000 7fca0d8e3700 1 -- 172.21.15.83:0/3987640633 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca00009d00 con 0x7fca080ffb70 2024-04-01T06:54:14.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:14.841+0000 7fca0d8e3700 1 --2- 172.21.15.83:0/3987640633 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca080ffb70 0x7fca08196ce0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fca0400e970 tx=0x7fca0400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:14.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:14.842+0000 7fc9faffd700 1 -- 172.21.15.83:0/3987640633 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca04009790 con 0x7fca080ffb70 2024-04-01T06:54:14.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:14.842+0000 7fca0fb47700 1 -- 172.21.15.83:0/3987640633 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca0819ee10 con 0x7fca080ffb70 2024-04-01T06:54:14.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:14.842+0000 7fc9faffd700 1 -- 172.21.15.83:0/3987640633 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fca0400c7e0 con 0x7fca080ffb70 2024-04-01T06:54:14.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:14.842+0000 7fc9faffd700 1 -- 172.21.15.83:0/3987640633 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca04003c70 con 0x7fca080ffb70 2024-04-01T06:54:14.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:14.842+0000 7fca0fb47700 1 -- 172.21.15.83:0/3987640633 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca0819f240 con 0x7fca080ffb70 2024-04-01T06:54:14.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:14.842+0000 7fca0fb47700 1 -- 172.21.15.83:0/3987640633 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca08067e60 con 0x7fca080ffb70 2024-04-01T06:54:14.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:14.844+0000 7fc9faffd700 1 -- 172.21.15.83:0/3987640633 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) v1 ==== 135865+0+0 (secure 0 0 0) 0x7fca0400cc50 con 0x7fca080ffb70 2024-04-01T06:54:14.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:14.844+0000 7fc9faffd700 1 --2- 172.21.15.83:0/3987640633 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fc9f40a1120 0x7fc9f40a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:14.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:14.844+0000 7fc9faffd700 1 -- 172.21.15.83:0/3987640633 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fca04014070 con 0x7fca080ffb70 2024-04-01T06:54:14.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:14.844+0000 7fca0d0e2700 1 --2- 172.21.15.83:0/3987640633 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fc9f40a1120 0x7fc9f40a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:14.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:14.845+0000 7fca0d0e2700 1 --2- 172.21.15.83:0/3987640633 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fc9f40a1120 0x7fc9f40a35e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fca08198190 tx=0x7fc9fc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:14.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:14.849+0000 7fc9faffd700 1 -- 172.21.15.83:0/3987640633 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7fca040963a0 con 0x7fca080ffb70 2024-04-01T06:54:14.939 INFO:journalctl@ceph.mds.h.smithi145.stdout:Apr 01 06:54:14 smithi145 systemd[1]: Starting Ceph mds.h for c6f8eff4-eff3-11ee-b647-cb9ed24678a4... 2024-04-01T06:54:14.940 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:14 smithi145 ceph-mon[47816]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T06:54:14.940 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:14 smithi145 ceph-mon[47816]: Deploying daemon mds.h on smithi145 2024-04-01T06:54:14.940 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:14 smithi145 ceph-mon[47816]: mds.? [v2:172.21.15.153:6836/1993816527,v1:172.21.15.153:6837/1993816527] up:boot 2024-04-01T06:54:14.940 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:14 smithi145 ceph-mon[47816]: fsmap 7 up:standby 2024-04-01T06:54:14.940 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:14 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-01T06:54:15.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:14 smithi083 ceph-mon[43429]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T06:54:15.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:14 smithi083 ceph-mon[43429]: Deploying daemon mds.h on smithi145 2024-04-01T06:54:15.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:14 smithi083 ceph-mon[43429]: mds.? [v2:172.21.15.153:6836/1993816527,v1:172.21.15.153:6837/1993816527] up:boot 2024-04-01T06:54:15.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:14 smithi083 ceph-mon[43429]: fsmap 7 up:standby 2024-04-01T06:54:15.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:14 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-01T06:54:15.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:15.089+0000 7fca0fb47700 1 -- 172.21.15.83:0/3987640633 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fca0810b3e0 con 0x7fca080ffb70 2024-04-01T06:54:15.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:15.090+0000 7fc9faffd700 1 -- 172.21.15.83:0/3987640633 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+5811 (secure 0 0 0) 0x7fca04003dd0 con 0x7fca080ffb70 2024-04-01T06:54:15.090 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:54:15.090 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1271130478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1271130478},{"type":"v1","addr":"172.21.15.83:6835","nonce":1271130478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2412682983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2412682983},{"type":"v1","addr":"172.21.15.83:6837","nonce":2412682983}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2467459028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2467459028},{"type":"v1","addr":"172.21.15.153:6833","nonce":2467459028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24448,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4092629042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":4092629042},{"type":"v1","addr":"172.21.15.153:6835","nonce":4092629042}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24449,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/647005844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":647005844},{"type":"v1","addr":"172.21.15.145:6833","nonce":647005844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24454,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/1993816527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1993816527},{"type":"v1","addr":"172.21.15.153:6837","nonce":1993816527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/3104241497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":3104241497},{"type":"v1","addr":"172.21.15.145:6835","nonce":3104241497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[]} 2024-04-01T06:54:15.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:15.093+0000 7fca0fb47700 1 -- 172.21.15.83:0/3987640633 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fc9f40a1120 msgr2=0x7fc9f40a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:15.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:15.093+0000 7fca0fb47700 1 --2- 172.21.15.83:0/3987640633 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fc9f40a1120 0x7fc9f40a35e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fca08198190 tx=0x7fc9fc009260 comp rx=0 tx=0).stop 2024-04-01T06:54:15.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:15.093+0000 7fca0fb47700 1 -- 172.21.15.83:0/3987640633 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca080ffb70 msgr2=0x7fca08196ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:15.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:15.093+0000 7fca0fb47700 1 --2- 172.21.15.83:0/3987640633 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca080ffb70 0x7fca08196ce0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fca0400e970 tx=0x7fca0400ec80 comp rx=0 tx=0).stop 2024-04-01T06:54:15.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:15.093+0000 7fca0fb47700 1 -- 172.21.15.83:0/3987640633 shutdown_connections 2024-04-01T06:54:15.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:15.093+0000 7fca0fb47700 1 --2- 172.21.15.83:0/3987640633 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca080ffb70 0x7fca08196ce0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:15.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:15.093+0000 7fca0fb47700 1 --2- 172.21.15.83:0/3987640633 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fc9f40a1120 0x7fc9f40a35e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:15.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:15.093+0000 7fca0fb47700 1 --2- 172.21.15.83:0/3987640633 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca08101700 0x7fca0819e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:15.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:15.093+0000 7fca0fb47700 1 --2- 172.21.15.83:0/3987640633 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fca08100d60 0x7fca08197220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:15.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:15.093+0000 7fca0fb47700 1 -- 172.21.15.83:0/3987640633 >> 172.21.15.83:0/3987640633 conn(0x7fca080fb100 msgr2=0x7fca080691d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:15.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:15.093+0000 7fca0fb47700 1 -- 172.21.15.83:0/3987640633 shutdown_connections 2024-04-01T06:54:15.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:15.093+0000 7fca0fb47700 1 -- 172.21.15.83:0/3987640633 wait complete. 2024-04-01T06:54:15.093 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 8 2024-04-01T06:54:15.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:14 smithi153 ceph-mon[48187]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T06:54:15.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:14 smithi153 ceph-mon[48187]: Deploying daemon mds.h on smithi145 2024-04-01T06:54:15.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:14 smithi153 ceph-mon[48187]: mds.? [v2:172.21.15.153:6836/1993816527,v1:172.21.15.153:6837/1993816527] up:boot 2024-04-01T06:54:15.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:14 smithi153 ceph-mon[48187]: fsmap 7 up:standby 2024-04-01T06:54:15.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:14 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-01T06:54:15.751 INFO:journalctl@ceph.mds.h.smithi145.stdout:Apr 01 06:54:15 smithi145 ceph-mds[84227]: -- 172.21.15.145:0/1005822868 <== mon.2 v2:172.21.15.145:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d43a8d41a0 con 0x55d43a8ab000 2024-04-01T06:54:15.751 INFO:journalctl@ceph.mds.h.smithi145.stdout:Apr 01 06:54:15 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-h[84203]: starting mds.h at 2024-04-01T06:54:15.751 INFO:journalctl@ceph.mds.h.smithi145.stdout:Apr 01 06:54:15 smithi145 bash[84188]: 23b1fc00c7c55684f39425b82f320d1cc904173845591f2a7c2239f068d4b4c1 2024-04-01T06:54:15.752 INFO:journalctl@ceph.mds.h.smithi145.stdout:Apr 01 06:54:15 smithi145 systemd[1]: Started Ceph mds.h for c6f8eff4-eff3-11ee-b647-cb9ed24678a4. 2024-04-01T06:54:16.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:15 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/3987640633' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:54:16.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:15 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:16.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:15 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:16.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:15 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:16.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:15 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-01T06:54:16.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:15 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-01T06:54:16.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:15 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:54:16.005 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:15 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/3987640633' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:54:16.005 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:15 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:16.005 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:15 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:16.005 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:15 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:16.005 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:15 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-01T06:54:16.005 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:15 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-01T06:54:16.006 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:15 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:54:16.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:15 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/3987640633' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:54:16.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:15 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:16.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:15 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:16.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:15 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:16.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:15 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-01T06:54:16.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:15 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-01T06:54:16.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:15 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:54:16.891 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:54:16 smithi153 systemd[1]: Starting Ceph mds.i for c6f8eff4-eff3-11ee-b647-cb9ed24678a4... 2024-04-01T06:54:16.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:16 smithi153 ceph-mon[48187]: Deploying daemon mds.i on smithi153 2024-04-01T06:54:16.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:16 smithi153 ceph-mon[48187]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T06:54:16.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:16 smithi153 ceph-mon[48187]: mds.? [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] up:boot 2024-04-01T06:54:16.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:16 smithi153 ceph-mon[48187]: fsmap 8 up:standby 2024-04-01T06:54:16.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:16 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-01T06:54:17.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:16 smithi083 ceph-mon[43429]: Deploying daemon mds.i on smithi153 2024-04-01T06:54:17.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:16 smithi083 ceph-mon[43429]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T06:54:17.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:16 smithi083 ceph-mon[43429]: mds.? [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] up:boot 2024-04-01T06:54:17.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:16 smithi083 ceph-mon[43429]: fsmap 8 up:standby 2024-04-01T06:54:17.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:16 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-01T06:54:17.105 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T06:54:17.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:17.245+0000 7f191c52e700 1 -- 172.21.15.83:0/3763086833 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1914104040 msgr2=0x7f1914106430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:17.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:17.245+0000 7f191c52e700 1 --2- 172.21.15.83:0/3763086833 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1914104040 0x7f1914106430 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1904009990 tx=0x7f1904009ca0 comp rx=0 tx=0).stop 2024-04-01T06:54:17.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:17.245+0000 7f191c52e700 1 -- 172.21.15.83:0/3763086833 shutdown_connections 2024-04-01T06:54:17.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:17.245+0000 7f191c52e700 1 --2- 172.21.15.83:0/3763086833 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1914106970 0x7f1914108de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:17.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:17.245+0000 7f191c52e700 1 --2- 172.21.15.83:0/3763086833 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1914101710 0x7f1914103b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:17.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:17.245+0000 7f191c52e700 1 --2- 172.21.15.83:0/3763086833 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1914104040 0x7f1914106430 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:17.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:17.245+0000 7f191c52e700 1 -- 172.21.15.83:0/3763086833 >> 172.21.15.83:0/3763086833 conn(0x7f19140fb100 msgr2=0x7f19140fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:17.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:17.245+0000 7f191c52e700 1 -- 172.21.15.83:0/3763086833 shutdown_connections 2024-04-01T06:54:17.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:17.245+0000 7f191c52e700 1 -- 172.21.15.83:0/3763086833 wait complete. 2024-04-01T06:54:17.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:17.246+0000 7f191c52e700 1 Processor -- start 2024-04-01T06:54:17.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:17.246+0000 7f191c52e700 1 -- start start 2024-04-01T06:54:17.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:17.246+0000 7f191c52e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1914101710 0x7f1914196ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:17.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:17.246+0000 7f191c52e700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1914104040 0x7f19141970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:17.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:17.246+0000 7f191c52e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1914106970 0x7f191419e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:17.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:17.246+0000 7f191c52e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f191419e6d0 con 0x7f1914106970 2024-04-01T06:54:17.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:17.246+0000 7f191c52e700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f191419e810 con 0x7f1914104040 2024-04-01T06:54:17.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:17.246+0000 7f191c52e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f191419e9a0 con 0x7f1914101710 2024-04-01T06:54:17.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:17.246+0000 7f191aacb700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1914106970 0x7f191419e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:17.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:17.246+0000 7f191aacb700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1914106970 0x7f191419e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37898/0 (socket says 172.21.15.83:37898) 2024-04-01T06:54:17.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:17.246+0000 7f191aacb700 1 -- 172.21.15.83:0/3929011032 learned_addr learned my addr 172.21.15.83:0/3929011032 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:54:17.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:17.246+0000 7f191a2ca700 1 --2- 172.21.15.83:0/3929011032 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1914101710 0x7f1914196ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:17.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:17.246+0000 7f1919ac9700 1 --2- 172.21.15.83:0/3929011032 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1914104040 0x7f19141970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:17.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:17.247+0000 7f191aacb700 1 -- 172.21.15.83:0/3929011032 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1914101710 msgr2=0x7f1914196ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:17.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:17.247+0000 7f191aacb700 1 --2- 172.21.15.83:0/3929011032 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1914101710 0x7f1914196ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:17.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:17.247+0000 7f191aacb700 1 -- 172.21.15.83:0/3929011032 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1914104040 msgr2=0x7f19141970e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:17.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:17.247+0000 7f191aacb700 1 --2- 172.21.15.83:0/3929011032 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1914104040 0x7f19141970e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:17.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:17.247+0000 7f191aacb700 1 -- 172.21.15.83:0/3929011032 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19040095f0 con 0x7f1914106970 2024-04-01T06:54:17.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:17.247+0000 7f191aacb700 1 --2- 172.21.15.83:0/3929011032 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1914106970 0x7f191419e100 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f190c007ee0 tx=0x7f190c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:17.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:17.247+0000 7f190b7fe700 1 -- 172.21.15.83:0/3929011032 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190c017070 con 0x7f1914106970 2024-04-01T06:54:17.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:17.247+0000 7f190b7fe700 1 -- 172.21.15.83:0/3929011032 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f190c00f040 con 0x7f1914106970 2024-04-01T06:54:17.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:17.247+0000 7f191c52e700 1 -- 172.21.15.83:0/3929011032 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f191419ec80 con 0x7f1914106970 2024-04-01T06:54:17.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:17.247+0000 7f190b7fe700 1 -- 172.21.15.83:0/3929011032 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190c005740 con 0x7f1914106970 2024-04-01T06:54:17.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:17.247+0000 7f191c52e700 1 -- 172.21.15.83:0/3929011032 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f191419f140 con 0x7f1914106970 2024-04-01T06:54:17.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:17.248+0000 7f191c52e700 1 -- 172.21.15.83:0/3929011032 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19140fcc80 con 0x7f1914106970 2024-04-01T06:54:17.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:17.249+0000 7f190b7fe700 1 -- 172.21.15.83:0/3929011032 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) v1 ==== 135865+0+0 (secure 0 0 0) 0x7f190c00dc60 con 0x7f1914106970 2024-04-01T06:54:17.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:17.250+0000 7f190b7fe700 1 --2- 172.21.15.83:0/3929011032 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f19000a1120 0x7f19000a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:17.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:17.250+0000 7f191a2ca700 1 --2- 172.21.15.83:0/3929011032 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f19000a1120 0x7f19000a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:17.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:17.250+0000 7f190b7fe700 1 -- 172.21.15.83:0/3929011032 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f190c0cc260 con 0x7f1914106970 2024-04-01T06:54:17.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:17.250+0000 7f191a2ca700 1 --2- 172.21.15.83:0/3929011032 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f19000a1120 0x7f19000a35e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1910005950 tx=0x7f191000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:17.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:16 smithi145 ceph-mon[47816]: Deploying daemon mds.i on smithi153 2024-04-01T06:54:17.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:16 smithi145 ceph-mon[47816]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T06:54:17.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:16 smithi145 ceph-mon[47816]: mds.? [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] up:boot 2024-04-01T06:54:17.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:16 smithi145 ceph-mon[47816]: fsmap 8 up:standby 2024-04-01T06:54:17.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:16 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-01T06:54:17.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:17.254+0000 7f190b7fe700 1 -- 172.21.15.83:0/3929011032 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f190c095e90 con 0x7f1914106970 2024-04-01T06:54:17.390 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:54:17 smithi153 ceph-mds[85718]: -- 172.21.15.153:0/1195022014 <== mon.1 v2:172.21.15.153:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d1aeaba1a0 con 0x55d1aea90c00 2024-04-01T06:54:17.391 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:54:17 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[85695]: starting mds.i at 2024-04-01T06:54:17.391 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:54:17 smithi153 bash[85680]: ccf1fbb6cf8e70ac9f78f934d3bf62112117d0aa3d06b586cd290439127065ea 2024-04-01T06:54:17.391 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:54:17 smithi153 systemd[1]: Started Ceph mds.i for c6f8eff4-eff3-11ee-b647-cb9ed24678a4. 2024-04-01T06:54:17.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:17.514+0000 7f191c52e700 1 -- 172.21.15.83:0/3929011032 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1914067180 con 0x7f1914106970 2024-04-01T06:54:17.515 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:17.515+0000 7f190b7fe700 1 -- 172.21.15.83:0/3929011032 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6571 (secure 0 0 0) 0x7f190c0994b0 con 0x7f1914106970 2024-04-01T06:54:17.515 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:54:17.515 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1271130478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1271130478},{"type":"v1","addr":"172.21.15.83:6835","nonce":1271130478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2412682983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2412682983},{"type":"v1","addr":"172.21.15.83:6837","nonce":2412682983}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2467459028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2467459028},{"type":"v1","addr":"172.21.15.153:6833","nonce":2467459028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24448,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4092629042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":4092629042},{"type":"v1","addr":"172.21.15.153:6835","nonce":4092629042}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24449,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/647005844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":647005844},{"type":"v1","addr":"172.21.15.145:6833","nonce":647005844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24454,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/1993816527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1993816527},{"type":"v1","addr":"172.21.15.153:6837","nonce":1993816527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/3104241497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":3104241497},{"type":"v1","addr":"172.21.15.145:6835","nonce":3104241497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24494,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2687798317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2687798317},{"type":"v1","addr":"172.21.15.145:6837","nonce":2687798317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[]} 2024-04-01T06:54:17.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:17.517+0000 7f191c52e700 1 -- 172.21.15.83:0/3929011032 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f19000a1120 msgr2=0x7f19000a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:17.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:17.517+0000 7f191c52e700 1 --2- 172.21.15.83:0/3929011032 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f19000a1120 0x7f19000a35e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1910005950 tx=0x7f191000b410 comp rx=0 tx=0).stop 2024-04-01T06:54:17.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:17.517+0000 7f191c52e700 1 -- 172.21.15.83:0/3929011032 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1914106970 msgr2=0x7f191419e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:17.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:17.517+0000 7f191c52e700 1 --2- 172.21.15.83:0/3929011032 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1914106970 0x7f191419e100 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f190c007ee0 tx=0x7f190c00d3b0 comp rx=0 tx=0).stop 2024-04-01T06:54:17.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:17.517+0000 7f191c52e700 1 -- 172.21.15.83:0/3929011032 shutdown_connections 2024-04-01T06:54:17.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:17.517+0000 7f191c52e700 1 --2- 172.21.15.83:0/3929011032 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1914106970 0x7f191419e100 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:17.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:17.517+0000 7f191c52e700 1 --2- 172.21.15.83:0/3929011032 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f19000a1120 0x7f19000a35e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:17.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:17.517+0000 7f191c52e700 1 --2- 172.21.15.83:0/3929011032 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1914101710 0x7f1914196ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:17.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:17.517+0000 7f191c52e700 1 --2- 172.21.15.83:0/3929011032 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1914104040 0x7f19141970e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:17.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:17.517+0000 7f191c52e700 1 -- 172.21.15.83:0/3929011032 >> 172.21.15.83:0/3929011032 conn(0x7f19140fb100 msgr2=0x7f19141035b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:17.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:17.517+0000 7f191c52e700 1 -- 172.21.15.83:0/3929011032 shutdown_connections 2024-04-01T06:54:17.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:17.517+0000 7f191c52e700 1 -- 172.21.15.83:0/3929011032 wait complete. 2024-04-01T06:54:17.518 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 9 2024-04-01T06:54:18.232 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:18 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:18.233 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:18 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:18.233 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:18 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:18.233 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:18 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-01T06:54:18.233 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:18 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-01T06:54:18.233 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:18 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:54:18.233 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:18 smithi083 ceph-mon[43429]: Deploying daemon mds.g on smithi083 2024-04-01T06:54:18.233 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:18 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/3929011032' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:54:18.233 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:18 smithi083 ceph-mon[43429]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T06:54:18.233 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:18 smithi083 ceph-mon[43429]: mds.? [v2:172.21.15.153:6838/1399754640,v1:172.21.15.153:6839/1399754640] up:boot 2024-04-01T06:54:18.233 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:18 smithi083 ceph-mon[43429]: fsmap 9 up:standby 2024-04-01T06:54:18.233 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:18 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-01T06:54:18.502 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:18 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:18.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:18 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:18.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:18 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:18.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:18 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-01T06:54:18.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:18 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-01T06:54:18.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:18 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:54:18.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:18 smithi145 ceph-mon[47816]: Deploying daemon mds.g on smithi083 2024-04-01T06:54:18.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:18 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/3929011032' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:54:18.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:18 smithi145 ceph-mon[47816]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T06:54:18.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:18 smithi145 ceph-mon[47816]: mds.? [v2:172.21.15.153:6838/1399754640,v1:172.21.15.153:6839/1399754640] up:boot 2024-04-01T06:54:18.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:18 smithi145 ceph-mon[47816]: fsmap 9 up:standby 2024-04-01T06:54:18.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:18 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-01T06:54:18.512 INFO:journalctl@ceph.mds.g.smithi083.stdout:Apr 01 06:54:18 smithi083 systemd[1]: Starting Ceph mds.g for c6f8eff4-eff3-11ee-b647-cb9ed24678a4... 2024-04-01T06:54:18.640 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:18 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:18.641 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:18 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:18.641 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:18 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:18.641 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:18 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-01T06:54:18.641 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:18 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-01T06:54:18.641 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:18 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:54:18.641 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:18 smithi153 ceph-mon[48187]: Deploying daemon mds.g on smithi083 2024-04-01T06:54:18.641 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:18 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/3929011032' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:54:18.641 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:18 smithi153 ceph-mon[48187]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T06:54:18.641 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:18 smithi153 ceph-mon[48187]: mds.? [v2:172.21.15.153:6838/1399754640,v1:172.21.15.153:6839/1399754640] up:boot 2024-04-01T06:54:18.641 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:18 smithi153 ceph-mon[48187]: fsmap 9 up:standby 2024-04-01T06:54:18.642 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:18 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-01T06:54:19.262 INFO:journalctl@ceph.mds.g.smithi083.stdout:Apr 01 06:54:18 smithi083 ceph-mds[95050]: -- 172.21.15.83:0/1742808808 <== mon.0 v2:172.21.15.83:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f6908401a0 con 0x55f690816c00 2024-04-01T06:54:19.262 INFO:journalctl@ceph.mds.g.smithi083.stdout:Apr 01 06:54:18 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-g[95027]: starting mds.g at 2024-04-01T06:54:19.262 INFO:journalctl@ceph.mds.g.smithi083.stdout:Apr 01 06:54:18 smithi083 bash[95012]: 3e3b816b340a8e4a20d45c4c6555d85d716f181bc334182e6eaef2a7cf395c36 2024-04-01T06:54:19.263 INFO:journalctl@ceph.mds.g.smithi083.stdout:Apr 01 06:54:18 smithi083 systemd[1]: Started Ceph mds.g for c6f8eff4-eff3-11ee-b647-cb9ed24678a4. 2024-04-01T06:54:19.531 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T06:54:19.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:19.662+0000 7fe5de747700 1 -- 172.21.15.83:0/1857852232 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5d81016f0 msgr2=0x7fe5d8103ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:19.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:19.662+0000 7fe5de747700 1 --2- 172.21.15.83:0/1857852232 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5d81016f0 0x7fe5d8103ae0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8009990 tx=0x7fe5c8009ca0 comp rx=0 tx=0).stop 2024-04-01T06:54:19.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:19.662+0000 7fe5de747700 1 -- 172.21.15.83:0/1857852232 shutdown_connections 2024-04-01T06:54:19.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:19.662+0000 7fe5de747700 1 --2- 172.21.15.83:0/1857852232 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5d81016f0 0x7fe5d8103ae0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:19.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:19.662+0000 7fe5de747700 1 --2- 172.21.15.83:0/1857852232 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe5d8106950 0x7fe5d8108dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:19.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:19.662+0000 7fe5de747700 1 --2- 172.21.15.83:0/1857852232 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5d8104020 0x7fe5d8106410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:19.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:19.662+0000 7fe5de747700 1 -- 172.21.15.83:0/1857852232 >> 172.21.15.83:0/1857852232 conn(0x7fe5d80fb100 msgr2=0x7fe5d80fd520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:19.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:19.662+0000 7fe5de747700 1 -- 172.21.15.83:0/1857852232 shutdown_connections 2024-04-01T06:54:19.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:19.662+0000 7fe5de747700 1 -- 172.21.15.83:0/1857852232 wait complete. 2024-04-01T06:54:19.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:19.663+0000 7fe5de747700 1 Processor -- start 2024-04-01T06:54:19.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:19.663+0000 7fe5de747700 1 -- start start 2024-04-01T06:54:19.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:19.663+0000 7fe5de747700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5d81016f0 0x7fe5d8196bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:19.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:19.663+0000 7fe5de747700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5d8104020 0x7fe5d8197100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:19.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:19.663+0000 7fe5de747700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe5d8106950 0x7fe5d819e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:19.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:19.663+0000 7fe5de747700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d819e6f0 con 0x7fe5d8104020 2024-04-01T06:54:19.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:19.663+0000 7fe5de747700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d819e830 con 0x7fe5d8106950 2024-04-01T06:54:19.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:19.663+0000 7fe5de747700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d819e9c0 con 0x7fe5d81016f0 2024-04-01T06:54:19.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:19.664+0000 7fe5dcce4700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe5d8106950 0x7fe5d819e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:19.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:19.664+0000 7fe5d7fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5d81016f0 0x7fe5d8196bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:19.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:19.664+0000 7fe5dcce4700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe5d8106950 0x7fe5d819e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.83:40512/0 (socket says 172.21.15.83:40512) 2024-04-01T06:54:19.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:19.664+0000 7fe5dcce4700 1 -- 172.21.15.83:0/2328528666 learned_addr learned my addr 172.21.15.83:0/2328528666 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:54:19.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:19.664+0000 7fe5d77fe700 1 --2- 172.21.15.83:0/2328528666 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5d8104020 0x7fe5d8197100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:19.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:19.664+0000 7fe5dcce4700 1 -- 172.21.15.83:0/2328528666 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5d81016f0 msgr2=0x7fe5d8196bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:19.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:19.664+0000 7fe5dcce4700 1 --2- 172.21.15.83:0/2328528666 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5d81016f0 0x7fe5d8196bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:19.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:19.664+0000 7fe5dcce4700 1 -- 172.21.15.83:0/2328528666 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5d8104020 msgr2=0x7fe5d8197100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:19.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:19.664+0000 7fe5dcce4700 1 --2- 172.21.15.83:0/2328528666 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5d8104020 0x7fe5d8197100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:19.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:19.664+0000 7fe5dcce4700 1 -- 172.21.15.83:0/2328528666 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c80095f0 con 0x7fe5d8106950 2024-04-01T06:54:19.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:19.664+0000 7fe5d77fe700 1 --2- 172.21.15.83:0/2328528666 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5d8104020 0x7fe5d8197100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T06:54:19.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:19.664+0000 7fe5dcce4700 1 --2- 172.21.15.83:0/2328528666 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe5d8106950 0x7fe5d819e120 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe5d0007d70 tx=0x7fe5d000a340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:19.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:19.664+0000 7fe5d57fa700 1 -- 172.21.15.83:0/2328528666 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d000ac90 con 0x7fe5d8106950 2024-04-01T06:54:19.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:19.664+0000 7fe5d57fa700 1 -- 172.21.15.83:0/2328528666 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe5d000adf0 con 0x7fe5d8106950 2024-04-01T06:54:19.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:19.664+0000 7fe5de747700 1 -- 172.21.15.83:0/2328528666 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5d819eca0 con 0x7fe5d8106950 2024-04-01T06:54:19.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:19.664+0000 7fe5d57fa700 1 -- 172.21.15.83:0/2328528666 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d00115e0 con 0x7fe5d8106950 2024-04-01T06:54:19.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:19.665+0000 7fe5de747700 1 -- 172.21.15.83:0/2328528666 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5d819f160 con 0x7fe5d8106950 2024-04-01T06:54:19.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:19.665+0000 7fe5de747700 1 -- 172.21.15.83:0/2328528666 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5d80fcc80 con 0x7fe5d8106950 2024-04-01T06:54:19.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:19.667+0000 7fe5d57fa700 1 -- 172.21.15.83:0/2328528666 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 16) v1 ==== 135865+0+0 (secure 0 0 0) 0x7fe5d0004ad0 con 0x7fe5d8106950 2024-04-01T06:54:19.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:19.667+0000 7fe5d57fa700 1 --2- 172.21.15.83:0/2328528666 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fe5c40a1120 0x7fe5c40a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:19.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:19.668+0000 7fe5d57fa700 1 -- 172.21.15.83:0/2328528666 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fe5d00cca90 con 0x7fe5d8106950 2024-04-01T06:54:19.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:19.668+0000 7fe5d7fff700 1 --2- 172.21.15.83:0/2328528666 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fe5c40a1120 0x7fe5c40a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:19.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:19.668+0000 7fe5d7fff700 1 --2- 172.21.15.83:0/2328528666 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fe5c40a1120 0x7fe5c40a35e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe5c800b5c0 tx=0x7fe5c8003790 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:19.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:19.671+0000 7fe5d57fa700 1 -- 172.21.15.83:0/2328528666 <== mon.2 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7fe5d0096620 con 0x7fe5d8106950 2024-04-01T06:54:19.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:19.923+0000 7fe5de747700 1 -- 172.21.15.83:0/2328528666 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe5d8067180 con 0x7fe5d8106950 2024-04-01T06:54:19.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:19.924+0000 7fe5d57fa700 1 -- 172.21.15.83:0/2328528666 <== mon.2 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+8091 (secure 0 0 0) 0x7fe5d0099c40 con 0x7fe5d8106950 2024-04-01T06:54:19.924 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:54:19.924 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1271130478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1271130478},{"type":"v1","addr":"172.21.15.83:6835","nonce":1271130478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2412682983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2412682983},{"type":"v1","addr":"172.21.15.83:6837","nonce":2412682983}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6839/3348145990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":3348145990},{"type":"v1","addr":"172.21.15.83:6839","nonce":3348145990}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2467459028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2467459028},{"type":"v1","addr":"172.21.15.153:6833","nonce":2467459028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24448,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4092629042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":4092629042},{"type":"v1","addr":"172.21.15.153:6835","nonce":4092629042}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24449,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/647005844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":647005844},{"type":"v1","addr":"172.21.15.145:6833","nonce":647005844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24454,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/1993816527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1993816527},{"type":"v1","addr":"172.21.15.153:6837","nonce":1993816527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24472,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6839/1399754640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1399754640},{"type":"v1","addr":"172.21.15.153:6839","nonce":1399754640}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/3104241497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":3104241497},{"type":"v1","addr":"172.21.15.145:6835","nonce":3104241497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24494,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2687798317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2687798317},{"type":"v1","addr":"172.21.15.145:6837","nonce":2687798317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[]} 2024-04-01T06:54:19.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:19.926+0000 7fe5de747700 1 -- 172.21.15.83:0/2328528666 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fe5c40a1120 msgr2=0x7fe5c40a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:19.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:19.926+0000 7fe5de747700 1 --2- 172.21.15.83:0/2328528666 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fe5c40a1120 0x7fe5c40a35e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe5c800b5c0 tx=0x7fe5c8003790 comp rx=0 tx=0).stop 2024-04-01T06:54:19.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:19.926+0000 7fe5de747700 1 -- 172.21.15.83:0/2328528666 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe5d8106950 msgr2=0x7fe5d819e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:19.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:19.926+0000 7fe5de747700 1 --2- 172.21.15.83:0/2328528666 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe5d8106950 0x7fe5d819e120 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe5d0007d70 tx=0x7fe5d000a340 comp rx=0 tx=0).stop 2024-04-01T06:54:19.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:19.926+0000 7fe5de747700 1 -- 172.21.15.83:0/2328528666 shutdown_connections 2024-04-01T06:54:19.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:19.926+0000 7fe5de747700 1 --2- 172.21.15.83:0/2328528666 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fe5c40a1120 0x7fe5c40a35e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:19.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:19.926+0000 7fe5de747700 1 --2- 172.21.15.83:0/2328528666 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe5d8106950 0x7fe5d819e120 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:19.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:19.926+0000 7fe5de747700 1 --2- 172.21.15.83:0/2328528666 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5d81016f0 0x7fe5d8196bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:19.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:19.926+0000 7fe5de747700 1 --2- 172.21.15.83:0/2328528666 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5d8104020 0x7fe5d8197100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:19.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:19.926+0000 7fe5de747700 1 -- 172.21.15.83:0/2328528666 >> 172.21.15.83:0/2328528666 conn(0x7fe5d80fb100 msgr2=0x7fe5d8102030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:19.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:19.926+0000 7fe5de747700 1 -- 172.21.15.83:0/2328528666 shutdown_connections 2024-04-01T06:54:19.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:19.926+0000 7fe5de747700 1 -- 172.21.15.83:0/2328528666 wait complete. 2024-04-01T06:54:19.927 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 11 2024-04-01T06:54:20.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:19 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:20.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:19 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:20.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:19 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:20.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:19 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-01T06:54:20.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:19 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-01T06:54:20.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:19 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:54:20.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:19 smithi083 ceph-mon[43429]: mds.? [v2:172.21.15.83:6838/3348145990,v1:172.21.15.83:6839/3348145990] up:boot 2024-04-01T06:54:20.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:19 smithi083 ceph-mon[43429]: fsmap 10 up:standby 2024-04-01T06:54:20.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:19 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-01T06:54:20.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:19 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/2328528666' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:54:20.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:19 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:20.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:19 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:20.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:19 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:20.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:19 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-01T06:54:20.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:19 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-01T06:54:20.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:19 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:54:20.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:19 smithi145 ceph-mon[47816]: mds.? [v2:172.21.15.83:6838/3348145990,v1:172.21.15.83:6839/3348145990] up:boot 2024-04-01T06:54:20.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:19 smithi145 ceph-mon[47816]: fsmap 10 up:standby 2024-04-01T06:54:20.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:19 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-01T06:54:20.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:19 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/2328528666' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:54:20.303 INFO:journalctl@ceph.mds.a.smithi083.stdout:Apr 01 06:54:20 smithi083 systemd[1]: Starting Ceph mds.a for c6f8eff4-eff3-11ee-b647-cb9ed24678a4... 2024-04-01T06:54:20.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:19 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:20.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:19 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:20.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:19 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:20.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:19 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-01T06:54:20.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:19 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-01T06:54:20.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:19 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:54:20.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:19 smithi153 ceph-mon[48187]: mds.? [v2:172.21.15.83:6838/3348145990,v1:172.21.15.83:6839/3348145990] up:boot 2024-04-01T06:54:20.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:19 smithi153 ceph-mon[48187]: fsmap 10 up:standby 2024-04-01T06:54:20.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:19 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-01T06:54:20.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:19 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/2328528666' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:54:20.953 INFO:journalctl@ceph.mds.a.smithi083.stdout:Apr 01 06:54:20 smithi083 ceph-mds[95435]: -- 172.21.15.83:0/2558936151 <== mon.0 v2:172.21.15.83:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x557ebb0a21a0 con 0x557ebb079000 2024-04-01T06:54:20.954 INFO:journalctl@ceph.mds.a.smithi083.stdout:Apr 01 06:54:20 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-a[95412]: starting mds.a at 2024-04-01T06:54:20.954 INFO:journalctl@ceph.mds.a.smithi083.stdout:Apr 01 06:54:20 smithi083 bash[95397]: d5dbb3fbf88be2e99879138be8e04fa15d7577a4d3dc5a88aed4e9337b1e1aa3 2024-04-01T06:54:20.954 INFO:journalctl@ceph.mds.a.smithi083.stdout:Apr 01 06:54:20 smithi083 systemd[1]: Started Ceph mds.a for c6f8eff4-eff3-11ee-b647-cb9ed24678a4. 2024-04-01T06:54:21.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:20 smithi145 ceph-mon[47816]: Deploying daemon mds.a on smithi083 2024-04-01T06:54:21.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:20 smithi145 ceph-mon[47816]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T06:54:21.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:20 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:21.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:20 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:21.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:20 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:21.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:20 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-01T06:54:21.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:20 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-01T06:54:21.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:20 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:54:21.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:20 smithi083 ceph-mon[43429]: Deploying daemon mds.a on smithi083 2024-04-01T06:54:21.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:20 smithi083 ceph-mon[43429]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T06:54:21.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:20 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:21.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:20 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:21.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:20 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:21.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:20 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-01T06:54:21.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:20 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-01T06:54:21.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:20 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:54:21.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:20 smithi153 ceph-mon[48187]: Deploying daemon mds.a on smithi083 2024-04-01T06:54:21.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:20 smithi153 ceph-mon[48187]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T06:54:21.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:20 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:21.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:20 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:21.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:20 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:21.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:20 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-01T06:54:21.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:20 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-01T06:54:21.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:20 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:54:21.940 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T06:54:22.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:22.080+0000 7efd7f907700 1 -- 172.21.15.83:0/876598703 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd78104020 msgr2=0x7efd78106410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:22.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:22.080+0000 7efd7f907700 1 --2- 172.21.15.83:0/876598703 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd78104020 0x7efd78106410 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7efd68009990 tx=0x7efd68009ca0 comp rx=0 tx=0).stop 2024-04-01T06:54:22.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:22.080+0000 7efd7f907700 1 -- 172.21.15.83:0/876598703 shutdown_connections 2024-04-01T06:54:22.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:22.080+0000 7efd7f907700 1 --2- 172.21.15.83:0/876598703 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efd78106950 0x7efd78108dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:22.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:22.080+0000 7efd7f907700 1 --2- 172.21.15.83:0/876598703 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd781016f0 0x7efd78103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:22.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:22.080+0000 7efd7f907700 1 --2- 172.21.15.83:0/876598703 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd78104020 0x7efd78106410 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:22.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:22.080+0000 7efd7f907700 1 -- 172.21.15.83:0/876598703 >> 172.21.15.83:0/876598703 conn(0x7efd780fb100 msgr2=0x7efd780fd520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:22.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:22.080+0000 7efd7f907700 1 -- 172.21.15.83:0/876598703 shutdown_connections 2024-04-01T06:54:22.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:22.080+0000 7efd7f907700 1 -- 172.21.15.83:0/876598703 wait complete. 2024-04-01T06:54:22.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:22.081+0000 7efd7f907700 1 Processor -- start 2024-04-01T06:54:22.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:22.081+0000 7efd7f907700 1 -- start start 2024-04-01T06:54:22.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:22.081+0000 7efd7f907700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd781016f0 0x7efd78198e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:22.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:22.081+0000 7efd7f907700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd78104020 0x7efd78199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:22.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:22.081+0000 7efd7f907700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efd78106950 0x7efd781a0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:22.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:22.081+0000 7efd7f907700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd781a0930 con 0x7efd78104020 2024-04-01T06:54:22.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:22.081+0000 7efd7f907700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd781a0a70 con 0x7efd78106950 2024-04-01T06:54:22.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:22.081+0000 7efd7f907700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd781a0c00 con 0x7efd781016f0 2024-04-01T06:54:22.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:22.081+0000 7efd7cea2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd78104020 0x7efd78199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:22.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:22.081+0000 7efd7cea2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd78104020 0x7efd78199340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37966/0 (socket says 172.21.15.83:37966) 2024-04-01T06:54:22.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:22.081+0000 7efd7cea2700 1 -- 172.21.15.83:0/4042490452 learned_addr learned my addr 172.21.15.83:0/4042490452 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:54:22.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:22.081+0000 7efd7d6a3700 1 --2- 172.21.15.83:0/4042490452 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd781016f0 0x7efd78198e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:22.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:22.081+0000 7efd7dea4700 1 --2- 172.21.15.83:0/4042490452 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efd78106950 0x7efd781a0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:22.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:22.081+0000 7efd7cea2700 1 -- 172.21.15.83:0/4042490452 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd781016f0 msgr2=0x7efd78198e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:22.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:22.081+0000 7efd7cea2700 1 --2- 172.21.15.83:0/4042490452 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd781016f0 0x7efd78198e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:22.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:22.081+0000 7efd7cea2700 1 -- 172.21.15.83:0/4042490452 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efd78106950 msgr2=0x7efd781a0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:22.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:22.081+0000 7efd7cea2700 1 --2- 172.21.15.83:0/4042490452 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efd78106950 0x7efd781a0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:22.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:22.081+0000 7efd7cea2700 1 -- 172.21.15.83:0/4042490452 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd680095f0 con 0x7efd78104020 2024-04-01T06:54:22.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:22.081+0000 7efd7dea4700 1 --2- 172.21.15.83:0/4042490452 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efd78106950 0x7efd781a0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:54:22.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:22.082+0000 7efd7cea2700 1 --2- 172.21.15.83:0/4042490452 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd78104020 0x7efd78199340 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7efd68000c00 tx=0x7efd68004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:22.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:22.082+0000 7efd6e7fc700 1 -- 172.21.15.83:0/4042490452 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6801d070 con 0x7efd78104020 2024-04-01T06:54:22.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:22.082+0000 7efd7f907700 1 -- 172.21.15.83:0/4042490452 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd781a0e80 con 0x7efd78104020 2024-04-01T06:54:22.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:22.082+0000 7efd6e7fc700 1 -- 172.21.15.83:0/4042490452 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efd680054f0 con 0x7efd78104020 2024-04-01T06:54:22.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:22.082+0000 7efd6e7fc700 1 -- 172.21.15.83:0/4042490452 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd68004cd0 con 0x7efd78104020 2024-04-01T06:54:22.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:22.082+0000 7efd7f907700 1 -- 172.21.15.83:0/4042490452 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd781a1240 con 0x7efd78104020 2024-04-01T06:54:22.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:22.083+0000 7efd7f907700 1 -- 172.21.15.83:0/4042490452 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd78067180 con 0x7efd78104020 2024-04-01T06:54:22.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:22.084+0000 7efd6e7fc700 1 -- 172.21.15.83:0/4042490452 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) v1 ==== 135865+0+0 (secure 0 0 0) 0x7efd6800fc40 con 0x7efd78104020 2024-04-01T06:54:22.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:22.084+0000 7efd6e7fc700 1 --2- 172.21.15.83:0/4042490452 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7efd640a1120 0x7efd640a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:22.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:22.084+0000 7efd6e7fc700 1 -- 172.21.15.83:0/4042490452 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7127+0+0 (secure 0 0 0) 0x7efd680cd790 con 0x7efd78104020 2024-04-01T06:54:22.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:22.084+0000 7efd7d6a3700 1 --2- 172.21.15.83:0/4042490452 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7efd640a1120 0x7efd640a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:22.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:22.085+0000 7efd7d6a3700 1 --2- 172.21.15.83:0/4042490452 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7efd640a1120 0x7efd640a35e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7efd74005950 tx=0x7efd7400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:22.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:22.088+0000 7efd6e7fc700 1 -- 172.21.15.83:0/4042490452 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7efd68097450 con 0x7efd78104020 2024-04-01T06:54:22.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:21 smithi145 ceph-mon[47816]: Deploying daemon mds.b on smithi145 2024-04-01T06:54:22.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:21 smithi145 ceph-mon[47816]: mds.? [v2:172.21.15.83:6840/1191267445,v1:172.21.15.83:6841/1191267445] up:boot 2024-04-01T06:54:22.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:21 smithi145 ceph-mon[47816]: fsmap 11 up:standby 2024-04-01T06:54:22.135 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:21 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-01T06:54:22.136 INFO:journalctl@ceph.mds.b.smithi145.stdout:Apr 01 06:54:21 smithi145 systemd[1]: Starting Ceph mds.b for c6f8eff4-eff3-11ee-b647-cb9ed24678a4... 2024-04-01T06:54:22.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:21 smithi083 ceph-mon[43429]: Deploying daemon mds.b on smithi145 2024-04-01T06:54:22.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:21 smithi083 ceph-mon[43429]: mds.? [v2:172.21.15.83:6840/1191267445,v1:172.21.15.83:6841/1191267445] up:boot 2024-04-01T06:54:22.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:21 smithi083 ceph-mon[43429]: fsmap 11 up:standby 2024-04-01T06:54:22.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:21 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-01T06:54:22.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:22.332+0000 7efd7f907700 1 -- 172.21.15.83:0/4042490452 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efd7810c620 con 0x7efd78104020 2024-04-01T06:54:22.332 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:22.332+0000 7efd6e7fc700 1 -- 172.21.15.83:0/4042490452 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+8849 (secure 0 0 0) 0x7efd6809fe60 con 0x7efd78104020 2024-04-01T06:54:22.332 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:54:22.332 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1271130478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1271130478},{"type":"v1","addr":"172.21.15.83:6835","nonce":1271130478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2412682983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2412682983},{"type":"v1","addr":"172.21.15.83:6837","nonce":2412682983}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6839/3348145990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":3348145990},{"type":"v1","addr":"172.21.15.83:6839","nonce":3348145990}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6841/1191267445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6840","nonce":1191267445},{"type":"v1","addr":"172.21.15.83:6841","nonce":1191267445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2467459028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2467459028},{"type":"v1","addr":"172.21.15.153:6833","nonce":2467459028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24448,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4092629042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":4092629042},{"type":"v1","addr":"172.21.15.153:6835","nonce":4092629042}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24449,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/647005844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":647005844},{"type":"v1","addr":"172.21.15.145:6833","nonce":647005844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24454,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/1993816527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1993816527},{"type":"v1","addr":"172.21.15.153:6837","nonce":1993816527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24472,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6839/1399754640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1399754640},{"type":"v1","addr":"172.21.15.153:6839","nonce":1399754640}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/3104241497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":3104241497},{"type":"v1","addr":"172.21.15.145:6835","nonce":3104241497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24494,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2687798317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2687798317},{"type":"v1","addr":"172.21.15.145:6837","nonce":2687798317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[]} 2024-04-01T06:54:22.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:22.335+0000 7efd7f907700 1 -- 172.21.15.83:0/4042490452 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7efd640a1120 msgr2=0x7efd640a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:22.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:22.335+0000 7efd7f907700 1 --2- 172.21.15.83:0/4042490452 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7efd640a1120 0x7efd640a35e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7efd74005950 tx=0x7efd7400b410 comp rx=0 tx=0).stop 2024-04-01T06:54:22.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:22.335+0000 7efd7f907700 1 -- 172.21.15.83:0/4042490452 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd78104020 msgr2=0x7efd78199340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:22.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:22.335+0000 7efd7f907700 1 --2- 172.21.15.83:0/4042490452 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd78104020 0x7efd78199340 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7efd68000c00 tx=0x7efd68004730 comp rx=0 tx=0).stop 2024-04-01T06:54:22.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:22.335+0000 7efd7f907700 1 -- 172.21.15.83:0/4042490452 shutdown_connections 2024-04-01T06:54:22.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:22.335+0000 7efd7f907700 1 --2- 172.21.15.83:0/4042490452 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7efd640a1120 0x7efd640a35e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:22.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:22.335+0000 7efd7f907700 1 --2- 172.21.15.83:0/4042490452 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efd78106950 0x7efd781a0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:22.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:22.335+0000 7efd7f907700 1 --2- 172.21.15.83:0/4042490452 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd781016f0 0x7efd78198e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:22.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:22.335+0000 7efd7f907700 1 --2- 172.21.15.83:0/4042490452 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd78104020 0x7efd78199340 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:22.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:22.335+0000 7efd7f907700 1 -- 172.21.15.83:0/4042490452 >> 172.21.15.83:0/4042490452 conn(0x7efd780fb100 msgr2=0x7efd780ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:22.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:22.335+0000 7efd7f907700 1 -- 172.21.15.83:0/4042490452 shutdown_connections 2024-04-01T06:54:22.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:22.335+0000 7efd7f907700 1 -- 172.21.15.83:0/4042490452 wait complete. 2024-04-01T06:54:22.336 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 12 2024-04-01T06:54:22.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:21 smithi153 ceph-mon[48187]: Deploying daemon mds.b on smithi145 2024-04-01T06:54:22.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:21 smithi153 ceph-mon[48187]: mds.? [v2:172.21.15.83:6840/1191267445,v1:172.21.15.83:6841/1191267445] up:boot 2024-04-01T06:54:22.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:21 smithi153 ceph-mon[48187]: fsmap 11 up:standby 2024-04-01T06:54:22.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:21 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-01T06:54:22.752 INFO:journalctl@ceph.mds.b.smithi145.stdout:Apr 01 06:54:22 smithi145 ceph-mds[84571]: -- 172.21.15.145:0/2327813048 <== mon.2 v2:172.21.15.145:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55aee4d021a0 con 0x55aee4cd8800 2024-04-01T06:54:22.752 INFO:journalctl@ceph.mds.b.smithi145.stdout:Apr 01 06:54:22 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-b[84548]: starting mds.b at 2024-04-01T06:54:22.753 INFO:journalctl@ceph.mds.b.smithi145.stdout:Apr 01 06:54:22 smithi145 bash[84533]: d9149e43353998a37552a333efff626d4d18d215ee7c03c0081885600af7a00d 2024-04-01T06:54:22.753 INFO:journalctl@ceph.mds.b.smithi145.stdout:Apr 01 06:54:22 smithi145 systemd[1]: Started Ceph mds.b for c6f8eff4-eff3-11ee-b647-cb9ed24678a4. 2024-04-01T06:54:23.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:22 smithi145 ceph-mon[47816]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T06:54:23.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:22 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/4042490452' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:54:23.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:22 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:23.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:22 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:23.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:22 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:23.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:22 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:23.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:22 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:23.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:22 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:54:23.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:22 smithi083 ceph-mon[43429]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T06:54:23.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:22 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/4042490452' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:54:23.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:22 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:23.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:22 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:23.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:22 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:23.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:22 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:23.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:22 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:23.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:22 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:54:23.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:22 smithi153 ceph-mon[48187]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T06:54:23.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:22 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/4042490452' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:54:23.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:22 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:23.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:22 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:23.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:22 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:23.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:22 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:23.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:22 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:23.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:22 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:54:24.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:23 smithi145 ceph-mon[47816]: mds.? [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] up:boot 2024-04-01T06:54:24.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:23 smithi145 ceph-mon[47816]: fsmap 12 up:standby 2024-04-01T06:54:24.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:23 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-01T06:54:24.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:23 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:24.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:23 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:24.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:23 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:24.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:23 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:24.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:23 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:24.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:23 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:24.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:23 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:24.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:23 smithi083 ceph-mon[43429]: mds.? [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] up:boot 2024-04-01T06:54:24.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:23 smithi083 ceph-mon[43429]: fsmap 12 up:standby 2024-04-01T06:54:24.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:23 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-01T06:54:24.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:23 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:24.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:23 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:24.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:23 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:24.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:23 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:24.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:23 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:24.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:23 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:24.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:23 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:24.348 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T06:54:24.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:23 smithi153 ceph-mon[48187]: mds.? [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] up:boot 2024-04-01T06:54:24.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:23 smithi153 ceph-mon[48187]: fsmap 12 up:standby 2024-04-01T06:54:24.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:23 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-01T06:54:24.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:23 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:24.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:23 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:24.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:23 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:24.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:23 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:24.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:23 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:24.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:23 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:24.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:23 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:24.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.500+0000 7fa741a57700 1 -- 172.21.15.83:0/2566017782 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa73c101e80 msgr2=0x7fa73c1022e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:24.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.500+0000 7fa741a57700 1 --2- 172.21.15.83:0/2566017782 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa73c101e80 0x7fa73c1022e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa7300099c0 tx=0x7fa730009cd0 comp rx=0 tx=0).stop 2024-04-01T06:54:24.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.500+0000 7fa741a57700 1 -- 172.21.15.83:0/2566017782 shutdown_connections 2024-04-01T06:54:24.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.500+0000 7fa741a57700 1 --2- 172.21.15.83:0/2566017782 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa73c102820 0x7fa73c1090d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:24.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.500+0000 7fa741a57700 1 --2- 172.21.15.83:0/2566017782 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa73c100c90 0x7fa73c1010b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:24.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.500+0000 7fa741a57700 1 --2- 172.21.15.83:0/2566017782 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa73c101e80 0x7fa73c1022e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:24.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.500+0000 7fa741a57700 1 -- 172.21.15.83:0/2566017782 >> 172.21.15.83:0/2566017782 conn(0x7fa73c0fc200 msgr2=0x7fa73c0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:24.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.500+0000 7fa741a57700 1 -- 172.21.15.83:0/2566017782 shutdown_connections 2024-04-01T06:54:24.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.500+0000 7fa741a57700 1 -- 172.21.15.83:0/2566017782 wait complete. 2024-04-01T06:54:24.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.501+0000 7fa741a57700 1 Processor -- start 2024-04-01T06:54:24.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.501+0000 7fa741a57700 1 -- start start 2024-04-01T06:54:24.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.501+0000 7fa741a57700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa73c100c90 0x7fa73c196ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:24.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.501+0000 7fa741a57700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa73c101e80 0x7fa73c1970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:24.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.501+0000 7fa741a57700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa73c102820 0x7fa73c19e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:24.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.501+0000 7fa741a57700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c19e6d0 con 0x7fa73c101e80 2024-04-01T06:54:24.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.501+0000 7fa741a57700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c19e810 con 0x7fa73c102820 2024-04-01T06:54:24.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.501+0000 7fa741a57700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c19e9a0 con 0x7fa73c100c90 2024-04-01T06:54:24.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.501+0000 7fa73a7fc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa73c101e80 0x7fa73c1970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:24.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.501+0000 7fa73a7fc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa73c101e80 0x7fa73c1970e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:49308/0 (socket says 172.21.15.83:49308) 2024-04-01T06:54:24.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.501+0000 7fa73a7fc700 1 -- 172.21.15.83:0/746937824 learned_addr learned my addr 172.21.15.83:0/746937824 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:54:24.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.501+0000 7fa73b7fe700 1 --2- 172.21.15.83:0/746937824 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa73c102820 0x7fa73c19e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:24.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.501+0000 7fa73affd700 1 --2- 172.21.15.83:0/746937824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa73c100c90 0x7fa73c196ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:24.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.502+0000 7fa73a7fc700 1 -- 172.21.15.83:0/746937824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa73c100c90 msgr2=0x7fa73c196ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:24.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.502+0000 7fa73a7fc700 1 --2- 172.21.15.83:0/746937824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa73c100c90 0x7fa73c196ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:24.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.502+0000 7fa73a7fc700 1 -- 172.21.15.83:0/746937824 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa73c102820 msgr2=0x7fa73c19e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:24.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.502+0000 7fa73a7fc700 1 --2- 172.21.15.83:0/746937824 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa73c102820 0x7fa73c19e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:24.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.502+0000 7fa73a7fc700 1 -- 172.21.15.83:0/746937824 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7300095f0 con 0x7fa73c101e80 2024-04-01T06:54:24.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.502+0000 7fa73a7fc700 1 --2- 172.21.15.83:0/746937824 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa73c101e80 0x7fa73c1970e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa73000b580 tx=0x7fa730009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:24.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.502+0000 7fa740a55700 1 -- 172.21.15.83:0/746937824 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73001d070 con 0x7fa73c101e80 2024-04-01T06:54:24.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.502+0000 7fa740a55700 1 -- 172.21.15.83:0/746937824 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa730003f90 con 0x7fa73c101e80 2024-04-01T06:54:24.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.502+0000 7fa741a57700 1 -- 172.21.15.83:0/746937824 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa73c19ec20 con 0x7fa73c101e80 2024-04-01T06:54:24.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.502+0000 7fa740a55700 1 -- 172.21.15.83:0/746937824 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa730022c40 con 0x7fa73c101e80 2024-04-01T06:54:24.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.502+0000 7fa741a57700 1 -- 172.21.15.83:0/746937824 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa73c19f0d0 con 0x7fa73c101e80 2024-04-01T06:54:24.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.503+0000 7fa741a57700 1 -- 172.21.15.83:0/746937824 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa73c1080c0 con 0x7fa73c101e80 2024-04-01T06:54:24.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.504+0000 7fa740a55700 1 -- 172.21.15.83:0/746937824 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) v1 ==== 135865+0+0 (secure 0 0 0) 0x7fa730022470 con 0x7fa73c101e80 2024-04-01T06:54:24.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.505+0000 7fa740a55700 1 --2- 172.21.15.83:0/746937824 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fa7240a1120 0x7fa7240a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:24.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.505+0000 7fa740a55700 1 -- 172.21.15.83:0/746937824 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fa7300cd7f0 con 0x7fa73c101e80 2024-04-01T06:54:24.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.505+0000 7fa73affd700 1 --2- 172.21.15.83:0/746937824 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fa7240a1120 0x7fa7240a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:24.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.505+0000 7fa73affd700 1 --2- 172.21.15.83:0/746937824 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fa7240a1120 0x7fa7240a35e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa73c101ce0 tx=0x7fa72c007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:24.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.509+0000 7fa740a55700 1 -- 172.21.15.83:0/746937824 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7fa7300974b0 con 0x7fa73c101e80 2024-04-01T06:54:24.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.765+0000 7fa741a57700 1 -- 172.21.15.83:0/746937824 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa73c067e60 con 0x7fa73c101e80 2024-04-01T06:54:24.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.766+0000 7fa740a55700 1 -- 172.21.15.83:0/746937824 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+9610 (secure 0 0 0) 0x7fa73009aad0 con 0x7fa73c101e80 2024-04-01T06:54:24.766 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:54:24.766 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1271130478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1271130478},{"type":"v1","addr":"172.21.15.83:6835","nonce":1271130478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2412682983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2412682983},{"type":"v1","addr":"172.21.15.83:6837","nonce":2412682983}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6839/3348145990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":3348145990},{"type":"v1","addr":"172.21.15.83:6839","nonce":3348145990}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6841/1191267445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6840","nonce":1191267445},{"type":"v1","addr":"172.21.15.83:6841","nonce":1191267445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2467459028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2467459028},{"type":"v1","addr":"172.21.15.153:6833","nonce":2467459028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24448,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4092629042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":4092629042},{"type":"v1","addr":"172.21.15.153:6835","nonce":4092629042}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24449,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/647005844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":647005844},{"type":"v1","addr":"172.21.15.145:6833","nonce":647005844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24454,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/1993816527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1993816527},{"type":"v1","addr":"172.21.15.153:6837","nonce":1993816527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24472,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6839/1399754640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1399754640},{"type":"v1","addr":"172.21.15.153:6839","nonce":1399754640}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/3104241497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":3104241497},{"type":"v1","addr":"172.21.15.145:6835","nonce":3104241497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24494,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/2687798317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2687798317},{"type":"v1","addr":"172.21.15.145:6837","nonce":2687798317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24524,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6839/3886435411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3886435411},{"type":"v1","addr":"172.21.15.145:6839","nonce":3886435411}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[]} 2024-04-01T06:54:24.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.768+0000 7fa741a57700 1 -- 172.21.15.83:0/746937824 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fa7240a1120 msgr2=0x7fa7240a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:24.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.768+0000 7fa741a57700 1 --2- 172.21.15.83:0/746937824 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fa7240a1120 0x7fa7240a35e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa73c101ce0 tx=0x7fa72c007400 comp rx=0 tx=0).stop 2024-04-01T06:54:24.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.768+0000 7fa741a57700 1 -- 172.21.15.83:0/746937824 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa73c101e80 msgr2=0x7fa73c1970e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:24.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.768+0000 7fa741a57700 1 --2- 172.21.15.83:0/746937824 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa73c101e80 0x7fa73c1970e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa73000b580 tx=0x7fa730009580 comp rx=0 tx=0).stop 2024-04-01T06:54:24.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.768+0000 7fa741a57700 1 -- 172.21.15.83:0/746937824 shutdown_connections 2024-04-01T06:54:24.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.768+0000 7fa741a57700 1 --2- 172.21.15.83:0/746937824 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fa7240a1120 0x7fa7240a35e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:24.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.768+0000 7fa741a57700 1 --2- 172.21.15.83:0/746937824 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa73c102820 0x7fa73c19e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:24.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.768+0000 7fa741a57700 1 --2- 172.21.15.83:0/746937824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa73c100c90 0x7fa73c196ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:24.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.768+0000 7fa741a57700 1 --2- 172.21.15.83:0/746937824 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa73c101e80 0x7fa73c1970e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:24.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.768+0000 7fa741a57700 1 -- 172.21.15.83:0/746937824 >> 172.21.15.83:0/746937824 conn(0x7fa73c0fc200 msgr2=0x7fa73c105200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:24.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.768+0000 7fa741a57700 1 -- 172.21.15.83:0/746937824 shutdown_connections 2024-04-01T06:54:24.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.768+0000 7fa741a57700 1 -- 172.21.15.83:0/746937824 wait complete. 2024-04-01T06:54:24.769 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 13 2024-04-01T06:54:24.781 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T06:54:24.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.904+0000 7fc06c5b0700 1 -- 172.21.15.83:0/623135112 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc064102810 msgr2=0x7fc0641090c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:24.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.904+0000 7fc06c5b0700 1 --2- 172.21.15.83:0/623135112 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc064102810 0x7fc0641090c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc05c00b0d0 tx=0x7fc05c00b3e0 comp rx=0 tx=0).stop 2024-04-01T06:54:24.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.904+0000 7fc06c5b0700 1 -- 172.21.15.83:0/623135112 shutdown_connections 2024-04-01T06:54:24.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.904+0000 7fc06c5b0700 1 --2- 172.21.15.83:0/623135112 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc064102810 0x7fc0641090c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:24.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.904+0000 7fc06c5b0700 1 --2- 172.21.15.83:0/623135112 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc064100c80 0x7fc0641010a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:24.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.904+0000 7fc06c5b0700 1 --2- 172.21.15.83:0/623135112 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc064101e70 0x7fc0641022d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:24.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.904+0000 7fc06c5b0700 1 -- 172.21.15.83:0/623135112 >> 172.21.15.83:0/623135112 conn(0x7fc0640fc1f0 msgr2=0x7fc0640fe630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:24.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.904+0000 7fc06c5b0700 1 -- 172.21.15.83:0/623135112 shutdown_connections 2024-04-01T06:54:24.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.904+0000 7fc06c5b0700 1 -- 172.21.15.83:0/623135112 wait complete. 2024-04-01T06:54:24.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.904+0000 7fc06c5b0700 1 Processor -- start 2024-04-01T06:54:24.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.904+0000 7fc06c5b0700 1 -- start start 2024-04-01T06:54:24.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.905+0000 7fc06c5b0700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc064100c80 0x7fc064196cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:24.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.905+0000 7fc06c5b0700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc064101e70 0x7fc064197200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:24.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.905+0000 7fc06c5b0700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc064102810 0x7fc06419e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:24.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.905+0000 7fc06c5b0700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06419e7e0 con 0x7fc064101e70 2024-04-01T06:54:24.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.905+0000 7fc06c5b0700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06419e950 con 0x7fc064100c80 2024-04-01T06:54:24.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.905+0000 7fc06c5b0700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06419eb10 con 0x7fc064102810 2024-04-01T06:54:24.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.905+0000 7fc069b4b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc064101e70 0x7fc064197200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:24.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.905+0000 7fc069b4b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc064101e70 0x7fc064197200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:49330/0 (socket says 172.21.15.83:49330) 2024-04-01T06:54:24.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.905+0000 7fc069b4b700 1 -- 172.21.15.83:0/3923646512 learned_addr learned my addr 172.21.15.83:0/3923646512 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:54:24.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.905+0000 7fc06a34c700 1 --2- 172.21.15.83:0/3923646512 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc064100c80 0x7fc064196cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:24.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.905+0000 7fc06ab4d700 1 --2- 172.21.15.83:0/3923646512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc064102810 0x7fc06419e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:24.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.905+0000 7fc069b4b700 1 -- 172.21.15.83:0/3923646512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc064102810 msgr2=0x7fc06419e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:24.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.905+0000 7fc069b4b700 1 --2- 172.21.15.83:0/3923646512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc064102810 0x7fc06419e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:24.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.905+0000 7fc069b4b700 1 -- 172.21.15.83:0/3923646512 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc064100c80 msgr2=0x7fc064196cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:24.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.905+0000 7fc069b4b700 1 --2- 172.21.15.83:0/3923646512 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc064100c80 0x7fc064196cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:24.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.905+0000 7fc069b4b700 1 -- 172.21.15.83:0/3923646512 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc05c009d00 con 0x7fc064101e70 2024-04-01T06:54:24.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.905+0000 7fc069b4b700 1 --2- 172.21.15.83:0/3923646512 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc064101e70 0x7fc064197200 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc05400e9a0 tx=0x7fc05400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:24.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.905+0000 7fc05b7fe700 1 -- 172.21.15.83:0/3923646512 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc054009790 con 0x7fc064101e70 2024-04-01T06:54:24.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.905+0000 7fc05b7fe700 1 -- 172.21.15.83:0/3923646512 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc054010430 con 0x7fc064101e70 2024-04-01T06:54:24.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.905+0000 7fc06c5b0700 1 -- 172.21.15.83:0/3923646512 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc06419edf0 con 0x7fc064101e70 2024-04-01T06:54:24.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.905+0000 7fc05b7fe700 1 -- 172.21.15.83:0/3923646512 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc054018680 con 0x7fc064101e70 2024-04-01T06:54:24.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.905+0000 7fc06c5b0700 1 -- 172.21.15.83:0/3923646512 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc06419f270 con 0x7fc064101e70 2024-04-01T06:54:24.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.907+0000 7fc06c5b0700 1 -- 172.21.15.83:0/3923646512 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0641080d0 con 0x7fc064101e70 2024-04-01T06:54:24.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.908+0000 7fc05b7fe700 1 -- 172.21.15.83:0/3923646512 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) v1 ==== 135865+0+0 (secure 0 0 0) 0x7fc0540105a0 con 0x7fc064101e70 2024-04-01T06:54:24.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.908+0000 7fc05b7fe700 1 --2- 172.21.15.83:0/3923646512 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fc0500a1120 0x7fc0500a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:24.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.909+0000 7fc06a34c700 1 --2- 172.21.15.83:0/3923646512 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fc0500a1120 0x7fc0500a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:24.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.909+0000 7fc05b7fe700 1 -- 172.21.15.83:0/3923646512 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fc054014070 con 0x7fc064101e70 2024-04-01T06:54:24.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.909+0000 7fc06a34c700 1 --2- 172.21.15.83:0/3923646512 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fc0500a1120 0x7fc0500a35e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc0640fe5f0 tx=0x7fc060009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:24.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:24.913+0000 7fc05b7fe700 1 -- 172.21.15.83:0/3923646512 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7fc0540529f0 con 0x7fc064101e70 2024-04-01T06:54:25.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.147+0000 7fc06c5b0700 1 -- 172.21.15.83:0/3923646512 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc06410c4a0 con 0x7fc064101e70 2024-04-01T06:54:25.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.148+0000 7fc05b7fe700 1 -- 172.21.15.83:0/3923646512 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+18434 (secure 0 0 0) 0x7fc054096220 con 0x7fc064101e70 2024-04-01T06:54:25.148 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:54:25.148 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":75,"fsid":"c6f8eff4-eff3-11ee-b647-cb9ed24678a4","created":"2024-04-01T06:48:42.033382+0000","modified":"2024-04-01T06:53:56.797141+0000","last_up_change":"2024-04-01T06:53:55.791339+0000","last_in_change":"2024-04-01T06:53:39.777214+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T06:51:21.963996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"90b761b0-b06c-4142-854d-38ee42aa6052","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6803","nonce":3253845390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6805","nonce":3253845390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6809","nonce":3253845390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6807","nonce":3253845390}]},"public_addr":"172.21.15.83:6803/3253845390","cluster_addr":"172.21.15.83:6805/3253845390","heartbeat_back_addr":"172.21.15.83:6809/3253845390","heartbeat_front_addr":"172.21.15.83:6807/3253845390","state":["exists","up"]},{"osd":1,"uuid":"4d6ab85b-7088-451e-a829-c9119f35dee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6801","nonce":515889759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6803","nonce":515889759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6807","nonce":515889759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6805","nonce":515889759}]},"public_addr":"172.21.15.145:6801/515889759","cluster_addr":"172.21.15.145:6803/515889759","heartbeat_back_addr":"172.21.15.145:6807/515889759","heartbeat_front_addr":"172.21.15.145:6805/515889759","state":["exists","up"]},{"osd":2,"uuid":"d04c27f3-4972-4061-8bfb-5060645e3883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6801","nonce":3318516728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6803","nonce":3318516728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6807","nonce":3318516728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6805","nonce":3318516728}]},"public_addr":"172.21.15.153:6801/3318516728","cluster_addr":"172.21.15.153:6803/3318516728","heartbeat_back_addr":"172.21.15.153:6807/3318516728","heartbeat_front_addr":"172.21.15.153:6805/3318516728","state":["exists","up"]},{"osd":3,"uuid":"899b6c90-8f2f-44dd-b807-49594aadb443","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6811","nonce":504690234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6813","nonce":504690234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6817","nonce":504690234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6815","nonce":504690234}]},"public_addr":"172.21.15.83:6811/504690234","cluster_addr":"172.21.15.83:6813/504690234","heartbeat_back_addr":"172.21.15.83:6817/504690234","heartbeat_front_addr":"172.21.15.83:6815/504690234","state":["exists","up"]},{"osd":4,"uuid":"5071dd81-804e-4358-bfb6-11e718e9cf4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6809","nonce":2099824730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6811","nonce":2099824730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6815","nonce":2099824730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6813","nonce":2099824730}]},"public_addr":"172.21.15.145:6809/2099824730","cluster_addr":"172.21.15.145:6811/2099824730","heartbeat_back_addr":"172.21.15.145:6815/2099824730","heartbeat_front_addr":"172.21.15.145:6813/2099824730","state":["exists","up"]},{"osd":5,"uuid":"b8442b71-c26e-467f-b0c3-ea9f636f5a00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6809","nonce":3340941443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6811","nonce":3340941443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6815","nonce":3340941443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6813","nonce":3340941443}]},"public_addr":"172.21.15.153:6809/3340941443","cluster_addr":"172.21.15.153:6811/3340941443","heartbeat_back_addr":"172.21.15.153:6815/3340941443","heartbeat_front_addr":"172.21.15.153:6813/3340941443","state":["exists","up"]},{"osd":6,"uuid":"c26bb8cb-ccee-4bfc-91eb-14e1ad8e04df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6819","nonce":2005485079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6821","nonce":2005485079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6825","nonce":2005485079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6823","nonce":2005485079}]},"public_addr":"172.21.15.83:6819/2005485079","cluster_addr":"172.21.15.83:6821/2005485079","heartbeat_back_addr":"172.21.15.83:6825/2005485079","heartbeat_front_addr":"172.21.15.83:6823/2005485079","state":["exists","up"]},{"osd":7,"uuid":"a8940da2-0e79-4606-8d1e-d425afbf5753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6817","nonce":3737505059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6819","nonce":3737505059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6823","nonce":3737505059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6821","nonce":3737505059}]},"public_addr":"172.21.15.145:6817/3737505059","cluster_addr":"172.21.15.145:6819/3737505059","heartbeat_back_addr":"172.21.15.145:6823/3737505059","heartbeat_front_addr":"172.21.15.145:6821/3737505059","state":["exists","up"]},{"osd":8,"uuid":"602d43ac-a189-4da3-9e38-7025d14e0dd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6817","nonce":1031545791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6819","nonce":1031545791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6823","nonce":1031545791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6821","nonce":1031545791}]},"public_addr":"172.21.15.153:6817/1031545791","cluster_addr":"172.21.15.153:6819/1031545791","heartbeat_back_addr":"172.21.15.153:6823/1031545791","heartbeat_front_addr":"172.21.15.153:6821/1031545791","state":["exists","up"]},{"osd":9,"uuid":"08b12d27-1247-45e4-9d09-cacc0fce4bd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6827","nonce":3720996673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6829","nonce":3720996673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6833","nonce":3720996673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6831","nonce":3720996673}]},"public_addr":"172.21.15.83:6827/3720996673","cluster_addr":"172.21.15.83:6829/3720996673","heartbeat_back_addr":"172.21.15.83:6833/3720996673","heartbeat_front_addr":"172.21.15.83:6831/3720996673","state":["exists","up"]},{"osd":10,"uuid":"dd986b50-d68f-446c-9c66-261535880879","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6825","nonce":2671529479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6827","nonce":2671529479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6831","nonce":2671529479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6829","nonce":2671529479}]},"public_addr":"172.21.15.145:6825/2671529479","cluster_addr":"172.21.15.145:6827/2671529479","heartbeat_back_addr":"172.21.15.145:6831/2671529479","heartbeat_front_addr":"172.21.15.145:6829/2671529479","state":["exists","up"]},{"osd":11,"uuid":"d20a49cd-6224-4424-8375-46da791d9931","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6825","nonce":2342548429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6827","nonce":2342548429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6831","nonce":2342548429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6829","nonce":2342548429}]},"public_addr":"172.21.15.153:6825/2342548429","cluster_addr":"172.21.15.153:6827/2342548429","heartbeat_back_addr":"172.21.15.153:6831/2342548429","heartbeat_front_addr":"172.21.15.153:6829/2342548429","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:50:44.539932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:01.990470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:19.054426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:36.616393+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:53.896705+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:10.667502+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:27.880849+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:45.276308+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:02.280615+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:19.555547+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:37.062881+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:54.191589+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.83:6801/1867137261":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/2596683931":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/2125339627":"2024-04-02T06:49:33.656125+0000","172.21.15.83:6800/1644397953":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/690500472":"2024-04-02T06:49:13.456026+0000","172.21.15.83:6801/1644397953":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/785958951":"2024-04-02T06:49:33.656125+0000","172.21.15.83:6800/1867137261":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/2222527447":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/2071592157":"2024-04-02T06:49:13.456026+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T06:54:25.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.150+0000 7fc06c5b0700 1 -- 172.21.15.83:0/3923646512 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fc0500a1120 msgr2=0x7fc0500a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:25.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.150+0000 7fc06c5b0700 1 --2- 172.21.15.83:0/3923646512 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fc0500a1120 0x7fc0500a35e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc0640fe5f0 tx=0x7fc060009260 comp rx=0 tx=0).stop 2024-04-01T06:54:25.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.150+0000 7fc06c5b0700 1 -- 172.21.15.83:0/3923646512 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc064101e70 msgr2=0x7fc064197200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:25.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.150+0000 7fc06c5b0700 1 --2- 172.21.15.83:0/3923646512 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc064101e70 0x7fc064197200 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc05400e9a0 tx=0x7fc05400ecb0 comp rx=0 tx=0).stop 2024-04-01T06:54:25.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.150+0000 7fc06c5b0700 1 -- 172.21.15.83:0/3923646512 shutdown_connections 2024-04-01T06:54:25.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.150+0000 7fc06c5b0700 1 --2- 172.21.15.83:0/3923646512 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fc0500a1120 0x7fc0500a35e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:25.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.150+0000 7fc06c5b0700 1 --2- 172.21.15.83:0/3923646512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc064102810 0x7fc06419e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:25.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.150+0000 7fc06c5b0700 1 --2- 172.21.15.83:0/3923646512 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc064100c80 0x7fc064196cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:25.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.150+0000 7fc06c5b0700 1 --2- 172.21.15.83:0/3923646512 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc064101e70 0x7fc064197200 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:25.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.150+0000 7fc06c5b0700 1 -- 172.21.15.83:0/3923646512 >> 172.21.15.83:0/3923646512 conn(0x7fc0640fc1f0 msgr2=0x7fc064105210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:25.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.150+0000 7fc06c5b0700 1 -- 172.21.15.83:0/3923646512 shutdown_connections 2024-04-01T06:54:25.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.150+0000 7fc06c5b0700 1 -- 172.21.15.83:0/3923646512 wait complete. 2024-04-01T06:54:25.161 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:24 smithi083 ceph-mon[43429]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T06:54:25.161 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:24 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:54:25.161 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:24 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:54:25.161 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:24 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:25.161 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:24 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:54:25.162 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:24 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/746937824' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:54:25.163 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-01T06:51:21.963996+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-01T06:54:25.163 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-01T06:54:25.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:24 smithi145 ceph-mon[47816]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T06:54:25.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:24 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:54:25.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:24 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:54:25.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:24 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:25.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:24 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:54:25.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:24 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/746937824' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:54:25.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.300+0000 7f593fc6c700 1 -- 172.21.15.83:0/1009262250 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f59380ff040 msgr2=0x7f59380ff460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:25.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.300+0000 7f593fc6c700 1 --2- 172.21.15.83:0/1009262250 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f59380ff040 0x7f59380ff460 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5928009990 tx=0x7f5928009ca0 comp rx=0 tx=0).stop 2024-04-01T06:54:25.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.300+0000 7f593fc6c700 1 -- 172.21.15.83:0/1009262250 shutdown_connections 2024-04-01T06:54:25.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.300+0000 7f593fc6c700 1 --2- 172.21.15.83:0/1009262250 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f59380ff040 0x7f59380ff460 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:25.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.300+0000 7f593fc6c700 1 --2- 172.21.15.83:0/1009262250 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5938102a50 0x7f5938109300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:25.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.300+0000 7f593fc6c700 1 --2- 172.21.15.83:0/1009262250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f59381020b0 0x7f5938102510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:25.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.300+0000 7f593fc6c700 1 -- 172.21.15.83:0/1009262250 >> 172.21.15.83:0/1009262250 conn(0x7f59380fa950 msgr2=0x7f59380fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:25.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.300+0000 7f593fc6c700 1 -- 172.21.15.83:0/1009262250 shutdown_connections 2024-04-01T06:54:25.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.300+0000 7f593fc6c700 1 -- 172.21.15.83:0/1009262250 wait complete. 2024-04-01T06:54:25.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.301+0000 7f593fc6c700 1 Processor -- start 2024-04-01T06:54:25.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.301+0000 7f593fc6c700 1 -- start start 2024-04-01T06:54:25.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.301+0000 7f593fc6c700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f59380ff040 0x7f59381019d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:25.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.301+0000 7f593fc6c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f59381020b0 0x7f5938100060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:25.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.301+0000 7f593fc6c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5938102a50 0x7f59381005a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:25.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.301+0000 7f593fc6c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5938100d40 con 0x7f59381020b0 2024-04-01T06:54:25.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.301+0000 7f593fc6c700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5938100eb0 con 0x7f59380ff040 2024-04-01T06:54:25.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.301+0000 7f593fc6c700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59381a0d80 con 0x7f5938102a50 2024-04-01T06:54:25.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.301+0000 7f593d207700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f59381020b0 0x7f5938100060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:25.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.301+0000 7f593d207700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f59381020b0 0x7f5938100060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:49360/0 (socket says 172.21.15.83:49360) 2024-04-01T06:54:25.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.301+0000 7f593d207700 1 -- 172.21.15.83:0/170345995 learned_addr learned my addr 172.21.15.83:0/170345995 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:54:25.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.301+0000 7f593e209700 1 --2- 172.21.15.83:0/170345995 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5938102a50 0x7f59381005a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:25.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.301+0000 7f593da08700 1 --2- 172.21.15.83:0/170345995 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f59380ff040 0x7f59381019d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:25.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.301+0000 7f593d207700 1 -- 172.21.15.83:0/170345995 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5938102a50 msgr2=0x7f59381005a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:25.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.301+0000 7f593d207700 1 --2- 172.21.15.83:0/170345995 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5938102a50 0x7f59381005a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:25.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.301+0000 7f593d207700 1 -- 172.21.15.83:0/170345995 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f59380ff040 msgr2=0x7f59381019d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:25.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.301+0000 7f593d207700 1 --2- 172.21.15.83:0/170345995 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f59380ff040 0x7f59381019d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:25.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.301+0000 7f593d207700 1 -- 172.21.15.83:0/170345995 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59280095f0 con 0x7f59381020b0 2024-04-01T06:54:25.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.301+0000 7f593da08700 1 --2- 172.21.15.83:0/170345995 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f59380ff040 0x7f59381019d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:54:25.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.301+0000 7f593d207700 1 --2- 172.21.15.83:0/170345995 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f59381020b0 0x7f5938100060 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f593400d980 tx=0x7f593400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:25.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.301+0000 7f592effd700 1 -- 172.21.15.83:0/170345995 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5934004220 con 0x7f59381020b0 2024-04-01T06:54:25.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.301+0000 7f592effd700 1 -- 172.21.15.83:0/170345995 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5934007640 con 0x7f59381020b0 2024-04-01T06:54:25.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.301+0000 7f593fc6c700 1 -- 172.21.15.83:0/170345995 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59381a0fb0 con 0x7f59381020b0 2024-04-01T06:54:25.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.301+0000 7f592effd700 1 -- 172.21.15.83:0/170345995 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5934005610 con 0x7f59381020b0 2024-04-01T06:54:25.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.302+0000 7f593fc6c700 1 -- 172.21.15.83:0/170345995 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59381a1490 con 0x7f59381020b0 2024-04-01T06:54:25.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.303+0000 7f593fc6c700 1 -- 172.21.15.83:0/170345995 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59381083b0 con 0x7f59381020b0 2024-04-01T06:54:25.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.304+0000 7f592effd700 1 -- 172.21.15.83:0/170345995 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) v1 ==== 135865+0+0 (secure 0 0 0) 0x7f5934004750 con 0x7f59381020b0 2024-04-01T06:54:25.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.304+0000 7f592effd700 1 --2- 172.21.15.83:0/170345995 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f59240a1120 0x7f59240a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:25.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.304+0000 7f592effd700 1 -- 172.21.15.83:0/170345995 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f59340cc760 con 0x7f59381020b0 2024-04-01T06:54:25.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.304+0000 7f593da08700 1 --2- 172.21.15.83:0/170345995 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f59240a1120 0x7f59240a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:25.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.305+0000 7f593da08700 1 --2- 172.21.15.83:0/170345995 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f59240a1120 0x7f59240a35e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f592800b7b0 tx=0x7f5928005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:25.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.308+0000 7f592effd700 1 -- 172.21.15.83:0/170345995 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f5934096390 con 0x7f59381020b0 2024-04-01T06:54:25.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:24 smithi153 ceph-mon[48187]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T06:54:25.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:24 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:54:25.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:24 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:54:25.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:24 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:25.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:24 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:54:25.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:24 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/746937824' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:54:25.515 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.515+0000 7f593fc6c700 1 -- 172.21.15.83:0/170345995 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f593810c730 con 0x7f59381020b0 2024-04-01T06:54:25.515 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.516+0000 7f592effd700 1 -- 172.21.15.83:0/170345995 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) v1 ==== 93+0+10 (secure 0 0 0) 0x7f59340999b0 con 0x7f59381020b0 2024-04-01T06:54:25.515 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 1 2024-04-01T06:54:25.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.518+0000 7f593fc6c700 1 -- 172.21.15.83:0/170345995 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f59240a1120 msgr2=0x7f59240a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:25.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.518+0000 7f593fc6c700 1 --2- 172.21.15.83:0/170345995 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f59240a1120 0x7f59240a35e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f592800b7b0 tx=0x7f5928005fb0 comp rx=0 tx=0).stop 2024-04-01T06:54:25.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.518+0000 7f593fc6c700 1 -- 172.21.15.83:0/170345995 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f59381020b0 msgr2=0x7f5938100060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:25.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.518+0000 7f593fc6c700 1 --2- 172.21.15.83:0/170345995 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f59381020b0 0x7f5938100060 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f593400d980 tx=0x7f593400dc90 comp rx=0 tx=0).stop 2024-04-01T06:54:25.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.518+0000 7f593fc6c700 1 -- 172.21.15.83:0/170345995 shutdown_connections 2024-04-01T06:54:25.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.518+0000 7f593fc6c700 1 --2- 172.21.15.83:0/170345995 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f59240a1120 0x7f59240a35e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:25.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.518+0000 7f593fc6c700 1 --2- 172.21.15.83:0/170345995 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5938102a50 0x7f59381005a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:25.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.518+0000 7f593fc6c700 1 --2- 172.21.15.83:0/170345995 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f59380ff040 0x7f59381019d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:25.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.518+0000 7f593fc6c700 1 --2- 172.21.15.83:0/170345995 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f59381020b0 0x7f5938100060 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:25.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.518+0000 7f593fc6c700 1 -- 172.21.15.83:0/170345995 >> 172.21.15.83:0/170345995 conn(0x7f59380fa950 msgr2=0x7f59381054f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:25.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.518+0000 7f593fc6c700 1 -- 172.21.15.83:0/170345995 shutdown_connections 2024-04-01T06:54:25.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.518+0000 7f593fc6c700 1 -- 172.21.15.83:0/170345995 wait complete. 2024-04-01T06:54:25.530 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-01T06:54:25.652 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.652+0000 7f0f2cca9700 1 -- 172.21.15.83:0/1141869082 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0f281016f0 msgr2=0x7f0f28107fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:25.652 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.652+0000 7f0f2cca9700 1 --2- 172.21.15.83:0/1141869082 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0f281016f0 0x7f0f28107fa0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0f2000b0d0 tx=0x7f0f2000b3e0 comp rx=0 tx=0).stop 2024-04-01T06:54:25.652 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.652+0000 7f0f2cca9700 1 -- 172.21.15.83:0/1141869082 shutdown_connections 2024-04-01T06:54:25.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.652+0000 7f0f2cca9700 1 --2- 172.21.15.83:0/1141869082 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0f281016f0 0x7f0f28107fa0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:25.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.652+0000 7f0f2cca9700 1 --2- 172.21.15.83:0/1141869082 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0f280ffb60 0x7f0f280fff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:25.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.652+0000 7f0f2cca9700 1 --2- 172.21.15.83:0/1141869082 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f28100d50 0x7f0f281011b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:25.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.652+0000 7f0f2cca9700 1 -- 172.21.15.83:0/1141869082 >> 172.21.15.83:0/1141869082 conn(0x7f0f280fb0d0 msgr2=0x7f0f280fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:25.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.652+0000 7f0f2cca9700 1 -- 172.21.15.83:0/1141869082 shutdown_connections 2024-04-01T06:54:25.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.652+0000 7f0f2cca9700 1 -- 172.21.15.83:0/1141869082 wait complete. 2024-04-01T06:54:25.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.653+0000 7f0f2cca9700 1 Processor -- start 2024-04-01T06:54:25.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.653+0000 7f0f2cca9700 1 -- start start 2024-04-01T06:54:25.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.653+0000 7f0f2cca9700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0f280ffb60 0x7f0f28196cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:25.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.653+0000 7f0f2cca9700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0f28100d50 0x7f0f28197200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:25.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.653+0000 7f0f2cca9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f281016f0 0x7f0f2819e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:25.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.653+0000 7f0f2cca9700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f2819e7b0 con 0x7f0f28100d50 2024-04-01T06:54:25.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.653+0000 7f0f2cca9700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f2819e920 con 0x7f0f280ffb60 2024-04-01T06:54:25.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.653+0000 7f0f2cca9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f2819eae0 con 0x7f0f281016f0 2024-04-01T06:54:25.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.653+0000 7f0f25d9b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0f28100d50 0x7f0f28197200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:25.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.653+0000 7f0f25d9b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0f28100d50 0x7f0f28197200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:49380/0 (socket says 172.21.15.83:49380) 2024-04-01T06:54:25.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.653+0000 7f0f25d9b700 1 -- 172.21.15.83:0/2738206981 learned_addr learned my addr 172.21.15.83:0/2738206981 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:54:25.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.654+0000 7f0f2659c700 1 --2- 172.21.15.83:0/2738206981 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0f280ffb60 0x7f0f28196cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:25.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.654+0000 7f0f26d9d700 1 --2- 172.21.15.83:0/2738206981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f281016f0 0x7f0f2819e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:25.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.654+0000 7f0f25d9b700 1 -- 172.21.15.83:0/2738206981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f281016f0 msgr2=0x7f0f2819e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:25.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.654+0000 7f0f25d9b700 1 --2- 172.21.15.83:0/2738206981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f281016f0 0x7f0f2819e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:25.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.654+0000 7f0f25d9b700 1 -- 172.21.15.83:0/2738206981 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0f280ffb60 msgr2=0x7f0f28196cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:25.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.654+0000 7f0f25d9b700 1 --2- 172.21.15.83:0/2738206981 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0f280ffb60 0x7f0f28196cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:25.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.654+0000 7f0f25d9b700 1 -- 172.21.15.83:0/2738206981 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f20009d00 con 0x7f0f28100d50 2024-04-01T06:54:25.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.654+0000 7f0f26d9d700 1 --2- 172.21.15.83:0/2738206981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f281016f0 0x7f0f2819e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:54:25.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.654+0000 7f0f25d9b700 1 --2- 172.21.15.83:0/2738206981 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0f28100d50 0x7f0f28197200 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c00c920 tx=0x7f0f1c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:25.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.654+0000 7f0f177fe700 1 -- 172.21.15.83:0/2738206981 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1c007b00 con 0x7f0f28100d50 2024-04-01T06:54:25.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.654+0000 7f0f2cca9700 1 -- 172.21.15.83:0/2738206981 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f2819edc0 con 0x7f0f28100d50 2024-04-01T06:54:25.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.654+0000 7f0f177fe700 1 -- 172.21.15.83:0/2738206981 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0f1c00ce70 con 0x7f0f28100d50 2024-04-01T06:54:25.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.654+0000 7f0f177fe700 1 -- 172.21.15.83:0/2738206981 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1c005460 con 0x7f0f28100d50 2024-04-01T06:54:25.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.654+0000 7f0f2cca9700 1 -- 172.21.15.83:0/2738206981 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f2819f210 con 0x7f0f28100d50 2024-04-01T06:54:25.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.655+0000 7f0f2cca9700 1 -- 172.21.15.83:0/2738206981 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f28106f10 con 0x7f0f28100d50 2024-04-01T06:54:25.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.657+0000 7f0f177fe700 1 -- 172.21.15.83:0/2738206981 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) v1 ==== 135865+0+0 (secure 0 0 0) 0x7f0f1c0055c0 con 0x7f0f28100d50 2024-04-01T06:54:25.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.657+0000 7f0f177fe700 1 --2- 172.21.15.83:0/2738206981 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f0f100a1120 0x7f0f100a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:25.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.657+0000 7f0f2659c700 1 --2- 172.21.15.83:0/2738206981 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f0f100a1120 0x7f0f100a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:25.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.657+0000 7f0f177fe700 1 -- 172.21.15.83:0/2738206981 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f0f1c0cc430 con 0x7f0f28100d50 2024-04-01T06:54:25.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.658+0000 7f0f2659c700 1 --2- 172.21.15.83:0/2738206981 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f0f100a1120 0x7f0f100a35e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0f28198140 tx=0x7f0f18009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:25.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.661+0000 7f0f177fe700 1 -- 172.21.15.83:0/2738206981 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f0f1c096060 con 0x7f0f28100d50 2024-04-01T06:54:25.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.871+0000 7f0f2cca9700 1 -- 172.21.15.83:0/2738206981 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0f2810c550 con 0x7f0f28100d50 2024-04-01T06:54:25.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.872+0000 7f0f177fe700 1 -- 172.21.15.83:0/2738206981 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v75) v1 ==== 84+0+65 (secure 0 0 0) 0x7f0f1c01d060 con 0x7f0f28100d50 2024-04-01T06:54:25.871 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:54:25.872 INFO:teuthology.orchestra.run.smithi083.stdout:[ 2024-04-01T06:54:25.872 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:54:25.872 INFO:teuthology.orchestra.run.smithi083.stdout: "poolnum": 1, 2024-04-01T06:54:25.872 INFO:teuthology.orchestra.run.smithi083.stdout: "poolname": ".mgr" 2024-04-01T06:54:25.872 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T06:54:25.872 INFO:teuthology.orchestra.run.smithi083.stdout:] 2024-04-01T06:54:25.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.874+0000 7f0f2cca9700 1 -- 172.21.15.83:0/2738206981 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f0f100a1120 msgr2=0x7f0f100a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:25.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.874+0000 7f0f2cca9700 1 --2- 172.21.15.83:0/2738206981 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f0f100a1120 0x7f0f100a35e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0f28198140 tx=0x7f0f18009260 comp rx=0 tx=0).stop 2024-04-01T06:54:25.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.874+0000 7f0f2cca9700 1 -- 172.21.15.83:0/2738206981 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0f28100d50 msgr2=0x7f0f28197200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:25.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.874+0000 7f0f2cca9700 1 --2- 172.21.15.83:0/2738206981 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0f28100d50 0x7f0f28197200 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c00c920 tx=0x7f0f1c00cc30 comp rx=0 tx=0).stop 2024-04-01T06:54:25.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.874+0000 7f0f2cca9700 1 -- 172.21.15.83:0/2738206981 shutdown_connections 2024-04-01T06:54:25.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.874+0000 7f0f2cca9700 1 --2- 172.21.15.83:0/2738206981 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f0f100a1120 0x7f0f100a35e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:25.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.874+0000 7f0f2cca9700 1 --2- 172.21.15.83:0/2738206981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f281016f0 0x7f0f2819e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:25.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.874+0000 7f0f2cca9700 1 --2- 172.21.15.83:0/2738206981 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0f280ffb60 0x7f0f28196cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:25.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.874+0000 7f0f2cca9700 1 --2- 172.21.15.83:0/2738206981 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0f28100d50 0x7f0f28197200 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:25.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.874+0000 7f0f2cca9700 1 -- 172.21.15.83:0/2738206981 >> 172.21.15.83:0/2738206981 conn(0x7f0f280fb0d0 msgr2=0x7f0f28104050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:25.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.874+0000 7f0f2cca9700 1 -- 172.21.15.83:0/2738206981 shutdown_connections 2024-04-01T06:54:25.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:25.874+0000 7f0f2cca9700 1 -- 172.21.15.83:0/2738206981 wait complete. 2024-04-01T06:54:25.886 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-01T06:54:25.886 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-01T06:54:26.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:26.014+0000 7f78cb776700 1 -- 172.21.15.83:0/3244979349 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78c40ff020 msgr2=0x7f78c40ff440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:26.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:26.014+0000 7f78cb776700 1 --2- 172.21.15.83:0/3244979349 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78c40ff020 0x7f78c40ff440 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f78c0009990 tx=0x7f78c0009ca0 comp rx=0 tx=0).stop 2024-04-01T06:54:26.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:26.014+0000 7f78cb776700 1 -- 172.21.15.83:0/3244979349 shutdown_connections 2024-04-01T06:54:26.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:26.014+0000 7f78cb776700 1 --2- 172.21.15.83:0/3244979349 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78c40ff020 0x7f78c40ff440 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:26.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:26.014+0000 7f78cb776700 1 --2- 172.21.15.83:0/3244979349 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78c4102990 0x7f78c4109240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:26.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:26.014+0000 7f78cb776700 1 --2- 172.21.15.83:0/3244979349 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f78c4101ff0 0x7f78c4102450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:26.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:26.014+0000 7f78cb776700 1 -- 172.21.15.83:0/3244979349 >> 172.21.15.83:0/3244979349 conn(0x7f78c40fa950 msgr2=0x7f78c40fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:26.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:26.014+0000 7f78cb776700 1 -- 172.21.15.83:0/3244979349 shutdown_connections 2024-04-01T06:54:26.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:26.014+0000 7f78cb776700 1 -- 172.21.15.83:0/3244979349 wait complete. 2024-04-01T06:54:26.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:26.014+0000 7f78cb776700 1 Processor -- start 2024-04-01T06:54:26.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:26.014+0000 7f78cb776700 1 -- start start 2024-04-01T06:54:26.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:26.014+0000 7f78cb776700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78c40ff020 0x7f78c4101910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:26.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:26.014+0000 7f78cb776700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78c4101ff0 0x7f78c40fffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:26.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:26.014+0000 7f78cb776700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f78c4102990 0x7f78c41004e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:26.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:26.014+0000 7f78cb776700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c4100c80 con 0x7f78c4101ff0 2024-04-01T06:54:26.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:26.014+0000 7f78cb776700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c4100df0 con 0x7f78c4102990 2024-04-01T06:54:26.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:26.014+0000 7f78cb776700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c41a0e30 con 0x7f78c40ff020 2024-04-01T06:54:26.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:26.014+0000 7f78c8d11700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78c4101ff0 0x7f78c40fffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:26.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:26.015+0000 7f78c8d11700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78c4101ff0 0x7f78c40fffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:49406/0 (socket says 172.21.15.83:49406) 2024-04-01T06:54:26.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:26.015+0000 7f78c8d11700 1 -- 172.21.15.83:0/2637403956 learned_addr learned my addr 172.21.15.83:0/2637403956 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:54:26.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:26.015+0000 7f78c9512700 1 --2- 172.21.15.83:0/2637403956 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78c40ff020 0x7f78c4101910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:26.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:26.015+0000 7f78c8d11700 1 -- 172.21.15.83:0/2637403956 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78c40ff020 msgr2=0x7f78c4101910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:26.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:26.015+0000 7f78c8d11700 1 --2- 172.21.15.83:0/2637403956 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78c40ff020 0x7f78c4101910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:26.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:26.015+0000 7f78c8d11700 1 -- 172.21.15.83:0/2637403956 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f78c4102990 msgr2=0x7f78c41004e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:26.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:26.015+0000 7f78c9d13700 1 --2- 172.21.15.83:0/2637403956 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f78c4102990 0x7f78c41004e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:26.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:26.015+0000 7f78c8d11700 1 --2- 172.21.15.83:0/2637403956 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f78c4102990 0x7f78c41004e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:26.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:26.015+0000 7f78c8d11700 1 -- 172.21.15.83:0/2637403956 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c00095f0 con 0x7f78c4101ff0 2024-04-01T06:54:26.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:26.015+0000 7f78c9d13700 1 --2- 172.21.15.83:0/2637403956 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f78c4102990 0x7f78c41004e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:54:26.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:26.015+0000 7f78c8d11700 1 --2- 172.21.15.83:0/2637403956 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78c4101ff0 0x7f78c40fffa0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f78b400b530 tx=0x7f78b400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:26.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:26.015+0000 7f78ba7fc700 1 -- 172.21.15.83:0/2637403956 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b4011830 con 0x7f78c4101ff0 2024-04-01T06:54:26.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:26.015+0000 7f78ba7fc700 1 -- 172.21.15.83:0/2637403956 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f78b4011e50 con 0x7f78c4101ff0 2024-04-01T06:54:26.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:26.015+0000 7f78cb776700 1 -- 172.21.15.83:0/2637403956 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78c41a10c0 con 0x7f78c4101ff0 2024-04-01T06:54:26.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:26.015+0000 7f78ba7fc700 1 -- 172.21.15.83:0/2637403956 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b4010e50 con 0x7f78c4101ff0 2024-04-01T06:54:26.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:26.015+0000 7f78cb776700 1 -- 172.21.15.83:0/2637403956 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78c41a15d0 con 0x7f78c4101ff0 2024-04-01T06:54:26.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:26.016+0000 7f78cb776700 1 -- 172.21.15.83:0/2637403956 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78c41082d0 con 0x7f78c4101ff0 2024-04-01T06:54:26.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:26.017+0000 7f78ba7fc700 1 -- 172.21.15.83:0/2637403956 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) v1 ==== 135865+0+0 (secure 0 0 0) 0x7f78b40104f0 con 0x7f78c4101ff0 2024-04-01T06:54:26.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:26.018+0000 7f78ba7fc700 1 --2- 172.21.15.83:0/2637403956 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f78b00a1120 0x7f78b00a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:26.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:26.018+0000 7f78c9512700 1 --2- 172.21.15.83:0/2637403956 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f78b00a1120 0x7f78b00a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:26.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:26.018+0000 7f78ba7fc700 1 -- 172.21.15.83:0/2637403956 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f78b40cbfe0 con 0x7f78c4101ff0 2024-04-01T06:54:26.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:26.018+0000 7f78c9512700 1 --2- 172.21.15.83:0/2637403956 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f78b00a1120 0x7f78b00a35e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f78c000b5c0 tx=0x7f78c0005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:26.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:26.022+0000 7f78ba7fc700 1 -- 172.21.15.83:0/2637403956 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f78b4095b70 con 0x7f78c4101ff0 2024-04-01T06:54:26.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:26.220+0000 7f78cb776700 1 -- 172.21.15.83:0/2637403956 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f78c4067260 con 0x7f78c4101ff0 2024-04-01T06:54:26.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:25 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/3923646512' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T06:54:26.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:25 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:26.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:25 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:26.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:25 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:26.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:25 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:26.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:25 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:26.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:25 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:26.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:25 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:54:26.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:25 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:54:26.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:25 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:26.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:25 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/170345995' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-01T06:54:26.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:25 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/2738206981' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-04-01T06:54:26.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:25 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/3923646512' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T06:54:26.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:25 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:26.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:25 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:26.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:25 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:26.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:25 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:26.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:25 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:26.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:25 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:26.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:25 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:54:26.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:25 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:54:26.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:25 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:26.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:25 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/170345995' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-01T06:54:26.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:25 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/2738206981' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-04-01T06:54:26.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:25 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/3923646512' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T06:54:26.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:25 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:26.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:25 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:26.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:25 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:26.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:25 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:26.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:25 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:26.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:25 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:26.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:25 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:54:26.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:25 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:54:26.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:25 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:54:26.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:25 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/170345995' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-01T06:54:26.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:25 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/2738206981' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-04-01T06:54:26.978 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:26.978+0000 7f78ba7fc700 1 -- 172.21.15.83:0/2637403956 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v76) v1 ==== 138+0+0 (secure 0 0 0) 0x7f78b4099190 con 0x7f78c4101ff0 2024-04-01T06:54:26.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:26.983+0000 7f78cb776700 1 -- 172.21.15.83:0/2637403956 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f78b00a1120 msgr2=0x7f78b00a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:26.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:26.983+0000 7f78cb776700 1 --2- 172.21.15.83:0/2637403956 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f78b00a1120 0x7f78b00a35e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f78c000b5c0 tx=0x7f78c0005fd0 comp rx=0 tx=0).stop 2024-04-01T06:54:26.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:26.983+0000 7f78cb776700 1 -- 172.21.15.83:0/2637403956 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78c4101ff0 msgr2=0x7f78c40fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:26.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:26.983+0000 7f78cb776700 1 --2- 172.21.15.83:0/2637403956 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78c4101ff0 0x7f78c40fffa0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f78b400b530 tx=0x7f78b400b840 comp rx=0 tx=0).stop 2024-04-01T06:54:26.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:26.983+0000 7f78cb776700 1 -- 172.21.15.83:0/2637403956 shutdown_connections 2024-04-01T06:54:26.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:26.983+0000 7f78cb776700 1 --2- 172.21.15.83:0/2637403956 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f78b00a1120 0x7f78b00a35e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:26.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:26.983+0000 7f78cb776700 1 --2- 172.21.15.83:0/2637403956 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f78c4102990 0x7f78c41004e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:26.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:26.983+0000 7f78cb776700 1 --2- 172.21.15.83:0/2637403956 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78c40ff020 0x7f78c4101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:26.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:26.983+0000 7f78cb776700 1 --2- 172.21.15.83:0/2637403956 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78c4101ff0 0x7f78c40fffa0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:26.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:26.983+0000 7f78cb776700 1 -- 172.21.15.83:0/2637403956 >> 172.21.15.83:0/2637403956 conn(0x7f78c40fa950 msgr2=0x7f78c4105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:26.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:26.983+0000 7f78cb776700 1 -- 172.21.15.83:0/2637403956 shutdown_connections 2024-04-01T06:54:26.984 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:26.983+0000 7f78cb776700 1 -- 172.21.15.83:0/2637403956 wait complete. 2024-04-01T06:54:26.984 INFO:teuthology.orchestra.run.smithi083.stderr:pool 'cephfs_metadata' created 2024-04-01T06:54:26.997 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-01T06:54:27.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:27.129+0000 7f04b5680700 1 -- 172.21.15.83:0/3911326980 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f04b00ffc70 msgr2=0x7f04b0100090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:27.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:27.129+0000 7f04b5680700 1 --2- 172.21.15.83:0/3911326980 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f04b00ffc70 0x7f04b0100090 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f04a00099c0 tx=0x7f04a0009cd0 comp rx=0 tx=0).stop 2024-04-01T06:54:27.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:27.129+0000 7f04b5680700 1 -- 172.21.15.83:0/3911326980 shutdown_connections 2024-04-01T06:54:27.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:27.129+0000 7f04b5680700 1 --2- 172.21.15.83:0/3911326980 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f04b00ffc70 0x7f04b0100090 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:27.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:27.129+0000 7f04b5680700 1 --2- 172.21.15.83:0/3911326980 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f04b0101800 0x7f04b01080b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:27.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:27.129+0000 7f04b5680700 1 --2- 172.21.15.83:0/3911326980 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04b0100e60 0x7f04b01012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:27.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:27.129+0000 7f04b5680700 1 -- 172.21.15.83:0/3911326980 >> 172.21.15.83:0/3911326980 conn(0x7f04b00fb200 msgr2=0x7f04b00fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:27.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:27.129+0000 7f04b5680700 1 -- 172.21.15.83:0/3911326980 shutdown_connections 2024-04-01T06:54:27.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:27.129+0000 7f04b5680700 1 -- 172.21.15.83:0/3911326980 wait complete. 2024-04-01T06:54:27.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:27.129+0000 7f04b5680700 1 Processor -- start 2024-04-01T06:54:27.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:27.129+0000 7f04b5680700 1 -- start start 2024-04-01T06:54:27.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:27.130+0000 7f04b5680700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f04b00ffc70 0x7f04b0069d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:27.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:27.130+0000 7f04b5680700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04b0100e60 0x7f04b019ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:27.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:27.130+0000 7f04b5680700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f04b0101800 0x7f04b019e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:27.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:27.130+0000 7f04b5680700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b019e7b0 con 0x7f04b0101800 2024-04-01T06:54:27.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:27.130+0000 7f04b5680700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b019e920 con 0x7f04b00ffc70 2024-04-01T06:54:27.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:27.130+0000 7f04b5680700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b019eae0 con 0x7f04b0100e60 2024-04-01T06:54:27.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:27.130+0000 7f04af7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f04b0101800 0x7f04b019e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:27.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:27.130+0000 7f04af7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f04b0101800 0x7f04b019e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:49414/0 (socket says 172.21.15.83:49414) 2024-04-01T06:54:27.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:27.130+0000 7f04af7fe700 1 -- 172.21.15.83:0/1907359995 learned_addr learned my addr 172.21.15.83:0/1907359995 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:54:27.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:27.130+0000 7f04ae7fc700 1 --2- 172.21.15.83:0/1907359995 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04b0100e60 0x7f04b019ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:27.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:27.130+0000 7f04aeffd700 1 --2- 172.21.15.83:0/1907359995 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f04b00ffc70 0x7f04b0069d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:27.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:27.130+0000 7f04af7fe700 1 -- 172.21.15.83:0/1907359995 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04b0100e60 msgr2=0x7f04b019ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:27.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:27.130+0000 7f04af7fe700 1 --2- 172.21.15.83:0/1907359995 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04b0100e60 0x7f04b019ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:27.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:27.130+0000 7f04af7fe700 1 -- 172.21.15.83:0/1907359995 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f04b00ffc70 msgr2=0x7f04b0069d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:27.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:27.130+0000 7f04af7fe700 1 --2- 172.21.15.83:0/1907359995 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f04b00ffc70 0x7f04b0069d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:27.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:27.130+0000 7f04af7fe700 1 -- 172.21.15.83:0/1907359995 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a00095f0 con 0x7f04b0101800 2024-04-01T06:54:27.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:27.130+0000 7f04ae7fc700 1 --2- 172.21.15.83:0/1907359995 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04b0100e60 0x7f04b019ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:54:27.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:27.130+0000 7f04aeffd700 1 --2- 172.21.15.83:0/1907359995 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f04b00ffc70 0x7f04b0069d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:54:27.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:27.130+0000 7f04af7fe700 1 --2- 172.21.15.83:0/1907359995 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f04b0101800 0x7f04b019e010 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f04a8007ee0 tx=0x7f04a800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:27.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:27.130+0000 7f0497fff700 1 -- 172.21.15.83:0/1907359995 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a8017070 con 0x7f04b0101800 2024-04-01T06:54:27.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:27.130+0000 7f0497fff700 1 -- 172.21.15.83:0/1907359995 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f04a800f040 con 0x7f04b0101800 2024-04-01T06:54:27.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:27.130+0000 7f04b5680700 1 -- 172.21.15.83:0/1907359995 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04b019edc0 con 0x7f04b0101800 2024-04-01T06:54:27.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:27.130+0000 7f0497fff700 1 -- 172.21.15.83:0/1907359995 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a8005740 con 0x7f04b0101800 2024-04-01T06:54:27.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:27.130+0000 7f04b5680700 1 -- 172.21.15.83:0/1907359995 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04b019f270 con 0x7f04b0101800 2024-04-01T06:54:27.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:27.131+0000 7f04b5680700 1 -- 172.21.15.83:0/1907359995 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04b0107160 con 0x7f04b0101800 2024-04-01T06:54:27.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:27.133+0000 7f0497fff700 1 -- 172.21.15.83:0/1907359995 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) v1 ==== 135865+0+0 (secure 0 0 0) 0x7f04a80058a0 con 0x7f04b0101800 2024-04-01T06:54:27.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:27.133+0000 7f0497fff700 1 --2- 172.21.15.83:0/1907359995 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f04980a11a0 0x7f04980a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:27.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:27.133+0000 7f0497fff700 1 -- 172.21.15.83:0/1907359995 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 7497+0+0 (secure 0 0 0) 0x7f04a80cc440 con 0x7f04b0101800 2024-04-01T06:54:27.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:27.133+0000 7f04aeffd700 1 --2- 172.21.15.83:0/1907359995 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f04980a11a0 0x7f04980a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:27.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:27.134+0000 7f04aeffd700 1 --2- 172.21.15.83:0/1907359995 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f04980a11a0 0x7f04980a3660 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f04a0006010 tx=0x7f04a0009530 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:27.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:27.137+0000 7f0497fff700 1 -- 172.21.15.83:0/1907359995 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f04a8095f00 con 0x7f04b0101800 2024-04-01T06:54:27.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:26 smithi145 ceph-mon[47816]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T06:54:27.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:26 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/2637403956' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-01T06:54:27.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:26 smithi083 ceph-mon[43429]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T06:54:27.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:26 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/2637403956' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-01T06:54:27.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:27.335+0000 7f04b5680700 1 -- 172.21.15.83:0/1907359995 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f04b010b590 con 0x7f04b0101800 2024-04-01T06:54:27.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:26 smithi153 ceph-mon[48187]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T06:54:27.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:26 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/2637403956' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-01T06:54:27.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:27.979+0000 7f0497fff700 1 -- 172.21.15.83:0/1907359995 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v77) v1 ==== 170+0+0 (secure 0 0 0) 0x7f04a8099520 con 0x7f04b0101800 2024-04-01T06:54:27.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:27.986+0000 7f04b5680700 1 -- 172.21.15.83:0/1907359995 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f04980a11a0 msgr2=0x7f04980a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:27.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:27.986+0000 7f04b5680700 1 --2- 172.21.15.83:0/1907359995 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f04980a11a0 0x7f04980a3660 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f04a0006010 tx=0x7f04a0009530 comp rx=0 tx=0).stop 2024-04-01T06:54:27.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:27.986+0000 7f04b5680700 1 -- 172.21.15.83:0/1907359995 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f04b0101800 msgr2=0x7f04b019e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:27.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:27.986+0000 7f04b5680700 1 --2- 172.21.15.83:0/1907359995 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f04b0101800 0x7f04b019e010 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f04a8007ee0 tx=0x7f04a800d3b0 comp rx=0 tx=0).stop 2024-04-01T06:54:27.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:27.994+0000 7f04b5680700 1 -- 172.21.15.83:0/1907359995 shutdown_connections 2024-04-01T06:54:27.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:27.994+0000 7f04b5680700 1 --2- 172.21.15.83:0/1907359995 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f04b0101800 0x7f04b019e010 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:27.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:27.994+0000 7f04b5680700 1 --2- 172.21.15.83:0/1907359995 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f04980a11a0 0x7f04980a3660 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:27.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:27.994+0000 7f04b5680700 1 --2- 172.21.15.83:0/1907359995 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f04b00ffc70 0x7f04b0069d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:27.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:27.994+0000 7f04b5680700 1 --2- 172.21.15.83:0/1907359995 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04b0100e60 0x7f04b019ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:27.994 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:27.994+0000 7f04b5680700 1 -- 172.21.15.83:0/1907359995 >> 172.21.15.83:0/1907359995 conn(0x7f04b00fb200 msgr2=0x7f04b01042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:27.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:27.998+0000 7f04b5680700 1 -- 172.21.15.83:0/1907359995 shutdown_connections 2024-04-01T06:54:27.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:27.999+0000 7f04b5680700 1 -- 172.21.15.83:0/1907359995 wait complete. 2024-04-01T06:54:27.999 INFO:teuthology.orchestra.run.smithi083.stderr:pool 'cephfs_data' created 2024-04-01T06:54:28.014 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-01T06:54:28.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.140+0000 7f6d06d69700 1 -- 172.21.15.83:0/2327803553 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d001017e0 msgr2=0x7f6d00103bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:28.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.140+0000 7f6d06d69700 1 --2- 172.21.15.83:0/2327803553 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d001017e0 0x7f6d00103bd0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4009990 tx=0x7f6cf4009ca0 comp rx=0 tx=0).stop 2024-04-01T06:54:28.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.140+0000 7f6d06d69700 1 -- 172.21.15.83:0/2327803553 shutdown_connections 2024-04-01T06:54:28.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.140+0000 7f6d06d69700 1 --2- 172.21.15.83:0/2327803553 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d001017e0 0x7f6d00103bd0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:28.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.140+0000 7f6d06d69700 1 --2- 172.21.15.83:0/2327803553 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6d00106a40 0x7f6d00108eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:28.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.140+0000 7f6d06d69700 1 --2- 172.21.15.83:0/2327803553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d00104110 0x7f6d00106500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:28.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.140+0000 7f6d06d69700 1 -- 172.21.15.83:0/2327803553 >> 172.21.15.83:0/2327803553 conn(0x7f6d000fb1d0 msgr2=0x7f6d000fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:28.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.140+0000 7f6d06d69700 1 -- 172.21.15.83:0/2327803553 shutdown_connections 2024-04-01T06:54:28.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.140+0000 7f6d06d69700 1 -- 172.21.15.83:0/2327803553 wait complete. 2024-04-01T06:54:28.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.141+0000 7f6d06d69700 1 Processor -- start 2024-04-01T06:54:28.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.141+0000 7f6d06d69700 1 -- start start 2024-04-01T06:54:28.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.141+0000 7f6d06d69700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6d001017e0 0x7f6d00196cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:28.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.141+0000 7f6d06d69700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d00104110 0x7f6d001971f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:28.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.141+0000 7f6d06d69700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d00106a40 0x7f6d0019e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:28.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.141+0000 7f6d06d69700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0019e7a0 con 0x7f6d00104110 2024-04-01T06:54:28.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.141+0000 7f6d06d69700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0019e910 con 0x7f6d001017e0 2024-04-01T06:54:28.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.141+0000 7f6d06d69700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0019ead0 con 0x7f6d00106a40 2024-04-01T06:54:28.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.141+0000 7f6d04b05700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6d001017e0 0x7f6d00196cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:28.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.141+0000 7f6d04b05700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6d001017e0 0x7f6d00196cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.83:47886/0 (socket says 172.21.15.83:47886) 2024-04-01T06:54:28.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.141+0000 7f6d04b05700 1 -- 172.21.15.83:0/3375286648 learned_addr learned my addr 172.21.15.83:0/3375286648 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:54:28.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.141+0000 7f6cfffff700 1 --2- 172.21.15.83:0/3375286648 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d00104110 0x7f6d001971f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:28.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.142+0000 7f6d05306700 1 --2- 172.21.15.83:0/3375286648 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d00106a40 0x7f6d0019e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:28.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.142+0000 7f6d04b05700 1 -- 172.21.15.83:0/3375286648 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d00106a40 msgr2=0x7f6d0019e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:28.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.142+0000 7f6d04b05700 1 --2- 172.21.15.83:0/3375286648 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d00106a40 0x7f6d0019e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:28.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.142+0000 7f6d04b05700 1 -- 172.21.15.83:0/3375286648 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d00104110 msgr2=0x7f6d001971f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:28.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.142+0000 7f6d04b05700 1 --2- 172.21.15.83:0/3375286648 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d00104110 0x7f6d001971f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:28.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.142+0000 7f6d04b05700 1 -- 172.21.15.83:0/3375286648 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf40095f0 con 0x7f6d001017e0 2024-04-01T06:54:28.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.142+0000 7f6cfffff700 1 --2- 172.21.15.83:0/3375286648 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d00104110 0x7f6d001971f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T06:54:28.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.142+0000 7f6d04b05700 1 --2- 172.21.15.83:0/3375286648 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6d001017e0 0x7f6d00196cb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4000c00 tx=0x7f6cf4004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:28.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.142+0000 7f6cfdffb700 1 -- 172.21.15.83:0/3375286648 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf401d070 con 0x7f6d001017e0 2024-04-01T06:54:28.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.142+0000 7f6cfdffb700 1 -- 172.21.15.83:0/3375286648 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6cf40054f0 con 0x7f6d001017e0 2024-04-01T06:54:28.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.142+0000 7f6d06d69700 1 -- 172.21.15.83:0/3375286648 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d0019ed50 con 0x7f6d001017e0 2024-04-01T06:54:28.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.142+0000 7f6cfdffb700 1 -- 172.21.15.83:0/3375286648 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf4004cd0 con 0x7f6d001017e0 2024-04-01T06:54:28.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.142+0000 7f6d06d69700 1 -- 172.21.15.83:0/3375286648 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d0019f110 con 0x7f6d001017e0 2024-04-01T06:54:28.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.143+0000 7f6d06d69700 1 -- 172.21.15.83:0/3375286648 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d000fcd50 con 0x7f6d001017e0 2024-04-01T06:54:28.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.144+0000 7f6cfdffb700 1 -- 172.21.15.83:0/3375286648 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 16) v1 ==== 135865+0+0 (secure 0 0 0) 0x7f6cf400fc40 con 0x7f6d001017e0 2024-04-01T06:54:28.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.145+0000 7f6cfdffb700 1 --2- 172.21.15.83:0/3375286648 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f6cf00a1120 0x7f6cf00a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:28.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.145+0000 7f6cfffff700 1 --2- 172.21.15.83:0/3375286648 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f6cf00a1120 0x7f6cf00a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:28.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.145+0000 7f6cfdffb700 1 -- 172.21.15.83:0/3375286648 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 7879+0+0 (secure 0 0 0) 0x7f6cf40ce130 con 0x7f6d001017e0 2024-04-01T06:54:28.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.145+0000 7f6cfffff700 1 --2- 172.21.15.83:0/3375286648 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f6cf00a1120 0x7f6cf00a35e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6cec011490 tx=0x7f6cec009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:28.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.149+0000 7f6cfdffb700 1 -- 172.21.15.83:0/3375286648 <== mon.2 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f6cf4097a60 con 0x7f6d001017e0 2024-04-01T06:54:28.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:28 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/2637403956' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-04-01T06:54:28.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:28 smithi145 ceph-mon[47816]: osdmap e76: 12 total, 12 up, 12 in 2024-04-01T06:54:28.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:28 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/1907359995' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-04-01T06:54:28.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:28 smithi145 ceph-mon[47816]: pgmap v213: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T06:54:28.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:28 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/1907359995' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-04-01T06:54:28.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:28 smithi145 ceph-mon[47816]: osdmap e77: 12 total, 12 up, 12 in 2024-04-01T06:54:28.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:28 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/2637403956' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-04-01T06:54:28.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:28 smithi083 ceph-mon[43429]: osdmap e76: 12 total, 12 up, 12 in 2024-04-01T06:54:28.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:28 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/1907359995' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-04-01T06:54:28.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:28 smithi083 ceph-mon[43429]: pgmap v213: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T06:54:28.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:28 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/1907359995' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-04-01T06:54:28.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:28 smithi083 ceph-mon[43429]: osdmap e77: 12 total, 12 up, 12 in 2024-04-01T06:54:28.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:28 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/2637403956' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-04-01T06:54:28.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:28 smithi153 ceph-mon[48187]: osdmap e76: 12 total, 12 up, 12 in 2024-04-01T06:54:28.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:28 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/1907359995' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-04-01T06:54:28.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:28 smithi153 ceph-mon[48187]: pgmap v213: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T06:54:28.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:28 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/1907359995' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-04-01T06:54:28.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:28 smithi153 ceph-mon[48187]: osdmap e77: 12 total, 12 up, 12 in 2024-04-01T06:54:28.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.394+0000 7f6d06d69700 1 -- 172.21.15.83:0/3375286648 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f6d00067af0 con 0x7f6d001017e0 2024-04-01T06:54:28.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.404+0000 7f6cfdffb700 1 -- 172.21.15.83:0/3375286648 <== mon.2 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f6cf4004e30 con 0x7f6d001017e0 2024-04-01T06:54:28.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.408+0000 7f6d06d69700 1 -- 172.21.15.83:0/3375286648 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f6cf00a1120 msgr2=0x7f6cf00a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:28.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.408+0000 7f6d06d69700 1 --2- 172.21.15.83:0/3375286648 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f6cf00a1120 0x7f6cf00a35e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6cec011490 tx=0x7f6cec009260 comp rx=0 tx=0).stop 2024-04-01T06:54:28.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.408+0000 7f6d06d69700 1 -- 172.21.15.83:0/3375286648 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6d001017e0 msgr2=0x7f6d00196cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:28.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.408+0000 7f6d06d69700 1 --2- 172.21.15.83:0/3375286648 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6d001017e0 0x7f6d00196cb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4000c00 tx=0x7f6cf4004730 comp rx=0 tx=0).stop 2024-04-01T06:54:28.409 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.410+0000 7f6d06d69700 1 -- 172.21.15.83:0/3375286648 shutdown_connections 2024-04-01T06:54:28.409 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.410+0000 7f6d06d69700 1 --2- 172.21.15.83:0/3375286648 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f6cf00a1120 0x7f6cf00a35e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:28.409 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.410+0000 7f6d06d69700 1 --2- 172.21.15.83:0/3375286648 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d00106a40 0x7f6d0019e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:28.409 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.410+0000 7f6d06d69700 1 --2- 172.21.15.83:0/3375286648 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6d001017e0 0x7f6d00196cb0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:28.409 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.410+0000 7f6d06d69700 1 --2- 172.21.15.83:0/3375286648 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6d00104110 0x7f6d001971f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:28.409 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.410+0000 7f6d06d69700 1 -- 172.21.15.83:0/3375286648 >> 172.21.15.83:0/3375286648 conn(0x7f6d000fb1d0 msgr2=0x7f6d001036a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:28.411 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.411+0000 7f6d06d69700 1 -- 172.21.15.83:0/3375286648 shutdown_connections 2024-04-01T06:54:28.411 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.411+0000 7f6d06d69700 1 -- 172.21.15.83:0/3375286648 wait complete. 2024-04-01T06:54:28.413 INFO:teuthology.orchestra.run.smithi083.stderr:new fs with metadata pool 2 and data pool 3 2024-04-01T06:54:28.431 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T06:54:28.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.553+0000 7f4da0d42700 1 -- 172.21.15.83:0/1373970429 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d9c100d50 msgr2=0x7f4d9c1011b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:28.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.553+0000 7f4da0d42700 1 --2- 172.21.15.83:0/1373970429 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d9c100d50 0x7f4d9c1011b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c0099c0 tx=0x7f4d8c009cd0 comp rx=0 tx=0).stop 2024-04-01T06:54:28.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.553+0000 7f4da0d42700 1 -- 172.21.15.83:0/1373970429 shutdown_connections 2024-04-01T06:54:28.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.553+0000 7f4da0d42700 1 --2- 172.21.15.83:0/1373970429 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4d9c1016f0 0x7f4d9c107fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:28.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.553+0000 7f4da0d42700 1 --2- 172.21.15.83:0/1373970429 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d9c0ffb60 0x7f4d9c0fff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:28.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.553+0000 7f4da0d42700 1 --2- 172.21.15.83:0/1373970429 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d9c100d50 0x7f4d9c1011b0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:28.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.553+0000 7f4da0d42700 1 -- 172.21.15.83:0/1373970429 >> 172.21.15.83:0/1373970429 conn(0x7f4d9c0fb0d0 msgr2=0x7f4d9c0fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:28.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.553+0000 7f4da0d42700 1 -- 172.21.15.83:0/1373970429 shutdown_connections 2024-04-01T06:54:28.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.553+0000 7f4da0d42700 1 -- 172.21.15.83:0/1373970429 wait complete. 2024-04-01T06:54:28.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.554+0000 7f4da0d42700 1 Processor -- start 2024-04-01T06:54:28.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.554+0000 7f4da0d42700 1 -- start start 2024-04-01T06:54:28.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.554+0000 7f4da0d42700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4d9c0ffb60 0x7f4d9c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:28.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.554+0000 7f4da0d42700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d9c100d50 0x7f4d9c19b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:28.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.554+0000 7f4da0d42700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d9c1016f0 0x7f4d9c19de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:28.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.554+0000 7f4da0d42700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9c19e670 con 0x7f4d9c100d50 2024-04-01T06:54:28.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.554+0000 7f4da0d42700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9c19e7e0 con 0x7f4d9c0ffb60 2024-04-01T06:54:28.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.554+0000 7f4da0d42700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9c19e9a0 con 0x7f4d9c1016f0 2024-04-01T06:54:28.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.554+0000 7f4d99d9b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d9c100d50 0x7f4d9c19b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:28.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.554+0000 7f4d99d9b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d9c100d50 0x7f4d9c19b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:49444/0 (socket says 172.21.15.83:49444) 2024-04-01T06:54:28.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.554+0000 7f4d99d9b700 1 -- 172.21.15.83:0/2962098243 learned_addr learned my addr 172.21.15.83:0/2962098243 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:54:28.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.555+0000 7f4d9a59c700 1 --2- 172.21.15.83:0/2962098243 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4d9c0ffb60 0x7f4d9c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:28.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.555+0000 7f4d9ad9d700 1 --2- 172.21.15.83:0/2962098243 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d9c1016f0 0x7f4d9c19de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:28.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.555+0000 7f4d99d9b700 1 -- 172.21.15.83:0/2962098243 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d9c1016f0 msgr2=0x7f4d9c19de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:28.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.555+0000 7f4d99d9b700 1 --2- 172.21.15.83:0/2962098243 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d9c1016f0 0x7f4d9c19de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:28.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.555+0000 7f4d99d9b700 1 -- 172.21.15.83:0/2962098243 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4d9c0ffb60 msgr2=0x7f4d9c068930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:28.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.555+0000 7f4d99d9b700 1 --2- 172.21.15.83:0/2962098243 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4d9c0ffb60 0x7f4d9c068930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:28.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.555+0000 7f4d99d9b700 1 -- 172.21.15.83:0/2962098243 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d8c0095f0 con 0x7f4d9c100d50 2024-04-01T06:54:28.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.555+0000 7f4d99d9b700 1 --2- 172.21.15.83:0/2962098243 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d9c100d50 0x7f4d9c19b860 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c0036f0 tx=0x7f4d8c003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:28.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.555+0000 7f4d8b7fe700 1 -- 172.21.15.83:0/2962098243 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c01d070 con 0x7f4d9c100d50 2024-04-01T06:54:28.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.555+0000 7f4da0d42700 1 -- 172.21.15.83:0/2962098243 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d9c19ebc0 con 0x7f4d9c100d50 2024-04-01T06:54:28.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.555+0000 7f4d8b7fe700 1 -- 172.21.15.83:0/2962098243 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4d8c022470 con 0x7f4d9c100d50 2024-04-01T06:54:28.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.555+0000 7f4d8b7fe700 1 -- 172.21.15.83:0/2962098243 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c00f6e0 con 0x7f4d9c100d50 2024-04-01T06:54:28.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.555+0000 7f4da0d42700 1 -- 172.21.15.83:0/2962098243 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d9c19f0c0 con 0x7f4d9c100d50 2024-04-01T06:54:28.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.556+0000 7f4da0d42700 1 -- 172.21.15.83:0/2962098243 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d9c106f90 con 0x7f4d9c100d50 2024-04-01T06:54:28.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.557+0000 7f4d8b7fe700 1 -- 172.21.15.83:0/2962098243 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) v1 ==== 135865+0+0 (secure 0 0 0) 0x7f4d8c022890 con 0x7f4d9c100d50 2024-04-01T06:54:28.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.557+0000 7f4d8b7fe700 1 --2- 172.21.15.83:0/2962098243 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f4d840a1120 0x7f4d840a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:28.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.558+0000 7f4d9a59c700 1 --2- 172.21.15.83:0/2962098243 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f4d840a1120 0x7f4d840a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:28.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.558+0000 7f4d8b7fe700 1 -- 172.21.15.83:0/2962098243 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f4d8c0cde60 con 0x7f4d9c100d50 2024-04-01T06:54:28.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.558+0000 7f4d9a59c700 1 --2- 172.21.15.83:0/2962098243 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f4d840a1120 0x7f4d840a35e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4d90005fd0 tx=0x7f4d90005dd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:28.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.561+0000 7f4d8b7fe700 1 -- 172.21.15.83:0/2962098243 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f4d8c097730 con 0x7f4d9c100d50 2024-04-01T06:54:28.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.767+0000 7f4da0d42700 1 -- 172.21.15.83:0/2962098243 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4d9c10b370 con 0x7f4d9c100d50 2024-04-01T06:54:28.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.769+0000 7f4d8b7fe700 1 -- 172.21.15.83:0/2962098243 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+22144 (secure 0 0 0) 0x7f4d8c09ad50 con 0x7f4d9c100d50 2024-04-01T06:54:28.769 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:54:28.769 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":78,"fsid":"c6f8eff4-eff3-11ee-b647-cb9ed24678a4","created":"2024-04-01T06:48:42.033382+0000","modified":"2024-04-01T06:54:28.396676+0000","last_up_change":"2024-04-01T06:53:55.791339+0000","last_in_change":"2024-04-01T06:53:39.777214+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T06:51:21.963996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T06:54:26.450403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T06:54:27.564928+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"90b761b0-b06c-4142-854d-38ee42aa6052","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6803","nonce":3253845390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6805","nonce":3253845390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6809","nonce":3253845390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6807","nonce":3253845390}]},"public_addr":"172.21.15.83:6803/3253845390","cluster_addr":"172.21.15.83:6805/3253845390","heartbeat_back_addr":"172.21.15.83:6809/3253845390","heartbeat_front_addr":"172.21.15.83:6807/3253845390","state":["exists","up"]},{"osd":1,"uuid":"4d6ab85b-7088-451e-a829-c9119f35dee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6801","nonce":515889759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6803","nonce":515889759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6807","nonce":515889759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6805","nonce":515889759}]},"public_addr":"172.21.15.145:6801/515889759","cluster_addr":"172.21.15.145:6803/515889759","heartbeat_back_addr":"172.21.15.145:6807/515889759","heartbeat_front_addr":"172.21.15.145:6805/515889759","state":["exists","up"]},{"osd":2,"uuid":"d04c27f3-4972-4061-8bfb-5060645e3883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6801","nonce":3318516728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6803","nonce":3318516728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6807","nonce":3318516728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6805","nonce":3318516728}]},"public_addr":"172.21.15.153:6801/3318516728","cluster_addr":"172.21.15.153:6803/3318516728","heartbeat_back_addr":"172.21.15.153:6807/3318516728","heartbeat_front_addr":"172.21.15.153:6805/3318516728","state":["exists","up"]},{"osd":3,"uuid":"899b6c90-8f2f-44dd-b807-49594aadb443","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6811","nonce":504690234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6813","nonce":504690234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6817","nonce":504690234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6815","nonce":504690234}]},"public_addr":"172.21.15.83:6811/504690234","cluster_addr":"172.21.15.83:6813/504690234","heartbeat_back_addr":"172.21.15.83:6817/504690234","heartbeat_front_addr":"172.21.15.83:6815/504690234","state":["exists","up"]},{"osd":4,"uuid":"5071dd81-804e-4358-bfb6-11e718e9cf4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6809","nonce":2099824730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6811","nonce":2099824730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6815","nonce":2099824730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6813","nonce":2099824730}]},"public_addr":"172.21.15.145:6809/2099824730","cluster_addr":"172.21.15.145:6811/2099824730","heartbeat_back_addr":"172.21.15.145:6815/2099824730","heartbeat_front_addr":"172.21.15.145:6813/2099824730","state":["exists","up"]},{"osd":5,"uuid":"b8442b71-c26e-467f-b0c3-ea9f636f5a00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6809","nonce":3340941443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6811","nonce":3340941443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6815","nonce":3340941443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6813","nonce":3340941443}]},"public_addr":"172.21.15.153:6809/3340941443","cluster_addr":"172.21.15.153:6811/3340941443","heartbeat_back_addr":"172.21.15.153:6815/3340941443","heartbeat_front_addr":"172.21.15.153:6813/3340941443","state":["exists","up"]},{"osd":6,"uuid":"c26bb8cb-ccee-4bfc-91eb-14e1ad8e04df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6819","nonce":2005485079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6821","nonce":2005485079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6825","nonce":2005485079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6823","nonce":2005485079}]},"public_addr":"172.21.15.83:6819/2005485079","cluster_addr":"172.21.15.83:6821/2005485079","heartbeat_back_addr":"172.21.15.83:6825/2005485079","heartbeat_front_addr":"172.21.15.83:6823/2005485079","state":["exists","up"]},{"osd":7,"uuid":"a8940da2-0e79-4606-8d1e-d425afbf5753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6817","nonce":3737505059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6819","nonce":3737505059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6823","nonce":3737505059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6821","nonce":3737505059}]},"public_addr":"172.21.15.145:6817/3737505059","cluster_addr":"172.21.15.145:6819/3737505059","heartbeat_back_addr":"172.21.15.145:6823/3737505059","heartbeat_front_addr":"172.21.15.145:6821/3737505059","state":["exists","up"]},{"osd":8,"uuid":"602d43ac-a189-4da3-9e38-7025d14e0dd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6817","nonce":1031545791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6819","nonce":1031545791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6823","nonce":1031545791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6821","nonce":1031545791}]},"public_addr":"172.21.15.153:6817/1031545791","cluster_addr":"172.21.15.153:6819/1031545791","heartbeat_back_addr":"172.21.15.153:6823/1031545791","heartbeat_front_addr":"172.21.15.153:6821/1031545791","state":["exists","up"]},{"osd":9,"uuid":"08b12d27-1247-45e4-9d09-cacc0fce4bd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6827","nonce":3720996673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6829","nonce":3720996673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6833","nonce":3720996673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6831","nonce":3720996673}]},"public_addr":"172.21.15.83:6827/3720996673","cluster_addr":"172.21.15.83:6829/3720996673","heartbeat_back_addr":"172.21.15.83:6833/3720996673","heartbeat_front_addr":"172.21.15.83:6831/3720996673","state":["exists","up"]},{"osd":10,"uuid":"dd986b50-d68f-446c-9c66-261535880879","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6825","nonce":2671529479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6827","nonce":2671529479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6831","nonce":2671529479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6829","nonce":2671529479}]},"public_addr":"172.21.15.145:6825/2671529479","cluster_addr":"172.21.15.145:6827/2671529479","heartbeat_back_addr":"172.21.15.145:6831/2671529479","heartbeat_front_addr":"172.21.15.145:6829/2671529479","state":["exists","up"]},{"osd":11,"uuid":"d20a49cd-6224-4424-8375-46da791d9931","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6825","nonce":2342548429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6827","nonce":2342548429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6831","nonce":2342548429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6829","nonce":2342548429}]},"public_addr":"172.21.15.153:6825/2342548429","cluster_addr":"172.21.15.153:6827/2342548429","heartbeat_back_addr":"172.21.15.153:6831/2342548429","heartbeat_front_addr":"172.21.15.153:6829/2342548429","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:50:44.539932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:01.990470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:19.054426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:36.616393+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:53.896705+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:10.667502+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:27.880849+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:45.276308+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:02.280615+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:19.555547+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:37.062881+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:54.191589+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.83:6801/1867137261":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/2596683931":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/2125339627":"2024-04-02T06:49:33.656125+0000","172.21.15.83:6800/1644397953":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/690500472":"2024-04-02T06:49:13.456026+0000","172.21.15.83:6801/1644397953":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/785958951":"2024-04-02T06:49:33.656125+0000","172.21.15.83:6800/1867137261":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/2222527447":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/2071592157":"2024-04-02T06:49:13.456026+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T06:54:28.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.771+0000 7f4da0d42700 1 -- 172.21.15.83:0/2962098243 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f4d840a1120 msgr2=0x7f4d840a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:28.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.771+0000 7f4da0d42700 1 --2- 172.21.15.83:0/2962098243 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f4d840a1120 0x7f4d840a35e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4d90005fd0 tx=0x7f4d90005dd0 comp rx=0 tx=0).stop 2024-04-01T06:54:28.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.771+0000 7f4da0d42700 1 -- 172.21.15.83:0/2962098243 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d9c100d50 msgr2=0x7f4d9c19b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:28.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.771+0000 7f4da0d42700 1 --2- 172.21.15.83:0/2962098243 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d9c100d50 0x7f4d9c19b860 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c0036f0 tx=0x7f4d8c003970 comp rx=0 tx=0).stop 2024-04-01T06:54:28.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.771+0000 7f4da0d42700 1 -- 172.21.15.83:0/2962098243 shutdown_connections 2024-04-01T06:54:28.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.771+0000 7f4da0d42700 1 --2- 172.21.15.83:0/2962098243 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f4d840a1120 0x7f4d840a35e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:28.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.771+0000 7f4da0d42700 1 --2- 172.21.15.83:0/2962098243 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d9c1016f0 0x7f4d9c19de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:28.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.771+0000 7f4da0d42700 1 --2- 172.21.15.83:0/2962098243 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4d9c0ffb60 0x7f4d9c068930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:28.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.771+0000 7f4da0d42700 1 --2- 172.21.15.83:0/2962098243 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d9c100d50 0x7f4d9c19b860 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:28.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.771+0000 7f4da0d42700 1 -- 172.21.15.83:0/2962098243 >> 172.21.15.83:0/2962098243 conn(0x7f4d9c0fb0d0 msgr2=0x7f4d9c1040d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:28.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.771+0000 7f4da0d42700 1 -- 172.21.15.83:0/2962098243 shutdown_connections 2024-04-01T06:54:28.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.771+0000 7f4da0d42700 1 -- 172.21.15.83:0/2962098243 wait complete. 2024-04-01T06:54:28.783 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T06:54:28.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.906+0000 7f5640a9e700 1 -- 172.21.15.83:0/616285917 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f563c0fef60 msgr2=0x7f563c0ff380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:28.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.906+0000 7f5640a9e700 1 --2- 172.21.15.83:0/616285917 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f563c0fef60 0x7f563c0ff380 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5630009990 tx=0x7f5630009ca0 comp rx=0 tx=0).stop 2024-04-01T06:54:28.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.906+0000 7f5640a9e700 1 -- 172.21.15.83:0/616285917 shutdown_connections 2024-04-01T06:54:28.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.906+0000 7f5640a9e700 1 --2- 172.21.15.83:0/616285917 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f563c0fef60 0x7f563c0ff380 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:28.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.906+0000 7f5640a9e700 1 --2- 172.21.15.83:0/616285917 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f563c1028d0 0x7f563c109180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:28.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.906+0000 7f5640a9e700 1 --2- 172.21.15.83:0/616285917 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f563c101f30 0x7f563c102390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:28.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.906+0000 7f5640a9e700 1 -- 172.21.15.83:0/616285917 >> 172.21.15.83:0/616285917 conn(0x7f563c0fa890 msgr2=0x7f563c0fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:28.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.907+0000 7f5640a9e700 1 -- 172.21.15.83:0/616285917 shutdown_connections 2024-04-01T06:54:28.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.907+0000 7f5640a9e700 1 -- 172.21.15.83:0/616285917 wait complete. 2024-04-01T06:54:28.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.907+0000 7f5640a9e700 1 Processor -- start 2024-04-01T06:54:28.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.907+0000 7f5640a9e700 1 -- start start 2024-04-01T06:54:28.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.908+0000 7f5640a9e700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f563c0fef60 0x7f563c196c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:28.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.908+0000 7f5640a9e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f563c101f30 0x7f563c197170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:28.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.908+0000 7f5640a9e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f563c1028d0 0x7f563c19e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:28.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.908+0000 7f5640a9e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f563c19e760 con 0x7f563c1028d0 2024-04-01T06:54:28.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.908+0000 7f5640a9e700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f563c19e8a0 con 0x7f563c0fef60 2024-04-01T06:54:28.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.908+0000 7f5640a9e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f563c19ea30 con 0x7f563c101f30 2024-04-01T06:54:28.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.908+0000 7f563ad9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f563c1028d0 0x7f563c19e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:28.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.908+0000 7f563ad9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f563c1028d0 0x7f563c19e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:49476/0 (socket says 172.21.15.83:49476) 2024-04-01T06:54:28.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.908+0000 7f563ad9d700 1 -- 172.21.15.83:0/2792957093 learned_addr learned my addr 172.21.15.83:0/2792957093 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:54:28.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.908+0000 7f5639d9b700 1 --2- 172.21.15.83:0/2792957093 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f563c101f30 0x7f563c197170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:28.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.908+0000 7f563a59c700 1 --2- 172.21.15.83:0/2792957093 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f563c0fef60 0x7f563c196c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:28.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.908+0000 7f563ad9d700 1 -- 172.21.15.83:0/2792957093 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f563c101f30 msgr2=0x7f563c197170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:28.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.908+0000 7f563ad9d700 1 --2- 172.21.15.83:0/2792957093 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f563c101f30 0x7f563c197170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:28.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.908+0000 7f563ad9d700 1 -- 172.21.15.83:0/2792957093 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f563c0fef60 msgr2=0x7f563c196c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:28.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.908+0000 7f563ad9d700 1 --2- 172.21.15.83:0/2792957093 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f563c0fef60 0x7f563c196c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:28.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.908+0000 7f563ad9d700 1 -- 172.21.15.83:0/2792957093 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56300095f0 con 0x7f563c1028d0 2024-04-01T06:54:28.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.908+0000 7f563ad9d700 1 --2- 172.21.15.83:0/2792957093 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f563c1028d0 0x7f563c19e190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5634007ee0 tx=0x7f563400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:28.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.908+0000 7f562b7fe700 1 -- 172.21.15.83:0/2792957093 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5634017070 con 0x7f563c1028d0 2024-04-01T06:54:28.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.908+0000 7f5640a9e700 1 -- 172.21.15.83:0/2792957093 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f563c19ed10 con 0x7f563c1028d0 2024-04-01T06:54:28.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.909+0000 7f562b7fe700 1 -- 172.21.15.83:0/2792957093 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f563400f040 con 0x7f563c1028d0 2024-04-01T06:54:28.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.909+0000 7f562b7fe700 1 -- 172.21.15.83:0/2792957093 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5634005550 con 0x7f563c1028d0 2024-04-01T06:54:28.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.909+0000 7f5640a9e700 1 -- 172.21.15.83:0/2792957093 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f563c19f210 con 0x7f563c1028d0 2024-04-01T06:54:28.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.910+0000 7f5640a9e700 1 -- 172.21.15.83:0/2792957093 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f563c108230 con 0x7f563c1028d0 2024-04-01T06:54:28.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.911+0000 7f562b7fe700 1 -- 172.21.15.83:0/2792957093 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) v1 ==== 135865+0+0 (secure 0 0 0) 0x7f563400db20 con 0x7f563c1028d0 2024-04-01T06:54:28.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.911+0000 7f562b7fe700 1 --2- 172.21.15.83:0/2792957093 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f56240a1120 0x7f56240a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:28.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.911+0000 7f563a59c700 1 --2- 172.21.15.83:0/2792957093 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f56240a1120 0x7f56240a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:28.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.911+0000 7f562b7fe700 1 -- 172.21.15.83:0/2792957093 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f56340cbea0 con 0x7f563c1028d0 2024-04-01T06:54:28.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.912+0000 7f563a59c700 1 --2- 172.21.15.83:0/2792957093 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f56240a1120 0x7f56240a35e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5630000c00 tx=0x7f5630005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:28.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:28.916+0000 7f562b7fe700 1 -- 172.21.15.83:0/2792957093 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f5634095780 con 0x7f563c1028d0 2024-04-01T06:54:29.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:29.125+0000 7f5640a9e700 1 -- 172.21.15.83:0/2792957093 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f563c10c680 con 0x7f563c1028d0 2024-04-01T06:54:29.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:29.127+0000 7f562b7fe700 1 -- 172.21.15.83:0/2792957093 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+22144 (secure 0 0 0) 0x7f5634098da0 con 0x7f563c1028d0 2024-04-01T06:54:29.127 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:54:29.127 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":78,"fsid":"c6f8eff4-eff3-11ee-b647-cb9ed24678a4","created":"2024-04-01T06:48:42.033382+0000","modified":"2024-04-01T06:54:28.396676+0000","last_up_change":"2024-04-01T06:53:55.791339+0000","last_in_change":"2024-04-01T06:53:39.777214+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T06:51:21.963996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T06:54:26.450403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T06:54:27.564928+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"90b761b0-b06c-4142-854d-38ee42aa6052","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6803","nonce":3253845390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6805","nonce":3253845390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6809","nonce":3253845390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6807","nonce":3253845390}]},"public_addr":"172.21.15.83:6803/3253845390","cluster_addr":"172.21.15.83:6805/3253845390","heartbeat_back_addr":"172.21.15.83:6809/3253845390","heartbeat_front_addr":"172.21.15.83:6807/3253845390","state":["exists","up"]},{"osd":1,"uuid":"4d6ab85b-7088-451e-a829-c9119f35dee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6801","nonce":515889759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6803","nonce":515889759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6807","nonce":515889759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6805","nonce":515889759}]},"public_addr":"172.21.15.145:6801/515889759","cluster_addr":"172.21.15.145:6803/515889759","heartbeat_back_addr":"172.21.15.145:6807/515889759","heartbeat_front_addr":"172.21.15.145:6805/515889759","state":["exists","up"]},{"osd":2,"uuid":"d04c27f3-4972-4061-8bfb-5060645e3883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6801","nonce":3318516728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6803","nonce":3318516728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6807","nonce":3318516728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6805","nonce":3318516728}]},"public_addr":"172.21.15.153:6801/3318516728","cluster_addr":"172.21.15.153:6803/3318516728","heartbeat_back_addr":"172.21.15.153:6807/3318516728","heartbeat_front_addr":"172.21.15.153:6805/3318516728","state":["exists","up"]},{"osd":3,"uuid":"899b6c90-8f2f-44dd-b807-49594aadb443","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6811","nonce":504690234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6813","nonce":504690234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6817","nonce":504690234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6815","nonce":504690234}]},"public_addr":"172.21.15.83:6811/504690234","cluster_addr":"172.21.15.83:6813/504690234","heartbeat_back_addr":"172.21.15.83:6817/504690234","heartbeat_front_addr":"172.21.15.83:6815/504690234","state":["exists","up"]},{"osd":4,"uuid":"5071dd81-804e-4358-bfb6-11e718e9cf4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6809","nonce":2099824730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6811","nonce":2099824730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6815","nonce":2099824730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6813","nonce":2099824730}]},"public_addr":"172.21.15.145:6809/2099824730","cluster_addr":"172.21.15.145:6811/2099824730","heartbeat_back_addr":"172.21.15.145:6815/2099824730","heartbeat_front_addr":"172.21.15.145:6813/2099824730","state":["exists","up"]},{"osd":5,"uuid":"b8442b71-c26e-467f-b0c3-ea9f636f5a00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6809","nonce":3340941443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6811","nonce":3340941443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6815","nonce":3340941443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6813","nonce":3340941443}]},"public_addr":"172.21.15.153:6809/3340941443","cluster_addr":"172.21.15.153:6811/3340941443","heartbeat_back_addr":"172.21.15.153:6815/3340941443","heartbeat_front_addr":"172.21.15.153:6813/3340941443","state":["exists","up"]},{"osd":6,"uuid":"c26bb8cb-ccee-4bfc-91eb-14e1ad8e04df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6819","nonce":2005485079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6821","nonce":2005485079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6825","nonce":2005485079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6823","nonce":2005485079}]},"public_addr":"172.21.15.83:6819/2005485079","cluster_addr":"172.21.15.83:6821/2005485079","heartbeat_back_addr":"172.21.15.83:6825/2005485079","heartbeat_front_addr":"172.21.15.83:6823/2005485079","state":["exists","up"]},{"osd":7,"uuid":"a8940da2-0e79-4606-8d1e-d425afbf5753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6817","nonce":3737505059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6819","nonce":3737505059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6823","nonce":3737505059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6821","nonce":3737505059}]},"public_addr":"172.21.15.145:6817/3737505059","cluster_addr":"172.21.15.145:6819/3737505059","heartbeat_back_addr":"172.21.15.145:6823/3737505059","heartbeat_front_addr":"172.21.15.145:6821/3737505059","state":["exists","up"]},{"osd":8,"uuid":"602d43ac-a189-4da3-9e38-7025d14e0dd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6817","nonce":1031545791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6819","nonce":1031545791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6823","nonce":1031545791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6821","nonce":1031545791}]},"public_addr":"172.21.15.153:6817/1031545791","cluster_addr":"172.21.15.153:6819/1031545791","heartbeat_back_addr":"172.21.15.153:6823/1031545791","heartbeat_front_addr":"172.21.15.153:6821/1031545791","state":["exists","up"]},{"osd":9,"uuid":"08b12d27-1247-45e4-9d09-cacc0fce4bd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6827","nonce":3720996673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6829","nonce":3720996673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6833","nonce":3720996673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6831","nonce":3720996673}]},"public_addr":"172.21.15.83:6827/3720996673","cluster_addr":"172.21.15.83:6829/3720996673","heartbeat_back_addr":"172.21.15.83:6833/3720996673","heartbeat_front_addr":"172.21.15.83:6831/3720996673","state":["exists","up"]},{"osd":10,"uuid":"dd986b50-d68f-446c-9c66-261535880879","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6825","nonce":2671529479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6827","nonce":2671529479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6831","nonce":2671529479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6829","nonce":2671529479}]},"public_addr":"172.21.15.145:6825/2671529479","cluster_addr":"172.21.15.145:6827/2671529479","heartbeat_back_addr":"172.21.15.145:6831/2671529479","heartbeat_front_addr":"172.21.15.145:6829/2671529479","state":["exists","up"]},{"osd":11,"uuid":"d20a49cd-6224-4424-8375-46da791d9931","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6825","nonce":2342548429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6827","nonce":2342548429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6831","nonce":2342548429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6829","nonce":2342548429}]},"public_addr":"172.21.15.153:6825/2342548429","cluster_addr":"172.21.15.153:6827/2342548429","heartbeat_back_addr":"172.21.15.153:6831/2342548429","heartbeat_front_addr":"172.21.15.153:6829/2342548429","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:50:44.539932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:01.990470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:19.054426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:36.616393+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:53.896705+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:10.667502+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:27.880849+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:45.276308+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:02.280615+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:19.555547+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:37.062881+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:54.191589+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.83:6801/1867137261":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/2596683931":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/2125339627":"2024-04-02T06:49:33.656125+0000","172.21.15.83:6800/1644397953":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/690500472":"2024-04-02T06:49:13.456026+0000","172.21.15.83:6801/1644397953":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/785958951":"2024-04-02T06:49:33.656125+0000","172.21.15.83:6800/1867137261":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/2222527447":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/2071592157":"2024-04-02T06:49:13.456026+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T06:54:29.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:29.129+0000 7f5640a9e700 1 -- 172.21.15.83:0/2792957093 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f56240a1120 msgr2=0x7f56240a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:29.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:29.129+0000 7f5640a9e700 1 --2- 172.21.15.83:0/2792957093 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f56240a1120 0x7f56240a35e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5630000c00 tx=0x7f5630005fb0 comp rx=0 tx=0).stop 2024-04-01T06:54:29.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:29.129+0000 7f5640a9e700 1 -- 172.21.15.83:0/2792957093 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f563c1028d0 msgr2=0x7f563c19e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:29.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:29.129+0000 7f5640a9e700 1 --2- 172.21.15.83:0/2792957093 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f563c1028d0 0x7f563c19e190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5634007ee0 tx=0x7f563400d3b0 comp rx=0 tx=0).stop 2024-04-01T06:54:29.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:29.129+0000 7f5640a9e700 1 -- 172.21.15.83:0/2792957093 shutdown_connections 2024-04-01T06:54:29.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:29.129+0000 7f5640a9e700 1 --2- 172.21.15.83:0/2792957093 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f563c1028d0 0x7f563c19e190 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:29.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:29.129+0000 7f5640a9e700 1 --2- 172.21.15.83:0/2792957093 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f56240a1120 0x7f56240a35e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:29.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:29.129+0000 7f5640a9e700 1 --2- 172.21.15.83:0/2792957093 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f563c0fef60 0x7f563c196c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:29.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:29.129+0000 7f5640a9e700 1 --2- 172.21.15.83:0/2792957093 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f563c101f30 0x7f563c197170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:29.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:29.129+0000 7f5640a9e700 1 -- 172.21.15.83:0/2792957093 >> 172.21.15.83:0/2792957093 conn(0x7f563c0fa890 msgr2=0x7f563c105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:29.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:29.129+0000 7f5640a9e700 1 -- 172.21.15.83:0/2792957093 shutdown_connections 2024-04-01T06:54:29.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:29.129+0000 7f5640a9e700 1 -- 172.21.15.83:0/2792957093 wait complete. 2024-04-01T06:54:29.140 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:29 smithi083 ceph-mon[43429]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-01T06:54:29.140 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:29 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/3375286648' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-01T06:54:29.140 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:29 smithi083 ceph-mon[43429]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-01T06:54:29.140 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:29 smithi083 ceph-mon[43429]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-04-01T06:54:29.140 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:29 smithi083 ceph-mon[43429]: osdmap e78: 12 total, 12 up, 12 in 2024-04-01T06:54:29.140 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:29 smithi083 ceph-mon[43429]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-04-01T06:54:29.140 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:29 smithi083 ceph-mon[43429]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-04-01T06:54:29.140 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:29 smithi083 ceph-mon[43429]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-04-01T06:54:29.140 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:29 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/2962098243' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T06:54:29.142 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-01T06:54:29.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:29.267+0000 7fe918256700 1 -- 172.21.15.83:0/1761993571 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9101017f0 msgr2=0x7fe910103be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:29.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:29.267+0000 7fe918256700 1 --2- 172.21.15.83:0/1761993571 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9101017f0 0x7fe910103be0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe900009990 tx=0x7fe900009ca0 comp rx=0 tx=0).stop 2024-04-01T06:54:29.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:29.267+0000 7fe918256700 1 -- 172.21.15.83:0/1761993571 shutdown_connections 2024-04-01T06:54:29.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:29.267+0000 7fe918256700 1 --2- 172.21.15.83:0/1761993571 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9101017f0 0x7fe910103be0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:29.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:29.267+0000 7fe918256700 1 --2- 172.21.15.83:0/1761993571 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe910106a50 0x7fe910108ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:29.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:29.267+0000 7fe918256700 1 --2- 172.21.15.83:0/1761993571 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe910104120 0x7fe910106510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:29.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:29.267+0000 7fe918256700 1 -- 172.21.15.83:0/1761993571 >> 172.21.15.83:0/1761993571 conn(0x7fe9100fb200 msgr2=0x7fe9100fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:29.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:29.267+0000 7fe918256700 1 -- 172.21.15.83:0/1761993571 shutdown_connections 2024-04-01T06:54:29.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:29.267+0000 7fe918256700 1 -- 172.21.15.83:0/1761993571 wait complete. 2024-04-01T06:54:29.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:29.268+0000 7fe918256700 1 Processor -- start 2024-04-01T06:54:29.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:29.268+0000 7fe918256700 1 -- start start 2024-04-01T06:54:29.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:29.268+0000 7fe918256700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9101017f0 0x7fe910196d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:29.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:29.268+0000 7fe918256700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe910104120 0x7fe910197240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:29.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:29.268+0000 7fe918256700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe910106a50 0x7fe91019e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:29.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:29.268+0000 7fe918256700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe91019e820 con 0x7fe9101017f0 2024-04-01T06:54:29.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:29.268+0000 7fe918256700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe91019e990 con 0x7fe910104120 2024-04-01T06:54:29.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:29.268+0000 7fe918256700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe91019eb50 con 0x7fe910106a50 2024-04-01T06:54:29.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:29.268+0000 7fe915ff2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9101017f0 0x7fe910196d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:29.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:29.268+0000 7fe915ff2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9101017f0 0x7fe910196d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:49484/0 (socket says 172.21.15.83:49484) 2024-04-01T06:54:29.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:29.268+0000 7fe915ff2700 1 -- 172.21.15.83:0/1404918579 learned_addr learned my addr 172.21.15.83:0/1404918579 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:54:29.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:29.268+0000 7fe9167f3700 1 --2- 172.21.15.83:0/1404918579 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe910106a50 0x7fe91019e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:29.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:29.268+0000 7fe915ff2700 1 -- 172.21.15.83:0/1404918579 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe910106a50 msgr2=0x7fe91019e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:29.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:29.268+0000 7fe915ff2700 1 --2- 172.21.15.83:0/1404918579 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe910106a50 0x7fe91019e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:29.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:29.268+0000 7fe915ff2700 1 -- 172.21.15.83:0/1404918579 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe910104120 msgr2=0x7fe910197240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:29.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:29.268+0000 7fe915ff2700 1 --2- 172.21.15.83:0/1404918579 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe910104120 0x7fe910197240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:29.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:29.268+0000 7fe915ff2700 1 -- 172.21.15.83:0/1404918579 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9000095f0 con 0x7fe9101017f0 2024-04-01T06:54:29.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:29.268+0000 7fe9167f3700 1 --2- 172.21.15.83:0/1404918579 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe910106a50 0x7fe91019e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:54:29.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:29.268+0000 7fe915ff2700 1 --2- 172.21.15.83:0/1404918579 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9101017f0 0x7fe910196d00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe9000095c0 tx=0x7fe90000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:29.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:29.269+0000 7fe906ffd700 1 -- 172.21.15.83:0/1404918579 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90001d070 con 0x7fe9101017f0 2024-04-01T06:54:29.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:29.269+0000 7fe906ffd700 1 -- 172.21.15.83:0/1404918579 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe90000fb80 con 0x7fe9101017f0 2024-04-01T06:54:29.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:29.269+0000 7fe918256700 1 -- 172.21.15.83:0/1404918579 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe91019edd0 con 0x7fe9101017f0 2024-04-01T06:54:29.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:29.269+0000 7fe906ffd700 1 -- 172.21.15.83:0/1404918579 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe900017650 con 0x7fe9101017f0 2024-04-01T06:54:29.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:29.269+0000 7fe918256700 1 -- 172.21.15.83:0/1404918579 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe91019f1a0 con 0x7fe9101017f0 2024-04-01T06:54:29.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:29.270+0000 7fe918256700 1 -- 172.21.15.83:0/1404918579 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9100fcd80 con 0x7fe9101017f0 2024-04-01T06:54:29.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:29.271+0000 7fe906ffd700 1 -- 172.21.15.83:0/1404918579 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) v1 ==== 135865+0+0 (secure 0 0 0) 0x7fe900022470 con 0x7fe9101017f0 2024-04-01T06:54:29.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:29.271+0000 7fe906ffd700 1 --2- 172.21.15.83:0/1404918579 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fe8fc0a1120 0x7fe8fc0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:29.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:29.271+0000 7fe9157f1700 1 --2- 172.21.15.83:0/1404918579 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fe8fc0a1120 0x7fe8fc0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:29.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:29.271+0000 7fe906ffd700 1 -- 172.21.15.83:0/1404918579 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fe9000cdd80 con 0x7fe9101017f0 2024-04-01T06:54:29.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:29.272+0000 7fe9157f1700 1 --2- 172.21.15.83:0/1404918579 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fe8fc0a1120 0x7fe8fc0a35e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe90c005950 tx=0x7fe90c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:29.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:29.276+0000 7fe906ffd700 1 -- 172.21.15.83:0/1404918579 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7fe9000976f0 con 0x7fe9101017f0 2024-04-01T06:54:29.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:29 smithi153 ceph-mon[48187]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-01T06:54:29.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:29 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/3375286648' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-01T06:54:29.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:29 smithi153 ceph-mon[48187]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-01T06:54:29.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:29 smithi153 ceph-mon[48187]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-04-01T06:54:29.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:29 smithi153 ceph-mon[48187]: osdmap e78: 12 total, 12 up, 12 in 2024-04-01T06:54:29.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:29 smithi153 ceph-mon[48187]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-04-01T06:54:29.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:29 smithi153 ceph-mon[48187]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-04-01T06:54:29.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:29 smithi153 ceph-mon[48187]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-04-01T06:54:29.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:29 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/2962098243' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T06:54:29.502 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:29 smithi145 ceph-mon[47816]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-01T06:54:29.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:29 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/3375286648' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-01T06:54:29.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:29 smithi145 ceph-mon[47816]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-01T06:54:29.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:29 smithi145 ceph-mon[47816]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-04-01T06:54:29.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:29 smithi145 ceph-mon[47816]: osdmap e78: 12 total, 12 up, 12 in 2024-04-01T06:54:29.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:29 smithi145 ceph-mon[47816]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-04-01T06:54:29.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:29 smithi145 ceph-mon[47816]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-04-01T06:54:29.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:29 smithi145 ceph-mon[47816]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-04-01T06:54:29.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:29 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/2962098243' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T06:54:29.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:29.521+0000 7fe918256700 1 -- 172.21.15.83:0/1404918579 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe91010c6b0 con 0x7fe9101017f0 2024-04-01T06:54:30.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:30 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/2792957093' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T06:54:30.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:30 smithi083 ceph-mon[43429]: mds.? [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] up:active 2024-04-01T06:54:30.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:30 smithi083 ceph-mon[43429]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-01T06:54:30.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:30 smithi083 ceph-mon[43429]: osdmap e79: 12 total, 12 up, 12 in 2024-04-01T06:54:30.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:30 smithi083 ceph-mon[43429]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-01T06:54:30.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:30 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/1404918579' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-04-01T06:54:30.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:30 smithi083 ceph-mon[43429]: pgmap v217: 97 pgs: 7 creating+peering, 34 active+clean, 56 unknown; 578 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s wr, 7 op/s 2024-04-01T06:54:30.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:30 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/2792957093' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T06:54:30.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:30 smithi153 ceph-mon[48187]: mds.? [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] up:active 2024-04-01T06:54:30.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:30 smithi153 ceph-mon[48187]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-01T06:54:30.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:30 smithi153 ceph-mon[48187]: osdmap e79: 12 total, 12 up, 12 in 2024-04-01T06:54:30.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:30 smithi153 ceph-mon[48187]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-01T06:54:30.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:30 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/1404918579' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-04-01T06:54:30.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:30 smithi153 ceph-mon[48187]: pgmap v217: 97 pgs: 7 creating+peering, 34 active+clean, 56 unknown; 578 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s wr, 7 op/s 2024-04-01T06:54:30.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:30.417+0000 7fe906ffd700 1 -- 172.21.15.83:0/1404918579 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe9000270b0 con 0x7fe9101017f0 2024-04-01T06:54:30.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:30.420+0000 7fe918256700 1 -- 172.21.15.83:0/1404918579 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fe8fc0a1120 msgr2=0x7fe8fc0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:30.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:30.420+0000 7fe918256700 1 --2- 172.21.15.83:0/1404918579 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fe8fc0a1120 0x7fe8fc0a35e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe90c005950 tx=0x7fe90c0058e0 comp rx=0 tx=0).stop 2024-04-01T06:54:30.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:30.420+0000 7fe918256700 1 -- 172.21.15.83:0/1404918579 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9101017f0 msgr2=0x7fe910196d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:30.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:30.420+0000 7fe918256700 1 --2- 172.21.15.83:0/1404918579 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9101017f0 0x7fe910196d00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe9000095c0 tx=0x7fe90000f690 comp rx=0 tx=0).stop 2024-04-01T06:54:30.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:30.420+0000 7fe918256700 1 -- 172.21.15.83:0/1404918579 shutdown_connections 2024-04-01T06:54:30.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:30.420+0000 7fe918256700 1 --2- 172.21.15.83:0/1404918579 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9101017f0 0x7fe910196d00 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:30.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:30.420+0000 7fe918256700 1 --2- 172.21.15.83:0/1404918579 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fe8fc0a1120 0x7fe8fc0a35e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:30.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:30.420+0000 7fe918256700 1 --2- 172.21.15.83:0/1404918579 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe910106a50 0x7fe91019e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:30.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:30.420+0000 7fe918256700 1 --2- 172.21.15.83:0/1404918579 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe910104120 0x7fe910197240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:30.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:30.420+0000 7fe918256700 1 -- 172.21.15.83:0/1404918579 >> 172.21.15.83:0/1404918579 conn(0x7fe9100fb200 msgr2=0x7fe910102090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:30.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:30.420+0000 7fe918256700 1 -- 172.21.15.83:0/1404918579 shutdown_connections 2024-04-01T06:54:30.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:30.420+0000 7fe918256700 1 -- 172.21.15.83:0/1404918579 wait complete. 2024-04-01T06:54:30.434 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-04-01T06:54:30.435 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-04-01T06:54:30.502 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:30 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/2792957093' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T06:54:30.502 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:30 smithi145 ceph-mon[47816]: mds.? [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] up:active 2024-04-01T06:54:30.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:30 smithi145 ceph-mon[47816]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-01T06:54:30.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:30 smithi145 ceph-mon[47816]: osdmap e79: 12 total, 12 up, 12 in 2024-04-01T06:54:30.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:30 smithi145 ceph-mon[47816]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-01T06:54:30.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:30 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/1404918579' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-04-01T06:54:30.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:30 smithi145 ceph-mon[47816]: pgmap v217: 97 pgs: 7 creating+peering, 34 active+clean, 56 unknown; 578 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s wr, 7 op/s 2024-04-01T06:54:30.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:30.565+0000 7f5dbc534700 1 -- 172.21.15.83:0/2423411429 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5db4102910 msgr2=0x7f5db41091c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:30.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:30.565+0000 7f5dbc534700 1 --2- 172.21.15.83:0/2423411429 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5db4102910 0x7f5db41091c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5dac00b0d0 tx=0x7f5dac00b3e0 comp rx=0 tx=0).stop 2024-04-01T06:54:30.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:30.565+0000 7f5dbc534700 1 -- 172.21.15.83:0/2423411429 shutdown_connections 2024-04-01T06:54:30.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:30.565+0000 7f5dbc534700 1 --2- 172.21.15.83:0/2423411429 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5db4102910 0x7f5db41091c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:30.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:30.565+0000 7f5dbc534700 1 --2- 172.21.15.83:0/2423411429 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5db4100d80 0x7f5db41011a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:30.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:30.565+0000 7f5dbc534700 1 --2- 172.21.15.83:0/2423411429 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5db4101f70 0x7f5db41023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:30.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:30.565+0000 7f5dbc534700 1 -- 172.21.15.83:0/2423411429 >> 172.21.15.83:0/2423411429 conn(0x7f5db40fc2f0 msgr2=0x7f5db40fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:30.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:30.565+0000 7f5dbc534700 1 -- 172.21.15.83:0/2423411429 shutdown_connections 2024-04-01T06:54:30.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:30.565+0000 7f5dbc534700 1 -- 172.21.15.83:0/2423411429 wait complete. 2024-04-01T06:54:30.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:30.566+0000 7f5dbc534700 1 Processor -- start 2024-04-01T06:54:30.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:30.566+0000 7f5dbc534700 1 -- start start 2024-04-01T06:54:30.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:30.566+0000 7f5dbc534700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5db4100d80 0x7f5db4074b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:30.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:30.566+0000 7f5dbc534700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5db4101f70 0x7f5db40731a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:30.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:30.566+0000 7f5dbc534700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5db4102910 0x7f5db40736e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:30.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:30.566+0000 7f5dbc534700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db4073e80 con 0x7f5db4100d80 2024-04-01T06:54:30.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:30.566+0000 7f5dbc534700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db4073ff0 con 0x7f5db4102910 2024-04-01T06:54:30.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:30.566+0000 7f5dbc534700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db41a0e10 con 0x7f5db4101f70 2024-04-01T06:54:30.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:30.566+0000 7f5dba2d0700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5db4100d80 0x7f5db4074b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:30.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:30.566+0000 7f5dba2d0700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5db4100d80 0x7f5db4074b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:49506/0 (socket says 172.21.15.83:49506) 2024-04-01T06:54:30.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:30.566+0000 7f5dba2d0700 1 -- 172.21.15.83:0/2750857120 learned_addr learned my addr 172.21.15.83:0/2750857120 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:54:30.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:30.566+0000 7f5dba2d0700 1 -- 172.21.15.83:0/2750857120 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5db4101f70 msgr2=0x7f5db40731a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:30.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:30.566+0000 7f5dba2d0700 1 --2- 172.21.15.83:0/2750857120 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5db4101f70 0x7f5db40731a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:30.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:30.566+0000 7f5dba2d0700 1 -- 172.21.15.83:0/2750857120 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5db4102910 msgr2=0x7f5db40736e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:30.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:30.566+0000 7f5dba2d0700 1 --2- 172.21.15.83:0/2750857120 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5db4102910 0x7f5db40736e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:30.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:30.566+0000 7f5dba2d0700 1 -- 172.21.15.83:0/2750857120 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dac009d00 con 0x7f5db4100d80 2024-04-01T06:54:30.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:30.567+0000 7f5dba2d0700 1 --2- 172.21.15.83:0/2750857120 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5db4100d80 0x7f5db4074b10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5db000d980 tx=0x7f5db000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:30.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:30.567+0000 7f5dab7fe700 1 -- 172.21.15.83:0/2750857120 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db000de60 con 0x7f5db4100d80 2024-04-01T06:54:30.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:30.567+0000 7f5dab7fe700 1 -- 172.21.15.83:0/2750857120 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5db00044e0 con 0x7f5db4100d80 2024-04-01T06:54:30.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:30.567+0000 7f5dbc534700 1 -- 172.21.15.83:0/2750857120 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5db41a10a0 con 0x7f5db4100d80 2024-04-01T06:54:30.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:30.567+0000 7f5dab7fe700 1 -- 172.21.15.83:0/2750857120 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db0003b40 con 0x7f5db4100d80 2024-04-01T06:54:30.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:30.567+0000 7f5dbc534700 1 -- 172.21.15.83:0/2750857120 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5db41a15b0 con 0x7f5db4100d80 2024-04-01T06:54:30.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:30.568+0000 7f5dbc534700 1 -- 172.21.15.83:0/2750857120 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5db4108130 con 0x7f5db4100d80 2024-04-01T06:54:30.570 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:30.569+0000 7f5dab7fe700 1 -- 172.21.15.83:0/2750857120 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) v1 ==== 135865+0+0 (secure 0 0 0) 0x7f5db0004870 con 0x7f5db4100d80 2024-04-01T06:54:30.570 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:30.570+0000 7f5dab7fe700 1 --2- 172.21.15.83:0/2750857120 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f5da00a1120 0x7f5da00a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:30.570 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:30.570+0000 7f5db9acf700 1 --2- 172.21.15.83:0/2750857120 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f5da00a1120 0x7f5da00a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:30.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:30.570+0000 7f5dab7fe700 1 -- 172.21.15.83:0/2750857120 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f5db00cc9d0 con 0x7f5db4100d80 2024-04-01T06:54:30.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:30.570+0000 7f5db9acf700 1 --2- 172.21.15.83:0/2750857120 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f5da00a1120 0x7f5da00a35e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5da400a990 tx=0x7f5da4005c80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:30.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:30.573+0000 7f5dab7fe700 1 -- 172.21.15.83:0/2750857120 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f5db0096210 con 0x7f5db4100d80 2024-04-01T06:54:30.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:30.819+0000 7f5dbc534700 1 -- 172.21.15.83:0/2750857120 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) v1 -- 0x7f5db410c850 con 0x7f5db4100d80 2024-04-01T06:54:31.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:31 smithi083 ceph-mon[43429]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-01T06:54:31.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:31 smithi083 ceph-mon[43429]: Cluster is now healthy 2024-04-01T06:54:31.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:31 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/1404918579' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-04-01T06:54:31.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:31 smithi083 ceph-mon[43429]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-01T06:54:31.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:31 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/2750857120' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-04-01T06:54:31.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:31 smithi153 ceph-mon[48187]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-01T06:54:31.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:31 smithi153 ceph-mon[48187]: Cluster is now healthy 2024-04-01T06:54:31.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:31 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/1404918579' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-04-01T06:54:31.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:31 smithi153 ceph-mon[48187]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-01T06:54:31.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:31 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/2750857120' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-04-01T06:54:31.502 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:31 smithi145 ceph-mon[47816]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-01T06:54:31.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:31 smithi145 ceph-mon[47816]: Cluster is now healthy 2024-04-01T06:54:31.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:31 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/1404918579' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-04-01T06:54:31.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:31 smithi145 ceph-mon[47816]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-01T06:54:31.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:31 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/2750857120' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-04-01T06:54:31.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:31.686+0000 7f5dab7fe700 1 -- 172.21.15.83:0/2750857120 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) v1 ==== 105+0+0 (secure 0 0 0) 0x7f5db0099830 con 0x7f5db4100d80 2024-04-01T06:54:31.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:31.689+0000 7f5dbc534700 1 -- 172.21.15.83:0/2750857120 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f5da00a1120 msgr2=0x7f5da00a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:31.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:31.689+0000 7f5dbc534700 1 --2- 172.21.15.83:0/2750857120 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f5da00a1120 0x7f5da00a35e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5da400a990 tx=0x7f5da4005c80 comp rx=0 tx=0).stop 2024-04-01T06:54:31.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:31.689+0000 7f5dbc534700 1 -- 172.21.15.83:0/2750857120 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5db4100d80 msgr2=0x7f5db4074b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:31.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:31.689+0000 7f5dbc534700 1 --2- 172.21.15.83:0/2750857120 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5db4100d80 0x7f5db4074b10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5db000d980 tx=0x7f5db000dd40 comp rx=0 tx=0).stop 2024-04-01T06:54:31.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:31.689+0000 7f5dbc534700 1 -- 172.21.15.83:0/2750857120 shutdown_connections 2024-04-01T06:54:31.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:31.689+0000 7f5dbc534700 1 --2- 172.21.15.83:0/2750857120 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5db4100d80 0x7f5db4074b10 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:31.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:31.689+0000 7f5dbc534700 1 --2- 172.21.15.83:0/2750857120 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f5da00a1120 0x7f5da00a35e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:31.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:31.689+0000 7f5dbc534700 1 --2- 172.21.15.83:0/2750857120 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5db4102910 0x7f5db40736e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:31.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:31.689+0000 7f5dbc534700 1 --2- 172.21.15.83:0/2750857120 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5db4101f70 0x7f5db40731a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:31.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:31.689+0000 7f5dbc534700 1 -- 172.21.15.83:0/2750857120 >> 172.21.15.83:0/2750857120 conn(0x7f5db40fc2f0 msgr2=0x7f5db4105270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:31.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:31.690+0000 7f5dbc534700 1 -- 172.21.15.83:0/2750857120 shutdown_connections 2024-04-01T06:54:31.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:31.690+0000 7f5dbc534700 1 -- 172.21.15.83:0/2750857120 wait complete. 2024-04-01T06:54:31.707 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2024-04-01T06:54:31.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:31.838+0000 7fda6f990700 1 -- 172.21.15.83:0/1686481635 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda68101820 msgr2=0x7fda681080d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:31.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:31.838+0000 7fda6f990700 1 --2- 172.21.15.83:0/1686481635 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda68101820 0x7fda681080d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fda6000b0d0 tx=0x7fda6000b3e0 comp rx=0 tx=0).stop 2024-04-01T06:54:31.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:31.838+0000 7fda6f990700 1 -- 172.21.15.83:0/1686481635 shutdown_connections 2024-04-01T06:54:31.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:31.838+0000 7fda6f990700 1 --2- 172.21.15.83:0/1686481635 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda68101820 0x7fda681080d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:31.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:31.838+0000 7fda6f990700 1 --2- 172.21.15.83:0/1686481635 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda680ffc90 0x7fda681000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:31.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:31.838+0000 7fda6f990700 1 --2- 172.21.15.83:0/1686481635 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda68100e80 0x7fda681012e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:31.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:31.838+0000 7fda6f990700 1 -- 172.21.15.83:0/1686481635 >> 172.21.15.83:0/1686481635 conn(0x7fda680fb200 msgr2=0x7fda680fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:31.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:31.838+0000 7fda6f990700 1 -- 172.21.15.83:0/1686481635 shutdown_connections 2024-04-01T06:54:31.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:31.838+0000 7fda6f990700 1 -- 172.21.15.83:0/1686481635 wait complete. 2024-04-01T06:54:31.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:31.839+0000 7fda6f990700 1 Processor -- start 2024-04-01T06:54:31.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:31.839+0000 7fda6f990700 1 -- start start 2024-04-01T06:54:31.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:31.839+0000 7fda6f990700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda680ffc90 0x7fda68196f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:31.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:31.839+0000 7fda6f990700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda68100e80 0x7fda68197460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:31.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:31.839+0000 7fda6f990700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda68101820 0x7fda6819e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:31.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:31.839+0000 7fda6f990700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6819ea50 con 0x7fda68101820 2024-04-01T06:54:31.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:31.839+0000 7fda6f990700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6819eb90 con 0x7fda68100e80 2024-04-01T06:54:31.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:31.839+0000 7fda6f990700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6819ed20 con 0x7fda680ffc90 2024-04-01T06:54:31.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:31.839+0000 7fda6df2d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda68101820 0x7fda6819e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:31.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:31.839+0000 7fda6df2d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda68101820 0x7fda6819e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:49530/0 (socket says 172.21.15.83:49530) 2024-04-01T06:54:31.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:31.839+0000 7fda6df2d700 1 -- 172.21.15.83:0/1361779961 learned_addr learned my addr 172.21.15.83:0/1361779961 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:54:31.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:31.839+0000 7fda6cf2b700 1 --2- 172.21.15.83:0/1361779961 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda68100e80 0x7fda68197460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:31.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:31.839+0000 7fda6df2d700 1 -- 172.21.15.83:0/1361779961 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda680ffc90 msgr2=0x7fda68196f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:31.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:31.839+0000 7fda6df2d700 1 --2- 172.21.15.83:0/1361779961 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda680ffc90 0x7fda68196f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:31.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:31.839+0000 7fda6df2d700 1 -- 172.21.15.83:0/1361779961 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda68100e80 msgr2=0x7fda68197460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:31.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:31.839+0000 7fda6df2d700 1 --2- 172.21.15.83:0/1361779961 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda68100e80 0x7fda68197460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:31.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:31.839+0000 7fda6df2d700 1 -- 172.21.15.83:0/1361779961 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda60009d00 con 0x7fda68101820 2024-04-01T06:54:31.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:31.840+0000 7fda6df2d700 1 --2- 172.21.15.83:0/1361779961 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda68101820 0x7fda6819e480 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fda60007bd0 tx=0x7fda60009570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:31.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:31.840+0000 7fda5e7fc700 1 -- 172.21.15.83:0/1361779961 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6000e040 con 0x7fda68101820 2024-04-01T06:54:31.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:31.840+0000 7fda5e7fc700 1 -- 172.21.15.83:0/1361779961 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fda60004e60 con 0x7fda68101820 2024-04-01T06:54:31.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:31.840+0000 7fda6f990700 1 -- 172.21.15.83:0/1361779961 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda6819efa0 con 0x7fda68101820 2024-04-01T06:54:31.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:31.840+0000 7fda5e7fc700 1 -- 172.21.15.83:0/1361779961 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda60005640 con 0x7fda68101820 2024-04-01T06:54:31.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:31.840+0000 7fda6f990700 1 -- 172.21.15.83:0/1361779961 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda6819f3c0 con 0x7fda68101820 2024-04-01T06:54:31.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:31.841+0000 7fda6f990700 1 -- 172.21.15.83:0/1361779961 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda68067260 con 0x7fda68101820 2024-04-01T06:54:31.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:31.842+0000 7fda5e7fc700 1 -- 172.21.15.83:0/1361779961 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) v1 ==== 135865+0+0 (secure 0 0 0) 0x7fda600057a0 con 0x7fda68101820 2024-04-01T06:54:31.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:31.843+0000 7fda5e7fc700 1 --2- 172.21.15.83:0/1361779961 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fda540a11a0 0x7fda540a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:31.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:31.843+0000 7fda6d72c700 1 --2- 172.21.15.83:0/1361779961 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fda540a11a0 0x7fda540a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:31.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:31.843+0000 7fda5e7fc700 1 -- 172.21.15.83:0/1361779961 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fda600ce070 con 0x7fda68101820 2024-04-01T06:54:31.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:31.843+0000 7fda6d72c700 1 --2- 172.21.15.83:0/1361779961 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fda540a11a0 0x7fda540a3660 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fda68100ce0 tx=0x7fda64006d20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:31.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:31.847+0000 7fda5e7fc700 1 -- 172.21.15.83:0/1361779961 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7fda600979e0 con 0x7fda68101820 2024-04-01T06:54:32.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:32.091+0000 7fda6f990700 1 -- 172.21.15.83:0/1361779961 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7fda6810b810 con 0x7fda68101820 2024-04-01T06:54:32.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:32 smithi083 ceph-mon[43429]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-01T06:54:32.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:32 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/2750857120' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-04-01T06:54:32.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:32 smithi083 ceph-mon[43429]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-01T06:54:32.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:32 smithi083 ceph-mon[43429]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-01T06:54:32.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:32 smithi083 ceph-mon[43429]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-04-01T06:54:32.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:32 smithi083 ceph-mon[43429]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-04-01T06:54:32.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:32 smithi083 ceph-mon[43429]: pgmap v218: 97 pgs: 7 creating+peering, 44 active+clean, 46 unknown; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 7 op/s 2024-04-01T06:54:32.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:32 smithi153 ceph-mon[48187]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-01T06:54:32.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:32 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/2750857120' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-04-01T06:54:32.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:32 smithi153 ceph-mon[48187]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-01T06:54:32.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:32 smithi153 ceph-mon[48187]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-01T06:54:32.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:32 smithi153 ceph-mon[48187]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-04-01T06:54:32.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:32 smithi153 ceph-mon[48187]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-04-01T06:54:32.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:32 smithi153 ceph-mon[48187]: pgmap v218: 97 pgs: 7 creating+peering, 44 active+clean, 46 unknown; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 7 op/s 2024-04-01T06:54:32.502 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:32 smithi145 ceph-mon[47816]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-01T06:54:32.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:32 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/2750857120' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-04-01T06:54:32.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:32 smithi145 ceph-mon[47816]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-01T06:54:32.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:32 smithi145 ceph-mon[47816]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-04-01T06:54:32.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:32 smithi145 ceph-mon[47816]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-04-01T06:54:32.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:32 smithi145 ceph-mon[47816]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-04-01T06:54:32.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:32 smithi145 ceph-mon[47816]: pgmap v218: 97 pgs: 7 creating+peering, 44 active+clean, 46 unknown; 579 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 7 op/s 2024-04-01T06:54:32.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:32.697+0000 7fda5e7fc700 1 -- 172.21.15.83:0/1361779961 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v20) v1 ==== 121+0+0 (secure 0 0 0) 0x7fda6009b000 con 0x7fda68101820 2024-04-01T06:54:32.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:32.700+0000 7fda6f990700 1 -- 172.21.15.83:0/1361779961 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fda540a11a0 msgr2=0x7fda540a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:32.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:32.700+0000 7fda6f990700 1 --2- 172.21.15.83:0/1361779961 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fda540a11a0 0x7fda540a3660 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fda68100ce0 tx=0x7fda64006d20 comp rx=0 tx=0).stop 2024-04-01T06:54:32.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:32.700+0000 7fda6f990700 1 -- 172.21.15.83:0/1361779961 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda68101820 msgr2=0x7fda6819e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:32.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:32.700+0000 7fda6f990700 1 --2- 172.21.15.83:0/1361779961 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda68101820 0x7fda6819e480 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fda60007bd0 tx=0x7fda60009570 comp rx=0 tx=0).stop 2024-04-01T06:54:32.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:32.700+0000 7fda6f990700 1 -- 172.21.15.83:0/1361779961 shutdown_connections 2024-04-01T06:54:32.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:32.700+0000 7fda6f990700 1 --2- 172.21.15.83:0/1361779961 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fda68101820 0x7fda6819e480 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:32.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:32.700+0000 7fda6f990700 1 --2- 172.21.15.83:0/1361779961 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fda540a11a0 0x7fda540a3660 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:32.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:32.700+0000 7fda6f990700 1 --2- 172.21.15.83:0/1361779961 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda680ffc90 0x7fda68196f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:32.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:32.700+0000 7fda6f990700 1 --2- 172.21.15.83:0/1361779961 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda68100e80 0x7fda68197460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:32.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:32.700+0000 7fda6f990700 1 -- 172.21.15.83:0/1361779961 >> 172.21.15.83:0/1361779961 conn(0x7fda680fb200 msgr2=0x7fda680fcce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:32.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:32.700+0000 7fda6f990700 1 -- 172.21.15.83:0/1361779961 shutdown_connections 2024-04-01T06:54:32.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:32.700+0000 7fda6f990700 1 -- 172.21.15.83:0/1361779961 wait complete. 2024-04-01T06:54:32.718 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-04-01T06:54:32.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:32.848+0000 7f5c19008700 1 -- 172.21.15.83:0/278855725 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5c14100880 msgr2=0x7f5c14108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:32.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:32.848+0000 7f5c19008700 1 --2- 172.21.15.83:0/278855725 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5c14100880 0x7f5c14108120 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c00b0a0 tx=0x7f5c0c00b3b0 comp rx=0 tx=0).stop 2024-04-01T06:54:32.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:32.848+0000 7f5c19008700 1 -- 172.21.15.83:0/278855725 shutdown_connections 2024-04-01T06:54:32.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:32.848+0000 7f5c19008700 1 --2- 172.21.15.83:0/278855725 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5c14100880 0x7f5c14108120 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:32.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:32.848+0000 7f5c19008700 1 --2- 172.21.15.83:0/278855725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c14101270 0x7f5c14101690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:32.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:32.848+0000 7f5c19008700 1 --2- 172.21.15.83:0/278855725 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5c140ffec0 0x7f5c14100340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:32.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:32.848+0000 7f5c19008700 1 -- 172.21.15.83:0/278855725 >> 172.21.15.83:0/278855725 conn(0x7f5c140fa950 msgr2=0x7f5c140fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:32.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:32.848+0000 7f5c19008700 1 -- 172.21.15.83:0/278855725 shutdown_connections 2024-04-01T06:54:32.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:32.848+0000 7f5c19008700 1 -- 172.21.15.83:0/278855725 wait complete. 2024-04-01T06:54:32.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:32.849+0000 7f5c19008700 1 Processor -- start 2024-04-01T06:54:32.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:32.849+0000 7f5c19008700 1 -- start start 2024-04-01T06:54:32.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:32.850+0000 7f5c19008700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c140ffec0 0x7f5c14195c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:32.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:32.850+0000 7f5c19008700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5c14100880 0x7f5c14196150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:32.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:32.850+0000 7f5c19008700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5c14101270 0x7f5c1419d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:32.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:32.850+0000 7f5c19008700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1419d740 con 0x7f5c14100880 2024-04-01T06:54:32.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:32.850+0000 7f5c19008700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1419d880 con 0x7f5c14101270 2024-04-01T06:54:32.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:32.850+0000 7f5c19008700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1419da10 con 0x7f5c140ffec0 2024-04-01T06:54:32.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:32.850+0000 7f5c1259c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5c14100880 0x7f5c14196150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:32.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:32.850+0000 7f5c1259c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5c14100880 0x7f5c14196150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:49554/0 (socket says 172.21.15.83:49554) 2024-04-01T06:54:32.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:32.850+0000 7f5c1259c700 1 -- 172.21.15.83:0/684711185 learned_addr learned my addr 172.21.15.83:0/684711185 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:54:32.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:32.850+0000 7f5c12d9d700 1 --2- 172.21.15.83:0/684711185 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c140ffec0 0x7f5c14195c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:32.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:32.850+0000 7f5c1359e700 1 --2- 172.21.15.83:0/684711185 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5c14101270 0x7f5c1419d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:32.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:32.850+0000 7f5c1259c700 1 -- 172.21.15.83:0/684711185 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c140ffec0 msgr2=0x7f5c14195c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:32.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:32.850+0000 7f5c1259c700 1 --2- 172.21.15.83:0/684711185 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c140ffec0 0x7f5c14195c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:32.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:32.850+0000 7f5c1259c700 1 -- 172.21.15.83:0/684711185 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5c14101270 msgr2=0x7f5c1419d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:32.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:32.850+0000 7f5c1259c700 1 --2- 172.21.15.83:0/684711185 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5c14101270 0x7f5c1419d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:32.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:32.850+0000 7f5c1259c700 1 -- 172.21.15.83:0/684711185 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c0c009d00 con 0x7f5c14100880 2024-04-01T06:54:32.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:32.850+0000 7f5c1259c700 1 --2- 172.21.15.83:0/684711185 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5c14100880 0x7f5c14196150 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5c0400c9b0 tx=0x7f5c0400ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:32.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:32.850+0000 7f5bfbfff700 1 -- 172.21.15.83:0/684711185 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c04007b00 con 0x7f5c14100880 2024-04-01T06:54:32.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:32.850+0000 7f5c19008700 1 -- 172.21.15.83:0/684711185 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c1419dcf0 con 0x7f5c14100880 2024-04-01T06:54:32.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:32.850+0000 7f5bfbfff700 1 -- 172.21.15.83:0/684711185 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5c04007c60 con 0x7f5c14100880 2024-04-01T06:54:32.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:32.850+0000 7f5bfbfff700 1 -- 172.21.15.83:0/684711185 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c04018660 con 0x7f5c14100880 2024-04-01T06:54:32.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:32.850+0000 7f5c19008700 1 -- 172.21.15.83:0/684711185 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c1419e1f0 con 0x7f5c14100880 2024-04-01T06:54:32.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:32.851+0000 7f5c19008700 1 -- 172.21.15.83:0/684711185 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c14107030 con 0x7f5c14100880 2024-04-01T06:54:32.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:32.852+0000 7f5bfbfff700 1 -- 172.21.15.83:0/684711185 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) v1 ==== 135865+0+0 (secure 0 0 0) 0x7f5c0400f450 con 0x7f5c14100880 2024-04-01T06:54:32.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:32.853+0000 7f5bfbfff700 1 --2- 172.21.15.83:0/684711185 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f5bfc0a1120 0x7f5bfc0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:32.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:32.853+0000 7f5c12d9d700 1 --2- 172.21.15.83:0/684711185 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f5bfc0a1120 0x7f5bfc0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:32.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:32.853+0000 7f5bfbfff700 1 -- 172.21.15.83:0/684711185 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f5c040cc9e0 con 0x7f5c14100880 2024-04-01T06:54:32.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:32.853+0000 7f5c12d9d700 1 --2- 172.21.15.83:0/684711185 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f5bfc0a1120 0x7f5bfc0a35e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5c14067bd0 tx=0x7f5c08007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:32.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:32.857+0000 7f5bfbfff700 1 -- 172.21.15.83:0/684711185 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f5c04096350 con 0x7f5c14100880 2024-04-01T06:54:33.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:33.103+0000 7f5c19008700 1 -- 172.21.15.83:0/684711185 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f5c1410b460 con 0x7f5c14100880 2024-04-01T06:54:33.253 INFO:journalctl@ceph.mds.b.smithi145.stdout:Apr 01 06:54:32 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-b[84548]: 2024-04-01T06:54:32.966+0000 7f9d6e539700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-01T06:54:33.253 INFO:journalctl@ceph.mds.b.smithi145.stdout:Apr 01 06:54:32 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-b[84548]: 2024-04-01T06:54:32.966+0000 7f9d6e539700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-04-01T06:54:33.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:33 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/1361779961' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-01T06:54:33.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:33 smithi145 ceph-mon[47816]: mds.? [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] up:active 2024-04-01T06:54:33.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:33 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/1361779961' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-01T06:54:33.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:33 smithi145 ceph-mon[47816]: daemon mds.e assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-04-01T06:54:33.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:33 smithi145 ceph-mon[47816]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-01T06:54:33.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:33 smithi145 ceph-mon[47816]: Cluster is now healthy 2024-04-01T06:54:33.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:33 smithi145 ceph-mon[47816]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-04-01T06:54:33.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:33 smithi145 ceph-mon[47816]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:creating} 9 up:standby 2024-04-01T06:54:33.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:33 smithi145 ceph-mon[47816]: daemon mds.e is now active in filesystem cephfs as rank 2 2024-04-01T06:54:33.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:33 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/1361779961' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-01T06:54:33.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:33 smithi083 ceph-mon[43429]: mds.? [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] up:active 2024-04-01T06:54:33.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:33 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/1361779961' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-01T06:54:33.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:33 smithi083 ceph-mon[43429]: daemon mds.e assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-04-01T06:54:33.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:33 smithi083 ceph-mon[43429]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-01T06:54:33.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:33 smithi083 ceph-mon[43429]: Cluster is now healthy 2024-04-01T06:54:33.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:33 smithi083 ceph-mon[43429]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-04-01T06:54:33.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:33 smithi083 ceph-mon[43429]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:creating} 9 up:standby 2024-04-01T06:54:33.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:33 smithi083 ceph-mon[43429]: daemon mds.e is now active in filesystem cephfs as rank 2 2024-04-01T06:54:33.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:33 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/1361779961' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-01T06:54:33.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:33 smithi153 ceph-mon[48187]: mds.? [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] up:active 2024-04-01T06:54:33.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:33 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/1361779961' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-01T06:54:33.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:33 smithi153 ceph-mon[48187]: daemon mds.e assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-04-01T06:54:33.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:33 smithi153 ceph-mon[48187]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-01T06:54:33.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:33 smithi153 ceph-mon[48187]: Cluster is now healthy 2024-04-01T06:54:33.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:33 smithi153 ceph-mon[48187]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-04-01T06:54:33.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:33 smithi153 ceph-mon[48187]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:creating} 9 up:standby 2024-04-01T06:54:33.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:33 smithi153 ceph-mon[48187]: daemon mds.e is now active in filesystem cephfs as rank 2 2024-04-01T06:54:33.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:33.703+0000 7f5bfbfff700 1 -- 172.21.15.83:0/684711185 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v22) v1 ==== 115+0+0 (secure 0 0 0) 0x7f5c04099970 con 0x7f5c14100880 2024-04-01T06:54:33.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:33.706+0000 7f5c19008700 1 -- 172.21.15.83:0/684711185 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f5bfc0a1120 msgr2=0x7f5bfc0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:33.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:33.706+0000 7f5c19008700 1 --2- 172.21.15.83:0/684711185 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f5bfc0a1120 0x7f5bfc0a35e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5c14067bd0 tx=0x7f5c08007400 comp rx=0 tx=0).stop 2024-04-01T06:54:33.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:33.706+0000 7f5c19008700 1 -- 172.21.15.83:0/684711185 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5c14100880 msgr2=0x7f5c14196150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:33.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:33.706+0000 7f5c19008700 1 --2- 172.21.15.83:0/684711185 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5c14100880 0x7f5c14196150 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5c0400c9b0 tx=0x7f5c0400ccc0 comp rx=0 tx=0).stop 2024-04-01T06:54:33.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:33.706+0000 7f5c19008700 1 -- 172.21.15.83:0/684711185 shutdown_connections 2024-04-01T06:54:33.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:33.706+0000 7f5c19008700 1 --2- 172.21.15.83:0/684711185 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f5bfc0a1120 0x7f5bfc0a35e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:33.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:33.706+0000 7f5c19008700 1 --2- 172.21.15.83:0/684711185 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5c14101270 0x7f5c1419d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:33.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:33.706+0000 7f5c19008700 1 --2- 172.21.15.83:0/684711185 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c140ffec0 0x7f5c14195c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:33.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:33.706+0000 7f5c19008700 1 --2- 172.21.15.83:0/684711185 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5c14100880 0x7f5c14196150 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:33.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:33.706+0000 7f5c19008700 1 -- 172.21.15.83:0/684711185 >> 172.21.15.83:0/684711185 conn(0x7f5c140fa950 msgr2=0x7f5c14104170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:33.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:33.706+0000 7f5c19008700 1 -- 172.21.15.83:0/684711185 shutdown_connections 2024-04-01T06:54:33.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:33.706+0000 7f5c19008700 1 -- 172.21.15.83:0/684711185 wait complete. 2024-04-01T06:54:33.720 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'} subvols for filesystem 'cephfs' 2024-04-01T06:54:33.720 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs qa 2024-04-01T06:54:33.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:33.849+0000 7fd9e46d2700 1 -- 172.21.15.83:0/104384641 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9dc1017f0 msgr2=0x7fd9dc1080a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:33.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:33.849+0000 7fd9e46d2700 1 --2- 172.21.15.83:0/104384641 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9dc1017f0 0x7fd9dc1080a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd9d400b0d0 tx=0x7fd9d400b3e0 comp rx=0 tx=0).stop 2024-04-01T06:54:33.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:33.849+0000 7fd9e46d2700 1 -- 172.21.15.83:0/104384641 shutdown_connections 2024-04-01T06:54:33.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:33.849+0000 7fd9e46d2700 1 --2- 172.21.15.83:0/104384641 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9dc1017f0 0x7fd9dc1080a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:33.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:33.849+0000 7fd9e46d2700 1 --2- 172.21.15.83:0/104384641 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd9dc0ffc60 0x7fd9dc100080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:33.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:33.849+0000 7fd9e46d2700 1 --2- 172.21.15.83:0/104384641 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9dc100e50 0x7fd9dc1012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:33.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:33.849+0000 7fd9e46d2700 1 -- 172.21.15.83:0/104384641 >> 172.21.15.83:0/104384641 conn(0x7fd9dc0fb1d0 msgr2=0x7fd9dc0fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:33.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:33.849+0000 7fd9e46d2700 1 -- 172.21.15.83:0/104384641 shutdown_connections 2024-04-01T06:54:33.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:33.849+0000 7fd9e46d2700 1 -- 172.21.15.83:0/104384641 wait complete. 2024-04-01T06:54:33.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:33.850+0000 7fd9e46d2700 1 Processor -- start 2024-04-01T06:54:33.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:33.850+0000 7fd9e46d2700 1 -- start start 2024-04-01T06:54:33.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:33.850+0000 7fd9e46d2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9dc0ffc60 0x7fd9dc068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:33.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:33.850+0000 7fd9e46d2700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd9dc100e50 0x7fd9dc19bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:33.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:33.850+0000 7fd9e46d2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9dc1017f0 0x7fd9dc19e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:33.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:33.850+0000 7fd9e46d2700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9dc19e8a0 con 0x7fd9dc1017f0 2024-04-01T06:54:33.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:33.850+0000 7fd9e46d2700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9dc19ea10 con 0x7fd9dc100e50 2024-04-01T06:54:33.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:33.850+0000 7fd9e46d2700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9dc19ebd0 con 0x7fd9dc0ffc60 2024-04-01T06:54:33.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:33.850+0000 7fd9e2c6f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9dc1017f0 0x7fd9dc19e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:33.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:33.850+0000 7fd9e2c6f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9dc1017f0 0x7fd9dc19e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:35238/0 (socket says 172.21.15.83:35238) 2024-04-01T06:54:33.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:33.850+0000 7fd9e2c6f700 1 -- 172.21.15.83:0/3305863291 learned_addr learned my addr 172.21.15.83:0/3305863291 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:54:33.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:33.850+0000 7fd9e246e700 1 --2- 172.21.15.83:0/3305863291 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9dc0ffc60 0x7fd9dc068970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:33.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:33.850+0000 7fd9e1c6d700 1 --2- 172.21.15.83:0/3305863291 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd9dc100e50 0x7fd9dc19bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:33.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:33.850+0000 7fd9e2c6f700 1 -- 172.21.15.83:0/3305863291 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9dc0ffc60 msgr2=0x7fd9dc068970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:33.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:33.850+0000 7fd9e2c6f700 1 --2- 172.21.15.83:0/3305863291 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9dc0ffc60 0x7fd9dc068970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:33.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:33.850+0000 7fd9e2c6f700 1 -- 172.21.15.83:0/3305863291 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd9dc100e50 msgr2=0x7fd9dc19bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:33.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:33.850+0000 7fd9e2c6f700 1 --2- 172.21.15.83:0/3305863291 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd9dc100e50 0x7fd9dc19bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:33.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:33.850+0000 7fd9e2c6f700 1 -- 172.21.15.83:0/3305863291 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d4009d00 con 0x7fd9dc1017f0 2024-04-01T06:54:33.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:33.851+0000 7fd9e1c6d700 1 --2- 172.21.15.83:0/3305863291 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd9dc100e50 0x7fd9dc19bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:54:33.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:33.851+0000 7fd9e2c6f700 1 --2- 172.21.15.83:0/3305863291 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9dc1017f0 0x7fd9dc19e100 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd9d4007bd0 tx=0x7fd9d40094f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:33.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:33.851+0000 7fd9d37fe700 1 -- 172.21.15.83:0/3305863291 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d400e040 con 0x7fd9dc1017f0 2024-04-01T06:54:33.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:33.851+0000 7fd9d37fe700 1 -- 172.21.15.83:0/3305863291 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd9d4012dc0 con 0x7fd9dc1017f0 2024-04-01T06:54:33.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:33.851+0000 7fd9e46d2700 1 -- 172.21.15.83:0/3305863291 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9dc19ee50 con 0x7fd9dc1017f0 2024-04-01T06:54:33.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:33.851+0000 7fd9d37fe700 1 -- 172.21.15.83:0/3305863291 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d401b450 con 0x7fd9dc1017f0 2024-04-01T06:54:33.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:33.851+0000 7fd9e46d2700 1 -- 172.21.15.83:0/3305863291 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9dc19f270 con 0x7fd9dc1017f0 2024-04-01T06:54:33.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:33.852+0000 7fd9e46d2700 1 -- 172.21.15.83:0/3305863291 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9dc1070e0 con 0x7fd9dc1017f0 2024-04-01T06:54:33.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:33.853+0000 7fd9d37fe700 1 -- 172.21.15.83:0/3305863291 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) v1 ==== 135865+0+0 (secure 0 0 0) 0x7fd9d401d610 con 0x7fd9dc1017f0 2024-04-01T06:54:33.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:33.853+0000 7fd9d37fe700 1 --2- 172.21.15.83:0/3305863291 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd9c80a1120 0x7fd9c80a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:33.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:33.853+0000 7fd9e246e700 1 --2- 172.21.15.83:0/3305863291 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd9c80a1120 0x7fd9c80a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:33.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:33.853+0000 7fd9d37fe700 1 -- 172.21.15.83:0/3305863291 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fd9d40ced60 con 0x7fd9dc1017f0 2024-04-01T06:54:33.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:33.854+0000 7fd9e246e700 1 --2- 172.21.15.83:0/3305863291 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd9c80a1120 0x7fd9c80a35e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc005950 tx=0x7fd9cc0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:33.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:33.857+0000 7fd9d37fe700 1 -- 172.21.15.83:0/3305863291 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7fd9d40986d0 con 0x7fd9dc1017f0 2024-04-01T06:54:34.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.086+0000 7fd9e46d2700 1 -- 172.21.15.83:0/3305863291 --> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7fd9dc067ac0 con 0x7fd9c80a1120 2024-04-01T06:54:34.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.111+0000 7fd9d37fe700 1 -- 172.21.15.83:0/3305863291 <== mgr.14152 v2:172.21.15.83:6800/3375372052 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fd9dc067ac0 con 0x7fd9c80a1120 2024-04-01T06:54:34.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.113+0000 7fd9e46d2700 1 -- 172.21.15.83:0/3305863291 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd9c80a1120 msgr2=0x7fd9c80a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:34.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.113+0000 7fd9e46d2700 1 --2- 172.21.15.83:0/3305863291 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd9c80a1120 0x7fd9c80a35e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc005950 tx=0x7fd9cc0058e0 comp rx=0 tx=0).stop 2024-04-01T06:54:34.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.113+0000 7fd9e46d2700 1 -- 172.21.15.83:0/3305863291 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9dc1017f0 msgr2=0x7fd9dc19e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:34.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.113+0000 7fd9e46d2700 1 --2- 172.21.15.83:0/3305863291 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9dc1017f0 0x7fd9dc19e100 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd9d4007bd0 tx=0x7fd9d40094f0 comp rx=0 tx=0).stop 2024-04-01T06:54:34.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.113+0000 7fd9e46d2700 1 -- 172.21.15.83:0/3305863291 shutdown_connections 2024-04-01T06:54:34.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.113+0000 7fd9e46d2700 1 --2- 172.21.15.83:0/3305863291 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9dc1017f0 0x7fd9dc19e100 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:34.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.113+0000 7fd9e46d2700 1 --2- 172.21.15.83:0/3305863291 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd9c80a1120 0x7fd9c80a35e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:34.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.113+0000 7fd9e46d2700 1 --2- 172.21.15.83:0/3305863291 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9dc0ffc60 0x7fd9dc068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:34.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.113+0000 7fd9e46d2700 1 --2- 172.21.15.83:0/3305863291 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd9dc100e50 0x7fd9dc19bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:34.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.113+0000 7fd9e46d2700 1 -- 172.21.15.83:0/3305863291 >> 172.21.15.83:0/3305863291 conn(0x7fd9dc0fb1d0 msgr2=0x7fd9dc104220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:34.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.114+0000 7fd9e46d2700 1 -- 172.21.15.83:0/3305863291 shutdown_connections 2024-04-01T06:54:34.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.114+0000 7fd9e46d2700 1 -- 172.21.15.83:0/3305863291 wait complete. 2024-04-01T06:54:34.125 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 --group_name qa 2024-04-01T06:54:34.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.254+0000 7f6a9bd11700 1 -- 172.21.15.83:0/2526500593 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a94102910 msgr2=0x7f6a941091c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:34.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.254+0000 7f6a9bd11700 1 --2- 172.21.15.83:0/2526500593 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a94102910 0x7f6a941091c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c00b0d0 tx=0x7f6a8c00b3e0 comp rx=0 tx=0).stop 2024-04-01T06:54:34.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.254+0000 7f6a9bd11700 1 -- 172.21.15.83:0/2526500593 shutdown_connections 2024-04-01T06:54:34.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.254+0000 7f6a9bd11700 1 --2- 172.21.15.83:0/2526500593 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a94102910 0x7f6a941091c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:34.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.254+0000 7f6a9bd11700 1 --2- 172.21.15.83:0/2526500593 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a94100d80 0x7f6a941011a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:34.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.254+0000 7f6a9bd11700 1 --2- 172.21.15.83:0/2526500593 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6a94101f70 0x7f6a941023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:34.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.254+0000 7f6a9bd11700 1 -- 172.21.15.83:0/2526500593 >> 172.21.15.83:0/2526500593 conn(0x7f6a940fc2f0 msgr2=0x7f6a940fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:34.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.254+0000 7f6a9bd11700 1 -- 172.21.15.83:0/2526500593 shutdown_connections 2024-04-01T06:54:34.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.254+0000 7f6a9bd11700 1 -- 172.21.15.83:0/2526500593 wait complete. 2024-04-01T06:54:34.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.254+0000 7f6a9bd11700 1 Processor -- start 2024-04-01T06:54:34.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.254+0000 7f6a9bd11700 1 -- start start 2024-04-01T06:54:34.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.255+0000 7f6a9bd11700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a94100d80 0x7f6a94196e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:34.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.255+0000 7f6a9bd11700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6a94101f70 0x7f6a94197340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:34.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.255+0000 7f6a9bd11700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a94102910 0x7f6a9419e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:34.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.255+0000 7f6a9bd11700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9419e8f0 con 0x7f6a94102910 2024-04-01T06:54:34.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.255+0000 7f6a9bd11700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9419ea60 con 0x7f6a94101f70 2024-04-01T06:54:34.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.255+0000 7f6a9bd11700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9419ec20 con 0x7f6a94100d80 2024-04-01T06:54:34.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.255+0000 7f6a9a2ae700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a94102910 0x7f6a9419e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:34.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.255+0000 7f6a9a2ae700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a94102910 0x7f6a9419e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:35276/0 (socket says 172.21.15.83:35276) 2024-04-01T06:54:34.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.255+0000 7f6a9a2ae700 1 -- 172.21.15.83:0/1986733647 learned_addr learned my addr 172.21.15.83:0/1986733647 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:54:34.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.255+0000 7f6a992ac700 1 --2- 172.21.15.83:0/1986733647 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6a94101f70 0x7f6a94197340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:34.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.255+0000 7f6a99aad700 1 --2- 172.21.15.83:0/1986733647 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a94100d80 0x7f6a94196e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:34.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.255+0000 7f6a9a2ae700 1 -- 172.21.15.83:0/1986733647 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a94100d80 msgr2=0x7f6a94196e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:34.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.255+0000 7f6a9a2ae700 1 --2- 172.21.15.83:0/1986733647 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a94100d80 0x7f6a94196e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:34.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.255+0000 7f6a9a2ae700 1 -- 172.21.15.83:0/1986733647 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6a94101f70 msgr2=0x7f6a94197340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:34.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.255+0000 7f6a9a2ae700 1 --2- 172.21.15.83:0/1986733647 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6a94101f70 0x7f6a94197340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:34.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.255+0000 7f6a9a2ae700 1 -- 172.21.15.83:0/1986733647 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a8c009d00 con 0x7f6a94102910 2024-04-01T06:54:34.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.255+0000 7f6a992ac700 1 --2- 172.21.15.83:0/1986733647 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6a94101f70 0x7f6a94197340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:54:34.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.255+0000 7f6a99aad700 1 --2- 172.21.15.83:0/1986733647 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a94100d80 0x7f6a94196e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:54:34.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.255+0000 7f6a9a2ae700 1 --2- 172.21.15.83:0/1986733647 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a94102910 0x7f6a9419e320 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c007bd0 tx=0x7f6a8c0094f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:34.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.255+0000 7f6a8affd700 1 -- 172.21.15.83:0/1986733647 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c00e040 con 0x7f6a94102910 2024-04-01T06:54:34.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.255+0000 7f6a8affd700 1 -- 172.21.15.83:0/1986733647 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6a8c012dc0 con 0x7f6a94102910 2024-04-01T06:54:34.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.255+0000 7f6a9bd11700 1 -- 172.21.15.83:0/1986733647 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a9419eea0 con 0x7f6a94102910 2024-04-01T06:54:34.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.255+0000 7f6a8affd700 1 -- 172.21.15.83:0/1986733647 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c01b450 con 0x7f6a94102910 2024-04-01T06:54:34.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.255+0000 7f6a9bd11700 1 -- 172.21.15.83:0/1986733647 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a9419f2c0 con 0x7f6a94102910 2024-04-01T06:54:34.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.256+0000 7f6a9bd11700 1 -- 172.21.15.83:0/1986733647 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a94108130 con 0x7f6a94102910 2024-04-01T06:54:34.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.258+0000 7f6a8affd700 1 -- 172.21.15.83:0/1986733647 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) v1 ==== 135865+0+0 (secure 0 0 0) 0x7f6a8c01d610 con 0x7f6a94102910 2024-04-01T06:54:34.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.258+0000 7f6a8affd700 1 --2- 172.21.15.83:0/1986733647 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f6a800a11a0 0x7f6a800a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:34.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.259+0000 7f6a99aad700 1 --2- 172.21.15.83:0/1986733647 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f6a800a11a0 0x7f6a800a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:34.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.259+0000 7f6a8affd700 1 -- 172.21.15.83:0/1986733647 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f6a8c0ced30 con 0x7f6a94102910 2024-04-01T06:54:34.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.259+0000 7f6a99aad700 1 --2- 172.21.15.83:0/1986733647 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f6a800a11a0 0x7f6a800a3660 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6a90005fd0 tx=0x7f6a90005de0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:34.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.262+0000 7f6a8affd700 1 -- 172.21.15.83:0/1986733647 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f6a8c098600 con 0x7f6a94102910 2024-04-01T06:54:34.262 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:54:34 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:54:34.091+0000 7f623c525700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-01T06:54:34.262 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:54:34 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:54:34.091+0000 7f623c525700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-01T06:54:34.262 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:54:34 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:54:34.091+0000 7f623c525700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-01T06:54:34.262 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:54:34 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:54:34.091+0000 7f623c525700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-01T06:54:34.262 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:54:34 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:54:34.091+0000 7f623c525700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-01T06:54:34.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:34 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/684711185' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-04-01T06:54:34.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:34 smithi083 ceph-mon[43429]: mds.? [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] up:active 2024-04-01T06:54:34.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:34 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/684711185' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-04-01T06:54:34.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:34 smithi083 ceph-mon[43429]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 9 up:standby 2024-04-01T06:54:34.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:34 smithi083 ceph-mon[43429]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-04-01T06:54:34.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:34 smithi083 ceph-mon[43429]: pgmap v219: 97 pgs: 97 active+clean; 580 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 11 op/s 2024-04-01T06:54:34.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:34 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/684711185' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-04-01T06:54:34.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:34 smithi153 ceph-mon[48187]: mds.? [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] up:active 2024-04-01T06:54:34.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:34 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/684711185' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-04-01T06:54:34.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:34 smithi153 ceph-mon[48187]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 9 up:standby 2024-04-01T06:54:34.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:34 smithi153 ceph-mon[48187]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-04-01T06:54:34.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:34 smithi153 ceph-mon[48187]: pgmap v219: 97 pgs: 97 active+clean; 580 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 11 op/s 2024-04-01T06:54:34.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.489+0000 7f6a9bd11700 1 -- 172.21.15.83:0/1986733647 --> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7f6a940611f0 con 0x7f6a800a11a0 2024-04-01T06:54:34.502 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:34 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/684711185' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-04-01T06:54:34.502 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:34 smithi145 ceph-mon[47816]: mds.? [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] up:active 2024-04-01T06:54:34.502 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:34 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/684711185' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-04-01T06:54:34.502 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:34 smithi145 ceph-mon[47816]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 9 up:standby 2024-04-01T06:54:34.502 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:34 smithi145 ceph-mon[47816]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-04-01T06:54:34.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:34 smithi145 ceph-mon[47816]: pgmap v219: 97 pgs: 97 active+clean; 580 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 11 op/s 2024-04-01T06:54:34.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.511+0000 7f6a8affd700 1 -- 172.21.15.83:0/1986733647 <== mgr.14152 v2:172.21.15.83:6800/3375372052 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f6a940611f0 con 0x7f6a800a11a0 2024-04-01T06:54:34.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.513+0000 7f6a9bd11700 1 -- 172.21.15.83:0/1986733647 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f6a800a11a0 msgr2=0x7f6a800a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:34.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.513+0000 7f6a9bd11700 1 --2- 172.21.15.83:0/1986733647 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f6a800a11a0 0x7f6a800a3660 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6a90005fd0 tx=0x7f6a90005de0 comp rx=0 tx=0).stop 2024-04-01T06:54:34.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.513+0000 7f6a9bd11700 1 -- 172.21.15.83:0/1986733647 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a94102910 msgr2=0x7f6a9419e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:34.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.513+0000 7f6a9bd11700 1 --2- 172.21.15.83:0/1986733647 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a94102910 0x7f6a9419e320 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c007bd0 tx=0x7f6a8c0094f0 comp rx=0 tx=0).stop 2024-04-01T06:54:34.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.513+0000 7f6a9bd11700 1 -- 172.21.15.83:0/1986733647 shutdown_connections 2024-04-01T06:54:34.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.513+0000 7f6a9bd11700 1 --2- 172.21.15.83:0/1986733647 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a94102910 0x7f6a9419e320 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:34.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.513+0000 7f6a9bd11700 1 --2- 172.21.15.83:0/1986733647 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f6a800a11a0 0x7f6a800a3660 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:34.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.513+0000 7f6a9bd11700 1 --2- 172.21.15.83:0/1986733647 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a94100d80 0x7f6a94196e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:34.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.513+0000 7f6a9bd11700 1 --2- 172.21.15.83:0/1986733647 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6a94101f70 0x7f6a94197340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:34.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.513+0000 7f6a9bd11700 1 -- 172.21.15.83:0/1986733647 >> 172.21.15.83:0/1986733647 conn(0x7f6a940fc2f0 msgr2=0x7f6a94105270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:34.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.513+0000 7f6a9bd11700 1 -- 172.21.15.83:0/1986733647 shutdown_connections 2024-04-01T06:54:34.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.513+0000 7f6a9bd11700 1 -- 172.21.15.83:0/1986733647 wait complete. 2024-04-01T06:54:34.525 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-04-01T06:54:34.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.651+0000 7fd2fea23700 1 -- 172.21.15.83:0/2373048397 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2f8101ff0 msgr2=0x7fd2f8102450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:34.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.651+0000 7fd2fea23700 1 --2- 172.21.15.83:0/2373048397 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2f8101ff0 0x7fd2f8102450 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd2e8009990 tx=0x7fd2e8009ca0 comp rx=0 tx=0).stop 2024-04-01T06:54:34.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.652+0000 7fd2fea23700 1 -- 172.21.15.83:0/2373048397 shutdown_connections 2024-04-01T06:54:34.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.652+0000 7fd2fea23700 1 --2- 172.21.15.83:0/2373048397 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd2f8102990 0x7fd2f8109240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:34.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.652+0000 7fd2fea23700 1 --2- 172.21.15.83:0/2373048397 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2f80ff020 0x7fd2f80ff440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:34.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.652+0000 7fd2fea23700 1 --2- 172.21.15.83:0/2373048397 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2f8101ff0 0x7fd2f8102450 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:34.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.652+0000 7fd2fea23700 1 -- 172.21.15.83:0/2373048397 >> 172.21.15.83:0/2373048397 conn(0x7fd2f80fa950 msgr2=0x7fd2f80fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:34.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.652+0000 7fd2fea23700 1 -- 172.21.15.83:0/2373048397 shutdown_connections 2024-04-01T06:54:34.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.652+0000 7fd2fea23700 1 -- 172.21.15.83:0/2373048397 wait complete. 2024-04-01T06:54:34.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.652+0000 7fd2fea23700 1 Processor -- start 2024-04-01T06:54:34.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.652+0000 7fd2fea23700 1 -- start start 2024-04-01T06:54:34.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.652+0000 7fd2fea23700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd2f80ff020 0x7fd2f8196cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:34.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.653+0000 7fd2fea23700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2f8101ff0 0x7fd2f8197200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:34.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.653+0000 7fd2fea23700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2f8102990 0x7fd2f819e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:34.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.653+0000 7fd2fea23700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f819e7b0 con 0x7fd2f8101ff0 2024-04-01T06:54:34.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.653+0000 7fd2fea23700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f819e920 con 0x7fd2f80ff020 2024-04-01T06:54:34.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.653+0000 7fd2fea23700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f819eae0 con 0x7fd2f8102990 2024-04-01T06:54:34.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.653+0000 7fd2f77fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2f8101ff0 0x7fd2f8197200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:34.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.653+0000 7fd2f77fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2f8101ff0 0x7fd2f8197200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:35280/0 (socket says 172.21.15.83:35280) 2024-04-01T06:54:34.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.653+0000 7fd2f77fe700 1 -- 172.21.15.83:0/2192833385 learned_addr learned my addr 172.21.15.83:0/2192833385 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:54:34.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.653+0000 7fd2f7fff700 1 --2- 172.21.15.83:0/2192833385 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd2f80ff020 0x7fd2f8196cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:34.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.653+0000 7fd2fcfc0700 1 --2- 172.21.15.83:0/2192833385 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2f8102990 0x7fd2f819e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:34.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.653+0000 7fd2f77fe700 1 -- 172.21.15.83:0/2192833385 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2f8102990 msgr2=0x7fd2f819e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:34.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.653+0000 7fd2f77fe700 1 --2- 172.21.15.83:0/2192833385 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2f8102990 0x7fd2f819e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:34.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.653+0000 7fd2f77fe700 1 -- 172.21.15.83:0/2192833385 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd2f80ff020 msgr2=0x7fd2f8196cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:34.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.653+0000 7fd2f77fe700 1 --2- 172.21.15.83:0/2192833385 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd2f80ff020 0x7fd2f8196cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:34.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.653+0000 7fd2f77fe700 1 -- 172.21.15.83:0/2192833385 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e80095f0 con 0x7fd2f8101ff0 2024-04-01T06:54:34.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.653+0000 7fd2f7fff700 1 --2- 172.21.15.83:0/2192833385 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd2f80ff020 0x7fd2f8196cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:54:34.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.653+0000 7fd2f77fe700 1 --2- 172.21.15.83:0/2192833385 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2f8101ff0 0x7fd2f8197200 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd2e80095c0 tx=0x7fd2e800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:34.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.653+0000 7fd2f57fa700 1 -- 172.21.15.83:0/2192833385 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e801d070 con 0x7fd2f8101ff0 2024-04-01T06:54:34.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.653+0000 7fd2fea23700 1 -- 172.21.15.83:0/2192833385 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2f819ed60 con 0x7fd2f8101ff0 2024-04-01T06:54:34.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.653+0000 7fd2f57fa700 1 -- 172.21.15.83:0/2192833385 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd2e800fb80 con 0x7fd2f8101ff0 2024-04-01T06:54:34.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.653+0000 7fd2f57fa700 1 -- 172.21.15.83:0/2192833385 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e8017650 con 0x7fd2f8101ff0 2024-04-01T06:54:34.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.653+0000 7fd2fea23700 1 -- 172.21.15.83:0/2192833385 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2f819f190 con 0x7fd2f8101ff0 2024-04-01T06:54:34.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.654+0000 7fd2fea23700 1 -- 172.21.15.83:0/2192833385 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2f8108230 con 0x7fd2f8101ff0 2024-04-01T06:54:34.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.655+0000 7fd2f57fa700 1 -- 172.21.15.83:0/2192833385 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) v1 ==== 135865+0+0 (secure 0 0 0) 0x7fd2e8022470 con 0x7fd2f8101ff0 2024-04-01T06:54:34.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.656+0000 7fd2f57fa700 1 --2- 172.21.15.83:0/2192833385 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd2e00a1120 0x7fd2e00a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:34.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.656+0000 7fd2f7fff700 1 --2- 172.21.15.83:0/2192833385 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd2e00a1120 0x7fd2e00a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:34.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.656+0000 7fd2f57fa700 1 -- 172.21.15.83:0/2192833385 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fd2e80ce1c0 con 0x7fd2f8101ff0 2024-04-01T06:54:34.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.656+0000 7fd2f7fff700 1 --2- 172.21.15.83:0/2192833385 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd2e00a1120 0x7fd2e00a35e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec005950 tx=0x7fd2ec0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:34.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.659+0000 7fd2f57fa700 1 -- 172.21.15.83:0/2192833385 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7fd2e8097b30 con 0x7fd2f8101ff0 2024-04-01T06:54:34.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.890+0000 7fd2fea23700 1 -- 172.21.15.83:0/2192833385 --> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) v1 -- 0x7fd2f80611f0 con 0x7fd2e00a1120 2024-04-01T06:54:34.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.894+0000 7fd2f57fa700 1 -- 172.21.15.83:0/2192833385 <== mgr.14152 v2:172.21.15.83:6800/3375372052 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+54 (secure 0 0 0) 0x7fd2f80611f0 con 0x7fd2e00a1120 2024-04-01T06:54:34.894 INFO:teuthology.orchestra.run.smithi083.stdout:/volumes/qa/sv_0/e2fd47eb-e24e-41fd-9a3f-b24ed0fd9ec9 2024-04-01T06:54:34.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.896+0000 7fd2fea23700 1 -- 172.21.15.83:0/2192833385 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd2e00a1120 msgr2=0x7fd2e00a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:34.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.896+0000 7fd2fea23700 1 --2- 172.21.15.83:0/2192833385 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd2e00a1120 0x7fd2e00a35e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec005950 tx=0x7fd2ec0058e0 comp rx=0 tx=0).stop 2024-04-01T06:54:34.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.896+0000 7fd2fea23700 1 -- 172.21.15.83:0/2192833385 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2f8101ff0 msgr2=0x7fd2f8197200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:34.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.896+0000 7fd2fea23700 1 --2- 172.21.15.83:0/2192833385 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2f8101ff0 0x7fd2f8197200 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd2e80095c0 tx=0x7fd2e800f690 comp rx=0 tx=0).stop 2024-04-01T06:54:34.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.896+0000 7fd2fea23700 1 -- 172.21.15.83:0/2192833385 shutdown_connections 2024-04-01T06:54:34.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.896+0000 7fd2fea23700 1 --2- 172.21.15.83:0/2192833385 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd2e00a1120 0x7fd2e00a35e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:34.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.896+0000 7fd2fea23700 1 --2- 172.21.15.83:0/2192833385 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2f8102990 0x7fd2f819e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:34.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.896+0000 7fd2fea23700 1 --2- 172.21.15.83:0/2192833385 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd2f80ff020 0x7fd2f8196cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:34.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.896+0000 7fd2fea23700 1 --2- 172.21.15.83:0/2192833385 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2f8101ff0 0x7fd2f8197200 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:34.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.896+0000 7fd2fea23700 1 -- 172.21.15.83:0/2192833385 >> 172.21.15.83:0/2192833385 conn(0x7fd2f80fa950 msgr2=0x7fd2f8105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:34.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.896+0000 7fd2fea23700 1 -- 172.21.15.83:0/2192833385 shutdown_connections 2024-04-01T06:54:34.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:34.896+0000 7fd2fea23700 1 -- 172.21.15.83:0/2192833385 wait complete. 2024-04-01T06:54:34.909 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 --group_name qa 2024-04-01T06:54:35.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.036+0000 7fdfcddc0700 1 -- 172.21.15.83:0/3272323357 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfc8100e80 msgr2=0x7fdfc81012e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:35.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.036+0000 7fdfcddc0700 1 --2- 172.21.15.83:0/3272323357 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfc8100e80 0x7fdfc81012e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdfb80099c0 tx=0x7fdfb8009cd0 comp rx=0 tx=0).stop 2024-04-01T06:54:35.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.036+0000 7fdfcddc0700 1 -- 172.21.15.83:0/3272323357 shutdown_connections 2024-04-01T06:54:35.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.036+0000 7fdfcddc0700 1 --2- 172.21.15.83:0/3272323357 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdfc8101820 0x7fdfc81080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:35.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.036+0000 7fdfcddc0700 1 --2- 172.21.15.83:0/3272323357 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfc80ffc90 0x7fdfc81000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:35.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.036+0000 7fdfcddc0700 1 --2- 172.21.15.83:0/3272323357 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfc8100e80 0x7fdfc81012e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:35.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.036+0000 7fdfcddc0700 1 -- 172.21.15.83:0/3272323357 >> 172.21.15.83:0/3272323357 conn(0x7fdfc80fb200 msgr2=0x7fdfc80fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:35.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.036+0000 7fdfcddc0700 1 -- 172.21.15.83:0/3272323357 shutdown_connections 2024-04-01T06:54:35.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.036+0000 7fdfcddc0700 1 -- 172.21.15.83:0/3272323357 wait complete. 2024-04-01T06:54:35.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.037+0000 7fdfcddc0700 1 Processor -- start 2024-04-01T06:54:35.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.037+0000 7fdfcddc0700 1 -- start start 2024-04-01T06:54:35.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.037+0000 7fdfcddc0700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfc80ffc90 0x7fdfc8195d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:35.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.037+0000 7fdfcddc0700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfc8100e80 0x7fdfc8196250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:35.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.037+0000 7fdfcddc0700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdfc8101820 0x7fdfc819d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:35.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.037+0000 7fdfcddc0700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc819d830 con 0x7fdfc8100e80 2024-04-01T06:54:35.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.037+0000 7fdfcddc0700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc819d9a0 con 0x7fdfc8101820 2024-04-01T06:54:35.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.037+0000 7fdfcddc0700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc819db60 con 0x7fdfc80ffc90 2024-04-01T06:54:35.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.037+0000 7fdfc6ffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfc8100e80 0x7fdfc8196250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:35.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.037+0000 7fdfc6ffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfc8100e80 0x7fdfc8196250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:35292/0 (socket says 172.21.15.83:35292) 2024-04-01T06:54:35.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.037+0000 7fdfc6ffd700 1 -- 172.21.15.83:0/1074886868 learned_addr learned my addr 172.21.15.83:0/1074886868 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:54:35.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.037+0000 7fdfc7fff700 1 --2- 172.21.15.83:0/1074886868 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdfc8101820 0x7fdfc819d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:35.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.037+0000 7fdfc77fe700 1 --2- 172.21.15.83:0/1074886868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfc80ffc90 0x7fdfc8195d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:35.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.037+0000 7fdfc6ffd700 1 -- 172.21.15.83:0/1074886868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfc80ffc90 msgr2=0x7fdfc8195d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:35.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.037+0000 7fdfc6ffd700 1 --2- 172.21.15.83:0/1074886868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfc80ffc90 0x7fdfc8195d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:35.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.037+0000 7fdfc6ffd700 1 -- 172.21.15.83:0/1074886868 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdfc8101820 msgr2=0x7fdfc819d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:35.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.037+0000 7fdfc6ffd700 1 --2- 172.21.15.83:0/1074886868 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdfc8101820 0x7fdfc819d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:35.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.037+0000 7fdfc6ffd700 1 -- 172.21.15.83:0/1074886868 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb80095f0 con 0x7fdfc8100e80 2024-04-01T06:54:35.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.037+0000 7fdfc77fe700 1 --2- 172.21.15.83:0/1074886868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfc80ffc90 0x7fdfc8195d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:54:35.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.038+0000 7fdfc6ffd700 1 --2- 172.21.15.83:0/1074886868 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfc8100e80 0x7fdfc8196250 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fdfb80036f0 tx=0x7fdfb80047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:35.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.038+0000 7fdfc4ff9700 1 -- 172.21.15.83:0/1074886868 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb801d070 con 0x7fdfc8100e80 2024-04-01T06:54:35.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.038+0000 7fdfcddc0700 1 -- 172.21.15.83:0/1074886868 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfc819dde0 con 0x7fdfc8100e80 2024-04-01T06:54:35.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.038+0000 7fdfc4ff9700 1 -- 172.21.15.83:0/1074886868 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdfb8004200 con 0x7fdfc8100e80 2024-04-01T06:54:35.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.038+0000 7fdfc4ff9700 1 -- 172.21.15.83:0/1074886868 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb800f460 con 0x7fdfc8100e80 2024-04-01T06:54:35.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.038+0000 7fdfcddc0700 1 -- 172.21.15.83:0/1074886868 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfc819e230 con 0x7fdfc8100e80 2024-04-01T06:54:35.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.039+0000 7fdfcddc0700 1 -- 172.21.15.83:0/1074886868 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfc8107130 con 0x7fdfc8100e80 2024-04-01T06:54:35.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.040+0000 7fdfc4ff9700 1 -- 172.21.15.83:0/1074886868 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) v1 ==== 135865+0+0 (secure 0 0 0) 0x7fdfb8022600 con 0x7fdfc8100e80 2024-04-01T06:54:35.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.041+0000 7fdfc4ff9700 1 --2- 172.21.15.83:0/1074886868 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fdfb40a1120 0x7fdfb40a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:35.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.041+0000 7fdfc77fe700 1 --2- 172.21.15.83:0/1074886868 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fdfb40a1120 0x7fdfb40a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:35.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.041+0000 7fdfc4ff9700 1 -- 172.21.15.83:0/1074886868 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fdfb80cde20 con 0x7fdfc8100e80 2024-04-01T06:54:35.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.041+0000 7fdfc77fe700 1 --2- 172.21.15.83:0/1074886868 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fdfb40a1120 0x7fdfb40a35e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdfc80fce40 tx=0x7fdfb0008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:35.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.044+0000 7fdfc4ff9700 1 -- 172.21.15.83:0/1074886868 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7fdfb8097790 con 0x7fdfc8100e80 2024-04-01T06:54:35.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.281+0000 7fdfcddc0700 1 -- 172.21.15.83:0/1074886868 --> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7fdfc802cd20 con 0x7fdfb40a1120 2024-04-01T06:54:35.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.305+0000 7fdfc4ff9700 1 -- 172.21.15.83:0/1074886868 <== mgr.14152 v2:172.21.15.83:6800/3375372052 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fdfc802cd20 con 0x7fdfb40a1120 2024-04-01T06:54:35.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.307+0000 7fdfcddc0700 1 -- 172.21.15.83:0/1074886868 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fdfb40a1120 msgr2=0x7fdfb40a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:35.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.307+0000 7fdfcddc0700 1 --2- 172.21.15.83:0/1074886868 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fdfb40a1120 0x7fdfb40a35e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdfc80fce40 tx=0x7fdfb0008040 comp rx=0 tx=0).stop 2024-04-01T06:54:35.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.307+0000 7fdfcddc0700 1 -- 172.21.15.83:0/1074886868 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfc8100e80 msgr2=0x7fdfc8196250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:35.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.307+0000 7fdfcddc0700 1 --2- 172.21.15.83:0/1074886868 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfc8100e80 0x7fdfc8196250 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fdfb80036f0 tx=0x7fdfb80047b0 comp rx=0 tx=0).stop 2024-04-01T06:54:35.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.307+0000 7fdfcddc0700 1 -- 172.21.15.83:0/1074886868 shutdown_connections 2024-04-01T06:54:35.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.307+0000 7fdfcddc0700 1 --2- 172.21.15.83:0/1074886868 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fdfb40a1120 0x7fdfb40a35e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:35.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.307+0000 7fdfcddc0700 1 --2- 172.21.15.83:0/1074886868 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdfc8101820 0x7fdfc819d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:35.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.307+0000 7fdfcddc0700 1 --2- 172.21.15.83:0/1074886868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfc80ffc90 0x7fdfc8195d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:35.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.307+0000 7fdfcddc0700 1 --2- 172.21.15.83:0/1074886868 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfc8100e80 0x7fdfc8196250 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:35.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.307+0000 7fdfcddc0700 1 -- 172.21.15.83:0/1074886868 >> 172.21.15.83:0/1074886868 conn(0x7fdfc80fb200 msgr2=0x7fdfc8104270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:35.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.307+0000 7fdfcddc0700 1 -- 172.21.15.83:0/1074886868 shutdown_connections 2024-04-01T06:54:35.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.307+0000 7fdfcddc0700 1 -- 172.21.15.83:0/1074886868 wait complete. 2024-04-01T06:54:35.319 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-04-01T06:54:35.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.447+0000 7ff3f7353700 1 -- 172.21.15.83:0/1599243798 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3f01017f0 msgr2=0x7ff3f01080a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:35.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.447+0000 7ff3f7353700 1 --2- 172.21.15.83:0/1599243798 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3f01017f0 0x7ff3f01080a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff3e800b0d0 tx=0x7ff3e800b3e0 comp rx=0 tx=0).stop 2024-04-01T06:54:35.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.447+0000 7ff3f7353700 1 -- 172.21.15.83:0/1599243798 shutdown_connections 2024-04-01T06:54:35.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.447+0000 7ff3f7353700 1 --2- 172.21.15.83:0/1599243798 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3f01017f0 0x7ff3f01080a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:35.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.447+0000 7ff3f7353700 1 --2- 172.21.15.83:0/1599243798 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3f00ffc60 0x7ff3f0100080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:35.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.447+0000 7ff3f7353700 1 --2- 172.21.15.83:0/1599243798 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff3f0100e50 0x7ff3f01012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:35.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.447+0000 7ff3f7353700 1 -- 172.21.15.83:0/1599243798 >> 172.21.15.83:0/1599243798 conn(0x7ff3f00fb1d0 msgr2=0x7ff3f00fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:35.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.447+0000 7ff3f7353700 1 -- 172.21.15.83:0/1599243798 shutdown_connections 2024-04-01T06:54:35.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.447+0000 7ff3f7353700 1 -- 172.21.15.83:0/1599243798 wait complete. 2024-04-01T06:54:35.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.447+0000 7ff3f7353700 1 Processor -- start 2024-04-01T06:54:35.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.447+0000 7ff3f7353700 1 -- start start 2024-04-01T06:54:35.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.447+0000 7ff3f7353700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3f00ffc60 0x7ff3f0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:35.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.447+0000 7ff3f7353700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff3f0100e50 0x7ff3f019baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:35.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.447+0000 7ff3f7353700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3f01017f0 0x7ff3f019e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:35.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.447+0000 7ff3f7353700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f019e900 con 0x7ff3f01017f0 2024-04-01T06:54:35.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.447+0000 7ff3f7353700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f019ea70 con 0x7ff3f0100e50 2024-04-01T06:54:35.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.447+0000 7ff3f7353700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f019ec30 con 0x7ff3f00ffc60 2024-04-01T06:54:35.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.448+0000 7ff3f58f0700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3f01017f0 0x7ff3f019e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:35.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.448+0000 7ff3f58f0700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3f01017f0 0x7ff3f019e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:35312/0 (socket says 172.21.15.83:35312) 2024-04-01T06:54:35.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.448+0000 7ff3f58f0700 1 -- 172.21.15.83:0/3651034479 learned_addr learned my addr 172.21.15.83:0/3651034479 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:54:35.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.448+0000 7ff3f50ef700 1 --2- 172.21.15.83:0/3651034479 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3f00ffc60 0x7ff3f0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:35.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.448+0000 7ff3f58f0700 1 -- 172.21.15.83:0/3651034479 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3f00ffc60 msgr2=0x7ff3f0068930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:35.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.448+0000 7ff3f58f0700 1 --2- 172.21.15.83:0/3651034479 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3f00ffc60 0x7ff3f0068930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:35.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.448+0000 7ff3f58f0700 1 -- 172.21.15.83:0/3651034479 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff3f0100e50 msgr2=0x7ff3f019baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:35.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.448+0000 7ff3f48ee700 1 --2- 172.21.15.83:0/3651034479 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff3f0100e50 0x7ff3f019baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:35.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.448+0000 7ff3f58f0700 1 --2- 172.21.15.83:0/3651034479 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff3f0100e50 0x7ff3f019baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:35.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.448+0000 7ff3f58f0700 1 -- 172.21.15.83:0/3651034479 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e8009d00 con 0x7ff3f01017f0 2024-04-01T06:54:35.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.448+0000 7ff3f50ef700 1 --2- 172.21.15.83:0/3651034479 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3f00ffc60 0x7ff3f0068930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:54:35.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.448+0000 7ff3f48ee700 1 --2- 172.21.15.83:0/3651034479 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff3f0100e50 0x7ff3f019baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:54:35.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.448+0000 7ff3f58f0700 1 --2- 172.21.15.83:0/3651034479 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3f01017f0 0x7ff3f019e110 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8007b60 tx=0x7ff3e8008fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:35.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.448+0000 7ff3e67fc700 1 -- 172.21.15.83:0/3651034479 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e800e040 con 0x7ff3f01017f0 2024-04-01T06:54:35.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.448+0000 7ff3e67fc700 1 -- 172.21.15.83:0/3651034479 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff3e801db30 con 0x7ff3f01017f0 2024-04-01T06:54:35.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.448+0000 7ff3e67fc700 1 -- 172.21.15.83:0/3651034479 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e801bb80 con 0x7ff3f01017f0 2024-04-01T06:54:35.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.448+0000 7ff3f7353700 1 -- 172.21.15.83:0/3651034479 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3f019ee50 con 0x7ff3f01017f0 2024-04-01T06:54:35.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.448+0000 7ff3f7353700 1 -- 172.21.15.83:0/3651034479 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3f019f220 con 0x7ff3f01017f0 2024-04-01T06:54:35.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.449+0000 7ff3f7353700 1 -- 172.21.15.83:0/3651034479 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3f01070e0 con 0x7ff3f01017f0 2024-04-01T06:54:35.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.450+0000 7ff3e67fc700 1 -- 172.21.15.83:0/3651034479 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 16) v1 ==== 135865+0+0 (secure 0 0 0) 0x7ff3e801dca0 con 0x7ff3f01017f0 2024-04-01T06:54:35.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.451+0000 7ff3e67fc700 1 --2- 172.21.15.83:0/3651034479 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7ff3dc0a11a0 0x7ff3dc0a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:35.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.451+0000 7ff3f50ef700 1 --2- 172.21.15.83:0/3651034479 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7ff3dc0a11a0 0x7ff3dc0a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:35.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.451+0000 7ff3e67fc700 1 -- 172.21.15.83:0/3651034479 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ff3e80cdfe0 con 0x7ff3f01017f0 2024-04-01T06:54:35.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.451+0000 7ff3f50ef700 1 --2- 172.21.15.83:0/3651034479 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7ff3dc0a11a0 0x7ff3dc0a3660 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0100cb0 tx=0x7ff3ec00b670 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:35.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.455+0000 7ff3e67fc700 1 -- 172.21.15.83:0/3651034479 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7ff3e80978b0 con 0x7ff3f01017f0 2024-04-01T06:54:35.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.690+0000 7ff3f7353700 1 -- 172.21.15.83:0/3651034479 --> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7ff3f002cd70 con 0x7ff3dc0a11a0 2024-04-01T06:54:35.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.693+0000 7ff3e67fc700 1 -- 172.21.15.83:0/3651034479 <== mgr.14152 v2:172.21.15.83:6800/3375372052 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+54 (secure 0 0 0) 0x7ff3f002cd70 con 0x7ff3dc0a11a0 2024-04-01T06:54:35.693 INFO:teuthology.orchestra.run.smithi083.stdout:/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579 2024-04-01T06:54:35.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.696+0000 7ff3f7353700 1 -- 172.21.15.83:0/3651034479 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7ff3dc0a11a0 msgr2=0x7ff3dc0a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:35.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.696+0000 7ff3f7353700 1 --2- 172.21.15.83:0/3651034479 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7ff3dc0a11a0 0x7ff3dc0a3660 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0100cb0 tx=0x7ff3ec00b670 comp rx=0 tx=0).stop 2024-04-01T06:54:35.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.696+0000 7ff3f7353700 1 -- 172.21.15.83:0/3651034479 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3f01017f0 msgr2=0x7ff3f019e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:35.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.696+0000 7ff3f7353700 1 --2- 172.21.15.83:0/3651034479 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3f01017f0 0x7ff3f019e110 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8007b60 tx=0x7ff3e8008fc0 comp rx=0 tx=0).stop 2024-04-01T06:54:35.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.696+0000 7ff3f7353700 1 -- 172.21.15.83:0/3651034479 shutdown_connections 2024-04-01T06:54:35.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.696+0000 7ff3f7353700 1 --2- 172.21.15.83:0/3651034479 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3f01017f0 0x7ff3f019e110 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:35.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.696+0000 7ff3f7353700 1 --2- 172.21.15.83:0/3651034479 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7ff3dc0a11a0 0x7ff3dc0a3660 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:35.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.696+0000 7ff3f7353700 1 --2- 172.21.15.83:0/3651034479 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3f00ffc60 0x7ff3f0068930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:35.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.696+0000 7ff3f7353700 1 --2- 172.21.15.83:0/3651034479 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff3f0100e50 0x7ff3f019baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:35.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.696+0000 7ff3f7353700 1 -- 172.21.15.83:0/3651034479 >> 172.21.15.83:0/3651034479 conn(0x7ff3f00fb1d0 msgr2=0x7ff3f0104220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:35.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.696+0000 7ff3f7353700 1 -- 172.21.15.83:0/3651034479 shutdown_connections 2024-04-01T06:54:35.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.696+0000 7ff3f7353700 1 -- 172.21.15.83:0/3651034479 wait complete. 2024-04-01T06:54:35.708 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T06:54:35.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.834+0000 7f833c34d700 1 -- 172.21.15.83:0/3919204302 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83341040a0 msgr2=0x7f8334106490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:35.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.834+0000 7f833c34d700 1 --2- 172.21.15.83:0/3919204302 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83341040a0 0x7f8334106490 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8328009990 tx=0x7f8328009ca0 comp rx=0 tx=0).stop 2024-04-01T06:54:35.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.834+0000 7f833c34d700 1 -- 172.21.15.83:0/3919204302 shutdown_connections 2024-04-01T06:54:35.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.834+0000 7f833c34d700 1 --2- 172.21.15.83:0/3919204302 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f83341069d0 0x7f8334108de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:35.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.834+0000 7f833c34d700 1 --2- 172.21.15.83:0/3919204302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8334101770 0x7f8334103b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:35.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.834+0000 7f833c34d700 1 --2- 172.21.15.83:0/3919204302 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83341040a0 0x7f8334106490 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:35.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.834+0000 7f833c34d700 1 -- 172.21.15.83:0/3919204302 >> 172.21.15.83:0/3919204302 conn(0x7f83340fb100 msgr2=0x7f83340fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:35.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.834+0000 7f833c34d700 1 -- 172.21.15.83:0/3919204302 shutdown_connections 2024-04-01T06:54:35.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.834+0000 7f833c34d700 1 -- 172.21.15.83:0/3919204302 wait complete. 2024-04-01T06:54:35.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.835+0000 7f833c34d700 1 Processor -- start 2024-04-01T06:54:35.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.835+0000 7f833c34d700 1 -- start start 2024-04-01T06:54:35.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.835+0000 7f833c34d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8334101770 0x7f8334196bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:35.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.835+0000 7f833c34d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83341040a0 0x7f8334197110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:35.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.835+0000 7f833c34d700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f83341069d0 0x7f833419e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:35.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.835+0000 7f833c34d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f833419e700 con 0x7f8334101770 2024-04-01T06:54:35.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.835+0000 7f833c34d700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f833419e840 con 0x7f83341069d0 2024-04-01T06:54:35.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.835+0000 7f833c34d700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f833419e9d0 con 0x7f83341040a0 2024-04-01T06:54:35.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.835+0000 7f833a0e9700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8334101770 0x7f8334196bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:35.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.835+0000 7f833a0e9700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8334101770 0x7f8334196bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:35338/0 (socket says 172.21.15.83:35338) 2024-04-01T06:54:35.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.835+0000 7f833a0e9700 1 -- 172.21.15.83:0/678664390 learned_addr learned my addr 172.21.15.83:0/678664390 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:54:35.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.835+0000 7f833a0e9700 1 -- 172.21.15.83:0/678664390 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83341040a0 msgr2=0x7f8334197110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:35.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.835+0000 7f83398e8700 1 --2- 172.21.15.83:0/678664390 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83341040a0 0x7f8334197110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:35.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.835+0000 7f833a0e9700 1 --2- 172.21.15.83:0/678664390 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83341040a0 0x7f8334197110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:35.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.835+0000 7f833a0e9700 1 -- 172.21.15.83:0/678664390 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f83341069d0 msgr2=0x7f833419e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:35.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.835+0000 7f833a8ea700 1 --2- 172.21.15.83:0/678664390 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f83341069d0 0x7f833419e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:35.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.835+0000 7f833a0e9700 1 --2- 172.21.15.83:0/678664390 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f83341069d0 0x7f833419e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:35.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.835+0000 7f833a0e9700 1 -- 172.21.15.83:0/678664390 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83280095f0 con 0x7f8334101770 2024-04-01T06:54:35.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.835+0000 7f833a0e9700 1 --2- 172.21.15.83:0/678664390 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8334101770 0x7f8334196bd0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f832c0060b0 tx=0x7f832c007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:35.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.835+0000 7f83337fe700 1 -- 172.21.15.83:0/678664390 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832c00de20 con 0x7f8334101770 2024-04-01T06:54:35.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.835+0000 7f83337fe700 1 -- 172.21.15.83:0/678664390 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f832c00f040 con 0x7f8334101770 2024-04-01T06:54:35.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.835+0000 7f83337fe700 1 -- 172.21.15.83:0/678664390 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832c0146e0 con 0x7f8334101770 2024-04-01T06:54:35.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.836+0000 7f833c34d700 1 -- 172.21.15.83:0/678664390 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f833419ecb0 con 0x7f8334101770 2024-04-01T06:54:35.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.836+0000 7f833c34d700 1 -- 172.21.15.83:0/678664390 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f833419f170 con 0x7f8334101770 2024-04-01T06:54:35.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.837+0000 7f833c34d700 1 -- 172.21.15.83:0/678664390 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83340fcc80 con 0x7f8334101770 2024-04-01T06:54:35.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.838+0000 7f83337fe700 1 -- 172.21.15.83:0/678664390 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f832c015a30 con 0x7f8334101770 2024-04-01T06:54:35.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.838+0000 7f83337fe700 1 --2- 172.21.15.83:0/678664390 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f831c0a11b0 0x7f831c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:35.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.838+0000 7f83337fe700 1 -- 172.21.15.83:0/678664390 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f832c0cc380 con 0x7f8334101770 2024-04-01T06:54:35.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.838+0000 7f83398e8700 1 --2- 172.21.15.83:0/678664390 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f831c0a11b0 0x7f831c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:35.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.839+0000 7f83398e8700 1 --2- 172.21.15.83:0/678664390 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f831c0a11b0 0x7f831c0a3670 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f83280095c0 tx=0x7f8328009510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:35.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:35.843+0000 7f83337fe700 1 -- 172.21.15.83:0/678664390 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f832c095b60 con 0x7f8334101770 2024-04-01T06:54:36.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:35 smithi145 ceph-mon[47816]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:54:36.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:35 smithi145 ceph-mon[47816]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:54:36.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:35 smithi145 ceph-mon[47816]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:54:36.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:35 smithi083 ceph-mon[43429]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:54:36.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:35 smithi083 ceph-mon[43429]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:54:36.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:35 smithi083 ceph-mon[43429]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:54:36.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.088+0000 7f833c34d700 1 -- 172.21.15.83:0/678664390 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8334067180 con 0x7f8334101770 2024-04-01T06:54:36.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.089+0000 7f83337fe700 1 -- 172.21.15.83:0/678664390 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+10876 (secure 0 0 0) 0x7f832c099180 con 0x7f8334101770 2024-04-01T06:54:36.088 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:54:36.089 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1271130478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1271130478},{"type":"v1","addr":"172.21.15.83:6835","nonce":1271130478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2412682983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2412682983},{"type":"v1","addr":"172.21.15.83:6837","nonce":2412682983}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6839/3348145990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":3348145990},{"type":"v1","addr":"172.21.15.83:6839","nonce":3348145990}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6841/1191267445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6840","nonce":1191267445},{"type":"v1","addr":"172.21.15.83:6841","nonce":1191267445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2467459028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2467459028},{"type":"v1","addr":"172.21.15.153:6833","nonce":2467459028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24448,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4092629042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":4092629042},{"type":"v1","addr":"172.21.15.153:6835","nonce":4092629042}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-01T06:54:28.397062+0000","modified":"2024-04-01T06:54:33.704443+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24524,"mds_1":24494,"mds_2":24473},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6833/647005844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":647005844},{"type":"v1","addr":"172.21.15.145:6833","nonce":647005844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24454":{"gid":24454,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6837/1993816527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1993816527},{"type":"v1","addr":"172.21.15.153:6837","nonce":1993816527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6839/1399754640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1399754640},{"type":"v1","addr":"172.21.15.153:6839","nonce":1399754640}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24473":{"gid":24473,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.145:6835/3104241497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":3104241497},{"type":"v1","addr":"172.21.15.145:6835","nonce":3104241497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24494":{"gid":24494,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.145:6837/2687798317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2687798317},{"type":"v1","addr":"172.21.15.145:6837","nonce":2687798317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6839/3886435411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3886435411},{"type":"v1","addr":"172.21.15.145:6839","nonce":3886435411}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-01T06:54:36.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.091+0000 7f833c34d700 1 -- 172.21.15.83:0/678664390 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f831c0a11b0 msgr2=0x7f831c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:36.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.091+0000 7f833c34d700 1 --2- 172.21.15.83:0/678664390 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f831c0a11b0 0x7f831c0a3670 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f83280095c0 tx=0x7f8328009510 comp rx=0 tx=0).stop 2024-04-01T06:54:36.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.091+0000 7f833c34d700 1 -- 172.21.15.83:0/678664390 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8334101770 msgr2=0x7f8334196bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:36.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.091+0000 7f833c34d700 1 --2- 172.21.15.83:0/678664390 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8334101770 0x7f8334196bd0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f832c0060b0 tx=0x7f832c007f90 comp rx=0 tx=0).stop 2024-04-01T06:54:36.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.091+0000 7f833c34d700 1 -- 172.21.15.83:0/678664390 shutdown_connections 2024-04-01T06:54:36.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.091+0000 7f833c34d700 1 --2- 172.21.15.83:0/678664390 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8334101770 0x7f8334196bd0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:36.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.091+0000 7f833c34d700 1 --2- 172.21.15.83:0/678664390 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f831c0a11b0 0x7f831c0a3670 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:36.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.091+0000 7f833c34d700 1 --2- 172.21.15.83:0/678664390 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f83341069d0 0x7f833419e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:36.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.091+0000 7f833c34d700 1 --2- 172.21.15.83:0/678664390 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83341040a0 0x7f8334197110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:36.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.091+0000 7f833c34d700 1 -- 172.21.15.83:0/678664390 >> 172.21.15.83:0/678664390 conn(0x7f83340fb100 msgr2=0x7f8334102010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:36.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.091+0000 7f833c34d700 1 -- 172.21.15.83:0/678664390 shutdown_connections 2024-04-01T06:54:36.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.091+0000 7f833c34d700 1 -- 172.21.15.83:0/678664390 wait complete. 2024-04-01T06:54:36.092 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 23 2024-04-01T06:54:36.103 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T06:54:36.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:35 smithi153 ceph-mon[48187]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:54:36.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:35 smithi153 ceph-mon[48187]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:54:36.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:35 smithi153 ceph-mon[48187]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:54:36.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.225+0000 7fe8f23d1700 1 -- 172.21.15.83:0/2067393277 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe8ec1028a0 msgr2=0x7fe8ec109150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:36.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.225+0000 7fe8f23d1700 1 --2- 172.21.15.83:0/2067393277 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe8ec1028a0 0x7fe8ec109150 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe8e400b0a0 tx=0x7fe8e400b3b0 comp rx=0 tx=0).stop 2024-04-01T06:54:36.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.225+0000 7fe8f23d1700 1 -- 172.21.15.83:0/2067393277 shutdown_connections 2024-04-01T06:54:36.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.225+0000 7fe8f23d1700 1 --2- 172.21.15.83:0/2067393277 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe8ec1028a0 0x7fe8ec109150 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:36.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.225+0000 7fe8f23d1700 1 --2- 172.21.15.83:0/2067393277 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe8ec0fef30 0x7fe8ec0ff350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:36.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.225+0000 7fe8f23d1700 1 --2- 172.21.15.83:0/2067393277 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8ec101f00 0x7fe8ec102360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:36.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.225+0000 7fe8f23d1700 1 -- 172.21.15.83:0/2067393277 >> 172.21.15.83:0/2067393277 conn(0x7fe8ec0fa880 msgr2=0x7fe8ec0fcca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:36.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.225+0000 7fe8f23d1700 1 -- 172.21.15.83:0/2067393277 shutdown_connections 2024-04-01T06:54:36.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.225+0000 7fe8f23d1700 1 -- 172.21.15.83:0/2067393277 wait complete. 2024-04-01T06:54:36.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.226+0000 7fe8f23d1700 1 Processor -- start 2024-04-01T06:54:36.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.226+0000 7fe8f23d1700 1 -- start start 2024-04-01T06:54:36.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.226+0000 7fe8f23d1700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe8ec0fef30 0x7fe8ec101820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:36.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.226+0000 7fe8f23d1700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe8ec101f00 0x7fe8ec0ffeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:36.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.226+0000 7fe8f23d1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8ec1028a0 0x7fe8ec1003f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:36.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.226+0000 7fe8f23d1700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ec100b90 con 0x7fe8ec0fef30 2024-04-01T06:54:36.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.226+0000 7fe8f23d1700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ec100d00 con 0x7fe8ec101f00 2024-04-01T06:54:36.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.226+0000 7fe8f23d1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ec1a0d90 con 0x7fe8ec1028a0 2024-04-01T06:54:36.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.226+0000 7fe8ebfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe8ec0fef30 0x7fe8ec101820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:36.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.226+0000 7fe8ebfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe8ec0fef30 0x7fe8ec101820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:35360/0 (socket says 172.21.15.83:35360) 2024-04-01T06:54:36.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.226+0000 7fe8ebfff700 1 -- 172.21.15.83:0/4041979390 learned_addr learned my addr 172.21.15.83:0/4041979390 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:54:36.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.226+0000 7fe8f096e700 1 --2- 172.21.15.83:0/4041979390 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8ec1028a0 0x7fe8ec1003f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:36.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.226+0000 7fe8eb7fe700 1 --2- 172.21.15.83:0/4041979390 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe8ec101f00 0x7fe8ec0ffeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:36.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.226+0000 7fe8ebfff700 1 -- 172.21.15.83:0/4041979390 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8ec1028a0 msgr2=0x7fe8ec1003f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:36.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.226+0000 7fe8ebfff700 1 --2- 172.21.15.83:0/4041979390 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8ec1028a0 0x7fe8ec1003f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:36.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.226+0000 7fe8ebfff700 1 -- 172.21.15.83:0/4041979390 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe8ec101f00 msgr2=0x7fe8ec0ffeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:36.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.226+0000 7fe8ebfff700 1 --2- 172.21.15.83:0/4041979390 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe8ec101f00 0x7fe8ec0ffeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:36.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.226+0000 7fe8ebfff700 1 -- 172.21.15.83:0/4041979390 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e4009d00 con 0x7fe8ec0fef30 2024-04-01T06:54:36.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.226+0000 7fe8f096e700 1 --2- 172.21.15.83:0/4041979390 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8ec1028a0 0x7fe8ec1003f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:54:36.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.226+0000 7fe8eb7fe700 1 --2- 172.21.15.83:0/4041979390 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe8ec101f00 0x7fe8ec0ffeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:54:36.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.227+0000 7fe8ebfff700 1 --2- 172.21.15.83:0/4041979390 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe8ec0fef30 0x7fe8ec101820 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc00c970 tx=0x7fe8dc00cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:36.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.227+0000 7fe8e97fa700 1 -- 172.21.15.83:0/4041979390 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc004220 con 0x7fe8ec0fef30 2024-04-01T06:54:36.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.227+0000 7fe8e97fa700 1 -- 172.21.15.83:0/4041979390 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe8dc007d60 con 0x7fe8ec0fef30 2024-04-01T06:54:36.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.227+0000 7fe8f23d1700 1 -- 172.21.15.83:0/4041979390 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8ec1a0fc0 con 0x7fe8ec0fef30 2024-04-01T06:54:36.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.227+0000 7fe8e97fa700 1 -- 172.21.15.83:0/4041979390 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc003d00 con 0x7fe8ec0fef30 2024-04-01T06:54:36.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.227+0000 7fe8f23d1700 1 -- 172.21.15.83:0/4041979390 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8ec1a1440 con 0x7fe8ec0fef30 2024-04-01T06:54:36.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.228+0000 7fe8f23d1700 1 -- 172.21.15.83:0/4041979390 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8ec1080e0 con 0x7fe8ec0fef30 2024-04-01T06:54:36.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.229+0000 7fe8e97fa700 1 -- 172.21.15.83:0/4041979390 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7fe8dc004380 con 0x7fe8ec0fef30 2024-04-01T06:54:36.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.229+0000 7fe8e97fa700 1 --2- 172.21.15.83:0/4041979390 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fe8d40a11b0 0x7fe8d40a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:36.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.229+0000 7fe8eb7fe700 1 --2- 172.21.15.83:0/4041979390 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fe8d40a11b0 0x7fe8d40a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:36.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.229+0000 7fe8e97fa700 1 -- 172.21.15.83:0/4041979390 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fe8dc0cc490 con 0x7fe8ec0fef30 2024-04-01T06:54:36.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.230+0000 7fe8eb7fe700 1 --2- 172.21.15.83:0/4041979390 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fe8d40a11b0 0x7fe8d40a3670 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0005fd0 tx=0x7fe8e0005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:36.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.234+0000 7fe8e97fa700 1 -- 172.21.15.83:0/4041979390 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7fe8dc095c70 con 0x7fe8ec0fef30 2024-04-01T06:54:36.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.442+0000 7fe8f23d1700 1 -- 172.21.15.83:0/4041979390 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe8ec10c540 con 0x7fe8ec0fef30 2024-04-01T06:54:36.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.444+0000 7fe8e97fa700 1 -- 172.21.15.83:0/4041979390 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+22131 (secure 0 0 0) 0x7fe8dc099290 con 0x7fe8ec0fef30 2024-04-01T06:54:36.444 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:54:36.444 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":79,"fsid":"c6f8eff4-eff3-11ee-b647-cb9ed24678a4","created":"2024-04-01T06:48:42.033382+0000","modified":"2024-04-01T06:54:29.399277+0000","last_up_change":"2024-04-01T06:53:55.791339+0000","last_in_change":"2024-04-01T06:53:39.777214+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T06:51:21.963996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T06:54:26.450403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T06:54:27.564928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"90b761b0-b06c-4142-854d-38ee42aa6052","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6803","nonce":3253845390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6805","nonce":3253845390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6809","nonce":3253845390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6807","nonce":3253845390}]},"public_addr":"172.21.15.83:6803/3253845390","cluster_addr":"172.21.15.83:6805/3253845390","heartbeat_back_addr":"172.21.15.83:6809/3253845390","heartbeat_front_addr":"172.21.15.83:6807/3253845390","state":["exists","up"]},{"osd":1,"uuid":"4d6ab85b-7088-451e-a829-c9119f35dee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6801","nonce":515889759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6803","nonce":515889759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6807","nonce":515889759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6805","nonce":515889759}]},"public_addr":"172.21.15.145:6801/515889759","cluster_addr":"172.21.15.145:6803/515889759","heartbeat_back_addr":"172.21.15.145:6807/515889759","heartbeat_front_addr":"172.21.15.145:6805/515889759","state":["exists","up"]},{"osd":2,"uuid":"d04c27f3-4972-4061-8bfb-5060645e3883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6801","nonce":3318516728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6803","nonce":3318516728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6807","nonce":3318516728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6805","nonce":3318516728}]},"public_addr":"172.21.15.153:6801/3318516728","cluster_addr":"172.21.15.153:6803/3318516728","heartbeat_back_addr":"172.21.15.153:6807/3318516728","heartbeat_front_addr":"172.21.15.153:6805/3318516728","state":["exists","up"]},{"osd":3,"uuid":"899b6c90-8f2f-44dd-b807-49594aadb443","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6811","nonce":504690234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6813","nonce":504690234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6817","nonce":504690234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6815","nonce":504690234}]},"public_addr":"172.21.15.83:6811/504690234","cluster_addr":"172.21.15.83:6813/504690234","heartbeat_back_addr":"172.21.15.83:6817/504690234","heartbeat_front_addr":"172.21.15.83:6815/504690234","state":["exists","up"]},{"osd":4,"uuid":"5071dd81-804e-4358-bfb6-11e718e9cf4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6809","nonce":2099824730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6811","nonce":2099824730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6815","nonce":2099824730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6813","nonce":2099824730}]},"public_addr":"172.21.15.145:6809/2099824730","cluster_addr":"172.21.15.145:6811/2099824730","heartbeat_back_addr":"172.21.15.145:6815/2099824730","heartbeat_front_addr":"172.21.15.145:6813/2099824730","state":["exists","up"]},{"osd":5,"uuid":"b8442b71-c26e-467f-b0c3-ea9f636f5a00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6809","nonce":3340941443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6811","nonce":3340941443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6815","nonce":3340941443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6813","nonce":3340941443}]},"public_addr":"172.21.15.153:6809/3340941443","cluster_addr":"172.21.15.153:6811/3340941443","heartbeat_back_addr":"172.21.15.153:6815/3340941443","heartbeat_front_addr":"172.21.15.153:6813/3340941443","state":["exists","up"]},{"osd":6,"uuid":"c26bb8cb-ccee-4bfc-91eb-14e1ad8e04df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6819","nonce":2005485079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6821","nonce":2005485079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6825","nonce":2005485079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6823","nonce":2005485079}]},"public_addr":"172.21.15.83:6819/2005485079","cluster_addr":"172.21.15.83:6821/2005485079","heartbeat_back_addr":"172.21.15.83:6825/2005485079","heartbeat_front_addr":"172.21.15.83:6823/2005485079","state":["exists","up"]},{"osd":7,"uuid":"a8940da2-0e79-4606-8d1e-d425afbf5753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6817","nonce":3737505059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6819","nonce":3737505059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6823","nonce":3737505059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6821","nonce":3737505059}]},"public_addr":"172.21.15.145:6817/3737505059","cluster_addr":"172.21.15.145:6819/3737505059","heartbeat_back_addr":"172.21.15.145:6823/3737505059","heartbeat_front_addr":"172.21.15.145:6821/3737505059","state":["exists","up"]},{"osd":8,"uuid":"602d43ac-a189-4da3-9e38-7025d14e0dd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6817","nonce":1031545791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6819","nonce":1031545791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6823","nonce":1031545791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6821","nonce":1031545791}]},"public_addr":"172.21.15.153:6817/1031545791","cluster_addr":"172.21.15.153:6819/1031545791","heartbeat_back_addr":"172.21.15.153:6823/1031545791","heartbeat_front_addr":"172.21.15.153:6821/1031545791","state":["exists","up"]},{"osd":9,"uuid":"08b12d27-1247-45e4-9d09-cacc0fce4bd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6827","nonce":3720996673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6829","nonce":3720996673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6833","nonce":3720996673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6831","nonce":3720996673}]},"public_addr":"172.21.15.83:6827/3720996673","cluster_addr":"172.21.15.83:6829/3720996673","heartbeat_back_addr":"172.21.15.83:6833/3720996673","heartbeat_front_addr":"172.21.15.83:6831/3720996673","state":["exists","up"]},{"osd":10,"uuid":"dd986b50-d68f-446c-9c66-261535880879","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6825","nonce":2671529479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6827","nonce":2671529479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6831","nonce":2671529479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6829","nonce":2671529479}]},"public_addr":"172.21.15.145:6825/2671529479","cluster_addr":"172.21.15.145:6827/2671529479","heartbeat_back_addr":"172.21.15.145:6831/2671529479","heartbeat_front_addr":"172.21.15.145:6829/2671529479","state":["exists","up"]},{"osd":11,"uuid":"d20a49cd-6224-4424-8375-46da791d9931","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6825","nonce":2342548429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6827","nonce":2342548429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6831","nonce":2342548429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6829","nonce":2342548429}]},"public_addr":"172.21.15.153:6825/2342548429","cluster_addr":"172.21.15.153:6827/2342548429","heartbeat_back_addr":"172.21.15.153:6831/2342548429","heartbeat_front_addr":"172.21.15.153:6829/2342548429","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:50:44.539932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:01.990470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:19.054426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:36.616393+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:53.896705+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:10.667502+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:27.880849+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:45.276308+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:02.280615+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:19.555547+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:37.062881+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:54.191589+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.83:6801/1867137261":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/2596683931":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/2125339627":"2024-04-02T06:49:33.656125+0000","172.21.15.83:6800/1644397953":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/690500472":"2024-04-02T06:49:13.456026+0000","172.21.15.83:6801/1644397953":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/785958951":"2024-04-02T06:49:33.656125+0000","172.21.15.83:6800/1867137261":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/2222527447":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/2071592157":"2024-04-02T06:49:13.456026+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T06:54:36.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.446+0000 7fe8f23d1700 1 -- 172.21.15.83:0/4041979390 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fe8d40a11b0 msgr2=0x7fe8d40a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:36.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.446+0000 7fe8f23d1700 1 --2- 172.21.15.83:0/4041979390 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fe8d40a11b0 0x7fe8d40a3670 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0005fd0 tx=0x7fe8e0005ee0 comp rx=0 tx=0).stop 2024-04-01T06:54:36.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.446+0000 7fe8f23d1700 1 -- 172.21.15.83:0/4041979390 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe8ec0fef30 msgr2=0x7fe8ec101820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:36.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.446+0000 7fe8f23d1700 1 --2- 172.21.15.83:0/4041979390 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe8ec0fef30 0x7fe8ec101820 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc00c970 tx=0x7fe8dc00cd30 comp rx=0 tx=0).stop 2024-04-01T06:54:36.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.446+0000 7fe8f23d1700 1 -- 172.21.15.83:0/4041979390 shutdown_connections 2024-04-01T06:54:36.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.446+0000 7fe8f23d1700 1 --2- 172.21.15.83:0/4041979390 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe8ec0fef30 0x7fe8ec101820 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:36.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.446+0000 7fe8f23d1700 1 --2- 172.21.15.83:0/4041979390 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fe8d40a11b0 0x7fe8d40a3670 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:36.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.446+0000 7fe8f23d1700 1 --2- 172.21.15.83:0/4041979390 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8ec1028a0 0x7fe8ec1003f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:36.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.446+0000 7fe8f23d1700 1 --2- 172.21.15.83:0/4041979390 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe8ec101f00 0x7fe8ec0ffeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:36.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.446+0000 7fe8f23d1700 1 -- 172.21.15.83:0/4041979390 >> 172.21.15.83:0/4041979390 conn(0x7fe8ec0fa880 msgr2=0x7fe8ec105220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:36.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.446+0000 7fe8f23d1700 1 -- 172.21.15.83:0/4041979390 shutdown_connections 2024-04-01T06:54:36.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.446+0000 7fe8f23d1700 1 -- 172.21.15.83:0/4041979390 wait complete. 2024-04-01T06:54:36.458 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-01T06:54:36.459 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-01T06:54:36.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.580+0000 7f2b7882b700 1 -- 172.21.15.83:0/3671371240 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b741016f0 msgr2=0x7f2b74107fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:36.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.580+0000 7f2b7882b700 1 --2- 172.21.15.83:0/3671371240 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b741016f0 0x7f2b74107fa0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c00b0d0 tx=0x7f2b6c00b3e0 comp rx=0 tx=0).stop 2024-04-01T06:54:36.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.580+0000 7f2b7882b700 1 -- 172.21.15.83:0/3671371240 shutdown_connections 2024-04-01T06:54:36.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.580+0000 7f2b7882b700 1 --2- 172.21.15.83:0/3671371240 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b741016f0 0x7f2b74107fa0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:36.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.580+0000 7f2b7882b700 1 --2- 172.21.15.83:0/3671371240 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b740ffb60 0x7f2b740fff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:36.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.580+0000 7f2b7882b700 1 --2- 172.21.15.83:0/3671371240 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2b74100d50 0x7f2b741011b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:36.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.580+0000 7f2b7882b700 1 -- 172.21.15.83:0/3671371240 >> 172.21.15.83:0/3671371240 conn(0x7f2b740fb0d0 msgr2=0x7f2b740fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:36.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.580+0000 7f2b7882b700 1 -- 172.21.15.83:0/3671371240 shutdown_connections 2024-04-01T06:54:36.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.580+0000 7f2b7882b700 1 -- 172.21.15.83:0/3671371240 wait complete. 2024-04-01T06:54:36.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.581+0000 7f2b7882b700 1 Processor -- start 2024-04-01T06:54:36.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.581+0000 7f2b7882b700 1 -- start start 2024-04-01T06:54:36.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.581+0000 7f2b7882b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b740ffb60 0x7f2b74196cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:36.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.581+0000 7f2b7882b700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2b74100d50 0x7f2b74197200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:36.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.581+0000 7f2b7882b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b741016f0 0x7f2b7419e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:36.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.581+0000 7f2b7882b700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7419e7b0 con 0x7f2b741016f0 2024-04-01T06:54:36.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.581+0000 7f2b7882b700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7419e920 con 0x7f2b74100d50 2024-04-01T06:54:36.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.581+0000 7f2b7882b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7419eae0 con 0x7f2b740ffb60 2024-04-01T06:54:36.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.581+0000 7f2b72d9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b741016f0 0x7f2b7419e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:36.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.581+0000 7f2b72d9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b741016f0 0x7f2b7419e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:35374/0 (socket says 172.21.15.83:35374) 2024-04-01T06:54:36.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.581+0000 7f2b72d9d700 1 -- 172.21.15.83:0/3453354522 learned_addr learned my addr 172.21.15.83:0/3453354522 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:54:36.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.581+0000 7f2b71d9b700 1 --2- 172.21.15.83:0/3453354522 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2b74100d50 0x7f2b74197200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:36.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.581+0000 7f2b7259c700 1 --2- 172.21.15.83:0/3453354522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b740ffb60 0x7f2b74196cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:36.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.581+0000 7f2b72d9d700 1 -- 172.21.15.83:0/3453354522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b740ffb60 msgr2=0x7f2b74196cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:36.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.581+0000 7f2b72d9d700 1 --2- 172.21.15.83:0/3453354522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b740ffb60 0x7f2b74196cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:36.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.581+0000 7f2b72d9d700 1 -- 172.21.15.83:0/3453354522 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2b74100d50 msgr2=0x7f2b74197200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:36.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.581+0000 7f2b72d9d700 1 --2- 172.21.15.83:0/3453354522 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2b74100d50 0x7f2b74197200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:36.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.581+0000 7f2b72d9d700 1 -- 172.21.15.83:0/3453354522 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b6c009d00 con 0x7f2b741016f0 2024-04-01T06:54:36.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.581+0000 7f2b72d9d700 1 --2- 172.21.15.83:0/3453354522 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b741016f0 0x7f2b7419e1e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c007bd0 tx=0x7f2b6c009440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:36.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.582+0000 7f2b6b7fe700 1 -- 172.21.15.83:0/3453354522 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c00e040 con 0x7f2b741016f0 2024-04-01T06:54:36.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.582+0000 7f2b6b7fe700 1 -- 172.21.15.83:0/3453354522 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2b6c01dd50 con 0x7f2b741016f0 2024-04-01T06:54:36.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.582+0000 7f2b7882b700 1 -- 172.21.15.83:0/3453354522 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b7419ed60 con 0x7f2b741016f0 2024-04-01T06:54:36.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.582+0000 7f2b6b7fe700 1 -- 172.21.15.83:0/3453354522 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c01b450 con 0x7f2b741016f0 2024-04-01T06:54:36.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.582+0000 7f2b7882b700 1 -- 172.21.15.83:0/3453354522 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b7419f190 con 0x7f2b741016f0 2024-04-01T06:54:36.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.583+0000 7f2b7882b700 1 -- 172.21.15.83:0/3453354522 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b74067a10 con 0x7f2b741016f0 2024-04-01T06:54:36.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.584+0000 7f2b6b7fe700 1 -- 172.21.15.83:0/3453354522 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f2b6c01d890 con 0x7f2b741016f0 2024-04-01T06:54:36.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.585+0000 7f2b6b7fe700 1 --2- 172.21.15.83:0/3453354522 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f2b600a1230 0x7f2b600a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:36.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.585+0000 7f2b7259c700 1 --2- 172.21.15.83:0/3453354522 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f2b600a1230 0x7f2b600a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:36.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.585+0000 7f2b6b7fe700 1 -- 172.21.15.83:0/3453354522 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f2b6c0cec90 con 0x7f2b741016f0 2024-04-01T06:54:36.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.585+0000 7f2b7259c700 1 --2- 172.21.15.83:0/3453354522 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f2b600a1230 0x7f2b600a36f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c005fd0 tx=0x7f2b5c005dd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:36.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.588+0000 7f2b6b7fe700 1 -- 172.21.15.83:0/3453354522 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f2b6c098500 con 0x7f2b741016f0 2024-04-01T06:54:36.783 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.783+0000 7f2b7882b700 1 -- 172.21.15.83:0/3453354522 --> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2b74068500 con 0x7f2b600a1230 2024-04-01T06:54:36.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.793+0000 7f2b6b7fe700 1 -- 172.21.15.83:0/3453354522 <== mgr.14152 v2:172.21.15.83:6800/3375372052 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+328705 (secure 0 0 0) 0x7f2b74068500 con 0x7f2b600a1230 2024-04-01T06:54:36.798 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:54:36.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.796+0000 7f2b7882b700 1 -- 172.21.15.83:0/3453354522 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f2b600a1230 msgr2=0x7f2b600a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:36.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.796+0000 7f2b7882b700 1 --2- 172.21.15.83:0/3453354522 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f2b600a1230 0x7f2b600a36f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c005fd0 tx=0x7f2b5c005dd0 comp rx=0 tx=0).stop 2024-04-01T06:54:36.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.796+0000 7f2b7882b700 1 -- 172.21.15.83:0/3453354522 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b741016f0 msgr2=0x7f2b7419e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:36.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.796+0000 7f2b7882b700 1 --2- 172.21.15.83:0/3453354522 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b741016f0 0x7f2b7419e1e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c007bd0 tx=0x7f2b6c009440 comp rx=0 tx=0).stop 2024-04-01T06:54:36.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.796+0000 7f2b7882b700 1 -- 172.21.15.83:0/3453354522 shutdown_connections 2024-04-01T06:54:36.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.796+0000 7f2b7882b700 1 --2- 172.21.15.83:0/3453354522 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b741016f0 0x7f2b7419e1e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:36.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.796+0000 7f2b7882b700 1 --2- 172.21.15.83:0/3453354522 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f2b600a1230 0x7f2b600a36f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:36.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.796+0000 7f2b7882b700 1 --2- 172.21.15.83:0/3453354522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b740ffb60 0x7f2b74196cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:36.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.796+0000 7f2b7882b700 1 --2- 172.21.15.83:0/3453354522 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2b74100d50 0x7f2b74197200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:36.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.796+0000 7f2b7882b700 1 -- 172.21.15.83:0/3453354522 >> 172.21.15.83:0/3453354522 conn(0x7f2b740fb0d0 msgr2=0x7f2b74067df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:36.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.796+0000 7f2b7882b700 1 -- 172.21.15.83:0/3453354522 shutdown_connections 2024-04-01T06:54:36.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.796+0000 7f2b7882b700 1 -- 172.21.15.83:0/3453354522 wait complete. 2024-04-01T06:54:36.801 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-04-01T06:54:36.808 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":220,"stamp":"2024-04-01T06:54:35.714578+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594290,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":142,"num_read_kb":125,"num_write":275,"num_write_kb":2967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":220,"ondisk_log_size":220,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":242,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":359040,"kb_used_data":10220,"kb_used_omap":18,"kb_used_meta":348653,"kb_avail":1124582784,"statfs":{"total":1151940427776,"available":1151572770816,"internally_reserved":0,"allocated":10465280,"data_stored":6678986,"data_compressed":107118,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19130,"internal_metadata":357020998},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3922,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":94,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.737443"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.479985+0000","last_change":"2024-04-01T06:54:28.426588+0000","last_active":"2024-04-01T06:54:30.479985+0000","last_peered":"2024-04-01T06:54:30.479985+0000","last_clean":"2024-04-01T06:54:30.479985+0000","last_became_active":"2024-04-01T06:54:28.423723+0000","last_became_peered":"2024-04-01T06:54:28.423723+0000","last_unstale":"2024-04-01T06:54:30.479985+0000","last_undegraded":"2024-04-01T06:54:30.479985+0000","last_fullsized":"2024-04-01T06:54:30.479985+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:52:38.856474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358294+0000","last_change":"2024-04-01T06:54:28.419858+0000","last_active":"2024-04-01T06:54:30.358294+0000","last_peered":"2024-04-01T06:54:30.358294+0000","last_clean":"2024-04-01T06:54:30.358294+0000","last_became_active":"2024-04-01T06:54:28.419534+0000","last_became_peered":"2024-04-01T06:54:28.419534+0000","last_unstale":"2024-04-01T06:54:30.358294+0000","last_undegraded":"2024-04-01T06:54:30.358294+0000","last_fullsized":"2024-04-01T06:54:30.358294+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:26:56.349672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.357923+0000","last_change":"2024-04-01T06:54:28.422763+0000","last_active":"2024-04-01T06:54:30.357923+0000","last_peered":"2024-04-01T06:54:30.357923+0000","last_clean":"2024-04-01T06:54:30.357923+0000","last_became_active":"2024-04-01T06:54:28.422439+0000","last_became_peered":"2024-04-01T06:54:28.422439+0000","last_unstale":"2024-04-01T06:54:30.357923+0000","last_undegraded":"2024-04-01T06:54:30.357923+0000","last_fullsized":"2024-04-01T06:54:30.357923+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:55:24.379428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358669+0000","last_change":"2024-04-01T06:54:28.421996+0000","last_active":"2024-04-01T06:54:30.358669+0000","last_peered":"2024-04-01T06:54:30.358669+0000","last_clean":"2024-04-01T06:54:30.358669+0000","last_became_active":"2024-04-01T06:54:28.421594+0000","last_became_peered":"2024-04-01T06:54:28.421594+0000","last_unstale":"2024-04-01T06:54:30.358669+0000","last_undegraded":"2024-04-01T06:54:30.358669+0000","last_fullsized":"2024-04-01T06:54:30.358669+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:36:53.200615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.412828+0000","last_change":"2024-04-01T06:54:28.415652+0000","last_active":"2024-04-01T06:54:29.412828+0000","last_peered":"2024-04-01T06:54:29.412828+0000","last_clean":"2024-04-01T06:54:29.412828+0000","last_became_active":"2024-04-01T06:54:28.415296+0000","last_became_peered":"2024-04-01T06:54:28.415296+0000","last_unstale":"2024-04-01T06:54:29.412828+0000","last_undegraded":"2024-04-01T06:54:29.412828+0000","last_fullsized":"2024-04-01T06:54:29.412828+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:36:36.967298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-01T06:54:28.690214+0000","last_change":"2024-04-01T06:54:28.421188+0000","last_active":"2024-04-01T06:54:28.690214+0000","last_peered":"2024-04-01T06:54:28.690214+0000","last_clean":"2024-04-01T06:54:28.690214+0000","last_became_active":"2024-04-01T06:54:28.420863+0000","last_became_peered":"2024-04-01T06:54:28.420863+0000","last_unstale":"2024-04-01T06:54:28.690214+0000","last_undegraded":"2024-04-01T06:54:28.690214+0000","last_fullsized":"2024-04-01T06:54:28.690214+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:40:38.641128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358358+0000","last_change":"2024-04-01T06:54:28.422554+0000","last_active":"2024-04-01T06:54:30.358358+0000","last_peered":"2024-04-01T06:54:30.358358+0000","last_clean":"2024-04-01T06:54:30.358358+0000","last_became_active":"2024-04-01T06:54:28.422209+0000","last_became_peered":"2024-04-01T06:54:28.422209+0000","last_unstale":"2024-04-01T06:54:30.358358+0000","last_undegraded":"2024-04-01T06:54:30.358358+0000","last_fullsized":"2024-04-01T06:54:30.358358+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T14:59:45.017681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.515266+0000","last_change":"2024-04-01T06:54:28.419291+0000","last_active":"2024-04-01T06:54:29.515266+0000","last_peered":"2024-04-01T06:54:29.515266+0000","last_clean":"2024-04-01T06:54:29.515266+0000","last_became_active":"2024-04-01T06:54:28.419013+0000","last_became_peered":"2024-04-01T06:54:28.419013+0000","last_unstale":"2024-04-01T06:54:29.515266+0000","last_undegraded":"2024-04-01T06:54:29.515266+0000","last_fullsized":"2024-04-01T06:54:29.515266+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:45:08.226568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.413505+0000","last_change":"2024-04-01T06:54:28.410264+0000","last_active":"2024-04-01T06:54:29.413505+0000","last_peered":"2024-04-01T06:54:29.413505+0000","last_clean":"2024-04-01T06:54:29.413505+0000","last_became_active":"2024-04-01T06:54:28.409959+0000","last_became_peered":"2024-04-01T06:54:28.409959+0000","last_unstale":"2024-04-01T06:54:29.413505+0000","last_undegraded":"2024-04-01T06:54:29.413505+0000","last_fullsized":"2024-04-01T06:54:29.413505+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:14:13.184396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-01T06:54:28.690280+0000","last_change":"2024-04-01T06:54:28.422115+0000","last_active":"2024-04-01T06:54:28.690280+0000","last_peered":"2024-04-01T06:54:28.690280+0000","last_clean":"2024-04-01T06:54:28.690280+0000","last_became_active":"2024-04-01T06:54:28.421629+0000","last_became_peered":"2024-04-01T06:54:28.421629+0000","last_unstale":"2024-04-01T06:54:28.690280+0000","last_undegraded":"2024-04-01T06:54:28.690280+0000","last_fullsized":"2024-04-01T06:54:28.690280+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:47:03.271557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358701+0000","last_change":"2024-04-01T06:54:28.429652+0000","last_active":"2024-04-01T06:54:30.358701+0000","last_peered":"2024-04-01T06:54:30.358701+0000","last_clean":"2024-04-01T06:54:30.358701+0000","last_became_active":"2024-04-01T06:54:28.429298+0000","last_became_peered":"2024-04-01T06:54:28.429298+0000","last_unstale":"2024-04-01T06:54:30.358701+0000","last_undegraded":"2024-04-01T06:54:30.358701+0000","last_fullsized":"2024-04-01T06:54:30.358701+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:03:16.110580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358421+0000","last_change":"2024-04-01T06:54:28.429645+0000","last_active":"2024-04-01T06:54:30.358421+0000","last_peered":"2024-04-01T06:54:30.358421+0000","last_clean":"2024-04-01T06:54:30.358421+0000","last_became_active":"2024-04-01T06:54:28.429285+0000","last_became_peered":"2024-04-01T06:54:28.429285+0000","last_unstale":"2024-04-01T06:54:30.358421+0000","last_undegraded":"2024-04-01T06:54:30.358421+0000","last_fullsized":"2024-04-01T06:54:30.358421+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:04:10.285396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.411765+0000","last_change":"2024-04-01T06:54:28.419390+0000","last_active":"2024-04-01T06:54:29.411765+0000","last_peered":"2024-04-01T06:54:29.411765+0000","last_clean":"2024-04-01T06:54:29.411765+0000","last_became_active":"2024-04-01T06:54:28.419110+0000","last_became_peered":"2024-04-01T06:54:28.419110+0000","last_unstale":"2024-04-01T06:54:29.411765+0000","last_undegraded":"2024-04-01T06:54:29.411765+0000","last_fullsized":"2024-04-01T06:54:29.411765+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:21:52.192681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.357608+0000","last_change":"2024-04-01T06:54:28.419416+0000","last_active":"2024-04-01T06:54:30.357608+0000","last_peered":"2024-04-01T06:54:30.357608+0000","last_clean":"2024-04-01T06:54:30.357608+0000","last_became_active":"2024-04-01T06:54:28.419099+0000","last_became_peered":"2024-04-01T06:54:28.419099+0000","last_unstale":"2024-04-01T06:54:30.357608+0000","last_undegraded":"2024-04-01T06:54:30.357608+0000","last_fullsized":"2024-04-01T06:54:30.357608+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:26:44.889806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.357586+0000","last_change":"2024-04-01T06:54:28.427391+0000","last_active":"2024-04-01T06:54:30.357586+0000","last_peered":"2024-04-01T06:54:30.357586+0000","last_clean":"2024-04-01T06:54:30.357586+0000","last_became_active":"2024-04-01T06:54:28.427153+0000","last_became_peered":"2024-04-01T06:54:28.427153+0000","last_unstale":"2024-04-01T06:54:30.357586+0000","last_undegraded":"2024-04-01T06:54:30.357586+0000","last_fullsized":"2024-04-01T06:54:30.357586+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:42:41.084729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.413106+0000","last_change":"2024-04-01T06:54:28.417088+0000","last_active":"2024-04-01T06:54:29.413106+0000","last_peered":"2024-04-01T06:54:29.413106+0000","last_clean":"2024-04-01T06:54:29.413106+0000","last_became_active":"2024-04-01T06:54:28.416747+0000","last_became_peered":"2024-04-01T06:54:28.416747+0000","last_unstale":"2024-04-01T06:54:29.413106+0000","last_undegraded":"2024-04-01T06:54:29.413106+0000","last_fullsized":"2024-04-01T06:54:29.413106+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:59:14.069761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.480070+0000","last_change":"2024-04-01T06:54:28.426049+0000","last_active":"2024-04-01T06:54:30.480070+0000","last_peered":"2024-04-01T06:54:30.480070+0000","last_clean":"2024-04-01T06:54:30.480070+0000","last_became_active":"2024-04-01T06:54:28.425723+0000","last_became_peered":"2024-04-01T06:54:28.425723+0000","last_unstale":"2024-04-01T06:54:30.480070+0000","last_undegraded":"2024-04-01T06:54:30.480070+0000","last_fullsized":"2024-04-01T06:54:30.480070+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:48:59.394352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.357884+0000","last_change":"2024-04-01T06:54:28.421574+0000","last_active":"2024-04-01T06:54:30.357884+0000","last_peered":"2024-04-01T06:54:30.357884+0000","last_clean":"2024-04-01T06:54:30.357884+0000","last_became_active":"2024-04-01T06:54:28.420852+0000","last_became_peered":"2024-04-01T06:54:28.420852+0000","last_unstale":"2024-04-01T06:54:30.357884+0000","last_undegraded":"2024-04-01T06:54:30.357884+0000","last_fullsized":"2024-04-01T06:54:30.357884+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:20:30.373285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358552+0000","last_change":"2024-04-01T06:54:28.419249+0000","last_active":"2024-04-01T06:54:30.358552+0000","last_peered":"2024-04-01T06:54:30.358552+0000","last_clean":"2024-04-01T06:54:30.358552+0000","last_became_active":"2024-04-01T06:54:28.418931+0000","last_became_peered":"2024-04-01T06:54:28.418931+0000","last_unstale":"2024-04-01T06:54:30.358552+0000","last_undegraded":"2024-04-01T06:54:30.358552+0000","last_fullsized":"2024-04-01T06:54:30.358552+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:38:04.786657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"78'4","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358045+0000","last_change":"2024-04-01T06:54:27.993489+0000","last_active":"2024-04-01T06:54:30.358045+0000","last_peered":"2024-04-01T06:54:30.358045+0000","last_clean":"2024-04-01T06:54:30.358045+0000","last_became_active":"2024-04-01T06:54:27.993201+0000","last_became_peered":"2024-04-01T06:54:27.993201+0000","last_unstale":"2024-04-01T06:54:30.358045+0000","last_undegraded":"2024-04-01T06:54:30.358045+0000","last_fullsized":"2024-04-01T06:54:30.358045+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:10:53.897013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.515446+0000","last_change":"2024-04-01T06:54:28.417750+0000","last_active":"2024-04-01T06:54:29.515446+0000","last_peered":"2024-04-01T06:54:29.515446+0000","last_clean":"2024-04-01T06:54:29.515446+0000","last_became_active":"2024-04-01T06:54:28.417470+0000","last_became_peered":"2024-04-01T06:54:28.417470+0000","last_unstale":"2024-04-01T06:54:29.515446+0000","last_undegraded":"2024-04-01T06:54:29.515446+0000","last_fullsized":"2024-04-01T06:54:29.515446+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:06:12.668846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"79'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.515595+0000","last_change":"2024-04-01T06:54:27.998302+0000","last_active":"2024-04-01T06:54:29.515595+0000","last_peered":"2024-04-01T06:54:29.515595+0000","last_clean":"2024-04-01T06:54:29.515595+0000","last_became_active":"2024-04-01T06:54:27.997951+0000","last_became_peered":"2024-04-01T06:54:27.997951+0000","last_unstale":"2024-04-01T06:54:29.515595+0000","last_undegraded":"2024-04-01T06:54:29.515595+0000","last_fullsized":"2024-04-01T06:54:29.515595+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:28:45.076734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358361+0000","last_change":"2024-04-01T06:54:28.415641+0000","last_active":"2024-04-01T06:54:30.358361+0000","last_peered":"2024-04-01T06:54:30.358361+0000","last_clean":"2024-04-01T06:54:30.358361+0000","last_became_active":"2024-04-01T06:54:28.415305+0000","last_became_peered":"2024-04-01T06:54:28.415305+0000","last_unstale":"2024-04-01T06:54:30.358361+0000","last_undegraded":"2024-04-01T06:54:30.358361+0000","last_fullsized":"2024-04-01T06:54:30.358361+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:01:46.528332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"79'4","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:32.707231+0000","last_change":"2024-04-01T06:54:27.990581+0000","last_active":"2024-04-01T06:54:32.707231+0000","last_peered":"2024-04-01T06:54:32.707231+0000","last_clean":"2024-04-01T06:54:32.707231+0000","last_became_active":"2024-04-01T06:54:27.990099+0000","last_became_peered":"2024-04-01T06:54:27.990099+0000","last_unstale":"2024-04-01T06:54:32.707231+0000","last_undegraded":"2024-04-01T06:54:32.707231+0000","last_fullsized":"2024-04-01T06:54:32.707231+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T14:53:49.183394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.413310+0000","last_change":"2024-04-01T06:54:28.423208+0000","last_active":"2024-04-01T06:54:29.413310+0000","last_peered":"2024-04-01T06:54:29.413310+0000","last_clean":"2024-04-01T06:54:29.413310+0000","last_became_active":"2024-04-01T06:54:28.422648+0000","last_became_peered":"2024-04-01T06:54:28.422648+0000","last_unstale":"2024-04-01T06:54:29.413310+0000","last_undegraded":"2024-04-01T06:54:29.413310+0000","last_fullsized":"2024-04-01T06:54:29.413310+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:02:58.380288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.413114+0000","last_change":"2024-04-01T06:54:27.995776+0000","last_active":"2024-04-01T06:54:29.413114+0000","last_peered":"2024-04-01T06:54:29.413114+0000","last_clean":"2024-04-01T06:54:29.413114+0000","last_became_active":"2024-04-01T06:54:27.995417+0000","last_became_peered":"2024-04-01T06:54:27.995417+0000","last_unstale":"2024-04-01T06:54:29.413114+0000","last_undegraded":"2024-04-01T06:54:29.413114+0000","last_fullsized":"2024-04-01T06:54:29.413114+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:46:36.694460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.214258+0000","last_change":"2024-04-01T06:54:28.422448+0000","last_active":"2024-04-01T06:54:30.214258+0000","last_peered":"2024-04-01T06:54:30.214258+0000","last_clean":"2024-04-01T06:54:30.214258+0000","last_became_active":"2024-04-01T06:54:28.422080+0000","last_became_peered":"2024-04-01T06:54:28.422080+0000","last_unstale":"2024-04-01T06:54:30.214258+0000","last_undegraded":"2024-04-01T06:54:30.214258+0000","last_fullsized":"2024-04-01T06:54:30.214258+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:03:23.686194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"79'5","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:31.701348+0000","last_change":"2024-04-01T06:54:27.998822+0000","last_active":"2024-04-01T06:54:31.701348+0000","last_peered":"2024-04-01T06:54:31.701348+0000","last_clean":"2024-04-01T06:54:31.701348+0000","last_became_active":"2024-04-01T06:54:27.998514+0000","last_became_peered":"2024-04-01T06:54:27.998514+0000","last_unstale":"2024-04-01T06:54:31.701348+0000","last_undegraded":"2024-04-01T06:54:31.701348+0000","last_fullsized":"2024-04-01T06:54:31.701348+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T14:21:28.340169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.412849+0000","last_change":"2024-04-01T06:54:28.415825+0000","last_active":"2024-04-01T06:54:29.412849+0000","last_peered":"2024-04-01T06:54:29.412849+0000","last_clean":"2024-04-01T06:54:29.412849+0000","last_became_active":"2024-04-01T06:54:28.413679+0000","last_became_peered":"2024-04-01T06:54:28.413679+0000","last_unstale":"2024-04-01T06:54:29.412849+0000","last_undegraded":"2024-04-01T06:54:29.412849+0000","last_fullsized":"2024-04-01T06:54:29.412849+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:13:19.907109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"79'3","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:32.708798+0000","last_change":"2024-04-01T06:54:27.994194+0000","last_active":"2024-04-01T06:54:32.708798+0000","last_peered":"2024-04-01T06:54:32.708798+0000","last_clean":"2024-04-01T06:54:32.708798+0000","last_became_active":"2024-04-01T06:54:27.993868+0000","last_became_peered":"2024-04-01T06:54:27.993868+0000","last_unstale":"2024-04-01T06:54:32.708798+0000","last_undegraded":"2024-04-01T06:54:32.708798+0000","last_fullsized":"2024-04-01T06:54:32.708798+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:55:17.003472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.214120+0000","last_change":"2024-04-01T06:54:28.412629+0000","last_active":"2024-04-01T06:54:30.214120+0000","last_peered":"2024-04-01T06:54:30.214120+0000","last_clean":"2024-04-01T06:54:30.214120+0000","last_became_active":"2024-04-01T06:54:28.412291+0000","last_became_peered":"2024-04-01T06:54:28.412291+0000","last_unstale":"2024-04-01T06:54:30.214120+0000","last_undegraded":"2024-04-01T06:54:30.214120+0000","last_fullsized":"2024-04-01T06:54:30.214120+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:29:14.007470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"79'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:32.708507+0000","last_change":"2024-04-01T06:54:27.996570+0000","last_active":"2024-04-01T06:54:32.708507+0000","last_peered":"2024-04-01T06:54:32.708507+0000","last_clean":"2024-04-01T06:54:32.708507+0000","last_became_active":"2024-04-01T06:54:27.994897+0000","last_became_peered":"2024-04-01T06:54:27.994897+0000","last_unstale":"2024-04-01T06:54:32.708507+0000","last_undegraded":"2024-04-01T06:54:32.708507+0000","last_fullsized":"2024-04-01T06:54:32.708507+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:53:05.733608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.515225+0000","last_change":"2024-04-01T06:54:28.413701+0000","last_active":"2024-04-01T06:54:29.515225+0000","last_peered":"2024-04-01T06:54:29.515225+0000","last_clean":"2024-04-01T06:54:29.515225+0000","last_became_active":"2024-04-01T06:54:28.413435+0000","last_became_peered":"2024-04-01T06:54:28.413435+0000","last_unstale":"2024-04-01T06:54:29.515225+0000","last_undegraded":"2024-04-01T06:54:29.515225+0000","last_fullsized":"2024-04-01T06:54:29.515225+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:43:27.835398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'1","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.213830+0000","last_change":"2024-04-01T06:54:28.001115+0000","last_active":"2024-04-01T06:54:30.213830+0000","last_peered":"2024-04-01T06:54:30.213830+0000","last_clean":"2024-04-01T06:54:30.213830+0000","last_became_active":"2024-04-01T06:54:28.000732+0000","last_became_peered":"2024-04-01T06:54:28.000732+0000","last_unstale":"2024-04-01T06:54:30.213830+0000","last_undegraded":"2024-04-01T06:54:30.213830+0000","last_fullsized":"2024-04-01T06:54:30.213830+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:06:02.064402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358103+0000","last_change":"2024-04-01T06:54:28.421670+0000","last_active":"2024-04-01T06:54:30.358103+0000","last_peered":"2024-04-01T06:54:30.358103+0000","last_clean":"2024-04-01T06:54:30.358103+0000","last_became_active":"2024-04-01T06:54:28.421335+0000","last_became_peered":"2024-04-01T06:54:28.421335+0000","last_unstale":"2024-04-01T06:54:30.358103+0000","last_undegraded":"2024-04-01T06:54:30.358103+0000","last_fullsized":"2024-04-01T06:54:30.358103+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:25:55.223397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"79'3","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:31.699724+0000","last_change":"2024-04-01T06:54:27.999413+0000","last_active":"2024-04-01T06:54:31.699724+0000","last_peered":"2024-04-01T06:54:31.699724+0000","last_clean":"2024-04-01T06:54:31.699724+0000","last_became_active":"2024-04-01T06:54:27.999123+0000","last_became_peered":"2024-04-01T06:54:27.999123+0000","last_unstale":"2024-04-01T06:54:31.699724+0000","last_undegraded":"2024-04-01T06:54:31.699724+0000","last_fullsized":"2024-04-01T06:54:31.699724+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:30:06.399907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.413618+0000","last_change":"2024-04-01T06:54:28.423843+0000","last_active":"2024-04-01T06:54:29.413618+0000","last_peered":"2024-04-01T06:54:29.413618+0000","last_clean":"2024-04-01T06:54:29.413618+0000","last_became_active":"2024-04-01T06:54:28.423538+0000","last_became_peered":"2024-04-01T06:54:28.423538+0000","last_unstale":"2024-04-01T06:54:29.413618+0000","last_undegraded":"2024-04-01T06:54:29.413618+0000","last_fullsized":"2024-04-01T06:54:29.413618+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:51:23.986409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:31.700817+0000","last_change":"2024-04-01T06:54:27.997137+0000","last_active":"2024-04-01T06:54:31.700817+0000","last_peered":"2024-04-01T06:54:31.700817+0000","last_clean":"2024-04-01T06:54:31.700817+0000","last_became_active":"2024-04-01T06:54:27.996386+0000","last_became_peered":"2024-04-01T06:54:27.996386+0000","last_unstale":"2024-04-01T06:54:31.700817+0000","last_undegraded":"2024-04-01T06:54:31.700817+0000","last_fullsized":"2024-04-01T06:54:31.700817+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:29:57.365756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358233+0000","last_change":"2024-04-01T06:54:28.426837+0000","last_active":"2024-04-01T06:54:30.358233+0000","last_peered":"2024-04-01T06:54:30.358233+0000","last_clean":"2024-04-01T06:54:30.358233+0000","last_became_active":"2024-04-01T06:54:28.426551+0000","last_became_peered":"2024-04-01T06:54:28.426551+0000","last_unstale":"2024-04-01T06:54:30.358233+0000","last_undegraded":"2024-04-01T06:54:30.358233+0000","last_fullsized":"2024-04-01T06:54:30.358233+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:05:50.264912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'4","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.214333+0000","last_change":"2024-04-01T06:54:27.999968+0000","last_active":"2024-04-01T06:54:30.214333+0000","last_peered":"2024-04-01T06:54:30.214333+0000","last_clean":"2024-04-01T06:54:30.214333+0000","last_became_active":"2024-04-01T06:54:27.999415+0000","last_became_peered":"2024-04-01T06:54:27.999415+0000","last_unstale":"2024-04-01T06:54:30.214333+0000","last_undegraded":"2024-04-01T06:54:30.214333+0000","last_fullsized":"2024-04-01T06:54:30.214333+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:31:57.472227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.413424+0000","last_change":"2024-04-01T06:54:28.421174+0000","last_active":"2024-04-01T06:54:29.413424+0000","last_peered":"2024-04-01T06:54:29.413424+0000","last_clean":"2024-04-01T06:54:29.413424+0000","last_became_active":"2024-04-01T06:54:28.420841+0000","last_became_peered":"2024-04-01T06:54:28.420841+0000","last_unstale":"2024-04-01T06:54:29.413424+0000","last_undegraded":"2024-04-01T06:54:29.413424+0000","last_fullsized":"2024-04-01T06:54:29.413424+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:05:25.377496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"79'8","reported_seq":20,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:31.697634+0000","last_change":"2024-04-01T06:54:27.995496+0000","last_active":"2024-04-01T06:54:31.697634+0000","last_peered":"2024-04-01T06:54:31.697634+0000","last_clean":"2024-04-01T06:54:31.697634+0000","last_became_active":"2024-04-01T06:54:27.995131+0000","last_became_peered":"2024-04-01T06:54:27.995131+0000","last_unstale":"2024-04-01T06:54:31.697634+0000","last_undegraded":"2024-04-01T06:54:31.697634+0000","last_fullsized":"2024-04-01T06:54:31.697634+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:36:12.129235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.413022+0000","last_change":"2024-04-01T06:54:28.427835+0000","last_active":"2024-04-01T06:54:29.413022+0000","last_peered":"2024-04-01T06:54:29.413022+0000","last_clean":"2024-04-01T06:54:29.413022+0000","last_became_active":"2024-04-01T06:54:28.426956+0000","last_became_peered":"2024-04-01T06:54:28.426956+0000","last_unstale":"2024-04-01T06:54:29.413022+0000","last_undegraded":"2024-04-01T06:54:29.413022+0000","last_fullsized":"2024-04-01T06:54:29.413022+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:41:17.334977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'4","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:31.698104+0000","last_change":"2024-04-01T06:54:27.992756+0000","last_active":"2024-04-01T06:54:31.698104+0000","last_peered":"2024-04-01T06:54:31.698104+0000","last_clean":"2024-04-01T06:54:31.698104+0000","last_became_active":"2024-04-01T06:54:27.992403+0000","last_became_peered":"2024-04-01T06:54:27.992403+0000","last_unstale":"2024-04-01T06:54:31.698104+0000","last_undegraded":"2024-04-01T06:54:31.698104+0000","last_fullsized":"2024-04-01T06:54:31.698104+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:40:33.458435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.411545+0000","last_change":"2024-04-01T06:54:28.416750+0000","last_active":"2024-04-01T06:54:29.411545+0000","last_peered":"2024-04-01T06:54:29.411545+0000","last_clean":"2024-04-01T06:54:29.411545+0000","last_became_active":"2024-04-01T06:54:28.416417+0000","last_became_peered":"2024-04-01T06:54:28.416417+0000","last_unstale":"2024-04-01T06:54:29.411545+0000","last_undegraded":"2024-04-01T06:54:29.411545+0000","last_fullsized":"2024-04-01T06:54:29.411545+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:04:41.698842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'3","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:31.701032+0000","last_change":"2024-04-01T06:54:28.001450+0000","last_active":"2024-04-01T06:54:31.701032+0000","last_peered":"2024-04-01T06:54:31.701032+0000","last_clean":"2024-04-01T06:54:31.701032+0000","last_became_active":"2024-04-01T06:54:28.001165+0000","last_became_peered":"2024-04-01T06:54:28.001165+0000","last_unstale":"2024-04-01T06:54:31.701032+0000","last_undegraded":"2024-04-01T06:54:31.701032+0000","last_fullsized":"2024-04-01T06:54:31.701032+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:20:03.876123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358814+0000","last_change":"2024-04-01T06:54:28.421097+0000","last_active":"2024-04-01T06:54:30.358814+0000","last_peered":"2024-04-01T06:54:30.358814+0000","last_clean":"2024-04-01T06:54:30.358814+0000","last_became_active":"2024-04-01T06:54:28.420781+0000","last_became_peered":"2024-04-01T06:54:28.420781+0000","last_unstale":"2024-04-01T06:54:30.358814+0000","last_undegraded":"2024-04-01T06:54:30.358814+0000","last_fullsized":"2024-04-01T06:54:30.358814+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:11:47.192742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358021+0000","last_change":"2024-04-01T06:54:27.993832+0000","last_active":"2024-04-01T06:54:30.358021+0000","last_peered":"2024-04-01T06:54:30.358021+0000","last_clean":"2024-04-01T06:54:30.358021+0000","last_became_active":"2024-04-01T06:54:27.993423+0000","last_became_peered":"2024-04-01T06:54:27.993423+0000","last_unstale":"2024-04-01T06:54:30.358021+0000","last_undegraded":"2024-04-01T06:54:30.358021+0000","last_fullsized":"2024-04-01T06:54:30.358021+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:58:37.542214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358345+0000","last_change":"2024-04-01T06:54:28.423352+0000","last_active":"2024-04-01T06:54:30.358345+0000","last_peered":"2024-04-01T06:54:30.358345+0000","last_clean":"2024-04-01T06:54:30.358345+0000","last_became_active":"2024-04-01T06:54:28.423049+0000","last_became_peered":"2024-04-01T06:54:28.423049+0000","last_unstale":"2024-04-01T06:54:30.358345+0000","last_undegraded":"2024-04-01T06:54:30.358345+0000","last_fullsized":"2024-04-01T06:54:30.358345+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:07:34.963189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'15","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:32.711057+0000","last_change":"2024-04-01T06:54:27.990469+0000","last_active":"2024-04-01T06:54:32.711057+0000","last_peered":"2024-04-01T06:54:32.711057+0000","last_clean":"2024-04-01T06:54:32.711057+0000","last_became_active":"2024-04-01T06:54:27.990147+0000","last_became_peered":"2024-04-01T06:54:27.990147+0000","last_unstale":"2024-04-01T06:54:32.711057+0000","last_undegraded":"2024-04-01T06:54:32.711057+0000","last_fullsized":"2024-04-01T06:54:32.711057+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:27:29.415723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.214102+0000","last_change":"2024-04-01T06:54:28.422479+0000","last_active":"2024-04-01T06:54:30.214102+0000","last_peered":"2024-04-01T06:54:30.214102+0000","last_clean":"2024-04-01T06:54:30.214102+0000","last_became_active":"2024-04-01T06:54:28.422155+0000","last_became_peered":"2024-04-01T06:54:28.422155+0000","last_unstale":"2024-04-01T06:54:30.214102+0000","last_undegraded":"2024-04-01T06:54:30.214102+0000","last_fullsized":"2024-04-01T06:54:30.214102+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:44:19.545796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"78'1","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.676983+0000","last_change":"2024-04-01T06:54:27.995827+0000","last_active":"2024-04-01T06:54:29.676983+0000","last_peered":"2024-04-01T06:54:29.676983+0000","last_clean":"2024-04-01T06:54:29.676983+0000","last_became_active":"2024-04-01T06:54:27.995450+0000","last_became_peered":"2024-04-01T06:54:27.995450+0000","last_unstale":"2024-04-01T06:54:29.676983+0000","last_undegraded":"2024-04-01T06:54:29.676983+0000","last_fullsized":"2024-04-01T06:54:29.676983+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T14:14:03.935578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.479897+0000","last_change":"2024-04-01T06:54:28.425376+0000","last_active":"2024-04-01T06:54:30.479897+0000","last_peered":"2024-04-01T06:54:30.479897+0000","last_clean":"2024-04-01T06:54:30.479897+0000","last_became_active":"2024-04-01T06:54:28.421235+0000","last_became_peered":"2024-04-01T06:54:28.421235+0000","last_unstale":"2024-04-01T06:54:30.479897+0000","last_undegraded":"2024-04-01T06:54:30.479897+0000","last_fullsized":"2024-04-01T06:54:30.479897+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:19:05.244735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.357821+0000","last_change":"2024-04-01T06:54:27.991659+0000","last_active":"2024-04-01T06:54:30.357821+0000","last_peered":"2024-04-01T06:54:30.357821+0000","last_clean":"2024-04-01T06:54:30.357821+0000","last_became_active":"2024-04-01T06:54:27.991280+0000","last_became_peered":"2024-04-01T06:54:27.991280+0000","last_unstale":"2024-04-01T06:54:30.357821+0000","last_undegraded":"2024-04-01T06:54:30.357821+0000","last_fullsized":"2024-04-01T06:54:30.357821+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:29:38.560570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-01T06:54:28.690268+0000","last_change":"2024-04-01T06:54:28.417654+0000","last_active":"2024-04-01T06:54:28.690268+0000","last_peered":"2024-04-01T06:54:28.690268+0000","last_clean":"2024-04-01T06:54:28.690268+0000","last_became_active":"2024-04-01T06:54:28.417318+0000","last_became_peered":"2024-04-01T06:54:28.417318+0000","last_unstale":"2024-04-01T06:54:28.690268+0000","last_undegraded":"2024-04-01T06:54:28.690268+0000","last_fullsized":"2024-04-01T06:54:28.690268+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:59:25.843730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358892+0000","last_change":"2024-04-01T06:54:27.998825+0000","last_active":"2024-04-01T06:54:30.358892+0000","last_peered":"2024-04-01T06:54:30.358892+0000","last_clean":"2024-04-01T06:54:30.358892+0000","last_became_active":"2024-04-01T06:54:27.998488+0000","last_became_peered":"2024-04-01T06:54:27.998488+0000","last_unstale":"2024-04-01T06:54:30.358892+0000","last_undegraded":"2024-04-01T06:54:30.358892+0000","last_fullsized":"2024-04-01T06:54:30.358892+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:22:24.878723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-01T06:54:28.690226+0000","last_change":"2024-04-01T06:54:28.421053+0000","last_active":"2024-04-01T06:54:28.690226+0000","last_peered":"2024-04-01T06:54:28.690226+0000","last_clean":"2024-04-01T06:54:28.690226+0000","last_became_active":"2024-04-01T06:54:28.420718+0000","last_became_peered":"2024-04-01T06:54:28.420718+0000","last_unstale":"2024-04-01T06:54:28.690226+0000","last_undegraded":"2024-04-01T06:54:28.690226+0000","last_fullsized":"2024-04-01T06:54:28.690226+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:58:10.109158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.214303+0000","last_change":"2024-04-01T06:54:28.419126+0000","last_active":"2024-04-01T06:54:30.214303+0000","last_peered":"2024-04-01T06:54:30.214303+0000","last_clean":"2024-04-01T06:54:30.214303+0000","last_became_active":"2024-04-01T06:54:28.418217+0000","last_became_peered":"2024-04-01T06:54:28.418217+0000","last_unstale":"2024-04-01T06:54:30.214303+0000","last_undegraded":"2024-04-01T06:54:30.214303+0000","last_fullsized":"2024-04-01T06:54:30.214303+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T14:02:41.148200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"79'4","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:32.710991+0000","last_change":"2024-04-01T06:54:27.993059+0000","last_active":"2024-04-01T06:54:32.710991+0000","last_peered":"2024-04-01T06:54:32.710991+0000","last_clean":"2024-04-01T06:54:32.710991+0000","last_became_active":"2024-04-01T06:54:27.992471+0000","last_became_peered":"2024-04-01T06:54:27.992471+0000","last_unstale":"2024-04-01T06:54:32.710991+0000","last_undegraded":"2024-04-01T06:54:32.710991+0000","last_fullsized":"2024-04-01T06:54:32.710991+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:27:38.691261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.515528+0000","last_change":"2024-04-01T06:54:28.411805+0000","last_active":"2024-04-01T06:54:29.515528+0000","last_peered":"2024-04-01T06:54:29.515528+0000","last_clean":"2024-04-01T06:54:29.515528+0000","last_became_active":"2024-04-01T06:54:28.411526+0000","last_became_peered":"2024-04-01T06:54:28.411526+0000","last_unstale":"2024-04-01T06:54:29.515528+0000","last_undegraded":"2024-04-01T06:54:29.515528+0000","last_fullsized":"2024-04-01T06:54:29.515528+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:59:08.223590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358605+0000","last_change":"2024-04-01T06:54:27.988695+0000","last_active":"2024-04-01T06:54:30.358605+0000","last_peered":"2024-04-01T06:54:30.358605+0000","last_clean":"2024-04-01T06:54:30.358605+0000","last_became_active":"2024-04-01T06:54:27.988069+0000","last_became_peered":"2024-04-01T06:54:27.988069+0000","last_unstale":"2024-04-01T06:54:30.358605+0000","last_undegraded":"2024-04-01T06:54:30.358605+0000","last_fullsized":"2024-04-01T06:54:30.358605+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:27:11.287962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":329,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-01T06:54:28.415048+0000","last_change":"2024-04-01T06:53:41.678430+0000","last_active":"2024-04-01T06:54:28.415048+0000","last_peered":"2024-04-01T06:54:28.415048+0000","last_clean":"2024-04-01T06:54:28.415048+0000","last_became_active":"2024-04-01T06:53:41.677964+0000","last_became_peered":"2024-04-01T06:53:41.677964+0000","last_unstale":"2024-04-01T06:54:28.415048+0000","last_undegraded":"2024-04-01T06:54:28.415048+0000","last_fullsized":"2024-04-01T06:54:28.415048+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:51:21.964420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:51:21.964420+0000","last_clean_scrub_stamp":"2024-04-01T06:51:21.964420+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:24:29.916692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.411404+0000","last_change":"2024-04-01T06:54:28.423775+0000","last_active":"2024-04-01T06:54:29.411404+0000","last_peered":"2024-04-01T06:54:29.411404+0000","last_clean":"2024-04-01T06:54:29.411404+0000","last_became_active":"2024-04-01T06:54:28.423462+0000","last_became_peered":"2024-04-01T06:54:28.423462+0000","last_unstale":"2024-04-01T06:54:29.411404+0000","last_undegraded":"2024-04-01T06:54:29.411404+0000","last_fullsized":"2024-04-01T06:54:29.411404+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:09:38.043033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"79'1","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:31.700850+0000","last_change":"2024-04-01T06:54:27.997801+0000","last_active":"2024-04-01T06:54:31.700850+0000","last_peered":"2024-04-01T06:54:31.700850+0000","last_clean":"2024-04-01T06:54:31.700850+0000","last_became_active":"2024-04-01T06:54:27.997305+0000","last_became_peered":"2024-04-01T06:54:27.997305+0000","last_unstale":"2024-04-01T06:54:31.700850+0000","last_undegraded":"2024-04-01T06:54:31.700850+0000","last_fullsized":"2024-04-01T06:54:31.700850+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:46:09.224535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"79'1","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:31.698306+0000","last_change":"2024-04-01T06:54:27.994483+0000","last_active":"2024-04-01T06:54:31.698306+0000","last_peered":"2024-04-01T06:54:31.698306+0000","last_clean":"2024-04-01T06:54:31.698306+0000","last_became_active":"2024-04-01T06:54:27.994093+0000","last_became_peered":"2024-04-01T06:54:27.994093+0000","last_unstale":"2024-04-01T06:54:31.698306+0000","last_undegraded":"2024-04-01T06:54:31.698306+0000","last_fullsized":"2024-04-01T06:54:31.698306+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:27:48.272196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.411547+0000","last_change":"2024-04-01T06:54:28.423895+0000","last_active":"2024-04-01T06:54:29.411547+0000","last_peered":"2024-04-01T06:54:29.411547+0000","last_clean":"2024-04-01T06:54:29.411547+0000","last_became_active":"2024-04-01T06:54:28.423593+0000","last_became_peered":"2024-04-01T06:54:28.423593+0000","last_unstale":"2024-04-01T06:54:29.411547+0000","last_undegraded":"2024-04-01T06:54:29.411547+0000","last_fullsized":"2024-04-01T06:54:29.411547+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:09:30.414080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.357814+0000","last_change":"2024-04-01T06:54:27.987207+0000","last_active":"2024-04-01T06:54:30.357814+0000","last_peered":"2024-04-01T06:54:30.357814+0000","last_clean":"2024-04-01T06:54:30.357814+0000","last_became_active":"2024-04-01T06:54:27.986537+0000","last_became_peered":"2024-04-01T06:54:27.986537+0000","last_unstale":"2024-04-01T06:54:30.357814+0000","last_undegraded":"2024-04-01T06:54:30.357814+0000","last_fullsized":"2024-04-01T06:54:30.357814+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:26:41.096843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.515518+0000","last_change":"2024-04-01T06:54:28.416591+0000","last_active":"2024-04-01T06:54:29.515518+0000","last_peered":"2024-04-01T06:54:29.515518+0000","last_clean":"2024-04-01T06:54:29.515518+0000","last_became_active":"2024-04-01T06:54:28.416295+0000","last_became_peered":"2024-04-01T06:54:28.416295+0000","last_unstale":"2024-04-01T06:54:29.515518+0000","last_undegraded":"2024-04-01T06:54:29.515518+0000","last_fullsized":"2024-04-01T06:54:29.515518+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:17:24.670572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358370+0000","last_change":"2024-04-01T06:54:27.996075+0000","last_active":"2024-04-01T06:54:30.358370+0000","last_peered":"2024-04-01T06:54:30.358370+0000","last_clean":"2024-04-01T06:54:30.358370+0000","last_became_active":"2024-04-01T06:54:27.995664+0000","last_became_peered":"2024-04-01T06:54:27.995664+0000","last_unstale":"2024-04-01T06:54:30.358370+0000","last_undegraded":"2024-04-01T06:54:30.358370+0000","last_fullsized":"2024-04-01T06:54:30.358370+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:17:33.214644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358295+0000","last_change":"2024-04-01T06:54:28.422041+0000","last_active":"2024-04-01T06:54:30.358295+0000","last_peered":"2024-04-01T06:54:30.358295+0000","last_clean":"2024-04-01T06:54:30.358295+0000","last_became_active":"2024-04-01T06:54:28.421743+0000","last_became_peered":"2024-04-01T06:54:28.421743+0000","last_unstale":"2024-04-01T06:54:30.358295+0000","last_undegraded":"2024-04-01T06:54:30.358295+0000","last_fullsized":"2024-04-01T06:54:30.358295+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:23:14.405879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:31.701969+0000","last_change":"2024-04-01T06:54:27.991734+0000","last_active":"2024-04-01T06:54:31.701969+0000","last_peered":"2024-04-01T06:54:31.701969+0000","last_clean":"2024-04-01T06:54:31.701969+0000","last_became_active":"2024-04-01T06:54:27.991139+0000","last_became_peered":"2024-04-01T06:54:27.991139+0000","last_unstale":"2024-04-01T06:54:31.701969+0000","last_undegraded":"2024-04-01T06:54:31.701969+0000","last_fullsized":"2024-04-01T06:54:31.701969+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:08:49.188179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.412717+0000","last_change":"2024-04-01T06:54:28.428467+0000","last_active":"2024-04-01T06:54:29.412717+0000","last_peered":"2024-04-01T06:54:29.412717+0000","last_clean":"2024-04-01T06:54:29.412717+0000","last_became_active":"2024-04-01T06:54:28.428095+0000","last_became_peered":"2024-04-01T06:54:28.428095+0000","last_unstale":"2024-04-01T06:54:29.412717+0000","last_undegraded":"2024-04-01T06:54:29.412717+0000","last_fullsized":"2024-04-01T06:54:29.412717+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:21:04.500427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'3","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:31.699951+0000","last_change":"2024-04-01T06:54:27.990321+0000","last_active":"2024-04-01T06:54:31.699951+0000","last_peered":"2024-04-01T06:54:31.699951+0000","last_clean":"2024-04-01T06:54:31.699951+0000","last_became_active":"2024-04-01T06:54:27.989997+0000","last_became_peered":"2024-04-01T06:54:27.989997+0000","last_unstale":"2024-04-01T06:54:31.699951+0000","last_undegraded":"2024-04-01T06:54:31.699951+0000","last_fullsized":"2024-04-01T06:54:31.699951+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:14:04.059812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.479669+0000","last_change":"2024-04-01T06:54:28.416480+0000","last_active":"2024-04-01T06:54:30.479669+0000","last_peered":"2024-04-01T06:54:30.479669+0000","last_clean":"2024-04-01T06:54:30.479669+0000","last_became_active":"2024-04-01T06:54:28.416009+0000","last_became_peered":"2024-04-01T06:54:28.416009+0000","last_unstale":"2024-04-01T06:54:30.479669+0000","last_undegraded":"2024-04-01T06:54:30.479669+0000","last_fullsized":"2024-04-01T06:54:30.479669+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:32:09.759447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358211+0000","last_change":"2024-04-01T06:54:27.996538+0000","last_active":"2024-04-01T06:54:30.358211+0000","last_peered":"2024-04-01T06:54:30.358211+0000","last_clean":"2024-04-01T06:54:30.358211+0000","last_became_active":"2024-04-01T06:54:27.996177+0000","last_became_peered":"2024-04-01T06:54:27.996177+0000","last_unstale":"2024-04-01T06:54:30.358211+0000","last_undegraded":"2024-04-01T06:54:30.358211+0000","last_fullsized":"2024-04-01T06:54:30.358211+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:39:45.386450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.515616+0000","last_change":"2024-04-01T06:54:28.419403+0000","last_active":"2024-04-01T06:54:29.515616+0000","last_peered":"2024-04-01T06:54:29.515616+0000","last_clean":"2024-04-01T06:54:29.515616+0000","last_became_active":"2024-04-01T06:54:28.419127+0000","last_became_peered":"2024-04-01T06:54:28.419127+0000","last_unstale":"2024-04-01T06:54:29.515616+0000","last_undegraded":"2024-04-01T06:54:29.515616+0000","last_fullsized":"2024-04-01T06:54:29.515616+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:52:13.510448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:31.698144+0000","last_change":"2024-04-01T06:54:27.992775+0000","last_active":"2024-04-01T06:54:31.698144+0000","last_peered":"2024-04-01T06:54:31.698144+0000","last_clean":"2024-04-01T06:54:31.698144+0000","last_became_active":"2024-04-01T06:54:27.992356+0000","last_became_peered":"2024-04-01T06:54:27.992356+0000","last_unstale":"2024-04-01T06:54:31.698144+0000","last_undegraded":"2024-04-01T06:54:31.698144+0000","last_fullsized":"2024-04-01T06:54:31.698144+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T14:46:37.302172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358992+0000","last_change":"2024-04-01T06:54:28.430132+0000","last_active":"2024-04-01T06:54:30.358992+0000","last_peered":"2024-04-01T06:54:30.358992+0000","last_clean":"2024-04-01T06:54:30.358992+0000","last_became_active":"2024-04-01T06:54:28.429816+0000","last_became_peered":"2024-04-01T06:54:28.429816+0000","last_unstale":"2024-04-01T06:54:30.358992+0000","last_undegraded":"2024-04-01T06:54:30.358992+0000","last_fullsized":"2024-04-01T06:54:30.358992+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T14:49:58.661275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358540+0000","last_change":"2024-04-01T06:54:27.999460+0000","last_active":"2024-04-01T06:54:30.358540+0000","last_peered":"2024-04-01T06:54:30.358540+0000","last_clean":"2024-04-01T06:54:30.358540+0000","last_became_active":"2024-04-01T06:54:27.999128+0000","last_became_peered":"2024-04-01T06:54:27.999128+0000","last_unstale":"2024-04-01T06:54:30.358540+0000","last_undegraded":"2024-04-01T06:54:30.358540+0000","last_fullsized":"2024-04-01T06:54:30.358540+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:19:24.285698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358852+0000","last_change":"2024-04-01T06:54:28.427720+0000","last_active":"2024-04-01T06:54:30.358852+0000","last_peered":"2024-04-01T06:54:30.358852+0000","last_clean":"2024-04-01T06:54:30.358852+0000","last_became_active":"2024-04-01T06:54:28.427357+0000","last_became_peered":"2024-04-01T06:54:28.427357+0000","last_unstale":"2024-04-01T06:54:30.358852+0000","last_undegraded":"2024-04-01T06:54:30.358852+0000","last_fullsized":"2024-04-01T06:54:30.358852+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:20:56.631811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-01T06:54:28.437747+0000","last_change":"2024-04-01T06:54:27.997806+0000","last_active":"2024-04-01T06:54:28.437747+0000","last_peered":"2024-04-01T06:54:28.437747+0000","last_clean":"2024-04-01T06:54:28.437747+0000","last_became_active":"2024-04-01T06:54:27.997490+0000","last_became_peered":"2024-04-01T06:54:27.997490+0000","last_unstale":"2024-04-01T06:54:28.437747+0000","last_undegraded":"2024-04-01T06:54:28.437747+0000","last_fullsized":"2024-04-01T06:54:28.437747+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:06:15.099390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358856+0000","last_change":"2024-04-01T06:54:28.419639+0000","last_active":"2024-04-01T06:54:30.358856+0000","last_peered":"2024-04-01T06:54:30.358856+0000","last_clean":"2024-04-01T06:54:30.358856+0000","last_became_active":"2024-04-01T06:54:28.418081+0000","last_became_peered":"2024-04-01T06:54:28.418081+0000","last_unstale":"2024-04-01T06:54:30.358856+0000","last_undegraded":"2024-04-01T06:54:30.358856+0000","last_fullsized":"2024-04-01T06:54:30.358856+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:15:44.753121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.411587+0000","last_change":"2024-04-01T06:54:27.995854+0000","last_active":"2024-04-01T06:54:29.411587+0000","last_peered":"2024-04-01T06:54:29.411587+0000","last_clean":"2024-04-01T06:54:29.411587+0000","last_became_active":"2024-04-01T06:54:27.995540+0000","last_became_peered":"2024-04-01T06:54:27.995540+0000","last_unstale":"2024-04-01T06:54:29.411587+0000","last_undegraded":"2024-04-01T06:54:29.411587+0000","last_fullsized":"2024-04-01T06:54:29.411587+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:47:15.075909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358991+0000","last_change":"2024-04-01T06:54:28.428100+0000","last_active":"2024-04-01T06:54:30.358991+0000","last_peered":"2024-04-01T06:54:30.358991+0000","last_clean":"2024-04-01T06:54:30.358991+0000","last_became_active":"2024-04-01T06:54:28.427769+0000","last_became_peered":"2024-04-01T06:54:28.427769+0000","last_unstale":"2024-04-01T06:54:30.358991+0000","last_undegraded":"2024-04-01T06:54:30.358991+0000","last_fullsized":"2024-04-01T06:54:30.358991+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:47:18.161878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.479810+0000","last_change":"2024-04-01T06:54:28.427557+0000","last_active":"2024-04-01T06:54:30.479810+0000","last_peered":"2024-04-01T06:54:30.479810+0000","last_clean":"2024-04-01T06:54:30.479810+0000","last_became_active":"2024-04-01T06:54:28.427209+0000","last_became_peered":"2024-04-01T06:54:28.427209+0000","last_unstale":"2024-04-01T06:54:30.479810+0000","last_undegraded":"2024-04-01T06:54:30.479810+0000","last_fullsized":"2024-04-01T06:54:30.479810+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:10:06.835360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358390+0000","last_change":"2024-04-01T06:54:28.423264+0000","last_active":"2024-04-01T06:54:30.358390+0000","last_peered":"2024-04-01T06:54:30.358390+0000","last_clean":"2024-04-01T06:54:30.358390+0000","last_became_active":"2024-04-01T06:54:28.422868+0000","last_became_peered":"2024-04-01T06:54:28.422868+0000","last_unstale":"2024-04-01T06:54:30.358390+0000","last_undegraded":"2024-04-01T06:54:30.358390+0000","last_fullsized":"2024-04-01T06:54:30.358390+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:00:49.784276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358186+0000","last_change":"2024-04-01T06:54:28.417824+0000","last_active":"2024-04-01T06:54:30.358186+0000","last_peered":"2024-04-01T06:54:30.358186+0000","last_clean":"2024-04-01T06:54:30.358186+0000","last_became_active":"2024-04-01T06:54:28.417510+0000","last_became_peered":"2024-04-01T06:54:28.417510+0000","last_unstale":"2024-04-01T06:54:30.358186+0000","last_undegraded":"2024-04-01T06:54:30.358186+0000","last_fullsized":"2024-04-01T06:54:30.358186+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:40:52.024183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358330+0000","last_change":"2024-04-01T06:54:28.426099+0000","last_active":"2024-04-01T06:54:30.358330+0000","last_peered":"2024-04-01T06:54:30.358330+0000","last_clean":"2024-04-01T06:54:30.358330+0000","last_became_active":"2024-04-01T06:54:28.425745+0000","last_became_peered":"2024-04-01T06:54:28.425745+0000","last_unstale":"2024-04-01T06:54:30.358330+0000","last_undegraded":"2024-04-01T06:54:30.358330+0000","last_fullsized":"2024-04-01T06:54:30.358330+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:13:45.145447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.411652+0000","last_change":"2024-04-01T06:54:28.421892+0000","last_active":"2024-04-01T06:54:29.411652+0000","last_peered":"2024-04-01T06:54:29.411652+0000","last_clean":"2024-04-01T06:54:29.411652+0000","last_became_active":"2024-04-01T06:54:28.421582+0000","last_became_peered":"2024-04-01T06:54:28.421582+0000","last_unstale":"2024-04-01T06:54:29.411652+0000","last_undegraded":"2024-04-01T06:54:29.411652+0000","last_fullsized":"2024-04-01T06:54:29.411652+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:44:12.137335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.479910+0000","last_change":"2024-04-01T06:54:28.421013+0000","last_active":"2024-04-01T06:54:30.479910+0000","last_peered":"2024-04-01T06:54:30.479910+0000","last_clean":"2024-04-01T06:54:30.479910+0000","last_became_active":"2024-04-01T06:54:28.420339+0000","last_became_peered":"2024-04-01T06:54:28.420339+0000","last_unstale":"2024-04-01T06:54:30.479910+0000","last_undegraded":"2024-04-01T06:54:30.479910+0000","last_fullsized":"2024-04-01T06:54:30.479910+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:59:07.758542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358708+0000","last_change":"2024-04-01T06:54:28.433203+0000","last_active":"2024-04-01T06:54:30.358708+0000","last_peered":"2024-04-01T06:54:30.358708+0000","last_clean":"2024-04-01T06:54:30.358708+0000","last_became_active":"2024-04-01T06:54:28.431890+0000","last_became_peered":"2024-04-01T06:54:28.431890+0000","last_unstale":"2024-04-01T06:54:30.358708+0000","last_undegraded":"2024-04-01T06:54:30.358708+0000","last_fullsized":"2024-04-01T06:54:30.358708+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:55:33.169722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.515418+0000","last_change":"2024-04-01T06:54:28.418425+0000","last_active":"2024-04-01T06:54:29.515418+0000","last_peered":"2024-04-01T06:54:29.515418+0000","last_clean":"2024-04-01T06:54:29.515418+0000","last_became_active":"2024-04-01T06:54:28.418165+0000","last_became_peered":"2024-04-01T06:54:28.418165+0000","last_unstale":"2024-04-01T06:54:29.515418+0000","last_undegraded":"2024-04-01T06:54:29.515418+0000","last_fullsized":"2024-04-01T06:54:29.515418+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:45:01.425680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.213976+0000","last_change":"2024-04-01T06:54:28.412058+0000","last_active":"2024-04-01T06:54:30.213976+0000","last_peered":"2024-04-01T06:54:30.213976+0000","last_clean":"2024-04-01T06:54:30.213976+0000","last_became_active":"2024-04-01T06:54:28.411680+0000","last_became_peered":"2024-04-01T06:54:28.411680+0000","last_unstale":"2024-04-01T06:54:30.213976+0000","last_undegraded":"2024-04-01T06:54:30.213976+0000","last_fullsized":"2024-04-01T06:54:30.213976+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:21:05.628262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.515699+0000","last_change":"2024-04-01T06:54:28.422304+0000","last_active":"2024-04-01T06:54:29.515699+0000","last_peered":"2024-04-01T06:54:29.515699+0000","last_clean":"2024-04-01T06:54:29.515699+0000","last_became_active":"2024-04-01T06:54:28.422023+0000","last_became_peered":"2024-04-01T06:54:28.422023+0000","last_unstale":"2024-04-01T06:54:29.515699+0000","last_undegraded":"2024-04-01T06:54:29.515699+0000","last_fullsized":"2024-04-01T06:54:29.515699+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:26:45.810780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.413317+0000","last_change":"2024-04-01T06:54:28.420350+0000","last_active":"2024-04-01T06:54:29.413317+0000","last_peered":"2024-04-01T06:54:29.413317+0000","last_clean":"2024-04-01T06:54:29.413317+0000","last_became_active":"2024-04-01T06:54:28.419995+0000","last_became_peered":"2024-04-01T06:54:28.419995+0000","last_unstale":"2024-04-01T06:54:29.413317+0000","last_undegraded":"2024-04-01T06:54:29.413317+0000","last_fullsized":"2024-04-01T06:54:29.413317+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:30:20.831966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.411779+0000","last_change":"2024-04-01T06:54:28.417067+0000","last_active":"2024-04-01T06:54:29.411779+0000","last_peered":"2024-04-01T06:54:29.411779+0000","last_clean":"2024-04-01T06:54:29.411779+0000","last_became_active":"2024-04-01T06:54:28.416796+0000","last_became_peered":"2024-04-01T06:54:28.416796+0000","last_unstale":"2024-04-01T06:54:29.411779+0000","last_undegraded":"2024-04-01T06:54:29.411779+0000","last_fullsized":"2024-04-01T06:54:29.411779+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:39:43.396643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.479743+0000","last_change":"2024-04-01T06:54:28.424971+0000","last_active":"2024-04-01T06:54:30.479743+0000","last_peered":"2024-04-01T06:54:30.479743+0000","last_clean":"2024-04-01T06:54:30.479743+0000","last_became_active":"2024-04-01T06:54:28.424664+0000","last_became_peered":"2024-04-01T06:54:28.424664+0000","last_unstale":"2024-04-01T06:54:30.479743+0000","last_undegraded":"2024-04-01T06:54:30.479743+0000","last_fullsized":"2024-04-01T06:54:30.479743+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:03:51.434412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":246668,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3922,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":94,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200704,"data_stored":31109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579913,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":847872,"data_stored":408370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]}]},{"osd":10,"up_from":67,"seq":287762808845,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":942080,"data_stored":1001832,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]}]},{"osd":9,"up_from":62,"seq":266287972369,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31948,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713204,"statfs":{"total":95995035648,"available":95962320896,"internally_reserved":0,"allocated":851968,"data_stored":408952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:54:22 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.27700000000000002}]},{"osd":1,"last update":"Mon Apr 1 06:54:22 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.56799999999999995}]},{"osd":2,"last update":"Mon Apr 1 06:54:22 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.47699999999999998}]},{"osd":3,"last update":"Mon Apr 1 06:54:22 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.316},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.42299999999999999}]},{"osd":4,"last update":"Mon Apr 1 06:54:22 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.57999999999999996}]},{"osd":5,"last update":"Mon Apr 1 06:54:22 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":0.39600000000000002}]},{"osd":6,"last update":"Mon Apr 1 06:54:22 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.504},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.434}]},{"osd":7,"last update":"Mon Apr 1 06:54:22 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.59099999999999997}]},{"osd":8,"last update":"Mon Apr 1 06:54:22 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":5.6600000000000001,"5min":5.6600000000000001,"15min":5.6600000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":5.6070000000000002,"5min":5.6070000000000002,"15min":5.6070000000000002},"last":0.51600000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]}]},{"osd":8,"up_from":55,"seq":236223201301,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31956,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713196,"statfs":{"total":95995035648,"available":95962312704,"internally_reserved":0,"allocated":864256,"data_stored":408777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:54:05 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.65600000000000003}]},{"osd":1,"last update":"Mon Apr 1 06:54:05 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.82999999999999996}]},{"osd":2,"last update":"Mon Apr 1 06:54:05 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.629},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.60899999999999999}]},{"osd":3,"last update":"Mon Apr 1 06:54:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.749},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.76500000000000001}]},{"osd":4,"last update":"Mon Apr 1 06:54:05 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.81899999999999995}]},{"osd":5,"last update":"Mon Apr 1 06:54:05 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.79700000000000004}]},{"osd":6,"last update":"Mon Apr 1 06:54:05 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.89300000000000002}]},{"osd":7,"last update":"Mon Apr 1 06:54:05 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.90400000000000003}]},{"osd":9,"last update":"Mon Apr 1 06:54:24 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.98499999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]}]},{"osd":7,"up_from":48,"seq":206158430230,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31996,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713156,"statfs":{"total":95995035648,"available":95962271744,"internally_reserved":0,"allocated":901120,"data_stored":999320,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:53:48 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.41099999999999998}]},{"osd":1,"last update":"Mon Apr 1 06:53:48 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.46000000000000002}]},{"osd":2,"last update":"Mon Apr 1 06:53:48 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.501},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.67500000000000004}]},{"osd":3,"last update":"Mon Apr 1 06:53:48 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.65900000000000003}]},{"osd":4,"last update":"Mon Apr 1 06:53:48 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.63900000000000001}]},{"osd":5,"last update":"Mon Apr 1 06:53:48 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.62}]},{"osd":6,"last update":"Mon Apr 1 06:53:48 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.71699999999999997}]},{"osd":8,"last update":"Mon Apr 1 06:54:04 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.70399999999999996}]},{"osd":9,"last update":"Mon Apr 1 06:54:24 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.79800000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]}]},{"osd":6,"up_from":43,"seq":184683593755,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":851968,"data_stored":408460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:53:32 2024","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.39100000000000001}]},{"osd":1,"last update":"Mon Apr 1 06:53:32 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.55100000000000005}]},{"osd":2,"last update":"Mon Apr 1 06:53:32 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.88100000000000001}]},{"osd":3,"last update":"Mon Apr 1 06:53:32 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.48399999999999999}]},{"osd":4,"last update":"Mon Apr 1 06:53:32 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.626}]},{"osd":5,"last update":"Mon Apr 1 06:53:32 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.66600000000000004}]},{"osd":7,"last update":"Mon Apr 1 06:53:48 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.82399999999999995}]},{"osd":8,"last update":"Mon Apr 1 06:54:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.80600000000000005}]},{"osd":9,"last update":"Mon Apr 1 06:54:26 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.60699999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574893,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31956,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713196,"statfs":{"total":95995035648,"available":95962312704,"internally_reserved":0,"allocated":864256,"data_stored":416536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:54:16 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.48499999999999999,"15min":0.46600000000000003},"min":{"1min":0.32800000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.501,"15min":0.48099999999999998},"min":{"1min":0.35499999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.45300000000000001}]},{"osd":2,"last update":"Mon Apr 1 06:54:28 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.55300000000000005,"15min":0.53800000000000003},"min":{"1min":0.42899999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.53600000000000003,"15min":0.52200000000000002},"min":{"1min":0.38800000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.42899999999999999}]},{"osd":3,"last update":"Mon Apr 1 06:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.54100000000000004,"15min":0.53100000000000003},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.55400000000000005,"15min":0.54000000000000004},"min":{"1min":0.40799999999999997,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.58799999999999997}]},{"osd":4,"last update":"Mon Apr 1 06:54:02 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.41399999999999998,"15min":0.40200000000000002},"min":{"1min":0.28999999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.501,"5min":0.42099999999999999,"15min":0.40699999999999997},"min":{"1min":0.33000000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.60499999999999998}]},{"osd":5,"last update":"Mon Apr 1 06:54:16 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.58899999999999997,"15min":0.58499999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.56799999999999995,"15min":0.56000000000000005},"min":{"1min":0.44600000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.57599999999999996}]},{"osd":6,"last update":"Mon Apr 1 06:54:33 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.56999999999999995,"15min":0.55100000000000005},"min":{"1min":0.47099999999999997,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.58499999999999996,"15min":0.56799999999999995},"min":{"1min":0.51500000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.66800000000000004}]},{"osd":7,"last update":"Mon Apr 1 06:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.754},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.74099999999999999}]},{"osd":8,"last update":"Mon Apr 1 06:54:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.80700000000000005}]},{"osd":9,"last update":"Mon Apr 1 06:54:25 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.78900000000000003}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]}]},{"osd":0,"up_from":8,"seq":34359738416,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":851968,"data_stored":408460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Apr 1 06:54:08 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.47899999999999998,"15min":0.46500000000000002},"min":{"1min":0.29299999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69099999999999995,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.379},{"interface":"front","average":{"1min":0.495,"5min":0.47299999999999998,"15min":0.46999999999999997},"min":{"1min":0.32800000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.64800000000000002,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.36199999999999999}]},{"osd":2,"last update":"Mon Apr 1 06:54:28 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.47799999999999998,"15min":0.46400000000000002},"min":{"1min":0.317,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.66900000000000004,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.317},{"interface":"front","average":{"1min":0.5,"5min":0.48599999999999999,"15min":0.47999999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.64200000000000002,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.30599999999999999}]},{"osd":3,"last update":"Mon Apr 1 06:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.26200000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.59399999999999997,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.38900000000000001,"15min":0.379},"min":{"1min":0.29699999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.64200000000000002,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.33500000000000002}]},{"osd":4,"last update":"Mon Apr 1 06:54:03 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.50600000000000001,"15min":0.5},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.51300000000000001,"15min":0.50900000000000001},"min":{"1min":0.40400000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.435}]},{"osd":5,"last update":"Mon Apr 1 06:54:15 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53300000000000003,"15min":0.52900000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52400000000000002,"15min":0.52500000000000002},"min":{"1min":0.38700000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.747,"5min":0.748,"15min":0.748},"last":0.66200000000000003}]},{"osd":6,"last update":"Mon Apr 1 06:53:33 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.51700000000000002}]},{"osd":7,"last update":"Mon Apr 1 06:53:50 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.46000000000000002}]},{"osd":8,"last update":"Mon Apr 1 06:54:08 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.70199999999999996}]},{"osd":9,"last update":"Mon Apr 1 06:54:21 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.61599999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]},{"osd":2,"up_from":18,"seq":77309411369,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":864256,"data_stored":409968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:54:27 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.48399999999999999,"15min":0.46700000000000003},"min":{"1min":0.33900000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.65600000000000003,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.498},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.46899999999999997,"15min":0.45700000000000002},"min":{"1min":0.35799999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.65600000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.51500000000000001}]},{"osd":1,"last update":"Mon Apr 1 06:54:27 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.52300000000000002,"15min":0.51300000000000001},"min":{"1min":0.42499999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.53900000000000003,"15min":0.53500000000000003},"min":{"1min":0.39800000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.40699999999999997}]},{"osd":3,"last update":"Mon Apr 1 06:53:43 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53100000000000003,"15min":0.52700000000000002},"min":{"1min":0.39100000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.55400000000000005,"15min":0.54400000000000004},"min":{"1min":0.38700000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.57999999999999996}]},{"osd":4,"last update":"Mon Apr 1 06:53:59 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.54300000000000004,"15min":0.53700000000000003},"min":{"1min":0.42299999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.53400000000000003,"15min":0.52700000000000002},"min":{"1min":0.45900000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71699999999999997,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.69399999999999995}]},{"osd":5,"last update":"Mon Apr 1 06:54:15 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.45500000000000002,"15min":0.44900000000000001},"min":{"1min":0.317,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.74199999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.46300000000000002,"15min":0.45900000000000002},"min":{"1min":0.32600000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.68999999999999995,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.66500000000000004}]},{"osd":6,"last update":"Mon Apr 1 06:53:32 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.79400000000000004}]},{"osd":7,"last update":"Mon Apr 1 06:53:49 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.60099999999999998}]},{"osd":8,"last update":"Mon Apr 1 06:54:04 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.56499999999999995}]},{"osd":9,"last update":"Mon Apr 1 06:54:24 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.88400000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]}]},{"osd":3,"up_from":25,"seq":107374182437,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31952,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713200,"statfs":{"total":95995035648,"available":95962316800,"internally_reserved":0,"allocated":860160,"data_stored":408323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:53:40 2024","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.32800000000000001,"15min":0.32600000000000001},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.48599999999999999,"5min":0.496,"15min":0.496},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.33500000000000002,"15min":0.33100000000000002},"min":{"1min":0.24399999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.58199999999999996,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.379}]},{"osd":1,"last update":"Mon Apr 1 06:53:40 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.51400000000000001,"15min":0.51100000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.502,"15min":0.495},"min":{"1min":0.38400000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.48199999999999998}]},{"osd":2,"last update":"Mon Apr 1 06:53:40 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.51400000000000001,"15min":0.51100000000000001},"min":{"1min":0.32600000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.746,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52800000000000002,"15min":0.52600000000000002},"min":{"1min":0.374,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.70999999999999996}]},{"osd":4,"last update":"Mon Apr 1 06:53:56 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.53500000000000003,"15min":0.52500000000000002},"min":{"1min":0.38200000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.56599999999999995,"15min":0.55700000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.34599999999999997}]},{"osd":5,"last update":"Mon Apr 1 06:54:16 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.51500000000000001,"15min":0.50900000000000001},"min":{"1min":0.40699999999999997,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.56000000000000005,"15min":0.55200000000000005},"min":{"1min":0.39800000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73199999999999998,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.61899999999999999}]},{"osd":6,"last update":"Mon Apr 1 06:53:34 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.40600000000000003}]},{"osd":7,"last update":"Mon Apr 1 06:53:52 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.67200000000000004}]},{"osd":8,"last update":"Mon Apr 1 06:54:04 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.71999999999999997}]},{"osd":9,"last update":"Mon Apr 1 06:54:23 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.42099999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]}]},{"osd":4,"up_from":32,"seq":137438953506,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":839680,"data_stored":399822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:54:02 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.496,"15min":0.48799999999999999},"min":{"1min":0.34899999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.433},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.48299999999999998,"15min":0.47699999999999998},"min":{"1min":0.30399999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.41799999999999998}]},{"osd":1,"last update":"Mon Apr 1 06:54:02 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.33300000000000002,"15min":0.32800000000000001},"min":{"1min":0.27200000000000002,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.53600000000000003,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.376,"5min":0.35199999999999998,"15min":0.34799999999999998},"min":{"1min":0.26500000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.52400000000000002,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.50600000000000001}]},{"osd":2,"last update":"Mon Apr 1 06:54:02 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.49199999999999999,"15min":0.48999999999999999},"min":{"1min":0.39900000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.64100000000000001,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.48899999999999999,"15min":0.47899999999999998},"min":{"1min":0.40799999999999997,"5min":0.316,"15min":0.316},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.67800000000000005}]},{"osd":3,"last update":"Mon Apr 1 06:54:02 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.53100000000000003,"15min":0.52800000000000002},"min":{"1min":0.35099999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.69299999999999995,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.497,"15min":0.49299999999999999},"min":{"1min":0.40400000000000003,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.69299999999999995,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.61699999999999999}]},{"osd":5,"last update":"Mon Apr 1 06:54:15 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.55000000000000004,"15min":0.54500000000000004},"min":{"1min":0.40300000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.54000000000000004,"15min":0.54400000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.624,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.60399999999999998}]},{"osd":6,"last update":"Mon Apr 1 06:53:33 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":2.52,"5min":2.52,"15min":2.52},"last":0.81399999999999995}]},{"osd":7,"last update":"Mon Apr 1 06:53:48 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.66100000000000003}]},{"osd":8,"last update":"Mon Apr 1 06:54:05 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.86099999999999999}]},{"osd":9,"last update":"Mon Apr 1 06:54:21 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.83999999999999997}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]}]},{"osd":5,"up_from":36,"seq":154618822687,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":925696,"data_stored":1000166,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:54:13 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.496,"15min":0.48299999999999998},"min":{"1min":0.41299999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.498,"15min":0.49299999999999999},"min":{"1min":0.39800000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.55700000000000005}]},{"osd":1,"last update":"Mon Apr 1 06:54:13 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.53000000000000003,"15min":0.52400000000000002},"min":{"1min":0.42599999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.69899999999999995,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53200000000000003,"15min":0.52700000000000002},"min":{"1min":0.40799999999999997,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.73199999999999998,"5min":0.753,"15min":0.753},"last":0.73599999999999999}]},{"osd":2,"last update":"Mon Apr 1 06:54:13 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.38600000000000001,"15min":0.38400000000000001},"min":{"1min":0.28899999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39900000000000002,"15min":0.40000000000000002},"min":{"1min":0.29399999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.48699999999999999}]},{"osd":3,"last update":"Mon Apr 1 06:54:13 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.39800000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.83899999999999997,"5min":1.389,"15min":1.389},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.65900000000000003,"15min":0.67500000000000004},"min":{"1min":0.38500000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.73799999999999999,"5min":3.9540000000000002,"15min":3.9540000000000002},"last":0.64900000000000002}]},{"osd":4,"last update":"Mon Apr 1 06:54:13 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.55200000000000005,"15min":0.54600000000000004},"min":{"1min":0.46400000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.70699999999999996,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.75700000000000001,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.70899999999999996}]},{"osd":6,"last update":"Mon Apr 1 06:53:31 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.753},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.57799999999999996}]},{"osd":7,"last update":"Mon Apr 1 06:53:48 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.72199999999999998}]},{"osd":8,"last update":"Mon Apr 1 06:54:04 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.82499999999999996}]},{"osd":9,"last update":"Mon Apr 1 06:54:22 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.76400000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34069,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34069,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":20849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T06:54:36.815 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-01T06:54:36.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.970+0000 7fdc27414700 1 -- 172.21.15.83:0/1362538273 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc20101e70 msgr2=0x7fdc201022d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:36.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.970+0000 7fdc27414700 1 --2- 172.21.15.83:0/1362538273 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc20101e70 0x7fdc201022d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c0099c0 tx=0x7fdc1c009cd0 comp rx=0 tx=0).stop 2024-04-01T06:54:36.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.970+0000 7fdc27414700 1 -- 172.21.15.83:0/1362538273 shutdown_connections 2024-04-01T06:54:36.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.970+0000 7fdc27414700 1 --2- 172.21.15.83:0/1362538273 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc20102810 0x7fdc201090c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:36.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.970+0000 7fdc27414700 1 --2- 172.21.15.83:0/1362538273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc20100c80 0x7fdc201010a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:36.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.970+0000 7fdc27414700 1 --2- 172.21.15.83:0/1362538273 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc20101e70 0x7fdc201022d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:36.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.970+0000 7fdc27414700 1 -- 172.21.15.83:0/1362538273 >> 172.21.15.83:0/1362538273 conn(0x7fdc200fc1f0 msgr2=0x7fdc200fe630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:36.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.970+0000 7fdc27414700 1 -- 172.21.15.83:0/1362538273 shutdown_connections 2024-04-01T06:54:36.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.970+0000 7fdc27414700 1 -- 172.21.15.83:0/1362538273 wait complete. 2024-04-01T06:54:36.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.971+0000 7fdc27414700 1 Processor -- start 2024-04-01T06:54:36.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.971+0000 7fdc27414700 1 -- start start 2024-04-01T06:54:36.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.971+0000 7fdc27414700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc20100c80 0x7fdc20074b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:36.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.971+0000 7fdc27414700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc20101e70 0x7fdc200731a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:36.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.971+0000 7fdc27414700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc20102810 0x7fdc200736e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:36.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.971+0000 7fdc27414700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc20073e80 con 0x7fdc20100c80 2024-04-01T06:54:36.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.971+0000 7fdc27414700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc20073ff0 con 0x7fdc20102810 2024-04-01T06:54:36.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.971+0000 7fdc27414700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc201a0be0 con 0x7fdc20101e70 2024-04-01T06:54:36.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.971+0000 7fdc251b0700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc20100c80 0x7fdc20074b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:36.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.971+0000 7fdc251b0700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc20100c80 0x7fdc20074b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:35400/0 (socket says 172.21.15.83:35400) 2024-04-01T06:54:36.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.971+0000 7fdc251b0700 1 -- 172.21.15.83:0/1252089232 learned_addr learned my addr 172.21.15.83:0/1252089232 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:54:36.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.971+0000 7fdc259b1700 1 --2- 172.21.15.83:0/1252089232 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc20102810 0x7fdc200736e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:36.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.972+0000 7fdc249af700 1 --2- 172.21.15.83:0/1252089232 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc20101e70 0x7fdc200731a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:36.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.972+0000 7fdc251b0700 1 -- 172.21.15.83:0/1252089232 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc20101e70 msgr2=0x7fdc200731a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:36.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.972+0000 7fdc251b0700 1 --2- 172.21.15.83:0/1252089232 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc20101e70 0x7fdc200731a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:36.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.972+0000 7fdc251b0700 1 -- 172.21.15.83:0/1252089232 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc20102810 msgr2=0x7fdc200736e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:36.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.972+0000 7fdc251b0700 1 --2- 172.21.15.83:0/1252089232 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc20102810 0x7fdc200736e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:36.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.972+0000 7fdc251b0700 1 -- 172.21.15.83:0/1252089232 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc1c0095f0 con 0x7fdc20100c80 2024-04-01T06:54:36.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.972+0000 7fdc251b0700 1 --2- 172.21.15.83:0/1252089232 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc20100c80 0x7fdc20074b10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdc1400c970 tx=0x7fdc1400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:36.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.972+0000 7fdc127fc700 1 -- 172.21.15.83:0/1252089232 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc14004220 con 0x7fdc20100c80 2024-04-01T06:54:36.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.972+0000 7fdc127fc700 1 -- 172.21.15.83:0/1252089232 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdc1400ce60 con 0x7fdc20100c80 2024-04-01T06:54:36.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.972+0000 7fdc27414700 1 -- 172.21.15.83:0/1252089232 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc201a0e70 con 0x7fdc20100c80 2024-04-01T06:54:36.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.972+0000 7fdc127fc700 1 -- 172.21.15.83:0/1252089232 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc14003c00 con 0x7fdc20100c80 2024-04-01T06:54:36.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.972+0000 7fdc27414700 1 -- 172.21.15.83:0/1252089232 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc201a12a0 con 0x7fdc20100c80 2024-04-01T06:54:36.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.973+0000 7fdc27414700 1 -- 172.21.15.83:0/1252089232 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc201080a0 con 0x7fdc20100c80 2024-04-01T06:54:36.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.974+0000 7fdc127fc700 1 -- 172.21.15.83:0/1252089232 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7fdc14003d60 con 0x7fdc20100c80 2024-04-01T06:54:36.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.975+0000 7fdc127fc700 1 --2- 172.21.15.83:0/1252089232 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fdc0c0a1230 0x7fdc0c0a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:36.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.975+0000 7fdc249af700 1 --2- 172.21.15.83:0/1252089232 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fdc0c0a1230 0x7fdc0c0a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:36.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.975+0000 7fdc127fc700 1 -- 172.21.15.83:0/1252089232 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fdc140cc3e0 con 0x7fdc20100c80 2024-04-01T06:54:36.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.975+0000 7fdc249af700 1 --2- 172.21.15.83:0/1252089232 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fdc0c0a1230 0x7fdc0c0a36f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c003820 tx=0x7fdc1c000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:36.978 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:36.979+0000 7fdc127fc700 1 -- 172.21.15.83:0/1252089232 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7fdc14095bc0 con 0x7fdc20100c80 2024-04-01T06:54:37.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:36 smithi145 ceph-mon[47816]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:54:37.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:36 smithi145 ceph-mon[47816]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:54:37.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:36 smithi145 ceph-mon[47816]: pgmap v220: 97 pgs: 97 active+clean; 580 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 794 B/s rd, 3.7 KiB/s wr, 12 op/s 2024-04-01T06:54:37.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:36 smithi145 ceph-mon[47816]: mgrmap e17: x(active, since 5m), standbys: z, y 2024-04-01T06:54:37.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:36 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/678664390' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:54:37.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:36 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/4041979390' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T06:54:37.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:36 smithi083 ceph-mon[43429]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:54:37.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:36 smithi083 ceph-mon[43429]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:54:37.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:36 smithi083 ceph-mon[43429]: pgmap v220: 97 pgs: 97 active+clean; 580 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 794 B/s rd, 3.7 KiB/s wr, 12 op/s 2024-04-01T06:54:37.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:36 smithi083 ceph-mon[43429]: mgrmap e17: x(active, since 5m), standbys: z, y 2024-04-01T06:54:37.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:36 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/678664390' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:54:37.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:36 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/4041979390' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T06:54:37.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:36 smithi153 ceph-mon[48187]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:54:37.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:36 smithi153 ceph-mon[48187]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:54:37.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:36 smithi153 ceph-mon[48187]: pgmap v220: 97 pgs: 97 active+clean; 580 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 794 B/s rd, 3.7 KiB/s wr, 12 op/s 2024-04-01T06:54:37.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:36 smithi153 ceph-mon[48187]: mgrmap e17: x(active, since 5m), standbys: z, y 2024-04-01T06:54:37.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:36 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/678664390' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:54:37.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:36 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/4041979390' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T06:54:37.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:37.172+0000 7fdc27414700 1 -- 172.21.15.83:0/1252089232 --> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdc2002ce60 con 0x7fdc0c0a1230 2024-04-01T06:54:37.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:37.181+0000 7fdc127fc700 1 -- 172.21.15.83:0/1252089232 <== mgr.14152 v2:172.21.15.83:6800/3375372052 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+328705 (secure 0 0 0) 0x7fdc2002ce60 con 0x7fdc0c0a1230 2024-04-01T06:54:37.185 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:54:37.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:37.185+0000 7fdc27414700 1 -- 172.21.15.83:0/1252089232 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fdc0c0a1230 msgr2=0x7fdc0c0a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:37.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:37.185+0000 7fdc27414700 1 --2- 172.21.15.83:0/1252089232 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fdc0c0a1230 0x7fdc0c0a36f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c003820 tx=0x7fdc1c000bc0 comp rx=0 tx=0).stop 2024-04-01T06:54:37.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:37.185+0000 7fdc27414700 1 -- 172.21.15.83:0/1252089232 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc20100c80 msgr2=0x7fdc20074b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:37.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:37.185+0000 7fdc27414700 1 --2- 172.21.15.83:0/1252089232 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc20100c80 0x7fdc20074b10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdc1400c970 tx=0x7fdc1400cc80 comp rx=0 tx=0).stop 2024-04-01T06:54:37.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:37.185+0000 7fdc27414700 1 -- 172.21.15.83:0/1252089232 shutdown_connections 2024-04-01T06:54:37.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:37.185+0000 7fdc27414700 1 --2- 172.21.15.83:0/1252089232 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc20100c80 0x7fdc20074b10 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:37.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:37.185+0000 7fdc27414700 1 --2- 172.21.15.83:0/1252089232 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fdc0c0a1230 0x7fdc0c0a36f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:37.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:37.185+0000 7fdc27414700 1 --2- 172.21.15.83:0/1252089232 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc20102810 0x7fdc200736e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:37.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:37.185+0000 7fdc27414700 1 --2- 172.21.15.83:0/1252089232 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc20101e70 0x7fdc200731a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:37.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:37.185+0000 7fdc27414700 1 -- 172.21.15.83:0/1252089232 >> 172.21.15.83:0/1252089232 conn(0x7fdc200fc1f0 msgr2=0x7fdc201051e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:37.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:37.185+0000 7fdc27414700 1 -- 172.21.15.83:0/1252089232 shutdown_connections 2024-04-01T06:54:37.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:37.185+0000 7fdc27414700 1 -- 172.21.15.83:0/1252089232 wait complete. 2024-04-01T06:54:37.188 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-04-01T06:54:37.197 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":220,"stamp":"2024-04-01T06:54:35.714578+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594290,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":142,"num_read_kb":125,"num_write":275,"num_write_kb":2967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":220,"ondisk_log_size":220,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":242,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":359040,"kb_used_data":10220,"kb_used_omap":18,"kb_used_meta":348653,"kb_avail":1124582784,"statfs":{"total":1151940427776,"available":1151572770816,"internally_reserved":0,"allocated":10465280,"data_stored":6678986,"data_compressed":107118,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19130,"internal_metadata":357020998},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3922,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":94,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.737443"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.479985+0000","last_change":"2024-04-01T06:54:28.426588+0000","last_active":"2024-04-01T06:54:30.479985+0000","last_peered":"2024-04-01T06:54:30.479985+0000","last_clean":"2024-04-01T06:54:30.479985+0000","last_became_active":"2024-04-01T06:54:28.423723+0000","last_became_peered":"2024-04-01T06:54:28.423723+0000","last_unstale":"2024-04-01T06:54:30.479985+0000","last_undegraded":"2024-04-01T06:54:30.479985+0000","last_fullsized":"2024-04-01T06:54:30.479985+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:52:38.856474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358294+0000","last_change":"2024-04-01T06:54:28.419858+0000","last_active":"2024-04-01T06:54:30.358294+0000","last_peered":"2024-04-01T06:54:30.358294+0000","last_clean":"2024-04-01T06:54:30.358294+0000","last_became_active":"2024-04-01T06:54:28.419534+0000","last_became_peered":"2024-04-01T06:54:28.419534+0000","last_unstale":"2024-04-01T06:54:30.358294+0000","last_undegraded":"2024-04-01T06:54:30.358294+0000","last_fullsized":"2024-04-01T06:54:30.358294+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:26:56.349672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.357923+0000","last_change":"2024-04-01T06:54:28.422763+0000","last_active":"2024-04-01T06:54:30.357923+0000","last_peered":"2024-04-01T06:54:30.357923+0000","last_clean":"2024-04-01T06:54:30.357923+0000","last_became_active":"2024-04-01T06:54:28.422439+0000","last_became_peered":"2024-04-01T06:54:28.422439+0000","last_unstale":"2024-04-01T06:54:30.357923+0000","last_undegraded":"2024-04-01T06:54:30.357923+0000","last_fullsized":"2024-04-01T06:54:30.357923+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:55:24.379428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358669+0000","last_change":"2024-04-01T06:54:28.421996+0000","last_active":"2024-04-01T06:54:30.358669+0000","last_peered":"2024-04-01T06:54:30.358669+0000","last_clean":"2024-04-01T06:54:30.358669+0000","last_became_active":"2024-04-01T06:54:28.421594+0000","last_became_peered":"2024-04-01T06:54:28.421594+0000","last_unstale":"2024-04-01T06:54:30.358669+0000","last_undegraded":"2024-04-01T06:54:30.358669+0000","last_fullsized":"2024-04-01T06:54:30.358669+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:36:53.200615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.412828+0000","last_change":"2024-04-01T06:54:28.415652+0000","last_active":"2024-04-01T06:54:29.412828+0000","last_peered":"2024-04-01T06:54:29.412828+0000","last_clean":"2024-04-01T06:54:29.412828+0000","last_became_active":"2024-04-01T06:54:28.415296+0000","last_became_peered":"2024-04-01T06:54:28.415296+0000","last_unstale":"2024-04-01T06:54:29.412828+0000","last_undegraded":"2024-04-01T06:54:29.412828+0000","last_fullsized":"2024-04-01T06:54:29.412828+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:36:36.967298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-01T06:54:28.690214+0000","last_change":"2024-04-01T06:54:28.421188+0000","last_active":"2024-04-01T06:54:28.690214+0000","last_peered":"2024-04-01T06:54:28.690214+0000","last_clean":"2024-04-01T06:54:28.690214+0000","last_became_active":"2024-04-01T06:54:28.420863+0000","last_became_peered":"2024-04-01T06:54:28.420863+0000","last_unstale":"2024-04-01T06:54:28.690214+0000","last_undegraded":"2024-04-01T06:54:28.690214+0000","last_fullsized":"2024-04-01T06:54:28.690214+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:40:38.641128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358358+0000","last_change":"2024-04-01T06:54:28.422554+0000","last_active":"2024-04-01T06:54:30.358358+0000","last_peered":"2024-04-01T06:54:30.358358+0000","last_clean":"2024-04-01T06:54:30.358358+0000","last_became_active":"2024-04-01T06:54:28.422209+0000","last_became_peered":"2024-04-01T06:54:28.422209+0000","last_unstale":"2024-04-01T06:54:30.358358+0000","last_undegraded":"2024-04-01T06:54:30.358358+0000","last_fullsized":"2024-04-01T06:54:30.358358+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T14:59:45.017681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.515266+0000","last_change":"2024-04-01T06:54:28.419291+0000","last_active":"2024-04-01T06:54:29.515266+0000","last_peered":"2024-04-01T06:54:29.515266+0000","last_clean":"2024-04-01T06:54:29.515266+0000","last_became_active":"2024-04-01T06:54:28.419013+0000","last_became_peered":"2024-04-01T06:54:28.419013+0000","last_unstale":"2024-04-01T06:54:29.515266+0000","last_undegraded":"2024-04-01T06:54:29.515266+0000","last_fullsized":"2024-04-01T06:54:29.515266+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:45:08.226568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.413505+0000","last_change":"2024-04-01T06:54:28.410264+0000","last_active":"2024-04-01T06:54:29.413505+0000","last_peered":"2024-04-01T06:54:29.413505+0000","last_clean":"2024-04-01T06:54:29.413505+0000","last_became_active":"2024-04-01T06:54:28.409959+0000","last_became_peered":"2024-04-01T06:54:28.409959+0000","last_unstale":"2024-04-01T06:54:29.413505+0000","last_undegraded":"2024-04-01T06:54:29.413505+0000","last_fullsized":"2024-04-01T06:54:29.413505+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:14:13.184396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-01T06:54:28.690280+0000","last_change":"2024-04-01T06:54:28.422115+0000","last_active":"2024-04-01T06:54:28.690280+0000","last_peered":"2024-04-01T06:54:28.690280+0000","last_clean":"2024-04-01T06:54:28.690280+0000","last_became_active":"2024-04-01T06:54:28.421629+0000","last_became_peered":"2024-04-01T06:54:28.421629+0000","last_unstale":"2024-04-01T06:54:28.690280+0000","last_undegraded":"2024-04-01T06:54:28.690280+0000","last_fullsized":"2024-04-01T06:54:28.690280+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:47:03.271557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358701+0000","last_change":"2024-04-01T06:54:28.429652+0000","last_active":"2024-04-01T06:54:30.358701+0000","last_peered":"2024-04-01T06:54:30.358701+0000","last_clean":"2024-04-01T06:54:30.358701+0000","last_became_active":"2024-04-01T06:54:28.429298+0000","last_became_peered":"2024-04-01T06:54:28.429298+0000","last_unstale":"2024-04-01T06:54:30.358701+0000","last_undegraded":"2024-04-01T06:54:30.358701+0000","last_fullsized":"2024-04-01T06:54:30.358701+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:03:16.110580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358421+0000","last_change":"2024-04-01T06:54:28.429645+0000","last_active":"2024-04-01T06:54:30.358421+0000","last_peered":"2024-04-01T06:54:30.358421+0000","last_clean":"2024-04-01T06:54:30.358421+0000","last_became_active":"2024-04-01T06:54:28.429285+0000","last_became_peered":"2024-04-01T06:54:28.429285+0000","last_unstale":"2024-04-01T06:54:30.358421+0000","last_undegraded":"2024-04-01T06:54:30.358421+0000","last_fullsized":"2024-04-01T06:54:30.358421+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:04:10.285396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.411765+0000","last_change":"2024-04-01T06:54:28.419390+0000","last_active":"2024-04-01T06:54:29.411765+0000","last_peered":"2024-04-01T06:54:29.411765+0000","last_clean":"2024-04-01T06:54:29.411765+0000","last_became_active":"2024-04-01T06:54:28.419110+0000","last_became_peered":"2024-04-01T06:54:28.419110+0000","last_unstale":"2024-04-01T06:54:29.411765+0000","last_undegraded":"2024-04-01T06:54:29.411765+0000","last_fullsized":"2024-04-01T06:54:29.411765+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:21:52.192681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.357608+0000","last_change":"2024-04-01T06:54:28.419416+0000","last_active":"2024-04-01T06:54:30.357608+0000","last_peered":"2024-04-01T06:54:30.357608+0000","last_clean":"2024-04-01T06:54:30.357608+0000","last_became_active":"2024-04-01T06:54:28.419099+0000","last_became_peered":"2024-04-01T06:54:28.419099+0000","last_unstale":"2024-04-01T06:54:30.357608+0000","last_undegraded":"2024-04-01T06:54:30.357608+0000","last_fullsized":"2024-04-01T06:54:30.357608+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:26:44.889806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.357586+0000","last_change":"2024-04-01T06:54:28.427391+0000","last_active":"2024-04-01T06:54:30.357586+0000","last_peered":"2024-04-01T06:54:30.357586+0000","last_clean":"2024-04-01T06:54:30.357586+0000","last_became_active":"2024-04-01T06:54:28.427153+0000","last_became_peered":"2024-04-01T06:54:28.427153+0000","last_unstale":"2024-04-01T06:54:30.357586+0000","last_undegraded":"2024-04-01T06:54:30.357586+0000","last_fullsized":"2024-04-01T06:54:30.357586+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:42:41.084729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.413106+0000","last_change":"2024-04-01T06:54:28.417088+0000","last_active":"2024-04-01T06:54:29.413106+0000","last_peered":"2024-04-01T06:54:29.413106+0000","last_clean":"2024-04-01T06:54:29.413106+0000","last_became_active":"2024-04-01T06:54:28.416747+0000","last_became_peered":"2024-04-01T06:54:28.416747+0000","last_unstale":"2024-04-01T06:54:29.413106+0000","last_undegraded":"2024-04-01T06:54:29.413106+0000","last_fullsized":"2024-04-01T06:54:29.413106+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:59:14.069761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.480070+0000","last_change":"2024-04-01T06:54:28.426049+0000","last_active":"2024-04-01T06:54:30.480070+0000","last_peered":"2024-04-01T06:54:30.480070+0000","last_clean":"2024-04-01T06:54:30.480070+0000","last_became_active":"2024-04-01T06:54:28.425723+0000","last_became_peered":"2024-04-01T06:54:28.425723+0000","last_unstale":"2024-04-01T06:54:30.480070+0000","last_undegraded":"2024-04-01T06:54:30.480070+0000","last_fullsized":"2024-04-01T06:54:30.480070+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:48:59.394352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.357884+0000","last_change":"2024-04-01T06:54:28.421574+0000","last_active":"2024-04-01T06:54:30.357884+0000","last_peered":"2024-04-01T06:54:30.357884+0000","last_clean":"2024-04-01T06:54:30.357884+0000","last_became_active":"2024-04-01T06:54:28.420852+0000","last_became_peered":"2024-04-01T06:54:28.420852+0000","last_unstale":"2024-04-01T06:54:30.357884+0000","last_undegraded":"2024-04-01T06:54:30.357884+0000","last_fullsized":"2024-04-01T06:54:30.357884+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:20:30.373285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358552+0000","last_change":"2024-04-01T06:54:28.419249+0000","last_active":"2024-04-01T06:54:30.358552+0000","last_peered":"2024-04-01T06:54:30.358552+0000","last_clean":"2024-04-01T06:54:30.358552+0000","last_became_active":"2024-04-01T06:54:28.418931+0000","last_became_peered":"2024-04-01T06:54:28.418931+0000","last_unstale":"2024-04-01T06:54:30.358552+0000","last_undegraded":"2024-04-01T06:54:30.358552+0000","last_fullsized":"2024-04-01T06:54:30.358552+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:38:04.786657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"78'4","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358045+0000","last_change":"2024-04-01T06:54:27.993489+0000","last_active":"2024-04-01T06:54:30.358045+0000","last_peered":"2024-04-01T06:54:30.358045+0000","last_clean":"2024-04-01T06:54:30.358045+0000","last_became_active":"2024-04-01T06:54:27.993201+0000","last_became_peered":"2024-04-01T06:54:27.993201+0000","last_unstale":"2024-04-01T06:54:30.358045+0000","last_undegraded":"2024-04-01T06:54:30.358045+0000","last_fullsized":"2024-04-01T06:54:30.358045+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:10:53.897013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.515446+0000","last_change":"2024-04-01T06:54:28.417750+0000","last_active":"2024-04-01T06:54:29.515446+0000","last_peered":"2024-04-01T06:54:29.515446+0000","last_clean":"2024-04-01T06:54:29.515446+0000","last_became_active":"2024-04-01T06:54:28.417470+0000","last_became_peered":"2024-04-01T06:54:28.417470+0000","last_unstale":"2024-04-01T06:54:29.515446+0000","last_undegraded":"2024-04-01T06:54:29.515446+0000","last_fullsized":"2024-04-01T06:54:29.515446+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:06:12.668846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"79'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.515595+0000","last_change":"2024-04-01T06:54:27.998302+0000","last_active":"2024-04-01T06:54:29.515595+0000","last_peered":"2024-04-01T06:54:29.515595+0000","last_clean":"2024-04-01T06:54:29.515595+0000","last_became_active":"2024-04-01T06:54:27.997951+0000","last_became_peered":"2024-04-01T06:54:27.997951+0000","last_unstale":"2024-04-01T06:54:29.515595+0000","last_undegraded":"2024-04-01T06:54:29.515595+0000","last_fullsized":"2024-04-01T06:54:29.515595+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:28:45.076734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358361+0000","last_change":"2024-04-01T06:54:28.415641+0000","last_active":"2024-04-01T06:54:30.358361+0000","last_peered":"2024-04-01T06:54:30.358361+0000","last_clean":"2024-04-01T06:54:30.358361+0000","last_became_active":"2024-04-01T06:54:28.415305+0000","last_became_peered":"2024-04-01T06:54:28.415305+0000","last_unstale":"2024-04-01T06:54:30.358361+0000","last_undegraded":"2024-04-01T06:54:30.358361+0000","last_fullsized":"2024-04-01T06:54:30.358361+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:01:46.528332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"79'4","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:32.707231+0000","last_change":"2024-04-01T06:54:27.990581+0000","last_active":"2024-04-01T06:54:32.707231+0000","last_peered":"2024-04-01T06:54:32.707231+0000","last_clean":"2024-04-01T06:54:32.707231+0000","last_became_active":"2024-04-01T06:54:27.990099+0000","last_became_peered":"2024-04-01T06:54:27.990099+0000","last_unstale":"2024-04-01T06:54:32.707231+0000","last_undegraded":"2024-04-01T06:54:32.707231+0000","last_fullsized":"2024-04-01T06:54:32.707231+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T14:53:49.183394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.413310+0000","last_change":"2024-04-01T06:54:28.423208+0000","last_active":"2024-04-01T06:54:29.413310+0000","last_peered":"2024-04-01T06:54:29.413310+0000","last_clean":"2024-04-01T06:54:29.413310+0000","last_became_active":"2024-04-01T06:54:28.422648+0000","last_became_peered":"2024-04-01T06:54:28.422648+0000","last_unstale":"2024-04-01T06:54:29.413310+0000","last_undegraded":"2024-04-01T06:54:29.413310+0000","last_fullsized":"2024-04-01T06:54:29.413310+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:02:58.380288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.413114+0000","last_change":"2024-04-01T06:54:27.995776+0000","last_active":"2024-04-01T06:54:29.413114+0000","last_peered":"2024-04-01T06:54:29.413114+0000","last_clean":"2024-04-01T06:54:29.413114+0000","last_became_active":"2024-04-01T06:54:27.995417+0000","last_became_peered":"2024-04-01T06:54:27.995417+0000","last_unstale":"2024-04-01T06:54:29.413114+0000","last_undegraded":"2024-04-01T06:54:29.413114+0000","last_fullsized":"2024-04-01T06:54:29.413114+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:46:36.694460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.214258+0000","last_change":"2024-04-01T06:54:28.422448+0000","last_active":"2024-04-01T06:54:30.214258+0000","last_peered":"2024-04-01T06:54:30.214258+0000","last_clean":"2024-04-01T06:54:30.214258+0000","last_became_active":"2024-04-01T06:54:28.422080+0000","last_became_peered":"2024-04-01T06:54:28.422080+0000","last_unstale":"2024-04-01T06:54:30.214258+0000","last_undegraded":"2024-04-01T06:54:30.214258+0000","last_fullsized":"2024-04-01T06:54:30.214258+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:03:23.686194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"79'5","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:31.701348+0000","last_change":"2024-04-01T06:54:27.998822+0000","last_active":"2024-04-01T06:54:31.701348+0000","last_peered":"2024-04-01T06:54:31.701348+0000","last_clean":"2024-04-01T06:54:31.701348+0000","last_became_active":"2024-04-01T06:54:27.998514+0000","last_became_peered":"2024-04-01T06:54:27.998514+0000","last_unstale":"2024-04-01T06:54:31.701348+0000","last_undegraded":"2024-04-01T06:54:31.701348+0000","last_fullsized":"2024-04-01T06:54:31.701348+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T14:21:28.340169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.412849+0000","last_change":"2024-04-01T06:54:28.415825+0000","last_active":"2024-04-01T06:54:29.412849+0000","last_peered":"2024-04-01T06:54:29.412849+0000","last_clean":"2024-04-01T06:54:29.412849+0000","last_became_active":"2024-04-01T06:54:28.413679+0000","last_became_peered":"2024-04-01T06:54:28.413679+0000","last_unstale":"2024-04-01T06:54:29.412849+0000","last_undegraded":"2024-04-01T06:54:29.412849+0000","last_fullsized":"2024-04-01T06:54:29.412849+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:13:19.907109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"79'3","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:32.708798+0000","last_change":"2024-04-01T06:54:27.994194+0000","last_active":"2024-04-01T06:54:32.708798+0000","last_peered":"2024-04-01T06:54:32.708798+0000","last_clean":"2024-04-01T06:54:32.708798+0000","last_became_active":"2024-04-01T06:54:27.993868+0000","last_became_peered":"2024-04-01T06:54:27.993868+0000","last_unstale":"2024-04-01T06:54:32.708798+0000","last_undegraded":"2024-04-01T06:54:32.708798+0000","last_fullsized":"2024-04-01T06:54:32.708798+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:55:17.003472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.214120+0000","last_change":"2024-04-01T06:54:28.412629+0000","last_active":"2024-04-01T06:54:30.214120+0000","last_peered":"2024-04-01T06:54:30.214120+0000","last_clean":"2024-04-01T06:54:30.214120+0000","last_became_active":"2024-04-01T06:54:28.412291+0000","last_became_peered":"2024-04-01T06:54:28.412291+0000","last_unstale":"2024-04-01T06:54:30.214120+0000","last_undegraded":"2024-04-01T06:54:30.214120+0000","last_fullsized":"2024-04-01T06:54:30.214120+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:29:14.007470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"79'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:32.708507+0000","last_change":"2024-04-01T06:54:27.996570+0000","last_active":"2024-04-01T06:54:32.708507+0000","last_peered":"2024-04-01T06:54:32.708507+0000","last_clean":"2024-04-01T06:54:32.708507+0000","last_became_active":"2024-04-01T06:54:27.994897+0000","last_became_peered":"2024-04-01T06:54:27.994897+0000","last_unstale":"2024-04-01T06:54:32.708507+0000","last_undegraded":"2024-04-01T06:54:32.708507+0000","last_fullsized":"2024-04-01T06:54:32.708507+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:53:05.733608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.515225+0000","last_change":"2024-04-01T06:54:28.413701+0000","last_active":"2024-04-01T06:54:29.515225+0000","last_peered":"2024-04-01T06:54:29.515225+0000","last_clean":"2024-04-01T06:54:29.515225+0000","last_became_active":"2024-04-01T06:54:28.413435+0000","last_became_peered":"2024-04-01T06:54:28.413435+0000","last_unstale":"2024-04-01T06:54:29.515225+0000","last_undegraded":"2024-04-01T06:54:29.515225+0000","last_fullsized":"2024-04-01T06:54:29.515225+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:43:27.835398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'1","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.213830+0000","last_change":"2024-04-01T06:54:28.001115+0000","last_active":"2024-04-01T06:54:30.213830+0000","last_peered":"2024-04-01T06:54:30.213830+0000","last_clean":"2024-04-01T06:54:30.213830+0000","last_became_active":"2024-04-01T06:54:28.000732+0000","last_became_peered":"2024-04-01T06:54:28.000732+0000","last_unstale":"2024-04-01T06:54:30.213830+0000","last_undegraded":"2024-04-01T06:54:30.213830+0000","last_fullsized":"2024-04-01T06:54:30.213830+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:06:02.064402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358103+0000","last_change":"2024-04-01T06:54:28.421670+0000","last_active":"2024-04-01T06:54:30.358103+0000","last_peered":"2024-04-01T06:54:30.358103+0000","last_clean":"2024-04-01T06:54:30.358103+0000","last_became_active":"2024-04-01T06:54:28.421335+0000","last_became_peered":"2024-04-01T06:54:28.421335+0000","last_unstale":"2024-04-01T06:54:30.358103+0000","last_undegraded":"2024-04-01T06:54:30.358103+0000","last_fullsized":"2024-04-01T06:54:30.358103+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:25:55.223397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"79'3","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:31.699724+0000","last_change":"2024-04-01T06:54:27.999413+0000","last_active":"2024-04-01T06:54:31.699724+0000","last_peered":"2024-04-01T06:54:31.699724+0000","last_clean":"2024-04-01T06:54:31.699724+0000","last_became_active":"2024-04-01T06:54:27.999123+0000","last_became_peered":"2024-04-01T06:54:27.999123+0000","last_unstale":"2024-04-01T06:54:31.699724+0000","last_undegraded":"2024-04-01T06:54:31.699724+0000","last_fullsized":"2024-04-01T06:54:31.699724+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:30:06.399907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.413618+0000","last_change":"2024-04-01T06:54:28.423843+0000","last_active":"2024-04-01T06:54:29.413618+0000","last_peered":"2024-04-01T06:54:29.413618+0000","last_clean":"2024-04-01T06:54:29.413618+0000","last_became_active":"2024-04-01T06:54:28.423538+0000","last_became_peered":"2024-04-01T06:54:28.423538+0000","last_unstale":"2024-04-01T06:54:29.413618+0000","last_undegraded":"2024-04-01T06:54:29.413618+0000","last_fullsized":"2024-04-01T06:54:29.413618+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:51:23.986409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:31.700817+0000","last_change":"2024-04-01T06:54:27.997137+0000","last_active":"2024-04-01T06:54:31.700817+0000","last_peered":"2024-04-01T06:54:31.700817+0000","last_clean":"2024-04-01T06:54:31.700817+0000","last_became_active":"2024-04-01T06:54:27.996386+0000","last_became_peered":"2024-04-01T06:54:27.996386+0000","last_unstale":"2024-04-01T06:54:31.700817+0000","last_undegraded":"2024-04-01T06:54:31.700817+0000","last_fullsized":"2024-04-01T06:54:31.700817+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:29:57.365756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358233+0000","last_change":"2024-04-01T06:54:28.426837+0000","last_active":"2024-04-01T06:54:30.358233+0000","last_peered":"2024-04-01T06:54:30.358233+0000","last_clean":"2024-04-01T06:54:30.358233+0000","last_became_active":"2024-04-01T06:54:28.426551+0000","last_became_peered":"2024-04-01T06:54:28.426551+0000","last_unstale":"2024-04-01T06:54:30.358233+0000","last_undegraded":"2024-04-01T06:54:30.358233+0000","last_fullsized":"2024-04-01T06:54:30.358233+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:05:50.264912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'4","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.214333+0000","last_change":"2024-04-01T06:54:27.999968+0000","last_active":"2024-04-01T06:54:30.214333+0000","last_peered":"2024-04-01T06:54:30.214333+0000","last_clean":"2024-04-01T06:54:30.214333+0000","last_became_active":"2024-04-01T06:54:27.999415+0000","last_became_peered":"2024-04-01T06:54:27.999415+0000","last_unstale":"2024-04-01T06:54:30.214333+0000","last_undegraded":"2024-04-01T06:54:30.214333+0000","last_fullsized":"2024-04-01T06:54:30.214333+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:31:57.472227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.413424+0000","last_change":"2024-04-01T06:54:28.421174+0000","last_active":"2024-04-01T06:54:29.413424+0000","last_peered":"2024-04-01T06:54:29.413424+0000","last_clean":"2024-04-01T06:54:29.413424+0000","last_became_active":"2024-04-01T06:54:28.420841+0000","last_became_peered":"2024-04-01T06:54:28.420841+0000","last_unstale":"2024-04-01T06:54:29.413424+0000","last_undegraded":"2024-04-01T06:54:29.413424+0000","last_fullsized":"2024-04-01T06:54:29.413424+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:05:25.377496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"79'8","reported_seq":20,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:31.697634+0000","last_change":"2024-04-01T06:54:27.995496+0000","last_active":"2024-04-01T06:54:31.697634+0000","last_peered":"2024-04-01T06:54:31.697634+0000","last_clean":"2024-04-01T06:54:31.697634+0000","last_became_active":"2024-04-01T06:54:27.995131+0000","last_became_peered":"2024-04-01T06:54:27.995131+0000","last_unstale":"2024-04-01T06:54:31.697634+0000","last_undegraded":"2024-04-01T06:54:31.697634+0000","last_fullsized":"2024-04-01T06:54:31.697634+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:36:12.129235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.413022+0000","last_change":"2024-04-01T06:54:28.427835+0000","last_active":"2024-04-01T06:54:29.413022+0000","last_peered":"2024-04-01T06:54:29.413022+0000","last_clean":"2024-04-01T06:54:29.413022+0000","last_became_active":"2024-04-01T06:54:28.426956+0000","last_became_peered":"2024-04-01T06:54:28.426956+0000","last_unstale":"2024-04-01T06:54:29.413022+0000","last_undegraded":"2024-04-01T06:54:29.413022+0000","last_fullsized":"2024-04-01T06:54:29.413022+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:41:17.334977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'4","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:31.698104+0000","last_change":"2024-04-01T06:54:27.992756+0000","last_active":"2024-04-01T06:54:31.698104+0000","last_peered":"2024-04-01T06:54:31.698104+0000","last_clean":"2024-04-01T06:54:31.698104+0000","last_became_active":"2024-04-01T06:54:27.992403+0000","last_became_peered":"2024-04-01T06:54:27.992403+0000","last_unstale":"2024-04-01T06:54:31.698104+0000","last_undegraded":"2024-04-01T06:54:31.698104+0000","last_fullsized":"2024-04-01T06:54:31.698104+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:40:33.458435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.411545+0000","last_change":"2024-04-01T06:54:28.416750+0000","last_active":"2024-04-01T06:54:29.411545+0000","last_peered":"2024-04-01T06:54:29.411545+0000","last_clean":"2024-04-01T06:54:29.411545+0000","last_became_active":"2024-04-01T06:54:28.416417+0000","last_became_peered":"2024-04-01T06:54:28.416417+0000","last_unstale":"2024-04-01T06:54:29.411545+0000","last_undegraded":"2024-04-01T06:54:29.411545+0000","last_fullsized":"2024-04-01T06:54:29.411545+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:04:41.698842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'3","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:31.701032+0000","last_change":"2024-04-01T06:54:28.001450+0000","last_active":"2024-04-01T06:54:31.701032+0000","last_peered":"2024-04-01T06:54:31.701032+0000","last_clean":"2024-04-01T06:54:31.701032+0000","last_became_active":"2024-04-01T06:54:28.001165+0000","last_became_peered":"2024-04-01T06:54:28.001165+0000","last_unstale":"2024-04-01T06:54:31.701032+0000","last_undegraded":"2024-04-01T06:54:31.701032+0000","last_fullsized":"2024-04-01T06:54:31.701032+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:20:03.876123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358814+0000","last_change":"2024-04-01T06:54:28.421097+0000","last_active":"2024-04-01T06:54:30.358814+0000","last_peered":"2024-04-01T06:54:30.358814+0000","last_clean":"2024-04-01T06:54:30.358814+0000","last_became_active":"2024-04-01T06:54:28.420781+0000","last_became_peered":"2024-04-01T06:54:28.420781+0000","last_unstale":"2024-04-01T06:54:30.358814+0000","last_undegraded":"2024-04-01T06:54:30.358814+0000","last_fullsized":"2024-04-01T06:54:30.358814+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:11:47.192742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358021+0000","last_change":"2024-04-01T06:54:27.993832+0000","last_active":"2024-04-01T06:54:30.358021+0000","last_peered":"2024-04-01T06:54:30.358021+0000","last_clean":"2024-04-01T06:54:30.358021+0000","last_became_active":"2024-04-01T06:54:27.993423+0000","last_became_peered":"2024-04-01T06:54:27.993423+0000","last_unstale":"2024-04-01T06:54:30.358021+0000","last_undegraded":"2024-04-01T06:54:30.358021+0000","last_fullsized":"2024-04-01T06:54:30.358021+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:58:37.542214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358345+0000","last_change":"2024-04-01T06:54:28.423352+0000","last_active":"2024-04-01T06:54:30.358345+0000","last_peered":"2024-04-01T06:54:30.358345+0000","last_clean":"2024-04-01T06:54:30.358345+0000","last_became_active":"2024-04-01T06:54:28.423049+0000","last_became_peered":"2024-04-01T06:54:28.423049+0000","last_unstale":"2024-04-01T06:54:30.358345+0000","last_undegraded":"2024-04-01T06:54:30.358345+0000","last_fullsized":"2024-04-01T06:54:30.358345+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:07:34.963189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'15","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:32.711057+0000","last_change":"2024-04-01T06:54:27.990469+0000","last_active":"2024-04-01T06:54:32.711057+0000","last_peered":"2024-04-01T06:54:32.711057+0000","last_clean":"2024-04-01T06:54:32.711057+0000","last_became_active":"2024-04-01T06:54:27.990147+0000","last_became_peered":"2024-04-01T06:54:27.990147+0000","last_unstale":"2024-04-01T06:54:32.711057+0000","last_undegraded":"2024-04-01T06:54:32.711057+0000","last_fullsized":"2024-04-01T06:54:32.711057+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:27:29.415723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.214102+0000","last_change":"2024-04-01T06:54:28.422479+0000","last_active":"2024-04-01T06:54:30.214102+0000","last_peered":"2024-04-01T06:54:30.214102+0000","last_clean":"2024-04-01T06:54:30.214102+0000","last_became_active":"2024-04-01T06:54:28.422155+0000","last_became_peered":"2024-04-01T06:54:28.422155+0000","last_unstale":"2024-04-01T06:54:30.214102+0000","last_undegraded":"2024-04-01T06:54:30.214102+0000","last_fullsized":"2024-04-01T06:54:30.214102+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:44:19.545796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"78'1","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.676983+0000","last_change":"2024-04-01T06:54:27.995827+0000","last_active":"2024-04-01T06:54:29.676983+0000","last_peered":"2024-04-01T06:54:29.676983+0000","last_clean":"2024-04-01T06:54:29.676983+0000","last_became_active":"2024-04-01T06:54:27.995450+0000","last_became_peered":"2024-04-01T06:54:27.995450+0000","last_unstale":"2024-04-01T06:54:29.676983+0000","last_undegraded":"2024-04-01T06:54:29.676983+0000","last_fullsized":"2024-04-01T06:54:29.676983+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T14:14:03.935578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.479897+0000","last_change":"2024-04-01T06:54:28.425376+0000","last_active":"2024-04-01T06:54:30.479897+0000","last_peered":"2024-04-01T06:54:30.479897+0000","last_clean":"2024-04-01T06:54:30.479897+0000","last_became_active":"2024-04-01T06:54:28.421235+0000","last_became_peered":"2024-04-01T06:54:28.421235+0000","last_unstale":"2024-04-01T06:54:30.479897+0000","last_undegraded":"2024-04-01T06:54:30.479897+0000","last_fullsized":"2024-04-01T06:54:30.479897+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:19:05.244735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.357821+0000","last_change":"2024-04-01T06:54:27.991659+0000","last_active":"2024-04-01T06:54:30.357821+0000","last_peered":"2024-04-01T06:54:30.357821+0000","last_clean":"2024-04-01T06:54:30.357821+0000","last_became_active":"2024-04-01T06:54:27.991280+0000","last_became_peered":"2024-04-01T06:54:27.991280+0000","last_unstale":"2024-04-01T06:54:30.357821+0000","last_undegraded":"2024-04-01T06:54:30.357821+0000","last_fullsized":"2024-04-01T06:54:30.357821+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:29:38.560570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-01T06:54:28.690268+0000","last_change":"2024-04-01T06:54:28.417654+0000","last_active":"2024-04-01T06:54:28.690268+0000","last_peered":"2024-04-01T06:54:28.690268+0000","last_clean":"2024-04-01T06:54:28.690268+0000","last_became_active":"2024-04-01T06:54:28.417318+0000","last_became_peered":"2024-04-01T06:54:28.417318+0000","last_unstale":"2024-04-01T06:54:28.690268+0000","last_undegraded":"2024-04-01T06:54:28.690268+0000","last_fullsized":"2024-04-01T06:54:28.690268+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:59:25.843730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358892+0000","last_change":"2024-04-01T06:54:27.998825+0000","last_active":"2024-04-01T06:54:30.358892+0000","last_peered":"2024-04-01T06:54:30.358892+0000","last_clean":"2024-04-01T06:54:30.358892+0000","last_became_active":"2024-04-01T06:54:27.998488+0000","last_became_peered":"2024-04-01T06:54:27.998488+0000","last_unstale":"2024-04-01T06:54:30.358892+0000","last_undegraded":"2024-04-01T06:54:30.358892+0000","last_fullsized":"2024-04-01T06:54:30.358892+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:22:24.878723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-01T06:54:28.690226+0000","last_change":"2024-04-01T06:54:28.421053+0000","last_active":"2024-04-01T06:54:28.690226+0000","last_peered":"2024-04-01T06:54:28.690226+0000","last_clean":"2024-04-01T06:54:28.690226+0000","last_became_active":"2024-04-01T06:54:28.420718+0000","last_became_peered":"2024-04-01T06:54:28.420718+0000","last_unstale":"2024-04-01T06:54:28.690226+0000","last_undegraded":"2024-04-01T06:54:28.690226+0000","last_fullsized":"2024-04-01T06:54:28.690226+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:58:10.109158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.214303+0000","last_change":"2024-04-01T06:54:28.419126+0000","last_active":"2024-04-01T06:54:30.214303+0000","last_peered":"2024-04-01T06:54:30.214303+0000","last_clean":"2024-04-01T06:54:30.214303+0000","last_became_active":"2024-04-01T06:54:28.418217+0000","last_became_peered":"2024-04-01T06:54:28.418217+0000","last_unstale":"2024-04-01T06:54:30.214303+0000","last_undegraded":"2024-04-01T06:54:30.214303+0000","last_fullsized":"2024-04-01T06:54:30.214303+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T14:02:41.148200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"79'4","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:32.710991+0000","last_change":"2024-04-01T06:54:27.993059+0000","last_active":"2024-04-01T06:54:32.710991+0000","last_peered":"2024-04-01T06:54:32.710991+0000","last_clean":"2024-04-01T06:54:32.710991+0000","last_became_active":"2024-04-01T06:54:27.992471+0000","last_became_peered":"2024-04-01T06:54:27.992471+0000","last_unstale":"2024-04-01T06:54:32.710991+0000","last_undegraded":"2024-04-01T06:54:32.710991+0000","last_fullsized":"2024-04-01T06:54:32.710991+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:27:38.691261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.515528+0000","last_change":"2024-04-01T06:54:28.411805+0000","last_active":"2024-04-01T06:54:29.515528+0000","last_peered":"2024-04-01T06:54:29.515528+0000","last_clean":"2024-04-01T06:54:29.515528+0000","last_became_active":"2024-04-01T06:54:28.411526+0000","last_became_peered":"2024-04-01T06:54:28.411526+0000","last_unstale":"2024-04-01T06:54:29.515528+0000","last_undegraded":"2024-04-01T06:54:29.515528+0000","last_fullsized":"2024-04-01T06:54:29.515528+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:59:08.223590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358605+0000","last_change":"2024-04-01T06:54:27.988695+0000","last_active":"2024-04-01T06:54:30.358605+0000","last_peered":"2024-04-01T06:54:30.358605+0000","last_clean":"2024-04-01T06:54:30.358605+0000","last_became_active":"2024-04-01T06:54:27.988069+0000","last_became_peered":"2024-04-01T06:54:27.988069+0000","last_unstale":"2024-04-01T06:54:30.358605+0000","last_undegraded":"2024-04-01T06:54:30.358605+0000","last_fullsized":"2024-04-01T06:54:30.358605+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:27:11.287962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":329,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-01T06:54:28.415048+0000","last_change":"2024-04-01T06:53:41.678430+0000","last_active":"2024-04-01T06:54:28.415048+0000","last_peered":"2024-04-01T06:54:28.415048+0000","last_clean":"2024-04-01T06:54:28.415048+0000","last_became_active":"2024-04-01T06:53:41.677964+0000","last_became_peered":"2024-04-01T06:53:41.677964+0000","last_unstale":"2024-04-01T06:54:28.415048+0000","last_undegraded":"2024-04-01T06:54:28.415048+0000","last_fullsized":"2024-04-01T06:54:28.415048+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:51:21.964420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:51:21.964420+0000","last_clean_scrub_stamp":"2024-04-01T06:51:21.964420+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:24:29.916692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.411404+0000","last_change":"2024-04-01T06:54:28.423775+0000","last_active":"2024-04-01T06:54:29.411404+0000","last_peered":"2024-04-01T06:54:29.411404+0000","last_clean":"2024-04-01T06:54:29.411404+0000","last_became_active":"2024-04-01T06:54:28.423462+0000","last_became_peered":"2024-04-01T06:54:28.423462+0000","last_unstale":"2024-04-01T06:54:29.411404+0000","last_undegraded":"2024-04-01T06:54:29.411404+0000","last_fullsized":"2024-04-01T06:54:29.411404+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:09:38.043033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"79'1","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:31.700850+0000","last_change":"2024-04-01T06:54:27.997801+0000","last_active":"2024-04-01T06:54:31.700850+0000","last_peered":"2024-04-01T06:54:31.700850+0000","last_clean":"2024-04-01T06:54:31.700850+0000","last_became_active":"2024-04-01T06:54:27.997305+0000","last_became_peered":"2024-04-01T06:54:27.997305+0000","last_unstale":"2024-04-01T06:54:31.700850+0000","last_undegraded":"2024-04-01T06:54:31.700850+0000","last_fullsized":"2024-04-01T06:54:31.700850+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:46:09.224535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"79'1","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:31.698306+0000","last_change":"2024-04-01T06:54:27.994483+0000","last_active":"2024-04-01T06:54:31.698306+0000","last_peered":"2024-04-01T06:54:31.698306+0000","last_clean":"2024-04-01T06:54:31.698306+0000","last_became_active":"2024-04-01T06:54:27.994093+0000","last_became_peered":"2024-04-01T06:54:27.994093+0000","last_unstale":"2024-04-01T06:54:31.698306+0000","last_undegraded":"2024-04-01T06:54:31.698306+0000","last_fullsized":"2024-04-01T06:54:31.698306+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:27:48.272196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.411547+0000","last_change":"2024-04-01T06:54:28.423895+0000","last_active":"2024-04-01T06:54:29.411547+0000","last_peered":"2024-04-01T06:54:29.411547+0000","last_clean":"2024-04-01T06:54:29.411547+0000","last_became_active":"2024-04-01T06:54:28.423593+0000","last_became_peered":"2024-04-01T06:54:28.423593+0000","last_unstale":"2024-04-01T06:54:29.411547+0000","last_undegraded":"2024-04-01T06:54:29.411547+0000","last_fullsized":"2024-04-01T06:54:29.411547+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:09:30.414080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.357814+0000","last_change":"2024-04-01T06:54:27.987207+0000","last_active":"2024-04-01T06:54:30.357814+0000","last_peered":"2024-04-01T06:54:30.357814+0000","last_clean":"2024-04-01T06:54:30.357814+0000","last_became_active":"2024-04-01T06:54:27.986537+0000","last_became_peered":"2024-04-01T06:54:27.986537+0000","last_unstale":"2024-04-01T06:54:30.357814+0000","last_undegraded":"2024-04-01T06:54:30.357814+0000","last_fullsized":"2024-04-01T06:54:30.357814+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:26:41.096843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.515518+0000","last_change":"2024-04-01T06:54:28.416591+0000","last_active":"2024-04-01T06:54:29.515518+0000","last_peered":"2024-04-01T06:54:29.515518+0000","last_clean":"2024-04-01T06:54:29.515518+0000","last_became_active":"2024-04-01T06:54:28.416295+0000","last_became_peered":"2024-04-01T06:54:28.416295+0000","last_unstale":"2024-04-01T06:54:29.515518+0000","last_undegraded":"2024-04-01T06:54:29.515518+0000","last_fullsized":"2024-04-01T06:54:29.515518+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:17:24.670572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"78'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358370+0000","last_change":"2024-04-01T06:54:27.996075+0000","last_active":"2024-04-01T06:54:30.358370+0000","last_peered":"2024-04-01T06:54:30.358370+0000","last_clean":"2024-04-01T06:54:30.358370+0000","last_became_active":"2024-04-01T06:54:27.995664+0000","last_became_peered":"2024-04-01T06:54:27.995664+0000","last_unstale":"2024-04-01T06:54:30.358370+0000","last_undegraded":"2024-04-01T06:54:30.358370+0000","last_fullsized":"2024-04-01T06:54:30.358370+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:17:33.214644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358295+0000","last_change":"2024-04-01T06:54:28.422041+0000","last_active":"2024-04-01T06:54:30.358295+0000","last_peered":"2024-04-01T06:54:30.358295+0000","last_clean":"2024-04-01T06:54:30.358295+0000","last_became_active":"2024-04-01T06:54:28.421743+0000","last_became_peered":"2024-04-01T06:54:28.421743+0000","last_unstale":"2024-04-01T06:54:30.358295+0000","last_undegraded":"2024-04-01T06:54:30.358295+0000","last_fullsized":"2024-04-01T06:54:30.358295+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:23:14.405879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:31.701969+0000","last_change":"2024-04-01T06:54:27.991734+0000","last_active":"2024-04-01T06:54:31.701969+0000","last_peered":"2024-04-01T06:54:31.701969+0000","last_clean":"2024-04-01T06:54:31.701969+0000","last_became_active":"2024-04-01T06:54:27.991139+0000","last_became_peered":"2024-04-01T06:54:27.991139+0000","last_unstale":"2024-04-01T06:54:31.701969+0000","last_undegraded":"2024-04-01T06:54:31.701969+0000","last_fullsized":"2024-04-01T06:54:31.701969+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:08:49.188179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.412717+0000","last_change":"2024-04-01T06:54:28.428467+0000","last_active":"2024-04-01T06:54:29.412717+0000","last_peered":"2024-04-01T06:54:29.412717+0000","last_clean":"2024-04-01T06:54:29.412717+0000","last_became_active":"2024-04-01T06:54:28.428095+0000","last_became_peered":"2024-04-01T06:54:28.428095+0000","last_unstale":"2024-04-01T06:54:29.412717+0000","last_undegraded":"2024-04-01T06:54:29.412717+0000","last_fullsized":"2024-04-01T06:54:29.412717+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:21:04.500427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'3","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:31.699951+0000","last_change":"2024-04-01T06:54:27.990321+0000","last_active":"2024-04-01T06:54:31.699951+0000","last_peered":"2024-04-01T06:54:31.699951+0000","last_clean":"2024-04-01T06:54:31.699951+0000","last_became_active":"2024-04-01T06:54:27.989997+0000","last_became_peered":"2024-04-01T06:54:27.989997+0000","last_unstale":"2024-04-01T06:54:31.699951+0000","last_undegraded":"2024-04-01T06:54:31.699951+0000","last_fullsized":"2024-04-01T06:54:31.699951+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:14:04.059812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.479669+0000","last_change":"2024-04-01T06:54:28.416480+0000","last_active":"2024-04-01T06:54:30.479669+0000","last_peered":"2024-04-01T06:54:30.479669+0000","last_clean":"2024-04-01T06:54:30.479669+0000","last_became_active":"2024-04-01T06:54:28.416009+0000","last_became_peered":"2024-04-01T06:54:28.416009+0000","last_unstale":"2024-04-01T06:54:30.479669+0000","last_undegraded":"2024-04-01T06:54:30.479669+0000","last_fullsized":"2024-04-01T06:54:30.479669+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:32:09.759447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358211+0000","last_change":"2024-04-01T06:54:27.996538+0000","last_active":"2024-04-01T06:54:30.358211+0000","last_peered":"2024-04-01T06:54:30.358211+0000","last_clean":"2024-04-01T06:54:30.358211+0000","last_became_active":"2024-04-01T06:54:27.996177+0000","last_became_peered":"2024-04-01T06:54:27.996177+0000","last_unstale":"2024-04-01T06:54:30.358211+0000","last_undegraded":"2024-04-01T06:54:30.358211+0000","last_fullsized":"2024-04-01T06:54:30.358211+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:39:45.386450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.515616+0000","last_change":"2024-04-01T06:54:28.419403+0000","last_active":"2024-04-01T06:54:29.515616+0000","last_peered":"2024-04-01T06:54:29.515616+0000","last_clean":"2024-04-01T06:54:29.515616+0000","last_became_active":"2024-04-01T06:54:28.419127+0000","last_became_peered":"2024-04-01T06:54:28.419127+0000","last_unstale":"2024-04-01T06:54:29.515616+0000","last_undegraded":"2024-04-01T06:54:29.515616+0000","last_fullsized":"2024-04-01T06:54:29.515616+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:52:13.510448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:31.698144+0000","last_change":"2024-04-01T06:54:27.992775+0000","last_active":"2024-04-01T06:54:31.698144+0000","last_peered":"2024-04-01T06:54:31.698144+0000","last_clean":"2024-04-01T06:54:31.698144+0000","last_became_active":"2024-04-01T06:54:27.992356+0000","last_became_peered":"2024-04-01T06:54:27.992356+0000","last_unstale":"2024-04-01T06:54:31.698144+0000","last_undegraded":"2024-04-01T06:54:31.698144+0000","last_fullsized":"2024-04-01T06:54:31.698144+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T14:46:37.302172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358992+0000","last_change":"2024-04-01T06:54:28.430132+0000","last_active":"2024-04-01T06:54:30.358992+0000","last_peered":"2024-04-01T06:54:30.358992+0000","last_clean":"2024-04-01T06:54:30.358992+0000","last_became_active":"2024-04-01T06:54:28.429816+0000","last_became_peered":"2024-04-01T06:54:28.429816+0000","last_unstale":"2024-04-01T06:54:30.358992+0000","last_undegraded":"2024-04-01T06:54:30.358992+0000","last_fullsized":"2024-04-01T06:54:30.358992+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T14:49:58.661275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358540+0000","last_change":"2024-04-01T06:54:27.999460+0000","last_active":"2024-04-01T06:54:30.358540+0000","last_peered":"2024-04-01T06:54:30.358540+0000","last_clean":"2024-04-01T06:54:30.358540+0000","last_became_active":"2024-04-01T06:54:27.999128+0000","last_became_peered":"2024-04-01T06:54:27.999128+0000","last_unstale":"2024-04-01T06:54:30.358540+0000","last_undegraded":"2024-04-01T06:54:30.358540+0000","last_fullsized":"2024-04-01T06:54:30.358540+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:19:24.285698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358852+0000","last_change":"2024-04-01T06:54:28.427720+0000","last_active":"2024-04-01T06:54:30.358852+0000","last_peered":"2024-04-01T06:54:30.358852+0000","last_clean":"2024-04-01T06:54:30.358852+0000","last_became_active":"2024-04-01T06:54:28.427357+0000","last_became_peered":"2024-04-01T06:54:28.427357+0000","last_unstale":"2024-04-01T06:54:30.358852+0000","last_undegraded":"2024-04-01T06:54:30.358852+0000","last_fullsized":"2024-04-01T06:54:30.358852+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:20:56.631811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-01T06:54:28.437747+0000","last_change":"2024-04-01T06:54:27.997806+0000","last_active":"2024-04-01T06:54:28.437747+0000","last_peered":"2024-04-01T06:54:28.437747+0000","last_clean":"2024-04-01T06:54:28.437747+0000","last_became_active":"2024-04-01T06:54:27.997490+0000","last_became_peered":"2024-04-01T06:54:27.997490+0000","last_unstale":"2024-04-01T06:54:28.437747+0000","last_undegraded":"2024-04-01T06:54:28.437747+0000","last_fullsized":"2024-04-01T06:54:28.437747+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:06:15.099390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358856+0000","last_change":"2024-04-01T06:54:28.419639+0000","last_active":"2024-04-01T06:54:30.358856+0000","last_peered":"2024-04-01T06:54:30.358856+0000","last_clean":"2024-04-01T06:54:30.358856+0000","last_became_active":"2024-04-01T06:54:28.418081+0000","last_became_peered":"2024-04-01T06:54:28.418081+0000","last_unstale":"2024-04-01T06:54:30.358856+0000","last_undegraded":"2024-04-01T06:54:30.358856+0000","last_fullsized":"2024-04-01T06:54:30.358856+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:15:44.753121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.411587+0000","last_change":"2024-04-01T06:54:27.995854+0000","last_active":"2024-04-01T06:54:29.411587+0000","last_peered":"2024-04-01T06:54:29.411587+0000","last_clean":"2024-04-01T06:54:29.411587+0000","last_became_active":"2024-04-01T06:54:27.995540+0000","last_became_peered":"2024-04-01T06:54:27.995540+0000","last_unstale":"2024-04-01T06:54:29.411587+0000","last_undegraded":"2024-04-01T06:54:29.411587+0000","last_fullsized":"2024-04-01T06:54:29.411587+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:47:15.075909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358991+0000","last_change":"2024-04-01T06:54:28.428100+0000","last_active":"2024-04-01T06:54:30.358991+0000","last_peered":"2024-04-01T06:54:30.358991+0000","last_clean":"2024-04-01T06:54:30.358991+0000","last_became_active":"2024-04-01T06:54:28.427769+0000","last_became_peered":"2024-04-01T06:54:28.427769+0000","last_unstale":"2024-04-01T06:54:30.358991+0000","last_undegraded":"2024-04-01T06:54:30.358991+0000","last_fullsized":"2024-04-01T06:54:30.358991+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:47:18.161878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.479810+0000","last_change":"2024-04-01T06:54:28.427557+0000","last_active":"2024-04-01T06:54:30.479810+0000","last_peered":"2024-04-01T06:54:30.479810+0000","last_clean":"2024-04-01T06:54:30.479810+0000","last_became_active":"2024-04-01T06:54:28.427209+0000","last_became_peered":"2024-04-01T06:54:28.427209+0000","last_unstale":"2024-04-01T06:54:30.479810+0000","last_undegraded":"2024-04-01T06:54:30.479810+0000","last_fullsized":"2024-04-01T06:54:30.479810+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:10:06.835360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358390+0000","last_change":"2024-04-01T06:54:28.423264+0000","last_active":"2024-04-01T06:54:30.358390+0000","last_peered":"2024-04-01T06:54:30.358390+0000","last_clean":"2024-04-01T06:54:30.358390+0000","last_became_active":"2024-04-01T06:54:28.422868+0000","last_became_peered":"2024-04-01T06:54:28.422868+0000","last_unstale":"2024-04-01T06:54:30.358390+0000","last_undegraded":"2024-04-01T06:54:30.358390+0000","last_fullsized":"2024-04-01T06:54:30.358390+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:00:49.784276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358186+0000","last_change":"2024-04-01T06:54:28.417824+0000","last_active":"2024-04-01T06:54:30.358186+0000","last_peered":"2024-04-01T06:54:30.358186+0000","last_clean":"2024-04-01T06:54:30.358186+0000","last_became_active":"2024-04-01T06:54:28.417510+0000","last_became_peered":"2024-04-01T06:54:28.417510+0000","last_unstale":"2024-04-01T06:54:30.358186+0000","last_undegraded":"2024-04-01T06:54:30.358186+0000","last_fullsized":"2024-04-01T06:54:30.358186+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:40:52.024183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358330+0000","last_change":"2024-04-01T06:54:28.426099+0000","last_active":"2024-04-01T06:54:30.358330+0000","last_peered":"2024-04-01T06:54:30.358330+0000","last_clean":"2024-04-01T06:54:30.358330+0000","last_became_active":"2024-04-01T06:54:28.425745+0000","last_became_peered":"2024-04-01T06:54:28.425745+0000","last_unstale":"2024-04-01T06:54:30.358330+0000","last_undegraded":"2024-04-01T06:54:30.358330+0000","last_fullsized":"2024-04-01T06:54:30.358330+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:13:45.145447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.411652+0000","last_change":"2024-04-01T06:54:28.421892+0000","last_active":"2024-04-01T06:54:29.411652+0000","last_peered":"2024-04-01T06:54:29.411652+0000","last_clean":"2024-04-01T06:54:29.411652+0000","last_became_active":"2024-04-01T06:54:28.421582+0000","last_became_peered":"2024-04-01T06:54:28.421582+0000","last_unstale":"2024-04-01T06:54:29.411652+0000","last_undegraded":"2024-04-01T06:54:29.411652+0000","last_fullsized":"2024-04-01T06:54:29.411652+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:44:12.137335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.479910+0000","last_change":"2024-04-01T06:54:28.421013+0000","last_active":"2024-04-01T06:54:30.479910+0000","last_peered":"2024-04-01T06:54:30.479910+0000","last_clean":"2024-04-01T06:54:30.479910+0000","last_became_active":"2024-04-01T06:54:28.420339+0000","last_became_peered":"2024-04-01T06:54:28.420339+0000","last_unstale":"2024-04-01T06:54:30.479910+0000","last_undegraded":"2024-04-01T06:54:30.479910+0000","last_fullsized":"2024-04-01T06:54:30.479910+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:59:07.758542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358708+0000","last_change":"2024-04-01T06:54:28.433203+0000","last_active":"2024-04-01T06:54:30.358708+0000","last_peered":"2024-04-01T06:54:30.358708+0000","last_clean":"2024-04-01T06:54:30.358708+0000","last_became_active":"2024-04-01T06:54:28.431890+0000","last_became_peered":"2024-04-01T06:54:28.431890+0000","last_unstale":"2024-04-01T06:54:30.358708+0000","last_undegraded":"2024-04-01T06:54:30.358708+0000","last_fullsized":"2024-04-01T06:54:30.358708+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:55:33.169722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.515418+0000","last_change":"2024-04-01T06:54:28.418425+0000","last_active":"2024-04-01T06:54:29.515418+0000","last_peered":"2024-04-01T06:54:29.515418+0000","last_clean":"2024-04-01T06:54:29.515418+0000","last_became_active":"2024-04-01T06:54:28.418165+0000","last_became_peered":"2024-04-01T06:54:28.418165+0000","last_unstale":"2024-04-01T06:54:29.515418+0000","last_undegraded":"2024-04-01T06:54:29.515418+0000","last_fullsized":"2024-04-01T06:54:29.515418+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:45:01.425680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.213976+0000","last_change":"2024-04-01T06:54:28.412058+0000","last_active":"2024-04-01T06:54:30.213976+0000","last_peered":"2024-04-01T06:54:30.213976+0000","last_clean":"2024-04-01T06:54:30.213976+0000","last_became_active":"2024-04-01T06:54:28.411680+0000","last_became_peered":"2024-04-01T06:54:28.411680+0000","last_unstale":"2024-04-01T06:54:30.213976+0000","last_undegraded":"2024-04-01T06:54:30.213976+0000","last_fullsized":"2024-04-01T06:54:30.213976+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:21:05.628262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.515699+0000","last_change":"2024-04-01T06:54:28.422304+0000","last_active":"2024-04-01T06:54:29.515699+0000","last_peered":"2024-04-01T06:54:29.515699+0000","last_clean":"2024-04-01T06:54:29.515699+0000","last_became_active":"2024-04-01T06:54:28.422023+0000","last_became_peered":"2024-04-01T06:54:28.422023+0000","last_unstale":"2024-04-01T06:54:29.515699+0000","last_undegraded":"2024-04-01T06:54:29.515699+0000","last_fullsized":"2024-04-01T06:54:29.515699+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:26:45.810780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.413317+0000","last_change":"2024-04-01T06:54:28.420350+0000","last_active":"2024-04-01T06:54:29.413317+0000","last_peered":"2024-04-01T06:54:29.413317+0000","last_clean":"2024-04-01T06:54:29.413317+0000","last_became_active":"2024-04-01T06:54:28.419995+0000","last_became_peered":"2024-04-01T06:54:28.419995+0000","last_unstale":"2024-04-01T06:54:29.413317+0000","last_undegraded":"2024-04-01T06:54:29.413317+0000","last_fullsized":"2024-04-01T06:54:29.413317+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:30:20.831966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.411779+0000","last_change":"2024-04-01T06:54:28.417067+0000","last_active":"2024-04-01T06:54:29.411779+0000","last_peered":"2024-04-01T06:54:29.411779+0000","last_clean":"2024-04-01T06:54:29.411779+0000","last_became_active":"2024-04-01T06:54:28.416796+0000","last_became_peered":"2024-04-01T06:54:28.416796+0000","last_unstale":"2024-04-01T06:54:29.411779+0000","last_undegraded":"2024-04-01T06:54:29.411779+0000","last_fullsized":"2024-04-01T06:54:29.411779+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:39:43.396643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.479743+0000","last_change":"2024-04-01T06:54:28.424971+0000","last_active":"2024-04-01T06:54:30.479743+0000","last_peered":"2024-04-01T06:54:30.479743+0000","last_clean":"2024-04-01T06:54:30.479743+0000","last_became_active":"2024-04-01T06:54:28.424664+0000","last_became_peered":"2024-04-01T06:54:28.424664+0000","last_unstale":"2024-04-01T06:54:30.479743+0000","last_undegraded":"2024-04-01T06:54:30.479743+0000","last_fullsized":"2024-04-01T06:54:30.479743+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:03:51.434412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":246668,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3922,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":94,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200704,"data_stored":31109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579913,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":847872,"data_stored":408370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]}]},{"osd":10,"up_from":67,"seq":287762808845,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":942080,"data_stored":1001832,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]}]},{"osd":9,"up_from":62,"seq":266287972369,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31948,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713204,"statfs":{"total":95995035648,"available":95962320896,"internally_reserved":0,"allocated":851968,"data_stored":408952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:54:22 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.27700000000000002}]},{"osd":1,"last update":"Mon Apr 1 06:54:22 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.56799999999999995}]},{"osd":2,"last update":"Mon Apr 1 06:54:22 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.47699999999999998}]},{"osd":3,"last update":"Mon Apr 1 06:54:22 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.316},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.42299999999999999}]},{"osd":4,"last update":"Mon Apr 1 06:54:22 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.57999999999999996}]},{"osd":5,"last update":"Mon Apr 1 06:54:22 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":0.39600000000000002}]},{"osd":6,"last update":"Mon Apr 1 06:54:22 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.504},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.434}]},{"osd":7,"last update":"Mon Apr 1 06:54:22 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.59099999999999997}]},{"osd":8,"last update":"Mon Apr 1 06:54:22 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":5.6600000000000001,"5min":5.6600000000000001,"15min":5.6600000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":5.6070000000000002,"5min":5.6070000000000002,"15min":5.6070000000000002},"last":0.51600000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]}]},{"osd":8,"up_from":55,"seq":236223201301,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31956,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713196,"statfs":{"total":95995035648,"available":95962312704,"internally_reserved":0,"allocated":864256,"data_stored":408777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:54:05 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.65600000000000003}]},{"osd":1,"last update":"Mon Apr 1 06:54:05 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.82999999999999996}]},{"osd":2,"last update":"Mon Apr 1 06:54:05 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.629},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.60899999999999999}]},{"osd":3,"last update":"Mon Apr 1 06:54:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.749},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.76500000000000001}]},{"osd":4,"last update":"Mon Apr 1 06:54:05 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.81899999999999995}]},{"osd":5,"last update":"Mon Apr 1 06:54:05 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.79700000000000004}]},{"osd":6,"last update":"Mon Apr 1 06:54:05 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.89300000000000002}]},{"osd":7,"last update":"Mon Apr 1 06:54:05 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.90400000000000003}]},{"osd":9,"last update":"Mon Apr 1 06:54:24 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.98499999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]}]},{"osd":7,"up_from":48,"seq":206158430230,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31996,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713156,"statfs":{"total":95995035648,"available":95962271744,"internally_reserved":0,"allocated":901120,"data_stored":999320,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:53:48 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.41099999999999998}]},{"osd":1,"last update":"Mon Apr 1 06:53:48 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.46000000000000002}]},{"osd":2,"last update":"Mon Apr 1 06:53:48 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.501},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.67500000000000004}]},{"osd":3,"last update":"Mon Apr 1 06:53:48 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.65900000000000003}]},{"osd":4,"last update":"Mon Apr 1 06:53:48 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.63900000000000001}]},{"osd":5,"last update":"Mon Apr 1 06:53:48 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.62}]},{"osd":6,"last update":"Mon Apr 1 06:53:48 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.71699999999999997}]},{"osd":8,"last update":"Mon Apr 1 06:54:04 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.70399999999999996}]},{"osd":9,"last update":"Mon Apr 1 06:54:24 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.79800000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]}]},{"osd":6,"up_from":43,"seq":184683593755,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":851968,"data_stored":408460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:53:32 2024","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.39100000000000001}]},{"osd":1,"last update":"Mon Apr 1 06:53:32 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.55100000000000005}]},{"osd":2,"last update":"Mon Apr 1 06:53:32 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.88100000000000001}]},{"osd":3,"last update":"Mon Apr 1 06:53:32 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.48399999999999999}]},{"osd":4,"last update":"Mon Apr 1 06:53:32 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.626}]},{"osd":5,"last update":"Mon Apr 1 06:53:32 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.66600000000000004}]},{"osd":7,"last update":"Mon Apr 1 06:53:48 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.82399999999999995}]},{"osd":8,"last update":"Mon Apr 1 06:54:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.80600000000000005}]},{"osd":9,"last update":"Mon Apr 1 06:54:26 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.60699999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574893,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31956,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713196,"statfs":{"total":95995035648,"available":95962312704,"internally_reserved":0,"allocated":864256,"data_stored":416536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:54:16 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.48499999999999999,"15min":0.46600000000000003},"min":{"1min":0.32800000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.501,"15min":0.48099999999999998},"min":{"1min":0.35499999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.45300000000000001}]},{"osd":2,"last update":"Mon Apr 1 06:54:28 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.55300000000000005,"15min":0.53800000000000003},"min":{"1min":0.42899999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.53600000000000003,"15min":0.52200000000000002},"min":{"1min":0.38800000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.42899999999999999}]},{"osd":3,"last update":"Mon Apr 1 06:53:42 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.54100000000000004,"15min":0.53100000000000003},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.55400000000000005,"15min":0.54000000000000004},"min":{"1min":0.40799999999999997,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.58799999999999997}]},{"osd":4,"last update":"Mon Apr 1 06:54:02 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.41399999999999998,"15min":0.40200000000000002},"min":{"1min":0.28999999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.501,"5min":0.42099999999999999,"15min":0.40699999999999997},"min":{"1min":0.33000000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.60499999999999998}]},{"osd":5,"last update":"Mon Apr 1 06:54:16 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.58899999999999997,"15min":0.58499999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.56799999999999995,"15min":0.56000000000000005},"min":{"1min":0.44600000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.57599999999999996}]},{"osd":6,"last update":"Mon Apr 1 06:54:33 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.56999999999999995,"15min":0.55100000000000005},"min":{"1min":0.47099999999999997,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.58499999999999996,"15min":0.56799999999999995},"min":{"1min":0.51500000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.66800000000000004}]},{"osd":7,"last update":"Mon Apr 1 06:53:46 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.754},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.74099999999999999}]},{"osd":8,"last update":"Mon Apr 1 06:54:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.80700000000000005}]},{"osd":9,"last update":"Mon Apr 1 06:54:25 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.78900000000000003}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]}]},{"osd":0,"up_from":8,"seq":34359738416,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":851968,"data_stored":408460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Apr 1 06:54:08 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.47899999999999998,"15min":0.46500000000000002},"min":{"1min":0.29299999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69099999999999995,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.379},{"interface":"front","average":{"1min":0.495,"5min":0.47299999999999998,"15min":0.46999999999999997},"min":{"1min":0.32800000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.64800000000000002,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.36199999999999999}]},{"osd":2,"last update":"Mon Apr 1 06:54:28 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.47799999999999998,"15min":0.46400000000000002},"min":{"1min":0.317,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.66900000000000004,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.317},{"interface":"front","average":{"1min":0.5,"5min":0.48599999999999999,"15min":0.47999999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.64200000000000002,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.30599999999999999}]},{"osd":3,"last update":"Mon Apr 1 06:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.26200000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.59399999999999997,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.38900000000000001,"15min":0.379},"min":{"1min":0.29699999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.64200000000000002,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.33500000000000002}]},{"osd":4,"last update":"Mon Apr 1 06:54:03 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.50600000000000001,"15min":0.5},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.51300000000000001,"15min":0.50900000000000001},"min":{"1min":0.40400000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.435}]},{"osd":5,"last update":"Mon Apr 1 06:54:15 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53300000000000003,"15min":0.52900000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52400000000000002,"15min":0.52500000000000002},"min":{"1min":0.38700000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.747,"5min":0.748,"15min":0.748},"last":0.66200000000000003}]},{"osd":6,"last update":"Mon Apr 1 06:53:33 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.51700000000000002}]},{"osd":7,"last update":"Mon Apr 1 06:53:50 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.46000000000000002}]},{"osd":8,"last update":"Mon Apr 1 06:54:08 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.70199999999999996}]},{"osd":9,"last update":"Mon Apr 1 06:54:21 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.61599999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]},{"osd":2,"up_from":18,"seq":77309411369,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":864256,"data_stored":409968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:54:27 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.48399999999999999,"15min":0.46700000000000003},"min":{"1min":0.33900000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.65600000000000003,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.498},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.46899999999999997,"15min":0.45700000000000002},"min":{"1min":0.35799999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.65600000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.51500000000000001}]},{"osd":1,"last update":"Mon Apr 1 06:54:27 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.52300000000000002,"15min":0.51300000000000001},"min":{"1min":0.42499999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.53900000000000003,"15min":0.53500000000000003},"min":{"1min":0.39800000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.40699999999999997}]},{"osd":3,"last update":"Mon Apr 1 06:53:43 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53100000000000003,"15min":0.52700000000000002},"min":{"1min":0.39100000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.55400000000000005,"15min":0.54400000000000004},"min":{"1min":0.38700000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.57999999999999996}]},{"osd":4,"last update":"Mon Apr 1 06:53:59 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.54300000000000004,"15min":0.53700000000000003},"min":{"1min":0.42299999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.53400000000000003,"15min":0.52700000000000002},"min":{"1min":0.45900000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71699999999999997,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.69399999999999995}]},{"osd":5,"last update":"Mon Apr 1 06:54:15 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.45500000000000002,"15min":0.44900000000000001},"min":{"1min":0.317,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.74199999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.46300000000000002,"15min":0.45900000000000002},"min":{"1min":0.32600000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.68999999999999995,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.66500000000000004}]},{"osd":6,"last update":"Mon Apr 1 06:53:32 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.79400000000000004}]},{"osd":7,"last update":"Mon Apr 1 06:53:49 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.60099999999999998}]},{"osd":8,"last update":"Mon Apr 1 06:54:04 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.56499999999999995}]},{"osd":9,"last update":"Mon Apr 1 06:54:24 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.88400000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]}]},{"osd":3,"up_from":25,"seq":107374182437,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31952,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713200,"statfs":{"total":95995035648,"available":95962316800,"internally_reserved":0,"allocated":860160,"data_stored":408323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:53:40 2024","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.32800000000000001,"15min":0.32600000000000001},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.48599999999999999,"5min":0.496,"15min":0.496},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.33500000000000002,"15min":0.33100000000000002},"min":{"1min":0.24399999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.58199999999999996,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.379}]},{"osd":1,"last update":"Mon Apr 1 06:53:40 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.51400000000000001,"15min":0.51100000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.502,"15min":0.495},"min":{"1min":0.38400000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.48199999999999998}]},{"osd":2,"last update":"Mon Apr 1 06:53:40 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.51400000000000001,"15min":0.51100000000000001},"min":{"1min":0.32600000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.746,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52800000000000002,"15min":0.52600000000000002},"min":{"1min":0.374,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.70999999999999996}]},{"osd":4,"last update":"Mon Apr 1 06:53:56 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.53500000000000003,"15min":0.52500000000000002},"min":{"1min":0.38200000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.56599999999999995,"15min":0.55700000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.34599999999999997}]},{"osd":5,"last update":"Mon Apr 1 06:54:16 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.51500000000000001,"15min":0.50900000000000001},"min":{"1min":0.40699999999999997,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.56000000000000005,"15min":0.55200000000000005},"min":{"1min":0.39800000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73199999999999998,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.61899999999999999}]},{"osd":6,"last update":"Mon Apr 1 06:53:34 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.40600000000000003}]},{"osd":7,"last update":"Mon Apr 1 06:53:52 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.67200000000000004}]},{"osd":8,"last update":"Mon Apr 1 06:54:04 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.71999999999999997}]},{"osd":9,"last update":"Mon Apr 1 06:54:23 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.42099999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]}]},{"osd":4,"up_from":32,"seq":137438953506,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":839680,"data_stored":399822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:54:02 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.496,"15min":0.48799999999999999},"min":{"1min":0.34899999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.433},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.48299999999999998,"15min":0.47699999999999998},"min":{"1min":0.30399999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.41799999999999998}]},{"osd":1,"last update":"Mon Apr 1 06:54:02 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.33300000000000002,"15min":0.32800000000000001},"min":{"1min":0.27200000000000002,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.53600000000000003,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.376,"5min":0.35199999999999998,"15min":0.34799999999999998},"min":{"1min":0.26500000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.52400000000000002,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.50600000000000001}]},{"osd":2,"last update":"Mon Apr 1 06:54:02 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.49199999999999999,"15min":0.48999999999999999},"min":{"1min":0.39900000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.64100000000000001,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.48899999999999999,"15min":0.47899999999999998},"min":{"1min":0.40799999999999997,"5min":0.316,"15min":0.316},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.67800000000000005}]},{"osd":3,"last update":"Mon Apr 1 06:54:02 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.53100000000000003,"15min":0.52800000000000002},"min":{"1min":0.35099999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.69299999999999995,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.497,"15min":0.49299999999999999},"min":{"1min":0.40400000000000003,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.69299999999999995,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.61699999999999999}]},{"osd":5,"last update":"Mon Apr 1 06:54:15 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.55000000000000004,"15min":0.54500000000000004},"min":{"1min":0.40300000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.54000000000000004,"15min":0.54400000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.624,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.60399999999999998}]},{"osd":6,"last update":"Mon Apr 1 06:53:33 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":2.52,"5min":2.52,"15min":2.52},"last":0.81399999999999995}]},{"osd":7,"last update":"Mon Apr 1 06:53:48 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.66100000000000003}]},{"osd":8,"last update":"Mon Apr 1 06:54:05 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.86099999999999999}]},{"osd":9,"last update":"Mon Apr 1 06:54:21 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.83999999999999997}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]}]},{"osd":5,"up_from":36,"seq":154618822687,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":925696,"data_stored":1000166,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:54:13 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.496,"15min":0.48299999999999998},"min":{"1min":0.41299999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.498,"15min":0.49299999999999999},"min":{"1min":0.39800000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.55700000000000005}]},{"osd":1,"last update":"Mon Apr 1 06:54:13 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.53000000000000003,"15min":0.52400000000000002},"min":{"1min":0.42599999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.69899999999999995,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53200000000000003,"15min":0.52700000000000002},"min":{"1min":0.40799999999999997,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.73199999999999998,"5min":0.753,"15min":0.753},"last":0.73599999999999999}]},{"osd":2,"last update":"Mon Apr 1 06:54:13 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.38600000000000001,"15min":0.38400000000000001},"min":{"1min":0.28899999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39900000000000002,"15min":0.40000000000000002},"min":{"1min":0.29399999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.48699999999999999}]},{"osd":3,"last update":"Mon Apr 1 06:54:13 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.39800000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.83899999999999997,"5min":1.389,"15min":1.389},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.65900000000000003,"15min":0.67500000000000004},"min":{"1min":0.38500000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.73799999999999999,"5min":3.9540000000000002,"15min":3.9540000000000002},"last":0.64900000000000002}]},{"osd":4,"last update":"Mon Apr 1 06:54:13 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.55200000000000005,"15min":0.54600000000000004},"min":{"1min":0.46400000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.70699999999999996,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.75700000000000001,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.70899999999999996}]},{"osd":6,"last update":"Mon Apr 1 06:53:31 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.753},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.57799999999999996}]},{"osd":7,"last update":"Mon Apr 1 06:53:48 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.72199999999999998}]},{"osd":8,"last update":"Mon Apr 1 06:54:04 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.82499999999999996}]},{"osd":9,"last update":"Mon Apr 1 06:54:22 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.76400000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34069,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34069,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":20849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T06:54:37.203 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-01T06:54:37.203 INFO:tasks.cephadm:Setting up client nodes... 2024-04-01T06:54:37.203 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-04-01T06:54:37.454 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:54:37.899 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:37 smithi083 ceph-mon[43429]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T06:54:38.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:37 smithi145 ceph-mon[47816]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T06:54:38.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:37 smithi153 ceph-mon[48187]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T06:54:38.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:38.458+0000 7f2d6d096700 1 -- 172.21.15.83:0/3489717147 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d68100de0 msgr2=0x7f2d68101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:38.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:38.458+0000 7f2d6d096700 1 --2- 172.21.15.83:0/3489717147 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d68100de0 0x7f2d68101200 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c0099c0 tx=0x7f2d5c009cd0 comp rx=0 tx=0).stop 2024-04-01T06:54:38.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:38.458+0000 7f2d6d096700 1 -- 172.21.15.83:0/3489717147 shutdown_connections 2024-04-01T06:54:38.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:38.458+0000 7f2d6d096700 1 --2- 172.21.15.83:0/3489717147 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d68100de0 0x7f2d68101200 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:38.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:38.458+0000 7f2d6d096700 1 --2- 172.21.15.83:0/3489717147 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d68102980 0x7f2d68109230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:38.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:38.458+0000 7f2d6d096700 1 --2- 172.21.15.83:0/3489717147 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2d68101fe0 0x7f2d68102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:38.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:38.458+0000 7f2d6d096700 1 -- 172.21.15.83:0/3489717147 >> 172.21.15.83:0/3489717147 conn(0x7f2d680fc3c0 msgr2=0x7f2d680fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:38.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:38.458+0000 7f2d6d096700 1 -- 172.21.15.83:0/3489717147 shutdown_connections 2024-04-01T06:54:38.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:38.458+0000 7f2d6d096700 1 -- 172.21.15.83:0/3489717147 wait complete. 2024-04-01T06:54:38.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:38.459+0000 7f2d6d096700 1 Processor -- start 2024-04-01T06:54:38.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:38.459+0000 7f2d6d096700 1 -- start start 2024-04-01T06:54:38.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:38.459+0000 7f2d6d096700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d68100de0 0x7f2d68196d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:38.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:38.459+0000 7f2d6d096700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d68101fe0 0x7f2d681972d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:38.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:38.460+0000 7f2d6d096700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2d68102980 0x7f2d6819e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:38.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:38.460+0000 7f2d6d096700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6819e890 con 0x7f2d68101fe0 2024-04-01T06:54:38.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:38.460+0000 7f2d6d096700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6819e9d0 con 0x7f2d68102980 2024-04-01T06:54:38.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:38.460+0000 7f2d6d096700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6819eb90 con 0x7f2d68100de0 2024-04-01T06:54:38.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:38.460+0000 7f2d6659c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d68101fe0 0x7f2d681972d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:38.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:38.460+0000 7f2d6659c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d68101fe0 0x7f2d681972d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:35422/0 (socket says 172.21.15.83:35422) 2024-04-01T06:54:38.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:38.460+0000 7f2d6659c700 1 -- 172.21.15.83:0/3639630882 learned_addr learned my addr 172.21.15.83:0/3639630882 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:54:38.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:38.460+0000 7f2d6759e700 1 --2- 172.21.15.83:0/3639630882 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2d68102980 0x7f2d6819e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:38.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:38.460+0000 7f2d66d9d700 1 --2- 172.21.15.83:0/3639630882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d68100de0 0x7f2d68196d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:38.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:38.460+0000 7f2d6659c700 1 -- 172.21.15.83:0/3639630882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d68100de0 msgr2=0x7f2d68196d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:38.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:38.460+0000 7f2d6659c700 1 --2- 172.21.15.83:0/3639630882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d68100de0 0x7f2d68196d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:38.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:38.460+0000 7f2d6659c700 1 -- 172.21.15.83:0/3639630882 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2d68102980 msgr2=0x7f2d6819e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:38.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:38.460+0000 7f2d6659c700 1 --2- 172.21.15.83:0/3639630882 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2d68102980 0x7f2d6819e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:38.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:38.460+0000 7f2d6659c700 1 -- 172.21.15.83:0/3639630882 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d5c0095f0 con 0x7f2d68101fe0 2024-04-01T06:54:38.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:38.460+0000 7f2d66d9d700 1 --2- 172.21.15.83:0/3639630882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d68100de0 0x7f2d68196d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:54:38.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:38.460+0000 7f2d6759e700 1 --2- 172.21.15.83:0/3639630882 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2d68102980 0x7f2d6819e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:54:38.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:38.460+0000 7f2d6659c700 1 --2- 172.21.15.83:0/3639630882 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d68101fe0 0x7f2d681972d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2d5800b530 tx=0x7f2d5800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:38.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:38.460+0000 7f2d4ffff700 1 -- 172.21.15.83:0/3639630882 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d58011830 con 0x7f2d68101fe0 2024-04-01T06:54:38.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:38.460+0000 7f2d6d096700 1 -- 172.21.15.83:0/3639630882 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d6819ee70 con 0x7f2d68101fe0 2024-04-01T06:54:38.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:38.460+0000 7f2d4ffff700 1 -- 172.21.15.83:0/3639630882 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2d58011e50 con 0x7f2d68101fe0 2024-04-01T06:54:38.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:38.460+0000 7f2d4ffff700 1 -- 172.21.15.83:0/3639630882 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5800f2e0 con 0x7f2d68101fe0 2024-04-01T06:54:38.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:38.460+0000 7f2d6d096700 1 -- 172.21.15.83:0/3639630882 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d6819f2e0 con 0x7f2d68101fe0 2024-04-01T06:54:38.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:38.461+0000 7f2d6d096700 1 -- 172.21.15.83:0/3639630882 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d68108330 con 0x7f2d68101fe0 2024-04-01T06:54:38.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:38.462+0000 7f2d4ffff700 1 -- 172.21.15.83:0/3639630882 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f2d58010580 con 0x7f2d68101fe0 2024-04-01T06:54:38.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:38.463+0000 7f2d4ffff700 1 --2- 172.21.15.83:0/3639630882 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f2d500a1230 0x7f2d500a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:38.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:38.463+0000 7f2d66d9d700 1 --2- 172.21.15.83:0/3639630882 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f2d500a1230 0x7f2d500a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:38.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:38.463+0000 7f2d4ffff700 1 -- 172.21.15.83:0/3639630882 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f2d580cc940 con 0x7f2d68101fe0 2024-04-01T06:54:38.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:38.463+0000 7f2d66d9d700 1 --2- 172.21.15.83:0/3639630882 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f2d500a1230 0x7f2d500a36f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c000c00 tx=0x7f2d5c009f10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:38.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:38.466+0000 7f2d4ffff700 1 -- 172.21.15.83:0/3639630882 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f2d58096130 con 0x7f2d68101fe0 2024-04-01T06:54:38.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:38.739+0000 7f2d6d096700 1 -- 172.21.15.83:0/3639630882 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f2d6804ea80 con 0x7f2d68101fe0 2024-04-01T06:54:38.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:38.743+0000 7f2d4ffff700 1 -- 172.21.15.83:0/3639630882 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v31) v1 ==== 170+0+59 (secure 0 0 0) 0x7f2d58015050 con 0x7f2d68101fe0 2024-04-01T06:54:38.743 INFO:teuthology.orchestra.run.smithi083.stdout:[client.0] 2024-04-01T06:54:38.743 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQAuWgpmxW0rLBAARf5gAiOPeyHkV0aU+J7BDA== 2024-04-01T06:54:38.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:38.745+0000 7f2d6d096700 1 -- 172.21.15.83:0/3639630882 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f2d500a1230 msgr2=0x7f2d500a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:38.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:38.745+0000 7f2d6d096700 1 --2- 172.21.15.83:0/3639630882 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f2d500a1230 0x7f2d500a36f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c000c00 tx=0x7f2d5c009f10 comp rx=0 tx=0).stop 2024-04-01T06:54:38.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:38.745+0000 7f2d6d096700 1 -- 172.21.15.83:0/3639630882 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d68101fe0 msgr2=0x7f2d681972d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:38.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:38.745+0000 7f2d6d096700 1 --2- 172.21.15.83:0/3639630882 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d68101fe0 0x7f2d681972d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2d5800b530 tx=0x7f2d5800b8f0 comp rx=0 tx=0).stop 2024-04-01T06:54:38.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:38.746+0000 7f2d6d096700 1 -- 172.21.15.83:0/3639630882 shutdown_connections 2024-04-01T06:54:38.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:38.746+0000 7f2d6d096700 1 --2- 172.21.15.83:0/3639630882 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f2d500a1230 0x7f2d500a36f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:38.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:38.746+0000 7f2d6d096700 1 --2- 172.21.15.83:0/3639630882 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2d68102980 0x7f2d6819e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:38.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:38.746+0000 7f2d6d096700 1 --2- 172.21.15.83:0/3639630882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d68100de0 0x7f2d68196d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:38.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:38.746+0000 7f2d6d096700 1 --2- 172.21.15.83:0/3639630882 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2d68101fe0 0x7f2d681972d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:38.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:38.746+0000 7f2d6d096700 1 -- 172.21.15.83:0/3639630882 >> 172.21.15.83:0/3639630882 conn(0x7f2d680fc3c0 msgr2=0x7f2d68105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:38.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:38.746+0000 7f2d6d096700 1 -- 172.21.15.83:0/3639630882 shutdown_connections 2024-04-01T06:54:38.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:38.746+0000 7f2d6d096700 1 -- 172.21.15.83:0/3639630882 wait complete. 2024-04-01T06:54:39.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:38 smithi145 ceph-mon[47816]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T06:54:39.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:38 smithi145 ceph-mon[47816]: pgmap v221: 97 pgs: 97 active+clean; 582 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4.3 KiB/s wr, 15 op/s 2024-04-01T06:54:39.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:38 smithi083 ceph-mon[43429]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T06:54:39.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:38 smithi083 ceph-mon[43429]: pgmap v221: 97 pgs: 97 active+clean; 582 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4.3 KiB/s wr, 15 op/s 2024-04-01T06:54:39.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:38 smithi153 ceph-mon[48187]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T06:54:39.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:38 smithi153 ceph-mon[48187]: pgmap v221: 97 pgs: 97 active+clean; 582 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 4.3 KiB/s wr, 15 op/s 2024-04-01T06:54:39.213 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-04-01T06:54:39.213 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-04-01T06:54:39.213 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-01T06:54:39.254 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-01T06:54:39.254 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-04-01T06:54:39.254 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph mgr dump --format=json 2024-04-01T06:54:39.514 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:54:39.998 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:39 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/3639630882' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-01T06:54:39.998 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:39 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/3639630882' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-01T06:54:40.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:39 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/3639630882' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-01T06:54:40.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:39 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/3639630882' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-01T06:54:40.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:39 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/3639630882' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-01T06:54:40.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:39 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/3639630882' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-01T06:54:40.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:40.532+0000 7f139032f700 1 -- 172.21.15.83:0/2263091508 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1388100920 msgr2=0x7f13881048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:40.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:40.532+0000 7f139032f700 1 --2- 172.21.15.83:0/2263091508 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1388100920 0x7f13881048d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1384009990 tx=0x7f1384009ca0 comp rx=0 tx=0).stop 2024-04-01T06:54:40.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:40.532+0000 7f139032f700 1 -- 172.21.15.83:0/2263091508 shutdown_connections 2024-04-01T06:54:40.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:40.532+0000 7f139032f700 1 --2- 172.21.15.83:0/2263091508 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1388104fb0 0x7f138810cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:40.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:40.532+0000 7f139032f700 1 --2- 172.21.15.83:0/2263091508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13880fff70 0x7f1388100350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:40.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:40.532+0000 7f139032f700 1 --2- 172.21.15.83:0/2263091508 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1388100920 0x7f13881048d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:40.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:40.532+0000 7f139032f700 1 -- 172.21.15.83:0/2263091508 >> 172.21.15.83:0/2263091508 conn(0x7f1388075d50 msgr2=0x7f1388076160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:40.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:40.532+0000 7f139032f700 1 -- 172.21.15.83:0/2263091508 shutdown_connections 2024-04-01T06:54:40.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:40.532+0000 7f139032f700 1 -- 172.21.15.83:0/2263091508 wait complete. 2024-04-01T06:54:40.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:40.532+0000 7f139032f700 1 Processor -- start 2024-04-01T06:54:40.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:40.533+0000 7f139032f700 1 -- start start 2024-04-01T06:54:40.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:40.533+0000 7f139032f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13880fff70 0x7f1388197220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:40.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:40.533+0000 7f139032f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1388100920 0x7f1388197760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:40.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:40.533+0000 7f139032f700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1388104fb0 0x7f138819bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:40.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:40.533+0000 7f139032f700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138819c0d0 con 0x7f1388100920 2024-04-01T06:54:40.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:40.533+0000 7f139032f700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138819c240 con 0x7f1388104fb0 2024-04-01T06:54:40.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:40.533+0000 7f139032f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138819c400 con 0x7f13880fff70 2024-04-01T06:54:40.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:40.533+0000 7f138d8ca700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1388100920 0x7f1388197760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:40.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:40.533+0000 7f138d8ca700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1388100920 0x7f1388197760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:35438/0 (socket says 172.21.15.83:35438) 2024-04-01T06:54:40.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:40.533+0000 7f138d8ca700 1 -- 172.21.15.83:0/3704632172 learned_addr learned my addr 172.21.15.83:0/3704632172 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:54:40.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:40.533+0000 7f138e0cb700 1 --2- 172.21.15.83:0/3704632172 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13880fff70 0x7f1388197220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:40.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:40.533+0000 7f138e8cc700 1 --2- 172.21.15.83:0/3704632172 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1388104fb0 0x7f138819bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:40.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:40.533+0000 7f138d8ca700 1 -- 172.21.15.83:0/3704632172 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13880fff70 msgr2=0x7f1388197220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:40.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:40.533+0000 7f138d8ca700 1 --2- 172.21.15.83:0/3704632172 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13880fff70 0x7f1388197220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:40.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:40.533+0000 7f138d8ca700 1 -- 172.21.15.83:0/3704632172 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1388104fb0 msgr2=0x7f138819bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:40.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:40.533+0000 7f138d8ca700 1 --2- 172.21.15.83:0/3704632172 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1388104fb0 0x7f138819bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:40.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:40.533+0000 7f138d8ca700 1 -- 172.21.15.83:0/3704632172 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13840095f0 con 0x7f1388100920 2024-04-01T06:54:40.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:40.533+0000 7f138e0cb700 1 --2- 172.21.15.83:0/3704632172 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13880fff70 0x7f1388197220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:54:40.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:40.533+0000 7f138e8cc700 1 --2- 172.21.15.83:0/3704632172 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1388104fb0 0x7f138819bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:54:40.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:40.533+0000 7f138d8ca700 1 --2- 172.21.15.83:0/3704632172 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1388100920 0x7f1388197760 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f13840098e0 tx=0x7f138400f720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:40.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:40.533+0000 7f137f7fe700 1 -- 172.21.15.83:0/3704632172 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138401d070 con 0x7f1388100920 2024-04-01T06:54:40.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:40.533+0000 7f137f7fe700 1 -- 172.21.15.83:0/3704632172 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f138400fb90 con 0x7f1388100920 2024-04-01T06:54:40.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:40.533+0000 7f139032f700 1 -- 172.21.15.83:0/3704632172 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f138819c680 con 0x7f1388100920 2024-04-01T06:54:40.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:40.534+0000 7f137f7fe700 1 -- 172.21.15.83:0/3704632172 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1384017650 con 0x7f1388100920 2024-04-01T06:54:40.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:40.534+0000 7f139032f700 1 -- 172.21.15.83:0/3704632172 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13881a3f40 con 0x7f1388100920 2024-04-01T06:54:40.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:40.535+0000 7f139032f700 1 -- 172.21.15.83:0/3704632172 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13881082d0 con 0x7f1388100920 2024-04-01T06:54:40.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:40.536+0000 7f137f7fe700 1 -- 172.21.15.83:0/3704632172 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f138400fd00 con 0x7f1388100920 2024-04-01T06:54:40.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:40.536+0000 7f137f7fe700 1 --2- 172.21.15.83:0/3704632172 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f13740a11b0 0x7f13740a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:40.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:40.536+0000 7f138e0cb700 1 --2- 172.21.15.83:0/3704632172 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f13740a11b0 0x7f13740a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:40.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:40.536+0000 7f137f7fe700 1 -- 172.21.15.83:0/3704632172 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f13840cdd50 con 0x7f1388100920 2024-04-01T06:54:40.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:40.537+0000 7f138e0cb700 1 --2- 172.21.15.83:0/3704632172 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f13740a11b0 0x7f13740a3670 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1378005950 tx=0x7f13780058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:40.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:40.540+0000 7f137f7fe700 1 -- 172.21.15.83:0/3704632172 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f13840975c0 con 0x7f1388100920 2024-04-01T06:54:40.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:40.787+0000 7f139032f700 1 -- 172.21.15.83:0/3704632172 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f138804ea80 con 0x7f1388100920 2024-04-01T06:54:40.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:40.792+0000 7f137f7fe700 1 -- 172.21.15.83:0/3704632172 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) v1 ==== 74+0+260275 (secure 0 0 0) 0x7f138409abe0 con 0x7f1388100920 2024-04-01T06:54:40.795 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:54:40.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:40.794+0000 7f139032f700 1 -- 172.21.15.83:0/3704632172 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f13740a11b0 msgr2=0x7f13740a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:40.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:40.794+0000 7f139032f700 1 --2- 172.21.15.83:0/3704632172 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f13740a11b0 0x7f13740a3670 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1378005950 tx=0x7f13780058e0 comp rx=0 tx=0).stop 2024-04-01T06:54:40.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:40.794+0000 7f139032f700 1 -- 172.21.15.83:0/3704632172 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1388100920 msgr2=0x7f1388197760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:40.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:40.794+0000 7f139032f700 1 --2- 172.21.15.83:0/3704632172 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1388100920 0x7f1388197760 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f13840098e0 tx=0x7f138400f720 comp rx=0 tx=0).stop 2024-04-01T06:54:40.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:40.795+0000 7f139032f700 1 -- 172.21.15.83:0/3704632172 shutdown_connections 2024-04-01T06:54:40.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:40.795+0000 7f139032f700 1 --2- 172.21.15.83:0/3704632172 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f13740a11b0 0x7f13740a3670 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:40.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:40.795+0000 7f139032f700 1 --2- 172.21.15.83:0/3704632172 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1388104fb0 0x7f138819bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:40.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:40.795+0000 7f139032f700 1 --2- 172.21.15.83:0/3704632172 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13880fff70 0x7f1388197220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:40.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:40.795+0000 7f139032f700 1 --2- 172.21.15.83:0/3704632172 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1388100920 0x7f1388197760 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:40.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:40.795+0000 7f139032f700 1 -- 172.21.15.83:0/3704632172 >> 172.21.15.83:0/3704632172 conn(0x7f1388075d50 msgr2=0x7f13880fde00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:40.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:40.795+0000 7f139032f700 1 -- 172.21.15.83:0/3704632172 shutdown_connections 2024-04-01T06:54:40.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:40.795+0000 7f139032f700 1 -- 172.21.15.83:0/3704632172 wait complete. 2024-04-01T06:54:41.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:40 smithi145 ceph-mon[47816]: pgmap v222: 97 pgs: 97 active+clean; 623 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 8.1 KiB/s wr, 18 op/s 2024-04-01T06:54:41.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:40 smithi083 ceph-mon[43429]: pgmap v222: 97 pgs: 97 active+clean; 623 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 8.1 KiB/s wr, 18 op/s 2024-04-01T06:54:41.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:40 smithi153 ceph-mon[48187]: pgmap v222: 97 pgs: 97 active+clean; 623 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 8.1 KiB/s wr, 18 op/s 2024-04-01T06:54:41.169 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":17,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":3375372052},{"type":"v1","addr":"172.21.15.83:6801","nonce":3375372052}]},"active_addr":"172.21.15.83:6801/3375372052","active_change":"2024-04-01T06:49:33.656232+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":24115,"name":"z","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24116,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.83:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.83:0","nonce":1365273187}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.83:0","nonce":4017737477}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.83:0","nonce":3082162092}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.83:0","nonce":3245313698}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.83:0","nonce":223927839}]}]} 2024-04-01T06:54:41.175 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-04-01T06:54:41.175 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-04-01T06:54:41.175 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph osd dump --format=json 2024-04-01T06:54:41.397 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:54:41.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:41 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/3704632172' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-01T06:54:42.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:41 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/3704632172' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-01T06:54:42.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:41 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/3704632172' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-01T06:54:42.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:42.423+0000 7f385004e700 1 -- 172.21.15.83:0/2102402015 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38480ffca0 msgr2=0x7f3848100120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:42.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:42.423+0000 7f385004e700 1 --2- 172.21.15.83:0/2102402015 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38480ffca0 0x7f3848100120 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3844009990 tx=0x7f3844009ca0 comp rx=0 tx=0).stop 2024-04-01T06:54:42.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:42.423+0000 7f385004e700 1 -- 172.21.15.83:0/2102402015 shutdown_connections 2024-04-01T06:54:42.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:42.423+0000 7f385004e700 1 --2- 172.21.15.83:0/2102402015 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3848100660 0x7f384810cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:42.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:42.423+0000 7f385004e700 1 --2- 172.21.15.83:0/2102402015 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3848105d50 0x7f3848106130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:42.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:42.423+0000 7f385004e700 1 --2- 172.21.15.83:0/2102402015 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38480ffca0 0x7f3848100120 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:42.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:42.423+0000 7f385004e700 1 -- 172.21.15.83:0/2102402015 >> 172.21.15.83:0/2102402015 conn(0x7f3848076c80 msgr2=0x7f3848077090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:42.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:42.423+0000 7f385004e700 1 -- 172.21.15.83:0/2102402015 shutdown_connections 2024-04-01T06:54:42.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:42.423+0000 7f385004e700 1 -- 172.21.15.83:0/2102402015 wait complete. 2024-04-01T06:54:42.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:42.424+0000 7f385004e700 1 Processor -- start 2024-04-01T06:54:42.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:42.424+0000 7f385004e700 1 -- start start 2024-04-01T06:54:42.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:42.424+0000 7f385004e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38480ffca0 0x7f38481970d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:42.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:42.424+0000 7f385004e700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3848100660 0x7f3848197610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:42.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:42.424+0000 7f385004e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3848105d50 0x7f384819b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:42.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:42.424+0000 7f385004e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384819bfd0 con 0x7f38480ffca0 2024-04-01T06:54:42.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:42.424+0000 7f385004e700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384819c140 con 0x7f3848100660 2024-04-01T06:54:42.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:42.424+0000 7f385004e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384819c300 con 0x7f3848105d50 2024-04-01T06:54:42.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:42.424+0000 7f384ddea700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38480ffca0 0x7f38481970d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:42.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:42.424+0000 7f384ddea700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38480ffca0 0x7f38481970d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:35458/0 (socket says 172.21.15.83:35458) 2024-04-01T06:54:42.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:42.424+0000 7f384ddea700 1 -- 172.21.15.83:0/3566425124 learned_addr learned my addr 172.21.15.83:0/3566425124 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:54:42.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:42.424+0000 7f384d5e9700 1 --2- 172.21.15.83:0/3566425124 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3848100660 0x7f3848197610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:42.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:42.424+0000 7f384e5eb700 1 --2- 172.21.15.83:0/3566425124 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3848105d50 0x7f384819b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:42.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:42.424+0000 7f384ddea700 1 -- 172.21.15.83:0/3566425124 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3848105d50 msgr2=0x7f384819b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:42.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:42.424+0000 7f384ddea700 1 --2- 172.21.15.83:0/3566425124 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3848105d50 0x7f384819b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:42.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:42.424+0000 7f384ddea700 1 -- 172.21.15.83:0/3566425124 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3848100660 msgr2=0x7f3848197610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:42.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:42.424+0000 7f384ddea700 1 --2- 172.21.15.83:0/3566425124 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3848100660 0x7f3848197610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:42.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:42.424+0000 7f384ddea700 1 -- 172.21.15.83:0/3566425124 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38440095f0 con 0x7f38480ffca0 2024-04-01T06:54:42.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:42.425+0000 7f384ddea700 1 --2- 172.21.15.83:0/3566425124 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38480ffca0 0x7f38481970d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f383c00e9a0 tx=0x7f383c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:42.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:42.425+0000 7f383affd700 1 -- 172.21.15.83:0/3566425124 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383c009790 con 0x7f38480ffca0 2024-04-01T06:54:42.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:42.425+0000 7f385004e700 1 -- 172.21.15.83:0/3566425124 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f384819c5e0 con 0x7f38480ffca0 2024-04-01T06:54:42.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:42.425+0000 7f385004e700 1 -- 172.21.15.83:0/3566425124 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38481a3e40 con 0x7f38480ffca0 2024-04-01T06:54:42.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:42.425+0000 7f383affd700 1 -- 172.21.15.83:0/3566425124 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f383c00cbd0 con 0x7f38480ffca0 2024-04-01T06:54:42.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:42.425+0000 7f383affd700 1 -- 172.21.15.83:0/3566425124 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383c018680 con 0x7f38480ffca0 2024-04-01T06:54:42.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:42.426+0000 7f385004e700 1 -- 172.21.15.83:0/3566425124 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f382c005320 con 0x7f38480ffca0 2024-04-01T06:54:42.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:42.427+0000 7f383affd700 1 -- 172.21.15.83:0/3566425124 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f383c010430 con 0x7f38480ffca0 2024-04-01T06:54:42.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:42.427+0000 7f383affd700 1 --2- 172.21.15.83:0/3566425124 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f38340a11b0 0x7f38340a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:42.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:42.428+0000 7f384d5e9700 1 --2- 172.21.15.83:0/3566425124 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f38340a11b0 0x7f38340a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:42.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:42.428+0000 7f383affd700 1 -- 172.21.15.83:0/3566425124 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f383c014070 con 0x7f38480ffca0 2024-04-01T06:54:42.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:42.428+0000 7f384d5e9700 1 --2- 172.21.15.83:0/3566425124 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f38340a11b0 0x7f38340a3670 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3844006010 tx=0x7f384400b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:42.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:42.432+0000 7f383affd700 1 -- 172.21.15.83:0/3566425124 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f383c0529f0 con 0x7f38480ffca0 2024-04-01T06:54:42.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:42.623+0000 7f385004e700 1 -- 172.21.15.83:0/3566425124 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f382c0058a0 con 0x7f38480ffca0 2024-04-01T06:54:42.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:42.625+0000 7f383affd700 1 -- 172.21.15.83:0/3566425124 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+22131 (secure 0 0 0) 0x7f383c099d90 con 0x7f38480ffca0 2024-04-01T06:54:42.625 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:54:42.625 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":79,"fsid":"c6f8eff4-eff3-11ee-b647-cb9ed24678a4","created":"2024-04-01T06:48:42.033382+0000","modified":"2024-04-01T06:54:29.399277+0000","last_up_change":"2024-04-01T06:53:55.791339+0000","last_in_change":"2024-04-01T06:53:39.777214+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T06:51:21.963996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T06:54:26.450403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T06:54:27.564928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"90b761b0-b06c-4142-854d-38ee42aa6052","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6803","nonce":3253845390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6805","nonce":3253845390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6809","nonce":3253845390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6807","nonce":3253845390}]},"public_addr":"172.21.15.83:6803/3253845390","cluster_addr":"172.21.15.83:6805/3253845390","heartbeat_back_addr":"172.21.15.83:6809/3253845390","heartbeat_front_addr":"172.21.15.83:6807/3253845390","state":["exists","up"]},{"osd":1,"uuid":"4d6ab85b-7088-451e-a829-c9119f35dee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6801","nonce":515889759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6803","nonce":515889759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6807","nonce":515889759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6805","nonce":515889759}]},"public_addr":"172.21.15.145:6801/515889759","cluster_addr":"172.21.15.145:6803/515889759","heartbeat_back_addr":"172.21.15.145:6807/515889759","heartbeat_front_addr":"172.21.15.145:6805/515889759","state":["exists","up"]},{"osd":2,"uuid":"d04c27f3-4972-4061-8bfb-5060645e3883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6801","nonce":3318516728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6803","nonce":3318516728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6807","nonce":3318516728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6805","nonce":3318516728}]},"public_addr":"172.21.15.153:6801/3318516728","cluster_addr":"172.21.15.153:6803/3318516728","heartbeat_back_addr":"172.21.15.153:6807/3318516728","heartbeat_front_addr":"172.21.15.153:6805/3318516728","state":["exists","up"]},{"osd":3,"uuid":"899b6c90-8f2f-44dd-b807-49594aadb443","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6811","nonce":504690234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6813","nonce":504690234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6817","nonce":504690234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6815","nonce":504690234}]},"public_addr":"172.21.15.83:6811/504690234","cluster_addr":"172.21.15.83:6813/504690234","heartbeat_back_addr":"172.21.15.83:6817/504690234","heartbeat_front_addr":"172.21.15.83:6815/504690234","state":["exists","up"]},{"osd":4,"uuid":"5071dd81-804e-4358-bfb6-11e718e9cf4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6809","nonce":2099824730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6811","nonce":2099824730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6815","nonce":2099824730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6813","nonce":2099824730}]},"public_addr":"172.21.15.145:6809/2099824730","cluster_addr":"172.21.15.145:6811/2099824730","heartbeat_back_addr":"172.21.15.145:6815/2099824730","heartbeat_front_addr":"172.21.15.145:6813/2099824730","state":["exists","up"]},{"osd":5,"uuid":"b8442b71-c26e-467f-b0c3-ea9f636f5a00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6809","nonce":3340941443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6811","nonce":3340941443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6815","nonce":3340941443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6813","nonce":3340941443}]},"public_addr":"172.21.15.153:6809/3340941443","cluster_addr":"172.21.15.153:6811/3340941443","heartbeat_back_addr":"172.21.15.153:6815/3340941443","heartbeat_front_addr":"172.21.15.153:6813/3340941443","state":["exists","up"]},{"osd":6,"uuid":"c26bb8cb-ccee-4bfc-91eb-14e1ad8e04df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6819","nonce":2005485079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6821","nonce":2005485079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6825","nonce":2005485079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6823","nonce":2005485079}]},"public_addr":"172.21.15.83:6819/2005485079","cluster_addr":"172.21.15.83:6821/2005485079","heartbeat_back_addr":"172.21.15.83:6825/2005485079","heartbeat_front_addr":"172.21.15.83:6823/2005485079","state":["exists","up"]},{"osd":7,"uuid":"a8940da2-0e79-4606-8d1e-d425afbf5753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6817","nonce":3737505059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6819","nonce":3737505059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6823","nonce":3737505059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6821","nonce":3737505059}]},"public_addr":"172.21.15.145:6817/3737505059","cluster_addr":"172.21.15.145:6819/3737505059","heartbeat_back_addr":"172.21.15.145:6823/3737505059","heartbeat_front_addr":"172.21.15.145:6821/3737505059","state":["exists","up"]},{"osd":8,"uuid":"602d43ac-a189-4da3-9e38-7025d14e0dd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6817","nonce":1031545791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6819","nonce":1031545791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6823","nonce":1031545791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6821","nonce":1031545791}]},"public_addr":"172.21.15.153:6817/1031545791","cluster_addr":"172.21.15.153:6819/1031545791","heartbeat_back_addr":"172.21.15.153:6823/1031545791","heartbeat_front_addr":"172.21.15.153:6821/1031545791","state":["exists","up"]},{"osd":9,"uuid":"08b12d27-1247-45e4-9d09-cacc0fce4bd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6827","nonce":3720996673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6829","nonce":3720996673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6833","nonce":3720996673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6831","nonce":3720996673}]},"public_addr":"172.21.15.83:6827/3720996673","cluster_addr":"172.21.15.83:6829/3720996673","heartbeat_back_addr":"172.21.15.83:6833/3720996673","heartbeat_front_addr":"172.21.15.83:6831/3720996673","state":["exists","up"]},{"osd":10,"uuid":"dd986b50-d68f-446c-9c66-261535880879","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6825","nonce":2671529479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6827","nonce":2671529479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6831","nonce":2671529479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6829","nonce":2671529479}]},"public_addr":"172.21.15.145:6825/2671529479","cluster_addr":"172.21.15.145:6827/2671529479","heartbeat_back_addr":"172.21.15.145:6831/2671529479","heartbeat_front_addr":"172.21.15.145:6829/2671529479","state":["exists","up"]},{"osd":11,"uuid":"d20a49cd-6224-4424-8375-46da791d9931","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6825","nonce":2342548429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6827","nonce":2342548429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6831","nonce":2342548429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6829","nonce":2342548429}]},"public_addr":"172.21.15.153:6825/2342548429","cluster_addr":"172.21.15.153:6827/2342548429","heartbeat_back_addr":"172.21.15.153:6831/2342548429","heartbeat_front_addr":"172.21.15.153:6829/2342548429","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:50:44.539932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:01.990470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:19.054426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:36.616393+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:53.896705+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:10.667502+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:27.880849+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:45.276308+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:02.280615+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:19.555547+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:37.062881+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:54.191589+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.83:6801/1867137261":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/2596683931":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/2125339627":"2024-04-02T06:49:33.656125+0000","172.21.15.83:6800/1644397953":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/690500472":"2024-04-02T06:49:13.456026+0000","172.21.15.83:6801/1644397953":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/785958951":"2024-04-02T06:49:33.656125+0000","172.21.15.83:6800/1867137261":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/2222527447":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/2071592157":"2024-04-02T06:49:13.456026+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T06:54:42.626 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:42.627+0000 7f385004e700 1 -- 172.21.15.83:0/3566425124 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f38340a11b0 msgr2=0x7f38340a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:42.626 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:42.627+0000 7f385004e700 1 --2- 172.21.15.83:0/3566425124 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f38340a11b0 0x7f38340a3670 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3844006010 tx=0x7f384400b260 comp rx=0 tx=0).stop 2024-04-01T06:54:42.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:42.627+0000 7f385004e700 1 -- 172.21.15.83:0/3566425124 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38480ffca0 msgr2=0x7f38481970d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:42.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:42.627+0000 7f385004e700 1 --2- 172.21.15.83:0/3566425124 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38480ffca0 0x7f38481970d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f383c00e9a0 tx=0x7f383c00ed60 comp rx=0 tx=0).stop 2024-04-01T06:54:42.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:42.627+0000 7f385004e700 1 -- 172.21.15.83:0/3566425124 shutdown_connections 2024-04-01T06:54:42.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:42.627+0000 7f385004e700 1 --2- 172.21.15.83:0/3566425124 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f38480ffca0 0x7f38481970d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:42.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:42.627+0000 7f385004e700 1 --2- 172.21.15.83:0/3566425124 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f38340a11b0 0x7f38340a3670 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:42.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:42.627+0000 7f385004e700 1 --2- 172.21.15.83:0/3566425124 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3848105d50 0x7f384819b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:42.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:42.627+0000 7f385004e700 1 --2- 172.21.15.83:0/3566425124 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3848100660 0x7f3848197610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:42.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:42.627+0000 7f385004e700 1 -- 172.21.15.83:0/3566425124 >> 172.21.15.83:0/3566425124 conn(0x7f3848076c80 msgr2=0x7f38480ff070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:42.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:42.627+0000 7f385004e700 1 -- 172.21.15.83:0/3566425124 shutdown_connections 2024-04-01T06:54:42.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:42.627+0000 7f385004e700 1 -- 172.21.15.83:0/3566425124 wait complete. 2024-04-01T06:54:42.918 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:42 smithi083 ceph-mon[43429]: pgmap v223: 97 pgs: 97 active+clean; 623 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 6.9 KiB/s wr, 14 op/s 2024-04-01T06:54:42.918 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:42 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/3566425124' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T06:54:42.994 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-04-01T06:54:42.994 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph osd dump --format=json 2024-04-01T06:54:43.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:42 smithi145 ceph-mon[47816]: pgmap v223: 97 pgs: 97 active+clean; 623 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 6.9 KiB/s wr, 14 op/s 2024-04-01T06:54:43.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:42 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/3566425124' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T06:54:43.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:42 smithi153 ceph-mon[48187]: pgmap v223: 97 pgs: 97 active+clean; 623 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 6.9 KiB/s wr, 14 op/s 2024-04-01T06:54:43.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:42 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/3566425124' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T06:54:43.216 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:54:44.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:44.115+0000 7f3eda142700 1 -- 172.21.15.83:0/3515169996 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3ed4104fb0 msgr2=0x7f3ed410cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:44.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:44.115+0000 7f3eda142700 1 --2- 172.21.15.83:0/3515169996 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3ed4104fb0 0x7f3ed410cb80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc00b0a0 tx=0x7f3ecc00b3b0 comp rx=0 tx=0).stop 2024-04-01T06:54:44.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:44.115+0000 7f3eda142700 1 -- 172.21.15.83:0/3515169996 shutdown_connections 2024-04-01T06:54:44.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:44.115+0000 7f3eda142700 1 --2- 172.21.15.83:0/3515169996 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3ed4104fb0 0x7f3ed410cb80 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:44.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:44.115+0000 7f3eda142700 1 --2- 172.21.15.83:0/3515169996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ed40fff70 0x7f3ed4100350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:44.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:44.115+0000 7f3eda142700 1 --2- 172.21.15.83:0/3515169996 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3ed4100920 0x7f3ed41048d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:44.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:44.115+0000 7f3eda142700 1 -- 172.21.15.83:0/3515169996 >> 172.21.15.83:0/3515169996 conn(0x7f3ed4075d50 msgr2=0x7f3ed4076160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:44.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:44.115+0000 7f3eda142700 1 -- 172.21.15.83:0/3515169996 shutdown_connections 2024-04-01T06:54:44.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:44.115+0000 7f3eda142700 1 -- 172.21.15.83:0/3515169996 wait complete. 2024-04-01T06:54:44.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:44.116+0000 7f3eda142700 1 Processor -- start 2024-04-01T06:54:44.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:44.116+0000 7f3eda142700 1 -- start start 2024-04-01T06:54:44.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:44.116+0000 7f3eda142700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ed40fff70 0x7f3ed4101970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:44.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:44.116+0000 7f3eda142700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3ed4100920 0x7f3ed4101eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:44.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:44.116+0000 7f3eda142700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3ed4104fb0 0x7f3ed41023f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:44.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:44.116+0000 7f3eda142700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed41a56e0 con 0x7f3ed4104fb0 2024-04-01T06:54:44.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:44.116+0000 7f3eda142700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed41a5850 con 0x7f3ed4100920 2024-04-01T06:54:44.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:44.116+0000 7f3eda142700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed41a5a10 con 0x7f3ed40fff70 2024-04-01T06:54:44.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:44.116+0000 7f3ed3fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3ed4104fb0 0x7f3ed41023f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:44.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:44.116+0000 7f3ed3fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3ed4104fb0 0x7f3ed41023f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:60038/0 (socket says 172.21.15.83:60038) 2024-04-01T06:54:44.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:44.116+0000 7f3ed3fff700 1 -- 172.21.15.83:0/233337858 learned_addr learned my addr 172.21.15.83:0/233337858 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:54:44.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:44.116+0000 7f3ed37fe700 1 --2- 172.21.15.83:0/233337858 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ed40fff70 0x7f3ed4101970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:44.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:44.117+0000 7f3ed2ffd700 1 --2- 172.21.15.83:0/233337858 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3ed4100920 0x7f3ed4101eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:44.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:44.117+0000 7f3ed3fff700 1 -- 172.21.15.83:0/233337858 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ed40fff70 msgr2=0x7f3ed4101970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:44.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:44.117+0000 7f3ed3fff700 1 --2- 172.21.15.83:0/233337858 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ed40fff70 0x7f3ed4101970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:44.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:44.117+0000 7f3ed3fff700 1 -- 172.21.15.83:0/233337858 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3ed4100920 msgr2=0x7f3ed4101eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:44.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:44.117+0000 7f3ed3fff700 1 --2- 172.21.15.83:0/233337858 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3ed4100920 0x7f3ed4101eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:44.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:44.117+0000 7f3ed3fff700 1 -- 172.21.15.83:0/233337858 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ecc009d00 con 0x7f3ed4104fb0 2024-04-01T06:54:44.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:44.117+0000 7f3ed3fff700 1 --2- 172.21.15.83:0/233337858 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3ed4104fb0 0x7f3ed41023f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc00b070 tx=0x7f3ecc007920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:44.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:44.117+0000 7f3ed0ff9700 1 -- 172.21.15.83:0/233337858 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc00e040 con 0x7f3ed4104fb0 2024-04-01T06:54:44.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:44.117+0000 7f3ed0ff9700 1 -- 172.21.15.83:0/233337858 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3ecc009440 con 0x7f3ed4104fb0 2024-04-01T06:54:44.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:44.117+0000 7f3eda142700 1 -- 172.21.15.83:0/233337858 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ed41a5c90 con 0x7f3ed4104fb0 2024-04-01T06:54:44.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:44.117+0000 7f3ed0ff9700 1 -- 172.21.15.83:0/233337858 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc01b6b0 con 0x7f3ed4104fb0 2024-04-01T06:54:44.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:44.117+0000 7f3eda142700 1 -- 172.21.15.83:0/233337858 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ed41a6100 con 0x7f3ed4104fb0 2024-04-01T06:54:44.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:44.118+0000 7f3eda142700 1 -- 172.21.15.83:0/233337858 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ed41092e0 con 0x7f3ed4104fb0 2024-04-01T06:54:44.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:44.119+0000 7f3ed0ff9700 1 -- 172.21.15.83:0/233337858 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f3ecc01d480 con 0x7f3ed4104fb0 2024-04-01T06:54:44.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:44.120+0000 7f3ed0ff9700 1 --2- 172.21.15.83:0/233337858 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f3ec00a11b0 0x7f3ec00a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:44.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:44.120+0000 7f3ed37fe700 1 --2- 172.21.15.83:0/233337858 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f3ec00a11b0 0x7f3ec00a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:44.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:44.120+0000 7f3ed0ff9700 1 -- 172.21.15.83:0/233337858 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f3ecc0ce4e0 con 0x7f3ed4104fb0 2024-04-01T06:54:44.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:44.120+0000 7f3ed37fe700 1 --2- 172.21.15.83:0/233337858 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f3ec00a11b0 0x7f3ec00a3670 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4005950 tx=0x7f3ec40058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:44.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:44.123+0000 7f3ed0ff9700 1 -- 172.21.15.83:0/233337858 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f3ecc097d50 con 0x7f3ed4104fb0 2024-04-01T06:54:44.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:44.320+0000 7f3eda142700 1 -- 172.21.15.83:0/233337858 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3ed4102e50 con 0x7f3ed4104fb0 2024-04-01T06:54:44.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:44.322+0000 7f3ed0ff9700 1 -- 172.21.15.83:0/233337858 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+22131 (secure 0 0 0) 0x7f3ecc01de60 con 0x7f3ed4104fb0 2024-04-01T06:54:44.322 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:54:44.322 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":79,"fsid":"c6f8eff4-eff3-11ee-b647-cb9ed24678a4","created":"2024-04-01T06:48:42.033382+0000","modified":"2024-04-01T06:54:29.399277+0000","last_up_change":"2024-04-01T06:53:55.791339+0000","last_in_change":"2024-04-01T06:53:39.777214+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T06:51:21.963996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T06:54:26.450403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T06:54:27.564928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"90b761b0-b06c-4142-854d-38ee42aa6052","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6803","nonce":3253845390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6805","nonce":3253845390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6809","nonce":3253845390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6807","nonce":3253845390}]},"public_addr":"172.21.15.83:6803/3253845390","cluster_addr":"172.21.15.83:6805/3253845390","heartbeat_back_addr":"172.21.15.83:6809/3253845390","heartbeat_front_addr":"172.21.15.83:6807/3253845390","state":["exists","up"]},{"osd":1,"uuid":"4d6ab85b-7088-451e-a829-c9119f35dee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6801","nonce":515889759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6803","nonce":515889759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6807","nonce":515889759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6805","nonce":515889759}]},"public_addr":"172.21.15.145:6801/515889759","cluster_addr":"172.21.15.145:6803/515889759","heartbeat_back_addr":"172.21.15.145:6807/515889759","heartbeat_front_addr":"172.21.15.145:6805/515889759","state":["exists","up"]},{"osd":2,"uuid":"d04c27f3-4972-4061-8bfb-5060645e3883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6801","nonce":3318516728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6803","nonce":3318516728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6807","nonce":3318516728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6805","nonce":3318516728}]},"public_addr":"172.21.15.153:6801/3318516728","cluster_addr":"172.21.15.153:6803/3318516728","heartbeat_back_addr":"172.21.15.153:6807/3318516728","heartbeat_front_addr":"172.21.15.153:6805/3318516728","state":["exists","up"]},{"osd":3,"uuid":"899b6c90-8f2f-44dd-b807-49594aadb443","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6811","nonce":504690234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6813","nonce":504690234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6817","nonce":504690234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6815","nonce":504690234}]},"public_addr":"172.21.15.83:6811/504690234","cluster_addr":"172.21.15.83:6813/504690234","heartbeat_back_addr":"172.21.15.83:6817/504690234","heartbeat_front_addr":"172.21.15.83:6815/504690234","state":["exists","up"]},{"osd":4,"uuid":"5071dd81-804e-4358-bfb6-11e718e9cf4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6809","nonce":2099824730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6811","nonce":2099824730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6815","nonce":2099824730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6813","nonce":2099824730}]},"public_addr":"172.21.15.145:6809/2099824730","cluster_addr":"172.21.15.145:6811/2099824730","heartbeat_back_addr":"172.21.15.145:6815/2099824730","heartbeat_front_addr":"172.21.15.145:6813/2099824730","state":["exists","up"]},{"osd":5,"uuid":"b8442b71-c26e-467f-b0c3-ea9f636f5a00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6809","nonce":3340941443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6811","nonce":3340941443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6815","nonce":3340941443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6813","nonce":3340941443}]},"public_addr":"172.21.15.153:6809/3340941443","cluster_addr":"172.21.15.153:6811/3340941443","heartbeat_back_addr":"172.21.15.153:6815/3340941443","heartbeat_front_addr":"172.21.15.153:6813/3340941443","state":["exists","up"]},{"osd":6,"uuid":"c26bb8cb-ccee-4bfc-91eb-14e1ad8e04df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6819","nonce":2005485079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6821","nonce":2005485079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6825","nonce":2005485079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6823","nonce":2005485079}]},"public_addr":"172.21.15.83:6819/2005485079","cluster_addr":"172.21.15.83:6821/2005485079","heartbeat_back_addr":"172.21.15.83:6825/2005485079","heartbeat_front_addr":"172.21.15.83:6823/2005485079","state":["exists","up"]},{"osd":7,"uuid":"a8940da2-0e79-4606-8d1e-d425afbf5753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6817","nonce":3737505059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6819","nonce":3737505059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6823","nonce":3737505059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6821","nonce":3737505059}]},"public_addr":"172.21.15.145:6817/3737505059","cluster_addr":"172.21.15.145:6819/3737505059","heartbeat_back_addr":"172.21.15.145:6823/3737505059","heartbeat_front_addr":"172.21.15.145:6821/3737505059","state":["exists","up"]},{"osd":8,"uuid":"602d43ac-a189-4da3-9e38-7025d14e0dd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6817","nonce":1031545791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6819","nonce":1031545791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6823","nonce":1031545791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6821","nonce":1031545791}]},"public_addr":"172.21.15.153:6817/1031545791","cluster_addr":"172.21.15.153:6819/1031545791","heartbeat_back_addr":"172.21.15.153:6823/1031545791","heartbeat_front_addr":"172.21.15.153:6821/1031545791","state":["exists","up"]},{"osd":9,"uuid":"08b12d27-1247-45e4-9d09-cacc0fce4bd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6827","nonce":3720996673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6829","nonce":3720996673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6833","nonce":3720996673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6831","nonce":3720996673}]},"public_addr":"172.21.15.83:6827/3720996673","cluster_addr":"172.21.15.83:6829/3720996673","heartbeat_back_addr":"172.21.15.83:6833/3720996673","heartbeat_front_addr":"172.21.15.83:6831/3720996673","state":["exists","up"]},{"osd":10,"uuid":"dd986b50-d68f-446c-9c66-261535880879","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6825","nonce":2671529479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6827","nonce":2671529479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6831","nonce":2671529479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6829","nonce":2671529479}]},"public_addr":"172.21.15.145:6825/2671529479","cluster_addr":"172.21.15.145:6827/2671529479","heartbeat_back_addr":"172.21.15.145:6831/2671529479","heartbeat_front_addr":"172.21.15.145:6829/2671529479","state":["exists","up"]},{"osd":11,"uuid":"d20a49cd-6224-4424-8375-46da791d9931","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6825","nonce":2342548429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6827","nonce":2342548429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6831","nonce":2342548429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6829","nonce":2342548429}]},"public_addr":"172.21.15.153:6825/2342548429","cluster_addr":"172.21.15.153:6827/2342548429","heartbeat_back_addr":"172.21.15.153:6831/2342548429","heartbeat_front_addr":"172.21.15.153:6829/2342548429","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:50:44.539932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:01.990470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:19.054426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:36.616393+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:53.896705+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:10.667502+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:27.880849+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:45.276308+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:02.280615+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:19.555547+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:37.062881+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:54.191589+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.83:6801/1867137261":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/2596683931":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/2125339627":"2024-04-02T06:49:33.656125+0000","172.21.15.83:6800/1644397953":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/690500472":"2024-04-02T06:49:13.456026+0000","172.21.15.83:6801/1644397953":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/785958951":"2024-04-02T06:49:33.656125+0000","172.21.15.83:6800/1867137261":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/2222527447":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/2071592157":"2024-04-02T06:49:13.456026+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T06:54:44.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:44.324+0000 7f3eda142700 1 -- 172.21.15.83:0/233337858 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f3ec00a11b0 msgr2=0x7f3ec00a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:44.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:44.324+0000 7f3eda142700 1 --2- 172.21.15.83:0/233337858 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f3ec00a11b0 0x7f3ec00a3670 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4005950 tx=0x7f3ec40058e0 comp rx=0 tx=0).stop 2024-04-01T06:54:44.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:44.324+0000 7f3eda142700 1 -- 172.21.15.83:0/233337858 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3ed4104fb0 msgr2=0x7f3ed41023f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:44.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:44.324+0000 7f3eda142700 1 --2- 172.21.15.83:0/233337858 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3ed4104fb0 0x7f3ed41023f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc00b070 tx=0x7f3ecc007920 comp rx=0 tx=0).stop 2024-04-01T06:54:44.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:44.324+0000 7f3eda142700 1 -- 172.21.15.83:0/233337858 shutdown_connections 2024-04-01T06:54:44.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:44.324+0000 7f3eda142700 1 --2- 172.21.15.83:0/233337858 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3ed4104fb0 0x7f3ed41023f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:44.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:44.324+0000 7f3eda142700 1 --2- 172.21.15.83:0/233337858 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f3ec00a11b0 0x7f3ec00a3670 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:44.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:44.324+0000 7f3eda142700 1 --2- 172.21.15.83:0/233337858 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ed40fff70 0x7f3ed4101970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:44.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:44.324+0000 7f3eda142700 1 --2- 172.21.15.83:0/233337858 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3ed4100920 0x7f3ed4101eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:44.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:44.324+0000 7f3eda142700 1 -- 172.21.15.83:0/233337858 >> 172.21.15.83:0/233337858 conn(0x7f3ed4075d50 msgr2=0x7f3ed4068a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:44.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:44.324+0000 7f3eda142700 1 -- 172.21.15.83:0/233337858 shutdown_connections 2024-04-01T06:54:44.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:44.324+0000 7f3eda142700 1 -- 172.21.15.83:0/233337858 wait complete. 2024-04-01T06:54:44.695 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph tell osd.0 flush_pg_stats 2024-04-01T06:54:44.696 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph tell osd.1 flush_pg_stats 2024-04-01T06:54:44.696 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph tell osd.2 flush_pg_stats 2024-04-01T06:54:44.697 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph tell osd.3 flush_pg_stats 2024-04-01T06:54:44.697 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph tell osd.4 flush_pg_stats 2024-04-01T06:54:44.698 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph tell osd.5 flush_pg_stats 2024-04-01T06:54:44.698 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph tell osd.6 flush_pg_stats 2024-04-01T06:54:44.699 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph tell osd.7 flush_pg_stats 2024-04-01T06:54:44.699 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph tell osd.8 flush_pg_stats 2024-04-01T06:54:44.700 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph tell osd.9 flush_pg_stats 2024-04-01T06:54:44.700 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph tell osd.10 flush_pg_stats 2024-04-01T06:54:44.701 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph tell osd.11 flush_pg_stats 2024-04-01T06:54:44.907 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:44 smithi083 ceph-mon[43429]: pgmap v224: 97 pgs: 97 active+clean; 635 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 8.1 KiB/s wr, 15 op/s 2024-04-01T06:54:44.908 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:44 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/233337858' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T06:54:45.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:44 smithi153 ceph-mon[48187]: pgmap v224: 97 pgs: 97 active+clean; 635 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 8.1 KiB/s wr, 15 op/s 2024-04-01T06:54:45.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:44 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/233337858' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T06:54:45.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:44 smithi145 ceph-mon[47816]: pgmap v224: 97 pgs: 97 active+clean; 635 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 8.1 KiB/s wr, 15 op/s 2024-04-01T06:54:45.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:44 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/233337858' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T06:54:45.566 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:54:45.869 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:54:46.022 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:54:46.575 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:54:46.792 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:46 smithi083 ceph-mon[43429]: pgmap v225: 97 pgs: 97 active+clean; 635 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.9 KiB/s wr, 13 op/s 2024-04-01T06:54:46.878 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:54:47.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:46 smithi145 ceph-mon[47816]: pgmap v225: 97 pgs: 97 active+clean; 635 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.9 KiB/s wr, 13 op/s 2024-04-01T06:54:47.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:46 smithi153 ceph-mon[48187]: pgmap v225: 97 pgs: 97 active+clean; 635 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.9 KiB/s wr, 13 op/s 2024-04-01T06:54:47.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.412+0000 7f8e7b367700 1 -- 172.21.15.83:0/2871586019 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e74100e00 msgr2=0x7f8e74101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:47.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.412+0000 7f8e7b367700 1 --2- 172.21.15.83:0/2871586019 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e74100e00 0x7f8e74101280 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8e64009990 tx=0x7f8e64009ca0 comp rx=0 tx=0).stop 2024-04-01T06:54:47.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.412+0000 7f8e7b367700 1 -- 172.21.15.83:0/2871586019 shutdown_connections 2024-04-01T06:54:47.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.412+0000 7f8e7b367700 1 --2- 172.21.15.83:0/2871586019 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e741017c0 0x7f8e7410dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:47.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.412+0000 7f8e7b367700 1 --2- 172.21.15.83:0/2871586019 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e74106e40 0x7f8e74107220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:47.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.412+0000 7f8e7b367700 1 --2- 172.21.15.83:0/2871586019 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e74100e00 0x7f8e74101280 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:47.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.412+0000 7f8e7b367700 1 -- 172.21.15.83:0/2871586019 >> 172.21.15.83:0/2871586019 conn(0x7f8e74077f10 msgr2=0x7f8e74078320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:47.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.412+0000 7f8e7b367700 1 -- 172.21.15.83:0/2871586019 shutdown_connections 2024-04-01T06:54:47.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.412+0000 7f8e7b367700 1 -- 172.21.15.83:0/2871586019 wait complete. 2024-04-01T06:54:47.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.413+0000 7f8e7b367700 1 Processor -- start 2024-04-01T06:54:47.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.413+0000 7f8e7b367700 1 -- start start 2024-04-01T06:54:47.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.413+0000 7f8e7b367700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e74100e00 0x7f8e74197100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:47.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.413+0000 7f8e7b367700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e741017c0 0x7f8e74197640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:47.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.413+0000 7f8e7b367700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e74106e40 0x7f8e7419b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:47.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.413+0000 7f8e7b367700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7419c000 con 0x7f8e74100e00 2024-04-01T06:54:47.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.413+0000 7f8e7b367700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7419c170 con 0x7f8e74106e40 2024-04-01T06:54:47.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.413+0000 7f8e7b367700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7419c330 con 0x7f8e741017c0 2024-04-01T06:54:47.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.413+0000 7f8e79103700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e74100e00 0x7f8e74197100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:47.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.413+0000 7f8e79103700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e74100e00 0x7f8e74197100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:60064/0 (socket says 172.21.15.83:60064) 2024-04-01T06:54:47.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.413+0000 7f8e79103700 1 -- 172.21.15.83:0/3786374406 learned_addr learned my addr 172.21.15.83:0/3786374406 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:54:47.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.413+0000 7f8e78902700 1 --2- 172.21.15.83:0/3786374406 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e741017c0 0x7f8e74197640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:47.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.413+0000 7f8e79904700 1 --2- 172.21.15.83:0/3786374406 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e74106e40 0x7f8e7419b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:47.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.413+0000 7f8e79103700 1 -- 172.21.15.83:0/3786374406 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e741017c0 msgr2=0x7f8e74197640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:47.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.413+0000 7f8e79103700 1 --2- 172.21.15.83:0/3786374406 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e741017c0 0x7f8e74197640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:47.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.413+0000 7f8e79103700 1 -- 172.21.15.83:0/3786374406 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e74106e40 msgr2=0x7f8e7419b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:47.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.413+0000 7f8e79103700 1 --2- 172.21.15.83:0/3786374406 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e74106e40 0x7f8e7419b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:47.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.413+0000 7f8e79103700 1 -- 172.21.15.83:0/3786374406 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e640095f0 con 0x7f8e74100e00 2024-04-01T06:54:47.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.414+0000 7f8e79103700 1 --2- 172.21.15.83:0/3786374406 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e74100e00 0x7f8e74197100 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8e7000d950 tx=0x7f8e7000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:47.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.414+0000 7f8e6a7fc700 1 -- 172.21.15.83:0/3786374406 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7000f890 con 0x7f8e74100e00 2024-04-01T06:54:47.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.414+0000 7f8e7b367700 1 -- 172.21.15.83:0/3786374406 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e7419c610 con 0x7f8e74100e00 2024-04-01T06:54:47.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.414+0000 7f8e7b367700 1 -- 172.21.15.83:0/3786374406 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e741a3e70 con 0x7f8e74100e00 2024-04-01T06:54:47.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.414+0000 7f8e6a7fc700 1 -- 172.21.15.83:0/3786374406 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8e70010460 con 0x7f8e74100e00 2024-04-01T06:54:47.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.414+0000 7f8e6a7fc700 1 -- 172.21.15.83:0/3786374406 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7000e610 con 0x7f8e74100e00 2024-04-01T06:54:47.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.415+0000 7f8e7b367700 1 -- 172.21.15.83:0/3786374406 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8e74102480 con 0x7f8e74100e00 2024-04-01T06:54:47.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.416+0000 7f8e6a7fc700 1 -- 172.21.15.83:0/3786374406 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f8e700105d0 con 0x7f8e74100e00 2024-04-01T06:54:47.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.417+0000 7f8e6a7fc700 1 --2- 172.21.15.83:0/3786374406 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f8e600a11b0 0x7f8e600a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:47.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.417+0000 7f8e78902700 1 --2- 172.21.15.83:0/3786374406 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f8e600a11b0 0x7f8e600a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:47.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.417+0000 7f8e6a7fc700 1 -- 172.21.15.83:0/3786374406 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f8e700ccb70 con 0x7f8e74100e00 2024-04-01T06:54:47.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.417+0000 7f8e6a7fc700 1 --2- 172.21.15.83:0/3786374406 >> [v2:172.21.15.145:6824/2671529479,v1:172.21.15.145:6825/2671529479] conn(0x7f8e600aa990 0x7f8e600acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:47.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.417+0000 7f8e6a7fc700 1 -- 172.21.15.83:0/3786374406 --> [v2:172.21.15.145:6824/2671529479,v1:172.21.15.145:6825/2671529479] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8e600ad460 con 0x7f8e600aa990 2024-04-01T06:54:47.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.417+0000 7f8e6a7fc700 1 -- 172.21.15.83:0/3786374406 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e700cd010 con 0x7f8e74100e00 2024-04-01T06:54:47.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.417+0000 7f8e78902700 1 --2- 172.21.15.83:0/3786374406 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f8e600a11b0 0x7f8e600a3670 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8e6400b5c0 tx=0x7f8e64005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:47.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.417+0000 7f8e79904700 1 --2- 172.21.15.83:0/3786374406 >> [v2:172.21.15.145:6824/2671529479,v1:172.21.15.145:6825/2671529479] conn(0x7f8e600aa990 0x7f8e600acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:47.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.418+0000 7f8e79904700 1 --2- 172.21.15.83:0/3786374406 >> [v2:172.21.15.145:6824/2671529479,v1:172.21.15.145:6825/2671529479] conn(0x7f8e600aa990 0x7f8e600acdb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:47.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.419+0000 7f8e6a7fc700 1 -- 172.21.15.83:0/3786374406 <== osd.10 v2:172.21.15.145:6824/2671529479 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f8e600ad460 con 0x7f8e600aa990 2024-04-01T06:54:47.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.434+0000 7f8e7b367700 1 -- 172.21.15.83:0/3786374406 --> [v2:172.21.15.145:6824/2671529479,v1:172.21.15.145:6825/2671529479] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8e74110f50 con 0x7f8e600aa990 2024-04-01T06:54:47.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.435+0000 7f8e6a7fc700 1 -- 172.21.15.83:0/3786374406 <== osd.10 v2:172.21.15.145:6824/2671529479 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f8e74110f50 con 0x7f8e600aa990 2024-04-01T06:54:47.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.435+0000 7f8e7b367700 1 -- 172.21.15.83:0/3786374406 >> [v2:172.21.15.145:6824/2671529479,v1:172.21.15.145:6825/2671529479] conn(0x7f8e600aa990 msgr2=0x7f8e600acdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:47.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.435+0000 7f8e7b367700 1 --2- 172.21.15.83:0/3786374406 >> [v2:172.21.15.145:6824/2671529479,v1:172.21.15.145:6825/2671529479] conn(0x7f8e600aa990 0x7f8e600acdb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:47.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.435+0000 7f8e7b367700 1 -- 172.21.15.83:0/3786374406 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f8e600a11b0 msgr2=0x7f8e600a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:47.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.435+0000 7f8e7b367700 1 --2- 172.21.15.83:0/3786374406 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f8e600a11b0 0x7f8e600a3670 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8e6400b5c0 tx=0x7f8e64005960 comp rx=0 tx=0).stop 2024-04-01T06:54:47.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.435+0000 7f8e7b367700 1 -- 172.21.15.83:0/3786374406 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e74100e00 msgr2=0x7f8e74197100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:47.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.435+0000 7f8e7b367700 1 --2- 172.21.15.83:0/3786374406 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e74100e00 0x7f8e74197100 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8e7000d950 tx=0x7f8e7000dc60 comp rx=0 tx=0).stop 2024-04-01T06:54:47.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.435+0000 7f8e79904700 1 -- 172.21.15.83:0/3786374406 reap_dead start 2024-04-01T06:54:47.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.436+0000 7f8e7b367700 1 -- 172.21.15.83:0/3786374406 shutdown_connections 2024-04-01T06:54:47.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.436+0000 7f8e7b367700 1 -- 172.21.15.83:0/3786374406 >> 172.21.15.83:0/3786374406 conn(0x7f8e74077f10 msgr2=0x7f8e740ffac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:47.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.436+0000 7f8e7b367700 1 -- 172.21.15.83:0/3786374406 shutdown_connections 2024-04-01T06:54:47.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.436+0000 7f8e7b367700 1 -- 172.21.15.83:0/3786374406 wait complete. 2024-04-01T06:54:47.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.837+0000 7fbcdfddb700 1 -- 172.21.15.83:0/2580991569 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbcd8068750 msgr2=0x7fbcd8068bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:47.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.837+0000 7fbcdfddb700 1 --2- 172.21.15.83:0/2580991569 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbcd8068750 0x7fbcd8068bb0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4009990 tx=0x7fbcd4009ca0 comp rx=0 tx=0).stop 2024-04-01T06:54:47.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.837+0000 7fbcdfddb700 1 -- 172.21.15.83:0/2580991569 shutdown_connections 2024-04-01T06:54:47.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.837+0000 7fbcdfddb700 1 --2- 172.21.15.83:0/2580991569 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbcd80690f0 0x7fbcd810dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:47.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.837+0000 7fbcdfddb700 1 --2- 172.21.15.83:0/2580991569 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcd8106df0 0x7fbcd81071d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:47.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.837+0000 7fbcdfddb700 1 --2- 172.21.15.83:0/2580991569 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbcd8068750 0x7fbcd8068bb0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:47.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.837+0000 7fbcdfddb700 1 -- 172.21.15.83:0/2580991569 >> 172.21.15.83:0/2580991569 conn(0x7fbcd8075d50 msgr2=0x7fbcd8076160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:47.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.837+0000 7fbcdfddb700 1 -- 172.21.15.83:0/2580991569 shutdown_connections 2024-04-01T06:54:47.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.837+0000 7fbcdfddb700 1 -- 172.21.15.83:0/2580991569 wait complete. 2024-04-01T06:54:47.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.838+0000 7fbcdfddb700 1 Processor -- start 2024-04-01T06:54:47.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.838+0000 7fbcdfddb700 1 -- start start 2024-04-01T06:54:47.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.838+0000 7fbcdfddb700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbcd8068750 0x7fbcd81972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:47.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.838+0000 7fbcdfddb700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbcd80690f0 0x7fbcd8197830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:47.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.838+0000 7fbcdfddb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcd8106df0 0x7fbcd819bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:47.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.838+0000 7fbcdfddb700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd819c1f0 con 0x7fbcd8068750 2024-04-01T06:54:47.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.838+0000 7fbcdfddb700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd819c360 con 0x7fbcd80690f0 2024-04-01T06:54:47.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.838+0000 7fbcdfddb700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd819c520 con 0x7fbcd8106df0 2024-04-01T06:54:47.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.838+0000 7fbcddb77700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbcd8068750 0x7fbcd81972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:47.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.838+0000 7fbcddb77700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbcd8068750 0x7fbcd81972f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:60074/0 (socket says 172.21.15.83:60074) 2024-04-01T06:54:47.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.838+0000 7fbcddb77700 1 -- 172.21.15.83:0/3314162990 learned_addr learned my addr 172.21.15.83:0/3314162990 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:54:47.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.838+0000 7fbcde378700 1 --2- 172.21.15.83:0/3314162990 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcd8106df0 0x7fbcd819bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:47.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.838+0000 7fbcdd376700 1 --2- 172.21.15.83:0/3314162990 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbcd80690f0 0x7fbcd8197830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:47.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.838+0000 7fbcddb77700 1 -- 172.21.15.83:0/3314162990 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcd8106df0 msgr2=0x7fbcd819bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:47.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.838+0000 7fbcddb77700 1 --2- 172.21.15.83:0/3314162990 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcd8106df0 0x7fbcd819bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:47.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.839+0000 7fbcddb77700 1 -- 172.21.15.83:0/3314162990 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbcd80690f0 msgr2=0x7fbcd8197830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:47.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.839+0000 7fbcddb77700 1 --2- 172.21.15.83:0/3314162990 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbcd80690f0 0x7fbcd8197830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:47.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.839+0000 7fbcddb77700 1 -- 172.21.15.83:0/3314162990 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcd40095f0 con 0x7fbcd8068750 2024-04-01T06:54:47.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.839+0000 7fbcddb77700 1 --2- 172.21.15.83:0/3314162990 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbcd8068750 0x7fbcd81972f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbcc800b530 tx=0x7fbcc800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:47.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.839+0000 7fbcceffd700 1 -- 172.21.15.83:0/3314162990 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc8011830 con 0x7fbcd8068750 2024-04-01T06:54:47.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.839+0000 7fbcdfddb700 1 -- 172.21.15.83:0/3314162990 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcd819c800 con 0x7fbcd8068750 2024-04-01T06:54:47.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.839+0000 7fbcceffd700 1 -- 172.21.15.83:0/3314162990 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbcc8011e50 con 0x7fbcd8068750 2024-04-01T06:54:47.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.839+0000 7fbcceffd700 1 -- 172.21.15.83:0/3314162990 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc800f2e0 con 0x7fbcd8068750 2024-04-01T06:54:47.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.839+0000 7fbcdfddb700 1 -- 172.21.15.83:0/3314162990 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcd81a4060 con 0x7fbcd8068750 2024-04-01T06:54:47.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.840+0000 7fbcdfddb700 1 -- 172.21.15.83:0/3314162990 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbcd81024a0 con 0x7fbcd8068750 2024-04-01T06:54:47.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.841+0000 7fbcceffd700 1 -- 172.21.15.83:0/3314162990 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7fbcc8010580 con 0x7fbcd8068750 2024-04-01T06:54:47.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.841+0000 7fbcceffd700 1 --2- 172.21.15.83:0/3314162990 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fbcc40a11b0 0x7fbcc40a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:47.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.842+0000 7fbcdd376700 1 --2- 172.21.15.83:0/3314162990 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fbcc40a11b0 0x7fbcc40a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:47.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.842+0000 7fbcceffd700 1 -- 172.21.15.83:0/3314162990 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fbcc80cca20 con 0x7fbcd8068750 2024-04-01T06:54:47.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.842+0000 7fbcceffd700 1 --2- 172.21.15.83:0/3314162990 >> [v2:172.21.15.153:6808/3340941443,v1:172.21.15.153:6809/3340941443] conn(0x7fbcc40aa990 0x7fbcc40acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:47.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.842+0000 7fbcceffd700 1 -- 172.21.15.83:0/3314162990 --> [v2:172.21.15.153:6808/3340941443,v1:172.21.15.153:6809/3340941443] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbcc40ad460 con 0x7fbcc40aa990 2024-04-01T06:54:47.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.842+0000 7fbcceffd700 1 -- 172.21.15.83:0/3314162990 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbcc80ccd90 con 0x7fbcd8068750 2024-04-01T06:54:47.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.842+0000 7fbcdd376700 1 --2- 172.21.15.83:0/3314162990 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fbcc40a11b0 0x7fbcc40a3670 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fbcd400b5c0 tx=0x7fbcd4005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:47.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.842+0000 7fbcde378700 1 --2- 172.21.15.83:0/3314162990 >> [v2:172.21.15.153:6808/3340941443,v1:172.21.15.153:6809/3340941443] conn(0x7fbcc40aa990 0x7fbcc40acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:47.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.842+0000 7fbcde378700 1 --2- 172.21.15.83:0/3314162990 >> [v2:172.21.15.153:6808/3340941443,v1:172.21.15.153:6809/3340941443] conn(0x7fbcc40aa990 0x7fbcc40acdb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:47.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.843+0000 7fbcceffd700 1 -- 172.21.15.83:0/3314162990 <== osd.5 v2:172.21.15.153:6808/3340941443 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7fbcc40ad460 con 0x7fbcc40aa990 2024-04-01T06:54:47.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.859+0000 7fbcdfddb700 1 -- 172.21.15.83:0/3314162990 --> [v2:172.21.15.153:6808/3340941443,v1:172.21.15.153:6809/3340941443] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbcd8111040 con 0x7fbcc40aa990 2024-04-01T06:54:47.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.859+0000 7fbcceffd700 1 -- 172.21.15.83:0/3314162990 <== osd.5 v2:172.21.15.153:6808/3340941443 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fbcd8111040 con 0x7fbcc40aa990 2024-04-01T06:54:47.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.860+0000 7fbcdfddb700 1 -- 172.21.15.83:0/3314162990 >> [v2:172.21.15.153:6808/3340941443,v1:172.21.15.153:6809/3340941443] conn(0x7fbcc40aa990 msgr2=0x7fbcc40acdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:47.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.860+0000 7fbcdfddb700 1 --2- 172.21.15.83:0/3314162990 >> [v2:172.21.15.153:6808/3340941443,v1:172.21.15.153:6809/3340941443] conn(0x7fbcc40aa990 0x7fbcc40acdb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:47.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.860+0000 7fbcdfddb700 1 -- 172.21.15.83:0/3314162990 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fbcc40a11b0 msgr2=0x7fbcc40a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:47.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.860+0000 7fbcdfddb700 1 --2- 172.21.15.83:0/3314162990 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fbcc40a11b0 0x7fbcc40a3670 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fbcd400b5c0 tx=0x7fbcd4005fd0 comp rx=0 tx=0).stop 2024-04-01T06:54:47.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.860+0000 7fbcdfddb700 1 -- 172.21.15.83:0/3314162990 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbcd8068750 msgr2=0x7fbcd81972f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:47.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.860+0000 7fbcdfddb700 1 --2- 172.21.15.83:0/3314162990 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbcd8068750 0x7fbcd81972f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbcc800b530 tx=0x7fbcc800b8f0 comp rx=0 tx=0).stop 2024-04-01T06:54:47.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.860+0000 7fbcde378700 1 -- 172.21.15.83:0/3314162990 reap_dead start 2024-04-01T06:54:47.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.860+0000 7fbcdfddb700 1 -- 172.21.15.83:0/3314162990 shutdown_connections 2024-04-01T06:54:47.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.860+0000 7fbcdfddb700 1 -- 172.21.15.83:0/3314162990 >> 172.21.15.83:0/3314162990 conn(0x7fbcd8075d50 msgr2=0x7fbcd80fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:47.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.860+0000 7fbcdfddb700 1 -- 172.21.15.83:0/3314162990 shutdown_connections 2024-04-01T06:54:47.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:47.860+0000 7fbcdfddb700 1 -- 172.21.15.83:0/3314162990 wait complete. 2024-04-01T06:54:48.454 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:54:48.502 INFO:teuthology.orchestra.run.smithi083.stdout:287762808848 2024-04-01T06:54:48.503 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.10 2024-04-01T06:54:48.692 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:54:48.693 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:54:48.922 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:48 smithi083 ceph-mon[43429]: pgmap v226: 97 pgs: 97 active+clean; 635 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.1 KiB/s wr, 12 op/s 2024-04-01T06:54:49.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.103+0000 7f73f3584700 1 -- 172.21.15.83:0/1740540035 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f73ec100e60 msgr2=0x7f73ec1012e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:49.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.103+0000 7f73f3584700 1 --2- 172.21.15.83:0/1740540035 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f73ec100e60 0x7f73ec1012e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f73e80099c0 tx=0x7f73e8009cd0 comp rx=0 tx=0).stop 2024-04-01T06:54:49.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.103+0000 7f73f3584700 1 -- 172.21.15.83:0/1740540035 shutdown_connections 2024-04-01T06:54:49.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.103+0000 7f73f3584700 1 --2- 172.21.15.83:0/1740540035 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73ec101820 0x7f73ec10dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:49.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.103+0000 7f73f3584700 1 --2- 172.21.15.83:0/1740540035 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f73ec106ef0 0x7f73ec1072d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:49.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.103+0000 7f73f3584700 1 --2- 172.21.15.83:0/1740540035 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f73ec100e60 0x7f73ec1012e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:49.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.103+0000 7f73f3584700 1 -- 172.21.15.83:0/1740540035 >> 172.21.15.83:0/1740540035 conn(0x7f73ec077fa0 msgr2=0x7f73ec0783b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:49.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.103+0000 7f73f3584700 1 -- 172.21.15.83:0/1740540035 shutdown_connections 2024-04-01T06:54:49.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.103+0000 7f73f3584700 1 -- 172.21.15.83:0/1740540035 wait complete. 2024-04-01T06:54:49.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.104+0000 7f73f3584700 1 Processor -- start 2024-04-01T06:54:49.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.104+0000 7f73f3584700 1 -- start start 2024-04-01T06:54:49.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.104+0000 7f73f3584700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73ec100e60 0x7f73ec197240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:49.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.104+0000 7f73f3584700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f73ec101820 0x7f73ec197780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:49.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.104+0000 7f73f3584700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f73ec106ef0 0x7f73ec19bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:49.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.104+0000 7f73f3584700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73ec19c140 con 0x7f73ec101820 2024-04-01T06:54:49.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.104+0000 7f73f3584700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73ec19c2b0 con 0x7f73ec106ef0 2024-04-01T06:54:49.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.104+0000 7f73f3584700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73ec19c470 con 0x7f73ec100e60 2024-04-01T06:54:49.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.104+0000 7f73f0b1f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f73ec101820 0x7f73ec197780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:49.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.104+0000 7f73f0b1f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f73ec101820 0x7f73ec197780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:60088/0 (socket says 172.21.15.83:60088) 2024-04-01T06:54:49.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.104+0000 7f73f0b1f700 1 -- 172.21.15.83:0/3421991586 learned_addr learned my addr 172.21.15.83:0/3421991586 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:54:49.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.104+0000 7f73f1320700 1 --2- 172.21.15.83:0/3421991586 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73ec100e60 0x7f73ec197240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:49.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.104+0000 7f73f1b21700 1 --2- 172.21.15.83:0/3421991586 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f73ec106ef0 0x7f73ec19bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:49.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.104+0000 7f73f0b1f700 1 -- 172.21.15.83:0/3421991586 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73ec100e60 msgr2=0x7f73ec197240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:49.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.104+0000 7f73f0b1f700 1 --2- 172.21.15.83:0/3421991586 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73ec100e60 0x7f73ec197240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:49.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.104+0000 7f73f0b1f700 1 -- 172.21.15.83:0/3421991586 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f73ec106ef0 msgr2=0x7f73ec19bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:49.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.104+0000 7f73f0b1f700 1 --2- 172.21.15.83:0/3421991586 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f73ec106ef0 0x7f73ec19bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:49.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.104+0000 7f73f0b1f700 1 -- 172.21.15.83:0/3421991586 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e80095f0 con 0x7f73ec101820 2024-04-01T06:54:49.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.105+0000 7f73f0b1f700 1 --2- 172.21.15.83:0/3421991586 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f73ec101820 0x7f73ec197780 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f73e8009990 tx=0x7f73e8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:49.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.105+0000 7f73e27fc700 1 -- 172.21.15.83:0/3421991586 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e801d070 con 0x7f73ec101820 2024-04-01T06:54:49.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.105+0000 7f73f3584700 1 -- 172.21.15.83:0/3421991586 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73ec19c6f0 con 0x7f73ec101820 2024-04-01T06:54:49.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.105+0000 7f73e27fc700 1 -- 172.21.15.83:0/3421991586 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f73e8004ca0 con 0x7f73ec101820 2024-04-01T06:54:49.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.105+0000 7f73e27fc700 1 -- 172.21.15.83:0/3421991586 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e800f8d0 con 0x7f73ec101820 2024-04-01T06:54:49.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.105+0000 7f73f3584700 1 -- 172.21.15.83:0/3421991586 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73ec1a3fb0 con 0x7f73ec101820 2024-04-01T06:54:49.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.106+0000 7f73f3584700 1 -- 172.21.15.83:0/3421991586 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f73ec1110f0 con 0x7f73ec101820 2024-04-01T06:54:49.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.107+0000 7f73e27fc700 1 -- 172.21.15.83:0/3421991586 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f73e8005000 con 0x7f73ec101820 2024-04-01T06:54:49.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.107+0000 7f73e27fc700 1 --2- 172.21.15.83:0/3421991586 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f73d80a11b0 0x7f73d80a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:49.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.107+0000 7f73f1320700 1 --2- 172.21.15.83:0/3421991586 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f73d80a11b0 0x7f73d80a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:49.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.108+0000 7f73e27fc700 1 -- 172.21.15.83:0/3421991586 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f73e80cddb0 con 0x7f73ec101820 2024-04-01T06:54:49.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.108+0000 7f73e27fc700 1 --2- 172.21.15.83:0/3421991586 >> [v2:172.21.15.145:6816/3737505059,v1:172.21.15.145:6817/3737505059] conn(0x7f73d80aa990 0x7f73d80acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:49.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.108+0000 7f73e27fc700 1 -- 172.21.15.83:0/3421991586 --> [v2:172.21.15.145:6816/3737505059,v1:172.21.15.145:6817/3737505059] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f73d80ad460 con 0x7f73d80aa990 2024-04-01T06:54:49.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.108+0000 7f73e27fc700 1 -- 172.21.15.83:0/3421991586 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7f73e80ce250 con 0x7f73ec101820 2024-04-01T06:54:49.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.108+0000 7f73f1320700 1 --2- 172.21.15.83:0/3421991586 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f73d80a11b0 0x7f73d80a3670 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f73dc005950 tx=0x7f73dc00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:49.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.108+0000 7f73f1b21700 1 --2- 172.21.15.83:0/3421991586 >> [v2:172.21.15.145:6816/3737505059,v1:172.21.15.145:6817/3737505059] conn(0x7f73d80aa990 0x7f73d80acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:49.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.108+0000 7f73f1b21700 1 --2- 172.21.15.83:0/3421991586 >> [v2:172.21.15.145:6816/3737505059,v1:172.21.15.145:6817/3737505059] conn(0x7f73d80aa990 0x7f73d80acdb0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:49.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.109+0000 7f73e27fc700 1 -- 172.21.15.83:0/3421991586 <== osd.7 v2:172.21.15.145:6816/3737505059 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f73d80ad460 con 0x7f73d80aa990 2024-04-01T06:54:49.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.124+0000 7f73f3584700 1 -- 172.21.15.83:0/3421991586 --> [v2:172.21.15.145:6816/3737505059,v1:172.21.15.145:6817/3737505059] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f73ec061430 con 0x7f73d80aa990 2024-04-01T06:54:49.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.125+0000 7f73e27fc700 1 -- 172.21.15.83:0/3421991586 <== osd.7 v2:172.21.15.145:6816/3737505059 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f73ec061430 con 0x7f73d80aa990 2024-04-01T06:54:49.127 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.125+0000 7f73f3584700 1 -- 172.21.15.83:0/3421991586 >> [v2:172.21.15.145:6816/3737505059,v1:172.21.15.145:6817/3737505059] conn(0x7f73d80aa990 msgr2=0x7f73d80acdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:49.127 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.125+0000 7f73f3584700 1 --2- 172.21.15.83:0/3421991586 >> [v2:172.21.15.145:6816/3737505059,v1:172.21.15.145:6817/3737505059] conn(0x7f73d80aa990 0x7f73d80acdb0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:49.127 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.125+0000 7f73f3584700 1 -- 172.21.15.83:0/3421991586 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f73d80a11b0 msgr2=0x7f73d80a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:49.127 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.125+0000 7f73f3584700 1 --2- 172.21.15.83:0/3421991586 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f73d80a11b0 0x7f73d80a3670 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f73dc005950 tx=0x7f73dc00b410 comp rx=0 tx=0).stop 2024-04-01T06:54:49.127 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.126+0000 7f73f3584700 1 -- 172.21.15.83:0/3421991586 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f73ec101820 msgr2=0x7f73ec197780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:49.127 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.126+0000 7f73f3584700 1 --2- 172.21.15.83:0/3421991586 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f73ec101820 0x7f73ec197780 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f73e8009990 tx=0x7f73e8004730 comp rx=0 tx=0).stop 2024-04-01T06:54:49.128 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.126+0000 7f73f1b21700 1 -- 172.21.15.83:0/3421991586 reap_dead start 2024-04-01T06:54:49.128 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.126+0000 7f73f3584700 1 -- 172.21.15.83:0/3421991586 shutdown_connections 2024-04-01T06:54:49.128 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.126+0000 7f73f3584700 1 -- 172.21.15.83:0/3421991586 >> 172.21.15.83:0/3421991586 conn(0x7f73ec077fa0 msgr2=0x7f73ec0ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:49.128 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.126+0000 7f73f3584700 1 -- 172.21.15.83:0/3421991586 shutdown_connections 2024-04-01T06:54:49.128 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:49.126+0000 7f73f3584700 1 -- 172.21.15.83:0/3421991586 wait complete. 2024-04-01T06:54:49.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:48 smithi153 ceph-mon[48187]: pgmap v226: 97 pgs: 97 active+clean; 635 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.1 KiB/s wr, 12 op/s 2024-04-01T06:54:49.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:48 smithi145 ceph-mon[47816]: pgmap v226: 97 pgs: 97 active+clean; 635 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.1 KiB/s wr, 12 op/s 2024-04-01T06:54:49.494 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:54:50.110 INFO:teuthology.orchestra.run.smithi083.stdout:206158430234 2024-04-01T06:54:50.110 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.7 2024-04-01T06:54:50.752 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:54:50.791 INFO:teuthology.orchestra.run.smithi083.stdout:154618822691 2024-04-01T06:54:50.791 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.5 2024-04-01T06:54:51.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:50 smithi083 ceph-mon[43429]: pgmap v227: 97 pgs: 97 active+clean; 635 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 5.2 KiB/s wr, 9 op/s 2024-04-01T06:54:51.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.354+0000 7f8431954700 1 -- 172.21.15.83:0/816384768 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f842c100e60 msgr2=0x7f842c1012e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:51.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.354+0000 7f8431954700 1 --2- 172.21.15.83:0/816384768 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f842c100e60 0x7f842c1012e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f84200099c0 tx=0x7f8420009cd0 comp rx=0 tx=0).stop 2024-04-01T06:54:51.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.354+0000 7f8431954700 1 -- 172.21.15.83:0/816384768 shutdown_connections 2024-04-01T06:54:51.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.354+0000 7f8431954700 1 --2- 172.21.15.83:0/816384768 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f842c101820 0x7f842c10dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:51.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.354+0000 7f8431954700 1 --2- 172.21.15.83:0/816384768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f842c106ef0 0x7f842c1072d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:51.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.354+0000 7f8431954700 1 --2- 172.21.15.83:0/816384768 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f842c100e60 0x7f842c1012e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:51.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.354+0000 7f8431954700 1 -- 172.21.15.83:0/816384768 >> 172.21.15.83:0/816384768 conn(0x7f842c077fa0 msgr2=0x7f842c0783b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:51.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.355+0000 7f8431954700 1 -- 172.21.15.83:0/816384768 shutdown_connections 2024-04-01T06:54:51.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.355+0000 7f8431954700 1 -- 172.21.15.83:0/816384768 wait complete. 2024-04-01T06:54:51.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.355+0000 7f8431954700 1 Processor -- start 2024-04-01T06:54:51.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.355+0000 7f8431954700 1 -- start start 2024-04-01T06:54:51.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.355+0000 7f8431954700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f842c100e60 0x7f842c0730b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:51.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.355+0000 7f8431954700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f842c101820 0x7f842c0735f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:51.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.355+0000 7f8431954700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f842c106ef0 0x7f842c073b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:51.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.355+0000 7f8431954700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842c1a5510 con 0x7f842c100e60 2024-04-01T06:54:51.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.355+0000 7f8431954700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842c1a5680 con 0x7f842c106ef0 2024-04-01T06:54:51.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.355+0000 7f8431954700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842c1a5840 con 0x7f842c101820 2024-04-01T06:54:51.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.356+0000 7f842affd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f842c100e60 0x7f842c0730b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:51.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.356+0000 7f842affd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f842c100e60 0x7f842c0730b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:60100/0 (socket says 172.21.15.83:60100) 2024-04-01T06:54:51.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.356+0000 7f842affd700 1 -- 172.21.15.83:0/270852502 learned_addr learned my addr 172.21.15.83:0/270852502 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:54:51.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.356+0000 7f842a7fc700 1 --2- 172.21.15.83:0/270852502 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f842c101820 0x7f842c0735f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:51.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.356+0000 7f842affd700 1 -- 172.21.15.83:0/270852502 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f842c101820 msgr2=0x7f842c0735f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:51.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.356+0000 7f842affd700 1 --2- 172.21.15.83:0/270852502 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f842c101820 0x7f842c0735f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:51.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.356+0000 7f842affd700 1 -- 172.21.15.83:0/270852502 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f842c106ef0 msgr2=0x7f842c073b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:51.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.356+0000 7f842affd700 1 --2- 172.21.15.83:0/270852502 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f842c106ef0 0x7f842c073b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:51.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.356+0000 7f842affd700 1 -- 172.21.15.83:0/270852502 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84200095f0 con 0x7f842c100e60 2024-04-01T06:54:51.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.356+0000 7f842a7fc700 1 --2- 172.21.15.83:0/270852502 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f842c101820 0x7f842c0735f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:54:51.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.356+0000 7f842affd700 1 --2- 172.21.15.83:0/270852502 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f842c100e60 0x7f842c0730b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f841c00c920 tx=0x7f841c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:51.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.356+0000 7f8430952700 1 -- 172.21.15.83:0/270852502 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841c007b00 con 0x7f842c100e60 2024-04-01T06:54:51.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.356+0000 7f8431954700 1 -- 172.21.15.83:0/270852502 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f842c1a5b20 con 0x7f842c100e60 2024-04-01T06:54:51.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.356+0000 7f8430952700 1 -- 172.21.15.83:0/270852502 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f841c004cf0 con 0x7f842c100e60 2024-04-01T06:54:51.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.356+0000 7f8430952700 1 -- 172.21.15.83:0/270852502 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841c005520 con 0x7f842c100e60 2024-04-01T06:54:51.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.356+0000 7f8431954700 1 -- 172.21.15.83:0/270852502 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f842c1a6070 con 0x7f842c100e60 2024-04-01T06:54:51.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.357+0000 7f8431954700 1 -- 172.21.15.83:0/270852502 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f842c1024f0 con 0x7f842c100e60 2024-04-01T06:54:51.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.358+0000 7f8430952700 1 -- 172.21.15.83:0/270852502 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f841c004750 con 0x7f842c100e60 2024-04-01T06:54:51.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.359+0000 7f8430952700 1 --2- 172.21.15.83:0/270852502 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f84140a11b0 0x7f84140a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:51.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.359+0000 7f842a7fc700 1 --2- 172.21.15.83:0/270852502 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f84140a11b0 0x7f84140a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:51.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.359+0000 7f8430952700 1 -- 172.21.15.83:0/270852502 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f841c0cc930 con 0x7f842c100e60 2024-04-01T06:54:51.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.359+0000 7f8430952700 1 --2- 172.21.15.83:0/270852502 >> [v2:172.21.15.153:6800/3318516728,v1:172.21.15.153:6801/3318516728] conn(0x7f84140aa990 0x7f84140acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:51.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.359+0000 7f8430952700 1 -- 172.21.15.83:0/270852502 --> [v2:172.21.15.153:6800/3318516728,v1:172.21.15.153:6801/3318516728] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f84140ad460 con 0x7f84140aa990 2024-04-01T06:54:51.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.359+0000 7f8430952700 1 -- 172.21.15.83:0/270852502 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7f841c0ccdd0 con 0x7f842c100e60 2024-04-01T06:54:51.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.359+0000 7f842a7fc700 1 --2- 172.21.15.83:0/270852502 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f84140a11b0 0x7f84140a3670 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8420006010 tx=0x7f8420009f10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:51.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.359+0000 7f842b7fe700 1 --2- 172.21.15.83:0/270852502 >> [v2:172.21.15.153:6800/3318516728,v1:172.21.15.153:6801/3318516728] conn(0x7f84140aa990 0x7f84140acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:51.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.360+0000 7f842b7fe700 1 --2- 172.21.15.83:0/270852502 >> [v2:172.21.15.153:6800/3318516728,v1:172.21.15.153:6801/3318516728] conn(0x7f84140aa990 0x7f84140acdb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:51.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.360+0000 7f8430952700 1 -- 172.21.15.83:0/270852502 <== osd.2 v2:172.21.15.153:6800/3318516728 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f84140ad460 con 0x7f84140aa990 2024-04-01T06:54:51.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.380+0000 7f8431954700 1 -- 172.21.15.83:0/270852502 --> [v2:172.21.15.153:6800/3318516728,v1:172.21.15.153:6801/3318516728] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f842c110f80 con 0x7f84140aa990 2024-04-01T06:54:51.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.381+0000 7f8430952700 1 -- 172.21.15.83:0/270852502 <== osd.2 v2:172.21.15.153:6800/3318516728 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f842c110f80 con 0x7f84140aa990 2024-04-01T06:54:51.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.381+0000 7f8431954700 1 -- 172.21.15.83:0/270852502 >> [v2:172.21.15.153:6800/3318516728,v1:172.21.15.153:6801/3318516728] conn(0x7f84140aa990 msgr2=0x7f84140acdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:51.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.381+0000 7f8431954700 1 --2- 172.21.15.83:0/270852502 >> [v2:172.21.15.153:6800/3318516728,v1:172.21.15.153:6801/3318516728] conn(0x7f84140aa990 0x7f84140acdb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:51.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.381+0000 7f8431954700 1 -- 172.21.15.83:0/270852502 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f84140a11b0 msgr2=0x7f84140a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:51.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.381+0000 7f8431954700 1 --2- 172.21.15.83:0/270852502 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f84140a11b0 0x7f84140a3670 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8420006010 tx=0x7f8420009f10 comp rx=0 tx=0).stop 2024-04-01T06:54:51.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.381+0000 7f8431954700 1 -- 172.21.15.83:0/270852502 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f842c100e60 msgr2=0x7f842c0730b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:51.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.381+0000 7f8431954700 1 --2- 172.21.15.83:0/270852502 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f842c100e60 0x7f842c0730b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f841c00c920 tx=0x7f841c00cce0 comp rx=0 tx=0).stop 2024-04-01T06:54:51.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.381+0000 7f842b7fe700 1 -- 172.21.15.83:0/270852502 reap_dead start 2024-04-01T06:54:51.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.381+0000 7f8431954700 1 -- 172.21.15.83:0/270852502 shutdown_connections 2024-04-01T06:54:51.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.381+0000 7f8431954700 1 -- 172.21.15.83:0/270852502 >> 172.21.15.83:0/270852502 conn(0x7f842c077fa0 msgr2=0x7f842c0ffba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:51.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.382+0000 7f8431954700 1 -- 172.21.15.83:0/270852502 shutdown_connections 2024-04-01T06:54:51.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:50.382+0000 7f8431954700 1 -- 172.21.15.83:0/270852502 wait complete. 2024-04-01T06:54:51.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:50 smithi153 ceph-mon[48187]: pgmap v227: 97 pgs: 97 active+clean; 635 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 5.2 KiB/s wr, 9 op/s 2024-04-01T06:54:51.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:50 smithi145 ceph-mon[47816]: pgmap v227: 97 pgs: 97 active+clean; 635 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 5.2 KiB/s wr, 9 op/s 2024-04-01T06:54:51.406 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:54:51.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.700+0000 7f8db2f72700 1 -- 172.21.15.83:0/3448923079 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8dac106ec0 msgr2=0x7f8dac1072a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:51.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.700+0000 7f8db2f72700 1 --2- 172.21.15.83:0/3448923079 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8dac106ec0 0x7f8dac1072a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c009990 tx=0x7f8d9c009ca0 comp rx=0 tx=0).stop 2024-04-01T06:54:51.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.700+0000 7f8db2f72700 1 -- 172.21.15.83:0/3448923079 shutdown_connections 2024-04-01T06:54:51.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.700+0000 7f8db2f72700 1 --2- 172.21.15.83:0/3448923079 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8dac106ec0 0x7f8dac1072a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:51.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.700+0000 7f8db2f72700 1 --2- 172.21.15.83:0/3448923079 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8dac069100 0x7f8dac10db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:51.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.700+0000 7f8db2f72700 1 --2- 172.21.15.83:0/3448923079 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8dac068740 0x7f8dac068bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:51.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.700+0000 7f8db2f72700 1 -- 172.21.15.83:0/3448923079 >> 172.21.15.83:0/3448923079 conn(0x7f8dac076db0 msgr2=0x7f8dac0771c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:51.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.701+0000 7f8db2f72700 1 -- 172.21.15.83:0/3448923079 shutdown_connections 2024-04-01T06:54:51.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.701+0000 7f8db2f72700 1 -- 172.21.15.83:0/3448923079 wait complete. 2024-04-01T06:54:51.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.701+0000 7f8db2f72700 1 Processor -- start 2024-04-01T06:54:51.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.701+0000 7f8db2f72700 1 -- start start 2024-04-01T06:54:51.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.701+0000 7f8db2f72700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8dac068740 0x7f8dac1970f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:51.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.701+0000 7f8db2f72700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8dac069100 0x7f8dac197630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:51.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.701+0000 7f8db2f72700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8dac106ec0 0x7f8dac19b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:51.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.701+0000 7f8db2f72700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dac19bff0 con 0x7f8dac068740 2024-04-01T06:54:51.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.701+0000 7f8db2f72700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dac19c160 con 0x7f8dac106ec0 2024-04-01T06:54:51.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.701+0000 7f8db2f72700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dac19c320 con 0x7f8dac069100 2024-04-01T06:54:51.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.702+0000 7f8db0d0e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8dac068740 0x7f8dac1970f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:51.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.702+0000 7f8db0d0e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8dac068740 0x7f8dac1970f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:60138/0 (socket says 172.21.15.83:60138) 2024-04-01T06:54:51.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.702+0000 7f8db0d0e700 1 -- 172.21.15.83:0/4294110888 learned_addr learned my addr 172.21.15.83:0/4294110888 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:54:51.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.702+0000 7f8dabfff700 1 --2- 172.21.15.83:0/4294110888 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8dac069100 0x7f8dac197630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:51.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.702+0000 7f8db150f700 1 --2- 172.21.15.83:0/4294110888 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8dac106ec0 0x7f8dac19b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:51.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.702+0000 7f8db0d0e700 1 -- 172.21.15.83:0/4294110888 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8dac069100 msgr2=0x7f8dac197630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:51.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.702+0000 7f8db0d0e700 1 --2- 172.21.15.83:0/4294110888 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8dac069100 0x7f8dac197630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:51.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.702+0000 7f8db0d0e700 1 -- 172.21.15.83:0/4294110888 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8dac106ec0 msgr2=0x7f8dac19b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:51.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.702+0000 7f8db0d0e700 1 --2- 172.21.15.83:0/4294110888 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8dac106ec0 0x7f8dac19b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:51.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.702+0000 7f8db0d0e700 1 -- 172.21.15.83:0/4294110888 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d9c0095f0 con 0x7f8dac068740 2024-04-01T06:54:51.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.702+0000 7f8db0d0e700 1 --2- 172.21.15.83:0/4294110888 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8dac068740 0x7f8dac1970f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c0095c0 tx=0x7f8d9c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:51.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.702+0000 7f8da9ffb700 1 -- 172.21.15.83:0/4294110888 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c01d070 con 0x7f8dac068740 2024-04-01T06:54:51.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.702+0000 7f8da9ffb700 1 -- 172.21.15.83:0/4294110888 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8d9c005030 con 0x7f8dac068740 2024-04-01T06:54:51.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.702+0000 7f8db2f72700 1 -- 172.21.15.83:0/4294110888 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dac19c5a0 con 0x7f8dac068740 2024-04-01T06:54:51.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.702+0000 7f8da9ffb700 1 -- 172.21.15.83:0/4294110888 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c004a90 con 0x7f8dac068740 2024-04-01T06:54:51.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.702+0000 7f8db2f72700 1 -- 172.21.15.83:0/4294110888 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dac1a3e60 con 0x7f8dac068740 2024-04-01T06:54:51.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.703+0000 7f8db2f72700 1 -- 172.21.15.83:0/4294110888 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8dac110f60 con 0x7f8dac068740 2024-04-01T06:54:51.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.704+0000 7f8da9ffb700 1 -- 172.21.15.83:0/4294110888 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f8d9c005410 con 0x7f8dac068740 2024-04-01T06:54:51.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.705+0000 7f8da9ffb700 1 --2- 172.21.15.83:0/4294110888 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f8d940a1230 0x7f8d940a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:51.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.705+0000 7f8dabfff700 1 --2- 172.21.15.83:0/4294110888 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f8d940a1230 0x7f8d940a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:51.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.705+0000 7f8da9ffb700 1 -- 172.21.15.83:0/4294110888 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f8d9c0cddb0 con 0x7f8dac068740 2024-04-01T06:54:51.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.705+0000 7f8da9ffb700 1 --2- 172.21.15.83:0/4294110888 >> [v2:172.21.15.145:6808/2099824730,v1:172.21.15.145:6809/2099824730] conn(0x7f8d940aaa10 0x7f8d940ace30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:51.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.705+0000 7f8da9ffb700 1 -- 172.21.15.83:0/4294110888 --> [v2:172.21.15.145:6808/2099824730,v1:172.21.15.145:6809/2099824730] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8d940ad4e0 con 0x7f8d940aaa10 2024-04-01T06:54:51.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.705+0000 7f8da9ffb700 1 -- 172.21.15.83:0/4294110888 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d9c0ce120 con 0x7f8dac068740 2024-04-01T06:54:51.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.705+0000 7f8dabfff700 1 --2- 172.21.15.83:0/4294110888 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f8d940a1230 0x7f8d940a36f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8dac198650 tx=0x7f8da000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:51.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.706+0000 7f8db150f700 1 --2- 172.21.15.83:0/4294110888 >> [v2:172.21.15.145:6808/2099824730,v1:172.21.15.145:6809/2099824730] conn(0x7f8d940aaa10 0x7f8d940ace30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:51.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.706+0000 7f8db150f700 1 --2- 172.21.15.83:0/4294110888 >> [v2:172.21.15.145:6808/2099824730,v1:172.21.15.145:6809/2099824730] conn(0x7f8d940aaa10 0x7f8d940ace30 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:51.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.707+0000 7f8da9ffb700 1 -- 172.21.15.83:0/4294110888 <== osd.4 v2:172.21.15.145:6808/2099824730 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f8d940ad4e0 con 0x7f8d940aaa10 2024-04-01T06:54:51.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.722+0000 7f8db2f72700 1 -- 172.21.15.83:0/4294110888 --> [v2:172.21.15.145:6808/2099824730,v1:172.21.15.145:6809/2099824730] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8dac102470 con 0x7f8d940aaa10 2024-04-01T06:54:51.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.723+0000 7f8da9ffb700 1 -- 172.21.15.83:0/4294110888 <== osd.4 v2:172.21.15.145:6808/2099824730 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f8dac102470 con 0x7f8d940aaa10 2024-04-01T06:54:51.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.723+0000 7f8db2f72700 1 -- 172.21.15.83:0/4294110888 >> [v2:172.21.15.145:6808/2099824730,v1:172.21.15.145:6809/2099824730] conn(0x7f8d940aaa10 msgr2=0x7f8d940ace30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:51.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.723+0000 7f8db2f72700 1 --2- 172.21.15.83:0/4294110888 >> [v2:172.21.15.145:6808/2099824730,v1:172.21.15.145:6809/2099824730] conn(0x7f8d940aaa10 0x7f8d940ace30 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:51.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.723+0000 7f8db2f72700 1 -- 172.21.15.83:0/4294110888 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f8d940a1230 msgr2=0x7f8d940a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:51.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.723+0000 7f8db2f72700 1 --2- 172.21.15.83:0/4294110888 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f8d940a1230 0x7f8d940a36f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8dac198650 tx=0x7f8da000b410 comp rx=0 tx=0).stop 2024-04-01T06:54:51.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.723+0000 7f8db2f72700 1 -- 172.21.15.83:0/4294110888 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8dac068740 msgr2=0x7f8dac1970f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:51.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.723+0000 7f8db2f72700 1 --2- 172.21.15.83:0/4294110888 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8dac068740 0x7f8dac1970f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c0095c0 tx=0x7f8d9c00f690 comp rx=0 tx=0).stop 2024-04-01T06:54:51.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.723+0000 7f8db150f700 1 -- 172.21.15.83:0/4294110888 reap_dead start 2024-04-01T06:54:51.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.723+0000 7f8db2f72700 1 -- 172.21.15.83:0/4294110888 shutdown_connections 2024-04-01T06:54:51.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.723+0000 7f8db2f72700 1 -- 172.21.15.83:0/4294110888 >> 172.21.15.83:0/4294110888 conn(0x7f8dac076db0 msgr2=0x7f8dac0fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:51.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.724+0000 7f8db2f72700 1 -- 172.21.15.83:0/4294110888 shutdown_connections 2024-04-01T06:54:51.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.724+0000 7f8db2f72700 1 -- 172.21.15.83:0/4294110888 wait complete. 2024-04-01T06:54:51.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.600+0000 7f4500517700 1 -- 172.21.15.83:0/54332029 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f44f8105e90 msgr2=0x7f44f8106270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:51.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.600+0000 7f4500517700 1 --2- 172.21.15.83:0/54332029 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f44f8105e90 0x7f44f8106270 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f44f4009990 tx=0x7f44f4009ca0 comp rx=0 tx=0).stop 2024-04-01T06:54:51.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.600+0000 7f4500517700 1 -- 172.21.15.83:0/54332029 shutdown_connections 2024-04-01T06:54:51.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.600+0000 7f4500517700 1 --2- 172.21.15.83:0/54332029 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f44f8105e90 0x7f44f8106270 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:51.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.600+0000 7f4500517700 1 --2- 172.21.15.83:0/54332029 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f44f81000f0 0x7f44f810db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:51.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.600+0000 7f4500517700 1 --2- 172.21.15.83:0/54332029 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44f80ff750 0x7f44f80ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:51.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.600+0000 7f4500517700 1 -- 172.21.15.83:0/54332029 >> 172.21.15.83:0/54332029 conn(0x7f44f8074fd0 msgr2=0x7f44f80753e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:51.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.600+0000 7f4500517700 1 -- 172.21.15.83:0/54332029 shutdown_connections 2024-04-01T06:54:51.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.600+0000 7f4500517700 1 -- 172.21.15.83:0/54332029 wait complete. 2024-04-01T06:54:51.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.601+0000 7f4500517700 1 Processor -- start 2024-04-01T06:54:51.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.601+0000 7f4500517700 1 -- start start 2024-04-01T06:54:51.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.601+0000 7f4500517700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44f80ff750 0x7f44f8199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:51.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.601+0000 7f4500517700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f44f81000f0 0x7f44f8199980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:51.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.601+0000 7f4500517700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f44f8105e90 0x7f44f819dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:51.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.601+0000 7f4500517700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f819e340 con 0x7f44f81000f0 2024-04-01T06:54:51.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.601+0000 7f4500517700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f819e4b0 con 0x7f44f8105e90 2024-04-01T06:54:51.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.601+0000 7f4500517700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f819e670 con 0x7f44f80ff750 2024-04-01T06:54:51.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.601+0000 7f44fdab2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f44f81000f0 0x7f44f8199980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:51.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.601+0000 7f44fdab2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f44f81000f0 0x7f44f8199980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:60124/0 (socket says 172.21.15.83:60124) 2024-04-01T06:54:51.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.601+0000 7f44fdab2700 1 -- 172.21.15.83:0/3858436356 learned_addr learned my addr 172.21.15.83:0/3858436356 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:54:51.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.601+0000 7f44feab4700 1 --2- 172.21.15.83:0/3858436356 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f44f8105e90 0x7f44f819dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:51.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.601+0000 7f44fe2b3700 1 --2- 172.21.15.83:0/3858436356 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44f80ff750 0x7f44f8199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:51.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.602+0000 7f44fdab2700 1 -- 172.21.15.83:0/3858436356 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44f80ff750 msgr2=0x7f44f8199440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:51.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.602+0000 7f44fdab2700 1 --2- 172.21.15.83:0/3858436356 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44f80ff750 0x7f44f8199440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:51.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.602+0000 7f44fdab2700 1 -- 172.21.15.83:0/3858436356 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f44f8105e90 msgr2=0x7f44f819dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:51.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.602+0000 7f44fdab2700 1 --2- 172.21.15.83:0/3858436356 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f44f8105e90 0x7f44f819dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:51.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.602+0000 7f44fdab2700 1 -- 172.21.15.83:0/3858436356 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f40095f0 con 0x7f44f81000f0 2024-04-01T06:54:51.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.602+0000 7f44fe2b3700 1 --2- 172.21.15.83:0/3858436356 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44f80ff750 0x7f44f8199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:54:51.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.602+0000 7f44fdab2700 1 --2- 172.21.15.83:0/3858436356 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f44f81000f0 0x7f44f8199980 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f44e800b530 tx=0x7f44e800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:51.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.602+0000 7f44ef7fe700 1 -- 172.21.15.83:0/3858436356 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e8011830 con 0x7f44f81000f0 2024-04-01T06:54:51.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.602+0000 7f44ef7fe700 1 -- 172.21.15.83:0/3858436356 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f44e8011e50 con 0x7f44f81000f0 2024-04-01T06:54:51.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.602+0000 7f44ef7fe700 1 -- 172.21.15.83:0/3858436356 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e800f2e0 con 0x7f44f81000f0 2024-04-01T06:54:51.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.602+0000 7f4500517700 1 -- 172.21.15.83:0/3858436356 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44f819e950 con 0x7f44f81000f0 2024-04-01T06:54:51.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.602+0000 7f4500517700 1 -- 172.21.15.83:0/3858436356 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44f81a61b0 con 0x7f44f81000f0 2024-04-01T06:54:51.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.603+0000 7f4500517700 1 -- 172.21.15.83:0/3858436356 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f44f8111000 con 0x7f44f81000f0 2024-04-01T06:54:51.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.604+0000 7f44ef7fe700 1 -- 172.21.15.83:0/3858436356 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f44e8010580 con 0x7f44f81000f0 2024-04-01T06:54:51.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.604+0000 7f44ef7fe700 1 --2- 172.21.15.83:0/3858436356 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f44e40a1230 0x7f44e40a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:51.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.605+0000 7f44fe2b3700 1 --2- 172.21.15.83:0/3858436356 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f44e40a1230 0x7f44e40a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:51.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.605+0000 7f44ef7fe700 1 -- 172.21.15.83:0/3858436356 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f44e80cc8e0 con 0x7f44f81000f0 2024-04-01T06:54:51.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.605+0000 7f44ef7fe700 1 --2- 172.21.15.83:0/3858436356 >> [v2:172.21.15.153:6816/1031545791,v1:172.21.15.153:6817/1031545791] conn(0x7f44e40aaa10 0x7f44e40ace30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:51.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.605+0000 7f44ef7fe700 1 -- 172.21.15.83:0/3858436356 --> [v2:172.21.15.153:6816/1031545791,v1:172.21.15.153:6817/1031545791] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f44e40ad4e0 con 0x7f44e40aaa10 2024-04-01T06:54:51.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.605+0000 7f44ef7fe700 1 -- 172.21.15.83:0/3858436356 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7f44e80ccd80 con 0x7f44f81000f0 2024-04-01T06:54:51.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.605+0000 7f44fe2b3700 1 --2- 172.21.15.83:0/3858436356 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f44e40a1230 0x7f44e40a36f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f44f400b5c0 tx=0x7f44f4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:51.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.605+0000 7f44feab4700 1 --2- 172.21.15.83:0/3858436356 >> [v2:172.21.15.153:6816/1031545791,v1:172.21.15.153:6817/1031545791] conn(0x7f44e40aaa10 0x7f44e40ace30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:51.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.606+0000 7f44feab4700 1 --2- 172.21.15.83:0/3858436356 >> [v2:172.21.15.153:6816/1031545791,v1:172.21.15.153:6817/1031545791] conn(0x7f44e40aaa10 0x7f44e40ace30 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:51.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.606+0000 7f44ef7fe700 1 -- 172.21.15.83:0/3858436356 <== osd.8 v2:172.21.15.153:6816/1031545791 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f44e40ad4e0 con 0x7f44e40aaa10 2024-04-01T06:54:51.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.624+0000 7f4500517700 1 -- 172.21.15.83:0/3858436356 --> [v2:172.21.15.153:6816/1031545791,v1:172.21.15.153:6817/1031545791] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f44f80feb30 con 0x7f44e40aaa10 2024-04-01T06:54:51.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.625+0000 7f44ef7fe700 1 -- 172.21.15.83:0/3858436356 <== osd.8 v2:172.21.15.153:6816/1031545791 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f44f80feb30 con 0x7f44e40aaa10 2024-04-01T06:54:51.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.625+0000 7f4500517700 1 -- 172.21.15.83:0/3858436356 >> [v2:172.21.15.153:6816/1031545791,v1:172.21.15.153:6817/1031545791] conn(0x7f44e40aaa10 msgr2=0x7f44e40ace30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:51.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.625+0000 7f4500517700 1 --2- 172.21.15.83:0/3858436356 >> [v2:172.21.15.153:6816/1031545791,v1:172.21.15.153:6817/1031545791] conn(0x7f44e40aaa10 0x7f44e40ace30 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:51.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.625+0000 7f4500517700 1 -- 172.21.15.83:0/3858436356 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f44e40a1230 msgr2=0x7f44e40a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:51.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.625+0000 7f4500517700 1 --2- 172.21.15.83:0/3858436356 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f44e40a1230 0x7f44e40a36f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f44f400b5c0 tx=0x7f44f4005fb0 comp rx=0 tx=0).stop 2024-04-01T06:54:51.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.625+0000 7f4500517700 1 -- 172.21.15.83:0/3858436356 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f44f81000f0 msgr2=0x7f44f8199980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:51.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.625+0000 7f4500517700 1 --2- 172.21.15.83:0/3858436356 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f44f81000f0 0x7f44f8199980 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f44e800b530 tx=0x7f44e800b8f0 comp rx=0 tx=0).stop 2024-04-01T06:54:51.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.625+0000 7f44feab4700 1 -- 172.21.15.83:0/3858436356 reap_dead start 2024-04-01T06:54:51.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.625+0000 7f4500517700 1 -- 172.21.15.83:0/3858436356 shutdown_connections 2024-04-01T06:54:51.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.625+0000 7f4500517700 1 -- 172.21.15.83:0/3858436356 >> 172.21.15.83:0/3858436356 conn(0x7f44f8074fd0 msgr2=0x7f44f80fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:51.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.625+0000 7f4500517700 1 -- 172.21.15.83:0/3858436356 shutdown_connections 2024-04-01T06:54:51.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:51.625+0000 7f4500517700 1 -- 172.21.15.83:0/3858436356 wait complete. 2024-04-01T06:54:51.934 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:54:52.387 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.249+0000 7f2fa7e15700 1 -- 172.21.15.83:0/1963313704 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2fa00fff70 msgr2=0x7f2fa0100350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:52.387 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.249+0000 7f2fa7e15700 1 --2- 172.21.15.83:0/1963313704 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2fa00fff70 0x7f2fa0100350 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2f94009990 tx=0x7f2f94009ca0 comp rx=0 tx=0).stop 2024-04-01T06:54:52.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.249+0000 7f2fa7e15700 1 -- 172.21.15.83:0/1963313704 shutdown_connections 2024-04-01T06:54:52.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.249+0000 7f2fa7e15700 1 --2- 172.21.15.83:0/1963313704 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2fa00fff70 0x7f2fa0100350 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:52.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.249+0000 7f2fa7e15700 1 --2- 172.21.15.83:0/1963313704 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2fa0104fb0 0x7f2fa010cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:52.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.249+0000 7f2fa7e15700 1 --2- 172.21.15.83:0/1963313704 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2fa0100920 0x7f2fa01048d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:52.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.249+0000 7f2fa7e15700 1 -- 172.21.15.83:0/1963313704 >> 172.21.15.83:0/1963313704 conn(0x7f2fa0075d50 msgr2=0x7f2fa0076160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:52.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.249+0000 7f2fa7e15700 1 -- 172.21.15.83:0/1963313704 shutdown_connections 2024-04-01T06:54:52.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.249+0000 7f2fa7e15700 1 -- 172.21.15.83:0/1963313704 wait complete. 2024-04-01T06:54:52.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.250+0000 7f2fa7e15700 1 Processor -- start 2024-04-01T06:54:52.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.250+0000 7f2fa7e15700 1 -- start start 2024-04-01T06:54:52.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.250+0000 7f2fa7e15700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2fa00fff70 0x7f2fa0196170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:52.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.250+0000 7f2fa7e15700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2fa0100920 0x7f2fa01966b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:52.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.250+0000 7f2fa7e15700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2fa0104fb0 0x7f2fa019aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:52.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.250+0000 7f2fa7e15700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa019b070 con 0x7f2fa0104fb0 2024-04-01T06:54:52.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.250+0000 7f2fa7e15700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa019b1e0 con 0x7f2fa00fff70 2024-04-01T06:54:52.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.250+0000 7f2fa7e15700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa019b3a0 con 0x7f2fa0100920 2024-04-01T06:54:52.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.250+0000 7f2fa63b2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2fa0104fb0 0x7f2fa019aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:52.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.250+0000 7f2fa63b2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2fa0104fb0 0x7f2fa019aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:60150/0 (socket says 172.21.15.83:60150) 2024-04-01T06:54:52.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.250+0000 7f2fa63b2700 1 -- 172.21.15.83:0/649333745 learned_addr learned my addr 172.21.15.83:0/649333745 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:54:52.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.250+0000 7f2fa5bb1700 1 --2- 172.21.15.83:0/649333745 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2fa00fff70 0x7f2fa0196170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:52.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.250+0000 7f2fa53b0700 1 --2- 172.21.15.83:0/649333745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2fa0100920 0x7f2fa01966b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:52.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.250+0000 7f2fa63b2700 1 -- 172.21.15.83:0/649333745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2fa0100920 msgr2=0x7f2fa01966b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:52.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.250+0000 7f2fa63b2700 1 --2- 172.21.15.83:0/649333745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2fa0100920 0x7f2fa01966b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:52.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.250+0000 7f2fa63b2700 1 -- 172.21.15.83:0/649333745 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2fa00fff70 msgr2=0x7f2fa0196170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:52.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.250+0000 7f2fa63b2700 1 --2- 172.21.15.83:0/649333745 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2fa00fff70 0x7f2fa0196170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:52.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.250+0000 7f2fa63b2700 1 -- 172.21.15.83:0/649333745 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f940095f0 con 0x7f2fa0104fb0 2024-04-01T06:54:52.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.250+0000 7f2fa5bb1700 1 --2- 172.21.15.83:0/649333745 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2fa00fff70 0x7f2fa0196170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:54:52.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.250+0000 7f2fa53b0700 1 --2- 172.21.15.83:0/649333745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2fa0100920 0x7f2fa01966b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:54:52.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.251+0000 7f2fa63b2700 1 --2- 172.21.15.83:0/649333745 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2fa0104fb0 0x7f2fa019aa60 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2f9800db90 tx=0x7f2f9800df50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:52.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.251+0000 7f2f92ffd700 1 -- 172.21.15.83:0/649333745 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9800e800 con 0x7f2fa0104fb0 2024-04-01T06:54:52.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.251+0000 7f2f92ffd700 1 -- 172.21.15.83:0/649333745 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2f9800bac0 con 0x7f2fa0104fb0 2024-04-01T06:54:52.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.251+0000 7f2fa7e15700 1 -- 172.21.15.83:0/649333745 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fa019b620 con 0x7f2fa0104fb0 2024-04-01T06:54:52.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.251+0000 7f2f92ffd700 1 -- 172.21.15.83:0/649333745 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f980163f0 con 0x7f2fa0104fb0 2024-04-01T06:54:52.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.251+0000 7f2fa7e15700 1 -- 172.21.15.83:0/649333745 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fa0068920 con 0x7f2fa0104fb0 2024-04-01T06:54:52.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.251+0000 7f2fa7e15700 1 -- 172.21.15.83:0/649333745 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2fa019b900 con 0x7f2fa0104fb0 2024-04-01T06:54:52.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.253+0000 7f2f92ffd700 1 -- 172.21.15.83:0/649333745 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f2f98009580 con 0x7f2fa0104fb0 2024-04-01T06:54:52.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.253+0000 7f2f92ffd700 1 --2- 172.21.15.83:0/649333745 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f2f8c0a11b0 0x7f2f8c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:52.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.253+0000 7f2fa5bb1700 1 --2- 172.21.15.83:0/649333745 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f2f8c0a11b0 0x7f2f8c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:52.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.253+0000 7f2f92ffd700 1 -- 172.21.15.83:0/649333745 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f2f98006e40 con 0x7f2fa0104fb0 2024-04-01T06:54:52.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.254+0000 7f2f92ffd700 1 --2- 172.21.15.83:0/649333745 >> [v2:172.21.15.145:6800/515889759,v1:172.21.15.145:6801/515889759] conn(0x7f2f8c0aa990 0x7f2f8c0acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:52.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.254+0000 7f2f92ffd700 1 -- 172.21.15.83:0/649333745 --> [v2:172.21.15.145:6800/515889759,v1:172.21.15.145:6801/515889759] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2f8c0ad460 con 0x7f2f8c0aa990 2024-04-01T06:54:52.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.254+0000 7f2f92ffd700 1 -- 172.21.15.83:0/649333745 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f980ce4f0 con 0x7f2fa0104fb0 2024-04-01T06:54:52.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.254+0000 7f2fa5bb1700 1 --2- 172.21.15.83:0/649333745 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f2f8c0a11b0 0x7f2f8c0a3670 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2f94006010 tx=0x7f2f9401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:52.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.254+0000 7f2fa53b0700 1 --2- 172.21.15.83:0/649333745 >> [v2:172.21.15.145:6800/515889759,v1:172.21.15.145:6801/515889759] conn(0x7f2f8c0aa990 0x7f2f8c0acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:52.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.254+0000 7f2fa53b0700 1 --2- 172.21.15.83:0/649333745 >> [v2:172.21.15.145:6800/515889759,v1:172.21.15.145:6801/515889759] conn(0x7f2f8c0aa990 0x7f2f8c0acdb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:52.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.255+0000 7f2f92ffd700 1 -- 172.21.15.83:0/649333745 <== osd.1 v2:172.21.15.145:6800/515889759 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f2f8c0ad460 con 0x7f2f8c0aa990 2024-04-01T06:54:52.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.272+0000 7f2fa7e15700 1 -- 172.21.15.83:0/649333745 --> [v2:172.21.15.145:6800/515889759,v1:172.21.15.145:6801/515889759] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2fa010fec0 con 0x7f2f8c0aa990 2024-04-01T06:54:52.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.272+0000 7f2f92ffd700 1 -- 172.21.15.83:0/649333745 <== osd.1 v2:172.21.15.145:6800/515889759 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2fa010fec0 con 0x7f2f8c0aa990 2024-04-01T06:54:52.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.273+0000 7f2fa7e15700 1 -- 172.21.15.83:0/649333745 >> [v2:172.21.15.145:6800/515889759,v1:172.21.15.145:6801/515889759] conn(0x7f2f8c0aa990 msgr2=0x7f2f8c0acdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:52.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.273+0000 7f2fa7e15700 1 --2- 172.21.15.83:0/649333745 >> [v2:172.21.15.145:6800/515889759,v1:172.21.15.145:6801/515889759] conn(0x7f2f8c0aa990 0x7f2f8c0acdb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:52.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.273+0000 7f2fa7e15700 1 -- 172.21.15.83:0/649333745 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f2f8c0a11b0 msgr2=0x7f2f8c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:52.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.273+0000 7f2fa7e15700 1 --2- 172.21.15.83:0/649333745 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f2f8c0a11b0 0x7f2f8c0a3670 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2f94006010 tx=0x7f2f9401a040 comp rx=0 tx=0).stop 2024-04-01T06:54:52.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.273+0000 7f2fa7e15700 1 -- 172.21.15.83:0/649333745 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2fa0104fb0 msgr2=0x7f2fa019aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:52.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.273+0000 7f2fa7e15700 1 --2- 172.21.15.83:0/649333745 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2fa0104fb0 0x7f2fa019aa60 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2f9800db90 tx=0x7f2f9800df50 comp rx=0 tx=0).stop 2024-04-01T06:54:52.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.273+0000 7f2fa63b2700 1 -- 172.21.15.83:0/649333745 reap_dead start 2024-04-01T06:54:52.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.273+0000 7f2fa7e15700 1 -- 172.21.15.83:0/649333745 shutdown_connections 2024-04-01T06:54:52.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.273+0000 7f2fa7e15700 1 -- 172.21.15.83:0/649333745 >> 172.21.15.83:0/649333745 conn(0x7f2fa0075d50 msgr2=0x7f2fa00fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:52.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.273+0000 7f2fa7e15700 1 -- 172.21.15.83:0/649333745 shutdown_connections 2024-04-01T06:54:52.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:52.273+0000 7f2fa7e15700 1 -- 172.21.15.83:0/649333745 wait complete. 2024-04-01T06:54:52.710 INFO:teuthology.orchestra.run.smithi083.stdout:137438953511 2024-04-01T06:54:52.710 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.4 2024-04-01T06:54:52.801 INFO:teuthology.orchestra.run.smithi083.stdout:77309411373 2024-04-01T06:54:52.801 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.2 2024-04-01T06:54:52.816 INFO:teuthology.orchestra.run.smithi083.stdout:55834574897 2024-04-01T06:54:52.816 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.1 2024-04-01T06:54:52.868 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:52 smithi083 ceph-mon[43429]: pgmap v228: 97 pgs: 97 active+clean; 635 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-04-01T06:54:53.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:52 smithi153 ceph-mon[48187]: pgmap v228: 97 pgs: 97 active+clean; 635 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-04-01T06:54:53.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:52 smithi145 ceph-mon[47816]: pgmap v228: 97 pgs: 97 active+clean; 635 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-04-01T06:54:53.485 INFO:teuthology.orchestra.run.smithi083.stdout:236223201305 2024-04-01T06:54:53.485 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.8 2024-04-01T06:54:53.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.303+0000 7ffb71b40700 1 -- 172.21.15.83:0/1537802147 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb6c104fb0 msgr2=0x7ffb6c10cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:53.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.303+0000 7ffb71b40700 1 --2- 172.21.15.83:0/1537802147 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb6c104fb0 0x7ffb6c10cb80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ffb6400b0a0 tx=0x7ffb6400b3b0 comp rx=0 tx=0).stop 2024-04-01T06:54:53.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.303+0000 7ffb71b40700 1 -- 172.21.15.83:0/1537802147 shutdown_connections 2024-04-01T06:54:53.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.303+0000 7ffb71b40700 1 --2- 172.21.15.83:0/1537802147 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb6c104fb0 0x7ffb6c10cb80 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:53.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.303+0000 7ffb71b40700 1 --2- 172.21.15.83:0/1537802147 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb6c0fff70 0x7ffb6c100350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:53.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.303+0000 7ffb71b40700 1 --2- 172.21.15.83:0/1537802147 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffb6c100920 0x7ffb6c1048d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:53.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.303+0000 7ffb71b40700 1 -- 172.21.15.83:0/1537802147 >> 172.21.15.83:0/1537802147 conn(0x7ffb6c075d50 msgr2=0x7ffb6c076160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:53.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.303+0000 7ffb71b40700 1 -- 172.21.15.83:0/1537802147 shutdown_connections 2024-04-01T06:54:53.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.303+0000 7ffb71b40700 1 -- 172.21.15.83:0/1537802147 wait complete. 2024-04-01T06:54:53.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.304+0000 7ffb71b40700 1 Processor -- start 2024-04-01T06:54:53.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.304+0000 7ffb71b40700 1 -- start start 2024-04-01T06:54:53.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.304+0000 7ffb71b40700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffb6c0fff70 0x7ffb6c197320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:53.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.304+0000 7ffb71b40700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb6c100920 0x7ffb6c197860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:53.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.304+0000 7ffb71b40700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb6c104fb0 0x7ffb6c19bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:53.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.304+0000 7ffb71b40700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6c19c220 con 0x7ffb6c104fb0 2024-04-01T06:54:53.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.304+0000 7ffb71b40700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6c19c390 con 0x7ffb6c0fff70 2024-04-01T06:54:53.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.304+0000 7ffb71b40700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6c19c550 con 0x7ffb6c100920 2024-04-01T06:54:53.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.304+0000 7ffb6bfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb6c104fb0 0x7ffb6c19bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:53.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.304+0000 7ffb6bfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb6c104fb0 0x7ffb6c19bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:41604/0 (socket says 172.21.15.83:41604) 2024-04-01T06:54:53.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.304+0000 7ffb6bfff700 1 -- 172.21.15.83:0/2625335096 learned_addr learned my addr 172.21.15.83:0/2625335096 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:54:53.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.305+0000 7ffb6b7fe700 1 --2- 172.21.15.83:0/2625335096 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffb6c0fff70 0x7ffb6c197320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:53.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.305+0000 7ffb6affd700 1 --2- 172.21.15.83:0/2625335096 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb6c100920 0x7ffb6c197860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:53.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.305+0000 7ffb6bfff700 1 -- 172.21.15.83:0/2625335096 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb6c100920 msgr2=0x7ffb6c197860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:53.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.305+0000 7ffb6bfff700 1 --2- 172.21.15.83:0/2625335096 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb6c100920 0x7ffb6c197860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:53.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.305+0000 7ffb6bfff700 1 -- 172.21.15.83:0/2625335096 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffb6c0fff70 msgr2=0x7ffb6c197320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:53.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.305+0000 7ffb6bfff700 1 --2- 172.21.15.83:0/2625335096 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffb6c0fff70 0x7ffb6c197320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:53.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.305+0000 7ffb6bfff700 1 -- 172.21.15.83:0/2625335096 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb64009d00 con 0x7ffb6c104fb0 2024-04-01T06:54:53.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.305+0000 7ffb6affd700 1 --2- 172.21.15.83:0/2625335096 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb6c100920 0x7ffb6c197860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:54:53.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.305+0000 7ffb6b7fe700 1 --2- 172.21.15.83:0/2625335096 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffb6c0fff70 0x7ffb6c197320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:54:53.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.305+0000 7ffb6bfff700 1 --2- 172.21.15.83:0/2625335096 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb6c104fb0 0x7ffb6c19bc10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ffb6400b070 tx=0x7ffb64007920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:53.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.305+0000 7ffb68ff9700 1 -- 172.21.15.83:0/2625335096 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6400e040 con 0x7ffb6c104fb0 2024-04-01T06:54:53.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.305+0000 7ffb71b40700 1 -- 172.21.15.83:0/2625335096 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb6c19c7d0 con 0x7ffb6c104fb0 2024-04-01T06:54:53.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.305+0000 7ffb68ff9700 1 -- 172.21.15.83:0/2625335096 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffb64009440 con 0x7ffb6c104fb0 2024-04-01T06:54:53.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.305+0000 7ffb68ff9700 1 -- 172.21.15.83:0/2625335096 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6401b6b0 con 0x7ffb6c104fb0 2024-04-01T06:54:53.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.305+0000 7ffb71b40700 1 -- 172.21.15.83:0/2625335096 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb6c1a4090 con 0x7ffb6c104fb0 2024-04-01T06:54:53.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.306+0000 7ffb527fc700 1 -- 172.21.15.83:0/2625335096 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffb4c000fc0 con 0x7ffb6c104fb0 2024-04-01T06:54:53.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.307+0000 7ffb68ff9700 1 -- 172.21.15.83:0/2625335096 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7ffb6401d480 con 0x7ffb6c104fb0 2024-04-01T06:54:53.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.308+0000 7ffb68ff9700 1 --2- 172.21.15.83:0/2625335096 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7ffb540a11b0 0x7ffb540a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:53.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.308+0000 7ffb6b7fe700 1 --2- 172.21.15.83:0/2625335096 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7ffb540a11b0 0x7ffb540a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:53.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.308+0000 7ffb68ff9700 1 -- 172.21.15.83:0/2625335096 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ffb640ce910 con 0x7ffb6c104fb0 2024-04-01T06:54:53.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.308+0000 7ffb68ff9700 1 --2- 172.21.15.83:0/2625335096 >> [v2:172.21.15.83:6818/2005485079,v1:172.21.15.83:6819/2005485079] conn(0x7ffb540aa990 0x7ffb540acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:53.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.308+0000 7ffb68ff9700 1 -- 172.21.15.83:0/2625335096 --> [v2:172.21.15.83:6818/2005485079,v1:172.21.15.83:6819/2005485079] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffb540ad460 con 0x7ffb540aa990 2024-04-01T06:54:53.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.308+0000 7ffb68ff9700 1 -- 172.21.15.83:0/2625335096 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffb640cedb0 con 0x7ffb6c104fb0 2024-04-01T06:54:53.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.308+0000 7ffb6b7fe700 1 --2- 172.21.15.83:0/2625335096 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7ffb540a11b0 0x7ffb540a3670 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c0099d0 tx=0x7ffb5c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:53.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.308+0000 7ffb6affd700 1 --2- 172.21.15.83:0/2625335096 >> [v2:172.21.15.83:6818/2005485079,v1:172.21.15.83:6819/2005485079] conn(0x7ffb540aa990 0x7ffb540acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:53.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.308+0000 7ffb6affd700 1 --2- 172.21.15.83:0/2625335096 >> [v2:172.21.15.83:6818/2005485079,v1:172.21.15.83:6819/2005485079] conn(0x7ffb540aa990 0x7ffb540acdb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:53.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.309+0000 7ffb68ff9700 1 -- 172.21.15.83:0/2625335096 <== osd.6 v2:172.21.15.83:6818/2005485079 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7ffb540ad460 con 0x7ffb540aa990 2024-04-01T06:54:53.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.325+0000 7ffb527fc700 1 -- 172.21.15.83:0/2625335096 --> [v2:172.21.15.83:6818/2005485079,v1:172.21.15.83:6819/2005485079] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ffb4c002d40 con 0x7ffb540aa990 2024-04-01T06:54:53.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.325+0000 7ffb68ff9700 1 -- 172.21.15.83:0/2625335096 <== osd.6 v2:172.21.15.83:6818/2005485079 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7ffb4c002d40 con 0x7ffb540aa990 2024-04-01T06:54:53.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.325+0000 7ffb527fc700 1 -- 172.21.15.83:0/2625335096 >> [v2:172.21.15.83:6818/2005485079,v1:172.21.15.83:6819/2005485079] conn(0x7ffb540aa990 msgr2=0x7ffb540acdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:53.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.325+0000 7ffb527fc700 1 --2- 172.21.15.83:0/2625335096 >> [v2:172.21.15.83:6818/2005485079,v1:172.21.15.83:6819/2005485079] conn(0x7ffb540aa990 0x7ffb540acdb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:53.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.325+0000 7ffb527fc700 1 -- 172.21.15.83:0/2625335096 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7ffb540a11b0 msgr2=0x7ffb540a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:53.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.325+0000 7ffb527fc700 1 --2- 172.21.15.83:0/2625335096 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7ffb540a11b0 0x7ffb540a3670 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c0099d0 tx=0x7ffb5c008040 comp rx=0 tx=0).stop 2024-04-01T06:54:53.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.325+0000 7ffb527fc700 1 -- 172.21.15.83:0/2625335096 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb6c104fb0 msgr2=0x7ffb6c19bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:53.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.325+0000 7ffb527fc700 1 --2- 172.21.15.83:0/2625335096 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb6c104fb0 0x7ffb6c19bc10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ffb6400b070 tx=0x7ffb64007920 comp rx=0 tx=0).stop 2024-04-01T06:54:53.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.325+0000 7ffb6bfff700 1 -- 172.21.15.83:0/2625335096 reap_dead start 2024-04-01T06:54:53.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.326+0000 7ffb527fc700 1 -- 172.21.15.83:0/2625335096 shutdown_connections 2024-04-01T06:54:53.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.326+0000 7ffb527fc700 1 -- 172.21.15.83:0/2625335096 >> 172.21.15.83:0/2625335096 conn(0x7ffb6c075d50 msgr2=0x7ffb6c0ff490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:53.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.326+0000 7ffb527fc700 1 -- 172.21.15.83:0/2625335096 shutdown_connections 2024-04-01T06:54:53.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.326+0000 7ffb527fc700 1 -- 172.21.15.83:0/2625335096 wait complete. 2024-04-01T06:54:53.713 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:54:53.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.797+0000 7efdde0d7700 1 -- 172.21.15.83:0/1953536905 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efdd81017c0 msgr2=0x7efdd810dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:53.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.797+0000 7efdde0d7700 1 --2- 172.21.15.83:0/1953536905 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efdd81017c0 0x7efdd810dbf0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7efdd000b0a0 tx=0x7efdd000b3b0 comp rx=0 tx=0).stop 2024-04-01T06:54:53.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.797+0000 7efdde0d7700 1 -- 172.21.15.83:0/1953536905 shutdown_connections 2024-04-01T06:54:53.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.797+0000 7efdde0d7700 1 --2- 172.21.15.83:0/1953536905 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efdd81017c0 0x7efdd810dbf0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:53.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.797+0000 7efdde0d7700 1 --2- 172.21.15.83:0/1953536905 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efdd8106e40 0x7efdd8107220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:53.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.797+0000 7efdde0d7700 1 --2- 172.21.15.83:0/1953536905 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efdd8100e00 0x7efdd8101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:53.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.797+0000 7efdde0d7700 1 -- 172.21.15.83:0/1953536905 >> 172.21.15.83:0/1953536905 conn(0x7efdd8077f10 msgr2=0x7efdd8078320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:53.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.797+0000 7efdde0d7700 1 -- 172.21.15.83:0/1953536905 shutdown_connections 2024-04-01T06:54:53.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.797+0000 7efdde0d7700 1 -- 172.21.15.83:0/1953536905 wait complete. 2024-04-01T06:54:53.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.798+0000 7efdde0d7700 1 Processor -- start 2024-04-01T06:54:53.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.798+0000 7efdde0d7700 1 -- start start 2024-04-01T06:54:53.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.798+0000 7efdde0d7700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efdd8100e00 0x7efdd81972c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:53.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.798+0000 7efdde0d7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efdd81017c0 0x7efdd8197800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:53.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.798+0000 7efdde0d7700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efdd8106e40 0x7efdd819bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:53.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.798+0000 7efdde0d7700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd819c170 con 0x7efdd8100e00 2024-04-01T06:54:53.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.798+0000 7efdde0d7700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd819c2e0 con 0x7efdd8106e40 2024-04-01T06:54:53.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.798+0000 7efdde0d7700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd819c4a0 con 0x7efdd81017c0 2024-04-01T06:54:53.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.798+0000 7efdd77fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efdd8100e00 0x7efdd81972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:53.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.798+0000 7efdd77fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efdd8100e00 0x7efdd81972c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:41614/0 (socket says 172.21.15.83:41614) 2024-04-01T06:54:53.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.798+0000 7efdd77fe700 1 -- 172.21.15.83:0/2600075443 learned_addr learned my addr 172.21.15.83:0/2600075443 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:54:53.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.798+0000 7efdd6ffd700 1 --2- 172.21.15.83:0/2600075443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efdd81017c0 0x7efdd8197800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:53.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.798+0000 7efdd7fff700 1 --2- 172.21.15.83:0/2600075443 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efdd8106e40 0x7efdd819bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:53.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.798+0000 7efdd77fe700 1 -- 172.21.15.83:0/2600075443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efdd81017c0 msgr2=0x7efdd8197800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:53.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.798+0000 7efdd77fe700 1 --2- 172.21.15.83:0/2600075443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efdd81017c0 0x7efdd8197800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:53.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.798+0000 7efdd77fe700 1 -- 172.21.15.83:0/2600075443 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efdd8106e40 msgr2=0x7efdd819bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:53.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.798+0000 7efdd77fe700 1 --2- 172.21.15.83:0/2600075443 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efdd8106e40 0x7efdd819bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:53.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.798+0000 7efdd77fe700 1 -- 172.21.15.83:0/2600075443 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd0009d00 con 0x7efdd8100e00 2024-04-01T06:54:53.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.798+0000 7efdd6ffd700 1 --2- 172.21.15.83:0/2600075443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efdd81017c0 0x7efdd8197800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:54:53.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.798+0000 7efdd77fe700 1 --2- 172.21.15.83:0/2600075443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efdd8100e00 0x7efdd81972c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7efdcc00c9b0 tx=0x7efdcc00cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:53.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.799+0000 7efdd4ff9700 1 -- 172.21.15.83:0/2600075443 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdcc007b00 con 0x7efdd8100e00 2024-04-01T06:54:53.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.799+0000 7efdd4ff9700 1 -- 172.21.15.83:0/2600075443 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efdcc007c60 con 0x7efdd8100e00 2024-04-01T06:54:53.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.799+0000 7efdde0d7700 1 -- 172.21.15.83:0/2600075443 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdd819c780 con 0x7efdd8100e00 2024-04-01T06:54:53.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.799+0000 7efdd4ff9700 1 -- 172.21.15.83:0/2600075443 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdcc018660 con 0x7efdd8100e00 2024-04-01T06:54:53.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.799+0000 7efdde0d7700 1 -- 172.21.15.83:0/2600075443 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdd81a3fe0 con 0x7efdd8100e00 2024-04-01T06:54:53.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.799+0000 7efdde0d7700 1 -- 172.21.15.83:0/2600075443 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efdd8102480 con 0x7efdd8100e00 2024-04-01T06:54:53.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.801+0000 7efdd4ff9700 1 -- 172.21.15.83:0/2600075443 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7efdcc018880 con 0x7efdd8100e00 2024-04-01T06:54:53.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.801+0000 7efdd4ff9700 1 --2- 172.21.15.83:0/2600075443 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7efdc00a11b0 0x7efdc00a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:53.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.801+0000 7efdd4ff9700 1 -- 172.21.15.83:0/2600075443 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7efdcc0ccd30 con 0x7efdd8100e00 2024-04-01T06:54:53.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.801+0000 7efdd6ffd700 1 --2- 172.21.15.83:0/2600075443 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7efdc00a11b0 0x7efdc00a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:53.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.801+0000 7efdd4ff9700 1 --2- 172.21.15.83:0/2600075443 >> [v2:172.21.15.83:6810/504690234,v1:172.21.15.83:6811/504690234] conn(0x7efdc00aa990 0x7efdc00acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:53.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.801+0000 7efdd4ff9700 1 -- 172.21.15.83:0/2600075443 --> [v2:172.21.15.83:6810/504690234,v1:172.21.15.83:6811/504690234] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efdc00ad460 con 0x7efdc00aa990 2024-04-01T06:54:53.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.801+0000 7efdd4ff9700 1 -- 172.21.15.83:0/2600075443 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7efdcc0cd1d0 con 0x7efdd8100e00 2024-04-01T06:54:53.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.801+0000 7efdd7fff700 1 --2- 172.21.15.83:0/2600075443 >> [v2:172.21.15.83:6810/504690234,v1:172.21.15.83:6811/504690234] conn(0x7efdc00aa990 0x7efdc00acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:53.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.802+0000 7efdd6ffd700 1 --2- 172.21.15.83:0/2600075443 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7efdc00a11b0 0x7efdc00a3670 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7efdd81987d0 tx=0x7efdc8008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:53.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.802+0000 7efdd7fff700 1 --2- 172.21.15.83:0/2600075443 >> [v2:172.21.15.83:6810/504690234,v1:172.21.15.83:6811/504690234] conn(0x7efdc00aa990 0x7efdc00acdb0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:53.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.802+0000 7efdd4ff9700 1 -- 172.21.15.83:0/2600075443 <== osd.3 v2:172.21.15.83:6810/504690234 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7efdc00ad460 con 0x7efdc00aa990 2024-04-01T06:54:53.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.822+0000 7efdde0d7700 1 -- 172.21.15.83:0/2600075443 --> [v2:172.21.15.83:6810/504690234,v1:172.21.15.83:6811/504690234] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efdd8110f70 con 0x7efdc00aa990 2024-04-01T06:54:53.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.822+0000 7efdd4ff9700 1 -- 172.21.15.83:0/2600075443 <== osd.3 v2:172.21.15.83:6810/504690234 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7efdd8110f70 con 0x7efdc00aa990 2024-04-01T06:54:53.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.823+0000 7efdde0d7700 1 -- 172.21.15.83:0/2600075443 >> [v2:172.21.15.83:6810/504690234,v1:172.21.15.83:6811/504690234] conn(0x7efdc00aa990 msgr2=0x7efdc00acdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:53.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.823+0000 7efdde0d7700 1 --2- 172.21.15.83:0/2600075443 >> [v2:172.21.15.83:6810/504690234,v1:172.21.15.83:6811/504690234] conn(0x7efdc00aa990 0x7efdc00acdb0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:53.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.823+0000 7efdde0d7700 1 -- 172.21.15.83:0/2600075443 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7efdc00a11b0 msgr2=0x7efdc00a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:53.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.823+0000 7efdde0d7700 1 --2- 172.21.15.83:0/2600075443 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7efdc00a11b0 0x7efdc00a3670 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7efdd81987d0 tx=0x7efdc8008040 comp rx=0 tx=0).stop 2024-04-01T06:54:53.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.823+0000 7efdde0d7700 1 -- 172.21.15.83:0/2600075443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efdd8100e00 msgr2=0x7efdd81972c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:53.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.823+0000 7efdde0d7700 1 --2- 172.21.15.83:0/2600075443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efdd8100e00 0x7efdd81972c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7efdcc00c9b0 tx=0x7efdcc00cd70 comp rx=0 tx=0).stop 2024-04-01T06:54:53.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.823+0000 7efdd7fff700 1 -- 172.21.15.83:0/2600075443 reap_dead start 2024-04-01T06:54:53.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.823+0000 7efdde0d7700 1 -- 172.21.15.83:0/2600075443 shutdown_connections 2024-04-01T06:54:53.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.823+0000 7efdde0d7700 1 -- 172.21.15.83:0/2600075443 >> 172.21.15.83:0/2600075443 conn(0x7efdd8077f10 msgr2=0x7efdd80ffa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:53.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.823+0000 7efdde0d7700 1 -- 172.21.15.83:0/2600075443 shutdown_connections 2024-04-01T06:54:53.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:53.823+0000 7efdde0d7700 1 -- 172.21.15.83:0/2600075443 wait complete. 2024-04-01T06:54:54.002 INFO:teuthology.orchestra.run.smithi083.stdout:184683593759 2024-04-01T06:54:54.002 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.6 2024-04-01T06:54:54.984 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:54 smithi083 ceph-mon[43429]: pgmap v229: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-04-01T06:54:55.077 INFO:teuthology.orchestra.run.smithi083.stdout:107374182442 2024-04-01T06:54:55.077 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.3 2024-04-01T06:54:55.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.114+0000 7f5854bef700 1 -- 172.21.15.83:0/2057057629 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5850068750 msgr2=0x7f5850068bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:55.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.114+0000 7f5854bef700 1 --2- 172.21.15.83:0/2057057629 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5850068750 0x7f5850068bb0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5844009990 tx=0x7f5844009ca0 comp rx=0 tx=0).stop 2024-04-01T06:54:55.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.114+0000 7f5854bef700 1 -- 172.21.15.83:0/2057057629 shutdown_connections 2024-04-01T06:54:55.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.114+0000 7f5854bef700 1 --2- 172.21.15.83:0/2057057629 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58500690f0 0x7f585010dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:55.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.114+0000 7f5854bef700 1 --2- 172.21.15.83:0/2057057629 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5850106df0 0x7f58501071d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:55.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.114+0000 7f5854bef700 1 --2- 172.21.15.83:0/2057057629 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5850068750 0x7f5850068bb0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:55.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.114+0000 7f5854bef700 1 -- 172.21.15.83:0/2057057629 >> 172.21.15.83:0/2057057629 conn(0x7f5850075d50 msgr2=0x7f5850076160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:55.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.114+0000 7f5854bef700 1 -- 172.21.15.83:0/2057057629 shutdown_connections 2024-04-01T06:54:55.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.114+0000 7f5854bef700 1 -- 172.21.15.83:0/2057057629 wait complete. 2024-04-01T06:54:55.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.115+0000 7f5854bef700 1 Processor -- start 2024-04-01T06:54:55.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.115+0000 7f5854bef700 1 -- start start 2024-04-01T06:54:55.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.116+0000 7f5854bef700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5850068750 0x7f58500ffde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:55.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.116+0000 7f5854bef700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58500690f0 0x7f5850100320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:55.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.116+0000 7f5854bef700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5850106df0 0x7f5850100860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:55.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.116+0000 7f5854bef700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58501a5580 con 0x7f5850068750 2024-04-01T06:54:55.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.116+0000 7f5854bef700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58501a56f0 con 0x7f5850106df0 2024-04-01T06:54:55.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.116+0000 7f5854bef700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58501a58b0 con 0x7f58500690f0 2024-04-01T06:54:55.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.116+0000 7f584e59c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5850068750 0x7f58500ffde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:55.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.116+0000 7f584e59c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5850068750 0x7f58500ffde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:41628/0 (socket says 172.21.15.83:41628) 2024-04-01T06:54:55.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.116+0000 7f584e59c700 1 -- 172.21.15.83:0/2197059344 learned_addr learned my addr 172.21.15.83:0/2197059344 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:54:55.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.116+0000 7f584dd9b700 1 --2- 172.21.15.83:0/2197059344 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58500690f0 0x7f5850100320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:55.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.116+0000 7f584ed9d700 1 --2- 172.21.15.83:0/2197059344 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5850106df0 0x7f5850100860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:55.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.116+0000 7f584e59c700 1 -- 172.21.15.83:0/2197059344 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58500690f0 msgr2=0x7f5850100320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:55.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.116+0000 7f584e59c700 1 --2- 172.21.15.83:0/2197059344 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58500690f0 0x7f5850100320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:55.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.116+0000 7f584e59c700 1 -- 172.21.15.83:0/2197059344 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5850106df0 msgr2=0x7f5850100860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:55.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.116+0000 7f584e59c700 1 --2- 172.21.15.83:0/2197059344 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5850106df0 0x7f5850100860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:55.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.116+0000 7f584e59c700 1 -- 172.21.15.83:0/2197059344 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58440095f0 con 0x7f5850068750 2024-04-01T06:54:55.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.116+0000 7f584e59c700 1 --2- 172.21.15.83:0/2197059344 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5850068750 0x7f58500ffde0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f584000e9a0 tx=0x7f584000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:55.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.117+0000 7f583f7fe700 1 -- 172.21.15.83:0/2197059344 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5840009790 con 0x7f5850068750 2024-04-01T06:54:55.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.117+0000 7f583f7fe700 1 -- 172.21.15.83:0/2197059344 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f584000cbd0 con 0x7f5850068750 2024-04-01T06:54:55.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.117+0000 7f583f7fe700 1 -- 172.21.15.83:0/2197059344 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5840018680 con 0x7f5850068750 2024-04-01T06:54:55.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.117+0000 7f5854bef700 1 -- 172.21.15.83:0/2197059344 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58501a5b90 con 0x7f5850068750 2024-04-01T06:54:55.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.117+0000 7f5854bef700 1 -- 172.21.15.83:0/2197059344 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58501a6010 con 0x7f5850068750 2024-04-01T06:54:55.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.118+0000 7f5854bef700 1 -- 172.21.15.83:0/2197059344 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f58501024a0 con 0x7f5850068750 2024-04-01T06:54:55.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.120+0000 7f583f7fe700 1 -- 172.21.15.83:0/2197059344 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f584000cd40 con 0x7f5850068750 2024-04-01T06:54:55.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.120+0000 7f583f7fe700 1 --2- 172.21.15.83:0/2197059344 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f58380a11b0 0x7f58380a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:55.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.120+0000 7f584dd9b700 1 --2- 172.21.15.83:0/2197059344 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f58380a11b0 0x7f58380a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:55.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.120+0000 7f583f7fe700 1 -- 172.21.15.83:0/2197059344 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f5840014070 con 0x7f5850068750 2024-04-01T06:54:55.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.120+0000 7f583f7fe700 1 --2- 172.21.15.83:0/2197059344 >> [v2:172.21.15.83:6802/3253845390,v1:172.21.15.83:6803/3253845390] conn(0x7f58380aa990 0x7f58380acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:55.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.120+0000 7f583f7fe700 1 -- 172.21.15.83:0/2197059344 --> [v2:172.21.15.83:6802/3253845390,v1:172.21.15.83:6803/3253845390] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f58380ad460 con 0x7f58380aa990 2024-04-01T06:54:55.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.120+0000 7f583f7fe700 1 -- 172.21.15.83:0/2197059344 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58400cd320 con 0x7f5850068750 2024-04-01T06:54:55.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.120+0000 7f584ed9d700 1 --2- 172.21.15.83:0/2197059344 >> [v2:172.21.15.83:6802/3253845390,v1:172.21.15.83:6803/3253845390] conn(0x7f58380aa990 0x7f58380acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:55.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.121+0000 7f584dd9b700 1 --2- 172.21.15.83:0/2197059344 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f58380a11b0 0x7f58380a3670 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f584400b2e0 tx=0x7f5844005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:55.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.121+0000 7f584ed9d700 1 --2- 172.21.15.83:0/2197059344 >> [v2:172.21.15.83:6802/3253845390,v1:172.21.15.83:6803/3253845390] conn(0x7f58380aa990 0x7f58380acdb0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:55.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.122+0000 7f583f7fe700 1 -- 172.21.15.83:0/2197059344 <== osd.0 v2:172.21.15.83:6802/3253845390 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f58380ad460 con 0x7f58380aa990 2024-04-01T06:54:55.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:54 smithi153 ceph-mon[48187]: pgmap v229: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-04-01T06:54:55.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.155+0000 7f5854bef700 1 -- 172.21.15.83:0/2197059344 --> [v2:172.21.15.83:6802/3253845390,v1:172.21.15.83:6803/3253845390] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5850110ef0 con 0x7f58380aa990 2024-04-01T06:54:55.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.155+0000 7f583f7fe700 1 -- 172.21.15.83:0/2197059344 <== osd.0 v2:172.21.15.83:6802/3253845390 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5850110ef0 con 0x7f58380aa990 2024-04-01T06:54:55.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.155+0000 7f5854bef700 1 -- 172.21.15.83:0/2197059344 >> [v2:172.21.15.83:6802/3253845390,v1:172.21.15.83:6803/3253845390] conn(0x7f58380aa990 msgr2=0x7f58380acdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:55.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.155+0000 7f5854bef700 1 --2- 172.21.15.83:0/2197059344 >> [v2:172.21.15.83:6802/3253845390,v1:172.21.15.83:6803/3253845390] conn(0x7f58380aa990 0x7f58380acdb0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:55.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.156+0000 7f5854bef700 1 -- 172.21.15.83:0/2197059344 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f58380a11b0 msgr2=0x7f58380a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:55.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.156+0000 7f5854bef700 1 --2- 172.21.15.83:0/2197059344 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f58380a11b0 0x7f58380a3670 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f584400b2e0 tx=0x7f5844005960 comp rx=0 tx=0).stop 2024-04-01T06:54:55.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.156+0000 7f5854bef700 1 -- 172.21.15.83:0/2197059344 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5850068750 msgr2=0x7f58500ffde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:55.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.156+0000 7f5854bef700 1 --2- 172.21.15.83:0/2197059344 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5850068750 0x7f58500ffde0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f584000e9a0 tx=0x7f584000ecb0 comp rx=0 tx=0).stop 2024-04-01T06:54:55.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.156+0000 7f584ed9d700 1 -- 172.21.15.83:0/2197059344 reap_dead start 2024-04-01T06:54:55.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.156+0000 7f5854bef700 1 -- 172.21.15.83:0/2197059344 shutdown_connections 2024-04-01T06:54:55.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.156+0000 7f5854bef700 1 -- 172.21.15.83:0/2197059344 >> 172.21.15.83:0/2197059344 conn(0x7f5850075d50 msgr2=0x7f58500febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:55.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.156+0000 7f5854bef700 1 -- 172.21.15.83:0/2197059344 shutdown_connections 2024-04-01T06:54:55.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.156+0000 7f5854bef700 1 -- 172.21.15.83:0/2197059344 wait complete. 2024-04-01T06:54:55.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.214+0000 7fb8bfab3700 1 -- 172.21.15.83:0/3711420561 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8b8106df0 msgr2=0x7fb8b81071d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:55.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.214+0000 7fb8bfab3700 1 --2- 172.21.15.83:0/3711420561 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8b8106df0 0x7fb8b81071d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4009990 tx=0x7fb8b4009ca0 comp rx=0 tx=0).stop 2024-04-01T06:54:55.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.214+0000 7fb8bfab3700 1 -- 172.21.15.83:0/3711420561 shutdown_connections 2024-04-01T06:54:55.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.214+0000 7fb8bfab3700 1 --2- 172.21.15.83:0/3711420561 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8b8106df0 0x7fb8b81071d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:55.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.214+0000 7fb8bfab3700 1 --2- 172.21.15.83:0/3711420561 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb8b80690f0 0x7fb8b810dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:55.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.214+0000 7fb8bfab3700 1 --2- 172.21.15.83:0/3711420561 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8b8068750 0x7fb8b8068bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:55.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.214+0000 7fb8bfab3700 1 -- 172.21.15.83:0/3711420561 >> 172.21.15.83:0/3711420561 conn(0x7fb8b8075d50 msgr2=0x7fb8b8076160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:55.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.214+0000 7fb8bfab3700 1 -- 172.21.15.83:0/3711420561 shutdown_connections 2024-04-01T06:54:55.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.214+0000 7fb8bfab3700 1 -- 172.21.15.83:0/3711420561 wait complete. 2024-04-01T06:54:55.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.214+0000 7fb8bfab3700 1 Processor -- start 2024-04-01T06:54:55.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.215+0000 7fb8bfab3700 1 -- start start 2024-04-01T06:54:55.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.215+0000 7fb8bfab3700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8b8068750 0x7fb8b8197200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:55.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.215+0000 7fb8bfab3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8b80690f0 0x7fb8b8197740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:55.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.215+0000 7fb8bfab3700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb8b8106df0 0x7fb8b819baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:55.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.215+0000 7fb8bfab3700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b819c0b0 con 0x7fb8b8068750 2024-04-01T06:54:55.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.215+0000 7fb8bfab3700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b819c220 con 0x7fb8b8106df0 2024-04-01T06:54:55.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.215+0000 7fb8bfab3700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b819c3e0 con 0x7fb8b80690f0 2024-04-01T06:54:55.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.215+0000 7fb8bd84f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8b8068750 0x7fb8b8197200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:55.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.215+0000 7fb8bd84f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8b8068750 0x7fb8b8197200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:41638/0 (socket says 172.21.15.83:41638) 2024-04-01T06:54:55.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.215+0000 7fb8bd84f700 1 -- 172.21.15.83:0/610884647 learned_addr learned my addr 172.21.15.83:0/610884647 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:54:55.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.215+0000 7fb8bd04e700 1 --2- 172.21.15.83:0/610884647 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8b80690f0 0x7fb8b8197740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:55.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.215+0000 7fb8be050700 1 --2- 172.21.15.83:0/610884647 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb8b8106df0 0x7fb8b819baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:55.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.215+0000 7fb8bd84f700 1 -- 172.21.15.83:0/610884647 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8b80690f0 msgr2=0x7fb8b8197740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:55.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.215+0000 7fb8bd84f700 1 --2- 172.21.15.83:0/610884647 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8b80690f0 0x7fb8b8197740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:55.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.215+0000 7fb8bd84f700 1 -- 172.21.15.83:0/610884647 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb8b8106df0 msgr2=0x7fb8b819baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:55.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.215+0000 7fb8bd84f700 1 --2- 172.21.15.83:0/610884647 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb8b8106df0 0x7fb8b819baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:55.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.215+0000 7fb8bd84f700 1 -- 172.21.15.83:0/610884647 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b40095f0 con 0x7fb8b8068750 2024-04-01T06:54:55.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.215+0000 7fb8bd84f700 1 --2- 172.21.15.83:0/610884647 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8b8068750 0x7fb8b8197200 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4000c00 tx=0x7fb8b400f7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:55.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.216+0000 7fb8aeffd700 1 -- 172.21.15.83:0/610884647 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b401d070 con 0x7fb8b8068750 2024-04-01T06:54:55.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.216+0000 7fb8bfab3700 1 -- 172.21.15.83:0/610884647 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8b819c660 con 0x7fb8b8068750 2024-04-01T06:54:55.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.216+0000 7fb8aeffd700 1 -- 172.21.15.83:0/610884647 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb8b400fd30 con 0x7fb8b8068750 2024-04-01T06:54:55.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.216+0000 7fb8aeffd700 1 -- 172.21.15.83:0/610884647 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b4017630 con 0x7fb8b8068750 2024-04-01T06:54:55.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.216+0000 7fb8bfab3700 1 -- 172.21.15.83:0/610884647 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8b81a3f20 con 0x7fb8b8068750 2024-04-01T06:54:55.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.216+0000 7fb8bfab3700 1 -- 172.21.15.83:0/610884647 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb8b819c930 con 0x7fb8b8068750 2024-04-01T06:54:55.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.218+0000 7fb8aeffd700 1 -- 172.21.15.83:0/610884647 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7fb8b4017790 con 0x7fb8b8068750 2024-04-01T06:54:55.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.218+0000 7fb8aeffd700 1 --2- 172.21.15.83:0/610884647 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fb8a40a11b0 0x7fb8a40a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:55.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.218+0000 7fb8bd04e700 1 --2- 172.21.15.83:0/610884647 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fb8a40a11b0 0x7fb8a40a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:55.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.218+0000 7fb8aeffd700 1 -- 172.21.15.83:0/610884647 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fb8b40ce450 con 0x7fb8b8068750 2024-04-01T06:54:55.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.218+0000 7fb8aeffd700 1 --2- 172.21.15.83:0/610884647 >> [v2:172.21.15.83:6826/3720996673,v1:172.21.15.83:6827/3720996673] conn(0x7fb8a40aa990 0x7fb8a40acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:55.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.218+0000 7fb8aeffd700 1 -- 172.21.15.83:0/610884647 --> [v2:172.21.15.83:6826/3720996673,v1:172.21.15.83:6827/3720996673] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb8a40ad460 con 0x7fb8a40aa990 2024-04-01T06:54:55.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.219+0000 7fb8aeffd700 1 -- 172.21.15.83:0/610884647 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb8b40ce8f0 con 0x7fb8b8068750 2024-04-01T06:54:55.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.219+0000 7fb8be050700 1 --2- 172.21.15.83:0/610884647 >> [v2:172.21.15.83:6826/3720996673,v1:172.21.15.83:6827/3720996673] conn(0x7fb8a40aa990 0x7fb8a40acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:55.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.219+0000 7fb8bd04e700 1 --2- 172.21.15.83:0/610884647 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fb8a40a11b0 0x7fb8a40a3670 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8198710 tx=0x7fb8a8009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:55.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.219+0000 7fb8be050700 1 --2- 172.21.15.83:0/610884647 >> [v2:172.21.15.83:6826/3720996673,v1:172.21.15.83:6827/3720996673] conn(0x7fb8a40aa990 0x7fb8a40acdb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:55.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.220+0000 7fb8aeffd700 1 -- 172.21.15.83:0/610884647 <== osd.9 v2:172.21.15.83:6826/3720996673 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7fb8a40ad460 con 0x7fb8a40aa990 2024-04-01T06:54:55.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.236+0000 7fb8bfab3700 1 -- 172.21.15.83:0/610884647 --> [v2:172.21.15.83:6826/3720996673,v1:172.21.15.83:6827/3720996673] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb8b8110ff0 con 0x7fb8a40aa990 2024-04-01T06:54:55.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.237+0000 7fb8aeffd700 1 -- 172.21.15.83:0/610884647 <== osd.9 v2:172.21.15.83:6826/3720996673 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fb8b8110ff0 con 0x7fb8a40aa990 2024-04-01T06:54:55.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.237+0000 7fb8bfab3700 1 -- 172.21.15.83:0/610884647 >> [v2:172.21.15.83:6826/3720996673,v1:172.21.15.83:6827/3720996673] conn(0x7fb8a40aa990 msgr2=0x7fb8a40acdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:55.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.237+0000 7fb8bfab3700 1 --2- 172.21.15.83:0/610884647 >> [v2:172.21.15.83:6826/3720996673,v1:172.21.15.83:6827/3720996673] conn(0x7fb8a40aa990 0x7fb8a40acdb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:55.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.237+0000 7fb8bfab3700 1 -- 172.21.15.83:0/610884647 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fb8a40a11b0 msgr2=0x7fb8a40a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:55.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.237+0000 7fb8bfab3700 1 --2- 172.21.15.83:0/610884647 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fb8a40a11b0 0x7fb8a40a3670 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8198710 tx=0x7fb8a8009190 comp rx=0 tx=0).stop 2024-04-01T06:54:55.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.237+0000 7fb8bfab3700 1 -- 172.21.15.83:0/610884647 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8b8068750 msgr2=0x7fb8b8197200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:55.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.237+0000 7fb8bfab3700 1 --2- 172.21.15.83:0/610884647 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8b8068750 0x7fb8b8197200 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4000c00 tx=0x7fb8b400f7d0 comp rx=0 tx=0).stop 2024-04-01T06:54:55.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.237+0000 7fb8be050700 1 -- 172.21.15.83:0/610884647 reap_dead start 2024-04-01T06:54:55.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.237+0000 7fb8bfab3700 1 -- 172.21.15.83:0/610884647 shutdown_connections 2024-04-01T06:54:55.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.237+0000 7fb8bfab3700 1 -- 172.21.15.83:0/610884647 >> 172.21.15.83:0/610884647 conn(0x7fb8b8075d50 msgr2=0x7fb8b80feb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:55.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.237+0000 7fb8bfab3700 1 -- 172.21.15.83:0/610884647 shutdown_connections 2024-04-01T06:54:55.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:55.237+0000 7fb8bfab3700 1 -- 172.21.15.83:0/610884647 wait complete. 2024-04-01T06:54:55.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:54 smithi145 ceph-mon[47816]: pgmap v229: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-04-01T06:54:55.687 INFO:teuthology.orchestra.run.smithi083.stdout:266287972374 2024-04-01T06:54:55.687 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.9 2024-04-01T06:54:56.301 INFO:teuthology.orchestra.run.smithi083.stdout:34359738421 2024-04-01T06:54:56.302 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.0 2024-04-01T06:54:56.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.589+0000 7faec2baa700 1 -- 172.21.15.83:0/301466145 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faebc100660 msgr2=0x7faebc10cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:56.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.589+0000 7faec2baa700 1 --2- 172.21.15.83:0/301466145 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faebc100660 0x7faebc10cb00 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7faeb400b0a0 tx=0x7faeb400b3b0 comp rx=0 tx=0).stop 2024-04-01T06:54:56.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.589+0000 7faec2baa700 1 -- 172.21.15.83:0/301466145 shutdown_connections 2024-04-01T06:54:56.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.589+0000 7faec2baa700 1 --2- 172.21.15.83:0/301466145 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faebc100660 0x7faebc10cb00 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:56.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.589+0000 7faec2baa700 1 --2- 172.21.15.83:0/301466145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faebc105d50 0x7faebc106130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:56.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.589+0000 7faec2baa700 1 --2- 172.21.15.83:0/301466145 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faebc0ffca0 0x7faebc100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:56.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.589+0000 7faec2baa700 1 -- 172.21.15.83:0/301466145 >> 172.21.15.83:0/301466145 conn(0x7faebc076c80 msgr2=0x7faebc077090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:56.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.589+0000 7faec2baa700 1 -- 172.21.15.83:0/301466145 shutdown_connections 2024-04-01T06:54:56.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.589+0000 7faec2baa700 1 -- 172.21.15.83:0/301466145 wait complete. 2024-04-01T06:54:56.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.589+0000 7faec2baa700 1 Processor -- start 2024-04-01T06:54:56.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.590+0000 7faec2baa700 1 -- start start 2024-04-01T06:54:56.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.590+0000 7faec2baa700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faebc0ffca0 0x7faebc198160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:56.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.590+0000 7faec2baa700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faebc100660 0x7faebc1986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:56.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.590+0000 7faec2baa700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faebc105d50 0x7faebc198c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:56.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.590+0000 7faec2baa700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faebc1a3450 con 0x7faebc105d50 2024-04-01T06:54:56.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.590+0000 7faec2baa700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faebc1a35c0 con 0x7faebc100660 2024-04-01T06:54:56.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.590+0000 7faec2baa700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faebc1a3780 con 0x7faebc0ffca0 2024-04-01T06:54:56.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.590+0000 7faec1147700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faebc105d50 0x7faebc198c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:56.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.590+0000 7faec1147700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faebc105d50 0x7faebc198c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:41662/0 (socket says 172.21.15.83:41662) 2024-04-01T06:54:56.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.590+0000 7faec1147700 1 -- 172.21.15.83:0/2292581353 learned_addr learned my addr 172.21.15.83:0/2292581353 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:54:56.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.590+0000 7faec0946700 1 --2- 172.21.15.83:0/2292581353 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faebc0ffca0 0x7faebc198160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:56.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.590+0000 7faec1147700 1 -- 172.21.15.83:0/2292581353 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faebc0ffca0 msgr2=0x7faebc198160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:56.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.590+0000 7faec1147700 1 --2- 172.21.15.83:0/2292581353 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faebc0ffca0 0x7faebc198160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:56.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.590+0000 7faec1147700 1 -- 172.21.15.83:0/2292581353 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faebc100660 msgr2=0x7faebc1986a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:56.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.590+0000 7faec1147700 1 --2- 172.21.15.83:0/2292581353 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faebc100660 0x7faebc1986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:56.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.590+0000 7faec1147700 1 -- 172.21.15.83:0/2292581353 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb4009d00 con 0x7faebc105d50 2024-04-01T06:54:56.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.590+0000 7faec1147700 1 --2- 172.21.15.83:0/2292581353 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faebc105d50 0x7faebc198c00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7faeb400b830 tx=0x7faeb40078a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:56.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.590+0000 7faeb9ffb700 1 -- 172.21.15.83:0/2292581353 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb400e040 con 0x7faebc105d50 2024-04-01T06:54:56.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.590+0000 7faeb9ffb700 1 -- 172.21.15.83:0/2292581353 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faeb4004e60 con 0x7faebc105d50 2024-04-01T06:54:56.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.590+0000 7faec2baa700 1 -- 172.21.15.83:0/2292581353 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faebc1a3a00 con 0x7faebc105d50 2024-04-01T06:54:56.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.590+0000 7faeb9ffb700 1 -- 172.21.15.83:0/2292581353 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb4005420 con 0x7faebc105d50 2024-04-01T06:54:56.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.591+0000 7faec2baa700 1 -- 172.21.15.83:0/2292581353 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faebc1a3f00 con 0x7faebc105d50 2024-04-01T06:54:56.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.591+0000 7faec2baa700 1 -- 172.21.15.83:0/2292581353 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faebc10fec0 con 0x7faebc105d50 2024-04-01T06:54:56.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.593+0000 7faeb9ffb700 1 -- 172.21.15.83:0/2292581353 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7faeb401bb30 con 0x7faebc105d50 2024-04-01T06:54:56.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.593+0000 7faeb9ffb700 1 --2- 172.21.15.83:0/2292581353 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7faeac0a11b0 0x7faeac0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:56.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.593+0000 7faec0946700 1 --2- 172.21.15.83:0/2292581353 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7faeac0a11b0 0x7faeac0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:56.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.593+0000 7faeb9ffb700 1 -- 172.21.15.83:0/2292581353 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7faeb40ce500 con 0x7faebc105d50 2024-04-01T06:54:56.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.594+0000 7faeb9ffb700 1 --2- 172.21.15.83:0/2292581353 >> [v2:172.21.15.153:6824/2342548429,v1:172.21.15.153:6825/2342548429] conn(0x7faeac0aa860 0x7faeac0acc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:56.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.594+0000 7faeb9ffb700 1 -- 172.21.15.83:0/2292581353 --> [v2:172.21.15.153:6824/2342548429,v1:172.21.15.153:6825/2342548429] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faeac0ad330 con 0x7faeac0aa860 2024-04-01T06:54:56.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.594+0000 7faeb9ffb700 1 -- 172.21.15.83:0/2292581353 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7faeb40ce9a0 con 0x7faebc105d50 2024-04-01T06:54:56.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.594+0000 7faec0946700 1 --2- 172.21.15.83:0/2292581353 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7faeac0a11b0 0x7faeac0a3670 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7faeb0005ea0 tx=0x7faeb0005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:56.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.594+0000 7faebbfff700 1 --2- 172.21.15.83:0/2292581353 >> [v2:172.21.15.153:6824/2342548429,v1:172.21.15.153:6825/2342548429] conn(0x7faeac0aa860 0x7faeac0acc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:56.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.594+0000 7faebbfff700 1 --2- 172.21.15.83:0/2292581353 >> [v2:172.21.15.153:6824/2342548429,v1:172.21.15.153:6825/2342548429] conn(0x7faeac0aa860 0x7faeac0acc80 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:56.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.595+0000 7faeb9ffb700 1 -- 172.21.15.83:0/2292581353 <== osd.11 v2:172.21.15.153:6824/2342548429 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7faeac0ad330 con 0x7faeac0aa860 2024-04-01T06:54:56.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.611+0000 7faec2baa700 1 -- 172.21.15.83:0/2292581353 --> [v2:172.21.15.153:6824/2342548429,v1:172.21.15.153:6825/2342548429] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7faebc0614b0 con 0x7faeac0aa860 2024-04-01T06:54:56.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.612+0000 7faeb9ffb700 1 -- 172.21.15.83:0/2292581353 <== osd.11 v2:172.21.15.153:6824/2342548429 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7faebc0614b0 con 0x7faeac0aa860 2024-04-01T06:54:56.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.612+0000 7faec2baa700 1 -- 172.21.15.83:0/2292581353 >> [v2:172.21.15.153:6824/2342548429,v1:172.21.15.153:6825/2342548429] conn(0x7faeac0aa860 msgr2=0x7faeac0acc80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:56.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.612+0000 7faec2baa700 1 --2- 172.21.15.83:0/2292581353 >> [v2:172.21.15.153:6824/2342548429,v1:172.21.15.153:6825/2342548429] conn(0x7faeac0aa860 0x7faeac0acc80 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:56.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.612+0000 7faec2baa700 1 -- 172.21.15.83:0/2292581353 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7faeac0a11b0 msgr2=0x7faeac0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:56.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.612+0000 7faec2baa700 1 --2- 172.21.15.83:0/2292581353 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7faeac0a11b0 0x7faeac0a3670 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7faeb0005ea0 tx=0x7faeb0005e30 comp rx=0 tx=0).stop 2024-04-01T06:54:56.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.612+0000 7faec2baa700 1 -- 172.21.15.83:0/2292581353 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faebc105d50 msgr2=0x7faebc198c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:56.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.612+0000 7faec2baa700 1 --2- 172.21.15.83:0/2292581353 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faebc105d50 0x7faebc198c00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7faeb400b830 tx=0x7faeb40078a0 comp rx=0 tx=0).stop 2024-04-01T06:54:56.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.613+0000 7faec1147700 1 -- 172.21.15.83:0/2292581353 reap_dead start 2024-04-01T06:54:56.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.613+0000 7faec2baa700 1 -- 172.21.15.83:0/2292581353 shutdown_connections 2024-04-01T06:54:56.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.613+0000 7faec2baa700 1 -- 172.21.15.83:0/2292581353 >> 172.21.15.83:0/2292581353 conn(0x7faebc076c80 msgr2=0x7faebc0fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:56.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.613+0000 7faec2baa700 1 -- 172.21.15.83:0/2292581353 shutdown_connections 2024-04-01T06:54:56.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.613+0000 7faec2baa700 1 -- 172.21.15.83:0/2292581353 wait complete. 2024-04-01T06:54:56.799 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:54:56.820 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.821+0000 7fe7911bd700 1 -- 172.21.15.83:0/3258471381 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe78c073520 msgr2=0x7fe78c0739a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:56.820 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.821+0000 7fe7911bd700 1 --2- 172.21.15.83:0/3258471381 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe78c073520 0x7fe78c0739a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe780009990 tx=0x7fe780009ca0 comp rx=0 tx=0).stop 2024-04-01T06:54:56.827 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.822+0000 7fe7911bd700 1 -- 172.21.15.83:0/3258471381 shutdown_connections 2024-04-01T06:54:56.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.822+0000 7fe7911bd700 1 --2- 172.21.15.83:0/3258471381 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe78c111aa0 0x7fe78c113e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:56.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.822+0000 7fe7911bd700 1 --2- 172.21.15.83:0/3258471381 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe78c074d80 0x7fe78c072fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:56.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.822+0000 7fe7911bd700 1 --2- 172.21.15.83:0/3258471381 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe78c073520 0x7fe78c0739a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:56.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.822+0000 7fe7911bd700 1 -- 172.21.15.83:0/3258471381 >> 172.21.15.83:0/3258471381 conn(0x7fe78c077f10 msgr2=0x7fe78c078320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:56.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.822+0000 7fe7911bd700 1 -- 172.21.15.83:0/3258471381 shutdown_connections 2024-04-01T06:54:56.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.822+0000 7fe7911bd700 1 -- 172.21.15.83:0/3258471381 wait complete. 2024-04-01T06:54:56.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.823+0000 7fe7911bd700 1 Processor -- start 2024-04-01T06:54:56.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.823+0000 7fe7911bd700 1 -- start start 2024-04-01T06:54:56.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.823+0000 7fe7911bd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe78c073520 0x7fe78c1a3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:56.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.823+0000 7fe7911bd700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe78c074d80 0x7fe78c1a3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:56.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.823+0000 7fe7911bd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe78c111aa0 0x7fe78c19d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:56.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.823+0000 7fe7911bd700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe78c19dd20 con 0x7fe78c111aa0 2024-04-01T06:54:56.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.823+0000 7fe7911bd700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe78c19de90 con 0x7fe78c074d80 2024-04-01T06:54:56.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.823+0000 7fe7911bd700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe78c19e050 con 0x7fe78c073520 2024-04-01T06:54:56.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.823+0000 7fe78b59e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe78c111aa0 0x7fe78c19d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:56.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.823+0000 7fe78b59e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe78c111aa0 0x7fe78c19d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:41678/0 (socket says 172.21.15.83:41678) 2024-04-01T06:54:56.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.823+0000 7fe78b59e700 1 -- 172.21.15.83:0/2416617812 learned_addr learned my addr 172.21.15.83:0/2416617812 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:54:56.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.823+0000 7fe78a59c700 1 --2- 172.21.15.83:0/2416617812 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe78c074d80 0x7fe78c1a3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:56.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.824+0000 7fe78b59e700 1 -- 172.21.15.83:0/2416617812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe78c073520 msgr2=0x7fe78c1a3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:56.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.824+0000 7fe78b59e700 1 --2- 172.21.15.83:0/2416617812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe78c073520 0x7fe78c1a3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:56.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.824+0000 7fe78b59e700 1 -- 172.21.15.83:0/2416617812 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe78c074d80 msgr2=0x7fe78c1a3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:56.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.824+0000 7fe78b59e700 1 --2- 172.21.15.83:0/2416617812 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe78c074d80 0x7fe78c1a3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:56.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.824+0000 7fe78b59e700 1 -- 172.21.15.83:0/2416617812 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7800095f0 con 0x7fe78c111aa0 2024-04-01T06:54:56.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.824+0000 7fe78b59e700 1 --2- 172.21.15.83:0/2416617812 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe78c111aa0 0x7fe78c19d6c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe784007ee0 tx=0x7fe78400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:56.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.824+0000 7fe773fff700 1 -- 172.21.15.83:0/2416617812 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe784017070 con 0x7fe78c111aa0 2024-04-01T06:54:56.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.824+0000 7fe7911bd700 1 -- 172.21.15.83:0/2416617812 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe78c19e330 con 0x7fe78c111aa0 2024-04-01T06:54:56.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.824+0000 7fe773fff700 1 -- 172.21.15.83:0/2416617812 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe78400f040 con 0x7fe78c111aa0 2024-04-01T06:54:56.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.824+0000 7fe773fff700 1 -- 172.21.15.83:0/2416617812 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe784005740 con 0x7fe78c111aa0 2024-04-01T06:54:56.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.824+0000 7fe7911bd700 1 -- 172.21.15.83:0/2416617812 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe78c1aa570 con 0x7fe78c111aa0 2024-04-01T06:54:56.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.825+0000 7fe7911bd700 1 -- 172.21.15.83:0/2416617812 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe78c074630 con 0x7fe78c111aa0 2024-04-01T06:54:56.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.826+0000 7fe773fff700 1 -- 172.21.15.83:0/2416617812 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7fe78400dc60 con 0x7fe78c111aa0 2024-04-01T06:54:56.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.827+0000 7fe773fff700 1 --2- 172.21.15.83:0/2416617812 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fe7740a11b0 0x7fe7740a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:56.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.827+0000 7fe773fff700 1 -- 172.21.15.83:0/2416617812 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fe7840cc0b0 con 0x7fe78c111aa0 2024-04-01T06:54:56.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.827+0000 7fe78ad9d700 1 --2- 172.21.15.83:0/2416617812 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fe7740a11b0 0x7fe7740a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:56.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.828+0000 7fe78ad9d700 1 --2- 172.21.15.83:0/2416617812 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fe7740a11b0 0x7fe7740a3670 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe77c0097b0 tx=0x7fe77c006d20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:56.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:56.834+0000 7fe773fff700 1 -- 172.21.15.83:0/2416617812 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7fe784095890 con 0x7fe78c111aa0 2024-04-01T06:54:56.850 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:54:56.947 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:56 smithi083 ceph-mon[43429]: pgmap v230: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-01T06:54:57.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:56 smithi145 ceph-mon[47816]: pgmap v230: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-01T06:54:57.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:57.070+0000 7fe7911bd700 1 -- 172.21.15.83:0/2416617812 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7fe78c04ea80 con 0x7fe78c111aa0 2024-04-01T06:54:57.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:57.070+0000 7fe773fff700 1 -- 172.21.15.83:0/2416617812 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7fe784098eb0 con 0x7fe78c111aa0 2024-04-01T06:54:57.070 INFO:teuthology.orchestra.run.smithi083.stdout:287762808850 2024-04-01T06:54:57.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:57.072+0000 7fe7911bd700 1 -- 172.21.15.83:0/2416617812 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fe7740a11b0 msgr2=0x7fe7740a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:57.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:57.072+0000 7fe7911bd700 1 --2- 172.21.15.83:0/2416617812 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fe7740a11b0 0x7fe7740a3670 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe77c0097b0 tx=0x7fe77c006d20 comp rx=0 tx=0).stop 2024-04-01T06:54:57.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:57.072+0000 7fe7911bd700 1 -- 172.21.15.83:0/2416617812 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe78c111aa0 msgr2=0x7fe78c19d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:57.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:57.072+0000 7fe7911bd700 1 --2- 172.21.15.83:0/2416617812 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe78c111aa0 0x7fe78c19d6c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe784007ee0 tx=0x7fe78400d3b0 comp rx=0 tx=0).stop 2024-04-01T06:54:57.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:57.072+0000 7fe7911bd700 1 -- 172.21.15.83:0/2416617812 shutdown_connections 2024-04-01T06:54:57.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:57.072+0000 7fe7911bd700 1 --2- 172.21.15.83:0/2416617812 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe78c111aa0 0x7fe78c19d6c0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:57.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:57.072+0000 7fe7911bd700 1 --2- 172.21.15.83:0/2416617812 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fe7740a11b0 0x7fe7740a3670 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:57.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:57.072+0000 7fe7911bd700 1 --2- 172.21.15.83:0/2416617812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe78c073520 0x7fe78c1a3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:57.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:57.072+0000 7fe7911bd700 1 --2- 172.21.15.83:0/2416617812 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe78c074d80 0x7fe78c1a3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:57.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:57.072+0000 7fe7911bd700 1 -- 172.21.15.83:0/2416617812 >> 172.21.15.83:0/2416617812 conn(0x7fe78c077f10 msgr2=0x7fe78c10fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:57.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:57.073+0000 7fe7911bd700 1 -- 172.21.15.83:0/2416617812 shutdown_connections 2024-04-01T06:54:57.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:57.073+0000 7fe7911bd700 1 -- 172.21.15.83:0/2416617812 wait complete. 2024-04-01T06:54:57.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:56 smithi153 ceph-mon[48187]: pgmap v230: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-01T06:54:57.365 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:54:57.510 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:54:57.560 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:54:57.768 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808848 got 287762808850 for osd.10 2024-04-01T06:54:57.769 DEBUG:teuthology.parallel:result is None 2024-04-01T06:54:57.779 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:57 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/2416617812' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-04-01T06:54:58.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:57 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/2416617812' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-04-01T06:54:58.012 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:54:58.012 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:54:58.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:57 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/2416617812' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-04-01T06:54:58.189 INFO:teuthology.orchestra.run.smithi083.stdout:317827579918 2024-04-01T06:54:58.190 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph osd last-stat-seq osd.11 2024-04-01T06:54:58.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:58.614+0000 7f50c529d700 1 -- 172.21.15.83:0/2500951955 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f50c00fff70 msgr2=0x7f50c0100350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:58.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:58.614+0000 7f50c529d700 1 --2- 172.21.15.83:0/2500951955 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f50c00fff70 0x7f50c0100350 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f50b4009990 tx=0x7f50b4009ca0 comp rx=0 tx=0).stop 2024-04-01T06:54:58.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:58.614+0000 7f50c529d700 1 -- 172.21.15.83:0/2500951955 shutdown_connections 2024-04-01T06:54:58.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:58.614+0000 7f50c529d700 1 --2- 172.21.15.83:0/2500951955 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f50c00fff70 0x7f50c0100350 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:58.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:58.614+0000 7f50c529d700 1 --2- 172.21.15.83:0/2500951955 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f50c0104fb0 0x7f50c010cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:58.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:58.614+0000 7f50c529d700 1 --2- 172.21.15.83:0/2500951955 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50c0100920 0x7f50c01048d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:58.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:58.614+0000 7f50c529d700 1 -- 172.21.15.83:0/2500951955 >> 172.21.15.83:0/2500951955 conn(0x7f50c0075d50 msgr2=0x7f50c0076160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:58.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:58.614+0000 7f50c529d700 1 -- 172.21.15.83:0/2500951955 shutdown_connections 2024-04-01T06:54:58.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:58.614+0000 7f50c529d700 1 -- 172.21.15.83:0/2500951955 wait complete. 2024-04-01T06:54:58.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:58.615+0000 7f50c529d700 1 Processor -- start 2024-04-01T06:54:58.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:58.615+0000 7f50c529d700 1 -- start start 2024-04-01T06:54:58.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:58.615+0000 7f50c529d700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f50c00fff70 0x7f50c01972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:58.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:58.615+0000 7f50c529d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f50c0100920 0x7f50c01977f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:58.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:58.615+0000 7f50c529d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50c0104fb0 0x7f50c019bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:58.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:58.615+0000 7f50c529d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c019c1b0 con 0x7f50c0100920 2024-04-01T06:54:58.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:58.615+0000 7f50c529d700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c019c320 con 0x7f50c00fff70 2024-04-01T06:54:58.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:58.615+0000 7f50c529d700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c019c4e0 con 0x7f50c0104fb0 2024-04-01T06:54:58.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:58.615+0000 7f50be7fc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f50c0100920 0x7f50c01977f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:58.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:58.615+0000 7f50be7fc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f50c0100920 0x7f50c01977f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:41688/0 (socket says 172.21.15.83:41688) 2024-04-01T06:54:58.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:58.615+0000 7f50be7fc700 1 -- 172.21.15.83:0/3189565710 learned_addr learned my addr 172.21.15.83:0/3189565710 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:54:58.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:58.616+0000 7f50beffd700 1 --2- 172.21.15.83:0/3189565710 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f50c00fff70 0x7f50c01972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:58.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:58.616+0000 7f50bf7fe700 1 --2- 172.21.15.83:0/3189565710 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50c0104fb0 0x7f50c019bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:58.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:58.616+0000 7f50be7fc700 1 -- 172.21.15.83:0/3189565710 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50c0104fb0 msgr2=0x7f50c019bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:58.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:58.616+0000 7f50be7fc700 1 --2- 172.21.15.83:0/3189565710 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50c0104fb0 0x7f50c019bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:58.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:58.616+0000 7f50be7fc700 1 -- 172.21.15.83:0/3189565710 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f50c00fff70 msgr2=0x7f50c01972b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:58.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:58.616+0000 7f50be7fc700 1 --2- 172.21.15.83:0/3189565710 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f50c00fff70 0x7f50c01972b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:58.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:58.616+0000 7f50be7fc700 1 -- 172.21.15.83:0/3189565710 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b40095f0 con 0x7f50c0100920 2024-04-01T06:54:58.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:58.616+0000 7f50be7fc700 1 --2- 172.21.15.83:0/3189565710 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f50c0100920 0x7f50c01977f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f50b000b500 tx=0x7f50b000b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:58.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:58.616+0000 7f50a7fff700 1 -- 172.21.15.83:0/3189565710 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b0011830 con 0x7f50c0100920 2024-04-01T06:54:58.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:58.616+0000 7f50a7fff700 1 -- 172.21.15.83:0/3189565710 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f50b0011e50 con 0x7f50c0100920 2024-04-01T06:54:58.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:58.616+0000 7f50c529d700 1 -- 172.21.15.83:0/3189565710 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50c019c7c0 con 0x7f50c0100920 2024-04-01T06:54:58.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:58.616+0000 7f50a7fff700 1 -- 172.21.15.83:0/3189565710 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b0010de0 con 0x7f50c0100920 2024-04-01T06:54:58.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:58.616+0000 7f50c529d700 1 -- 172.21.15.83:0/3189565710 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50c01a4020 con 0x7f50c0100920 2024-04-01T06:54:58.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:58.617+0000 7f50c529d700 1 -- 172.21.15.83:0/3189565710 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50c0109230 con 0x7f50c0100920 2024-04-01T06:54:58.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:58.618+0000 7f50a7fff700 1 -- 172.21.15.83:0/3189565710 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f50b0010480 con 0x7f50c0100920 2024-04-01T06:54:58.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:58.619+0000 7f50a7fff700 1 --2- 172.21.15.83:0/3189565710 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f50a80a1230 0x7f50a80a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:58.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:58.619+0000 7f50beffd700 1 --2- 172.21.15.83:0/3189565710 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f50a80a1230 0x7f50a80a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:58.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:58.619+0000 7f50a7fff700 1 -- 172.21.15.83:0/3189565710 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f50b00cc6d0 con 0x7f50c0100920 2024-04-01T06:54:58.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:58.619+0000 7f50beffd700 1 --2- 172.21.15.83:0/3189565710 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f50a80a1230 0x7f50a80a36f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f50b400b5c0 tx=0x7f50b4005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:58.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:58.622+0000 7f50a7fff700 1 -- 172.21.15.83:0/3189565710 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f50b0095fc0 con 0x7f50c0100920 2024-04-01T06:54:58.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:58 smithi083 ceph-mon[43429]: pgmap v231: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-01T06:54:58.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:58.839+0000 7f50c529d700 1 -- 172.21.15.83:0/3189565710 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f50c01013b0 con 0x7f50c0100920 2024-04-01T06:54:58.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:58.839+0000 7f50a7fff700 1 -- 172.21.15.83:0/3189565710 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f50b0015090 con 0x7f50c0100920 2024-04-01T06:54:58.840 INFO:teuthology.orchestra.run.smithi083.stdout:206158430236 2024-04-01T06:54:58.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:58.841+0000 7f50c529d700 1 -- 172.21.15.83:0/3189565710 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f50a80a1230 msgr2=0x7f50a80a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:58.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:58.841+0000 7f50c529d700 1 --2- 172.21.15.83:0/3189565710 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f50a80a1230 0x7f50a80a36f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f50b400b5c0 tx=0x7f50b4005960 comp rx=0 tx=0).stop 2024-04-01T06:54:58.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:58.841+0000 7f50c529d700 1 -- 172.21.15.83:0/3189565710 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f50c0100920 msgr2=0x7f50c01977f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:58.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:58.841+0000 7f50c529d700 1 --2- 172.21.15.83:0/3189565710 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f50c0100920 0x7f50c01977f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f50b000b500 tx=0x7f50b000b810 comp rx=0 tx=0).stop 2024-04-01T06:54:58.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:58.841+0000 7f50c529d700 1 -- 172.21.15.83:0/3189565710 shutdown_connections 2024-04-01T06:54:58.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:58.841+0000 7f50c529d700 1 --2- 172.21.15.83:0/3189565710 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f50a80a1230 0x7f50a80a36f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:58.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:58.841+0000 7f50c529d700 1 --2- 172.21.15.83:0/3189565710 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50c0104fb0 0x7f50c019bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:58.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:58.841+0000 7f50c529d700 1 --2- 172.21.15.83:0/3189565710 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f50c00fff70 0x7f50c01972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:58.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:58.841+0000 7f50c529d700 1 --2- 172.21.15.83:0/3189565710 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f50c0100920 0x7f50c01977f0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:58.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:58.841+0000 7f50c529d700 1 -- 172.21.15.83:0/3189565710 >> 172.21.15.83:0/3189565710 conn(0x7f50c0075d50 msgr2=0x7f50c0068bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:58.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:58.842+0000 7f50c529d700 1 -- 172.21.15.83:0/3189565710 shutdown_connections 2024-04-01T06:54:58.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:58.842+0000 7f50c529d700 1 -- 172.21.15.83:0/3189565710 wait complete. 2024-04-01T06:54:59.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:58 smithi145 ceph-mon[47816]: pgmap v231: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-01T06:54:59.128 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:59.019+0000 7f8670fc6700 1 -- 172.21.15.83:0/1270224861 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f866c0ff710 msgr2=0x7f866c0ffb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:59.128 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:59.019+0000 7f8670fc6700 1 --2- 172.21.15.83:0/1270224861 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f866c0ff710 0x7f866c0ffb90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f865c009990 tx=0x7f865c009ca0 comp rx=0 tx=0).stop 2024-04-01T06:54:59.128 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:59.019+0000 7f8670fc6700 1 -- 172.21.15.83:0/1270224861 shutdown_connections 2024-04-01T06:54:59.128 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:59.019+0000 7f8670fc6700 1 --2- 172.21.15.83:0/1270224861 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f866c1000d0 0x7f866c10dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:59.128 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:59.019+0000 7f8670fc6700 1 --2- 172.21.15.83:0/1270224861 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f866c105e00 0x7f866c1061e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:59.128 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:59.019+0000 7f8670fc6700 1 --2- 172.21.15.83:0/1270224861 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f866c0ff710 0x7f866c0ffb90 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:59.128 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:59.019+0000 7f8670fc6700 1 -- 172.21.15.83:0/1270224861 >> 172.21.15.83:0/1270224861 conn(0x7f866c075060 msgr2=0x7f866c075470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:59.128 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:59.019+0000 7f8670fc6700 1 -- 172.21.15.83:0/1270224861 shutdown_connections 2024-04-01T06:54:59.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:59.019+0000 7f8670fc6700 1 -- 172.21.15.83:0/1270224861 wait complete. 2024-04-01T06:54:59.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:59.020+0000 7f8670fc6700 1 Processor -- start 2024-04-01T06:54:59.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:59.020+0000 7f8670fc6700 1 -- start start 2024-04-01T06:54:59.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:59.020+0000 7f8670fc6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f866c0ff710 0x7f866c197290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:59.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:59.020+0000 7f8670fc6700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f866c1000d0 0x7f866c1977d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:59.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:59.020+0000 7f8670fc6700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f866c105e00 0x7f866c19bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:59.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:59.020+0000 7f8670fc6700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f866c19c0d0 con 0x7f866c1000d0 2024-04-01T06:54:59.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:59.020+0000 7f8670fc6700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f866c19c240 con 0x7f866c105e00 2024-04-01T06:54:59.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:59.020+0000 7f8670fc6700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f866c19c400 con 0x7f866c0ff710 2024-04-01T06:54:59.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:59.020+0000 7f8669d9b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f866c1000d0 0x7f866c1977d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:59.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:59.020+0000 7f8669d9b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f866c1000d0 0x7f866c1977d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:41712/0 (socket says 172.21.15.83:41712) 2024-04-01T06:54:59.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:59.020+0000 7f8669d9b700 1 -- 172.21.15.83:0/3961754409 learned_addr learned my addr 172.21.15.83:0/3961754409 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:54:59.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:59.020+0000 7f866a59c700 1 --2- 172.21.15.83:0/3961754409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f866c0ff710 0x7f866c197290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:59.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:59.020+0000 7f8669d9b700 1 -- 172.21.15.83:0/3961754409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f866c0ff710 msgr2=0x7f866c197290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:59.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:59.020+0000 7f866ad9d700 1 --2- 172.21.15.83:0/3961754409 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f866c105e00 0x7f866c19bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:59.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:59.020+0000 7f8669d9b700 1 --2- 172.21.15.83:0/3961754409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f866c0ff710 0x7f866c197290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:59.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:59.020+0000 7f8669d9b700 1 -- 172.21.15.83:0/3961754409 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f866c105e00 msgr2=0x7f866c19bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:59.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:59.020+0000 7f8669d9b700 1 --2- 172.21.15.83:0/3961754409 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f866c105e00 0x7f866c19bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:59.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:59.020+0000 7f8669d9b700 1 -- 172.21.15.83:0/3961754409 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f865c0095f0 con 0x7f866c1000d0 2024-04-01T06:54:59.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:59.020+0000 7f866a59c700 1 --2- 172.21.15.83:0/3961754409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f866c0ff710 0x7f866c197290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:54:59.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:59.020+0000 7f866ad9d700 1 --2- 172.21.15.83:0/3961754409 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f866c105e00 0x7f866c19bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:54:59.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:59.021+0000 7f8669d9b700 1 --2- 172.21.15.83:0/3961754409 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f866c1000d0 0x7f866c1977d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f865c000c00 tx=0x7f865c00f880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:59.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:59.021+0000 7f86637fe700 1 -- 172.21.15.83:0/3961754409 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c01d070 con 0x7f866c1000d0 2024-04-01T06:54:59.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:59.021+0000 7f8670fc6700 1 -- 172.21.15.83:0/3961754409 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f866c19c680 con 0x7f866c1000d0 2024-04-01T06:54:59.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:59.021+0000 7f86637fe700 1 -- 172.21.15.83:0/3961754409 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f865c00fde0 con 0x7f866c1000d0 2024-04-01T06:54:59.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:59.021+0000 7f86637fe700 1 -- 172.21.15.83:0/3961754409 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c017770 con 0x7f866c1000d0 2024-04-01T06:54:59.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:59.021+0000 7f8670fc6700 1 -- 172.21.15.83:0/3961754409 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f866c1a3f40 con 0x7f866c1000d0 2024-04-01T06:54:59.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:59.022+0000 7f8670fc6700 1 -- 172.21.15.83:0/3961754409 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f866c109370 con 0x7f866c1000d0 2024-04-01T06:54:59.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:59.023+0000 7f86637fe700 1 -- 172.21.15.83:0/3961754409 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f865c022aa0 con 0x7f866c1000d0 2024-04-01T06:54:59.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:59.023+0000 7f86637fe700 1 --2- 172.21.15.83:0/3961754409 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f86580a11b0 0x7f86580a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:54:59.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:59.024+0000 7f866a59c700 1 --2- 172.21.15.83:0/3961754409 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f86580a11b0 0x7f86580a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:54:59.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:59.024+0000 7f86637fe700 1 -- 172.21.15.83:0/3961754409 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f865c0cdd90 con 0x7f866c1000d0 2024-04-01T06:54:59.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:59.024+0000 7f866a59c700 1 --2- 172.21.15.83:0/3961754409 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f86580a11b0 0x7f86580a3670 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f86540099d0 tx=0x7f8654008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:54:59.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:59.028+0000 7f86637fe700 1 -- 172.21.15.83:0/3961754409 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f865c05d9f0 con 0x7f866c1000d0 2024-04-01T06:54:59.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:58 smithi153 ceph-mon[48187]: pgmap v231: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-01T06:54:59.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:59.226+0000 7f8670fc6700 1 -- 172.21.15.83:0/3961754409 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f866c198550 con 0x7f866c1000d0 2024-04-01T06:54:59.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:59.226+0000 7f86637fe700 1 -- 172.21.15.83:0/3961754409 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f865c097600 con 0x7f866c1000d0 2024-04-01T06:54:59.226 INFO:teuthology.orchestra.run.smithi083.stdout:154618822692 2024-04-01T06:54:59.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:59.228+0000 7f8670fc6700 1 -- 172.21.15.83:0/3961754409 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f86580a11b0 msgr2=0x7f86580a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:59.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:59.228+0000 7f8670fc6700 1 --2- 172.21.15.83:0/3961754409 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f86580a11b0 0x7f86580a3670 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f86540099d0 tx=0x7f8654008040 comp rx=0 tx=0).stop 2024-04-01T06:54:59.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:59.228+0000 7f8670fc6700 1 -- 172.21.15.83:0/3961754409 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f866c1000d0 msgr2=0x7f866c1977d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:54:59.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:59.228+0000 7f8670fc6700 1 --2- 172.21.15.83:0/3961754409 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f866c1000d0 0x7f866c1977d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f865c000c00 tx=0x7f865c00f880 comp rx=0 tx=0).stop 2024-04-01T06:54:59.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:59.229+0000 7f8670fc6700 1 -- 172.21.15.83:0/3961754409 shutdown_connections 2024-04-01T06:54:59.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:59.229+0000 7f8670fc6700 1 --2- 172.21.15.83:0/3961754409 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f86580a11b0 0x7f86580a3670 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:59.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:59.229+0000 7f8670fc6700 1 --2- 172.21.15.83:0/3961754409 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f866c105e00 0x7f866c19bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:59.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:59.229+0000 7f8670fc6700 1 --2- 172.21.15.83:0/3961754409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f866c0ff710 0x7f866c197290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:59.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:59.229+0000 7f8670fc6700 1 --2- 172.21.15.83:0/3961754409 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f866c1000d0 0x7f866c1977d0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:54:59.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:59.229+0000 7f8670fc6700 1 -- 172.21.15.83:0/3961754409 >> 172.21.15.83:0/3961754409 conn(0x7f866c075060 msgr2=0x7f866c0fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:54:59.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:59.229+0000 7f8670fc6700 1 -- 172.21.15.83:0/3961754409 shutdown_connections 2024-04-01T06:54:59.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:54:59.229+0000 7f8670fc6700 1 -- 172.21.15.83:0/3961754409 wait complete. 2024-04-01T06:54:59.752 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:54:59.795 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:55:00.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:59 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/3189565710' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-01T06:55:00.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:54:59 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/3961754409' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-01T06:55:00.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:59 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/3189565710' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-01T06:55:00.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:54:59 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/3961754409' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-01T06:55:00.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:59 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/3189565710' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-01T06:55:00.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:54:59 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/3961754409' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-01T06:55:00.398 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:55:00.455 INFO:tasks.cephadm.ceph_manager.ceph:need seq 206158430234 got 206158430236 for osd.7 2024-04-01T06:55:00.455 DEBUG:teuthology.parallel:result is None 2024-04-01T06:55:00.997 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:00 smithi083 ceph-mon[43429]: pgmap v232: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-04-01T06:55:01.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:00 smithi145 ceph-mon[47816]: pgmap v232: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-04-01T06:55:01.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:00 smithi153 ceph-mon[48187]: pgmap v232: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-04-01T06:55:01.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.379+0000 7fdca6e8c700 1 -- 172.21.15.83:0/2039442053 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdca0100920 msgr2=0x7fdca01048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:01.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.379+0000 7fdca6e8c700 1 --2- 172.21.15.83:0/2039442053 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdca0100920 0x7fdca01048d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c009990 tx=0x7fdc8c009ca0 comp rx=0 tx=0).stop 2024-04-01T06:55:01.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.379+0000 7fdca6e8c700 1 -- 172.21.15.83:0/2039442053 shutdown_connections 2024-04-01T06:55:01.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.379+0000 7fdca6e8c700 1 --2- 172.21.15.83:0/2039442053 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdca0104fb0 0x7fdca010cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:01.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.380+0000 7fdca6e8c700 1 --2- 172.21.15.83:0/2039442053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdca00fff70 0x7fdca0100350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:01.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.380+0000 7fdca6e8c700 1 --2- 172.21.15.83:0/2039442053 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdca0100920 0x7fdca01048d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:01.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.380+0000 7fdca6e8c700 1 -- 172.21.15.83:0/2039442053 >> 172.21.15.83:0/2039442053 conn(0x7fdca0075d50 msgr2=0x7fdca0076160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:01.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.380+0000 7fdca6e8c700 1 -- 172.21.15.83:0/2039442053 shutdown_connections 2024-04-01T06:55:01.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.380+0000 7fdca6e8c700 1 -- 172.21.15.83:0/2039442053 wait complete. 2024-04-01T06:55:01.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.380+0000 7fdca6e8c700 1 Processor -- start 2024-04-01T06:55:01.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.380+0000 7fdca6e8c700 1 -- start start 2024-04-01T06:55:01.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.380+0000 7fdca6e8c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdca00fff70 0x7fdca0198010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:01.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.380+0000 7fdca6e8c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdca0100920 0x7fdca0198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:01.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.380+0000 7fdca6e8c700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdca0104fb0 0x7fdca01a3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:01.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.380+0000 7fdca6e8c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca0198da0 con 0x7fdca00fff70 2024-04-01T06:55:01.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.380+0000 7fdca6e8c700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca01a35d0 con 0x7fdca0104fb0 2024-04-01T06:55:01.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.380+0000 7fdca6e8c700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca01a3710 con 0x7fdca0100920 2024-04-01T06:55:01.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.380+0000 7fdca4c28700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdca00fff70 0x7fdca0198010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:01.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.380+0000 7fdca4c28700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdca00fff70 0x7fdca0198010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:41730/0 (socket says 172.21.15.83:41730) 2024-04-01T06:55:01.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.380+0000 7fdca4c28700 1 -- 172.21.15.83:0/2193725634 learned_addr learned my addr 172.21.15.83:0/2193725634 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:01.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.381+0000 7fdca5429700 1 --2- 172.21.15.83:0/2193725634 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdca0104fb0 0x7fdca01a3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:01.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.381+0000 7fdc9ffff700 1 --2- 172.21.15.83:0/2193725634 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdca0100920 0x7fdca0198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:01.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.381+0000 7fdca4c28700 1 -- 172.21.15.83:0/2193725634 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdca0100920 msgr2=0x7fdca0198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:01.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.381+0000 7fdca4c28700 1 --2- 172.21.15.83:0/2193725634 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdca0100920 0x7fdca0198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:01.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.381+0000 7fdca4c28700 1 -- 172.21.15.83:0/2193725634 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdca0104fb0 msgr2=0x7fdca01a3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:01.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.381+0000 7fdca4c28700 1 --2- 172.21.15.83:0/2193725634 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdca0104fb0 0x7fdca01a3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:01.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.381+0000 7fdca4c28700 1 -- 172.21.15.83:0/2193725634 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc8c0095f0 con 0x7fdca00fff70 2024-04-01T06:55:01.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.381+0000 7fdca4c28700 1 --2- 172.21.15.83:0/2193725634 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdca00fff70 0x7fdca0198010 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fdc9400c950 tx=0x7fdc9400cd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:01.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.381+0000 7fdc9dffb700 1 -- 172.21.15.83:0/2193725634 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc94007ac0 con 0x7fdca00fff70 2024-04-01T06:55:01.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.381+0000 7fdc9dffb700 1 -- 172.21.15.83:0/2193725634 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdc94004cf0 con 0x7fdca00fff70 2024-04-01T06:55:01.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.381+0000 7fdc9dffb700 1 -- 172.21.15.83:0/2193725634 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc94005550 con 0x7fdca00fff70 2024-04-01T06:55:01.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.381+0000 7fdca6e8c700 1 -- 172.21.15.83:0/2193725634 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdca01a3970 con 0x7fdca00fff70 2024-04-01T06:55:01.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.381+0000 7fdca6e8c700 1 -- 172.21.15.83:0/2193725634 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdca01a3e20 con 0x7fdca00fff70 2024-04-01T06:55:01.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.382+0000 7fdca6e8c700 1 -- 172.21.15.83:0/2193725634 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdca01082d0 con 0x7fdca00fff70 2024-04-01T06:55:01.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.383+0000 7fdc9dffb700 1 -- 172.21.15.83:0/2193725634 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7fdc94004750 con 0x7fdca00fff70 2024-04-01T06:55:01.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.383+0000 7fdc9dffb700 1 --2- 172.21.15.83:0/2193725634 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fdc900a11b0 0x7fdc900a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:01.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.384+0000 7fdc9ffff700 1 --2- 172.21.15.83:0/2193725634 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fdc900a11b0 0x7fdc900a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:01.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.384+0000 7fdc9dffb700 1 -- 172.21.15.83:0/2193725634 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fdc940cc5a0 con 0x7fdca00fff70 2024-04-01T06:55:01.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.384+0000 7fdc9ffff700 1 --2- 172.21.15.83:0/2193725634 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fdc900a11b0 0x7fdc900a3670 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c006010 tx=0x7fdc8c01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:01.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.388+0000 7fdc9dffb700 1 -- 172.21.15.83:0/2193725634 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7fdc94095c80 con 0x7fdca00fff70 2024-04-01T06:55:01.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.597+0000 7fdca6e8c700 1 -- 172.21.15.83:0/2193725634 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7fdca01013b0 con 0x7fdca00fff70 2024-04-01T06:55:01.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.597+0000 7fdc9dffb700 1 -- 172.21.15.83:0/2193725634 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdca01013b0 con 0x7fdca00fff70 2024-04-01T06:55:01.597 INFO:teuthology.orchestra.run.smithi083.stdout:266287972375 2024-04-01T06:55:01.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.599+0000 7fdca6e8c700 1 -- 172.21.15.83:0/2193725634 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fdc900a11b0 msgr2=0x7fdc900a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:01.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.599+0000 7fdca6e8c700 1 --2- 172.21.15.83:0/2193725634 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fdc900a11b0 0x7fdc900a3670 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c006010 tx=0x7fdc8c01a040 comp rx=0 tx=0).stop 2024-04-01T06:55:01.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.599+0000 7fdca6e8c700 1 -- 172.21.15.83:0/2193725634 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdca00fff70 msgr2=0x7fdca0198010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:01.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.599+0000 7fdca6e8c700 1 --2- 172.21.15.83:0/2193725634 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdca00fff70 0x7fdca0198010 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fdc9400c950 tx=0x7fdc9400cd10 comp rx=0 tx=0).stop 2024-04-01T06:55:01.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.599+0000 7fdca6e8c700 1 -- 172.21.15.83:0/2193725634 shutdown_connections 2024-04-01T06:55:01.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.599+0000 7fdca6e8c700 1 --2- 172.21.15.83:0/2193725634 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdca00fff70 0x7fdca0198010 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:01.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.599+0000 7fdca6e8c700 1 --2- 172.21.15.83:0/2193725634 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fdc900a11b0 0x7fdc900a3670 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:01.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.599+0000 7fdca6e8c700 1 --2- 172.21.15.83:0/2193725634 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdca0104fb0 0x7fdca01a3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:01.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.599+0000 7fdca6e8c700 1 --2- 172.21.15.83:0/2193725634 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdca0100920 0x7fdca0198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:01.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.599+0000 7fdca6e8c700 1 -- 172.21.15.83:0/2193725634 >> 172.21.15.83:0/2193725634 conn(0x7fdca0075d50 msgr2=0x7fdca00ff4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:01.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.599+0000 7fdca6e8c700 1 -- 172.21.15.83:0/2193725634 shutdown_connections 2024-04-01T06:55:01.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.600+0000 7fdca6e8c700 1 -- 172.21.15.83:0/2193725634 wait complete. 2024-04-01T06:55:01.796 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:01 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/2193725634' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-04-01T06:55:02.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:01 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/2193725634' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-04-01T06:55:02.030 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:55:02.116 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822691 got 154618822692 for osd.5 2024-04-01T06:55:02.116 DEBUG:teuthology.parallel:result is None 2024-04-01T06:55:02.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:01 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/2193725634' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-04-01T06:55:02.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.670+0000 7f8ad1133700 1 -- 172.21.15.83:0/1493070499 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8acc0690f0 msgr2=0x7f8acc10dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:02.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.670+0000 7f8ad1133700 1 --2- 172.21.15.83:0/1493070499 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8acc0690f0 0x7f8acc10dc60 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8ac400b0a0 tx=0x7f8ac400b3b0 comp rx=0 tx=0).stop 2024-04-01T06:55:02.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.670+0000 7f8ad1133700 1 -- 172.21.15.83:0/1493070499 shutdown_connections 2024-04-01T06:55:02.152 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.670+0000 7f8ad1133700 1 --2- 172.21.15.83:0/1493070499 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8acc0690f0 0x7f8acc10dc60 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:02.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.670+0000 7f8ad1133700 1 --2- 172.21.15.83:0/1493070499 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8acc106e20 0x7f8acc107200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:02.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.670+0000 7f8ad1133700 1 --2- 172.21.15.83:0/1493070499 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8acc068750 0x7f8acc068bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:02.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.670+0000 7f8ad1133700 1 -- 172.21.15.83:0/1493070499 >> 172.21.15.83:0/1493070499 conn(0x7f8acc075d50 msgr2=0x7f8acc076160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:02.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.670+0000 7f8ad1133700 1 -- 172.21.15.83:0/1493070499 shutdown_connections 2024-04-01T06:55:02.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.670+0000 7f8ad1133700 1 -- 172.21.15.83:0/1493070499 wait complete. 2024-04-01T06:55:02.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.671+0000 7f8ad1133700 1 Processor -- start 2024-04-01T06:55:02.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.671+0000 7f8ad1133700 1 -- start start 2024-04-01T06:55:02.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.671+0000 7f8ad1133700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8acc068750 0x7f8acc197320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:02.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.671+0000 7f8ad1133700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8acc0690f0 0x7f8acc197860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:02.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.671+0000 7f8ad1133700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8acc106e20 0x7f8acc19bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:02.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.671+0000 7f8ad1133700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8acc19c220 con 0x7f8acc0690f0 2024-04-01T06:55:02.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.671+0000 7f8ad1133700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8acc19c390 con 0x7f8acc068750 2024-04-01T06:55:02.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.671+0000 7f8ad1133700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8acc19c550 con 0x7f8acc106e20 2024-04-01T06:55:02.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.671+0000 7f8ac3fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8acc0690f0 0x7f8acc197860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:02.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.671+0000 7f8ac3fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8acc0690f0 0x7f8acc197860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:41756/0 (socket says 172.21.15.83:41756) 2024-04-01T06:55:02.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.671+0000 7f8ac3fff700 1 -- 172.21.15.83:0/4178108532 learned_addr learned my addr 172.21.15.83:0/4178108532 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:02.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.671+0000 7f8acad9d700 1 --2- 172.21.15.83:0/4178108532 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8acc068750 0x7f8acc197320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:02.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.671+0000 7f8acb59e700 1 --2- 172.21.15.83:0/4178108532 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8acc106e20 0x7f8acc19bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:02.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.672+0000 7f8ac3fff700 1 -- 172.21.15.83:0/4178108532 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8acc106e20 msgr2=0x7f8acc19bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:02.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.672+0000 7f8ac3fff700 1 --2- 172.21.15.83:0/4178108532 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8acc106e20 0x7f8acc19bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:02.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.672+0000 7f8ac3fff700 1 -- 172.21.15.83:0/4178108532 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8acc068750 msgr2=0x7f8acc197320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:02.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.672+0000 7f8ac3fff700 1 --2- 172.21.15.83:0/4178108532 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8acc068750 0x7f8acc197320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:02.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.672+0000 7f8ac3fff700 1 -- 172.21.15.83:0/4178108532 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac4009d00 con 0x7f8acc0690f0 2024-04-01T06:55:02.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.672+0000 7f8ac3fff700 1 --2- 172.21.15.83:0/4178108532 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8acc0690f0 0x7f8acc197860 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8ab400d950 tx=0x7f8ab400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:02.154 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.672+0000 7f8ac8d99700 1 -- 172.21.15.83:0/4178108532 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab400f890 con 0x7f8acc0690f0 2024-04-01T06:55:02.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.672+0000 7f8ac8d99700 1 -- 172.21.15.83:0/4178108532 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8ab4010460 con 0x7f8acc0690f0 2024-04-01T06:55:02.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.672+0000 7f8ad1133700 1 -- 172.21.15.83:0/4178108532 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8acc19c830 con 0x7f8acc0690f0 2024-04-01T06:55:02.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.672+0000 7f8ac8d99700 1 -- 172.21.15.83:0/4178108532 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab400e610 con 0x7f8acc0690f0 2024-04-01T06:55:02.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.672+0000 7f8ad1133700 1 -- 172.21.15.83:0/4178108532 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8acc1a4090 con 0x7f8acc0690f0 2024-04-01T06:55:02.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.673+0000 7f8ad1133700 1 -- 172.21.15.83:0/4178108532 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8acc109340 con 0x7f8acc0690f0 2024-04-01T06:55:02.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.674+0000 7f8ac8d99700 1 -- 172.21.15.83:0/4178108532 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f8ab40108d0 con 0x7f8acc0690f0 2024-04-01T06:55:02.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.675+0000 7f8ac8d99700 1 --2- 172.21.15.83:0/4178108532 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f8ab80a11b0 0x7f8ab80a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:02.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.675+0000 7f8ac8d99700 1 -- 172.21.15.83:0/4178108532 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f8ab40cc670 con 0x7f8acc0690f0 2024-04-01T06:55:02.155 INFO:teuthology.orchestra.run.smithi083.stdout:55834574899 2024-04-01T06:55:02.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.678+0000 7f8acad9d700 1 --2- 172.21.15.83:0/4178108532 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f8ab80a11b0 0x7f8ab80a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:02.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.678+0000 7f8acad9d700 1 --2- 172.21.15.83:0/4178108532 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f8ab80a11b0 0x7f8ab80a3670 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8abc005950 tx=0x7f8abc00a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:02.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.678+0000 7f8ac8d99700 1 -- 172.21.15.83:0/4178108532 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f8ab4095e50 con 0x7f8acc0690f0 2024-04-01T06:55:02.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.888+0000 7f8ad1133700 1 -- 172.21.15.83:0/4178108532 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8acc1024d0 con 0x7f8acc0690f0 2024-04-01T06:55:02.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.889+0000 7f8ac8d99700 1 -- 172.21.15.83:0/4178108532 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8ab4016090 con 0x7f8acc0690f0 2024-04-01T06:55:02.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.891+0000 7f8ad1133700 1 -- 172.21.15.83:0/4178108532 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f8ab80a11b0 msgr2=0x7f8ab80a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:02.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.891+0000 7f8ad1133700 1 --2- 172.21.15.83:0/4178108532 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f8ab80a11b0 0x7f8ab80a3670 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8abc005950 tx=0x7f8abc00a300 comp rx=0 tx=0).stop 2024-04-01T06:55:02.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.891+0000 7f8ad1133700 1 -- 172.21.15.83:0/4178108532 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8acc0690f0 msgr2=0x7f8acc197860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:02.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.891+0000 7f8ad1133700 1 --2- 172.21.15.83:0/4178108532 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8acc0690f0 0x7f8acc197860 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8ab400d950 tx=0x7f8ab400dc60 comp rx=0 tx=0).stop 2024-04-01T06:55:02.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.891+0000 7f8ad1133700 1 -- 172.21.15.83:0/4178108532 shutdown_connections 2024-04-01T06:55:02.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.891+0000 7f8ad1133700 1 --2- 172.21.15.83:0/4178108532 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f8ab80a11b0 0x7f8ab80a3670 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:02.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.891+0000 7f8ad1133700 1 --2- 172.21.15.83:0/4178108532 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8acc106e20 0x7f8acc19bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:02.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.891+0000 7f8ad1133700 1 --2- 172.21.15.83:0/4178108532 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8acc068750 0x7f8acc197320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:02.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.891+0000 7f8ad1133700 1 --2- 172.21.15.83:0/4178108532 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8acc0690f0 0x7f8acc197860 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:02.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.891+0000 7f8ad1133700 1 -- 172.21.15.83:0/4178108532 >> 172.21.15.83:0/4178108532 conn(0x7f8acc075d50 msgr2=0x7f8acc0feaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:02.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.891+0000 7f8ad1133700 1 -- 172.21.15.83:0/4178108532 shutdown_connections 2024-04-01T06:55:02.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:01.891+0000 7f8ad1133700 1 -- 172.21.15.83:0/4178108532 wait complete. 2024-04-01T06:55:02.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:02.193+0000 7fa19abd0700 1 -- 172.21.15.83:0/2907415240 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa194105d50 msgr2=0x7fa194106130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:02.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:02.193+0000 7fa19abd0700 1 --2- 172.21.15.83:0/2907415240 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa194105d50 0x7fa194106130 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa190009990 tx=0x7fa190009ca0 comp rx=0 tx=0).stop 2024-04-01T06:55:02.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:02.193+0000 7fa19abd0700 1 -- 172.21.15.83:0/2907415240 shutdown_connections 2024-04-01T06:55:02.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:02.193+0000 7fa19abd0700 1 --2- 172.21.15.83:0/2907415240 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa194105d50 0x7fa194106130 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:02.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:02.193+0000 7fa19abd0700 1 --2- 172.21.15.83:0/2907415240 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa194100660 0x7fa19410cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:02.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:02.193+0000 7fa19abd0700 1 --2- 172.21.15.83:0/2907415240 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa1940ffca0 0x7fa194100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:02.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:02.193+0000 7fa19abd0700 1 -- 172.21.15.83:0/2907415240 >> 172.21.15.83:0/2907415240 conn(0x7fa194076c80 msgr2=0x7fa194077090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:02.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:02.193+0000 7fa19abd0700 1 -- 172.21.15.83:0/2907415240 shutdown_connections 2024-04-01T06:55:02.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:02.193+0000 7fa19abd0700 1 -- 172.21.15.83:0/2907415240 wait complete. 2024-04-01T06:55:02.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:02.194+0000 7fa19abd0700 1 Processor -- start 2024-04-01T06:55:02.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:02.194+0000 7fa19abd0700 1 -- start start 2024-04-01T06:55:02.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:02.194+0000 7fa19abd0700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1940ffca0 0x7fa1941960e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:02.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:02.194+0000 7fa19abd0700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa194100660 0x7fa194196620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:02.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:02.194+0000 7fa19abd0700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa194105d50 0x7fa19419a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:02.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:02.194+0000 7fa19abd0700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19419af90 con 0x7fa194100660 2024-04-01T06:55:02.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:02.194+0000 7fa19abd0700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19419b100 con 0x7fa194105d50 2024-04-01T06:55:02.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:02.194+0000 7fa19abd0700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19419b2c0 con 0x7fa1940ffca0 2024-04-01T06:55:02.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:02.194+0000 7fa18bfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa194100660 0x7fa194196620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:02.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:02.194+0000 7fa18bfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa194100660 0x7fa194196620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:41774/0 (socket says 172.21.15.83:41774) 2024-04-01T06:55:02.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:02.194+0000 7fa18bfff700 1 -- 172.21.15.83:0/4097686337 learned_addr learned my addr 172.21.15.83:0/4097686337 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:02.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:02.194+0000 7fa19896c700 1 --2- 172.21.15.83:0/4097686337 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1940ffca0 0x7fa1941960e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:02.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:02.194+0000 7fa19916d700 1 --2- 172.21.15.83:0/4097686337 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa194105d50 0x7fa19419a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:02.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:02.194+0000 7fa18bfff700 1 -- 172.21.15.83:0/4097686337 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1940ffca0 msgr2=0x7fa1941960e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:02.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:02.194+0000 7fa18bfff700 1 --2- 172.21.15.83:0/4097686337 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1940ffca0 0x7fa1941960e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:02.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:02.194+0000 7fa18bfff700 1 -- 172.21.15.83:0/4097686337 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa194105d50 msgr2=0x7fa19419a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:02.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:02.194+0000 7fa18bfff700 1 --2- 172.21.15.83:0/4097686337 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa194105d50 0x7fa19419a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:02.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:02.194+0000 7fa18bfff700 1 -- 172.21.15.83:0/4097686337 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1900095f0 con 0x7fa194100660 2024-04-01T06:55:02.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:02.194+0000 7fa19896c700 1 --2- 172.21.15.83:0/4097686337 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1940ffca0 0x7fa1941960e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:55:02.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:02.195+0000 7fa18bfff700 1 --2- 172.21.15.83:0/4097686337 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa194100660 0x7fa194196620 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa184007b50 tx=0x7fa184007f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:02.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:02.195+0000 7fa189ffb700 1 -- 172.21.15.83:0/4097686337 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa184011070 con 0x7fa194100660 2024-04-01T06:55:02.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:02.195+0000 7fa189ffb700 1 -- 172.21.15.83:0/4097686337 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa18400c2e0 con 0x7fa194100660 2024-04-01T06:55:02.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:02.195+0000 7fa19abd0700 1 -- 172.21.15.83:0/4097686337 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa19419b5a0 con 0x7fa194100660 2024-04-01T06:55:02.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:02.195+0000 7fa189ffb700 1 -- 172.21.15.83:0/4097686337 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18400aa30 con 0x7fa194100660 2024-04-01T06:55:02.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:02.195+0000 7fa19abd0700 1 -- 172.21.15.83:0/4097686337 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1940691d0 con 0x7fa194100660 2024-04-01T06:55:02.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:02.196+0000 7fa19abd0700 1 -- 172.21.15.83:0/4097686337 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa194101390 con 0x7fa194100660 2024-04-01T06:55:02.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:02.197+0000 7fa189ffb700 1 -- 172.21.15.83:0/4097686337 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7fa18400ec80 con 0x7fa194100660 2024-04-01T06:55:02.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:02.197+0000 7fa189ffb700 1 --2- 172.21.15.83:0/4097686337 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fa17c0a11b0 0x7fa17c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:02.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:02.197+0000 7fa189ffb700 1 -- 172.21.15.83:0/4097686337 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa1840cd6a0 con 0x7fa194100660 2024-04-01T06:55:02.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:02.197+0000 7fa19896c700 1 --2- 172.21.15.83:0/4097686337 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fa17c0a11b0 0x7fa17c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:02.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:02.198+0000 7fa19896c700 1 --2- 172.21.15.83:0/4097686337 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fa17c0a11b0 0x7fa17c0a3670 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa190006010 tx=0x7fa19001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:02.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:02.202+0000 7fa189ffb700 1 -- 172.21.15.83:0/4097686337 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7fa184096e80 con 0x7fa194100660 2024-04-01T06:55:02.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:02.404+0000 7fa19abd0700 1 -- 172.21.15.83:0/4097686337 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa19410fc30 con 0x7fa194100660 2024-04-01T06:55:02.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:02.405+0000 7fa189ffb700 1 -- 172.21.15.83:0/4097686337 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa18409a4a0 con 0x7fa194100660 2024-04-01T06:55:02.405 INFO:teuthology.orchestra.run.smithi083.stdout:77309411375 2024-04-01T06:55:02.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:02.407+0000 7fa19abd0700 1 -- 172.21.15.83:0/4097686337 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fa17c0a11b0 msgr2=0x7fa17c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:02.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:02.407+0000 7fa19abd0700 1 --2- 172.21.15.83:0/4097686337 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fa17c0a11b0 0x7fa17c0a3670 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa190006010 tx=0x7fa19001a040 comp rx=0 tx=0).stop 2024-04-01T06:55:02.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:02.407+0000 7fa19abd0700 1 -- 172.21.15.83:0/4097686337 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa194100660 msgr2=0x7fa194196620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:02.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:02.407+0000 7fa19abd0700 1 --2- 172.21.15.83:0/4097686337 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa194100660 0x7fa194196620 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa184007b50 tx=0x7fa184007f10 comp rx=0 tx=0).stop 2024-04-01T06:55:02.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:02.407+0000 7fa19abd0700 1 -- 172.21.15.83:0/4097686337 shutdown_connections 2024-04-01T06:55:02.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:02.407+0000 7fa19abd0700 1 --2- 172.21.15.83:0/4097686337 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fa17c0a11b0 0x7fa17c0a3670 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:02.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:02.407+0000 7fa19abd0700 1 --2- 172.21.15.83:0/4097686337 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa194105d50 0x7fa19419a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:02.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:02.407+0000 7fa19abd0700 1 --2- 172.21.15.83:0/4097686337 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1940ffca0 0x7fa1941960e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:02.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:02.407+0000 7fa19abd0700 1 --2- 172.21.15.83:0/4097686337 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa194100660 0x7fa194196620 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:02.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:02.407+0000 7fa19abd0700 1 -- 172.21.15.83:0/4097686337 >> 172.21.15.83:0/4097686337 conn(0x7fa194076c80 msgr2=0x7fa1940fe9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:02.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:02.407+0000 7fa19abd0700 1 -- 172.21.15.83:0/4097686337 shutdown_connections 2024-04-01T06:55:02.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:02.407+0000 7fa19abd0700 1 -- 172.21.15.83:0/4097686337 wait complete. 2024-04-01T06:55:02.999 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:02 smithi083 ceph-mon[43429]: pgmap v233: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-01T06:55:03.000 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:02 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/4178108532' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-01T06:55:03.000 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:02 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/4097686337' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-01T06:55:03.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:02 smithi145 ceph-mon[47816]: pgmap v233: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-01T06:55:03.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:02 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/4178108532' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-01T06:55:03.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:02 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/4097686337' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-01T06:55:03.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:02 smithi153 ceph-mon[48187]: pgmap v233: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 5 op/s 2024-04-01T06:55:03.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:02 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/4178108532' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-01T06:55:03.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:02 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/4097686337' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-01T06:55:03.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.386+0000 7f934ed40700 1 -- 172.21.15.83:0/1247114167 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9348104fb0 msgr2=0x7f934810cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:03.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.386+0000 7f934ed40700 1 --2- 172.21.15.83:0/1247114167 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9348104fb0 0x7f934810cb80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f934000b0a0 tx=0x7f934000b3b0 comp rx=0 tx=0).stop 2024-04-01T06:55:03.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.386+0000 7f934ed40700 1 -- 172.21.15.83:0/1247114167 shutdown_connections 2024-04-01T06:55:03.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.386+0000 7f934ed40700 1 --2- 172.21.15.83:0/1247114167 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9348104fb0 0x7f934810cb80 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:03.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.386+0000 7f934ed40700 1 --2- 172.21.15.83:0/1247114167 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93480fff70 0x7f9348100350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:03.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.386+0000 7f934ed40700 1 --2- 172.21.15.83:0/1247114167 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9348100920 0x7f93481048d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:03.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.386+0000 7f934ed40700 1 -- 172.21.15.83:0/1247114167 >> 172.21.15.83:0/1247114167 conn(0x7f9348075d50 msgr2=0x7f9348076160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:03.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.386+0000 7f934ed40700 1 -- 172.21.15.83:0/1247114167 shutdown_connections 2024-04-01T06:55:03.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.386+0000 7f934ed40700 1 -- 172.21.15.83:0/1247114167 wait complete. 2024-04-01T06:55:03.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.387+0000 7f934ed40700 1 Processor -- start 2024-04-01T06:55:03.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.387+0000 7f934ed40700 1 -- start start 2024-04-01T06:55:03.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.387+0000 7f934ed40700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f93480fff70 0x7f9348195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:03.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.387+0000 7f934ed40700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9348100920 0x7f9348196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:03.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.387+0000 7f934ed40700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9348104fb0 0x7f9348196970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:03.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.387+0000 7f934ed40700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93481a5690 con 0x7f93480fff70 2024-04-01T06:55:03.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.387+0000 7f934ed40700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93481a5800 con 0x7f9348100920 2024-04-01T06:55:03.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.387+0000 7f934ed40700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93481a59c0 con 0x7f9348104fb0 2024-04-01T06:55:03.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.387+0000 7f934cadc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f93480fff70 0x7f9348195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:03.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.387+0000 7f934cadc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f93480fff70 0x7f9348195ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:50322/0 (socket says 172.21.15.83:50322) 2024-04-01T06:55:03.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.387+0000 7f934cadc700 1 -- 172.21.15.83:0/364165082 learned_addr learned my addr 172.21.15.83:0/364165082 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:03.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.387+0000 7f934d2dd700 1 --2- 172.21.15.83:0/364165082 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9348104fb0 0x7f9348196970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:03.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.387+0000 7f9347fff700 1 --2- 172.21.15.83:0/364165082 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9348100920 0x7f9348196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:03.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.387+0000 7f934cadc700 1 -- 172.21.15.83:0/364165082 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9348104fb0 msgr2=0x7f9348196970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:03.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.387+0000 7f934cadc700 1 --2- 172.21.15.83:0/364165082 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9348104fb0 0x7f9348196970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:03.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.387+0000 7f934cadc700 1 -- 172.21.15.83:0/364165082 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9348100920 msgr2=0x7f9348196430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:03.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.387+0000 7f934cadc700 1 --2- 172.21.15.83:0/364165082 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9348100920 0x7f9348196430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:03.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.387+0000 7f934cadc700 1 -- 172.21.15.83:0/364165082 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9340009d00 con 0x7f93480fff70 2024-04-01T06:55:03.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.387+0000 7f9347fff700 1 --2- 172.21.15.83:0/364165082 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9348100920 0x7f9348196430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:55:03.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.387+0000 7f934cadc700 1 --2- 172.21.15.83:0/364165082 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f93480fff70 0x7f9348195ef0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f933c00e9a0 tx=0x7f933c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:03.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.387+0000 7f9345ffb700 1 -- 172.21.15.83:0/364165082 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933c009790 con 0x7f93480fff70 2024-04-01T06:55:03.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.388+0000 7f934ed40700 1 -- 172.21.15.83:0/364165082 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93481a5ca0 con 0x7f93480fff70 2024-04-01T06:55:03.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.388+0000 7f9345ffb700 1 -- 172.21.15.83:0/364165082 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f933c00cbd0 con 0x7f93480fff70 2024-04-01T06:55:03.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.388+0000 7f9345ffb700 1 -- 172.21.15.83:0/364165082 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933c018680 con 0x7f93480fff70 2024-04-01T06:55:03.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.388+0000 7f934ed40700 1 -- 172.21.15.83:0/364165082 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93481a61a0 con 0x7f93480fff70 2024-04-01T06:55:03.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.389+0000 7f934ed40700 1 -- 172.21.15.83:0/364165082 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93481082d0 con 0x7f93480fff70 2024-04-01T06:55:03.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.390+0000 7f9345ffb700 1 -- 172.21.15.83:0/364165082 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f933c00cd40 con 0x7f93480fff70 2024-04-01T06:55:03.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.391+0000 7f9345ffb700 1 --2- 172.21.15.83:0/364165082 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f93380a11b0 0x7f93380a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:03.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.391+0000 7f9347fff700 1 --2- 172.21.15.83:0/364165082 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f93380a11b0 0x7f93380a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:03.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.391+0000 7f9345ffb700 1 -- 172.21.15.83:0/364165082 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f933c014070 con 0x7f93480fff70 2024-04-01T06:55:03.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.391+0000 7f9347fff700 1 --2- 172.21.15.83:0/364165082 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f93380a11b0 0x7f93380a3670 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9348069010 tx=0x7f9334009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:03.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.395+0000 7f9345ffb700 1 -- 172.21.15.83:0/364165082 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f933c096c40 con 0x7f93480fff70 2024-04-01T06:55:03.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.587+0000 7f5f07272700 1 -- 172.21.15.83:0/3995948054 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5f00100920 msgr2=0x7f5f001048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:03.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.587+0000 7f5f07272700 1 --2- 172.21.15.83:0/3995948054 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5f00100920 0x7f5f001048d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5ef0009990 tx=0x7f5ef0009ca0 comp rx=0 tx=0).stop 2024-04-01T06:55:03.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.587+0000 7f5f07272700 1 -- 172.21.15.83:0/3995948054 shutdown_connections 2024-04-01T06:55:03.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.587+0000 7f5f07272700 1 --2- 172.21.15.83:0/3995948054 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5f00104fb0 0x7f5f0010cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:03.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.587+0000 7f5f07272700 1 --2- 172.21.15.83:0/3995948054 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5f000fff70 0x7f5f00100350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:03.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.587+0000 7f5f07272700 1 --2- 172.21.15.83:0/3995948054 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5f00100920 0x7f5f001048d0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:03.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.587+0000 7f5f07272700 1 -- 172.21.15.83:0/3995948054 >> 172.21.15.83:0/3995948054 conn(0x7f5f00075d50 msgr2=0x7f5f00076160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:03.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.588+0000 7f5f07272700 1 -- 172.21.15.83:0/3995948054 shutdown_connections 2024-04-01T06:55:03.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.588+0000 7f5f07272700 1 -- 172.21.15.83:0/3995948054 wait complete. 2024-04-01T06:55:03.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.588+0000 7f5f07272700 1 Processor -- start 2024-04-01T06:55:03.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.588+0000 7f5f07272700 1 -- start start 2024-04-01T06:55:03.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.589+0000 7f5f07272700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5f000fff70 0x7f5f001971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:03.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.589+0000 7f5f07272700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5f00100920 0x7f5f00197700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:03.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.589+0000 7f5f07272700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5f00104fb0 0x7f5f0019bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:03.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.589+0000 7f5f07272700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0019c0c0 con 0x7f5f00104fb0 2024-04-01T06:55:03.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.589+0000 7f5f07272700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0019c230 con 0x7f5f00100920 2024-04-01T06:55:03.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.589+0000 7f5f07272700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0019c3f0 con 0x7f5f000fff70 2024-04-01T06:55:03.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.589+0000 7f5f0580f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5f00104fb0 0x7f5f0019bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:03.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.589+0000 7f5f0580f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5f00104fb0 0x7f5f0019bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:50344/0 (socket says 172.21.15.83:50344) 2024-04-01T06:55:03.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.589+0000 7f5f0580f700 1 -- 172.21.15.83:0/1658809691 learned_addr learned my addr 172.21.15.83:0/1658809691 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:03.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.589+0000 7f5f0480d700 1 --2- 172.21.15.83:0/1658809691 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5f00100920 0x7f5f00197700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:03.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.589+0000 7f5f0500e700 1 --2- 172.21.15.83:0/1658809691 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5f000fff70 0x7f5f001971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:03.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.589+0000 7f5f0580f700 1 -- 172.21.15.83:0/1658809691 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5f000fff70 msgr2=0x7f5f001971c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:03.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.589+0000 7f5f0580f700 1 --2- 172.21.15.83:0/1658809691 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5f000fff70 0x7f5f001971c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:03.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.589+0000 7f5f0580f700 1 -- 172.21.15.83:0/1658809691 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5f00100920 msgr2=0x7f5f00197700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:03.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.589+0000 7f5f0580f700 1 --2- 172.21.15.83:0/1658809691 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5f00100920 0x7f5f00197700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:03.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.589+0000 7f5f0580f700 1 -- 172.21.15.83:0/1658809691 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef00095f0 con 0x7f5f00104fb0 2024-04-01T06:55:03.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.589+0000 7f5f0480d700 1 --2- 172.21.15.83:0/1658809691 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5f00100920 0x7f5f00197700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:55:03.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.589+0000 7f5f0580f700 1 --2- 172.21.15.83:0/1658809691 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5f00104fb0 0x7f5f0019bab0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5ef8007ee0 tx=0x7f5ef800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:03.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.589+0000 7f5ef67fc700 1 -- 172.21.15.83:0/1658809691 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef8017070 con 0x7f5f00104fb0 2024-04-01T06:55:03.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.589+0000 7f5ef67fc700 1 -- 172.21.15.83:0/1658809691 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5ef800f040 con 0x7f5f00104fb0 2024-04-01T06:55:03.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.589+0000 7f5ef67fc700 1 -- 172.21.15.83:0/1658809691 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef8005740 con 0x7f5f00104fb0 2024-04-01T06:55:03.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.589+0000 7f5f07272700 1 -- 172.21.15.83:0/1658809691 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f0019c6d0 con 0x7f5f00104fb0 2024-04-01T06:55:03.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.589+0000 7f5f07272700 1 -- 172.21.15.83:0/1658809691 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f001a3f30 con 0x7f5f00104fb0 2024-04-01T06:55:03.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.590+0000 7f5f07272700 1 -- 172.21.15.83:0/1658809691 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f001081e0 con 0x7f5f00104fb0 2024-04-01T06:55:03.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.591+0000 7f5ef67fc700 1 -- 172.21.15.83:0/1658809691 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f5ef80058a0 con 0x7f5f00104fb0 2024-04-01T06:55:03.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.592+0000 7f5ef67fc700 1 --2- 172.21.15.83:0/1658809691 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f5eec0a1230 0x7f5eec0a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:03.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.592+0000 7f5ef67fc700 1 -- 172.21.15.83:0/1658809691 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f5ef80cc080 con 0x7f5f00104fb0 2024-04-01T06:55:03.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.593+0000 7f5f0500e700 1 --2- 172.21.15.83:0/1658809691 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f5eec0a1230 0x7f5eec0a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:03.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.593+0000 7f5f0500e700 1 --2- 172.21.15.83:0/1658809691 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f5eec0a1230 0x7f5eec0a36f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5efc005950 tx=0x7f5efc0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:03.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.596+0000 7f5ef67fc700 1 -- 172.21.15.83:0/1658809691 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f5ef8095860 con 0x7f5f00104fb0 2024-04-01T06:55:03.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.606+0000 7f934ed40700 1 -- 172.21.15.83:0/364165082 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f93481013b0 con 0x7f93480fff70 2024-04-01T06:55:03.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.607+0000 7f9345ffb700 1 -- 172.21.15.83:0/364165082 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f933c09a260 con 0x7f93480fff70 2024-04-01T06:55:03.607 INFO:teuthology.orchestra.run.smithi083.stdout:34359738422 2024-04-01T06:55:03.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.609+0000 7f934ed40700 1 -- 172.21.15.83:0/364165082 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f93380a11b0 msgr2=0x7f93380a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:03.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.609+0000 7f934ed40700 1 --2- 172.21.15.83:0/364165082 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f93380a11b0 0x7f93380a3670 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9348069010 tx=0x7f9334009260 comp rx=0 tx=0).stop 2024-04-01T06:55:03.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.609+0000 7f934ed40700 1 -- 172.21.15.83:0/364165082 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f93480fff70 msgr2=0x7f9348195ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:03.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.609+0000 7f934ed40700 1 --2- 172.21.15.83:0/364165082 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f93480fff70 0x7f9348195ef0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f933c00e9a0 tx=0x7f933c00ecb0 comp rx=0 tx=0).stop 2024-04-01T06:55:03.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.609+0000 7f934ed40700 1 -- 172.21.15.83:0/364165082 shutdown_connections 2024-04-01T06:55:03.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.609+0000 7f934ed40700 1 --2- 172.21.15.83:0/364165082 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f93480fff70 0x7f9348195ef0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:03.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.609+0000 7f934ed40700 1 --2- 172.21.15.83:0/364165082 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f93380a11b0 0x7f93380a3670 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:03.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.609+0000 7f934ed40700 1 --2- 172.21.15.83:0/364165082 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9348104fb0 0x7f9348196970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:03.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.609+0000 7f934ed40700 1 --2- 172.21.15.83:0/364165082 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9348100920 0x7f9348196430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:03.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.609+0000 7f934ed40700 1 -- 172.21.15.83:0/364165082 >> 172.21.15.83:0/364165082 conn(0x7f9348075d50 msgr2=0x7f93480ff490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:03.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.609+0000 7f934ed40700 1 -- 172.21.15.83:0/364165082 shutdown_connections 2024-04-01T06:55:03.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.609+0000 7f934ed40700 1 -- 172.21.15.83:0/364165082 wait complete. 2024-04-01T06:55:03.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.807+0000 7f5f07272700 1 -- 172.21.15.83:0/1658809691 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f5f001013b0 con 0x7f5f00104fb0 2024-04-01T06:55:03.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.808+0000 7f5ef67fc700 1 -- 172.21.15.83:0/1658809691 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5ef8098e80 con 0x7f5f00104fb0 2024-04-01T06:55:03.808 INFO:teuthology.orchestra.run.smithi083.stdout:137438953513 2024-04-01T06:55:03.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.810+0000 7f5f07272700 1 -- 172.21.15.83:0/1658809691 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f5eec0a1230 msgr2=0x7f5eec0a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:03.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.810+0000 7f5f07272700 1 --2- 172.21.15.83:0/1658809691 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f5eec0a1230 0x7f5eec0a36f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5efc005950 tx=0x7f5efc0058e0 comp rx=0 tx=0).stop 2024-04-01T06:55:03.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.810+0000 7f5f07272700 1 -- 172.21.15.83:0/1658809691 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5f00104fb0 msgr2=0x7f5f0019bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:03.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.810+0000 7f5f07272700 1 --2- 172.21.15.83:0/1658809691 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5f00104fb0 0x7f5f0019bab0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5ef8007ee0 tx=0x7f5ef800d3b0 comp rx=0 tx=0).stop 2024-04-01T06:55:03.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.810+0000 7f5f07272700 1 -- 172.21.15.83:0/1658809691 shutdown_connections 2024-04-01T06:55:03.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.810+0000 7f5f07272700 1 --2- 172.21.15.83:0/1658809691 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5f00104fb0 0x7f5f0019bab0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:03.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.810+0000 7f5f07272700 1 --2- 172.21.15.83:0/1658809691 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f5eec0a1230 0x7f5eec0a36f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:03.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.810+0000 7f5f07272700 1 --2- 172.21.15.83:0/1658809691 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5f000fff70 0x7f5f001971c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:03.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.810+0000 7f5f07272700 1 --2- 172.21.15.83:0/1658809691 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5f00100920 0x7f5f00197700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:03.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.810+0000 7f5f07272700 1 -- 172.21.15.83:0/1658809691 >> 172.21.15.83:0/1658809691 conn(0x7f5f00075d50 msgr2=0x7f5f00103c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:03.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.811+0000 7f5f07272700 1 -- 172.21.15.83:0/1658809691 shutdown_connections 2024-04-01T06:55:03.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.811+0000 7f5f07272700 1 -- 172.21.15.83:0/1658809691 wait complete. 2024-04-01T06:55:03.830 INFO:tasks.cephadm.ceph_manager.ceph:need seq 266287972374 got 266287972375 for osd.9 2024-04-01T06:55:03.830 DEBUG:teuthology.parallel:result is None 2024-04-01T06:55:04.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.788+0000 7f503f687700 1 -- 172.21.15.83:0/2490667544 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f50380693e0 msgr2=0x7f5038069840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:04.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.788+0000 7f503f687700 1 --2- 172.21.15.83:0/2490667544 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f50380693e0 0x7f5038069840 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5028009990 tx=0x7f5028009ca0 comp rx=0 tx=0).stop 2024-04-01T06:55:04.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.788+0000 7f503f687700 1 -- 172.21.15.83:0/2490667544 shutdown_connections 2024-04-01T06:55:04.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.788+0000 7f503f687700 1 --2- 172.21.15.83:0/2490667544 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5038069d80 0x7f503810dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:04.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.788+0000 7f503f687700 1 --2- 172.21.15.83:0/2490667544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5038105e00 0x7f50381061e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:04.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.788+0000 7f503f687700 1 --2- 172.21.15.83:0/2490667544 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f50380693e0 0x7f5038069840 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:04.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.788+0000 7f503f687700 1 -- 172.21.15.83:0/2490667544 >> 172.21.15.83:0/2490667544 conn(0x7f5038076b70 msgr2=0x7f5038076f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:04.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.788+0000 7f503f687700 1 -- 172.21.15.83:0/2490667544 shutdown_connections 2024-04-01T06:55:04.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.788+0000 7f503f687700 1 -- 172.21.15.83:0/2490667544 wait complete. 2024-04-01T06:55:04.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.789+0000 7f503f687700 1 Processor -- start 2024-04-01T06:55:04.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.789+0000 7f503f687700 1 -- start start 2024-04-01T06:55:04.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.789+0000 7f503f687700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f50380693e0 0x7f50381972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:04.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.789+0000 7f503f687700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5038069d80 0x7f5038197830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:04.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.789+0000 7f503f687700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5038105e00 0x7f503819bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:04.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.789+0000 7f503f687700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f503819c1a0 con 0x7f50380693e0 2024-04-01T06:55:04.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.789+0000 7f503f687700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f503819c310 con 0x7f5038105e00 2024-04-01T06:55:04.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.789+0000 7f503f687700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f503819c4d0 con 0x7f5038069d80 2024-04-01T06:55:04.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.789+0000 7f503d423700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f50380693e0 0x7f50381972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:04.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.789+0000 7f503d423700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f50380693e0 0x7f50381972f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:50360/0 (socket says 172.21.15.83:50360) 2024-04-01T06:55:04.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.789+0000 7f503d423700 1 -- 172.21.15.83:0/3861210245 learned_addr learned my addr 172.21.15.83:0/3861210245 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:04.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.789+0000 7f503cc22700 1 --2- 172.21.15.83:0/3861210245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5038069d80 0x7f5038197830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:04.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.789+0000 7f503dc24700 1 --2- 172.21.15.83:0/3861210245 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5038105e00 0x7f503819bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:04.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.790+0000 7f503d423700 1 -- 172.21.15.83:0/3861210245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5038069d80 msgr2=0x7f5038197830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:04.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.790+0000 7f503d423700 1 --2- 172.21.15.83:0/3861210245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5038069d80 0x7f5038197830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:04.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.790+0000 7f503d423700 1 -- 172.21.15.83:0/3861210245 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5038105e00 msgr2=0x7f503819bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:04.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.790+0000 7f503d423700 1 --2- 172.21.15.83:0/3861210245 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5038105e00 0x7f503819bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:04.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.790+0000 7f503d423700 1 -- 172.21.15.83:0/3861210245 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50280095f0 con 0x7f50380693e0 2024-04-01T06:55:04.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.790+0000 7f503dc24700 1 --2- 172.21.15.83:0/3861210245 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5038105e00 0x7f503819bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:55:04.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.790+0000 7f503d423700 1 --2- 172.21.15.83:0/3861210245 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f50380693e0 0x7f50381972f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f503400d980 tx=0x7f503400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:04.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.790+0000 7f502e7fc700 1 -- 172.21.15.83:0/3861210245 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5034004020 con 0x7f50380693e0 2024-04-01T06:55:04.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.790+0000 7f502e7fc700 1 -- 172.21.15.83:0/3861210245 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5034009730 con 0x7f50380693e0 2024-04-01T06:55:04.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.790+0000 7f503f687700 1 -- 172.21.15.83:0/3861210245 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f503819c7b0 con 0x7f50380693e0 2024-04-01T06:55:04.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.790+0000 7f502e7fc700 1 -- 172.21.15.83:0/3861210245 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5034003a80 con 0x7f50380693e0 2024-04-01T06:55:04.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.790+0000 7f503f687700 1 -- 172.21.15.83:0/3861210245 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50381a4010 con 0x7f50380693e0 2024-04-01T06:55:04.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.791+0000 7f503f687700 1 -- 172.21.15.83:0/3861210245 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50381093f0 con 0x7f50380693e0 2024-04-01T06:55:04.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.793+0000 7f502e7fc700 1 -- 172.21.15.83:0/3861210245 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f50340098a0 con 0x7f50380693e0 2024-04-01T06:55:04.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.793+0000 7f502e7fc700 1 --2- 172.21.15.83:0/3861210245 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f50240a12b0 0x7f50240a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:04.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.794+0000 7f503cc22700 1 --2- 172.21.15.83:0/3861210245 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f50240a12b0 0x7f50240a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:04.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.794+0000 7f502e7fc700 1 -- 172.21.15.83:0/3861210245 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f50340cc910 con 0x7f50380693e0 2024-04-01T06:55:04.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.794+0000 7f503cc22700 1 --2- 172.21.15.83:0/3861210245 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f50240a12b0 0x7f50240a3770 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5038198800 tx=0x7f5028005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:04.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:03.796+0000 7f502e7fc700 1 -- 172.21.15.83:0/3861210245 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f5034096070 con 0x7f50380693e0 2024-04-01T06:55:04.006 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:03 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/364165082' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-01T06:55:04.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:04.003+0000 7f503f687700 1 -- 172.21.15.83:0/3861210245 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7f5038102540 con 0x7f50380693e0 2024-04-01T06:55:04.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:04.004+0000 7f502e7fc700 1 -- 172.21.15.83:0/3861210245 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5034099690 con 0x7f50380693e0 2024-04-01T06:55:04.006 INFO:teuthology.orchestra.run.smithi083.stdout:236223201307 2024-04-01T06:55:04.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:04.006+0000 7f503f687700 1 -- 172.21.15.83:0/3861210245 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f50240a12b0 msgr2=0x7f50240a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:04.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:04.006+0000 7f503f687700 1 --2- 172.21.15.83:0/3861210245 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f50240a12b0 0x7f50240a3770 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5038198800 tx=0x7f5028005fd0 comp rx=0 tx=0).stop 2024-04-01T06:55:04.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:04.006+0000 7f503f687700 1 -- 172.21.15.83:0/3861210245 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f50380693e0 msgr2=0x7f50381972f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:04.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:04.006+0000 7f503f687700 1 --2- 172.21.15.83:0/3861210245 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f50380693e0 0x7f50381972f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f503400d980 tx=0x7f503400dc90 comp rx=0 tx=0).stop 2024-04-01T06:55:04.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:04.006+0000 7f503f687700 1 -- 172.21.15.83:0/3861210245 shutdown_connections 2024-04-01T06:55:04.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:04.006+0000 7f503f687700 1 --2- 172.21.15.83:0/3861210245 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f50380693e0 0x7f50381972f0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:04.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:04.006+0000 7f503f687700 1 --2- 172.21.15.83:0/3861210245 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f50240a12b0 0x7f50240a3770 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:04.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:04.006+0000 7f503f687700 1 --2- 172.21.15.83:0/3861210245 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5038105e00 0x7f503819bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:04.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:04.006+0000 7f503f687700 1 --2- 172.21.15.83:0/3861210245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5038069d80 0x7f5038197830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:04.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:04.006+0000 7f503f687700 1 -- 172.21.15.83:0/3861210245 >> 172.21.15.83:0/3861210245 conn(0x7f5038076b70 msgr2=0x7f50380fe140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:04.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:04.006+0000 7f503f687700 1 -- 172.21.15.83:0/3861210245 shutdown_connections 2024-04-01T06:55:04.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:04.006+0000 7f503f687700 1 -- 172.21.15.83:0/3861210245 wait complete. 2024-04-01T06:55:04.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:03 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/364165082' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-01T06:55:04.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:03 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/364165082' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-01T06:55:04.416 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953511 got 137438953513 for osd.4 2024-04-01T06:55:04.416 DEBUG:teuthology.parallel:result is None 2024-04-01T06:55:04.591 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411373 got 77309411375 for osd.2 2024-04-01T06:55:04.592 DEBUG:teuthology.parallel:result is None 2024-04-01T06:55:04.939 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:04 smithi083 ceph-mon[43429]: pgmap v234: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 7 op/s 2024-04-01T06:55:04.939 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:04 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/1658809691' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-01T06:55:04.939 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:04 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/3861210245' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-04-01T06:55:04.956 INFO:tasks.cephadm.ceph_manager.ceph:need seq 236223201305 got 236223201307 for osd.8 2024-04-01T06:55:04.956 DEBUG:teuthology.parallel:result is None 2024-04-01T06:55:05.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:04 smithi145 ceph-mon[47816]: pgmap v234: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 7 op/s 2024-04-01T06:55:05.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:04 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/1658809691' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-01T06:55:05.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:04 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/3861210245' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-04-01T06:55:05.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:04.874+0000 7fbdca06f700 1 -- 172.21.15.83:0/2257350095 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbdc41017c0 msgr2=0x7fbdc410dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:05.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:04.874+0000 7fbdca06f700 1 --2- 172.21.15.83:0/2257350095 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbdc41017c0 0x7fbdc410dbf0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc00b0a0 tx=0x7fbdbc00b3b0 comp rx=0 tx=0).stop 2024-04-01T06:55:05.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:04.874+0000 7fbdca06f700 1 -- 172.21.15.83:0/2257350095 shutdown_connections 2024-04-01T06:55:05.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:04.874+0000 7fbdca06f700 1 --2- 172.21.15.83:0/2257350095 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbdc41017c0 0x7fbdc410dbf0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:05.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:04.874+0000 7fbdca06f700 1 --2- 172.21.15.83:0/2257350095 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbdc4106e40 0x7fbdc4107220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:05.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:04.874+0000 7fbdca06f700 1 --2- 172.21.15.83:0/2257350095 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbdc4100e00 0x7fbdc4101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:05.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:04.874+0000 7fbdca06f700 1 -- 172.21.15.83:0/2257350095 >> 172.21.15.83:0/2257350095 conn(0x7fbdc4077f10 msgr2=0x7fbdc4078320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:05.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:04.874+0000 7fbdca06f700 1 -- 172.21.15.83:0/2257350095 shutdown_connections 2024-04-01T06:55:05.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:04.874+0000 7fbdca06f700 1 -- 172.21.15.83:0/2257350095 wait complete. 2024-04-01T06:55:05.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:04.874+0000 7fbdca06f700 1 Processor -- start 2024-04-01T06:55:05.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:04.875+0000 7fbdca06f700 1 -- start start 2024-04-01T06:55:05.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:04.875+0000 7fbdca06f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbdc4100e00 0x7fbdc4197290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:05.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:04.875+0000 7fbdca06f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbdc41017c0 0x7fbdc41977d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:05.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:04.875+0000 7fbdca06f700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbdc4106e40 0x7fbdc419bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:05.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:04.875+0000 7fbdca06f700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc419c140 con 0x7fbdc4100e00 2024-04-01T06:55:05.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:04.875+0000 7fbdca06f700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc419c2b0 con 0x7fbdc4106e40 2024-04-01T06:55:05.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:04.875+0000 7fbdca06f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc419c470 con 0x7fbdc41017c0 2024-04-01T06:55:05.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:04.875+0000 7fbdc37fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbdc4100e00 0x7fbdc4197290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:05.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:04.875+0000 7fbdc37fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbdc4100e00 0x7fbdc4197290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:50370/0 (socket says 172.21.15.83:50370) 2024-04-01T06:55:05.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:04.875+0000 7fbdc37fe700 1 -- 172.21.15.83:0/608619728 learned_addr learned my addr 172.21.15.83:0/608619728 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:05.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:04.875+0000 7fbdc2ffd700 1 --2- 172.21.15.83:0/608619728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbdc41017c0 0x7fbdc41977d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:05.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:04.875+0000 7fbdc37fe700 1 -- 172.21.15.83:0/608619728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbdc41017c0 msgr2=0x7fbdc41977d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:05.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:04.875+0000 7fbdc37fe700 1 --2- 172.21.15.83:0/608619728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbdc41017c0 0x7fbdc41977d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:05.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:04.875+0000 7fbdc3fff700 1 --2- 172.21.15.83:0/608619728 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbdc4106e40 0x7fbdc419bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:05.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:04.875+0000 7fbdc37fe700 1 -- 172.21.15.83:0/608619728 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbdc4106e40 msgr2=0x7fbdc419bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:05.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:04.875+0000 7fbdc37fe700 1 --2- 172.21.15.83:0/608619728 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbdc4106e40 0x7fbdc419bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:05.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:04.875+0000 7fbdc37fe700 1 -- 172.21.15.83:0/608619728 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdbc009d00 con 0x7fbdc4100e00 2024-04-01T06:55:05.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:04.875+0000 7fbdc2ffd700 1 --2- 172.21.15.83:0/608619728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbdc41017c0 0x7fbdc41977d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:55:05.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:04.876+0000 7fbdc37fe700 1 --2- 172.21.15.83:0/608619728 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbdc4100e00 0x7fbdc4197290 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbdb400c920 tx=0x7fbdb400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:05.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:04.876+0000 7fbdc0ff9700 1 -- 172.21.15.83:0/608619728 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb4007b00 con 0x7fbdc4100e00 2024-04-01T06:55:05.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:04.876+0000 7fbdc0ff9700 1 -- 172.21.15.83:0/608619728 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbdb4004cf0 con 0x7fbdc4100e00 2024-04-01T06:55:05.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:04.876+0000 7fbdca06f700 1 -- 172.21.15.83:0/608619728 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdc419c750 con 0x7fbdc4100e00 2024-04-01T06:55:05.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:04.876+0000 7fbdc0ff9700 1 -- 172.21.15.83:0/608619728 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb4005610 con 0x7fbdc4100e00 2024-04-01T06:55:05.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:04.876+0000 7fbdca06f700 1 -- 172.21.15.83:0/608619728 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdc41a3fb0 con 0x7fbdc4100e00 2024-04-01T06:55:05.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:04.877+0000 7fbdca06f700 1 -- 172.21.15.83:0/608619728 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdc41092d0 con 0x7fbdc4100e00 2024-04-01T06:55:05.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:04.878+0000 7fbdc0ff9700 1 -- 172.21.15.83:0/608619728 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7fbdb4004750 con 0x7fbdc4100e00 2024-04-01T06:55:05.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:04.879+0000 7fbdc0ff9700 1 --2- 172.21.15.83:0/608619728 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fbdac0a1230 0x7fbdac0a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:05.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:04.879+0000 7fbdc2ffd700 1 --2- 172.21.15.83:0/608619728 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fbdac0a1230 0x7fbdac0a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:05.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:04.879+0000 7fbdc0ff9700 1 -- 172.21.15.83:0/608619728 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fbdb40cc970 con 0x7fbdc4100e00 2024-04-01T06:55:05.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:04.879+0000 7fbdc2ffd700 1 --2- 172.21.15.83:0/608619728 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fbdac0a1230 0x7fbdac0a36f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fbdb8005fd0 tx=0x7fbdb8005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:05.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:04.883+0000 7fbdc0ff9700 1 -- 172.21.15.83:0/608619728 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7fbdb4096050 con 0x7fbdc4100e00 2024-04-01T06:55:05.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.083+0000 7fbdca06f700 1 -- 172.21.15.83:0/608619728 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fbdc4102480 con 0x7fbdc4100e00 2024-04-01T06:55:05.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.084+0000 7fbdc0ff9700 1 -- 172.21.15.83:0/608619728 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbdb401d020 con 0x7fbdc4100e00 2024-04-01T06:55:05.084 INFO:teuthology.orchestra.run.smithi083.stdout:184683593761 2024-04-01T06:55:05.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.086+0000 7fbdca06f700 1 -- 172.21.15.83:0/608619728 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fbdac0a1230 msgr2=0x7fbdac0a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:05.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.086+0000 7fbdca06f700 1 --2- 172.21.15.83:0/608619728 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fbdac0a1230 0x7fbdac0a36f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fbdb8005fd0 tx=0x7fbdb8005ee0 comp rx=0 tx=0).stop 2024-04-01T06:55:05.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.086+0000 7fbdca06f700 1 -- 172.21.15.83:0/608619728 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbdc4100e00 msgr2=0x7fbdc4197290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:05.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.086+0000 7fbdca06f700 1 --2- 172.21.15.83:0/608619728 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbdc4100e00 0x7fbdc4197290 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbdb400c920 tx=0x7fbdb400cce0 comp rx=0 tx=0).stop 2024-04-01T06:55:05.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.086+0000 7fbdca06f700 1 -- 172.21.15.83:0/608619728 shutdown_connections 2024-04-01T06:55:05.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.086+0000 7fbdca06f700 1 --2- 172.21.15.83:0/608619728 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbdc4100e00 0x7fbdc4197290 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:05.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.086+0000 7fbdca06f700 1 --2- 172.21.15.83:0/608619728 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fbdac0a1230 0x7fbdac0a36f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:05.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.086+0000 7fbdca06f700 1 --2- 172.21.15.83:0/608619728 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbdc4106e40 0x7fbdc419bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:05.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.086+0000 7fbdca06f700 1 --2- 172.21.15.83:0/608619728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbdc41017c0 0x7fbdc41977d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:05.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.086+0000 7fbdca06f700 1 -- 172.21.15.83:0/608619728 >> 172.21.15.83:0/608619728 conn(0x7fbdc4077f10 msgr2=0x7fbdc40ffae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:05.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.086+0000 7fbdca06f700 1 -- 172.21.15.83:0/608619728 shutdown_connections 2024-04-01T06:55:05.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.086+0000 7fbdca06f700 1 -- 172.21.15.83:0/608619728 wait complete. 2024-04-01T06:55:05.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:04 smithi153 ceph-mon[48187]: pgmap v234: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 7 op/s 2024-04-01T06:55:05.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:04 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/1658809691' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-01T06:55:05.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:04 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/3861210245' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-04-01T06:55:05.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.515+0000 7fac0f89a700 1 -- 172.21.15.83:0/1289306767 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac08104ce0 msgr2=0x7fac081050c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:05.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.515+0000 7fac0f89a700 1 --2- 172.21.15.83:0/1289306767 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac08104ce0 0x7fac081050c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fac04009990 tx=0x7fac04009ca0 comp rx=0 tx=0).stop 2024-04-01T06:55:05.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.515+0000 7fac0f89a700 1 -- 172.21.15.83:0/1289306767 shutdown_connections 2024-04-01T06:55:05.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.515+0000 7fac0f89a700 1 --2- 172.21.15.83:0/1289306767 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac08104ce0 0x7fac081050c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:05.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.515+0000 7fac0f89a700 1 --2- 172.21.15.83:0/1289306767 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fac08101220 0x7fac0810cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:05.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.515+0000 7fac0f89a700 1 --2- 172.21.15.83:0/1289306767 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac08100860 0x7fac08100ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:05.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.515+0000 7fac0f89a700 1 -- 172.21.15.83:0/1289306767 >> 172.21.15.83:0/1289306767 conn(0x7fac08074fd0 msgr2=0x7fac080753e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:05.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.515+0000 7fac0f89a700 1 -- 172.21.15.83:0/1289306767 shutdown_connections 2024-04-01T06:55:05.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.515+0000 7fac0f89a700 1 -- 172.21.15.83:0/1289306767 wait complete. 2024-04-01T06:55:05.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.516+0000 7fac0f89a700 1 Processor -- start 2024-04-01T06:55:05.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.516+0000 7fac0f89a700 1 -- start start 2024-04-01T06:55:05.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.516+0000 7fac0f89a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac08100860 0x7fac08198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:05.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.516+0000 7fac0f89a700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fac08101220 0x7fac08198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:05.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.516+0000 7fac0f89a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac08104ce0 0x7fac081a30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:05.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.516+0000 7fac0f89a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac08198e40 con 0x7fac08100860 2024-04-01T06:55:05.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.516+0000 7fac0f89a700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac081a3600 con 0x7fac08101220 2024-04-01T06:55:05.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.516+0000 7fac0f89a700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac081a3740 con 0x7fac08104ce0 2024-04-01T06:55:05.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.517+0000 7fac0d636700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac08100860 0x7fac08198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:05.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.517+0000 7fac0d636700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac08100860 0x7fac08198040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:50392/0 (socket says 172.21.15.83:50392) 2024-04-01T06:55:05.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.517+0000 7fac0d636700 1 -- 172.21.15.83:0/1507608006 learned_addr learned my addr 172.21.15.83:0/1507608006 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:05.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.517+0000 7fac0ce35700 1 --2- 172.21.15.83:0/1507608006 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fac08101220 0x7fac08198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:05.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.517+0000 7fac0d636700 1 -- 172.21.15.83:0/1507608006 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac08104ce0 msgr2=0x7fac081a30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:05.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.517+0000 7fac0d636700 1 --2- 172.21.15.83:0/1507608006 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac08104ce0 0x7fac081a30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:05.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.517+0000 7fac0d636700 1 -- 172.21.15.83:0/1507608006 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fac08101220 msgr2=0x7fac08198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:05.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.517+0000 7fac0d636700 1 --2- 172.21.15.83:0/1507608006 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fac08101220 0x7fac08198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:05.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.517+0000 7fac0d636700 1 -- 172.21.15.83:0/1507608006 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac040095f0 con 0x7fac08100860 2024-04-01T06:55:05.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.517+0000 7fac0d636700 1 --2- 172.21.15.83:0/1507608006 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac08100860 0x7fac08198040 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fac04009fd0 tx=0x7fac0400f720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:05.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.517+0000 7fabfe7fc700 1 -- 172.21.15.83:0/1507608006 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0401d070 con 0x7fac08100860 2024-04-01T06:55:05.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.517+0000 7fabfe7fc700 1 -- 172.21.15.83:0/1507608006 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fac04005510 con 0x7fac08100860 2024-04-01T06:55:05.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.517+0000 7fac0f89a700 1 -- 172.21.15.83:0/1507608006 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac08195e90 con 0x7fac08100860 2024-04-01T06:55:05.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.517+0000 7fabfe7fc700 1 -- 172.21.15.83:0/1507608006 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac04004bd0 con 0x7fac08100860 2024-04-01T06:55:05.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.517+0000 7fac0f89a700 1 -- 172.21.15.83:0/1507608006 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac08196380 con 0x7fac08100860 2024-04-01T06:55:05.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.518+0000 7fac0f89a700 1 -- 172.21.15.83:0/1507608006 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac08108240 con 0x7fac08100860 2024-04-01T06:55:05.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.520+0000 7fabfe7fc700 1 -- 172.21.15.83:0/1507608006 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7fac04004d30 con 0x7fac08100860 2024-04-01T06:55:05.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.520+0000 7fabfe7fc700 1 --2- 172.21.15.83:0/1507608006 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fabf40a1230 0x7fabf40a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:05.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.521+0000 7fac0ce35700 1 --2- 172.21.15.83:0/1507608006 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fabf40a1230 0x7fabf40a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:05.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.521+0000 7fabfe7fc700 1 -- 172.21.15.83:0/1507608006 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fac040cdbe0 con 0x7fac08100860 2024-04-01T06:55:05.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.521+0000 7fac0ce35700 1 --2- 172.21.15.83:0/1507608006 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fabf40a1230 0x7fabf40a36f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fabf8006fd0 tx=0x7fabf8008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:05.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.524+0000 7fabfe7fc700 1 -- 172.21.15.83:0/1507608006 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7fac04097350 con 0x7fac08100860 2024-04-01T06:55:05.528 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738421 got 34359738422 for osd.0 2024-04-01T06:55:05.529 DEBUG:teuthology.parallel:result is None 2024-04-01T06:55:05.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.724+0000 7fac0f89a700 1 -- 172.21.15.83:0/1507608006 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fac080682d0 con 0x7fac08100860 2024-04-01T06:55:05.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.727+0000 7fabfe7fc700 1 -- 172.21.15.83:0/1507608006 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fac0409a970 con 0x7fac08100860 2024-04-01T06:55:05.727 INFO:teuthology.orchestra.run.smithi083.stdout:107374182444 2024-04-01T06:55:05.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.729+0000 7fac0f89a700 1 -- 172.21.15.83:0/1507608006 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fabf40a1230 msgr2=0x7fabf40a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:05.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.729+0000 7fac0f89a700 1 --2- 172.21.15.83:0/1507608006 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fabf40a1230 0x7fabf40a36f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fabf8006fd0 tx=0x7fabf8008040 comp rx=0 tx=0).stop 2024-04-01T06:55:05.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.729+0000 7fac0f89a700 1 -- 172.21.15.83:0/1507608006 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac08100860 msgr2=0x7fac08198040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:05.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.729+0000 7fac0f89a700 1 --2- 172.21.15.83:0/1507608006 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac08100860 0x7fac08198040 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fac04009fd0 tx=0x7fac0400f720 comp rx=0 tx=0).stop 2024-04-01T06:55:05.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.729+0000 7fac0f89a700 1 -- 172.21.15.83:0/1507608006 shutdown_connections 2024-04-01T06:55:05.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.729+0000 7fac0f89a700 1 --2- 172.21.15.83:0/1507608006 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac08100860 0x7fac08198040 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:05.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.729+0000 7fac0f89a700 1 --2- 172.21.15.83:0/1507608006 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fabf40a1230 0x7fabf40a36f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:05.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.729+0000 7fac0f89a700 1 --2- 172.21.15.83:0/1507608006 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac08104ce0 0x7fac081a30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:05.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.729+0000 7fac0f89a700 1 --2- 172.21.15.83:0/1507608006 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fac08101220 0x7fac08198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:05.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.729+0000 7fac0f89a700 1 -- 172.21.15.83:0/1507608006 >> 172.21.15.83:0/1507608006 conn(0x7fac08074fd0 msgr2=0x7fac080fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:05.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.729+0000 7fac0f89a700 1 -- 172.21.15.83:0/1507608006 shutdown_connections 2024-04-01T06:55:05.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:05.729+0000 7fac0f89a700 1 -- 172.21.15.83:0/1507608006 wait complete. 2024-04-01T06:55:05.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:05 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/608619728' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-01T06:55:05.770 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574897 got 55834574899 for osd.1 2024-04-01T06:55:05.770 DEBUG:teuthology.parallel:result is None 2024-04-01T06:55:06.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:05 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/608619728' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-01T06:55:06.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:05 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/608619728' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-01T06:55:06.177 INFO:tasks.cephadm.ceph_manager.ceph:need seq 184683593759 got 184683593761 for osd.6 2024-04-01T06:55:06.178 DEBUG:teuthology.parallel:result is None 2024-04-01T06:55:06.208 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182442 got 107374182444 for osd.3 2024-04-01T06:55:06.208 DEBUG:teuthology.parallel:result is None 2024-04-01T06:55:06.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:06.329+0000 7ff777275700 1 -- 172.21.15.83:0/1006646439 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff770104fb0 msgr2=0x7ff77010cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:06.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:06.329+0000 7ff777275700 1 --2- 172.21.15.83:0/1006646439 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff770104fb0 0x7ff77010cb80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff76800b0a0 tx=0x7ff76800b3b0 comp rx=0 tx=0).stop 2024-04-01T06:55:06.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:06.329+0000 7ff777275700 1 -- 172.21.15.83:0/1006646439 shutdown_connections 2024-04-01T06:55:06.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:06.329+0000 7ff777275700 1 --2- 172.21.15.83:0/1006646439 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff770104fb0 0x7ff77010cb80 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:06.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:06.329+0000 7ff777275700 1 --2- 172.21.15.83:0/1006646439 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7700fff70 0x7ff770100350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:06.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:06.329+0000 7ff777275700 1 --2- 172.21.15.83:0/1006646439 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff770100920 0x7ff7701048d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:06.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:06.329+0000 7ff777275700 1 -- 172.21.15.83:0/1006646439 >> 172.21.15.83:0/1006646439 conn(0x7ff770075d50 msgr2=0x7ff770076160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:06.329 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:06.329+0000 7ff777275700 1 -- 172.21.15.83:0/1006646439 shutdown_connections 2024-04-01T06:55:06.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:06.329+0000 7ff777275700 1 -- 172.21.15.83:0/1006646439 wait complete. 2024-04-01T06:55:06.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:06.329+0000 7ff777275700 1 Processor -- start 2024-04-01T06:55:06.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:06.329+0000 7ff777275700 1 -- start start 2024-04-01T06:55:06.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:06.330+0000 7ff777275700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7700fff70 0x7ff7701961b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:06.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:06.330+0000 7ff777275700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff770100920 0x7ff7701966f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:06.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:06.330+0000 7ff777275700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff770104fb0 0x7ff77019aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:06.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:06.330+0000 7ff777275700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff77019b0b0 con 0x7ff770104fb0 2024-04-01T06:55:06.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:06.330+0000 7ff777275700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff77019b220 con 0x7ff770100920 2024-04-01T06:55:06.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:06.330+0000 7ff777275700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff77019b3e0 con 0x7ff7700fff70 2024-04-01T06:55:06.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:06.330+0000 7ff775812700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff770104fb0 0x7ff77019aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:06.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:06.330+0000 7ff775812700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff770104fb0 0x7ff77019aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:50418/0 (socket says 172.21.15.83:50418) 2024-04-01T06:55:06.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:06.330+0000 7ff775812700 1 -- 172.21.15.83:0/260860298 learned_addr learned my addr 172.21.15.83:0/260860298 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:06.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:06.330+0000 7ff775011700 1 --2- 172.21.15.83:0/260860298 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7700fff70 0x7ff7701961b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:06.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:06.330+0000 7ff774810700 1 --2- 172.21.15.83:0/260860298 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff770100920 0x7ff7701966f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:06.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:06.330+0000 7ff775812700 1 -- 172.21.15.83:0/260860298 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7700fff70 msgr2=0x7ff7701961b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:06.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:06.330+0000 7ff775812700 1 --2- 172.21.15.83:0/260860298 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7700fff70 0x7ff7701961b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:06.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:06.330+0000 7ff775812700 1 -- 172.21.15.83:0/260860298 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff770100920 msgr2=0x7ff7701966f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:06.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:06.330+0000 7ff775812700 1 --2- 172.21.15.83:0/260860298 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff770100920 0x7ff7701966f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:06.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:06.330+0000 7ff775812700 1 -- 172.21.15.83:0/260860298 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff768009d00 con 0x7ff770104fb0 2024-04-01T06:55:06.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:06.330+0000 7ff775812700 1 --2- 172.21.15.83:0/260860298 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff770104fb0 0x7ff77019aaa0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff76800b070 tx=0x7ff7680079e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:06.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:06.330+0000 7ff7667fc700 1 -- 172.21.15.83:0/260860298 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76800e040 con 0x7ff770104fb0 2024-04-01T06:55:06.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:06.330+0000 7ff777275700 1 -- 172.21.15.83:0/260860298 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff77019b660 con 0x7ff770104fb0 2024-04-01T06:55:06.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:06.330+0000 7ff7667fc700 1 -- 172.21.15.83:0/260860298 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff768004c50 con 0x7ff770104fb0 2024-04-01T06:55:06.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:06.330+0000 7ff7667fc700 1 -- 172.21.15.83:0/260860298 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7680052a0 con 0x7ff770104fb0 2024-04-01T06:55:06.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:06.330+0000 7ff777275700 1 -- 172.21.15.83:0/260860298 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff770068920 con 0x7ff770104fb0 2024-04-01T06:55:06.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:06.331+0000 7ff777275700 1 -- 172.21.15.83:0/260860298 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7701013b0 con 0x7ff770104fb0 2024-04-01T06:55:06.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:06.333+0000 7ff7667fc700 1 -- 172.21.15.83:0/260860298 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7ff76801d470 con 0x7ff770104fb0 2024-04-01T06:55:06.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:06.333+0000 7ff7667fc700 1 --2- 172.21.15.83:0/260860298 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7ff75c0a11b0 0x7ff75c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:06.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:06.334+0000 7ff775011700 1 --2- 172.21.15.83:0/260860298 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7ff75c0a11b0 0x7ff75c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:06.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:06.334+0000 7ff7667fc700 1 -- 172.21.15.83:0/260860298 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ff7680ce670 con 0x7ff770104fb0 2024-04-01T06:55:06.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:06.334+0000 7ff775011700 1 --2- 172.21.15.83:0/260860298 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7ff75c0a11b0 0x7ff75c0a3670 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff76c005fd0 tx=0x7ff76c00a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:06.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:06.337+0000 7ff7667fc700 1 -- 172.21.15.83:0/260860298 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7ff768097de0 con 0x7ff770104fb0 2024-04-01T06:55:06.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:06.532+0000 7ff777275700 1 -- 172.21.15.83:0/260860298 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7ff7701974c0 con 0x7ff770104fb0 2024-04-01T06:55:06.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:06.532+0000 7ff7667fc700 1 -- 172.21.15.83:0/260860298 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7ff76809b400 con 0x7ff770104fb0 2024-04-01T06:55:06.533 INFO:teuthology.orchestra.run.smithi083.stdout:317827579920 2024-04-01T06:55:06.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:06.534+0000 7ff777275700 1 -- 172.21.15.83:0/260860298 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7ff75c0a11b0 msgr2=0x7ff75c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:06.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:06.534+0000 7ff777275700 1 --2- 172.21.15.83:0/260860298 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7ff75c0a11b0 0x7ff75c0a3670 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff76c005fd0 tx=0x7ff76c00a560 comp rx=0 tx=0).stop 2024-04-01T06:55:06.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:06.534+0000 7ff777275700 1 -- 172.21.15.83:0/260860298 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff770104fb0 msgr2=0x7ff77019aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:06.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:06.534+0000 7ff777275700 1 --2- 172.21.15.83:0/260860298 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff770104fb0 0x7ff77019aaa0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff76800b070 tx=0x7ff7680079e0 comp rx=0 tx=0).stop 2024-04-01T06:55:06.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:06.534+0000 7ff777275700 1 -- 172.21.15.83:0/260860298 shutdown_connections 2024-04-01T06:55:06.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:06.534+0000 7ff777275700 1 --2- 172.21.15.83:0/260860298 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff770104fb0 0x7ff77019aaa0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:06.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:06.534+0000 7ff777275700 1 --2- 172.21.15.83:0/260860298 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7ff75c0a11b0 0x7ff75c0a3670 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:06.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:06.534+0000 7ff777275700 1 --2- 172.21.15.83:0/260860298 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7700fff70 0x7ff7701961b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:06.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:06.534+0000 7ff777275700 1 --2- 172.21.15.83:0/260860298 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff770100920 0x7ff7701966f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:06.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:06.534+0000 7ff777275700 1 -- 172.21.15.83:0/260860298 >> 172.21.15.83:0/260860298 conn(0x7ff770075d50 msgr2=0x7ff7700ff490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:06.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:06.535+0000 7ff777275700 1 -- 172.21.15.83:0/260860298 shutdown_connections 2024-04-01T06:55:06.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:06.535+0000 7ff777275700 1 -- 172.21.15.83:0/260860298 wait complete. 2024-04-01T06:55:06.897 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:06 smithi083 ceph-mon[43429]: pgmap v235: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-01T06:55:06.898 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:06 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/1507608006' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-01T06:55:06.898 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:06 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/260860298' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-04-01T06:55:06.899 INFO:tasks.cephadm.ceph_manager.ceph:need seq 317827579918 got 317827579920 for osd.11 2024-04-01T06:55:06.899 DEBUG:teuthology.parallel:result is None 2024-04-01T06:55:06.899 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-04-01T06:55:06.899 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-04-01T06:55:07.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:06 smithi145 ceph-mon[47816]: pgmap v235: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-01T06:55:07.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:06 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/1507608006' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-01T06:55:07.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:06 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/260860298' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-04-01T06:55:07.121 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:55:07.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:06 smithi153 ceph-mon[48187]: pgmap v235: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-01T06:55:07.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:06 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/1507608006' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-01T06:55:07.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:06 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/260860298' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-04-01T06:55:08.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:08.141+0000 7fbabb432700 1 -- 172.21.15.83:0/3215299319 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbab4068750 msgr2=0x7fbab4068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:08.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:08.141+0000 7fbabb432700 1 --2- 172.21.15.83:0/3215299319 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbab4068750 0x7fbab4068bd0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fbab00099c0 tx=0x7fbab0009cd0 comp rx=0 tx=0).stop 2024-04-01T06:55:08.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:08.141+0000 7fbabb432700 1 -- 172.21.15.83:0/3215299319 shutdown_connections 2024-04-01T06:55:08.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:08.141+0000 7fbabb432700 1 --2- 172.21.15.83:0/3215299319 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbab4069110 0x7fbab410dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:08.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:08.141+0000 7fbabb432700 1 --2- 172.21.15.83:0/3215299319 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbab4106e00 0x7fbab41071e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:08.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:08.141+0000 7fbabb432700 1 --2- 172.21.15.83:0/3215299319 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbab4068750 0x7fbab4068bd0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:08.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:08.141+0000 7fbabb432700 1 -- 172.21.15.83:0/3215299319 >> 172.21.15.83:0/3215299319 conn(0x7fbab4075d50 msgr2=0x7fbab4076160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:08.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:08.141+0000 7fbabb432700 1 -- 172.21.15.83:0/3215299319 shutdown_connections 2024-04-01T06:55:08.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:08.141+0000 7fbabb432700 1 -- 172.21.15.83:0/3215299319 wait complete. 2024-04-01T06:55:08.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:08.142+0000 7fbabb432700 1 Processor -- start 2024-04-01T06:55:08.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:08.142+0000 7fbabb432700 1 -- start start 2024-04-01T06:55:08.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:08.142+0000 7fbabb432700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbab4068750 0x7fbab41971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:08.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:08.142+0000 7fbabb432700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbab4069110 0x7fbab4197700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:08.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:08.142+0000 7fbabb432700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbab4106e00 0x7fbab419bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:08.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:08.142+0000 7fbabb432700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab419c0c0 con 0x7fbab4068750 2024-04-01T06:55:08.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:08.142+0000 7fbabb432700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab419c230 con 0x7fbab4106e00 2024-04-01T06:55:08.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:08.142+0000 7fbabb432700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab419c3f0 con 0x7fbab4069110 2024-04-01T06:55:08.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:08.142+0000 7fbab91ce700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbab4068750 0x7fbab41971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:08.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:08.142+0000 7fbab91ce700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbab4068750 0x7fbab41971c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:50426/0 (socket says 172.21.15.83:50426) 2024-04-01T06:55:08.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:08.142+0000 7fbab91ce700 1 -- 172.21.15.83:0/2230284835 learned_addr learned my addr 172.21.15.83:0/2230284835 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:08.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:08.142+0000 7fbab99cf700 1 --2- 172.21.15.83:0/2230284835 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbab4106e00 0x7fbab419bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:08.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:08.142+0000 7fbab89cd700 1 --2- 172.21.15.83:0/2230284835 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbab4069110 0x7fbab4197700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:08.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:08.142+0000 7fbab91ce700 1 -- 172.21.15.83:0/2230284835 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbab4069110 msgr2=0x7fbab4197700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:08.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:08.142+0000 7fbab91ce700 1 --2- 172.21.15.83:0/2230284835 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbab4069110 0x7fbab4197700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:08.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:08.142+0000 7fbab91ce700 1 -- 172.21.15.83:0/2230284835 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbab4106e00 msgr2=0x7fbab419bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:08.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:08.142+0000 7fbab91ce700 1 --2- 172.21.15.83:0/2230284835 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbab4106e00 0x7fbab419bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:08.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:08.142+0000 7fbab91ce700 1 -- 172.21.15.83:0/2230284835 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab00095f0 con 0x7fbab4068750 2024-04-01T06:55:08.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:08.143+0000 7fbab91ce700 1 --2- 172.21.15.83:0/2230284835 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbab4068750 0x7fbab41971c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbaa800c920 tx=0x7fbaa800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:08.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:08.143+0000 7fbaa67fc700 1 -- 172.21.15.83:0/2230284835 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa8007b00 con 0x7fbab4068750 2024-04-01T06:55:08.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:08.143+0000 7fbabb432700 1 -- 172.21.15.83:0/2230284835 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbab419c6d0 con 0x7fbab4068750 2024-04-01T06:55:08.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:08.143+0000 7fbaa67fc700 1 -- 172.21.15.83:0/2230284835 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbaa800ce70 con 0x7fbab4068750 2024-04-01T06:55:08.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:08.143+0000 7fbaa67fc700 1 -- 172.21.15.83:0/2230284835 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa80054e0 con 0x7fbab4068750 2024-04-01T06:55:08.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:08.143+0000 7fbabb432700 1 -- 172.21.15.83:0/2230284835 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbab41a3f30 con 0x7fbab4068750 2024-04-01T06:55:08.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:08.144+0000 7fbabb432700 1 -- 172.21.15.83:0/2230284835 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbab4109300 con 0x7fbab4068750 2024-04-01T06:55:08.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:08.145+0000 7fbaa67fc700 1 -- 172.21.15.83:0/2230284835 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7fbaa8004750 con 0x7fbab4068750 2024-04-01T06:55:08.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:08.145+0000 7fbaa67fc700 1 --2- 172.21.15.83:0/2230284835 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fbaa00a11b0 0x7fbaa00a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:08.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:08.145+0000 7fbab89cd700 1 --2- 172.21.15.83:0/2230284835 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fbaa00a11b0 0x7fbaa00a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:08.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:08.146+0000 7fbaa67fc700 1 -- 172.21.15.83:0/2230284835 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fbaa80cc890 con 0x7fbab4068750 2024-04-01T06:55:08.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:08.146+0000 7fbab89cd700 1 --2- 172.21.15.83:0/2230284835 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fbaa00a11b0 0x7fbaa00a3670 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbab4198720 tx=0x7fbab0005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:08.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:08.149+0000 7fbaa67fc700 1 -- 172.21.15.83:0/2230284835 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7fbaa8095f70 con 0x7fbab4068750 2024-04-01T06:55:08.336 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:08.336+0000 7fbabb432700 1 -- 172.21.15.83:0/2230284835 --> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbab4198540 con 0x7fbaa00a11b0 2024-04-01T06:55:08.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:08.346+0000 7fbaa67fc700 1 -- 172.21.15.83:0/2230284835 <== mgr.14152 v2:172.21.15.83:6800/3375372052 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+341591 (secure 0 0 0) 0x7fbab4198540 con 0x7fbaa00a11b0 2024-04-01T06:55:08.351 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:55:08.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:08.349+0000 7fbabb432700 1 -- 172.21.15.83:0/2230284835 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fbaa00a11b0 msgr2=0x7fbaa00a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:08.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:08.349+0000 7fbabb432700 1 --2- 172.21.15.83:0/2230284835 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fbaa00a11b0 0x7fbaa00a3670 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbab4198720 tx=0x7fbab0005fd0 comp rx=0 tx=0).stop 2024-04-01T06:55:08.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:08.349+0000 7fbabb432700 1 -- 172.21.15.83:0/2230284835 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbab4068750 msgr2=0x7fbab41971c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:08.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:08.349+0000 7fbabb432700 1 --2- 172.21.15.83:0/2230284835 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbab4068750 0x7fbab41971c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbaa800c920 tx=0x7fbaa800cc30 comp rx=0 tx=0).stop 2024-04-01T06:55:08.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:08.349+0000 7fbabb432700 1 -- 172.21.15.83:0/2230284835 shutdown_connections 2024-04-01T06:55:08.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:08.349+0000 7fbabb432700 1 --2- 172.21.15.83:0/2230284835 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbab4068750 0x7fbab41971c0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:08.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:08.349+0000 7fbabb432700 1 --2- 172.21.15.83:0/2230284835 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fbaa00a11b0 0x7fbaa00a3670 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:08.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:08.349+0000 7fbabb432700 1 --2- 172.21.15.83:0/2230284835 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbab4106e00 0x7fbab419bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:08.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:08.349+0000 7fbabb432700 1 --2- 172.21.15.83:0/2230284835 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbab4069110 0x7fbab4197700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:08.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:08.349+0000 7fbabb432700 1 -- 172.21.15.83:0/2230284835 >> 172.21.15.83:0/2230284835 conn(0x7fbab4075d50 msgr2=0x7fbab40fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:08.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:08.349+0000 7fbabb432700 1 -- 172.21.15.83:0/2230284835 shutdown_connections 2024-04-01T06:55:08.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:08.349+0000 7fbabb432700 1 -- 172.21.15.83:0/2230284835 wait complete. 2024-04-01T06:55:08.355 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-04-01T06:55:08.757 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":236,"stamp":"2024-04-01T06:55:07.722925+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655902,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":348,"num_read_kb":293,"num_write":334,"num_write_kb":3047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":272,"ondisk_log_size":272,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":359260,"kb_used_data":10492,"kb_used_omap":18,"kb_used_meta":348653,"kb_avail":1124582564,"statfs":{"total":1151940427776,"available":1151572545536,"internally_reserved":0,"allocated":10743808,"data_stored":6867484,"data_compressed":112716,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":19130,"internal_metadata":357020998},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1652,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":32,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003245"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.479985+0000","last_change":"2024-04-01T06:54:28.426588+0000","last_active":"2024-04-01T06:54:30.479985+0000","last_peered":"2024-04-01T06:54:30.479985+0000","last_clean":"2024-04-01T06:54:30.479985+0000","last_became_active":"2024-04-01T06:54:28.423723+0000","last_became_peered":"2024-04-01T06:54:28.423723+0000","last_unstale":"2024-04-01T06:54:30.479985+0000","last_undegraded":"2024-04-01T06:54:30.479985+0000","last_fullsized":"2024-04-01T06:54:30.479985+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:52:38.856474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358294+0000","last_change":"2024-04-01T06:54:28.419858+0000","last_active":"2024-04-01T06:54:30.358294+0000","last_peered":"2024-04-01T06:54:30.358294+0000","last_clean":"2024-04-01T06:54:30.358294+0000","last_became_active":"2024-04-01T06:54:28.419534+0000","last_became_peered":"2024-04-01T06:54:28.419534+0000","last_unstale":"2024-04-01T06:54:30.358294+0000","last_undegraded":"2024-04-01T06:54:30.358294+0000","last_fullsized":"2024-04-01T06:54:30.358294+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:26:56.349672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.357923+0000","last_change":"2024-04-01T06:54:28.422763+0000","last_active":"2024-04-01T06:54:30.357923+0000","last_peered":"2024-04-01T06:54:30.357923+0000","last_clean":"2024-04-01T06:54:30.357923+0000","last_became_active":"2024-04-01T06:54:28.422439+0000","last_became_peered":"2024-04-01T06:54:28.422439+0000","last_unstale":"2024-04-01T06:54:30.357923+0000","last_undegraded":"2024-04-01T06:54:30.357923+0000","last_fullsized":"2024-04-01T06:54:30.357923+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:55:24.379428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358669+0000","last_change":"2024-04-01T06:54:28.421996+0000","last_active":"2024-04-01T06:54:30.358669+0000","last_peered":"2024-04-01T06:54:30.358669+0000","last_clean":"2024-04-01T06:54:30.358669+0000","last_became_active":"2024-04-01T06:54:28.421594+0000","last_became_peered":"2024-04-01T06:54:28.421594+0000","last_unstale":"2024-04-01T06:54:30.358669+0000","last_undegraded":"2024-04-01T06:54:30.358669+0000","last_fullsized":"2024-04-01T06:54:30.358669+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:36:53.200615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.412828+0000","last_change":"2024-04-01T06:54:28.415652+0000","last_active":"2024-04-01T06:54:29.412828+0000","last_peered":"2024-04-01T06:54:29.412828+0000","last_clean":"2024-04-01T06:54:29.412828+0000","last_became_active":"2024-04-01T06:54:28.415296+0000","last_became_peered":"2024-04-01T06:54:28.415296+0000","last_unstale":"2024-04-01T06:54:29.412828+0000","last_undegraded":"2024-04-01T06:54:29.412828+0000","last_fullsized":"2024-04-01T06:54:29.412828+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:36:36.967298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-01T06:54:28.690214+0000","last_change":"2024-04-01T06:54:28.421188+0000","last_active":"2024-04-01T06:54:28.690214+0000","last_peered":"2024-04-01T06:54:28.690214+0000","last_clean":"2024-04-01T06:54:28.690214+0000","last_became_active":"2024-04-01T06:54:28.420863+0000","last_became_peered":"2024-04-01T06:54:28.420863+0000","last_unstale":"2024-04-01T06:54:28.690214+0000","last_undegraded":"2024-04-01T06:54:28.690214+0000","last_fullsized":"2024-04-01T06:54:28.690214+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:40:38.641128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358358+0000","last_change":"2024-04-01T06:54:28.422554+0000","last_active":"2024-04-01T06:54:30.358358+0000","last_peered":"2024-04-01T06:54:30.358358+0000","last_clean":"2024-04-01T06:54:30.358358+0000","last_became_active":"2024-04-01T06:54:28.422209+0000","last_became_peered":"2024-04-01T06:54:28.422209+0000","last_unstale":"2024-04-01T06:54:30.358358+0000","last_undegraded":"2024-04-01T06:54:30.358358+0000","last_fullsized":"2024-04-01T06:54:30.358358+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T14:59:45.017681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.515266+0000","last_change":"2024-04-01T06:54:28.419291+0000","last_active":"2024-04-01T06:54:29.515266+0000","last_peered":"2024-04-01T06:54:29.515266+0000","last_clean":"2024-04-01T06:54:29.515266+0000","last_became_active":"2024-04-01T06:54:28.419013+0000","last_became_peered":"2024-04-01T06:54:28.419013+0000","last_unstale":"2024-04-01T06:54:29.515266+0000","last_undegraded":"2024-04-01T06:54:29.515266+0000","last_fullsized":"2024-04-01T06:54:29.515266+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:45:08.226568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.413505+0000","last_change":"2024-04-01T06:54:28.410264+0000","last_active":"2024-04-01T06:54:29.413505+0000","last_peered":"2024-04-01T06:54:29.413505+0000","last_clean":"2024-04-01T06:54:29.413505+0000","last_became_active":"2024-04-01T06:54:28.409959+0000","last_became_peered":"2024-04-01T06:54:28.409959+0000","last_unstale":"2024-04-01T06:54:29.413505+0000","last_undegraded":"2024-04-01T06:54:29.413505+0000","last_fullsized":"2024-04-01T06:54:29.413505+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:14:13.184396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-01T06:54:28.690280+0000","last_change":"2024-04-01T06:54:28.422115+0000","last_active":"2024-04-01T06:54:28.690280+0000","last_peered":"2024-04-01T06:54:28.690280+0000","last_clean":"2024-04-01T06:54:28.690280+0000","last_became_active":"2024-04-01T06:54:28.421629+0000","last_became_peered":"2024-04-01T06:54:28.421629+0000","last_unstale":"2024-04-01T06:54:28.690280+0000","last_undegraded":"2024-04-01T06:54:28.690280+0000","last_fullsized":"2024-04-01T06:54:28.690280+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:47:03.271557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358701+0000","last_change":"2024-04-01T06:54:28.429652+0000","last_active":"2024-04-01T06:54:30.358701+0000","last_peered":"2024-04-01T06:54:30.358701+0000","last_clean":"2024-04-01T06:54:30.358701+0000","last_became_active":"2024-04-01T06:54:28.429298+0000","last_became_peered":"2024-04-01T06:54:28.429298+0000","last_unstale":"2024-04-01T06:54:30.358701+0000","last_undegraded":"2024-04-01T06:54:30.358701+0000","last_fullsized":"2024-04-01T06:54:30.358701+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:03:16.110580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358421+0000","last_change":"2024-04-01T06:54:28.429645+0000","last_active":"2024-04-01T06:54:30.358421+0000","last_peered":"2024-04-01T06:54:30.358421+0000","last_clean":"2024-04-01T06:54:30.358421+0000","last_became_active":"2024-04-01T06:54:28.429285+0000","last_became_peered":"2024-04-01T06:54:28.429285+0000","last_unstale":"2024-04-01T06:54:30.358421+0000","last_undegraded":"2024-04-01T06:54:30.358421+0000","last_fullsized":"2024-04-01T06:54:30.358421+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:04:10.285396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.411765+0000","last_change":"2024-04-01T06:54:28.419390+0000","last_active":"2024-04-01T06:54:29.411765+0000","last_peered":"2024-04-01T06:54:29.411765+0000","last_clean":"2024-04-01T06:54:29.411765+0000","last_became_active":"2024-04-01T06:54:28.419110+0000","last_became_peered":"2024-04-01T06:54:28.419110+0000","last_unstale":"2024-04-01T06:54:29.411765+0000","last_undegraded":"2024-04-01T06:54:29.411765+0000","last_fullsized":"2024-04-01T06:54:29.411765+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:21:52.192681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.357608+0000","last_change":"2024-04-01T06:54:28.419416+0000","last_active":"2024-04-01T06:54:30.357608+0000","last_peered":"2024-04-01T06:54:30.357608+0000","last_clean":"2024-04-01T06:54:30.357608+0000","last_became_active":"2024-04-01T06:54:28.419099+0000","last_became_peered":"2024-04-01T06:54:28.419099+0000","last_unstale":"2024-04-01T06:54:30.357608+0000","last_undegraded":"2024-04-01T06:54:30.357608+0000","last_fullsized":"2024-04-01T06:54:30.357608+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:26:44.889806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.357586+0000","last_change":"2024-04-01T06:54:28.427391+0000","last_active":"2024-04-01T06:54:30.357586+0000","last_peered":"2024-04-01T06:54:30.357586+0000","last_clean":"2024-04-01T06:54:30.357586+0000","last_became_active":"2024-04-01T06:54:28.427153+0000","last_became_peered":"2024-04-01T06:54:28.427153+0000","last_unstale":"2024-04-01T06:54:30.357586+0000","last_undegraded":"2024-04-01T06:54:30.357586+0000","last_fullsized":"2024-04-01T06:54:30.357586+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:42:41.084729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.413106+0000","last_change":"2024-04-01T06:54:28.417088+0000","last_active":"2024-04-01T06:54:29.413106+0000","last_peered":"2024-04-01T06:54:29.413106+0000","last_clean":"2024-04-01T06:54:29.413106+0000","last_became_active":"2024-04-01T06:54:28.416747+0000","last_became_peered":"2024-04-01T06:54:28.416747+0000","last_unstale":"2024-04-01T06:54:29.413106+0000","last_undegraded":"2024-04-01T06:54:29.413106+0000","last_fullsized":"2024-04-01T06:54:29.413106+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:59:14.069761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.480070+0000","last_change":"2024-04-01T06:54:28.426049+0000","last_active":"2024-04-01T06:54:30.480070+0000","last_peered":"2024-04-01T06:54:30.480070+0000","last_clean":"2024-04-01T06:54:30.480070+0000","last_became_active":"2024-04-01T06:54:28.425723+0000","last_became_peered":"2024-04-01T06:54:28.425723+0000","last_unstale":"2024-04-01T06:54:30.480070+0000","last_undegraded":"2024-04-01T06:54:30.480070+0000","last_fullsized":"2024-04-01T06:54:30.480070+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:48:59.394352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.357884+0000","last_change":"2024-04-01T06:54:28.421574+0000","last_active":"2024-04-01T06:54:30.357884+0000","last_peered":"2024-04-01T06:54:30.357884+0000","last_clean":"2024-04-01T06:54:30.357884+0000","last_became_active":"2024-04-01T06:54:28.420852+0000","last_became_peered":"2024-04-01T06:54:28.420852+0000","last_unstale":"2024-04-01T06:54:30.357884+0000","last_undegraded":"2024-04-01T06:54:30.357884+0000","last_fullsized":"2024-04-01T06:54:30.357884+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:20:30.373285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358552+0000","last_change":"2024-04-01T06:54:28.419249+0000","last_active":"2024-04-01T06:54:30.358552+0000","last_peered":"2024-04-01T06:54:30.358552+0000","last_clean":"2024-04-01T06:54:30.358552+0000","last_became_active":"2024-04-01T06:54:28.418931+0000","last_became_peered":"2024-04-01T06:54:28.418931+0000","last_unstale":"2024-04-01T06:54:30.358552+0000","last_undegraded":"2024-04-01T06:54:30.358552+0000","last_fullsized":"2024-04-01T06:54:30.358552+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:38:04.786657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"79'9","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:32.710563+0000","last_change":"2024-04-01T06:54:27.993489+0000","last_active":"2024-04-01T06:54:32.710563+0000","last_peered":"2024-04-01T06:54:32.710563+0000","last_clean":"2024-04-01T06:54:32.710563+0000","last_became_active":"2024-04-01T06:54:27.993201+0000","last_became_peered":"2024-04-01T06:54:27.993201+0000","last_unstale":"2024-04-01T06:54:32.710563+0000","last_undegraded":"2024-04-01T06:54:32.710563+0000","last_fullsized":"2024-04-01T06:54:32.710563+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:10:53.897013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.515446+0000","last_change":"2024-04-01T06:54:28.417750+0000","last_active":"2024-04-01T06:54:29.515446+0000","last_peered":"2024-04-01T06:54:29.515446+0000","last_clean":"2024-04-01T06:54:29.515446+0000","last_became_active":"2024-04-01T06:54:28.417470+0000","last_became_peered":"2024-04-01T06:54:28.417470+0000","last_unstale":"2024-04-01T06:54:29.515446+0000","last_undegraded":"2024-04-01T06:54:29.515446+0000","last_fullsized":"2024-04-01T06:54:29.515446+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:06:12.668846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"79'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.515595+0000","last_change":"2024-04-01T06:54:27.998302+0000","last_active":"2024-04-01T06:54:29.515595+0000","last_peered":"2024-04-01T06:54:29.515595+0000","last_clean":"2024-04-01T06:54:29.515595+0000","last_became_active":"2024-04-01T06:54:27.997951+0000","last_became_peered":"2024-04-01T06:54:27.997951+0000","last_unstale":"2024-04-01T06:54:29.515595+0000","last_undegraded":"2024-04-01T06:54:29.515595+0000","last_fullsized":"2024-04-01T06:54:29.515595+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:28:45.076734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358361+0000","last_change":"2024-04-01T06:54:28.415641+0000","last_active":"2024-04-01T06:54:30.358361+0000","last_peered":"2024-04-01T06:54:30.358361+0000","last_clean":"2024-04-01T06:54:30.358361+0000","last_became_active":"2024-04-01T06:54:28.415305+0000","last_became_peered":"2024-04-01T06:54:28.415305+0000","last_unstale":"2024-04-01T06:54:30.358361+0000","last_undegraded":"2024-04-01T06:54:30.358361+0000","last_fullsized":"2024-04-01T06:54:30.358361+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:01:46.528332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"79'4","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:32.707231+0000","last_change":"2024-04-01T06:54:27.990581+0000","last_active":"2024-04-01T06:54:32.707231+0000","last_peered":"2024-04-01T06:54:32.707231+0000","last_clean":"2024-04-01T06:54:32.707231+0000","last_became_active":"2024-04-01T06:54:27.990099+0000","last_became_peered":"2024-04-01T06:54:27.990099+0000","last_unstale":"2024-04-01T06:54:32.707231+0000","last_undegraded":"2024-04-01T06:54:32.707231+0000","last_fullsized":"2024-04-01T06:54:32.707231+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T14:53:49.183394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.413310+0000","last_change":"2024-04-01T06:54:28.423208+0000","last_active":"2024-04-01T06:54:29.413310+0000","last_peered":"2024-04-01T06:54:29.413310+0000","last_clean":"2024-04-01T06:54:29.413310+0000","last_became_active":"2024-04-01T06:54:28.422648+0000","last_became_peered":"2024-04-01T06:54:28.422648+0000","last_unstale":"2024-04-01T06:54:29.413310+0000","last_undegraded":"2024-04-01T06:54:29.413310+0000","last_fullsized":"2024-04-01T06:54:29.413310+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:02:58.380288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.413114+0000","last_change":"2024-04-01T06:54:27.995776+0000","last_active":"2024-04-01T06:54:29.413114+0000","last_peered":"2024-04-01T06:54:29.413114+0000","last_clean":"2024-04-01T06:54:29.413114+0000","last_became_active":"2024-04-01T06:54:27.995417+0000","last_became_peered":"2024-04-01T06:54:27.995417+0000","last_unstale":"2024-04-01T06:54:29.413114+0000","last_undegraded":"2024-04-01T06:54:29.413114+0000","last_fullsized":"2024-04-01T06:54:29.413114+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:46:36.694460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.214258+0000","last_change":"2024-04-01T06:54:28.422448+0000","last_active":"2024-04-01T06:54:30.214258+0000","last_peered":"2024-04-01T06:54:30.214258+0000","last_clean":"2024-04-01T06:54:30.214258+0000","last_became_active":"2024-04-01T06:54:28.422080+0000","last_became_peered":"2024-04-01T06:54:28.422080+0000","last_unstale":"2024-04-01T06:54:30.214258+0000","last_undegraded":"2024-04-01T06:54:30.214258+0000","last_fullsized":"2024-04-01T06:54:30.214258+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:03:23.686194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"79'6","reported_seq":51,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:55:01.756808+0000","last_change":"2024-04-01T06:54:27.998822+0000","last_active":"2024-04-01T06:55:01.756808+0000","last_peered":"2024-04-01T06:55:01.756808+0000","last_clean":"2024-04-01T06:55:01.756808+0000","last_became_active":"2024-04-01T06:54:27.998514+0000","last_became_peered":"2024-04-01T06:54:27.998514+0000","last_unstale":"2024-04-01T06:55:01.756808+0000","last_undegraded":"2024-04-01T06:55:01.756808+0000","last_fullsized":"2024-04-01T06:55:01.756808+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T14:21:28.340169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.412849+0000","last_change":"2024-04-01T06:54:28.415825+0000","last_active":"2024-04-01T06:54:29.412849+0000","last_peered":"2024-04-01T06:54:29.412849+0000","last_clean":"2024-04-01T06:54:29.412849+0000","last_became_active":"2024-04-01T06:54:28.413679+0000","last_became_peered":"2024-04-01T06:54:28.413679+0000","last_unstale":"2024-04-01T06:54:29.412849+0000","last_undegraded":"2024-04-01T06:54:29.412849+0000","last_fullsized":"2024-04-01T06:54:29.412849+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:13:19.907109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"79'3","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:32.708798+0000","last_change":"2024-04-01T06:54:27.994194+0000","last_active":"2024-04-01T06:54:32.708798+0000","last_peered":"2024-04-01T06:54:32.708798+0000","last_clean":"2024-04-01T06:54:32.708798+0000","last_became_active":"2024-04-01T06:54:27.993868+0000","last_became_peered":"2024-04-01T06:54:27.993868+0000","last_unstale":"2024-04-01T06:54:32.708798+0000","last_undegraded":"2024-04-01T06:54:32.708798+0000","last_fullsized":"2024-04-01T06:54:32.708798+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:55:17.003472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.214120+0000","last_change":"2024-04-01T06:54:28.412629+0000","last_active":"2024-04-01T06:54:30.214120+0000","last_peered":"2024-04-01T06:54:30.214120+0000","last_clean":"2024-04-01T06:54:30.214120+0000","last_became_active":"2024-04-01T06:54:28.412291+0000","last_became_peered":"2024-04-01T06:54:28.412291+0000","last_unstale":"2024-04-01T06:54:30.214120+0000","last_undegraded":"2024-04-01T06:54:30.214120+0000","last_fullsized":"2024-04-01T06:54:30.214120+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:29:14.007470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"79'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:32.708507+0000","last_change":"2024-04-01T06:54:27.996570+0000","last_active":"2024-04-01T06:54:32.708507+0000","last_peered":"2024-04-01T06:54:32.708507+0000","last_clean":"2024-04-01T06:54:32.708507+0000","last_became_active":"2024-04-01T06:54:27.994897+0000","last_became_peered":"2024-04-01T06:54:27.994897+0000","last_unstale":"2024-04-01T06:54:32.708507+0000","last_undegraded":"2024-04-01T06:54:32.708507+0000","last_fullsized":"2024-04-01T06:54:32.708507+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:53:05.733608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.515225+0000","last_change":"2024-04-01T06:54:28.413701+0000","last_active":"2024-04-01T06:54:29.515225+0000","last_peered":"2024-04-01T06:54:29.515225+0000","last_clean":"2024-04-01T06:54:29.515225+0000","last_became_active":"2024-04-01T06:54:28.413435+0000","last_became_peered":"2024-04-01T06:54:28.413435+0000","last_unstale":"2024-04-01T06:54:29.515225+0000","last_undegraded":"2024-04-01T06:54:29.515225+0000","last_fullsized":"2024-04-01T06:54:29.515225+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:43:27.835398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'1","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.213830+0000","last_change":"2024-04-01T06:54:28.001115+0000","last_active":"2024-04-01T06:54:30.213830+0000","last_peered":"2024-04-01T06:54:30.213830+0000","last_clean":"2024-04-01T06:54:30.213830+0000","last_became_active":"2024-04-01T06:54:28.000732+0000","last_became_peered":"2024-04-01T06:54:28.000732+0000","last_unstale":"2024-04-01T06:54:30.213830+0000","last_undegraded":"2024-04-01T06:54:30.213830+0000","last_fullsized":"2024-04-01T06:54:30.213830+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:06:02.064402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358103+0000","last_change":"2024-04-01T06:54:28.421670+0000","last_active":"2024-04-01T06:54:30.358103+0000","last_peered":"2024-04-01T06:54:30.358103+0000","last_clean":"2024-04-01T06:54:30.358103+0000","last_became_active":"2024-04-01T06:54:28.421335+0000","last_became_peered":"2024-04-01T06:54:28.421335+0000","last_unstale":"2024-04-01T06:54:30.358103+0000","last_undegraded":"2024-04-01T06:54:30.358103+0000","last_fullsized":"2024-04-01T06:54:30.358103+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:25:55.223397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"79'3","reported_seq":45,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:55:01.756098+0000","last_change":"2024-04-01T06:54:27.999413+0000","last_active":"2024-04-01T06:55:01.756098+0000","last_peered":"2024-04-01T06:55:01.756098+0000","last_clean":"2024-04-01T06:55:01.756098+0000","last_became_active":"2024-04-01T06:54:27.999123+0000","last_became_peered":"2024-04-01T06:54:27.999123+0000","last_unstale":"2024-04-01T06:55:01.756098+0000","last_undegraded":"2024-04-01T06:55:01.756098+0000","last_fullsized":"2024-04-01T06:55:01.756098+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:30:06.399907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.413618+0000","last_change":"2024-04-01T06:54:28.423843+0000","last_active":"2024-04-01T06:54:29.413618+0000","last_peered":"2024-04-01T06:54:29.413618+0000","last_clean":"2024-04-01T06:54:29.413618+0000","last_became_active":"2024-04-01T06:54:28.423538+0000","last_became_peered":"2024-04-01T06:54:28.423538+0000","last_unstale":"2024-04-01T06:54:29.413618+0000","last_undegraded":"2024-04-01T06:54:29.413618+0000","last_fullsized":"2024-04-01T06:54:29.413618+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:51:23.986409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:31.700817+0000","last_change":"2024-04-01T06:54:27.997137+0000","last_active":"2024-04-01T06:54:31.700817+0000","last_peered":"2024-04-01T06:54:31.700817+0000","last_clean":"2024-04-01T06:54:31.700817+0000","last_became_active":"2024-04-01T06:54:27.996386+0000","last_became_peered":"2024-04-01T06:54:27.996386+0000","last_unstale":"2024-04-01T06:54:31.700817+0000","last_undegraded":"2024-04-01T06:54:31.700817+0000","last_fullsized":"2024-04-01T06:54:31.700817+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:29:57.365756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358233+0000","last_change":"2024-04-01T06:54:28.426837+0000","last_active":"2024-04-01T06:54:30.358233+0000","last_peered":"2024-04-01T06:54:30.358233+0000","last_clean":"2024-04-01T06:54:30.358233+0000","last_became_active":"2024-04-01T06:54:28.426551+0000","last_became_peered":"2024-04-01T06:54:28.426551+0000","last_unstale":"2024-04-01T06:54:30.358233+0000","last_undegraded":"2024-04-01T06:54:30.358233+0000","last_fullsized":"2024-04-01T06:54:30.358233+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:05:50.264912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'4","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:31.700655+0000","last_change":"2024-04-01T06:54:27.999968+0000","last_active":"2024-04-01T06:54:31.700655+0000","last_peered":"2024-04-01T06:54:31.700655+0000","last_clean":"2024-04-01T06:54:31.700655+0000","last_became_active":"2024-04-01T06:54:27.999415+0000","last_became_peered":"2024-04-01T06:54:27.999415+0000","last_unstale":"2024-04-01T06:54:31.700655+0000","last_undegraded":"2024-04-01T06:54:31.700655+0000","last_fullsized":"2024-04-01T06:54:31.700655+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:31:57.472227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.413424+0000","last_change":"2024-04-01T06:54:28.421174+0000","last_active":"2024-04-01T06:54:29.413424+0000","last_peered":"2024-04-01T06:54:29.413424+0000","last_clean":"2024-04-01T06:54:29.413424+0000","last_became_active":"2024-04-01T06:54:28.420841+0000","last_became_peered":"2024-04-01T06:54:28.420841+0000","last_unstale":"2024-04-01T06:54:29.413424+0000","last_undegraded":"2024-04-01T06:54:29.413424+0000","last_fullsized":"2024-04-01T06:54:29.413424+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:05:25.377496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"79'28","reported_seq":108,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:55:02.764907+0000","last_change":"2024-04-01T06:54:27.995496+0000","last_active":"2024-04-01T06:55:02.764907+0000","last_peered":"2024-04-01T06:55:02.764907+0000","last_clean":"2024-04-01T06:55:02.764907+0000","last_became_active":"2024-04-01T06:54:27.995131+0000","last_became_peered":"2024-04-01T06:54:27.995131+0000","last_unstale":"2024-04-01T06:55:02.764907+0000","last_undegraded":"2024-04-01T06:55:02.764907+0000","last_fullsized":"2024-04-01T06:55:02.764907+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:36:12.129235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61000,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":68,"num_read_kb":93,"num_write":29,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.413022+0000","last_change":"2024-04-01T06:54:28.427835+0000","last_active":"2024-04-01T06:54:29.413022+0000","last_peered":"2024-04-01T06:54:29.413022+0000","last_clean":"2024-04-01T06:54:29.413022+0000","last_became_active":"2024-04-01T06:54:28.426956+0000","last_became_peered":"2024-04-01T06:54:28.426956+0000","last_unstale":"2024-04-01T06:54:29.413022+0000","last_undegraded":"2024-04-01T06:54:29.413022+0000","last_fullsized":"2024-04-01T06:54:29.413022+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:41:17.334977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'6","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:32.708508+0000","last_change":"2024-04-01T06:54:27.992756+0000","last_active":"2024-04-01T06:54:32.708508+0000","last_peered":"2024-04-01T06:54:32.708508+0000","last_clean":"2024-04-01T06:54:32.708508+0000","last_became_active":"2024-04-01T06:54:27.992403+0000","last_became_peered":"2024-04-01T06:54:27.992403+0000","last_unstale":"2024-04-01T06:54:32.708508+0000","last_undegraded":"2024-04-01T06:54:32.708508+0000","last_fullsized":"2024-04-01T06:54:32.708508+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:40:33.458435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.411545+0000","last_change":"2024-04-01T06:54:28.416750+0000","last_active":"2024-04-01T06:54:29.411545+0000","last_peered":"2024-04-01T06:54:29.411545+0000","last_clean":"2024-04-01T06:54:29.411545+0000","last_became_active":"2024-04-01T06:54:28.416417+0000","last_became_peered":"2024-04-01T06:54:28.416417+0000","last_unstale":"2024-04-01T06:54:29.411545+0000","last_undegraded":"2024-04-01T06:54:29.411545+0000","last_fullsized":"2024-04-01T06:54:29.411545+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:04:41.698842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'3","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:31.701032+0000","last_change":"2024-04-01T06:54:28.001450+0000","last_active":"2024-04-01T06:54:31.701032+0000","last_peered":"2024-04-01T06:54:31.701032+0000","last_clean":"2024-04-01T06:54:31.701032+0000","last_became_active":"2024-04-01T06:54:28.001165+0000","last_became_peered":"2024-04-01T06:54:28.001165+0000","last_unstale":"2024-04-01T06:54:31.701032+0000","last_undegraded":"2024-04-01T06:54:31.701032+0000","last_fullsized":"2024-04-01T06:54:31.701032+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:20:03.876123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358814+0000","last_change":"2024-04-01T06:54:28.421097+0000","last_active":"2024-04-01T06:54:30.358814+0000","last_peered":"2024-04-01T06:54:30.358814+0000","last_clean":"2024-04-01T06:54:30.358814+0000","last_became_active":"2024-04-01T06:54:28.420781+0000","last_became_peered":"2024-04-01T06:54:28.420781+0000","last_unstale":"2024-04-01T06:54:30.358814+0000","last_undegraded":"2024-04-01T06:54:30.358814+0000","last_fullsized":"2024-04-01T06:54:30.358814+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:11:47.192742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"79'4","reported_seq":52,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:55:04.760439+0000","last_change":"2024-04-01T06:54:27.993832+0000","last_active":"2024-04-01T06:55:04.760439+0000","last_peered":"2024-04-01T06:55:04.760439+0000","last_clean":"2024-04-01T06:55:04.760439+0000","last_became_active":"2024-04-01T06:54:27.993423+0000","last_became_peered":"2024-04-01T06:54:27.993423+0000","last_unstale":"2024-04-01T06:55:04.760439+0000","last_undegraded":"2024-04-01T06:55:04.760439+0000","last_fullsized":"2024-04-01T06:55:04.760439+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:58:37.542214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":933,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":37,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358345+0000","last_change":"2024-04-01T06:54:28.423352+0000","last_active":"2024-04-01T06:54:30.358345+0000","last_peered":"2024-04-01T06:54:30.358345+0000","last_clean":"2024-04-01T06:54:30.358345+0000","last_became_active":"2024-04-01T06:54:28.423049+0000","last_became_peered":"2024-04-01T06:54:28.423049+0000","last_unstale":"2024-04-01T06:54:30.358345+0000","last_undegraded":"2024-04-01T06:54:30.358345+0000","last_fullsized":"2024-04-01T06:54:30.358345+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:07:34.963189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'15","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:32.711057+0000","last_change":"2024-04-01T06:54:27.990469+0000","last_active":"2024-04-01T06:54:32.711057+0000","last_peered":"2024-04-01T06:54:32.711057+0000","last_clean":"2024-04-01T06:54:32.711057+0000","last_became_active":"2024-04-01T06:54:27.990147+0000","last_became_peered":"2024-04-01T06:54:27.990147+0000","last_unstale":"2024-04-01T06:54:32.711057+0000","last_undegraded":"2024-04-01T06:54:32.711057+0000","last_fullsized":"2024-04-01T06:54:32.711057+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:27:29.415723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.214102+0000","last_change":"2024-04-01T06:54:28.422479+0000","last_active":"2024-04-01T06:54:30.214102+0000","last_peered":"2024-04-01T06:54:30.214102+0000","last_clean":"2024-04-01T06:54:30.214102+0000","last_became_active":"2024-04-01T06:54:28.422155+0000","last_became_peered":"2024-04-01T06:54:28.422155+0000","last_unstale":"2024-04-01T06:54:30.214102+0000","last_undegraded":"2024-04-01T06:54:30.214102+0000","last_fullsized":"2024-04-01T06:54:30.214102+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:44:19.545796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"79'2","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:33.711923+0000","last_change":"2024-04-01T06:54:27.995827+0000","last_active":"2024-04-01T06:54:33.711923+0000","last_peered":"2024-04-01T06:54:33.711923+0000","last_clean":"2024-04-01T06:54:33.711923+0000","last_became_active":"2024-04-01T06:54:27.995450+0000","last_became_peered":"2024-04-01T06:54:27.995450+0000","last_unstale":"2024-04-01T06:54:33.711923+0000","last_undegraded":"2024-04-01T06:54:33.711923+0000","last_fullsized":"2024-04-01T06:54:33.711923+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T14:14:03.935578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.479897+0000","last_change":"2024-04-01T06:54:28.425376+0000","last_active":"2024-04-01T06:54:30.479897+0000","last_peered":"2024-04-01T06:54:30.479897+0000","last_clean":"2024-04-01T06:54:30.479897+0000","last_became_active":"2024-04-01T06:54:28.421235+0000","last_became_peered":"2024-04-01T06:54:28.421235+0000","last_unstale":"2024-04-01T06:54:30.479897+0000","last_undegraded":"2024-04-01T06:54:30.479897+0000","last_fullsized":"2024-04-01T06:54:30.479897+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:19:05.244735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.357821+0000","last_change":"2024-04-01T06:54:27.991659+0000","last_active":"2024-04-01T06:54:30.357821+0000","last_peered":"2024-04-01T06:54:30.357821+0000","last_clean":"2024-04-01T06:54:30.357821+0000","last_became_active":"2024-04-01T06:54:27.991280+0000","last_became_peered":"2024-04-01T06:54:27.991280+0000","last_unstale":"2024-04-01T06:54:30.357821+0000","last_undegraded":"2024-04-01T06:54:30.357821+0000","last_fullsized":"2024-04-01T06:54:30.357821+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:29:38.560570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"79'1","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.291309+0000","last_change":"2024-04-01T06:54:28.417654+0000","last_active":"2024-04-01T06:54:30.291309+0000","last_peered":"2024-04-01T06:54:30.291309+0000","last_clean":"2024-04-01T06:54:30.291309+0000","last_became_active":"2024-04-01T06:54:28.417318+0000","last_became_peered":"2024-04-01T06:54:28.417318+0000","last_unstale":"2024-04-01T06:54:30.291309+0000","last_undegraded":"2024-04-01T06:54:30.291309+0000","last_fullsized":"2024-04-01T06:54:30.291309+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:59:25.843730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"79'1","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:31.834046+0000","last_change":"2024-04-01T06:54:27.998825+0000","last_active":"2024-04-01T06:54:31.834046+0000","last_peered":"2024-04-01T06:54:31.834046+0000","last_clean":"2024-04-01T06:54:31.834046+0000","last_became_active":"2024-04-01T06:54:27.998488+0000","last_became_peered":"2024-04-01T06:54:27.998488+0000","last_unstale":"2024-04-01T06:54:31.834046+0000","last_undegraded":"2024-04-01T06:54:31.834046+0000","last_fullsized":"2024-04-01T06:54:31.834046+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:22:24.878723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-01T06:54:28.690226+0000","last_change":"2024-04-01T06:54:28.421053+0000","last_active":"2024-04-01T06:54:28.690226+0000","last_peered":"2024-04-01T06:54:28.690226+0000","last_clean":"2024-04-01T06:54:28.690226+0000","last_became_active":"2024-04-01T06:54:28.420718+0000","last_became_peered":"2024-04-01T06:54:28.420718+0000","last_unstale":"2024-04-01T06:54:28.690226+0000","last_undegraded":"2024-04-01T06:54:28.690226+0000","last_fullsized":"2024-04-01T06:54:28.690226+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:58:10.109158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.214303+0000","last_change":"2024-04-01T06:54:28.419126+0000","last_active":"2024-04-01T06:54:30.214303+0000","last_peered":"2024-04-01T06:54:30.214303+0000","last_clean":"2024-04-01T06:54:30.214303+0000","last_became_active":"2024-04-01T06:54:28.418217+0000","last_became_peered":"2024-04-01T06:54:28.418217+0000","last_unstale":"2024-04-01T06:54:30.214303+0000","last_undegraded":"2024-04-01T06:54:30.214303+0000","last_fullsized":"2024-04-01T06:54:30.214303+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T14:02:41.148200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"79'4","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:55:02.756806+0000","last_change":"2024-04-01T06:54:27.993059+0000","last_active":"2024-04-01T06:55:02.756806+0000","last_peered":"2024-04-01T06:55:02.756806+0000","last_clean":"2024-04-01T06:55:02.756806+0000","last_became_active":"2024-04-01T06:54:27.992471+0000","last_became_peered":"2024-04-01T06:54:27.992471+0000","last_unstale":"2024-04-01T06:55:02.756806+0000","last_undegraded":"2024-04-01T06:55:02.756806+0000","last_fullsized":"2024-04-01T06:55:02.756806+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:27:38.691261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.515528+0000","last_change":"2024-04-01T06:54:28.411805+0000","last_active":"2024-04-01T06:54:29.515528+0000","last_peered":"2024-04-01T06:54:29.515528+0000","last_clean":"2024-04-01T06:54:29.515528+0000","last_became_active":"2024-04-01T06:54:28.411526+0000","last_became_peered":"2024-04-01T06:54:28.411526+0000","last_unstale":"2024-04-01T06:54:29.515528+0000","last_undegraded":"2024-04-01T06:54:29.515528+0000","last_fullsized":"2024-04-01T06:54:29.515528+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:59:08.223590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"79'3","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:33.710576+0000","last_change":"2024-04-01T06:54:27.988695+0000","last_active":"2024-04-01T06:54:33.710576+0000","last_peered":"2024-04-01T06:54:33.710576+0000","last_clean":"2024-04-01T06:54:33.710576+0000","last_became_active":"2024-04-01T06:54:27.988069+0000","last_became_peered":"2024-04-01T06:54:27.988069+0000","last_unstale":"2024-04-01T06:54:33.710576+0000","last_undegraded":"2024-04-01T06:54:33.710576+0000","last_fullsized":"2024-04-01T06:54:33.710576+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:27:11.287962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":330,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358445+0000","last_change":"2024-04-01T06:53:41.678430+0000","last_active":"2024-04-01T06:54:30.358445+0000","last_peered":"2024-04-01T06:54:30.358445+0000","last_clean":"2024-04-01T06:54:30.358445+0000","last_became_active":"2024-04-01T06:53:41.677964+0000","last_became_peered":"2024-04-01T06:53:41.677964+0000","last_unstale":"2024-04-01T06:54:30.358445+0000","last_undegraded":"2024-04-01T06:54:30.358445+0000","last_fullsized":"2024-04-01T06:54:30.358445+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:51:21.964420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:51:21.964420+0000","last_clean_scrub_stamp":"2024-04-01T06:51:21.964420+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:24:29.916692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.411404+0000","last_change":"2024-04-01T06:54:28.423775+0000","last_active":"2024-04-01T06:54:29.411404+0000","last_peered":"2024-04-01T06:54:29.411404+0000","last_clean":"2024-04-01T06:54:29.411404+0000","last_became_active":"2024-04-01T06:54:28.423462+0000","last_became_peered":"2024-04-01T06:54:28.423462+0000","last_unstale":"2024-04-01T06:54:29.411404+0000","last_undegraded":"2024-04-01T06:54:29.411404+0000","last_fullsized":"2024-04-01T06:54:29.411404+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:09:38.043033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"79'3","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:32.707578+0000","last_change":"2024-04-01T06:54:27.997801+0000","last_active":"2024-04-01T06:54:32.707578+0000","last_peered":"2024-04-01T06:54:32.707578+0000","last_clean":"2024-04-01T06:54:32.707578+0000","last_became_active":"2024-04-01T06:54:27.997305+0000","last_became_peered":"2024-04-01T06:54:27.997305+0000","last_unstale":"2024-04-01T06:54:32.707578+0000","last_undegraded":"2024-04-01T06:54:32.707578+0000","last_fullsized":"2024-04-01T06:54:32.707578+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:46:09.224535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"79'1","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:31.698306+0000","last_change":"2024-04-01T06:54:27.994483+0000","last_active":"2024-04-01T06:54:31.698306+0000","last_peered":"2024-04-01T06:54:31.698306+0000","last_clean":"2024-04-01T06:54:31.698306+0000","last_became_active":"2024-04-01T06:54:27.994093+0000","last_became_peered":"2024-04-01T06:54:27.994093+0000","last_unstale":"2024-04-01T06:54:31.698306+0000","last_undegraded":"2024-04-01T06:54:31.698306+0000","last_fullsized":"2024-04-01T06:54:31.698306+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:27:48.272196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.411547+0000","last_change":"2024-04-01T06:54:28.423895+0000","last_active":"2024-04-01T06:54:29.411547+0000","last_peered":"2024-04-01T06:54:29.411547+0000","last_clean":"2024-04-01T06:54:29.411547+0000","last_became_active":"2024-04-01T06:54:28.423593+0000","last_became_peered":"2024-04-01T06:54:28.423593+0000","last_unstale":"2024-04-01T06:54:29.411547+0000","last_undegraded":"2024-04-01T06:54:29.411547+0000","last_fullsized":"2024-04-01T06:54:29.411547+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:09:30.414080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"79'5","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:37.294249+0000","last_change":"2024-04-01T06:54:27.987207+0000","last_active":"2024-04-01T06:54:37.294249+0000","last_peered":"2024-04-01T06:54:37.294249+0000","last_clean":"2024-04-01T06:54:37.294249+0000","last_became_active":"2024-04-01T06:54:27.986537+0000","last_became_peered":"2024-04-01T06:54:27.986537+0000","last_unstale":"2024-04-01T06:54:37.294249+0000","last_undegraded":"2024-04-01T06:54:37.294249+0000","last_fullsized":"2024-04-01T06:54:37.294249+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:26:41.096843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.515518+0000","last_change":"2024-04-01T06:54:28.416591+0000","last_active":"2024-04-01T06:54:29.515518+0000","last_peered":"2024-04-01T06:54:29.515518+0000","last_clean":"2024-04-01T06:54:29.515518+0000","last_became_active":"2024-04-01T06:54:28.416295+0000","last_became_peered":"2024-04-01T06:54:28.416295+0000","last_unstale":"2024-04-01T06:54:29.515518+0000","last_undegraded":"2024-04-01T06:54:29.515518+0000","last_fullsized":"2024-04-01T06:54:29.515518+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:17:24.670572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'4","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:31.697072+0000","last_change":"2024-04-01T06:54:27.996075+0000","last_active":"2024-04-01T06:54:31.697072+0000","last_peered":"2024-04-01T06:54:31.697072+0000","last_clean":"2024-04-01T06:54:31.697072+0000","last_became_active":"2024-04-01T06:54:27.995664+0000","last_became_peered":"2024-04-01T06:54:27.995664+0000","last_unstale":"2024-04-01T06:54:31.697072+0000","last_undegraded":"2024-04-01T06:54:31.697072+0000","last_fullsized":"2024-04-01T06:54:31.697072+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:17:33.214644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358295+0000","last_change":"2024-04-01T06:54:28.422041+0000","last_active":"2024-04-01T06:54:30.358295+0000","last_peered":"2024-04-01T06:54:30.358295+0000","last_clean":"2024-04-01T06:54:30.358295+0000","last_became_active":"2024-04-01T06:54:28.421743+0000","last_became_peered":"2024-04-01T06:54:28.421743+0000","last_unstale":"2024-04-01T06:54:30.358295+0000","last_undegraded":"2024-04-01T06:54:30.358295+0000","last_fullsized":"2024-04-01T06:54:30.358295+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:23:14.405879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:31.701969+0000","last_change":"2024-04-01T06:54:27.991734+0000","last_active":"2024-04-01T06:54:31.701969+0000","last_peered":"2024-04-01T06:54:31.701969+0000","last_clean":"2024-04-01T06:54:31.701969+0000","last_became_active":"2024-04-01T06:54:27.991139+0000","last_became_peered":"2024-04-01T06:54:27.991139+0000","last_unstale":"2024-04-01T06:54:31.701969+0000","last_undegraded":"2024-04-01T06:54:31.701969+0000","last_fullsized":"2024-04-01T06:54:31.701969+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:08:49.188179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.412717+0000","last_change":"2024-04-01T06:54:28.428467+0000","last_active":"2024-04-01T06:54:29.412717+0000","last_peered":"2024-04-01T06:54:29.412717+0000","last_clean":"2024-04-01T06:54:29.412717+0000","last_became_active":"2024-04-01T06:54:28.428095+0000","last_became_peered":"2024-04-01T06:54:28.428095+0000","last_unstale":"2024-04-01T06:54:29.412717+0000","last_undegraded":"2024-04-01T06:54:29.412717+0000","last_fullsized":"2024-04-01T06:54:29.412717+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:21:04.500427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'3","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:31.699951+0000","last_change":"2024-04-01T06:54:27.990321+0000","last_active":"2024-04-01T06:54:31.699951+0000","last_peered":"2024-04-01T06:54:31.699951+0000","last_clean":"2024-04-01T06:54:31.699951+0000","last_became_active":"2024-04-01T06:54:27.989997+0000","last_became_peered":"2024-04-01T06:54:27.989997+0000","last_unstale":"2024-04-01T06:54:31.699951+0000","last_undegraded":"2024-04-01T06:54:31.699951+0000","last_fullsized":"2024-04-01T06:54:31.699951+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:14:04.059812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.479669+0000","last_change":"2024-04-01T06:54:28.416480+0000","last_active":"2024-04-01T06:54:30.479669+0000","last_peered":"2024-04-01T06:54:30.479669+0000","last_clean":"2024-04-01T06:54:30.479669+0000","last_became_active":"2024-04-01T06:54:28.416009+0000","last_became_peered":"2024-04-01T06:54:28.416009+0000","last_unstale":"2024-04-01T06:54:30.479669+0000","last_undegraded":"2024-04-01T06:54:30.479669+0000","last_fullsized":"2024-04-01T06:54:30.479669+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:32:09.759447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"79'1","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:31.760608+0000","last_change":"2024-04-01T06:54:27.996538+0000","last_active":"2024-04-01T06:54:31.760608+0000","last_peered":"2024-04-01T06:54:31.760608+0000","last_clean":"2024-04-01T06:54:31.760608+0000","last_became_active":"2024-04-01T06:54:27.996177+0000","last_became_peered":"2024-04-01T06:54:27.996177+0000","last_unstale":"2024-04-01T06:54:31.760608+0000","last_undegraded":"2024-04-01T06:54:31.760608+0000","last_fullsized":"2024-04-01T06:54:31.760608+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:39:45.386450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.515616+0000","last_change":"2024-04-01T06:54:28.419403+0000","last_active":"2024-04-01T06:54:29.515616+0000","last_peered":"2024-04-01T06:54:29.515616+0000","last_clean":"2024-04-01T06:54:29.515616+0000","last_became_active":"2024-04-01T06:54:28.419127+0000","last_became_peered":"2024-04-01T06:54:28.419127+0000","last_unstale":"2024-04-01T06:54:29.515616+0000","last_undegraded":"2024-04-01T06:54:29.515616+0000","last_fullsized":"2024-04-01T06:54:29.515616+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:52:13.510448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:31.698144+0000","last_change":"2024-04-01T06:54:27.992775+0000","last_active":"2024-04-01T06:54:31.698144+0000","last_peered":"2024-04-01T06:54:31.698144+0000","last_clean":"2024-04-01T06:54:31.698144+0000","last_became_active":"2024-04-01T06:54:27.992356+0000","last_became_peered":"2024-04-01T06:54:27.992356+0000","last_unstale":"2024-04-01T06:54:31.698144+0000","last_undegraded":"2024-04-01T06:54:31.698144+0000","last_fullsized":"2024-04-01T06:54:31.698144+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T14:46:37.302172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358992+0000","last_change":"2024-04-01T06:54:28.430132+0000","last_active":"2024-04-01T06:54:30.358992+0000","last_peered":"2024-04-01T06:54:30.358992+0000","last_clean":"2024-04-01T06:54:30.358992+0000","last_became_active":"2024-04-01T06:54:28.429816+0000","last_became_peered":"2024-04-01T06:54:28.429816+0000","last_unstale":"2024-04-01T06:54:30.358992+0000","last_undegraded":"2024-04-01T06:54:30.358992+0000","last_fullsized":"2024-04-01T06:54:30.358992+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T14:49:58.661275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"79'3","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:32.710043+0000","last_change":"2024-04-01T06:54:27.999460+0000","last_active":"2024-04-01T06:54:32.710043+0000","last_peered":"2024-04-01T06:54:32.710043+0000","last_clean":"2024-04-01T06:54:32.710043+0000","last_became_active":"2024-04-01T06:54:27.999128+0000","last_became_peered":"2024-04-01T06:54:27.999128+0000","last_unstale":"2024-04-01T06:54:32.710043+0000","last_undegraded":"2024-04-01T06:54:32.710043+0000","last_fullsized":"2024-04-01T06:54:32.710043+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:19:24.285698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358852+0000","last_change":"2024-04-01T06:54:28.427720+0000","last_active":"2024-04-01T06:54:30.358852+0000","last_peered":"2024-04-01T06:54:30.358852+0000","last_clean":"2024-04-01T06:54:30.358852+0000","last_became_active":"2024-04-01T06:54:28.427357+0000","last_became_peered":"2024-04-01T06:54:28.427357+0000","last_unstale":"2024-04-01T06:54:30.358852+0000","last_undegraded":"2024-04-01T06:54:30.358852+0000","last_fullsized":"2024-04-01T06:54:30.358852+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:20:56.631811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.214238+0000","last_change":"2024-04-01T06:54:27.997806+0000","last_active":"2024-04-01T06:54:30.214238+0000","last_peered":"2024-04-01T06:54:30.214238+0000","last_clean":"2024-04-01T06:54:30.214238+0000","last_became_active":"2024-04-01T06:54:27.997490+0000","last_became_peered":"2024-04-01T06:54:27.997490+0000","last_unstale":"2024-04-01T06:54:30.214238+0000","last_undegraded":"2024-04-01T06:54:30.214238+0000","last_fullsized":"2024-04-01T06:54:30.214238+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:06:15.099390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"79'1","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:31.834090+0000","last_change":"2024-04-01T06:54:28.419639+0000","last_active":"2024-04-01T06:54:31.834090+0000","last_peered":"2024-04-01T06:54:31.834090+0000","last_clean":"2024-04-01T06:54:31.834090+0000","last_became_active":"2024-04-01T06:54:28.418081+0000","last_became_peered":"2024-04-01T06:54:28.418081+0000","last_unstale":"2024-04-01T06:54:31.834090+0000","last_undegraded":"2024-04-01T06:54:31.834090+0000","last_fullsized":"2024-04-01T06:54:31.834090+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:15:44.753121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.411587+0000","last_change":"2024-04-01T06:54:27.995854+0000","last_active":"2024-04-01T06:54:29.411587+0000","last_peered":"2024-04-01T06:54:29.411587+0000","last_clean":"2024-04-01T06:54:29.411587+0000","last_became_active":"2024-04-01T06:54:27.995540+0000","last_became_peered":"2024-04-01T06:54:27.995540+0000","last_unstale":"2024-04-01T06:54:29.411587+0000","last_undegraded":"2024-04-01T06:54:29.411587+0000","last_fullsized":"2024-04-01T06:54:29.411587+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:47:15.075909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358991+0000","last_change":"2024-04-01T06:54:28.428100+0000","last_active":"2024-04-01T06:54:30.358991+0000","last_peered":"2024-04-01T06:54:30.358991+0000","last_clean":"2024-04-01T06:54:30.358991+0000","last_became_active":"2024-04-01T06:54:28.427769+0000","last_became_peered":"2024-04-01T06:54:28.427769+0000","last_unstale":"2024-04-01T06:54:30.358991+0000","last_undegraded":"2024-04-01T06:54:30.358991+0000","last_fullsized":"2024-04-01T06:54:30.358991+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:47:18.161878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.479810+0000","last_change":"2024-04-01T06:54:28.427557+0000","last_active":"2024-04-01T06:54:30.479810+0000","last_peered":"2024-04-01T06:54:30.479810+0000","last_clean":"2024-04-01T06:54:30.479810+0000","last_became_active":"2024-04-01T06:54:28.427209+0000","last_became_peered":"2024-04-01T06:54:28.427209+0000","last_unstale":"2024-04-01T06:54:30.479810+0000","last_undegraded":"2024-04-01T06:54:30.479810+0000","last_fullsized":"2024-04-01T06:54:30.479810+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:10:06.835360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358390+0000","last_change":"2024-04-01T06:54:28.423264+0000","last_active":"2024-04-01T06:54:30.358390+0000","last_peered":"2024-04-01T06:54:30.358390+0000","last_clean":"2024-04-01T06:54:30.358390+0000","last_became_active":"2024-04-01T06:54:28.422868+0000","last_became_peered":"2024-04-01T06:54:28.422868+0000","last_unstale":"2024-04-01T06:54:30.358390+0000","last_undegraded":"2024-04-01T06:54:30.358390+0000","last_fullsized":"2024-04-01T06:54:30.358390+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:00:49.784276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358186+0000","last_change":"2024-04-01T06:54:28.417824+0000","last_active":"2024-04-01T06:54:30.358186+0000","last_peered":"2024-04-01T06:54:30.358186+0000","last_clean":"2024-04-01T06:54:30.358186+0000","last_became_active":"2024-04-01T06:54:28.417510+0000","last_became_peered":"2024-04-01T06:54:28.417510+0000","last_unstale":"2024-04-01T06:54:30.358186+0000","last_undegraded":"2024-04-01T06:54:30.358186+0000","last_fullsized":"2024-04-01T06:54:30.358186+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:40:52.024183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358330+0000","last_change":"2024-04-01T06:54:28.426099+0000","last_active":"2024-04-01T06:54:30.358330+0000","last_peered":"2024-04-01T06:54:30.358330+0000","last_clean":"2024-04-01T06:54:30.358330+0000","last_became_active":"2024-04-01T06:54:28.425745+0000","last_became_peered":"2024-04-01T06:54:28.425745+0000","last_unstale":"2024-04-01T06:54:30.358330+0000","last_undegraded":"2024-04-01T06:54:30.358330+0000","last_fullsized":"2024-04-01T06:54:30.358330+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:13:45.145447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.411652+0000","last_change":"2024-04-01T06:54:28.421892+0000","last_active":"2024-04-01T06:54:29.411652+0000","last_peered":"2024-04-01T06:54:29.411652+0000","last_clean":"2024-04-01T06:54:29.411652+0000","last_became_active":"2024-04-01T06:54:28.421582+0000","last_became_peered":"2024-04-01T06:54:28.421582+0000","last_unstale":"2024-04-01T06:54:29.411652+0000","last_undegraded":"2024-04-01T06:54:29.411652+0000","last_fullsized":"2024-04-01T06:54:29.411652+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:44:12.137335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.479910+0000","last_change":"2024-04-01T06:54:28.421013+0000","last_active":"2024-04-01T06:54:30.479910+0000","last_peered":"2024-04-01T06:54:30.479910+0000","last_clean":"2024-04-01T06:54:30.479910+0000","last_became_active":"2024-04-01T06:54:28.420339+0000","last_became_peered":"2024-04-01T06:54:28.420339+0000","last_unstale":"2024-04-01T06:54:30.479910+0000","last_undegraded":"2024-04-01T06:54:30.479910+0000","last_fullsized":"2024-04-01T06:54:30.479910+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:59:07.758542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358708+0000","last_change":"2024-04-01T06:54:28.433203+0000","last_active":"2024-04-01T06:54:30.358708+0000","last_peered":"2024-04-01T06:54:30.358708+0000","last_clean":"2024-04-01T06:54:30.358708+0000","last_became_active":"2024-04-01T06:54:28.431890+0000","last_became_peered":"2024-04-01T06:54:28.431890+0000","last_unstale":"2024-04-01T06:54:30.358708+0000","last_undegraded":"2024-04-01T06:54:30.358708+0000","last_fullsized":"2024-04-01T06:54:30.358708+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:55:33.169722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.515418+0000","last_change":"2024-04-01T06:54:28.418425+0000","last_active":"2024-04-01T06:54:29.515418+0000","last_peered":"2024-04-01T06:54:29.515418+0000","last_clean":"2024-04-01T06:54:29.515418+0000","last_became_active":"2024-04-01T06:54:28.418165+0000","last_became_peered":"2024-04-01T06:54:28.418165+0000","last_unstale":"2024-04-01T06:54:29.515418+0000","last_undegraded":"2024-04-01T06:54:29.515418+0000","last_fullsized":"2024-04-01T06:54:29.515418+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:45:01.425680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.213976+0000","last_change":"2024-04-01T06:54:28.412058+0000","last_active":"2024-04-01T06:54:30.213976+0000","last_peered":"2024-04-01T06:54:30.213976+0000","last_clean":"2024-04-01T06:54:30.213976+0000","last_became_active":"2024-04-01T06:54:28.411680+0000","last_became_peered":"2024-04-01T06:54:28.411680+0000","last_unstale":"2024-04-01T06:54:30.213976+0000","last_undegraded":"2024-04-01T06:54:30.213976+0000","last_fullsized":"2024-04-01T06:54:30.213976+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:21:05.628262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.515699+0000","last_change":"2024-04-01T06:54:28.422304+0000","last_active":"2024-04-01T06:54:29.515699+0000","last_peered":"2024-04-01T06:54:29.515699+0000","last_clean":"2024-04-01T06:54:29.515699+0000","last_became_active":"2024-04-01T06:54:28.422023+0000","last_became_peered":"2024-04-01T06:54:28.422023+0000","last_unstale":"2024-04-01T06:54:29.515699+0000","last_undegraded":"2024-04-01T06:54:29.515699+0000","last_fullsized":"2024-04-01T06:54:29.515699+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:26:45.810780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.413317+0000","last_change":"2024-04-01T06:54:28.420350+0000","last_active":"2024-04-01T06:54:29.413317+0000","last_peered":"2024-04-01T06:54:29.413317+0000","last_clean":"2024-04-01T06:54:29.413317+0000","last_became_active":"2024-04-01T06:54:28.419995+0000","last_became_peered":"2024-04-01T06:54:28.419995+0000","last_unstale":"2024-04-01T06:54:29.413317+0000","last_undegraded":"2024-04-01T06:54:29.413317+0000","last_fullsized":"2024-04-01T06:54:29.413317+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:30:20.831966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.411779+0000","last_change":"2024-04-01T06:54:28.417067+0000","last_active":"2024-04-01T06:54:29.411779+0000","last_peered":"2024-04-01T06:54:29.411779+0000","last_clean":"2024-04-01T06:54:29.411779+0000","last_became_active":"2024-04-01T06:54:28.416796+0000","last_became_peered":"2024-04-01T06:54:28.416796+0000","last_unstale":"2024-04-01T06:54:29.411779+0000","last_undegraded":"2024-04-01T06:54:29.411779+0000","last_fullsized":"2024-04-01T06:54:29.411779+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:39:43.396643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.479743+0000","last_change":"2024-04-01T06:54:28.424971+0000","last_active":"2024-04-01T06:54:30.479743+0000","last_peered":"2024-04-01T06:54:30.479743+0000","last_clean":"2024-04-01T06:54:30.479743+0000","last_became_active":"2024-04-01T06:54:28.424664+0000","last_became_peered":"2024-04-01T06:54:28.424664+0000","last_unstale":"2024-04-01T06:54:30.479743+0000","last_undegraded":"2024-04-01T06:54:30.479743+0000","last_fullsized":"2024-04-01T06:54:30.479743+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:03:51.434412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":246668,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65300,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":212,"num_read_kb":174,"num_write":151,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":195900,"data_compressed":5598,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579921,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":851968,"data_stored":408952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:54:55 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.59599999999999997}]},{"osd":1,"last update":"Mon Apr 1 06:54:55 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.628},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.58599999999999997}]},{"osd":2,"last update":"Mon Apr 1 06:54:55 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.54700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":4,"last update":"Mon Apr 1 06:54:55 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":3.1970000000000001,"5min":3.1970000000000001,"15min":3.1970000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.748}]},{"osd":5,"last update":"Mon Apr 1 06:54:55 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.437},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.47999999999999998}]},{"osd":6,"last update":"Mon Apr 1 06:54:55 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.56299999999999994}]},{"osd":7,"last update":"Mon Apr 1 06:54:55 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":3.3479999999999999,"5min":3.3479999999999999,"15min":3.3479999999999999},"last":0.71799999999999997}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":9,"last update":"Mon Apr 1 06:54:55 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1,"5min":1,"15min":1},"last":0.67000000000000004}]},{"osd":10,"last update":"Mon Apr 1 06:54:55 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.76100000000000001}]}]},{"osd":10,"up_from":67,"seq":287762808852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":999424,"data_stored":1061778,"data_compressed":37572,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":1,"last update":"Mon Apr 1 06:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.433},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.47499999999999998}]},{"osd":2,"last update":"Mon Apr 1 06:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.57499999999999996}]},{"osd":3,"last update":"Mon Apr 1 06:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.50900000000000001}]},{"osd":4,"last update":"Mon Apr 1 06:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.56200000000000006}]},{"osd":5,"last update":"Mon Apr 1 06:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.622}]},{"osd":6,"last update":"Mon Apr 1 06:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.68600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":8,"last update":"Mon Apr 1 06:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.73699999999999999}]},{"osd":9,"last update":"Mon Apr 1 06:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.67900000000000005}]},{"osd":11,"last update":"Mon Apr 1 06:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.76100000000000001}]}]},{"osd":9,"up_from":62,"seq":266287972377,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31960,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713192,"statfs":{"total":95995035648,"available":95962308608,"internally_reserved":0,"allocated":868352,"data_stored":409188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:54:22 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.32100000000000001}]},{"osd":1,"last update":"Mon Apr 1 06:54:22 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.46899999999999997}]},{"osd":2,"last update":"Mon Apr 1 06:54:22 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.41299999999999998}]},{"osd":3,"last update":"Mon Apr 1 06:54:22 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.49099999999999999}]},{"osd":4,"last update":"Mon Apr 1 06:54:22 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.502},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.48299999999999998}]},{"osd":5,"last update":"Mon Apr 1 06:54:22 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.435},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":0.53000000000000003}]},{"osd":6,"last update":"Mon Apr 1 06:54:22 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.53700000000000003}]},{"osd":7,"last update":"Mon Apr 1 06:54:22 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.54900000000000004}]},{"osd":8,"last update":"Mon Apr 1 06:54:22 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":5.6600000000000001,"5min":5.6600000000000001,"15min":5.6600000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":5.6070000000000002,"5min":5.6070000000000002,"15min":5.6070000000000002},"last":0.59199999999999997}]},{"osd":10,"last update":"Mon Apr 1 06:54:39 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.55600000000000005}]}]},{"osd":8,"up_from":55,"seq":236223201308,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31956,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713196,"statfs":{"total":95995035648,"available":95962312704,"internally_reserved":0,"allocated":864256,"data_stored":408777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:54:05 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.59999999999999998}]},{"osd":1,"last update":"Mon Apr 1 06:54:05 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.68400000000000005}]},{"osd":2,"last update":"Mon Apr 1 06:54:05 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.64100000000000001}]},{"osd":3,"last update":"Mon Apr 1 06:54:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.77500000000000002}]},{"osd":4,"last update":"Mon Apr 1 06:54:05 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.70199999999999996}]},{"osd":5,"last update":"Mon Apr 1 06:54:05 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.80900000000000005}]},{"osd":6,"last update":"Mon Apr 1 06:54:05 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.75600000000000001}]},{"osd":7,"last update":"Mon Apr 1 06:54:05 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.91800000000000004}]},{"osd":9,"last update":"Mon Apr 1 06:54:24 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.95699999999999996}]},{"osd":10,"last update":"Mon Apr 1 06:54:43 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.97599999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]}]},{"osd":7,"up_from":48,"seq":206158430238,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32008,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713144,"statfs":{"total":95995035648,"available":95962259456,"internally_reserved":0,"allocated":917504,"data_stored":1001337,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:53:48 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.41099999999999998}]},{"osd":1,"last update":"Mon Apr 1 06:54:51 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.39400000000000002,"15min":0.38800000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.42399999999999999,"15min":0.41599999999999998},"min":{"1min":0.32700000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.59199999999999997}]},{"osd":2,"last update":"Mon Apr 1 06:54:51 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.56499999999999995,"15min":0.56100000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.56200000000000006,"15min":0.55400000000000005},"min":{"1min":0.42799999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.80200000000000005,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.79500000000000004}]},{"osd":3,"last update":"Mon Apr 1 06:54:51 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.56599999999999995,"15min":0.56000000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.74299999999999999,"5min":0.755,"15min":0.755},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.58799999999999997,"15min":0.58399999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.80300000000000005,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.76200000000000001}]},{"osd":4,"last update":"Mon Apr 1 06:54:51 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.51000000000000001,"15min":0.505},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.51000000000000001,"15min":0.50700000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.73999999999999999}]},{"osd":5,"last update":"Mon Apr 1 06:54:51 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.60599999999999998,"15min":0.59599999999999997},"min":{"1min":0.46700000000000003,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.63600000000000001,"15min":0.63},"min":{"1min":0.501,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.86799999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.83499999999999996}]},{"osd":6,"last update":"Mon Apr 1 06:54:51 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.47599999999999998,"5min":0.443,"15min":0.443},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.439,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.81200000000000006}]},{"osd":8,"last update":"Mon Apr 1 06:55:05 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.68600000000000005,"15min":0.68000000000000005},"min":{"1min":0.56699999999999995,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.52000000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.91300000000000003,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.89700000000000002}]},{"osd":9,"last update":"Mon Apr 1 06:54:24 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.874}]},{"osd":10,"last update":"Mon Apr 1 06:54:44 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.94699999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]}]},{"osd":6,"up_from":43,"seq":184683593762,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":856064,"data_stored":408577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:54:35 2024","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.34000000000000002,"15min":0.33100000000000002},"min":{"1min":0.247,"5min":0.246,"15min":0.246},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.36699999999999999,"15min":0.36099999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.33800000000000002}]},{"osd":1,"last update":"Mon Apr 1 06:54:35 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.501,"15min":0.48299999999999998},"min":{"1min":0.36099999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.51200000000000001,"15min":0.504},"min":{"1min":0.42399999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.68500000000000005,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.49399999999999999}]},{"osd":2,"last update":"Mon Apr 1 06:54:35 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.52400000000000002,"15min":0.51400000000000001},"min":{"1min":0.38600000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76800000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.439},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56999999999999995,"15min":0.56599999999999995},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.88100000000000001,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.625}]},{"osd":3,"last update":"Mon Apr 1 06:54:35 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.42699999999999999,"15min":0.42199999999999999},"min":{"1min":0.30499999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.77400000000000002,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.504,"5min":0.44800000000000001,"15min":0.439},"min":{"1min":0.32700000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.46700000000000003}]},{"osd":4,"last update":"Mon Apr 1 06:54:35 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.52600000000000002,"15min":0.51400000000000001},"min":{"1min":0.39100000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.55900000000000005,"15min":0.54300000000000004},"min":{"1min":0.47999999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.64200000000000002}]},{"osd":5,"last update":"Mon Apr 1 06:54:35 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.61299999999999999,"15min":0.60299999999999998},"min":{"1min":0.45300000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.61799999999999999,"15min":0.61099999999999999},"min":{"1min":0.42099999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.88500000000000001,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.47799999999999998}]},{"osd":7,"last update":"Mon Apr 1 06:54:49 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.621,"15min":0.625},"min":{"1min":0.437,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.83699999999999997,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.65200000000000002,"15min":0.65000000000000002},"min":{"1min":0.52400000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.82399999999999995,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.55300000000000005}]},{"osd":8,"last update":"Mon Apr 1 06:54:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.59899999999999998}]},{"osd":9,"last update":"Mon Apr 1 06:54:26 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.52100000000000002}]},{"osd":10,"last update":"Mon Apr 1 06:54:40 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.63300000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574900,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32004,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713148,"statfs":{"total":95995035648,"available":95962263552,"internally_reserved":0,"allocated":913408,"data_stored":469370,"data_compressed":1866,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:54:16 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.48499999999999999,"15min":0.46600000000000003},"min":{"1min":0.32800000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.501,"15min":0.48099999999999998},"min":{"1min":0.35499999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.60899999999999999}]},{"osd":2,"last update":"Mon Apr 1 06:54:28 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.55300000000000005,"15min":0.53800000000000003},"min":{"1min":0.42899999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.53600000000000003,"15min":0.52200000000000002},"min":{"1min":0.38800000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.46100000000000002}]},{"osd":3,"last update":"Mon Apr 1 06:54:43 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.55400000000000005,"15min":0.53500000000000003},"min":{"1min":0.39700000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.58199999999999996,"15min":0.55000000000000004},"min":{"1min":0.48499999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.65800000000000003}]},{"osd":4,"last update":"Mon Apr 1 06:55:03 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.443,"15min":0.41199999999999998},"min":{"1min":0.379,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.46200000000000002,"15min":0.42099999999999999},"min":{"1min":0.35599999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.67200000000000004}]},{"osd":5,"last update":"Mon Apr 1 06:54:16 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.58899999999999997,"15min":0.58499999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.56799999999999995,"15min":0.56000000000000005},"min":{"1min":0.44600000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.34300000000000003}]},{"osd":6,"last update":"Mon Apr 1 06:54:33 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.56999999999999995,"15min":0.55100000000000005},"min":{"1min":0.47099999999999997,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.58499999999999996,"15min":0.56799999999999995},"min":{"1min":0.51500000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.49299999999999999}]},{"osd":7,"last update":"Mon Apr 1 06:54:48 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.59599999999999997,"15min":0.58299999999999996},"min":{"1min":0.436,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.63400000000000001,"15min":0.622},"min":{"1min":0.54800000000000004,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.90700000000000003,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.57899999999999996}]},{"osd":8,"last update":"Mon Apr 1 06:54:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.753}]},{"osd":9,"last update":"Mon Apr 1 06:54:25 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.71099999999999997}]},{"osd":10,"last update":"Mon Apr 1 06:54:43 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.626}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]}]},{"osd":0,"up_from":8,"seq":34359738424,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":876544,"data_stored":409848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Apr 1 06:54:08 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.47899999999999998,"15min":0.46500000000000002},"min":{"1min":0.29299999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69099999999999995,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.625},{"interface":"front","average":{"1min":0.495,"5min":0.47299999999999998,"15min":0.46999999999999997},"min":{"1min":0.32800000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.64800000000000002,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.53700000000000003}]},{"osd":2,"last update":"Mon Apr 1 06:54:28 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.47799999999999998,"15min":0.46400000000000002},"min":{"1min":0.317,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.66900000000000004,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.5,"5min":0.48599999999999999,"15min":0.47999999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.64200000000000002,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.434}]},{"osd":3,"last update":"Mon Apr 1 06:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.26200000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.59399999999999997,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.38900000000000001,"15min":0.379},"min":{"1min":0.29699999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.64200000000000002,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.27700000000000002}]},{"osd":4,"last update":"Mon Apr 1 06:55:03 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.50900000000000001,"15min":0.501},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.71099999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.502},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.52500000000000002,"15min":0.51300000000000001},"min":{"1min":0.40799999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.69499999999999995,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.58799999999999997}]},{"osd":5,"last update":"Mon Apr 1 06:54:15 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53300000000000003,"15min":0.52900000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52400000000000002,"15min":0.52500000000000002},"min":{"1min":0.38700000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.747,"5min":0.748,"15min":0.748},"last":0.47899999999999998}]},{"osd":6,"last update":"Mon Apr 1 06:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.44,"15min":0.436},"min":{"1min":0.33200000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.311},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.502,"15min":0.50600000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.36099999999999999}]},{"osd":7,"last update":"Mon Apr 1 06:53:50 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.46000000000000002}]},{"osd":8,"last update":"Mon Apr 1 06:54:08 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.52000000000000002}]},{"osd":9,"last update":"Mon Apr 1 06:54:21 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.40100000000000002}]},{"osd":10,"last update":"Mon Apr 1 06:54:43 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.61499999999999999}]},{"osd":11,"last update":"Mon Apr 1 06:55:03 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.55900000000000005}]}]},{"osd":2,"up_from":18,"seq":77309411377,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":937984,"data_stored":471065,"data_compressed":1866,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:54:27 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.48399999999999999,"15min":0.46700000000000003},"min":{"1min":0.33900000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.65600000000000003,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.46899999999999997,"15min":0.45700000000000002},"min":{"1min":0.35799999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.65600000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.38400000000000001}]},{"osd":1,"last update":"Mon Apr 1 06:54:27 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.52300000000000002,"15min":0.51300000000000001},"min":{"1min":0.42499999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.53900000000000003,"15min":0.53500000000000003},"min":{"1min":0.39800000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.435}]},{"osd":3,"last update":"Mon Apr 1 06:54:45 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.53500000000000003,"15min":0.52900000000000003},"min":{"1min":0.40899999999999997,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.71199999999999997,"5min":0.748,"15min":0.748},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56200000000000006,"15min":0.54600000000000004},"min":{"1min":0.434,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77500000000000002,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.57699999999999996}]},{"osd":4,"last update":"Mon Apr 1 06:53:59 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.54300000000000004,"15min":0.53700000000000003},"min":{"1min":0.42299999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.53400000000000003,"15min":0.52700000000000002},"min":{"1min":0.45900000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71699999999999997,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.51100000000000001}]},{"osd":5,"last update":"Mon Apr 1 06:54:15 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.45500000000000002,"15min":0.44900000000000001},"min":{"1min":0.317,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.74199999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.46300000000000002,"15min":0.45900000000000002},"min":{"1min":0.32600000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.68999999999999995,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.625}]},{"osd":6,"last update":"Mon Apr 1 06:54:33 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.42099999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.88,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63400000000000001,"15min":0.63},"min":{"1min":0.45700000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.72499999999999998}]},{"osd":7,"last update":"Mon Apr 1 06:53:49 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.60099999999999998}]},{"osd":8,"last update":"Mon Apr 1 06:55:06 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.67900000000000005,"15min":0.68200000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60599999999999998,"15min":0.60399999999999998},"min":{"1min":0.438,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.55800000000000005}]},{"osd":9,"last update":"Mon Apr 1 06:54:24 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.76400000000000001}]},{"osd":10,"last update":"Mon Apr 1 06:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.78000000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]}]},{"osd":3,"up_from":25,"seq":107374182444,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31960,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713192,"statfs":{"total":95995035648,"available":95962308608,"internally_reserved":0,"allocated":868352,"data_stored":408557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:54:41 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.33900000000000002,"15min":0.33000000000000002},"min":{"1min":0.29499999999999998,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.34599999999999997,"15min":0.33500000000000002},"min":{"1min":0.26400000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.57999999999999996,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.377}]},{"osd":1,"last update":"Mon Apr 1 06:54:41 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.52900000000000003,"15min":0.51600000000000001},"min":{"1min":0.38800000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.51400000000000001,"15min":0.499},"min":{"1min":0.39400000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76900000000000002,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.58799999999999997}]},{"osd":2,"last update":"Mon Apr 1 06:54:41 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.52400000000000002,"15min":0.51400000000000001},"min":{"1min":0.35599999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.68899999999999995,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.54000000000000004,"15min":0.53000000000000003},"min":{"1min":0.41799999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.85199999999999998,"5min":0.874,"15min":0.874},"last":0.46999999999999997}]},{"osd":4,"last update":"Mon Apr 1 06:55:02 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53900000000000003,"15min":0.52700000000000002},"min":{"1min":0.40200000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.745,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56699999999999995,"15min":0.55700000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80600000000000005,"5min":1.131,"15min":1.131},"last":0.57899999999999996}]},{"osd":5,"last update":"Mon Apr 1 06:54:16 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.51500000000000001,"15min":0.50900000000000001},"min":{"1min":0.40699999999999997,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.56000000000000005,"15min":0.55200000000000005},"min":{"1min":0.39800000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73199999999999998,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.52300000000000002}]},{"osd":6,"last update":"Mon Apr 1 06:54:35 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.435,"15min":0.42799999999999999},"min":{"1min":0.314,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.47399999999999998,"15min":0.46800000000000003},"min":{"1min":0.34599999999999997,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.44700000000000001}]},{"osd":7,"last update":"Mon Apr 1 06:54:56 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.42199999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.75700000000000001,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.621,"5min":0.63300000000000001,"15min":0.63500000000000001},"min":{"1min":0.41499999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.85799999999999998,"5min":1.171,"15min":1.171},"last":0.61199999999999999}]},{"osd":8,"last update":"Mon Apr 1 06:54:04 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.71999999999999997}]},{"osd":9,"last update":"Mon Apr 1 06:54:23 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.501}]},{"osd":10,"last update":"Mon Apr 1 06:54:40 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.59599999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]}]},{"osd":4,"up_from":32,"seq":137438953514,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":860160,"data_stored":409359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:54:02 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.496,"15min":0.48799999999999999},"min":{"1min":0.34899999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.433},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.48299999999999998,"15min":0.47699999999999998},"min":{"1min":0.30399999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.41799999999999998}]},{"osd":1,"last update":"Mon Apr 1 06:55:03 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.35199999999999998,"15min":0.33400000000000002},"min":{"1min":0.251,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.36499999999999999,"15min":0.35299999999999998},"min":{"1min":0.29099999999999998,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.42699999999999999}]},{"osd":2,"last update":"Mon Apr 1 06:55:03 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.51200000000000001,"15min":0.496},"min":{"1min":0.435,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.52100000000000002,"15min":0.48899999999999999},"min":{"1min":0.40699999999999997,"5min":0.316,"15min":0.316},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.55000000000000004}]},{"osd":3,"last update":"Mon Apr 1 06:55:03 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.53400000000000003,"15min":0.52900000000000003},"min":{"1min":0.36899999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.73499999999999999,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.51400000000000001,"15min":0.498},"min":{"1min":0.39200000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.44700000000000001}]},{"osd":5,"last update":"Mon Apr 1 06:54:15 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.55000000000000004,"15min":0.54500000000000004},"min":{"1min":0.40300000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.54000000000000004,"15min":0.54400000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.624,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.56799999999999995}]},{"osd":6,"last update":"Mon Apr 1 06:54:37 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.54400000000000004,"15min":0.54000000000000004},"min":{"1min":0.40500000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.498,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.01,"5min":2.52,"15min":2.52},"last":0.51200000000000001}]},{"osd":7,"last update":"Mon Apr 1 06:54:48 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.34200000000000003,"5min":0.316,"15min":0.316},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.624},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.51500000000000001,"15min":0.51200000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.5}]},{"osd":8,"last update":"Mon Apr 1 06:54:05 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.67200000000000004}]},{"osd":9,"last update":"Mon Apr 1 06:54:21 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.65200000000000002}]},{"osd":10,"last update":"Mon Apr 1 06:54:43 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.60399999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]}]},{"osd":5,"up_from":36,"seq":154618822694,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":929792,"data_stored":1000676,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:54:13 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.496,"15min":0.48299999999999998},"min":{"1min":0.41299999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.498,"15min":0.49299999999999999},"min":{"1min":0.39800000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.48399999999999999}]},{"osd":1,"last update":"Mon Apr 1 06:54:13 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.53000000000000003,"15min":0.52400000000000002},"min":{"1min":0.42599999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.69899999999999995,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53200000000000003,"15min":0.52700000000000002},"min":{"1min":0.40799999999999997,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.73199999999999998,"5min":0.753,"15min":0.753},"last":0.75900000000000001}]},{"osd":2,"last update":"Mon Apr 1 06:54:13 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.38600000000000001,"15min":0.38400000000000001},"min":{"1min":0.28899999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.505},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39900000000000002,"15min":0.40000000000000002},"min":{"1min":0.29399999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.52000000000000002}]},{"osd":3,"last update":"Mon Apr 1 06:54:13 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.39800000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.83899999999999997,"5min":1.389,"15min":1.389},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.65900000000000003,"15min":0.67500000000000004},"min":{"1min":0.38500000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.73799999999999999,"5min":3.9540000000000002,"15min":3.9540000000000002},"last":0.61199999999999999}]},{"osd":4,"last update":"Mon Apr 1 06:54:13 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.55200000000000005,"15min":0.54600000000000004},"min":{"1min":0.46400000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.70699999999999996,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.75700000000000001,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.79000000000000004}]},{"osd":6,"last update":"Mon Apr 1 06:54:33 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.55700000000000005,"15min":0.55300000000000005},"min":{"1min":0.39300000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.78400000000000003,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.57599999999999996,"15min":0.57299999999999995},"min":{"1min":0.46400000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76200000000000001,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.65500000000000003}]},{"osd":7,"last update":"Mon Apr 1 06:54:49 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64200000000000002,"15min":0.64000000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.86499999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.65600000000000003,"15min":0.65000000000000002},"min":{"1min":0.53000000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.77400000000000002}]},{"osd":8,"last update":"Mon Apr 1 06:54:04 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.67300000000000004}]},{"osd":9,"last update":"Mon Apr 1 06:54:22 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.82499999999999996}]},{"osd":10,"last update":"Mon Apr 1 06:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.86699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34069,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34069,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":61000,"data_compressed":1866,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":62695,"data_compressed":1866,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":62923,"data_compressed":1866,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T06:55:08.764 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph pg dump --format=json 2024-04-01T06:55:08.986 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:55:09.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:08 smithi145 ceph-mon[47816]: pgmap v236: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-01T06:55:09.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:08 smithi083 ceph-mon[43429]: pgmap v236: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-01T06:55:09.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:08 smithi153 ceph-mon[48187]: pgmap v236: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-01T06:55:09.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:09.928+0000 7f0a86d06700 1 -- 172.21.15.83:0/1656717764 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0a80104cf0 msgr2=0x7f0a801050d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:09.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:09.928+0000 7f0a86d06700 1 --2- 172.21.15.83:0/1656717764 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0a80104cf0 0x7f0a801050d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0a74009990 tx=0x7f0a74009ca0 comp rx=0 tx=0).stop 2024-04-01T06:55:09.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:09.928+0000 7f0a86d06700 1 -- 172.21.15.83:0/1656717764 shutdown_connections 2024-04-01T06:55:09.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:09.928+0000 7f0a86d06700 1 --2- 172.21.15.83:0/1656717764 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0a80104cf0 0x7f0a801050d0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:09.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:09.928+0000 7f0a86d06700 1 --2- 172.21.15.83:0/1656717764 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a80100950 0x7f0a8010cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:09.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:09.928+0000 7f0a86d06700 1 --2- 172.21.15.83:0/1656717764 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0a800fff90 0x7f0a80100410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:09.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:09.928+0000 7f0a86d06700 1 -- 172.21.15.83:0/1656717764 >> 172.21.15.83:0/1656717764 conn(0x7f0a80076b70 msgr2=0x7f0a80076f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:09.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:09.928+0000 7f0a86d06700 1 -- 172.21.15.83:0/1656717764 shutdown_connections 2024-04-01T06:55:09.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:09.928+0000 7f0a86d06700 1 -- 172.21.15.83:0/1656717764 wait complete. 2024-04-01T06:55:09.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:09.929+0000 7f0a86d06700 1 Processor -- start 2024-04-01T06:55:09.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:09.929+0000 7f0a86d06700 1 -- start start 2024-04-01T06:55:09.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:09.929+0000 7f0a86d06700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0a800fff90 0x7f0a80196200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:09.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:09.929+0000 7f0a86d06700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0a80100950 0x7f0a80196740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:09.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:09.929+0000 7f0a86d06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a80104cf0 0x7f0a8019aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:09.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:09.929+0000 7f0a86d06700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8019b0b0 con 0x7f0a800fff90 2024-04-01T06:55:09.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:09.929+0000 7f0a86d06700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8019b220 con 0x7f0a80100950 2024-04-01T06:55:09.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:09.929+0000 7f0a86d06700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8019b3e0 con 0x7f0a80104cf0 2024-04-01T06:55:09.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:09.930+0000 7f0a84aa2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0a800fff90 0x7f0a80196200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:09.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:09.930+0000 7f0a84aa2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0a800fff90 0x7f0a80196200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:50452/0 (socket says 172.21.15.83:50452) 2024-04-01T06:55:09.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:09.930+0000 7f0a84aa2700 1 -- 172.21.15.83:0/2786149152 learned_addr learned my addr 172.21.15.83:0/2786149152 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:09.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:09.930+0000 7f0a852a3700 1 --2- 172.21.15.83:0/2786149152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a80104cf0 0x7f0a8019aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:09.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:09.930+0000 7f0a7ffff700 1 --2- 172.21.15.83:0/2786149152 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0a80100950 0x7f0a80196740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:09.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:09.930+0000 7f0a84aa2700 1 -- 172.21.15.83:0/2786149152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a80104cf0 msgr2=0x7f0a8019aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:09.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:09.930+0000 7f0a84aa2700 1 --2- 172.21.15.83:0/2786149152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a80104cf0 0x7f0a8019aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:09.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:09.930+0000 7f0a84aa2700 1 -- 172.21.15.83:0/2786149152 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0a80100950 msgr2=0x7f0a80196740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:09.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:09.930+0000 7f0a84aa2700 1 --2- 172.21.15.83:0/2786149152 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0a80100950 0x7f0a80196740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:09.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:09.930+0000 7f0a84aa2700 1 -- 172.21.15.83:0/2786149152 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a740095f0 con 0x7f0a800fff90 2024-04-01T06:55:09.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:09.930+0000 7f0a84aa2700 1 --2- 172.21.15.83:0/2786149152 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0a800fff90 0x7f0a80196200 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0a7400b5c0 tx=0x7f0a7400f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:09.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:09.930+0000 7f0a7dffb700 1 -- 172.21.15.83:0/2786149152 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7401d070 con 0x7f0a800fff90 2024-04-01T06:55:09.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:09.930+0000 7f0a7dffb700 1 -- 172.21.15.83:0/2786149152 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0a7400fb60 con 0x7f0a800fff90 2024-04-01T06:55:09.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:09.930+0000 7f0a86d06700 1 -- 172.21.15.83:0/2786149152 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a8019b660 con 0x7f0a800fff90 2024-04-01T06:55:09.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:09.930+0000 7f0a7dffb700 1 -- 172.21.15.83:0/2786149152 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a74017650 con 0x7f0a800fff90 2024-04-01T06:55:09.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:09.930+0000 7f0a86d06700 1 -- 172.21.15.83:0/2786149152 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a801a2f20 con 0x7f0a800fff90 2024-04-01T06:55:09.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:09.931+0000 7f0a86d06700 1 -- 172.21.15.83:0/2786149152 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a801082a0 con 0x7f0a800fff90 2024-04-01T06:55:09.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:09.932+0000 7f0a7dffb700 1 -- 172.21.15.83:0/2786149152 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f0a7400fcd0 con 0x7f0a800fff90 2024-04-01T06:55:09.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:09.933+0000 7f0a7dffb700 1 --2- 172.21.15.83:0/2786149152 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f0a700a11b0 0x7f0a700a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:09.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:09.933+0000 7f0a7ffff700 1 --2- 172.21.15.83:0/2786149152 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f0a700a11b0 0x7f0a700a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:09.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:09.933+0000 7f0a7dffb700 1 -- 172.21.15.83:0/2786149152 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f0a740cdc10 con 0x7f0a800fff90 2024-04-01T06:55:09.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:09.934+0000 7f0a7ffff700 1 --2- 172.21.15.83:0/2786149152 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f0a700a11b0 0x7f0a700a3670 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c005ea0 tx=0x7f0a6c005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:09.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:09.938+0000 7f0a7dffb700 1 -- 172.21.15.83:0/2786149152 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f0a74097480 con 0x7f0a800fff90 2024-04-01T06:55:10.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:09 smithi145 ceph-mon[47816]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T06:55:10.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:09 smithi083 ceph-mon[43429]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T06:55:10.127 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:10.127+0000 7f0a86d06700 1 -- 172.21.15.83:0/2786149152 --> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0a8004ea80 con 0x7f0a700a11b0 2024-04-01T06:55:10.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:10.137+0000 7f0a7dffb700 1 -- 172.21.15.83:0/2786149152 <== mgr.14152 v2:172.21.15.83:6800/3375372052 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+341574 (secure 0 0 0) 0x7f0a8004ea80 con 0x7f0a700a11b0 2024-04-01T06:55:10.142 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:55:10.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:10.140+0000 7f0a86d06700 1 -- 172.21.15.83:0/2786149152 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f0a700a11b0 msgr2=0x7f0a700a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:10.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:10.140+0000 7f0a86d06700 1 --2- 172.21.15.83:0/2786149152 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f0a700a11b0 0x7f0a700a3670 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c005ea0 tx=0x7f0a6c005e30 comp rx=0 tx=0).stop 2024-04-01T06:55:10.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:10.140+0000 7f0a86d06700 1 -- 172.21.15.83:0/2786149152 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0a800fff90 msgr2=0x7f0a80196200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:10.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:10.140+0000 7f0a86d06700 1 --2- 172.21.15.83:0/2786149152 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0a800fff90 0x7f0a80196200 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0a7400b5c0 tx=0x7f0a7400f670 comp rx=0 tx=0).stop 2024-04-01T06:55:10.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:10.140+0000 7f0a86d06700 1 -- 172.21.15.83:0/2786149152 shutdown_connections 2024-04-01T06:55:10.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:10.140+0000 7f0a86d06700 1 --2- 172.21.15.83:0/2786149152 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0a800fff90 0x7f0a80196200 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:10.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:10.140+0000 7f0a86d06700 1 --2- 172.21.15.83:0/2786149152 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f0a700a11b0 0x7f0a700a3670 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:10.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:10.140+0000 7f0a86d06700 1 --2- 172.21.15.83:0/2786149152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a80104cf0 0x7f0a8019aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:10.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:10.140+0000 7f0a86d06700 1 --2- 172.21.15.83:0/2786149152 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0a80100950 0x7f0a80196740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:10.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:10.140+0000 7f0a86d06700 1 -- 172.21.15.83:0/2786149152 >> 172.21.15.83:0/2786149152 conn(0x7f0a80076b70 msgr2=0x7f0a800fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:10.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:10.140+0000 7f0a86d06700 1 -- 172.21.15.83:0/2786149152 shutdown_connections 2024-04-01T06:55:10.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:10.140+0000 7f0a86d06700 1 -- 172.21.15.83:0/2786149152 wait complete. 2024-04-01T06:55:10.145 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-04-01T06:55:10.145 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:09 smithi153 ceph-mon[48187]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T06:55:10.508 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":237,"stamp":"2024-04-01T06:55:09.723401+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655902,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":373,"num_read_kb":308,"num_write":334,"num_write_kb":3047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":272,"ondisk_log_size":272,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":359260,"kb_used_data":10492,"kb_used_omap":18,"kb_used_meta":348653,"kb_avail":1124582564,"statfs":{"total":1151940427776,"available":1151572545536,"internally_reserved":0,"allocated":10743808,"data_stored":6867484,"data_compressed":112716,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":19130,"internal_metadata":357020998},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1652,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":47,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003163"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.479985+0000","last_change":"2024-04-01T06:54:28.426588+0000","last_active":"2024-04-01T06:54:30.479985+0000","last_peered":"2024-04-01T06:54:30.479985+0000","last_clean":"2024-04-01T06:54:30.479985+0000","last_became_active":"2024-04-01T06:54:28.423723+0000","last_became_peered":"2024-04-01T06:54:28.423723+0000","last_unstale":"2024-04-01T06:54:30.479985+0000","last_undegraded":"2024-04-01T06:54:30.479985+0000","last_fullsized":"2024-04-01T06:54:30.479985+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:52:38.856474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358294+0000","last_change":"2024-04-01T06:54:28.419858+0000","last_active":"2024-04-01T06:54:30.358294+0000","last_peered":"2024-04-01T06:54:30.358294+0000","last_clean":"2024-04-01T06:54:30.358294+0000","last_became_active":"2024-04-01T06:54:28.419534+0000","last_became_peered":"2024-04-01T06:54:28.419534+0000","last_unstale":"2024-04-01T06:54:30.358294+0000","last_undegraded":"2024-04-01T06:54:30.358294+0000","last_fullsized":"2024-04-01T06:54:30.358294+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:26:56.349672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.357923+0000","last_change":"2024-04-01T06:54:28.422763+0000","last_active":"2024-04-01T06:54:30.357923+0000","last_peered":"2024-04-01T06:54:30.357923+0000","last_clean":"2024-04-01T06:54:30.357923+0000","last_became_active":"2024-04-01T06:54:28.422439+0000","last_became_peered":"2024-04-01T06:54:28.422439+0000","last_unstale":"2024-04-01T06:54:30.357923+0000","last_undegraded":"2024-04-01T06:54:30.357923+0000","last_fullsized":"2024-04-01T06:54:30.357923+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:55:24.379428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358669+0000","last_change":"2024-04-01T06:54:28.421996+0000","last_active":"2024-04-01T06:54:30.358669+0000","last_peered":"2024-04-01T06:54:30.358669+0000","last_clean":"2024-04-01T06:54:30.358669+0000","last_became_active":"2024-04-01T06:54:28.421594+0000","last_became_peered":"2024-04-01T06:54:28.421594+0000","last_unstale":"2024-04-01T06:54:30.358669+0000","last_undegraded":"2024-04-01T06:54:30.358669+0000","last_fullsized":"2024-04-01T06:54:30.358669+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:36:53.200615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.412828+0000","last_change":"2024-04-01T06:54:28.415652+0000","last_active":"2024-04-01T06:54:29.412828+0000","last_peered":"2024-04-01T06:54:29.412828+0000","last_clean":"2024-04-01T06:54:29.412828+0000","last_became_active":"2024-04-01T06:54:28.415296+0000","last_became_peered":"2024-04-01T06:54:28.415296+0000","last_unstale":"2024-04-01T06:54:29.412828+0000","last_undegraded":"2024-04-01T06:54:29.412828+0000","last_fullsized":"2024-04-01T06:54:29.412828+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:36:36.967298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-01T06:54:28.690214+0000","last_change":"2024-04-01T06:54:28.421188+0000","last_active":"2024-04-01T06:54:28.690214+0000","last_peered":"2024-04-01T06:54:28.690214+0000","last_clean":"2024-04-01T06:54:28.690214+0000","last_became_active":"2024-04-01T06:54:28.420863+0000","last_became_peered":"2024-04-01T06:54:28.420863+0000","last_unstale":"2024-04-01T06:54:28.690214+0000","last_undegraded":"2024-04-01T06:54:28.690214+0000","last_fullsized":"2024-04-01T06:54:28.690214+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:40:38.641128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358358+0000","last_change":"2024-04-01T06:54:28.422554+0000","last_active":"2024-04-01T06:54:30.358358+0000","last_peered":"2024-04-01T06:54:30.358358+0000","last_clean":"2024-04-01T06:54:30.358358+0000","last_became_active":"2024-04-01T06:54:28.422209+0000","last_became_peered":"2024-04-01T06:54:28.422209+0000","last_unstale":"2024-04-01T06:54:30.358358+0000","last_undegraded":"2024-04-01T06:54:30.358358+0000","last_fullsized":"2024-04-01T06:54:30.358358+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T14:59:45.017681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.515266+0000","last_change":"2024-04-01T06:54:28.419291+0000","last_active":"2024-04-01T06:54:29.515266+0000","last_peered":"2024-04-01T06:54:29.515266+0000","last_clean":"2024-04-01T06:54:29.515266+0000","last_became_active":"2024-04-01T06:54:28.419013+0000","last_became_peered":"2024-04-01T06:54:28.419013+0000","last_unstale":"2024-04-01T06:54:29.515266+0000","last_undegraded":"2024-04-01T06:54:29.515266+0000","last_fullsized":"2024-04-01T06:54:29.515266+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:45:08.226568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.413505+0000","last_change":"2024-04-01T06:54:28.410264+0000","last_active":"2024-04-01T06:54:29.413505+0000","last_peered":"2024-04-01T06:54:29.413505+0000","last_clean":"2024-04-01T06:54:29.413505+0000","last_became_active":"2024-04-01T06:54:28.409959+0000","last_became_peered":"2024-04-01T06:54:28.409959+0000","last_unstale":"2024-04-01T06:54:29.413505+0000","last_undegraded":"2024-04-01T06:54:29.413505+0000","last_fullsized":"2024-04-01T06:54:29.413505+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:14:13.184396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-01T06:54:28.690280+0000","last_change":"2024-04-01T06:54:28.422115+0000","last_active":"2024-04-01T06:54:28.690280+0000","last_peered":"2024-04-01T06:54:28.690280+0000","last_clean":"2024-04-01T06:54:28.690280+0000","last_became_active":"2024-04-01T06:54:28.421629+0000","last_became_peered":"2024-04-01T06:54:28.421629+0000","last_unstale":"2024-04-01T06:54:28.690280+0000","last_undegraded":"2024-04-01T06:54:28.690280+0000","last_fullsized":"2024-04-01T06:54:28.690280+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:47:03.271557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358701+0000","last_change":"2024-04-01T06:54:28.429652+0000","last_active":"2024-04-01T06:54:30.358701+0000","last_peered":"2024-04-01T06:54:30.358701+0000","last_clean":"2024-04-01T06:54:30.358701+0000","last_became_active":"2024-04-01T06:54:28.429298+0000","last_became_peered":"2024-04-01T06:54:28.429298+0000","last_unstale":"2024-04-01T06:54:30.358701+0000","last_undegraded":"2024-04-01T06:54:30.358701+0000","last_fullsized":"2024-04-01T06:54:30.358701+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:03:16.110580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358421+0000","last_change":"2024-04-01T06:54:28.429645+0000","last_active":"2024-04-01T06:54:30.358421+0000","last_peered":"2024-04-01T06:54:30.358421+0000","last_clean":"2024-04-01T06:54:30.358421+0000","last_became_active":"2024-04-01T06:54:28.429285+0000","last_became_peered":"2024-04-01T06:54:28.429285+0000","last_unstale":"2024-04-01T06:54:30.358421+0000","last_undegraded":"2024-04-01T06:54:30.358421+0000","last_fullsized":"2024-04-01T06:54:30.358421+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:04:10.285396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.411765+0000","last_change":"2024-04-01T06:54:28.419390+0000","last_active":"2024-04-01T06:54:29.411765+0000","last_peered":"2024-04-01T06:54:29.411765+0000","last_clean":"2024-04-01T06:54:29.411765+0000","last_became_active":"2024-04-01T06:54:28.419110+0000","last_became_peered":"2024-04-01T06:54:28.419110+0000","last_unstale":"2024-04-01T06:54:29.411765+0000","last_undegraded":"2024-04-01T06:54:29.411765+0000","last_fullsized":"2024-04-01T06:54:29.411765+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:21:52.192681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.357608+0000","last_change":"2024-04-01T06:54:28.419416+0000","last_active":"2024-04-01T06:54:30.357608+0000","last_peered":"2024-04-01T06:54:30.357608+0000","last_clean":"2024-04-01T06:54:30.357608+0000","last_became_active":"2024-04-01T06:54:28.419099+0000","last_became_peered":"2024-04-01T06:54:28.419099+0000","last_unstale":"2024-04-01T06:54:30.357608+0000","last_undegraded":"2024-04-01T06:54:30.357608+0000","last_fullsized":"2024-04-01T06:54:30.357608+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:26:44.889806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.357586+0000","last_change":"2024-04-01T06:54:28.427391+0000","last_active":"2024-04-01T06:54:30.357586+0000","last_peered":"2024-04-01T06:54:30.357586+0000","last_clean":"2024-04-01T06:54:30.357586+0000","last_became_active":"2024-04-01T06:54:28.427153+0000","last_became_peered":"2024-04-01T06:54:28.427153+0000","last_unstale":"2024-04-01T06:54:30.357586+0000","last_undegraded":"2024-04-01T06:54:30.357586+0000","last_fullsized":"2024-04-01T06:54:30.357586+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:42:41.084729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.413106+0000","last_change":"2024-04-01T06:54:28.417088+0000","last_active":"2024-04-01T06:54:29.413106+0000","last_peered":"2024-04-01T06:54:29.413106+0000","last_clean":"2024-04-01T06:54:29.413106+0000","last_became_active":"2024-04-01T06:54:28.416747+0000","last_became_peered":"2024-04-01T06:54:28.416747+0000","last_unstale":"2024-04-01T06:54:29.413106+0000","last_undegraded":"2024-04-01T06:54:29.413106+0000","last_fullsized":"2024-04-01T06:54:29.413106+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:59:14.069761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.480070+0000","last_change":"2024-04-01T06:54:28.426049+0000","last_active":"2024-04-01T06:54:30.480070+0000","last_peered":"2024-04-01T06:54:30.480070+0000","last_clean":"2024-04-01T06:54:30.480070+0000","last_became_active":"2024-04-01T06:54:28.425723+0000","last_became_peered":"2024-04-01T06:54:28.425723+0000","last_unstale":"2024-04-01T06:54:30.480070+0000","last_undegraded":"2024-04-01T06:54:30.480070+0000","last_fullsized":"2024-04-01T06:54:30.480070+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:48:59.394352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.357884+0000","last_change":"2024-04-01T06:54:28.421574+0000","last_active":"2024-04-01T06:54:30.357884+0000","last_peered":"2024-04-01T06:54:30.357884+0000","last_clean":"2024-04-01T06:54:30.357884+0000","last_became_active":"2024-04-01T06:54:28.420852+0000","last_became_peered":"2024-04-01T06:54:28.420852+0000","last_unstale":"2024-04-01T06:54:30.357884+0000","last_undegraded":"2024-04-01T06:54:30.357884+0000","last_fullsized":"2024-04-01T06:54:30.357884+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:20:30.373285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358552+0000","last_change":"2024-04-01T06:54:28.419249+0000","last_active":"2024-04-01T06:54:30.358552+0000","last_peered":"2024-04-01T06:54:30.358552+0000","last_clean":"2024-04-01T06:54:30.358552+0000","last_became_active":"2024-04-01T06:54:28.418931+0000","last_became_peered":"2024-04-01T06:54:28.418931+0000","last_unstale":"2024-04-01T06:54:30.358552+0000","last_undegraded":"2024-04-01T06:54:30.358552+0000","last_fullsized":"2024-04-01T06:54:30.358552+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:38:04.786657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"79'9","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:32.710563+0000","last_change":"2024-04-01T06:54:27.993489+0000","last_active":"2024-04-01T06:54:32.710563+0000","last_peered":"2024-04-01T06:54:32.710563+0000","last_clean":"2024-04-01T06:54:32.710563+0000","last_became_active":"2024-04-01T06:54:27.993201+0000","last_became_peered":"2024-04-01T06:54:27.993201+0000","last_unstale":"2024-04-01T06:54:32.710563+0000","last_undegraded":"2024-04-01T06:54:32.710563+0000","last_fullsized":"2024-04-01T06:54:32.710563+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:10:53.897013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.515446+0000","last_change":"2024-04-01T06:54:28.417750+0000","last_active":"2024-04-01T06:54:29.515446+0000","last_peered":"2024-04-01T06:54:29.515446+0000","last_clean":"2024-04-01T06:54:29.515446+0000","last_became_active":"2024-04-01T06:54:28.417470+0000","last_became_peered":"2024-04-01T06:54:28.417470+0000","last_unstale":"2024-04-01T06:54:29.515446+0000","last_undegraded":"2024-04-01T06:54:29.515446+0000","last_fullsized":"2024-04-01T06:54:29.515446+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:06:12.668846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"79'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.515595+0000","last_change":"2024-04-01T06:54:27.998302+0000","last_active":"2024-04-01T06:54:29.515595+0000","last_peered":"2024-04-01T06:54:29.515595+0000","last_clean":"2024-04-01T06:54:29.515595+0000","last_became_active":"2024-04-01T06:54:27.997951+0000","last_became_peered":"2024-04-01T06:54:27.997951+0000","last_unstale":"2024-04-01T06:54:29.515595+0000","last_undegraded":"2024-04-01T06:54:29.515595+0000","last_fullsized":"2024-04-01T06:54:29.515595+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:28:45.076734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358361+0000","last_change":"2024-04-01T06:54:28.415641+0000","last_active":"2024-04-01T06:54:30.358361+0000","last_peered":"2024-04-01T06:54:30.358361+0000","last_clean":"2024-04-01T06:54:30.358361+0000","last_became_active":"2024-04-01T06:54:28.415305+0000","last_became_peered":"2024-04-01T06:54:28.415305+0000","last_unstale":"2024-04-01T06:54:30.358361+0000","last_undegraded":"2024-04-01T06:54:30.358361+0000","last_fullsized":"2024-04-01T06:54:30.358361+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:01:46.528332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"79'4","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:32.707231+0000","last_change":"2024-04-01T06:54:27.990581+0000","last_active":"2024-04-01T06:54:32.707231+0000","last_peered":"2024-04-01T06:54:32.707231+0000","last_clean":"2024-04-01T06:54:32.707231+0000","last_became_active":"2024-04-01T06:54:27.990099+0000","last_became_peered":"2024-04-01T06:54:27.990099+0000","last_unstale":"2024-04-01T06:54:32.707231+0000","last_undegraded":"2024-04-01T06:54:32.707231+0000","last_fullsized":"2024-04-01T06:54:32.707231+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T14:53:49.183394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.413310+0000","last_change":"2024-04-01T06:54:28.423208+0000","last_active":"2024-04-01T06:54:29.413310+0000","last_peered":"2024-04-01T06:54:29.413310+0000","last_clean":"2024-04-01T06:54:29.413310+0000","last_became_active":"2024-04-01T06:54:28.422648+0000","last_became_peered":"2024-04-01T06:54:28.422648+0000","last_unstale":"2024-04-01T06:54:29.413310+0000","last_undegraded":"2024-04-01T06:54:29.413310+0000","last_fullsized":"2024-04-01T06:54:29.413310+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:02:58.380288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.413114+0000","last_change":"2024-04-01T06:54:27.995776+0000","last_active":"2024-04-01T06:54:29.413114+0000","last_peered":"2024-04-01T06:54:29.413114+0000","last_clean":"2024-04-01T06:54:29.413114+0000","last_became_active":"2024-04-01T06:54:27.995417+0000","last_became_peered":"2024-04-01T06:54:27.995417+0000","last_unstale":"2024-04-01T06:54:29.413114+0000","last_undegraded":"2024-04-01T06:54:29.413114+0000","last_fullsized":"2024-04-01T06:54:29.413114+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:46:36.694460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.214258+0000","last_change":"2024-04-01T06:54:28.422448+0000","last_active":"2024-04-01T06:54:30.214258+0000","last_peered":"2024-04-01T06:54:30.214258+0000","last_clean":"2024-04-01T06:54:30.214258+0000","last_became_active":"2024-04-01T06:54:28.422080+0000","last_became_peered":"2024-04-01T06:54:28.422080+0000","last_unstale":"2024-04-01T06:54:30.214258+0000","last_undegraded":"2024-04-01T06:54:30.214258+0000","last_fullsized":"2024-04-01T06:54:30.214258+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:03:23.686194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"79'6","reported_seq":56,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:55:06.763983+0000","last_change":"2024-04-01T06:54:27.998822+0000","last_active":"2024-04-01T06:55:06.763983+0000","last_peered":"2024-04-01T06:55:06.763983+0000","last_clean":"2024-04-01T06:55:06.763983+0000","last_became_active":"2024-04-01T06:54:27.998514+0000","last_became_peered":"2024-04-01T06:54:27.998514+0000","last_unstale":"2024-04-01T06:55:06.763983+0000","last_undegraded":"2024-04-01T06:55:06.763983+0000","last_fullsized":"2024-04-01T06:55:06.763983+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T14:21:28.340169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":38,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.412849+0000","last_change":"2024-04-01T06:54:28.415825+0000","last_active":"2024-04-01T06:54:29.412849+0000","last_peered":"2024-04-01T06:54:29.412849+0000","last_clean":"2024-04-01T06:54:29.412849+0000","last_became_active":"2024-04-01T06:54:28.413679+0000","last_became_peered":"2024-04-01T06:54:28.413679+0000","last_unstale":"2024-04-01T06:54:29.412849+0000","last_undegraded":"2024-04-01T06:54:29.412849+0000","last_fullsized":"2024-04-01T06:54:29.412849+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:13:19.907109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"79'3","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:32.708798+0000","last_change":"2024-04-01T06:54:27.994194+0000","last_active":"2024-04-01T06:54:32.708798+0000","last_peered":"2024-04-01T06:54:32.708798+0000","last_clean":"2024-04-01T06:54:32.708798+0000","last_became_active":"2024-04-01T06:54:27.993868+0000","last_became_peered":"2024-04-01T06:54:27.993868+0000","last_unstale":"2024-04-01T06:54:32.708798+0000","last_undegraded":"2024-04-01T06:54:32.708798+0000","last_fullsized":"2024-04-01T06:54:32.708798+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:55:17.003472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.214120+0000","last_change":"2024-04-01T06:54:28.412629+0000","last_active":"2024-04-01T06:54:30.214120+0000","last_peered":"2024-04-01T06:54:30.214120+0000","last_clean":"2024-04-01T06:54:30.214120+0000","last_became_active":"2024-04-01T06:54:28.412291+0000","last_became_peered":"2024-04-01T06:54:28.412291+0000","last_unstale":"2024-04-01T06:54:30.214120+0000","last_undegraded":"2024-04-01T06:54:30.214120+0000","last_fullsized":"2024-04-01T06:54:30.214120+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:29:14.007470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"79'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:32.708507+0000","last_change":"2024-04-01T06:54:27.996570+0000","last_active":"2024-04-01T06:54:32.708507+0000","last_peered":"2024-04-01T06:54:32.708507+0000","last_clean":"2024-04-01T06:54:32.708507+0000","last_became_active":"2024-04-01T06:54:27.994897+0000","last_became_peered":"2024-04-01T06:54:27.994897+0000","last_unstale":"2024-04-01T06:54:32.708507+0000","last_undegraded":"2024-04-01T06:54:32.708507+0000","last_fullsized":"2024-04-01T06:54:32.708507+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:53:05.733608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.515225+0000","last_change":"2024-04-01T06:54:28.413701+0000","last_active":"2024-04-01T06:54:29.515225+0000","last_peered":"2024-04-01T06:54:29.515225+0000","last_clean":"2024-04-01T06:54:29.515225+0000","last_became_active":"2024-04-01T06:54:28.413435+0000","last_became_peered":"2024-04-01T06:54:28.413435+0000","last_unstale":"2024-04-01T06:54:29.515225+0000","last_undegraded":"2024-04-01T06:54:29.515225+0000","last_fullsized":"2024-04-01T06:54:29.515225+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:43:27.835398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'1","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.213830+0000","last_change":"2024-04-01T06:54:28.001115+0000","last_active":"2024-04-01T06:54:30.213830+0000","last_peered":"2024-04-01T06:54:30.213830+0000","last_clean":"2024-04-01T06:54:30.213830+0000","last_became_active":"2024-04-01T06:54:28.000732+0000","last_became_peered":"2024-04-01T06:54:28.000732+0000","last_unstale":"2024-04-01T06:54:30.213830+0000","last_undegraded":"2024-04-01T06:54:30.213830+0000","last_fullsized":"2024-04-01T06:54:30.213830+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:06:02.064402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358103+0000","last_change":"2024-04-01T06:54:28.421670+0000","last_active":"2024-04-01T06:54:30.358103+0000","last_peered":"2024-04-01T06:54:30.358103+0000","last_clean":"2024-04-01T06:54:30.358103+0000","last_became_active":"2024-04-01T06:54:28.421335+0000","last_became_peered":"2024-04-01T06:54:28.421335+0000","last_unstale":"2024-04-01T06:54:30.358103+0000","last_undegraded":"2024-04-01T06:54:30.358103+0000","last_fullsized":"2024-04-01T06:54:30.358103+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:25:55.223397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"79'3","reported_seq":50,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:55:06.763444+0000","last_change":"2024-04-01T06:54:27.999413+0000","last_active":"2024-04-01T06:55:06.763444+0000","last_peered":"2024-04-01T06:55:06.763444+0000","last_clean":"2024-04-01T06:55:06.763444+0000","last_became_active":"2024-04-01T06:54:27.999123+0000","last_became_peered":"2024-04-01T06:54:27.999123+0000","last_unstale":"2024-04-01T06:55:06.763444+0000","last_undegraded":"2024-04-01T06:55:06.763444+0000","last_fullsized":"2024-04-01T06:55:06.763444+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:30:06.399907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.413618+0000","last_change":"2024-04-01T06:54:28.423843+0000","last_active":"2024-04-01T06:54:29.413618+0000","last_peered":"2024-04-01T06:54:29.413618+0000","last_clean":"2024-04-01T06:54:29.413618+0000","last_became_active":"2024-04-01T06:54:28.423538+0000","last_became_peered":"2024-04-01T06:54:28.423538+0000","last_unstale":"2024-04-01T06:54:29.413618+0000","last_undegraded":"2024-04-01T06:54:29.413618+0000","last_fullsized":"2024-04-01T06:54:29.413618+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:51:23.986409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:31.700817+0000","last_change":"2024-04-01T06:54:27.997137+0000","last_active":"2024-04-01T06:54:31.700817+0000","last_peered":"2024-04-01T06:54:31.700817+0000","last_clean":"2024-04-01T06:54:31.700817+0000","last_became_active":"2024-04-01T06:54:27.996386+0000","last_became_peered":"2024-04-01T06:54:27.996386+0000","last_unstale":"2024-04-01T06:54:31.700817+0000","last_undegraded":"2024-04-01T06:54:31.700817+0000","last_fullsized":"2024-04-01T06:54:31.700817+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:29:57.365756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358233+0000","last_change":"2024-04-01T06:54:28.426837+0000","last_active":"2024-04-01T06:54:30.358233+0000","last_peered":"2024-04-01T06:54:30.358233+0000","last_clean":"2024-04-01T06:54:30.358233+0000","last_became_active":"2024-04-01T06:54:28.426551+0000","last_became_peered":"2024-04-01T06:54:28.426551+0000","last_unstale":"2024-04-01T06:54:30.358233+0000","last_undegraded":"2024-04-01T06:54:30.358233+0000","last_fullsized":"2024-04-01T06:54:30.358233+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:05:50.264912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'4","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:31.700655+0000","last_change":"2024-04-01T06:54:27.999968+0000","last_active":"2024-04-01T06:54:31.700655+0000","last_peered":"2024-04-01T06:54:31.700655+0000","last_clean":"2024-04-01T06:54:31.700655+0000","last_became_active":"2024-04-01T06:54:27.999415+0000","last_became_peered":"2024-04-01T06:54:27.999415+0000","last_unstale":"2024-04-01T06:54:31.700655+0000","last_undegraded":"2024-04-01T06:54:31.700655+0000","last_fullsized":"2024-04-01T06:54:31.700655+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:31:57.472227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.413424+0000","last_change":"2024-04-01T06:54:28.421174+0000","last_active":"2024-04-01T06:54:29.413424+0000","last_peered":"2024-04-01T06:54:29.413424+0000","last_clean":"2024-04-01T06:54:29.413424+0000","last_became_active":"2024-04-01T06:54:28.420841+0000","last_became_peered":"2024-04-01T06:54:28.420841+0000","last_unstale":"2024-04-01T06:54:29.413424+0000","last_undegraded":"2024-04-01T06:54:29.413424+0000","last_fullsized":"2024-04-01T06:54:29.413424+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:05:25.377496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"79'28","reported_seq":118,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:55:07.773050+0000","last_change":"2024-04-01T06:54:27.995496+0000","last_active":"2024-04-01T06:55:07.773050+0000","last_peered":"2024-04-01T06:55:07.773050+0000","last_clean":"2024-04-01T06:55:07.773050+0000","last_became_active":"2024-04-01T06:54:27.995131+0000","last_became_peered":"2024-04-01T06:54:27.995131+0000","last_unstale":"2024-04-01T06:55:07.773050+0000","last_undegraded":"2024-04-01T06:55:07.773050+0000","last_fullsized":"2024-04-01T06:55:07.773050+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:36:12.129235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61000,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":78,"num_read_kb":98,"num_write":29,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.413022+0000","last_change":"2024-04-01T06:54:28.427835+0000","last_active":"2024-04-01T06:54:29.413022+0000","last_peered":"2024-04-01T06:54:29.413022+0000","last_clean":"2024-04-01T06:54:29.413022+0000","last_became_active":"2024-04-01T06:54:28.426956+0000","last_became_peered":"2024-04-01T06:54:28.426956+0000","last_unstale":"2024-04-01T06:54:29.413022+0000","last_undegraded":"2024-04-01T06:54:29.413022+0000","last_fullsized":"2024-04-01T06:54:29.413022+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:41:17.334977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'6","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:32.708508+0000","last_change":"2024-04-01T06:54:27.992756+0000","last_active":"2024-04-01T06:54:32.708508+0000","last_peered":"2024-04-01T06:54:32.708508+0000","last_clean":"2024-04-01T06:54:32.708508+0000","last_became_active":"2024-04-01T06:54:27.992403+0000","last_became_peered":"2024-04-01T06:54:27.992403+0000","last_unstale":"2024-04-01T06:54:32.708508+0000","last_undegraded":"2024-04-01T06:54:32.708508+0000","last_fullsized":"2024-04-01T06:54:32.708508+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:40:33.458435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.411545+0000","last_change":"2024-04-01T06:54:28.416750+0000","last_active":"2024-04-01T06:54:29.411545+0000","last_peered":"2024-04-01T06:54:29.411545+0000","last_clean":"2024-04-01T06:54:29.411545+0000","last_became_active":"2024-04-01T06:54:28.416417+0000","last_became_peered":"2024-04-01T06:54:28.416417+0000","last_unstale":"2024-04-01T06:54:29.411545+0000","last_undegraded":"2024-04-01T06:54:29.411545+0000","last_fullsized":"2024-04-01T06:54:29.411545+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:04:41.698842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'3","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:31.701032+0000","last_change":"2024-04-01T06:54:28.001450+0000","last_active":"2024-04-01T06:54:31.701032+0000","last_peered":"2024-04-01T06:54:31.701032+0000","last_clean":"2024-04-01T06:54:31.701032+0000","last_became_active":"2024-04-01T06:54:28.001165+0000","last_became_peered":"2024-04-01T06:54:28.001165+0000","last_unstale":"2024-04-01T06:54:31.701032+0000","last_undegraded":"2024-04-01T06:54:31.701032+0000","last_fullsized":"2024-04-01T06:54:31.701032+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:20:03.876123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358814+0000","last_change":"2024-04-01T06:54:28.421097+0000","last_active":"2024-04-01T06:54:30.358814+0000","last_peered":"2024-04-01T06:54:30.358814+0000","last_clean":"2024-04-01T06:54:30.358814+0000","last_became_active":"2024-04-01T06:54:28.420781+0000","last_became_peered":"2024-04-01T06:54:28.420781+0000","last_unstale":"2024-04-01T06:54:30.358814+0000","last_undegraded":"2024-04-01T06:54:30.358814+0000","last_fullsized":"2024-04-01T06:54:30.358814+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:11:47.192742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"79'4","reported_seq":52,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:55:04.760439+0000","last_change":"2024-04-01T06:54:27.993832+0000","last_active":"2024-04-01T06:55:04.760439+0000","last_peered":"2024-04-01T06:55:04.760439+0000","last_clean":"2024-04-01T06:55:04.760439+0000","last_became_active":"2024-04-01T06:54:27.993423+0000","last_became_peered":"2024-04-01T06:54:27.993423+0000","last_unstale":"2024-04-01T06:55:04.760439+0000","last_undegraded":"2024-04-01T06:55:04.760439+0000","last_fullsized":"2024-04-01T06:55:04.760439+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:58:37.542214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":933,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":37,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358345+0000","last_change":"2024-04-01T06:54:28.423352+0000","last_active":"2024-04-01T06:54:30.358345+0000","last_peered":"2024-04-01T06:54:30.358345+0000","last_clean":"2024-04-01T06:54:30.358345+0000","last_became_active":"2024-04-01T06:54:28.423049+0000","last_became_peered":"2024-04-01T06:54:28.423049+0000","last_unstale":"2024-04-01T06:54:30.358345+0000","last_undegraded":"2024-04-01T06:54:30.358345+0000","last_fullsized":"2024-04-01T06:54:30.358345+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:07:34.963189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'15","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:32.711057+0000","last_change":"2024-04-01T06:54:27.990469+0000","last_active":"2024-04-01T06:54:32.711057+0000","last_peered":"2024-04-01T06:54:32.711057+0000","last_clean":"2024-04-01T06:54:32.711057+0000","last_became_active":"2024-04-01T06:54:27.990147+0000","last_became_peered":"2024-04-01T06:54:27.990147+0000","last_unstale":"2024-04-01T06:54:32.711057+0000","last_undegraded":"2024-04-01T06:54:32.711057+0000","last_fullsized":"2024-04-01T06:54:32.711057+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:27:29.415723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.214102+0000","last_change":"2024-04-01T06:54:28.422479+0000","last_active":"2024-04-01T06:54:30.214102+0000","last_peered":"2024-04-01T06:54:30.214102+0000","last_clean":"2024-04-01T06:54:30.214102+0000","last_became_active":"2024-04-01T06:54:28.422155+0000","last_became_peered":"2024-04-01T06:54:28.422155+0000","last_unstale":"2024-04-01T06:54:30.214102+0000","last_undegraded":"2024-04-01T06:54:30.214102+0000","last_fullsized":"2024-04-01T06:54:30.214102+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:44:19.545796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"79'2","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:33.711923+0000","last_change":"2024-04-01T06:54:27.995827+0000","last_active":"2024-04-01T06:54:33.711923+0000","last_peered":"2024-04-01T06:54:33.711923+0000","last_clean":"2024-04-01T06:54:33.711923+0000","last_became_active":"2024-04-01T06:54:27.995450+0000","last_became_peered":"2024-04-01T06:54:27.995450+0000","last_unstale":"2024-04-01T06:54:33.711923+0000","last_undegraded":"2024-04-01T06:54:33.711923+0000","last_fullsized":"2024-04-01T06:54:33.711923+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T14:14:03.935578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.479897+0000","last_change":"2024-04-01T06:54:28.425376+0000","last_active":"2024-04-01T06:54:30.479897+0000","last_peered":"2024-04-01T06:54:30.479897+0000","last_clean":"2024-04-01T06:54:30.479897+0000","last_became_active":"2024-04-01T06:54:28.421235+0000","last_became_peered":"2024-04-01T06:54:28.421235+0000","last_unstale":"2024-04-01T06:54:30.479897+0000","last_undegraded":"2024-04-01T06:54:30.479897+0000","last_fullsized":"2024-04-01T06:54:30.479897+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:19:05.244735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.357821+0000","last_change":"2024-04-01T06:54:27.991659+0000","last_active":"2024-04-01T06:54:30.357821+0000","last_peered":"2024-04-01T06:54:30.357821+0000","last_clean":"2024-04-01T06:54:30.357821+0000","last_became_active":"2024-04-01T06:54:27.991280+0000","last_became_peered":"2024-04-01T06:54:27.991280+0000","last_unstale":"2024-04-01T06:54:30.357821+0000","last_undegraded":"2024-04-01T06:54:30.357821+0000","last_fullsized":"2024-04-01T06:54:30.357821+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:29:38.560570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"79'1","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.291309+0000","last_change":"2024-04-01T06:54:28.417654+0000","last_active":"2024-04-01T06:54:30.291309+0000","last_peered":"2024-04-01T06:54:30.291309+0000","last_clean":"2024-04-01T06:54:30.291309+0000","last_became_active":"2024-04-01T06:54:28.417318+0000","last_became_peered":"2024-04-01T06:54:28.417318+0000","last_unstale":"2024-04-01T06:54:30.291309+0000","last_undegraded":"2024-04-01T06:54:30.291309+0000","last_fullsized":"2024-04-01T06:54:30.291309+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:59:25.843730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"79'1","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:31.834046+0000","last_change":"2024-04-01T06:54:27.998825+0000","last_active":"2024-04-01T06:54:31.834046+0000","last_peered":"2024-04-01T06:54:31.834046+0000","last_clean":"2024-04-01T06:54:31.834046+0000","last_became_active":"2024-04-01T06:54:27.998488+0000","last_became_peered":"2024-04-01T06:54:27.998488+0000","last_unstale":"2024-04-01T06:54:31.834046+0000","last_undegraded":"2024-04-01T06:54:31.834046+0000","last_fullsized":"2024-04-01T06:54:31.834046+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:22:24.878723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-01T06:54:28.690226+0000","last_change":"2024-04-01T06:54:28.421053+0000","last_active":"2024-04-01T06:54:28.690226+0000","last_peered":"2024-04-01T06:54:28.690226+0000","last_clean":"2024-04-01T06:54:28.690226+0000","last_became_active":"2024-04-01T06:54:28.420718+0000","last_became_peered":"2024-04-01T06:54:28.420718+0000","last_unstale":"2024-04-01T06:54:28.690226+0000","last_undegraded":"2024-04-01T06:54:28.690226+0000","last_fullsized":"2024-04-01T06:54:28.690226+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:58:10.109158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.214303+0000","last_change":"2024-04-01T06:54:28.419126+0000","last_active":"2024-04-01T06:54:30.214303+0000","last_peered":"2024-04-01T06:54:30.214303+0000","last_clean":"2024-04-01T06:54:30.214303+0000","last_became_active":"2024-04-01T06:54:28.418217+0000","last_became_peered":"2024-04-01T06:54:28.418217+0000","last_unstale":"2024-04-01T06:54:30.214303+0000","last_undegraded":"2024-04-01T06:54:30.214303+0000","last_fullsized":"2024-04-01T06:54:30.214303+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T14:02:41.148200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"79'4","reported_seq":52,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:55:07.764222+0000","last_change":"2024-04-01T06:54:27.993059+0000","last_active":"2024-04-01T06:55:07.764222+0000","last_peered":"2024-04-01T06:55:07.764222+0000","last_clean":"2024-04-01T06:55:07.764222+0000","last_became_active":"2024-04-01T06:54:27.992471+0000","last_became_peered":"2024-04-01T06:54:27.992471+0000","last_unstale":"2024-04-01T06:55:07.764222+0000","last_undegraded":"2024-04-01T06:55:07.764222+0000","last_fullsized":"2024-04-01T06:55:07.764222+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:27:38.691261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.515528+0000","last_change":"2024-04-01T06:54:28.411805+0000","last_active":"2024-04-01T06:54:29.515528+0000","last_peered":"2024-04-01T06:54:29.515528+0000","last_clean":"2024-04-01T06:54:29.515528+0000","last_became_active":"2024-04-01T06:54:28.411526+0000","last_became_peered":"2024-04-01T06:54:28.411526+0000","last_unstale":"2024-04-01T06:54:29.515528+0000","last_undegraded":"2024-04-01T06:54:29.515528+0000","last_fullsized":"2024-04-01T06:54:29.515528+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:59:08.223590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"79'3","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:33.710576+0000","last_change":"2024-04-01T06:54:27.988695+0000","last_active":"2024-04-01T06:54:33.710576+0000","last_peered":"2024-04-01T06:54:33.710576+0000","last_clean":"2024-04-01T06:54:33.710576+0000","last_became_active":"2024-04-01T06:54:27.988069+0000","last_became_peered":"2024-04-01T06:54:27.988069+0000","last_unstale":"2024-04-01T06:54:33.710576+0000","last_undegraded":"2024-04-01T06:54:33.710576+0000","last_fullsized":"2024-04-01T06:54:33.710576+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:27:11.287962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":330,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358445+0000","last_change":"2024-04-01T06:53:41.678430+0000","last_active":"2024-04-01T06:54:30.358445+0000","last_peered":"2024-04-01T06:54:30.358445+0000","last_clean":"2024-04-01T06:54:30.358445+0000","last_became_active":"2024-04-01T06:53:41.677964+0000","last_became_peered":"2024-04-01T06:53:41.677964+0000","last_unstale":"2024-04-01T06:54:30.358445+0000","last_undegraded":"2024-04-01T06:54:30.358445+0000","last_fullsized":"2024-04-01T06:54:30.358445+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:51:21.964420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:51:21.964420+0000","last_clean_scrub_stamp":"2024-04-01T06:51:21.964420+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:24:29.916692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.411404+0000","last_change":"2024-04-01T06:54:28.423775+0000","last_active":"2024-04-01T06:54:29.411404+0000","last_peered":"2024-04-01T06:54:29.411404+0000","last_clean":"2024-04-01T06:54:29.411404+0000","last_became_active":"2024-04-01T06:54:28.423462+0000","last_became_peered":"2024-04-01T06:54:28.423462+0000","last_unstale":"2024-04-01T06:54:29.411404+0000","last_undegraded":"2024-04-01T06:54:29.411404+0000","last_fullsized":"2024-04-01T06:54:29.411404+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:09:38.043033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"79'3","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:32.707578+0000","last_change":"2024-04-01T06:54:27.997801+0000","last_active":"2024-04-01T06:54:32.707578+0000","last_peered":"2024-04-01T06:54:32.707578+0000","last_clean":"2024-04-01T06:54:32.707578+0000","last_became_active":"2024-04-01T06:54:27.997305+0000","last_became_peered":"2024-04-01T06:54:27.997305+0000","last_unstale":"2024-04-01T06:54:32.707578+0000","last_undegraded":"2024-04-01T06:54:32.707578+0000","last_fullsized":"2024-04-01T06:54:32.707578+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:46:09.224535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"79'1","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:31.698306+0000","last_change":"2024-04-01T06:54:27.994483+0000","last_active":"2024-04-01T06:54:31.698306+0000","last_peered":"2024-04-01T06:54:31.698306+0000","last_clean":"2024-04-01T06:54:31.698306+0000","last_became_active":"2024-04-01T06:54:27.994093+0000","last_became_peered":"2024-04-01T06:54:27.994093+0000","last_unstale":"2024-04-01T06:54:31.698306+0000","last_undegraded":"2024-04-01T06:54:31.698306+0000","last_fullsized":"2024-04-01T06:54:31.698306+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:27:48.272196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.411547+0000","last_change":"2024-04-01T06:54:28.423895+0000","last_active":"2024-04-01T06:54:29.411547+0000","last_peered":"2024-04-01T06:54:29.411547+0000","last_clean":"2024-04-01T06:54:29.411547+0000","last_became_active":"2024-04-01T06:54:28.423593+0000","last_became_peered":"2024-04-01T06:54:28.423593+0000","last_unstale":"2024-04-01T06:54:29.411547+0000","last_undegraded":"2024-04-01T06:54:29.411547+0000","last_fullsized":"2024-04-01T06:54:29.411547+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:09:30.414080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"79'5","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:37.294249+0000","last_change":"2024-04-01T06:54:27.987207+0000","last_active":"2024-04-01T06:54:37.294249+0000","last_peered":"2024-04-01T06:54:37.294249+0000","last_clean":"2024-04-01T06:54:37.294249+0000","last_became_active":"2024-04-01T06:54:27.986537+0000","last_became_peered":"2024-04-01T06:54:27.986537+0000","last_unstale":"2024-04-01T06:54:37.294249+0000","last_undegraded":"2024-04-01T06:54:37.294249+0000","last_fullsized":"2024-04-01T06:54:37.294249+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:26:41.096843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.515518+0000","last_change":"2024-04-01T06:54:28.416591+0000","last_active":"2024-04-01T06:54:29.515518+0000","last_peered":"2024-04-01T06:54:29.515518+0000","last_clean":"2024-04-01T06:54:29.515518+0000","last_became_active":"2024-04-01T06:54:28.416295+0000","last_became_peered":"2024-04-01T06:54:28.416295+0000","last_unstale":"2024-04-01T06:54:29.515518+0000","last_undegraded":"2024-04-01T06:54:29.515518+0000","last_fullsized":"2024-04-01T06:54:29.515518+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:17:24.670572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'4","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:31.697072+0000","last_change":"2024-04-01T06:54:27.996075+0000","last_active":"2024-04-01T06:54:31.697072+0000","last_peered":"2024-04-01T06:54:31.697072+0000","last_clean":"2024-04-01T06:54:31.697072+0000","last_became_active":"2024-04-01T06:54:27.995664+0000","last_became_peered":"2024-04-01T06:54:27.995664+0000","last_unstale":"2024-04-01T06:54:31.697072+0000","last_undegraded":"2024-04-01T06:54:31.697072+0000","last_fullsized":"2024-04-01T06:54:31.697072+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:17:33.214644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358295+0000","last_change":"2024-04-01T06:54:28.422041+0000","last_active":"2024-04-01T06:54:30.358295+0000","last_peered":"2024-04-01T06:54:30.358295+0000","last_clean":"2024-04-01T06:54:30.358295+0000","last_became_active":"2024-04-01T06:54:28.421743+0000","last_became_peered":"2024-04-01T06:54:28.421743+0000","last_unstale":"2024-04-01T06:54:30.358295+0000","last_undegraded":"2024-04-01T06:54:30.358295+0000","last_fullsized":"2024-04-01T06:54:30.358295+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:23:14.405879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:31.701969+0000","last_change":"2024-04-01T06:54:27.991734+0000","last_active":"2024-04-01T06:54:31.701969+0000","last_peered":"2024-04-01T06:54:31.701969+0000","last_clean":"2024-04-01T06:54:31.701969+0000","last_became_active":"2024-04-01T06:54:27.991139+0000","last_became_peered":"2024-04-01T06:54:27.991139+0000","last_unstale":"2024-04-01T06:54:31.701969+0000","last_undegraded":"2024-04-01T06:54:31.701969+0000","last_fullsized":"2024-04-01T06:54:31.701969+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:08:49.188179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.412717+0000","last_change":"2024-04-01T06:54:28.428467+0000","last_active":"2024-04-01T06:54:29.412717+0000","last_peered":"2024-04-01T06:54:29.412717+0000","last_clean":"2024-04-01T06:54:29.412717+0000","last_became_active":"2024-04-01T06:54:28.428095+0000","last_became_peered":"2024-04-01T06:54:28.428095+0000","last_unstale":"2024-04-01T06:54:29.412717+0000","last_undegraded":"2024-04-01T06:54:29.412717+0000","last_fullsized":"2024-04-01T06:54:29.412717+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:21:04.500427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'3","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:31.699951+0000","last_change":"2024-04-01T06:54:27.990321+0000","last_active":"2024-04-01T06:54:31.699951+0000","last_peered":"2024-04-01T06:54:31.699951+0000","last_clean":"2024-04-01T06:54:31.699951+0000","last_became_active":"2024-04-01T06:54:27.989997+0000","last_became_peered":"2024-04-01T06:54:27.989997+0000","last_unstale":"2024-04-01T06:54:31.699951+0000","last_undegraded":"2024-04-01T06:54:31.699951+0000","last_fullsized":"2024-04-01T06:54:31.699951+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:14:04.059812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.479669+0000","last_change":"2024-04-01T06:54:28.416480+0000","last_active":"2024-04-01T06:54:30.479669+0000","last_peered":"2024-04-01T06:54:30.479669+0000","last_clean":"2024-04-01T06:54:30.479669+0000","last_became_active":"2024-04-01T06:54:28.416009+0000","last_became_peered":"2024-04-01T06:54:28.416009+0000","last_unstale":"2024-04-01T06:54:30.479669+0000","last_undegraded":"2024-04-01T06:54:30.479669+0000","last_fullsized":"2024-04-01T06:54:30.479669+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:32:09.759447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"79'1","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:31.760608+0000","last_change":"2024-04-01T06:54:27.996538+0000","last_active":"2024-04-01T06:54:31.760608+0000","last_peered":"2024-04-01T06:54:31.760608+0000","last_clean":"2024-04-01T06:54:31.760608+0000","last_became_active":"2024-04-01T06:54:27.996177+0000","last_became_peered":"2024-04-01T06:54:27.996177+0000","last_unstale":"2024-04-01T06:54:31.760608+0000","last_undegraded":"2024-04-01T06:54:31.760608+0000","last_fullsized":"2024-04-01T06:54:31.760608+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:39:45.386450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.515616+0000","last_change":"2024-04-01T06:54:28.419403+0000","last_active":"2024-04-01T06:54:29.515616+0000","last_peered":"2024-04-01T06:54:29.515616+0000","last_clean":"2024-04-01T06:54:29.515616+0000","last_became_active":"2024-04-01T06:54:28.419127+0000","last_became_peered":"2024-04-01T06:54:28.419127+0000","last_unstale":"2024-04-01T06:54:29.515616+0000","last_undegraded":"2024-04-01T06:54:29.515616+0000","last_fullsized":"2024-04-01T06:54:29.515616+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:52:13.510448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:31.698144+0000","last_change":"2024-04-01T06:54:27.992775+0000","last_active":"2024-04-01T06:54:31.698144+0000","last_peered":"2024-04-01T06:54:31.698144+0000","last_clean":"2024-04-01T06:54:31.698144+0000","last_became_active":"2024-04-01T06:54:27.992356+0000","last_became_peered":"2024-04-01T06:54:27.992356+0000","last_unstale":"2024-04-01T06:54:31.698144+0000","last_undegraded":"2024-04-01T06:54:31.698144+0000","last_fullsized":"2024-04-01T06:54:31.698144+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T14:46:37.302172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358992+0000","last_change":"2024-04-01T06:54:28.430132+0000","last_active":"2024-04-01T06:54:30.358992+0000","last_peered":"2024-04-01T06:54:30.358992+0000","last_clean":"2024-04-01T06:54:30.358992+0000","last_became_active":"2024-04-01T06:54:28.429816+0000","last_became_peered":"2024-04-01T06:54:28.429816+0000","last_unstale":"2024-04-01T06:54:30.358992+0000","last_undegraded":"2024-04-01T06:54:30.358992+0000","last_fullsized":"2024-04-01T06:54:30.358992+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T14:49:58.661275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"79'3","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:32.710043+0000","last_change":"2024-04-01T06:54:27.999460+0000","last_active":"2024-04-01T06:54:32.710043+0000","last_peered":"2024-04-01T06:54:32.710043+0000","last_clean":"2024-04-01T06:54:32.710043+0000","last_became_active":"2024-04-01T06:54:27.999128+0000","last_became_peered":"2024-04-01T06:54:27.999128+0000","last_unstale":"2024-04-01T06:54:32.710043+0000","last_undegraded":"2024-04-01T06:54:32.710043+0000","last_fullsized":"2024-04-01T06:54:32.710043+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:19:24.285698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358852+0000","last_change":"2024-04-01T06:54:28.427720+0000","last_active":"2024-04-01T06:54:30.358852+0000","last_peered":"2024-04-01T06:54:30.358852+0000","last_clean":"2024-04-01T06:54:30.358852+0000","last_became_active":"2024-04-01T06:54:28.427357+0000","last_became_peered":"2024-04-01T06:54:28.427357+0000","last_unstale":"2024-04-01T06:54:30.358852+0000","last_undegraded":"2024-04-01T06:54:30.358852+0000","last_fullsized":"2024-04-01T06:54:30.358852+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:20:56.631811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.214238+0000","last_change":"2024-04-01T06:54:27.997806+0000","last_active":"2024-04-01T06:54:30.214238+0000","last_peered":"2024-04-01T06:54:30.214238+0000","last_clean":"2024-04-01T06:54:30.214238+0000","last_became_active":"2024-04-01T06:54:27.997490+0000","last_became_peered":"2024-04-01T06:54:27.997490+0000","last_unstale":"2024-04-01T06:54:30.214238+0000","last_undegraded":"2024-04-01T06:54:30.214238+0000","last_fullsized":"2024-04-01T06:54:30.214238+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:06:15.099390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"79'1","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:31.834090+0000","last_change":"2024-04-01T06:54:28.419639+0000","last_active":"2024-04-01T06:54:31.834090+0000","last_peered":"2024-04-01T06:54:31.834090+0000","last_clean":"2024-04-01T06:54:31.834090+0000","last_became_active":"2024-04-01T06:54:28.418081+0000","last_became_peered":"2024-04-01T06:54:28.418081+0000","last_unstale":"2024-04-01T06:54:31.834090+0000","last_undegraded":"2024-04-01T06:54:31.834090+0000","last_fullsized":"2024-04-01T06:54:31.834090+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:15:44.753121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.411587+0000","last_change":"2024-04-01T06:54:27.995854+0000","last_active":"2024-04-01T06:54:29.411587+0000","last_peered":"2024-04-01T06:54:29.411587+0000","last_clean":"2024-04-01T06:54:29.411587+0000","last_became_active":"2024-04-01T06:54:27.995540+0000","last_became_peered":"2024-04-01T06:54:27.995540+0000","last_unstale":"2024-04-01T06:54:29.411587+0000","last_undegraded":"2024-04-01T06:54:29.411587+0000","last_fullsized":"2024-04-01T06:54:29.411587+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:47:15.075909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358991+0000","last_change":"2024-04-01T06:54:28.428100+0000","last_active":"2024-04-01T06:54:30.358991+0000","last_peered":"2024-04-01T06:54:30.358991+0000","last_clean":"2024-04-01T06:54:30.358991+0000","last_became_active":"2024-04-01T06:54:28.427769+0000","last_became_peered":"2024-04-01T06:54:28.427769+0000","last_unstale":"2024-04-01T06:54:30.358991+0000","last_undegraded":"2024-04-01T06:54:30.358991+0000","last_fullsized":"2024-04-01T06:54:30.358991+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:47:18.161878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.479810+0000","last_change":"2024-04-01T06:54:28.427557+0000","last_active":"2024-04-01T06:54:30.479810+0000","last_peered":"2024-04-01T06:54:30.479810+0000","last_clean":"2024-04-01T06:54:30.479810+0000","last_became_active":"2024-04-01T06:54:28.427209+0000","last_became_peered":"2024-04-01T06:54:28.427209+0000","last_unstale":"2024-04-01T06:54:30.479810+0000","last_undegraded":"2024-04-01T06:54:30.479810+0000","last_fullsized":"2024-04-01T06:54:30.479810+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:10:06.835360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358390+0000","last_change":"2024-04-01T06:54:28.423264+0000","last_active":"2024-04-01T06:54:30.358390+0000","last_peered":"2024-04-01T06:54:30.358390+0000","last_clean":"2024-04-01T06:54:30.358390+0000","last_became_active":"2024-04-01T06:54:28.422868+0000","last_became_peered":"2024-04-01T06:54:28.422868+0000","last_unstale":"2024-04-01T06:54:30.358390+0000","last_undegraded":"2024-04-01T06:54:30.358390+0000","last_fullsized":"2024-04-01T06:54:30.358390+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:00:49.784276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358186+0000","last_change":"2024-04-01T06:54:28.417824+0000","last_active":"2024-04-01T06:54:30.358186+0000","last_peered":"2024-04-01T06:54:30.358186+0000","last_clean":"2024-04-01T06:54:30.358186+0000","last_became_active":"2024-04-01T06:54:28.417510+0000","last_became_peered":"2024-04-01T06:54:28.417510+0000","last_unstale":"2024-04-01T06:54:30.358186+0000","last_undegraded":"2024-04-01T06:54:30.358186+0000","last_fullsized":"2024-04-01T06:54:30.358186+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:40:52.024183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358330+0000","last_change":"2024-04-01T06:54:28.426099+0000","last_active":"2024-04-01T06:54:30.358330+0000","last_peered":"2024-04-01T06:54:30.358330+0000","last_clean":"2024-04-01T06:54:30.358330+0000","last_became_active":"2024-04-01T06:54:28.425745+0000","last_became_peered":"2024-04-01T06:54:28.425745+0000","last_unstale":"2024-04-01T06:54:30.358330+0000","last_undegraded":"2024-04-01T06:54:30.358330+0000","last_fullsized":"2024-04-01T06:54:30.358330+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:13:45.145447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.411652+0000","last_change":"2024-04-01T06:54:28.421892+0000","last_active":"2024-04-01T06:54:29.411652+0000","last_peered":"2024-04-01T06:54:29.411652+0000","last_clean":"2024-04-01T06:54:29.411652+0000","last_became_active":"2024-04-01T06:54:28.421582+0000","last_became_peered":"2024-04-01T06:54:28.421582+0000","last_unstale":"2024-04-01T06:54:29.411652+0000","last_undegraded":"2024-04-01T06:54:29.411652+0000","last_fullsized":"2024-04-01T06:54:29.411652+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:44:12.137335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.479910+0000","last_change":"2024-04-01T06:54:28.421013+0000","last_active":"2024-04-01T06:54:30.479910+0000","last_peered":"2024-04-01T06:54:30.479910+0000","last_clean":"2024-04-01T06:54:30.479910+0000","last_became_active":"2024-04-01T06:54:28.420339+0000","last_became_peered":"2024-04-01T06:54:28.420339+0000","last_unstale":"2024-04-01T06:54:30.479910+0000","last_undegraded":"2024-04-01T06:54:30.479910+0000","last_fullsized":"2024-04-01T06:54:30.479910+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:59:07.758542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.358708+0000","last_change":"2024-04-01T06:54:28.433203+0000","last_active":"2024-04-01T06:54:30.358708+0000","last_peered":"2024-04-01T06:54:30.358708+0000","last_clean":"2024-04-01T06:54:30.358708+0000","last_became_active":"2024-04-01T06:54:28.431890+0000","last_became_peered":"2024-04-01T06:54:28.431890+0000","last_unstale":"2024-04-01T06:54:30.358708+0000","last_undegraded":"2024-04-01T06:54:30.358708+0000","last_fullsized":"2024-04-01T06:54:30.358708+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:55:33.169722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.515418+0000","last_change":"2024-04-01T06:54:28.418425+0000","last_active":"2024-04-01T06:54:29.515418+0000","last_peered":"2024-04-01T06:54:29.515418+0000","last_clean":"2024-04-01T06:54:29.515418+0000","last_became_active":"2024-04-01T06:54:28.418165+0000","last_became_peered":"2024-04-01T06:54:28.418165+0000","last_unstale":"2024-04-01T06:54:29.515418+0000","last_undegraded":"2024-04-01T06:54:29.515418+0000","last_fullsized":"2024-04-01T06:54:29.515418+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:45:01.425680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.213976+0000","last_change":"2024-04-01T06:54:28.412058+0000","last_active":"2024-04-01T06:54:30.213976+0000","last_peered":"2024-04-01T06:54:30.213976+0000","last_clean":"2024-04-01T06:54:30.213976+0000","last_became_active":"2024-04-01T06:54:28.411680+0000","last_became_peered":"2024-04-01T06:54:28.411680+0000","last_unstale":"2024-04-01T06:54:30.213976+0000","last_undegraded":"2024-04-01T06:54:30.213976+0000","last_fullsized":"2024-04-01T06:54:30.213976+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:21:05.628262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.515699+0000","last_change":"2024-04-01T06:54:28.422304+0000","last_active":"2024-04-01T06:54:29.515699+0000","last_peered":"2024-04-01T06:54:29.515699+0000","last_clean":"2024-04-01T06:54:29.515699+0000","last_became_active":"2024-04-01T06:54:28.422023+0000","last_became_peered":"2024-04-01T06:54:28.422023+0000","last_unstale":"2024-04-01T06:54:29.515699+0000","last_undegraded":"2024-04-01T06:54:29.515699+0000","last_fullsized":"2024-04-01T06:54:29.515699+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:26:45.810780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.413317+0000","last_change":"2024-04-01T06:54:28.420350+0000","last_active":"2024-04-01T06:54:29.413317+0000","last_peered":"2024-04-01T06:54:29.413317+0000","last_clean":"2024-04-01T06:54:29.413317+0000","last_became_active":"2024-04-01T06:54:28.419995+0000","last_became_peered":"2024-04-01T06:54:28.419995+0000","last_unstale":"2024-04-01T06:54:29.413317+0000","last_undegraded":"2024-04-01T06:54:29.413317+0000","last_fullsized":"2024-04-01T06:54:29.413317+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:30:20.831966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:29.411779+0000","last_change":"2024-04-01T06:54:28.417067+0000","last_active":"2024-04-01T06:54:29.411779+0000","last_peered":"2024-04-01T06:54:29.411779+0000","last_clean":"2024-04-01T06:54:29.411779+0000","last_became_active":"2024-04-01T06:54:28.416796+0000","last_became_peered":"2024-04-01T06:54:28.416796+0000","last_unstale":"2024-04-01T06:54:29.411779+0000","last_undegraded":"2024-04-01T06:54:29.411779+0000","last_fullsized":"2024-04-01T06:54:29.411779+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:39:43.396643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-01T06:54:30.479743+0000","last_change":"2024-04-01T06:54:28.424971+0000","last_active":"2024-04-01T06:54:30.479743+0000","last_peered":"2024-04-01T06:54:30.479743+0000","last_clean":"2024-04-01T06:54:30.479743+0000","last_became_active":"2024-04-01T06:54:28.424664+0000","last_became_peered":"2024-04-01T06:54:28.424664+0000","last_unstale":"2024-04-01T06:54:30.479743+0000","last_undegraded":"2024-04-01T06:54:30.479743+0000","last_fullsized":"2024-04-01T06:54:30.479743+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:03:51.434412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":246668,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65300,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":237,"num_read_kb":189,"num_write":151,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":195900,"data_compressed":5598,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579921,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":851968,"data_stored":408952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:54:55 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.59599999999999997}]},{"osd":1,"last update":"Mon Apr 1 06:54:55 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.628},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.58599999999999997}]},{"osd":2,"last update":"Mon Apr 1 06:54:55 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.54700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":4,"last update":"Mon Apr 1 06:54:55 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":3.1970000000000001,"5min":3.1970000000000001,"15min":3.1970000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.748}]},{"osd":5,"last update":"Mon Apr 1 06:54:55 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.437},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.47999999999999998}]},{"osd":6,"last update":"Mon Apr 1 06:54:55 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.56299999999999994}]},{"osd":7,"last update":"Mon Apr 1 06:54:55 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":3.3479999999999999,"5min":3.3479999999999999,"15min":3.3479999999999999},"last":0.71799999999999997}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":9,"last update":"Mon Apr 1 06:54:55 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1,"5min":1,"15min":1},"last":0.67000000000000004}]},{"osd":10,"last update":"Mon Apr 1 06:54:55 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.76100000000000001}]}]},{"osd":10,"up_from":67,"seq":287762808853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":999424,"data_stored":1061778,"data_compressed":37572,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":1,"last update":"Mon Apr 1 06:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.45500000000000002}]},{"osd":2,"last update":"Mon Apr 1 06:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.75600000000000001}]},{"osd":3,"last update":"Mon Apr 1 06:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.64100000000000001}]},{"osd":4,"last update":"Mon Apr 1 06:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.627}]},{"osd":5,"last update":"Mon Apr 1 06:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.65600000000000003}]},{"osd":6,"last update":"Mon Apr 1 06:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.74399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":8,"last update":"Mon Apr 1 06:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.79900000000000004}]},{"osd":9,"last update":"Mon Apr 1 06:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.77700000000000002}]},{"osd":11,"last update":"Mon Apr 1 06:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.82499999999999996}]}]},{"osd":9,"up_from":62,"seq":266287972377,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31960,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713192,"statfs":{"total":95995035648,"available":95962308608,"internally_reserved":0,"allocated":868352,"data_stored":409188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:54:22 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.32100000000000001}]},{"osd":1,"last update":"Mon Apr 1 06:54:22 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.46899999999999997}]},{"osd":2,"last update":"Mon Apr 1 06:54:22 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.41299999999999998}]},{"osd":3,"last update":"Mon Apr 1 06:54:22 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.49099999999999999}]},{"osd":4,"last update":"Mon Apr 1 06:54:22 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.502},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.48299999999999998}]},{"osd":5,"last update":"Mon Apr 1 06:54:22 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.435},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":0.53000000000000003}]},{"osd":6,"last update":"Mon Apr 1 06:54:22 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.53700000000000003}]},{"osd":7,"last update":"Mon Apr 1 06:54:22 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.54900000000000004}]},{"osd":8,"last update":"Mon Apr 1 06:54:22 2024","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":5.6600000000000001,"5min":5.6600000000000001,"15min":5.6600000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":5.6070000000000002,"5min":5.6070000000000002,"15min":5.6070000000000002},"last":0.59199999999999997}]},{"osd":10,"last update":"Mon Apr 1 06:54:39 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.55600000000000005}]}]},{"osd":8,"up_from":55,"seq":236223201309,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31956,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713196,"statfs":{"total":95995035648,"available":95962312704,"internally_reserved":0,"allocated":864256,"data_stored":408777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:55:08 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52900000000000003,"15min":0.53300000000000003},"min":{"1min":0.379,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.72099999999999997,"5min":0.747,"15min":0.747},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.54000000000000004,"15min":0.54400000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.65600000000000003,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.48999999999999999}]},{"osd":1,"last update":"Mon Apr 1 06:55:08 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.57899999999999996,"15min":0.56699999999999995},"min":{"1min":0.38400000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.58699999999999997,"15min":0.58199999999999996},"min":{"1min":0.35199999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.82999999999999996,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.70099999999999996}]},{"osd":2,"last update":"Mon Apr 1 06:55:08 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.46100000000000002,"15min":0.442},"min":{"1min":0.30199999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.46600000000000003,"15min":0.45100000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.56799999999999995}]},{"osd":3,"last update":"Mon Apr 1 06:55:08 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.749,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.56000000000000005,"15min":0.55400000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78600000000000003,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.52000000000000002}]},{"osd":4,"last update":"Mon Apr 1 06:55:08 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.58599999999999997,"15min":0.57899999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.85299999999999998,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.61399999999999999,"15min":0.59599999999999997},"min":{"1min":0.47499999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.77500000000000002}]},{"osd":5,"last update":"Mon Apr 1 06:55:08 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.53400000000000003,"15min":0.52000000000000002},"min":{"1min":0.41199999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.626},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.55300000000000005,"15min":0.53700000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.65000000000000002}]},{"osd":6,"last update":"Mon Apr 1 06:55:08 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.64500000000000002,"15min":0.629},"min":{"1min":0.51700000000000002,"5min":0.433,"15min":0.433},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.67200000000000004,"15min":0.66200000000000003},"min":{"1min":0.54000000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.755}]},{"osd":7,"last update":"Mon Apr 1 06:55:08 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.68300000000000005,"15min":0.67100000000000004},"min":{"1min":0.50900000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.92700000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.745,"5min":0.68899999999999995,"15min":0.68000000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.82499999999999996}]},{"osd":9,"last update":"Mon Apr 1 06:54:24 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.876}]},{"osd":10,"last update":"Mon Apr 1 06:54:43 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.92500000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]}]},{"osd":7,"up_from":48,"seq":206158430238,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32008,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713144,"statfs":{"total":95995035648,"available":95962259456,"internally_reserved":0,"allocated":917504,"data_stored":1001337,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:53:48 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.41099999999999998}]},{"osd":1,"last update":"Mon Apr 1 06:54:51 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.39400000000000002,"15min":0.38800000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.42399999999999999,"15min":0.41599999999999998},"min":{"1min":0.32700000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.59199999999999997}]},{"osd":2,"last update":"Mon Apr 1 06:54:51 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.56499999999999995,"15min":0.56100000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.56200000000000006,"15min":0.55400000000000005},"min":{"1min":0.42799999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.80200000000000005,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.79500000000000004}]},{"osd":3,"last update":"Mon Apr 1 06:54:51 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.56599999999999995,"15min":0.56000000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.74299999999999999,"5min":0.755,"15min":0.755},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.58799999999999997,"15min":0.58399999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.80300000000000005,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.76200000000000001}]},{"osd":4,"last update":"Mon Apr 1 06:54:51 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.51000000000000001,"15min":0.505},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.51000000000000001,"15min":0.50700000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.73999999999999999}]},{"osd":5,"last update":"Mon Apr 1 06:54:51 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.60599999999999998,"15min":0.59599999999999997},"min":{"1min":0.46700000000000003,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.63600000000000001,"15min":0.63},"min":{"1min":0.501,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.86799999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.83499999999999996}]},{"osd":6,"last update":"Mon Apr 1 06:54:51 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.47599999999999998,"5min":0.443,"15min":0.443},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.439,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.81200000000000006}]},{"osd":8,"last update":"Mon Apr 1 06:55:05 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.68600000000000005,"15min":0.68000000000000005},"min":{"1min":0.56699999999999995,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.52000000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.91300000000000003,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.89700000000000002}]},{"osd":9,"last update":"Mon Apr 1 06:54:24 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.874}]},{"osd":10,"last update":"Mon Apr 1 06:54:44 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.94699999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]}]},{"osd":6,"up_from":43,"seq":184683593763,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":856064,"data_stored":408577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:54:35 2024","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.34000000000000002,"15min":0.33100000000000002},"min":{"1min":0.247,"5min":0.246,"15min":0.246},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.36699999999999999,"15min":0.36099999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.32100000000000001}]},{"osd":1,"last update":"Mon Apr 1 06:54:35 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.501,"15min":0.48299999999999998},"min":{"1min":0.36099999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.51200000000000001,"15min":0.504},"min":{"1min":0.42399999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.68500000000000005,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.44700000000000001}]},{"osd":2,"last update":"Mon Apr 1 06:54:35 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.52400000000000002,"15min":0.51400000000000001},"min":{"1min":0.38600000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76800000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56999999999999995,"15min":0.56599999999999995},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.88100000000000001,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.59099999999999997}]},{"osd":3,"last update":"Mon Apr 1 06:54:35 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.42699999999999999,"15min":0.42199999999999999},"min":{"1min":0.30499999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.77400000000000002,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.504,"5min":0.44800000000000001,"15min":0.439},"min":{"1min":0.32700000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.37}]},{"osd":4,"last update":"Mon Apr 1 06:54:35 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.52600000000000002,"15min":0.51400000000000001},"min":{"1min":0.39100000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.55900000000000005,"15min":0.54300000000000004},"min":{"1min":0.47999999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.46999999999999997}]},{"osd":5,"last update":"Mon Apr 1 06:54:35 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.61299999999999999,"15min":0.60299999999999998},"min":{"1min":0.45300000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.624},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.61799999999999999,"15min":0.61099999999999999},"min":{"1min":0.42099999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.88500000000000001,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.63600000000000001}]},{"osd":7,"last update":"Mon Apr 1 06:54:49 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.621,"15min":0.625},"min":{"1min":0.437,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.83699999999999997,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.436},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.65200000000000002,"15min":0.65000000000000002},"min":{"1min":0.52400000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.82399999999999995,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.49199999999999999}]},{"osd":8,"last update":"Mon Apr 1 06:55:08 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.67600000000000005,"15min":0.68500000000000005},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.88800000000000001,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.65900000000000003,"15min":0.66300000000000003},"min":{"1min":0.51000000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.80600000000000005,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.67800000000000005}]},{"osd":9,"last update":"Mon Apr 1 06:54:26 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.504}]},{"osd":10,"last update":"Mon Apr 1 06:54:40 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.61499999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32004,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713148,"statfs":{"total":95995035648,"available":95962263552,"internally_reserved":0,"allocated":913408,"data_stored":469370,"data_compressed":1866,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:54:16 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.48499999999999999,"15min":0.46600000000000003},"min":{"1min":0.32800000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.501,"15min":0.48099999999999998},"min":{"1min":0.35499999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.495}]},{"osd":2,"last update":"Mon Apr 1 06:54:28 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.55300000000000005,"15min":0.53800000000000003},"min":{"1min":0.42899999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.53600000000000003,"15min":0.52200000000000002},"min":{"1min":0.38800000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.65800000000000003}]},{"osd":3,"last update":"Mon Apr 1 06:54:43 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.55400000000000005,"15min":0.53500000000000003},"min":{"1min":0.39700000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.58199999999999996,"15min":0.55000000000000004},"min":{"1min":0.48499999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.60699999999999998}]},{"osd":4,"last update":"Mon Apr 1 06:55:03 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.443,"15min":0.41199999999999998},"min":{"1min":0.379,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.46200000000000002,"15min":0.42099999999999999},"min":{"1min":0.35599999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.72199999999999998}]},{"osd":5,"last update":"Mon Apr 1 06:54:16 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.58899999999999997,"15min":0.58499999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.56799999999999995,"15min":0.56000000000000005},"min":{"1min":0.44600000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.69399999999999995}]},{"osd":6,"last update":"Mon Apr 1 06:54:33 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.56999999999999995,"15min":0.55100000000000005},"min":{"1min":0.47099999999999997,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.58499999999999996,"15min":0.56799999999999995},"min":{"1min":0.51500000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.63700000000000001}]},{"osd":7,"last update":"Mon Apr 1 06:54:48 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.59599999999999997,"15min":0.58299999999999996},"min":{"1min":0.436,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.63400000000000001,"15min":0.622},"min":{"1min":0.54800000000000004,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.90700000000000003,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.67700000000000005}]},{"osd":8,"last update":"Mon Apr 1 06:55:07 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.69699999999999995,"15min":0.69199999999999995},"min":{"1min":0.499,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.73899999999999999,"15min":0.73099999999999998},"min":{"1min":0.63700000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.94599999999999995,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.81799999999999995}]},{"osd":9,"last update":"Mon Apr 1 06:54:25 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.627},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.80300000000000005}]},{"osd":10,"last update":"Mon Apr 1 06:54:43 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.752}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738424,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":876544,"data_stored":409848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Apr 1 06:54:08 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.47899999999999998,"15min":0.46500000000000002},"min":{"1min":0.29299999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69099999999999995,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.625},{"interface":"front","average":{"1min":0.495,"5min":0.47299999999999998,"15min":0.46999999999999997},"min":{"1min":0.32800000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.64800000000000002,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.53700000000000003}]},{"osd":2,"last update":"Mon Apr 1 06:54:28 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.47799999999999998,"15min":0.46400000000000002},"min":{"1min":0.317,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.66900000000000004,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.5,"5min":0.48599999999999999,"15min":0.47999999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.64200000000000002,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.434}]},{"osd":3,"last update":"Mon Apr 1 06:53:44 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.26200000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.59399999999999997,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.38900000000000001,"15min":0.379},"min":{"1min":0.29699999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.64200000000000002,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.27700000000000002}]},{"osd":4,"last update":"Mon Apr 1 06:55:03 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.50900000000000001,"15min":0.501},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.71099999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.502},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.52500000000000002,"15min":0.51300000000000001},"min":{"1min":0.40799999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.69499999999999995,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.58799999999999997}]},{"osd":5,"last update":"Mon Apr 1 06:54:15 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53300000000000003,"15min":0.52900000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52400000000000002,"15min":0.52500000000000002},"min":{"1min":0.38700000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.747,"5min":0.748,"15min":0.748},"last":0.47899999999999998}]},{"osd":6,"last update":"Mon Apr 1 06:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.44,"15min":0.436},"min":{"1min":0.33200000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.311},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.502,"15min":0.50600000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.36099999999999999}]},{"osd":7,"last update":"Mon Apr 1 06:53:50 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.46000000000000002}]},{"osd":8,"last update":"Mon Apr 1 06:54:08 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.52000000000000002}]},{"osd":9,"last update":"Mon Apr 1 06:54:21 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.40100000000000002}]},{"osd":10,"last update":"Mon Apr 1 06:54:43 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.61499999999999999}]},{"osd":11,"last update":"Mon Apr 1 06:55:03 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.55900000000000005}]}]},{"osd":2,"up_from":18,"seq":77309411377,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":937984,"data_stored":471065,"data_compressed":1866,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:54:27 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.48399999999999999,"15min":0.46700000000000003},"min":{"1min":0.33900000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.65600000000000003,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.46899999999999997,"15min":0.45700000000000002},"min":{"1min":0.35799999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.65600000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.38400000000000001}]},{"osd":1,"last update":"Mon Apr 1 06:54:27 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.52300000000000002,"15min":0.51300000000000001},"min":{"1min":0.42499999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.53900000000000003,"15min":0.53500000000000003},"min":{"1min":0.39800000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.435}]},{"osd":3,"last update":"Mon Apr 1 06:54:45 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.53500000000000003,"15min":0.52900000000000003},"min":{"1min":0.40899999999999997,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.71199999999999997,"5min":0.748,"15min":0.748},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56200000000000006,"15min":0.54600000000000004},"min":{"1min":0.434,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77500000000000002,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.57699999999999996}]},{"osd":4,"last update":"Mon Apr 1 06:53:59 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.54300000000000004,"15min":0.53700000000000003},"min":{"1min":0.42299999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.53400000000000003,"15min":0.52700000000000002},"min":{"1min":0.45900000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71699999999999997,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.51100000000000001}]},{"osd":5,"last update":"Mon Apr 1 06:54:15 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.45500000000000002,"15min":0.44900000000000001},"min":{"1min":0.317,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.74199999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.46300000000000002,"15min":0.45900000000000002},"min":{"1min":0.32600000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.68999999999999995,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.625}]},{"osd":6,"last update":"Mon Apr 1 06:54:33 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.42099999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.88,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63400000000000001,"15min":0.63},"min":{"1min":0.45700000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.72499999999999998}]},{"osd":7,"last update":"Mon Apr 1 06:53:49 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.60099999999999998}]},{"osd":8,"last update":"Mon Apr 1 06:55:06 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.67900000000000005,"15min":0.68200000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60599999999999998,"15min":0.60399999999999998},"min":{"1min":0.438,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.55800000000000005}]},{"osd":9,"last update":"Mon Apr 1 06:54:24 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.76400000000000001}]},{"osd":10,"last update":"Mon Apr 1 06:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.78000000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]}]},{"osd":3,"up_from":25,"seq":107374182445,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31960,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713192,"statfs":{"total":95995035648,"available":95962308608,"internally_reserved":0,"allocated":868352,"data_stored":408557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:54:41 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.33900000000000002,"15min":0.33000000000000002},"min":{"1min":0.29499999999999998,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.34599999999999997,"15min":0.33500000000000002},"min":{"1min":0.26400000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.57999999999999996,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.505}]},{"osd":1,"last update":"Mon Apr 1 06:54:41 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.52900000000000003,"15min":0.51600000000000001},"min":{"1min":0.38800000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.51400000000000001,"15min":0.499},"min":{"1min":0.39400000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76900000000000002,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.57099999999999995}]},{"osd":2,"last update":"Mon Apr 1 06:54:41 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.52400000000000002,"15min":0.51400000000000001},"min":{"1min":0.35599999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.68899999999999995,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.54000000000000004,"15min":0.53000000000000003},"min":{"1min":0.41799999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.85199999999999998,"5min":0.874,"15min":0.874},"last":0.53300000000000003}]},{"osd":4,"last update":"Mon Apr 1 06:55:02 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53900000000000003,"15min":0.52700000000000002},"min":{"1min":0.40200000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.745,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56699999999999995,"15min":0.55700000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80600000000000005,"5min":1.131,"15min":1.131},"last":0.61699999999999999}]},{"osd":5,"last update":"Mon Apr 1 06:54:16 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.51500000000000001,"15min":0.50900000000000001},"min":{"1min":0.40699999999999997,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.628},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.56000000000000005,"15min":0.55200000000000005},"min":{"1min":0.39800000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73199999999999998,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.68600000000000005}]},{"osd":6,"last update":"Mon Apr 1 06:54:35 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.435,"15min":0.42799999999999999},"min":{"1min":0.314,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.47399999999999998,"15min":0.46800000000000003},"min":{"1min":0.34599999999999997,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.67100000000000004}]},{"osd":7,"last update":"Mon Apr 1 06:54:56 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.42199999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.75700000000000001,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.63300000000000001,"15min":0.63500000000000001},"min":{"1min":0.41499999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.85799999999999998,"5min":1.171,"15min":1.171},"last":0.70699999999999996}]},{"osd":8,"last update":"Mon Apr 1 06:54:04 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.71999999999999997}]},{"osd":9,"last update":"Mon Apr 1 06:54:23 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.745},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.66300000000000003}]},{"osd":10,"last update":"Mon Apr 1 06:54:40 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.73699999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]}]},{"osd":4,"up_from":32,"seq":137438953514,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":860160,"data_stored":409359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:54:02 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.496,"15min":0.48799999999999999},"min":{"1min":0.34899999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.433},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.48299999999999998,"15min":0.47699999999999998},"min":{"1min":0.30399999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.41799999999999998}]},{"osd":1,"last update":"Mon Apr 1 06:55:03 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.35199999999999998,"15min":0.33400000000000002},"min":{"1min":0.251,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.36499999999999999,"15min":0.35299999999999998},"min":{"1min":0.29099999999999998,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.42699999999999999}]},{"osd":2,"last update":"Mon Apr 1 06:55:03 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.51200000000000001,"15min":0.496},"min":{"1min":0.435,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.52100000000000002,"15min":0.48899999999999999},"min":{"1min":0.40699999999999997,"5min":0.316,"15min":0.316},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.55000000000000004}]},{"osd":3,"last update":"Mon Apr 1 06:55:03 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.53400000000000003,"15min":0.52900000000000003},"min":{"1min":0.36899999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.73499999999999999,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.51400000000000001,"15min":0.498},"min":{"1min":0.39200000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.44700000000000001}]},{"osd":5,"last update":"Mon Apr 1 06:54:15 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.55000000000000004,"15min":0.54500000000000004},"min":{"1min":0.40300000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.54000000000000004,"15min":0.54400000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.624,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.56799999999999995}]},{"osd":6,"last update":"Mon Apr 1 06:54:37 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.54400000000000004,"15min":0.54000000000000004},"min":{"1min":0.40500000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.498,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.01,"5min":2.52,"15min":2.52},"last":0.51200000000000001}]},{"osd":7,"last update":"Mon Apr 1 06:54:48 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.34200000000000003,"5min":0.316,"15min":0.316},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.624},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.51500000000000001,"15min":0.51200000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.5}]},{"osd":8,"last update":"Mon Apr 1 06:54:05 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.67200000000000004}]},{"osd":9,"last update":"Mon Apr 1 06:54:21 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.65200000000000002}]},{"osd":10,"last update":"Mon Apr 1 06:54:43 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.60399999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]}]},{"osd":5,"up_from":36,"seq":154618822695,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":929792,"data_stored":1000676,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:54:13 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.496,"15min":0.48299999999999998},"min":{"1min":0.41299999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.624},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.498,"15min":0.49299999999999999},"min":{"1min":0.39800000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.52500000000000002}]},{"osd":1,"last update":"Mon Apr 1 06:54:13 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.53000000000000003,"15min":0.52400000000000002},"min":{"1min":0.42599999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.69899999999999995,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53200000000000003,"15min":0.52700000000000002},"min":{"1min":0.40799999999999997,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.73199999999999998,"5min":0.753,"15min":0.753},"last":0.77000000000000002}]},{"osd":2,"last update":"Mon Apr 1 06:54:13 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.38600000000000001,"15min":0.38400000000000001},"min":{"1min":0.28899999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39900000000000002,"15min":0.40000000000000002},"min":{"1min":0.29399999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.503}]},{"osd":3,"last update":"Mon Apr 1 06:54:13 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.39800000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.83899999999999997,"5min":1.389,"15min":1.389},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.65900000000000003,"15min":0.67500000000000004},"min":{"1min":0.38500000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.73799999999999999,"5min":3.9540000000000002,"15min":3.9540000000000002},"last":0.64500000000000002}]},{"osd":4,"last update":"Mon Apr 1 06:54:13 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.55200000000000005,"15min":0.54600000000000004},"min":{"1min":0.46400000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.70699999999999996,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.75700000000000001,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.747}]},{"osd":6,"last update":"Mon Apr 1 06:54:33 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.55700000000000005,"15min":0.55300000000000005},"min":{"1min":0.39300000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.78400000000000003,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.57599999999999996,"15min":0.57299999999999995},"min":{"1min":0.46400000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76200000000000001,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.69399999999999995}]},{"osd":7,"last update":"Mon Apr 1 06:54:49 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64200000000000002,"15min":0.64000000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.86499999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.65600000000000003,"15min":0.65000000000000002},"min":{"1min":0.53000000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.80300000000000005}]},{"osd":8,"last update":"Mon Apr 1 06:55:05 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.622,"15min":0.623},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.61199999999999999,"15min":0.60799999999999998},"min":{"1min":0.42999999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.71099999999999997}]},{"osd":9,"last update":"Mon Apr 1 06:54:22 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.82799999999999996}]},{"osd":10,"last update":"Mon Apr 1 06:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.85399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34069,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34069,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":61000,"data_compressed":1866,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":62695,"data_compressed":1866,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":62923,"data_compressed":1866,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T06:55:10.514 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-04-01T06:55:10.514 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-01T06:55:10.514 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-04-01T06:55:10.514 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph health --format=json 2024-04-01T06:55:10.736 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:55:11.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:10 smithi145 ceph-mon[47816]: pgmap v237: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2024-04-01T06:55:11.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:10 smithi083 ceph-mon[43429]: pgmap v237: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2024-04-01T06:55:11.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:10 smithi153 ceph-mon[48187]: pgmap v237: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2024-04-01T06:55:11.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:11.796+0000 7fc8f6b68700 1 -- 172.21.15.83:0/3480119329 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc8f00ff750 msgr2=0x7fc8f00ffbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:11.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:11.796+0000 7fc8f6b68700 1 --2- 172.21.15.83:0/3480119329 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc8f00ff750 0x7fc8f00ffbb0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc009990 tx=0x7fc8dc009ca0 comp rx=0 tx=0).stop 2024-04-01T06:55:11.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:11.796+0000 7fc8f6b68700 1 -- 172.21.15.83:0/3480119329 shutdown_connections 2024-04-01T06:55:11.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:11.796+0000 7fc8f6b68700 1 --2- 172.21.15.83:0/3480119329 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc8f01000f0 0x7fc8f010db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:11.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:11.796+0000 7fc8f6b68700 1 --2- 172.21.15.83:0/3480119329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8f0105e90 0x7fc8f0106270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:11.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:11.796+0000 7fc8f6b68700 1 --2- 172.21.15.83:0/3480119329 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc8f00ff750 0x7fc8f00ffbb0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:11.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:11.796+0000 7fc8f6b68700 1 -- 172.21.15.83:0/3480119329 >> 172.21.15.83:0/3480119329 conn(0x7fc8f0074fd0 msgr2=0x7fc8f00753e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:11.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:11.796+0000 7fc8f6b68700 1 -- 172.21.15.83:0/3480119329 shutdown_connections 2024-04-01T06:55:11.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:11.796+0000 7fc8f6b68700 1 -- 172.21.15.83:0/3480119329 wait complete. 2024-04-01T06:55:11.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:11.797+0000 7fc8f6b68700 1 Processor -- start 2024-04-01T06:55:11.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:11.797+0000 7fc8f6b68700 1 -- start start 2024-04-01T06:55:11.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:11.797+0000 7fc8f6b68700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc8f00ff750 0x7fc8f0100930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:11.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:11.797+0000 7fc8f6b68700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8f01000f0 0x7fc8f0100e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:11.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:11.797+0000 7fc8f6b68700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc8f0105e90 0x7fc8f01013b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:11.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:11.797+0000 7fc8f6b68700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f01a56d0 con 0x7fc8f00ff750 2024-04-01T06:55:11.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:11.797+0000 7fc8f6b68700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f01a5840 con 0x7fc8f0105e90 2024-04-01T06:55:11.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:11.797+0000 7fc8f6b68700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f01a5a00 con 0x7fc8f01000f0 2024-04-01T06:55:11.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:11.797+0000 7fc8f4904700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc8f00ff750 0x7fc8f0100930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:11.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:11.797+0000 7fc8f4904700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc8f00ff750 0x7fc8f0100930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:50468/0 (socket says 172.21.15.83:50468) 2024-04-01T06:55:11.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:11.797+0000 7fc8f4904700 1 -- 172.21.15.83:0/3434667911 learned_addr learned my addr 172.21.15.83:0/3434667911 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:11.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:11.798+0000 7fc8f4904700 1 -- 172.21.15.83:0/3434667911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8f01000f0 msgr2=0x7fc8f0100e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:11.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:11.798+0000 7fc8f4904700 1 --2- 172.21.15.83:0/3434667911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8f01000f0 0x7fc8f0100e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:11.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:11.798+0000 7fc8f4904700 1 -- 172.21.15.83:0/3434667911 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc8f0105e90 msgr2=0x7fc8f01013b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:11.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:11.798+0000 7fc8f5105700 1 --2- 172.21.15.83:0/3434667911 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc8f0105e90 0x7fc8f01013b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:11.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:11.798+0000 7fc8f4904700 1 --2- 172.21.15.83:0/3434667911 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc8f0105e90 0x7fc8f01013b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:11.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:11.798+0000 7fc8f4904700 1 -- 172.21.15.83:0/3434667911 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8dc0095f0 con 0x7fc8f00ff750 2024-04-01T06:55:11.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:11.798+0000 7fc8f5105700 1 --2- 172.21.15.83:0/3434667911 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc8f0105e90 0x7fc8f01013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:55:11.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:11.798+0000 7fc8f4904700 1 --2- 172.21.15.83:0/3434667911 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc8f00ff750 0x7fc8f0100930 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc8e400b500 tx=0x7fc8e400b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:11.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:11.798+0000 7fc8edffb700 1 -- 172.21.15.83:0/3434667911 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e4011830 con 0x7fc8f00ff750 2024-04-01T06:55:11.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:11.798+0000 7fc8f6b68700 1 -- 172.21.15.83:0/3434667911 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8f01a5ce0 con 0x7fc8f00ff750 2024-04-01T06:55:11.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:11.798+0000 7fc8edffb700 1 -- 172.21.15.83:0/3434667911 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc8e4011e50 con 0x7fc8f00ff750 2024-04-01T06:55:11.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:11.798+0000 7fc8edffb700 1 -- 172.21.15.83:0/3434667911 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e400f2e0 con 0x7fc8f00ff750 2024-04-01T06:55:11.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:11.798+0000 7fc8f6b68700 1 -- 172.21.15.83:0/3434667911 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8f01a6190 con 0x7fc8f00ff750 2024-04-01T06:55:11.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:11.799+0000 7fc8f6b68700 1 -- 172.21.15.83:0/3434667911 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8f01092f0 con 0x7fc8f00ff750 2024-04-01T06:55:11.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:11.800+0000 7fc8edffb700 1 -- 172.21.15.83:0/3434667911 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7fc8e4010580 con 0x7fc8f00ff750 2024-04-01T06:55:11.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:11.800+0000 7fc8edffb700 1 --2- 172.21.15.83:0/3434667911 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fc8e00a11b0 0x7fc8e00a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:11.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:11.801+0000 7fc8effff700 1 --2- 172.21.15.83:0/3434667911 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fc8e00a11b0 0x7fc8e00a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:11.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:11.801+0000 7fc8edffb700 1 -- 172.21.15.83:0/3434667911 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fc8e40cc3d0 con 0x7fc8f00ff750 2024-04-01T06:55:11.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:11.801+0000 7fc8effff700 1 --2- 172.21.15.83:0/3434667911 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fc8e00a11b0 0x7fc8e00a3670 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc0098e0 tx=0x7fc8dc005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:11.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:11.805+0000 7fc8edffb700 1 -- 172.21.15.83:0/3434667911 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7fc8e4095bc0 con 0x7fc8f00ff750 2024-04-01T06:55:12.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:11 smithi145 ceph-mon[47816]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T06:55:12.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:11 smithi083 ceph-mon[43429]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T06:55:12.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.043+0000 7fc8f6b68700 1 -- 172.21.15.83:0/3434667911 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fc8f0101e10 con 0x7fc8f00ff750 2024-04-01T06:55:12.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.043+0000 7fc8edffb700 1 -- 172.21.15.83:0/3434667911 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fc8e40991e0 con 0x7fc8f00ff750 2024-04-01T06:55:12.043 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:55:12.043 INFO:teuthology.orchestra.run.smithi083.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-01T06:55:12.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.045+0000 7fc8f6b68700 1 -- 172.21.15.83:0/3434667911 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fc8e00a11b0 msgr2=0x7fc8e00a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:12.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.045+0000 7fc8f6b68700 1 --2- 172.21.15.83:0/3434667911 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fc8e00a11b0 0x7fc8e00a3670 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc0098e0 tx=0x7fc8dc005fb0 comp rx=0 tx=0).stop 2024-04-01T06:55:12.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.045+0000 7fc8f6b68700 1 -- 172.21.15.83:0/3434667911 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc8f00ff750 msgr2=0x7fc8f0100930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:12.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.045+0000 7fc8f6b68700 1 --2- 172.21.15.83:0/3434667911 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc8f00ff750 0x7fc8f0100930 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc8e400b500 tx=0x7fc8e400b8c0 comp rx=0 tx=0).stop 2024-04-01T06:55:12.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.045+0000 7fc8f6b68700 1 -- 172.21.15.83:0/3434667911 shutdown_connections 2024-04-01T06:55:12.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.045+0000 7fc8f6b68700 1 --2- 172.21.15.83:0/3434667911 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc8f00ff750 0x7fc8f0100930 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:12.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.045+0000 7fc8f6b68700 1 --2- 172.21.15.83:0/3434667911 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fc8e00a11b0 0x7fc8e00a3670 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:12.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.045+0000 7fc8f6b68700 1 --2- 172.21.15.83:0/3434667911 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc8f0105e90 0x7fc8f01013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:12.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.045+0000 7fc8f6b68700 1 --2- 172.21.15.83:0/3434667911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8f01000f0 0x7fc8f0100e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:12.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.045+0000 7fc8f6b68700 1 -- 172.21.15.83:0/3434667911 >> 172.21.15.83:0/3434667911 conn(0x7fc8f0074fd0 msgr2=0x7fc8f00fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:12.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.045+0000 7fc8f6b68700 1 -- 172.21.15.83:0/3434667911 shutdown_connections 2024-04-01T06:55:12.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.045+0000 7fc8f6b68700 1 -- 172.21.15.83:0/3434667911 wait complete. 2024-04-01T06:55:12.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:11 smithi153 ceph-mon[48187]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T06:55:12.408 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-04-01T06:55:12.409 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T06:55:12.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.537+0000 7f8e94641700 1 -- 172.21.15.83:0/562900126 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e8c100d70 msgr2=0x7f8e8c1011d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:12.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.537+0000 7f8e94641700 1 --2- 172.21.15.83:0/562900126 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e8c100d70 0x7f8e8c1011d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c0099c0 tx=0x7f8e7c009cd0 comp rx=0 tx=0).stop 2024-04-01T06:55:12.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.537+0000 7f8e94641700 1 -- 172.21.15.83:0/562900126 shutdown_connections 2024-04-01T06:55:12.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.537+0000 7f8e94641700 1 --2- 172.21.15.83:0/562900126 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e8c101710 0x7f8e8c107fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:12.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.537+0000 7f8e94641700 1 --2- 172.21.15.83:0/562900126 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e8c0ffb80 0x7f8e8c0fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:12.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.537+0000 7f8e94641700 1 --2- 172.21.15.83:0/562900126 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e8c100d70 0x7f8e8c1011d0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:12.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.537+0000 7f8e94641700 1 -- 172.21.15.83:0/562900126 >> 172.21.15.83:0/562900126 conn(0x7f8e8c0fb0f0 msgr2=0x7f8e8c0fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:12.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.537+0000 7f8e94641700 1 -- 172.21.15.83:0/562900126 shutdown_connections 2024-04-01T06:55:12.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.537+0000 7f8e94641700 1 -- 172.21.15.83:0/562900126 wait complete. 2024-04-01T06:55:12.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.537+0000 7f8e94641700 1 Processor -- start 2024-04-01T06:55:12.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.537+0000 7f8e94641700 1 -- start start 2024-04-01T06:55:12.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.538+0000 7f8e94641700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e8c0ffb80 0x7f8e8c10ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:12.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.538+0000 7f8e94641700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e8c100d70 0x7f8e8c10b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:12.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.538+0000 7f8e94641700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e8c101710 0x7f8e8c10b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:12.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.538+0000 7f8e94641700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8c10bdf0 con 0x7f8e8c100d70 2024-04-01T06:55:12.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.538+0000 7f8e94641700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8c10bf60 con 0x7f8e8c101710 2024-04-01T06:55:12.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.538+0000 7f8e94641700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8c1a0cb0 con 0x7f8e8c0ffb80 2024-04-01T06:55:12.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.538+0000 7f8e91bdc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e8c100d70 0x7f8e8c10b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:12.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.538+0000 7f8e91bdc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e8c100d70 0x7f8e8c10b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:50496/0 (socket says 172.21.15.83:50496) 2024-04-01T06:55:12.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.538+0000 7f8e91bdc700 1 -- 172.21.15.83:0/645676730 learned_addr learned my addr 172.21.15.83:0/645676730 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:12.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.538+0000 7f8e92bde700 1 --2- 172.21.15.83:0/645676730 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e8c101710 0x7f8e8c10b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:12.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.538+0000 7f8e923dd700 1 --2- 172.21.15.83:0/645676730 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e8c0ffb80 0x7f8e8c10ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:12.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.538+0000 7f8e91bdc700 1 -- 172.21.15.83:0/645676730 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e8c0ffb80 msgr2=0x7f8e8c10ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:12.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.538+0000 7f8e91bdc700 1 --2- 172.21.15.83:0/645676730 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e8c0ffb80 0x7f8e8c10ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:12.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.538+0000 7f8e91bdc700 1 -- 172.21.15.83:0/645676730 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e8c101710 msgr2=0x7f8e8c10b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:12.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.538+0000 7f8e91bdc700 1 --2- 172.21.15.83:0/645676730 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e8c101710 0x7f8e8c10b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:12.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.538+0000 7f8e91bdc700 1 -- 172.21.15.83:0/645676730 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e7c0095f0 con 0x7f8e8c100d70 2024-04-01T06:55:12.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.538+0000 7f8e92bde700 1 --2- 172.21.15.83:0/645676730 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e8c101710 0x7f8e8c10b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:55:12.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.538+0000 7f8e923dd700 1 --2- 172.21.15.83:0/645676730 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e8c0ffb80 0x7f8e8c10ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:55:12.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.538+0000 7f8e91bdc700 1 --2- 172.21.15.83:0/645676730 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e8c100d70 0x7f8e8c10b110 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c006010 tx=0x7f8e7c005af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:12.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.538+0000 7f8e837fe700 1 -- 172.21.15.83:0/645676730 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c01d070 con 0x7f8e8c100d70 2024-04-01T06:55:12.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.538+0000 7f8e94641700 1 -- 172.21.15.83:0/645676730 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e8c1a0ee0 con 0x7f8e8c100d70 2024-04-01T06:55:12.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.538+0000 7f8e837fe700 1 -- 172.21.15.83:0/645676730 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8e7c004150 con 0x7f8e8c100d70 2024-04-01T06:55:12.541 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.538+0000 7f8e837fe700 1 -- 172.21.15.83:0/645676730 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c00f460 con 0x7f8e8c100d70 2024-04-01T06:55:12.542 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.538+0000 7f8e94641700 1 -- 172.21.15.83:0/645676730 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e8c1a12a0 con 0x7f8e8c100d70 2024-04-01T06:55:12.542 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.539+0000 7f8e94641700 1 -- 172.21.15.83:0/645676730 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e8c106ed0 con 0x7f8e8c100d70 2024-04-01T06:55:12.542 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.541+0000 7f8e837fe700 1 -- 172.21.15.83:0/645676730 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f8e7c022700 con 0x7f8e8c100d70 2024-04-01T06:55:12.542 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.541+0000 7f8e837fe700 1 --2- 172.21.15.83:0/645676730 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f8e780a11b0 0x7f8e780a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:12.543 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.542+0000 7f8e923dd700 1 --2- 172.21.15.83:0/645676730 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f8e780a11b0 0x7f8e780a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:12.543 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.542+0000 7f8e837fe700 1 -- 172.21.15.83:0/645676730 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f8e7c0ce160 con 0x7f8e8c100d70 2024-04-01T06:55:12.543 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.542+0000 7f8e923dd700 1 --2- 172.21.15.83:0/645676730 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f8e780a11b0 0x7f8e780a3670 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8e88005fd0 tx=0x7f8e88005f00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:12.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.545+0000 7f8e837fe700 1 -- 172.21.15.83:0/645676730 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f8e7c0978d0 con 0x7f8e8c100d70 2024-04-01T06:55:12.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.753+0000 7f8e94641700 1 -- 172.21.15.83:0/645676730 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8e8c0695d0 con 0x7f8e8c100d70 2024-04-01T06:55:12.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.755+0000 7f8e837fe700 1 -- 172.21.15.83:0/645676730 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+22131 (secure 0 0 0) 0x7f8e7c09aef0 con 0x7f8e8c100d70 2024-04-01T06:55:12.755 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:55:12.755 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":79,"fsid":"c6f8eff4-eff3-11ee-b647-cb9ed24678a4","created":"2024-04-01T06:48:42.033382+0000","modified":"2024-04-01T06:54:29.399277+0000","last_up_change":"2024-04-01T06:53:55.791339+0000","last_in_change":"2024-04-01T06:53:39.777214+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T06:51:21.963996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T06:54:26.450403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T06:54:27.564928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"90b761b0-b06c-4142-854d-38ee42aa6052","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6803","nonce":3253845390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6805","nonce":3253845390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6809","nonce":3253845390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6807","nonce":3253845390}]},"public_addr":"172.21.15.83:6803/3253845390","cluster_addr":"172.21.15.83:6805/3253845390","heartbeat_back_addr":"172.21.15.83:6809/3253845390","heartbeat_front_addr":"172.21.15.83:6807/3253845390","state":["exists","up"]},{"osd":1,"uuid":"4d6ab85b-7088-451e-a829-c9119f35dee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6801","nonce":515889759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6803","nonce":515889759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6807","nonce":515889759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6805","nonce":515889759}]},"public_addr":"172.21.15.145:6801/515889759","cluster_addr":"172.21.15.145:6803/515889759","heartbeat_back_addr":"172.21.15.145:6807/515889759","heartbeat_front_addr":"172.21.15.145:6805/515889759","state":["exists","up"]},{"osd":2,"uuid":"d04c27f3-4972-4061-8bfb-5060645e3883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6801","nonce":3318516728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6803","nonce":3318516728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6807","nonce":3318516728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6805","nonce":3318516728}]},"public_addr":"172.21.15.153:6801/3318516728","cluster_addr":"172.21.15.153:6803/3318516728","heartbeat_back_addr":"172.21.15.153:6807/3318516728","heartbeat_front_addr":"172.21.15.153:6805/3318516728","state":["exists","up"]},{"osd":3,"uuid":"899b6c90-8f2f-44dd-b807-49594aadb443","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6811","nonce":504690234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6813","nonce":504690234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6817","nonce":504690234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6815","nonce":504690234}]},"public_addr":"172.21.15.83:6811/504690234","cluster_addr":"172.21.15.83:6813/504690234","heartbeat_back_addr":"172.21.15.83:6817/504690234","heartbeat_front_addr":"172.21.15.83:6815/504690234","state":["exists","up"]},{"osd":4,"uuid":"5071dd81-804e-4358-bfb6-11e718e9cf4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6809","nonce":2099824730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6811","nonce":2099824730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6815","nonce":2099824730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6813","nonce":2099824730}]},"public_addr":"172.21.15.145:6809/2099824730","cluster_addr":"172.21.15.145:6811/2099824730","heartbeat_back_addr":"172.21.15.145:6815/2099824730","heartbeat_front_addr":"172.21.15.145:6813/2099824730","state":["exists","up"]},{"osd":5,"uuid":"b8442b71-c26e-467f-b0c3-ea9f636f5a00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6809","nonce":3340941443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6811","nonce":3340941443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6815","nonce":3340941443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6813","nonce":3340941443}]},"public_addr":"172.21.15.153:6809/3340941443","cluster_addr":"172.21.15.153:6811/3340941443","heartbeat_back_addr":"172.21.15.153:6815/3340941443","heartbeat_front_addr":"172.21.15.153:6813/3340941443","state":["exists","up"]},{"osd":6,"uuid":"c26bb8cb-ccee-4bfc-91eb-14e1ad8e04df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6819","nonce":2005485079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6821","nonce":2005485079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6825","nonce":2005485079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6823","nonce":2005485079}]},"public_addr":"172.21.15.83:6819/2005485079","cluster_addr":"172.21.15.83:6821/2005485079","heartbeat_back_addr":"172.21.15.83:6825/2005485079","heartbeat_front_addr":"172.21.15.83:6823/2005485079","state":["exists","up"]},{"osd":7,"uuid":"a8940da2-0e79-4606-8d1e-d425afbf5753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6817","nonce":3737505059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6819","nonce":3737505059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6823","nonce":3737505059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6821","nonce":3737505059}]},"public_addr":"172.21.15.145:6817/3737505059","cluster_addr":"172.21.15.145:6819/3737505059","heartbeat_back_addr":"172.21.15.145:6823/3737505059","heartbeat_front_addr":"172.21.15.145:6821/3737505059","state":["exists","up"]},{"osd":8,"uuid":"602d43ac-a189-4da3-9e38-7025d14e0dd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6817","nonce":1031545791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6819","nonce":1031545791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6823","nonce":1031545791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6821","nonce":1031545791}]},"public_addr":"172.21.15.153:6817/1031545791","cluster_addr":"172.21.15.153:6819/1031545791","heartbeat_back_addr":"172.21.15.153:6823/1031545791","heartbeat_front_addr":"172.21.15.153:6821/1031545791","state":["exists","up"]},{"osd":9,"uuid":"08b12d27-1247-45e4-9d09-cacc0fce4bd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6827","nonce":3720996673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6829","nonce":3720996673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6833","nonce":3720996673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6831","nonce":3720996673}]},"public_addr":"172.21.15.83:6827/3720996673","cluster_addr":"172.21.15.83:6829/3720996673","heartbeat_back_addr":"172.21.15.83:6833/3720996673","heartbeat_front_addr":"172.21.15.83:6831/3720996673","state":["exists","up"]},{"osd":10,"uuid":"dd986b50-d68f-446c-9c66-261535880879","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6825","nonce":2671529479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6827","nonce":2671529479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6831","nonce":2671529479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6829","nonce":2671529479}]},"public_addr":"172.21.15.145:6825/2671529479","cluster_addr":"172.21.15.145:6827/2671529479","heartbeat_back_addr":"172.21.15.145:6831/2671529479","heartbeat_front_addr":"172.21.15.145:6829/2671529479","state":["exists","up"]},{"osd":11,"uuid":"d20a49cd-6224-4424-8375-46da791d9931","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6825","nonce":2342548429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6827","nonce":2342548429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6831","nonce":2342548429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6829","nonce":2342548429}]},"public_addr":"172.21.15.153:6825/2342548429","cluster_addr":"172.21.15.153:6827/2342548429","heartbeat_back_addr":"172.21.15.153:6831/2342548429","heartbeat_front_addr":"172.21.15.153:6829/2342548429","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:50:44.539932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:01.990470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:19.054426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:36.616393+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:53.896705+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:10.667502+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:27.880849+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:45.276308+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:02.280615+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:19.555547+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:37.062881+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:54.191589+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.83:6801/1867137261":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/2596683931":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/2125339627":"2024-04-02T06:49:33.656125+0000","172.21.15.83:6800/1644397953":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/690500472":"2024-04-02T06:49:13.456026+0000","172.21.15.83:6801/1644397953":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/785958951":"2024-04-02T06:49:33.656125+0000","172.21.15.83:6800/1867137261":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/2222527447":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/2071592157":"2024-04-02T06:49:13.456026+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T06:55:12.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.757+0000 7f8e94641700 1 -- 172.21.15.83:0/645676730 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f8e780a11b0 msgr2=0x7f8e780a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:12.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.757+0000 7f8e94641700 1 --2- 172.21.15.83:0/645676730 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f8e780a11b0 0x7f8e780a3670 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8e88005fd0 tx=0x7f8e88005f00 comp rx=0 tx=0).stop 2024-04-01T06:55:12.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.757+0000 7f8e94641700 1 -- 172.21.15.83:0/645676730 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e8c100d70 msgr2=0x7f8e8c10b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:12.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.757+0000 7f8e94641700 1 --2- 172.21.15.83:0/645676730 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e8c100d70 0x7f8e8c10b110 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c006010 tx=0x7f8e7c005af0 comp rx=0 tx=0).stop 2024-04-01T06:55:12.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.757+0000 7f8e94641700 1 -- 172.21.15.83:0/645676730 shutdown_connections 2024-04-01T06:55:12.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.757+0000 7f8e94641700 1 --2- 172.21.15.83:0/645676730 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f8e780a11b0 0x7f8e780a3670 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:12.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.757+0000 7f8e94641700 1 --2- 172.21.15.83:0/645676730 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e8c101710 0x7f8e8c10b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:12.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.757+0000 7f8e94641700 1 --2- 172.21.15.83:0/645676730 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e8c0ffb80 0x7f8e8c10ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:12.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.757+0000 7f8e94641700 1 --2- 172.21.15.83:0/645676730 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e8c100d70 0x7f8e8c10b110 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:12.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.757+0000 7f8e94641700 1 -- 172.21.15.83:0/645676730 >> 172.21.15.83:0/645676730 conn(0x7f8e8c0fb0f0 msgr2=0x7f8e8c104010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:12.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.757+0000 7f8e94641700 1 -- 172.21.15.83:0/645676730 shutdown_connections 2024-04-01T06:55:12.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.757+0000 7f8e94641700 1 -- 172.21.15.83:0/645676730 wait complete. 2024-04-01T06:55:12.769 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-01T06:51:21.963996+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-01T06:54:26.450403+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-01T06:54:27.564928+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-01T06:55:12.770 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-01T06:55:12.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.895+0000 7f23b6827700 1 -- 172.21.15.83:0/1645397712 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f23b0100d80 msgr2=0x7f23b01011a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:12.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.895+0000 7f23b6827700 1 --2- 172.21.15.83:0/1645397712 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f23b0100d80 0x7f23b01011a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f23a40099c0 tx=0x7f23a4009cd0 comp rx=0 tx=0).stop 2024-04-01T06:55:12.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.895+0000 7f23b6827700 1 -- 172.21.15.83:0/1645397712 shutdown_connections 2024-04-01T06:55:12.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.895+0000 7f23b6827700 1 --2- 172.21.15.83:0/1645397712 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f23b0100d80 0x7f23b01011a0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:12.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.895+0000 7f23b6827700 1 --2- 172.21.15.83:0/1645397712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23b0102910 0x7f23b01091c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:12.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.895+0000 7f23b6827700 1 --2- 172.21.15.83:0/1645397712 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f23b0101f70 0x7f23b01023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:12.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.895+0000 7f23b6827700 1 -- 172.21.15.83:0/1645397712 >> 172.21.15.83:0/1645397712 conn(0x7f23b00fc2f0 msgr2=0x7f23b00fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:12.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.895+0000 7f23b6827700 1 -- 172.21.15.83:0/1645397712 shutdown_connections 2024-04-01T06:55:12.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.895+0000 7f23b6827700 1 -- 172.21.15.83:0/1645397712 wait complete. 2024-04-01T06:55:12.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.895+0000 7f23b6827700 1 Processor -- start 2024-04-01T06:55:12.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.895+0000 7f23b6827700 1 -- start start 2024-04-01T06:55:12.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.896+0000 7f23b6827700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f23b0100d80 0x7f23b0074b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:12.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.896+0000 7f23b6827700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f23b0101f70 0x7f23b00731a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:12.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.896+0000 7f23b6827700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23b0102910 0x7f23b00736e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:12.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.896+0000 7f23b6827700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b0073e80 con 0x7f23b0100d80 2024-04-01T06:55:12.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.896+0000 7f23b6827700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b0073ff0 con 0x7f23b0101f70 2024-04-01T06:55:12.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.896+0000 7f23b6827700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b01a0d80 con 0x7f23b0102910 2024-04-01T06:55:12.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.896+0000 7f23affff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f23b0100d80 0x7f23b0074b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:12.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.896+0000 7f23affff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f23b0100d80 0x7f23b0074b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:50520/0 (socket says 172.21.15.83:50520) 2024-04-01T06:55:12.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.896+0000 7f23affff700 1 -- 172.21.15.83:0/1581097681 learned_addr learned my addr 172.21.15.83:0/1581097681 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:12.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.896+0000 7f23b4dc4700 1 --2- 172.21.15.83:0/1581097681 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23b0102910 0x7f23b00736e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:12.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.896+0000 7f23affff700 1 -- 172.21.15.83:0/1581097681 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23b0102910 msgr2=0x7f23b00736e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:12.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.896+0000 7f23affff700 1 --2- 172.21.15.83:0/1581097681 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23b0102910 0x7f23b00736e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:12.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.896+0000 7f23af7fe700 1 --2- 172.21.15.83:0/1581097681 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f23b0101f70 0x7f23b00731a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:12.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.896+0000 7f23affff700 1 -- 172.21.15.83:0/1581097681 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f23b0101f70 msgr2=0x7f23b00731a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:12.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.896+0000 7f23affff700 1 --2- 172.21.15.83:0/1581097681 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f23b0101f70 0x7f23b00731a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:12.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.896+0000 7f23affff700 1 -- 172.21.15.83:0/1581097681 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a40095f0 con 0x7f23b0100d80 2024-04-01T06:55:12.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.896+0000 7f23af7fe700 1 --2- 172.21.15.83:0/1581097681 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f23b0101f70 0x7f23b00731a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:55:12.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.896+0000 7f23affff700 1 --2- 172.21.15.83:0/1581097681 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f23b0100d80 0x7f23b0074b10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f23a4003820 tx=0x7f23a4005ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:12.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.896+0000 7f23ad7fa700 1 -- 172.21.15.83:0/1581097681 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a401d070 con 0x7f23b0100d80 2024-04-01T06:55:12.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.896+0000 7f23ad7fa700 1 -- 172.21.15.83:0/1581097681 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f23a4004110 con 0x7f23b0100d80 2024-04-01T06:55:12.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.896+0000 7f23b6827700 1 -- 172.21.15.83:0/1581097681 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23b01a0fb0 con 0x7f23b0100d80 2024-04-01T06:55:12.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.896+0000 7f23ad7fa700 1 -- 172.21.15.83:0/1581097681 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a4022e40 con 0x7f23b0100d80 2024-04-01T06:55:12.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.896+0000 7f23b6827700 1 -- 172.21.15.83:0/1581097681 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23b01a1320 con 0x7f23b0100d80 2024-04-01T06:55:12.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.897+0000 7f23b6827700 1 -- 172.21.15.83:0/1581097681 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23b0108220 con 0x7f23b0100d80 2024-04-01T06:55:12.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.899+0000 7f23ad7fa700 1 -- 172.21.15.83:0/1581097681 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f23a4022570 con 0x7f23b0100d80 2024-04-01T06:55:12.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.899+0000 7f23ad7fa700 1 --2- 172.21.15.83:0/1581097681 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f23980a11b0 0x7f23980a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:12.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.899+0000 7f23af7fe700 1 --2- 172.21.15.83:0/1581097681 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f23980a11b0 0x7f23980a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:12.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.899+0000 7f23ad7fa700 1 -- 172.21.15.83:0/1581097681 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f23a40cdcd0 con 0x7f23b0100d80 2024-04-01T06:55:12.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.900+0000 7f23af7fe700 1 --2- 172.21.15.83:0/1581097681 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f23980a11b0 0x7f23980a3670 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f23a0005fd0 tx=0x7f23a0005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:12.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:12.903+0000 7f23ad7fa700 1 -- 172.21.15.83:0/1581097681 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f23a4097540 con 0x7f23b0100d80 2024-04-01T06:55:13.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:12 smithi145 ceph-mon[47816]: pgmap v238: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-01T06:55:13.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:12 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/3434667911' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-01T06:55:13.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:12 smithi083 ceph-mon[43429]: pgmap v238: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-01T06:55:13.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:12 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/3434667911' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-01T06:55:13.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.099+0000 7f23b6827700 1 -- 172.21.15.83:0/1581097681 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f23b002ccb0 con 0x7f23b0100d80 2024-04-01T06:55:13.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.100+0000 7f23ad7fa700 1 -- 172.21.15.83:0/1581097681 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) v1 ==== 93+0+10 (secure 0 0 0) 0x7f23a4027020 con 0x7f23b0100d80 2024-04-01T06:55:13.100 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 1 2024-04-01T06:55:13.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.102+0000 7f23b6827700 1 -- 172.21.15.83:0/1581097681 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f23980a11b0 msgr2=0x7f23980a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:13.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.102+0000 7f23b6827700 1 --2- 172.21.15.83:0/1581097681 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f23980a11b0 0x7f23980a3670 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f23a0005fd0 tx=0x7f23a0005ee0 comp rx=0 tx=0).stop 2024-04-01T06:55:13.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.102+0000 7f23b6827700 1 -- 172.21.15.83:0/1581097681 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f23b0100d80 msgr2=0x7f23b0074b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:13.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.102+0000 7f23b6827700 1 --2- 172.21.15.83:0/1581097681 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f23b0100d80 0x7f23b0074b10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f23a4003820 tx=0x7f23a4005ad0 comp rx=0 tx=0).stop 2024-04-01T06:55:13.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.102+0000 7f23b6827700 1 -- 172.21.15.83:0/1581097681 shutdown_connections 2024-04-01T06:55:13.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.102+0000 7f23b6827700 1 --2- 172.21.15.83:0/1581097681 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f23b0100d80 0x7f23b0074b10 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:13.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.102+0000 7f23b6827700 1 --2- 172.21.15.83:0/1581097681 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f23980a11b0 0x7f23980a3670 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:13.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.102+0000 7f23b6827700 1 --2- 172.21.15.83:0/1581097681 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23b0102910 0x7f23b00736e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:13.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.102+0000 7f23b6827700 1 --2- 172.21.15.83:0/1581097681 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f23b0101f70 0x7f23b00731a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:13.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.102+0000 7f23b6827700 1 -- 172.21.15.83:0/1581097681 >> 172.21.15.83:0/1581097681 conn(0x7f23b00fc2f0 msgr2=0x7f23b0105360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:13.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.102+0000 7f23b6827700 1 -- 172.21.15.83:0/1581097681 shutdown_connections 2024-04-01T06:55:13.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.102+0000 7f23b6827700 1 -- 172.21.15.83:0/1581097681 wait complete. 2024-04-01T06:55:13.114 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-01T06:55:13.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:12 smithi153 ceph-mon[48187]: pgmap v238: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-04-01T06:55:13.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:12 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/3434667911' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-01T06:55:13.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.240+0000 7fc3b9897700 1 -- 172.21.15.83:0/1773473560 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc3b4104120 msgr2=0x7fc3b4106510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:13.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.240+0000 7fc3b9897700 1 --2- 172.21.15.83:0/1773473560 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc3b4104120 0x7fc3b4106510 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4009990 tx=0x7fc3a4009ca0 comp rx=0 tx=0).stop 2024-04-01T06:55:13.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.240+0000 7fc3b9897700 1 -- 172.21.15.83:0/1773473560 shutdown_connections 2024-04-01T06:55:13.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.240+0000 7fc3b9897700 1 --2- 172.21.15.83:0/1773473560 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3b4106a50 0x7fc3b4108ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:13.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.240+0000 7fc3b9897700 1 --2- 172.21.15.83:0/1773473560 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3b41017f0 0x7fc3b4103be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:13.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.240+0000 7fc3b9897700 1 --2- 172.21.15.83:0/1773473560 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc3b4104120 0x7fc3b4106510 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:13.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.240+0000 7fc3b9897700 1 -- 172.21.15.83:0/1773473560 >> 172.21.15.83:0/1773473560 conn(0x7fc3b40fb200 msgr2=0x7fc3b40fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:13.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.240+0000 7fc3b9897700 1 -- 172.21.15.83:0/1773473560 shutdown_connections 2024-04-01T06:55:13.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.240+0000 7fc3b9897700 1 -- 172.21.15.83:0/1773473560 wait complete. 2024-04-01T06:55:13.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.240+0000 7fc3b9897700 1 Processor -- start 2024-04-01T06:55:13.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.241+0000 7fc3b9897700 1 -- start start 2024-04-01T06:55:13.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.241+0000 7fc3b9897700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3b41017f0 0x7fc3b4196d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:13.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.241+0000 7fc3b9897700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc3b4104120 0x7fc3b4197250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:13.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.241+0000 7fc3b9897700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3b4106a50 0x7fc3b419e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:13.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.241+0000 7fc3b9897700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b419e830 con 0x7fc3b4104120 2024-04-01T06:55:13.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.241+0000 7fc3b9897700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b419e9a0 con 0x7fc3b4106a50 2024-04-01T06:55:13.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.241+0000 7fc3b9897700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b419eb60 con 0x7fc3b41017f0 2024-04-01T06:55:13.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.241+0000 7fc3b27fc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc3b4104120 0x7fc3b4197250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:13.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.241+0000 7fc3b27fc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc3b4104120 0x7fc3b4197250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:50544/0 (socket says 172.21.15.83:50544) 2024-04-01T06:55:13.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.241+0000 7fc3b27fc700 1 -- 172.21.15.83:0/2474157508 learned_addr learned my addr 172.21.15.83:0/2474157508 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:13.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.241+0000 7fc3b2ffd700 1 --2- 172.21.15.83:0/2474157508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3b41017f0 0x7fc3b4196d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:13.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.241+0000 7fc3b27fc700 1 -- 172.21.15.83:0/2474157508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3b41017f0 msgr2=0x7fc3b4196d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:13.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.241+0000 7fc3b27fc700 1 --2- 172.21.15.83:0/2474157508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3b41017f0 0x7fc3b4196d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:13.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.241+0000 7fc3b37fe700 1 --2- 172.21.15.83:0/2474157508 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3b4106a50 0x7fc3b419e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:13.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.241+0000 7fc3b27fc700 1 -- 172.21.15.83:0/2474157508 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3b4106a50 msgr2=0x7fc3b419e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:13.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.241+0000 7fc3b27fc700 1 --2- 172.21.15.83:0/2474157508 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3b4106a50 0x7fc3b419e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:13.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.241+0000 7fc3b27fc700 1 -- 172.21.15.83:0/2474157508 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a40095f0 con 0x7fc3b4104120 2024-04-01T06:55:13.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.241+0000 7fc3b2ffd700 1 --2- 172.21.15.83:0/2474157508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3b41017f0 0x7fc3b4196d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:55:13.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.241+0000 7fc3b27fc700 1 --2- 172.21.15.83:0/2474157508 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc3b4104120 0x7fc3b4197250 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4006010 tx=0x7fc3a4005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:13.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.242+0000 7fc3b8895700 1 -- 172.21.15.83:0/2474157508 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a401d070 con 0x7fc3b4104120 2024-04-01T06:55:13.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.242+0000 7fc3b8895700 1 -- 172.21.15.83:0/2474157508 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc3a4004ca0 con 0x7fc3b4104120 2024-04-01T06:55:13.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.242+0000 7fc3b9897700 1 -- 172.21.15.83:0/2474157508 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3b419ede0 con 0x7fc3b4104120 2024-04-01T06:55:13.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.242+0000 7fc3b8895700 1 -- 172.21.15.83:0/2474157508 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a4005500 con 0x7fc3b4104120 2024-04-01T06:55:13.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.242+0000 7fc3b9897700 1 -- 172.21.15.83:0/2474157508 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3b419f1b0 con 0x7fc3b4104120 2024-04-01T06:55:13.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.242+0000 7fc3b9897700 1 -- 172.21.15.83:0/2474157508 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3b40fcd80 con 0x7fc3b4104120 2024-04-01T06:55:13.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.244+0000 7fc3b8895700 1 -- 172.21.15.83:0/2474157508 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7fc3a400fb80 con 0x7fc3b4104120 2024-04-01T06:55:13.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.245+0000 7fc3b8895700 1 --2- 172.21.15.83:0/2474157508 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fc3a00a11b0 0x7fc3a00a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:13.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.245+0000 7fc3b2ffd700 1 --2- 172.21.15.83:0/2474157508 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fc3a00a11b0 0x7fc3a00a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:13.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.245+0000 7fc3b8895700 1 -- 172.21.15.83:0/2474157508 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fc3a40cdfb0 con 0x7fc3b4104120 2024-04-01T06:55:13.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.245+0000 7fc3b2ffd700 1 --2- 172.21.15.83:0/2474157508 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fc3a00a11b0 0x7fc3a00a3670 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc39c005950 tx=0x7fc39c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:13.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.248+0000 7fc3b8895700 1 -- 172.21.15.83:0/2474157508 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7fc3a4097760 con 0x7fc3b4104120 2024-04-01T06:55:13.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.444+0000 7fc3b9897700 1 -- 172.21.15.83:0/2474157508 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc3b410c760 con 0x7fc3b4104120 2024-04-01T06:55:13.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.444+0000 7fc3b8895700 1 -- 172.21.15.83:0/2474157508 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v79) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc3a40a1070 con 0x7fc3b4104120 2024-04-01T06:55:13.444 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 32 2024-04-01T06:55:13.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.446+0000 7fc3b9897700 1 -- 172.21.15.83:0/2474157508 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fc3a00a11b0 msgr2=0x7fc3a00a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:13.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.446+0000 7fc3b9897700 1 --2- 172.21.15.83:0/2474157508 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fc3a00a11b0 0x7fc3a00a3670 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc39c005950 tx=0x7fc39c0058e0 comp rx=0 tx=0).stop 2024-04-01T06:55:13.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.446+0000 7fc3b9897700 1 -- 172.21.15.83:0/2474157508 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc3b4104120 msgr2=0x7fc3b4197250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:13.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.446+0000 7fc3b9897700 1 --2- 172.21.15.83:0/2474157508 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc3b4104120 0x7fc3b4197250 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4006010 tx=0x7fc3a4005ef0 comp rx=0 tx=0).stop 2024-04-01T06:55:13.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.446+0000 7fc3b9897700 1 -- 172.21.15.83:0/2474157508 shutdown_connections 2024-04-01T06:55:13.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.446+0000 7fc3b9897700 1 --2- 172.21.15.83:0/2474157508 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fc3a00a11b0 0x7fc3a00a3670 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:13.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.446+0000 7fc3b9897700 1 --2- 172.21.15.83:0/2474157508 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3b4106a50 0x7fc3b419e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:13.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.446+0000 7fc3b9897700 1 --2- 172.21.15.83:0/2474157508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3b41017f0 0x7fc3b4196d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:13.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.446+0000 7fc3b9897700 1 --2- 172.21.15.83:0/2474157508 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc3b4104120 0x7fc3b4197250 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:13.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.446+0000 7fc3b9897700 1 -- 172.21.15.83:0/2474157508 >> 172.21.15.83:0/2474157508 conn(0x7fc3b40fb200 msgr2=0x7fc3b41036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:13.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.446+0000 7fc3b9897700 1 -- 172.21.15.83:0/2474157508 shutdown_connections 2024-04-01T06:55:13.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.447+0000 7fc3b9897700 1 -- 172.21.15.83:0/2474157508 wait complete. 2024-04-01T06:55:13.458 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-01T06:55:13.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.584+0000 7f70d703a700 1 -- 172.21.15.83:0/2364726910 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70d01017f0 msgr2=0x7f70d01080a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:13.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.584+0000 7f70d703a700 1 --2- 172.21.15.83:0/2364726910 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70d01017f0 0x7f70d01080a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f70c800b0d0 tx=0x7f70c800b3e0 comp rx=0 tx=0).stop 2024-04-01T06:55:13.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.584+0000 7f70d703a700 1 -- 172.21.15.83:0/2364726910 shutdown_connections 2024-04-01T06:55:13.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.584+0000 7f70d703a700 1 --2- 172.21.15.83:0/2364726910 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70d01017f0 0x7f70d01080a0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:13.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.584+0000 7f70d703a700 1 --2- 172.21.15.83:0/2364726910 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f70d00ffc60 0x7f70d0100080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:13.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.584+0000 7f70d703a700 1 --2- 172.21.15.83:0/2364726910 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70d0100e50 0x7f70d01012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:13.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.584+0000 7f70d703a700 1 -- 172.21.15.83:0/2364726910 >> 172.21.15.83:0/2364726910 conn(0x7f70d00fb1d0 msgr2=0x7f70d00fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:13.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.584+0000 7f70d703a700 1 -- 172.21.15.83:0/2364726910 shutdown_connections 2024-04-01T06:55:13.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.584+0000 7f70d703a700 1 -- 172.21.15.83:0/2364726910 wait complete. 2024-04-01T06:55:13.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.584+0000 7f70d703a700 1 Processor -- start 2024-04-01T06:55:13.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.584+0000 7f70d703a700 1 -- start start 2024-04-01T06:55:13.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.584+0000 7f70d703a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70d00ffc60 0x7f70d0196ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:13.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.584+0000 7f70d703a700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f70d0100e50 0x7f70d0197410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:13.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.584+0000 7f70d703a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70d01017f0 0x7f70d019e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:13.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.584+0000 7f70d703a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d019ea00 con 0x7f70d00ffc60 2024-04-01T06:55:13.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.584+0000 7f70d703a700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d019eb40 con 0x7f70d0100e50 2024-04-01T06:55:13.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.584+0000 7f70d703a700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d019ecd0 con 0x7f70d01017f0 2024-04-01T06:55:13.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.584+0000 7f70d4dd6700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70d00ffc60 0x7f70d0196ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:13.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.585+0000 7f70d4dd6700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70d00ffc60 0x7f70d0196ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:41624/0 (socket says 172.21.15.83:41624) 2024-04-01T06:55:13.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.585+0000 7f70d4dd6700 1 -- 172.21.15.83:0/429890596 learned_addr learned my addr 172.21.15.83:0/429890596 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:13.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.585+0000 7f70d55d7700 1 --2- 172.21.15.83:0/429890596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70d01017f0 0x7f70d019e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:13.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.585+0000 7f70cffff700 1 --2- 172.21.15.83:0/429890596 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f70d0100e50 0x7f70d0197410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:13.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.585+0000 7f70d4dd6700 1 -- 172.21.15.83:0/429890596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70d01017f0 msgr2=0x7f70d019e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:13.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.585+0000 7f70d4dd6700 1 --2- 172.21.15.83:0/429890596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70d01017f0 0x7f70d019e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:13.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.585+0000 7f70d4dd6700 1 -- 172.21.15.83:0/429890596 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f70d0100e50 msgr2=0x7f70d0197410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:13.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.585+0000 7f70d4dd6700 1 --2- 172.21.15.83:0/429890596 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f70d0100e50 0x7f70d0197410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:13.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.585+0000 7f70d4dd6700 1 -- 172.21.15.83:0/429890596 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c8009d00 con 0x7f70d00ffc60 2024-04-01T06:55:13.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.585+0000 7f70d4dd6700 1 --2- 172.21.15.83:0/429890596 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70d00ffc60 0x7f70d0196ed0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f70c400b500 tx=0x7f70c400b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:13.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.585+0000 7f70cdffb700 1 -- 172.21.15.83:0/429890596 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c4011830 con 0x7f70d00ffc60 2024-04-01T06:55:13.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.585+0000 7f70cdffb700 1 -- 172.21.15.83:0/429890596 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f70c4011e50 con 0x7f70d00ffc60 2024-04-01T06:55:13.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.585+0000 7f70d703a700 1 -- 172.21.15.83:0/429890596 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70d019efb0 con 0x7f70d00ffc60 2024-04-01T06:55:13.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.585+0000 7f70cdffb700 1 -- 172.21.15.83:0/429890596 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c400f2e0 con 0x7f70d00ffc60 2024-04-01T06:55:13.588 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.585+0000 7f70d703a700 1 -- 172.21.15.83:0/429890596 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70d019f3e0 con 0x7f70d00ffc60 2024-04-01T06:55:13.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.586+0000 7f70d703a700 1 -- 172.21.15.83:0/429890596 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70d0107010 con 0x7f70d00ffc60 2024-04-01T06:55:13.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.587+0000 7f70cdffb700 1 -- 172.21.15.83:0/429890596 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f70c4010580 con 0x7f70d00ffc60 2024-04-01T06:55:13.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.588+0000 7f70cdffb700 1 --2- 172.21.15.83:0/429890596 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f70c00a12b0 0x7f70c00a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:13.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.588+0000 7f70cffff700 1 --2- 172.21.15.83:0/429890596 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f70c00a12b0 0x7f70c00a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:13.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.588+0000 7f70cdffb700 1 -- 172.21.15.83:0/429890596 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f70c40cc300 con 0x7f70d00ffc60 2024-04-01T06:55:13.589 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.588+0000 7f70cffff700 1 --2- 172.21.15.83:0/429890596 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f70c00a12b0 0x7f70c00a3770 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f70bc006fd0 tx=0x7f70bc008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:13.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.592+0000 7f70cdffb700 1 -- 172.21.15.83:0/429890596 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f70c4095af0 con 0x7f70d00ffc60 2024-04-01T06:55:13.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.790+0000 7f70d703a700 1 -- 172.21.15.83:0/429890596 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f70d010c6f0 con 0x7f70d00ffc60 2024-04-01T06:55:13.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.791+0000 7f70cdffb700 1 -- 172.21.15.83:0/429890596 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v79) v1 ==== 100+0+11 (secure 0 0 0) 0x7f70c4099110 con 0x7f70d00ffc60 2024-04-01T06:55:13.790 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 64 2024-04-01T06:55:13.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.793+0000 7f70d703a700 1 -- 172.21.15.83:0/429890596 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f70c00a12b0 msgr2=0x7f70c00a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:13.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.793+0000 7f70d703a700 1 --2- 172.21.15.83:0/429890596 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f70c00a12b0 0x7f70c00a3770 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f70bc006fd0 tx=0x7f70bc008040 comp rx=0 tx=0).stop 2024-04-01T06:55:13.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.793+0000 7f70d703a700 1 -- 172.21.15.83:0/429890596 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70d00ffc60 msgr2=0x7f70d0196ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:13.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.793+0000 7f70d703a700 1 --2- 172.21.15.83:0/429890596 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70d00ffc60 0x7f70d0196ed0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f70c400b500 tx=0x7f70c400b8c0 comp rx=0 tx=0).stop 2024-04-01T06:55:13.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.793+0000 7f70d703a700 1 -- 172.21.15.83:0/429890596 shutdown_connections 2024-04-01T06:55:13.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.793+0000 7f70d703a700 1 --2- 172.21.15.83:0/429890596 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70d00ffc60 0x7f70d0196ed0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:13.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.793+0000 7f70d703a700 1 --2- 172.21.15.83:0/429890596 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f70c00a12b0 0x7f70c00a3770 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:13.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.793+0000 7f70d703a700 1 --2- 172.21.15.83:0/429890596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70d01017f0 0x7f70d019e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:13.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.793+0000 7f70d703a700 1 --2- 172.21.15.83:0/429890596 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f70d0100e50 0x7f70d0197410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:13.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.793+0000 7f70d703a700 1 -- 172.21.15.83:0/429890596 >> 172.21.15.83:0/429890596 conn(0x7f70d00fb1d0 msgr2=0x7f70d0104150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:13.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.793+0000 7f70d703a700 1 -- 172.21.15.83:0/429890596 shutdown_connections 2024-04-01T06:55:13.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.793+0000 7f70d703a700 1 -- 172.21.15.83:0/429890596 wait complete. 2024-04-01T06:55:13.805 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T06:55:13.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.926+0000 7f18123d6700 1 -- 172.21.15.83:0/3621235634 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f180c0fef60 msgr2=0x7f180c0ff380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:13.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.926+0000 7f18123d6700 1 --2- 172.21.15.83:0/3621235634 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f180c0fef60 0x7f180c0ff380 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1800009990 tx=0x7f1800009ca0 comp rx=0 tx=0).stop 2024-04-01T06:55:13.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.926+0000 7f18123d6700 1 -- 172.21.15.83:0/3621235634 shutdown_connections 2024-04-01T06:55:13.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.926+0000 7f18123d6700 1 --2- 172.21.15.83:0/3621235634 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f180c0fef60 0x7f180c0ff380 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:13.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.926+0000 7f18123d6700 1 --2- 172.21.15.83:0/3621235634 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f180c1028d0 0x7f180c109180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:13.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.926+0000 7f18123d6700 1 --2- 172.21.15.83:0/3621235634 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f180c101f30 0x7f180c102390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:13.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.926+0000 7f18123d6700 1 -- 172.21.15.83:0/3621235634 >> 172.21.15.83:0/3621235634 conn(0x7f180c0fa890 msgr2=0x7f180c0fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:13.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.927+0000 7f18123d6700 1 -- 172.21.15.83:0/3621235634 shutdown_connections 2024-04-01T06:55:13.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.927+0000 7f18123d6700 1 -- 172.21.15.83:0/3621235634 wait complete. 2024-04-01T06:55:13.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.927+0000 7f18123d6700 1 Processor -- start 2024-04-01T06:55:13.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.927+0000 7f18123d6700 1 -- start start 2024-04-01T06:55:13.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.927+0000 7f18123d6700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f180c0fef60 0x7f180c196be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:13.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.927+0000 7f18123d6700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f180c101f30 0x7f180c197120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:13.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.927+0000 7f18123d6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f180c1028d0 0x7f180c19e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:13.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.927+0000 7f18123d6700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180c19e710 con 0x7f180c0fef60 2024-04-01T06:55:13.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.927+0000 7f18123d6700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180c19e850 con 0x7f180c101f30 2024-04-01T06:55:13.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.927+0000 7f18123d6700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180c19e9e0 con 0x7f180c1028d0 2024-04-01T06:55:13.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.928+0000 7f180bfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f180c0fef60 0x7f180c196be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:13.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.928+0000 7f180bfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f180c0fef60 0x7f180c196be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:41642/0 (socket says 172.21.15.83:41642) 2024-04-01T06:55:13.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.928+0000 7f180bfff700 1 -- 172.21.15.83:0/846604444 learned_addr learned my addr 172.21.15.83:0/846604444 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:13.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.928+0000 7f1810973700 1 --2- 172.21.15.83:0/846604444 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f180c1028d0 0x7f180c19e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:13.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.928+0000 7f180b7fe700 1 --2- 172.21.15.83:0/846604444 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f180c101f30 0x7f180c197120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:13.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.928+0000 7f180bfff700 1 -- 172.21.15.83:0/846604444 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f180c1028d0 msgr2=0x7f180c19e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:13.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.928+0000 7f180bfff700 1 --2- 172.21.15.83:0/846604444 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f180c1028d0 0x7f180c19e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:13.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.928+0000 7f180bfff700 1 -- 172.21.15.83:0/846604444 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f180c101f30 msgr2=0x7f180c197120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:13.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.928+0000 7f180bfff700 1 --2- 172.21.15.83:0/846604444 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f180c101f30 0x7f180c197120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:13.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.928+0000 7f180bfff700 1 -- 172.21.15.83:0/846604444 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18000095f0 con 0x7f180c0fef60 2024-04-01T06:55:13.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.928+0000 7f1810973700 1 --2- 172.21.15.83:0/846604444 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f180c1028d0 0x7f180c19e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:55:13.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.928+0000 7f180b7fe700 1 --2- 172.21.15.83:0/846604444 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f180c101f30 0x7f180c197120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:55:13.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.928+0000 7f180bfff700 1 --2- 172.21.15.83:0/846604444 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f180c0fef60 0x7f180c196be0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f18000095c0 tx=0x7f180000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:13.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.928+0000 7f18097fa700 1 -- 172.21.15.83:0/846604444 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180001d070 con 0x7f180c0fef60 2024-04-01T06:55:13.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.928+0000 7f18097fa700 1 -- 172.21.15.83:0/846604444 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f180000fb80 con 0x7f180c0fef60 2024-04-01T06:55:13.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.928+0000 7f18123d6700 1 -- 172.21.15.83:0/846604444 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f180c19ec60 con 0x7f180c0fef60 2024-04-01T06:55:13.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.928+0000 7f18097fa700 1 -- 172.21.15.83:0/846604444 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1800017650 con 0x7f180c0fef60 2024-04-01T06:55:13.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.928+0000 7f18123d6700 1 -- 172.21.15.83:0/846604444 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f180c19f080 con 0x7f180c0fef60 2024-04-01T06:55:13.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.929+0000 7f18123d6700 1 -- 172.21.15.83:0/846604444 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f180c1081c0 con 0x7f180c0fef60 2024-04-01T06:55:13.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.930+0000 7f18097fa700 1 -- 172.21.15.83:0/846604444 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f180000fcf0 con 0x7f180c0fef60 2024-04-01T06:55:13.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.931+0000 7f18097fa700 1 --2- 172.21.15.83:0/846604444 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f17f40a11b0 0x7f17f40a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:13.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.931+0000 7f180b7fe700 1 --2- 172.21.15.83:0/846604444 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f17f40a11b0 0x7f17f40a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:13.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.931+0000 7f18097fa700 1 -- 172.21.15.83:0/846604444 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f18000ce4e0 con 0x7f180c0fef60 2024-04-01T06:55:13.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.931+0000 7f180b7fe700 1 --2- 172.21.15.83:0/846604444 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f17f40a11b0 0x7f17f40a3670 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f17fc005fd0 tx=0x7f17fc005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:13.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:13.934+0000 7f18097fa700 1 -- 172.21.15.83:0/846604444 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f180009b7e0 con 0x7f180c0fef60 2024-04-01T06:55:14.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:13 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/645676730' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T06:55:14.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:13 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/1581097681' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-01T06:55:14.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:13 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/2474157508' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-01T06:55:14.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:13 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/645676730' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T06:55:14.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:13 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/1581097681' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-01T06:55:14.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:13 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/2474157508' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-01T06:55:14.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.176+0000 7f18123d6700 1 -- 172.21.15.83:0/846604444 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f180c067e60 con 0x7f180c0fef60 2024-04-01T06:55:14.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.177+0000 7f18097fa700 1 -- 172.21.15.83:0/846604444 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+10876 (secure 0 0 0) 0x7f180009b370 con 0x7f180c0fef60 2024-04-01T06:55:14.177 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:55:14.177 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1271130478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1271130478},{"type":"v1","addr":"172.21.15.83:6835","nonce":1271130478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2412682983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2412682983},{"type":"v1","addr":"172.21.15.83:6837","nonce":2412682983}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6839/3348145990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":3348145990},{"type":"v1","addr":"172.21.15.83:6839","nonce":3348145990}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6841/1191267445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6840","nonce":1191267445},{"type":"v1","addr":"172.21.15.83:6841","nonce":1191267445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2467459028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2467459028},{"type":"v1","addr":"172.21.15.153:6833","nonce":2467459028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24448,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4092629042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":4092629042},{"type":"v1","addr":"172.21.15.153:6835","nonce":4092629042}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-01T06:54:28.397062+0000","modified":"2024-04-01T06:54:33.704443+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24524,"mds_1":24494,"mds_2":24473},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6833/647005844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":647005844},{"type":"v1","addr":"172.21.15.145:6833","nonce":647005844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24454":{"gid":24454,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6837/1993816527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1993816527},{"type":"v1","addr":"172.21.15.153:6837","nonce":1993816527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6839/1399754640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1399754640},{"type":"v1","addr":"172.21.15.153:6839","nonce":1399754640}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24473":{"gid":24473,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.145:6835/3104241497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":3104241497},{"type":"v1","addr":"172.21.15.145:6835","nonce":3104241497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24494":{"gid":24494,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.145:6837/2687798317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2687798317},{"type":"v1","addr":"172.21.15.145:6837","nonce":2687798317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6839/3886435411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3886435411},{"type":"v1","addr":"172.21.15.145:6839","nonce":3886435411}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-01T06:55:14.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.179+0000 7f18123d6700 1 -- 172.21.15.83:0/846604444 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f17f40a11b0 msgr2=0x7f17f40a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:14.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.179+0000 7f18123d6700 1 --2- 172.21.15.83:0/846604444 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f17f40a11b0 0x7f17f40a3670 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f17fc005fd0 tx=0x7f17fc005e30 comp rx=0 tx=0).stop 2024-04-01T06:55:14.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.179+0000 7f18123d6700 1 -- 172.21.15.83:0/846604444 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f180c0fef60 msgr2=0x7f180c196be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:14.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.179+0000 7f18123d6700 1 --2- 172.21.15.83:0/846604444 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f180c0fef60 0x7f180c196be0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f18000095c0 tx=0x7f180000f690 comp rx=0 tx=0).stop 2024-04-01T06:55:14.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.179+0000 7f18123d6700 1 -- 172.21.15.83:0/846604444 shutdown_connections 2024-04-01T06:55:14.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.179+0000 7f18123d6700 1 --2- 172.21.15.83:0/846604444 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f180c0fef60 0x7f180c196be0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:14.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.179+0000 7f18123d6700 1 --2- 172.21.15.83:0/846604444 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f17f40a11b0 0x7f17f40a3670 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:14.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.179+0000 7f18123d6700 1 --2- 172.21.15.83:0/846604444 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f180c1028d0 0x7f180c19e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:14.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.179+0000 7f18123d6700 1 --2- 172.21.15.83:0/846604444 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f180c101f30 0x7f180c197120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:14.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.179+0000 7f18123d6700 1 -- 172.21.15.83:0/846604444 >> 172.21.15.83:0/846604444 conn(0x7f180c0fa890 msgr2=0x7f180c105300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:14.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.179+0000 7f18123d6700 1 -- 172.21.15.83:0/846604444 shutdown_connections 2024-04-01T06:55:14.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.179+0000 7f18123d6700 1 -- 172.21.15.83:0/846604444 wait complete. 2024-04-01T06:55:14.180 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 23 2024-04-01T06:55:14.192 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T06:55:14.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:13 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/645676730' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T06:55:14.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:13 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/1581097681' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-01T06:55:14.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:13 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/2474157508' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-01T06:55:14.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.315+0000 7fd4baa18700 1 -- 172.21.15.83:0/949083772 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd4b4101720 msgr2=0x7fd4b4107fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:14.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.315+0000 7fd4baa18700 1 --2- 172.21.15.83:0/949083772 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd4b4101720 0x7fd4b4107fd0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac00b0d0 tx=0x7fd4ac00b3e0 comp rx=0 tx=0).stop 2024-04-01T06:55:14.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.315+0000 7fd4baa18700 1 -- 172.21.15.83:0/949083772 shutdown_connections 2024-04-01T06:55:14.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.315+0000 7fd4baa18700 1 --2- 172.21.15.83:0/949083772 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd4b4101720 0x7fd4b4107fd0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:14.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.315+0000 7fd4baa18700 1 --2- 172.21.15.83:0/949083772 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4b40ffb90 0x7fd4b40fffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:14.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.315+0000 7fd4baa18700 1 --2- 172.21.15.83:0/949083772 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd4b4100d80 0x7fd4b41011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:14.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.315+0000 7fd4baa18700 1 -- 172.21.15.83:0/949083772 >> 172.21.15.83:0/949083772 conn(0x7fd4b40fb100 msgr2=0x7fd4b40fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:14.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.315+0000 7fd4baa18700 1 -- 172.21.15.83:0/949083772 shutdown_connections 2024-04-01T06:55:14.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.315+0000 7fd4baa18700 1 -- 172.21.15.83:0/949083772 wait complete. 2024-04-01T06:55:14.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.315+0000 7fd4baa18700 1 Processor -- start 2024-04-01T06:55:14.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.315+0000 7fd4baa18700 1 -- start start 2024-04-01T06:55:14.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.316+0000 7fd4baa18700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd4b40ffb90 0x7fd4b4069b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:14.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.316+0000 7fd4baa18700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4b4100d80 0x7fd4b419ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:14.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.316+0000 7fd4baa18700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd4b4101720 0x7fd4b419e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:14.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.316+0000 7fd4baa18700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b419e820 con 0x7fd4b4101720 2024-04-01T06:55:14.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.316+0000 7fd4baa18700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b419e990 con 0x7fd4b40ffb90 2024-04-01T06:55:14.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.316+0000 7fd4baa18700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b419eb50 con 0x7fd4b4100d80 2024-04-01T06:55:14.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.316+0000 7fd4b8fb5700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd4b4101720 0x7fd4b419e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:14.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.316+0000 7fd4b8fb5700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd4b4101720 0x7fd4b419e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:41658/0 (socket says 172.21.15.83:41658) 2024-04-01T06:55:14.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.316+0000 7fd4b8fb5700 1 -- 172.21.15.83:0/1666628200 learned_addr learned my addr 172.21.15.83:0/1666628200 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:14.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.316+0000 7fd4b3fff700 1 --2- 172.21.15.83:0/1666628200 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd4b40ffb90 0x7fd4b4069b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:14.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.316+0000 7fd4b37fe700 1 --2- 172.21.15.83:0/1666628200 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4b4100d80 0x7fd4b419ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:14.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.316+0000 7fd4b8fb5700 1 -- 172.21.15.83:0/1666628200 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4b4100d80 msgr2=0x7fd4b419ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:14.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.316+0000 7fd4b8fb5700 1 --2- 172.21.15.83:0/1666628200 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4b4100d80 0x7fd4b419ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:14.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.316+0000 7fd4b8fb5700 1 -- 172.21.15.83:0/1666628200 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd4b40ffb90 msgr2=0x7fd4b4069b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:14.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.316+0000 7fd4b8fb5700 1 --2- 172.21.15.83:0/1666628200 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd4b40ffb90 0x7fd4b4069b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:14.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.316+0000 7fd4b8fb5700 1 -- 172.21.15.83:0/1666628200 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4ac009d00 con 0x7fd4b4101720 2024-04-01T06:55:14.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.317+0000 7fd4b8fb5700 1 --2- 172.21.15.83:0/1666628200 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd4b4101720 0x7fd4b419e030 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac007bd0 tx=0x7fd4ac009440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:14.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.317+0000 7fd4b17fa700 1 -- 172.21.15.83:0/1666628200 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac00e040 con 0x7fd4b4101720 2024-04-01T06:55:14.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.317+0000 7fd4b17fa700 1 -- 172.21.15.83:0/1666628200 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd4ac01dd50 con 0x7fd4b4101720 2024-04-01T06:55:14.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.317+0000 7fd4baa18700 1 -- 172.21.15.83:0/1666628200 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4b419ed70 con 0x7fd4b4101720 2024-04-01T06:55:14.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.317+0000 7fd4b17fa700 1 -- 172.21.15.83:0/1666628200 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac0123f0 con 0x7fd4b4101720 2024-04-01T06:55:14.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.317+0000 7fd4baa18700 1 -- 172.21.15.83:0/1666628200 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4b419f1a0 con 0x7fd4b4101720 2024-04-01T06:55:14.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.318+0000 7fd4baa18700 1 -- 172.21.15.83:0/1666628200 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4b4106f90 con 0x7fd4b4101720 2024-04-01T06:55:14.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.319+0000 7fd4b17fa700 1 -- 172.21.15.83:0/1666628200 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7fd4ac01d890 con 0x7fd4b4101720 2024-04-01T06:55:14.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.319+0000 7fd4b17fa700 1 --2- 172.21.15.83:0/1666628200 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd4a00a11b0 0x7fd4a00a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:14.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.319+0000 7fd4b3fff700 1 --2- 172.21.15.83:0/1666628200 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd4a00a11b0 0x7fd4a00a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:14.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.319+0000 7fd4b17fa700 1 -- 172.21.15.83:0/1666628200 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fd4ac0ce5b0 con 0x7fd4b4101720 2024-04-01T06:55:14.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.320+0000 7fd4b3fff700 1 --2- 172.21.15.83:0/1666628200 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd4a00a11b0 0x7fd4a00a3670 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd4b4100be0 tx=0x7fd49c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:14.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.323+0000 7fd4b17fa700 1 -- 172.21.15.83:0/1666628200 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7fd4ac097e20 con 0x7fd4b4101720 2024-04-01T06:55:14.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.532+0000 7fd4baa18700 1 -- 172.21.15.83:0/1666628200 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd4b410b430 con 0x7fd4b4101720 2024-04-01T06:55:14.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.533+0000 7fd4b17fa700 1 -- 172.21.15.83:0/1666628200 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+22131 (secure 0 0 0) 0x7fd4ac09b440 con 0x7fd4b4101720 2024-04-01T06:55:14.534 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:55:14.534 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":79,"fsid":"c6f8eff4-eff3-11ee-b647-cb9ed24678a4","created":"2024-04-01T06:48:42.033382+0000","modified":"2024-04-01T06:54:29.399277+0000","last_up_change":"2024-04-01T06:53:55.791339+0000","last_in_change":"2024-04-01T06:53:39.777214+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T06:51:21.963996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T06:54:26.450403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T06:54:27.564928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"90b761b0-b06c-4142-854d-38ee42aa6052","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6803","nonce":3253845390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6805","nonce":3253845390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6809","nonce":3253845390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6807","nonce":3253845390}]},"public_addr":"172.21.15.83:6803/3253845390","cluster_addr":"172.21.15.83:6805/3253845390","heartbeat_back_addr":"172.21.15.83:6809/3253845390","heartbeat_front_addr":"172.21.15.83:6807/3253845390","state":["exists","up"]},{"osd":1,"uuid":"4d6ab85b-7088-451e-a829-c9119f35dee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6801","nonce":515889759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6803","nonce":515889759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6807","nonce":515889759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6805","nonce":515889759}]},"public_addr":"172.21.15.145:6801/515889759","cluster_addr":"172.21.15.145:6803/515889759","heartbeat_back_addr":"172.21.15.145:6807/515889759","heartbeat_front_addr":"172.21.15.145:6805/515889759","state":["exists","up"]},{"osd":2,"uuid":"d04c27f3-4972-4061-8bfb-5060645e3883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6801","nonce":3318516728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6803","nonce":3318516728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6807","nonce":3318516728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6805","nonce":3318516728}]},"public_addr":"172.21.15.153:6801/3318516728","cluster_addr":"172.21.15.153:6803/3318516728","heartbeat_back_addr":"172.21.15.153:6807/3318516728","heartbeat_front_addr":"172.21.15.153:6805/3318516728","state":["exists","up"]},{"osd":3,"uuid":"899b6c90-8f2f-44dd-b807-49594aadb443","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6811","nonce":504690234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6813","nonce":504690234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6817","nonce":504690234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6815","nonce":504690234}]},"public_addr":"172.21.15.83:6811/504690234","cluster_addr":"172.21.15.83:6813/504690234","heartbeat_back_addr":"172.21.15.83:6817/504690234","heartbeat_front_addr":"172.21.15.83:6815/504690234","state":["exists","up"]},{"osd":4,"uuid":"5071dd81-804e-4358-bfb6-11e718e9cf4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6809","nonce":2099824730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6811","nonce":2099824730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6815","nonce":2099824730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6813","nonce":2099824730}]},"public_addr":"172.21.15.145:6809/2099824730","cluster_addr":"172.21.15.145:6811/2099824730","heartbeat_back_addr":"172.21.15.145:6815/2099824730","heartbeat_front_addr":"172.21.15.145:6813/2099824730","state":["exists","up"]},{"osd":5,"uuid":"b8442b71-c26e-467f-b0c3-ea9f636f5a00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6809","nonce":3340941443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6811","nonce":3340941443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6815","nonce":3340941443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6813","nonce":3340941443}]},"public_addr":"172.21.15.153:6809/3340941443","cluster_addr":"172.21.15.153:6811/3340941443","heartbeat_back_addr":"172.21.15.153:6815/3340941443","heartbeat_front_addr":"172.21.15.153:6813/3340941443","state":["exists","up"]},{"osd":6,"uuid":"c26bb8cb-ccee-4bfc-91eb-14e1ad8e04df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6819","nonce":2005485079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6821","nonce":2005485079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6825","nonce":2005485079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6823","nonce":2005485079}]},"public_addr":"172.21.15.83:6819/2005485079","cluster_addr":"172.21.15.83:6821/2005485079","heartbeat_back_addr":"172.21.15.83:6825/2005485079","heartbeat_front_addr":"172.21.15.83:6823/2005485079","state":["exists","up"]},{"osd":7,"uuid":"a8940da2-0e79-4606-8d1e-d425afbf5753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6817","nonce":3737505059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6819","nonce":3737505059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6823","nonce":3737505059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6821","nonce":3737505059}]},"public_addr":"172.21.15.145:6817/3737505059","cluster_addr":"172.21.15.145:6819/3737505059","heartbeat_back_addr":"172.21.15.145:6823/3737505059","heartbeat_front_addr":"172.21.15.145:6821/3737505059","state":["exists","up"]},{"osd":8,"uuid":"602d43ac-a189-4da3-9e38-7025d14e0dd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6817","nonce":1031545791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6819","nonce":1031545791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6823","nonce":1031545791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6821","nonce":1031545791}]},"public_addr":"172.21.15.153:6817/1031545791","cluster_addr":"172.21.15.153:6819/1031545791","heartbeat_back_addr":"172.21.15.153:6823/1031545791","heartbeat_front_addr":"172.21.15.153:6821/1031545791","state":["exists","up"]},{"osd":9,"uuid":"08b12d27-1247-45e4-9d09-cacc0fce4bd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6827","nonce":3720996673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6829","nonce":3720996673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6833","nonce":3720996673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6831","nonce":3720996673}]},"public_addr":"172.21.15.83:6827/3720996673","cluster_addr":"172.21.15.83:6829/3720996673","heartbeat_back_addr":"172.21.15.83:6833/3720996673","heartbeat_front_addr":"172.21.15.83:6831/3720996673","state":["exists","up"]},{"osd":10,"uuid":"dd986b50-d68f-446c-9c66-261535880879","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6825","nonce":2671529479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6827","nonce":2671529479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6831","nonce":2671529479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6829","nonce":2671529479}]},"public_addr":"172.21.15.145:6825/2671529479","cluster_addr":"172.21.15.145:6827/2671529479","heartbeat_back_addr":"172.21.15.145:6831/2671529479","heartbeat_front_addr":"172.21.15.145:6829/2671529479","state":["exists","up"]},{"osd":11,"uuid":"d20a49cd-6224-4424-8375-46da791d9931","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6825","nonce":2342548429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6827","nonce":2342548429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6831","nonce":2342548429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6829","nonce":2342548429}]},"public_addr":"172.21.15.153:6825/2342548429","cluster_addr":"172.21.15.153:6827/2342548429","heartbeat_back_addr":"172.21.15.153:6831/2342548429","heartbeat_front_addr":"172.21.15.153:6829/2342548429","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:50:44.539932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:01.990470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:19.054426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:36.616393+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:53.896705+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:10.667502+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:27.880849+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:45.276308+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:02.280615+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:19.555547+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:37.062881+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:54.191589+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.83:6801/1867137261":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/2596683931":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/2125339627":"2024-04-02T06:49:33.656125+0000","172.21.15.83:6800/1644397953":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/690500472":"2024-04-02T06:49:13.456026+0000","172.21.15.83:6801/1644397953":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/785958951":"2024-04-02T06:49:33.656125+0000","172.21.15.83:6800/1867137261":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/2222527447":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/2071592157":"2024-04-02T06:49:13.456026+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T06:55:14.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.536+0000 7fd4baa18700 1 -- 172.21.15.83:0/1666628200 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd4a00a11b0 msgr2=0x7fd4a00a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:14.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.536+0000 7fd4baa18700 1 --2- 172.21.15.83:0/1666628200 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd4a00a11b0 0x7fd4a00a3670 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd4b4100be0 tx=0x7fd49c00b410 comp rx=0 tx=0).stop 2024-04-01T06:55:14.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.536+0000 7fd4baa18700 1 -- 172.21.15.83:0/1666628200 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd4b4101720 msgr2=0x7fd4b419e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:14.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.536+0000 7fd4baa18700 1 --2- 172.21.15.83:0/1666628200 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd4b4101720 0x7fd4b419e030 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac007bd0 tx=0x7fd4ac009440 comp rx=0 tx=0).stop 2024-04-01T06:55:14.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.536+0000 7fd4baa18700 1 -- 172.21.15.83:0/1666628200 shutdown_connections 2024-04-01T06:55:14.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.536+0000 7fd4baa18700 1 --2- 172.21.15.83:0/1666628200 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd4b4101720 0x7fd4b419e030 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:14.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.536+0000 7fd4baa18700 1 --2- 172.21.15.83:0/1666628200 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd4a00a11b0 0x7fd4a00a3670 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:14.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.536+0000 7fd4baa18700 1 --2- 172.21.15.83:0/1666628200 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd4b40ffb90 0x7fd4b4069b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:14.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.536+0000 7fd4baa18700 1 --2- 172.21.15.83:0/1666628200 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4b4100d80 0x7fd4b419ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:14.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.536+0000 7fd4baa18700 1 -- 172.21.15.83:0/1666628200 >> 172.21.15.83:0/1666628200 conn(0x7fd4b40fb100 msgr2=0x7fd4b41040d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:14.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.536+0000 7fd4baa18700 1 -- 172.21.15.83:0/1666628200 shutdown_connections 2024-04-01T06:55:14.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.536+0000 7fd4baa18700 1 -- 172.21.15.83:0/1666628200 wait complete. 2024-04-01T06:55:14.548 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-01T06:51:21.963996+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-01T06:54:26.450403+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-01T06:54:27.564928+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-01T06:55:14.549 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-01T06:55:14.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.674+0000 7f6e27d6d700 1 -- 172.21.15.83:0/641707648 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e20101270 msgr2=0x7f6e20101690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:14.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.674+0000 7f6e27d6d700 1 --2- 172.21.15.83:0/641707648 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e20101270 0x7f6e20101690 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6e14009990 tx=0x7f6e14009ca0 comp rx=0 tx=0).stop 2024-04-01T06:55:14.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.674+0000 7f6e27d6d700 1 -- 172.21.15.83:0/641707648 shutdown_connections 2024-04-01T06:55:14.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.674+0000 7f6e27d6d700 1 --2- 172.21.15.83:0/641707648 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e20101270 0x7f6e20101690 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:14.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.674+0000 7f6e27d6d700 1 --2- 172.21.15.83:0/641707648 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e20100880 0x7f6e20108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:14.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.674+0000 7f6e27d6d700 1 --2- 172.21.15.83:0/641707648 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6e200ffec0 0x7f6e20100340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:14.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.674+0000 7f6e27d6d700 1 -- 172.21.15.83:0/641707648 >> 172.21.15.83:0/641707648 conn(0x7f6e200fa950 msgr2=0x7f6e200fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:14.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.674+0000 7f6e27d6d700 1 -- 172.21.15.83:0/641707648 shutdown_connections 2024-04-01T06:55:14.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.674+0000 7f6e27d6d700 1 -- 172.21.15.83:0/641707648 wait complete. 2024-04-01T06:55:14.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.674+0000 7f6e27d6d700 1 Processor -- start 2024-04-01T06:55:14.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.675+0000 7f6e27d6d700 1 -- start start 2024-04-01T06:55:14.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.675+0000 7f6e27d6d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e200ffec0 0x7f6e20103c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:14.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.675+0000 7f6e27d6d700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6e20100880 0x7f6e201022b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:14.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.675+0000 7f6e27d6d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e20101270 0x7f6e201027f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:14.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.675+0000 7f6e27d6d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e20102f90 con 0x7f6e200ffec0 2024-04-01T06:55:14.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.675+0000 7f6e27d6d700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e20103100 con 0x7f6e20100880 2024-04-01T06:55:14.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.675+0000 7f6e27d6d700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e201a0d80 con 0x7f6e20101270 2024-04-01T06:55:14.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.675+0000 7f6e25b09700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e200ffec0 0x7f6e20103c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:14.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.675+0000 7f6e25b09700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e200ffec0 0x7f6e20103c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:41672/0 (socket says 172.21.15.83:41672) 2024-04-01T06:55:14.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.675+0000 7f6e25b09700 1 -- 172.21.15.83:0/1215483802 learned_addr learned my addr 172.21.15.83:0/1215483802 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:14.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.675+0000 7f6e2630a700 1 --2- 172.21.15.83:0/1215483802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e20101270 0x7f6e201027f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:14.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.675+0000 7f6e25308700 1 --2- 172.21.15.83:0/1215483802 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6e20100880 0x7f6e201022b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:14.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.675+0000 7f6e25b09700 1 -- 172.21.15.83:0/1215483802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e20101270 msgr2=0x7f6e201027f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:14.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.675+0000 7f6e25b09700 1 --2- 172.21.15.83:0/1215483802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e20101270 0x7f6e201027f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:14.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.675+0000 7f6e25b09700 1 -- 172.21.15.83:0/1215483802 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6e20100880 msgr2=0x7f6e201022b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:14.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.675+0000 7f6e25b09700 1 --2- 172.21.15.83:0/1215483802 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6e20100880 0x7f6e201022b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:14.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.675+0000 7f6e25b09700 1 -- 172.21.15.83:0/1215483802 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e140095f0 con 0x7f6e200ffec0 2024-04-01T06:55:14.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.675+0000 7f6e25b09700 1 --2- 172.21.15.83:0/1215483802 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e200ffec0 0x7f6e20103c20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6e140095c0 tx=0x7f6e1400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:14.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.675+0000 7f6e12ffd700 1 -- 172.21.15.83:0/1215483802 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1401d070 con 0x7f6e200ffec0 2024-04-01T06:55:14.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.675+0000 7f6e12ffd700 1 -- 172.21.15.83:0/1215483802 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6e1400fb80 con 0x7f6e200ffec0 2024-04-01T06:55:14.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.675+0000 7f6e12ffd700 1 -- 172.21.15.83:0/1215483802 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e14022ea0 con 0x7f6e200ffec0 2024-04-01T06:55:14.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.675+0000 7f6e27d6d700 1 -- 172.21.15.83:0/1215483802 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e201a0fb0 con 0x7f6e200ffec0 2024-04-01T06:55:14.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.675+0000 7f6e27d6d700 1 -- 172.21.15.83:0/1215483802 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e201a1320 con 0x7f6e200ffec0 2024-04-01T06:55:14.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.676+0000 7f6e27d6d700 1 -- 172.21.15.83:0/1215483802 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e20067260 con 0x7f6e200ffec0 2024-04-01T06:55:14.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.677+0000 7f6e12ffd700 1 -- 172.21.15.83:0/1215483802 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f6e14004830 con 0x7f6e200ffec0 2024-04-01T06:55:14.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.678+0000 7f6e12ffd700 1 --2- 172.21.15.83:0/1215483802 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f6e0c0a11b0 0x7f6e0c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:14.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.678+0000 7f6e12ffd700 1 -- 172.21.15.83:0/1215483802 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f6e140cde00 con 0x7f6e200ffec0 2024-04-01T06:55:14.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.678+0000 7f6e25308700 1 --2- 172.21.15.83:0/1215483802 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f6e0c0a11b0 0x7f6e0c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:14.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.678+0000 7f6e25308700 1 --2- 172.21.15.83:0/1215483802 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f6e0c0a11b0 0x7f6e0c0a3670 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c00bbd0 tx=0x7f6e1c00b5b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:14.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.682+0000 7f6e12ffd700 1 -- 172.21.15.83:0/1215483802 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f6e14097670 con 0x7f6e200ffec0 2024-04-01T06:55:14.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.876+0000 7f6e27d6d700 1 -- 172.21.15.83:0/1215483802 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6e201a1640 con 0x7f6e200ffec0 2024-04-01T06:55:14.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.876+0000 7f6e12ffd700 1 -- 172.21.15.83:0/1215483802 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6e1409ac90 con 0x7f6e200ffec0 2024-04-01T06:55:14.876 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 1 2024-04-01T06:55:14.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.878+0000 7f6e27d6d700 1 -- 172.21.15.83:0/1215483802 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f6e0c0a11b0 msgr2=0x7f6e0c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:14.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.878+0000 7f6e27d6d700 1 --2- 172.21.15.83:0/1215483802 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f6e0c0a11b0 0x7f6e0c0a3670 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c00bbd0 tx=0x7f6e1c00b5b0 comp rx=0 tx=0).stop 2024-04-01T06:55:14.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.878+0000 7f6e27d6d700 1 -- 172.21.15.83:0/1215483802 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e200ffec0 msgr2=0x7f6e20103c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:14.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.878+0000 7f6e27d6d700 1 --2- 172.21.15.83:0/1215483802 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e200ffec0 0x7f6e20103c20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6e140095c0 tx=0x7f6e1400f690 comp rx=0 tx=0).stop 2024-04-01T06:55:14.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.878+0000 7f6e27d6d700 1 -- 172.21.15.83:0/1215483802 shutdown_connections 2024-04-01T06:55:14.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.878+0000 7f6e27d6d700 1 --2- 172.21.15.83:0/1215483802 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e200ffec0 0x7f6e20103c20 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:14.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.878+0000 7f6e27d6d700 1 --2- 172.21.15.83:0/1215483802 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f6e0c0a11b0 0x7f6e0c0a3670 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:14.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.878+0000 7f6e27d6d700 1 --2- 172.21.15.83:0/1215483802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e20101270 0x7f6e201027f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:14.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.878+0000 7f6e27d6d700 1 --2- 172.21.15.83:0/1215483802 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6e20100880 0x7f6e201022b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:14.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.878+0000 7f6e27d6d700 1 -- 172.21.15.83:0/1215483802 >> 172.21.15.83:0/1215483802 conn(0x7f6e200fa950 msgr2=0x7f6e200fee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:14.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.878+0000 7f6e27d6d700 1 -- 172.21.15.83:0/1215483802 shutdown_connections 2024-04-01T06:55:14.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:14.878+0000 7f6e27d6d700 1 -- 172.21.15.83:0/1215483802 wait complete. 2024-04-01T06:55:14.889 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:14 smithi083 ceph-mon[43429]: pgmap v239: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 6 op/s 2024-04-01T06:55:14.889 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:14 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/429890596' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-01T06:55:14.889 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:14 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/846604444' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:55:14.889 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:14 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/1666628200' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T06:55:14.890 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-01T06:55:15.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.015+0000 7fd6ac8f2700 1 -- 172.21.15.83:0/447224540 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd6a81017f0 msgr2=0x7fd6a81080a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:15.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.015+0000 7fd6ac8f2700 1 --2- 172.21.15.83:0/447224540 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd6a81017f0 0x7fd6a81080a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd6a000b0d0 tx=0x7fd6a000b3e0 comp rx=0 tx=0).stop 2024-04-01T06:55:15.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.015+0000 7fd6ac8f2700 1 -- 172.21.15.83:0/447224540 shutdown_connections 2024-04-01T06:55:15.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.015+0000 7fd6ac8f2700 1 --2- 172.21.15.83:0/447224540 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd6a81017f0 0x7fd6a81080a0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:15.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.015+0000 7fd6ac8f2700 1 --2- 172.21.15.83:0/447224540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6a80ffc60 0x7fd6a8100080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:15.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.015+0000 7fd6ac8f2700 1 --2- 172.21.15.83:0/447224540 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd6a8100e50 0x7fd6a81012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:15.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.015+0000 7fd6ac8f2700 1 -- 172.21.15.83:0/447224540 >> 172.21.15.83:0/447224540 conn(0x7fd6a80fb1d0 msgr2=0x7fd6a80fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:15.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.016+0000 7fd6ac8f2700 1 -- 172.21.15.83:0/447224540 shutdown_connections 2024-04-01T06:55:15.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.016+0000 7fd6ac8f2700 1 -- 172.21.15.83:0/447224540 wait complete. 2024-04-01T06:55:15.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.016+0000 7fd6ac8f2700 1 Processor -- start 2024-04-01T06:55:15.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.016+0000 7fd6ac8f2700 1 -- start start 2024-04-01T06:55:15.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.016+0000 7fd6ac8f2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6a80ffc60 0x7fd6a8103b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:15.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.016+0000 7fd6ac8f2700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd6a8100e50 0x7fd6a8102230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:15.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.016+0000 7fd6ac8f2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd6a81017f0 0x7fd6a8102770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:15.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.016+0000 7fd6ac8f2700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a8102e70 con 0x7fd6a81017f0 2024-04-01T06:55:15.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.016+0000 7fd6ac8f2700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a8102fe0 con 0x7fd6a8100e50 2024-04-01T06:55:15.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.016+0000 7fd6ac8f2700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a81a0e60 con 0x7fd6a80ffc60 2024-04-01T06:55:15.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.017+0000 7fd6a6d9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd6a81017f0 0x7fd6a8102770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:15.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.017+0000 7fd6a6d9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd6a81017f0 0x7fd6a8102770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:41680/0 (socket says 172.21.15.83:41680) 2024-04-01T06:55:15.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.017+0000 7fd6a6d9d700 1 -- 172.21.15.83:0/3902743029 learned_addr learned my addr 172.21.15.83:0/3902743029 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:15.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.017+0000 7fd6a5d9b700 1 --2- 172.21.15.83:0/3902743029 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd6a8100e50 0x7fd6a8102230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:15.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.017+0000 7fd6a6d9d700 1 -- 172.21.15.83:0/3902743029 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6a80ffc60 msgr2=0x7fd6a8103b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:15.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.017+0000 7fd6a659c700 1 --2- 172.21.15.83:0/3902743029 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6a80ffc60 0x7fd6a8103b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:15.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.017+0000 7fd6a6d9d700 1 --2- 172.21.15.83:0/3902743029 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6a80ffc60 0x7fd6a8103b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:15.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.017+0000 7fd6a6d9d700 1 -- 172.21.15.83:0/3902743029 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd6a8100e50 msgr2=0x7fd6a8102230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:15.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.017+0000 7fd6a6d9d700 1 --2- 172.21.15.83:0/3902743029 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd6a8100e50 0x7fd6a8102230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:15.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.017+0000 7fd6a6d9d700 1 -- 172.21.15.83:0/3902743029 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a0009d00 con 0x7fd6a81017f0 2024-04-01T06:55:15.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.017+0000 7fd6a6d9d700 1 --2- 172.21.15.83:0/3902743029 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd6a81017f0 0x7fd6a8102770 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd6a0007bd0 tx=0x7fd6a00094f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:15.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.017+0000 7fd69f7fe700 1 -- 172.21.15.83:0/3902743029 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a000e040 con 0x7fd6a81017f0 2024-04-01T06:55:15.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.017+0000 7fd69f7fe700 1 -- 172.21.15.83:0/3902743029 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd6a0012dc0 con 0x7fd6a81017f0 2024-04-01T06:55:15.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.017+0000 7fd6ac8f2700 1 -- 172.21.15.83:0/3902743029 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6a81a1060 con 0x7fd6a81017f0 2024-04-01T06:55:15.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.017+0000 7fd69f7fe700 1 -- 172.21.15.83:0/3902743029 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a001b450 con 0x7fd6a81017f0 2024-04-01T06:55:15.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.017+0000 7fd6ac8f2700 1 -- 172.21.15.83:0/3902743029 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6a81a14e0 con 0x7fd6a81017f0 2024-04-01T06:55:15.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.018+0000 7fd6ac8f2700 1 -- 172.21.15.83:0/3902743029 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6a8067af0 con 0x7fd6a81017f0 2024-04-01T06:55:15.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.020+0000 7fd69f7fe700 1 -- 172.21.15.83:0/3902743029 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7fd6a001d610 con 0x7fd6a81017f0 2024-04-01T06:55:15.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.020+0000 7fd69f7fe700 1 --2- 172.21.15.83:0/3902743029 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd6940a11b0 0x7fd6940a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:15.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.020+0000 7fd6a659c700 1 --2- 172.21.15.83:0/3902743029 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd6940a11b0 0x7fd6940a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:15.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.020+0000 7fd69f7fe700 1 -- 172.21.15.83:0/3902743029 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fd6a00ceee0 con 0x7fd6a81017f0 2024-04-01T06:55:15.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.021+0000 7fd6a659c700 1 --2- 172.21.15.83:0/3902743029 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd6940a11b0 0x7fd6940a3670 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd690005950 tx=0x7fd6900058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:15.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.024+0000 7fd69f7fe700 1 -- 172.21.15.83:0/3902743029 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7fd6a0098750 con 0x7fd6a81017f0 2024-04-01T06:55:15.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:14 smithi153 ceph-mon[48187]: pgmap v239: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 6 op/s 2024-04-01T06:55:15.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:14 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/429890596' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-01T06:55:15.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:14 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/846604444' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:55:15.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:14 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/1666628200' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T06:55:15.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.218+0000 7fd6ac8f2700 1 -- 172.21.15.83:0/3902743029 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd6a810b480 con 0x7fd6a81017f0 2024-04-01T06:55:15.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.219+0000 7fd69f7fe700 1 -- 172.21.15.83:0/3902743029 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v79) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd6a009bd70 con 0x7fd6a81017f0 2024-04-01T06:55:15.219 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 32 2024-04-01T06:55:15.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.221+0000 7fd6ac8f2700 1 -- 172.21.15.83:0/3902743029 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd6940a11b0 msgr2=0x7fd6940a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:15.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.221+0000 7fd6ac8f2700 1 --2- 172.21.15.83:0/3902743029 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd6940a11b0 0x7fd6940a3670 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd690005950 tx=0x7fd6900058e0 comp rx=0 tx=0).stop 2024-04-01T06:55:15.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.221+0000 7fd6ac8f2700 1 -- 172.21.15.83:0/3902743029 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd6a81017f0 msgr2=0x7fd6a8102770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:15.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.221+0000 7fd6ac8f2700 1 --2- 172.21.15.83:0/3902743029 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd6a81017f0 0x7fd6a8102770 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd6a0007bd0 tx=0x7fd6a00094f0 comp rx=0 tx=0).stop 2024-04-01T06:55:15.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.221+0000 7fd6ac8f2700 1 -- 172.21.15.83:0/3902743029 shutdown_connections 2024-04-01T06:55:15.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.221+0000 7fd6ac8f2700 1 --2- 172.21.15.83:0/3902743029 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd6a81017f0 0x7fd6a8102770 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:15.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.221+0000 7fd6ac8f2700 1 --2- 172.21.15.83:0/3902743029 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd6940a11b0 0x7fd6940a3670 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:15.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.221+0000 7fd6ac8f2700 1 --2- 172.21.15.83:0/3902743029 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6a80ffc60 0x7fd6a8103b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:15.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.221+0000 7fd6ac8f2700 1 --2- 172.21.15.83:0/3902743029 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd6a8100e50 0x7fd6a8102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:15.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.221+0000 7fd6ac8f2700 1 -- 172.21.15.83:0/3902743029 >> 172.21.15.83:0/3902743029 conn(0x7fd6a80fb1d0 msgr2=0x7fd6a80fcc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:15.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.221+0000 7fd6ac8f2700 1 -- 172.21.15.83:0/3902743029 shutdown_connections 2024-04-01T06:55:15.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.221+0000 7fd6ac8f2700 1 -- 172.21.15.83:0/3902743029 wait complete. 2024-04-01T06:55:15.233 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-01T06:55:15.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:14 smithi145 ceph-mon[47816]: pgmap v239: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 6 op/s 2024-04-01T06:55:15.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:14 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/429890596' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-01T06:55:15.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:14 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/846604444' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:55:15.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:14 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/1666628200' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T06:55:15.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.357+0000 7ff07c3a3700 1 -- 172.21.15.83:0/1656521627 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff0740ffc60 msgr2=0x7ff074100080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:15.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.357+0000 7ff07c3a3700 1 --2- 172.21.15.83:0/1656521627 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff0740ffc60 0x7ff074100080 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff0640099c0 tx=0x7ff064009cd0 comp rx=0 tx=0).stop 2024-04-01T06:55:15.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.357+0000 7ff07c3a3700 1 -- 172.21.15.83:0/1656521627 shutdown_connections 2024-04-01T06:55:15.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.357+0000 7ff07c3a3700 1 --2- 172.21.15.83:0/1656521627 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff0740ffc60 0x7ff074100080 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:15.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.357+0000 7ff07c3a3700 1 --2- 172.21.15.83:0/1656521627 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff0741017f0 0x7ff0741080a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:15.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.357+0000 7ff07c3a3700 1 --2- 172.21.15.83:0/1656521627 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff074100e50 0x7ff0741012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:15.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.357+0000 7ff07c3a3700 1 -- 172.21.15.83:0/1656521627 >> 172.21.15.83:0/1656521627 conn(0x7ff0740fb1d0 msgr2=0x7ff0740fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:15.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.357+0000 7ff07c3a3700 1 -- 172.21.15.83:0/1656521627 shutdown_connections 2024-04-01T06:55:15.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.357+0000 7ff07c3a3700 1 -- 172.21.15.83:0/1656521627 wait complete. 2024-04-01T06:55:15.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.358+0000 7ff07c3a3700 1 Processor -- start 2024-04-01T06:55:15.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.358+0000 7ff07c3a3700 1 -- start start 2024-04-01T06:55:15.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.358+0000 7ff07c3a3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0740ffc60 0x7ff074196d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:15.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.358+0000 7ff07c3a3700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff074100e50 0x7ff0741972c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:15.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.358+0000 7ff07c3a3700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff0741017f0 0x7ff07419e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:15.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.358+0000 7ff07c3a3700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff07419e870 con 0x7ff0741017f0 2024-04-01T06:55:15.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.358+0000 7ff07c3a3700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff07419e9e0 con 0x7ff074100e50 2024-04-01T06:55:15.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.358+0000 7ff07c3a3700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff07419eba0 con 0x7ff0740ffc60 2024-04-01T06:55:15.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.358+0000 7ff07a940700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff0741017f0 0x7ff07419e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:15.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.358+0000 7ff07a940700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff0741017f0 0x7ff07419e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:41690/0 (socket says 172.21.15.83:41690) 2024-04-01T06:55:15.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.358+0000 7ff07a940700 1 -- 172.21.15.83:0/2965067418 learned_addr learned my addr 172.21.15.83:0/2965067418 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:15.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.358+0000 7ff07a13f700 1 --2- 172.21.15.83:0/2965067418 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0740ffc60 0x7ff074196d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:15.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.358+0000 7ff07a940700 1 -- 172.21.15.83:0/2965067418 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0740ffc60 msgr2=0x7ff074196d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:15.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.358+0000 7ff07a940700 1 --2- 172.21.15.83:0/2965067418 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0740ffc60 0x7ff074196d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:15.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.358+0000 7ff07993e700 1 --2- 172.21.15.83:0/2965067418 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff074100e50 0x7ff0741972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:15.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.358+0000 7ff07a940700 1 -- 172.21.15.83:0/2965067418 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff074100e50 msgr2=0x7ff0741972c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:15.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.358+0000 7ff07a940700 1 --2- 172.21.15.83:0/2965067418 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff074100e50 0x7ff0741972c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:15.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.358+0000 7ff07a940700 1 -- 172.21.15.83:0/2965067418 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0640095f0 con 0x7ff0741017f0 2024-04-01T06:55:15.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.358+0000 7ff07a940700 1 --2- 172.21.15.83:0/2965067418 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff0741017f0 0x7ff07419e2a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff06c00b970 tx=0x7ff06c00bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:15.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.358+0000 7ff06b7fe700 1 -- 172.21.15.83:0/2965067418 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06c00c9b0 con 0x7ff0741017f0 2024-04-01T06:55:15.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.359+0000 7ff06b7fe700 1 -- 172.21.15.83:0/2965067418 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff06c014440 con 0x7ff0741017f0 2024-04-01T06:55:15.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.359+0000 7ff07c3a3700 1 -- 172.21.15.83:0/2965067418 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff07419ee80 con 0x7ff0741017f0 2024-04-01T06:55:15.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.359+0000 7ff06b7fe700 1 -- 172.21.15.83:0/2965067418 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06c0075d0 con 0x7ff0741017f0 2024-04-01T06:55:15.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.359+0000 7ff07c3a3700 1 -- 172.21.15.83:0/2965067418 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff07419f250 con 0x7ff0741017f0 2024-04-01T06:55:15.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.360+0000 7ff07c3a3700 1 -- 172.21.15.83:0/2965067418 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff074067af0 con 0x7ff0741017f0 2024-04-01T06:55:15.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.361+0000 7ff06b7fe700 1 -- 172.21.15.83:0/2965067418 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7ff06c0145b0 con 0x7ff0741017f0 2024-04-01T06:55:15.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.361+0000 7ff06b7fe700 1 --2- 172.21.15.83:0/2965067418 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7ff0600a11b0 0x7ff0600a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:15.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.361+0000 7ff07a13f700 1 --2- 172.21.15.83:0/2965067418 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7ff0600a11b0 0x7ff0600a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:15.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.361+0000 7ff06b7fe700 1 -- 172.21.15.83:0/2965067418 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ff06c006e40 con 0x7ff0741017f0 2024-04-01T06:55:15.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.361+0000 7ff07a13f700 1 --2- 172.21.15.83:0/2965067418 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7ff0600a11b0 0x7ff0600a3670 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff064000c00 tx=0x7ff064009f10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:15.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.365+0000 7ff06b7fe700 1 -- 172.21.15.83:0/2965067418 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7ff06c095800 con 0x7ff0741017f0 2024-04-01T06:55:15.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.559+0000 7ff07c3a3700 1 -- 172.21.15.83:0/2965067418 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff07419f6d0 con 0x7ff0741017f0 2024-04-01T06:55:15.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.560+0000 7ff06b7fe700 1 -- 172.21.15.83:0/2965067418 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v79) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff06c098e20 con 0x7ff0741017f0 2024-04-01T06:55:15.560 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 64 2024-04-01T06:55:15.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.562+0000 7ff07c3a3700 1 -- 172.21.15.83:0/2965067418 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7ff0600a11b0 msgr2=0x7ff0600a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:15.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.562+0000 7ff07c3a3700 1 --2- 172.21.15.83:0/2965067418 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7ff0600a11b0 0x7ff0600a3670 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff064000c00 tx=0x7ff064009f10 comp rx=0 tx=0).stop 2024-04-01T06:55:15.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.562+0000 7ff07c3a3700 1 -- 172.21.15.83:0/2965067418 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff0741017f0 msgr2=0x7ff07419e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:15.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.562+0000 7ff07c3a3700 1 --2- 172.21.15.83:0/2965067418 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff0741017f0 0x7ff07419e2a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff06c00b970 tx=0x7ff06c00bd30 comp rx=0 tx=0).stop 2024-04-01T06:55:15.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.562+0000 7ff07c3a3700 1 -- 172.21.15.83:0/2965067418 shutdown_connections 2024-04-01T06:55:15.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.562+0000 7ff07c3a3700 1 --2- 172.21.15.83:0/2965067418 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff0741017f0 0x7ff07419e2a0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:15.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.562+0000 7ff07c3a3700 1 --2- 172.21.15.83:0/2965067418 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7ff0600a11b0 0x7ff0600a3670 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:15.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.562+0000 7ff07c3a3700 1 --2- 172.21.15.83:0/2965067418 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0740ffc60 0x7ff074196d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:15.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.562+0000 7ff07c3a3700 1 --2- 172.21.15.83:0/2965067418 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff074100e50 0x7ff0741972c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:15.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.562+0000 7ff07c3a3700 1 -- 172.21.15.83:0/2965067418 >> 172.21.15.83:0/2965067418 conn(0x7ff0740fb1d0 msgr2=0x7ff074067df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:15.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.562+0000 7ff07c3a3700 1 -- 172.21.15.83:0/2965067418 shutdown_connections 2024-04-01T06:55:15.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.562+0000 7ff07c3a3700 1 -- 172.21.15.83:0/2965067418 wait complete. 2024-04-01T06:55:15.575 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T06:55:15.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.697+0000 7f5dd6410700 1 -- 172.21.15.83:0/1699842121 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dd0101720 msgr2=0x7f5dd0107fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:15.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.697+0000 7f5dd6410700 1 --2- 172.21.15.83:0/1699842121 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dd0101720 0x7f5dd0107fd0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5dc800b0d0 tx=0x7f5dc800b3e0 comp rx=0 tx=0).stop 2024-04-01T06:55:15.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.697+0000 7f5dd6410700 1 -- 172.21.15.83:0/1699842121 shutdown_connections 2024-04-01T06:55:15.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.697+0000 7f5dd6410700 1 --2- 172.21.15.83:0/1699842121 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dd0101720 0x7f5dd0107fd0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:15.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.698+0000 7f5dd6410700 1 --2- 172.21.15.83:0/1699842121 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5dd00ffb90 0x7f5dd00fffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:15.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.698+0000 7f5dd6410700 1 --2- 172.21.15.83:0/1699842121 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5dd0100d80 0x7f5dd01011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:15.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.698+0000 7f5dd6410700 1 -- 172.21.15.83:0/1699842121 >> 172.21.15.83:0/1699842121 conn(0x7f5dd00fb100 msgr2=0x7f5dd00fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:15.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.698+0000 7f5dd6410700 1 -- 172.21.15.83:0/1699842121 shutdown_connections 2024-04-01T06:55:15.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.698+0000 7f5dd6410700 1 -- 172.21.15.83:0/1699842121 wait complete. 2024-04-01T06:55:15.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.698+0000 7f5dd6410700 1 Processor -- start 2024-04-01T06:55:15.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.698+0000 7f5dd6410700 1 -- start start 2024-04-01T06:55:15.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.699+0000 7f5dd6410700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5dd00ffb90 0x7f5dd0195bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:15.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.699+0000 7f5dd6410700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5dd0100d80 0x7f5dd01960f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:15.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.699+0000 7f5dd6410700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dd0101720 0x7f5dd019d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:15.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.699+0000 7f5dd6410700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd019d6e0 con 0x7f5dd0101720 2024-04-01T06:55:15.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.699+0000 7f5dd6410700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd019d820 con 0x7f5dd0100d80 2024-04-01T06:55:15.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.699+0000 7f5dd6410700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd019d9b0 con 0x7f5dd00ffb90 2024-04-01T06:55:15.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.699+0000 7f5dd49ad700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dd0101720 0x7f5dd019d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:15.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.699+0000 7f5dd49ad700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dd0101720 0x7f5dd019d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:41710/0 (socket says 172.21.15.83:41710) 2024-04-01T06:55:15.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.699+0000 7f5dd49ad700 1 -- 172.21.15.83:0/3533488619 learned_addr learned my addr 172.21.15.83:0/3533488619 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:15.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.699+0000 7f5dcffff700 1 --2- 172.21.15.83:0/3533488619 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5dd00ffb90 0x7f5dd0195bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:15.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.699+0000 7f5dcf7fe700 1 --2- 172.21.15.83:0/3533488619 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5dd0100d80 0x7f5dd01960f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:15.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.699+0000 7f5dd49ad700 1 -- 172.21.15.83:0/3533488619 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5dd00ffb90 msgr2=0x7f5dd0195bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:15.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.699+0000 7f5dd49ad700 1 --2- 172.21.15.83:0/3533488619 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5dd00ffb90 0x7f5dd0195bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:15.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.699+0000 7f5dd49ad700 1 -- 172.21.15.83:0/3533488619 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5dd0100d80 msgr2=0x7f5dd01960f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:15.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.699+0000 7f5dd49ad700 1 --2- 172.21.15.83:0/3533488619 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5dd0100d80 0x7f5dd01960f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:15.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.699+0000 7f5dd49ad700 1 -- 172.21.15.83:0/3533488619 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc8009d00 con 0x7f5dd0101720 2024-04-01T06:55:15.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.699+0000 7f5dcf7fe700 1 --2- 172.21.15.83:0/3533488619 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5dd0100d80 0x7f5dd01960f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:55:15.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.699+0000 7f5dd49ad700 1 --2- 172.21.15.83:0/3533488619 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dd0101720 0x7f5dd019d110 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5dc8007b60 tx=0x7f5dc8008f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:15.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.699+0000 7f5dcd7fa700 1 -- 172.21.15.83:0/3533488619 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc800e040 con 0x7f5dd0101720 2024-04-01T06:55:15.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.699+0000 7f5dd6410700 1 -- 172.21.15.83:0/3533488619 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dd019dc30 con 0x7f5dd0101720 2024-04-01T06:55:15.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.699+0000 7f5dcd7fa700 1 -- 172.21.15.83:0/3533488619 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5dc801db30 con 0x7f5dd0101720 2024-04-01T06:55:15.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.699+0000 7f5dcd7fa700 1 -- 172.21.15.83:0/3533488619 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc801bb20 con 0x7f5dd0101720 2024-04-01T06:55:15.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.699+0000 7f5dd6410700 1 -- 172.21.15.83:0/3533488619 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dd019e100 con 0x7f5dd0101720 2024-04-01T06:55:15.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.700+0000 7f5dd6410700 1 -- 172.21.15.83:0/3533488619 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dd0106f40 con 0x7f5dd0101720 2024-04-01T06:55:15.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.701+0000 7f5dcd7fa700 1 -- 172.21.15.83:0/3533488619 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f5dc801dca0 con 0x7f5dd0101720 2024-04-01T06:55:15.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.702+0000 7f5dcd7fa700 1 --2- 172.21.15.83:0/3533488619 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f5dbc0a11b0 0x7f5dbc0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:15.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.702+0000 7f5dcffff700 1 --2- 172.21.15.83:0/3533488619 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f5dbc0a11b0 0x7f5dbc0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:15.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.702+0000 7f5dcd7fa700 1 -- 172.21.15.83:0/3533488619 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f5dc80ceb00 con 0x7f5dd0101720 2024-04-01T06:55:15.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.703+0000 7f5dcffff700 1 --2- 172.21.15.83:0/3533488619 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f5dbc0a11b0 0x7f5dbc0a3670 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5dd0100be0 tx=0x7f5dc0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:15.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.706+0000 7f5dcd7fa700 1 -- 172.21.15.83:0/3533488619 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f5dc8098270 con 0x7f5dd0101720 2024-04-01T06:55:15.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.947+0000 7f5dd6410700 1 -- 172.21.15.83:0/3533488619 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5dd0067180 con 0x7f5dd0101720 2024-04-01T06:55:15.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.948+0000 7f5dcd7fa700 1 -- 172.21.15.83:0/3533488619 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+10876 (secure 0 0 0) 0x7f5dc809b890 con 0x7f5dd0101720 2024-04-01T06:55:15.947 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:55:15.947 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1271130478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1271130478},{"type":"v1","addr":"172.21.15.83:6835","nonce":1271130478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2412682983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2412682983},{"type":"v1","addr":"172.21.15.83:6837","nonce":2412682983}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6839/3348145990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":3348145990},{"type":"v1","addr":"172.21.15.83:6839","nonce":3348145990}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6841/1191267445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6840","nonce":1191267445},{"type":"v1","addr":"172.21.15.83:6841","nonce":1191267445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2467459028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2467459028},{"type":"v1","addr":"172.21.15.153:6833","nonce":2467459028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24448,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4092629042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":4092629042},{"type":"v1","addr":"172.21.15.153:6835","nonce":4092629042}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-01T06:54:28.397062+0000","modified":"2024-04-01T06:54:33.704443+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24524,"mds_1":24494,"mds_2":24473},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6833/647005844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":647005844},{"type":"v1","addr":"172.21.15.145:6833","nonce":647005844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24454":{"gid":24454,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6837/1993816527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1993816527},{"type":"v1","addr":"172.21.15.153:6837","nonce":1993816527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6839/1399754640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1399754640},{"type":"v1","addr":"172.21.15.153:6839","nonce":1399754640}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24473":{"gid":24473,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.145:6835/3104241497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":3104241497},{"type":"v1","addr":"172.21.15.145:6835","nonce":3104241497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24494":{"gid":24494,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.145:6837/2687798317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2687798317},{"type":"v1","addr":"172.21.15.145:6837","nonce":2687798317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6839/3886435411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3886435411},{"type":"v1","addr":"172.21.15.145:6839","nonce":3886435411}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-01T06:55:15.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.950+0000 7f5dd6410700 1 -- 172.21.15.83:0/3533488619 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f5dbc0a11b0 msgr2=0x7f5dbc0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:15.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.950+0000 7f5dd6410700 1 --2- 172.21.15.83:0/3533488619 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f5dbc0a11b0 0x7f5dbc0a3670 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5dd0100be0 tx=0x7f5dc0009260 comp rx=0 tx=0).stop 2024-04-01T06:55:15.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.950+0000 7f5dd6410700 1 -- 172.21.15.83:0/3533488619 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dd0101720 msgr2=0x7f5dd019d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:15.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.950+0000 7f5dd6410700 1 --2- 172.21.15.83:0/3533488619 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dd0101720 0x7f5dd019d110 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5dc8007b60 tx=0x7f5dc8008f70 comp rx=0 tx=0).stop 2024-04-01T06:55:15.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.950+0000 7f5dd6410700 1 -- 172.21.15.83:0/3533488619 shutdown_connections 2024-04-01T06:55:15.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.950+0000 7f5dd6410700 1 --2- 172.21.15.83:0/3533488619 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dd0101720 0x7f5dd019d110 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:15.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.950+0000 7f5dd6410700 1 --2- 172.21.15.83:0/3533488619 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f5dbc0a11b0 0x7f5dbc0a3670 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:15.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.950+0000 7f5dd6410700 1 --2- 172.21.15.83:0/3533488619 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5dd00ffb90 0x7f5dd0195bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:15.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.950+0000 7f5dd6410700 1 --2- 172.21.15.83:0/3533488619 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5dd0100d80 0x7f5dd01960f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:15.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.950+0000 7f5dd6410700 1 -- 172.21.15.83:0/3533488619 >> 172.21.15.83:0/3533488619 conn(0x7f5dd00fb100 msgr2=0x7f5dd0104080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:15.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.950+0000 7f5dd6410700 1 -- 172.21.15.83:0/3533488619 shutdown_connections 2024-04-01T06:55:15.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:15.950+0000 7f5dd6410700 1 -- 172.21.15.83:0/3533488619 wait complete. 2024-04-01T06:55:15.953 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 23 2024-04-01T06:55:15.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:15 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/1215483802' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-01T06:55:15.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:15 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/3902743029' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-01T06:55:15.961 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:15 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/2965067418' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-01T06:55:15.962 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T06:55:16.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.087+0000 7f6e0a1f1700 1 -- 172.21.15.83:0/1521635940 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e04106970 msgr2=0x7f6e04108de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:16.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.087+0000 7f6e0a1f1700 1 --2- 172.21.15.83:0/1521635940 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e04106970 0x7f6e04108de0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc00b0a0 tx=0x7f6dfc00b3b0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.087+0000 7f6e0a1f1700 1 -- 172.21.15.83:0/1521635940 shutdown_connections 2024-04-01T06:55:16.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.087+0000 7f6e0a1f1700 1 --2- 172.21.15.83:0/1521635940 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e04106970 0x7f6e04108de0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.087+0000 7f6e0a1f1700 1 --2- 172.21.15.83:0/1521635940 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e04101710 0x7f6e04103b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.087+0000 7f6e0a1f1700 1 --2- 172.21.15.83:0/1521635940 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6e04104040 0x7f6e04106430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.087+0000 7f6e0a1f1700 1 -- 172.21.15.83:0/1521635940 >> 172.21.15.83:0/1521635940 conn(0x7f6e040fb100 msgr2=0x7f6e040fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:16.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.087+0000 7f6e0a1f1700 1 -- 172.21.15.83:0/1521635940 shutdown_connections 2024-04-01T06:55:16.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.087+0000 7f6e0a1f1700 1 -- 172.21.15.83:0/1521635940 wait complete. 2024-04-01T06:55:16.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.087+0000 7f6e0a1f1700 1 Processor -- start 2024-04-01T06:55:16.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.088+0000 7f6e0a1f1700 1 -- start start 2024-04-01T06:55:16.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.088+0000 7f6e0a1f1700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6e04101710 0x7f6e04196cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:16.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.088+0000 7f6e0a1f1700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e04104040 0x7f6e04197210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:16.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.088+0000 7f6e0a1f1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e04106970 0x7f6e0419e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:16.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.088+0000 7f6e0a1f1700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0419e7f0 con 0x7f6e04104040 2024-04-01T06:55:16.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.088+0000 7f6e0a1f1700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0419e960 con 0x7f6e04101710 2024-04-01T06:55:16.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.088+0000 7f6e0a1f1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0419eb20 con 0x7f6e04106970 2024-04-01T06:55:16.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.088+0000 7f6e02ffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e04104040 0x7f6e04197210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:16.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.088+0000 7f6e02ffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e04104040 0x7f6e04197210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:41724/0 (socket says 172.21.15.83:41724) 2024-04-01T06:55:16.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.088+0000 7f6e02ffd700 1 -- 172.21.15.83:0/3045142535 learned_addr learned my addr 172.21.15.83:0/3045142535 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:16.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.088+0000 7f6e037fe700 1 --2- 172.21.15.83:0/3045142535 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6e04101710 0x7f6e04196cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:16.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.088+0000 7f6e02ffd700 1 -- 172.21.15.83:0/3045142535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e04106970 msgr2=0x7f6e0419e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:16.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.088+0000 7f6e02ffd700 1 --2- 172.21.15.83:0/3045142535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e04106970 0x7f6e0419e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.088+0000 7f6e02ffd700 1 -- 172.21.15.83:0/3045142535 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6e04101710 msgr2=0x7f6e04196cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:16.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.088+0000 7f6e02ffd700 1 --2- 172.21.15.83:0/3045142535 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6e04101710 0x7f6e04196cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.088+0000 7f6e02ffd700 1 -- 172.21.15.83:0/3045142535 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dfc009d00 con 0x7f6e04104040 2024-04-01T06:55:16.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.088+0000 7f6e02ffd700 1 --2- 172.21.15.83:0/3045142535 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e04104040 0x7f6e04197210 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6df400d950 tx=0x7f6df400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:16.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.089+0000 7f6e00ff9700 1 -- 172.21.15.83:0/3045142535 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df4009b40 con 0x7f6e04104040 2024-04-01T06:55:16.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.089+0000 7f6e00ff9700 1 -- 172.21.15.83:0/3045142535 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6df4009ca0 con 0x7f6e04104040 2024-04-01T06:55:16.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.089+0000 7f6e0a1f1700 1 -- 172.21.15.83:0/3045142535 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e0419ee00 con 0x7f6e04104040 2024-04-01T06:55:16.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.089+0000 7f6e00ff9700 1 -- 172.21.15.83:0/3045142535 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df400f620 con 0x7f6e04104040 2024-04-01T06:55:16.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.089+0000 7f6e0a1f1700 1 -- 172.21.15.83:0/3045142535 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e0419f280 con 0x7f6e04104040 2024-04-01T06:55:16.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.090+0000 7f6e0a1f1700 1 -- 172.21.15.83:0/3045142535 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e040fcc80 con 0x7f6e04104040 2024-04-01T06:55:16.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.091+0000 7f6e00ff9700 1 -- 172.21.15.83:0/3045142535 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f6df4010460 con 0x7f6e04104040 2024-04-01T06:55:16.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.091+0000 7f6e00ff9700 1 --2- 172.21.15.83:0/3045142535 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f6df00a11b0 0x7f6df00a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:16.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.091+0000 7f6e037fe700 1 --2- 172.21.15.83:0/3045142535 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f6df00a11b0 0x7f6df00a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:16.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.091+0000 7f6e00ff9700 1 -- 172.21.15.83:0/3045142535 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f6df40ccc30 con 0x7f6e04104040 2024-04-01T06:55:16.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.092+0000 7f6e037fe700 1 --2- 172.21.15.83:0/3045142535 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f6df00a11b0 0x7f6df00a3670 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6dec005950 tx=0x7f6dec0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:16.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.095+0000 7f6e00ff9700 1 -- 172.21.15.83:0/3045142535 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f6df4096410 con 0x7f6e04104040 2024-04-01T06:55:16.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:15 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/1215483802' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-01T06:55:16.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:15 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/3902743029' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-01T06:55:16.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:15 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/2965067418' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-01T06:55:16.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:15 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/1215483802' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-01T06:55:16.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:15 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/3902743029' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-01T06:55:16.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:15 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/2965067418' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-01T06:55:16.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.305+0000 7f6e0a1f1700 1 -- 172.21.15.83:0/3045142535 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6e0410c650 con 0x7f6e04104040 2024-04-01T06:55:16.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.307+0000 7f6e00ff9700 1 -- 172.21.15.83:0/3045142535 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+22131 (secure 0 0 0) 0x7f6df4020090 con 0x7f6e04104040 2024-04-01T06:55:16.307 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:55:16.307 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":79,"fsid":"c6f8eff4-eff3-11ee-b647-cb9ed24678a4","created":"2024-04-01T06:48:42.033382+0000","modified":"2024-04-01T06:54:29.399277+0000","last_up_change":"2024-04-01T06:53:55.791339+0000","last_in_change":"2024-04-01T06:53:39.777214+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T06:51:21.963996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T06:54:26.450403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T06:54:27.564928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"90b761b0-b06c-4142-854d-38ee42aa6052","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6803","nonce":3253845390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6805","nonce":3253845390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6809","nonce":3253845390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6807","nonce":3253845390}]},"public_addr":"172.21.15.83:6803/3253845390","cluster_addr":"172.21.15.83:6805/3253845390","heartbeat_back_addr":"172.21.15.83:6809/3253845390","heartbeat_front_addr":"172.21.15.83:6807/3253845390","state":["exists","up"]},{"osd":1,"uuid":"4d6ab85b-7088-451e-a829-c9119f35dee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6801","nonce":515889759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6803","nonce":515889759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6807","nonce":515889759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6805","nonce":515889759}]},"public_addr":"172.21.15.145:6801/515889759","cluster_addr":"172.21.15.145:6803/515889759","heartbeat_back_addr":"172.21.15.145:6807/515889759","heartbeat_front_addr":"172.21.15.145:6805/515889759","state":["exists","up"]},{"osd":2,"uuid":"d04c27f3-4972-4061-8bfb-5060645e3883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6801","nonce":3318516728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6803","nonce":3318516728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6807","nonce":3318516728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6805","nonce":3318516728}]},"public_addr":"172.21.15.153:6801/3318516728","cluster_addr":"172.21.15.153:6803/3318516728","heartbeat_back_addr":"172.21.15.153:6807/3318516728","heartbeat_front_addr":"172.21.15.153:6805/3318516728","state":["exists","up"]},{"osd":3,"uuid":"899b6c90-8f2f-44dd-b807-49594aadb443","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6811","nonce":504690234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6813","nonce":504690234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6817","nonce":504690234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6815","nonce":504690234}]},"public_addr":"172.21.15.83:6811/504690234","cluster_addr":"172.21.15.83:6813/504690234","heartbeat_back_addr":"172.21.15.83:6817/504690234","heartbeat_front_addr":"172.21.15.83:6815/504690234","state":["exists","up"]},{"osd":4,"uuid":"5071dd81-804e-4358-bfb6-11e718e9cf4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6809","nonce":2099824730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6811","nonce":2099824730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6815","nonce":2099824730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6813","nonce":2099824730}]},"public_addr":"172.21.15.145:6809/2099824730","cluster_addr":"172.21.15.145:6811/2099824730","heartbeat_back_addr":"172.21.15.145:6815/2099824730","heartbeat_front_addr":"172.21.15.145:6813/2099824730","state":["exists","up"]},{"osd":5,"uuid":"b8442b71-c26e-467f-b0c3-ea9f636f5a00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6809","nonce":3340941443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6811","nonce":3340941443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6815","nonce":3340941443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6813","nonce":3340941443}]},"public_addr":"172.21.15.153:6809/3340941443","cluster_addr":"172.21.15.153:6811/3340941443","heartbeat_back_addr":"172.21.15.153:6815/3340941443","heartbeat_front_addr":"172.21.15.153:6813/3340941443","state":["exists","up"]},{"osd":6,"uuid":"c26bb8cb-ccee-4bfc-91eb-14e1ad8e04df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6819","nonce":2005485079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6821","nonce":2005485079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6825","nonce":2005485079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6823","nonce":2005485079}]},"public_addr":"172.21.15.83:6819/2005485079","cluster_addr":"172.21.15.83:6821/2005485079","heartbeat_back_addr":"172.21.15.83:6825/2005485079","heartbeat_front_addr":"172.21.15.83:6823/2005485079","state":["exists","up"]},{"osd":7,"uuid":"a8940da2-0e79-4606-8d1e-d425afbf5753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6817","nonce":3737505059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6819","nonce":3737505059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6823","nonce":3737505059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6821","nonce":3737505059}]},"public_addr":"172.21.15.145:6817/3737505059","cluster_addr":"172.21.15.145:6819/3737505059","heartbeat_back_addr":"172.21.15.145:6823/3737505059","heartbeat_front_addr":"172.21.15.145:6821/3737505059","state":["exists","up"]},{"osd":8,"uuid":"602d43ac-a189-4da3-9e38-7025d14e0dd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6817","nonce":1031545791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6819","nonce":1031545791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6823","nonce":1031545791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6821","nonce":1031545791}]},"public_addr":"172.21.15.153:6817/1031545791","cluster_addr":"172.21.15.153:6819/1031545791","heartbeat_back_addr":"172.21.15.153:6823/1031545791","heartbeat_front_addr":"172.21.15.153:6821/1031545791","state":["exists","up"]},{"osd":9,"uuid":"08b12d27-1247-45e4-9d09-cacc0fce4bd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6827","nonce":3720996673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6829","nonce":3720996673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6833","nonce":3720996673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6831","nonce":3720996673}]},"public_addr":"172.21.15.83:6827/3720996673","cluster_addr":"172.21.15.83:6829/3720996673","heartbeat_back_addr":"172.21.15.83:6833/3720996673","heartbeat_front_addr":"172.21.15.83:6831/3720996673","state":["exists","up"]},{"osd":10,"uuid":"dd986b50-d68f-446c-9c66-261535880879","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6825","nonce":2671529479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6827","nonce":2671529479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6831","nonce":2671529479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6829","nonce":2671529479}]},"public_addr":"172.21.15.145:6825/2671529479","cluster_addr":"172.21.15.145:6827/2671529479","heartbeat_back_addr":"172.21.15.145:6831/2671529479","heartbeat_front_addr":"172.21.15.145:6829/2671529479","state":["exists","up"]},{"osd":11,"uuid":"d20a49cd-6224-4424-8375-46da791d9931","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6825","nonce":2342548429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6827","nonce":2342548429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6831","nonce":2342548429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6829","nonce":2342548429}]},"public_addr":"172.21.15.153:6825/2342548429","cluster_addr":"172.21.15.153:6827/2342548429","heartbeat_back_addr":"172.21.15.153:6831/2342548429","heartbeat_front_addr":"172.21.15.153:6829/2342548429","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:50:44.539932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:01.990470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:19.054426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:36.616393+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:53.896705+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:10.667502+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:27.880849+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:45.276308+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:02.280615+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:19.555547+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:37.062881+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:54.191589+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.83:6801/1867137261":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/2596683931":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/2125339627":"2024-04-02T06:49:33.656125+0000","172.21.15.83:6800/1644397953":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/690500472":"2024-04-02T06:49:13.456026+0000","172.21.15.83:6801/1644397953":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/785958951":"2024-04-02T06:49:33.656125+0000","172.21.15.83:6800/1867137261":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/2222527447":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/2071592157":"2024-04-02T06:49:13.456026+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T06:55:16.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.309+0000 7f6e0a1f1700 1 -- 172.21.15.83:0/3045142535 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f6df00a11b0 msgr2=0x7f6df00a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:16.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.309+0000 7f6e0a1f1700 1 --2- 172.21.15.83:0/3045142535 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f6df00a11b0 0x7f6df00a3670 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6dec005950 tx=0x7f6dec0058e0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.309+0000 7f6e0a1f1700 1 -- 172.21.15.83:0/3045142535 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e04104040 msgr2=0x7f6e04197210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:16.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.309+0000 7f6e0a1f1700 1 --2- 172.21.15.83:0/3045142535 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e04104040 0x7f6e04197210 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6df400d950 tx=0x7f6df400dd10 comp rx=0 tx=0).stop 2024-04-01T06:55:16.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.309+0000 7f6e0a1f1700 1 -- 172.21.15.83:0/3045142535 shutdown_connections 2024-04-01T06:55:16.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.309+0000 7f6e0a1f1700 1 --2- 172.21.15.83:0/3045142535 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f6df00a11b0 0x7f6df00a3670 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.309+0000 7f6e0a1f1700 1 --2- 172.21.15.83:0/3045142535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e04106970 0x7f6e0419e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.309+0000 7f6e0a1f1700 1 --2- 172.21.15.83:0/3045142535 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6e04101710 0x7f6e04196cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.309+0000 7f6e0a1f1700 1 --2- 172.21.15.83:0/3045142535 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e04104040 0x7f6e04197210 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.309+0000 7f6e0a1f1700 1 -- 172.21.15.83:0/3045142535 >> 172.21.15.83:0/3045142535 conn(0x7f6e040fb100 msgr2=0x7f6e04102070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:16.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.309+0000 7f6e0a1f1700 1 -- 172.21.15.83:0/3045142535 shutdown_connections 2024-04-01T06:55:16.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.309+0000 7f6e0a1f1700 1 -- 172.21.15.83:0/3045142535 wait complete. 2024-04-01T06:55:16.322 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T06:55:16.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.446+0000 7f4beeca8700 1 -- 172.21.15.83:0/1646058745 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4be81016e0 msgr2=0x7f4be8103ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:16.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.446+0000 7f4beeca8700 1 --2- 172.21.15.83:0/1646058745 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4be81016e0 0x7f4be8103ad0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc009990 tx=0x7f4bdc009ca0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.446+0000 7f4beeca8700 1 -- 172.21.15.83:0/1646058745 shutdown_connections 2024-04-01T06:55:16.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.446+0000 7f4beeca8700 1 --2- 172.21.15.83:0/1646058745 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4be81016e0 0x7f4be8103ad0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.446+0000 7f4beeca8700 1 --2- 172.21.15.83:0/1646058745 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4be8106940 0x7f4be8108db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.446+0000 7f4beeca8700 1 --2- 172.21.15.83:0/1646058745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4be8104010 0x7f4be8106400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.446+0000 7f4beeca8700 1 -- 172.21.15.83:0/1646058745 >> 172.21.15.83:0/1646058745 conn(0x7f4be80fb0d0 msgr2=0x7f4be80fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:16.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.446+0000 7f4beeca8700 1 -- 172.21.15.83:0/1646058745 shutdown_connections 2024-04-01T06:55:16.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.446+0000 7f4beeca8700 1 -- 172.21.15.83:0/1646058745 wait complete. 2024-04-01T06:55:16.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.447+0000 7f4beeca8700 1 Processor -- start 2024-04-01T06:55:16.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.447+0000 7f4beeca8700 1 -- start start 2024-04-01T06:55:16.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.447+0000 7f4beeca8700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4be81016e0 0x7f4be8196c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:16.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.447+0000 7f4beeca8700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4be8104010 0x7f4be8197160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:16.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.447+0000 7f4beeca8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4be8106940 0x7f4be819e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:16.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.447+0000 7f4beeca8700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be819e750 con 0x7f4be8104010 2024-04-01T06:55:16.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.447+0000 7f4beeca8700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be819e890 con 0x7f4be81016e0 2024-04-01T06:55:16.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.447+0000 7f4beeca8700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be819ea20 con 0x7f4be8106940 2024-04-01T06:55:16.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.447+0000 7f4be7fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4be8104010 0x7f4be8197160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:16.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.447+0000 7f4be7fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4be8104010 0x7f4be8197160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:41734/0 (socket says 172.21.15.83:41734) 2024-04-01T06:55:16.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.447+0000 7f4be7fff700 1 -- 172.21.15.83:0/3413748311 learned_addr learned my addr 172.21.15.83:0/3413748311 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:16.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.447+0000 7f4beca44700 1 --2- 172.21.15.83:0/3413748311 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4be81016e0 0x7f4be8196c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:16.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.447+0000 7f4bed245700 1 --2- 172.21.15.83:0/3413748311 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4be8106940 0x7f4be819e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:16.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.447+0000 7f4be7fff700 1 -- 172.21.15.83:0/3413748311 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4be8106940 msgr2=0x7f4be819e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:16.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.447+0000 7f4be7fff700 1 --2- 172.21.15.83:0/3413748311 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4be8106940 0x7f4be819e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.447+0000 7f4be7fff700 1 -- 172.21.15.83:0/3413748311 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4be81016e0 msgr2=0x7f4be8196c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:16.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.447+0000 7f4be7fff700 1 --2- 172.21.15.83:0/3413748311 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4be81016e0 0x7f4be8196c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.447+0000 7f4be7fff700 1 -- 172.21.15.83:0/3413748311 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bdc0095f0 con 0x7f4be8104010 2024-04-01T06:55:16.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.447+0000 7f4beca44700 1 --2- 172.21.15.83:0/3413748311 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4be81016e0 0x7f4be8196c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:55:16.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.448+0000 7f4be7fff700 1 --2- 172.21.15.83:0/3413748311 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4be8104010 0x7f4be8197160 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4bd400b530 tx=0x7f4bd400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:16.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.448+0000 7f4be5ffb700 1 -- 172.21.15.83:0/3413748311 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd4011830 con 0x7f4be8104010 2024-04-01T06:55:16.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.448+0000 7f4beeca8700 1 -- 172.21.15.83:0/3413748311 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4be819ed00 con 0x7f4be8104010 2024-04-01T06:55:16.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.448+0000 7f4be5ffb700 1 -- 172.21.15.83:0/3413748311 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4bd4011e50 con 0x7f4be8104010 2024-04-01T06:55:16.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.448+0000 7f4be5ffb700 1 -- 172.21.15.83:0/3413748311 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd400f2e0 con 0x7f4be8104010 2024-04-01T06:55:16.450 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.448+0000 7f4beeca8700 1 -- 172.21.15.83:0/3413748311 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4be819f1b0 con 0x7f4be8104010 2024-04-01T06:55:16.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.449+0000 7f4beeca8700 1 -- 172.21.15.83:0/3413748311 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4be80fcc50 con 0x7f4be8104010 2024-04-01T06:55:16.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.450+0000 7f4be5ffb700 1 -- 172.21.15.83:0/3413748311 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f4bd4010580 con 0x7f4be8104010 2024-04-01T06:55:16.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.450+0000 7f4be5ffb700 1 --2- 172.21.15.83:0/3413748311 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f4bd80a11b0 0x7f4bd80a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:16.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.450+0000 7f4be5ffb700 1 -- 172.21.15.83:0/3413748311 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f4bd40cc2c0 con 0x7f4be8104010 2024-04-01T06:55:16.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.450+0000 7f4beca44700 1 --2- 172.21.15.83:0/3413748311 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f4bd80a11b0 0x7f4bd80a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:16.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.451+0000 7f4beca44700 1 --2- 172.21.15.83:0/3413748311 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f4bd80a11b0 0x7f4bd80a3670 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc006010 tx=0x7f4bdc0037b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:16.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.455+0000 7f4be5ffb700 1 -- 172.21.15.83:0/3413748311 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f4bd4095bb0 con 0x7f4be8104010 2024-04-01T06:55:16.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.697+0000 7f4beeca8700 1 -- 172.21.15.83:0/3413748311 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4be810c620 con 0x7f4be8104010 2024-04-01T06:55:16.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.698+0000 7f4be5ffb700 1 -- 172.21.15.83:0/3413748311 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+10876 (secure 0 0 0) 0x7f4bd40b7e60 con 0x7f4be8104010 2024-04-01T06:55:16.697 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:55:16.698 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1271130478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1271130478},{"type":"v1","addr":"172.21.15.83:6835","nonce":1271130478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2412682983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2412682983},{"type":"v1","addr":"172.21.15.83:6837","nonce":2412682983}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6839/3348145990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":3348145990},{"type":"v1","addr":"172.21.15.83:6839","nonce":3348145990}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6841/1191267445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6840","nonce":1191267445},{"type":"v1","addr":"172.21.15.83:6841","nonce":1191267445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2467459028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2467459028},{"type":"v1","addr":"172.21.15.153:6833","nonce":2467459028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24448,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4092629042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":4092629042},{"type":"v1","addr":"172.21.15.153:6835","nonce":4092629042}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-01T06:54:28.397062+0000","modified":"2024-04-01T06:54:33.704443+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24524,"mds_1":24494,"mds_2":24473},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6833/647005844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":647005844},{"type":"v1","addr":"172.21.15.145:6833","nonce":647005844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24454":{"gid":24454,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6837/1993816527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1993816527},{"type":"v1","addr":"172.21.15.153:6837","nonce":1993816527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6839/1399754640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1399754640},{"type":"v1","addr":"172.21.15.153:6839","nonce":1399754640}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24473":{"gid":24473,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.145:6835/3104241497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":3104241497},{"type":"v1","addr":"172.21.15.145:6835","nonce":3104241497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24494":{"gid":24494,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.145:6837/2687798317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2687798317},{"type":"v1","addr":"172.21.15.145:6837","nonce":2687798317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6839/3886435411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3886435411},{"type":"v1","addr":"172.21.15.145:6839","nonce":3886435411}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-01T06:55:16.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.700+0000 7f4beeca8700 1 -- 172.21.15.83:0/3413748311 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f4bd80a11b0 msgr2=0x7f4bd80a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:16.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.700+0000 7f4beeca8700 1 --2- 172.21.15.83:0/3413748311 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f4bd80a11b0 0x7f4bd80a3670 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc006010 tx=0x7f4bdc0037b0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.700+0000 7f4beeca8700 1 -- 172.21.15.83:0/3413748311 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4be8104010 msgr2=0x7f4be8197160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:16.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.700+0000 7f4beeca8700 1 --2- 172.21.15.83:0/3413748311 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4be8104010 0x7f4be8197160 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4bd400b530 tx=0x7f4bd400b8f0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.700+0000 7f4beeca8700 1 -- 172.21.15.83:0/3413748311 shutdown_connections 2024-04-01T06:55:16.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.700+0000 7f4beeca8700 1 --2- 172.21.15.83:0/3413748311 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f4bd80a11b0 0x7f4bd80a3670 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.700+0000 7f4beeca8700 1 --2- 172.21.15.83:0/3413748311 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4be8106940 0x7f4be819e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.700+0000 7f4beeca8700 1 --2- 172.21.15.83:0/3413748311 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4be81016e0 0x7f4be8196c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.700+0000 7f4beeca8700 1 --2- 172.21.15.83:0/3413748311 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4be8104010 0x7f4be8197160 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.700+0000 7f4beeca8700 1 -- 172.21.15.83:0/3413748311 >> 172.21.15.83:0/3413748311 conn(0x7f4be80fb0d0 msgr2=0x7f4be8102020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:16.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.700+0000 7f4beeca8700 1 -- 172.21.15.83:0/3413748311 shutdown_connections 2024-04-01T06:55:16.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.700+0000 7f4beeca8700 1 -- 172.21.15.83:0/3413748311 wait complete. 2024-04-01T06:55:16.701 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 23 2024-04-01T06:55:16.713 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-04-01T06:54:28.397062+0000', 'modified': '2024-04-01T06:54:33.704443+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24524, 'mds_1': 24494, 'mds_2': 24473}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24449': {'gid': 24449, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.145:6833/647005844', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.145:6832', 'nonce': 647005844}, {'type': 'v1', 'addr': '172.21.15.145:6833', 'nonce': 647005844}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24454': {'gid': 24454, 'name': 'c', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.153:6837/1993816527', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6836', 'nonce': 1993816527}, {'type': 'v1', 'addr': '172.21.15.153:6837', 'nonce': 1993816527}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24472': {'gid': 24472, 'name': 'i', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.153:6839/1399754640', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6838', 'nonce': 1399754640}, {'type': 'v1', 'addr': '172.21.15.153:6839', 'nonce': 1399754640}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24473': {'gid': 24473, 'name': 'e', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.145:6835/3104241497', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.145:6834', 'nonce': 3104241497}, {'type': 'v1', 'addr': '172.21.15.145:6835', 'nonce': 3104241497}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24494': {'gid': 24494, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.145:6837/2687798317', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.145:6836', 'nonce': 2687798317}, {'type': 'v1', 'addr': '172.21.15.145:6837', 'nonce': 2687798317}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24524': {'gid': 24524, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.145:6839/3886435411', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.145:6838', 'nonce': 3886435411}, {'type': 'v1', 'addr': '172.21.15.145:6839', 'nonce': 3886435411}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-01T06:55:16.713 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-04-01T06:55:16.713 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-04-01T06:55:16.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.838+0000 7f4d99fc3700 1 -- 172.21.15.83:0/316114065 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d940fffb0 msgr2=0x7f4d94100430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:16.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.838+0000 7f4d99fc3700 1 --2- 172.21.15.83:0/316114065 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d940fffb0 0x7f4d94100430 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4d88009990 tx=0x7f4d88009ca0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.838+0000 7f4d99fc3700 1 -- 172.21.15.83:0/316114065 shutdown_connections 2024-04-01T06:55:16.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.838+0000 7f4d99fc3700 1 --2- 172.21.15.83:0/316114065 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4d94100970 0x7f4d94100df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.838+0000 7f4d99fc3700 1 --2- 172.21.15.83:0/316114065 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d940ff650 0x7f4d940ffa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.838+0000 7f4d99fc3700 1 --2- 172.21.15.83:0/316114065 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d940fffb0 0x7f4d94100430 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.838+0000 7f4d99fc3700 1 -- 172.21.15.83:0/316114065 >> 172.21.15.83:0/316114065 conn(0x7f4d940fb1d0 msgr2=0x7f4d940fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:16.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.838+0000 7f4d99fc3700 1 -- 172.21.15.83:0/316114065 shutdown_connections 2024-04-01T06:55:16.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.838+0000 7f4d99fc3700 1 -- 172.21.15.83:0/316114065 wait complete. 2024-04-01T06:55:16.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.839+0000 7f4d99fc3700 1 Processor -- start 2024-04-01T06:55:16.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.839+0000 7f4d99fc3700 1 -- start start 2024-04-01T06:55:16.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.839+0000 7f4d99fc3700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d940ff650 0x7f4d94198e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:16.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.839+0000 7f4d99fc3700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4d940fffb0 0x7f4d941993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:16.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.839+0000 7f4d99fc3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d94100970 0x7f4d941a03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:16.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.839+0000 7f4d99fc3700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d941a09b0 con 0x7f4d940ff650 2024-04-01T06:55:16.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.839+0000 7f4d99fc3700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d941a0af0 con 0x7f4d940fffb0 2024-04-01T06:55:16.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.839+0000 7f4d99fc3700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d941a0c80 con 0x7f4d94100970 2024-04-01T06:55:16.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.839+0000 7f4d937fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d940ff650 0x7f4d94198e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:16.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.839+0000 7f4d937fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d940ff650 0x7f4d94198e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:41750/0 (socket says 172.21.15.83:41750) 2024-04-01T06:55:16.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.839+0000 7f4d937fe700 1 -- 172.21.15.83:0/909450816 learned_addr learned my addr 172.21.15.83:0/909450816 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:16.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.839+0000 7f4d92ffd700 1 --2- 172.21.15.83:0/909450816 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4d940fffb0 0x7f4d941993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:16.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.839+0000 7f4d93fff700 1 --2- 172.21.15.83:0/909450816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d94100970 0x7f4d941a03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:16.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.839+0000 7f4d937fe700 1 -- 172.21.15.83:0/909450816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d94100970 msgr2=0x7f4d941a03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:16.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.839+0000 7f4d937fe700 1 --2- 172.21.15.83:0/909450816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d94100970 0x7f4d941a03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.839+0000 7f4d937fe700 1 -- 172.21.15.83:0/909450816 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4d940fffb0 msgr2=0x7f4d941993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:16.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.839+0000 7f4d937fe700 1 --2- 172.21.15.83:0/909450816 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4d940fffb0 0x7f4d941993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.839+0000 7f4d937fe700 1 -- 172.21.15.83:0/909450816 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d880095f0 con 0x7f4d940ff650 2024-04-01T06:55:16.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.839+0000 7f4d92ffd700 1 --2- 172.21.15.83:0/909450816 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4d940fffb0 0x7f4d941993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:55:16.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.839+0000 7f4d93fff700 1 --2- 172.21.15.83:0/909450816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d94100970 0x7f4d941a03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:55:16.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.840+0000 7f4d937fe700 1 --2- 172.21.15.83:0/909450816 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d940ff650 0x7f4d94198e80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f4d8400c920 tx=0x7f4d8400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:16.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.840+0000 7f4d90ff9700 1 -- 172.21.15.83:0/909450816 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d84007b00 con 0x7f4d940ff650 2024-04-01T06:55:16.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.840+0000 7f4d99fc3700 1 -- 172.21.15.83:0/909450816 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d941a0f60 con 0x7f4d940ff650 2024-04-01T06:55:16.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.840+0000 7f4d90ff9700 1 -- 172.21.15.83:0/909450816 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4d84004cf0 con 0x7f4d940ff650 2024-04-01T06:55:16.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.840+0000 7f4d90ff9700 1 -- 172.21.15.83:0/909450816 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d84005520 con 0x7f4d940ff650 2024-04-01T06:55:16.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.840+0000 7f4d99fc3700 1 -- 172.21.15.83:0/909450816 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d941a1390 con 0x7f4d940ff650 2024-04-01T06:55:16.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.842+0000 7f4d90ff9700 1 -- 172.21.15.83:0/909450816 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f4d84004750 con 0x7f4d940ff650 2024-04-01T06:55:16.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.842+0000 7f4d90ff9700 1 --2- 172.21.15.83:0/909450816 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f4d7c0a11b0 0x7f4d7c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:16.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.842+0000 7f4d92ffd700 1 --2- 172.21.15.83:0/909450816 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f4d7c0a11b0 0x7f4d7c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:16.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.842+0000 7f4d90ff9700 1 -- 172.21.15.83:0/909450816 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f4d840cc510 con 0x7f4d940ff650 2024-04-01T06:55:16.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.843+0000 7f4d92ffd700 1 --2- 172.21.15.83:0/909450816 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f4d7c0a11b0 0x7f4d7c0a3670 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4d8800b5c0 tx=0x7f4d88005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:16.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.843+0000 7f4da6159b80 1 Processor -- start 2024-04-01T06:55:16.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.843+0000 7f4da6159b80 1 -- start start 2024-04-01T06:55:16.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.844+0000 7f4da6159b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ef7b20e780 0x55ef7b20eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:16.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.844+0000 7f4da6159b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ef7b20f0e0 0x55ef7b20f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:16.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.844+0000 7f4da6159b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ef7b20ff80 0x55ef7b210400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:16.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.844+0000 7f4da6159b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef7b166940 con 0x55ef7b20f0e0 2024-04-01T06:55:16.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.844+0000 7f4da6159b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef7b164300 con 0x55ef7b20e780 2024-04-01T06:55:16.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.844+0000 7f4da6159b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef7b15fbf0 con 0x55ef7b20ff80 2024-04-01T06:55:16.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.844+0000 7f4d92ffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ef7b20f0e0 0x55ef7b20f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:16.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.844+0000 7f4d92ffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ef7b20f0e0 0x55ef7b20f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:41758/0 (socket says 172.21.15.83:41758) 2024-04-01T06:55:16.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.844+0000 7f4d92ffd700 1 -- 172.21.15.83:0/2395598207 learned_addr learned my addr 172.21.15.83:0/2395598207 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:16.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.844+0000 7f4d937fe700 1 --2- 172.21.15.83:0/2395598207 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ef7b20e780 0x55ef7b20eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:16.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.844+0000 7f4d93fff700 1 --2- 172.21.15.83:0/2395598207 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ef7b20ff80 0x55ef7b210400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:16.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.844+0000 7f4d92ffd700 1 -- 172.21.15.83:0/2395598207 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ef7b20ff80 msgr2=0x55ef7b210400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:16.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.844+0000 7f4d92ffd700 1 --2- 172.21.15.83:0/2395598207 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ef7b20ff80 0x55ef7b210400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.844+0000 7f4d92ffd700 1 -- 172.21.15.83:0/2395598207 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ef7b20e780 msgr2=0x55ef7b20eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:16.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.844+0000 7f4d92ffd700 1 --2- 172.21.15.83:0/2395598207 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ef7b20e780 0x55ef7b20eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.844+0000 7f4d92ffd700 1 -- 172.21.15.83:0/2395598207 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef7afe1360 con 0x55ef7b20f0e0 2024-04-01T06:55:16.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.844+0000 7f4d937fe700 1 --2- 172.21.15.83:0/2395598207 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ef7b20e780 0x55ef7b20eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:55:16.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.844+0000 7f4d92ffd700 1 --2- 172.21.15.83:0/2395598207 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ef7b20f0e0 0x55ef7b20f9a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4d88005cd0 tx=0x7f4d8801f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=363d99793358448f server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:16.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.844+0000 7f4d79ffb700 1 -- 172.21.15.83:0/2395598207 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8802b070 con 0x55ef7b20f0e0 2024-04-01T06:55:16.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.844+0000 7f4d79ffb700 1 -- 172.21.15.83:0/2395598207 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4d8801e040 con 0x55ef7b20f0e0 2024-04-01T06:55:16.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.844+0000 7f4d79ffb700 1 -- 172.21.15.83:0/2395598207 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d88004d50 con 0x55ef7b20f0e0 2024-04-01T06:55:16.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.845+0000 7f4da6159b80 1 -- 172.21.15.83:0/2395598207 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ef7b20f0e0 msgr2=0x55ef7b20f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:16.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.845+0000 7f4da6159b80 1 --2- 172.21.15.83:0/2395598207 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ef7b20f0e0 0x55ef7b20f9a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4d88005cd0 tx=0x7f4d8801f000 comp rx=0 tx=0).stop 2024-04-01T06:55:16.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.845+0000 7f4da6159b80 1 -- 172.21.15.83:0/2395598207 shutdown_connections 2024-04-01T06:55:16.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.845+0000 7f4da6159b80 1 --2- 172.21.15.83:0/2395598207 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ef7b20ff80 0x55ef7b210400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.845+0000 7f4da6159b80 1 --2- 172.21.15.83:0/2395598207 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ef7b20e780 0x55ef7b20eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.845+0000 7f4da6159b80 1 --2- 172.21.15.83:0/2395598207 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ef7b20f0e0 0x55ef7b20f9a0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.845+0000 7f4da6159b80 1 -- 172.21.15.83:0/2395598207 >> 172.21.15.83:0/2395598207 conn(0x55ef7b16d650 msgr2=0x55ef7b209950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:16.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.845+0000 7f4da6159b80 1 -- 172.21.15.83:0/2395598207 shutdown_connections 2024-04-01T06:55:16.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.845+0000 7f4da6159b80 1 -- 172.21.15.83:0/2395598207 wait complete. 2024-04-01T06:55:16.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.845+0000 7f4da6159b80 1 -- start start 2024-04-01T06:55:16.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.846+0000 7f4da6159b80 1 Processor -- start 2024-04-01T06:55:16.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.846+0000 7f4da6159b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ef7b20e780 0x55ef7b218640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:16.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.846+0000 7f4da6159b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ef7b20f0e0 0x55ef7b218b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:16.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.846+0000 7f4da6159b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ef7b20ff80 0x55ef7b21fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:16.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.846+0000 7f4da6159b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef7b0fbd30 con 0x55ef7b20f0e0 2024-04-01T06:55:16.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.846+0000 7f4da6159b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef7b0fb9d0 con 0x55ef7b20ff80 2024-04-01T06:55:16.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.846+0000 7f4da6159b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef7afe3650 con 0x55ef7b20e780 2024-04-01T06:55:16.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.846+0000 7f4da6159b80 10 client.0 _ll_register_callbacks cb 0x55ef7b105420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:55:16.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.846+0000 7f4d92ffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ef7b20f0e0 0x55ef7b218b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:16.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.846+0000 7f4d92ffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ef7b20f0e0 0x55ef7b218b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:41768/0 (socket says 172.21.15.83:41768) 2024-04-01T06:55:16.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.846+0000 7f4d92ffd700 1 -- 172.21.15.83:0/3733229301 learned_addr learned my addr 172.21.15.83:0/3733229301 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:16.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.846+0000 7f4d937fe700 1 --2- 172.21.15.83:0/3733229301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ef7b20e780 0x55ef7b218640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:16.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.846+0000 7f4d93fff700 1 --2- 172.21.15.83:0/3733229301 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ef7b20ff80 0x55ef7b21fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:16.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.846+0000 7f4d92ffd700 1 -- 172.21.15.83:0/3733229301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ef7b20e780 msgr2=0x55ef7b218640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:16.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.846+0000 7f4d92ffd700 1 --2- 172.21.15.83:0/3733229301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ef7b20e780 0x55ef7b218640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.846+0000 7f4d92ffd700 1 -- 172.21.15.83:0/3733229301 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ef7b20ff80 msgr2=0x55ef7b21fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:16.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.846+0000 7f4d92ffd700 1 --2- 172.21.15.83:0/3733229301 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ef7b20ff80 0x55ef7b21fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.846+0000 7f4d92ffd700 1 -- 172.21.15.83:0/3733229301 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d9410bcd0 con 0x55ef7b20f0e0 2024-04-01T06:55:16.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.846+0000 7f4d93fff700 1 --2- 172.21.15.83:0/3733229301 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ef7b20ff80 0x55ef7b21fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:55:16.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.846+0000 7f4d92ffd700 1 --2- 172.21.15.83:0/3733229301 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ef7b20f0e0 0x55ef7b218b80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f4d88009990 tx=0x7f4d88005970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f9199daa1d3f987 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:16.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.846+0000 7f4d72ffd700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:55:16.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.847+0000 7f4d72ffd700 1 -- 172.21.15.83:0/3733229301 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8802b030 con 0x55ef7b20f0e0 2024-04-01T06:55:16.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.847+0000 7f4da6159b80 1 -- 172.21.15.83:0/3733229301 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ef7b120330 con 0x55ef7b20f0e0 2024-04-01T06:55:16.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.847+0000 7f4d72ffd700 1 -- 172.21.15.83:0/3733229301 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f4d8802c070 con 0x55ef7b20f0e0 2024-04-01T06:55:16.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.847+0000 7f4d72ffd700 1 -- 172.21.15.83:0/3733229301 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d88003890 con 0x55ef7b20f0e0 2024-04-01T06:55:16.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.847+0000 7f4da6159b80 10 client.15036 fetch_fsmap learned FSMap version 23 2024-04-01T06:55:16.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.847+0000 7f4da6159b80 1 -- 172.21.15.83:0/3733229301 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55ef7af8db10 con 0x55ef7b20f0e0 2024-04-01T06:55:16.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.847+0000 7f4d72ffd700 1 -- 172.21.15.83:0/3733229301 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4d88043080 con 0x55ef7b20f0e0 2024-04-01T06:55:16.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.847+0000 7f4d72ffd700 1 -- 172.21.15.83:0/3733229301 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 23) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4d880307e0 con 0x55ef7b20f0e0 2024-04-01T06:55:16.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.847+0000 7f4da6159b80 10 client.15036 fetch_fsmap finished waiting for FSMap version 23 2024-04-01T06:55:16.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.847+0000 7f4da6159b80 10 client.15036 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-01T06:55:16.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.847+0000 7f4da6159b80 20 client.15036 populate_metadata read hostname 'smithi083' 2024-04-01T06:55:16.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.847+0000 7f4da6159b80 1 --2- 172.21.15.83:0/3733229301 >> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] conn(0x55ef7b223290 0x55ef7b228530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:16.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.847+0000 7f4da6159b80 4 client.15036 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-01T06:55:16.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.847+0000 7f4da6159b80 1 -- 172.21.15.83:0/3733229301 --> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ef7b1586b0 con 0x55ef7b223290 2024-04-01T06:55:16.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.847+0000 7f4d937fe700 1 --2- 172.21.15.83:0/3733229301 >> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] conn(0x55ef7b223290 0x55ef7b228530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:16.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.848+0000 7f4d72ffd700 10 client.15036 ms_handle_connect on v2:172.21.15.145:6834/3104241497 2024-04-01T06:55:16.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.848+0000 7f4d937fe700 1 --2- 172.21.15.83:0/3733229301 >> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] conn(0x55ef7b223290 0x55ef7b228530 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=faa9086cf43009c2 server_cookie=41f931c2968033fe in_seq=0 out_seq=0 2024-04-01T06:55:16.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.849+0000 7f4d72ffd700 1 -- 172.21.15.83:0/3733229301 <== mds.2 v2:172.21.15.145:6834/3104241497 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ef7b1586b0 con 0x55ef7b223290 2024-04-01T06:55:16.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.849+0000 7f4d72ffd700 10 client.15036 handle_command_reply: tid=0 2024-04-01T06:55:16.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.849+0000 7f4da6159b80 1 client.15036 shutdown 2024-04-01T06:55:16.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.849+0000 7f4da6159b80 1 -- 172.21.15.83:0/3733229301 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ef7b20f0e0 msgr2=0x55ef7b218b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:16.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.849+0000 7f4da6159b80 1 --2- 172.21.15.83:0/3733229301 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ef7b20f0e0 0x55ef7b218b80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f4d88009990 tx=0x7f4d88005970 comp rx=0 tx=0).stop 2024-04-01T06:55:16.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.849+0000 7f4da6159b80 1 -- 172.21.15.83:0/3733229301 shutdown_connections 2024-04-01T06:55:16.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.849+0000 7f4da6159b80 1 --2- 172.21.15.83:0/3733229301 >> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] conn(0x55ef7b223290 0x55ef7b228530 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.849+0000 7f4da6159b80 1 --2- 172.21.15.83:0/3733229301 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ef7b20ff80 0x55ef7b21fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.849+0000 7f4da6159b80 1 --2- 172.21.15.83:0/3733229301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ef7b20e780 0x55ef7b218640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.849+0000 7f4da6159b80 1 --2- 172.21.15.83:0/3733229301 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ef7b20f0e0 0x55ef7b218b80 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.849+0000 7f4d72ffd700 0 client.15036 ms_handle_reset on v2:172.21.15.145:6834/3104241497 2024-04-01T06:55:16.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.849+0000 7f4da6159b80 1 -- 172.21.15.83:0/3733229301 >> 172.21.15.83:0/3733229301 conn(0x55ef7b16d650 msgr2=0x55ef7b20d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:16.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.849+0000 7f4da6159b80 1 -- 172.21.15.83:0/3733229301 shutdown_connections 2024-04-01T06:55:16.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.849+0000 7f4da6159b80 1 -- 172.21.15.83:0/3733229301 wait complete. 2024-04-01T06:55:16.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.849+0000 7f4da6159b80 20 client.15036 trim_cache size 0 max 16384 2024-04-01T06:55:16.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.866+0000 7f4da6159b80 1 Processor -- start 2024-04-01T06:55:16.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.866+0000 7f4da6159b80 1 -- start start 2024-04-01T06:55:16.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.867+0000 7f4da6159b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ef7b20e780 0x55ef7b20eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:16.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.867+0000 7f4da6159b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ef7b20f0e0 0x55ef7b217b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:16.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.867+0000 7f4da6159b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ef7b20ff80 0x55ef7b21fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:16.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.867+0000 7f4da6159b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef7b158990 con 0x55ef7b20ff80 2024-04-01T06:55:16.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.867+0000 7f4da6159b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef7b15c850 con 0x55ef7b20e780 2024-04-01T06:55:16.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.867+0000 7f4da6159b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef7b0fede0 con 0x55ef7b20f0e0 2024-04-01T06:55:16.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.867+0000 7f4d93fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ef7b20ff80 0x55ef7b21fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:16.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.867+0000 7f4d93fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ef7b20ff80 0x55ef7b21fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:41780/0 (socket says 172.21.15.83:41780) 2024-04-01T06:55:16.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.867+0000 7f4d93fff700 1 -- 172.21.15.83:0/124115224 learned_addr learned my addr 172.21.15.83:0/124115224 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:16.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.867+0000 7f4d92ffd700 1 --2- 172.21.15.83:0/124115224 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ef7b20f0e0 0x55ef7b217b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:16.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.867+0000 7f4d937fe700 1 --2- 172.21.15.83:0/124115224 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ef7b20e780 0x55ef7b20eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:16.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.867+0000 7f4d93fff700 1 -- 172.21.15.83:0/124115224 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ef7b20f0e0 msgr2=0x55ef7b217b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:16.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.867+0000 7f4d93fff700 1 --2- 172.21.15.83:0/124115224 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ef7b20f0e0 0x55ef7b217b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.867+0000 7f4d93fff700 1 -- 172.21.15.83:0/124115224 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ef7b20e780 msgr2=0x55ef7b20eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:16.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.867+0000 7f4d93fff700 1 --2- 172.21.15.83:0/124115224 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ef7b20e780 0x55ef7b20eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.867+0000 7f4d93fff700 1 -- 172.21.15.83:0/124115224 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef7b125e50 con 0x55ef7b20ff80 2024-04-01T06:55:16.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.867+0000 7f4d937fe700 1 --2- 172.21.15.83:0/124115224 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ef7b20e780 0x55ef7b20eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:55:16.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.867+0000 7f4d93fff700 1 --2- 172.21.15.83:0/124115224 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ef7b20ff80 0x55ef7b21fb80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c009d30 tx=0x7f4d8c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52405506321c00b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:16.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.867+0000 7f4d7a7fc700 1 -- 172.21.15.83:0/124115224 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c007ea0 con 0x55ef7b20ff80 2024-04-01T06:55:16.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.867+0000 7f4d7a7fc700 1 -- 172.21.15.83:0/124115224 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4d8c00f030 con 0x55ef7b20ff80 2024-04-01T06:55:16.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.867+0000 7f4d7a7fc700 1 -- 172.21.15.83:0/124115224 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c0146d0 con 0x55ef7b20ff80 2024-04-01T06:55:16.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.868+0000 7f4da6159b80 1 -- 172.21.15.83:0/124115224 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ef7b20ff80 msgr2=0x55ef7b21fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:16.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.868+0000 7f4da6159b80 1 --2- 172.21.15.83:0/124115224 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ef7b20ff80 0x55ef7b21fb80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c009d30 tx=0x7f4d8c009040 comp rx=0 tx=0).stop 2024-04-01T06:55:16.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.868+0000 7f4da6159b80 1 -- 172.21.15.83:0/124115224 shutdown_connections 2024-04-01T06:55:16.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.868+0000 7f4da6159b80 1 --2- 172.21.15.83:0/124115224 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ef7b20ff80 0x55ef7b21fb80 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.868+0000 7f4da6159b80 1 --2- 172.21.15.83:0/124115224 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ef7b20e780 0x55ef7b20eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.868+0000 7f4da6159b80 1 --2- 172.21.15.83:0/124115224 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ef7b20f0e0 0x55ef7b217b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.868+0000 7f4da6159b80 1 -- 172.21.15.83:0/124115224 >> 172.21.15.83:0/124115224 conn(0x55ef7b16d650 msgr2=0x55ef7b202550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:16.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.868+0000 7f4da6159b80 1 -- 172.21.15.83:0/124115224 shutdown_connections 2024-04-01T06:55:16.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.868+0000 7f4da6159b80 1 -- 172.21.15.83:0/124115224 wait complete. 2024-04-01T06:55:16.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.868+0000 7f4da6159b80 1 -- start start 2024-04-01T06:55:16.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.868+0000 7f4da6159b80 1 Processor -- start 2024-04-01T06:55:16.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.869+0000 7f4da6159b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ef7b20e780 0x55ef7b21c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:16.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.869+0000 7f4da6159b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ef7b20f0e0 0x55ef7b21cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:16.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.869+0000 7f4da6159b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ef7b20ff80 0x55ef7b277b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:16.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.869+0000 7f4da6159b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef7b21d4e0 con 0x55ef7b20f0e0 2024-04-01T06:55:16.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.869+0000 7f4da6159b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef7b278060 con 0x55ef7b20e780 2024-04-01T06:55:16.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.869+0000 7f4da6159b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef7b2781a0 con 0x55ef7b20ff80 2024-04-01T06:55:16.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.869+0000 7f4da6159b80 10 client.0 _ll_register_callbacks cb 0x55ef7b105420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:55:16.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.869+0000 7f4d92ffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ef7b20f0e0 0x55ef7b21cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:16.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.869+0000 7f4d92ffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ef7b20f0e0 0x55ef7b21cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:41782/0 (socket says 172.21.15.83:41782) 2024-04-01T06:55:16.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.869+0000 7f4d92ffd700 1 -- 172.21.15.83:0/4288437955 learned_addr learned my addr 172.21.15.83:0/4288437955 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:16.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.869+0000 7f4d937fe700 1 --2- 172.21.15.83:0/4288437955 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ef7b20e780 0x55ef7b21c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:16.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.869+0000 7f4d93fff700 1 --2- 172.21.15.83:0/4288437955 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ef7b20ff80 0x55ef7b277b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:16.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.869+0000 7f4d92ffd700 1 -- 172.21.15.83:0/4288437955 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ef7b20ff80 msgr2=0x55ef7b277b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:16.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.869+0000 7f4d92ffd700 1 --2- 172.21.15.83:0/4288437955 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ef7b20ff80 0x55ef7b277b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.869+0000 7f4d92ffd700 1 -- 172.21.15.83:0/4288437955 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ef7b20e780 msgr2=0x55ef7b21c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:16.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.869+0000 7f4d92ffd700 1 --2- 172.21.15.83:0/4288437955 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ef7b20e780 0x55ef7b21c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.869+0000 7f4d92ffd700 1 -- 172.21.15.83:0/4288437955 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d8c009960 con 0x55ef7b20f0e0 2024-04-01T06:55:16.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.869+0000 7f4d937fe700 1 --2- 172.21.15.83:0/4288437955 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ef7b20e780 0x55ef7b21c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:55:16.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.869+0000 7f4d92ffd700 1 --2- 172.21.15.83:0/4288437955 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ef7b20f0e0 0x55ef7b21cec0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4d88030b90 tx=0x7f4d88004eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=803b57936ef9d891 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:16.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.869+0000 7f4d72ffd700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:55:16.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.869+0000 7f4d72ffd700 1 -- 172.21.15.83:0/4288437955 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8802b040 con 0x55ef7b20f0e0 2024-04-01T06:55:16.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.869+0000 7f4d72ffd700 1 -- 172.21.15.83:0/4288437955 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f4d8803f520 con 0x55ef7b20f0e0 2024-04-01T06:55:16.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.869+0000 7f4da6159b80 1 -- 172.21.15.83:0/4288437955 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4d8801e040 con 0x55ef7b20f0e0 2024-04-01T06:55:16.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.870+0000 7f4d72ffd700 1 -- 172.21.15.83:0/4288437955 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d88030930 con 0x55ef7b20f0e0 2024-04-01T06:55:16.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.870+0000 7f4da6159b80 10 client.15042 fetch_fsmap learned FSMap version 23 2024-04-01T06:55:16.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.870+0000 7f4da6159b80 1 -- 172.21.15.83:0/4288437955 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55ef7afe5c80 con 0x55ef7b20f0e0 2024-04-01T06:55:16.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.870+0000 7f4d72ffd700 1 -- 172.21.15.83:0/4288437955 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4d8801e040 con 0x55ef7b20f0e0 2024-04-01T06:55:16.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.870+0000 7f4d72ffd700 1 -- 172.21.15.83:0/4288437955 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 23) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4d88003b90 con 0x55ef7b20f0e0 2024-04-01T06:55:16.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.870+0000 7f4da6159b80 10 client.15042 fetch_fsmap finished waiting for FSMap version 23 2024-04-01T06:55:16.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.870+0000 7f4da6159b80 10 client.15042 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-01T06:55:16.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.870+0000 7f4da6159b80 20 client.15042 populate_metadata read hostname 'smithi083' 2024-04-01T06:55:16.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.870+0000 7f4da6159b80 1 --2- 172.21.15.83:0/4288437955 >> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] conn(0x55ef7b27ca90 0x55ef7b2793e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:16.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.870+0000 7f4da6159b80 4 client.15042 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-01T06:55:16.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.870+0000 7f4da6159b80 1 -- 172.21.15.83:0/4288437955 --> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ef7afaeca0 con 0x55ef7b27ca90 2024-04-01T06:55:16.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.870+0000 7f4d937fe700 1 --2- 172.21.15.83:0/4288437955 >> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] conn(0x55ef7b27ca90 0x55ef7b2793e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:16.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.870+0000 7f4d72ffd700 10 client.15042 ms_handle_connect on v2:172.21.15.145:6834/3104241497 2024-04-01T06:55:16.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.870+0000 7f4d937fe700 1 --2- 172.21.15.83:0/4288437955 >> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] conn(0x55ef7b27ca90 0x55ef7b2793e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=82350d87c94490c5 server_cookie=7ee13fb070b584e9 in_seq=0 out_seq=0 2024-04-01T06:55:16.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.871+0000 7f4d72ffd700 1 -- 172.21.15.83:0/4288437955 <== mds.2 v2:172.21.15.145:6834/3104241497 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55ef7afaeca0 con 0x55ef7b27ca90 2024-04-01T06:55:16.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.871+0000 7f4d72ffd700 10 client.15042 handle_command_reply: tid=0 2024-04-01T06:55:16.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.871+0000 7f4da6159b80 1 client.15042 shutdown 2024-04-01T06:55:16.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.871+0000 7f4da6159b80 1 -- 172.21.15.83:0/4288437955 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ef7b20f0e0 msgr2=0x55ef7b21cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:16.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.871+0000 7f4da6159b80 1 --2- 172.21.15.83:0/4288437955 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ef7b20f0e0 0x55ef7b21cec0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4d88030b90 tx=0x7f4d88004eb0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.871+0000 7f4da6159b80 1 -- 172.21.15.83:0/4288437955 shutdown_connections 2024-04-01T06:55:16.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.871+0000 7f4da6159b80 1 --2- 172.21.15.83:0/4288437955 >> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] conn(0x55ef7b27ca90 0x55ef7b2793e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.871+0000 7f4da6159b80 1 --2- 172.21.15.83:0/4288437955 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ef7b20ff80 0x55ef7b277b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.871+0000 7f4da6159b80 1 --2- 172.21.15.83:0/4288437955 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ef7b20e780 0x55ef7b21c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.871+0000 7f4da6159b80 1 --2- 172.21.15.83:0/4288437955 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ef7b20f0e0 0x55ef7b21cec0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.871+0000 7f4d72ffd700 0 client.15042 ms_handle_reset on v2:172.21.15.145:6834/3104241497 2024-04-01T06:55:16.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.871+0000 7f4da6159b80 1 -- 172.21.15.83:0/4288437955 >> 172.21.15.83:0/4288437955 conn(0x55ef7b16d650 msgr2=0x55ef7b217b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:16.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.871+0000 7f4da6159b80 1 -- 172.21.15.83:0/4288437955 shutdown_connections 2024-04-01T06:55:16.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.871+0000 7f4da6159b80 1 -- 172.21.15.83:0/4288437955 wait complete. 2024-04-01T06:55:16.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.871+0000 7f4da6159b80 20 client.15042 trim_cache size 0 max 16384 2024-04-01T06:55:16.878 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-04-01T06:55:16.878 INFO:teuthology.orchestra.run.smithi083.stdout: "cluster_fsid": "c6f8eff4-eff3-11ee-b647-cb9ed24678a4", 2024-04-01T06:55:16.879 INFO:teuthology.orchestra.run.smithi083.stdout: "whoami": 2, 2024-04-01T06:55:16.879 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 24473, 2024-04-01T06:55:16.879 INFO:teuthology.orchestra.run.smithi083.stdout: "want_state": "up:active", 2024-04-01T06:55:16.879 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "up:active", 2024-04-01T06:55:16.879 INFO:teuthology.orchestra.run.smithi083.stdout: "fs_name": "cephfs", 2024-04-01T06:55:16.879 INFO:teuthology.orchestra.run.smithi083.stdout: "rank_uptime": 44.171909384999999, 2024-04-01T06:55:16.879 INFO:teuthology.orchestra.run.smithi083.stdout: "mdsmap_epoch": 23, 2024-04-01T06:55:16.879 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_epoch": 79, 2024-04-01T06:55:16.879 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_epoch_barrier": 79, 2024-04-01T06:55:16.879 INFO:teuthology.orchestra.run.smithi083.stdout: "uptime": 66.645520633999993 2024-04-01T06:55:16.879 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-04-01T06:55:16.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.871+0000 7f4d99fc3700 1 -- 172.21.15.83:0/909450816 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f4d7c0a11b0 msgr2=0x7f4d7c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:16.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.871+0000 7f4d99fc3700 1 --2- 172.21.15.83:0/909450816 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f4d7c0a11b0 0x7f4d7c0a3670 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4d8800b5c0 tx=0x7f4d88005fb0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.871+0000 7f4d99fc3700 1 -- 172.21.15.83:0/909450816 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d940ff650 msgr2=0x7f4d94198e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:16.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.871+0000 7f4d99fc3700 1 --2- 172.21.15.83:0/909450816 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d940ff650 0x7f4d94198e80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f4d8400c920 tx=0x7f4d8400cce0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.872+0000 7f4d99fc3700 1 -- 172.21.15.83:0/909450816 shutdown_connections 2024-04-01T06:55:16.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.872+0000 7f4d99fc3700 1 --2- 172.21.15.83:0/909450816 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d940ff650 0x7f4d94198e80 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.872+0000 7f4d99fc3700 1 --2- 172.21.15.83:0/909450816 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f4d7c0a11b0 0x7f4d7c0a3670 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.872+0000 7f4d99fc3700 1 --2- 172.21.15.83:0/909450816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d94100970 0x7f4d941a03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.872+0000 7f4d99fc3700 1 --2- 172.21.15.83:0/909450816 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4d940fffb0 0x7f4d941993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:16.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.872+0000 7f4d99fc3700 1 -- 172.21.15.83:0/909450816 >> 172.21.15.83:0/909450816 conn(0x7f4d940fb1d0 msgr2=0x7f4d940fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:16.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.872+0000 7f4d99fc3700 1 -- 172.21.15.83:0/909450816 shutdown_connections 2024-04-01T06:55:16.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:16.872+0000 7f4d99fc3700 1 -- 172.21.15.83:0/909450816 wait complete. 2024-04-01T06:55:16.883 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2024-04-01T06:55:17.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.007+0000 7fa75da57700 1 -- 172.21.15.83:0/845744755 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa758100e80 msgr2=0x7fa7581012e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:17.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.007+0000 7fa75da57700 1 --2- 172.21.15.83:0/845744755 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa758100e80 0x7fa7581012e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fa7400099c0 tx=0x7fa740009cd0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.007+0000 7fa75da57700 1 -- 172.21.15.83:0/845744755 shutdown_connections 2024-04-01T06:55:17.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.007+0000 7fa75da57700 1 --2- 172.21.15.83:0/845744755 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa758101820 0x7fa7581080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.007+0000 7fa75da57700 1 --2- 172.21.15.83:0/845744755 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7580ffc90 0x7fa7581000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.007+0000 7fa75da57700 1 --2- 172.21.15.83:0/845744755 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa758100e80 0x7fa7581012e0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.007+0000 7fa75da57700 1 -- 172.21.15.83:0/845744755 >> 172.21.15.83:0/845744755 conn(0x7fa7580fb200 msgr2=0x7fa7580fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:17.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.007+0000 7fa75da57700 1 -- 172.21.15.83:0/845744755 shutdown_connections 2024-04-01T06:55:17.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.007+0000 7fa75da57700 1 -- 172.21.15.83:0/845744755 wait complete. 2024-04-01T06:55:17.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.008+0000 7fa75da57700 1 Processor -- start 2024-04-01T06:55:17.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.008+0000 7fa75da57700 1 -- start start 2024-04-01T06:55:17.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.008+0000 7fa75da57700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa7580ffc90 0x7fa758103b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:17.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.008+0000 7fa75da57700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa758100e80 0x7fa758102260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:17.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.008+0000 7fa75da57700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa758101820 0x7fa7581027a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:17.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.008+0000 7fa75da57700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa758102e50 con 0x7fa758100e80 2024-04-01T06:55:17.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.008+0000 7fa75da57700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa758102fc0 con 0x7fa7580ffc90 2024-04-01T06:55:17.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.008+0000 7fa75da57700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7581a0db0 con 0x7fa758101820 2024-04-01T06:55:17.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.008+0000 7fa7567fc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa758100e80 0x7fa758102260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:17.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.008+0000 7fa7567fc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa758100e80 0x7fa758102260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:41792/0 (socket says 172.21.15.83:41792) 2024-04-01T06:55:17.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.008+0000 7fa7567fc700 1 -- 172.21.15.83:0/2879623365 learned_addr learned my addr 172.21.15.83:0/2879623365 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:17.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.008+0000 7fa7577fe700 1 --2- 172.21.15.83:0/2879623365 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa758101820 0x7fa7581027a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:17.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.008+0000 7fa756ffd700 1 --2- 172.21.15.83:0/2879623365 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa7580ffc90 0x7fa758103b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:17.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.008+0000 7fa7567fc700 1 -- 172.21.15.83:0/2879623365 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa758101820 msgr2=0x7fa7581027a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:17.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.008+0000 7fa7567fc700 1 --2- 172.21.15.83:0/2879623365 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa758101820 0x7fa7581027a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.008+0000 7fa7567fc700 1 -- 172.21.15.83:0/2879623365 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa7580ffc90 msgr2=0x7fa758103b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:17.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.008+0000 7fa7567fc700 1 --2- 172.21.15.83:0/2879623365 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa7580ffc90 0x7fa758103b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.008+0000 7fa7567fc700 1 -- 172.21.15.83:0/2879623365 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7400095f0 con 0x7fa758100e80 2024-04-01T06:55:17.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.008+0000 7fa756ffd700 1 --2- 172.21.15.83:0/2879623365 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa7580ffc90 0x7fa758103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:55:17.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.009+0000 7fa7567fc700 1 --2- 172.21.15.83:0/2879623365 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa758100e80 0x7fa758102260 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa7400036f0 tx=0x7fa7400047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:17.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.009+0000 7fa75ca55700 1 -- 172.21.15.83:0/2879623365 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74001d070 con 0x7fa758100e80 2024-04-01T06:55:17.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.009+0000 7fa75ca55700 1 -- 172.21.15.83:0/2879623365 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa740004110 con 0x7fa758100e80 2024-04-01T06:55:17.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.009+0000 7fa75da57700 1 -- 172.21.15.83:0/2879623365 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7581a0f50 con 0x7fa758100e80 2024-04-01T06:55:17.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.009+0000 7fa75ca55700 1 -- 172.21.15.83:0/2879623365 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa740022e10 con 0x7fa758100e80 2024-04-01T06:55:17.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.009+0000 7fa75da57700 1 -- 172.21.15.83:0/2879623365 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7581a1380 con 0x7fa758100e80 2024-04-01T06:55:17.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.011+0000 7fa75ca55700 1 -- 172.21.15.83:0/2879623365 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7fa740022470 con 0x7fa758100e80 2024-04-01T06:55:17.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.011+0000 7fa75ca55700 1 --2- 172.21.15.83:0/2879623365 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fa7440a1230 0x7fa7440a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:17.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.011+0000 7fa75ca55700 1 -- 172.21.15.83:0/2879623365 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa7400cdaf0 con 0x7fa758100e80 2024-04-01T06:55:17.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.011+0000 7fa756ffd700 1 --2- 172.21.15.83:0/2879623365 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fa7440a1230 0x7fa7440a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:17.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.012+0000 7fa756ffd700 1 --2- 172.21.15.83:0/2879623365 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fa7440a1230 0x7fa7440a36f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa748005fd0 tx=0x7fa748005f00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:17.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.012+0000 7fa769bedb80 1 Processor -- start 2024-04-01T06:55:17.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.012+0000 7fa769bedb80 1 -- start start 2024-04-01T06:55:17.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:16 smithi083 ceph-mon[43429]: pgmap v240: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-01T06:55:17.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:16 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/3533488619' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:55:17.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:16 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/3045142535' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T06:55:17.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:16 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/3413748311' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:55:17.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.012+0000 7fa769bedb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564c1acf2780 0x564c1acf2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:17.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.013+0000 7fa769bedb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c1acf30e0 0x564c1acf39a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:17.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.013+0000 7fa769bedb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c1acf3f80 0x564c1acf4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:17.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.013+0000 7fa769bedb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c1ac4a940 con 0x564c1acf3f80 2024-04-01T06:55:17.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.013+0000 7fa769bedb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c1ac48300 con 0x564c1acf2780 2024-04-01T06:55:17.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.013+0000 7fa769bedb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c1ac43bf0 con 0x564c1acf30e0 2024-04-01T06:55:17.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.013+0000 7fa7577fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c1acf3f80 0x564c1acf4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:17.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.013+0000 7fa7577fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c1acf3f80 0x564c1acf4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:41800/0 (socket says 172.21.15.83:41800) 2024-04-01T06:55:17.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.013+0000 7fa7577fe700 1 -- 172.21.15.83:0/914920378 learned_addr learned my addr 172.21.15.83:0/914920378 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:17.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.013+0000 7fa7567fc700 1 --2- 172.21.15.83:0/914920378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c1acf30e0 0x564c1acf39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:17.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.013+0000 7fa756ffd700 1 --2- 172.21.15.83:0/914920378 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564c1acf2780 0x564c1acf2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:17.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.013+0000 7fa7577fe700 1 -- 172.21.15.83:0/914920378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c1acf30e0 msgr2=0x564c1acf39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:17.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.013+0000 7fa7577fe700 1 --2- 172.21.15.83:0/914920378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c1acf30e0 0x564c1acf39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.013+0000 7fa7577fe700 1 -- 172.21.15.83:0/914920378 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564c1acf2780 msgr2=0x564c1acf2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:17.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.013+0000 7fa7577fe700 1 --2- 172.21.15.83:0/914920378 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564c1acf2780 0x564c1acf2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.013+0000 7fa7577fe700 1 -- 172.21.15.83:0/914920378 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564c1aac5360 con 0x564c1acf3f80 2024-04-01T06:55:17.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.013+0000 7fa7577fe700 1 --2- 172.21.15.83:0/914920378 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c1acf3f80 0x564c1acf4400 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa750009dc0 tx=0x7fa7500077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f58b7792d884977f server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:17.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.013+0000 7fa74dffb700 1 -- 172.21.15.83:0/914920378 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa750014610 con 0x564c1acf3f80 2024-04-01T06:55:17.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.013+0000 7fa74dffb700 1 -- 172.21.15.83:0/914920378 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa75000f050 con 0x564c1acf3f80 2024-04-01T06:55:17.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.013+0000 7fa74dffb700 1 -- 172.21.15.83:0/914920378 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7500138f0 con 0x564c1acf3f80 2024-04-01T06:55:17.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.014+0000 7fa769bedb80 1 -- 172.21.15.83:0/914920378 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c1acf3f80 msgr2=0x564c1acf4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:17.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.014+0000 7fa769bedb80 1 --2- 172.21.15.83:0/914920378 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c1acf3f80 0x564c1acf4400 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa750009dc0 tx=0x7fa7500077e0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.014+0000 7fa769bedb80 1 -- 172.21.15.83:0/914920378 shutdown_connections 2024-04-01T06:55:17.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.014+0000 7fa769bedb80 1 --2- 172.21.15.83:0/914920378 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c1acf3f80 0x564c1acf4400 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.014+0000 7fa769bedb80 1 --2- 172.21.15.83:0/914920378 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564c1acf2780 0x564c1acf2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.014+0000 7fa769bedb80 1 --2- 172.21.15.83:0/914920378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c1acf30e0 0x564c1acf39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.014+0000 7fa769bedb80 1 -- 172.21.15.83:0/914920378 >> 172.21.15.83:0/914920378 conn(0x564c1ac51650 msgr2=0x564c1aced950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:17.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.014+0000 7fa769bedb80 1 -- 172.21.15.83:0/914920378 shutdown_connections 2024-04-01T06:55:17.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.014+0000 7fa769bedb80 1 -- 172.21.15.83:0/914920378 wait complete. 2024-04-01T06:55:17.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.014+0000 7fa769bedb80 1 -- start start 2024-04-01T06:55:17.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.015+0000 7fa769bedb80 1 Processor -- start 2024-04-01T06:55:17.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.015+0000 7fa769bedb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c1acf2780 0x564c1acfc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:17.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.015+0000 7fa769bedb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564c1acf30e0 0x564c1acfcb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:17.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.015+0000 7fa769bedb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c1acf3f80 0x564c1ad03b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:17.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.015+0000 7fa769bedb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c1abdfd30 con 0x564c1acf2780 2024-04-01T06:55:17.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.015+0000 7fa769bedb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c1abdf9d0 con 0x564c1acf30e0 2024-04-01T06:55:17.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.015+0000 7fa769bedb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c1aac7650 con 0x564c1acf3f80 2024-04-01T06:55:17.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.015+0000 7fa769bedb80 10 client.0 _ll_register_callbacks cb 0x564c1abe9420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:55:17.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.015+0000 7fa756ffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c1acf2780 0x564c1acfc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:17.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.015+0000 7fa756ffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c1acf2780 0x564c1acfc5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:41810/0 (socket says 172.21.15.83:41810) 2024-04-01T06:55:17.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.015+0000 7fa756ffd700 1 -- 172.21.15.83:0/1004720968 learned_addr learned my addr 172.21.15.83:0/1004720968 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:17.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.015+0000 7fa7577fe700 1 --2- 172.21.15.83:0/1004720968 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c1acf3f80 0x564c1ad03b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:17.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.015+0000 7fa7567fc700 1 --2- 172.21.15.83:0/1004720968 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564c1acf30e0 0x564c1acfcb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:17.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.015+0000 7fa756ffd700 1 -- 172.21.15.83:0/1004720968 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c1acf3f80 msgr2=0x564c1ad03b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:17.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.015+0000 7fa756ffd700 1 --2- 172.21.15.83:0/1004720968 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c1acf3f80 0x564c1ad03b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.015+0000 7fa756ffd700 1 -- 172.21.15.83:0/1004720968 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564c1acf30e0 msgr2=0x564c1acfcb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:17.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.015+0000 7fa756ffd700 1 --2- 172.21.15.83:0/1004720968 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564c1acf30e0 0x564c1acfcb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.015+0000 7fa756ffd700 1 -- 172.21.15.83:0/1004720968 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa750009a20 con 0x564c1acf2780 2024-04-01T06:55:17.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.015+0000 7fa756ffd700 1 --2- 172.21.15.83:0/1004720968 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c1acf2780 0x564c1acfc5d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa748011700 tx=0x7fa748004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c62a715f0054f99 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:17.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.015+0000 7fa736ffd700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:55:17.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.015+0000 7fa736ffd700 1 -- 172.21.15.83:0/1004720968 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74801f830 con 0x564c1acf2780 2024-04-01T06:55:17.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.016+0000 7fa736ffd700 1 -- 172.21.15.83:0/1004720968 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa74801f990 con 0x564c1acf2780 2024-04-01T06:55:17.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.016+0000 7fa769bedb80 1 -- 172.21.15.83:0/1004720968 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564c1ac04330 con 0x564c1acf2780 2024-04-01T06:55:17.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.016+0000 7fa736ffd700 1 -- 172.21.15.83:0/1004720968 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa74801fb50 con 0x564c1acf2780 2024-04-01T06:55:17.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.016+0000 7fa769bedb80 10 client.15054 fetch_fsmap learned FSMap version 23 2024-04-01T06:55:17.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.016+0000 7fa769bedb80 1 -- 172.21.15.83:0/1004720968 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x564c1aa71b10 con 0x564c1acf2780 2024-04-01T06:55:17.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.016+0000 7fa736ffd700 1 -- 172.21.15.83:0/1004720968 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x564c1ac04330 con 0x564c1acf2780 2024-04-01T06:55:17.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.016+0000 7fa736ffd700 1 -- 172.21.15.83:0/1004720968 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 23) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa7480103d0 con 0x564c1acf2780 2024-04-01T06:55:17.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.016+0000 7fa769bedb80 10 client.15054 fetch_fsmap finished waiting for FSMap version 23 2024-04-01T06:55:17.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.016+0000 7fa769bedb80 10 client.15054 resolve_mds: resolved name 'h' to daemon mds.h 2024-04-01T06:55:17.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.016+0000 7fa769bedb80 20 client.15054 populate_metadata read hostname 'smithi083' 2024-04-01T06:55:17.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.016+0000 7fa769bedb80 1 --2- 172.21.15.83:0/1004720968 >> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] conn(0x564c1ad06c10 0x564c1ad0ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:17.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.016+0000 7fa769bedb80 4 client.15054 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-01T06:55:17.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.016+0000 7fa769bedb80 1 -- 172.21.15.83:0/1004720968 --> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564c1ac3c6b0 con 0x564c1ad06c10 2024-04-01T06:55:17.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.016+0000 7fa7567fc700 1 --2- 172.21.15.83:0/1004720968 >> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] conn(0x564c1ad06c10 0x564c1ad0ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:17.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.017+0000 7fa736ffd700 10 client.15054 ms_handle_connect on v2:172.21.15.145:6836/2687798317 2024-04-01T06:55:17.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.017+0000 7fa7567fc700 1 --2- 172.21.15.83:0/1004720968 >> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] conn(0x564c1ad06c10 0x564c1ad0ca30 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2d71b10a50763e73 server_cookie=474a64d52d1b744b in_seq=0 out_seq=0 2024-04-01T06:55:17.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.017+0000 7fa736ffd700 1 -- 172.21.15.83:0/1004720968 <== mds.1 v2:172.21.15.145:6836/2687798317 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564c1ac3c6b0 con 0x564c1ad06c10 2024-04-01T06:55:17.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.017+0000 7fa736ffd700 10 client.15054 handle_command_reply: tid=0 2024-04-01T06:55:17.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.017+0000 7fa769bedb80 1 client.15054 shutdown 2024-04-01T06:55:17.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.018+0000 7fa769bedb80 1 -- 172.21.15.83:0/1004720968 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c1acf2780 msgr2=0x564c1acfc5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:17.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.018+0000 7fa769bedb80 1 --2- 172.21.15.83:0/1004720968 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c1acf2780 0x564c1acfc5d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa748011700 tx=0x7fa748004750 comp rx=0 tx=0).stop 2024-04-01T06:55:17.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.018+0000 7fa769bedb80 1 -- 172.21.15.83:0/1004720968 shutdown_connections 2024-04-01T06:55:17.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.018+0000 7fa769bedb80 1 --2- 172.21.15.83:0/1004720968 >> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] conn(0x564c1ad06c10 0x564c1ad0ca30 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.018+0000 7fa769bedb80 1 --2- 172.21.15.83:0/1004720968 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c1acf2780 0x564c1acfc5d0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.018+0000 7fa736ffd700 0 client.15054 ms_handle_reset on v2:172.21.15.145:6836/2687798317 2024-04-01T06:55:17.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.018+0000 7fa769bedb80 1 --2- 172.21.15.83:0/1004720968 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c1acf3f80 0x564c1ad03b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.018+0000 7fa769bedb80 1 --2- 172.21.15.83:0/1004720968 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564c1acf30e0 0x564c1acfcb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.018+0000 7fa769bedb80 1 -- 172.21.15.83:0/1004720968 >> 172.21.15.83:0/1004720968 conn(0x564c1ac51650 msgr2=0x564c1acf1120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:17.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.018+0000 7fa769bedb80 1 -- 172.21.15.83:0/1004720968 shutdown_connections 2024-04-01T06:55:17.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.018+0000 7fa769bedb80 1 -- 172.21.15.83:0/1004720968 wait complete. 2024-04-01T06:55:17.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.018+0000 7fa769bedb80 20 client.15054 trim_cache size 0 max 16384 2024-04-01T06:55:17.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.035+0000 7fa769bedb80 1 Processor -- start 2024-04-01T06:55:17.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.035+0000 7fa769bedb80 1 -- start start 2024-04-01T06:55:17.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.035+0000 7fa769bedb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c1acf2780 0x564c1acf2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:17.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.035+0000 7fa769bedb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c1acf30e0 0x564c1ad03b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:17.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.035+0000 7fa769bedb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564c1acf3f80 0x564c1acf4360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:17.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.035+0000 7fa769bedb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c1ac3c990 con 0x564c1acf2780 2024-04-01T06:55:17.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.035+0000 7fa769bedb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c1ac40850 con 0x564c1acf3f80 2024-04-01T06:55:17.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.035+0000 7fa769bedb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c1abe2de0 con 0x564c1acf30e0 2024-04-01T06:55:17.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.035+0000 7fa756ffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c1acf2780 0x564c1acf2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:17.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.035+0000 7fa756ffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c1acf2780 0x564c1acf2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:41820/0 (socket says 172.21.15.83:41820) 2024-04-01T06:55:17.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.035+0000 7fa756ffd700 1 -- 172.21.15.83:0/2594404498 learned_addr learned my addr 172.21.15.83:0/2594404498 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:17.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.036+0000 7fa7567fc700 1 --2- 172.21.15.83:0/2594404498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c1acf30e0 0x564c1ad03b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:17.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.036+0000 7fa756ffd700 1 -- 172.21.15.83:0/2594404498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c1acf30e0 msgr2=0x564c1ad03b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:17.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.036+0000 7fa756ffd700 1 --2- 172.21.15.83:0/2594404498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c1acf30e0 0x564c1ad03b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.036+0000 7fa756ffd700 1 -- 172.21.15.83:0/2594404498 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564c1acf3f80 msgr2=0x564c1acf4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:17.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.036+0000 7fa756ffd700 1 --2- 172.21.15.83:0/2594404498 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564c1acf3f80 0x564c1acf4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.036+0000 7fa756ffd700 1 -- 172.21.15.83:0/2594404498 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564c1ac09e50 con 0x564c1acf2780 2024-04-01T06:55:17.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.036+0000 7fa7567fc700 1 --2- 172.21.15.83:0/2594404498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c1acf30e0 0x564c1ad03b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:55:17.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.036+0000 7fa756ffd700 1 --2- 172.21.15.83:0/2594404498 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c1acf2780 0x564c1acf2b60 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa748011e20 tx=0x7fa748011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb1ef0544bf03797 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:17.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.036+0000 7fa74e7fc700 1 -- 172.21.15.83:0/2594404498 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa748010550 con 0x564c1acf2780 2024-04-01T06:55:17.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.036+0000 7fa74e7fc700 1 -- 172.21.15.83:0/2594404498 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa748004cf0 con 0x564c1acf2780 2024-04-01T06:55:17.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.036+0000 7fa74e7fc700 1 -- 172.21.15.83:0/2594404498 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa748005690 con 0x564c1acf2780 2024-04-01T06:55:17.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.036+0000 7fa769bedb80 1 -- 172.21.15.83:0/2594404498 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c1acf2780 msgr2=0x564c1acf2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:17.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.036+0000 7fa769bedb80 1 --2- 172.21.15.83:0/2594404498 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c1acf2780 0x564c1acf2b60 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa748011e20 tx=0x7fa748011e50 comp rx=0 tx=0).stop 2024-04-01T06:55:17.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.037+0000 7fa769bedb80 1 -- 172.21.15.83:0/2594404498 shutdown_connections 2024-04-01T06:55:17.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.037+0000 7fa769bedb80 1 --2- 172.21.15.83:0/2594404498 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c1acf2780 0x564c1acf2b60 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.037+0000 7fa769bedb80 1 --2- 172.21.15.83:0/2594404498 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564c1acf3f80 0x564c1acf4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.037+0000 7fa769bedb80 1 --2- 172.21.15.83:0/2594404498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c1acf30e0 0x564c1ad03b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.037+0000 7fa769bedb80 1 -- 172.21.15.83:0/2594404498 >> 172.21.15.83:0/2594404498 conn(0x564c1ac51650 msgr2=0x564c1acfb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:17.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.037+0000 7fa769bedb80 1 -- 172.21.15.83:0/2594404498 shutdown_connections 2024-04-01T06:55:17.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.037+0000 7fa769bedb80 1 -- 172.21.15.83:0/2594404498 wait complete. 2024-04-01T06:55:17.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.037+0000 7fa769bedb80 1 -- start start 2024-04-01T06:55:17.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.037+0000 7fa769bedb80 1 Processor -- start 2024-04-01T06:55:17.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.037+0000 7fa769bedb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564c1acf2780 0x564c1ad03ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:17.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.037+0000 7fa769bedb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c1acf30e0 0x564c1ad00600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:17.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.037+0000 7fa769bedb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c1acf3f80 0x564c1ad00bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:17.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.038+0000 7fa769bedb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c1ad5c020 con 0x564c1acf3f80 2024-04-01T06:55:17.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.038+0000 7fa769bedb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c1ad5c160 con 0x564c1acf2780 2024-04-01T06:55:17.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.038+0000 7fa769bedb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c1ad5c2a0 con 0x564c1acf30e0 2024-04-01T06:55:17.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.038+0000 7fa769bedb80 10 client.0 _ll_register_callbacks cb 0x564c1abe9420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:55:17.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.038+0000 7fa7577fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c1acf3f80 0x564c1ad00bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:17.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.038+0000 7fa7577fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c1acf3f80 0x564c1ad00bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:41832/0 (socket says 172.21.15.83:41832) 2024-04-01T06:55:17.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.038+0000 7fa7577fe700 1 -- 172.21.15.83:0/2848199369 learned_addr learned my addr 172.21.15.83:0/2848199369 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:17.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.038+0000 7fa7567fc700 1 --2- 172.21.15.83:0/2848199369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c1acf30e0 0x564c1ad00600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:17.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.038+0000 7fa756ffd700 1 --2- 172.21.15.83:0/2848199369 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564c1acf2780 0x564c1ad03ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:17.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.038+0000 7fa7577fe700 1 -- 172.21.15.83:0/2848199369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c1acf30e0 msgr2=0x564c1ad00600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:17.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.038+0000 7fa7577fe700 1 --2- 172.21.15.83:0/2848199369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c1acf30e0 0x564c1ad00600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.038+0000 7fa7577fe700 1 -- 172.21.15.83:0/2848199369 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564c1acf2780 msgr2=0x564c1ad03ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:17.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.038+0000 7fa7577fe700 1 --2- 172.21.15.83:0/2848199369 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564c1acf2780 0x564c1ad03ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.038+0000 7fa7577fe700 1 -- 172.21.15.83:0/2848199369 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564c1aa71b10 con 0x564c1acf3f80 2024-04-01T06:55:17.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.038+0000 7fa756ffd700 1 --2- 172.21.15.83:0/2848199369 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564c1acf2780 0x564c1ad03ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:55:17.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.038+0000 7fa7577fe700 1 --2- 172.21.15.83:0/2848199369 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c1acf3f80 0x564c1ad00bc0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x564c1acf3760 tx=0x7fa750014b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8603022fc6ff453c server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:17.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.038+0000 7fa736ffd700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:55:17.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.038+0000 7fa736ffd700 1 -- 172.21.15.83:0/2848199369 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa750004c50 con 0x564c1acf3f80 2024-04-01T06:55:17.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.038+0000 7fa736ffd700 1 -- 172.21.15.83:0/2848199369 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa750004db0 con 0x564c1acf3f80 2024-04-01T06:55:17.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.038+0000 7fa769bedb80 1 -- 172.21.15.83:0/2848199369 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa75000f050 con 0x564c1acf3f80 2024-04-01T06:55:17.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.038+0000 7fa736ffd700 1 -- 172.21.15.83:0/2848199369 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa750014d60 con 0x564c1acf3f80 2024-04-01T06:55:17.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.038+0000 7fa769bedb80 10 client.15060 fetch_fsmap learned FSMap version 23 2024-04-01T06:55:17.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.038+0000 7fa769bedb80 1 -- 172.21.15.83:0/2848199369 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x564c1aac9c80 con 0x564c1acf3f80 2024-04-01T06:55:17.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.039+0000 7fa736ffd700 1 -- 172.21.15.83:0/2848199369 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa75000f050 con 0x564c1acf3f80 2024-04-01T06:55:17.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.039+0000 7fa736ffd700 1 -- 172.21.15.83:0/2848199369 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 23) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa750031070 con 0x564c1acf3f80 2024-04-01T06:55:17.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.039+0000 7fa769bedb80 10 client.15060 fetch_fsmap finished waiting for FSMap version 23 2024-04-01T06:55:17.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.039+0000 7fa769bedb80 10 client.15060 resolve_mds: resolved name 'h' to daemon mds.h 2024-04-01T06:55:17.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.039+0000 7fa769bedb80 20 client.15060 populate_metadata read hostname 'smithi083' 2024-04-01T06:55:17.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.039+0000 7fa769bedb80 1 --2- 172.21.15.83:0/2848199369 >> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] conn(0x564c1ad61070 0x564c1ad5d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:17.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.039+0000 7fa769bedb80 4 client.15060 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-01T06:55:17.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.039+0000 7fa769bedb80 1 -- 172.21.15.83:0/2848199369 --> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564c1aa92ca0 con 0x564c1ad61070 2024-04-01T06:55:17.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.039+0000 7fa756ffd700 1 --2- 172.21.15.83:0/2848199369 >> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] conn(0x564c1ad61070 0x564c1ad5d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:17.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.040+0000 7fa736ffd700 10 client.15060 ms_handle_connect on v2:172.21.15.145:6836/2687798317 2024-04-01T06:55:17.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.040+0000 7fa756ffd700 1 --2- 172.21.15.83:0/2848199369 >> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] conn(0x564c1ad61070 0x564c1ad5d9a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c7eb4a8a312b8772 server_cookie=70ff1c6cb54b7903 in_seq=0 out_seq=0 2024-04-01T06:55:17.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.040+0000 7fa736ffd700 1 -- 172.21.15.83:0/2848199369 <== mds.1 v2:172.21.15.145:6836/2687798317 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x564c1aa92ca0 con 0x564c1ad61070 2024-04-01T06:55:17.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.040+0000 7fa736ffd700 10 client.15060 handle_command_reply: tid=0 2024-04-01T06:55:17.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.040+0000 7fa769bedb80 1 client.15060 shutdown 2024-04-01T06:55:17.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.040+0000 7fa769bedb80 1 -- 172.21.15.83:0/2848199369 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c1acf3f80 msgr2=0x564c1ad00bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:17.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.040+0000 7fa769bedb80 1 --2- 172.21.15.83:0/2848199369 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c1acf3f80 0x564c1ad00bc0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x564c1acf3760 tx=0x7fa750014b40 comp rx=0 tx=0).stop 2024-04-01T06:55:17.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.040+0000 7fa769bedb80 1 -- 172.21.15.83:0/2848199369 shutdown_connections 2024-04-01T06:55:17.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.040+0000 7fa769bedb80 1 --2- 172.21.15.83:0/2848199369 >> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] conn(0x564c1ad61070 0x564c1ad5d9a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.040+0000 7fa769bedb80 1 --2- 172.21.15.83:0/2848199369 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x564c1acf3f80 0x564c1ad00bc0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.040+0000 7fa769bedb80 1 --2- 172.21.15.83:0/2848199369 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564c1acf2780 0x564c1ad03ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.040+0000 7fa736ffd700 0 client.15060 ms_handle_reset on v2:172.21.15.145:6836/2687798317 2024-04-01T06:55:17.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.040+0000 7fa769bedb80 1 --2- 172.21.15.83:0/2848199369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564c1acf30e0 0x564c1ad00600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.040+0000 7fa769bedb80 1 -- 172.21.15.83:0/2848199369 >> 172.21.15.83:0/2848199369 conn(0x564c1ac51650 msgr2=0x564c1ad10a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:17.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.040+0000 7fa769bedb80 1 -- 172.21.15.83:0/2848199369 shutdown_connections 2024-04-01T06:55:17.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.040+0000 7fa769bedb80 1 -- 172.21.15.83:0/2848199369 wait complete. 2024-04-01T06:55:17.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.040+0000 7fa769bedb80 20 client.15060 trim_cache size 0 max 16384 2024-04-01T06:55:17.047 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-04-01T06:55:17.047 INFO:teuthology.orchestra.run.smithi083.stdout: "cluster_fsid": "c6f8eff4-eff3-11ee-b647-cb9ed24678a4", 2024-04-01T06:55:17.047 INFO:teuthology.orchestra.run.smithi083.stdout: "whoami": 1, 2024-04-01T06:55:17.047 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 24494, 2024-04-01T06:55:17.047 INFO:teuthology.orchestra.run.smithi083.stdout: "want_state": "up:active", 2024-04-01T06:55:17.047 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "up:active", 2024-04-01T06:55:17.047 INFO:teuthology.orchestra.run.smithi083.stdout: "fs_name": "cephfs", 2024-04-01T06:55:17.047 INFO:teuthology.orchestra.run.smithi083.stdout: "rank_uptime": 45.350788156, 2024-04-01T06:55:17.048 INFO:teuthology.orchestra.run.smithi083.stdout: "mdsmap_epoch": 23, 2024-04-01T06:55:17.048 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_epoch": 79, 2024-04-01T06:55:17.048 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_epoch_barrier": 79, 2024-04-01T06:55:17.048 INFO:teuthology.orchestra.run.smithi083.stdout: "uptime": 61.648905554000002 2024-04-01T06:55:17.048 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-04-01T06:55:17.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.041+0000 7fa75da57700 1 -- 172.21.15.83:0/2879623365 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fa7440a1230 msgr2=0x7fa7440a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:17.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.041+0000 7fa75da57700 1 --2- 172.21.15.83:0/2879623365 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fa7440a1230 0x7fa7440a36f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa748005fd0 tx=0x7fa748005f00 comp rx=0 tx=0).stop 2024-04-01T06:55:17.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.041+0000 7fa75da57700 1 -- 172.21.15.83:0/2879623365 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa758100e80 msgr2=0x7fa758102260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:17.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.041+0000 7fa75da57700 1 --2- 172.21.15.83:0/2879623365 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa758100e80 0x7fa758102260 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa7400036f0 tx=0x7fa7400047b0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.041+0000 7fa75da57700 1 -- 172.21.15.83:0/2879623365 shutdown_connections 2024-04-01T06:55:17.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.041+0000 7fa75da57700 1 --2- 172.21.15.83:0/2879623365 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fa7440a1230 0x7fa7440a36f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.041+0000 7fa75da57700 1 --2- 172.21.15.83:0/2879623365 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa758101820 0x7fa7581027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.041+0000 7fa75da57700 1 --2- 172.21.15.83:0/2879623365 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa7580ffc90 0x7fa758103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.041+0000 7fa75da57700 1 --2- 172.21.15.83:0/2879623365 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa758100e80 0x7fa758102260 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.041+0000 7fa75da57700 1 -- 172.21.15.83:0/2879623365 >> 172.21.15.83:0/2879623365 conn(0x7fa7580fb200 msgr2=0x7fa7580fcd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:17.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.041+0000 7fa75da57700 1 -- 172.21.15.83:0/2879623365 shutdown_connections 2024-04-01T06:55:17.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.041+0000 7fa75da57700 1 -- 172.21.15.83:0/2879623365 wait complete. 2024-04-01T06:55:17.053 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-01T06:55:17.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:16 smithi153 ceph-mon[48187]: pgmap v240: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-01T06:55:17.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:16 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/3533488619' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:55:17.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:16 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/3045142535' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T06:55:17.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:16 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/3413748311' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:55:17.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.176+0000 7f5cb6578700 1 -- 172.21.15.83:0/1587005123 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5cb00ffc70 msgr2=0x7f5cb0100090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:17.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.176+0000 7f5cb6578700 1 --2- 172.21.15.83:0/1587005123 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5cb00ffc70 0x7f5cb0100090 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5ca00099c0 tx=0x7f5ca0009cd0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.176+0000 7f5cb6578700 1 -- 172.21.15.83:0/1587005123 shutdown_connections 2024-04-01T06:55:17.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.176+0000 7f5cb6578700 1 --2- 172.21.15.83:0/1587005123 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5cb00ffc70 0x7f5cb0100090 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.176+0000 7f5cb6578700 1 --2- 172.21.15.83:0/1587005123 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5cb0101800 0x7f5cb01080b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.176+0000 7f5cb6578700 1 --2- 172.21.15.83:0/1587005123 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5cb0100e60 0x7f5cb01012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.176+0000 7f5cb6578700 1 -- 172.21.15.83:0/1587005123 >> 172.21.15.83:0/1587005123 conn(0x7f5cb00fb200 msgr2=0x7f5cb00fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:17.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.176+0000 7f5cb6578700 1 -- 172.21.15.83:0/1587005123 shutdown_connections 2024-04-01T06:55:17.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.176+0000 7f5cb6578700 1 -- 172.21.15.83:0/1587005123 wait complete. 2024-04-01T06:55:17.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.176+0000 7f5cb6578700 1 Processor -- start 2024-04-01T06:55:17.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.176+0000 7f5cb6578700 1 -- start start 2024-04-01T06:55:17.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.177+0000 7f5cb6578700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5cb00ffc70 0x7f5cb0069d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:17.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.177+0000 7f5cb6578700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5cb0100e60 0x7f5cb019ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:17.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.177+0000 7f5cb6578700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5cb0101800 0x7f5cb019e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:17.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.177+0000 7f5cb6578700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb019e840 con 0x7f5cb00ffc70 2024-04-01T06:55:17.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.177+0000 7f5cb6578700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb019e9b0 con 0x7f5cb0100e60 2024-04-01T06:55:17.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.177+0000 7f5cb6578700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb019eb70 con 0x7f5cb0101800 2024-04-01T06:55:17.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.177+0000 7f5caffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5cb00ffc70 0x7f5cb0069d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:17.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.177+0000 7f5caffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5cb00ffc70 0x7f5cb0069d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:41858/0 (socket says 172.21.15.83:41858) 2024-04-01T06:55:17.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.177+0000 7f5caffff700 1 -- 172.21.15.83:0/2100077502 learned_addr learned my addr 172.21.15.83:0/2100077502 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:17.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.177+0000 7f5caf7fe700 1 --2- 172.21.15.83:0/2100077502 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5cb0100e60 0x7f5cb019ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:17.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.177+0000 7f5cb4b15700 1 --2- 172.21.15.83:0/2100077502 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5cb0101800 0x7f5cb019e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:17.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.177+0000 7f5caffff700 1 -- 172.21.15.83:0/2100077502 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5cb0101800 msgr2=0x7f5cb019e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:17.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.177+0000 7f5caffff700 1 --2- 172.21.15.83:0/2100077502 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5cb0101800 0x7f5cb019e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.177+0000 7f5caffff700 1 -- 172.21.15.83:0/2100077502 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5cb0100e60 msgr2=0x7f5cb019ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:17.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.177+0000 7f5caffff700 1 --2- 172.21.15.83:0/2100077502 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5cb0100e60 0x7f5cb019ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.177+0000 7f5caffff700 1 -- 172.21.15.83:0/2100077502 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca00095f0 con 0x7f5cb00ffc70 2024-04-01T06:55:17.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.177+0000 7f5caffff700 1 --2- 172.21.15.83:0/2100077502 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5cb00ffc70 0x7f5cb0069d90 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5ca0003820 tx=0x7f5ca0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:17.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.177+0000 7f5cad7fa700 1 -- 172.21.15.83:0/2100077502 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca001d070 con 0x7f5cb00ffc70 2024-04-01T06:55:17.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.177+0000 7f5cb6578700 1 -- 172.21.15.83:0/2100077502 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cb019ed90 con 0x7f5cb00ffc70 2024-04-01T06:55:17.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.177+0000 7f5cad7fa700 1 -- 172.21.15.83:0/2100077502 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5ca00054f0 con 0x7f5cb00ffc70 2024-04-01T06:55:17.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.177+0000 7f5cad7fa700 1 -- 172.21.15.83:0/2100077502 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca0004a00 con 0x7f5cb00ffc70 2024-04-01T06:55:17.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.177+0000 7f5cb6578700 1 -- 172.21.15.83:0/2100077502 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cb019f1d0 con 0x7f5cb00ffc70 2024-04-01T06:55:17.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.179+0000 7f5cad7fa700 1 -- 172.21.15.83:0/2100077502 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f5ca0003b50 con 0x7f5cb00ffc70 2024-04-01T06:55:17.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.180+0000 7f5cad7fa700 1 --2- 172.21.15.83:0/2100077502 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f5c9c0a11b0 0x7f5c9c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:17.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.180+0000 7f5caf7fe700 1 --2- 172.21.15.83:0/2100077502 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f5c9c0a11b0 0x7f5c9c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:17.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.180+0000 7f5cad7fa700 1 -- 172.21.15.83:0/2100077502 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f5ca00cd710 con 0x7f5cb00ffc70 2024-04-01T06:55:17.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.180+0000 7f5caf7fe700 1 --2- 172.21.15.83:0/2100077502 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f5c9c0a11b0 0x7f5c9c0a3670 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5cb006a330 tx=0x7f5c9800a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:17.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.181+0000 7f5cc270eb80 1 Processor -- start 2024-04-01T06:55:17.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.181+0000 7f5cc270eb80 1 -- start start 2024-04-01T06:55:17.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.181+0000 7f5cc270eb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c49d051780 0x55c49d051ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:17.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.181+0000 7f5cc270eb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c49d0520e0 0x55c49d0529a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:17.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.181+0000 7f5cc270eb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c49d052f80 0x55c49d053400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:17.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.181+0000 7f5cc270eb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c49cfa9940 con 0x55c49d0520e0 2024-04-01T06:55:17.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.181+0000 7f5cc270eb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c49cfa7300 con 0x55c49d052f80 2024-04-01T06:55:17.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.181+0000 7f5cc270eb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c49cfa2bf0 con 0x55c49d051780 2024-04-01T06:55:17.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.181+0000 7f5caf7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c49d0520e0 0x55c49d0529a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:17.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.181+0000 7f5caf7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c49d0520e0 0x55c49d0529a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:41870/0 (socket says 172.21.15.83:41870) 2024-04-01T06:55:17.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.181+0000 7f5caf7fe700 1 -- 172.21.15.83:0/993098325 learned_addr learned my addr 172.21.15.83:0/993098325 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:17.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.181+0000 7f5caffff700 1 --2- 172.21.15.83:0/993098325 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c49d051780 0x55c49d051ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:17.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.181+0000 7f5cb4b15700 1 --2- 172.21.15.83:0/993098325 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c49d052f80 0x55c49d053400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:17.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.181+0000 7f5caf7fe700 1 -- 172.21.15.83:0/993098325 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c49d051780 msgr2=0x55c49d051ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:17.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.181+0000 7f5caf7fe700 1 --2- 172.21.15.83:0/993098325 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c49d051780 0x55c49d051ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.181+0000 7f5caf7fe700 1 -- 172.21.15.83:0/993098325 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c49d052f80 msgr2=0x55c49d053400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:17.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.181+0000 7f5caf7fe700 1 --2- 172.21.15.83:0/993098325 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c49d052f80 0x55c49d053400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.181+0000 7f5caf7fe700 1 -- 172.21.15.83:0/993098325 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c49ce24360 con 0x55c49d0520e0 2024-04-01T06:55:17.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.182+0000 7f5caf7fe700 1 --2- 172.21.15.83:0/993098325 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c49d0520e0 0x55c49d0529a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f5c9800fdb0 tx=0x7f5c98012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31af185cf6155825 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:17.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.182+0000 7f5ca67fc700 1 -- 172.21.15.83:0/993098325 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c980108c0 con 0x55c49d0520e0 2024-04-01T06:55:17.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.182+0000 7f5ca67fc700 1 -- 172.21.15.83:0/993098325 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5c98020070 con 0x55c49d0520e0 2024-04-01T06:55:17.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.182+0000 7f5ca67fc700 1 -- 172.21.15.83:0/993098325 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c98025e10 con 0x55c49d0520e0 2024-04-01T06:55:17.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.182+0000 7f5cc270eb80 1 -- 172.21.15.83:0/993098325 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c49d0520e0 msgr2=0x55c49d0529a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:17.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.182+0000 7f5cc270eb80 1 --2- 172.21.15.83:0/993098325 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c49d0520e0 0x55c49d0529a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f5c9800fdb0 tx=0x7f5c98012000 comp rx=0 tx=0).stop 2024-04-01T06:55:17.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.182+0000 7f5cc270eb80 1 -- 172.21.15.83:0/993098325 shutdown_connections 2024-04-01T06:55:17.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.182+0000 7f5cc270eb80 1 --2- 172.21.15.83:0/993098325 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c49d052f80 0x55c49d053400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.182+0000 7f5cc270eb80 1 --2- 172.21.15.83:0/993098325 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c49d051780 0x55c49d051ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.183+0000 7f5cc270eb80 1 --2- 172.21.15.83:0/993098325 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c49d0520e0 0x55c49d0529a0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.183+0000 7f5cc270eb80 1 -- 172.21.15.83:0/993098325 >> 172.21.15.83:0/993098325 conn(0x55c49cfb0650 msgr2=0x55c49d04c950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:17.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.183+0000 7f5cc270eb80 1 -- 172.21.15.83:0/993098325 shutdown_connections 2024-04-01T06:55:17.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.183+0000 7f5cc270eb80 1 -- 172.21.15.83:0/993098325 wait complete. 2024-04-01T06:55:17.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.183+0000 7f5cc270eb80 1 -- start start 2024-04-01T06:55:17.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.183+0000 7f5cc270eb80 1 Processor -- start 2024-04-01T06:55:17.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.183+0000 7f5cc270eb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c49d051780 0x55c49d05b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:17.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.183+0000 7f5cc270eb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c49d0520e0 0x55c49d05bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:17.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.183+0000 7f5cc270eb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c49d052f80 0x55c49d062c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:17.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.183+0000 7f5cc270eb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c49cf3ed30 con 0x55c49d052f80 2024-04-01T06:55:17.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.183+0000 7f5cc270eb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c49cf3e9d0 con 0x55c49d0520e0 2024-04-01T06:55:17.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.183+0000 7f5cc270eb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c49ce26650 con 0x55c49d051780 2024-04-01T06:55:17.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.183+0000 7f5cc270eb80 10 client.0 _ll_register_callbacks cb 0x55c49cf48420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:55:17.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.183+0000 7f5cb4b15700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c49d052f80 0x55c49d062c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:17.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.183+0000 7f5cb4b15700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c49d052f80 0x55c49d062c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:41872/0 (socket says 172.21.15.83:41872) 2024-04-01T06:55:17.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.183+0000 7f5cb4b15700 1 -- 172.21.15.83:0/2838462666 learned_addr learned my addr 172.21.15.83:0/2838462666 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:17.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.183+0000 7f5caf7fe700 1 --2- 172.21.15.83:0/2838462666 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c49d0520e0 0x55c49d05bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:17.195 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.184+0000 7f5caffff700 1 --2- 172.21.15.83:0/2838462666 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c49d051780 0x55c49d05b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:17.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.184+0000 7f5cb4b15700 1 -- 172.21.15.83:0/2838462666 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c49d051780 msgr2=0x55c49d05b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:17.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.184+0000 7f5cb4b15700 1 --2- 172.21.15.83:0/2838462666 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c49d051780 0x55c49d05b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.184+0000 7f5cb4b15700 1 -- 172.21.15.83:0/2838462666 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c49d0520e0 msgr2=0x55c49d05bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:17.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.184+0000 7f5cb4b15700 1 --2- 172.21.15.83:0/2838462666 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c49d0520e0 0x55c49d05bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.184+0000 7f5cb4b15700 1 -- 172.21.15.83:0/2838462666 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c9800fa60 con 0x55c49d052f80 2024-04-01T06:55:17.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.184+0000 7f5cb4b15700 1 --2- 172.21.15.83:0/2838462666 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c49d052f80 0x55c49d062c10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5ca8007b70 tx=0x7f5ca8007e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f2de8d12168f31b server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:17.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.184+0000 7f5c8f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:55:17.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.184+0000 7f5c8f7fe700 1 -- 172.21.15.83:0/2838462666 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca80118d0 con 0x55c49d052f80 2024-04-01T06:55:17.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.184+0000 7f5c8f7fe700 1 -- 172.21.15.83:0/2838462666 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f5ca8011a30 con 0x55c49d052f80 2024-04-01T06:55:17.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.184+0000 7f5cc270eb80 1 -- 172.21.15.83:0/2838462666 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c49cf63330 con 0x55c49d052f80 2024-04-01T06:55:17.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.184+0000 7f5c8f7fe700 1 -- 172.21.15.83:0/2838462666 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5ca8011bf0 con 0x55c49d052f80 2024-04-01T06:55:17.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.184+0000 7f5cc270eb80 10 client.15072 fetch_fsmap learned FSMap version 23 2024-04-01T06:55:17.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.184+0000 7f5cc270eb80 1 -- 172.21.15.83:0/2838462666 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55c49cdd0b10 con 0x55c49d052f80 2024-04-01T06:55:17.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.184+0000 7f5c8f7fe700 1 -- 172.21.15.83:0/2838462666 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c49cf63330 con 0x55c49d052f80 2024-04-01T06:55:17.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.185+0000 7f5c8f7fe700 1 -- 172.21.15.83:0/2838462666 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 23) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f5ca8014070 con 0x55c49d052f80 2024-04-01T06:55:17.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.185+0000 7f5cc270eb80 10 client.15072 fetch_fsmap finished waiting for FSMap version 23 2024-04-01T06:55:17.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.185+0000 7f5cc270eb80 10 client.15072 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-01T06:55:17.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.185+0000 7f5cc270eb80 20 client.15072 populate_metadata read hostname 'smithi083' 2024-04-01T06:55:17.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.185+0000 7f5cc270eb80 1 --2- 172.21.15.83:0/2838462666 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55c49d065e10 0x55c49d06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:17.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.185+0000 7f5cc270eb80 4 client.15072 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-01T06:55:17.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.185+0000 7f5cc270eb80 1 -- 172.21.15.83:0/2838462666 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c49cf9b6b0 con 0x55c49d065e10 2024-04-01T06:55:17.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.185+0000 7f5caffff700 1 --2- 172.21.15.83:0/2838462666 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55c49d065e10 0x55c49d06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:17.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.185+0000 7f5caffff700 1 --2- 172.21.15.83:0/2838462666 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55c49d065e10 0x55c49d06bc10 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4377408986829ef server_cookie=e34b10859d2ad25f in_seq=0 out_seq=0 2024-04-01T06:55:17.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.185+0000 7f5c8f7fe700 10 client.15072 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:55:17.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.186+0000 7f5c8f7fe700 1 -- 172.21.15.83:0/2838462666 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c49cf9b6b0 con 0x55c49d065e10 2024-04-01T06:55:17.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.186+0000 7f5c8f7fe700 10 client.15072 handle_command_reply: tid=0 2024-04-01T06:55:17.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.186+0000 7f5cc270eb80 1 client.15072 shutdown 2024-04-01T06:55:17.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.186+0000 7f5cc270eb80 1 -- 172.21.15.83:0/2838462666 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c49d052f80 msgr2=0x55c49d062c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:17.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.186+0000 7f5cc270eb80 1 --2- 172.21.15.83:0/2838462666 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c49d052f80 0x55c49d062c10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5ca8007b70 tx=0x7f5ca8007e80 comp rx=0 tx=0).stop 2024-04-01T06:55:17.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.186+0000 7f5cc270eb80 1 -- 172.21.15.83:0/2838462666 shutdown_connections 2024-04-01T06:55:17.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.186+0000 7f5cc270eb80 1 --2- 172.21.15.83:0/2838462666 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55c49d065e10 0x55c49d06bc10 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.186+0000 7f5cc270eb80 1 --2- 172.21.15.83:0/2838462666 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c49d052f80 0x55c49d062c10 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.186+0000 7f5c8f7fe700 0 client.15072 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:55:17.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.186+0000 7f5cc270eb80 1 --2- 172.21.15.83:0/2838462666 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c49d051780 0x55c49d05b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.186+0000 7f5cc270eb80 1 --2- 172.21.15.83:0/2838462666 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c49d0520e0 0x55c49d05bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.186+0000 7f5cc270eb80 1 -- 172.21.15.83:0/2838462666 >> 172.21.15.83:0/2838462666 conn(0x55c49cfb0650 msgr2=0x55c49d050120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:17.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.186+0000 7f5cc270eb80 1 -- 172.21.15.83:0/2838462666 shutdown_connections 2024-04-01T06:55:17.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.186+0000 7f5cc270eb80 1 -- 172.21.15.83:0/2838462666 wait complete. 2024-04-01T06:55:17.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.186+0000 7f5cc270eb80 20 client.15072 trim_cache size 0 max 16384 2024-04-01T06:55:17.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.204+0000 7f5cc270eb80 1 Processor -- start 2024-04-01T06:55:17.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.204+0000 7f5cc270eb80 1 -- start start 2024-04-01T06:55:17.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.204+0000 7f5cc270eb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c49d051780 0x55c49d051b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:17.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.204+0000 7f5cc270eb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c49d0520e0 0x55c49d05aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:17.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.204+0000 7f5cc270eb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c49d052f80 0x55c49d053360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:17.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.204+0000 7f5cc270eb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c49cf9b6b0 con 0x55c49d051780 2024-04-01T06:55:17.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.204+0000 7f5cc270eb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c49cf63330 con 0x55c49d0520e0 2024-04-01T06:55:17.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.204+0000 7f5cc270eb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c49cf60ad0 con 0x55c49d052f80 2024-04-01T06:55:17.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.204+0000 7f5caffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c49d051780 0x55c49d051b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:17.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.204+0000 7f5caffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c49d051780 0x55c49d051b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:41874/0 (socket says 172.21.15.83:41874) 2024-04-01T06:55:17.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.204+0000 7f5caffff700 1 -- 172.21.15.83:0/3753524515 learned_addr learned my addr 172.21.15.83:0/3753524515 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:17.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.204+0000 7f5caf7fe700 1 --2- 172.21.15.83:0/3753524515 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c49d0520e0 0x55c49d05aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:17.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.204+0000 7f5caffff700 1 -- 172.21.15.83:0/3753524515 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c49d052f80 msgr2=0x55c49d053360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:17.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.204+0000 7f5caffff700 1 --2- 172.21.15.83:0/3753524515 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c49d052f80 0x55c49d053360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.204+0000 7f5caffff700 1 -- 172.21.15.83:0/3753524515 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c49d0520e0 msgr2=0x55c49d05aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:17.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.204+0000 7f5caffff700 1 --2- 172.21.15.83:0/3753524515 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c49d0520e0 0x55c49d05aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.204+0000 7f5caffff700 1 -- 172.21.15.83:0/3753524515 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c49cf68e50 con 0x55c49d051780 2024-04-01T06:55:17.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.205+0000 7f5caffff700 1 --2- 172.21.15.83:0/3753524515 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c49d051780 0x55c49d051b60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5ca00976b0 tx=0x7f5ca0009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b944ac32b1faaaf9 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:17.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.205+0000 7f5ca6ffd700 1 -- 172.21.15.83:0/3753524515 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca009ac40 con 0x55c49d051780 2024-04-01T06:55:17.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.205+0000 7f5ca6ffd700 1 -- 172.21.15.83:0/3753524515 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5ca009ea70 con 0x55c49d051780 2024-04-01T06:55:17.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.205+0000 7f5ca6ffd700 1 -- 172.21.15.83:0/3753524515 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca00a2ba0 con 0x55c49d051780 2024-04-01T06:55:17.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.205+0000 7f5cc270eb80 1 -- 172.21.15.83:0/3753524515 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c49d051780 msgr2=0x55c49d051b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:17.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.205+0000 7f5cc270eb80 1 --2- 172.21.15.83:0/3753524515 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c49d051780 0x55c49d051b60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5ca00976b0 tx=0x7f5ca0009310 comp rx=0 tx=0).stop 2024-04-01T06:55:17.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.205+0000 7f5cc270eb80 1 -- 172.21.15.83:0/3753524515 shutdown_connections 2024-04-01T06:55:17.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.205+0000 7f5cc270eb80 1 --2- 172.21.15.83:0/3753524515 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c49d051780 0x55c49d051b60 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.205+0000 7f5cc270eb80 1 --2- 172.21.15.83:0/3753524515 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c49d052f80 0x55c49d053360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.205+0000 7f5cc270eb80 1 --2- 172.21.15.83:0/3753524515 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c49d0520e0 0x55c49d05aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.205+0000 7f5cc270eb80 1 -- 172.21.15.83:0/3753524515 >> 172.21.15.83:0/3753524515 conn(0x55c49cfb0650 msgr2=0x55c49d059530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:17.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.205+0000 7f5cc270eb80 1 -- 172.21.15.83:0/3753524515 shutdown_connections 2024-04-01T06:55:17.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.205+0000 7f5cc270eb80 1 -- 172.21.15.83:0/3753524515 wait complete. 2024-04-01T06:55:17.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.206+0000 7f5cc270eb80 1 -- start start 2024-04-01T06:55:17.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.206+0000 7f5cc270eb80 1 Processor -- start 2024-04-01T06:55:17.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.206+0000 7f5cc270eb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c49d051780 0x55c49d05f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:17.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.206+0000 7f5cc270eb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c49d0520e0 0x55c49d05fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:17.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.206+0000 7f5cc270eb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c49d052f80 0x55c49d0bb200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:17.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.206+0000 7f5cc270eb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c49d062da0 con 0x55c49d052f80 2024-04-01T06:55:17.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.206+0000 7f5cc270eb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c49d062f10 con 0x55c49d051780 2024-04-01T06:55:17.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.206+0000 7f5cc270eb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c49d0630d0 con 0x55c49d0520e0 2024-04-01T06:55:17.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.206+0000 7f5cc270eb80 10 client.0 _ll_register_callbacks cb 0x55c49cf48420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:55:17.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.206+0000 7f5cb4b15700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c49d052f80 0x55c49d0bb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:17.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.206+0000 7f5cb4b15700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c49d052f80 0x55c49d0bb200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:41890/0 (socket says 172.21.15.83:41890) 2024-04-01T06:55:17.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.206+0000 7f5cb4b15700 1 -- 172.21.15.83:0/979825848 learned_addr learned my addr 172.21.15.83:0/979825848 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:17.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.206+0000 7f5caf7fe700 1 --2- 172.21.15.83:0/979825848 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c49d0520e0 0x55c49d05fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:17.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.206+0000 7f5caffff700 1 --2- 172.21.15.83:0/979825848 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c49d051780 0x55c49d05f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:17.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.206+0000 7f5cb4b15700 1 -- 172.21.15.83:0/979825848 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c49d0520e0 msgr2=0x55c49d05fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:17.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.206+0000 7f5cb4b15700 1 --2- 172.21.15.83:0/979825848 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c49d0520e0 0x55c49d05fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.206+0000 7f5cb4b15700 1 -- 172.21.15.83:0/979825848 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c49d051780 msgr2=0x55c49d05f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:17.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.206+0000 7f5cb4b15700 1 --2- 172.21.15.83:0/979825848 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c49d051780 0x55c49d05f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.206+0000 7f5cb4b15700 1 -- 172.21.15.83:0/979825848 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cb019f1d0 con 0x55c49d052f80 2024-04-01T06:55:17.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.206+0000 7f5caffff700 1 --2- 172.21.15.83:0/979825848 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c49d051780 0x55c49d05f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:55:17.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.206+0000 7f5cb4b15700 1 --2- 172.21.15.83:0/979825848 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c49d052f80 0x55c49d0bb200 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5ca8006130 tx=0x7f5ca8015eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c9da699f1d35585 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:17.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.206+0000 7f5c8f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:55:17.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.207+0000 7f5c8f7fe700 1 -- 172.21.15.83:0/979825848 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca8004c70 con 0x55c49d052f80 2024-04-01T06:55:17.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.207+0000 7f5c8f7fe700 1 -- 172.21.15.83:0/979825848 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f5ca80155a0 con 0x55c49d052f80 2024-04-01T06:55:17.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.207+0000 7f5cc270eb80 1 -- 172.21.15.83:0/979825848 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5c98020070 con 0x55c49d052f80 2024-04-01T06:55:17.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.207+0000 7f5c8f7fe700 1 -- 172.21.15.83:0/979825848 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5ca8004dd0 con 0x55c49d052f80 2024-04-01T06:55:17.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.207+0000 7f5cc270eb80 10 client.15078 fetch_fsmap learned FSMap version 23 2024-04-01T06:55:17.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.207+0000 7f5cc270eb80 1 -- 172.21.15.83:0/979825848 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55c49ce28c80 con 0x55c49d052f80 2024-04-01T06:55:17.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.207+0000 7f5c8f7fe700 1 -- 172.21.15.83:0/979825848 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5c98020070 con 0x55c49d052f80 2024-04-01T06:55:17.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.207+0000 7f5c8f7fe700 1 -- 172.21.15.83:0/979825848 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 23) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f5ca8014070 con 0x55c49d052f80 2024-04-01T06:55:17.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.207+0000 7f5cc270eb80 10 client.15078 fetch_fsmap finished waiting for FSMap version 23 2024-04-01T06:55:17.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.207+0000 7f5cc270eb80 10 client.15078 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-01T06:55:17.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.207+0000 7f5cc270eb80 20 client.15078 populate_metadata read hostname 'smithi083' 2024-04-01T06:55:17.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.207+0000 7f5cc270eb80 1 --2- 172.21.15.83:0/979825848 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55c49d0c0400 0x55c49d0bcd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:17.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.207+0000 7f5cc270eb80 4 client.15078 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-01T06:55:17.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.207+0000 7f5cc270eb80 1 -- 172.21.15.83:0/979825848 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c49cdf1ca0 con 0x55c49d0c0400 2024-04-01T06:55:17.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.207+0000 7f5caffff700 1 --2- 172.21.15.83:0/979825848 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55c49d0c0400 0x55c49d0bcd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:17.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.208+0000 7f5c8f7fe700 10 client.15078 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:55:17.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.208+0000 7f5caffff700 1 --2- 172.21.15.83:0/979825848 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55c49d0c0400 0x55c49d0bcd70 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e136364b5777cbd3 server_cookie=b8d9de76ebd3fe33 in_seq=0 out_seq=0 2024-04-01T06:55:17.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.208+0000 7f5c8f7fe700 1 -- 172.21.15.83:0/979825848 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55c49cdf1ca0 con 0x55c49d0c0400 2024-04-01T06:55:17.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.208+0000 7f5c8f7fe700 10 client.15078 handle_command_reply: tid=0 2024-04-01T06:55:17.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.208+0000 7f5cc270eb80 1 client.15078 shutdown 2024-04-01T06:55:17.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.208+0000 7f5cc270eb80 1 -- 172.21.15.83:0/979825848 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c49d052f80 msgr2=0x55c49d0bb200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:17.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.208+0000 7f5cc270eb80 1 --2- 172.21.15.83:0/979825848 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c49d052f80 0x55c49d0bb200 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5ca8006130 tx=0x7f5ca8015eb0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.208+0000 7f5cc270eb80 1 -- 172.21.15.83:0/979825848 shutdown_connections 2024-04-01T06:55:17.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.208+0000 7f5cc270eb80 1 --2- 172.21.15.83:0/979825848 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55c49d0c0400 0x55c49d0bcd70 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.208+0000 7f5cc270eb80 1 --2- 172.21.15.83:0/979825848 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c49d052f80 0x55c49d0bb200 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.208+0000 7f5c8f7fe700 0 client.15078 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:55:17.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.208+0000 7f5cc270eb80 1 --2- 172.21.15.83:0/979825848 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c49d051780 0x55c49d05f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.208+0000 7f5cc270eb80 1 --2- 172.21.15.83:0/979825848 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c49d0520e0 0x55c49d05fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.208+0000 7f5cc270eb80 1 -- 172.21.15.83:0/979825848 >> 172.21.15.83:0/979825848 conn(0x55c49cfb0650 msgr2=0x55c49d06fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:17.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.208+0000 7f5cc270eb80 1 -- 172.21.15.83:0/979825848 shutdown_connections 2024-04-01T06:55:17.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.208+0000 7f5cc270eb80 1 -- 172.21.15.83:0/979825848 wait complete. 2024-04-01T06:55:17.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.208+0000 7f5cc270eb80 20 client.15078 trim_cache size 0 max 16384 2024-04-01T06:55:17.219 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-04-01T06:55:17.219 INFO:teuthology.orchestra.run.smithi083.stdout: "cluster_fsid": "c6f8eff4-eff3-11ee-b647-cb9ed24678a4", 2024-04-01T06:55:17.219 INFO:teuthology.orchestra.run.smithi083.stdout: "whoami": 0, 2024-04-01T06:55:17.219 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 24524, 2024-04-01T06:55:17.219 INFO:teuthology.orchestra.run.smithi083.stdout: "want_state": "up:active", 2024-04-01T06:55:17.220 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "up:active", 2024-04-01T06:55:17.220 INFO:teuthology.orchestra.run.smithi083.stdout: "fs_name": "cephfs", 2024-04-01T06:55:17.220 INFO:teuthology.orchestra.run.smithi083.stdout: "rank_uptime": 48.808990274999999, 2024-04-01T06:55:17.220 INFO:teuthology.orchestra.run.smithi083.stdout: "mdsmap_epoch": 23, 2024-04-01T06:55:17.220 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_epoch": 79, 2024-04-01T06:55:17.220 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_epoch_barrier": 79, 2024-04-01T06:55:17.220 INFO:teuthology.orchestra.run.smithi083.stdout: "uptime": 54.918994451000003 2024-04-01T06:55:17.220 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-04-01T06:55:17.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.209+0000 7f5cb6578700 1 -- 172.21.15.83:0/2100077502 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f5c9c0a11b0 msgr2=0x7f5c9c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:17.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.209+0000 7f5cb6578700 1 --2- 172.21.15.83:0/2100077502 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f5c9c0a11b0 0x7f5c9c0a3670 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5cb006a330 tx=0x7f5c9800a300 comp rx=0 tx=0).stop 2024-04-01T06:55:17.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.209+0000 7f5cb6578700 1 -- 172.21.15.83:0/2100077502 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5cb00ffc70 msgr2=0x7f5cb0069d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:17.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.209+0000 7f5cb6578700 1 --2- 172.21.15.83:0/2100077502 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5cb00ffc70 0x7f5cb0069d90 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5ca0003820 tx=0x7f5ca0004730 comp rx=0 tx=0).stop 2024-04-01T06:55:17.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.209+0000 7f5cb6578700 1 -- 172.21.15.83:0/2100077502 shutdown_connections 2024-04-01T06:55:17.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.209+0000 7f5cb6578700 1 --2- 172.21.15.83:0/2100077502 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5cb00ffc70 0x7f5cb0069d90 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.209+0000 7f5cb6578700 1 --2- 172.21.15.83:0/2100077502 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f5c9c0a11b0 0x7f5c9c0a3670 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.209+0000 7f5cb6578700 1 --2- 172.21.15.83:0/2100077502 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5cb0101800 0x7f5cb019e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.209+0000 7f5cb6578700 1 --2- 172.21.15.83:0/2100077502 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5cb0100e60 0x7f5cb019ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:17.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.209+0000 7f5cb6578700 1 -- 172.21.15.83:0/2100077502 >> 172.21.15.83:0/2100077502 conn(0x7f5cb00fb200 msgr2=0x7f5cb0104280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:17.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.209+0000 7f5cb6578700 1 -- 172.21.15.83:0/2100077502 shutdown_connections 2024-04-01T06:55:17.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:17.209+0000 7f5cb6578700 1 -- 172.21.15.83:0/2100077502 wait complete. 2024-04-01T06:55:17.223 INFO:tasks.cephadm:Setup complete, yielding 2024-04-01T06:55:17.223 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-01T06:55:17.233 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi083.front.sepia.ceph.com 2024-04-01T06:55:17.234 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- bash -c 'ceph orch status' 2024-04-01T06:55:17.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:16 smithi145 ceph-mon[47816]: pgmap v240: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-01T06:55:17.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:16 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/3533488619' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:55:17.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:16 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/3045142535' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T06:55:17.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:16 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/3413748311' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:55:17.453 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:55:18.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:18.336+0000 7f652bd32700 1 -- 172.21.15.83:0/4281861546 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6524102920 msgr2=0x7f6524109240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:18.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:18.336+0000 7f652bd32700 1 --2- 172.21.15.83:0/4281861546 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6524102920 0x7f6524109240 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f651c00b0a0 tx=0x7f651c00b3b0 comp rx=0 tx=0).stop 2024-04-01T06:55:18.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:18.337+0000 7f652bd32700 1 -- 172.21.15.83:0/4281861546 shutdown_connections 2024-04-01T06:55:18.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:18.337+0000 7f652bd32700 1 --2- 172.21.15.83:0/4281861546 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6524102920 0x7f6524109240 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:18.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:18.337+0000 7f652bd32700 1 --2- 172.21.15.83:0/4281861546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6524100e00 0x7f6524101220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:18.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:18.337+0000 7f652bd32700 1 --2- 172.21.15.83:0/4281861546 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6524101f60 0x7f65241023e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:18.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:18.337+0000 7f652bd32700 1 -- 172.21.15.83:0/4281861546 >> 172.21.15.83:0/4281861546 conn(0x7f65240fc3c0 msgr2=0x7f65240fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:18.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:18.337+0000 7f652bd32700 1 -- 172.21.15.83:0/4281861546 shutdown_connections 2024-04-01T06:55:18.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:18.337+0000 7f652bd32700 1 -- 172.21.15.83:0/4281861546 wait complete. 2024-04-01T06:55:18.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:18.337+0000 7f652bd32700 1 Processor -- start 2024-04-01T06:55:18.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:18.337+0000 7f652bd32700 1 -- start start 2024-04-01T06:55:18.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:18.337+0000 7f652bd32700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6524100e00 0x7f6524196e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:18.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:18.337+0000 7f652bd32700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6524101f60 0x7f6524197370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:18.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:18.337+0000 7f652bd32700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6524102920 0x7f652419e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:18.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:18.337+0000 7f652bd32700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f652419e970 con 0x7f6524102920 2024-04-01T06:55:18.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:18.337+0000 7f652bd32700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f652419eab0 con 0x7f6524101f60 2024-04-01T06:55:18.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:18.337+0000 7f652bd32700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f652419ec40 con 0x7f6524100e00 2024-04-01T06:55:18.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:18.338+0000 7f652a2cf700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6524102920 0x7f652419e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:18.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:18.338+0000 7f652a2cf700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6524102920 0x7f652419e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:41908/0 (socket says 172.21.15.83:41908) 2024-04-01T06:55:18.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:18.338+0000 7f652a2cf700 1 -- 172.21.15.83:0/2179718478 learned_addr learned my addr 172.21.15.83:0/2179718478 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:18.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:18.338+0000 7f6529ace700 1 --2- 172.21.15.83:0/2179718478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6524100e00 0x7f6524196e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:18.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:18.338+0000 7f65292cd700 1 --2- 172.21.15.83:0/2179718478 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6524101f60 0x7f6524197370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:18.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:18.338+0000 7f652a2cf700 1 -- 172.21.15.83:0/2179718478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6524100e00 msgr2=0x7f6524196e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:18.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:18.338+0000 7f652a2cf700 1 --2- 172.21.15.83:0/2179718478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6524100e00 0x7f6524196e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:18.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:18.338+0000 7f652a2cf700 1 -- 172.21.15.83:0/2179718478 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6524101f60 msgr2=0x7f6524197370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:18.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:18.338+0000 7f652a2cf700 1 --2- 172.21.15.83:0/2179718478 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6524101f60 0x7f6524197370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:18.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:18.338+0000 7f652a2cf700 1 -- 172.21.15.83:0/2179718478 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f651c009d00 con 0x7f6524102920 2024-04-01T06:55:18.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:18.338+0000 7f65292cd700 1 --2- 172.21.15.83:0/2179718478 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6524101f60 0x7f6524197370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:55:18.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:18.338+0000 7f652a2cf700 1 --2- 172.21.15.83:0/2179718478 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6524102920 0x7f652419e3a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f651c007a60 tx=0x7f651c004d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:18.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:18.338+0000 7f651affd700 1 -- 172.21.15.83:0/2179718478 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f651c00e040 con 0x7f6524102920 2024-04-01T06:55:18.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:18.338+0000 7f651affd700 1 -- 172.21.15.83:0/2179718478 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f651c009440 con 0x7f6524102920 2024-04-01T06:55:18.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:18.338+0000 7f651affd700 1 -- 172.21.15.83:0/2179718478 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f651c0042a0 con 0x7f6524102920 2024-04-01T06:55:18.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:18.338+0000 7f652bd32700 1 -- 172.21.15.83:0/2179718478 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f652419eec0 con 0x7f6524102920 2024-04-01T06:55:18.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:18.338+0000 7f652bd32700 1 -- 172.21.15.83:0/2179718478 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f652419f280 con 0x7f6524102920 2024-04-01T06:55:18.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:18.339+0000 7f652bd32700 1 -- 172.21.15.83:0/2179718478 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6524108230 con 0x7f6524102920 2024-04-01T06:55:18.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:18.340+0000 7f651affd700 1 -- 172.21.15.83:0/2179718478 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f651c01d790 con 0x7f6524102920 2024-04-01T06:55:18.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:18.341+0000 7f651affd700 1 --2- 172.21.15.83:0/2179718478 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f65100a11b0 0x7f65100a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:18.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:18.341+0000 7f6529ace700 1 --2- 172.21.15.83:0/2179718478 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f65100a11b0 0x7f65100a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:18.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:18.341+0000 7f651affd700 1 -- 172.21.15.83:0/2179718478 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f651c0ce550 con 0x7f6524102920 2024-04-01T06:55:18.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:18.342+0000 7f6529ace700 1 --2- 172.21.15.83:0/2179718478 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f65100a11b0 0x7f65100a3670 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6520005950 tx=0x7f65200058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:18.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:18.345+0000 7f651affd700 1 -- 172.21.15.83:0/2179718478 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f651c097dc0 con 0x7f6524102920 2024-04-01T06:55:18.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:18.556+0000 7f652bd32700 1 -- 172.21.15.83:0/2179718478 --> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f652402cdc0 con 0x7f65100a11b0 2024-04-01T06:55:18.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:18.557+0000 7f651affd700 1 -- 172.21.15.83:0/2179718478 <== mgr.14152 v2:172.21.15.83:6800/3375372052 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f652402cdc0 con 0x7f65100a11b0 2024-04-01T06:55:18.557 INFO:teuthology.orchestra.run.smithi083.stdout:Backend: cephadm 2024-04-01T06:55:18.557 INFO:teuthology.orchestra.run.smithi083.stdout:Available: Yes 2024-04-01T06:55:18.557 INFO:teuthology.orchestra.run.smithi083.stdout:Paused: No 2024-04-01T06:55:18.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:18.559+0000 7f652bd32700 1 -- 172.21.15.83:0/2179718478 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f65100a11b0 msgr2=0x7f65100a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:18.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:18.559+0000 7f652bd32700 1 --2- 172.21.15.83:0/2179718478 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f65100a11b0 0x7f65100a3670 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6520005950 tx=0x7f65200058e0 comp rx=0 tx=0).stop 2024-04-01T06:55:18.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:18.559+0000 7f652bd32700 1 -- 172.21.15.83:0/2179718478 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6524102920 msgr2=0x7f652419e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:18.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:18.559+0000 7f652bd32700 1 --2- 172.21.15.83:0/2179718478 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6524102920 0x7f652419e3a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f651c007a60 tx=0x7f651c004d30 comp rx=0 tx=0).stop 2024-04-01T06:55:18.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:18.559+0000 7f652bd32700 1 -- 172.21.15.83:0/2179718478 shutdown_connections 2024-04-01T06:55:18.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:18.559+0000 7f652bd32700 1 --2- 172.21.15.83:0/2179718478 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6524102920 0x7f652419e3a0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:18.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:18.559+0000 7f652bd32700 1 --2- 172.21.15.83:0/2179718478 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f65100a11b0 0x7f65100a3670 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:18.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:18.559+0000 7f652bd32700 1 --2- 172.21.15.83:0/2179718478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6524100e00 0x7f6524196e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:18.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:18.559+0000 7f652bd32700 1 --2- 172.21.15.83:0/2179718478 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6524101f60 0x7f6524197370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:18.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:18.559+0000 7f652bd32700 1 -- 172.21.15.83:0/2179718478 >> 172.21.15.83:0/2179718478 conn(0x7f65240fc3c0 msgr2=0x7f6524105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:18.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:18.559+0000 7f652bd32700 1 -- 172.21.15.83:0/2179718478 shutdown_connections 2024-04-01T06:55:18.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:18.559+0000 7f652bd32700 1 -- 172.21.15.83:0/2179718478 wait complete. 2024-04-01T06:55:18.879 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:18 smithi083 ceph-mon[43429]: pgmap v241: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-01T06:55:18.940 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- bash -c 'ceph orch ps' 2024-04-01T06:55:19.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:18 smithi153 ceph-mon[48187]: pgmap v241: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-01T06:55:19.161 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:55:19.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:18 smithi145 ceph-mon[47816]: pgmap v241: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-01T06:55:19.960 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:19 smithi083 ceph-mon[43429]: from='client.15084 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:55:20.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:19 smithi153 ceph-mon[48187]: from='client.15084 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:55:20.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:20.153+0000 7fd8ec9f1700 1 -- 172.21.15.83:0/2211820724 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8e8100e00 msgr2=0x7fd8e8101220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:20.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:20.153+0000 7fd8ec9f1700 1 --2- 172.21.15.83:0/2211820724 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8e8100e00 0x7fd8e8101220 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc009990 tx=0x7fd8dc009ca0 comp rx=0 tx=0).stop 2024-04-01T06:55:20.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:20.153+0000 7fd8ec9f1700 1 -- 172.21.15.83:0/2211820724 shutdown_connections 2024-04-01T06:55:20.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:20.153+0000 7fd8ec9f1700 1 --2- 172.21.15.83:0/2211820724 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8e8100e00 0x7fd8e8101220 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:20.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:20.153+0000 7fd8ec9f1700 1 --2- 172.21.15.83:0/2211820724 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd8e8102920 0x7fd8e8109240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:20.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:20.153+0000 7fd8ec9f1700 1 --2- 172.21.15.83:0/2211820724 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8e8101f60 0x7fd8e81023e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:20.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:20.153+0000 7fd8ec9f1700 1 -- 172.21.15.83:0/2211820724 >> 172.21.15.83:0/2211820724 conn(0x7fd8e80fc3c0 msgr2=0x7fd8e80fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:20.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:20.153+0000 7fd8ec9f1700 1 -- 172.21.15.83:0/2211820724 shutdown_connections 2024-04-01T06:55:20.153 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:20.153+0000 7fd8ec9f1700 1 -- 172.21.15.83:0/2211820724 wait complete. 2024-04-01T06:55:20.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:20.154+0000 7fd8ec9f1700 1 Processor -- start 2024-04-01T06:55:20.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:20.154+0000 7fd8ec9f1700 1 -- start start 2024-04-01T06:55:20.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:20.154+0000 7fd8ec9f1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8e8100e00 0x7fd8e8198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:20.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:20.154+0000 7fd8ec9f1700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd8e8101f60 0x7fd8e81993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:20.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:20.154+0000 7fd8ec9f1700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8e8102920 0x7fd8e81a03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:20.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:20.154+0000 7fd8ec9f1700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e81a09a0 con 0x7fd8e8102920 2024-04-01T06:55:20.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:20.154+0000 7fd8ec9f1700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e81a0ae0 con 0x7fd8e8101f60 2024-04-01T06:55:20.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:20.154+0000 7fd8ec9f1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e81a0c70 con 0x7fd8e8100e00 2024-04-01T06:55:20.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:20.154+0000 7fd8e6d9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8e8102920 0x7fd8e81a03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:20.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:20.154+0000 7fd8e6d9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8e8102920 0x7fd8e81a03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:41932/0 (socket says 172.21.15.83:41932) 2024-04-01T06:55:20.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:20.154+0000 7fd8e6d9d700 1 -- 172.21.15.83:0/3833162656 learned_addr learned my addr 172.21.15.83:0/3833162656 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:20.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:20.154+0000 7fd8e659c700 1 --2- 172.21.15.83:0/3833162656 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8e8100e00 0x7fd8e8198e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:20.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:20.154+0000 7fd8e5d9b700 1 --2- 172.21.15.83:0/3833162656 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd8e8101f60 0x7fd8e81993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:20.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:20.154+0000 7fd8e6d9d700 1 -- 172.21.15.83:0/3833162656 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8e8100e00 msgr2=0x7fd8e8198e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:20.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:20.154+0000 7fd8e6d9d700 1 --2- 172.21.15.83:0/3833162656 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8e8100e00 0x7fd8e8198e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:20.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:20.154+0000 7fd8e6d9d700 1 -- 172.21.15.83:0/3833162656 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd8e8101f60 msgr2=0x7fd8e81993a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:20.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:20.154+0000 7fd8e6d9d700 1 --2- 172.21.15.83:0/3833162656 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd8e8101f60 0x7fd8e81993a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:20.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:20.154+0000 7fd8e6d9d700 1 -- 172.21.15.83:0/3833162656 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8dc0095f0 con 0x7fd8e8102920 2024-04-01T06:55:20.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:20.154+0000 7fd8e5d9b700 1 --2- 172.21.15.83:0/3833162656 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd8e8101f60 0x7fd8e81993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:55:20.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:20.154+0000 7fd8e6d9d700 1 --2- 172.21.15.83:0/3833162656 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8e8102920 0x7fd8e81a03d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd8e000add0 tx=0x7fd8e000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:20.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:20.155+0000 7fd8d77fe700 1 -- 172.21.15.83:0/3833162656 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e000f070 con 0x7fd8e8102920 2024-04-01T06:55:20.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:20.155+0000 7fd8ec9f1700 1 -- 172.21.15.83:0/3833162656 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8e81a0f50 con 0x7fd8e8102920 2024-04-01T06:55:20.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:20.155+0000 7fd8d77fe700 1 -- 172.21.15.83:0/3833162656 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd8e0007b30 con 0x7fd8e8102920 2024-04-01T06:55:20.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:20.155+0000 7fd8d77fe700 1 -- 172.21.15.83:0/3833162656 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e0005310 con 0x7fd8e8102920 2024-04-01T06:55:20.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:20.155+0000 7fd8ec9f1700 1 -- 172.21.15.83:0/3833162656 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8e81a13c0 con 0x7fd8e8102920 2024-04-01T06:55:20.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:20.155+0000 7fd8ec9f1700 1 -- 172.21.15.83:0/3833162656 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8e804ea80 con 0x7fd8e8102920 2024-04-01T06:55:20.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:20.157+0000 7fd8d77fe700 1 -- 172.21.15.83:0/3833162656 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7fd8e000c940 con 0x7fd8e8102920 2024-04-01T06:55:20.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:20.157+0000 7fd8d77fe700 1 --2- 172.21.15.83:0/3833162656 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd8d00a11b0 0x7fd8d00a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:20.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:20.157+0000 7fd8e659c700 1 --2- 172.21.15.83:0/3833162656 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd8d00a11b0 0x7fd8d00a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:20.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:20.157+0000 7fd8d77fe700 1 -- 172.21.15.83:0/3833162656 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fd8e00cc460 con 0x7fd8e8102920 2024-04-01T06:55:20.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:20.158+0000 7fd8e659c700 1 --2- 172.21.15.83:0/3833162656 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd8d00a11b0 0x7fd8d00a3670 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc00b5c0 tx=0x7fd8dc003790 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:20.160 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:20.161+0000 7fd8d77fe700 1 -- 172.21.15.83:0/3833162656 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7fd8e0095cd0 con 0x7fd8e8102920 2024-04-01T06:55:20.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:19 smithi145 ceph-mon[47816]: from='client.15084 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:55:20.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:20.364+0000 7fd8ec9f1700 1 -- 172.21.15.83:0/3833162656 --> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd8e8074700 con 0x7fd8d00a11b0 2024-04-01T06:55:20.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:20.377+0000 7fd8d77fe700 1 -- 172.21.15.83:0/3833162656 <== mgr.14152 v2:172.21.15.83:6800/3375372052 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+4185 (secure 0 0 0) 0x7fd8e8074700 con 0x7fd8d00a11b0 2024-04-01T06:55:20.377 INFO:teuthology.orchestra.run.smithi083.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-01T06:55:20.377 INFO:teuthology.orchestra.run.smithi083.stdout:mds.a smithi083 running (59s) 55s ago 59s 15.6M - 18.2.2-1001-g9d2ee692 37bf26e8388e d5dbb3fbf88b 2024-04-01T06:55:20.377 INFO:teuthology.orchestra.run.smithi083.stdout:mds.b smithi145 running (58s) 55s ago 58s 13.3M - 18.2.2-1001-g9d2ee692 37bf26e8388e d9149e433539 2024-04-01T06:55:20.377 INFO:teuthology.orchestra.run.smithi083.stdout:mds.c smithi153 running (67s) 55s ago 66s 14.2M - 18.2.2-1001-g9d2ee692 37bf26e8388e 34bd58749f25 2024-04-01T06:55:20.377 INFO:teuthology.orchestra.run.smithi083.stdout:mds.d smithi083 running (72s) 55s ago 71s 16.8M - 18.2.2-1001-g9d2ee692 37bf26e8388e 57f5644d0f69 2024-04-01T06:55:20.377 INFO:teuthology.orchestra.run.smithi083.stdout:mds.e smithi145 running (70s) 55s ago 70s 15.5M - 18.2.2-1001-g9d2ee692 37bf26e8388e ec35efdca321 2024-04-01T06:55:20.377 INFO:teuthology.orchestra.run.smithi083.stdout:mds.f smithi153 running (68s) 55s ago 68s 13.3M - 18.2.2-1001-g9d2ee692 37bf26e8388e 76c1d22d863e 2024-04-01T06:55:20.377 INFO:teuthology.orchestra.run.smithi083.stdout:mds.g smithi083 running (61s) 55s ago 61s 14.1M - 18.2.2-1001-g9d2ee692 37bf26e8388e 3e3b816b340a 2024-04-01T06:55:20.377 INFO:teuthology.orchestra.run.smithi083.stdout:mds.h smithi145 running (65s) 55s ago 64s 15.7M - 18.2.2-1001-g9d2ee692 37bf26e8388e 23b1fc00c7c5 2024-04-01T06:55:20.377 INFO:teuthology.orchestra.run.smithi083.stdout:mds.i smithi153 running (63s) 55s ago 63s 15.7M - 18.2.2-1001-g9d2ee692 37bf26e8388e ccf1fbb6cf8e 2024-04-01T06:55:20.378 INFO:teuthology.orchestra.run.smithi083.stdout:mds.j smithi083 running (73s) 55s ago 73s 13.3M - 18.2.2-1001-g9d2ee692 37bf26e8388e ce05b05332c5 2024-04-01T06:55:20.378 INFO:teuthology.orchestra.run.smithi083.stdout:mds.k smithi145 running (75s) 55s ago 75s 13.5M - 18.2.2-1001-g9d2ee692 37bf26e8388e 959366083bc4 2024-04-01T06:55:20.378 INFO:teuthology.orchestra.run.smithi083.stdout:mds.l smithi153 running (77s) 55s ago 77s 14.4M - 18.2.2-1001-g9d2ee692 37bf26e8388e b7b76f56d344 2024-04-01T06:55:20.378 INFO:teuthology.orchestra.run.smithi083.stdout:mgr.x smithi083 *:9283,8765 running (6m) 55s ago 6m 523M - 18.2.2-1001-g9d2ee692 37bf26e8388e 030867c29d83 2024-04-01T06:55:20.378 INFO:teuthology.orchestra.run.smithi083.stdout:mgr.y smithi145 *:8443,8765 running (4m) 55s ago 4m 457M - 18.2.2-1001-g9d2ee692 37bf26e8388e 8fb1d003406a 2024-04-01T06:55:20.378 INFO:teuthology.orchestra.run.smithi083.stdout:mgr.z smithi153 *:8443,8765 running (4m) 55s ago 4m 456M - 18.2.2-1001-g9d2ee692 37bf26e8388e d2e4c2a79fc7 2024-04-01T06:55:20.378 INFO:teuthology.orchestra.run.smithi083.stdout:mon.a smithi083 running (6m) 55s ago 6m 78.4M 2048M 18.2.2-1001-g9d2ee692 37bf26e8388e fc010074d32b 2024-04-01T06:55:20.378 INFO:teuthology.orchestra.run.smithi083.stdout:mon.b smithi145 running (5m) 55s ago 5m 54.3M 2048M 18.2.2-1001-g9d2ee692 37bf26e8388e e175e60bbdd1 2024-04-01T06:55:20.378 INFO:teuthology.orchestra.run.smithi083.stdout:mon.c smithi153 running (5m) 55s ago 5m 55.2M 2048M 18.2.2-1001-g9d2ee692 37bf26e8388e 6dba70c267b7 2024-04-01T06:55:20.378 INFO:teuthology.orchestra.run.smithi083.stdout:osd.0 smithi083 running (4m) 55s ago 4m 55.2M 4278M 18.2.2-1001-g9d2ee692 37bf26e8388e 80f503dbc118 2024-04-01T06:55:20.378 INFO:teuthology.orchestra.run.smithi083.stdout:osd.1 smithi145 running (4m) 55s ago 4m 134M 4278M 18.2.2-1001-g9d2ee692 37bf26e8388e 1b98309af8f8 2024-04-01T06:55:20.378 INFO:teuthology.orchestra.run.smithi083.stdout:osd.2 smithi153 running (4m) 55s ago 4m 55.8M 4278M 18.2.2-1001-g9d2ee692 37bf26e8388e 9122f3665667 2024-04-01T06:55:20.378 INFO:teuthology.orchestra.run.smithi083.stdout:osd.3 smithi083 running (3m) 55s ago 3m 118M 4278M 18.2.2-1001-g9d2ee692 37bf26e8388e 24ebca33541e 2024-04-01T06:55:20.379 INFO:teuthology.orchestra.run.smithi083.stdout:osd.4 smithi145 running (3m) 55s ago 3m 49.4M 4278M 18.2.2-1001-g9d2ee692 37bf26e8388e a1aa3dbe974a 2024-04-01T06:55:20.379 INFO:teuthology.orchestra.run.smithi083.stdout:osd.5 smithi153 running (3m) 55s ago 3m 121M 4278M 18.2.2-1001-g9d2ee692 37bf26e8388e 055e5bda008d 2024-04-01T06:55:20.379 INFO:teuthology.orchestra.run.smithi083.stdout:osd.6 smithi083 running (2m) 55s ago 2m 44.9M 4278M 18.2.2-1001-g9d2ee692 37bf26e8388e f82a6c58fde0 2024-04-01T06:55:20.379 INFO:teuthology.orchestra.run.smithi083.stdout:osd.7 smithi145 running (2m) 55s ago 2m 123M 4278M 18.2.2-1001-g9d2ee692 37bf26e8388e 7ba583d959e4 2024-04-01T06:55:20.379 INFO:teuthology.orchestra.run.smithi083.stdout:osd.8 smithi153 running (2m) 55s ago 2m 120M 4278M 18.2.2-1001-g9d2ee692 37bf26e8388e 5c77ebbd3357 2024-04-01T06:55:20.379 INFO:teuthology.orchestra.run.smithi083.stdout:osd.9 smithi083 running (2m) 55s ago 2m 115M 4278M 18.2.2-1001-g9d2ee692 37bf26e8388e 787d740798b3 2024-04-01T06:55:20.379 INFO:teuthology.orchestra.run.smithi083.stdout:osd.10 smithi145 running (108s) 55s ago 108s 45.3M 4278M 18.2.2-1001-g9d2ee692 37bf26e8388e 3dcb783b6ad2 2024-04-01T06:55:20.379 INFO:teuthology.orchestra.run.smithi083.stdout:osd.11 smithi153 running (91s) 55s ago 91s 44.4M 4278M 18.2.2-1001-g9d2ee692 37bf26e8388e 012686f93729 2024-04-01T06:55:20.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:20.379+0000 7fd8ec9f1700 1 -- 172.21.15.83:0/3833162656 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd8d00a11b0 msgr2=0x7fd8d00a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:20.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:20.379+0000 7fd8ec9f1700 1 --2- 172.21.15.83:0/3833162656 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd8d00a11b0 0x7fd8d00a3670 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc00b5c0 tx=0x7fd8dc003790 comp rx=0 tx=0).stop 2024-04-01T06:55:20.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:20.379+0000 7fd8ec9f1700 1 -- 172.21.15.83:0/3833162656 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8e8102920 msgr2=0x7fd8e81a03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:20.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:20.379+0000 7fd8ec9f1700 1 --2- 172.21.15.83:0/3833162656 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8e8102920 0x7fd8e81a03d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd8e000add0 tx=0x7fd8e000c330 comp rx=0 tx=0).stop 2024-04-01T06:55:20.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:20.379+0000 7fd8ec9f1700 1 -- 172.21.15.83:0/3833162656 shutdown_connections 2024-04-01T06:55:20.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:20.379+0000 7fd8ec9f1700 1 --2- 172.21.15.83:0/3833162656 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8e8102920 0x7fd8e81a03d0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:20.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:20.379+0000 7fd8ec9f1700 1 --2- 172.21.15.83:0/3833162656 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd8d00a11b0 0x7fd8d00a3670 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:20.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:20.379+0000 7fd8ec9f1700 1 --2- 172.21.15.83:0/3833162656 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8e8100e00 0x7fd8e8198e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:20.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:20.379+0000 7fd8ec9f1700 1 --2- 172.21.15.83:0/3833162656 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd8e8101f60 0x7fd8e81993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:20.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:20.379+0000 7fd8ec9f1700 1 -- 172.21.15.83:0/3833162656 >> 172.21.15.83:0/3833162656 conn(0x7fd8e80fc3c0 msgr2=0x7fd8e8072fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:20.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:20.379+0000 7fd8ec9f1700 1 -- 172.21.15.83:0/3833162656 shutdown_connections 2024-04-01T06:55:20.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:20.379+0000 7fd8ec9f1700 1 -- 172.21.15.83:0/3833162656 wait complete. 2024-04-01T06:55:20.764 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- bash -c 'ceph orch ls' 2024-04-01T06:55:20.987 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:55:21.084 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:20 smithi083 ceph-mon[43429]: pgmap v242: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T06:55:21.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:20 smithi153 ceph-mon[48187]: pgmap v242: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T06:55:21.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:20 smithi145 ceph-mon[47816]: pgmap v242: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T06:55:21.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:21.903+0000 7fbe7bcc3700 1 -- 172.21.15.83:0/405856266 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe74101890 msgr2=0x7fbe74108140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:21.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:21.903+0000 7fbe7bcc3700 1 --2- 172.21.15.83:0/405856266 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe74101890 0x7fbe74108140 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c00b0d0 tx=0x7fbe6c00b3e0 comp rx=0 tx=0).stop 2024-04-01T06:55:21.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:21.903+0000 7fbe7bcc3700 1 -- 172.21.15.83:0/405856266 shutdown_connections 2024-04-01T06:55:21.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:21.903+0000 7fbe7bcc3700 1 --2- 172.21.15.83:0/405856266 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe74101890 0x7fbe74108140 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:21.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:21.903+0000 7fbe7bcc3700 1 --2- 172.21.15.83:0/405856266 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbe740ffcf0 0x7fbe74100110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:21.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:21.903+0000 7fbe7bcc3700 1 --2- 172.21.15.83:0/405856266 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe74100ef0 0x7fbe74101350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:21.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:21.903+0000 7fbe7bcc3700 1 -- 172.21.15.83:0/405856266 >> 172.21.15.83:0/405856266 conn(0x7fbe740fb2b0 msgr2=0x7fbe740fd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:21.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:21.903+0000 7fbe7bcc3700 1 -- 172.21.15.83:0/405856266 shutdown_connections 2024-04-01T06:55:21.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:21.903+0000 7fbe7bcc3700 1 -- 172.21.15.83:0/405856266 wait complete. 2024-04-01T06:55:21.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:21.904+0000 7fbe7bcc3700 1 Processor -- start 2024-04-01T06:55:21.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:21.904+0000 7fbe7bcc3700 1 -- start start 2024-04-01T06:55:21.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:21.904+0000 7fbe7bcc3700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe740ffcf0 0x7fbe74199070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:21.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:21.904+0000 7fbe7bcc3700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbe74100ef0 0x7fbe741995b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:21.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:21.904+0000 7fbe7bcc3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe74101890 0x7fbe741a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:21.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:21.904+0000 7fbe7bcc3700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe741a0bb0 con 0x7fbe740ffcf0 2024-04-01T06:55:21.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:21.904+0000 7fbe7bcc3700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe741a0cf0 con 0x7fbe74100ef0 2024-04-01T06:55:21.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:21.904+0000 7fbe7bcc3700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe741a0e80 con 0x7fbe74101890 2024-04-01T06:55:21.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:21.904+0000 7fbe79a5f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe740ffcf0 0x7fbe74199070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:21.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:21.904+0000 7fbe79a5f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe740ffcf0 0x7fbe74199070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:41952/0 (socket says 172.21.15.83:41952) 2024-04-01T06:55:21.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:21.904+0000 7fbe79a5f700 1 -- 172.21.15.83:0/1197660291 learned_addr learned my addr 172.21.15.83:0/1197660291 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:21.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:21.904+0000 7fbe7a260700 1 --2- 172.21.15.83:0/1197660291 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe74101890 0x7fbe741a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:21.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:21.904+0000 7fbe7925e700 1 --2- 172.21.15.83:0/1197660291 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbe74100ef0 0x7fbe741995b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:21.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:21.904+0000 7fbe79a5f700 1 -- 172.21.15.83:0/1197660291 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe74101890 msgr2=0x7fbe741a05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:21.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:21.904+0000 7fbe79a5f700 1 --2- 172.21.15.83:0/1197660291 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe74101890 0x7fbe741a05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:21.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:21.904+0000 7fbe79a5f700 1 -- 172.21.15.83:0/1197660291 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbe74100ef0 msgr2=0x7fbe741995b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:21.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:21.904+0000 7fbe79a5f700 1 --2- 172.21.15.83:0/1197660291 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbe74100ef0 0x7fbe741995b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:21.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:21.904+0000 7fbe79a5f700 1 -- 172.21.15.83:0/1197660291 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe6c009d00 con 0x7fbe740ffcf0 2024-04-01T06:55:21.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:21.904+0000 7fbe7925e700 1 --2- 172.21.15.83:0/1197660291 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbe74100ef0 0x7fbe741995b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:55:21.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:21.904+0000 7fbe79a5f700 1 --2- 172.21.15.83:0/1197660291 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe740ffcf0 0x7fbe74199070 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fbe7000c9a0 tx=0x7fbe7000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:21.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:21.904+0000 7fbe6affd700 1 -- 172.21.15.83:0/1197660291 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe70004220 con 0x7fbe740ffcf0 2024-04-01T06:55:21.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:21.904+0000 7fbe6affd700 1 -- 172.21.15.83:0/1197660291 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbe70007d20 con 0x7fbe740ffcf0 2024-04-01T06:55:21.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:21.905+0000 7fbe6affd700 1 -- 172.21.15.83:0/1197660291 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe70003c00 con 0x7fbe740ffcf0 2024-04-01T06:55:21.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:21.905+0000 7fbe7bcc3700 1 -- 172.21.15.83:0/1197660291 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe741a1160 con 0x7fbe740ffcf0 2024-04-01T06:55:21.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:21.905+0000 7fbe7bcc3700 1 -- 172.21.15.83:0/1197660291 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe741a1610 con 0x7fbe740ffcf0 2024-04-01T06:55:21.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:21.906+0000 7fbe7bcc3700 1 -- 172.21.15.83:0/1197660291 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe7404ea80 con 0x7fbe740ffcf0 2024-04-01T06:55:21.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:21.907+0000 7fbe6affd700 1 -- 172.21.15.83:0/1197660291 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7fbe70007860 con 0x7fbe740ffcf0 2024-04-01T06:55:21.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:21.908+0000 7fbe6affd700 1 --2- 172.21.15.83:0/1197660291 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fbe600a11b0 0x7fbe600a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:21.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:21.908+0000 7fbe7925e700 1 --2- 172.21.15.83:0/1197660291 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fbe600a11b0 0x7fbe600a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:21.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:21.908+0000 7fbe6affd700 1 -- 172.21.15.83:0/1197660291 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fbe700cc9a0 con 0x7fbe740ffcf0 2024-04-01T06:55:21.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:21.908+0000 7fbe7925e700 1 --2- 172.21.15.83:0/1197660291 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fbe600a11b0 0x7fbe600a3670 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbe64007900 tx=0x7fbe64008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:21.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:21.911+0000 7fbe6affd700 1 -- 172.21.15.83:0/1197660291 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7fbe70096080 con 0x7fbe740ffcf0 2024-04-01T06:55:22.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:21 smithi083 ceph-mon[43429]: from='client.15090 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:55:22.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:22.113+0000 7fbe7bcc3700 1 -- 172.21.15.83:0/1197660291 --> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fbe740fd470 con 0x7fbe600a11b0 2024-04-01T06:55:22.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:22.119+0000 7fbe6affd700 1 -- 172.21.15.83:0/1197660291 <== mgr.14152 v2:172.21.15.83:6800/3375372052 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+980 (secure 0 0 0) 0x7fbe740fd470 con 0x7fbe600a11b0 2024-04-01T06:55:22.119 INFO:teuthology.orchestra.run.smithi083.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-04-01T06:55:22.119 INFO:teuthology.orchestra.run.smithi083.stdout:mds.all 12/12 56s ago 80s smithi083=a;smithi083=d;smithi083=g;smithi083=j;smithi145=b;smithi145=e;smithi145=h;smithi145=k;smithi153=c;smithi153=f;smithi153=i;smithi153=l;count:12 2024-04-01T06:55:22.119 INFO:teuthology.orchestra.run.smithi083.stdout:mgr 3/3 56s ago 4m smithi083=x;smithi145=y;smithi153=z;count:3 2024-04-01T06:55:22.119 INFO:teuthology.orchestra.run.smithi083.stdout:mon 3/3 56s ago 5m smithi083:172.21.15.83=a;smithi145:172.21.15.145=b;smithi153:172.21.15.153=c;count:3 2024-04-01T06:55:22.119 INFO:teuthology.orchestra.run.smithi083.stdout:osd 12 56s ago - 2024-04-01T06:55:22.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:22.121+0000 7fbe7bcc3700 1 -- 172.21.15.83:0/1197660291 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fbe600a11b0 msgr2=0x7fbe600a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:22.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:22.121+0000 7fbe7bcc3700 1 --2- 172.21.15.83:0/1197660291 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fbe600a11b0 0x7fbe600a3670 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbe64007900 tx=0x7fbe64008040 comp rx=0 tx=0).stop 2024-04-01T06:55:22.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:22.121+0000 7fbe7bcc3700 1 -- 172.21.15.83:0/1197660291 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe740ffcf0 msgr2=0x7fbe74199070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:22.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:22.121+0000 7fbe7bcc3700 1 --2- 172.21.15.83:0/1197660291 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe740ffcf0 0x7fbe74199070 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fbe7000c9a0 tx=0x7fbe7000ccb0 comp rx=0 tx=0).stop 2024-04-01T06:55:22.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:22.121+0000 7fbe7bcc3700 1 -- 172.21.15.83:0/1197660291 shutdown_connections 2024-04-01T06:55:22.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:22.121+0000 7fbe7bcc3700 1 --2- 172.21.15.83:0/1197660291 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe740ffcf0 0x7fbe74199070 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:22.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:22.121+0000 7fbe7bcc3700 1 --2- 172.21.15.83:0/1197660291 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fbe600a11b0 0x7fbe600a3670 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:22.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:22.121+0000 7fbe7bcc3700 1 --2- 172.21.15.83:0/1197660291 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe74101890 0x7fbe741a05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:22.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:22.121+0000 7fbe7bcc3700 1 --2- 172.21.15.83:0/1197660291 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbe74100ef0 0x7fbe741995b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:22.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:22.121+0000 7fbe7bcc3700 1 -- 172.21.15.83:0/1197660291 >> 172.21.15.83:0/1197660291 conn(0x7fbe740fb2b0 msgr2=0x7fbe740fcd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:22.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:22.121+0000 7fbe7bcc3700 1 -- 172.21.15.83:0/1197660291 shutdown_connections 2024-04-01T06:55:22.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:22.121+0000 7fbe7bcc3700 1 -- 172.21.15.83:0/1197660291 wait complete. 2024-04-01T06:55:22.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:21 smithi153 ceph-mon[48187]: from='client.15090 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:55:22.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:21 smithi145 ceph-mon[47816]: from='client.15090 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:55:22.497 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- bash -c 'ceph orch host ls' 2024-04-01T06:55:22.719 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:55:22.827 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:22 smithi083 ceph-mon[43429]: pgmap v243: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-01T06:55:23.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:22 smithi153 ceph-mon[48187]: pgmap v243: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-01T06:55:23.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:22 smithi145 ceph-mon[47816]: pgmap v243: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-01T06:55:23.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:23.654+0000 7f96bda0f700 1 -- 172.21.15.83:0/3995056946 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96b8102980 msgr2=0x7f96b8109230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:23.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:23.654+0000 7f96bda0f700 1 --2- 172.21.15.83:0/3995056946 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96b8102980 0x7f96b8109230 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f96b000b0d0 tx=0x7f96b000b3e0 comp rx=0 tx=0).stop 2024-04-01T06:55:23.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:23.654+0000 7f96bda0f700 1 -- 172.21.15.83:0/3995056946 shutdown_connections 2024-04-01T06:55:23.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:23.654+0000 7f96bda0f700 1 --2- 172.21.15.83:0/3995056946 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96b8102980 0x7f96b8109230 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:23.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:23.654+0000 7f96bda0f700 1 --2- 172.21.15.83:0/3995056946 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96b8100de0 0x7f96b8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:23.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:23.654+0000 7f96bda0f700 1 --2- 172.21.15.83:0/3995056946 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96b8101fe0 0x7f96b8102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:23.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:23.654+0000 7f96bda0f700 1 -- 172.21.15.83:0/3995056946 >> 172.21.15.83:0/3995056946 conn(0x7f96b80fc380 msgr2=0x7f96b80fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:23.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:23.654+0000 7f96bda0f700 1 -- 172.21.15.83:0/3995056946 shutdown_connections 2024-04-01T06:55:23.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:23.654+0000 7f96bda0f700 1 -- 172.21.15.83:0/3995056946 wait complete. 2024-04-01T06:55:23.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:23.655+0000 7f96bda0f700 1 Processor -- start 2024-04-01T06:55:23.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:23.655+0000 7f96bda0f700 1 -- start start 2024-04-01T06:55:23.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:23.655+0000 7f96bda0f700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96b8100de0 0x7f96b8196df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:23.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:23.655+0000 7f96bda0f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96b8101fe0 0x7f96b8197330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:23.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:23.655+0000 7f96bda0f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96b8102980 0x7f96b819e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:23.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:23.655+0000 7f96bda0f700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b819e8f0 con 0x7f96b8101fe0 2024-04-01T06:55:23.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:23.655+0000 7f96bda0f700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b819ea30 con 0x7f96b8100de0 2024-04-01T06:55:23.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:23.655+0000 7f96bda0f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b819ebf0 con 0x7f96b8102980 2024-04-01T06:55:23.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:23.655+0000 7f96b67fc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96b8101fe0 0x7f96b8197330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:23.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:23.655+0000 7f96b67fc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96b8101fe0 0x7f96b8197330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:45150/0 (socket says 172.21.15.83:45150) 2024-04-01T06:55:23.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:23.655+0000 7f96b67fc700 1 -- 172.21.15.83:0/2773176538 learned_addr learned my addr 172.21.15.83:0/2773176538 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:23.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:23.656+0000 7f96b77fe700 1 --2- 172.21.15.83:0/2773176538 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96b8102980 0x7f96b819e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:23.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:23.656+0000 7f96b6ffd700 1 --2- 172.21.15.83:0/2773176538 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96b8100de0 0x7f96b8196df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:23.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:23.656+0000 7f96b67fc700 1 -- 172.21.15.83:0/2773176538 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96b8102980 msgr2=0x7f96b819e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:23.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:23.656+0000 7f96b67fc700 1 --2- 172.21.15.83:0/2773176538 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96b8102980 0x7f96b819e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:23.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:23.656+0000 7f96b67fc700 1 -- 172.21.15.83:0/2773176538 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96b8100de0 msgr2=0x7f96b8196df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:23.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:23.656+0000 7f96b67fc700 1 --2- 172.21.15.83:0/2773176538 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96b8100de0 0x7f96b8196df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:23.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:23.656+0000 7f96b67fc700 1 -- 172.21.15.83:0/2773176538 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b0009d00 con 0x7f96b8101fe0 2024-04-01T06:55:23.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:23.656+0000 7f96b6ffd700 1 --2- 172.21.15.83:0/2773176538 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96b8100de0 0x7f96b8196df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:55:23.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:23.656+0000 7f96b67fc700 1 --2- 172.21.15.83:0/2773176538 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96b8101fe0 0x7f96b8197330 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f96a800c920 tx=0x7f96a800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:23.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:23.656+0000 7f96bca0d700 1 -- 172.21.15.83:0/2773176538 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a8007b00 con 0x7f96b8101fe0 2024-04-01T06:55:23.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:23.656+0000 7f96bca0d700 1 -- 172.21.15.83:0/2773176538 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f96a800ce70 con 0x7f96b8101fe0 2024-04-01T06:55:23.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:23.656+0000 7f96bda0f700 1 -- 172.21.15.83:0/2773176538 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96b819eed0 con 0x7f96b8101fe0 2024-04-01T06:55:23.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:23.656+0000 7f96bca0d700 1 -- 172.21.15.83:0/2773176538 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a80054e0 con 0x7f96b8101fe0 2024-04-01T06:55:23.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:23.656+0000 7f96bda0f700 1 -- 172.21.15.83:0/2773176538 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96b819f340 con 0x7f96b8101fe0 2024-04-01T06:55:23.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:23.657+0000 7f96bda0f700 1 -- 172.21.15.83:0/2773176538 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96b81081c0 con 0x7f96b8101fe0 2024-04-01T06:55:23.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:23.658+0000 7f96bca0d700 1 -- 172.21.15.83:0/2773176538 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f96a8004750 con 0x7f96b8101fe0 2024-04-01T06:55:23.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:23.659+0000 7f96bca0d700 1 --2- 172.21.15.83:0/2773176538 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f96a40a1230 0x7f96a40a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:23.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:23.659+0000 7f96b6ffd700 1 --2- 172.21.15.83:0/2773176538 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f96a40a1230 0x7f96a40a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:23.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:23.659+0000 7f96bca0d700 1 -- 172.21.15.83:0/2773176538 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f96a80cc7e0 con 0x7f96b8101fe0 2024-04-01T06:55:23.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:23.659+0000 7f96b6ffd700 1 --2- 172.21.15.83:0/2773176538 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f96a40a1230 0x7f96a40a36f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f96a0005950 tx=0x7f96a00058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:23.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:23.662+0000 7f96bca0d700 1 -- 172.21.15.83:0/2773176538 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f96a8096040 con 0x7f96b8101fe0 2024-04-01T06:55:23.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:23.864+0000 7f96bda0f700 1 -- 172.21.15.83:0/2773176538 --> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f96b802cd50 con 0x7f96a40a1230 2024-04-01T06:55:23.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:23.866+0000 7f96bca0d700 1 -- 172.21.15.83:0/2773176538 <== mgr.14152 v2:172.21.15.83:6800/3375372052 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+191 (secure 0 0 0) 0x7f96b802cd50 con 0x7f96a40a1230 2024-04-01T06:55:23.865 INFO:teuthology.orchestra.run.smithi083.stdout:HOST ADDR LABELS STATUS 2024-04-01T06:55:23.865 INFO:teuthology.orchestra.run.smithi083.stdout:smithi083 172.21.15.83 2024-04-01T06:55:23.865 INFO:teuthology.orchestra.run.smithi083.stdout:smithi145 172.21.15.145 2024-04-01T06:55:23.866 INFO:teuthology.orchestra.run.smithi083.stdout:smithi153 172.21.15.153 2024-04-01T06:55:23.866 INFO:teuthology.orchestra.run.smithi083.stdout:3 hosts in cluster 2024-04-01T06:55:23.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:23.868+0000 7f96bda0f700 1 -- 172.21.15.83:0/2773176538 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f96a40a1230 msgr2=0x7f96a40a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:23.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:23.868+0000 7f96bda0f700 1 --2- 172.21.15.83:0/2773176538 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f96a40a1230 0x7f96a40a36f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f96a0005950 tx=0x7f96a00058e0 comp rx=0 tx=0).stop 2024-04-01T06:55:23.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:23.868+0000 7f96bda0f700 1 -- 172.21.15.83:0/2773176538 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96b8101fe0 msgr2=0x7f96b8197330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:23.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:23.868+0000 7f96bda0f700 1 --2- 172.21.15.83:0/2773176538 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96b8101fe0 0x7f96b8197330 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f96a800c920 tx=0x7f96a800cc30 comp rx=0 tx=0).stop 2024-04-01T06:55:23.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:23.868+0000 7f96bda0f700 1 -- 172.21.15.83:0/2773176538 shutdown_connections 2024-04-01T06:55:23.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:23.868+0000 7f96bda0f700 1 --2- 172.21.15.83:0/2773176538 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f96a40a1230 0x7f96a40a36f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:23.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:23.868+0000 7f96bda0f700 1 --2- 172.21.15.83:0/2773176538 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96b8102980 0x7f96b819e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:23.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:23.868+0000 7f96bda0f700 1 --2- 172.21.15.83:0/2773176538 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f96b8100de0 0x7f96b8196df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:23.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:23.868+0000 7f96bda0f700 1 --2- 172.21.15.83:0/2773176538 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96b8101fe0 0x7f96b8197330 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:23.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:23.868+0000 7f96bda0f700 1 -- 172.21.15.83:0/2773176538 >> 172.21.15.83:0/2773176538 conn(0x7f96b80fc380 msgr2=0x7f96b8105300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:23.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:23.868+0000 7f96bda0f700 1 -- 172.21.15.83:0/2773176538 shutdown_connections 2024-04-01T06:55:23.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:23.868+0000 7f96bda0f700 1 -- 172.21.15.83:0/2773176538 wait complete. 2024-04-01T06:55:24.120 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:23 smithi083 ceph-mon[43429]: from='client.15096 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:55:24.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:23 smithi153 ceph-mon[48187]: from='client.15096 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:55:24.238 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- bash -c 'ceph orch device ls' 2024-04-01T06:55:24.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:23 smithi145 ceph-mon[47816]: from='client.15096 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:55:24.459 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:55:24.860 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:24 smithi083 ceph-mon[43429]: pgmap v244: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-01T06:55:24.860 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:24 smithi083 ceph-mon[43429]: from='client.15102 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:55:25.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:24 smithi153 ceph-mon[48187]: pgmap v244: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-01T06:55:25.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:24 smithi153 ceph-mon[48187]: from='client.15102 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:55:25.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:24 smithi145 ceph-mon[47816]: pgmap v244: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-04-01T06:55:25.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:24 smithi145 ceph-mon[47816]: from='client.15102 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:55:25.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:25.404+0000 7fc99c55b700 1 -- 172.21.15.83:0/3259201680 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc994101890 msgr2=0x7fc994108140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:25.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:25.404+0000 7fc99c55b700 1 --2- 172.21.15.83:0/3259201680 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc994101890 0x7fc994108140 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc98c00b0d0 tx=0x7fc98c00b3e0 comp rx=0 tx=0).stop 2024-04-01T06:55:25.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:25.404+0000 7fc99c55b700 1 -- 172.21.15.83:0/3259201680 shutdown_connections 2024-04-01T06:55:25.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:25.404+0000 7fc99c55b700 1 --2- 172.21.15.83:0/3259201680 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc994101890 0x7fc994108140 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:25.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:25.404+0000 7fc99c55b700 1 --2- 172.21.15.83:0/3259201680 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9940ffcf0 0x7fc994100110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:25.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:25.404+0000 7fc99c55b700 1 --2- 172.21.15.83:0/3259201680 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc994100ef0 0x7fc994101350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:25.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:25.404+0000 7fc99c55b700 1 -- 172.21.15.83:0/3259201680 >> 172.21.15.83:0/3259201680 conn(0x7fc9940fb2b0 msgr2=0x7fc9940fd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:25.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:25.404+0000 7fc99c55b700 1 -- 172.21.15.83:0/3259201680 shutdown_connections 2024-04-01T06:55:25.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:25.404+0000 7fc99c55b700 1 -- 172.21.15.83:0/3259201680 wait complete. 2024-04-01T06:55:25.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:25.404+0000 7fc99c55b700 1 Processor -- start 2024-04-01T06:55:25.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:25.405+0000 7fc99c55b700 1 -- start start 2024-04-01T06:55:25.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:25.405+0000 7fc99c55b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9940ffcf0 0x7fc994103c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:25.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:25.405+0000 7fc99c55b700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc994100ef0 0x7fc9941022d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:25.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:25.405+0000 7fc99c55b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc994101890 0x7fc994102810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:25.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:25.405+0000 7fc99c55b700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc994102fb0 con 0x7fc9940ffcf0 2024-04-01T06:55:25.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:25.405+0000 7fc99c55b700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc994103120 con 0x7fc994100ef0 2024-04-01T06:55:25.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:25.405+0000 7fc99c55b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9941a0e50 con 0x7fc994101890 2024-04-01T06:55:25.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:25.405+0000 7fc99a2f7700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9940ffcf0 0x7fc994103c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:25.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:25.405+0000 7fc99a2f7700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9940ffcf0 0x7fc994103c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:45170/0 (socket says 172.21.15.83:45170) 2024-04-01T06:55:25.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:25.405+0000 7fc99a2f7700 1 -- 172.21.15.83:0/8123809 learned_addr learned my addr 172.21.15.83:0/8123809 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:25.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:25.405+0000 7fc99aaf8700 1 --2- 172.21.15.83:0/8123809 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc994101890 0x7fc994102810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:25.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:25.405+0000 7fc999af6700 1 --2- 172.21.15.83:0/8123809 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc994100ef0 0x7fc9941022d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:25.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:25.405+0000 7fc99a2f7700 1 -- 172.21.15.83:0/8123809 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc994101890 msgr2=0x7fc994102810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:25.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:25.405+0000 7fc99a2f7700 1 --2- 172.21.15.83:0/8123809 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc994101890 0x7fc994102810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:25.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:25.405+0000 7fc99a2f7700 1 -- 172.21.15.83:0/8123809 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc994100ef0 msgr2=0x7fc9941022d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:25.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:25.405+0000 7fc99a2f7700 1 --2- 172.21.15.83:0/8123809 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc994100ef0 0x7fc9941022d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:25.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:25.405+0000 7fc99a2f7700 1 -- 172.21.15.83:0/8123809 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc98c009d00 con 0x7fc9940ffcf0 2024-04-01T06:55:25.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:25.405+0000 7fc999af6700 1 --2- 172.21.15.83:0/8123809 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc994100ef0 0x7fc9941022d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:55:25.409 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:25.405+0000 7fc99a2f7700 1 --2- 172.21.15.83:0/8123809 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9940ffcf0 0x7fc994103c30 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc98400d980 tx=0x7fc98400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:25.409 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:25.405+0000 7fc98b7fe700 1 -- 172.21.15.83:0/8123809 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc984004020 con 0x7fc9940ffcf0 2024-04-01T06:55:25.409 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:25.405+0000 7fc99c55b700 1 -- 172.21.15.83:0/8123809 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9941a10e0 con 0x7fc9940ffcf0 2024-04-01T06:55:25.409 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:25.405+0000 7fc98b7fe700 1 -- 172.21.15.83:0/8123809 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc984009730 con 0x7fc9940ffcf0 2024-04-01T06:55:25.409 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:25.406+0000 7fc98b7fe700 1 -- 172.21.15.83:0/8123809 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc984003a30 con 0x7fc9940ffcf0 2024-04-01T06:55:25.409 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:25.406+0000 7fc99c55b700 1 -- 172.21.15.83:0/8123809 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9941a15e0 con 0x7fc9940ffcf0 2024-04-01T06:55:25.409 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:25.406+0000 7fc99c55b700 1 -- 172.21.15.83:0/8123809 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc99404ea80 con 0x7fc9940ffcf0 2024-04-01T06:55:25.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:25.407+0000 7fc98b7fe700 1 -- 172.21.15.83:0/8123809 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7fc9840098a0 con 0x7fc9940ffcf0 2024-04-01T06:55:25.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:25.408+0000 7fc98b7fe700 1 --2- 172.21.15.83:0/8123809 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fc9800a11b0 0x7fc9800a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:25.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:25.408+0000 7fc999af6700 1 --2- 172.21.15.83:0/8123809 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fc9800a11b0 0x7fc9800a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:25.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:25.408+0000 7fc98b7fe700 1 -- 172.21.15.83:0/8123809 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fc9840cc590 con 0x7fc9940ffcf0 2024-04-01T06:55:25.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:25.408+0000 7fc999af6700 1 --2- 172.21.15.83:0/8123809 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fc9800a11b0 0x7fc9800a3670 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc990005fd0 tx=0x7fc990005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:25.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:25.412+0000 7fc98b7fe700 1 -- 172.21.15.83:0/8123809 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7fc984095d70 con 0x7fc9940ffcf0 2024-04-01T06:55:25.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:25.630+0000 7fc99c55b700 1 -- 172.21.15.83:0/8123809 --> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fc9940fd480 con 0x7fc9800a11b0 2024-04-01T06:55:25.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:25.632+0000 7fc98b7fe700 1 -- 172.21.15.83:0/8123809 <== mgr.14152 v2:172.21.15.83:6800/3375372052 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+532 (secure 0 0 0) 0x7fc9940fd480 con 0x7fc9800a11b0 2024-04-01T06:55:25.631 INFO:teuthology.orchestra.run.smithi083.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-04-01T06:55:25.631 INFO:teuthology.orchestra.run.smithi083.stdout:smithi083 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT62040148400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-04-01T06:55:25.631 INFO:teuthology.orchestra.run.smithi083.stdout:smithi145 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620500N9400BGN 372G No 108s ago Has a FileSystem, LVM detected 2024-04-01T06:55:25.632 INFO:teuthology.orchestra.run.smithi083.stdout:smithi153 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300MV400BGN 372G No 91s ago Has a FileSystem, LVM detected 2024-04-01T06:55:25.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:25.634+0000 7fc99c55b700 1 -- 172.21.15.83:0/8123809 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fc9800a11b0 msgr2=0x7fc9800a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:25.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:25.634+0000 7fc99c55b700 1 --2- 172.21.15.83:0/8123809 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fc9800a11b0 0x7fc9800a3670 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc990005fd0 tx=0x7fc990005ee0 comp rx=0 tx=0).stop 2024-04-01T06:55:25.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:25.634+0000 7fc99c55b700 1 -- 172.21.15.83:0/8123809 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9940ffcf0 msgr2=0x7fc994103c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:25.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:25.634+0000 7fc99c55b700 1 --2- 172.21.15.83:0/8123809 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9940ffcf0 0x7fc994103c30 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc98400d980 tx=0x7fc98400dc90 comp rx=0 tx=0).stop 2024-04-01T06:55:25.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:25.634+0000 7fc99c55b700 1 -- 172.21.15.83:0/8123809 shutdown_connections 2024-04-01T06:55:25.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:25.634+0000 7fc99c55b700 1 --2- 172.21.15.83:0/8123809 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9940ffcf0 0x7fc994103c30 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:25.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:25.634+0000 7fc99c55b700 1 --2- 172.21.15.83:0/8123809 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fc9800a11b0 0x7fc9800a3670 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:25.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:25.634+0000 7fc99c55b700 1 --2- 172.21.15.83:0/8123809 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc994101890 0x7fc994102810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:25.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:25.634+0000 7fc99c55b700 1 --2- 172.21.15.83:0/8123809 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc994100ef0 0x7fc9941022d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:25.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:25.634+0000 7fc99c55b700 1 -- 172.21.15.83:0/8123809 >> 172.21.15.83:0/8123809 conn(0x7fc9940fb2b0 msgr2=0x7fc9940fcd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:25.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:25.634+0000 7fc99c55b700 1 -- 172.21.15.83:0/8123809 shutdown_connections 2024-04-01T06:55:25.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:25.634+0000 7fc99c55b700 1 -- 172.21.15.83:0/8123809 wait complete. 2024-04-01T06:55:25.987 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:25 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:55:26.060 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-01T06:55:26.069 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi083.front.sepia.ceph.com 2024-04-01T06:55:26.069 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- bash -c 'ceph fs dump' 2024-04-01T06:55:26.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:25 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:55:26.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:25 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:55:26.353 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:55:27.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:26 smithi153 ceph-mon[48187]: from='client.15108 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:55:27.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:26 smithi153 ceph-mon[48187]: pgmap v245: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-01T06:55:27.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:26 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:55:27.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:26 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:55:27.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:26 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:55:27.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:26 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:55:27.185 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:26 smithi083 ceph-mon[43429]: from='client.15108 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:55:27.185 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:26 smithi083 ceph-mon[43429]: pgmap v245: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-01T06:55:27.185 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:26 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:55:27.185 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:26 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:55:27.185 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:26 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:55:27.186 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:26 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:55:27.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:26 smithi145 ceph-mon[47816]: from='client.15108 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:55:27.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:26 smithi145 ceph-mon[47816]: pgmap v245: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-04-01T06:55:27.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:26 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:55:27.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:26 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:55:27.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:26 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:55:27.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:26 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:55:27.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:27.371+0000 7f7c7f79e700 1 -- 172.21.15.83:0/2178084191 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c78106ae0 msgr2=0x7f7c78108f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:27.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:27.371+0000 7f7c7f79e700 1 --2- 172.21.15.83:0/2178084191 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c78106ae0 0x7f7c78108f50 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7c7000b0a0 tx=0x7f7c7000b3b0 comp rx=0 tx=0).stop 2024-04-01T06:55:27.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:27.371+0000 7f7c7f79e700 1 -- 172.21.15.83:0/2178084191 shutdown_connections 2024-04-01T06:55:27.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:27.371+0000 7f7c7f79e700 1 --2- 172.21.15.83:0/2178084191 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c78106ae0 0x7f7c78108f50 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:27.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:27.371+0000 7f7c7f79e700 1 --2- 172.21.15.83:0/2178084191 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7c78101880 0x7f7c78103c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:27.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:27.371+0000 7f7c7f79e700 1 --2- 172.21.15.83:0/2178084191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c781041b0 0x7f7c781065a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:27.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:27.371+0000 7f7c7f79e700 1 -- 172.21.15.83:0/2178084191 >> 172.21.15.83:0/2178084191 conn(0x7f7c780fb2b0 msgr2=0x7f7c780fd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:27.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:27.371+0000 7f7c7f79e700 1 -- 172.21.15.83:0/2178084191 shutdown_connections 2024-04-01T06:55:27.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:27.371+0000 7f7c7f79e700 1 -- 172.21.15.83:0/2178084191 wait complete. 2024-04-01T06:55:27.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:27.371+0000 7f7c7f79e700 1 Processor -- start 2024-04-01T06:55:27.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:27.371+0000 7f7c7f79e700 1 -- start start 2024-04-01T06:55:27.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:27.372+0000 7f7c7f79e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c78101880 0x7f7c78101190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:27.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:27.372+0000 7f7c7f79e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c781041b0 0x7f7c780ff830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:27.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:27.372+0000 7f7c7f79e700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7c78106ae0 0x7f7c780ffd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:27.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:27.372+0000 7f7c7f79e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c78100510 con 0x7f7c78101880 2024-04-01T06:55:27.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:27.372+0000 7f7c7f79e700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c78100680 con 0x7f7c78106ae0 2024-04-01T06:55:27.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:27.372+0000 7f7c7f79e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c781a0e80 con 0x7f7c781041b0 2024-04-01T06:55:27.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:27.372+0000 7f7c7d53a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c78101880 0x7f7c78101190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:27.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:27.372+0000 7f7c7d53a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c78101880 0x7f7c78101190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:45188/0 (socket says 172.21.15.83:45188) 2024-04-01T06:55:27.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:27.372+0000 7f7c7d53a700 1 -- 172.21.15.83:0/3351833004 learned_addr learned my addr 172.21.15.83:0/3351833004 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:27.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:27.372+0000 7f7c7cd39700 1 --2- 172.21.15.83:0/3351833004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c781041b0 0x7f7c780ff830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:27.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:27.372+0000 7f7c7dd3b700 1 --2- 172.21.15.83:0/3351833004 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7c78106ae0 0x7f7c780ffd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:27.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:27.372+0000 7f7c7d53a700 1 -- 172.21.15.83:0/3351833004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c781041b0 msgr2=0x7f7c780ff830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:27.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:27.372+0000 7f7c7d53a700 1 --2- 172.21.15.83:0/3351833004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c781041b0 0x7f7c780ff830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:27.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:27.372+0000 7f7c7d53a700 1 -- 172.21.15.83:0/3351833004 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7c78106ae0 msgr2=0x7f7c780ffd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:27.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:27.372+0000 7f7c7d53a700 1 --2- 172.21.15.83:0/3351833004 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7c78106ae0 0x7f7c780ffd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:27.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:27.372+0000 7f7c7d53a700 1 -- 172.21.15.83:0/3351833004 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c70009d00 con 0x7f7c78101880 2024-04-01T06:55:27.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:27.372+0000 7f7c7dd3b700 1 --2- 172.21.15.83:0/3351833004 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7c78106ae0 0x7f7c780ffd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:55:27.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:27.372+0000 7f7c7cd39700 1 --2- 172.21.15.83:0/3351833004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c781041b0 0x7f7c780ff830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:55:27.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:27.372+0000 7f7c7d53a700 1 --2- 172.21.15.83:0/3351833004 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c78101880 0x7f7c78101190 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7c7400d950 tx=0x7f7c7400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:27.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:27.372+0000 7f7c6e7fc700 1 -- 172.21.15.83:0/3351833004 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c74009b40 con 0x7f7c78101880 2024-04-01T06:55:27.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:27.372+0000 7f7c6e7fc700 1 -- 172.21.15.83:0/3351833004 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7c74009ca0 con 0x7f7c78101880 2024-04-01T06:55:27.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:27.372+0000 7f7c7f79e700 1 -- 172.21.15.83:0/3351833004 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c781a1110 con 0x7f7c78101880 2024-04-01T06:55:27.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:27.372+0000 7f7c6e7fc700 1 -- 172.21.15.83:0/3351833004 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7400f620 con 0x7f7c78101880 2024-04-01T06:55:27.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:27.372+0000 7f7c7f79e700 1 -- 172.21.15.83:0/3351833004 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c781a1610 con 0x7f7c78101880 2024-04-01T06:55:27.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:27.373+0000 7f7c7f79e700 1 -- 172.21.15.83:0/3351833004 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c780fce30 con 0x7f7c78101880 2024-04-01T06:55:27.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:27.375+0000 7f7c6e7fc700 1 -- 172.21.15.83:0/3351833004 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f7c74010460 con 0x7f7c78101880 2024-04-01T06:55:27.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:27.376+0000 7f7c6e7fc700 1 --2- 172.21.15.83:0/3351833004 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f7c640a11b0 0x7f7c640a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:27.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:27.376+0000 7f7c7cd39700 1 --2- 172.21.15.83:0/3351833004 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f7c640a11b0 0x7f7c640a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:27.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:27.376+0000 7f7c6e7fc700 1 -- 172.21.15.83:0/3351833004 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f7c740cccd0 con 0x7f7c78101880 2024-04-01T06:55:27.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:27.376+0000 7f7c7cd39700 1 --2- 172.21.15.83:0/3351833004 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f7c640a11b0 0x7f7c640a3670 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7c68005950 tx=0x7f7c68005f50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:27.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:27.379+0000 7f7c6e7fc700 1 -- 172.21.15.83:0/3351833004 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f7c740964b0 con 0x7f7c78101880 2024-04-01T06:55:27.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:27.625+0000 7f7c7f79e700 1 -- 172.21.15.83:0/3351833004 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7c7804ea80 con 0x7f7c78101880 2024-04-01T06:55:27.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:27.625+0000 7f7c6e7fc700 1 -- 172.21.15.83:0/3351833004 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) v1 ==== 76+0+2903 (secure 0 0 0) 0x7f7c74020b70 con 0x7f7c78101880 2024-04-01T06:55:27.625 INFO:teuthology.orchestra.run.smithi083.stdout:e23 2024-04-01T06:55:27.625 INFO:teuthology.orchestra.run.smithi083.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-01T06:55:27.625 INFO:teuthology.orchestra.run.smithi083.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-01T06:55:27.625 INFO:teuthology.orchestra.run.smithi083.stdout:legacy client fscid: 1 2024-04-01T06:55:27.625 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:55:27.626 INFO:teuthology.orchestra.run.smithi083.stdout:Filesystem 'cephfs' (1) 2024-04-01T06:55:27.626 INFO:teuthology.orchestra.run.smithi083.stdout:fs_name cephfs 2024-04-01T06:55:27.626 INFO:teuthology.orchestra.run.smithi083.stdout:epoch 23 2024-04-01T06:55:27.626 INFO:teuthology.orchestra.run.smithi083.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-01T06:55:27.626 INFO:teuthology.orchestra.run.smithi083.stdout:created 2024-04-01T06:54:28.397062+0000 2024-04-01T06:55:27.626 INFO:teuthology.orchestra.run.smithi083.stdout:modified 2024-04-01T06:54:33.704443+0000 2024-04-01T06:55:27.626 INFO:teuthology.orchestra.run.smithi083.stdout:tableserver 0 2024-04-01T06:55:27.626 INFO:teuthology.orchestra.run.smithi083.stdout:root 0 2024-04-01T06:55:27.626 INFO:teuthology.orchestra.run.smithi083.stdout:session_timeout 300 2024-04-01T06:55:27.626 INFO:teuthology.orchestra.run.smithi083.stdout:session_autoclose 300 2024-04-01T06:55:27.626 INFO:teuthology.orchestra.run.smithi083.stdout:max_file_size 1099511627776 2024-04-01T06:55:27.626 INFO:teuthology.orchestra.run.smithi083.stdout:max_xattr_size 65536 2024-04-01T06:55:27.626 INFO:teuthology.orchestra.run.smithi083.stdout:required_client_features {} 2024-04-01T06:55:27.627 INFO:teuthology.orchestra.run.smithi083.stdout:last_failure 0 2024-04-01T06:55:27.627 INFO:teuthology.orchestra.run.smithi083.stdout:last_failure_osd_epoch 0 2024-04-01T06:55:27.627 INFO:teuthology.orchestra.run.smithi083.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-01T06:55:27.627 INFO:teuthology.orchestra.run.smithi083.stdout:max_mds 3 2024-04-01T06:55:27.627 INFO:teuthology.orchestra.run.smithi083.stdout:in 0,1,2 2024-04-01T06:55:27.627 INFO:teuthology.orchestra.run.smithi083.stdout:up {0=24524,1=24494,2=24473} 2024-04-01T06:55:27.627 INFO:teuthology.orchestra.run.smithi083.stdout:failed 2024-04-01T06:55:27.627 INFO:teuthology.orchestra.run.smithi083.stdout:damaged 2024-04-01T06:55:27.627 INFO:teuthology.orchestra.run.smithi083.stdout:stopped 2024-04-01T06:55:27.627 INFO:teuthology.orchestra.run.smithi083.stdout:data_pools [3] 2024-04-01T06:55:27.627 INFO:teuthology.orchestra.run.smithi083.stdout:metadata_pool 2 2024-04-01T06:55:27.627 INFO:teuthology.orchestra.run.smithi083.stdout:inline_data disabled 2024-04-01T06:55:27.627 INFO:teuthology.orchestra.run.smithi083.stdout:balancer 2024-04-01T06:55:27.627 INFO:teuthology.orchestra.run.smithi083.stdout:bal_rank_mask -1 2024-04-01T06:55:27.628 INFO:teuthology.orchestra.run.smithi083.stdout:standby_count_wanted 0 2024-04-01T06:55:27.628 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.b{0:24524} state up:active seq 3 addr [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] compat {c=[1],r=[1],i=[7ff]}] 2024-04-01T06:55:27.628 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.i{0:24472} state up:standby-replay seq 1 addr [v2:172.21.15.153:6838/1399754640,v1:172.21.15.153:6839/1399754640] compat {c=[1],r=[1],i=[7ff]}] 2024-04-01T06:55:27.628 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.h{1:24494} state up:active seq 6 addr [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] compat {c=[1],r=[1],i=[7ff]}] 2024-04-01T06:55:27.628 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.c{1:24454} state up:standby-replay seq 1 addr [v2:172.21.15.153:6836/1993816527,v1:172.21.15.153:6837/1993816527] compat {c=[1],r=[1],i=[7ff]}] 2024-04-01T06:55:27.628 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.e{2:24473} state up:active seq 7 addr [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] compat {c=[1],r=[1],i=[7ff]}] 2024-04-01T06:55:27.628 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.k{2:24449} state up:standby-replay seq 1 addr [v2:172.21.15.145:6832/647005844,v1:172.21.15.145:6833/647005844] compat {c=[1],r=[1],i=[7ff]}] 2024-04-01T06:55:27.628 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:55:27.628 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:55:27.628 INFO:teuthology.orchestra.run.smithi083.stdout:Standby daemons: 2024-04-01T06:55:27.628 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:55:27.628 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.j{-1:14547} state up:standby seq 1 addr [v2:172.21.15.83:6834/1271130478,v1:172.21.15.83:6835/1271130478] compat {c=[1],r=[1],i=[7ff]}] 2024-04-01T06:55:27.628 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.d{-1:14559} state up:standby seq 1 addr [v2:172.21.15.83:6836/2412682983,v1:172.21.15.83:6837/2412682983] compat {c=[1],r=[1],i=[7ff]}] 2024-04-01T06:55:27.628 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.g{-1:14604} state up:standby seq 1 addr [v2:172.21.15.83:6838/3348145990,v1:172.21.15.83:6839/3348145990] compat {c=[1],r=[1],i=[7ff]}] 2024-04-01T06:55:27.628 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.a{-1:14616} state up:standby seq 1 addr [v2:172.21.15.83:6840/1191267445,v1:172.21.15.83:6841/1191267445] compat {c=[1],r=[1],i=[7ff]}] 2024-04-01T06:55:27.629 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.l{-1:24427} state up:standby seq 1 addr [v2:172.21.15.153:6832/2467459028,v1:172.21.15.153:6833/2467459028] compat {c=[1],r=[1],i=[7ff]}] 2024-04-01T06:55:27.629 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.f{-1:24448} state up:standby seq 1 addr [v2:172.21.15.153:6834/4092629042,v1:172.21.15.153:6835/4092629042] compat {c=[1],r=[1],i=[7ff]}] 2024-04-01T06:55:27.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:27.627+0000 7f7c7f79e700 1 -- 172.21.15.83:0/3351833004 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f7c640a11b0 msgr2=0x7f7c640a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:27.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:27.627+0000 7f7c7f79e700 1 --2- 172.21.15.83:0/3351833004 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f7c640a11b0 0x7f7c640a3670 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7c68005950 tx=0x7f7c68005f50 comp rx=0 tx=0).stop 2024-04-01T06:55:27.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:27.627+0000 7f7c7f79e700 1 -- 172.21.15.83:0/3351833004 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c78101880 msgr2=0x7f7c78101190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:27.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:27.627+0000 7f7c7f79e700 1 --2- 172.21.15.83:0/3351833004 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c78101880 0x7f7c78101190 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7c7400d950 tx=0x7f7c7400dd10 comp rx=0 tx=0).stop 2024-04-01T06:55:27.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:27.627+0000 7f7c7f79e700 1 -- 172.21.15.83:0/3351833004 shutdown_connections 2024-04-01T06:55:27.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:27.627+0000 7f7c7f79e700 1 --2- 172.21.15.83:0/3351833004 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c78101880 0x7f7c78101190 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:27.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:27.627+0000 7f7c7f79e700 1 --2- 172.21.15.83:0/3351833004 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f7c640a11b0 0x7f7c640a3670 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:27.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:27.627+0000 7f7c7f79e700 1 --2- 172.21.15.83:0/3351833004 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7c78106ae0 0x7f7c780ffd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:27.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:27.627+0000 7f7c7f79e700 1 --2- 172.21.15.83:0/3351833004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c781041b0 0x7f7c780ff830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:27.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:27.627+0000 7f7c7f79e700 1 -- 172.21.15.83:0/3351833004 >> 172.21.15.83:0/3351833004 conn(0x7f7c780fb2b0 msgr2=0x7f7c781021c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:27.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:27.627+0000 7f7c7f79e700 1 -- 172.21.15.83:0/3351833004 shutdown_connections 2024-04-01T06:55:27.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:27.627+0000 7f7c7f79e700 1 -- 172.21.15.83:0/3351833004 wait complete. 2024-04-01T06:55:27.630 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 23 2024-04-01T06:55:27.955 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- bash -c 'ceph osd dump' 2024-04-01T06:55:28.176 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:55:28.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:28 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:55:28.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:28 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:55:28.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:28 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:55:28.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:28 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:55:28.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:28 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:55:28.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:28 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/3351833004' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-01T06:55:28.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:28 smithi083 ceph-mon[43429]: pgmap v246: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-01T06:55:28.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:28 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:55:28.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:28 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:55:28.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:28 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:55:28.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:28 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:55:28.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:28 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:55:28.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:28 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/3351833004' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-01T06:55:28.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:28 smithi153 ceph-mon[48187]: pgmap v246: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-01T06:55:28.502 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:28 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:55:28.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:28 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:55:28.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:28 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:55:28.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:28 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:55:28.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:28 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' 2024-04-01T06:55:28.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:28 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/3351833004' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-01T06:55:28.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:28 smithi145 ceph-mon[47816]: pgmap v246: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-01T06:55:29.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.178+0000 7f986b523700 1 -- 172.21.15.83:0/553125274 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9864101f60 msgr2=0x7f98641023e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:29.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.178+0000 7f986b523700 1 --2- 172.21.15.83:0/553125274 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9864101f60 0x7f98641023e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9854009990 tx=0x7f9854009ca0 comp rx=0 tx=0).stop 2024-04-01T06:55:29.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.178+0000 7f986b523700 1 -- 172.21.15.83:0/553125274 shutdown_connections 2024-04-01T06:55:29.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.178+0000 7f986b523700 1 --2- 172.21.15.83:0/553125274 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9864102920 0x7f9864109240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:29.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.178+0000 7f986b523700 1 --2- 172.21.15.83:0/553125274 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9864100e00 0x7f9864101220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:29.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.178+0000 7f986b523700 1 --2- 172.21.15.83:0/553125274 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9864101f60 0x7f98641023e0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:29.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.178+0000 7f986b523700 1 -- 172.21.15.83:0/553125274 >> 172.21.15.83:0/553125274 conn(0x7f98640fc3c0 msgr2=0x7f98640fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:29.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.178+0000 7f986b523700 1 -- 172.21.15.83:0/553125274 shutdown_connections 2024-04-01T06:55:29.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.178+0000 7f986b523700 1 -- 172.21.15.83:0/553125274 wait complete. 2024-04-01T06:55:29.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.179+0000 7f986b523700 1 Processor -- start 2024-04-01T06:55:29.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.179+0000 7f986b523700 1 -- start start 2024-04-01T06:55:29.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.179+0000 7f986b523700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9864100e00 0x7f9864074b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:29.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.179+0000 7f986b523700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9864101f60 0x7f98640731a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:29.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.179+0000 7f986b523700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9864102920 0x7f98640736e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:29.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.179+0000 7f986b523700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9864073e80 con 0x7f9864100e00 2024-04-01T06:55:29.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.179+0000 7f986b523700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9864073ff0 con 0x7f9864102920 2024-04-01T06:55:29.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.179+0000 7f986b523700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98641a0d60 con 0x7f9864101f60 2024-04-01T06:55:29.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.179+0000 7f98692bf700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9864100e00 0x7f9864074b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:29.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.179+0000 7f98692bf700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9864100e00 0x7f9864074b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:45206/0 (socket says 172.21.15.83:45206) 2024-04-01T06:55:29.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.179+0000 7f98692bf700 1 -- 172.21.15.83:0/781201704 learned_addr learned my addr 172.21.15.83:0/781201704 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:29.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.179+0000 7f9868abe700 1 --2- 172.21.15.83:0/781201704 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9864101f60 0x7f98640731a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:29.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.179+0000 7f9869ac0700 1 --2- 172.21.15.83:0/781201704 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9864102920 0x7f98640736e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:29.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.179+0000 7f98692bf700 1 -- 172.21.15.83:0/781201704 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9864101f60 msgr2=0x7f98640731a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:29.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.179+0000 7f98692bf700 1 --2- 172.21.15.83:0/781201704 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9864101f60 0x7f98640731a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:29.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.179+0000 7f98692bf700 1 -- 172.21.15.83:0/781201704 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9864102920 msgr2=0x7f98640736e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:29.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.179+0000 7f98692bf700 1 --2- 172.21.15.83:0/781201704 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9864102920 0x7f98640736e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:29.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.179+0000 7f98692bf700 1 -- 172.21.15.83:0/781201704 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98540095f0 con 0x7f9864100e00 2024-04-01T06:55:29.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.179+0000 7f98692bf700 1 --2- 172.21.15.83:0/781201704 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9864100e00 0x7f9864074b00 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f986000d950 tx=0x7f986000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:29.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.180+0000 7f985a7fc700 1 -- 172.21.15.83:0/781201704 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986000f890 con 0x7f9864100e00 2024-04-01T06:55:29.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.180+0000 7f985a7fc700 1 -- 172.21.15.83:0/781201704 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9860010460 con 0x7f9864100e00 2024-04-01T06:55:29.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.180+0000 7f986b523700 1 -- 172.21.15.83:0/781201704 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98641a0ff0 con 0x7f9864100e00 2024-04-01T06:55:29.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.180+0000 7f985a7fc700 1 -- 172.21.15.83:0/781201704 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986000e610 con 0x7f9864100e00 2024-04-01T06:55:29.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.180+0000 7f986b523700 1 -- 172.21.15.83:0/781201704 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98641a1400 con 0x7f9864100e00 2024-04-01T06:55:29.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.181+0000 7f986b523700 1 -- 172.21.15.83:0/781201704 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9864108230 con 0x7f9864100e00 2024-04-01T06:55:29.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.182+0000 7f985a7fc700 1 -- 172.21.15.83:0/781201704 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f98600108d0 con 0x7f9864100e00 2024-04-01T06:55:29.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.182+0000 7f985a7fc700 1 --2- 172.21.15.83:0/781201704 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f98500a11b0 0x7f98500a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:29.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.183+0000 7f9868abe700 1 --2- 172.21.15.83:0/781201704 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f98500a11b0 0x7f98500a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:29.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.183+0000 7f985a7fc700 1 -- 172.21.15.83:0/781201704 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f98600cc730 con 0x7f9864100e00 2024-04-01T06:55:29.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.183+0000 7f9868abe700 1 --2- 172.21.15.83:0/781201704 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f98500a11b0 0x7f98500a3670 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f985400b5c0 tx=0x7f9854003790 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:29.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.186+0000 7f985a7fc700 1 -- 172.21.15.83:0/781201704 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f9860095e10 con 0x7f9864100e00 2024-04-01T06:55:29.379 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.379+0000 7f986b523700 1 -- 172.21.15.83:0/781201704 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump"} v 0) v1 -- 0x7f986404ea80 con 0x7f9864100e00 2024-04-01T06:55:29.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.380+0000 7f985a7fc700 1 -- 172.21.15.83:0/781201704 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v79) v1 ==== 56+0+5076 (secure 0 0 0) 0x7f9860099430 con 0x7f9864100e00 2024-04-01T06:55:29.380 INFO:teuthology.orchestra.run.smithi083.stdout:epoch 79 2024-04-01T06:55:29.380 INFO:teuthology.orchestra.run.smithi083.stdout:fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 2024-04-01T06:55:29.380 INFO:teuthology.orchestra.run.smithi083.stdout:created 2024-04-01T06:48:42.033382+0000 2024-04-01T06:55:29.381 INFO:teuthology.orchestra.run.smithi083.stdout:modified 2024-04-01T06:54:29.399277+0000 2024-04-01T06:55:29.381 INFO:teuthology.orchestra.run.smithi083.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-04-01T06:55:29.381 INFO:teuthology.orchestra.run.smithi083.stdout:crush_version 26 2024-04-01T06:55:29.381 INFO:teuthology.orchestra.run.smithi083.stdout:full_ratio 0.95 2024-04-01T06:55:29.381 INFO:teuthology.orchestra.run.smithi083.stdout:backfillfull_ratio 0.9 2024-04-01T06:55:29.381 INFO:teuthology.orchestra.run.smithi083.stdout:nearfull_ratio 0.85 2024-04-01T06:55:29.381 INFO:teuthology.orchestra.run.smithi083.stdout:require_min_compat_client luminous 2024-04-01T06:55:29.381 INFO:teuthology.orchestra.run.smithi083.stdout:min_compat_client jewel 2024-04-01T06:55:29.381 INFO:teuthology.orchestra.run.smithi083.stdout:require_osd_release reef 2024-04-01T06:55:29.381 INFO:teuthology.orchestra.run.smithi083.stdout:stretch_mode_enabled false 2024-04-01T06:55:29.381 INFO:teuthology.orchestra.run.smithi083.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-04-01T06:55:29.381 INFO:teuthology.orchestra.run.smithi083.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 78 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2024-04-01T06:55:29.381 INFO:teuthology.orchestra.run.smithi083.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 79 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-04-01T06:55:29.382 INFO:teuthology.orchestra.run.smithi083.stdout:max_osd 12 2024-04-01T06:55:29.382 INFO:teuthology.orchestra.run.smithi083.stdout:osd.0 up in weight 1 up_from 8 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.83:6802/3253845390,v1:172.21.15.83:6803/3253845390] [v2:172.21.15.83:6804/3253845390,v1:172.21.15.83:6805/3253845390] exists,up 90b761b0-b06c-4142-854d-38ee42aa6052 2024-04-01T06:55:29.382 INFO:teuthology.orchestra.run.smithi083.stdout:osd.1 up in weight 1 up_from 13 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.145:6800/515889759,v1:172.21.15.145:6801/515889759] [v2:172.21.15.145:6802/515889759,v1:172.21.15.145:6803/515889759] exists,up 4d6ab85b-7088-451e-a829-c9119f35dee0 2024-04-01T06:55:29.382 INFO:teuthology.orchestra.run.smithi083.stdout:osd.2 up in weight 1 up_from 18 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.153:6800/3318516728,v1:172.21.15.153:6801/3318516728] [v2:172.21.15.153:6802/3318516728,v1:172.21.15.153:6803/3318516728] exists,up d04c27f3-4972-4061-8bfb-5060645e3883 2024-04-01T06:55:29.382 INFO:teuthology.orchestra.run.smithi083.stdout:osd.3 up in weight 1 up_from 25 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.83:6810/504690234,v1:172.21.15.83:6811/504690234] [v2:172.21.15.83:6812/504690234,v1:172.21.15.83:6813/504690234] exists,up 899b6c90-8f2f-44dd-b807-49594aadb443 2024-04-01T06:55:29.382 INFO:teuthology.orchestra.run.smithi083.stdout:osd.4 up in weight 1 up_from 32 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.145:6808/2099824730,v1:172.21.15.145:6809/2099824730] [v2:172.21.15.145:6810/2099824730,v1:172.21.15.145:6811/2099824730] exists,up 5071dd81-804e-4358-bfb6-11e718e9cf4e 2024-04-01T06:55:29.382 INFO:teuthology.orchestra.run.smithi083.stdout:osd.5 up in weight 1 up_from 36 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.153:6808/3340941443,v1:172.21.15.153:6809/3340941443] [v2:172.21.15.153:6810/3340941443,v1:172.21.15.153:6811/3340941443] exists,up b8442b71-c26e-467f-b0c3-ea9f636f5a00 2024-04-01T06:55:29.382 INFO:teuthology.orchestra.run.smithi083.stdout:osd.6 up in weight 1 up_from 43 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.83:6818/2005485079,v1:172.21.15.83:6819/2005485079] [v2:172.21.15.83:6820/2005485079,v1:172.21.15.83:6821/2005485079] exists,up c26bb8cb-ccee-4bfc-91eb-14e1ad8e04df 2024-04-01T06:55:29.382 INFO:teuthology.orchestra.run.smithi083.stdout:osd.7 up in weight 1 up_from 48 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.145:6816/3737505059,v1:172.21.15.145:6817/3737505059] [v2:172.21.15.145:6818/3737505059,v1:172.21.15.145:6819/3737505059] exists,up a8940da2-0e79-4606-8d1e-d425afbf5753 2024-04-01T06:55:29.382 INFO:teuthology.orchestra.run.smithi083.stdout:osd.8 up in weight 1 up_from 55 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.153:6816/1031545791,v1:172.21.15.153:6817/1031545791] [v2:172.21.15.153:6818/1031545791,v1:172.21.15.153:6819/1031545791] exists,up 602d43ac-a189-4da3-9e38-7025d14e0dd4 2024-04-01T06:55:29.382 INFO:teuthology.orchestra.run.smithi083.stdout:osd.9 up in weight 1 up_from 62 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.83:6826/3720996673,v1:172.21.15.83:6827/3720996673] [v2:172.21.15.83:6828/3720996673,v1:172.21.15.83:6829/3720996673] exists,up 08b12d27-1247-45e4-9d09-cacc0fce4bd2 2024-04-01T06:55:29.382 INFO:teuthology.orchestra.run.smithi083.stdout:osd.10 up in weight 1 up_from 67 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.145:6824/2671529479,v1:172.21.15.145:6825/2671529479] [v2:172.21.15.145:6826/2671529479,v1:172.21.15.145:6827/2671529479] exists,up dd986b50-d68f-446c-9c66-261535880879 2024-04-01T06:55:29.382 INFO:teuthology.orchestra.run.smithi083.stdout:osd.11 up in weight 1 up_from 74 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.153:6824/2342548429,v1:172.21.15.153:6825/2342548429] [v2:172.21.15.153:6826/2342548429,v1:172.21.15.153:6827/2342548429] exists,up d20a49cd-6224-4424-8375-46da791d9931 2024-04-01T06:55:29.382 INFO:teuthology.orchestra.run.smithi083.stdout:blocklist 172.21.15.83:6801/1867137261 expires 2024-04-02T06:49:33.656125+0000 2024-04-01T06:55:29.383 INFO:teuthology.orchestra.run.smithi083.stdout:blocklist 172.21.15.83:0/2596683931 expires 2024-04-02T06:49:33.656125+0000 2024-04-01T06:55:29.383 INFO:teuthology.orchestra.run.smithi083.stdout:blocklist 172.21.15.83:0/2125339627 expires 2024-04-02T06:49:33.656125+0000 2024-04-01T06:55:29.383 INFO:teuthology.orchestra.run.smithi083.stdout:blocklist 172.21.15.83:6800/1644397953 expires 2024-04-02T06:49:13.456026+0000 2024-04-01T06:55:29.383 INFO:teuthology.orchestra.run.smithi083.stdout:blocklist 172.21.15.83:0/690500472 expires 2024-04-02T06:49:13.456026+0000 2024-04-01T06:55:29.383 INFO:teuthology.orchestra.run.smithi083.stdout:blocklist 172.21.15.83:6801/1644397953 expires 2024-04-02T06:49:13.456026+0000 2024-04-01T06:55:29.383 INFO:teuthology.orchestra.run.smithi083.stdout:blocklist 172.21.15.83:0/785958951 expires 2024-04-02T06:49:33.656125+0000 2024-04-01T06:55:29.383 INFO:teuthology.orchestra.run.smithi083.stdout:blocklist 172.21.15.83:6800/1867137261 expires 2024-04-02T06:49:33.656125+0000 2024-04-01T06:55:29.383 INFO:teuthology.orchestra.run.smithi083.stdout:blocklist 172.21.15.83:0/2222527447 expires 2024-04-02T06:49:13.456026+0000 2024-04-01T06:55:29.383 INFO:teuthology.orchestra.run.smithi083.stdout:blocklist 172.21.15.83:0/2071592157 expires 2024-04-02T06:49:13.456026+0000 2024-04-01T06:55:29.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.382+0000 7f986b523700 1 -- 172.21.15.83:0/781201704 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f98500a11b0 msgr2=0x7f98500a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:29.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.382+0000 7f986b523700 1 --2- 172.21.15.83:0/781201704 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f98500a11b0 0x7f98500a3670 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f985400b5c0 tx=0x7f9854003790 comp rx=0 tx=0).stop 2024-04-01T06:55:29.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.382+0000 7f986b523700 1 -- 172.21.15.83:0/781201704 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9864100e00 msgr2=0x7f9864074b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:29.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.382+0000 7f986b523700 1 --2- 172.21.15.83:0/781201704 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9864100e00 0x7f9864074b00 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f986000d950 tx=0x7f986000dc60 comp rx=0 tx=0).stop 2024-04-01T06:55:29.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.382+0000 7f986b523700 1 -- 172.21.15.83:0/781201704 shutdown_connections 2024-04-01T06:55:29.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.382+0000 7f986b523700 1 --2- 172.21.15.83:0/781201704 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9864100e00 0x7f9864074b00 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:29.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.382+0000 7f986b523700 1 --2- 172.21.15.83:0/781201704 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f98500a11b0 0x7f98500a3670 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:29.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.382+0000 7f986b523700 1 --2- 172.21.15.83:0/781201704 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9864102920 0x7f98640736e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:29.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.382+0000 7f986b523700 1 --2- 172.21.15.83:0/781201704 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9864101f60 0x7f98640731a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:29.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.382+0000 7f986b523700 1 -- 172.21.15.83:0/781201704 >> 172.21.15.83:0/781201704 conn(0x7f98640fc3c0 msgr2=0x7f9864105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:29.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.382+0000 7f986b523700 1 -- 172.21.15.83:0/781201704 shutdown_connections 2024-04-01T06:55:29.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.382+0000 7f986b523700 1 -- 172.21.15.83:0/781201704 wait complete. 2024-04-01T06:55:29.670 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:29 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/781201704' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-04-01T06:55:29.771 INFO:teuthology.run_tasks:Running task fs.ready... 2024-04-01T06:55:29.782 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T06:55:29.890 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:29 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/781201704' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-04-01T06:55:29.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.908+0000 7fd137b3d700 1 -- 172.21.15.83:0/88226617 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd130101720 msgr2=0x7fd130107fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:29.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.908+0000 7fd137b3d700 1 --2- 172.21.15.83:0/88226617 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd130101720 0x7fd130107fd0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd12800b0d0 tx=0x7fd12800b3e0 comp rx=0 tx=0).stop 2024-04-01T06:55:29.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.908+0000 7fd137b3d700 1 -- 172.21.15.83:0/88226617 shutdown_connections 2024-04-01T06:55:29.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.908+0000 7fd137b3d700 1 --2- 172.21.15.83:0/88226617 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd130101720 0x7fd130107fd0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:29.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.908+0000 7fd137b3d700 1 --2- 172.21.15.83:0/88226617 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd1300ffb90 0x7fd1300fffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:29.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.908+0000 7fd137b3d700 1 --2- 172.21.15.83:0/88226617 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd130100d80 0x7fd1301011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:29.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.908+0000 7fd137b3d700 1 -- 172.21.15.83:0/88226617 >> 172.21.15.83:0/88226617 conn(0x7fd1300fb100 msgr2=0x7fd1300fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:29.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.908+0000 7fd137b3d700 1 -- 172.21.15.83:0/88226617 shutdown_connections 2024-04-01T06:55:29.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.908+0000 7fd137b3d700 1 -- 172.21.15.83:0/88226617 wait complete. 2024-04-01T06:55:29.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.908+0000 7fd137b3d700 1 Processor -- start 2024-04-01T06:55:29.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.908+0000 7fd137b3d700 1 -- start start 2024-04-01T06:55:29.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.909+0000 7fd137b3d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1300ffb90 0x7fd130103ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:29.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.909+0000 7fd137b3d700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd130100d80 0x7fd130102160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:29.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.909+0000 7fd137b3d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd130101720 0x7fd1301026a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:29.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.909+0000 7fd137b3d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd130102e40 con 0x7fd1300ffb90 2024-04-01T06:55:29.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.909+0000 7fd137b3d700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd130102fb0 con 0x7fd130100d80 2024-04-01T06:55:29.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.909+0000 7fd137b3d700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1301a0d90 con 0x7fd130101720 2024-04-01T06:55:29.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.909+0000 7fd1358d9700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1300ffb90 0x7fd130103ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:29.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.909+0000 7fd1358d9700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1300ffb90 0x7fd130103ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:45234/0 (socket says 172.21.15.83:45234) 2024-04-01T06:55:29.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.909+0000 7fd1358d9700 1 -- 172.21.15.83:0/3931679353 learned_addr learned my addr 172.21.15.83:0/3931679353 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:29.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.909+0000 7fd1350d8700 1 --2- 172.21.15.83:0/3931679353 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd130100d80 0x7fd130102160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:29.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.909+0000 7fd1358d9700 1 -- 172.21.15.83:0/3931679353 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd130101720 msgr2=0x7fd1301026a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:29.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.909+0000 7fd1360da700 1 --2- 172.21.15.83:0/3931679353 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd130101720 0x7fd1301026a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:29.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.909+0000 7fd1358d9700 1 --2- 172.21.15.83:0/3931679353 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd130101720 0x7fd1301026a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:29.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.909+0000 7fd1358d9700 1 -- 172.21.15.83:0/3931679353 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd130100d80 msgr2=0x7fd130102160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:29.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.909+0000 7fd1358d9700 1 --2- 172.21.15.83:0/3931679353 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd130100d80 0x7fd130102160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:29.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.909+0000 7fd1358d9700 1 -- 172.21.15.83:0/3931679353 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd128009d00 con 0x7fd1300ffb90 2024-04-01T06:55:29.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.909+0000 7fd1350d8700 1 --2- 172.21.15.83:0/3931679353 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd130100d80 0x7fd130102160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:55:29.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.909+0000 7fd1358d9700 1 --2- 172.21.15.83:0/3931679353 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1300ffb90 0x7fd130103ad0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd12400d980 tx=0x7fd12400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:29.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.909+0000 7fd122ffd700 1 -- 172.21.15.83:0/3931679353 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12400bb00 con 0x7fd1300ffb90 2024-04-01T06:55:29.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.909+0000 7fd122ffd700 1 -- 172.21.15.83:0/3931679353 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd124007620 con 0x7fd1300ffb90 2024-04-01T06:55:29.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.909+0000 7fd137b3d700 1 -- 172.21.15.83:0/3931679353 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1301a0fc0 con 0x7fd1300ffb90 2024-04-01T06:55:29.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.909+0000 7fd122ffd700 1 -- 172.21.15.83:0/3931679353 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12400f3c0 con 0x7fd1300ffb90 2024-04-01T06:55:29.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.909+0000 7fd137b3d700 1 -- 172.21.15.83:0/3931679353 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1301a1490 con 0x7fd1300ffb90 2024-04-01T06:55:29.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.910+0000 7fd137b3d700 1 -- 172.21.15.83:0/3931679353 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd130067e60 con 0x7fd1300ffb90 2024-04-01T06:55:29.913 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.911+0000 7fd122ffd700 1 -- 172.21.15.83:0/3931679353 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7fd124010460 con 0x7fd1300ffb90 2024-04-01T06:55:29.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.912+0000 7fd122ffd700 1 --2- 172.21.15.83:0/3931679353 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd11c0a12b0 0x7fd11c0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:29.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.912+0000 7fd1350d8700 1 --2- 172.21.15.83:0/3931679353 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd11c0a12b0 0x7fd11c0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:29.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.912+0000 7fd122ffd700 1 -- 172.21.15.83:0/3931679353 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fd1240cd020 con 0x7fd1300ffb90 2024-04-01T06:55:29.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.912+0000 7fd1350d8700 1 --2- 172.21.15.83:0/3931679353 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd11c0a12b0 0x7fd11c0a3770 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd12c005e10 tx=0x7fd12c005d60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:29.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:29.915+0000 7fd122ffd700 1 -- 172.21.15.83:0/3931679353 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7fd124096700 con 0x7fd1300ffb90 2024-04-01T06:55:30.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:29 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/781201704' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-04-01T06:55:30.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.122+0000 7fd137b3d700 1 -- 172.21.15.83:0/3931679353 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd13010b620 con 0x7fd1300ffb90 2024-04-01T06:55:30.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.123+0000 7fd122ffd700 1 -- 172.21.15.83:0/3931679353 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+22131 (secure 0 0 0) 0x7fd124016090 con 0x7fd1300ffb90 2024-04-01T06:55:30.123 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:55:30.124 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":79,"fsid":"c6f8eff4-eff3-11ee-b647-cb9ed24678a4","created":"2024-04-01T06:48:42.033382+0000","modified":"2024-04-01T06:54:29.399277+0000","last_up_change":"2024-04-01T06:53:55.791339+0000","last_in_change":"2024-04-01T06:53:39.777214+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T06:51:21.963996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T06:54:26.450403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T06:54:27.564928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"90b761b0-b06c-4142-854d-38ee42aa6052","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6803","nonce":3253845390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6805","nonce":3253845390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6809","nonce":3253845390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6807","nonce":3253845390}]},"public_addr":"172.21.15.83:6803/3253845390","cluster_addr":"172.21.15.83:6805/3253845390","heartbeat_back_addr":"172.21.15.83:6809/3253845390","heartbeat_front_addr":"172.21.15.83:6807/3253845390","state":["exists","up"]},{"osd":1,"uuid":"4d6ab85b-7088-451e-a829-c9119f35dee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6801","nonce":515889759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6803","nonce":515889759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6807","nonce":515889759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6805","nonce":515889759}]},"public_addr":"172.21.15.145:6801/515889759","cluster_addr":"172.21.15.145:6803/515889759","heartbeat_back_addr":"172.21.15.145:6807/515889759","heartbeat_front_addr":"172.21.15.145:6805/515889759","state":["exists","up"]},{"osd":2,"uuid":"d04c27f3-4972-4061-8bfb-5060645e3883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6801","nonce":3318516728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6803","nonce":3318516728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6807","nonce":3318516728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6805","nonce":3318516728}]},"public_addr":"172.21.15.153:6801/3318516728","cluster_addr":"172.21.15.153:6803/3318516728","heartbeat_back_addr":"172.21.15.153:6807/3318516728","heartbeat_front_addr":"172.21.15.153:6805/3318516728","state":["exists","up"]},{"osd":3,"uuid":"899b6c90-8f2f-44dd-b807-49594aadb443","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6811","nonce":504690234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6813","nonce":504690234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6817","nonce":504690234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6815","nonce":504690234}]},"public_addr":"172.21.15.83:6811/504690234","cluster_addr":"172.21.15.83:6813/504690234","heartbeat_back_addr":"172.21.15.83:6817/504690234","heartbeat_front_addr":"172.21.15.83:6815/504690234","state":["exists","up"]},{"osd":4,"uuid":"5071dd81-804e-4358-bfb6-11e718e9cf4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6809","nonce":2099824730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6811","nonce":2099824730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6815","nonce":2099824730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6813","nonce":2099824730}]},"public_addr":"172.21.15.145:6809/2099824730","cluster_addr":"172.21.15.145:6811/2099824730","heartbeat_back_addr":"172.21.15.145:6815/2099824730","heartbeat_front_addr":"172.21.15.145:6813/2099824730","state":["exists","up"]},{"osd":5,"uuid":"b8442b71-c26e-467f-b0c3-ea9f636f5a00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6809","nonce":3340941443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6811","nonce":3340941443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6815","nonce":3340941443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6813","nonce":3340941443}]},"public_addr":"172.21.15.153:6809/3340941443","cluster_addr":"172.21.15.153:6811/3340941443","heartbeat_back_addr":"172.21.15.153:6815/3340941443","heartbeat_front_addr":"172.21.15.153:6813/3340941443","state":["exists","up"]},{"osd":6,"uuid":"c26bb8cb-ccee-4bfc-91eb-14e1ad8e04df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6819","nonce":2005485079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6821","nonce":2005485079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6825","nonce":2005485079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6823","nonce":2005485079}]},"public_addr":"172.21.15.83:6819/2005485079","cluster_addr":"172.21.15.83:6821/2005485079","heartbeat_back_addr":"172.21.15.83:6825/2005485079","heartbeat_front_addr":"172.21.15.83:6823/2005485079","state":["exists","up"]},{"osd":7,"uuid":"a8940da2-0e79-4606-8d1e-d425afbf5753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6817","nonce":3737505059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6819","nonce":3737505059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6823","nonce":3737505059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6821","nonce":3737505059}]},"public_addr":"172.21.15.145:6817/3737505059","cluster_addr":"172.21.15.145:6819/3737505059","heartbeat_back_addr":"172.21.15.145:6823/3737505059","heartbeat_front_addr":"172.21.15.145:6821/3737505059","state":["exists","up"]},{"osd":8,"uuid":"602d43ac-a189-4da3-9e38-7025d14e0dd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6817","nonce":1031545791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6819","nonce":1031545791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6823","nonce":1031545791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6821","nonce":1031545791}]},"public_addr":"172.21.15.153:6817/1031545791","cluster_addr":"172.21.15.153:6819/1031545791","heartbeat_back_addr":"172.21.15.153:6823/1031545791","heartbeat_front_addr":"172.21.15.153:6821/1031545791","state":["exists","up"]},{"osd":9,"uuid":"08b12d27-1247-45e4-9d09-cacc0fce4bd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6827","nonce":3720996673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6829","nonce":3720996673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6833","nonce":3720996673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6831","nonce":3720996673}]},"public_addr":"172.21.15.83:6827/3720996673","cluster_addr":"172.21.15.83:6829/3720996673","heartbeat_back_addr":"172.21.15.83:6833/3720996673","heartbeat_front_addr":"172.21.15.83:6831/3720996673","state":["exists","up"]},{"osd":10,"uuid":"dd986b50-d68f-446c-9c66-261535880879","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6825","nonce":2671529479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6827","nonce":2671529479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6831","nonce":2671529479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6829","nonce":2671529479}]},"public_addr":"172.21.15.145:6825/2671529479","cluster_addr":"172.21.15.145:6827/2671529479","heartbeat_back_addr":"172.21.15.145:6831/2671529479","heartbeat_front_addr":"172.21.15.145:6829/2671529479","state":["exists","up"]},{"osd":11,"uuid":"d20a49cd-6224-4424-8375-46da791d9931","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6825","nonce":2342548429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6827","nonce":2342548429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6831","nonce":2342548429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6829","nonce":2342548429}]},"public_addr":"172.21.15.153:6825/2342548429","cluster_addr":"172.21.15.153:6827/2342548429","heartbeat_back_addr":"172.21.15.153:6831/2342548429","heartbeat_front_addr":"172.21.15.153:6829/2342548429","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:50:44.539932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:01.990470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:19.054426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:36.616393+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:53.896705+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:10.667502+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:27.880849+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:45.276308+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:02.280615+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:19.555547+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:37.062881+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:54.191589+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.83:6801/1867137261":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/2596683931":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/2125339627":"2024-04-02T06:49:33.656125+0000","172.21.15.83:6800/1644397953":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/690500472":"2024-04-02T06:49:13.456026+0000","172.21.15.83:6801/1644397953":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/785958951":"2024-04-02T06:49:33.656125+0000","172.21.15.83:6800/1867137261":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/2222527447":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/2071592157":"2024-04-02T06:49:13.456026+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T06:55:30.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.126+0000 7fd137b3d700 1 -- 172.21.15.83:0/3931679353 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd11c0a12b0 msgr2=0x7fd11c0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:30.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.126+0000 7fd137b3d700 1 --2- 172.21.15.83:0/3931679353 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd11c0a12b0 0x7fd11c0a3770 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd12c005e10 tx=0x7fd12c005d60 comp rx=0 tx=0).stop 2024-04-01T06:55:30.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.126+0000 7fd137b3d700 1 -- 172.21.15.83:0/3931679353 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1300ffb90 msgr2=0x7fd130103ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:30.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.126+0000 7fd137b3d700 1 --2- 172.21.15.83:0/3931679353 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1300ffb90 0x7fd130103ad0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd12400d980 tx=0x7fd12400dd40 comp rx=0 tx=0).stop 2024-04-01T06:55:30.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.126+0000 7fd137b3d700 1 -- 172.21.15.83:0/3931679353 shutdown_connections 2024-04-01T06:55:30.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.126+0000 7fd137b3d700 1 --2- 172.21.15.83:0/3931679353 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1300ffb90 0x7fd130103ad0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:30.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.126+0000 7fd137b3d700 1 --2- 172.21.15.83:0/3931679353 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd11c0a12b0 0x7fd11c0a3770 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:30.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.126+0000 7fd137b3d700 1 --2- 172.21.15.83:0/3931679353 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd130101720 0x7fd1301026a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:30.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.126+0000 7fd137b3d700 1 --2- 172.21.15.83:0/3931679353 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd130100d80 0x7fd130102160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:30.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.126+0000 7fd137b3d700 1 -- 172.21.15.83:0/3931679353 >> 172.21.15.83:0/3931679353 conn(0x7fd1300fb100 msgr2=0x7fd1300fcb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:30.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.126+0000 7fd137b3d700 1 -- 172.21.15.83:0/3931679353 shutdown_connections 2024-04-01T06:55:30.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.126+0000 7fd137b3d700 1 -- 172.21.15.83:0/3931679353 wait complete. 2024-04-01T06:55:30.139 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-01T06:51:21.963996+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-01T06:54:26.450403+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-01T06:54:27.564928+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-01T06:55:30.139 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-01T06:55:30.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.265+0000 7f9eb291d700 1 -- 172.21.15.83:0/1680646502 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9eac101800 msgr2=0x7f9eac1080b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:30.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.265+0000 7f9eb291d700 1 --2- 172.21.15.83:0/1680646502 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9eac101800 0x7f9eac1080b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9ea400b0d0 tx=0x7f9ea400b3e0 comp rx=0 tx=0).stop 2024-04-01T06:55:30.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.265+0000 7f9eb291d700 1 -- 172.21.15.83:0/1680646502 shutdown_connections 2024-04-01T06:55:30.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.265+0000 7f9eb291d700 1 --2- 172.21.15.83:0/1680646502 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9eac101800 0x7f9eac1080b0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:30.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.265+0000 7f9eb291d700 1 --2- 172.21.15.83:0/1680646502 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9eac0ffc70 0x7f9eac100090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:30.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.265+0000 7f9eb291d700 1 --2- 172.21.15.83:0/1680646502 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9eac100e60 0x7f9eac1012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:30.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.265+0000 7f9eb291d700 1 -- 172.21.15.83:0/1680646502 >> 172.21.15.83:0/1680646502 conn(0x7f9eac0fb200 msgr2=0x7f9eac0fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:30.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.265+0000 7f9eb291d700 1 -- 172.21.15.83:0/1680646502 shutdown_connections 2024-04-01T06:55:30.265 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.265+0000 7f9eb291d700 1 -- 172.21.15.83:0/1680646502 wait complete. 2024-04-01T06:55:30.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.265+0000 7f9eb291d700 1 Processor -- start 2024-04-01T06:55:30.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.266+0000 7f9eb291d700 1 -- start start 2024-04-01T06:55:30.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.266+0000 7f9eb291d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9eac0ffc70 0x7f9eac195d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:30.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.266+0000 7f9eb291d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9eac100e60 0x7f9eac1962d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:30.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.266+0000 7f9eb291d700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9eac101800 0x7f9eac19d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:30.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.266+0000 7f9eb291d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac19d880 con 0x7f9eac0ffc70 2024-04-01T06:55:30.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.266+0000 7f9eb291d700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac19d9f0 con 0x7f9eac101800 2024-04-01T06:55:30.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.266+0000 7f9eb291d700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac19dbb0 con 0x7f9eac100e60 2024-04-01T06:55:30.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.266+0000 7f9eabfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9eac0ffc70 0x7f9eac195d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:30.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.266+0000 7f9eabfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9eac0ffc70 0x7f9eac195d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:45244/0 (socket says 172.21.15.83:45244) 2024-04-01T06:55:30.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.266+0000 7f9eabfff700 1 -- 172.21.15.83:0/3901540490 learned_addr learned my addr 172.21.15.83:0/3901540490 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:30.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.266+0000 7f9eb0eba700 1 --2- 172.21.15.83:0/3901540490 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9eac101800 0x7f9eac19d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:30.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.266+0000 7f9eab7fe700 1 --2- 172.21.15.83:0/3901540490 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9eac100e60 0x7f9eac1962d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:30.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.266+0000 7f9eabfff700 1 -- 172.21.15.83:0/3901540490 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9eac100e60 msgr2=0x7f9eac1962d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:30.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.266+0000 7f9eabfff700 1 --2- 172.21.15.83:0/3901540490 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9eac100e60 0x7f9eac1962d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:30.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.266+0000 7f9eabfff700 1 -- 172.21.15.83:0/3901540490 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9eac101800 msgr2=0x7f9eac19d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:30.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.266+0000 7f9eabfff700 1 --2- 172.21.15.83:0/3901540490 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9eac101800 0x7f9eac19d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:30.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.266+0000 7f9eabfff700 1 -- 172.21.15.83:0/3901540490 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea4009d00 con 0x7f9eac0ffc70 2024-04-01T06:55:30.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.266+0000 7f9eb0eba700 1 --2- 172.21.15.83:0/3901540490 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9eac101800 0x7f9eac19d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:55:30.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.267+0000 7f9eabfff700 1 --2- 172.21.15.83:0/3901540490 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9eac0ffc70 0x7f9eac195d90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9ea000b500 tx=0x7f9ea000b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:30.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.267+0000 7f9ea97fa700 1 -- 172.21.15.83:0/3901540490 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea000f8a0 con 0x7f9eac0ffc70 2024-04-01T06:55:30.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.267+0000 7f9eb291d700 1 -- 172.21.15.83:0/3901540490 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eac0692b0 con 0x7f9eac0ffc70 2024-04-01T06:55:30.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.267+0000 7f9ea97fa700 1 -- 172.21.15.83:0/3901540490 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9ea0010470 con 0x7f9eac0ffc70 2024-04-01T06:55:30.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.267+0000 7f9ea97fa700 1 -- 172.21.15.83:0/3901540490 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea0019660 con 0x7f9eac0ffc70 2024-04-01T06:55:30.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.267+0000 7f9eb291d700 1 -- 172.21.15.83:0/3901540490 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eac069770 con 0x7f9eac0ffc70 2024-04-01T06:55:30.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.268+0000 7f9eb291d700 1 -- 172.21.15.83:0/3901540490 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eac067f40 con 0x7f9eac0ffc70 2024-04-01T06:55:30.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.269+0000 7f9ea97fa700 1 -- 172.21.15.83:0/3901540490 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f9ea00105e0 con 0x7f9eac0ffc70 2024-04-01T06:55:30.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.269+0000 7f9ea97fa700 1 --2- 172.21.15.83:0/3901540490 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f9e940a11b0 0x7f9e940a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:30.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.269+0000 7f9ea97fa700 1 -- 172.21.15.83:0/3901540490 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f9ea00ce320 con 0x7f9eac0ffc70 2024-04-01T06:55:30.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.269+0000 7f9eab7fe700 1 --2- 172.21.15.83:0/3901540490 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f9e940a11b0 0x7f9e940a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:30.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.270+0000 7f9eab7fe700 1 --2- 172.21.15.83:0/3901540490 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f9e940a11b0 0x7f9e940a3670 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c005950 tx=0x7f9e9c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:30.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.273+0000 7f9ea97fa700 1 -- 172.21.15.83:0/3901540490 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f9ea0097b10 con 0x7f9eac0ffc70 2024-04-01T06:55:30.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.468+0000 7f9eb291d700 1 -- 172.21.15.83:0/3901540490 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9eac10b700 con 0x7f9eac0ffc70 2024-04-01T06:55:30.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.468+0000 7f9ea97fa700 1 -- 172.21.15.83:0/3901540490 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9ea009b130 con 0x7f9eac0ffc70 2024-04-01T06:55:30.468 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 1 2024-04-01T06:55:30.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.470+0000 7f9eb291d700 1 -- 172.21.15.83:0/3901540490 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f9e940a11b0 msgr2=0x7f9e940a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:30.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.470+0000 7f9eb291d700 1 --2- 172.21.15.83:0/3901540490 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f9e940a11b0 0x7f9e940a3670 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c005950 tx=0x7f9e9c0058e0 comp rx=0 tx=0).stop 2024-04-01T06:55:30.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.470+0000 7f9eb291d700 1 -- 172.21.15.83:0/3901540490 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9eac0ffc70 msgr2=0x7f9eac195d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:30.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.470+0000 7f9eb291d700 1 --2- 172.21.15.83:0/3901540490 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9eac0ffc70 0x7f9eac195d90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9ea000b500 tx=0x7f9ea000b8c0 comp rx=0 tx=0).stop 2024-04-01T06:55:30.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.470+0000 7f9eb291d700 1 -- 172.21.15.83:0/3901540490 shutdown_connections 2024-04-01T06:55:30.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.470+0000 7f9eb291d700 1 --2- 172.21.15.83:0/3901540490 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9eac0ffc70 0x7f9eac195d90 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:30.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.471+0000 7f9eb291d700 1 --2- 172.21.15.83:0/3901540490 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f9e940a11b0 0x7f9e940a3670 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:30.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.471+0000 7f9eb291d700 1 --2- 172.21.15.83:0/3901540490 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9eac101800 0x7f9eac19d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:30.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.471+0000 7f9eb291d700 1 --2- 172.21.15.83:0/3901540490 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9eac100e60 0x7f9eac1962d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:30.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.471+0000 7f9eb291d700 1 -- 172.21.15.83:0/3901540490 >> 172.21.15.83:0/3901540490 conn(0x7f9eac0fb200 msgr2=0x7f9eac104160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:30.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.471+0000 7f9eb291d700 1 -- 172.21.15.83:0/3901540490 shutdown_connections 2024-04-01T06:55:30.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.471+0000 7f9eb291d700 1 -- 172.21.15.83:0/3901540490 wait complete. 2024-04-01T06:55:30.483 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-01T06:55:30.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.609+0000 7f3bd4bbc700 1 -- 172.21.15.83:0/4244857585 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3bd01017e0 msgr2=0x7f3bd0103bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:30.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.609+0000 7f3bd4bbc700 1 --2- 172.21.15.83:0/4244857585 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3bd01017e0 0x7f3bd0103bd0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0009990 tx=0x7f3bc0009ca0 comp rx=0 tx=0).stop 2024-04-01T06:55:30.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.610+0000 7f3bd4bbc700 1 -- 172.21.15.83:0/4244857585 shutdown_connections 2024-04-01T06:55:30.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.610+0000 7f3bd4bbc700 1 --2- 172.21.15.83:0/4244857585 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3bd01017e0 0x7f3bd0103bd0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:30.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.610+0000 7f3bd4bbc700 1 --2- 172.21.15.83:0/4244857585 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3bd0106a40 0x7f3bd0108eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:30.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.610+0000 7f3bd4bbc700 1 --2- 172.21.15.83:0/4244857585 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3bd0104110 0x7f3bd0106500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:30.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.610+0000 7f3bd4bbc700 1 -- 172.21.15.83:0/4244857585 >> 172.21.15.83:0/4244857585 conn(0x7f3bd00fb1d0 msgr2=0x7f3bd00fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:30.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.610+0000 7f3bd4bbc700 1 -- 172.21.15.83:0/4244857585 shutdown_connections 2024-04-01T06:55:30.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.610+0000 7f3bd4bbc700 1 -- 172.21.15.83:0/4244857585 wait complete. 2024-04-01T06:55:30.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.610+0000 7f3bd4bbc700 1 Processor -- start 2024-04-01T06:55:30.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.610+0000 7f3bd4bbc700 1 -- start start 2024-04-01T06:55:30.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.610+0000 7f3bd4bbc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3bd01017e0 0x7f3bd0196c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:30.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.610+0000 7f3bd4bbc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3bd0104110 0x7f3bd0197160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:30.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.610+0000 7f3bd4bbc700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3bd0106a40 0x7f3bd019e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:30.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.611+0000 7f3bd4bbc700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd019e750 con 0x7f3bd0104110 2024-04-01T06:55:30.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.611+0000 7f3bd4bbc700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd019e890 con 0x7f3bd0106a40 2024-04-01T06:55:30.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.611+0000 7f3bd4bbc700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd019ea20 con 0x7f3bd01017e0 2024-04-01T06:55:30.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.611+0000 7f3bcdd9b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3bd0104110 0x7f3bd0197160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:30.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.611+0000 7f3bcdd9b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3bd0104110 0x7f3bd0197160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:45254/0 (socket says 172.21.15.83:45254) 2024-04-01T06:55:30.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.611+0000 7f3bcdd9b700 1 -- 172.21.15.83:0/1925688076 learned_addr learned my addr 172.21.15.83:0/1925688076 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:30.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.611+0000 7f3bce59c700 1 --2- 172.21.15.83:0/1925688076 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3bd01017e0 0x7f3bd0196c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:30.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.611+0000 7f3bced9d700 1 --2- 172.21.15.83:0/1925688076 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3bd0106a40 0x7f3bd019e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:30.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.611+0000 7f3bcdd9b700 1 -- 172.21.15.83:0/1925688076 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3bd01017e0 msgr2=0x7f3bd0196c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:30.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.611+0000 7f3bcdd9b700 1 --2- 172.21.15.83:0/1925688076 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3bd01017e0 0x7f3bd0196c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:30.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.611+0000 7f3bcdd9b700 1 -- 172.21.15.83:0/1925688076 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3bd0106a40 msgr2=0x7f3bd019e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:30.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.611+0000 7f3bcdd9b700 1 --2- 172.21.15.83:0/1925688076 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3bd0106a40 0x7f3bd019e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:30.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.611+0000 7f3bcdd9b700 1 -- 172.21.15.83:0/1925688076 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc00095f0 con 0x7f3bd0104110 2024-04-01T06:55:30.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.611+0000 7f3bcdd9b700 1 --2- 172.21.15.83:0/1925688076 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3bd0104110 0x7f3bd0197160 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3bc400c9b0 tx=0x7f3bc400ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:30.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.611+0000 7f3bbf7fe700 1 -- 172.21.15.83:0/1925688076 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc4007b00 con 0x7f3bd0104110 2024-04-01T06:55:30.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.611+0000 7f3bbf7fe700 1 -- 172.21.15.83:0/1925688076 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3bc4007c60 con 0x7f3bd0104110 2024-04-01T06:55:30.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.611+0000 7f3bd4bbc700 1 -- 172.21.15.83:0/1925688076 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bd019ed00 con 0x7f3bd0104110 2024-04-01T06:55:30.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.611+0000 7f3bbf7fe700 1 -- 172.21.15.83:0/1925688076 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc4018660 con 0x7f3bd0104110 2024-04-01T06:55:30.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.611+0000 7f3bd4bbc700 1 -- 172.21.15.83:0/1925688076 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bd019f1c0 con 0x7f3bd0104110 2024-04-01T06:55:30.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.612+0000 7f3bd4bbc700 1 -- 172.21.15.83:0/1925688076 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bd00fcd50 con 0x7f3bd0104110 2024-04-01T06:55:30.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.613+0000 7f3bbf7fe700 1 -- 172.21.15.83:0/1925688076 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f3bc400f450 con 0x7f3bd0104110 2024-04-01T06:55:30.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.614+0000 7f3bbf7fe700 1 --2- 172.21.15.83:0/1925688076 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f3bb80a11b0 0x7f3bb80a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:30.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.614+0000 7f3bce59c700 1 --2- 172.21.15.83:0/1925688076 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f3bb80a11b0 0x7f3bb80a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:30.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.614+0000 7f3bbf7fe700 1 -- 172.21.15.83:0/1925688076 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f3bc40ccaf0 con 0x7f3bd0104110 2024-04-01T06:55:30.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.614+0000 7f3bce59c700 1 --2- 172.21.15.83:0/1925688076 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f3bb80a11b0 0x7f3bb80a3670 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3bc000b5c0 tx=0x7f3bc0003790 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:30.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.617+0000 7f3bbf7fe700 1 -- 172.21.15.83:0/1925688076 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f3bc4096360 con 0x7f3bd0104110 2024-04-01T06:55:30.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:30 smithi083 ceph-mon[43429]: pgmap v247: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-01T06:55:30.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:30 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/3931679353' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T06:55:30.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:30 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/3901540490' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-01T06:55:30.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.813+0000 7f3bd4bbc700 1 -- 172.21.15.83:0/1925688076 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3bd010c650 con 0x7f3bd0104110 2024-04-01T06:55:30.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.813+0000 7f3bbf7fe700 1 -- 172.21.15.83:0/1925688076 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v79) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3bc4099980 con 0x7f3bd0104110 2024-04-01T06:55:30.813 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 32 2024-04-01T06:55:30.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.815+0000 7f3bd4bbc700 1 -- 172.21.15.83:0/1925688076 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f3bb80a11b0 msgr2=0x7f3bb80a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:30.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.815+0000 7f3bd4bbc700 1 --2- 172.21.15.83:0/1925688076 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f3bb80a11b0 0x7f3bb80a3670 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3bc000b5c0 tx=0x7f3bc0003790 comp rx=0 tx=0).stop 2024-04-01T06:55:30.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.815+0000 7f3bd4bbc700 1 -- 172.21.15.83:0/1925688076 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3bd0104110 msgr2=0x7f3bd0197160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:30.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.815+0000 7f3bd4bbc700 1 --2- 172.21.15.83:0/1925688076 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3bd0104110 0x7f3bd0197160 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3bc400c9b0 tx=0x7f3bc400ccc0 comp rx=0 tx=0).stop 2024-04-01T06:55:30.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.815+0000 7f3bd4bbc700 1 -- 172.21.15.83:0/1925688076 shutdown_connections 2024-04-01T06:55:30.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.815+0000 7f3bd4bbc700 1 --2- 172.21.15.83:0/1925688076 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f3bb80a11b0 0x7f3bb80a3670 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:30.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.815+0000 7f3bd4bbc700 1 --2- 172.21.15.83:0/1925688076 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3bd0106a40 0x7f3bd019e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:30.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.815+0000 7f3bd4bbc700 1 --2- 172.21.15.83:0/1925688076 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3bd01017e0 0x7f3bd0196c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:30.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.815+0000 7f3bd4bbc700 1 --2- 172.21.15.83:0/1925688076 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3bd0104110 0x7f3bd0197160 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:30.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.815+0000 7f3bd4bbc700 1 -- 172.21.15.83:0/1925688076 >> 172.21.15.83:0/1925688076 conn(0x7f3bd00fb1d0 msgr2=0x7f3bd0102380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:30.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.815+0000 7f3bd4bbc700 1 -- 172.21.15.83:0/1925688076 shutdown_connections 2024-04-01T06:55:30.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.815+0000 7f3bd4bbc700 1 -- 172.21.15.83:0/1925688076 wait complete. 2024-04-01T06:55:30.827 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-01T06:55:30.890 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:30 smithi153 ceph-mon[48187]: pgmap v247: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-01T06:55:30.890 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:30 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/3931679353' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T06:55:30.890 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:30 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/3901540490' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-01T06:55:30.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.954+0000 7f5db0b62700 1 -- 172.21.15.83:0/2389686996 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dac102910 msgr2=0x7f5dac1091c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:30.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.954+0000 7f5db0b62700 1 --2- 172.21.15.83:0/2389686996 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dac102910 0x7f5dac1091c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5da400b0d0 tx=0x7f5da400b3e0 comp rx=0 tx=0).stop 2024-04-01T06:55:30.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.954+0000 7f5db0b62700 1 -- 172.21.15.83:0/2389686996 shutdown_connections 2024-04-01T06:55:30.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.954+0000 7f5db0b62700 1 --2- 172.21.15.83:0/2389686996 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dac102910 0x7f5dac1091c0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:30.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.954+0000 7f5db0b62700 1 --2- 172.21.15.83:0/2389686996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5dac100d80 0x7f5dac1011a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:30.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.954+0000 7f5db0b62700 1 --2- 172.21.15.83:0/2389686996 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5dac101f70 0x7f5dac1023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:30.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.954+0000 7f5db0b62700 1 -- 172.21.15.83:0/2389686996 >> 172.21.15.83:0/2389686996 conn(0x7f5dac0fc2f0 msgr2=0x7f5dac0fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:30.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.954+0000 7f5db0b62700 1 -- 172.21.15.83:0/2389686996 shutdown_connections 2024-04-01T06:55:30.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.954+0000 7f5db0b62700 1 -- 172.21.15.83:0/2389686996 wait complete. 2024-04-01T06:55:30.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.954+0000 7f5db0b62700 1 Processor -- start 2024-04-01T06:55:30.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.955+0000 7f5db0b62700 1 -- start start 2024-04-01T06:55:30.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.955+0000 7f5db0b62700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dac100d80 0x7f5dac196e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:30.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.955+0000 7f5db0b62700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5dac101f70 0x7f5dac197380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:30.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.955+0000 7f5db0b62700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5dac102910 0x7f5dac19e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:30.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.955+0000 7f5db0b62700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dac19e970 con 0x7f5dac100d80 2024-04-01T06:55:30.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.955+0000 7f5db0b62700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dac19eab0 con 0x7f5dac101f70 2024-04-01T06:55:30.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.955+0000 7f5db0b62700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dac19ec40 con 0x7f5dac102910 2024-04-01T06:55:30.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.955+0000 7f5daa59c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dac100d80 0x7f5dac196e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:30.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.955+0000 7f5daa59c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dac100d80 0x7f5dac196e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:45278/0 (socket says 172.21.15.83:45278) 2024-04-01T06:55:30.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.955+0000 7f5daa59c700 1 -- 172.21.15.83:0/2247664695 learned_addr learned my addr 172.21.15.83:0/2247664695 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:30.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.955+0000 7f5daad9d700 1 --2- 172.21.15.83:0/2247664695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5dac102910 0x7f5dac19e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:30.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.955+0000 7f5da9d9b700 1 --2- 172.21.15.83:0/2247664695 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5dac101f70 0x7f5dac197380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:30.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.955+0000 7f5daa59c700 1 -- 172.21.15.83:0/2247664695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5dac102910 msgr2=0x7f5dac19e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:30.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.955+0000 7f5daa59c700 1 --2- 172.21.15.83:0/2247664695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5dac102910 0x7f5dac19e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:30.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.955+0000 7f5daa59c700 1 -- 172.21.15.83:0/2247664695 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5dac101f70 msgr2=0x7f5dac197380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:30.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.955+0000 7f5daa59c700 1 --2- 172.21.15.83:0/2247664695 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5dac101f70 0x7f5dac197380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:30.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.955+0000 7f5daa59c700 1 -- 172.21.15.83:0/2247664695 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da4009d00 con 0x7f5dac100d80 2024-04-01T06:55:30.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.955+0000 7f5daa59c700 1 --2- 172.21.15.83:0/2247664695 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dac100d80 0x7f5dac196e40 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5da000b500 tx=0x7f5da000b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:30.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.955+0000 7f5d9b7fe700 1 -- 172.21.15.83:0/2247664695 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da0011830 con 0x7f5dac100d80 2024-04-01T06:55:30.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.955+0000 7f5db0b62700 1 -- 172.21.15.83:0/2247664695 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dac19ef20 con 0x7f5dac100d80 2024-04-01T06:55:30.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.955+0000 7f5d9b7fe700 1 -- 172.21.15.83:0/2247664695 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5da0011e50 con 0x7f5dac100d80 2024-04-01T06:55:30.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.955+0000 7f5d9b7fe700 1 -- 172.21.15.83:0/2247664695 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da000f2e0 con 0x7f5dac100d80 2024-04-01T06:55:30.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.955+0000 7f5db0b62700 1 -- 172.21.15.83:0/2247664695 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dac19f350 con 0x7f5dac100d80 2024-04-01T06:55:30.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.956+0000 7f5db0b62700 1 -- 172.21.15.83:0/2247664695 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dac108130 con 0x7f5dac100d80 2024-04-01T06:55:30.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.957+0000 7f5d9b7fe700 1 -- 172.21.15.83:0/2247664695 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f5da0010580 con 0x7f5dac100d80 2024-04-01T06:55:30.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.958+0000 7f5d9b7fe700 1 --2- 172.21.15.83:0/2247664695 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f5d940a11b0 0x7f5d940a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:30.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.958+0000 7f5da9d9b700 1 --2- 172.21.15.83:0/2247664695 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f5d940a11b0 0x7f5d940a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:30.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.958+0000 7f5d9b7fe700 1 -- 172.21.15.83:0/2247664695 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f5da00cc810 con 0x7f5dac100d80 2024-04-01T06:55:30.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.958+0000 7f5da9d9b700 1 --2- 172.21.15.83:0/2247664695 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f5d940a11b0 0x7f5d940a3670 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c005fd0 tx=0x7f5d9c00a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:30.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:30.961+0000 7f5d9b7fe700 1 -- 172.21.15.83:0/2247664695 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f5da0096100 con 0x7f5dac100d80 2024-04-01T06:55:31.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:30 smithi145 ceph-mon[47816]: pgmap v247: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-01T06:55:31.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:30 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/3931679353' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T06:55:31.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:30 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/3901540490' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-01T06:55:31.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.158+0000 7f5db0b62700 1 -- 172.21.15.83:0/2247664695 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5dac10c7c0 con 0x7f5dac100d80 2024-04-01T06:55:31.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.158+0000 7f5d9b7fe700 1 -- 172.21.15.83:0/2247664695 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v79) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5da00150a0 con 0x7f5dac100d80 2024-04-01T06:55:31.159 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 64 2024-04-01T06:55:31.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.160+0000 7f5db0b62700 1 -- 172.21.15.83:0/2247664695 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f5d940a11b0 msgr2=0x7f5d940a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:31.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.160+0000 7f5db0b62700 1 --2- 172.21.15.83:0/2247664695 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f5d940a11b0 0x7f5d940a3670 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c005fd0 tx=0x7f5d9c00a560 comp rx=0 tx=0).stop 2024-04-01T06:55:31.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.160+0000 7f5db0b62700 1 -- 172.21.15.83:0/2247664695 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dac100d80 msgr2=0x7f5dac196e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:31.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.160+0000 7f5db0b62700 1 --2- 172.21.15.83:0/2247664695 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dac100d80 0x7f5dac196e40 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5da000b500 tx=0x7f5da000b8c0 comp rx=0 tx=0).stop 2024-04-01T06:55:31.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.160+0000 7f5db0b62700 1 -- 172.21.15.83:0/2247664695 shutdown_connections 2024-04-01T06:55:31.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.160+0000 7f5db0b62700 1 --2- 172.21.15.83:0/2247664695 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5dac100d80 0x7f5dac196e40 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:31.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.160+0000 7f5db0b62700 1 --2- 172.21.15.83:0/2247664695 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f5d940a11b0 0x7f5d940a3670 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:31.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.160+0000 7f5db0b62700 1 --2- 172.21.15.83:0/2247664695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5dac102910 0x7f5dac19e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:31.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.160+0000 7f5db0b62700 1 --2- 172.21.15.83:0/2247664695 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5dac101f70 0x7f5dac197380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:31.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.160+0000 7f5db0b62700 1 -- 172.21.15.83:0/2247664695 >> 172.21.15.83:0/2247664695 conn(0x7f5dac0fc2f0 msgr2=0x7f5dac105270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:31.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.161+0000 7f5db0b62700 1 -- 172.21.15.83:0/2247664695 shutdown_connections 2024-04-01T06:55:31.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.161+0000 7f5db0b62700 1 -- 172.21.15.83:0/2247664695 wait complete. 2024-04-01T06:55:31.173 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T06:55:31.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.295+0000 7fdc79246700 1 -- 172.21.15.83:0/865509272 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc740fece0 msgr2=0x7fdc740ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:31.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.295+0000 7fdc79246700 1 --2- 172.21.15.83:0/865509272 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc740fece0 0x7fdc740ff140 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fdc640099c0 tx=0x7fdc64009cd0 comp rx=0 tx=0).stop 2024-04-01T06:55:31.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.295+0000 7fdc79246700 1 -- 172.21.15.83:0/865509272 shutdown_connections 2024-04-01T06:55:31.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.295+0000 7fdc79246700 1 --2- 172.21.15.83:0/865509272 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc740ff680 0x7fdc74109250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:31.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.295+0000 7fdc79246700 1 --2- 172.21.15.83:0/865509272 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc74102270 0x7fdc74102690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:31.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.295+0000 7fdc79246700 1 --2- 172.21.15.83:0/865509272 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc740fece0 0x7fdc740ff140 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:31.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.295+0000 7fdc79246700 1 -- 172.21.15.83:0/865509272 >> 172.21.15.83:0/865509272 conn(0x7fdc740fa880 msgr2=0x7fdc740fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:31.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.295+0000 7fdc79246700 1 -- 172.21.15.83:0/865509272 shutdown_connections 2024-04-01T06:55:31.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.295+0000 7fdc79246700 1 -- 172.21.15.83:0/865509272 wait complete. 2024-04-01T06:55:31.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.295+0000 7fdc79246700 1 Processor -- start 2024-04-01T06:55:31.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.296+0000 7fdc79246700 1 -- start start 2024-04-01T06:55:31.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.296+0000 7fdc79246700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc740fece0 0x7fdc74196b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:31.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.296+0000 7fdc79246700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc740ff680 0x7fdc741970d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:31.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.296+0000 7fdc79246700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc74102270 0x7fdc7419e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:31.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.296+0000 7fdc79246700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7419e6c0 con 0x7fdc740fece0 2024-04-01T06:55:31.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.296+0000 7fdc79246700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7419e800 con 0x7fdc740ff680 2024-04-01T06:55:31.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.296+0000 7fdc79246700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7419e990 con 0x7fdc74102270 2024-04-01T06:55:31.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.296+0000 7fdc72d9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc740fece0 0x7fdc74196b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:31.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.296+0000 7fdc72d9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc740fece0 0x7fdc74196b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:45296/0 (socket says 172.21.15.83:45296) 2024-04-01T06:55:31.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.296+0000 7fdc72d9d700 1 -- 172.21.15.83:0/3289731818 learned_addr learned my addr 172.21.15.83:0/3289731818 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:31.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.296+0000 7fdc7359e700 1 --2- 172.21.15.83:0/3289731818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc74102270 0x7fdc7419e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:31.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.296+0000 7fdc7259c700 1 --2- 172.21.15.83:0/3289731818 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc740ff680 0x7fdc741970d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:31.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.296+0000 7fdc72d9d700 1 -- 172.21.15.83:0/3289731818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc74102270 msgr2=0x7fdc7419e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:31.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.296+0000 7fdc72d9d700 1 --2- 172.21.15.83:0/3289731818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc74102270 0x7fdc7419e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:31.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.296+0000 7fdc72d9d700 1 -- 172.21.15.83:0/3289731818 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc740ff680 msgr2=0x7fdc741970d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:31.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.296+0000 7fdc72d9d700 1 --2- 172.21.15.83:0/3289731818 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc740ff680 0x7fdc741970d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:31.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.296+0000 7fdc72d9d700 1 -- 172.21.15.83:0/3289731818 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc640095f0 con 0x7fdc740fece0 2024-04-01T06:55:31.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.296+0000 7fdc7259c700 1 --2- 172.21.15.83:0/3289731818 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc740ff680 0x7fdc741970d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:55:31.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.296+0000 7fdc72d9d700 1 --2- 172.21.15.83:0/3289731818 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc740fece0 0x7fdc74196b90 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fdc6800c990 tx=0x7fdc6800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:31.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.297+0000 7fdc5bfff700 1 -- 172.21.15.83:0/3289731818 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc68007b00 con 0x7fdc740fece0 2024-04-01T06:55:31.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.297+0000 7fdc79246700 1 -- 172.21.15.83:0/3289731818 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc7419ec70 con 0x7fdc740fece0 2024-04-01T06:55:31.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.297+0000 7fdc5bfff700 1 -- 172.21.15.83:0/3289731818 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdc68007c60 con 0x7fdc740fece0 2024-04-01T06:55:31.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.297+0000 7fdc5bfff700 1 -- 172.21.15.83:0/3289731818 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6800fea0 con 0x7fdc740fece0 2024-04-01T06:55:31.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.297+0000 7fdc79246700 1 -- 172.21.15.83:0/3289731818 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc7419f1d0 con 0x7fdc740fece0 2024-04-01T06:55:31.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.298+0000 7fdc79246700 1 -- 172.21.15.83:0/3289731818 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc74108160 con 0x7fdc740fece0 2024-04-01T06:55:31.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.299+0000 7fdc5bfff700 1 -- 172.21.15.83:0/3289731818 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7fdc6800f450 con 0x7fdc740fece0 2024-04-01T06:55:31.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.299+0000 7fdc5bfff700 1 --2- 172.21.15.83:0/3289731818 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fdc5c0a11b0 0x7fdc5c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:31.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.300+0000 7fdc7259c700 1 --2- 172.21.15.83:0/3289731818 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fdc5c0a11b0 0x7fdc5c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:31.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.300+0000 7fdc5bfff700 1 -- 172.21.15.83:0/3289731818 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fdc680cc820 con 0x7fdc740fece0 2024-04-01T06:55:31.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.300+0000 7fdc7259c700 1 --2- 172.21.15.83:0/3289731818 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fdc5c0a11b0 0x7fdc5c0a3670 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fdc64003820 tx=0x7fdc64009f10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:31.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.304+0000 7fdc5bfff700 1 -- 172.21.15.83:0/3289731818 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7fdc68096000 con 0x7fdc740fece0 2024-04-01T06:55:31.543 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.543+0000 7fdc79246700 1 -- 172.21.15.83:0/3289731818 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdc74067e60 con 0x7fdc740fece0 2024-04-01T06:55:31.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.544+0000 7fdc5bfff700 1 -- 172.21.15.83:0/3289731818 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+10876 (secure 0 0 0) 0x7fdc68099620 con 0x7fdc740fece0 2024-04-01T06:55:31.544 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:55:31.544 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1271130478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1271130478},{"type":"v1","addr":"172.21.15.83:6835","nonce":1271130478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2412682983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2412682983},{"type":"v1","addr":"172.21.15.83:6837","nonce":2412682983}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6839/3348145990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":3348145990},{"type":"v1","addr":"172.21.15.83:6839","nonce":3348145990}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6841/1191267445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6840","nonce":1191267445},{"type":"v1","addr":"172.21.15.83:6841","nonce":1191267445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2467459028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2467459028},{"type":"v1","addr":"172.21.15.153:6833","nonce":2467459028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24448,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4092629042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":4092629042},{"type":"v1","addr":"172.21.15.153:6835","nonce":4092629042}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-01T06:54:28.397062+0000","modified":"2024-04-01T06:54:33.704443+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24524,"mds_1":24494,"mds_2":24473},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6833/647005844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":647005844},{"type":"v1","addr":"172.21.15.145:6833","nonce":647005844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24454":{"gid":24454,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6837/1993816527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1993816527},{"type":"v1","addr":"172.21.15.153:6837","nonce":1993816527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6839/1399754640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1399754640},{"type":"v1","addr":"172.21.15.153:6839","nonce":1399754640}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24473":{"gid":24473,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.145:6835/3104241497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":3104241497},{"type":"v1","addr":"172.21.15.145:6835","nonce":3104241497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24494":{"gid":24494,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.145:6837/2687798317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2687798317},{"type":"v1","addr":"172.21.15.145:6837","nonce":2687798317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6839/3886435411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3886435411},{"type":"v1","addr":"172.21.15.145:6839","nonce":3886435411}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-01T06:55:31.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.546+0000 7fdc79246700 1 -- 172.21.15.83:0/3289731818 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fdc5c0a11b0 msgr2=0x7fdc5c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:31.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.546+0000 7fdc79246700 1 --2- 172.21.15.83:0/3289731818 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fdc5c0a11b0 0x7fdc5c0a3670 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fdc64003820 tx=0x7fdc64009f10 comp rx=0 tx=0).stop 2024-04-01T06:55:31.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.546+0000 7fdc79246700 1 -- 172.21.15.83:0/3289731818 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc740fece0 msgr2=0x7fdc74196b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:31.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.546+0000 7fdc79246700 1 --2- 172.21.15.83:0/3289731818 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc740fece0 0x7fdc74196b90 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fdc6800c990 tx=0x7fdc6800cca0 comp rx=0 tx=0).stop 2024-04-01T06:55:31.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.546+0000 7fdc79246700 1 -- 172.21.15.83:0/3289731818 shutdown_connections 2024-04-01T06:55:31.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.546+0000 7fdc79246700 1 --2- 172.21.15.83:0/3289731818 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc740fece0 0x7fdc74196b90 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:31.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.546+0000 7fdc79246700 1 --2- 172.21.15.83:0/3289731818 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fdc5c0a11b0 0x7fdc5c0a3670 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:31.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.546+0000 7fdc79246700 1 --2- 172.21.15.83:0/3289731818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdc74102270 0x7fdc7419e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:31.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.546+0000 7fdc79246700 1 --2- 172.21.15.83:0/3289731818 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc740ff680 0x7fdc741970d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:31.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.546+0000 7fdc79246700 1 -- 172.21.15.83:0/3289731818 >> 172.21.15.83:0/3289731818 conn(0x7fdc740fa880 msgr2=0x7fdc741052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:31.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.546+0000 7fdc79246700 1 -- 172.21.15.83:0/3289731818 shutdown_connections 2024-04-01T06:55:31.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.546+0000 7fdc79246700 1 -- 172.21.15.83:0/3289731818 wait complete. 2024-04-01T06:55:31.547 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 23 2024-04-01T06:55:31.559 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T06:55:31.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.681+0000 7f408a07a700 1 -- 172.21.15.83:0/4247874933 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f40841016e0 msgr2=0x7f4084103ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:31.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.681+0000 7f408a07a700 1 --2- 172.21.15.83:0/4247874933 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f40841016e0 0x7f4084103ad0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4074009990 tx=0x7f4074009ca0 comp rx=0 tx=0).stop 2024-04-01T06:55:31.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.681+0000 7f408a07a700 1 -- 172.21.15.83:0/4247874933 shutdown_connections 2024-04-01T06:55:31.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.681+0000 7f408a07a700 1 --2- 172.21.15.83:0/4247874933 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f40841016e0 0x7f4084103ad0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:31.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.681+0000 7f408a07a700 1 --2- 172.21.15.83:0/4247874933 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4084106940 0x7f4084108db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:31.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.681+0000 7f408a07a700 1 --2- 172.21.15.83:0/4247874933 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4084104010 0x7f4084106400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:31.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.681+0000 7f408a07a700 1 -- 172.21.15.83:0/4247874933 >> 172.21.15.83:0/4247874933 conn(0x7f40840fb0d0 msgr2=0x7f40840fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:31.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.681+0000 7f408a07a700 1 -- 172.21.15.83:0/4247874933 shutdown_connections 2024-04-01T06:55:31.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.681+0000 7f408a07a700 1 -- 172.21.15.83:0/4247874933 wait complete. 2024-04-01T06:55:31.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.682+0000 7f408a07a700 1 Processor -- start 2024-04-01T06:55:31.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.682+0000 7f408a07a700 1 -- start start 2024-04-01T06:55:31.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.682+0000 7f408a07a700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f40841016e0 0x7f4084196b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:31.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.682+0000 7f408a07a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4084104010 0x7f4084197060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:31.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.682+0000 7f408a07a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4084106940 0x7f408419e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:31.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.682+0000 7f408a07a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f408419e650 con 0x7f4084106940 2024-04-01T06:55:31.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.682+0000 7f408a07a700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f408419e790 con 0x7f40841016e0 2024-04-01T06:55:31.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.682+0000 7f408a07a700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f408419e920 con 0x7f4084104010 2024-04-01T06:55:31.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.682+0000 7f4083fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4084106940 0x7f408419e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:31.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.682+0000 7f4083fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4084106940 0x7f408419e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:45320/0 (socket says 172.21.15.83:45320) 2024-04-01T06:55:31.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.682+0000 7f4083fff700 1 -- 172.21.15.83:0/272417357 learned_addr learned my addr 172.21.15.83:0/272417357 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:31.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.682+0000 7f4082ffd700 1 --2- 172.21.15.83:0/272417357 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4084104010 0x7f4084197060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:31.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.682+0000 7f40837fe700 1 --2- 172.21.15.83:0/272417357 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f40841016e0 0x7f4084196b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:31.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.682+0000 7f4083fff700 1 -- 172.21.15.83:0/272417357 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4084104010 msgr2=0x7f4084197060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:31.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.682+0000 7f4083fff700 1 --2- 172.21.15.83:0/272417357 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4084104010 0x7f4084197060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:31.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.682+0000 7f4083fff700 1 -- 172.21.15.83:0/272417357 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f40841016e0 msgr2=0x7f4084196b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:31.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.682+0000 7f4083fff700 1 --2- 172.21.15.83:0/272417357 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f40841016e0 0x7f4084196b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:31.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.682+0000 7f4083fff700 1 -- 172.21.15.83:0/272417357 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40740095f0 con 0x7f4084106940 2024-04-01T06:55:31.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.682+0000 7f40837fe700 1 --2- 172.21.15.83:0/272417357 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f40841016e0 0x7f4084196b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:55:31.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.683+0000 7f4083fff700 1 --2- 172.21.15.83:0/272417357 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4084106940 0x7f408419e080 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f407c007ee0 tx=0x7f407c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:31.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.683+0000 7f4080ff9700 1 -- 172.21.15.83:0/272417357 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407c017070 con 0x7f4084106940 2024-04-01T06:55:31.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.683+0000 7f408a07a700 1 -- 172.21.15.83:0/272417357 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f408419ec00 con 0x7f4084106940 2024-04-01T06:55:31.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.683+0000 7f4080ff9700 1 -- 172.21.15.83:0/272417357 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f407c00f040 con 0x7f4084106940 2024-04-01T06:55:31.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.683+0000 7f408a07a700 1 -- 172.21.15.83:0/272417357 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f408419f110 con 0x7f4084106940 2024-04-01T06:55:31.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.683+0000 7f4080ff9700 1 -- 172.21.15.83:0/272417357 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407c005740 con 0x7f4084106940 2024-04-01T06:55:31.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.684+0000 7f408a07a700 1 -- 172.21.15.83:0/272417357 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40840fcc50 con 0x7f4084106940 2024-04-01T06:55:31.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.685+0000 7f4080ff9700 1 -- 172.21.15.83:0/272417357 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f407c0058a0 con 0x7f4084106940 2024-04-01T06:55:31.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.685+0000 7f4080ff9700 1 --2- 172.21.15.83:0/272417357 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f406c0a11b0 0x7f406c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:31.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.686+0000 7f40837fe700 1 --2- 172.21.15.83:0/272417357 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f406c0a11b0 0x7f406c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:31.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.686+0000 7f4080ff9700 1 -- 172.21.15.83:0/272417357 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f407c0cc7a0 con 0x7f4084106940 2024-04-01T06:55:31.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.686+0000 7f40837fe700 1 --2- 172.21.15.83:0/272417357 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f406c0a11b0 0x7f406c0a3670 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f407400b5c0 tx=0x7f4074005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:31.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.689+0000 7f4080ff9700 1 -- 172.21.15.83:0/272417357 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f407c095f80 con 0x7f4084106940 2024-04-01T06:55:31.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.898+0000 7f408a07a700 1 -- 172.21.15.83:0/272417357 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f408410c440 con 0x7f4084106940 2024-04-01T06:55:31.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.899+0000 7f4080ff9700 1 -- 172.21.15.83:0/272417357 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+22131 (secure 0 0 0) 0x7f407c0995a0 con 0x7f4084106940 2024-04-01T06:55:31.899 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:55:31.899 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":79,"fsid":"c6f8eff4-eff3-11ee-b647-cb9ed24678a4","created":"2024-04-01T06:48:42.033382+0000","modified":"2024-04-01T06:54:29.399277+0000","last_up_change":"2024-04-01T06:53:55.791339+0000","last_in_change":"2024-04-01T06:53:39.777214+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T06:51:21.963996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T06:54:26.450403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T06:54:27.564928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"90b761b0-b06c-4142-854d-38ee42aa6052","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6803","nonce":3253845390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6805","nonce":3253845390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6809","nonce":3253845390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6807","nonce":3253845390}]},"public_addr":"172.21.15.83:6803/3253845390","cluster_addr":"172.21.15.83:6805/3253845390","heartbeat_back_addr":"172.21.15.83:6809/3253845390","heartbeat_front_addr":"172.21.15.83:6807/3253845390","state":["exists","up"]},{"osd":1,"uuid":"4d6ab85b-7088-451e-a829-c9119f35dee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6801","nonce":515889759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6803","nonce":515889759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6807","nonce":515889759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6805","nonce":515889759}]},"public_addr":"172.21.15.145:6801/515889759","cluster_addr":"172.21.15.145:6803/515889759","heartbeat_back_addr":"172.21.15.145:6807/515889759","heartbeat_front_addr":"172.21.15.145:6805/515889759","state":["exists","up"]},{"osd":2,"uuid":"d04c27f3-4972-4061-8bfb-5060645e3883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6801","nonce":3318516728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6803","nonce":3318516728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6807","nonce":3318516728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6805","nonce":3318516728}]},"public_addr":"172.21.15.153:6801/3318516728","cluster_addr":"172.21.15.153:6803/3318516728","heartbeat_back_addr":"172.21.15.153:6807/3318516728","heartbeat_front_addr":"172.21.15.153:6805/3318516728","state":["exists","up"]},{"osd":3,"uuid":"899b6c90-8f2f-44dd-b807-49594aadb443","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6811","nonce":504690234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6813","nonce":504690234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6817","nonce":504690234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6815","nonce":504690234}]},"public_addr":"172.21.15.83:6811/504690234","cluster_addr":"172.21.15.83:6813/504690234","heartbeat_back_addr":"172.21.15.83:6817/504690234","heartbeat_front_addr":"172.21.15.83:6815/504690234","state":["exists","up"]},{"osd":4,"uuid":"5071dd81-804e-4358-bfb6-11e718e9cf4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6809","nonce":2099824730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6811","nonce":2099824730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6815","nonce":2099824730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6813","nonce":2099824730}]},"public_addr":"172.21.15.145:6809/2099824730","cluster_addr":"172.21.15.145:6811/2099824730","heartbeat_back_addr":"172.21.15.145:6815/2099824730","heartbeat_front_addr":"172.21.15.145:6813/2099824730","state":["exists","up"]},{"osd":5,"uuid":"b8442b71-c26e-467f-b0c3-ea9f636f5a00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6809","nonce":3340941443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6811","nonce":3340941443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6815","nonce":3340941443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6813","nonce":3340941443}]},"public_addr":"172.21.15.153:6809/3340941443","cluster_addr":"172.21.15.153:6811/3340941443","heartbeat_back_addr":"172.21.15.153:6815/3340941443","heartbeat_front_addr":"172.21.15.153:6813/3340941443","state":["exists","up"]},{"osd":6,"uuid":"c26bb8cb-ccee-4bfc-91eb-14e1ad8e04df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6819","nonce":2005485079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6821","nonce":2005485079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6825","nonce":2005485079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6823","nonce":2005485079}]},"public_addr":"172.21.15.83:6819/2005485079","cluster_addr":"172.21.15.83:6821/2005485079","heartbeat_back_addr":"172.21.15.83:6825/2005485079","heartbeat_front_addr":"172.21.15.83:6823/2005485079","state":["exists","up"]},{"osd":7,"uuid":"a8940da2-0e79-4606-8d1e-d425afbf5753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6817","nonce":3737505059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6819","nonce":3737505059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6823","nonce":3737505059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6821","nonce":3737505059}]},"public_addr":"172.21.15.145:6817/3737505059","cluster_addr":"172.21.15.145:6819/3737505059","heartbeat_back_addr":"172.21.15.145:6823/3737505059","heartbeat_front_addr":"172.21.15.145:6821/3737505059","state":["exists","up"]},{"osd":8,"uuid":"602d43ac-a189-4da3-9e38-7025d14e0dd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6817","nonce":1031545791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6819","nonce":1031545791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6823","nonce":1031545791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6821","nonce":1031545791}]},"public_addr":"172.21.15.153:6817/1031545791","cluster_addr":"172.21.15.153:6819/1031545791","heartbeat_back_addr":"172.21.15.153:6823/1031545791","heartbeat_front_addr":"172.21.15.153:6821/1031545791","state":["exists","up"]},{"osd":9,"uuid":"08b12d27-1247-45e4-9d09-cacc0fce4bd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6827","nonce":3720996673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6829","nonce":3720996673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6833","nonce":3720996673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6831","nonce":3720996673}]},"public_addr":"172.21.15.83:6827/3720996673","cluster_addr":"172.21.15.83:6829/3720996673","heartbeat_back_addr":"172.21.15.83:6833/3720996673","heartbeat_front_addr":"172.21.15.83:6831/3720996673","state":["exists","up"]},{"osd":10,"uuid":"dd986b50-d68f-446c-9c66-261535880879","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6825","nonce":2671529479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6827","nonce":2671529479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6831","nonce":2671529479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6829","nonce":2671529479}]},"public_addr":"172.21.15.145:6825/2671529479","cluster_addr":"172.21.15.145:6827/2671529479","heartbeat_back_addr":"172.21.15.145:6831/2671529479","heartbeat_front_addr":"172.21.15.145:6829/2671529479","state":["exists","up"]},{"osd":11,"uuid":"d20a49cd-6224-4424-8375-46da791d9931","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6825","nonce":2342548429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6827","nonce":2342548429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6831","nonce":2342548429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6829","nonce":2342548429}]},"public_addr":"172.21.15.153:6825/2342548429","cluster_addr":"172.21.15.153:6827/2342548429","heartbeat_back_addr":"172.21.15.153:6831/2342548429","heartbeat_front_addr":"172.21.15.153:6829/2342548429","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:50:44.539932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:01.990470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:19.054426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:36.616393+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:53.896705+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:10.667502+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:27.880849+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:45.276308+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:02.280615+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:19.555547+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:37.062881+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:54.191589+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.83:6801/1867137261":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/2596683931":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/2125339627":"2024-04-02T06:49:33.656125+0000","172.21.15.83:6800/1644397953":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/690500472":"2024-04-02T06:49:13.456026+0000","172.21.15.83:6801/1644397953":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/785958951":"2024-04-02T06:49:33.656125+0000","172.21.15.83:6800/1867137261":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/2222527447":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/2071592157":"2024-04-02T06:49:13.456026+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T06:55:31.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.901+0000 7f408a07a700 1 -- 172.21.15.83:0/272417357 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f406c0a11b0 msgr2=0x7f406c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:31.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.901+0000 7f408a07a700 1 --2- 172.21.15.83:0/272417357 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f406c0a11b0 0x7f406c0a3670 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f407400b5c0 tx=0x7f4074005fb0 comp rx=0 tx=0).stop 2024-04-01T06:55:31.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.901+0000 7f408a07a700 1 -- 172.21.15.83:0/272417357 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4084106940 msgr2=0x7f408419e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:31.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.901+0000 7f408a07a700 1 --2- 172.21.15.83:0/272417357 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4084106940 0x7f408419e080 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f407c007ee0 tx=0x7f407c00d3b0 comp rx=0 tx=0).stop 2024-04-01T06:55:31.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.901+0000 7f408a07a700 1 -- 172.21.15.83:0/272417357 shutdown_connections 2024-04-01T06:55:31.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.901+0000 7f408a07a700 1 --2- 172.21.15.83:0/272417357 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4084106940 0x7f408419e080 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:31.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.901+0000 7f408a07a700 1 --2- 172.21.15.83:0/272417357 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f406c0a11b0 0x7f406c0a3670 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:31.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.901+0000 7f408a07a700 1 --2- 172.21.15.83:0/272417357 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f40841016e0 0x7f4084196b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:31.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.901+0000 7f408a07a700 1 --2- 172.21.15.83:0/272417357 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4084104010 0x7f4084197060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:31.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.901+0000 7f408a07a700 1 -- 172.21.15.83:0/272417357 >> 172.21.15.83:0/272417357 conn(0x7f40840fb0d0 msgr2=0x7f4084102200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:31.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.902+0000 7f408a07a700 1 -- 172.21.15.83:0/272417357 shutdown_connections 2024-04-01T06:55:31.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:31.902+0000 7f408a07a700 1 -- 172.21.15.83:0/272417357 wait complete. 2024-04-01T06:55:31.912 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:31 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/1925688076' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-01T06:55:31.912 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:31 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/2247664695' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-01T06:55:31.912 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:31 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/3289731818' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:55:31.914 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-01T06:51:21.963996+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-01T06:54:26.450403+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-01T06:54:27.564928+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-01T06:55:31.914 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-01T06:55:32.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:31 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/1925688076' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-01T06:55:32.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:31 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/2247664695' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-01T06:55:32.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:31 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/3289731818' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:55:32.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.042+0000 7f1d7afb5700 1 -- 172.21.15.83:0/2423678287 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1d74100600 msgr2=0x7f1d74100a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:32.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.042+0000 7f1d7afb5700 1 --2- 172.21.15.83:0/2423678287 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1d74100600 0x7f1d74100a60 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f1d6000aad0 tx=0x7f1d6000ade0 comp rx=0 tx=0).stop 2024-04-01T06:55:32.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.042+0000 7f1d7afb5700 1 -- 172.21.15.83:0/2423678287 shutdown_connections 2024-04-01T06:55:32.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.042+0000 7f1d7afb5700 1 --2- 172.21.15.83:0/2423678287 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1d74100fa0 0x7f1d74107850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:32.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.042+0000 7f1d7afb5700 1 --2- 172.21.15.83:0/2423678287 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d740ff410 0x7f1d740ff830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:32.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.042+0000 7f1d7afb5700 1 --2- 172.21.15.83:0/2423678287 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1d74100600 0x7f1d74100a60 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:32.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.042+0000 7f1d7afb5700 1 -- 172.21.15.83:0/2423678287 >> 172.21.15.83:0/2423678287 conn(0x7f1d740fa980 msgr2=0x7f1d740fcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:32.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.042+0000 7f1d7afb5700 1 -- 172.21.15.83:0/2423678287 shutdown_connections 2024-04-01T06:55:32.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.042+0000 7f1d7afb5700 1 -- 172.21.15.83:0/2423678287 wait complete. 2024-04-01T06:55:32.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.043+0000 7f1d7afb5700 1 Processor -- start 2024-04-01T06:55:32.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.043+0000 7f1d7afb5700 1 -- start start 2024-04-01T06:55:32.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.043+0000 7f1d7afb5700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1d740ff410 0x7f1d74194a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:32.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.043+0000 7f1d7afb5700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d74100600 0x7f1d74194f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:32.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.043+0000 7f1d7afb5700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1d74100fa0 0x7f1d7419bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:32.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.043+0000 7f1d7afb5700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7419c580 con 0x7f1d74100fa0 2024-04-01T06:55:32.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.043+0000 7f1d7afb5700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7419c6c0 con 0x7f1d740ff410 2024-04-01T06:55:32.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.043+0000 7f1d7afb5700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7419c850 con 0x7f1d74100600 2024-04-01T06:55:32.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.043+0000 7f1d79552700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1d74100fa0 0x7f1d7419bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:32.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.043+0000 7f1d79552700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1d74100fa0 0x7f1d7419bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:45342/0 (socket says 172.21.15.83:45342) 2024-04-01T06:55:32.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.043+0000 7f1d78d51700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1d740ff410 0x7f1d74194a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:32.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.043+0000 7f1d79552700 1 -- 172.21.15.83:0/3032481591 learned_addr learned my addr 172.21.15.83:0/3032481591 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:32.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.043+0000 7f1d73fff700 1 --2- 172.21.15.83:0/3032481591 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d74100600 0x7f1d74194f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:32.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.044+0000 7f1d79552700 1 -- 172.21.15.83:0/3032481591 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d74100600 msgr2=0x7f1d74194f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:32.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.044+0000 7f1d79552700 1 --2- 172.21.15.83:0/3032481591 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d74100600 0x7f1d74194f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:32.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.044+0000 7f1d79552700 1 -- 172.21.15.83:0/3032481591 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1d740ff410 msgr2=0x7f1d74194a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:32.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.044+0000 7f1d79552700 1 --2- 172.21.15.83:0/3032481591 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1d740ff410 0x7f1d74194a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:32.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.044+0000 7f1d79552700 1 -- 172.21.15.83:0/3032481591 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d6000a700 con 0x7f1d74100fa0 2024-04-01T06:55:32.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.044+0000 7f1d79552700 1 --2- 172.21.15.83:0/3032481591 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1d74100fa0 0x7f1d7419bfb0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c007ee0 tx=0x7f1d6c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:32.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.044+0000 7f1d71ffb700 1 -- 172.21.15.83:0/3032481591 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c017070 con 0x7f1d74100fa0 2024-04-01T06:55:32.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.044+0000 7f1d71ffb700 1 -- 172.21.15.83:0/3032481591 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1d6c00f040 con 0x7f1d74100fa0 2024-04-01T06:55:32.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.044+0000 7f1d71ffb700 1 -- 172.21.15.83:0/3032481591 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c005580 con 0x7f1d74100fa0 2024-04-01T06:55:32.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.044+0000 7f1d7afb5700 1 -- 172.21.15.83:0/3032481591 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d7419cb30 con 0x7f1d74100fa0 2024-04-01T06:55:32.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.044+0000 7f1d7afb5700 1 -- 172.21.15.83:0/3032481591 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d7419cff0 con 0x7f1d74100fa0 2024-04-01T06:55:32.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.045+0000 7f1d7afb5700 1 -- 172.21.15.83:0/3032481591 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d741068e0 con 0x7f1d74100fa0 2024-04-01T06:55:32.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.046+0000 7f1d71ffb700 1 -- 172.21.15.83:0/3032481591 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f1d6c00db20 con 0x7f1d74100fa0 2024-04-01T06:55:32.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.047+0000 7f1d71ffb700 1 --2- 172.21.15.83:0/3032481591 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f1d640a12b0 0x7f1d640a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:32.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.047+0000 7f1d78d51700 1 --2- 172.21.15.83:0/3032481591 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f1d640a12b0 0x7f1d640a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:32.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.047+0000 7f1d71ffb700 1 -- 172.21.15.83:0/3032481591 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f1d6c0cc0a0 con 0x7f1d74100fa0 2024-04-01T06:55:32.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.047+0000 7f1d78d51700 1 --2- 172.21.15.83:0/3032481591 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f1d640a12b0 0x7f1d640a3770 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1d74100460 tx=0x7f1d6800a3b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:32.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.051+0000 7f1d71ffb700 1 -- 172.21.15.83:0/3032481591 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f1d6c0ff9f0 con 0x7f1d74100fa0 2024-04-01T06:55:32.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:31 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/1925688076' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-01T06:55:32.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:31 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/2247664695' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-01T06:55:32.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:31 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/3289731818' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:55:32.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.247+0000 7f1d7afb5700 1 -- 172.21.15.83:0/3032481591 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1d7410a3e0 con 0x7f1d74100fa0 2024-04-01T06:55:32.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.247+0000 7f1d71ffb700 1 -- 172.21.15.83:0/3032481591 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1d6c095780 con 0x7f1d74100fa0 2024-04-01T06:55:32.247 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 1 2024-04-01T06:55:32.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.249+0000 7f1d7afb5700 1 -- 172.21.15.83:0/3032481591 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f1d640a12b0 msgr2=0x7f1d640a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:32.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.250+0000 7f1d7afb5700 1 --2- 172.21.15.83:0/3032481591 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f1d640a12b0 0x7f1d640a3770 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1d74100460 tx=0x7f1d6800a3b0 comp rx=0 tx=0).stop 2024-04-01T06:55:32.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.250+0000 7f1d7afb5700 1 -- 172.21.15.83:0/3032481591 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1d74100fa0 msgr2=0x7f1d7419bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:32.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.250+0000 7f1d7afb5700 1 --2- 172.21.15.83:0/3032481591 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1d74100fa0 0x7f1d7419bfb0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c007ee0 tx=0x7f1d6c00d3b0 comp rx=0 tx=0).stop 2024-04-01T06:55:32.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.250+0000 7f1d7afb5700 1 -- 172.21.15.83:0/3032481591 shutdown_connections 2024-04-01T06:55:32.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.250+0000 7f1d7afb5700 1 --2- 172.21.15.83:0/3032481591 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1d74100fa0 0x7f1d7419bfb0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:32.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.250+0000 7f1d7afb5700 1 --2- 172.21.15.83:0/3032481591 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f1d640a12b0 0x7f1d640a3770 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:32.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.250+0000 7f1d7afb5700 1 --2- 172.21.15.83:0/3032481591 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1d740ff410 0x7f1d74194a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:32.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.250+0000 7f1d7afb5700 1 --2- 172.21.15.83:0/3032481591 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d74100600 0x7f1d74194f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:32.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.250+0000 7f1d7afb5700 1 -- 172.21.15.83:0/3032481591 >> 172.21.15.83:0/3032481591 conn(0x7f1d740fa980 msgr2=0x7f1d74103a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:32.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.250+0000 7f1d7afb5700 1 -- 172.21.15.83:0/3032481591 shutdown_connections 2024-04-01T06:55:32.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.250+0000 7f1d7afb5700 1 -- 172.21.15.83:0/3032481591 wait complete. 2024-04-01T06:55:32.262 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-01T06:55:32.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.387+0000 7f411c08b700 1 -- 172.21.15.83:0/1453848621 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f41140ffc60 msgr2=0x7f4114100080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:32.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.387+0000 7f411c08b700 1 --2- 172.21.15.83:0/1453848621 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f41140ffc60 0x7f4114100080 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f41040099c0 tx=0x7f4104009cd0 comp rx=0 tx=0).stop 2024-04-01T06:55:32.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.387+0000 7f411c08b700 1 -- 172.21.15.83:0/1453848621 shutdown_connections 2024-04-01T06:55:32.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.387+0000 7f411c08b700 1 --2- 172.21.15.83:0/1453848621 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f41140ffc60 0x7f4114100080 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:32.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.387+0000 7f411c08b700 1 --2- 172.21.15.83:0/1453848621 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41141017f0 0x7f41141080a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:32.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.387+0000 7f411c08b700 1 --2- 172.21.15.83:0/1453848621 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4114100e50 0x7f41141012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:32.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.387+0000 7f411c08b700 1 -- 172.21.15.83:0/1453848621 >> 172.21.15.83:0/1453848621 conn(0x7f41140fb1d0 msgr2=0x7f41140fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:32.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.387+0000 7f411c08b700 1 -- 172.21.15.83:0/1453848621 shutdown_connections 2024-04-01T06:55:32.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.387+0000 7f411c08b700 1 -- 172.21.15.83:0/1453848621 wait complete. 2024-04-01T06:55:32.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.387+0000 7f411c08b700 1 Processor -- start 2024-04-01T06:55:32.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.387+0000 7f411c08b700 1 -- start start 2024-04-01T06:55:32.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.388+0000 7f411c08b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f41140ffc60 0x7f4114068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:32.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.388+0000 7f411c08b700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4114100e50 0x7f411419b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:32.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.388+0000 7f411c08b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41141017f0 0x7f411419df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:32.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.388+0000 7f411c08b700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411419e6d0 con 0x7f41140ffc60 2024-04-01T06:55:32.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.388+0000 7f411c08b700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411419e840 con 0x7f4114100e50 2024-04-01T06:55:32.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.388+0000 7f411c08b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411419ea00 con 0x7f41141017f0 2024-04-01T06:55:32.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.388+0000 7f4119e27700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f41140ffc60 0x7f4114068970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:32.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.388+0000 7f4119e27700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f41140ffc60 0x7f4114068970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:45360/0 (socket says 172.21.15.83:45360) 2024-04-01T06:55:32.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.388+0000 7f4119e27700 1 -- 172.21.15.83:0/3784182539 learned_addr learned my addr 172.21.15.83:0/3784182539 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:32.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.388+0000 7f411a628700 1 --2- 172.21.15.83:0/3784182539 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41141017f0 0x7f411419df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:32.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.388+0000 7f4119626700 1 --2- 172.21.15.83:0/3784182539 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4114100e50 0x7f411419b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:32.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.388+0000 7f4119e27700 1 -- 172.21.15.83:0/3784182539 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41141017f0 msgr2=0x7f411419df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:32.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.388+0000 7f4119e27700 1 --2- 172.21.15.83:0/3784182539 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41141017f0 0x7f411419df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:32.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.388+0000 7f4119e27700 1 -- 172.21.15.83:0/3784182539 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4114100e50 msgr2=0x7f411419b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:32.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.388+0000 7f4119e27700 1 --2- 172.21.15.83:0/3784182539 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4114100e50 0x7f411419b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:32.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.388+0000 7f4119e27700 1 -- 172.21.15.83:0/3784182539 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41040095f0 con 0x7f41140ffc60 2024-04-01T06:55:32.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.388+0000 7f4119626700 1 --2- 172.21.15.83:0/3784182539 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4114100e50 0x7f411419b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:55:32.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.388+0000 7f4119e27700 1 --2- 172.21.15.83:0/3784182539 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f41140ffc60 0x7f4114068970 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f4104009f50 tx=0x7f4104003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:32.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.388+0000 7f410affd700 1 -- 172.21.15.83:0/3784182539 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f410401d070 con 0x7f41140ffc60 2024-04-01T06:55:32.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.388+0000 7f410affd700 1 -- 172.21.15.83:0/3784182539 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4104022470 con 0x7f41140ffc60 2024-04-01T06:55:32.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.388+0000 7f411c08b700 1 -- 172.21.15.83:0/3784182539 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f411419ec80 con 0x7f41140ffc60 2024-04-01T06:55:32.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.388+0000 7f410affd700 1 -- 172.21.15.83:0/3784182539 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4104022ea0 con 0x7f41140ffc60 2024-04-01T06:55:32.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.388+0000 7f411c08b700 1 -- 172.21.15.83:0/3784182539 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f411419f180 con 0x7f41140ffc60 2024-04-01T06:55:32.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.389+0000 7f411c08b700 1 -- 172.21.15.83:0/3784182539 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4114107010 con 0x7f41140ffc60 2024-04-01T06:55:32.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.390+0000 7f410affd700 1 -- 172.21.15.83:0/3784182539 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f4104022800 con 0x7f41140ffc60 2024-04-01T06:55:32.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.391+0000 7f410affd700 1 --2- 172.21.15.83:0/3784182539 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f41000a1230 0x7f41000a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:32.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.391+0000 7f4119626700 1 --2- 172.21.15.83:0/3784182539 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f41000a1230 0x7f41000a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:32.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.391+0000 7f410affd700 1 -- 172.21.15.83:0/3784182539 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f41040ce070 con 0x7f41140ffc60 2024-04-01T06:55:32.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.391+0000 7f4119626700 1 --2- 172.21.15.83:0/3784182539 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f41000a1230 0x7f41000a36f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4110005fd0 tx=0x7f4110005e20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:32.394 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.394+0000 7f410affd700 1 -- 172.21.15.83:0/3784182539 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f41040978e0 con 0x7f41140ffc60 2024-04-01T06:55:32.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.595+0000 7f411c08b700 1 -- 172.21.15.83:0/3784182539 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f411410b580 con 0x7f41140ffc60 2024-04-01T06:55:32.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.595+0000 7f410affd700 1 -- 172.21.15.83:0/3784182539 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v79) v1 ==== 104+0+11 (secure 0 0 0) 0x7f410409af00 con 0x7f41140ffc60 2024-04-01T06:55:32.595 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 32 2024-04-01T06:55:32.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.597+0000 7f411c08b700 1 -- 172.21.15.83:0/3784182539 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f41000a1230 msgr2=0x7f41000a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:32.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.597+0000 7f411c08b700 1 --2- 172.21.15.83:0/3784182539 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f41000a1230 0x7f41000a36f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4110005fd0 tx=0x7f4110005e20 comp rx=0 tx=0).stop 2024-04-01T06:55:32.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.597+0000 7f411c08b700 1 -- 172.21.15.83:0/3784182539 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f41140ffc60 msgr2=0x7f4114068970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:32.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.597+0000 7f411c08b700 1 --2- 172.21.15.83:0/3784182539 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f41140ffc60 0x7f4114068970 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f4104009f50 tx=0x7f4104003970 comp rx=0 tx=0).stop 2024-04-01T06:55:32.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.597+0000 7f411c08b700 1 -- 172.21.15.83:0/3784182539 shutdown_connections 2024-04-01T06:55:32.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.597+0000 7f411c08b700 1 --2- 172.21.15.83:0/3784182539 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f41140ffc60 0x7f4114068970 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:32.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.597+0000 7f411c08b700 1 --2- 172.21.15.83:0/3784182539 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f41000a1230 0x7f41000a36f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:32.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.597+0000 7f411c08b700 1 --2- 172.21.15.83:0/3784182539 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41141017f0 0x7f411419df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:32.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.597+0000 7f411c08b700 1 --2- 172.21.15.83:0/3784182539 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4114100e50 0x7f411419b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:32.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.597+0000 7f411c08b700 1 -- 172.21.15.83:0/3784182539 >> 172.21.15.83:0/3784182539 conn(0x7f41140fb1d0 msgr2=0x7f4114104150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:32.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.597+0000 7f411c08b700 1 -- 172.21.15.83:0/3784182539 shutdown_connections 2024-04-01T06:55:32.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.598+0000 7f411c08b700 1 -- 172.21.15.83:0/3784182539 wait complete. 2024-04-01T06:55:32.609 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-01T06:55:32.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.736+0000 7fd1f4e9b700 1 -- 172.21.15.83:0/1602302104 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1f0100d80 msgr2=0x7fd1f01011a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:32.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.736+0000 7fd1f4e9b700 1 --2- 172.21.15.83:0/1602302104 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1f0100d80 0x7fd1f01011a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd1e00099c0 tx=0x7fd1e0009cd0 comp rx=0 tx=0).stop 2024-04-01T06:55:32.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.736+0000 7fd1f4e9b700 1 -- 172.21.15.83:0/1602302104 shutdown_connections 2024-04-01T06:55:32.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.736+0000 7fd1f4e9b700 1 --2- 172.21.15.83:0/1602302104 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1f0100d80 0x7fd1f01011a0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:32.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.736+0000 7fd1f4e9b700 1 --2- 172.21.15.83:0/1602302104 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd1f0102910 0x7fd1f01091c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:32.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.736+0000 7fd1f4e9b700 1 --2- 172.21.15.83:0/1602302104 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1f0101f70 0x7fd1f01023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:32.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.736+0000 7fd1f4e9b700 1 -- 172.21.15.83:0/1602302104 >> 172.21.15.83:0/1602302104 conn(0x7fd1f00fc2f0 msgr2=0x7fd1f00fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:32.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.736+0000 7fd1f4e9b700 1 -- 172.21.15.83:0/1602302104 shutdown_connections 2024-04-01T06:55:32.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.736+0000 7fd1f4e9b700 1 -- 172.21.15.83:0/1602302104 wait complete. 2024-04-01T06:55:32.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.737+0000 7fd1f4e9b700 1 Processor -- start 2024-04-01T06:55:32.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.737+0000 7fd1f4e9b700 1 -- start start 2024-04-01T06:55:32.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.737+0000 7fd1f4e9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1f0100d80 0x7fd1f0196d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:32.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.737+0000 7fd1f4e9b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1f0101f70 0x7fd1f01972a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:32.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.737+0000 7fd1f4e9b700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd1f0102910 0x7fd1f019e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:32.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.737+0000 7fd1f4e9b700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f019e850 con 0x7fd1f0101f70 2024-04-01T06:55:32.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.737+0000 7fd1f4e9b700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f019e9c0 con 0x7fd1f0102910 2024-04-01T06:55:32.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.737+0000 7fd1f4e9b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f019eb80 con 0x7fd1f0100d80 2024-04-01T06:55:32.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.737+0000 7fd1edd9b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1f0101f70 0x7fd1f01972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:32.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.737+0000 7fd1edd9b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1f0101f70 0x7fd1f01972a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:45386/0 (socket says 172.21.15.83:45386) 2024-04-01T06:55:32.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.737+0000 7fd1edd9b700 1 -- 172.21.15.83:0/76212043 learned_addr learned my addr 172.21.15.83:0/76212043 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:32.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.737+0000 7fd1eed9d700 1 --2- 172.21.15.83:0/76212043 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd1f0102910 0x7fd1f019e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:32.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.737+0000 7fd1ee59c700 1 --2- 172.21.15.83:0/76212043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1f0100d80 0x7fd1f0196d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:32.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.737+0000 7fd1edd9b700 1 -- 172.21.15.83:0/76212043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1f0100d80 msgr2=0x7fd1f0196d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:32.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.737+0000 7fd1edd9b700 1 --2- 172.21.15.83:0/76212043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1f0100d80 0x7fd1f0196d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:32.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.737+0000 7fd1edd9b700 1 -- 172.21.15.83:0/76212043 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd1f0102910 msgr2=0x7fd1f019e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:32.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.737+0000 7fd1edd9b700 1 --2- 172.21.15.83:0/76212043 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd1f0102910 0x7fd1f019e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:32.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.737+0000 7fd1edd9b700 1 -- 172.21.15.83:0/76212043 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e00095f0 con 0x7fd1f0101f70 2024-04-01T06:55:32.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.737+0000 7fd1eed9d700 1 --2- 172.21.15.83:0/76212043 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd1f0102910 0x7fd1f019e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:55:32.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.737+0000 7fd1edd9b700 1 --2- 172.21.15.83:0/76212043 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1f0101f70 0x7fd1f01972a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd1e400b530 tx=0x7fd1e400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:32.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.738+0000 7fd1df7fe700 1 -- 172.21.15.83:0/76212043 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e4011830 con 0x7fd1f0101f70 2024-04-01T06:55:32.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.738+0000 7fd1df7fe700 1 -- 172.21.15.83:0/76212043 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd1e4011e50 con 0x7fd1f0101f70 2024-04-01T06:55:32.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.738+0000 7fd1f4e9b700 1 -- 172.21.15.83:0/76212043 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1f019ee60 con 0x7fd1f0101f70 2024-04-01T06:55:32.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.738+0000 7fd1df7fe700 1 -- 172.21.15.83:0/76212043 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e400f2e0 con 0x7fd1f0101f70 2024-04-01T06:55:32.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.738+0000 7fd1f4e9b700 1 -- 172.21.15.83:0/76212043 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1f019f280 con 0x7fd1f0101f70 2024-04-01T06:55:32.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.739+0000 7fd1f4e9b700 1 -- 172.21.15.83:0/76212043 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1f0108250 con 0x7fd1f0101f70 2024-04-01T06:55:32.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.740+0000 7fd1df7fe700 1 -- 172.21.15.83:0/76212043 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7fd1e4010580 con 0x7fd1f0101f70 2024-04-01T06:55:32.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.740+0000 7fd1df7fe700 1 --2- 172.21.15.83:0/76212043 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd1d80a11b0 0x7fd1d80a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:32.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.740+0000 7fd1ee59c700 1 --2- 172.21.15.83:0/76212043 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd1d80a11b0 0x7fd1d80a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:32.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.740+0000 7fd1df7fe700 1 -- 172.21.15.83:0/76212043 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fd1e40cc890 con 0x7fd1f0101f70 2024-04-01T06:55:32.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.741+0000 7fd1ee59c700 1 --2- 172.21.15.83:0/76212043 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd1d80a11b0 0x7fd1d80a3670 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd1e0000c00 tx=0x7fd1e0009f10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:32.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.744+0000 7fd1df7fe700 1 -- 172.21.15.83:0/76212043 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7fd1e4096180 con 0x7fd1f0101f70 2024-04-01T06:55:32.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.941+0000 7fd1f4e9b700 1 -- 172.21.15.83:0/76212043 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd1f0107c30 con 0x7fd1f0101f70 2024-04-01T06:55:32.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.942+0000 7fd1df7fe700 1 -- 172.21.15.83:0/76212043 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v79) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd1e40997a0 con 0x7fd1f0101f70 2024-04-01T06:55:32.942 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 64 2024-04-01T06:55:32.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.944+0000 7fd1f4e9b700 1 -- 172.21.15.83:0/76212043 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd1d80a11b0 msgr2=0x7fd1d80a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:32.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.944+0000 7fd1f4e9b700 1 --2- 172.21.15.83:0/76212043 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd1d80a11b0 0x7fd1d80a3670 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd1e0000c00 tx=0x7fd1e0009f10 comp rx=0 tx=0).stop 2024-04-01T06:55:32.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.944+0000 7fd1f4e9b700 1 -- 172.21.15.83:0/76212043 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1f0101f70 msgr2=0x7fd1f01972a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:32.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.944+0000 7fd1f4e9b700 1 --2- 172.21.15.83:0/76212043 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1f0101f70 0x7fd1f01972a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd1e400b530 tx=0x7fd1e400b8f0 comp rx=0 tx=0).stop 2024-04-01T06:55:32.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.944+0000 7fd1f4e9b700 1 -- 172.21.15.83:0/76212043 shutdown_connections 2024-04-01T06:55:32.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.944+0000 7fd1f4e9b700 1 --2- 172.21.15.83:0/76212043 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd1d80a11b0 0x7fd1d80a3670 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:32.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.944+0000 7fd1f4e9b700 1 --2- 172.21.15.83:0/76212043 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd1f0102910 0x7fd1f019e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:32.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.944+0000 7fd1f4e9b700 1 --2- 172.21.15.83:0/76212043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1f0100d80 0x7fd1f0196d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:32.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.944+0000 7fd1f4e9b700 1 --2- 172.21.15.83:0/76212043 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd1f0101f70 0x7fd1f01972a0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:32.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.944+0000 7fd1f4e9b700 1 -- 172.21.15.83:0/76212043 >> 172.21.15.83:0/76212043 conn(0x7fd1f00fc2f0 msgr2=0x7fd1f0105390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:32.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.944+0000 7fd1f4e9b700 1 -- 172.21.15.83:0/76212043 shutdown_connections 2024-04-01T06:55:32.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:32.944+0000 7fd1f4e9b700 1 -- 172.21.15.83:0/76212043 wait complete. 2024-04-01T06:55:32.958 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:32 smithi083 ceph-mon[43429]: pgmap v248: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-01T06:55:32.958 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:32 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/272417357' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T06:55:32.958 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:32 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/3032481591' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-01T06:55:32.958 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:32 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/3784182539' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-01T06:55:32.959 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T06:55:33.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:32 smithi145 ceph-mon[47816]: pgmap v248: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-01T06:55:33.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:32 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/272417357' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T06:55:33.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:32 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/3032481591' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-01T06:55:33.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:32 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/3784182539' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-01T06:55:33.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.081+0000 7f005243b700 1 -- 172.21.15.83:0/810381809 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f004c100d50 msgr2=0x7f004c1011b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:33.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.081+0000 7f005243b700 1 --2- 172.21.15.83:0/810381809 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f004c100d50 0x7f004c1011b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f003c0099c0 tx=0x7f003c009cd0 comp rx=0 tx=0).stop 2024-04-01T06:55:33.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.081+0000 7f005243b700 1 -- 172.21.15.83:0/810381809 shutdown_connections 2024-04-01T06:55:33.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.081+0000 7f005243b700 1 --2- 172.21.15.83:0/810381809 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f004c1016f0 0x7f004c107fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:33.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.081+0000 7f005243b700 1 --2- 172.21.15.83:0/810381809 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f004c0ffb60 0x7f004c0fff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:33.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.081+0000 7f005243b700 1 --2- 172.21.15.83:0/810381809 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f004c100d50 0x7f004c1011b0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:33.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.081+0000 7f005243b700 1 -- 172.21.15.83:0/810381809 >> 172.21.15.83:0/810381809 conn(0x7f004c0fb0d0 msgr2=0x7f004c0fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:33.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.081+0000 7f005243b700 1 -- 172.21.15.83:0/810381809 shutdown_connections 2024-04-01T06:55:33.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.081+0000 7f005243b700 1 -- 172.21.15.83:0/810381809 wait complete. 2024-04-01T06:55:33.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.081+0000 7f005243b700 1 Processor -- start 2024-04-01T06:55:33.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.082+0000 7f005243b700 1 -- start start 2024-04-01T06:55:33.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.082+0000 7f005243b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f004c0ffb60 0x7f004c068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:33.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.082+0000 7f005243b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f004c100d50 0x7f004c19b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:33.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.082+0000 7f005243b700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f004c1016f0 0x7f004c19df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:33.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.082+0000 7f005243b700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004c19e6a0 con 0x7f004c100d50 2024-04-01T06:55:33.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.082+0000 7f005243b700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004c19e810 con 0x7f004c1016f0 2024-04-01T06:55:33.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.082+0000 7f005243b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004c19e9d0 con 0x7f004c0ffb60 2024-04-01T06:55:33.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.082+0000 7f004b7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f004c100d50 0x7f004c19b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:33.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.082+0000 7f004b7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f004c100d50 0x7f004c19b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:45404/0 (socket says 172.21.15.83:45404) 2024-04-01T06:55:33.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.082+0000 7f004b7fe700 1 -- 172.21.15.83:0/766237079 learned_addr learned my addr 172.21.15.83:0/766237079 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:33.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.082+0000 7f004bfff700 1 --2- 172.21.15.83:0/766237079 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f004c0ffb60 0x7f004c068910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:33.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.082+0000 7f00509d8700 1 --2- 172.21.15.83:0/766237079 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f004c1016f0 0x7f004c19df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:33.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.082+0000 7f004b7fe700 1 -- 172.21.15.83:0/766237079 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f004c0ffb60 msgr2=0x7f004c068910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:33.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.082+0000 7f004b7fe700 1 --2- 172.21.15.83:0/766237079 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f004c0ffb60 0x7f004c068910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:33.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.082+0000 7f004b7fe700 1 -- 172.21.15.83:0/766237079 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f004c1016f0 msgr2=0x7f004c19df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:33.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.082+0000 7f004b7fe700 1 --2- 172.21.15.83:0/766237079 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f004c1016f0 0x7f004c19df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:33.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.082+0000 7f004b7fe700 1 -- 172.21.15.83:0/766237079 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f003c0095f0 con 0x7f004c100d50 2024-04-01T06:55:33.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.082+0000 7f004bfff700 1 --2- 172.21.15.83:0/766237079 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f004c0ffb60 0x7f004c068910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:55:33.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.082+0000 7f004b7fe700 1 --2- 172.21.15.83:0/766237079 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f004c100d50 0x7f004c19b910 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f003c009fd0 tx=0x7f003c005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:33.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.083+0000 7f00497fa700 1 -- 172.21.15.83:0/766237079 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003c01d070 con 0x7f004c100d50 2024-04-01T06:55:33.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.083+0000 7f00497fa700 1 -- 172.21.15.83:0/766237079 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f003c0059a0 con 0x7f004c100d50 2024-04-01T06:55:33.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.083+0000 7f005243b700 1 -- 172.21.15.83:0/766237079 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f004c19ec50 con 0x7f004c100d50 2024-04-01T06:55:33.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.083+0000 7f00497fa700 1 -- 172.21.15.83:0/766237079 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003c017650 con 0x7f004c100d50 2024-04-01T06:55:33.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.083+0000 7f005243b700 1 -- 172.21.15.83:0/766237079 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f004c19f150 con 0x7f004c100d50 2024-04-01T06:55:33.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.084+0000 7f005243b700 1 -- 172.21.15.83:0/766237079 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f004c106f80 con 0x7f004c100d50 2024-04-01T06:55:33.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.084+0000 7f00497fa700 1 -- 172.21.15.83:0/766237079 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f003c022470 con 0x7f004c100d50 2024-04-01T06:55:33.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.085+0000 7f00497fa700 1 --2- 172.21.15.83:0/766237079 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f00340a1230 0x7f00340a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:33.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.085+0000 7f004bfff700 1 --2- 172.21.15.83:0/766237079 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f00340a1230 0x7f00340a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:33.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.085+0000 7f00497fa700 1 -- 172.21.15.83:0/766237079 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f003c0cdbc0 con 0x7f004c100d50 2024-04-01T06:55:33.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.086+0000 7f004bfff700 1 --2- 172.21.15.83:0/766237079 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f00340a1230 0x7f00340a36f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f004c100bb0 tx=0x7f0040009670 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:33.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.089+0000 7f00497fa700 1 -- 172.21.15.83:0/766237079 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f003c097550 con 0x7f004c100d50 2024-04-01T06:55:33.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:32 smithi153 ceph-mon[48187]: pgmap v248: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-04-01T06:55:33.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:32 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/272417357' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T06:55:33.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:32 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/3032481591' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-01T06:55:33.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:32 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/3784182539' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-01T06:55:33.330 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.331+0000 7f005243b700 1 -- 172.21.15.83:0/766237079 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f004c067a10 con 0x7f004c100d50 2024-04-01T06:55:33.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.332+0000 7f00497fa700 1 -- 172.21.15.83:0/766237079 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+10876 (secure 0 0 0) 0x7f003c00fe60 con 0x7f004c100d50 2024-04-01T06:55:33.331 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:55:33.332 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1271130478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1271130478},{"type":"v1","addr":"172.21.15.83:6835","nonce":1271130478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2412682983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2412682983},{"type":"v1","addr":"172.21.15.83:6837","nonce":2412682983}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6839/3348145990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":3348145990},{"type":"v1","addr":"172.21.15.83:6839","nonce":3348145990}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6841/1191267445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6840","nonce":1191267445},{"type":"v1","addr":"172.21.15.83:6841","nonce":1191267445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2467459028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2467459028},{"type":"v1","addr":"172.21.15.153:6833","nonce":2467459028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24448,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4092629042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":4092629042},{"type":"v1","addr":"172.21.15.153:6835","nonce":4092629042}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-01T06:54:28.397062+0000","modified":"2024-04-01T06:54:33.704443+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24524,"mds_1":24494,"mds_2":24473},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6833/647005844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":647005844},{"type":"v1","addr":"172.21.15.145:6833","nonce":647005844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24454":{"gid":24454,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6837/1993816527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1993816527},{"type":"v1","addr":"172.21.15.153:6837","nonce":1993816527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6839/1399754640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1399754640},{"type":"v1","addr":"172.21.15.153:6839","nonce":1399754640}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24473":{"gid":24473,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.145:6835/3104241497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":3104241497},{"type":"v1","addr":"172.21.15.145:6835","nonce":3104241497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24494":{"gid":24494,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.145:6837/2687798317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2687798317},{"type":"v1","addr":"172.21.15.145:6837","nonce":2687798317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6839/3886435411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3886435411},{"type":"v1","addr":"172.21.15.145:6839","nonce":3886435411}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-01T06:55:33.333 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.334+0000 7f005243b700 1 -- 172.21.15.83:0/766237079 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f00340a1230 msgr2=0x7f00340a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:33.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.334+0000 7f005243b700 1 --2- 172.21.15.83:0/766237079 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f00340a1230 0x7f00340a36f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f004c100bb0 tx=0x7f0040009670 comp rx=0 tx=0).stop 2024-04-01T06:55:33.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.334+0000 7f005243b700 1 -- 172.21.15.83:0/766237079 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f004c100d50 msgr2=0x7f004c19b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:33.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.334+0000 7f005243b700 1 --2- 172.21.15.83:0/766237079 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f004c100d50 0x7f004c19b910 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f003c009fd0 tx=0x7f003c005f10 comp rx=0 tx=0).stop 2024-04-01T06:55:33.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.334+0000 7f005243b700 1 -- 172.21.15.83:0/766237079 shutdown_connections 2024-04-01T06:55:33.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.334+0000 7f005243b700 1 --2- 172.21.15.83:0/766237079 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f00340a1230 0x7f00340a36f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:33.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.334+0000 7f005243b700 1 --2- 172.21.15.83:0/766237079 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f004c1016f0 0x7f004c19df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:33.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.334+0000 7f005243b700 1 --2- 172.21.15.83:0/766237079 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f004c0ffb60 0x7f004c068910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:33.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.334+0000 7f005243b700 1 --2- 172.21.15.83:0/766237079 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f004c100d50 0x7f004c19b910 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:33.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.334+0000 7f005243b700 1 -- 172.21.15.83:0/766237079 >> 172.21.15.83:0/766237079 conn(0x7f004c0fb0d0 msgr2=0x7f004c1040c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:33.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.334+0000 7f005243b700 1 -- 172.21.15.83:0/766237079 shutdown_connections 2024-04-01T06:55:33.334 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.334+0000 7f005243b700 1 -- 172.21.15.83:0/766237079 wait complete. 2024-04-01T06:55:33.335 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 23 2024-04-01T06:55:33.346 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T06:55:33.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.468+0000 7f15124d1700 1 -- 172.21.15.83:0/1740222698 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f150c1028a0 msgr2=0x7f150c109150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:33.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.468+0000 7f15124d1700 1 --2- 172.21.15.83:0/1740222698 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f150c1028a0 0x7f150c109150 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f150400b0a0 tx=0x7f150400b3b0 comp rx=0 tx=0).stop 2024-04-01T06:55:33.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.468+0000 7f15124d1700 1 -- 172.21.15.83:0/1740222698 shutdown_connections 2024-04-01T06:55:33.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.468+0000 7f15124d1700 1 --2- 172.21.15.83:0/1740222698 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f150c1028a0 0x7f150c109150 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:33.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.468+0000 7f15124d1700 1 --2- 172.21.15.83:0/1740222698 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f150c0fef30 0x7f150c0ff350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:33.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.468+0000 7f15124d1700 1 --2- 172.21.15.83:0/1740222698 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f150c101f00 0x7f150c102360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:33.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.468+0000 7f15124d1700 1 -- 172.21.15.83:0/1740222698 >> 172.21.15.83:0/1740222698 conn(0x7f150c0fa880 msgr2=0x7f150c0fcca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:33.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.468+0000 7f15124d1700 1 -- 172.21.15.83:0/1740222698 shutdown_connections 2024-04-01T06:55:33.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.468+0000 7f15124d1700 1 -- 172.21.15.83:0/1740222698 wait complete. 2024-04-01T06:55:33.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.469+0000 7f15124d1700 1 Processor -- start 2024-04-01T06:55:33.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.469+0000 7f15124d1700 1 -- start start 2024-04-01T06:55:33.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.469+0000 7f15124d1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f150c0fef30 0x7f150c198ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:33.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.469+0000 7f15124d1700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f150c101f00 0x7f150c199410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:33.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.469+0000 7f15124d1700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f150c1028a0 0x7f150c1a0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:33.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.469+0000 7f15124d1700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150c1a0a00 con 0x7f150c1028a0 2024-04-01T06:55:33.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.469+0000 7f15124d1700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150c1a0b40 con 0x7f150c101f00 2024-04-01T06:55:33.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.469+0000 7f15124d1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150c1a0cd0 con 0x7f150c0fef30 2024-04-01T06:55:33.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.469+0000 7f1510a6e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f150c1028a0 0x7f150c1a0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:33.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.469+0000 7f1510a6e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f150c1028a0 0x7f150c1a0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46668/0 (socket says 172.21.15.83:46668) 2024-04-01T06:55:33.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.469+0000 7f1510a6e700 1 -- 172.21.15.83:0/4036771209 learned_addr learned my addr 172.21.15.83:0/4036771209 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:33.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.469+0000 7f150bfff700 1 --2- 172.21.15.83:0/4036771209 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f150c0fef30 0x7f150c198ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:33.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.469+0000 7f150b7fe700 1 --2- 172.21.15.83:0/4036771209 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f150c101f00 0x7f150c199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:33.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.469+0000 7f1510a6e700 1 -- 172.21.15.83:0/4036771209 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f150c0fef30 msgr2=0x7f150c198ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:33.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.469+0000 7f1510a6e700 1 --2- 172.21.15.83:0/4036771209 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f150c0fef30 0x7f150c198ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:33.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.469+0000 7f1510a6e700 1 -- 172.21.15.83:0/4036771209 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f150c101f00 msgr2=0x7f150c199410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:33.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.469+0000 7f1510a6e700 1 --2- 172.21.15.83:0/4036771209 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f150c101f00 0x7f150c199410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:33.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.469+0000 7f1510a6e700 1 -- 172.21.15.83:0/4036771209 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1504009d00 con 0x7f150c1028a0 2024-04-01T06:55:33.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.469+0000 7f1510a6e700 1 --2- 172.21.15.83:0/4036771209 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f150c1028a0 0x7f150c1a0430 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1504004d00 tx=0x7f1504004d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:33.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.470+0000 7f15097fa700 1 -- 172.21.15.83:0/4036771209 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150400e040 con 0x7f150c1028a0 2024-04-01T06:55:33.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.470+0000 7f15097fa700 1 -- 172.21.15.83:0/4036771209 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f150400cec0 con 0x7f150c1028a0 2024-04-01T06:55:33.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.470+0000 7f15097fa700 1 -- 172.21.15.83:0/4036771209 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150401b9c0 con 0x7f150c1028a0 2024-04-01T06:55:33.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.470+0000 7f15124d1700 1 -- 172.21.15.83:0/4036771209 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f150c1a0f50 con 0x7f150c1028a0 2024-04-01T06:55:33.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.470+0000 7f15124d1700 1 -- 172.21.15.83:0/4036771209 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f150c1a1320 con 0x7f150c1028a0 2024-04-01T06:55:33.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.471+0000 7f15124d1700 1 -- 172.21.15.83:0/4036771209 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f150c067180 con 0x7f150c1028a0 2024-04-01T06:55:33.473 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.472+0000 7f15097fa700 1 -- 172.21.15.83:0/4036771209 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f150401bb40 con 0x7f150c1028a0 2024-04-01T06:55:33.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.472+0000 7f15097fa700 1 --2- 172.21.15.83:0/4036771209 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f14f80a1230 0x7f14f80a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:33.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.472+0000 7f150bfff700 1 --2- 172.21.15.83:0/4036771209 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f14f80a1230 0x7f14f80a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:33.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.472+0000 7f15097fa700 1 -- 172.21.15.83:0/4036771209 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f15040ce600 con 0x7f150c1028a0 2024-04-01T06:55:33.474 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.473+0000 7f150bfff700 1 --2- 172.21.15.83:0/4036771209 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f14f80a1230 0x7f14f80a36f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f150c067bf0 tx=0x7f14f400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:33.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.477+0000 7f15097fa700 1 -- 172.21.15.83:0/4036771209 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f1504097d70 con 0x7f150c1028a0 2024-04-01T06:55:33.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.683+0000 7f15124d1700 1 -- 172.21.15.83:0/4036771209 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f150c10c670 con 0x7f150c1028a0 2024-04-01T06:55:33.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.684+0000 7f15097fa700 1 -- 172.21.15.83:0/4036771209 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+22131 (secure 0 0 0) 0x7f150409b390 con 0x7f150c1028a0 2024-04-01T06:55:33.684 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:55:33.684 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":79,"fsid":"c6f8eff4-eff3-11ee-b647-cb9ed24678a4","created":"2024-04-01T06:48:42.033382+0000","modified":"2024-04-01T06:54:29.399277+0000","last_up_change":"2024-04-01T06:53:55.791339+0000","last_in_change":"2024-04-01T06:53:39.777214+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T06:51:21.963996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T06:54:26.450403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T06:54:27.564928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"90b761b0-b06c-4142-854d-38ee42aa6052","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6803","nonce":3253845390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6805","nonce":3253845390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6809","nonce":3253845390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6807","nonce":3253845390}]},"public_addr":"172.21.15.83:6803/3253845390","cluster_addr":"172.21.15.83:6805/3253845390","heartbeat_back_addr":"172.21.15.83:6809/3253845390","heartbeat_front_addr":"172.21.15.83:6807/3253845390","state":["exists","up"]},{"osd":1,"uuid":"4d6ab85b-7088-451e-a829-c9119f35dee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6801","nonce":515889759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6803","nonce":515889759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6807","nonce":515889759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6805","nonce":515889759}]},"public_addr":"172.21.15.145:6801/515889759","cluster_addr":"172.21.15.145:6803/515889759","heartbeat_back_addr":"172.21.15.145:6807/515889759","heartbeat_front_addr":"172.21.15.145:6805/515889759","state":["exists","up"]},{"osd":2,"uuid":"d04c27f3-4972-4061-8bfb-5060645e3883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6801","nonce":3318516728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6803","nonce":3318516728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6807","nonce":3318516728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6805","nonce":3318516728}]},"public_addr":"172.21.15.153:6801/3318516728","cluster_addr":"172.21.15.153:6803/3318516728","heartbeat_back_addr":"172.21.15.153:6807/3318516728","heartbeat_front_addr":"172.21.15.153:6805/3318516728","state":["exists","up"]},{"osd":3,"uuid":"899b6c90-8f2f-44dd-b807-49594aadb443","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6811","nonce":504690234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6813","nonce":504690234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6817","nonce":504690234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6815","nonce":504690234}]},"public_addr":"172.21.15.83:6811/504690234","cluster_addr":"172.21.15.83:6813/504690234","heartbeat_back_addr":"172.21.15.83:6817/504690234","heartbeat_front_addr":"172.21.15.83:6815/504690234","state":["exists","up"]},{"osd":4,"uuid":"5071dd81-804e-4358-bfb6-11e718e9cf4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6809","nonce":2099824730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6811","nonce":2099824730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6815","nonce":2099824730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6813","nonce":2099824730}]},"public_addr":"172.21.15.145:6809/2099824730","cluster_addr":"172.21.15.145:6811/2099824730","heartbeat_back_addr":"172.21.15.145:6815/2099824730","heartbeat_front_addr":"172.21.15.145:6813/2099824730","state":["exists","up"]},{"osd":5,"uuid":"b8442b71-c26e-467f-b0c3-ea9f636f5a00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6809","nonce":3340941443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6811","nonce":3340941443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6815","nonce":3340941443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6813","nonce":3340941443}]},"public_addr":"172.21.15.153:6809/3340941443","cluster_addr":"172.21.15.153:6811/3340941443","heartbeat_back_addr":"172.21.15.153:6815/3340941443","heartbeat_front_addr":"172.21.15.153:6813/3340941443","state":["exists","up"]},{"osd":6,"uuid":"c26bb8cb-ccee-4bfc-91eb-14e1ad8e04df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6819","nonce":2005485079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6821","nonce":2005485079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6825","nonce":2005485079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6823","nonce":2005485079}]},"public_addr":"172.21.15.83:6819/2005485079","cluster_addr":"172.21.15.83:6821/2005485079","heartbeat_back_addr":"172.21.15.83:6825/2005485079","heartbeat_front_addr":"172.21.15.83:6823/2005485079","state":["exists","up"]},{"osd":7,"uuid":"a8940da2-0e79-4606-8d1e-d425afbf5753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6817","nonce":3737505059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6819","nonce":3737505059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6823","nonce":3737505059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6821","nonce":3737505059}]},"public_addr":"172.21.15.145:6817/3737505059","cluster_addr":"172.21.15.145:6819/3737505059","heartbeat_back_addr":"172.21.15.145:6823/3737505059","heartbeat_front_addr":"172.21.15.145:6821/3737505059","state":["exists","up"]},{"osd":8,"uuid":"602d43ac-a189-4da3-9e38-7025d14e0dd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6817","nonce":1031545791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6819","nonce":1031545791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6823","nonce":1031545791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6821","nonce":1031545791}]},"public_addr":"172.21.15.153:6817/1031545791","cluster_addr":"172.21.15.153:6819/1031545791","heartbeat_back_addr":"172.21.15.153:6823/1031545791","heartbeat_front_addr":"172.21.15.153:6821/1031545791","state":["exists","up"]},{"osd":9,"uuid":"08b12d27-1247-45e4-9d09-cacc0fce4bd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6827","nonce":3720996673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6829","nonce":3720996673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6833","nonce":3720996673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6831","nonce":3720996673}]},"public_addr":"172.21.15.83:6827/3720996673","cluster_addr":"172.21.15.83:6829/3720996673","heartbeat_back_addr":"172.21.15.83:6833/3720996673","heartbeat_front_addr":"172.21.15.83:6831/3720996673","state":["exists","up"]},{"osd":10,"uuid":"dd986b50-d68f-446c-9c66-261535880879","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6825","nonce":2671529479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6827","nonce":2671529479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6831","nonce":2671529479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6829","nonce":2671529479}]},"public_addr":"172.21.15.145:6825/2671529479","cluster_addr":"172.21.15.145:6827/2671529479","heartbeat_back_addr":"172.21.15.145:6831/2671529479","heartbeat_front_addr":"172.21.15.145:6829/2671529479","state":["exists","up"]},{"osd":11,"uuid":"d20a49cd-6224-4424-8375-46da791d9931","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6825","nonce":2342548429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6827","nonce":2342548429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6831","nonce":2342548429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6829","nonce":2342548429}]},"public_addr":"172.21.15.153:6825/2342548429","cluster_addr":"172.21.15.153:6827/2342548429","heartbeat_back_addr":"172.21.15.153:6831/2342548429","heartbeat_front_addr":"172.21.15.153:6829/2342548429","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:50:44.539932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:01.990470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:19.054426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:36.616393+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:53.896705+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:10.667502+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:27.880849+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:45.276308+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:02.280615+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:19.555547+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:37.062881+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:54.191589+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.83:6801/1867137261":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/2596683931":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/2125339627":"2024-04-02T06:49:33.656125+0000","172.21.15.83:6800/1644397953":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/690500472":"2024-04-02T06:49:13.456026+0000","172.21.15.83:6801/1644397953":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/785958951":"2024-04-02T06:49:33.656125+0000","172.21.15.83:6800/1867137261":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/2222527447":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/2071592157":"2024-04-02T06:49:13.456026+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T06:55:33.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.686+0000 7f15124d1700 1 -- 172.21.15.83:0/4036771209 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f14f80a1230 msgr2=0x7f14f80a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:33.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.686+0000 7f15124d1700 1 --2- 172.21.15.83:0/4036771209 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f14f80a1230 0x7f14f80a36f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f150c067bf0 tx=0x7f14f400b410 comp rx=0 tx=0).stop 2024-04-01T06:55:33.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.686+0000 7f15124d1700 1 -- 172.21.15.83:0/4036771209 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f150c1028a0 msgr2=0x7f150c1a0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:33.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.686+0000 7f15124d1700 1 --2- 172.21.15.83:0/4036771209 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f150c1028a0 0x7f150c1a0430 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1504004d00 tx=0x7f1504004d30 comp rx=0 tx=0).stop 2024-04-01T06:55:33.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.686+0000 7f15124d1700 1 -- 172.21.15.83:0/4036771209 shutdown_connections 2024-04-01T06:55:33.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.686+0000 7f15124d1700 1 --2- 172.21.15.83:0/4036771209 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f150c1028a0 0x7f150c1a0430 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:33.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.686+0000 7f15124d1700 1 --2- 172.21.15.83:0/4036771209 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f14f80a1230 0x7f14f80a36f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:33.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.686+0000 7f15124d1700 1 --2- 172.21.15.83:0/4036771209 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f150c0fef30 0x7f150c198ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:33.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.686+0000 7f15124d1700 1 --2- 172.21.15.83:0/4036771209 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f150c101f00 0x7f150c199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:33.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.686+0000 7f15124d1700 1 -- 172.21.15.83:0/4036771209 >> 172.21.15.83:0/4036771209 conn(0x7f150c0fa880 msgr2=0x7f150c0ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:33.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.686+0000 7f15124d1700 1 -- 172.21.15.83:0/4036771209 shutdown_connections 2024-04-01T06:55:33.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.686+0000 7f15124d1700 1 -- 172.21.15.83:0/4036771209 wait complete. 2024-04-01T06:55:33.701 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-04-01T06:54:28.397062+0000', 'modified': '2024-04-01T06:54:33.704443+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24524, 'mds_1': 24494, 'mds_2': 24473}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24449': {'gid': 24449, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.145:6833/647005844', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.145:6832', 'nonce': 647005844}, {'type': 'v1', 'addr': '172.21.15.145:6833', 'nonce': 647005844}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24454': {'gid': 24454, 'name': 'c', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.153:6837/1993816527', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6836', 'nonce': 1993816527}, {'type': 'v1', 'addr': '172.21.15.153:6837', 'nonce': 1993816527}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24472': {'gid': 24472, 'name': 'i', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.153:6839/1399754640', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6838', 'nonce': 1399754640}, {'type': 'v1', 'addr': '172.21.15.153:6839', 'nonce': 1399754640}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24473': {'gid': 24473, 'name': 'e', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.145:6835/3104241497', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.145:6834', 'nonce': 3104241497}, {'type': 'v1', 'addr': '172.21.15.145:6835', 'nonce': 3104241497}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24494': {'gid': 24494, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.145:6837/2687798317', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.145:6836', 'nonce': 2687798317}, {'type': 'v1', 'addr': '172.21.15.145:6837', 'nonce': 2687798317}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24524': {'gid': 24524, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.145:6839/3886435411', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.145:6838', 'nonce': 3886435411}, {'type': 'v1', 'addr': '172.21.15.145:6839', 'nonce': 3886435411}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-01T06:55:33.701 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-04-01T06:55:33.701 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-04-01T06:55:33.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.830+0000 7fa770c63700 1 -- 172.21.15.83:0/1931986947 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa76c102910 msgr2=0x7fa76c1091c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:33.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.830+0000 7fa770c63700 1 --2- 172.21.15.83:0/1931986947 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa76c102910 0x7fa76c1091c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa76400b0d0 tx=0x7fa76400b3e0 comp rx=0 tx=0).stop 2024-04-01T06:55:33.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.830+0000 7fa770c63700 1 -- 172.21.15.83:0/1931986947 shutdown_connections 2024-04-01T06:55:33.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.830+0000 7fa770c63700 1 --2- 172.21.15.83:0/1931986947 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa76c102910 0x7fa76c1091c0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:33.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.830+0000 7fa770c63700 1 --2- 172.21.15.83:0/1931986947 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa76c100d80 0x7fa76c1011a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:33.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.830+0000 7fa770c63700 1 --2- 172.21.15.83:0/1931986947 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa76c101f70 0x7fa76c1023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:33.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.830+0000 7fa770c63700 1 -- 172.21.15.83:0/1931986947 >> 172.21.15.83:0/1931986947 conn(0x7fa76c0fc2f0 msgr2=0x7fa76c0fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:33.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.830+0000 7fa770c63700 1 -- 172.21.15.83:0/1931986947 shutdown_connections 2024-04-01T06:55:33.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.830+0000 7fa770c63700 1 -- 172.21.15.83:0/1931986947 wait complete. 2024-04-01T06:55:33.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.831+0000 7fa770c63700 1 Processor -- start 2024-04-01T06:55:33.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.831+0000 7fa770c63700 1 -- start start 2024-04-01T06:55:33.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.831+0000 7fa770c63700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa76c100d80 0x7fa76c198fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:33.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.831+0000 7fa770c63700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa76c101f70 0x7fa76c199510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:33.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.831+0000 7fa770c63700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa76c102910 0x7fa76c1a0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:33.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.831+0000 7fa770c63700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c1a0b00 con 0x7fa76c102910 2024-04-01T06:55:33.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.831+0000 7fa770c63700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c1a0c40 con 0x7fa76c100d80 2024-04-01T06:55:33.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.831+0000 7fa770c63700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c1a0dd0 con 0x7fa76c101f70 2024-04-01T06:55:33.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.831+0000 7fa76ad9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa76c102910 0x7fa76c1a0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:33.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.831+0000 7fa76ad9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa76c102910 0x7fa76c1a0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46694/0 (socket says 172.21.15.83:46694) 2024-04-01T06:55:33.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.831+0000 7fa76ad9d700 1 -- 172.21.15.83:0/639343720 learned_addr learned my addr 172.21.15.83:0/639343720 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:33.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.831+0000 7fa76a59c700 1 --2- 172.21.15.83:0/639343720 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa76c100d80 0x7fa76c198fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:33.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.831+0000 7fa76ad9d700 1 -- 172.21.15.83:0/639343720 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa76c101f70 msgr2=0x7fa76c199510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:33.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.831+0000 7fa76ad9d700 1 --2- 172.21.15.83:0/639343720 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa76c101f70 0x7fa76c199510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:33.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.831+0000 7fa76ad9d700 1 -- 172.21.15.83:0/639343720 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa76c100d80 msgr2=0x7fa76c198fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:33.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.831+0000 7fa76ad9d700 1 --2- 172.21.15.83:0/639343720 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa76c100d80 0x7fa76c198fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:33.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.831+0000 7fa76ad9d700 1 -- 172.21.15.83:0/639343720 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa764009d00 con 0x7fa76c102910 2024-04-01T06:55:33.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.831+0000 7fa76a59c700 1 --2- 172.21.15.83:0/639343720 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa76c100d80 0x7fa76c198fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:55:33.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.831+0000 7fa76ad9d700 1 --2- 172.21.15.83:0/639343720 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa76c102910 0x7fa76c1a0530 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa764007bd0 tx=0x7fa764009570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:33.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.832+0000 7fa7637fe700 1 -- 172.21.15.83:0/639343720 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76400e040 con 0x7fa76c102910 2024-04-01T06:55:33.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.832+0000 7fa7637fe700 1 -- 172.21.15.83:0/639343720 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa764004e60 con 0x7fa76c102910 2024-04-01T06:55:33.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.832+0000 7fa770c63700 1 -- 172.21.15.83:0/639343720 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa76c1a1050 con 0x7fa76c102910 2024-04-01T06:55:33.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.832+0000 7fa7637fe700 1 -- 172.21.15.83:0/639343720 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa764005640 con 0x7fa76c102910 2024-04-01T06:55:33.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.832+0000 7fa770c63700 1 -- 172.21.15.83:0/639343720 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa76c1a1470 con 0x7fa76c102910 2024-04-01T06:55:33.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.834+0000 7fa7637fe700 1 -- 172.21.15.83:0/639343720 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7fa7640057a0 con 0x7fa76c102910 2024-04-01T06:55:33.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.834+0000 7fa7637fe700 1 --2- 172.21.15.83:0/639343720 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fa7580a11b0 0x7fa7580a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:33.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.835+0000 7fa76a59c700 1 --2- 172.21.15.83:0/639343720 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fa7580a11b0 0x7fa7580a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:33.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.835+0000 7fa7637fe700 1 -- 172.21.15.83:0/639343720 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fa7640ce030 con 0x7fa76c102910 2024-04-01T06:55:33.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.835+0000 7fa76a59c700 1 --2- 172.21.15.83:0/639343720 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fa7580a11b0 0x7fa7580a3670 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa754005fd0 tx=0x7fa754005e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:33.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.835+0000 7fa77cdf9b80 1 Processor -- start 2024-04-01T06:55:33.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.836+0000 7fa77cdf9b80 1 -- start start 2024-04-01T06:55:33.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.836+0000 7fa77cdf9b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba3c04c780 0x55ba3c04cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:33.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.836+0000 7fa77cdf9b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ba3c04d0e0 0x55ba3c04d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:33.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.836+0000 7fa77cdf9b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ba3c04df80 0x55ba3c04e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:33.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.836+0000 7fa77cdf9b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba3bfa4940 con 0x55ba3c04df80 2024-04-01T06:55:33.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.836+0000 7fa77cdf9b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba3bfa2300 con 0x55ba3c04d0e0 2024-04-01T06:55:33.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.836+0000 7fa77cdf9b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba3bf9dbf0 con 0x55ba3c04c780 2024-04-01T06:55:33.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.836+0000 7fa76ad9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ba3c04df80 0x55ba3c04e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:33.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.836+0000 7fa76ad9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ba3c04df80 0x55ba3c04e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46710/0 (socket says 172.21.15.83:46710) 2024-04-01T06:55:33.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.836+0000 7fa76ad9d700 1 -- 172.21.15.83:0/1995593700 learned_addr learned my addr 172.21.15.83:0/1995593700 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:33.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.836+0000 7fa76a59c700 1 --2- 172.21.15.83:0/1995593700 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba3c04c780 0x55ba3c04cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:33.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.836+0000 7fa76ad9d700 1 -- 172.21.15.83:0/1995593700 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba3c04c780 msgr2=0x55ba3c04cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:33.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.836+0000 7fa76ad9d700 1 --2- 172.21.15.83:0/1995593700 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba3c04c780 0x55ba3c04cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:33.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.836+0000 7fa76ad9d700 1 -- 172.21.15.83:0/1995593700 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ba3c04d0e0 msgr2=0x55ba3c04d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:33.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.836+0000 7fa76ad9d700 1 --2- 172.21.15.83:0/1995593700 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ba3c04d0e0 0x55ba3c04d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:33.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.836+0000 7fa76ad9d700 1 -- 172.21.15.83:0/1995593700 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ba3be1f360 con 0x55ba3c04df80 2024-04-01T06:55:33.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.836+0000 7fa76ad9d700 1 --2- 172.21.15.83:0/1995593700 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ba3c04df80 0x55ba3c04e400 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa764007a00 tx=0x7fa76400cfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c647fb3226729c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:33.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.836+0000 7fa760ff9700 1 -- 172.21.15.83:0/1995593700 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76409b450 con 0x55ba3c04df80 2024-04-01T06:55:33.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.836+0000 7fa760ff9700 1 -- 172.21.15.83:0/1995593700 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa76409f280 con 0x55ba3c04df80 2024-04-01T06:55:33.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.836+0000 7fa760ff9700 1 -- 172.21.15.83:0/1995593700 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76409b6b0 con 0x55ba3c04df80 2024-04-01T06:55:33.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.837+0000 7fa77cdf9b80 1 -- 172.21.15.83:0/1995593700 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ba3c04df80 msgr2=0x55ba3c04e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:33.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.837+0000 7fa77cdf9b80 1 --2- 172.21.15.83:0/1995593700 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ba3c04df80 0x55ba3c04e400 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa764007a00 tx=0x7fa76400cfa0 comp rx=0 tx=0).stop 2024-04-01T06:55:33.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.837+0000 7fa77cdf9b80 1 -- 172.21.15.83:0/1995593700 shutdown_connections 2024-04-01T06:55:33.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.837+0000 7fa77cdf9b80 1 --2- 172.21.15.83:0/1995593700 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ba3c04df80 0x55ba3c04e400 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:33.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.837+0000 7fa77cdf9b80 1 --2- 172.21.15.83:0/1995593700 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba3c04c780 0x55ba3c04cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:33.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.837+0000 7fa77cdf9b80 1 --2- 172.21.15.83:0/1995593700 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ba3c04d0e0 0x55ba3c04d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:33.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.837+0000 7fa77cdf9b80 1 -- 172.21.15.83:0/1995593700 >> 172.21.15.83:0/1995593700 conn(0x55ba3bfab650 msgr2=0x55ba3c047950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:33.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.837+0000 7fa77cdf9b80 1 -- 172.21.15.83:0/1995593700 shutdown_connections 2024-04-01T06:55:33.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.837+0000 7fa77cdf9b80 1 -- 172.21.15.83:0/1995593700 wait complete. 2024-04-01T06:55:33.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.837+0000 7fa77cdf9b80 1 -- start start 2024-04-01T06:55:33.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.838+0000 7fa77cdf9b80 1 Processor -- start 2024-04-01T06:55:33.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.838+0000 7fa77cdf9b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ba3c04c780 0x55ba3c056450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:33.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.838+0000 7fa77cdf9b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba3c04d0e0 0x55ba3c056990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:33.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.838+0000 7fa77cdf9b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ba3c04df80 0x55ba3c05d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:33.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.838+0000 7fa77cdf9b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba3bf39d30 con 0x55ba3c04df80 2024-04-01T06:55:33.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.838+0000 7fa77cdf9b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba3bf399d0 con 0x55ba3c04c780 2024-04-01T06:55:33.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.838+0000 7fa77cdf9b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba3be21650 con 0x55ba3c04d0e0 2024-04-01T06:55:33.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.838+0000 7fa77cdf9b80 10 client.0 _ll_register_callbacks cb 0x55ba3bf43420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:55:33.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.838+0000 7fa76ad9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ba3c04df80 0x55ba3c05d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:33.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.838+0000 7fa76ad9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ba3c04df80 0x55ba3c05d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46716/0 (socket says 172.21.15.83:46716) 2024-04-01T06:55:33.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.838+0000 7fa76ad9d700 1 -- 172.21.15.83:0/2368299218 learned_addr learned my addr 172.21.15.83:0/2368299218 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:33.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.838+0000 7fa76ad9d700 1 -- 172.21.15.83:0/2368299218 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba3c04d0e0 msgr2=0x55ba3c056990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:33.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.838+0000 7fa76ad9d700 1 --2- 172.21.15.83:0/2368299218 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba3c04d0e0 0x55ba3c056990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:33.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.838+0000 7fa76ad9d700 1 -- 172.21.15.83:0/2368299218 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ba3c04c780 msgr2=0x55ba3c056450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:33.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.838+0000 7fa76ad9d700 1 --2- 172.21.15.83:0/2368299218 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ba3c04c780 0x55ba3c056450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:33.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.838+0000 7fa76ad9d700 1 -- 172.21.15.83:0/2368299218 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa76c1a1470 con 0x55ba3c04df80 2024-04-01T06:55:33.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.838+0000 7fa76ad9d700 1 --2- 172.21.15.83:0/2368299218 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ba3c04df80 0x55ba3c05d9d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa76409b150 tx=0x7fa764009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afc04358300c40e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:33.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.838+0000 7fa751ffb700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:55:33.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.838+0000 7fa751ffb700 1 -- 172.21.15.83:0/2368299218 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76409b8b0 con 0x55ba3c04df80 2024-04-01T06:55:33.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.838+0000 7fa751ffb700 1 -- 172.21.15.83:0/2368299218 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(80..80 src has 1..80) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fa7640997f0 con 0x55ba3c04df80 2024-04-01T06:55:33.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.838+0000 7fa77cdf9b80 1 -- 172.21.15.83:0/2368299218 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ba3bf5e330 con 0x55ba3c04df80 2024-04-01T06:55:33.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.839+0000 7fa751ffb700 1 -- 172.21.15.83:0/2368299218 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa76409b450 con 0x55ba3c04df80 2024-04-01T06:55:33.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.839+0000 7fa77cdf9b80 10 client.15198 fetch_fsmap learned FSMap version 23 2024-04-01T06:55:33.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.839+0000 7fa77cdf9b80 1 -- 172.21.15.83:0/2368299218 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55ba3bdcbb10 con 0x55ba3c04df80 2024-04-01T06:55:33.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.839+0000 7fa751ffb700 1 -- 172.21.15.83:0/2368299218 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ba3bf5e330 con 0x55ba3c04df80 2024-04-01T06:55:33.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.839+0000 7fa751ffb700 1 -- 172.21.15.83:0/2368299218 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 23) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa764097360 con 0x55ba3c04df80 2024-04-01T06:55:33.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.839+0000 7fa77cdf9b80 10 client.15198 fetch_fsmap finished waiting for FSMap version 23 2024-04-01T06:55:33.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.839+0000 7fa77cdf9b80 10 client.15198 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-01T06:55:33.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.839+0000 7fa77cdf9b80 20 client.15198 populate_metadata read hostname 'smithi083' 2024-04-01T06:55:33.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.839+0000 7fa77cdf9b80 1 --2- 172.21.15.83:0/2368299218 >> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] conn(0x55ba3c060cc0 0x55ba3c0665d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:33.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.839+0000 7fa77cdf9b80 4 client.15198 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-01T06:55:33.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.839+0000 7fa77cdf9b80 1 -- 172.21.15.83:0/2368299218 --> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ba3bf966b0 con 0x55ba3c060cc0 2024-04-01T06:55:33.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.839+0000 7fa76a59c700 1 --2- 172.21.15.83:0/2368299218 >> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] conn(0x55ba3c060cc0 0x55ba3c0665d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:33.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.840+0000 7fa751ffb700 10 client.15198 ms_handle_connect on v2:172.21.15.145:6834/3104241497 2024-04-01T06:55:33.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.840+0000 7fa76a59c700 1 --2- 172.21.15.83:0/2368299218 >> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] conn(0x55ba3c060cc0 0x55ba3c0665d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=11f3cb80f19c2a5b server_cookie=f3c73fd76d4786fc in_seq=0 out_seq=0 2024-04-01T06:55:33.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.840+0000 7fa751ffb700 1 -- 172.21.15.83:0/2368299218 <== mds.2 v2:172.21.15.145:6834/3104241497 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ba3bf966b0 con 0x55ba3c060cc0 2024-04-01T06:55:33.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.840+0000 7fa751ffb700 10 client.15198 handle_command_reply: tid=0 2024-04-01T06:55:33.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.840+0000 7fa77cdf9b80 1 client.15198 shutdown 2024-04-01T06:55:33.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.841+0000 7fa77cdf9b80 1 -- 172.21.15.83:0/2368299218 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ba3c04df80 msgr2=0x55ba3c05d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:33.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.841+0000 7fa77cdf9b80 1 --2- 172.21.15.83:0/2368299218 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ba3c04df80 0x55ba3c05d9d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa76409b150 tx=0x7fa764009ba0 comp rx=0 tx=0).stop 2024-04-01T06:55:33.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.841+0000 7fa77cdf9b80 1 -- 172.21.15.83:0/2368299218 shutdown_connections 2024-04-01T06:55:33.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.841+0000 7fa77cdf9b80 1 --2- 172.21.15.83:0/2368299218 >> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] conn(0x55ba3c060cc0 0x55ba3c0665d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:33.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.841+0000 7fa77cdf9b80 1 --2- 172.21.15.83:0/2368299218 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ba3c04df80 0x55ba3c05d9d0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:33.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.841+0000 7fa751ffb700 0 client.15198 ms_handle_reset on v2:172.21.15.145:6834/3104241497 2024-04-01T06:55:33.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.841+0000 7fa77cdf9b80 1 --2- 172.21.15.83:0/2368299218 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ba3c04c780 0x55ba3c056450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:33.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.841+0000 7fa77cdf9b80 1 --2- 172.21.15.83:0/2368299218 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba3c04d0e0 0x55ba3c056990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:33.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.841+0000 7fa77cdf9b80 1 -- 172.21.15.83:0/2368299218 >> 172.21.15.83:0/2368299218 conn(0x55ba3bfab650 msgr2=0x55ba3c04b120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:33.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.841+0000 7fa77cdf9b80 1 -- 172.21.15.83:0/2368299218 shutdown_connections 2024-04-01T06:55:33.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.841+0000 7fa77cdf9b80 1 -- 172.21.15.83:0/2368299218 wait complete. 2024-04-01T06:55:33.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.841+0000 7fa77cdf9b80 20 client.15198 trim_cache size 0 max 16384 2024-04-01T06:55:33.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.858+0000 7fa77cdf9b80 1 Processor -- start 2024-04-01T06:55:33.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.858+0000 7fa77cdf9b80 1 -- start start 2024-04-01T06:55:33.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.858+0000 7fa77cdf9b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ba3c04c780 0x55ba3c04cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:33.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.858+0000 7fa77cdf9b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba3c04d0e0 0x55ba3c05e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:33.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.859+0000 7fa77cdf9b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ba3c04df80 0x55ba3c05d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:33.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.859+0000 7fa77cdf9b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba3bf966b0 con 0x55ba3c04df80 2024-04-01T06:55:33.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.859+0000 7fa77cdf9b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba3bf5e330 con 0x55ba3c04c780 2024-04-01T06:55:33.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.859+0000 7fa77cdf9b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba3bf96990 con 0x55ba3c04d0e0 2024-04-01T06:55:33.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.859+0000 7fa76ad9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ba3c04df80 0x55ba3c05d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:33.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.859+0000 7fa76ad9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ba3c04df80 0x55ba3c05d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46718/0 (socket says 172.21.15.83:46718) 2024-04-01T06:55:33.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.859+0000 7fa76ad9d700 1 -- 172.21.15.83:0/1296803897 learned_addr learned my addr 172.21.15.83:0/1296803897 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:33.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.859+0000 7fa76a59c700 1 --2- 172.21.15.83:0/1296803897 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ba3c04c780 0x55ba3c04cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:33.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.859+0000 7fa76ad9d700 1 -- 172.21.15.83:0/1296803897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba3c04d0e0 msgr2=0x55ba3c05e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:33.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.859+0000 7fa76ad9d700 1 --2- 172.21.15.83:0/1296803897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba3c04d0e0 0x55ba3c05e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:33.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.859+0000 7fa76ad9d700 1 -- 172.21.15.83:0/1296803897 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ba3c04c780 msgr2=0x55ba3c04cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:33.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.859+0000 7fa76ad9d700 1 --2- 172.21.15.83:0/1296803897 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ba3c04c780 0x55ba3c04cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:33.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.859+0000 7fa76ad9d700 1 -- 172.21.15.83:0/1296803897 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ba3bf63e50 con 0x55ba3c04df80 2024-04-01T06:55:33.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.859+0000 7fa76ad9d700 1 --2- 172.21.15.83:0/1296803897 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ba3c04df80 0x55ba3c05d990 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa764007590 tx=0x7fa7640976f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92347001187b44cd server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:33.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.859+0000 7fa7617fa700 1 -- 172.21.15.83:0/1296803897 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7640993a0 con 0x55ba3c04df80 2024-04-01T06:55:33.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.859+0000 7fa7617fa700 1 -- 172.21.15.83:0/1296803897 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa7640997f0 con 0x55ba3c04df80 2024-04-01T06:55:33.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.859+0000 7fa7617fa700 1 -- 172.21.15.83:0/1296803897 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76409b6b0 con 0x55ba3c04df80 2024-04-01T06:55:33.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.860+0000 7fa77cdf9b80 1 -- 172.21.15.83:0/1296803897 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ba3c04df80 msgr2=0x55ba3c05d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:33.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.860+0000 7fa77cdf9b80 1 --2- 172.21.15.83:0/1296803897 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ba3c04df80 0x55ba3c05d990 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa764007590 tx=0x7fa7640976f0 comp rx=0 tx=0).stop 2024-04-01T06:55:33.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.860+0000 7fa77cdf9b80 1 -- 172.21.15.83:0/1296803897 shutdown_connections 2024-04-01T06:55:33.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.860+0000 7fa77cdf9b80 1 --2- 172.21.15.83:0/1296803897 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ba3c04df80 0x55ba3c05d990 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:33.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.860+0000 7fa77cdf9b80 1 --2- 172.21.15.83:0/1296803897 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ba3c04c780 0x55ba3c04cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:33.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.860+0000 7fa77cdf9b80 1 --2- 172.21.15.83:0/1296803897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba3c04d0e0 0x55ba3c05e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:33.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.860+0000 7fa77cdf9b80 1 -- 172.21.15.83:0/1296803897 >> 172.21.15.83:0/1296803897 conn(0x55ba3bfab650 msgr2=0x55ba3c055960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:33.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.860+0000 7fa77cdf9b80 1 -- 172.21.15.83:0/1296803897 shutdown_connections 2024-04-01T06:55:33.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.860+0000 7fa77cdf9b80 1 -- 172.21.15.83:0/1296803897 wait complete. 2024-04-01T06:55:33.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.860+0000 7fa77cdf9b80 1 -- start start 2024-04-01T06:55:33.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.860+0000 7fa77cdf9b80 1 Processor -- start 2024-04-01T06:55:33.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.860+0000 7fa77cdf9b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ba3c04c780 0x55ba3c059a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:33.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.860+0000 7fa77cdf9b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ba3c04d0e0 0x55ba3c059f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:33.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.860+0000 7fa77cdf9b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba3c04df80 0x55ba3c05cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:33.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.860+0000 7fa77cdf9b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba3c05d4c0 con 0x55ba3c04c780 2024-04-01T06:55:33.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.860+0000 7fa77cdf9b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba3c05d630 con 0x55ba3c04d0e0 2024-04-01T06:55:33.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.860+0000 7fa77cdf9b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba3c05d7f0 con 0x55ba3c04df80 2024-04-01T06:55:33.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.860+0000 7fa77cdf9b80 10 client.0 _ll_register_callbacks cb 0x55ba3bf43420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:55:33.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.860+0000 7fa76a59c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ba3c04c780 0x55ba3c059a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:33.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.860+0000 7fa76a59c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ba3c04c780 0x55ba3c059a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46722/0 (socket says 172.21.15.83:46722) 2024-04-01T06:55:33.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.860+0000 7fa76a59c700 1 -- 172.21.15.83:0/273208097 learned_addr learned my addr 172.21.15.83:0/273208097 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:33.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.860+0000 7fa769d9b700 1 --2- 172.21.15.83:0/273208097 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ba3c04d0e0 0x55ba3c059f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:33.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.861+0000 7fa76ad9d700 1 --2- 172.21.15.83:0/273208097 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba3c04df80 0x55ba3c05cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:33.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.861+0000 7fa76a59c700 1 -- 172.21.15.83:0/273208097 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba3c04df80 msgr2=0x55ba3c05cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:33.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.861+0000 7fa76a59c700 1 --2- 172.21.15.83:0/273208097 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba3c04df80 0x55ba3c05cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:33.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.861+0000 7fa76a59c700 1 -- 172.21.15.83:0/273208097 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ba3c04d0e0 msgr2=0x55ba3c059f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:33.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.861+0000 7fa76a59c700 1 --2- 172.21.15.83:0/273208097 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ba3c04d0e0 0x55ba3c059f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:33.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.861+0000 7fa76a59c700 1 -- 172.21.15.83:0/273208097 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ba3bdcbb10 con 0x55ba3c04c780 2024-04-01T06:55:33.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.861+0000 7fa76a59c700 1 --2- 172.21.15.83:0/273208097 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ba3c04c780 0x55ba3c059a20 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x55ba3c062c10 tx=0x7fa7540047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14ba8ecc75004387 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:33.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.861+0000 7fa751ffb700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:55:33.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.861+0000 7fa751ffb700 1 -- 172.21.15.83:0/273208097 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa754022070 con 0x55ba3c04c780 2024-04-01T06:55:33.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.861+0000 7fa751ffb700 1 -- 172.21.15.83:0/273208097 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(80..80 src has 1..80) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fa754004450 con 0x55ba3c04c780 2024-04-01T06:55:33.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.861+0000 7fa77cdf9b80 1 -- 172.21.15.83:0/273208097 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa76409f280 con 0x55ba3c04c780 2024-04-01T06:55:33.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.861+0000 7fa751ffb700 1 -- 172.21.15.83:0/273208097 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa7540235d0 con 0x55ba3c04c780 2024-04-01T06:55:33.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.861+0000 7fa77cdf9b80 10 client.15204 fetch_fsmap learned FSMap version 23 2024-04-01T06:55:33.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.861+0000 7fa77cdf9b80 1 -- 172.21.15.83:0/273208097 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55ba3be23c80 con 0x55ba3c04c780 2024-04-01T06:55:33.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.861+0000 7fa751ffb700 1 -- 172.21.15.83:0/273208097 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa76409f280 con 0x55ba3c04c780 2024-04-01T06:55:33.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.861+0000 7fa751ffb700 1 -- 172.21.15.83:0/273208097 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 23) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa754003b80 con 0x55ba3c04c780 2024-04-01T06:55:33.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.861+0000 7fa77cdf9b80 10 client.15204 fetch_fsmap finished waiting for FSMap version 23 2024-04-01T06:55:33.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.861+0000 7fa77cdf9b80 10 client.15204 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-01T06:55:33.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.861+0000 7fa77cdf9b80 20 client.15204 populate_metadata read hostname 'smithi083' 2024-04-01T06:55:33.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.861+0000 7fa77cdf9b80 1 --2- 172.21.15.83:0/273208097 >> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] conn(0x55ba3c0ba210 0x55ba3c0b6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:33.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.861+0000 7fa77cdf9b80 4 client.15204 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-01T06:55:33.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.861+0000 7fa77cdf9b80 1 -- 172.21.15.83:0/273208097 --> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ba3bdecca0 con 0x55ba3c0ba210 2024-04-01T06:55:33.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.862+0000 7fa769d9b700 1 --2- 172.21.15.83:0/273208097 >> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] conn(0x55ba3c0ba210 0x55ba3c0b6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:33.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.862+0000 7fa751ffb700 10 client.15204 ms_handle_connect on v2:172.21.15.145:6834/3104241497 2024-04-01T06:55:33.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.862+0000 7fa769d9b700 1 --2- 172.21.15.83:0/273208097 >> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] conn(0x55ba3c0ba210 0x55ba3c0b6b80 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ed4564af18bf27 server_cookie=2e53654a10f0d835 in_seq=0 out_seq=0 2024-04-01T06:55:33.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.862+0000 7fa751ffb700 1 -- 172.21.15.83:0/273208097 <== mds.2 v2:172.21.15.145:6834/3104241497 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x55ba3bdecca0 con 0x55ba3c0ba210 2024-04-01T06:55:33.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.862+0000 7fa751ffb700 10 client.15204 handle_command_reply: tid=0 2024-04-01T06:55:33.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.862+0000 7fa77cdf9b80 1 client.15204 shutdown 2024-04-01T06:55:33.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.862+0000 7fa77cdf9b80 1 -- 172.21.15.83:0/273208097 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ba3c04c780 msgr2=0x55ba3c059a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:33.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.862+0000 7fa77cdf9b80 1 --2- 172.21.15.83:0/273208097 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ba3c04c780 0x55ba3c059a20 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x55ba3c062c10 tx=0x7fa7540047c0 comp rx=0 tx=0).stop 2024-04-01T06:55:33.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.862+0000 7fa77cdf9b80 1 -- 172.21.15.83:0/273208097 shutdown_connections 2024-04-01T06:55:33.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.863+0000 7fa77cdf9b80 1 --2- 172.21.15.83:0/273208097 >> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] conn(0x55ba3c0ba210 0x55ba3c0b6b80 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:33.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.863+0000 7fa77cdf9b80 1 --2- 172.21.15.83:0/273208097 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ba3c04c780 0x55ba3c059a20 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:33.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.863+0000 7fa77cdf9b80 1 --2- 172.21.15.83:0/273208097 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba3c04df80 0x55ba3c05cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:33.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.863+0000 7fa751ffb700 0 client.15204 ms_handle_reset on v2:172.21.15.145:6834/3104241497 2024-04-01T06:55:33.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.863+0000 7fa77cdf9b80 1 --2- 172.21.15.83:0/273208097 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ba3c04d0e0 0x55ba3c059f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:33.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.863+0000 7fa77cdf9b80 1 -- 172.21.15.83:0/273208097 >> 172.21.15.83:0/273208097 conn(0x55ba3bfab650 msgr2=0x55ba3c051190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:33.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.863+0000 7fa77cdf9b80 1 -- 172.21.15.83:0/273208097 shutdown_connections 2024-04-01T06:55:33.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.863+0000 7fa77cdf9b80 1 -- 172.21.15.83:0/273208097 wait complete. 2024-04-01T06:55:33.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.863+0000 7fa77cdf9b80 20 client.15204 trim_cache size 0 max 16384 2024-04-01T06:55:33.870 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-04-01T06:55:33.870 INFO:teuthology.orchestra.run.smithi083.stdout: "cluster_fsid": "c6f8eff4-eff3-11ee-b647-cb9ed24678a4", 2024-04-01T06:55:33.870 INFO:teuthology.orchestra.run.smithi083.stdout: "whoami": 2, 2024-04-01T06:55:33.870 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 24473, 2024-04-01T06:55:33.870 INFO:teuthology.orchestra.run.smithi083.stdout: "want_state": "up:active", 2024-04-01T06:55:33.870 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "up:active", 2024-04-01T06:55:33.870 INFO:teuthology.orchestra.run.smithi083.stdout: "fs_name": "cephfs", 2024-04-01T06:55:33.871 INFO:teuthology.orchestra.run.smithi083.stdout: "rank_uptime": 61.163579495, 2024-04-01T06:55:33.871 INFO:teuthology.orchestra.run.smithi083.stdout: "mdsmap_epoch": 23, 2024-04-01T06:55:33.871 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_epoch": 80, 2024-04-01T06:55:33.871 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_epoch_barrier": 79, 2024-04-01T06:55:33.871 INFO:teuthology.orchestra.run.smithi083.stdout: "uptime": 83.637182632000005 2024-04-01T06:55:33.871 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-04-01T06:55:33.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.863+0000 7fa770c63700 1 -- 172.21.15.83:0/639343720 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fa7580a11b0 msgr2=0x7fa7580a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:33.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.863+0000 7fa770c63700 1 --2- 172.21.15.83:0/639343720 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fa7580a11b0 0x7fa7580a3670 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa754005fd0 tx=0x7fa754005e40 comp rx=0 tx=0).stop 2024-04-01T06:55:33.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.863+0000 7fa770c63700 1 -- 172.21.15.83:0/639343720 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa76c102910 msgr2=0x7fa76c1a0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:33.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.863+0000 7fa770c63700 1 --2- 172.21.15.83:0/639343720 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa76c102910 0x7fa76c1a0530 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa764007bd0 tx=0x7fa764009570 comp rx=0 tx=0).stop 2024-04-01T06:55:33.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.863+0000 7fa770c63700 1 -- 172.21.15.83:0/639343720 shutdown_connections 2024-04-01T06:55:33.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.863+0000 7fa770c63700 1 --2- 172.21.15.83:0/639343720 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa76c102910 0x7fa76c1a0530 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:33.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.863+0000 7fa770c63700 1 --2- 172.21.15.83:0/639343720 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fa7580a11b0 0x7fa7580a3670 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:33.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.863+0000 7fa770c63700 1 --2- 172.21.15.83:0/639343720 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa76c100d80 0x7fa76c198fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:33.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.863+0000 7fa770c63700 1 --2- 172.21.15.83:0/639343720 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa76c101f70 0x7fa76c199510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:33.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.863+0000 7fa770c63700 1 -- 172.21.15.83:0/639343720 >> 172.21.15.83:0/639343720 conn(0x7fa76c0fc2f0 msgr2=0x7fa76c072fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:33.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.863+0000 7fa770c63700 1 -- 172.21.15.83:0/639343720 shutdown_connections 2024-04-01T06:55:33.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.863+0000 7fa770c63700 1 -- 172.21.15.83:0/639343720 wait complete. 2024-04-01T06:55:33.875 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2024-04-01T06:55:34.011 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:33 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/76212043' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-01T06:55:34.012 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:33 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/766237079' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:55:34.012 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:33 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/4036771209' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T06:55:34.012 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:33 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2024-04-01T06:55:34.012 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:33 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-04-01T06:55:34.012 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:33 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]: dispatch 2024-04-01T06:55:34.012 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:33 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-04-01T06:55:34.013 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:33 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-04-01T06:55:34.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.997+0000 7f0175a5c700 1 -- 172.21.15.83:0/657741696 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0170100d80 msgr2=0x7f01701011a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:34.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.997+0000 7f0175a5c700 1 --2- 172.21.15.83:0/657741696 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0170100d80 0x7f01701011a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f01600099c0 tx=0x7f0160009cd0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.997+0000 7f0175a5c700 1 -- 172.21.15.83:0/657741696 shutdown_connections 2024-04-01T06:55:34.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.997+0000 7f0175a5c700 1 --2- 172.21.15.83:0/657741696 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0170100d80 0x7f01701011a0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.997+0000 7f0175a5c700 1 --2- 172.21.15.83:0/657741696 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0170102910 0x7f01701091c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.997+0000 7f0175a5c700 1 --2- 172.21.15.83:0/657741696 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0170101f70 0x7f01701023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.997+0000 7f0175a5c700 1 -- 172.21.15.83:0/657741696 >> 172.21.15.83:0/657741696 conn(0x7f01700fc2f0 msgr2=0x7f01700fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:34.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.997+0000 7f0175a5c700 1 -- 172.21.15.83:0/657741696 shutdown_connections 2024-04-01T06:55:34.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.997+0000 7f0175a5c700 1 -- 172.21.15.83:0/657741696 wait complete. 2024-04-01T06:55:34.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.998+0000 7f0175a5c700 1 Processor -- start 2024-04-01T06:55:34.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.998+0000 7f0175a5c700 1 -- start start 2024-04-01T06:55:34.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.998+0000 7f0175a5c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0170100d80 0x7f0170196d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:34.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.998+0000 7f0175a5c700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0170101f70 0x7f0170197290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:34.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.998+0000 7f0175a5c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0170102910 0x7f017019e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:34.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.998+0000 7f0175a5c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f017019e840 con 0x7f0170102910 2024-04-01T06:55:34.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.998+0000 7f0175a5c700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f017019e9b0 con 0x7f0170101f70 2024-04-01T06:55:34.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.998+0000 7f0175a5c700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f017019eb70 con 0x7f0170100d80 2024-04-01T06:55:34.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.998+0000 7f016f7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0170102910 0x7f017019e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:34.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.998+0000 7f016f7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0170102910 0x7f017019e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46734/0 (socket says 172.21.15.83:46734) 2024-04-01T06:55:34.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.998+0000 7f016f7fe700 1 -- 172.21.15.83:0/1274651097 learned_addr learned my addr 172.21.15.83:0/1274651097 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:34.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.998+0000 7f01667fc700 1 --2- 172.21.15.83:0/1274651097 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0170101f70 0x7f0170197290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:34.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.998+0000 7f016effd700 1 --2- 172.21.15.83:0/1274651097 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0170100d80 0x7f0170196d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:34.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.998+0000 7f016f7fe700 1 -- 172.21.15.83:0/1274651097 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0170100d80 msgr2=0x7f0170196d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:34.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.998+0000 7f016f7fe700 1 --2- 172.21.15.83:0/1274651097 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0170100d80 0x7f0170196d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.998+0000 7f016f7fe700 1 -- 172.21.15.83:0/1274651097 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0170101f70 msgr2=0x7f0170197290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:34.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.998+0000 7f016f7fe700 1 --2- 172.21.15.83:0/1274651097 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0170101f70 0x7f0170197290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.998+0000 7f016f7fe700 1 -- 172.21.15.83:0/1274651097 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01600095f0 con 0x7f0170102910 2024-04-01T06:55:34.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.999+0000 7f016f7fe700 1 --2- 172.21.15.83:0/1274651097 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0170102910 0x7f017019e270 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f016800ada0 tx=0x7f016800c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:34.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.999+0000 7f0174a5a700 1 -- 172.21.15.83:0/1274651097 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016800f070 con 0x7f0170102910 2024-04-01T06:55:34.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.999+0000 7f0175a5c700 1 -- 172.21.15.83:0/1274651097 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0170073100 con 0x7f0170102910 2024-04-01T06:55:34.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.999+0000 7f0174a5a700 1 -- 172.21.15.83:0/1274651097 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0168007b30 con 0x7f0170102910 2024-04-01T06:55:34.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.999+0000 7f0174a5a700 1 -- 172.21.15.83:0/1274651097 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0168005440 con 0x7f0170102910 2024-04-01T06:55:34.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:33.999+0000 7f0175a5c700 1 -- 172.21.15.83:0/1274651097 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0170073610 con 0x7f0170102910 2024-04-01T06:55:34.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.001+0000 7f0174a5a700 1 -- 172.21.15.83:0/1274651097 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f0168004ad0 con 0x7f0170102910 2024-04-01T06:55:34.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.001+0000 7f0174a5a700 1 --2- 172.21.15.83:0/1274651097 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f015c0a11b0 0x7f015c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:34.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.001+0000 7f016effd700 1 --2- 172.21.15.83:0/1274651097 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f015c0a11b0 0x7f015c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:34.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.001+0000 7f0174a5a700 1 -- 172.21.15.83:0/1274651097 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f01680cbfc0 con 0x7f0170102910 2024-04-01T06:55:34.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.002+0000 7f016effd700 1 --2- 172.21.15.83:0/1274651097 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f015c0a11b0 0x7f015c0a3670 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0160009990 tx=0x7f0160005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:34.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.002+0000 7f0181bf2b80 1 Processor -- start 2024-04-01T06:55:34.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.002+0000 7f0181bf2b80 1 -- start start 2024-04-01T06:55:34.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.002+0000 7f0181bf2b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5617a1d95780 0x5617a1d95ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:34.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.002+0000 7f0181bf2b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5617a1d960e0 0x5617a1d969a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:34.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.002+0000 7f0181bf2b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5617a1d96f80 0x5617a1d97400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:34.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.002+0000 7f0181bf2b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617a1ced940 con 0x5617a1d95780 2024-04-01T06:55:34.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.002+0000 7f0181bf2b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617a1ceb300 con 0x5617a1d960e0 2024-04-01T06:55:34.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.002+0000 7f0181bf2b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617a1ce6bf0 con 0x5617a1d96f80 2024-04-01T06:55:34.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.002+0000 7f016effd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5617a1d95780 0x5617a1d95ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:34.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.003+0000 7f016effd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5617a1d95780 0x5617a1d95ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46738/0 (socket says 172.21.15.83:46738) 2024-04-01T06:55:34.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.003+0000 7f016effd700 1 -- 172.21.15.83:0/3306016839 learned_addr learned my addr 172.21.15.83:0/3306016839 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:34.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.003+0000 7f016effd700 1 -- 172.21.15.83:0/3306016839 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5617a1d96f80 msgr2=0x5617a1d97400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:34.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.003+0000 7f016effd700 1 --2- 172.21.15.83:0/3306016839 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5617a1d96f80 0x5617a1d97400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.003+0000 7f016effd700 1 -- 172.21.15.83:0/3306016839 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5617a1d960e0 msgr2=0x5617a1d969a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:34.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.003+0000 7f01667fc700 1 --2- 172.21.15.83:0/3306016839 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5617a1d960e0 0x5617a1d969a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:34.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.003+0000 7f016effd700 1 --2- 172.21.15.83:0/3306016839 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5617a1d960e0 0x5617a1d969a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.003+0000 7f016effd700 1 -- 172.21.15.83:0/3306016839 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5617a1b68360 con 0x5617a1d95780 2024-04-01T06:55:34.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.003+0000 7f016effd700 1 --2- 172.21.15.83:0/3306016839 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5617a1d95780 0x5617a1d95ba0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0160015000 tx=0x7f016001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3218289bd7c447c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:34.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.003+0000 7f0165ffb700 1 -- 172.21.15.83:0/3306016839 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016002b070 con 0x5617a1d95780 2024-04-01T06:55:34.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.003+0000 7f0165ffb700 1 -- 172.21.15.83:0/3306016839 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f016001e040 con 0x5617a1d95780 2024-04-01T06:55:34.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.003+0000 7f0165ffb700 1 -- 172.21.15.83:0/3306016839 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016000f660 con 0x5617a1d95780 2024-04-01T06:55:34.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.004+0000 7f0181bf2b80 1 -- 172.21.15.83:0/3306016839 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5617a1d95780 msgr2=0x5617a1d95ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:34.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.004+0000 7f0181bf2b80 1 --2- 172.21.15.83:0/3306016839 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5617a1d95780 0x5617a1d95ba0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0160015000 tx=0x7f016001f000 comp rx=0 tx=0).stop 2024-04-01T06:55:34.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.004+0000 7f0181bf2b80 1 -- 172.21.15.83:0/3306016839 shutdown_connections 2024-04-01T06:55:34.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.004+0000 7f0181bf2b80 1 --2- 172.21.15.83:0/3306016839 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5617a1d95780 0x5617a1d95ba0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.004+0000 7f0181bf2b80 1 --2- 172.21.15.83:0/3306016839 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5617a1d96f80 0x5617a1d97400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.004+0000 7f0181bf2b80 1 --2- 172.21.15.83:0/3306016839 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5617a1d960e0 0x5617a1d969a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.004+0000 7f0181bf2b80 1 -- 172.21.15.83:0/3306016839 >> 172.21.15.83:0/3306016839 conn(0x5617a1cf4650 msgr2=0x5617a1d90950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:34.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.004+0000 7f0181bf2b80 1 -- 172.21.15.83:0/3306016839 shutdown_connections 2024-04-01T06:55:34.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.004+0000 7f0181bf2b80 1 -- 172.21.15.83:0/3306016839 wait complete. 2024-04-01T06:55:34.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.004+0000 7f0181bf2b80 1 -- start start 2024-04-01T06:55:34.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.004+0000 7f0181bf2b80 1 Processor -- start 2024-04-01T06:55:34.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.005+0000 7f0181bf2b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5617a1d95780 0x5617a1d9f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:34.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.005+0000 7f0181bf2b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5617a1d960e0 0x5617a1d9fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:34.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.005+0000 7f0181bf2b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5617a1d96f80 0x5617a1da6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:34.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.005+0000 7f0181bf2b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617a1c82d30 con 0x5617a1d95780 2024-04-01T06:55:34.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.005+0000 7f0181bf2b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617a1c829d0 con 0x5617a1d96f80 2024-04-01T06:55:34.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.005+0000 7f0181bf2b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617a1b6a650 con 0x5617a1d960e0 2024-04-01T06:55:34.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.005+0000 7f0181bf2b80 10 client.0 _ll_register_callbacks cb 0x5617a1c8c420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:55:34.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.005+0000 7f016effd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5617a1d95780 0x5617a1d9f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:34.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.005+0000 7f016effd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5617a1d95780 0x5617a1d9f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46740/0 (socket says 172.21.15.83:46740) 2024-04-01T06:55:34.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.005+0000 7f016effd700 1 -- 172.21.15.83:0/1032339325 learned_addr learned my addr 172.21.15.83:0/1032339325 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:34.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.005+0000 7f016f7fe700 1 --2- 172.21.15.83:0/1032339325 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5617a1d96f80 0x5617a1da6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:34.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.005+0000 7f016effd700 1 -- 172.21.15.83:0/1032339325 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5617a1d960e0 msgr2=0x5617a1d9fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:34.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.005+0000 7f016effd700 1 --2- 172.21.15.83:0/1032339325 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5617a1d960e0 0x5617a1d9fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.005+0000 7f016effd700 1 -- 172.21.15.83:0/1032339325 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5617a1d96f80 msgr2=0x5617a1da6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:34.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.005+0000 7f016effd700 1 --2- 172.21.15.83:0/1032339325 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5617a1d96f80 0x5617a1da6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.005+0000 7f016effd700 1 -- 172.21.15.83:0/1032339325 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0170109b10 con 0x5617a1d95780 2024-04-01T06:55:34.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.005+0000 7f016f7fe700 1 --2- 172.21.15.83:0/1032339325 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5617a1d96f80 0x5617a1da6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:55:34.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.005+0000 7f016effd700 1 --2- 172.21.15.83:0/1032339325 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5617a1d95780 0x5617a1d9f550 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0160031040 tx=0x7f0160003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=201b644acc3dc144 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:34.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.005+0000 7f014effd700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:55:34.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.005+0000 7f014effd700 1 -- 172.21.15.83:0/1032339325 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016002b070 con 0x5617a1d95780 2024-04-01T06:55:34.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.005+0000 7f0181bf2b80 1 -- 172.21.15.83:0/1032339325 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5617a1ca7330 con 0x5617a1d95780 2024-04-01T06:55:34.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.005+0000 7f014effd700 1 -- 172.21.15.83:0/1032339325 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(80..80 src has 1..80) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f016000f930 con 0x5617a1d95780 2024-04-01T06:55:34.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.005+0000 7f014effd700 1 -- 172.21.15.83:0/1032339325 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f016000faf0 con 0x5617a1d95780 2024-04-01T06:55:34.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.005+0000 7f0181bf2b80 10 client.15216 fetch_fsmap learned FSMap version 23 2024-04-01T06:55:34.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.005+0000 7f0181bf2b80 1 -- 172.21.15.83:0/1032339325 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x5617a1b14b10 con 0x5617a1d95780 2024-04-01T06:55:34.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.006+0000 7f014effd700 1 -- 172.21.15.83:0/1032339325 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5617a1ca7330 con 0x5617a1d95780 2024-04-01T06:55:34.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.006+0000 7f014effd700 1 -- 172.21.15.83:0/1032339325 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 23) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f016002f400 con 0x5617a1d95780 2024-04-01T06:55:34.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.006+0000 7f0181bf2b80 10 client.15216 fetch_fsmap finished waiting for FSMap version 23 2024-04-01T06:55:34.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.006+0000 7f0181bf2b80 10 client.15216 resolve_mds: resolved name 'h' to daemon mds.h 2024-04-01T06:55:34.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.006+0000 7f0181bf2b80 20 client.15216 populate_metadata read hostname 'smithi083' 2024-04-01T06:55:34.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.006+0000 7f0181bf2b80 1 --2- 172.21.15.83:0/1032339325 >> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] conn(0x5617a1daa260 0x5617a1daf560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:34.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.006+0000 7f0181bf2b80 4 client.15216 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-01T06:55:34.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.006+0000 7f0181bf2b80 1 -- 172.21.15.83:0/1032339325 --> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5617a1cdf6b0 con 0x5617a1daa260 2024-04-01T06:55:34.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.006+0000 7f01667fc700 1 --2- 172.21.15.83:0/1032339325 >> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] conn(0x5617a1daa260 0x5617a1daf560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:34.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.007+0000 7f014effd700 10 client.15216 ms_handle_connect on v2:172.21.15.145:6836/2687798317 2024-04-01T06:55:34.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.007+0000 7f01667fc700 1 --2- 172.21.15.83:0/1032339325 >> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] conn(0x5617a1daa260 0x5617a1daf560 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b687b873b6a175f4 server_cookie=f81428b486abf247 in_seq=0 out_seq=0 2024-04-01T06:55:34.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.007+0000 7f014effd700 1 -- 172.21.15.83:0/1032339325 <== mds.1 v2:172.21.15.145:6836/2687798317 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5617a1cdf6b0 con 0x5617a1daa260 2024-04-01T06:55:34.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.007+0000 7f014effd700 10 client.15216 handle_command_reply: tid=0 2024-04-01T06:55:34.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.007+0000 7f0181bf2b80 1 client.15216 shutdown 2024-04-01T06:55:34.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.008+0000 7f0181bf2b80 1 -- 172.21.15.83:0/1032339325 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5617a1d95780 msgr2=0x5617a1d9f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:34.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.008+0000 7f0181bf2b80 1 --2- 172.21.15.83:0/1032339325 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5617a1d95780 0x5617a1d9f550 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0160031040 tx=0x7f0160003f90 comp rx=0 tx=0).stop 2024-04-01T06:55:34.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.008+0000 7f0181bf2b80 1 -- 172.21.15.83:0/1032339325 shutdown_connections 2024-04-01T06:55:34.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.008+0000 7f0181bf2b80 1 --2- 172.21.15.83:0/1032339325 >> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] conn(0x5617a1daa260 0x5617a1daf560 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.008+0000 7f0181bf2b80 1 --2- 172.21.15.83:0/1032339325 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5617a1d95780 0x5617a1d9f550 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.008+0000 7f0181bf2b80 1 --2- 172.21.15.83:0/1032339325 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5617a1d96f80 0x5617a1da6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.008+0000 7f014effd700 0 client.15216 ms_handle_reset on v2:172.21.15.145:6836/2687798317 2024-04-01T06:55:34.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.008+0000 7f0181bf2b80 1 --2- 172.21.15.83:0/1032339325 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5617a1d960e0 0x5617a1d9fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.008+0000 7f0181bf2b80 1 -- 172.21.15.83:0/1032339325 >> 172.21.15.83:0/1032339325 conn(0x5617a1cf4650 msgr2=0x5617a1d94120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:34.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.008+0000 7f0181bf2b80 1 -- 172.21.15.83:0/1032339325 shutdown_connections 2024-04-01T06:55:34.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.008+0000 7f0181bf2b80 1 -- 172.21.15.83:0/1032339325 wait complete. 2024-04-01T06:55:34.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.008+0000 7f0181bf2b80 20 client.15216 trim_cache size 0 max 16384 2024-04-01T06:55:34.027 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:33 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/76212043' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-01T06:55:34.028 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:33 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/766237079' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:55:34.028 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:33 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/4036771209' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T06:55:34.028 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:33 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2024-04-01T06:55:34.028 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:33 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-04-01T06:55:34.028 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:33 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]: dispatch 2024-04-01T06:55:34.028 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:33 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-04-01T06:55:34.028 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:33 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-04-01T06:55:34.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.025+0000 7f0181bf2b80 1 Processor -- start 2024-04-01T06:55:34.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.025+0000 7f0181bf2b80 1 -- start start 2024-04-01T06:55:34.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.025+0000 7f0181bf2b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5617a1d95780 0x5617a1da7180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:34.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.025+0000 7f0181bf2b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5617a1d960e0 0x5617a1da6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:34.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.025+0000 7f0181bf2b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5617a1d96f80 0x5617a1d8fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:34.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.025+0000 7f0181bf2b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617a1d9dd40 con 0x5617a1d95780 2024-04-01T06:55:34.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.025+0000 7f0181bf2b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617a1dabb10 con 0x5617a1d96f80 2024-04-01T06:55:34.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.025+0000 7f0181bf2b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617a1cdf6b0 con 0x5617a1d960e0 2024-04-01T06:55:34.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.025+0000 7f016effd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5617a1d95780 0x5617a1da7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:34.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.025+0000 7f016effd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5617a1d95780 0x5617a1da7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46744/0 (socket says 172.21.15.83:46744) 2024-04-01T06:55:34.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.025+0000 7f016effd700 1 -- 172.21.15.83:0/1653599946 learned_addr learned my addr 172.21.15.83:0/1653599946 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:34.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.025+0000 7f01667fc700 1 --2- 172.21.15.83:0/1653599946 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5617a1d960e0 0x5617a1da6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:34.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.025+0000 7f016effd700 1 -- 172.21.15.83:0/1653599946 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5617a1d960e0 msgr2=0x5617a1da6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:34.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.025+0000 7f016effd700 1 --2- 172.21.15.83:0/1653599946 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5617a1d960e0 0x5617a1da6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.025+0000 7f016f7fe700 1 --2- 172.21.15.83:0/1653599946 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5617a1d96f80 0x5617a1d8fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:34.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.025+0000 7f016effd700 1 -- 172.21.15.83:0/1653599946 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5617a1d96f80 msgr2=0x5617a1d8fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:34.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.025+0000 7f016effd700 1 --2- 172.21.15.83:0/1653599946 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5617a1d96f80 0x5617a1d8fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.025+0000 7f016effd700 1 -- 172.21.15.83:0/1653599946 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5617a1cace50 con 0x5617a1d95780 2024-04-01T06:55:34.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.026+0000 7f016effd700 1 --2- 172.21.15.83:0/1653599946 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5617a1d95780 0x5617a1da7180 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f0160009d10 tx=0x7f016000bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c09854d39f7f1c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:34.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.026+0000 7f0166ffd700 1 -- 172.21.15.83:0/1653599946 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016002b030 con 0x5617a1d95780 2024-04-01T06:55:34.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.026+0000 7f0166ffd700 1 -- 172.21.15.83:0/1653599946 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f016002c040 con 0x5617a1d95780 2024-04-01T06:55:34.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.026+0000 7f0166ffd700 1 -- 172.21.15.83:0/1653599946 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0160043440 con 0x5617a1d95780 2024-04-01T06:55:34.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.026+0000 7f0181bf2b80 1 -- 172.21.15.83:0/1653599946 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5617a1d95780 msgr2=0x5617a1da7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:34.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.026+0000 7f0181bf2b80 1 --2- 172.21.15.83:0/1653599946 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5617a1d95780 0x5617a1da7180 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f0160009d10 tx=0x7f016000bc20 comp rx=0 tx=0).stop 2024-04-01T06:55:34.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.026+0000 7f0181bf2b80 1 -- 172.21.15.83:0/1653599946 shutdown_connections 2024-04-01T06:55:34.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.026+0000 7f0181bf2b80 1 --2- 172.21.15.83:0/1653599946 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5617a1d95780 0x5617a1da7180 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.026+0000 7f0181bf2b80 1 --2- 172.21.15.83:0/1653599946 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5617a1d96f80 0x5617a1d8fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.026+0000 7f0181bf2b80 1 --2- 172.21.15.83:0/1653599946 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5617a1d960e0 0x5617a1da6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.026+0000 7f0181bf2b80 1 -- 172.21.15.83:0/1653599946 >> 172.21.15.83:0/1653599946 conn(0x5617a1cf4650 msgr2=0x5617a1d90540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:34.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.026+0000 7f0181bf2b80 1 -- 172.21.15.83:0/1653599946 shutdown_connections 2024-04-01T06:55:34.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.026+0000 7f0181bf2b80 1 -- 172.21.15.83:0/1653599946 wait complete. 2024-04-01T06:55:34.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.027+0000 7f0181bf2b80 1 -- start start 2024-04-01T06:55:34.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.027+0000 7f0181bf2b80 1 Processor -- start 2024-04-01T06:55:34.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.027+0000 7f0181bf2b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5617a1d95780 0x5617a1d9a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:34.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.027+0000 7f0181bf2b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5617a1d960e0 0x5617a1da5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:34.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.027+0000 7f0181bf2b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5617a1d96f80 0x5617a1da6230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:34.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.027+0000 7f0181bf2b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617a1da67b0 con 0x5617a1d96f80 2024-04-01T06:55:34.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.027+0000 7f0181bf2b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617a1da6920 con 0x5617a1d95780 2024-04-01T06:55:34.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.027+0000 7f0181bf2b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617a1da6ae0 con 0x5617a1d960e0 2024-04-01T06:55:34.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.027+0000 7f0181bf2b80 10 client.0 _ll_register_callbacks cb 0x5617a1c8c420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:55:34.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.027+0000 7f016f7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5617a1d96f80 0x5617a1da6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:34.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.027+0000 7f016f7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5617a1d96f80 0x5617a1da6230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46758/0 (socket says 172.21.15.83:46758) 2024-04-01T06:55:34.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.027+0000 7f016f7fe700 1 -- 172.21.15.83:0/2530963347 learned_addr learned my addr 172.21.15.83:0/2530963347 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:34.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.027+0000 7f01667fc700 1 --2- 172.21.15.83:0/2530963347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5617a1d960e0 0x5617a1da5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:34.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.027+0000 7f016effd700 1 --2- 172.21.15.83:0/2530963347 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5617a1d95780 0x5617a1d9a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:34.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.028+0000 7f016f7fe700 1 -- 172.21.15.83:0/2530963347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5617a1d960e0 msgr2=0x5617a1da5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:34.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.028+0000 7f016f7fe700 1 --2- 172.21.15.83:0/2530963347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5617a1d960e0 0x5617a1da5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.028+0000 7f016f7fe700 1 -- 172.21.15.83:0/2530963347 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5617a1d95780 msgr2=0x5617a1d9a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:34.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.028+0000 7f016f7fe700 1 --2- 172.21.15.83:0/2530963347 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5617a1d95780 0x5617a1d9a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.028+0000 7f016f7fe700 1 -- 172.21.15.83:0/2530963347 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5617a1b14b10 con 0x5617a1d96f80 2024-04-01T06:55:34.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.028+0000 7f016f7fe700 1 --2- 172.21.15.83:0/2530963347 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5617a1d96f80 0x5617a1da6230 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f016800ad70 tx=0x7f0168099010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab7a31dc98d8fc52 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:34.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.028+0000 7f014effd700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:55:34.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.028+0000 7f014effd700 1 -- 172.21.15.83:0/2530963347 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0168098b50 con 0x5617a1d96f80 2024-04-01T06:55:34.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.028+0000 7f0181bf2b80 1 -- 172.21.15.83:0/2530963347 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f016001e040 con 0x5617a1d96f80 2024-04-01T06:55:34.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.028+0000 7f014effd700 1 -- 172.21.15.83:0/2530963347 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(80..80 src has 1..80) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f0168099460 con 0x5617a1d96f80 2024-04-01T06:55:34.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.028+0000 7f014effd700 1 -- 172.21.15.83:0/2530963347 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f016809d290 con 0x5617a1d96f80 2024-04-01T06:55:34.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.028+0000 7f0181bf2b80 10 client.15222 fetch_fsmap learned FSMap version 23 2024-04-01T06:55:34.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.028+0000 7f0181bf2b80 1 -- 172.21.15.83:0/2530963347 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x5617a1b6cc80 con 0x5617a1d96f80 2024-04-01T06:55:34.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.028+0000 7f014effd700 1 -- 172.21.15.83:0/2530963347 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f01680b7020 con 0x5617a1d96f80 2024-04-01T06:55:34.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.028+0000 7f014effd700 1 -- 172.21.15.83:0/2530963347 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 23) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f0168095250 con 0x5617a1d96f80 2024-04-01T06:55:34.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.028+0000 7f0181bf2b80 10 client.15222 fetch_fsmap finished waiting for FSMap version 23 2024-04-01T06:55:34.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.028+0000 7f0181bf2b80 10 client.15222 resolve_mds: resolved name 'h' to daemon mds.h 2024-04-01T06:55:34.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.028+0000 7f0181bf2b80 20 client.15222 populate_metadata read hostname 'smithi083' 2024-04-01T06:55:34.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.028+0000 7f0181bf2b80 1 --2- 172.21.15.83:0/2530963347 >> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] conn(0x5617a1e03400 0x5617a1dffdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:34.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.028+0000 7f0181bf2b80 4 client.15222 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-01T06:55:34.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.028+0000 7f0181bf2b80 1 -- 172.21.15.83:0/2530963347 --> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5617a1b35ca0 con 0x5617a1e03400 2024-04-01T06:55:34.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.029+0000 7f016effd700 1 --2- 172.21.15.83:0/2530963347 >> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] conn(0x5617a1e03400 0x5617a1dffdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:34.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.029+0000 7f014effd700 10 client.15222 ms_handle_connect on v2:172.21.15.145:6836/2687798317 2024-04-01T06:55:34.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.029+0000 7f016effd700 1 --2- 172.21.15.83:0/2530963347 >> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] conn(0x5617a1e03400 0x5617a1dffdd0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5f14a8d30e5fb81 server_cookie=ecdc980159907a08 in_seq=0 out_seq=0 2024-04-01T06:55:34.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.029+0000 7f014effd700 1 -- 172.21.15.83:0/2530963347 <== mds.1 v2:172.21.15.145:6836/2687798317 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x5617a1b35ca0 con 0x5617a1e03400 2024-04-01T06:55:34.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.029+0000 7f014effd700 10 client.15222 handle_command_reply: tid=0 2024-04-01T06:55:34.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.029+0000 7f0181bf2b80 1 client.15222 shutdown 2024-04-01T06:55:34.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.030+0000 7f0181bf2b80 1 -- 172.21.15.83:0/2530963347 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5617a1d96f80 msgr2=0x5617a1da6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:34.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.030+0000 7f0181bf2b80 1 --2- 172.21.15.83:0/2530963347 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5617a1d96f80 0x5617a1da6230 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f016800ad70 tx=0x7f0168099010 comp rx=0 tx=0).stop 2024-04-01T06:55:34.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.030+0000 7f0181bf2b80 1 -- 172.21.15.83:0/2530963347 shutdown_connections 2024-04-01T06:55:34.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.030+0000 7f0181bf2b80 1 --2- 172.21.15.83:0/2530963347 >> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] conn(0x5617a1e03400 0x5617a1dffdd0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.030+0000 7f0181bf2b80 1 --2- 172.21.15.83:0/2530963347 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5617a1d96f80 0x5617a1da6230 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.030+0000 7f014effd700 0 client.15222 ms_handle_reset on v2:172.21.15.145:6836/2687798317 2024-04-01T06:55:34.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.030+0000 7f0181bf2b80 1 --2- 172.21.15.83:0/2530963347 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5617a1d95780 0x5617a1d9a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.030+0000 7f0181bf2b80 1 --2- 172.21.15.83:0/2530963347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5617a1d960e0 0x5617a1da5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.030+0000 7f0181bf2b80 1 -- 172.21.15.83:0/2530963347 >> 172.21.15.83:0/2530963347 conn(0x5617a1cf4650 msgr2=0x5617a1d9e730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:34.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.030+0000 7f0181bf2b80 1 -- 172.21.15.83:0/2530963347 shutdown_connections 2024-04-01T06:55:34.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.030+0000 7f0181bf2b80 1 -- 172.21.15.83:0/2530963347 wait complete. 2024-04-01T06:55:34.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.030+0000 7f0181bf2b80 20 client.15222 trim_cache size 0 max 16384 2024-04-01T06:55:34.047 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-04-01T06:55:34.047 INFO:teuthology.orchestra.run.smithi083.stdout: "cluster_fsid": "c6f8eff4-eff3-11ee-b647-cb9ed24678a4", 2024-04-01T06:55:34.047 INFO:teuthology.orchestra.run.smithi083.stdout: "whoami": 1, 2024-04-01T06:55:34.047 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 24494, 2024-04-01T06:55:34.047 INFO:teuthology.orchestra.run.smithi083.stdout: "want_state": "up:active", 2024-04-01T06:55:34.047 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "up:active", 2024-04-01T06:55:34.047 INFO:teuthology.orchestra.run.smithi083.stdout: "fs_name": "cephfs", 2024-04-01T06:55:34.047 INFO:teuthology.orchestra.run.smithi083.stdout: "rank_uptime": 62.340494208999999, 2024-04-01T06:55:34.048 INFO:teuthology.orchestra.run.smithi083.stdout: "mdsmap_epoch": 23, 2024-04-01T06:55:34.048 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_epoch": 80, 2024-04-01T06:55:34.048 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_epoch_barrier": 79, 2024-04-01T06:55:34.048 INFO:teuthology.orchestra.run.smithi083.stdout: "uptime": 78.638611505 2024-04-01T06:55:34.048 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-04-01T06:55:34.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.030+0000 7f0175a5c700 1 -- 172.21.15.83:0/1274651097 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f015c0a11b0 msgr2=0x7f015c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:34.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.030+0000 7f0175a5c700 1 --2- 172.21.15.83:0/1274651097 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f015c0a11b0 0x7f015c0a3670 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0160009990 tx=0x7f0160005fb0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.030+0000 7f0175a5c700 1 -- 172.21.15.83:0/1274651097 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0170102910 msgr2=0x7f017019e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:34.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.030+0000 7f0175a5c700 1 --2- 172.21.15.83:0/1274651097 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0170102910 0x7f017019e270 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f016800ada0 tx=0x7f016800c330 comp rx=0 tx=0).stop 2024-04-01T06:55:34.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.030+0000 7f0175a5c700 1 -- 172.21.15.83:0/1274651097 shutdown_connections 2024-04-01T06:55:34.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.030+0000 7f0175a5c700 1 --2- 172.21.15.83:0/1274651097 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0170102910 0x7f017019e270 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.030+0000 7f0175a5c700 1 --2- 172.21.15.83:0/1274651097 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f015c0a11b0 0x7f015c0a3670 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.030+0000 7f0175a5c700 1 --2- 172.21.15.83:0/1274651097 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0170100d80 0x7f0170196d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.030+0000 7f0175a5c700 1 --2- 172.21.15.83:0/1274651097 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0170101f70 0x7f0170197290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.030+0000 7f0175a5c700 1 -- 172.21.15.83:0/1274651097 >> 172.21.15.83:0/1274651097 conn(0x7f01700fc2f0 msgr2=0x7f01701052e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:34.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.030+0000 7f0175a5c700 1 -- 172.21.15.83:0/1274651097 shutdown_connections 2024-04-01T06:55:34.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.030+0000 7f0175a5c700 1 -- 172.21.15.83:0/1274651097 wait complete. 2024-04-01T06:55:34.051 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-01T06:55:34.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:33 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/76212043' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-01T06:55:34.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:33 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/766237079' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:55:34.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:33 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/4036771209' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T06:55:34.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:33 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2024-04-01T06:55:34.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:33 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-04-01T06:55:34.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:33 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]: dispatch 2024-04-01T06:55:34.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:33 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-04-01T06:55:34.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:33 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-04-01T06:55:34.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.175+0000 7f8c5ff3c700 1 -- 172.21.15.83:0/997055499 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8c580ffc60 msgr2=0x7f8c58100080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:34.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.175+0000 7f8c5ff3c700 1 --2- 172.21.15.83:0/997055499 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8c580ffc60 0x7f8c58100080 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c0099c0 tx=0x7f8c4c009cd0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.175+0000 7f8c5ff3c700 1 -- 172.21.15.83:0/997055499 shutdown_connections 2024-04-01T06:55:34.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.175+0000 7f8c5ff3c700 1 --2- 172.21.15.83:0/997055499 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8c580ffc60 0x7f8c58100080 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.175+0000 7f8c5ff3c700 1 --2- 172.21.15.83:0/997055499 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8c581017f0 0x7f8c581080a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.175+0000 7f8c5ff3c700 1 --2- 172.21.15.83:0/997055499 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c58100e50 0x7f8c581012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.175+0000 7f8c5ff3c700 1 -- 172.21.15.83:0/997055499 >> 172.21.15.83:0/997055499 conn(0x7f8c580fb1d0 msgr2=0x7f8c580fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:34.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.175+0000 7f8c5ff3c700 1 -- 172.21.15.83:0/997055499 shutdown_connections 2024-04-01T06:55:34.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.175+0000 7f8c5ff3c700 1 -- 172.21.15.83:0/997055499 wait complete. 2024-04-01T06:55:34.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.176+0000 7f8c5ff3c700 1 Processor -- start 2024-04-01T06:55:34.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.176+0000 7f8c5ff3c700 1 -- start start 2024-04-01T06:55:34.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.176+0000 7f8c5ff3c700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8c580ffc60 0x7f8c58196cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:34.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.176+0000 7f8c5ff3c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c58100e50 0x7f8c58197210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:34.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.176+0000 7f8c5ff3c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8c581017f0 0x7f8c5819e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:34.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.176+0000 7f8c5ff3c700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5819e7f0 con 0x7f8c581017f0 2024-04-01T06:55:34.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.176+0000 7f8c5ff3c700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5819e960 con 0x7f8c580ffc60 2024-04-01T06:55:34.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.176+0000 7f8c5ff3c700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5819eb20 con 0x7f8c58100e50 2024-04-01T06:55:34.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.176+0000 7f8c5e4d9700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8c581017f0 0x7f8c5819e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:34.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.176+0000 7f8c5e4d9700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8c581017f0 0x7f8c5819e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46774/0 (socket says 172.21.15.83:46774) 2024-04-01T06:55:34.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.176+0000 7f8c5e4d9700 1 -- 172.21.15.83:0/3333406653 learned_addr learned my addr 172.21.15.83:0/3333406653 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:34.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.176+0000 7f8c5d4d7700 1 --2- 172.21.15.83:0/3333406653 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c58100e50 0x7f8c58197210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:34.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.176+0000 7f8c5dcd8700 1 --2- 172.21.15.83:0/3333406653 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8c580ffc60 0x7f8c58196cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:34.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.176+0000 7f8c5e4d9700 1 -- 172.21.15.83:0/3333406653 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c58100e50 msgr2=0x7f8c58197210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:34.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.176+0000 7f8c5e4d9700 1 --2- 172.21.15.83:0/3333406653 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c58100e50 0x7f8c58197210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.176+0000 7f8c5e4d9700 1 -- 172.21.15.83:0/3333406653 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8c580ffc60 msgr2=0x7f8c58196cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:34.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.176+0000 7f8c5e4d9700 1 --2- 172.21.15.83:0/3333406653 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8c580ffc60 0x7f8c58196cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.176+0000 7f8c5e4d9700 1 -- 172.21.15.83:0/3333406653 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c4c0095f0 con 0x7f8c581017f0 2024-04-01T06:55:34.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.176+0000 7f8c5dcd8700 1 --2- 172.21.15.83:0/3333406653 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8c580ffc60 0x7f8c58196cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:55:34.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.176+0000 7f8c5d4d7700 1 --2- 172.21.15.83:0/3333406653 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c58100e50 0x7f8c58197210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:55:34.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.176+0000 7f8c5e4d9700 1 --2- 172.21.15.83:0/3333406653 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8c581017f0 0x7f8c5819e220 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8c5000ada0 tx=0x7f8c5000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:34.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.176+0000 7f8c4affd700 1 -- 172.21.15.83:0/3333406653 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5000f070 con 0x7f8c581017f0 2024-04-01T06:55:34.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.176+0000 7f8c5ff3c700 1 -- 172.21.15.83:0/3333406653 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c5819ee00 con 0x7f8c581017f0 2024-04-01T06:55:34.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.176+0000 7f8c4affd700 1 -- 172.21.15.83:0/3333406653 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8c50007b30 con 0x7f8c581017f0 2024-04-01T06:55:34.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.176+0000 7f8c4affd700 1 -- 172.21.15.83:0/3333406653 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c50005440 con 0x7f8c581017f0 2024-04-01T06:55:34.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.177+0000 7f8c5ff3c700 1 -- 172.21.15.83:0/3333406653 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c5819f280 con 0x7f8c581017f0 2024-04-01T06:55:34.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.179+0000 7f8c4affd700 1 -- 172.21.15.83:0/3333406653 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f8c50004ad0 con 0x7f8c581017f0 2024-04-01T06:55:34.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.180+0000 7f8c4affd700 1 --2- 172.21.15.83:0/3333406653 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f8c440a11b0 0x7f8c440a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:34.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.180+0000 7f8c5dcd8700 1 --2- 172.21.15.83:0/3333406653 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f8c440a11b0 0x7f8c440a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:34.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.180+0000 7f8c4affd700 1 -- 172.21.15.83:0/3333406653 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f8c500cc0a0 con 0x7f8c581017f0 2024-04-01T06:55:34.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.180+0000 7f8c5dcd8700 1 --2- 172.21.15.83:0/3333406653 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f8c440a11b0 0x7f8c440a3670 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c003820 tx=0x7f8c4c005c20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:34.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.180+0000 7f8c6c0d2b80 1 Processor -- start 2024-04-01T06:55:34.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.181+0000 7f8c6c0d2b80 1 -- start start 2024-04-01T06:55:34.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.181+0000 7f8c6c0d2b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55edebf39780 0x55edebf39ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:34.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.181+0000 7f8c6c0d2b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55edebf3a0e0 0x55edebf3a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:34.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.181+0000 7f8c6c0d2b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55edebf3af80 0x55edebf3b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:34.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.181+0000 7f8c6c0d2b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edebe91940 con 0x55edebf3af80 2024-04-01T06:55:34.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.181+0000 7f8c6c0d2b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edebe8f300 con 0x55edebf39780 2024-04-01T06:55:34.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.181+0000 7f8c6c0d2b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edebe8abf0 con 0x55edebf3a0e0 2024-04-01T06:55:34.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.181+0000 7f8c5e4d9700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55edebf3af80 0x55edebf3b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:34.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.181+0000 7f8c5e4d9700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55edebf3af80 0x55edebf3b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46790/0 (socket says 172.21.15.83:46790) 2024-04-01T06:55:34.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.181+0000 7f8c5e4d9700 1 -- 172.21.15.83:0/1339723279 learned_addr learned my addr 172.21.15.83:0/1339723279 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:34.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.181+0000 7f8c5d4d7700 1 --2- 172.21.15.83:0/1339723279 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55edebf3a0e0 0x55edebf3a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:34.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.181+0000 7f8c5e4d9700 1 -- 172.21.15.83:0/1339723279 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55edebf3a0e0 msgr2=0x55edebf3a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:34.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.181+0000 7f8c5dcd8700 1 --2- 172.21.15.83:0/1339723279 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55edebf39780 0x55edebf39ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:34.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.181+0000 7f8c5e4d9700 1 --2- 172.21.15.83:0/1339723279 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55edebf3a0e0 0x55edebf3a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.181+0000 7f8c5e4d9700 1 -- 172.21.15.83:0/1339723279 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55edebf39780 msgr2=0x55edebf39ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:34.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.181+0000 7f8c5e4d9700 1 --2- 172.21.15.83:0/1339723279 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55edebf39780 0x55edebf39ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.181+0000 7f8c5e4d9700 1 -- 172.21.15.83:0/1339723279 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55edebd0c360 con 0x55edebf3af80 2024-04-01T06:55:34.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.181+0000 7f8c5e4d9700 1 --2- 172.21.15.83:0/1339723279 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55edebf3af80 0x55edebf3b400 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8c50095940 tx=0x7f8c500992e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29a9d2b0f1e82833 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:34.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.181+0000 7f8c43fff700 1 -- 172.21.15.83:0/1339723279 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c50099440 con 0x55edebf3af80 2024-04-01T06:55:34.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.182+0000 7f8c43fff700 1 -- 172.21.15.83:0/1339723279 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8c5009d270 con 0x55edebf3af80 2024-04-01T06:55:34.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.182+0000 7f8c43fff700 1 -- 172.21.15.83:0/1339723279 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c500998a0 con 0x55edebf3af80 2024-04-01T06:55:34.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.182+0000 7f8c6c0d2b80 1 -- 172.21.15.83:0/1339723279 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55edebf3af80 msgr2=0x55edebf3b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:34.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.182+0000 7f8c6c0d2b80 1 --2- 172.21.15.83:0/1339723279 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55edebf3af80 0x55edebf3b400 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8c50095940 tx=0x7f8c500992e0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.182+0000 7f8c6c0d2b80 1 -- 172.21.15.83:0/1339723279 shutdown_connections 2024-04-01T06:55:34.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.182+0000 7f8c6c0d2b80 1 --2- 172.21.15.83:0/1339723279 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55edebf3af80 0x55edebf3b400 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.182+0000 7f8c6c0d2b80 1 --2- 172.21.15.83:0/1339723279 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55edebf39780 0x55edebf39ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.182+0000 7f8c6c0d2b80 1 --2- 172.21.15.83:0/1339723279 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55edebf3a0e0 0x55edebf3a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.182+0000 7f8c6c0d2b80 1 -- 172.21.15.83:0/1339723279 >> 172.21.15.83:0/1339723279 conn(0x55edebe98650 msgr2=0x55edebf34950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:34.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.182+0000 7f8c6c0d2b80 1 -- 172.21.15.83:0/1339723279 shutdown_connections 2024-04-01T06:55:34.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.182+0000 7f8c6c0d2b80 1 -- 172.21.15.83:0/1339723279 wait complete. 2024-04-01T06:55:34.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.183+0000 7f8c6c0d2b80 1 -- start start 2024-04-01T06:55:34.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.183+0000 7f8c6c0d2b80 1 Processor -- start 2024-04-01T06:55:34.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.183+0000 7f8c6c0d2b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55edebf39780 0x55edebf43690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:34.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.183+0000 7f8c6c0d2b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55edebf3a0e0 0x55edebf43bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:34.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.183+0000 7f8c6c0d2b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55edebf3af80 0x55edebf4ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:34.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.183+0000 7f8c6c0d2b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edebe26d30 con 0x55edebf3a0e0 2024-04-01T06:55:34.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.183+0000 7f8c6c0d2b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edebe269d0 con 0x55edebf39780 2024-04-01T06:55:34.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.183+0000 7f8c6c0d2b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edebd0e650 con 0x55edebf3af80 2024-04-01T06:55:34.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.183+0000 7f8c6c0d2b80 10 client.0 _ll_register_callbacks cb 0x55edebe30420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:55:34.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.183+0000 7f8c5d4d7700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55edebf3a0e0 0x55edebf43bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:34.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.183+0000 7f8c5d4d7700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55edebf3a0e0 0x55edebf43bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46806/0 (socket says 172.21.15.83:46806) 2024-04-01T06:55:34.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.183+0000 7f8c5d4d7700 1 -- 172.21.15.83:0/1222611514 learned_addr learned my addr 172.21.15.83:0/1222611514 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:34.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.183+0000 7f8c5dcd8700 1 --2- 172.21.15.83:0/1222611514 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55edebf39780 0x55edebf43690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:34.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.183+0000 7f8c5e4d9700 1 --2- 172.21.15.83:0/1222611514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55edebf3af80 0x55edebf4ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:34.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.183+0000 7f8c5d4d7700 1 -- 172.21.15.83:0/1222611514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55edebf3af80 msgr2=0x55edebf4ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:34.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.183+0000 7f8c5d4d7700 1 --2- 172.21.15.83:0/1222611514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55edebf3af80 0x55edebf4ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.183+0000 7f8c5d4d7700 1 -- 172.21.15.83:0/1222611514 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55edebf39780 msgr2=0x55edebf43690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:34.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.183+0000 7f8c5d4d7700 1 --2- 172.21.15.83:0/1222611514 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55edebf39780 0x55edebf43690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.183+0000 7f8c5d4d7700 1 -- 172.21.15.83:0/1222611514 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c5819f280 con 0x55edebf3a0e0 2024-04-01T06:55:34.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.184+0000 7f8c5dcd8700 1 --2- 172.21.15.83:0/1222611514 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55edebf39780 0x55edebf43690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:55:34.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.184+0000 7f8c5e4d9700 1 --2- 172.21.15.83:0/1222611514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55edebf3af80 0x55edebf4ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:55:34.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.184+0000 7f8c5d4d7700 1 --2- 172.21.15.83:0/1222611514 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55edebf3a0e0 0x55edebf43bd0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8c54010a70 tx=0x7f8c54010e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8be78ea3ef27283 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:34.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.184+0000 7f8c417fa700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:55:34.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.184+0000 7f8c417fa700 1 -- 172.21.15.83:0/1222611514 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5400ec50 con 0x55edebf3a0e0 2024-04-01T06:55:34.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.184+0000 7f8c417fa700 1 -- 172.21.15.83:0/1222611514 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(80..80 src has 1..80) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f8c54017070 con 0x55edebf3a0e0 2024-04-01T06:55:34.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.184+0000 7f8c6c0d2b80 1 -- 172.21.15.83:0/1222611514 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55edebe4b330 con 0x55edebf3a0e0 2024-04-01T06:55:34.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.184+0000 7f8c417fa700 1 -- 172.21.15.83:0/1222611514 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c5400ced0 con 0x55edebf3a0e0 2024-04-01T06:55:34.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.184+0000 7f8c6c0d2b80 10 client.15234 fetch_fsmap learned FSMap version 23 2024-04-01T06:55:34.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.184+0000 7f8c6c0d2b80 1 -- 172.21.15.83:0/1222611514 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55edebcb8b10 con 0x55edebf3a0e0 2024-04-01T06:55:34.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.184+0000 7f8c417fa700 1 -- 172.21.15.83:0/1222611514 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55edebe4b330 con 0x55edebf3a0e0 2024-04-01T06:55:34.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.184+0000 7f8c417fa700 1 -- 172.21.15.83:0/1222611514 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 23) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f8c54011440 con 0x55edebf3a0e0 2024-04-01T06:55:34.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.184+0000 7f8c6c0d2b80 10 client.15234 fetch_fsmap finished waiting for FSMap version 23 2024-04-01T06:55:34.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.184+0000 7f8c6c0d2b80 10 client.15234 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-01T06:55:34.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.184+0000 7f8c6c0d2b80 20 client.15234 populate_metadata read hostname 'smithi083' 2024-04-01T06:55:34.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.184+0000 7f8c6c0d2b80 1 --2- 172.21.15.83:0/1222611514 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55edebf4e8e0 0x55edebf53be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:34.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.184+0000 7f8c6c0d2b80 4 client.15234 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-01T06:55:34.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.184+0000 7f8c6c0d2b80 1 -- 172.21.15.83:0/1222611514 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55edebe836b0 con 0x55edebf4e8e0 2024-04-01T06:55:34.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.185+0000 7f8c5dcd8700 1 --2- 172.21.15.83:0/1222611514 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55edebf4e8e0 0x55edebf53be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:34.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.185+0000 7f8c5dcd8700 1 --2- 172.21.15.83:0/1222611514 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55edebf4e8e0 0x55edebf53be0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42cdf97fb637a87a server_cookie=87c1e235f4cf5c68 in_seq=0 out_seq=0 2024-04-01T06:55:34.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.185+0000 7f8c417fa700 10 client.15234 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:55:34.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.186+0000 7f8c417fa700 1 -- 172.21.15.83:0/1222611514 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55edebe836b0 con 0x55edebf4e8e0 2024-04-01T06:55:34.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.186+0000 7f8c417fa700 10 client.15234 handle_command_reply: tid=0 2024-04-01T06:55:34.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.186+0000 7f8c6c0d2b80 1 client.15234 shutdown 2024-04-01T06:55:34.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.186+0000 7f8c6c0d2b80 1 -- 172.21.15.83:0/1222611514 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55edebf3a0e0 msgr2=0x55edebf43bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:34.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.186+0000 7f8c6c0d2b80 1 --2- 172.21.15.83:0/1222611514 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55edebf3a0e0 0x55edebf43bd0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8c54010a70 tx=0x7f8c54010e30 comp rx=0 tx=0).stop 2024-04-01T06:55:34.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.186+0000 7f8c6c0d2b80 1 -- 172.21.15.83:0/1222611514 shutdown_connections 2024-04-01T06:55:34.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.186+0000 7f8c6c0d2b80 1 --2- 172.21.15.83:0/1222611514 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55edebf4e8e0 0x55edebf53be0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.186+0000 7f8c6c0d2b80 1 --2- 172.21.15.83:0/1222611514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55edebf3af80 0x55edebf4ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.186+0000 7f8c6c0d2b80 1 --2- 172.21.15.83:0/1222611514 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55edebf39780 0x55edebf43690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.186+0000 7f8c6c0d2b80 1 --2- 172.21.15.83:0/1222611514 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55edebf3a0e0 0x55edebf43bd0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.186+0000 7f8c417fa700 0 client.15234 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:55:34.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.186+0000 7f8c6c0d2b80 1 -- 172.21.15.83:0/1222611514 >> 172.21.15.83:0/1222611514 conn(0x55edebe98650 msgr2=0x55edebf38120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:34.193 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.186+0000 7f8c6c0d2b80 1 -- 172.21.15.83:0/1222611514 shutdown_connections 2024-04-01T06:55:34.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.186+0000 7f8c6c0d2b80 1 -- 172.21.15.83:0/1222611514 wait complete. 2024-04-01T06:55:34.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.186+0000 7f8c6c0d2b80 20 client.15234 trim_cache size 0 max 16384 2024-04-01T06:55:34.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.203+0000 7f8c6c0d2b80 1 Processor -- start 2024-04-01T06:55:34.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.203+0000 7f8c6c0d2b80 1 -- start start 2024-04-01T06:55:34.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.204+0000 7f8c6c0d2b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55edebf39780 0x55edebf39b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:34.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.204+0000 7f8c6c0d2b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55edebf3a0e0 0x55edebf4b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:34.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.204+0000 7f8c6c0d2b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55edebf3af80 0x55edebf3b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:34.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.204+0000 7f8c6c0d2b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edebe83990 con 0x55edebf39780 2024-04-01T06:55:34.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.204+0000 7f8c6c0d2b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edebe87850 con 0x55edebf3a0e0 2024-04-01T06:55:34.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.204+0000 7f8c6c0d2b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edebe29de0 con 0x55edebf3af80 2024-04-01T06:55:34.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.204+0000 7f8c5dcd8700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55edebf39780 0x55edebf39b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:34.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.204+0000 7f8c5dcd8700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55edebf39780 0x55edebf39b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46812/0 (socket says 172.21.15.83:46812) 2024-04-01T06:55:34.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.204+0000 7f8c5dcd8700 1 -- 172.21.15.83:0/3577901302 learned_addr learned my addr 172.21.15.83:0/3577901302 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:34.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.204+0000 7f8c5dcd8700 1 -- 172.21.15.83:0/3577901302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55edebf3af80 msgr2=0x55edebf3b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:34.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.204+0000 7f8c5dcd8700 1 --2- 172.21.15.83:0/3577901302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55edebf3af80 0x55edebf3b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.204+0000 7f8c5dcd8700 1 -- 172.21.15.83:0/3577901302 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55edebf3a0e0 msgr2=0x55edebf4b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:34.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.204+0000 7f8c5dcd8700 1 --2- 172.21.15.83:0/3577901302 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55edebf3a0e0 0x55edebf4b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.204+0000 7f8c5dcd8700 1 -- 172.21.15.83:0/3577901302 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55edebe50e50 con 0x55edebf39780 2024-04-01T06:55:34.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.204+0000 7f8c5dcd8700 1 --2- 172.21.15.83:0/3577901302 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55edebf39780 0x55edebf39b60 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c005850 tx=0x7f8c4c021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=255489568cb7a018 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:34.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.204+0000 7f8c48ff9700 1 -- 172.21.15.83:0/3577901302 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c01e070 con 0x55edebf39780 2024-04-01T06:55:34.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.204+0000 7f8c48ff9700 1 -- 172.21.15.83:0/3577901302 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8c4c02c040 con 0x55edebf39780 2024-04-01T06:55:34.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.204+0000 7f8c48ff9700 1 -- 172.21.15.83:0/3577901302 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c003d20 con 0x55edebf39780 2024-04-01T06:55:34.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.205+0000 7f8c6c0d2b80 1 -- 172.21.15.83:0/3577901302 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55edebf39780 msgr2=0x55edebf39b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:34.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.205+0000 7f8c6c0d2b80 1 --2- 172.21.15.83:0/3577901302 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55edebf39780 0x55edebf39b60 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c005850 tx=0x7f8c4c021000 comp rx=0 tx=0).stop 2024-04-01T06:55:34.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.205+0000 7f8c6c0d2b80 1 -- 172.21.15.83:0/3577901302 shutdown_connections 2024-04-01T06:55:34.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.205+0000 7f8c6c0d2b80 1 --2- 172.21.15.83:0/3577901302 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55edebf39780 0x55edebf39b60 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.205+0000 7f8c6c0d2b80 1 --2- 172.21.15.83:0/3577901302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55edebf3af80 0x55edebf3b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.205+0000 7f8c6c0d2b80 1 --2- 172.21.15.83:0/3577901302 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55edebf3a0e0 0x55edebf4b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.205+0000 7f8c6c0d2b80 1 -- 172.21.15.83:0/3577901302 >> 172.21.15.83:0/3577901302 conn(0x55edebe98650 msgr2=0x55edebf41550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:34.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.205+0000 7f8c6c0d2b80 1 -- 172.21.15.83:0/3577901302 shutdown_connections 2024-04-01T06:55:34.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.205+0000 7f8c6c0d2b80 1 -- 172.21.15.83:0/3577901302 wait complete. 2024-04-01T06:55:34.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.205+0000 7f8c6c0d2b80 1 -- start start 2024-04-01T06:55:34.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.205+0000 7f8c6c0d2b80 1 Processor -- start 2024-04-01T06:55:34.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.206+0000 7f8c6c0d2b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55edebf39780 0x55edebf481e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:34.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.206+0000 7f8c6c0d2b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55edebf3a0e0 0x55edebf48780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:34.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.206+0000 7f8c6c0d2b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55edebf3af80 0x55edebf494b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:34.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.206+0000 7f8c6c0d2b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edebf499f0 con 0x55edebf3af80 2024-04-01T06:55:34.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.206+0000 7f8c6c0d2b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edebf49b60 con 0x55edebf3a0e0 2024-04-01T06:55:34.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.206+0000 7f8c6c0d2b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edebf49cd0 con 0x55edebf39780 2024-04-01T06:55:34.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.206+0000 7f8c6c0d2b80 10 client.0 _ll_register_callbacks cb 0x55edebe30420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:55:34.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.206+0000 7f8c5e4d9700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55edebf3af80 0x55edebf494b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:34.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.206+0000 7f8c5e4d9700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55edebf3af80 0x55edebf494b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46820/0 (socket says 172.21.15.83:46820) 2024-04-01T06:55:34.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.206+0000 7f8c5e4d9700 1 -- 172.21.15.83:0/3796923621 learned_addr learned my addr 172.21.15.83:0/3796923621 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:34.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.206+0000 7f8c5d4d7700 1 --2- 172.21.15.83:0/3796923621 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55edebf3a0e0 0x55edebf48780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:34.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.206+0000 7f8c5dcd8700 1 --2- 172.21.15.83:0/3796923621 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55edebf39780 0x55edebf481e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:34.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.206+0000 7f8c5e4d9700 1 -- 172.21.15.83:0/3796923621 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55edebf39780 msgr2=0x55edebf481e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:34.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.206+0000 7f8c5e4d9700 1 --2- 172.21.15.83:0/3796923621 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55edebf39780 0x55edebf481e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.206+0000 7f8c5e4d9700 1 -- 172.21.15.83:0/3796923621 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55edebf3a0e0 msgr2=0x55edebf48780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:34.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.206+0000 7f8c5e4d9700 1 --2- 172.21.15.83:0/3796923621 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55edebf3a0e0 0x55edebf48780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.206+0000 7f8c5e4d9700 1 -- 172.21.15.83:0/3796923621 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c581089f0 con 0x55edebf3af80 2024-04-01T06:55:34.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.206+0000 7f8c5d4d7700 1 --2- 172.21.15.83:0/3796923621 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55edebf3a0e0 0x55edebf48780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:55:34.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.206+0000 7f8c5dcd8700 1 --2- 172.21.15.83:0/3796923621 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55edebf39780 0x55edebf481e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:55:34.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.206+0000 7f8c5e4d9700 1 --2- 172.21.15.83:0/3796923621 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55edebf3af80 0x55edebf494b0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8c5000a0a0 tx=0x7f8c50007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b069f53a372052e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:34.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.206+0000 7f8c417fa700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:55:34.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.206+0000 7f8c417fa700 1 -- 172.21.15.83:0/3796923621 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c50098b30 con 0x55edebf3af80 2024-04-01T06:55:34.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.207+0000 7f8c417fa700 1 -- 172.21.15.83:0/3796923621 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(80..80 src has 1..80) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f8c5009f050 con 0x55edebf3af80 2024-04-01T06:55:34.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.207+0000 7f8c6c0d2b80 1 -- 172.21.15.83:0/3796923621 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8c5009d270 con 0x55edebf3af80 2024-04-01T06:55:34.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.207+0000 7f8c417fa700 1 -- 172.21.15.83:0/3796923621 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c50099440 con 0x55edebf3af80 2024-04-01T06:55:34.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.207+0000 7f8c6c0d2b80 10 client.15240 fetch_fsmap learned FSMap version 23 2024-04-01T06:55:34.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.207+0000 7f8c6c0d2b80 1 -- 172.21.15.83:0/3796923621 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55edebd10c80 con 0x55edebf3af80 2024-04-01T06:55:34.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.207+0000 7f8c417fa700 1 -- 172.21.15.83:0/3796923621 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8c5009d270 con 0x55edebf3af80 2024-04-01T06:55:34.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.207+0000 7f8c417fa700 1 -- 172.21.15.83:0/3796923621 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 23) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f8c500a14c0 con 0x55edebf3af80 2024-04-01T06:55:34.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.207+0000 7f8c6c0d2b80 10 client.15240 fetch_fsmap finished waiting for FSMap version 23 2024-04-01T06:55:34.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.207+0000 7f8c6c0d2b80 10 client.15240 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-01T06:55:34.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.207+0000 7f8c6c0d2b80 20 client.15240 populate_metadata read hostname 'smithi083' 2024-04-01T06:55:34.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.207+0000 7f8c6c0d2b80 1 --2- 172.21.15.83:0/3796923621 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55edebfa85f0 0x55edebfa51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:34.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.207+0000 7f8c6c0d2b80 4 client.15240 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-01T06:55:34.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.207+0000 7f8c6c0d2b80 1 -- 172.21.15.83:0/3796923621 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55edebcd9ca0 con 0x55edebfa85f0 2024-04-01T06:55:34.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.207+0000 7f8c5dcd8700 1 --2- 172.21.15.83:0/3796923621 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55edebfa85f0 0x55edebfa51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:34.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.208+0000 7f8c5dcd8700 1 --2- 172.21.15.83:0/3796923621 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55edebfa85f0 0x55edebfa51e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ab0ad6fffd3c596 server_cookie=5061ced1491ea50 in_seq=0 out_seq=0 2024-04-01T06:55:34.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.208+0000 7f8c417fa700 10 client.15240 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:55:34.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.208+0000 7f8c417fa700 1 -- 172.21.15.83:0/3796923621 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55edebcd9ca0 con 0x55edebfa85f0 2024-04-01T06:55:34.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.208+0000 7f8c417fa700 10 client.15240 handle_command_reply: tid=0 2024-04-01T06:55:34.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.208+0000 7f8c6c0d2b80 1 client.15240 shutdown 2024-04-01T06:55:34.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.208+0000 7f8c6c0d2b80 1 -- 172.21.15.83:0/3796923621 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55edebf3af80 msgr2=0x55edebf494b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:34.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.208+0000 7f8c6c0d2b80 1 --2- 172.21.15.83:0/3796923621 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55edebf3af80 0x55edebf494b0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8c5000a0a0 tx=0x7f8c50007a00 comp rx=0 tx=0).stop 2024-04-01T06:55:34.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.208+0000 7f8c6c0d2b80 1 -- 172.21.15.83:0/3796923621 shutdown_connections 2024-04-01T06:55:34.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.208+0000 7f8c6c0d2b80 1 --2- 172.21.15.83:0/3796923621 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55edebfa85f0 0x55edebfa51e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.208+0000 7f8c6c0d2b80 1 --2- 172.21.15.83:0/3796923621 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55edebf3af80 0x55edebf494b0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.208+0000 7f8c6c0d2b80 1 --2- 172.21.15.83:0/3796923621 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55edebf39780 0x55edebf481e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.208+0000 7f8c6c0d2b80 1 --2- 172.21.15.83:0/3796923621 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55edebf3a0e0 0x55edebf48780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.208+0000 7f8c417fa700 0 client.15240 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:55:34.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.208+0000 7f8c6c0d2b80 1 -- 172.21.15.83:0/3796923621 >> 172.21.15.83:0/3796923621 conn(0x55edebe98650 msgr2=0x55edebf42bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:34.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.208+0000 7f8c6c0d2b80 1 -- 172.21.15.83:0/3796923621 shutdown_connections 2024-04-01T06:55:34.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.208+0000 7f8c6c0d2b80 1 -- 172.21.15.83:0/3796923621 wait complete. 2024-04-01T06:55:34.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.208+0000 7f8c6c0d2b80 20 client.15240 trim_cache size 0 max 16384 2024-04-01T06:55:34.216 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-04-01T06:55:34.216 INFO:teuthology.orchestra.run.smithi083.stdout: "cluster_fsid": "c6f8eff4-eff3-11ee-b647-cb9ed24678a4", 2024-04-01T06:55:34.216 INFO:teuthology.orchestra.run.smithi083.stdout: "whoami": 0, 2024-04-01T06:55:34.216 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 24524, 2024-04-01T06:55:34.216 INFO:teuthology.orchestra.run.smithi083.stdout: "want_state": "up:active", 2024-04-01T06:55:34.216 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "up:active", 2024-04-01T06:55:34.216 INFO:teuthology.orchestra.run.smithi083.stdout: "fs_name": "cephfs", 2024-04-01T06:55:34.216 INFO:teuthology.orchestra.run.smithi083.stdout: "rank_uptime": 65.808896955999998, 2024-04-01T06:55:34.216 INFO:teuthology.orchestra.run.smithi083.stdout: "mdsmap_epoch": 23, 2024-04-01T06:55:34.216 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_epoch": 80, 2024-04-01T06:55:34.217 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_epoch_barrier": 79, 2024-04-01T06:55:34.217 INFO:teuthology.orchestra.run.smithi083.stdout: "uptime": 71.918901152999993 2024-04-01T06:55:34.217 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-04-01T06:55:34.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.209+0000 7f8c5ff3c700 1 -- 172.21.15.83:0/3333406653 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f8c440a11b0 msgr2=0x7f8c440a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:34.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.209+0000 7f8c5ff3c700 1 --2- 172.21.15.83:0/3333406653 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f8c440a11b0 0x7f8c440a3670 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c003820 tx=0x7f8c4c005c20 comp rx=0 tx=0).stop 2024-04-01T06:55:34.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.209+0000 7f8c5ff3c700 1 -- 172.21.15.83:0/3333406653 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8c581017f0 msgr2=0x7f8c5819e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:34.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.209+0000 7f8c5ff3c700 1 --2- 172.21.15.83:0/3333406653 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8c581017f0 0x7f8c5819e220 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8c5000ada0 tx=0x7f8c5000c330 comp rx=0 tx=0).stop 2024-04-01T06:55:34.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.209+0000 7f8c5ff3c700 1 -- 172.21.15.83:0/3333406653 shutdown_connections 2024-04-01T06:55:34.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.209+0000 7f8c5ff3c700 1 --2- 172.21.15.83:0/3333406653 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8c581017f0 0x7f8c5819e220 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.209+0000 7f8c5ff3c700 1 --2- 172.21.15.83:0/3333406653 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f8c440a11b0 0x7f8c440a3670 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.209+0000 7f8c5ff3c700 1 --2- 172.21.15.83:0/3333406653 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8c580ffc60 0x7f8c58196cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.209+0000 7f8c5ff3c700 1 --2- 172.21.15.83:0/3333406653 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c58100e50 0x7f8c58197210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:34.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.209+0000 7f8c5ff3c700 1 -- 172.21.15.83:0/3333406653 >> 172.21.15.83:0/3333406653 conn(0x7f8c580fb1d0 msgr2=0x7f8c580fcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:34.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.209+0000 7f8c5ff3c700 1 -- 172.21.15.83:0/3333406653 shutdown_connections 2024-04-01T06:55:34.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:34.209+0000 7f8c5ff3c700 1 -- 172.21.15.83:0/3333406653 wait complete. 2024-04-01T06:55:34.220 INFO:teuthology.run_tasks:Running task kclient... 2024-04-01T06:55:34.244 INFO:tasks.kclient:Mounting kernel clients... 2024-04-01T06:55:34.244 INFO:tasks.kclient:config is {'client.0': {}} 2024-04-01T06:55:34.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T06:55:34.244 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2024-04-01T06:55:34.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T06:55:34.263 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link delete ceph-brx 2024-04-01T06:55:34.331 INFO:teuthology.orchestra.run.smithi083.stderr:Cannot find device "ceph-brx" 2024-04-01T06:55:34.333 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T06:55:34.333 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=legacy', 'wsync'], 'syntax': 'v2', 'mount_subvol_num': 1} 2024-04-01T06:55:34.333 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-01T06:55:34.334 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-01T06:55:34.334 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph fs ls 2024-04-01T06:55:34.593 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T06:55:34.999 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:34 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-04-01T06:55:34.999 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:34 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-04-01T06:55:34.999 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:34 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2024-04-01T06:55:34.999 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:34 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-04-01T06:55:34.999 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:34 smithi083 ceph-mon[43429]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-04-01T06:55:34.999 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:34 smithi083 ceph-mon[43429]: osdmap e80: 12 total, 12 up, 12 in 2024-04-01T06:55:35.000 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:34 smithi083 ceph-mon[43429]: pgmap v250: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-01T06:55:35.000 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:34 smithi083 ceph-mon[43429]: osdmap e81: 12 total, 12 up, 12 in 2024-04-01T06:55:35.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:34 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-04-01T06:55:35.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:34 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-04-01T06:55:35.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:34 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2024-04-01T06:55:35.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:34 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-04-01T06:55:35.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:34 smithi145 ceph-mon[47816]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-04-01T06:55:35.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:34 smithi145 ceph-mon[47816]: osdmap e80: 12 total, 12 up, 12 in 2024-04-01T06:55:35.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:34 smithi145 ceph-mon[47816]: pgmap v250: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-01T06:55:35.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:34 smithi145 ceph-mon[47816]: osdmap e81: 12 total, 12 up, 12 in 2024-04-01T06:55:35.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:34 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-04-01T06:55:35.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:34 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-04-01T06:55:35.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:34 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2024-04-01T06:55:35.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:34 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-04-01T06:55:35.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:34 smithi153 ceph-mon[48187]: from='mgr.14152 172.21.15.83:0/2621884329' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-04-01T06:55:35.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:34 smithi153 ceph-mon[48187]: osdmap e80: 12 total, 12 up, 12 in 2024-04-01T06:55:35.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:34 smithi153 ceph-mon[48187]: pgmap v250: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-01T06:55:35.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:34 smithi153 ceph-mon[48187]: osdmap e81: 12 total, 12 up, 12 in 2024-04-01T06:55:35.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:35.550+0000 7fa33f520700 1 -- 172.21.15.83:0/2714611589 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa3380ffca0 msgr2=0x7fa338100120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:35.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:35.550+0000 7fa33f520700 1 --2- 172.21.15.83:0/2714611589 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa3380ffca0 0x7fa338100120 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fa32c009990 tx=0x7fa32c009ca0 comp rx=0 tx=0).stop 2024-04-01T06:55:35.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:35.550+0000 7fa33f520700 1 -- 172.21.15.83:0/2714611589 shutdown_connections 2024-04-01T06:55:35.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:35.550+0000 7fa33f520700 1 --2- 172.21.15.83:0/2714611589 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa338100660 0x7fa33810cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:35.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:35.550+0000 7fa33f520700 1 --2- 172.21.15.83:0/2714611589 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa338105d50 0x7fa338106130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:35.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:35.550+0000 7fa33f520700 1 --2- 172.21.15.83:0/2714611589 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa3380ffca0 0x7fa338100120 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:35.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:35.550+0000 7fa33f520700 1 -- 172.21.15.83:0/2714611589 >> 172.21.15.83:0/2714611589 conn(0x7fa338076c80 msgr2=0x7fa338077090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:35.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:35.550+0000 7fa33f520700 1 -- 172.21.15.83:0/2714611589 shutdown_connections 2024-04-01T06:55:35.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:35.550+0000 7fa33f520700 1 -- 172.21.15.83:0/2714611589 wait complete. 2024-04-01T06:55:35.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:35.551+0000 7fa33f520700 1 Processor -- start 2024-04-01T06:55:35.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:35.551+0000 7fa33f520700 1 -- start start 2024-04-01T06:55:35.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:35.551+0000 7fa33f520700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa3380ffca0 0x7fa338101950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:35.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:35.551+0000 7fa33f520700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa338100660 0x7fa338101e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:35.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:35.551+0000 7fa33f520700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa338105d50 0x7fa3381023d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:35.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:35.551+0000 7fa33f520700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3381a5620 con 0x7fa3380ffca0 2024-04-01T06:55:35.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:35.551+0000 7fa33f520700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3381a5790 con 0x7fa338105d50 2024-04-01T06:55:35.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:35.551+0000 7fa33f520700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3381a5950 con 0x7fa338100660 2024-04-01T06:55:35.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:35.551+0000 7fa33d2bc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa3380ffca0 0x7fa338101950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:35.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:35.551+0000 7fa33d2bc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa3380ffca0 0x7fa338101950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46842/0 (socket says 172.21.15.83:46842) 2024-04-01T06:55:35.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:35.551+0000 7fa33d2bc700 1 -- 172.21.15.83:0/2161734960 learned_addr learned my addr 172.21.15.83:0/2161734960 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:35.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:35.551+0000 7fa33dabd700 1 --2- 172.21.15.83:0/2161734960 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa338105d50 0x7fa3381023d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:35.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:35.551+0000 7fa33cabb700 1 --2- 172.21.15.83:0/2161734960 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa338100660 0x7fa338101e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:35.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:35.551+0000 7fa33d2bc700 1 -- 172.21.15.83:0/2161734960 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa338100660 msgr2=0x7fa338101e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:35.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:35.551+0000 7fa33d2bc700 1 --2- 172.21.15.83:0/2161734960 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa338100660 0x7fa338101e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:35.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:35.551+0000 7fa33d2bc700 1 -- 172.21.15.83:0/2161734960 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa338105d50 msgr2=0x7fa3381023d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:35.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:35.551+0000 7fa33d2bc700 1 --2- 172.21.15.83:0/2161734960 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa338105d50 0x7fa3381023d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:35.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:35.551+0000 7fa33d2bc700 1 -- 172.21.15.83:0/2161734960 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa32c0095f0 con 0x7fa3380ffca0 2024-04-01T06:55:35.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:35.551+0000 7fa33dabd700 1 --2- 172.21.15.83:0/2161734960 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa338105d50 0x7fa3381023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:55:35.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:35.551+0000 7fa33cabb700 1 --2- 172.21.15.83:0/2161734960 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa338100660 0x7fa338101e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:55:35.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:35.552+0000 7fa33d2bc700 1 --2- 172.21.15.83:0/2161734960 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa3380ffca0 0x7fa338101950 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa33000ba50 tx=0x7fa33000be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:35.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:35.552+0000 7fa3367fc700 1 -- 172.21.15.83:0/2161734960 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa33000cab0 con 0x7fa3380ffca0 2024-04-01T06:55:35.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:35.552+0000 7fa3367fc700 1 -- 172.21.15.83:0/2161734960 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa33000cc10 con 0x7fa3380ffca0 2024-04-01T06:55:35.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:35.552+0000 7fa33f520700 1 -- 172.21.15.83:0/2161734960 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3381a5c30 con 0x7fa3380ffca0 2024-04-01T06:55:35.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:35.552+0000 7fa3367fc700 1 -- 172.21.15.83:0/2161734960 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3300075d0 con 0x7fa3380ffca0 2024-04-01T06:55:35.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:35.552+0000 7fa33f520700 1 -- 172.21.15.83:0/2161734960 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3381a6130 con 0x7fa3380ffca0 2024-04-01T06:55:35.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:35.553+0000 7fa33f520700 1 -- 172.21.15.83:0/2161734960 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa338101390 con 0x7fa3380ffca0 2024-04-01T06:55:35.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:35.554+0000 7fa3367fc700 1 -- 172.21.15.83:0/2161734960 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7fa330014440 con 0x7fa3380ffca0 2024-04-01T06:55:35.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:35.555+0000 7fa3367fc700 1 --2- 172.21.15.83:0/2161734960 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fa3200a11b0 0x7fa3200a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:35.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:35.555+0000 7fa33cabb700 1 --2- 172.21.15.83:0/2161734960 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fa3200a11b0 0x7fa3200a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:35.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:35.555+0000 7fa3367fc700 1 -- 172.21.15.83:0/2161734960 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fa330006e40 con 0x7fa3380ffca0 2024-04-01T06:55:35.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:35.555+0000 7fa33cabb700 1 --2- 172.21.15.83:0/2161734960 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fa3200a11b0 0x7fa3200a3670 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa32c00b5c0 tx=0x7fa32c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:35.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:35.558+0000 7fa3367fc700 1 -- 172.21.15.83:0/2161734960 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7fa330095cf0 con 0x7fa3380ffca0 2024-04-01T06:55:35.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:35.796+0000 7fa33f520700 1 -- 172.21.15.83:0/2161734960 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa33804ea80 con 0x7fa3380ffca0 2024-04-01T06:55:35.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:35.796+0000 7fa3367fc700 1 -- 172.21.15.83:0/2161734960 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa330099310 con 0x7fa3380ffca0 2024-04-01T06:55:35.796 INFO:teuthology.orchestra.run.smithi083.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-01T06:55:35.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:35.798+0000 7fa33f520700 1 -- 172.21.15.83:0/2161734960 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fa3200a11b0 msgr2=0x7fa3200a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:35.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:35.798+0000 7fa33f520700 1 --2- 172.21.15.83:0/2161734960 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fa3200a11b0 0x7fa3200a3670 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa32c00b5c0 tx=0x7fa32c005fb0 comp rx=0 tx=0).stop 2024-04-01T06:55:35.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:35.798+0000 7fa33f520700 1 -- 172.21.15.83:0/2161734960 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa3380ffca0 msgr2=0x7fa338101950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:35.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:35.798+0000 7fa33f520700 1 --2- 172.21.15.83:0/2161734960 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa3380ffca0 0x7fa338101950 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa33000ba50 tx=0x7fa33000be10 comp rx=0 tx=0).stop 2024-04-01T06:55:35.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:35.798+0000 7fa33f520700 1 -- 172.21.15.83:0/2161734960 shutdown_connections 2024-04-01T06:55:35.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:35.798+0000 7fa33f520700 1 --2- 172.21.15.83:0/2161734960 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa3380ffca0 0x7fa338101950 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:35.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:35.798+0000 7fa33f520700 1 --2- 172.21.15.83:0/2161734960 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fa3200a11b0 0x7fa3200a3670 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:35.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:35.798+0000 7fa33f520700 1 --2- 172.21.15.83:0/2161734960 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa338105d50 0x7fa3381023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:35.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:35.798+0000 7fa33f520700 1 --2- 172.21.15.83:0/2161734960 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa338100660 0x7fa338101e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:35.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:35.798+0000 7fa33f520700 1 -- 172.21.15.83:0/2161734960 >> 172.21.15.83:0/2161734960 conn(0x7fa338076c80 msgr2=0x7fa3380fefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:35.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:35.798+0000 7fa33f520700 1 -- 172.21.15.83:0/2161734960 shutdown_connections 2024-04-01T06:55:35.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:35.798+0000 7fa33f520700 1 -- 172.21.15.83:0/2161734960 wait complete. 2024-04-01T06:55:36.211 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-01T06:55:36.211 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-01T06:55:36.211 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi083.front.sepia.ceph.com 2024-04-01T06:55:36.211 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-01T06:55:36.212 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-01T06:55:36.212 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-01T06:55:36.212 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-01T06:55:36.212 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-01T06:55:36.212 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-01T06:55:36.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T06:55:36.212 DEBUG:teuthology.orchestra.run.smithi083:> ip addr 2024-04-01T06:55:36.230 INFO:teuthology.orchestra.run.smithi083.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-01T06:55:36.231 INFO:teuthology.orchestra.run.smithi083.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-01T06:55:36.231 INFO:teuthology.orchestra.run.smithi083.stdout: inet 127.0.0.1/8 scope host lo 2024-04-01T06:55:36.231 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-04-01T06:55:36.231 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 ::1/128 scope host 2024-04-01T06:55:36.231 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-04-01T06:55:36.231 INFO:teuthology.orchestra.run.smithi083.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-01T06:55:36.231 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1e brd ff:ff:ff:ff:ff:ff 2024-04-01T06:55:36.231 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f0 2024-04-01T06:55:36.231 INFO:teuthology.orchestra.run.smithi083.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-01T06:55:36.231 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1f brd ff:ff:ff:ff:ff:ff 2024-04-01T06:55:36.231 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f1 2024-04-01T06:55:36.231 INFO:teuthology.orchestra.run.smithi083.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-01T06:55:36.231 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:90 brd ff:ff:ff:ff:ff:ff 2024-04-01T06:55:36.231 INFO:teuthology.orchestra.run.smithi083.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-01T06:55:36.232 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:91 brd ff:ff:ff:ff:ff:ff 2024-04-01T06:55:36.232 INFO:teuthology.orchestra.run.smithi083.stdout: inet 172.21.15.83/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-01T06:55:36.232 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft 41977sec preferred_lft 41977sec 2024-04-01T06:55:36.232 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::f605:3ebc:3e93:c167/64 scope link noprefixroute 2024-04-01T06:55:36.232 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-04-01T06:55:36.232 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-01T06:55:36.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T06:55:36.232 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2024-04-01T06:55:36.233 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-04-01T06:55:36.233 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link add name ceph-brx type bridge 2024-04-01T06:55:36.233 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip addr flush dev ceph-brx 2024-04-01T06:55:36.233 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set ceph-brx up 2024-04-01T06:55:36.233 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-01T06:55:36.233 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-04-01T06:55:36.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T06:55:36.398 DEBUG:teuthology.orchestra.run.smithi083:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-01T06:55:36.427 INFO:teuthology.orchestra.run.smithi083.stdout:1 2024-04-01T06:55:36.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T06:55:36.429 DEBUG:teuthology.orchestra.run.smithi083:> route 2024-04-01T06:55:36.502 INFO:teuthology.orchestra.run.smithi083.stdout:Kernel IP routing table 2024-04-01T06:55:36.502 INFO:teuthology.orchestra.run.smithi083.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-01T06:55:36.503 INFO:teuthology.orchestra.run.smithi083.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-01T06:55:36.503 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-01T06:55:36.503 INFO:teuthology.orchestra.run.smithi083.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-01T06:55:36.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T06:55:36.503 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2024-04-01T06:55:36.503 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-04-01T06:55:36.503 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-01T06:55:36.504 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-01T06:55:36.504 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-01T06:55:36.504 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-04-01T06:55:36.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T06:55:36.764 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2024-04-01T06:55:36.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T06:55:36.781 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list-id 2024-04-01T06:55:36.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T06:55:36.838 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2024-04-01T06:55:36.838 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-04-01T06:55:36.838 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-01T06:55:36.838 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-01T06:55:36.838 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-04-01T06:55:36.917 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:36 smithi083 ceph-mon[43429]: pgmap v252: 97 pgs: 1 peering, 96 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-01T06:55:36.917 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:36 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/2161734960' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-01T06:55:36.935 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-01T06:55:36.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T06:55:36.935 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2024-04-01T06:55:36.935 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-04-01T06:55:36.935 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-01T06:55:36.935 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-01T06:55:36.935 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-01T06:55:36.935 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-01T06:55:36.935 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-01T06:55:36.935 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-04-01T06:55:37.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:36 smithi145 ceph-mon[47816]: pgmap v252: 97 pgs: 1 peering, 96 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-01T06:55:37.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:36 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/2161734960' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-01T06:55:37.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:36 smithi153 ceph-mon[48187]: pgmap v252: 97 pgs: 1 peering, 96 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-01T06:55:37.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:36 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/2161734960' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-01T06:55:37.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T06:55:37.197 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec bash -c ' 2024-04-01T06:55:37.197 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-04-01T06:55:37.197 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set brx.0 up 2024-04-01T06:55:37.197 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set dev brx.0 master ceph-brx 2024-04-01T06:55:37.197 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-04-01T06:55:37.295 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-01T06:55:37.295 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-01T06:55:37.312 INFO:teuthology.orchestra.run.smithi083.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-01T06:55:37.313 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-01T06:55:37.313 DEBUG:teuthology.orchestra.run.smithi083:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-01T06:55:37.369 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-04-01T06:55:37.369 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-04-01T06:55:37.369 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579 2024-04-01T06:55:37.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T06:55:37.369 DEBUG:teuthology.orchestra.run.smithi083:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,wsync,nofallback 2024-04-01T06:55:37.455 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,wsync,nofallback 2024-04-01T06:55:37.455 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,wsync". 2024-04-01T06:55:37.558 INFO:teuthology.orchestra.run.smithi083.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,wsync,nofallback 2024-04-01T06:55:37.558 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,wsync". 2024-04-01T06:55:37.558 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: resolved to: "172.21.15.83:6789,172.21.15.145:6789,172.21.15.153:6789" 2024-04-01T06:55:37.558 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: trying mount with new device syntax: 0@c6f8eff4-eff3-11ee-b647-cb9ed24678a4.cephfs=/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579 2024-04-01T06:55:37.559 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,wsync,name=0,key=0,mon_addr=172.21.15.83:6789/172.21.15.145:6789/172.21.15.153:6789" will pass to kernel 2024-04-01T06:55:37.559 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: v2 mount support check returned 2 2024-04-01T06:55:37.559 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: kernel does not support v2 syntax 2024-04-01T06:55:37.559 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.83:6789,172.21.15.145:6789,172.21.15.153:6789:/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579 2024-04-01T06:55:37.559 INFO:teuthology.orchestra.run.smithi083.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,wsync,name=0,key=0,mds_namespace=cephfs,fsid=c6f8eff4-eff3-11ee-b647-cb9ed24678a4" will pass to kernel 2024-04-01T06:55:37.561 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-01T06:55:37.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T06:55:37.562 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-01T06:55:37.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T06:55:37.591 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-01T06:55:37.685 INFO:teuthology.orchestra.run.smithi083.stdout:client15249 2024-04-01T06:55:37.685 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-04-01T06:55:37.685 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-01T06:55:37.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T06:55:37.703 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-01T06:55:37.795 INFO:teuthology.orchestra.run.smithi083.stdout:client15249 2024-04-01T06:55:37.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T06:55:37.795 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-01T06:55:37.847 INFO:teuthology.orchestra.run.smithi083.stdout:client15249 2024-04-01T06:55:37.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T06:55:37.847 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4.client15249/status') 2024-04-01T06:55:37.905 INFO:teuthology.orchestra.run.smithi083.stdout:instance: client.15249 (3)192.168.0.1:0/4181051302 2024-04-01T06:55:37.905 INFO:teuthology.orchestra.run.smithi083.stdout:blocklisted: false 2024-04-01T06:55:37.905 INFO:teuthology.orchestra.run.smithi083.stderr:0+1 records in 2024-04-01T06:55:37.905 INFO:teuthology.orchestra.run.smithi083.stderr:0+1 records out 2024-04-01T06:55:37.905 INFO:teuthology.orchestra.run.smithi083.stderr:70 bytes copied, 2.1574e-05 s, 3.2 MB/s 2024-04-01T06:55:37.907 INFO:teuthology.run_tasks:Running task exec... 2024-04-01T06:55:37.916 INFO:teuthology.task.exec:Executing custom commands... 2024-04-01T06:55:37.917 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi083.front.sepia.ceph.com 2024-04-01T06:55:37.917 DEBUG:teuthology.orchestra.run.smithi083:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-04-01T06:55:38.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:37 smithi145 ceph-mon[47816]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-04-01T06:55:38.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:37 smithi083 ceph-mon[43429]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-04-01T06:55:38.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.039+0000 7f6cb80f0700 1 -- 172.21.15.83:0/1520970357 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6cb0100910 msgr2=0x7f6cb0100d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:38.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.039+0000 7f6cb80f0700 1 --2- 172.21.15.83:0/1520970357 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6cb0100910 0x7f6cb0100d90 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f6ca800b0a0 tx=0x7f6ca800b3b0 comp rx=0 tx=0).stop 2024-04-01T06:55:38.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.039+0000 7f6cb80f0700 1 -- 172.21.15.83:0/1520970357 shutdown_connections 2024-04-01T06:55:38.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.039+0000 7f6cb80f0700 1 --2- 172.21.15.83:0/1520970357 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6cb0100910 0x7f6cb0100d90 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:38.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.039+0000 7f6cb80f0700 1 --2- 172.21.15.83:0/1520970357 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6cb00ff5f0 0x7f6cb00ffa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:38.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.039+0000 7f6cb80f0700 1 --2- 172.21.15.83:0/1520970357 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6cb00fff50 0x7f6cb01003d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:38.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.039+0000 7f6cb80f0700 1 -- 172.21.15.83:0/1520970357 >> 172.21.15.83:0/1520970357 conn(0x7f6cb00fb170 msgr2=0x7f6cb00fd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:38.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.040+0000 7f6cb80f0700 1 -- 172.21.15.83:0/1520970357 shutdown_connections 2024-04-01T06:55:38.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.040+0000 7f6cb80f0700 1 -- 172.21.15.83:0/1520970357 wait complete. 2024-04-01T06:55:38.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.040+0000 7f6cb80f0700 1 Processor -- start 2024-04-01T06:55:38.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.040+0000 7f6cb80f0700 1 -- start start 2024-04-01T06:55:38.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.040+0000 7f6cb80f0700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6cb00ff5f0 0x7f6cb0198f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:38.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.040+0000 7f6cb80f0700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6cb00fff50 0x7f6cb0199470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:38.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.040+0000 7f6cb80f0700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6cb0100910 0x7f6cb01a0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:38.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.040+0000 7f6cb80f0700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb01a0a60 con 0x7f6cb00fff50 2024-04-01T06:55:38.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.040+0000 7f6cb80f0700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb01a0ba0 con 0x7f6cb00ff5f0 2024-04-01T06:55:38.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.040+0000 7f6cb80f0700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb01a0d30 con 0x7f6cb0100910 2024-04-01T06:55:38.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.040+0000 7f6cb568b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6cb00fff50 0x7f6cb0199470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:38.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.040+0000 7f6cb568b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6cb00fff50 0x7f6cb0199470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46868/0 (socket says 172.21.15.83:46868) 2024-04-01T06:55:38.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.040+0000 7f6cb568b700 1 -- 172.21.15.83:0/298219064 learned_addr learned my addr 172.21.15.83:0/298219064 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:38.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.041+0000 7f6cb668d700 1 --2- 172.21.15.83:0/298219064 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6cb0100910 0x7f6cb01a0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:38.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.041+0000 7f6cb568b700 1 -- 172.21.15.83:0/298219064 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6cb0100910 msgr2=0x7f6cb01a0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:38.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.041+0000 7f6cb568b700 1 --2- 172.21.15.83:0/298219064 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6cb0100910 0x7f6cb01a0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:38.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.041+0000 7f6cb568b700 1 -- 172.21.15.83:0/298219064 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6cb00ff5f0 msgr2=0x7f6cb0198f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:38.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.041+0000 7f6cb5e8c700 1 --2- 172.21.15.83:0/298219064 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6cb00ff5f0 0x7f6cb0198f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:38.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.041+0000 7f6cb568b700 1 --2- 172.21.15.83:0/298219064 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6cb00ff5f0 0x7f6cb0198f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:38.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.041+0000 7f6cb568b700 1 -- 172.21.15.83:0/298219064 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca8009d00 con 0x7f6cb00fff50 2024-04-01T06:55:38.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.041+0000 7f6cb668d700 1 --2- 172.21.15.83:0/298219064 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6cb0100910 0x7f6cb01a0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:55:38.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.041+0000 7f6cb568b700 1 --2- 172.21.15.83:0/298219064 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6cb00fff50 0x7f6cb0199470 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6cac00d950 tx=0x7f6cac00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:38.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.041+0000 7f6ca6ffd700 1 -- 172.21.15.83:0/298219064 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cac009b40 con 0x7f6cb00fff50 2024-04-01T06:55:38.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.041+0000 7f6ca6ffd700 1 -- 172.21.15.83:0/298219064 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6cac009ca0 con 0x7f6cb00fff50 2024-04-01T06:55:38.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.041+0000 7f6ca6ffd700 1 -- 172.21.15.83:0/298219064 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cac00f620 con 0x7f6cb00fff50 2024-04-01T06:55:38.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.041+0000 7f6cb80f0700 1 -- 172.21.15.83:0/298219064 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cb01a0fb0 con 0x7f6cb00fff50 2024-04-01T06:55:38.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.041+0000 7f6cb80f0700 1 -- 172.21.15.83:0/298219064 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cb01a1490 con 0x7f6cb00fff50 2024-04-01T06:55:38.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.042+0000 7f6cb80f0700 1 -- 172.21.15.83:0/298219064 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cb010a3d0 con 0x7f6cb00fff50 2024-04-01T06:55:38.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.043+0000 7f6ca6ffd700 1 -- 172.21.15.83:0/298219064 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f6cac010460 con 0x7f6cb00fff50 2024-04-01T06:55:38.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.043+0000 7f6ca6ffd700 1 --2- 172.21.15.83:0/298219064 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f6c9c0a1230 0x7f6c9c0a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:38.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.044+0000 7f6cb5e8c700 1 --2- 172.21.15.83:0/298219064 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f6c9c0a1230 0x7f6c9c0a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:38.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.044+0000 7f6ca6ffd700 1 -- 172.21.15.83:0/298219064 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f6cac0ccc10 con 0x7f6cb00fff50 2024-04-01T06:55:38.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.044+0000 7f6cb5e8c700 1 --2- 172.21.15.83:0/298219064 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f6c9c0a1230 0x7f6c9c0a36f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6ca0005950 tx=0x7f6ca0005cf0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:38.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.047+0000 7f6ca6ffd700 1 -- 172.21.15.83:0/298219064 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f6cac096360 con 0x7f6cb00fff50 2024-04-01T06:55:38.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:37 smithi153 ceph-mon[48187]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-04-01T06:55:38.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.290+0000 7f6cb80f0700 1 -- 172.21.15.83:0/298219064 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) v1 -- 0x7f6cb0067c30 con 0x7f6cb00fff50 2024-04-01T06:55:38.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.712+0000 7f6ca6ffd700 1 -- 172.21.15.83:0/298219064 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v24) v1 ==== 117+0+0 (secure 0 0 0) 0x7f6cac0160b0 con 0x7f6cb00fff50 2024-04-01T06:55:38.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.715+0000 7f6cb80f0700 1 -- 172.21.15.83:0/298219064 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f6c9c0a1230 msgr2=0x7f6c9c0a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:38.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.715+0000 7f6cb80f0700 1 --2- 172.21.15.83:0/298219064 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f6c9c0a1230 0x7f6c9c0a36f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6ca0005950 tx=0x7f6ca0005cf0 comp rx=0 tx=0).stop 2024-04-01T06:55:38.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.715+0000 7f6cb80f0700 1 -- 172.21.15.83:0/298219064 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6cb00fff50 msgr2=0x7f6cb0199470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:38.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.715+0000 7f6cb80f0700 1 --2- 172.21.15.83:0/298219064 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6cb00fff50 0x7f6cb0199470 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6cac00d950 tx=0x7f6cac00dd10 comp rx=0 tx=0).stop 2024-04-01T06:55:38.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.715+0000 7f6cb80f0700 1 -- 172.21.15.83:0/298219064 shutdown_connections 2024-04-01T06:55:38.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.715+0000 7f6cb80f0700 1 --2- 172.21.15.83:0/298219064 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f6c9c0a1230 0x7f6c9c0a36f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:38.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.715+0000 7f6cb80f0700 1 --2- 172.21.15.83:0/298219064 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6cb0100910 0x7f6cb01a0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:38.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.715+0000 7f6cb80f0700 1 --2- 172.21.15.83:0/298219064 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6cb00ff5f0 0x7f6cb0198f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:38.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.715+0000 7f6cb80f0700 1 --2- 172.21.15.83:0/298219064 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6cb00fff50 0x7f6cb0199470 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:38.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.715+0000 7f6cb80f0700 1 -- 172.21.15.83:0/298219064 >> 172.21.15.83:0/298219064 conn(0x7f6cb00fb170 msgr2=0x7f6cb00fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:38.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.715+0000 7f6cb80f0700 1 -- 172.21.15.83:0/298219064 shutdown_connections 2024-04-01T06:55:38.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.715+0000 7f6cb80f0700 1 -- 172.21.15.83:0/298219064 wait complete. 2024-04-01T06:55:38.727 INFO:teuthology.run_tasks:Running task check-counter... 2024-04-01T06:55:38.738 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-04-01T06:55:38.782 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T06:55:38.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.914+0000 7fe5cad38700 1 -- 172.21.15.83:0/1109274897 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5c4102960 msgr2=0x7fe5c4109210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:38.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.914+0000 7fe5cad38700 1 --2- 172.21.15.83:0/1109274897 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5c4102960 0x7fe5c4109210 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc00b0a0 tx=0x7fe5bc00b3b0 comp rx=0 tx=0).stop 2024-04-01T06:55:38.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.914+0000 7fe5cad38700 1 -- 172.21.15.83:0/1109274897 shutdown_connections 2024-04-01T06:55:38.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.914+0000 7fe5cad38700 1 --2- 172.21.15.83:0/1109274897 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5c4102960 0x7fe5c4109210 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:38.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.914+0000 7fe5cad38700 1 --2- 172.21.15.83:0/1109274897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5c40fef50 0x7fe5c40ff370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:38.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.914+0000 7fe5cad38700 1 --2- 172.21.15.83:0/1109274897 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe5c4101fc0 0x7fe5c4102420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:38.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.914+0000 7fe5cad38700 1 -- 172.21.15.83:0/1109274897 >> 172.21.15.83:0/1109274897 conn(0x7fe5c40fa880 msgr2=0x7fe5c40fcca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:38.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.914+0000 7fe5cad38700 1 -- 172.21.15.83:0/1109274897 shutdown_connections 2024-04-01T06:55:38.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.914+0000 7fe5cad38700 1 -- 172.21.15.83:0/1109274897 wait complete. 2024-04-01T06:55:38.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.915+0000 7fe5cad38700 1 Processor -- start 2024-04-01T06:55:38.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.915+0000 7fe5cad38700 1 -- start start 2024-04-01T06:55:38.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.915+0000 7fe5cad38700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe5c40fef50 0x7fe5c4196cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:38.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.915+0000 7fe5cad38700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5c4101fc0 0x7fe5c41971f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:38.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.915+0000 7fe5cad38700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5c4102960 0x7fe5c419e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:38.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.915+0000 7fe5cad38700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c419e7a0 con 0x7fe5c4101fc0 2024-04-01T06:55:38.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.915+0000 7fe5cad38700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c419e910 con 0x7fe5c40fef50 2024-04-01T06:55:38.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.915+0000 7fe5cad38700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c419ead0 con 0x7fe5c4102960 2024-04-01T06:55:38.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.915+0000 7fe5c3fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5c4101fc0 0x7fe5c41971f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:38.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.915+0000 7fe5c3fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5c4101fc0 0x7fe5c41971f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46884/0 (socket says 172.21.15.83:46884) 2024-04-01T06:55:38.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.915+0000 7fe5c3fff700 1 -- 172.21.15.83:0/3042802577 learned_addr learned my addr 172.21.15.83:0/3042802577 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:38.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.915+0000 7fe5c8ad4700 1 --2- 172.21.15.83:0/3042802577 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe5c40fef50 0x7fe5c4196cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:38.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.915+0000 7fe5c92d5700 1 --2- 172.21.15.83:0/3042802577 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5c4102960 0x7fe5c419e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:38.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.916+0000 7fe5c3fff700 1 -- 172.21.15.83:0/3042802577 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5c4102960 msgr2=0x7fe5c419e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:38.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.916+0000 7fe5c3fff700 1 --2- 172.21.15.83:0/3042802577 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5c4102960 0x7fe5c419e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:38.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.916+0000 7fe5c3fff700 1 -- 172.21.15.83:0/3042802577 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe5c40fef50 msgr2=0x7fe5c4196cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:38.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.916+0000 7fe5c3fff700 1 --2- 172.21.15.83:0/3042802577 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe5c40fef50 0x7fe5c4196cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:38.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.916+0000 7fe5c3fff700 1 -- 172.21.15.83:0/3042802577 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5bc009d00 con 0x7fe5c4101fc0 2024-04-01T06:55:38.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.916+0000 7fe5c3fff700 1 --2- 172.21.15.83:0/3042802577 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5c4101fc0 0x7fe5c41971f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fe5b000c9b0 tx=0x7fe5b000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:38.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.916+0000 7fe5c1ffb700 1 -- 172.21.15.83:0/3042802577 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b0007b00 con 0x7fe5c4101fc0 2024-04-01T06:55:38.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.916+0000 7fe5cad38700 1 -- 172.21.15.83:0/3042802577 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5c419edb0 con 0x7fe5c4101fc0 2024-04-01T06:55:38.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.916+0000 7fe5c1ffb700 1 -- 172.21.15.83:0/3042802577 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe5b0007c60 con 0x7fe5c4101fc0 2024-04-01T06:55:38.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.916+0000 7fe5c1ffb700 1 -- 172.21.15.83:0/3042802577 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b0018660 con 0x7fe5c4101fc0 2024-04-01T06:55:38.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.916+0000 7fe5cad38700 1 -- 172.21.15.83:0/3042802577 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5c419f280 con 0x7fe5c4101fc0 2024-04-01T06:55:38.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.917+0000 7fe5cad38700 1 -- 172.21.15.83:0/3042802577 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5c4108180 con 0x7fe5c4101fc0 2024-04-01T06:55:38.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.918+0000 7fe5c1ffb700 1 -- 172.21.15.83:0/3042802577 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7fe5b000f450 con 0x7fe5c4101fc0 2024-04-01T06:55:38.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.918+0000 7fe5c1ffb700 1 --2- 172.21.15.83:0/3042802577 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fe5b40a11b0 0x7fe5b40a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:38.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.919+0000 7fe5c1ffb700 1 -- 172.21.15.83:0/3042802577 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fe5b00cc8f0 con 0x7fe5c4101fc0 2024-04-01T06:55:38.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.919+0000 7fe5c8ad4700 1 --2- 172.21.15.83:0/3042802577 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fe5b40a11b0 0x7fe5b40a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:38.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.919+0000 7fe5c8ad4700 1 --2- 172.21.15.83:0/3042802577 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fe5b40a11b0 0x7fe5b40a3670 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8005950 tx=0x7fe5b800a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:38.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:38.923+0000 7fe5c1ffb700 1 -- 172.21.15.83:0/3042802577 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7fe5b0096040 con 0x7fe5c4101fc0 2024-04-01T06:55:39.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:38 smithi145 ceph-mon[47816]: pgmap v253: 97 pgs: 1 peering, 96 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s; 0 B/s, 0 objects/s recovering 2024-04-01T06:55:39.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:38 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/298219064' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-04-01T06:55:39.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:38 smithi083 ceph-mon[43429]: pgmap v253: 97 pgs: 1 peering, 96 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s; 0 B/s, 0 objects/s recovering 2024-04-01T06:55:39.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:38 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/298219064' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-04-01T06:55:39.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.136+0000 7fe5cad38700 1 -- 172.21.15.83:0/3042802577 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5c410c4e0 con 0x7fe5c4101fc0 2024-04-01T06:55:39.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.137+0000 7fe5c1ffb700 1 -- 172.21.15.83:0/3042802577 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+22425 (secure 0 0 0) 0x7fe5b0099660 con 0x7fe5c4101fc0 2024-04-01T06:55:39.137 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:55:39.137 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":81,"fsid":"c6f8eff4-eff3-11ee-b647-cb9ed24678a4","created":"2024-04-01T06:48:42.033382+0000","modified":"2024-04-01T06:55:34.704509+0000","last_up_change":"2024-04-01T06:53:55.791339+0000","last_in_change":"2024-04-01T06:53:39.777214+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T06:51:21.963996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T06:54:26.450403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T06:54:27.564928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"90b761b0-b06c-4142-854d-38ee42aa6052","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6803","nonce":3253845390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6805","nonce":3253845390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6809","nonce":3253845390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6807","nonce":3253845390}]},"public_addr":"172.21.15.83:6803/3253845390","cluster_addr":"172.21.15.83:6805/3253845390","heartbeat_back_addr":"172.21.15.83:6809/3253845390","heartbeat_front_addr":"172.21.15.83:6807/3253845390","state":["exists","up"]},{"osd":1,"uuid":"4d6ab85b-7088-451e-a829-c9119f35dee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6801","nonce":515889759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6803","nonce":515889759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6807","nonce":515889759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6805","nonce":515889759}]},"public_addr":"172.21.15.145:6801/515889759","cluster_addr":"172.21.15.145:6803/515889759","heartbeat_back_addr":"172.21.15.145:6807/515889759","heartbeat_front_addr":"172.21.15.145:6805/515889759","state":["exists","up"]},{"osd":2,"uuid":"d04c27f3-4972-4061-8bfb-5060645e3883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6801","nonce":3318516728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6803","nonce":3318516728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6807","nonce":3318516728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6805","nonce":3318516728}]},"public_addr":"172.21.15.153:6801/3318516728","cluster_addr":"172.21.15.153:6803/3318516728","heartbeat_back_addr":"172.21.15.153:6807/3318516728","heartbeat_front_addr":"172.21.15.153:6805/3318516728","state":["exists","up"]},{"osd":3,"uuid":"899b6c90-8f2f-44dd-b807-49594aadb443","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6811","nonce":504690234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6813","nonce":504690234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6817","nonce":504690234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6815","nonce":504690234}]},"public_addr":"172.21.15.83:6811/504690234","cluster_addr":"172.21.15.83:6813/504690234","heartbeat_back_addr":"172.21.15.83:6817/504690234","heartbeat_front_addr":"172.21.15.83:6815/504690234","state":["exists","up"]},{"osd":4,"uuid":"5071dd81-804e-4358-bfb6-11e718e9cf4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6809","nonce":2099824730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6811","nonce":2099824730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6815","nonce":2099824730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6813","nonce":2099824730}]},"public_addr":"172.21.15.145:6809/2099824730","cluster_addr":"172.21.15.145:6811/2099824730","heartbeat_back_addr":"172.21.15.145:6815/2099824730","heartbeat_front_addr":"172.21.15.145:6813/2099824730","state":["exists","up"]},{"osd":5,"uuid":"b8442b71-c26e-467f-b0c3-ea9f636f5a00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6809","nonce":3340941443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6811","nonce":3340941443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6815","nonce":3340941443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6813","nonce":3340941443}]},"public_addr":"172.21.15.153:6809/3340941443","cluster_addr":"172.21.15.153:6811/3340941443","heartbeat_back_addr":"172.21.15.153:6815/3340941443","heartbeat_front_addr":"172.21.15.153:6813/3340941443","state":["exists","up"]},{"osd":6,"uuid":"c26bb8cb-ccee-4bfc-91eb-14e1ad8e04df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6819","nonce":2005485079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6821","nonce":2005485079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6825","nonce":2005485079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6823","nonce":2005485079}]},"public_addr":"172.21.15.83:6819/2005485079","cluster_addr":"172.21.15.83:6821/2005485079","heartbeat_back_addr":"172.21.15.83:6825/2005485079","heartbeat_front_addr":"172.21.15.83:6823/2005485079","state":["exists","up"]},{"osd":7,"uuid":"a8940da2-0e79-4606-8d1e-d425afbf5753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6817","nonce":3737505059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6819","nonce":3737505059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6823","nonce":3737505059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6821","nonce":3737505059}]},"public_addr":"172.21.15.145:6817/3737505059","cluster_addr":"172.21.15.145:6819/3737505059","heartbeat_back_addr":"172.21.15.145:6823/3737505059","heartbeat_front_addr":"172.21.15.145:6821/3737505059","state":["exists","up"]},{"osd":8,"uuid":"602d43ac-a189-4da3-9e38-7025d14e0dd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6817","nonce":1031545791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6819","nonce":1031545791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6823","nonce":1031545791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6821","nonce":1031545791}]},"public_addr":"172.21.15.153:6817/1031545791","cluster_addr":"172.21.15.153:6819/1031545791","heartbeat_back_addr":"172.21.15.153:6823/1031545791","heartbeat_front_addr":"172.21.15.153:6821/1031545791","state":["exists","up"]},{"osd":9,"uuid":"08b12d27-1247-45e4-9d09-cacc0fce4bd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6827","nonce":3720996673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6829","nonce":3720996673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6833","nonce":3720996673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6831","nonce":3720996673}]},"public_addr":"172.21.15.83:6827/3720996673","cluster_addr":"172.21.15.83:6829/3720996673","heartbeat_back_addr":"172.21.15.83:6833/3720996673","heartbeat_front_addr":"172.21.15.83:6831/3720996673","state":["exists","up"]},{"osd":10,"uuid":"dd986b50-d68f-446c-9c66-261535880879","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6825","nonce":2671529479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6827","nonce":2671529479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6831","nonce":2671529479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6829","nonce":2671529479}]},"public_addr":"172.21.15.145:6825/2671529479","cluster_addr":"172.21.15.145:6827/2671529479","heartbeat_back_addr":"172.21.15.145:6831/2671529479","heartbeat_front_addr":"172.21.15.145:6829/2671529479","state":["exists","up"]},{"osd":11,"uuid":"d20a49cd-6224-4424-8375-46da791d9931","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6825","nonce":2342548429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6827","nonce":2342548429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6831","nonce":2342548429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6829","nonce":2342548429}]},"public_addr":"172.21.15.153:6825/2342548429","cluster_addr":"172.21.15.153:6827/2342548429","heartbeat_back_addr":"172.21.15.153:6831/2342548429","heartbeat_front_addr":"172.21.15.153:6829/2342548429","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:50:44.539932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:01.990470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:19.054426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:36.616393+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:53.896705+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:10.667502+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:27.880849+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:45.276308+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:02.280615+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:19.555547+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:37.062881+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:54.191589+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.83:6801/1867137261":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/2596683931":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/2125339627":"2024-04-02T06:49:33.656125+0000","172.21.15.83:6800/1644397953":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/690500472":"2024-04-02T06:49:13.456026+0000","172.21.15.83:6801/1644397953":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/785958951":"2024-04-02T06:49:33.656125+0000","172.21.15.83:6800/1867137261":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/2222527447":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/2071592157":"2024-04-02T06:49:13.456026+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T06:55:39.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.139+0000 7fe5cad38700 1 -- 172.21.15.83:0/3042802577 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fe5b40a11b0 msgr2=0x7fe5b40a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:39.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.139+0000 7fe5cad38700 1 --2- 172.21.15.83:0/3042802577 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fe5b40a11b0 0x7fe5b40a3670 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe5b8005950 tx=0x7fe5b800a300 comp rx=0 tx=0).stop 2024-04-01T06:55:39.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.139+0000 7fe5cad38700 1 -- 172.21.15.83:0/3042802577 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5c4101fc0 msgr2=0x7fe5c41971f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:39.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.139+0000 7fe5cad38700 1 --2- 172.21.15.83:0/3042802577 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5c4101fc0 0x7fe5c41971f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fe5b000c9b0 tx=0x7fe5b000ccc0 comp rx=0 tx=0).stop 2024-04-01T06:55:39.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.139+0000 7fe5cad38700 1 -- 172.21.15.83:0/3042802577 shutdown_connections 2024-04-01T06:55:39.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.139+0000 7fe5cad38700 1 --2- 172.21.15.83:0/3042802577 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fe5b40a11b0 0x7fe5b40a3670 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:39.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.139+0000 7fe5cad38700 1 --2- 172.21.15.83:0/3042802577 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5c4102960 0x7fe5c419e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:39.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.139+0000 7fe5cad38700 1 --2- 172.21.15.83:0/3042802577 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe5c40fef50 0x7fe5c4196cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:39.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.139+0000 7fe5cad38700 1 --2- 172.21.15.83:0/3042802577 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe5c4101fc0 0x7fe5c41971f0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:39.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.139+0000 7fe5cad38700 1 -- 172.21.15.83:0/3042802577 >> 172.21.15.83:0/3042802577 conn(0x7fe5c40fa880 msgr2=0x7fe5c41052c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:39.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.139+0000 7fe5cad38700 1 -- 172.21.15.83:0/3042802577 shutdown_connections 2024-04-01T06:55:39.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.139+0000 7fe5cad38700 1 -- 172.21.15.83:0/3042802577 wait complete. 2024-04-01T06:55:39.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:38 smithi153 ceph-mon[48187]: pgmap v253: 97 pgs: 1 peering, 96 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s; 0 B/s, 0 objects/s recovering 2024-04-01T06:55:39.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:38 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/298219064' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-04-01T06:55:39.152 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-01T06:51:21.963996+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-01T06:54:26.450403+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-01T06:54:27.564928+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-01T06:55:39.152 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-01T06:55:39.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.277+0000 7f82223f4700 1 -- 172.21.15.83:0/4101691913 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f821c106aa0 msgr2=0x7f821c108eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:39.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.277+0000 7f82223f4700 1 --2- 172.21.15.83:0/4101691913 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f821c106aa0 0x7f821c108eb0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f821400b0a0 tx=0x7f821400b3b0 comp rx=0 tx=0).stop 2024-04-01T06:55:39.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.277+0000 7f82223f4700 1 -- 172.21.15.83:0/4101691913 shutdown_connections 2024-04-01T06:55:39.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.277+0000 7f82223f4700 1 --2- 172.21.15.83:0/4101691913 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f821c106aa0 0x7f821c108eb0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:39.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.277+0000 7f82223f4700 1 --2- 172.21.15.83:0/4101691913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f821c101840 0x7f821c103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:39.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.277+0000 7f82223f4700 1 --2- 172.21.15.83:0/4101691913 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f821c104170 0x7f821c106560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:39.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.277+0000 7f82223f4700 1 -- 172.21.15.83:0/4101691913 >> 172.21.15.83:0/4101691913 conn(0x7f821c0fb1d0 msgr2=0x7f821c0fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:39.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.277+0000 7f82223f4700 1 -- 172.21.15.83:0/4101691913 shutdown_connections 2024-04-01T06:55:39.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.277+0000 7f82223f4700 1 -- 172.21.15.83:0/4101691913 wait complete. 2024-04-01T06:55:39.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.277+0000 7f82223f4700 1 Processor -- start 2024-04-01T06:55:39.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.277+0000 7f82223f4700 1 -- start start 2024-04-01T06:55:39.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.278+0000 7f82223f4700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f821c101840 0x7f821c196e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:39.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.278+0000 7f82223f4700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f821c104170 0x7f821c197340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:39.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.278+0000 7f82223f4700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f821c106aa0 0x7f821c19e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:39.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.278+0000 7f82223f4700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821c19e930 con 0x7f821c101840 2024-04-01T06:55:39.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.278+0000 7f82223f4700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821c19ea70 con 0x7f821c104170 2024-04-01T06:55:39.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.278+0000 7f82223f4700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821c19ec00 con 0x7f821c106aa0 2024-04-01T06:55:39.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.278+0000 7f821bfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f821c101840 0x7f821c196e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:39.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.278+0000 7f821bfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f821c101840 0x7f821c196e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46896/0 (socket says 172.21.15.83:46896) 2024-04-01T06:55:39.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.278+0000 7f821bfff700 1 -- 172.21.15.83:0/333866391 learned_addr learned my addr 172.21.15.83:0/333866391 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:39.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.278+0000 7f8220991700 1 --2- 172.21.15.83:0/333866391 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f821c106aa0 0x7f821c19e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:39.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.278+0000 7f821b7fe700 1 --2- 172.21.15.83:0/333866391 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f821c104170 0x7f821c197340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:39.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.278+0000 7f821bfff700 1 -- 172.21.15.83:0/333866391 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f821c106aa0 msgr2=0x7f821c19e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:39.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.278+0000 7f821bfff700 1 --2- 172.21.15.83:0/333866391 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f821c106aa0 0x7f821c19e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:39.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.278+0000 7f821bfff700 1 -- 172.21.15.83:0/333866391 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f821c104170 msgr2=0x7f821c197340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:39.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.278+0000 7f821bfff700 1 --2- 172.21.15.83:0/333866391 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f821c104170 0x7f821c197340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:39.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.278+0000 7f821bfff700 1 -- 172.21.15.83:0/333866391 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8214009d00 con 0x7f821c101840 2024-04-01T06:55:39.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.278+0000 7f821b7fe700 1 --2- 172.21.15.83:0/333866391 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f821c104170 0x7f821c197340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:55:39.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.278+0000 7f821bfff700 1 --2- 172.21.15.83:0/333866391 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f821c101840 0x7f821c196e00 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f820400e9a0 tx=0x7f820400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:39.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.278+0000 7f82197fa700 1 -- 172.21.15.83:0/333866391 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8204009790 con 0x7f821c101840 2024-04-01T06:55:39.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.278+0000 7f82197fa700 1 -- 172.21.15.83:0/333866391 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f820400cbd0 con 0x7f821c101840 2024-04-01T06:55:39.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.278+0000 7f82197fa700 1 -- 172.21.15.83:0/333866391 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8204018680 con 0x7f821c101840 2024-04-01T06:55:39.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.278+0000 7f82223f4700 1 -- 172.21.15.83:0/333866391 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f821c19eee0 con 0x7f821c101840 2024-04-01T06:55:39.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.278+0000 7f82223f4700 1 -- 172.21.15.83:0/333866391 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f821c19f300 con 0x7f821c101840 2024-04-01T06:55:39.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.279+0000 7f82223f4700 1 -- 172.21.15.83:0/333866391 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f821c0fcd50 con 0x7f821c101840 2024-04-01T06:55:39.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.280+0000 7f82197fa700 1 -- 172.21.15.83:0/333866391 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f820400cd40 con 0x7f821c101840 2024-04-01T06:55:39.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.281+0000 7f82197fa700 1 --2- 172.21.15.83:0/333866391 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f82080a1230 0x7f82080a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:39.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.281+0000 7f821b7fe700 1 --2- 172.21.15.83:0/333866391 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f82080a1230 0x7f82080a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:39.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.281+0000 7f82197fa700 1 -- 172.21.15.83:0/333866391 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f8204014070 con 0x7f821c101840 2024-04-01T06:55:39.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.282+0000 7f821b7fe700 1 --2- 172.21.15.83:0/333866391 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f82080a1230 0x7f82080a36f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f820c009be0 tx=0x7f820c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:39.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.286+0000 7f82197fa700 1 -- 172.21.15.83:0/333866391 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f82040529f0 con 0x7f821c101840 2024-04-01T06:55:39.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.480+0000 7f82223f4700 1 -- 172.21.15.83:0/333866391 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f821c10c590 con 0x7f821c101840 2024-04-01T06:55:39.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.481+0000 7f82197fa700 1 -- 172.21.15.83:0/333866391 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8204099dc0 con 0x7f821c101840 2024-04-01T06:55:39.481 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 1 2024-04-01T06:55:39.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.483+0000 7f82223f4700 1 -- 172.21.15.83:0/333866391 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f82080a1230 msgr2=0x7f82080a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:39.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.483+0000 7f82223f4700 1 --2- 172.21.15.83:0/333866391 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f82080a1230 0x7f82080a36f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f820c009be0 tx=0x7f820c009260 comp rx=0 tx=0).stop 2024-04-01T06:55:39.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.483+0000 7f82223f4700 1 -- 172.21.15.83:0/333866391 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f821c101840 msgr2=0x7f821c196e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:39.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.483+0000 7f82223f4700 1 --2- 172.21.15.83:0/333866391 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f821c101840 0x7f821c196e00 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f820400e9a0 tx=0x7f820400ed60 comp rx=0 tx=0).stop 2024-04-01T06:55:39.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.483+0000 7f82223f4700 1 -- 172.21.15.83:0/333866391 shutdown_connections 2024-04-01T06:55:39.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.483+0000 7f82223f4700 1 --2- 172.21.15.83:0/333866391 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f821c101840 0x7f821c196e00 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:39.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.483+0000 7f82223f4700 1 --2- 172.21.15.83:0/333866391 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f82080a1230 0x7f82080a36f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:39.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.483+0000 7f82223f4700 1 --2- 172.21.15.83:0/333866391 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f821c106aa0 0x7f821c19e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:39.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.483+0000 7f82223f4700 1 --2- 172.21.15.83:0/333866391 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f821c104170 0x7f821c197340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:39.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.483+0000 7f82223f4700 1 -- 172.21.15.83:0/333866391 >> 172.21.15.83:0/333866391 conn(0x7f821c0fb1d0 msgr2=0x7f821c1020e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:39.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.483+0000 7f82223f4700 1 -- 172.21.15.83:0/333866391 shutdown_connections 2024-04-01T06:55:39.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.483+0000 7f82223f4700 1 -- 172.21.15.83:0/333866391 wait complete. 2024-04-01T06:55:39.495 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-01T06:55:39.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.620+0000 7f88dcba7700 1 -- 172.21.15.83:0/705505100 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88d80ffc90 msgr2=0x7f88d81000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:39.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.620+0000 7f88dcba7700 1 --2- 172.21.15.83:0/705505100 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88d80ffc90 0x7f88d81000b0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f88c80099c0 tx=0x7f88c8009cd0 comp rx=0 tx=0).stop 2024-04-01T06:55:39.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.620+0000 7f88dcba7700 1 -- 172.21.15.83:0/705505100 shutdown_connections 2024-04-01T06:55:39.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.620+0000 7f88dcba7700 1 --2- 172.21.15.83:0/705505100 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88d80ffc90 0x7f88d81000b0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:39.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.620+0000 7f88dcba7700 1 --2- 172.21.15.83:0/705505100 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f88d8101820 0x7f88d81080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:39.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.620+0000 7f88dcba7700 1 --2- 172.21.15.83:0/705505100 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88d8100e80 0x7f88d81012e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:39.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.620+0000 7f88dcba7700 1 -- 172.21.15.83:0/705505100 >> 172.21.15.83:0/705505100 conn(0x7f88d80fb200 msgr2=0x7f88d80fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:39.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.620+0000 7f88dcba7700 1 -- 172.21.15.83:0/705505100 shutdown_connections 2024-04-01T06:55:39.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.620+0000 7f88dcba7700 1 -- 172.21.15.83:0/705505100 wait complete. 2024-04-01T06:55:39.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.620+0000 7f88dcba7700 1 Processor -- start 2024-04-01T06:55:39.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.620+0000 7f88dcba7700 1 -- start start 2024-04-01T06:55:39.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.621+0000 7f88dcba7700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f88d80ffc90 0x7f88d8069e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:39.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.621+0000 7f88dcba7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88d8100e80 0x7f88d819ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:39.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.621+0000 7f88dcba7700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88d8101820 0x7f88d819e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:39.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.621+0000 7f88dcba7700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d819e850 con 0x7f88d8101820 2024-04-01T06:55:39.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.621+0000 7f88dcba7700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d819e9c0 con 0x7f88d80ffc90 2024-04-01T06:55:39.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.621+0000 7f88dcba7700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d819eb80 con 0x7f88d8100e80 2024-04-01T06:55:39.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.621+0000 7f88d6d9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88d8101820 0x7f88d819e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:39.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.621+0000 7f88d6d9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88d8101820 0x7f88d819e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46926/0 (socket says 172.21.15.83:46926) 2024-04-01T06:55:39.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.621+0000 7f88d6d9d700 1 -- 172.21.15.83:0/3425861851 learned_addr learned my addr 172.21.15.83:0/3425861851 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:39.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.621+0000 7f88d659c700 1 --2- 172.21.15.83:0/3425861851 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f88d80ffc90 0x7f88d8069e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:39.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.621+0000 7f88d5d9b700 1 --2- 172.21.15.83:0/3425861851 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88d8100e80 0x7f88d819ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:39.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.621+0000 7f88d6d9d700 1 -- 172.21.15.83:0/3425861851 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88d8100e80 msgr2=0x7f88d819ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:39.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.621+0000 7f88d6d9d700 1 --2- 172.21.15.83:0/3425861851 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88d8100e80 0x7f88d819ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:39.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.621+0000 7f88d6d9d700 1 -- 172.21.15.83:0/3425861851 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f88d80ffc90 msgr2=0x7f88d8069e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:39.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.621+0000 7f88d6d9d700 1 --2- 172.21.15.83:0/3425861851 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f88d80ffc90 0x7f88d8069e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:39.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.621+0000 7f88d6d9d700 1 -- 172.21.15.83:0/3425861851 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c80095f0 con 0x7f88d8101820 2024-04-01T06:55:39.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.621+0000 7f88d6d9d700 1 --2- 172.21.15.83:0/3425861851 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88d8101820 0x7f88d819e060 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f88d0007ee0 tx=0x7f88d000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:39.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.621+0000 7f88c77fe700 1 -- 172.21.15.83:0/3425861851 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d0017070 con 0x7f88d8101820 2024-04-01T06:55:39.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.621+0000 7f88dcba7700 1 -- 172.21.15.83:0/3425861851 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88d819ee00 con 0x7f88d8101820 2024-04-01T06:55:39.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.621+0000 7f88c77fe700 1 -- 172.21.15.83:0/3425861851 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f88d000f040 con 0x7f88d8101820 2024-04-01T06:55:39.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.621+0000 7f88c77fe700 1 -- 172.21.15.83:0/3425861851 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d00056e0 con 0x7f88d8101820 2024-04-01T06:55:39.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.621+0000 7f88dcba7700 1 -- 172.21.15.83:0/3425861851 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88d819f230 con 0x7f88d8101820 2024-04-01T06:55:39.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.622+0000 7f88dcba7700 1 -- 172.21.15.83:0/3425861851 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88d8107110 con 0x7f88d8101820 2024-04-01T06:55:39.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.623+0000 7f88c77fe700 1 -- 172.21.15.83:0/3425861851 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f88d000dc60 con 0x7f88d8101820 2024-04-01T06:55:39.626 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.624+0000 7f88c77fe700 1 --2- 172.21.15.83:0/3425861851 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f88c00a11b0 0x7f88c00a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:39.626 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.624+0000 7f88d659c700 1 --2- 172.21.15.83:0/3425861851 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f88c00a11b0 0x7f88c00a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:39.626 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.624+0000 7f88c77fe700 1 -- 172.21.15.83:0/3425861851 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f88d00cc8d0 con 0x7f88d8101820 2024-04-01T06:55:39.626 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.624+0000 7f88d659c700 1 --2- 172.21.15.83:0/3425861851 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f88c00a11b0 0x7f88c00a3670 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f88c8003820 tx=0x7f88c8005920 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:39.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.627+0000 7f88c77fe700 1 -- 172.21.15.83:0/3425861851 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f88d0095f20 con 0x7f88d8101820 2024-04-01T06:55:39.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:39 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/298219064' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-04-01T06:55:39.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:39 smithi083 ceph-mon[43429]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-04-01T06:55:39.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:39 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/3042802577' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T06:55:39.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:39 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/333866391' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-01T06:55:39.827 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.826+0000 7f88dcba7700 1 -- 172.21.15.83:0/3425861851 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f88d810b5b0 con 0x7f88d8101820 2024-04-01T06:55:39.827 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.827+0000 7f88c77fe700 1 -- 172.21.15.83:0/3425861851 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v81) v1 ==== 104+0+11 (secure 0 0 0) 0x7f88d0099540 con 0x7f88d8101820 2024-04-01T06:55:39.827 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 32 2024-04-01T06:55:39.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.829+0000 7f88dcba7700 1 -- 172.21.15.83:0/3425861851 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f88c00a11b0 msgr2=0x7f88c00a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:39.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.829+0000 7f88dcba7700 1 --2- 172.21.15.83:0/3425861851 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f88c00a11b0 0x7f88c00a3670 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f88c8003820 tx=0x7f88c8005920 comp rx=0 tx=0).stop 2024-04-01T06:55:39.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.829+0000 7f88dcba7700 1 -- 172.21.15.83:0/3425861851 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88d8101820 msgr2=0x7f88d819e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:39.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.829+0000 7f88dcba7700 1 --2- 172.21.15.83:0/3425861851 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88d8101820 0x7f88d819e060 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f88d0007ee0 tx=0x7f88d000d3b0 comp rx=0 tx=0).stop 2024-04-01T06:55:39.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.829+0000 7f88dcba7700 1 -- 172.21.15.83:0/3425861851 shutdown_connections 2024-04-01T06:55:39.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.829+0000 7f88dcba7700 1 --2- 172.21.15.83:0/3425861851 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f88d8101820 0x7f88d819e060 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:39.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.829+0000 7f88dcba7700 1 --2- 172.21.15.83:0/3425861851 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f88c00a11b0 0x7f88c00a3670 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:39.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.829+0000 7f88dcba7700 1 --2- 172.21.15.83:0/3425861851 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f88d80ffc90 0x7f88d8069e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:39.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.829+0000 7f88dcba7700 1 --2- 172.21.15.83:0/3425861851 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88d8100e80 0x7f88d819ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:39.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.829+0000 7f88dcba7700 1 -- 172.21.15.83:0/3425861851 >> 172.21.15.83:0/3425861851 conn(0x7f88d80fb200 msgr2=0x7f88d8104250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:39.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.829+0000 7f88dcba7700 1 -- 172.21.15.83:0/3425861851 shutdown_connections 2024-04-01T06:55:39.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.829+0000 7f88dcba7700 1 -- 172.21.15.83:0/3425861851 wait complete. 2024-04-01T06:55:39.842 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-01T06:55:39.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.966+0000 7f234cc55700 1 -- 172.21.15.83:0/1834140230 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2348101810 msgr2=0x7f2348103c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:39.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.966+0000 7f234cc55700 1 --2- 172.21.15.83:0/1834140230 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2348101810 0x7f2348103c00 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f2338009990 tx=0x7f2338009ca0 comp rx=0 tx=0).stop 2024-04-01T06:55:39.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.967+0000 7f234cc55700 1 -- 172.21.15.83:0/1834140230 shutdown_connections 2024-04-01T06:55:39.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.967+0000 7f234cc55700 1 --2- 172.21.15.83:0/1834140230 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2348101810 0x7f2348103c00 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:39.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.967+0000 7f234cc55700 1 --2- 172.21.15.83:0/1834140230 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2348106a70 0x7f2348108ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:39.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.967+0000 7f234cc55700 1 --2- 172.21.15.83:0/1834140230 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2348104140 0x7f2348106530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:39.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.967+0000 7f234cc55700 1 -- 172.21.15.83:0/1834140230 >> 172.21.15.83:0/1834140230 conn(0x7f23480fb200 msgr2=0x7f23480fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:39.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.967+0000 7f234cc55700 1 -- 172.21.15.83:0/1834140230 shutdown_connections 2024-04-01T06:55:39.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.967+0000 7f234cc55700 1 -- 172.21.15.83:0/1834140230 wait complete. 2024-04-01T06:55:39.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.967+0000 7f234cc55700 1 Processor -- start 2024-04-01T06:55:39.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.967+0000 7f234cc55700 1 -- start start 2024-04-01T06:55:39.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.967+0000 7f234cc55700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2348101810 0x7f2348196c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:39.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.968+0000 7f234cc55700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2348104140 0x7f23481971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:39.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.968+0000 7f234cc55700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2348106a70 0x7f234819e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:39.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.968+0000 7f234cc55700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f234819e770 con 0x7f2348104140 2024-04-01T06:55:39.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.968+0000 7f234cc55700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f234819e8e0 con 0x7f2348106a70 2024-04-01T06:55:39.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.968+0000 7f234cc55700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f234819eaa0 con 0x7f2348101810 2024-04-01T06:55:39.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.968+0000 7f2345d9b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2348104140 0x7f23481971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:39.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.968+0000 7f2345d9b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2348104140 0x7f23481971c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46946/0 (socket says 172.21.15.83:46946) 2024-04-01T06:55:39.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.968+0000 7f2345d9b700 1 -- 172.21.15.83:0/3509525160 learned_addr learned my addr 172.21.15.83:0/3509525160 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:39.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.968+0000 7f234659c700 1 --2- 172.21.15.83:0/3509525160 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2348101810 0x7f2348196c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:39.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.968+0000 7f2346d9d700 1 --2- 172.21.15.83:0/3509525160 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2348106a70 0x7f234819e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:39.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.968+0000 7f2345d9b700 1 -- 172.21.15.83:0/3509525160 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2348101810 msgr2=0x7f2348196c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:39.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.968+0000 7f2345d9b700 1 --2- 172.21.15.83:0/3509525160 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2348101810 0x7f2348196c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:39.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.968+0000 7f2345d9b700 1 -- 172.21.15.83:0/3509525160 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2348106a70 msgr2=0x7f234819e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:39.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.968+0000 7f2345d9b700 1 --2- 172.21.15.83:0/3509525160 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2348106a70 0x7f234819e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:39.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.968+0000 7f2345d9b700 1 -- 172.21.15.83:0/3509525160 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23380095f0 con 0x7f2348104140 2024-04-01T06:55:39.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.968+0000 7f2345d9b700 1 --2- 172.21.15.83:0/3509525160 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2348104140 0x7f23481971c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f233c00d950 tx=0x7f233c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:39.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.968+0000 7f23377fe700 1 -- 172.21.15.83:0/3509525160 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c009b40 con 0x7f2348104140 2024-04-01T06:55:39.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.968+0000 7f234cc55700 1 -- 172.21.15.83:0/3509525160 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f234819ed80 con 0x7f2348104140 2024-04-01T06:55:39.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.968+0000 7f23377fe700 1 -- 172.21.15.83:0/3509525160 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f233c009ca0 con 0x7f2348104140 2024-04-01T06:55:39.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.968+0000 7f23377fe700 1 -- 172.21.15.83:0/3509525160 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c00f620 con 0x7f2348104140 2024-04-01T06:55:39.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.968+0000 7f234cc55700 1 -- 172.21.15.83:0/3509525160 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f234819f1d0 con 0x7f2348104140 2024-04-01T06:55:39.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.969+0000 7f234cc55700 1 -- 172.21.15.83:0/3509525160 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23480fcd80 con 0x7f2348104140 2024-04-01T06:55:39.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.970+0000 7f23377fe700 1 -- 172.21.15.83:0/3509525160 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f233c010460 con 0x7f2348104140 2024-04-01T06:55:39.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.971+0000 7f23377fe700 1 --2- 172.21.15.83:0/3509525160 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f23300a11b0 0x7f23300a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:39.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.971+0000 7f23377fe700 1 -- 172.21.15.83:0/3509525160 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f233c0ccce0 con 0x7f2348104140 2024-04-01T06:55:39.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.971+0000 7f234659c700 1 --2- 172.21.15.83:0/3509525160 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f23300a11b0 0x7f23300a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:39.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.971+0000 7f234659c700 1 --2- 172.21.15.83:0/3509525160 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f23300a11b0 0x7f23300a3670 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f233800b5c0 tx=0x7f2338005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:39.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:39.974+0000 7f23377fe700 1 -- 172.21.15.83:0/3509525160 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f233c096430 con 0x7f2348104140 2024-04-01T06:55:40.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:39 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/298219064' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-04-01T06:55:40.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:39 smithi145 ceph-mon[47816]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-04-01T06:55:40.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:39 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/3042802577' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T06:55:40.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:39 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/333866391' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-01T06:55:40.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:39 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/298219064' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-04-01T06:55:40.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:39 smithi153 ceph-mon[48187]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-04-01T06:55:40.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:39 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/3042802577' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T06:55:40.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:39 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/333866391' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-01T06:55:40.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.170+0000 7f234cc55700 1 -- 172.21.15.83:0/3509525160 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f234810c680 con 0x7f2348104140 2024-04-01T06:55:40.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.170+0000 7f23377fe700 1 -- 172.21.15.83:0/3509525160 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v81) v1 ==== 100+0+11 (secure 0 0 0) 0x7f233c016020 con 0x7f2348104140 2024-04-01T06:55:40.171 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 64 2024-04-01T06:55:40.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.173+0000 7f234cc55700 1 -- 172.21.15.83:0/3509525160 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f23300a11b0 msgr2=0x7f23300a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:40.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.173+0000 7f234cc55700 1 --2- 172.21.15.83:0/3509525160 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f23300a11b0 0x7f23300a3670 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f233800b5c0 tx=0x7f2338005fb0 comp rx=0 tx=0).stop 2024-04-01T06:55:40.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.173+0000 7f234cc55700 1 -- 172.21.15.83:0/3509525160 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2348104140 msgr2=0x7f23481971c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:40.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.173+0000 7f234cc55700 1 --2- 172.21.15.83:0/3509525160 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2348104140 0x7f23481971c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f233c00d950 tx=0x7f233c00dd10 comp rx=0 tx=0).stop 2024-04-01T06:55:40.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.173+0000 7f234cc55700 1 -- 172.21.15.83:0/3509525160 shutdown_connections 2024-04-01T06:55:40.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.173+0000 7f234cc55700 1 --2- 172.21.15.83:0/3509525160 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f23300a11b0 0x7f23300a3670 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:40.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.173+0000 7f234cc55700 1 --2- 172.21.15.83:0/3509525160 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2348106a70 0x7f234819e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:40.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.173+0000 7f234cc55700 1 --2- 172.21.15.83:0/3509525160 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2348101810 0x7f2348196c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:40.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.173+0000 7f234cc55700 1 --2- 172.21.15.83:0/3509525160 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2348104140 0x7f23481971c0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:40.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.173+0000 7f234cc55700 1 -- 172.21.15.83:0/3509525160 >> 172.21.15.83:0/3509525160 conn(0x7f23480fb200 msgr2=0x7f23481020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:40.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.173+0000 7f234cc55700 1 -- 172.21.15.83:0/3509525160 shutdown_connections 2024-04-01T06:55:40.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.173+0000 7f234cc55700 1 -- 172.21.15.83:0/3509525160 wait complete. 2024-04-01T06:55:40.185 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T06:55:40.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.306+0000 7f3c271ac700 1 -- 172.21.15.83:0/3089225570 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c200ffb60 msgr2=0x7f3c200fff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:40.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.306+0000 7f3c271ac700 1 --2- 172.21.15.83:0/3089225570 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c200ffb60 0x7f3c200fff80 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f3c140099c0 tx=0x7f3c14009cd0 comp rx=0 tx=0).stop 2024-04-01T06:55:40.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.306+0000 7f3c271ac700 1 -- 172.21.15.83:0/3089225570 shutdown_connections 2024-04-01T06:55:40.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.306+0000 7f3c271ac700 1 --2- 172.21.15.83:0/3089225570 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c200ffb60 0x7f3c200fff80 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:40.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.306+0000 7f3c271ac700 1 --2- 172.21.15.83:0/3089225570 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3c201016f0 0x7f3c20107fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:40.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.306+0000 7f3c271ac700 1 --2- 172.21.15.83:0/3089225570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c20100d50 0x7f3c201011b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:40.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.306+0000 7f3c271ac700 1 -- 172.21.15.83:0/3089225570 >> 172.21.15.83:0/3089225570 conn(0x7f3c200fb0d0 msgr2=0x7f3c200fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:40.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.306+0000 7f3c271ac700 1 -- 172.21.15.83:0/3089225570 shutdown_connections 2024-04-01T06:55:40.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.306+0000 7f3c271ac700 1 -- 172.21.15.83:0/3089225570 wait complete. 2024-04-01T06:55:40.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.307+0000 7f3c271ac700 1 Processor -- start 2024-04-01T06:55:40.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.307+0000 7f3c271ac700 1 -- start start 2024-04-01T06:55:40.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.307+0000 7f3c271ac700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c200ffb60 0x7f3c20068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:40.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.307+0000 7f3c271ac700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c20100d50 0x7f3c2019b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:40.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.307+0000 7f3c271ac700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3c201016f0 0x7f3c2019dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:40.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.307+0000 7f3c271ac700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2019e7b0 con 0x7f3c20100d50 2024-04-01T06:55:40.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.307+0000 7f3c271ac700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2019e920 con 0x7f3c201016f0 2024-04-01T06:55:40.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.307+0000 7f3c271ac700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2019eae0 con 0x7f3c200ffb60 2024-04-01T06:55:40.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.307+0000 7f3c1ffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c20100d50 0x7f3c2019b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:40.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.307+0000 7f3c1ffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c20100d50 0x7f3c2019b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46966/0 (socket says 172.21.15.83:46966) 2024-04-01T06:55:40.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.307+0000 7f3c1ffff700 1 -- 172.21.15.83:0/1903033888 learned_addr learned my addr 172.21.15.83:0/1903033888 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:40.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.307+0000 7f3c25749700 1 --2- 172.21.15.83:0/1903033888 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3c201016f0 0x7f3c2019dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:40.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.307+0000 7f3c24f48700 1 --2- 172.21.15.83:0/1903033888 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c200ffb60 0x7f3c20068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:40.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.307+0000 7f3c1ffff700 1 -- 172.21.15.83:0/1903033888 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c200ffb60 msgr2=0x7f3c20068930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:40.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.307+0000 7f3c1ffff700 1 --2- 172.21.15.83:0/1903033888 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c200ffb60 0x7f3c20068930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:40.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.307+0000 7f3c1ffff700 1 -- 172.21.15.83:0/1903033888 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3c201016f0 msgr2=0x7f3c2019dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:40.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.307+0000 7f3c1ffff700 1 --2- 172.21.15.83:0/1903033888 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3c201016f0 0x7f3c2019dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:40.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.307+0000 7f3c1ffff700 1 -- 172.21.15.83:0/1903033888 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c140095f0 con 0x7f3c20100d50 2024-04-01T06:55:40.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.308+0000 7f3c25749700 1 --2- 172.21.15.83:0/1903033888 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3c201016f0 0x7f3c2019dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:55:40.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.308+0000 7f3c1ffff700 1 --2- 172.21.15.83:0/1903033888 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c20100d50 0x7f3c2019b9a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c00b530 tx=0x7f3c0c00b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:40.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.308+0000 7f3c1dffb700 1 -- 172.21.15.83:0/1903033888 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0c011830 con 0x7f3c20100d50 2024-04-01T06:55:40.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.308+0000 7f3c1dffb700 1 -- 172.21.15.83:0/1903033888 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3c0c011e50 con 0x7f3c20100d50 2024-04-01T06:55:40.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.308+0000 7f3c271ac700 1 -- 172.21.15.83:0/1903033888 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c2019ed60 con 0x7f3c20100d50 2024-04-01T06:55:40.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.308+0000 7f3c1dffb700 1 -- 172.21.15.83:0/1903033888 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0c00f2e0 con 0x7f3c20100d50 2024-04-01T06:55:40.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.308+0000 7f3c271ac700 1 -- 172.21.15.83:0/1903033888 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c2019f210 con 0x7f3c20100d50 2024-04-01T06:55:40.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.309+0000 7f3c271ac700 1 -- 172.21.15.83:0/1903033888 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c20107050 con 0x7f3c20100d50 2024-04-01T06:55:40.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.310+0000 7f3c1dffb700 1 -- 172.21.15.83:0/1903033888 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f3c0c010580 con 0x7f3c20100d50 2024-04-01T06:55:40.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.310+0000 7f3c1dffb700 1 --2- 172.21.15.83:0/1903033888 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f3c100a11b0 0x7f3c100a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:40.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.311+0000 7f3c24f48700 1 --2- 172.21.15.83:0/1903033888 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f3c100a11b0 0x7f3c100a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:40.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.311+0000 7f3c1dffb700 1 -- 172.21.15.83:0/1903033888 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f3c0c0cc350 con 0x7f3c20100d50 2024-04-01T06:55:40.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.311+0000 7f3c24f48700 1 --2- 172.21.15.83:0/1903033888 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f3c100a11b0 0x7f3c100a3670 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3c1400b580 tx=0x7f3c14005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:40.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.315+0000 7f3c1dffb700 1 -- 172.21.15.83:0/1903033888 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f3c0c095bb0 con 0x7f3c20100d50 2024-04-01T06:55:40.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.526+0000 7f3c271ac700 1 -- 172.21.15.83:0/1903033888 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c2010b3f0 con 0x7f3c20100d50 2024-04-01T06:55:40.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.527+0000 7f3c1dffb700 1 -- 172.21.15.83:0/1903033888 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+22425 (secure 0 0 0) 0x7f3c0c0b7e60 con 0x7f3c20100d50 2024-04-01T06:55:40.527 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:55:40.528 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":81,"fsid":"c6f8eff4-eff3-11ee-b647-cb9ed24678a4","created":"2024-04-01T06:48:42.033382+0000","modified":"2024-04-01T06:55:34.704509+0000","last_up_change":"2024-04-01T06:53:55.791339+0000","last_in_change":"2024-04-01T06:53:39.777214+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T06:51:21.963996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T06:54:26.450403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T06:54:27.564928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"90b761b0-b06c-4142-854d-38ee42aa6052","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6803","nonce":3253845390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6805","nonce":3253845390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6809","nonce":3253845390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6807","nonce":3253845390}]},"public_addr":"172.21.15.83:6803/3253845390","cluster_addr":"172.21.15.83:6805/3253845390","heartbeat_back_addr":"172.21.15.83:6809/3253845390","heartbeat_front_addr":"172.21.15.83:6807/3253845390","state":["exists","up"]},{"osd":1,"uuid":"4d6ab85b-7088-451e-a829-c9119f35dee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6801","nonce":515889759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6803","nonce":515889759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6807","nonce":515889759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6805","nonce":515889759}]},"public_addr":"172.21.15.145:6801/515889759","cluster_addr":"172.21.15.145:6803/515889759","heartbeat_back_addr":"172.21.15.145:6807/515889759","heartbeat_front_addr":"172.21.15.145:6805/515889759","state":["exists","up"]},{"osd":2,"uuid":"d04c27f3-4972-4061-8bfb-5060645e3883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6801","nonce":3318516728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6803","nonce":3318516728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6807","nonce":3318516728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6805","nonce":3318516728}]},"public_addr":"172.21.15.153:6801/3318516728","cluster_addr":"172.21.15.153:6803/3318516728","heartbeat_back_addr":"172.21.15.153:6807/3318516728","heartbeat_front_addr":"172.21.15.153:6805/3318516728","state":["exists","up"]},{"osd":3,"uuid":"899b6c90-8f2f-44dd-b807-49594aadb443","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6811","nonce":504690234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6813","nonce":504690234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6817","nonce":504690234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6815","nonce":504690234}]},"public_addr":"172.21.15.83:6811/504690234","cluster_addr":"172.21.15.83:6813/504690234","heartbeat_back_addr":"172.21.15.83:6817/504690234","heartbeat_front_addr":"172.21.15.83:6815/504690234","state":["exists","up"]},{"osd":4,"uuid":"5071dd81-804e-4358-bfb6-11e718e9cf4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6809","nonce":2099824730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6811","nonce":2099824730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6815","nonce":2099824730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6813","nonce":2099824730}]},"public_addr":"172.21.15.145:6809/2099824730","cluster_addr":"172.21.15.145:6811/2099824730","heartbeat_back_addr":"172.21.15.145:6815/2099824730","heartbeat_front_addr":"172.21.15.145:6813/2099824730","state":["exists","up"]},{"osd":5,"uuid":"b8442b71-c26e-467f-b0c3-ea9f636f5a00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6809","nonce":3340941443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6811","nonce":3340941443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6815","nonce":3340941443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6813","nonce":3340941443}]},"public_addr":"172.21.15.153:6809/3340941443","cluster_addr":"172.21.15.153:6811/3340941443","heartbeat_back_addr":"172.21.15.153:6815/3340941443","heartbeat_front_addr":"172.21.15.153:6813/3340941443","state":["exists","up"]},{"osd":6,"uuid":"c26bb8cb-ccee-4bfc-91eb-14e1ad8e04df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6819","nonce":2005485079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6821","nonce":2005485079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6825","nonce":2005485079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6823","nonce":2005485079}]},"public_addr":"172.21.15.83:6819/2005485079","cluster_addr":"172.21.15.83:6821/2005485079","heartbeat_back_addr":"172.21.15.83:6825/2005485079","heartbeat_front_addr":"172.21.15.83:6823/2005485079","state":["exists","up"]},{"osd":7,"uuid":"a8940da2-0e79-4606-8d1e-d425afbf5753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6817","nonce":3737505059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6819","nonce":3737505059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6823","nonce":3737505059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6821","nonce":3737505059}]},"public_addr":"172.21.15.145:6817/3737505059","cluster_addr":"172.21.15.145:6819/3737505059","heartbeat_back_addr":"172.21.15.145:6823/3737505059","heartbeat_front_addr":"172.21.15.145:6821/3737505059","state":["exists","up"]},{"osd":8,"uuid":"602d43ac-a189-4da3-9e38-7025d14e0dd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6817","nonce":1031545791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6819","nonce":1031545791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6823","nonce":1031545791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6821","nonce":1031545791}]},"public_addr":"172.21.15.153:6817/1031545791","cluster_addr":"172.21.15.153:6819/1031545791","heartbeat_back_addr":"172.21.15.153:6823/1031545791","heartbeat_front_addr":"172.21.15.153:6821/1031545791","state":["exists","up"]},{"osd":9,"uuid":"08b12d27-1247-45e4-9d09-cacc0fce4bd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6827","nonce":3720996673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6829","nonce":3720996673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6833","nonce":3720996673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6831","nonce":3720996673}]},"public_addr":"172.21.15.83:6827/3720996673","cluster_addr":"172.21.15.83:6829/3720996673","heartbeat_back_addr":"172.21.15.83:6833/3720996673","heartbeat_front_addr":"172.21.15.83:6831/3720996673","state":["exists","up"]},{"osd":10,"uuid":"dd986b50-d68f-446c-9c66-261535880879","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6825","nonce":2671529479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6827","nonce":2671529479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6831","nonce":2671529479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6829","nonce":2671529479}]},"public_addr":"172.21.15.145:6825/2671529479","cluster_addr":"172.21.15.145:6827/2671529479","heartbeat_back_addr":"172.21.15.145:6831/2671529479","heartbeat_front_addr":"172.21.15.145:6829/2671529479","state":["exists","up"]},{"osd":11,"uuid":"d20a49cd-6224-4424-8375-46da791d9931","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6825","nonce":2342548429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6827","nonce":2342548429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6831","nonce":2342548429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6829","nonce":2342548429}]},"public_addr":"172.21.15.153:6825/2342548429","cluster_addr":"172.21.15.153:6827/2342548429","heartbeat_back_addr":"172.21.15.153:6831/2342548429","heartbeat_front_addr":"172.21.15.153:6829/2342548429","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:50:44.539932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:01.990470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:19.054426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:36.616393+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:53.896705+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:10.667502+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:27.880849+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:45.276308+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:02.280615+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:19.555547+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:37.062881+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:54.191589+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.83:6801/1867137261":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/2596683931":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/2125339627":"2024-04-02T06:49:33.656125+0000","172.21.15.83:6800/1644397953":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/690500472":"2024-04-02T06:49:13.456026+0000","172.21.15.83:6801/1644397953":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/785958951":"2024-04-02T06:49:33.656125+0000","172.21.15.83:6800/1867137261":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/2222527447":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/2071592157":"2024-04-02T06:49:13.456026+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T06:55:40.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.530+0000 7f3c271ac700 1 -- 172.21.15.83:0/1903033888 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f3c100a11b0 msgr2=0x7f3c100a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:40.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.530+0000 7f3c271ac700 1 --2- 172.21.15.83:0/1903033888 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f3c100a11b0 0x7f3c100a3670 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3c1400b580 tx=0x7f3c14005fb0 comp rx=0 tx=0).stop 2024-04-01T06:55:40.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.530+0000 7f3c271ac700 1 -- 172.21.15.83:0/1903033888 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c20100d50 msgr2=0x7f3c2019b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:40.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.530+0000 7f3c271ac700 1 --2- 172.21.15.83:0/1903033888 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c20100d50 0x7f3c2019b9a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c00b530 tx=0x7f3c0c00b8f0 comp rx=0 tx=0).stop 2024-04-01T06:55:40.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.530+0000 7f3c271ac700 1 -- 172.21.15.83:0/1903033888 shutdown_connections 2024-04-01T06:55:40.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.530+0000 7f3c271ac700 1 --2- 172.21.15.83:0/1903033888 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f3c100a11b0 0x7f3c100a3670 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:40.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.530+0000 7f3c271ac700 1 --2- 172.21.15.83:0/1903033888 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3c201016f0 0x7f3c2019dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:40.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.530+0000 7f3c271ac700 1 --2- 172.21.15.83:0/1903033888 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c200ffb60 0x7f3c20068930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:40.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.530+0000 7f3c271ac700 1 --2- 172.21.15.83:0/1903033888 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3c20100d50 0x7f3c2019b9a0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:40.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.530+0000 7f3c271ac700 1 -- 172.21.15.83:0/1903033888 >> 172.21.15.83:0/1903033888 conn(0x7f3c200fb0d0 msgr2=0x7f3c20104190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:40.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.530+0000 7f3c271ac700 1 -- 172.21.15.83:0/1903033888 shutdown_connections 2024-04-01T06:55:40.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.530+0000 7f3c271ac700 1 -- 172.21.15.83:0/1903033888 wait complete. 2024-04-01T06:55:40.543 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-01T06:51:21.963996+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-01T06:54:26.450403+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-01T06:54:27.564928+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-01T06:55:40.543 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-01T06:55:40.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.669+0000 7f0b63065700 1 -- 172.21.15.83:0/1337267827 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0b5c0fedd0 msgr2=0x7f0b5c0ff230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:40.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.669+0000 7f0b63065700 1 --2- 172.21.15.83:0/1337267827 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0b5c0fedd0 0x7f0b5c0ff230 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0b480099c0 tx=0x7f0b48009cd0 comp rx=0 tx=0).stop 2024-04-01T06:55:40.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.669+0000 7f0b63065700 1 -- 172.21.15.83:0/1337267827 shutdown_connections 2024-04-01T06:55:40.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.669+0000 7f0b63065700 1 --2- 172.21.15.83:0/1337267827 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0b5c0ff770 0x7f0b5c109340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:40.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.669+0000 7f0b63065700 1 --2- 172.21.15.83:0/1337267827 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b5c102360 0x7f0b5c102780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:40.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.669+0000 7f0b63065700 1 --2- 172.21.15.83:0/1337267827 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0b5c0fedd0 0x7f0b5c0ff230 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:40.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.669+0000 7f0b63065700 1 -- 172.21.15.83:0/1337267827 >> 172.21.15.83:0/1337267827 conn(0x7f0b5c0fa990 msgr2=0x7f0b5c0fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:40.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.669+0000 7f0b63065700 1 -- 172.21.15.83:0/1337267827 shutdown_connections 2024-04-01T06:55:40.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.669+0000 7f0b63065700 1 -- 172.21.15.83:0/1337267827 wait complete. 2024-04-01T06:55:40.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.670+0000 7f0b63065700 1 Processor -- start 2024-04-01T06:55:40.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.670+0000 7f0b63065700 1 -- start start 2024-04-01T06:55:40.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.670+0000 7f0b63065700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0b5c0fedd0 0x7f0b5c101a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:40.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.670+0000 7f0b63065700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0b5c0ff770 0x7f0b5c1000a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:40.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.670+0000 7f0b63065700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b5c102360 0x7f0b5c1005e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:40.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.670+0000 7f0b63065700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c100d80 con 0x7f0b5c0ff770 2024-04-01T06:55:40.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.670+0000 7f0b63065700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c100ef0 con 0x7f0b5c0fedd0 2024-04-01T06:55:40.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.670+0000 7f0b63065700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c1a0d10 con 0x7f0b5c102360 2024-04-01T06:55:40.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.670+0000 7f0b5bfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0b5c0ff770 0x7f0b5c1000a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:40.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.670+0000 7f0b5bfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0b5c0ff770 0x7f0b5c1000a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46988/0 (socket says 172.21.15.83:46988) 2024-04-01T06:55:40.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.670+0000 7f0b5bfff700 1 -- 172.21.15.83:0/2873757046 learned_addr learned my addr 172.21.15.83:0/2873757046 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:40.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.670+0000 7f0b60e01700 1 --2- 172.21.15.83:0/2873757046 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0b5c0fedd0 0x7f0b5c101a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:40.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.671+0000 7f0b5bfff700 1 -- 172.21.15.83:0/2873757046 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b5c102360 msgr2=0x7f0b5c1005e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:40.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.671+0000 7f0b61602700 1 --2- 172.21.15.83:0/2873757046 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b5c102360 0x7f0b5c1005e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:40.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.671+0000 7f0b5bfff700 1 --2- 172.21.15.83:0/2873757046 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b5c102360 0x7f0b5c1005e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:40.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.671+0000 7f0b5bfff700 1 -- 172.21.15.83:0/2873757046 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0b5c0fedd0 msgr2=0x7f0b5c101a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:40.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.671+0000 7f0b5bfff700 1 --2- 172.21.15.83:0/2873757046 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0b5c0fedd0 0x7f0b5c101a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:40.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.671+0000 7f0b5bfff700 1 -- 172.21.15.83:0/2873757046 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b480095f0 con 0x7f0b5c0ff770 2024-04-01T06:55:40.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.671+0000 7f0b61602700 1 --2- 172.21.15.83:0/2873757046 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b5c102360 0x7f0b5c1005e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:55:40.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.671+0000 7f0b5bfff700 1 --2- 172.21.15.83:0/2873757046 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0b5c0ff770 0x7f0b5c1000a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0b480036f0 tx=0x7f0b480047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:40.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.671+0000 7f0b59ffb700 1 -- 172.21.15.83:0/2873757046 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4801d070 con 0x7f0b5c0ff770 2024-04-01T06:55:40.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.671+0000 7f0b59ffb700 1 -- 172.21.15.83:0/2873757046 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0b48004090 con 0x7f0b5c0ff770 2024-04-01T06:55:40.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.671+0000 7f0b63065700 1 -- 172.21.15.83:0/2873757046 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b5c1a0f40 con 0x7f0b5c0ff770 2024-04-01T06:55:40.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.671+0000 7f0b59ffb700 1 -- 172.21.15.83:0/2873757046 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b48022d40 con 0x7f0b5c0ff770 2024-04-01T06:55:40.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.671+0000 7f0b63065700 1 -- 172.21.15.83:0/2873757046 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b5c1a1300 con 0x7f0b5c0ff770 2024-04-01T06:55:40.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.672+0000 7f0b63065700 1 -- 172.21.15.83:0/2873757046 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b5c1083a0 con 0x7f0b5c0ff770 2024-04-01T06:55:40.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.673+0000 7f0b59ffb700 1 -- 172.21.15.83:0/2873757046 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f0b48022470 con 0x7f0b5c0ff770 2024-04-01T06:55:40.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.674+0000 7f0b59ffb700 1 --2- 172.21.15.83:0/2873757046 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f0b4c0a11b0 0x7f0b4c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:40.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.674+0000 7f0b60e01700 1 --2- 172.21.15.83:0/2873757046 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f0b4c0a11b0 0x7f0b4c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:40.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.674+0000 7f0b59ffb700 1 -- 172.21.15.83:0/2873757046 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f0b480cdf20 con 0x7f0b5c0ff770 2024-04-01T06:55:40.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.674+0000 7f0b60e01700 1 --2- 172.21.15.83:0/2873757046 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f0b4c0a11b0 0x7f0b4c0a3670 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c068ff0 tx=0x7f0b5000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:40.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.677+0000 7f0b59ffb700 1 -- 172.21.15.83:0/2873757046 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f0b48097600 con 0x7f0b5c0ff770 2024-04-01T06:55:40.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.878+0000 7f0b63065700 1 -- 172.21.15.83:0/2873757046 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0b5c10c690 con 0x7f0b5c0ff770 2024-04-01T06:55:40.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.879+0000 7f0b59ffb700 1 -- 172.21.15.83:0/2873757046 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0b4809ac20 con 0x7f0b5c0ff770 2024-04-01T06:55:40.879 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 1 2024-04-01T06:55:40.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.881+0000 7f0b63065700 1 -- 172.21.15.83:0/2873757046 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f0b4c0a11b0 msgr2=0x7f0b4c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:40.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.881+0000 7f0b63065700 1 --2- 172.21.15.83:0/2873757046 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f0b4c0a11b0 0x7f0b4c0a3670 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c068ff0 tx=0x7f0b5000b410 comp rx=0 tx=0).stop 2024-04-01T06:55:40.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.881+0000 7f0b63065700 1 -- 172.21.15.83:0/2873757046 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0b5c0ff770 msgr2=0x7f0b5c1000a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:40.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.881+0000 7f0b63065700 1 --2- 172.21.15.83:0/2873757046 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0b5c0ff770 0x7f0b5c1000a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0b480036f0 tx=0x7f0b480047b0 comp rx=0 tx=0).stop 2024-04-01T06:55:40.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.881+0000 7f0b63065700 1 -- 172.21.15.83:0/2873757046 shutdown_connections 2024-04-01T06:55:40.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.881+0000 7f0b63065700 1 --2- 172.21.15.83:0/2873757046 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f0b4c0a11b0 0x7f0b4c0a3670 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:40.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.881+0000 7f0b63065700 1 --2- 172.21.15.83:0/2873757046 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b5c102360 0x7f0b5c1005e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:40.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.881+0000 7f0b63065700 1 --2- 172.21.15.83:0/2873757046 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0b5c0fedd0 0x7f0b5c101a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:40.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.881+0000 7f0b63065700 1 --2- 172.21.15.83:0/2873757046 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0b5c0ff770 0x7f0b5c1000a0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:40.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.881+0000 7f0b63065700 1 -- 172.21.15.83:0/2873757046 >> 172.21.15.83:0/2873757046 conn(0x7f0b5c0fa990 msgr2=0x7f0b5c1054e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:40.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.881+0000 7f0b63065700 1 -- 172.21.15.83:0/2873757046 shutdown_connections 2024-04-01T06:55:40.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:40.881+0000 7f0b63065700 1 -- 172.21.15.83:0/2873757046 wait complete. 2024-04-01T06:55:40.892 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:40 smithi083 ceph-mon[43429]: pgmap v254: 97 pgs: 97 active+clean; 641 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 383 B/s wr, 7 op/s; 0 B/s, 0 objects/s recovering 2024-04-01T06:55:40.892 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:40 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/3425861851' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-01T06:55:40.892 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:40 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/3509525160' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-01T06:55:40.892 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:40 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/1903033888' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T06:55:40.893 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-01T06:55:41.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:40 smithi145 ceph-mon[47816]: pgmap v254: 97 pgs: 97 active+clean; 641 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 383 B/s wr, 7 op/s; 0 B/s, 0 objects/s recovering 2024-04-01T06:55:41.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:40 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/3425861851' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-01T06:55:41.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:40 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/3509525160' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-01T06:55:41.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:40 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/1903033888' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T06:55:41.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.019+0000 7fa75658a700 1 -- 172.21.15.83:0/3720006307 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa750102910 msgr2=0x7fa7501091c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:41.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.019+0000 7fa75658a700 1 --2- 172.21.15.83:0/3720006307 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa750102910 0x7fa7501091c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fa74800b0d0 tx=0x7fa74800b3e0 comp rx=0 tx=0).stop 2024-04-01T06:55:41.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.019+0000 7fa75658a700 1 -- 172.21.15.83:0/3720006307 shutdown_connections 2024-04-01T06:55:41.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.019+0000 7fa75658a700 1 --2- 172.21.15.83:0/3720006307 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa750102910 0x7fa7501091c0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:41.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.019+0000 7fa75658a700 1 --2- 172.21.15.83:0/3720006307 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa750100d80 0x7fa7501011a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:41.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.019+0000 7fa75658a700 1 --2- 172.21.15.83:0/3720006307 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa750101f70 0x7fa7501023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:41.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.019+0000 7fa75658a700 1 -- 172.21.15.83:0/3720006307 >> 172.21.15.83:0/3720006307 conn(0x7fa7500fc2f0 msgr2=0x7fa7500fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:41.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.019+0000 7fa75658a700 1 -- 172.21.15.83:0/3720006307 shutdown_connections 2024-04-01T06:55:41.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.019+0000 7fa75658a700 1 -- 172.21.15.83:0/3720006307 wait complete. 2024-04-01T06:55:41.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.020+0000 7fa75658a700 1 Processor -- start 2024-04-01T06:55:41.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.020+0000 7fa75658a700 1 -- start start 2024-04-01T06:55:41.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.020+0000 7fa75658a700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa750100d80 0x7fa750074b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:41.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.020+0000 7fa75658a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa750101f70 0x7fa7500731a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:41.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.020+0000 7fa75658a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa750102910 0x7fa7500736e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:41.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.020+0000 7fa75658a700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa750073e80 con 0x7fa750101f70 2024-04-01T06:55:41.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.020+0000 7fa75658a700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa750073ff0 con 0x7fa750100d80 2024-04-01T06:55:41.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.020+0000 7fa75658a700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7501a0e10 con 0x7fa750102910 2024-04-01T06:55:41.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.020+0000 7fa74f7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa750101f70 0x7fa7500731a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:41.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.020+0000 7fa74f7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa750101f70 0x7fa7500731a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:47008/0 (socket says 172.21.15.83:47008) 2024-04-01T06:55:41.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.021+0000 7fa74f7fe700 1 -- 172.21.15.83:0/3938937825 learned_addr learned my addr 172.21.15.83:0/3938937825 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:41.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.021+0000 7fa754b27700 1 --2- 172.21.15.83:0/3938937825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa750102910 0x7fa7500736e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:41.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.021+0000 7fa74ffff700 1 --2- 172.21.15.83:0/3938937825 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa750100d80 0x7fa750074b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:41.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.021+0000 7fa74f7fe700 1 -- 172.21.15.83:0/3938937825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa750102910 msgr2=0x7fa7500736e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:41.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.021+0000 7fa74f7fe700 1 --2- 172.21.15.83:0/3938937825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa750102910 0x7fa7500736e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:41.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.021+0000 7fa74f7fe700 1 -- 172.21.15.83:0/3938937825 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa750100d80 msgr2=0x7fa750074b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:41.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.021+0000 7fa74f7fe700 1 --2- 172.21.15.83:0/3938937825 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa750100d80 0x7fa750074b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:41.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.021+0000 7fa74f7fe700 1 -- 172.21.15.83:0/3938937825 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa748009d00 con 0x7fa750101f70 2024-04-01T06:55:41.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.021+0000 7fa74f7fe700 1 --2- 172.21.15.83:0/3938937825 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa750101f70 0x7fa7500731a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fa74400d950 tx=0x7fa74400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:41.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.021+0000 7fa74d7fa700 1 -- 172.21.15.83:0/3938937825 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74400f890 con 0x7fa750101f70 2024-04-01T06:55:41.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.021+0000 7fa74d7fa700 1 -- 172.21.15.83:0/3938937825 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa744010460 con 0x7fa750101f70 2024-04-01T06:55:41.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.021+0000 7fa75658a700 1 -- 172.21.15.83:0/3938937825 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7501a10a0 con 0x7fa750101f70 2024-04-01T06:55:41.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.021+0000 7fa74d7fa700 1 -- 172.21.15.83:0/3938937825 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7440195c0 con 0x7fa750101f70 2024-04-01T06:55:41.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.021+0000 7fa75658a700 1 -- 172.21.15.83:0/3938937825 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7501a15b0 con 0x7fa750101f70 2024-04-01T06:55:41.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.022+0000 7fa75658a700 1 -- 172.21.15.83:0/3938937825 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa750108130 con 0x7fa750101f70 2024-04-01T06:55:41.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.023+0000 7fa74d7fa700 1 -- 172.21.15.83:0/3938937825 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7fa7440108d0 con 0x7fa750101f70 2024-04-01T06:55:41.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.024+0000 7fa74d7fa700 1 --2- 172.21.15.83:0/3938937825 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fa7380a11b0 0x7fa7380a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:41.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.024+0000 7fa74ffff700 1 --2- 172.21.15.83:0/3938937825 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fa7380a11b0 0x7fa7380a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:41.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.024+0000 7fa74d7fa700 1 -- 172.21.15.83:0/3938937825 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fa7440cc6f0 con 0x7fa750101f70 2024-04-01T06:55:41.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.024+0000 7fa74ffff700 1 --2- 172.21.15.83:0/3938937825 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fa7380a11b0 0x7fa7380a3670 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa750101dd0 tx=0x7fa740009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:41.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.028+0000 7fa74d7fa700 1 -- 172.21.15.83:0/3938937825 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7fa744095e40 con 0x7fa750101f70 2024-04-01T06:55:41.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:40 smithi153 ceph-mon[48187]: pgmap v254: 97 pgs: 97 active+clean; 641 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 383 B/s wr, 7 op/s; 0 B/s, 0 objects/s recovering 2024-04-01T06:55:41.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:40 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/3425861851' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-01T06:55:41.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:40 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/3509525160' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-01T06:55:41.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:40 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/1903033888' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T06:55:41.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.223+0000 7fa75658a700 1 -- 172.21.15.83:0/3938937825 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa75010c5a0 con 0x7fa750101f70 2024-04-01T06:55:41.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.223+0000 7fa74d7fa700 1 -- 172.21.15.83:0/3938937825 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v81) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa744099460 con 0x7fa750101f70 2024-04-01T06:55:41.223 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 32 2024-04-01T06:55:41.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.226+0000 7fa75658a700 1 -- 172.21.15.83:0/3938937825 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fa7380a11b0 msgr2=0x7fa7380a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:41.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.226+0000 7fa75658a700 1 --2- 172.21.15.83:0/3938937825 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fa7380a11b0 0x7fa7380a3670 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa750101dd0 tx=0x7fa740009260 comp rx=0 tx=0).stop 2024-04-01T06:55:41.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.226+0000 7fa75658a700 1 -- 172.21.15.83:0/3938937825 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa750101f70 msgr2=0x7fa7500731a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:41.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.226+0000 7fa75658a700 1 --2- 172.21.15.83:0/3938937825 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa750101f70 0x7fa7500731a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fa74400d950 tx=0x7fa74400dc60 comp rx=0 tx=0).stop 2024-04-01T06:55:41.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.226+0000 7fa75658a700 1 -- 172.21.15.83:0/3938937825 shutdown_connections 2024-04-01T06:55:41.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.226+0000 7fa75658a700 1 --2- 172.21.15.83:0/3938937825 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fa7380a11b0 0x7fa7380a3670 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:41.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.226+0000 7fa75658a700 1 --2- 172.21.15.83:0/3938937825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa750102910 0x7fa7500736e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:41.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.226+0000 7fa75658a700 1 --2- 172.21.15.83:0/3938937825 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa750100d80 0x7fa750074b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:41.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.226+0000 7fa75658a700 1 --2- 172.21.15.83:0/3938937825 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa750101f70 0x7fa7500731a0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:41.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.226+0000 7fa75658a700 1 -- 172.21.15.83:0/3938937825 >> 172.21.15.83:0/3938937825 conn(0x7fa7500fc2f0 msgr2=0x7fa750105270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:41.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.226+0000 7fa75658a700 1 -- 172.21.15.83:0/3938937825 shutdown_connections 2024-04-01T06:55:41.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.226+0000 7fa75658a700 1 -- 172.21.15.83:0/3938937825 wait complete. 2024-04-01T06:55:41.238 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-01T06:55:41.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.363+0000 7f6771c31700 1 -- 172.21.15.83:0/2222691297 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f676c101230 msgr2=0x7f676c101650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:41.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.363+0000 7f6771c31700 1 --2- 172.21.15.83:0/2222691297 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f676c101230 0x7f676c101650 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f6754009990 tx=0x7f6754009ca0 comp rx=0 tx=0).stop 2024-04-01T06:55:41.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.363+0000 7f6771c31700 1 -- 172.21.15.83:0/2222691297 shutdown_connections 2024-04-01T06:55:41.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.363+0000 7f6771c31700 1 --2- 172.21.15.83:0/2222691297 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f676c101230 0x7f676c101650 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:41.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.363+0000 7f6771c31700 1 --2- 172.21.15.83:0/2222691297 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f676c100840 0x7f676c1080e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:41.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.363+0000 7f6771c31700 1 --2- 172.21.15.83:0/2222691297 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f676c0ffe80 0x7f676c100300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:41.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.363+0000 7f6771c31700 1 -- 172.21.15.83:0/2222691297 >> 172.21.15.83:0/2222691297 conn(0x7f676c0fa950 msgr2=0x7f676c0fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:41.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.363+0000 7f6771c31700 1 -- 172.21.15.83:0/2222691297 shutdown_connections 2024-04-01T06:55:41.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.363+0000 7f6771c31700 1 -- 172.21.15.83:0/2222691297 wait complete. 2024-04-01T06:55:41.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.364+0000 7f6771c31700 1 Processor -- start 2024-04-01T06:55:41.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.364+0000 7f6771c31700 1 -- start start 2024-04-01T06:55:41.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.364+0000 7f6771c31700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f676c0ffe80 0x7f676c0ff8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:41.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.364+0000 7f6771c31700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f676c100840 0x7f676c19ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:41.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.364+0000 7f6771c31700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f676c101230 0x7f676c19e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:41.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.364+0000 7f6771c31700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f676c19e830 con 0x7f676c0ffe80 2024-04-01T06:55:41.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.364+0000 7f6771c31700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f676c19e9a0 con 0x7f676c101230 2024-04-01T06:55:41.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.364+0000 7f6771c31700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f676c19eb60 con 0x7f676c100840 2024-04-01T06:55:41.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.364+0000 7f676b7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f676c0ffe80 0x7f676c0ff8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:41.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.364+0000 7f676b7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f676c0ffe80 0x7f676c0ff8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:47028/0 (socket says 172.21.15.83:47028) 2024-04-01T06:55:41.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.364+0000 7f676b7fe700 1 -- 172.21.15.83:0/2739548026 learned_addr learned my addr 172.21.15.83:0/2739548026 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:41.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.365+0000 7f676bfff700 1 --2- 172.21.15.83:0/2739548026 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f676c101230 0x7f676c19e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:41.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.365+0000 7f676affd700 1 --2- 172.21.15.83:0/2739548026 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f676c100840 0x7f676c19ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:41.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.365+0000 7f676b7fe700 1 -- 172.21.15.83:0/2739548026 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f676c100840 msgr2=0x7f676c19ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:41.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.365+0000 7f676b7fe700 1 --2- 172.21.15.83:0/2739548026 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f676c100840 0x7f676c19ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:41.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.365+0000 7f676b7fe700 1 -- 172.21.15.83:0/2739548026 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f676c101230 msgr2=0x7f676c19e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:41.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.365+0000 7f676b7fe700 1 --2- 172.21.15.83:0/2739548026 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f676c101230 0x7f676c19e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:41.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.365+0000 7f676b7fe700 1 -- 172.21.15.83:0/2739548026 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67540095f0 con 0x7f676c0ffe80 2024-04-01T06:55:41.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.365+0000 7f676bfff700 1 --2- 172.21.15.83:0/2739548026 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f676c101230 0x7f676c19e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:55:41.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.365+0000 7f676b7fe700 1 --2- 172.21.15.83:0/2739548026 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f676c0ffe80 0x7f676c0ff8b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f6754004730 tx=0x7f6754004760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:41.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.365+0000 7f6768ff9700 1 -- 172.21.15.83:0/2739548026 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675401d070 con 0x7f676c0ffe80 2024-04-01T06:55:41.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.365+0000 7f6771c31700 1 -- 172.21.15.83:0/2739548026 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f676c19ed80 con 0x7f676c0ffe80 2024-04-01T06:55:41.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.365+0000 7f6768ff9700 1 -- 172.21.15.83:0/2739548026 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6754022470 con 0x7f676c0ffe80 2024-04-01T06:55:41.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.365+0000 7f6768ff9700 1 -- 172.21.15.83:0/2739548026 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6754004230 con 0x7f676c0ffe80 2024-04-01T06:55:41.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.365+0000 7f6771c31700 1 -- 172.21.15.83:0/2739548026 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f676c19f1b0 con 0x7f676c0ffe80 2024-04-01T06:55:41.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.366+0000 7f6771c31700 1 -- 172.21.15.83:0/2739548026 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f676c107050 con 0x7f676c0ffe80 2024-04-01T06:55:41.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.367+0000 7f6768ff9700 1 -- 172.21.15.83:0/2739548026 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f67540225e0 con 0x7f676c0ffe80 2024-04-01T06:55:41.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.367+0000 7f6768ff9700 1 --2- 172.21.15.83:0/2739548026 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f67580a11b0 0x7f67580a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:41.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.368+0000 7f676affd700 1 --2- 172.21.15.83:0/2739548026 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f67580a11b0 0x7f67580a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:41.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.368+0000 7f6768ff9700 1 -- 172.21.15.83:0/2739548026 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f67540ce440 con 0x7f676c0ffe80 2024-04-01T06:55:41.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.368+0000 7f676affd700 1 --2- 172.21.15.83:0/2739548026 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f67580a11b0 0x7f67580a3670 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f676c0ffe50 tx=0x7f675c005d50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:41.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.371+0000 7f6768ff9700 1 -- 172.21.15.83:0/2739548026 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f6754097b20 con 0x7f676c0ffe80 2024-04-01T06:55:41.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.568+0000 7f6771c31700 1 -- 172.21.15.83:0/2739548026 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f676c10b510 con 0x7f676c0ffe80 2024-04-01T06:55:41.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.569+0000 7f6768ff9700 1 -- 172.21.15.83:0/2739548026 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v81) v1 ==== 100+0+11 (secure 0 0 0) 0x7f675409b140 con 0x7f676c0ffe80 2024-04-01T06:55:41.569 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 64 2024-04-01T06:55:41.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.571+0000 7f6771c31700 1 -- 172.21.15.83:0/2739548026 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f67580a11b0 msgr2=0x7f67580a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:41.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.571+0000 7f6771c31700 1 --2- 172.21.15.83:0/2739548026 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f67580a11b0 0x7f67580a3670 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f676c0ffe50 tx=0x7f675c005d50 comp rx=0 tx=0).stop 2024-04-01T06:55:41.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.571+0000 7f6771c31700 1 -- 172.21.15.83:0/2739548026 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f676c0ffe80 msgr2=0x7f676c0ff8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:41.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.571+0000 7f6771c31700 1 --2- 172.21.15.83:0/2739548026 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f676c0ffe80 0x7f676c0ff8b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f6754004730 tx=0x7f6754004760 comp rx=0 tx=0).stop 2024-04-01T06:55:41.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.571+0000 7f6771c31700 1 -- 172.21.15.83:0/2739548026 shutdown_connections 2024-04-01T06:55:41.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.571+0000 7f6771c31700 1 --2- 172.21.15.83:0/2739548026 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f676c0ffe80 0x7f676c0ff8b0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:41.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.571+0000 7f6771c31700 1 --2- 172.21.15.83:0/2739548026 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f67580a11b0 0x7f67580a3670 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:41.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.571+0000 7f6771c31700 1 --2- 172.21.15.83:0/2739548026 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f676c101230 0x7f676c19e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:41.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.571+0000 7f6771c31700 1 --2- 172.21.15.83:0/2739548026 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f676c100840 0x7f676c19ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:41.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.571+0000 7f6771c31700 1 -- 172.21.15.83:0/2739548026 >> 172.21.15.83:0/2739548026 conn(0x7f676c0fa950 msgr2=0x7f676c104190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:41.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.571+0000 7f6771c31700 1 -- 172.21.15.83:0/2739548026 shutdown_connections 2024-04-01T06:55:41.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.571+0000 7f6771c31700 1 -- 172.21.15.83:0/2739548026 wait complete. 2024-04-01T06:55:41.583 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-04-01T06:55:41.583 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T06:55:41.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.707+0000 7ffb6ac0e700 1 -- 172.21.15.83:0/1014370005 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb64100d50 msgr2=0x7ffb641011b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:41.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.707+0000 7ffb6ac0e700 1 --2- 172.21.15.83:0/1014370005 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb64100d50 0x7ffb641011b0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ffb500099c0 tx=0x7ffb50009cd0 comp rx=0 tx=0).stop 2024-04-01T06:55:41.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.707+0000 7ffb6ac0e700 1 -- 172.21.15.83:0/1014370005 shutdown_connections 2024-04-01T06:55:41.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.707+0000 7ffb6ac0e700 1 --2- 172.21.15.83:0/1014370005 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb641016f0 0x7ffb64107fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:41.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.707+0000 7ffb6ac0e700 1 --2- 172.21.15.83:0/1014370005 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffb640ffb60 0x7ffb640fff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:41.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.707+0000 7ffb6ac0e700 1 --2- 172.21.15.83:0/1014370005 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb64100d50 0x7ffb641011b0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:41.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.707+0000 7ffb6ac0e700 1 -- 172.21.15.83:0/1014370005 >> 172.21.15.83:0/1014370005 conn(0x7ffb640fb0d0 msgr2=0x7ffb640fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:41.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.707+0000 7ffb6ac0e700 1 -- 172.21.15.83:0/1014370005 shutdown_connections 2024-04-01T06:55:41.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.707+0000 7ffb6ac0e700 1 -- 172.21.15.83:0/1014370005 wait complete. 2024-04-01T06:55:41.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.707+0000 7ffb6ac0e700 1 Processor -- start 2024-04-01T06:55:41.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.707+0000 7ffb6ac0e700 1 -- start start 2024-04-01T06:55:41.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.708+0000 7ffb6ac0e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb640ffb60 0x7ffb64198d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:41.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.708+0000 7ffb6ac0e700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffb64100d50 0x7ffb641992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:41.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.708+0000 7ffb6ac0e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb641016f0 0x7ffb641a0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:41.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.708+0000 7ffb6ac0e700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb641a0860 con 0x7ffb640ffb60 2024-04-01T06:55:41.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.708+0000 7ffb6ac0e700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb641a09d0 con 0x7ffb64100d50 2024-04-01T06:55:41.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.708+0000 7ffb6ac0e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb641a0b90 con 0x7ffb641016f0 2024-04-01T06:55:41.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.708+0000 7ffb689aa700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb640ffb60 0x7ffb64198d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:41.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.708+0000 7ffb689aa700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb640ffb60 0x7ffb64198d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:47046/0 (socket says 172.21.15.83:47046) 2024-04-01T06:55:41.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.708+0000 7ffb689aa700 1 -- 172.21.15.83:0/4073667491 learned_addr learned my addr 172.21.15.83:0/4073667491 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:41.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.708+0000 7ffb691ab700 1 --2- 172.21.15.83:0/4073667491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb641016f0 0x7ffb641a0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:41.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.708+0000 7ffb63fff700 1 --2- 172.21.15.83:0/4073667491 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffb64100d50 0x7ffb641992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:41.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.708+0000 7ffb689aa700 1 -- 172.21.15.83:0/4073667491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb641016f0 msgr2=0x7ffb641a0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:41.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.708+0000 7ffb689aa700 1 --2- 172.21.15.83:0/4073667491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb641016f0 0x7ffb641a0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:41.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.708+0000 7ffb689aa700 1 -- 172.21.15.83:0/4073667491 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffb64100d50 msgr2=0x7ffb641992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:41.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.708+0000 7ffb689aa700 1 --2- 172.21.15.83:0/4073667491 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffb64100d50 0x7ffb641992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:41.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.708+0000 7ffb689aa700 1 -- 172.21.15.83:0/4073667491 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb500095f0 con 0x7ffb640ffb60 2024-04-01T06:55:41.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.708+0000 7ffb63fff700 1 --2- 172.21.15.83:0/4073667491 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffb64100d50 0x7ffb641992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:55:41.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.708+0000 7ffb689aa700 1 --2- 172.21.15.83:0/4073667491 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb640ffb60 0x7ffb64198d70 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ffb5800c990 tx=0x7ffb5800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:41.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.708+0000 7ffb61ffb700 1 -- 172.21.15.83:0/4073667491 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb58007b00 con 0x7ffb640ffb60 2024-04-01T06:55:41.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.708+0000 7ffb61ffb700 1 -- 172.21.15.83:0/4073667491 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffb58007c60 con 0x7ffb640ffb60 2024-04-01T06:55:41.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.708+0000 7ffb6ac0e700 1 -- 172.21.15.83:0/4073667491 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb641a0e70 con 0x7ffb640ffb60 2024-04-01T06:55:41.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.708+0000 7ffb61ffb700 1 -- 172.21.15.83:0/4073667491 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb58018660 con 0x7ffb640ffb60 2024-04-01T06:55:41.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.709+0000 7ffb6ac0e700 1 -- 172.21.15.83:0/4073667491 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb641a12a0 con 0x7ffb640ffb60 2024-04-01T06:55:41.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.710+0000 7ffb6ac0e700 1 -- 172.21.15.83:0/4073667491 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb64067a10 con 0x7ffb640ffb60 2024-04-01T06:55:41.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.710+0000 7ffb61ffb700 1 -- 172.21.15.83:0/4073667491 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7ffb5800f450 con 0x7ffb640ffb60 2024-04-01T06:55:41.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.711+0000 7ffb61ffb700 1 --2- 172.21.15.83:0/4073667491 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7ffb540a1230 0x7ffb540a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:41.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.711+0000 7ffb61ffb700 1 -- 172.21.15.83:0/4073667491 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8124+0+0 (secure 0 0 0) 0x7ffb580cc810 con 0x7ffb640ffb60 2024-04-01T06:55:41.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.711+0000 7ffb63fff700 1 --2- 172.21.15.83:0/4073667491 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7ffb540a1230 0x7ffb540a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:41.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.711+0000 7ffb63fff700 1 --2- 172.21.15.83:0/4073667491 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7ffb540a1230 0x7ffb540a36f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ffb50000c00 tx=0x7ffb50005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:41.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.715+0000 7ffb61ffb700 1 -- 172.21.15.83:0/4073667491 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7ffb58095f60 con 0x7ffb640ffb60 2024-04-01T06:55:41.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.960+0000 7ffb6ac0e700 1 -- 172.21.15.83:0/4073667491 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffb6410b370 con 0x7ffb640ffb60 2024-04-01T06:55:41.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.961+0000 7ffb61ffb700 1 -- 172.21.15.83:0/4073667491 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+10876 (secure 0 0 0) 0x7ffb58099580 con 0x7ffb640ffb60 2024-04-01T06:55:41.961 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:55:41.961 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1271130478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1271130478},{"type":"v1","addr":"172.21.15.83:6835","nonce":1271130478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2412682983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2412682983},{"type":"v1","addr":"172.21.15.83:6837","nonce":2412682983}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6839/3348145990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":3348145990},{"type":"v1","addr":"172.21.15.83:6839","nonce":3348145990}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6841/1191267445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6840","nonce":1191267445},{"type":"v1","addr":"172.21.15.83:6841","nonce":1191267445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2467459028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2467459028},{"type":"v1","addr":"172.21.15.153:6833","nonce":2467459028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24448,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4092629042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":4092629042},{"type":"v1","addr":"172.21.15.153:6835","nonce":4092629042}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-01T06:54:28.397062+0000","modified":"2024-04-01T06:55:38.703948+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24524,"mds_1":24494,"mds_2":24473},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6833/647005844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":647005844},{"type":"v1","addr":"172.21.15.145:6833","nonce":647005844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24454":{"gid":24454,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6837/1993816527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1993816527},{"type":"v1","addr":"172.21.15.153:6837","nonce":1993816527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6839/1399754640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1399754640},{"type":"v1","addr":"172.21.15.153:6839","nonce":1399754640}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24473":{"gid":24473,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.145:6835/3104241497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":3104241497},{"type":"v1","addr":"172.21.15.145:6835","nonce":3104241497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24494":{"gid":24494,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.145:6837/2687798317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2687798317},{"type":"v1","addr":"172.21.15.145:6837","nonce":2687798317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6839/3886435411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3886435411},{"type":"v1","addr":"172.21.15.145:6839","nonce":3886435411}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-01T06:55:41.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.963+0000 7ffb6ac0e700 1 -- 172.21.15.83:0/4073667491 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7ffb540a1230 msgr2=0x7ffb540a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:41.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.963+0000 7ffb6ac0e700 1 --2- 172.21.15.83:0/4073667491 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7ffb540a1230 0x7ffb540a36f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ffb50000c00 tx=0x7ffb50005fd0 comp rx=0 tx=0).stop 2024-04-01T06:55:41.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.963+0000 7ffb6ac0e700 1 -- 172.21.15.83:0/4073667491 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb640ffb60 msgr2=0x7ffb64198d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:41.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.963+0000 7ffb6ac0e700 1 --2- 172.21.15.83:0/4073667491 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb640ffb60 0x7ffb64198d70 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ffb5800c990 tx=0x7ffb5800cca0 comp rx=0 tx=0).stop 2024-04-01T06:55:41.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.963+0000 7ffb6ac0e700 1 -- 172.21.15.83:0/4073667491 shutdown_connections 2024-04-01T06:55:41.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.963+0000 7ffb6ac0e700 1 --2- 172.21.15.83:0/4073667491 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb640ffb60 0x7ffb64198d70 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:41.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.963+0000 7ffb6ac0e700 1 --2- 172.21.15.83:0/4073667491 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7ffb540a1230 0x7ffb540a36f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:41.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.963+0000 7ffb6ac0e700 1 --2- 172.21.15.83:0/4073667491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb641016f0 0x7ffb641a0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:41.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.963+0000 7ffb6ac0e700 1 --2- 172.21.15.83:0/4073667491 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ffb64100d50 0x7ffb641992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:41.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.963+0000 7ffb6ac0e700 1 -- 172.21.15.83:0/4073667491 >> 172.21.15.83:0/4073667491 conn(0x7ffb640fb0d0 msgr2=0x7ffb640fcb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:41.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.963+0000 7ffb6ac0e700 1 -- 172.21.15.83:0/4073667491 shutdown_connections 2024-04-01T06:55:41.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:41.963+0000 7ffb6ac0e700 1 -- 172.21.15.83:0/4073667491 wait complete. 2024-04-01T06:55:41.964 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 24 2024-04-01T06:55:41.974 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:41 smithi083 ceph-mon[43429]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-04-01T06:55:41.975 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:41 smithi083 ceph-mon[43429]: Cluster is now healthy 2024-04-01T06:55:41.975 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:41 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/2873757046' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-01T06:55:41.975 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:41 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/3938937825' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-01T06:55:41.975 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:41 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/2739548026' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-01T06:55:41.976 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-04-01T06:55:41.976 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-04-01T06:55:41.976 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-01T06:55:42.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:41 smithi145 ceph-mon[47816]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-04-01T06:55:42.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:41 smithi145 ceph-mon[47816]: Cluster is now healthy 2024-04-01T06:55:42.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:41 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/2873757046' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-01T06:55:42.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:41 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/3938937825' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-01T06:55:42.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:41 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/2739548026' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-01T06:55:42.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.099+0000 7f02d4e65700 1 -- 172.21.15.83:0/4001964554 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f02d0104010 msgr2=0x7f02d0106400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:42.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.099+0000 7f02d4e65700 1 --2- 172.21.15.83:0/4001964554 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f02d0104010 0x7f02d0106400 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f02c4009990 tx=0x7f02c4009ca0 comp rx=0 tx=0).stop 2024-04-01T06:55:42.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.099+0000 7f02d4e65700 1 -- 172.21.15.83:0/4001964554 shutdown_connections 2024-04-01T06:55:42.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.099+0000 7f02d4e65700 1 --2- 172.21.15.83:0/4001964554 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f02d0106940 0x7f02d0108db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:42.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.099+0000 7f02d4e65700 1 --2- 172.21.15.83:0/4001964554 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02d01016e0 0x7f02d0103ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:42.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.099+0000 7f02d4e65700 1 --2- 172.21.15.83:0/4001964554 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f02d0104010 0x7f02d0106400 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:42.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.099+0000 7f02d4e65700 1 -- 172.21.15.83:0/4001964554 >> 172.21.15.83:0/4001964554 conn(0x7f02d00fb0d0 msgr2=0x7f02d00fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:42.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.099+0000 7f02d4e65700 1 -- 172.21.15.83:0/4001964554 shutdown_connections 2024-04-01T06:55:42.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.099+0000 7f02d4e65700 1 -- 172.21.15.83:0/4001964554 wait complete. 2024-04-01T06:55:42.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.099+0000 7f02d4e65700 1 Processor -- start 2024-04-01T06:55:42.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.099+0000 7f02d4e65700 1 -- start start 2024-04-01T06:55:42.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.100+0000 7f02d4e65700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02d01016e0 0x7f02d0196b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:42.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.100+0000 7f02d4e65700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f02d0104010 0x7f02d01970d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:42.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.100+0000 7f02d4e65700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f02d0106940 0x7f02d019e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:42.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.100+0000 7f02d4e65700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d019e6c0 con 0x7f02d0104010 2024-04-01T06:55:42.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.100+0000 7f02d4e65700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d019e800 con 0x7f02d0106940 2024-04-01T06:55:42.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.100+0000 7f02d4e65700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d019e990 con 0x7f02d01016e0 2024-04-01T06:55:42.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.100+0000 7f02cdd9b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f02d0104010 0x7f02d01970d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:42.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.100+0000 7f02cdd9b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f02d0104010 0x7f02d01970d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:47076/0 (socket says 172.21.15.83:47076) 2024-04-01T06:55:42.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.100+0000 7f02cdd9b700 1 -- 172.21.15.83:0/2513737443 learned_addr learned my addr 172.21.15.83:0/2513737443 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:42.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.100+0000 7f02ce59c700 1 --2- 172.21.15.83:0/2513737443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02d01016e0 0x7f02d0196b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:42.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.100+0000 7f02ced9d700 1 --2- 172.21.15.83:0/2513737443 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f02d0106940 0x7f02d019e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:42.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.100+0000 7f02cdd9b700 1 -- 172.21.15.83:0/2513737443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02d01016e0 msgr2=0x7f02d0196b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:42.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.100+0000 7f02cdd9b700 1 --2- 172.21.15.83:0/2513737443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02d01016e0 0x7f02d0196b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:42.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.100+0000 7f02cdd9b700 1 -- 172.21.15.83:0/2513737443 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f02d0106940 msgr2=0x7f02d019e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:42.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.100+0000 7f02cdd9b700 1 --2- 172.21.15.83:0/2513737443 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f02d0106940 0x7f02d019e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:42.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.100+0000 7f02cdd9b700 1 -- 172.21.15.83:0/2513737443 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c40095f0 con 0x7f02d0104010 2024-04-01T06:55:42.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.100+0000 7f02cdd9b700 1 --2- 172.21.15.83:0/2513737443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f02d0104010 0x7f02d01970d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f02c40095c0 tx=0x7f02c400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:42.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.100+0000 7f02bf7fe700 1 -- 172.21.15.83:0/2513737443 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c401d070 con 0x7f02d0104010 2024-04-01T06:55:42.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.100+0000 7f02bf7fe700 1 -- 172.21.15.83:0/2513737443 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f02c4005030 con 0x7f02d0104010 2024-04-01T06:55:42.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.100+0000 7f02bf7fe700 1 -- 172.21.15.83:0/2513737443 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c4004a50 con 0x7f02d0104010 2024-04-01T06:55:42.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.100+0000 7f02d4e65700 1 -- 172.21.15.83:0/2513737443 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02d019ec10 con 0x7f02d0104010 2024-04-01T06:55:42.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.101+0000 7f02d4e65700 1 -- 172.21.15.83:0/2513737443 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02d019efe0 con 0x7f02d0104010 2024-04-01T06:55:42.104 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.101+0000 7f02d4e65700 1 -- 172.21.15.83:0/2513737443 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02d00fcc50 con 0x7f02d0104010 2024-04-01T06:55:42.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.103+0000 7f02bf7fe700 1 -- 172.21.15.83:0/2513737443 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f02c4005450 con 0x7f02d0104010 2024-04-01T06:55:42.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.104+0000 7f02bf7fe700 1 --2- 172.21.15.83:0/2513737443 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f02b80a11b0 0x7f02b80a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:42.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.104+0000 7f02ce59c700 1 --2- 172.21.15.83:0/2513737443 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f02b80a11b0 0x7f02b80a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:42.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.104+0000 7f02bf7fe700 1 -- 172.21.15.83:0/2513737443 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f02c40cdc50 con 0x7f02d0104010 2024-04-01T06:55:42.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.104+0000 7f02ce59c700 1 --2- 172.21.15.83:0/2513737443 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f02b80a11b0 0x7f02b80a3670 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f02c0005950 tx=0x7f02c000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:42.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.107+0000 7f02bf7fe700 1 -- 172.21.15.83:0/2513737443 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f02c4097330 con 0x7f02d0104010 2024-04-01T06:55:42.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:41 smithi153 ceph-mon[48187]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-04-01T06:55:42.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:41 smithi153 ceph-mon[48187]: Cluster is now healthy 2024-04-01T06:55:42.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:41 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/2873757046' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-01T06:55:42.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:41 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/3938937825' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-01T06:55:42.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:41 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/2739548026' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-01T06:55:42.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.300+0000 7f02d4e65700 1 -- 172.21.15.83:0/2513737443 --> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f02d002cdc0 con 0x7f02b80a11b0 2024-04-01T06:55:42.310 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.311+0000 7f02bf7fe700 1 -- 172.21.15.83:0/2513737443 <== mgr.14152 v2:172.21.15.83:6800/3375372052 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344736 (secure 0 0 0) 0x7f02d002cdc0 con 0x7f02b80a11b0 2024-04-01T06:55:42.315 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:55:42.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.314+0000 7f02d4e65700 1 -- 172.21.15.83:0/2513737443 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f02b80a11b0 msgr2=0x7f02b80a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:42.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.314+0000 7f02d4e65700 1 --2- 172.21.15.83:0/2513737443 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f02b80a11b0 0x7f02b80a3670 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f02c0005950 tx=0x7f02c000b410 comp rx=0 tx=0).stop 2024-04-01T06:55:42.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.314+0000 7f02d4e65700 1 -- 172.21.15.83:0/2513737443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f02d0104010 msgr2=0x7f02d01970d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:42.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.314+0000 7f02d4e65700 1 --2- 172.21.15.83:0/2513737443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f02d0104010 0x7f02d01970d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f02c40095c0 tx=0x7f02c400f690 comp rx=0 tx=0).stop 2024-04-01T06:55:42.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.314+0000 7f02d4e65700 1 -- 172.21.15.83:0/2513737443 shutdown_connections 2024-04-01T06:55:42.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.314+0000 7f02d4e65700 1 --2- 172.21.15.83:0/2513737443 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f02b80a11b0 0x7f02b80a3670 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:42.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.314+0000 7f02d4e65700 1 --2- 172.21.15.83:0/2513737443 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f02d0106940 0x7f02d019e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:42.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.314+0000 7f02d4e65700 1 --2- 172.21.15.83:0/2513737443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02d01016e0 0x7f02d0196b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:42.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.314+0000 7f02d4e65700 1 --2- 172.21.15.83:0/2513737443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f02d0104010 0x7f02d01970d0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:42.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.314+0000 7f02d4e65700 1 -- 172.21.15.83:0/2513737443 >> 172.21.15.83:0/2513737443 conn(0x7f02d00fb0d0 msgr2=0x7f02d0102040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:42.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.314+0000 7f02d4e65700 1 -- 172.21.15.83:0/2513737443 shutdown_connections 2024-04-01T06:55:42.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.314+0000 7f02d4e65700 1 -- 172.21.15.83:0/2513737443 wait complete. 2024-04-01T06:55:42.319 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-04-01T06:55:42.326 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":255,"stamp":"2024-04-01T06:55:41.730451+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656530,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":559,"num_read_kb":400,"num_write":338,"num_write_kb":3051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":292,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":363716,"kb_used_data":10780,"kb_used_omap":18,"kb_used_meta":352749,"kb_avail":1124578108,"statfs":{"total":1151940427776,"available":1151567982592,"internally_reserved":0,"allocated":11038720,"data_stored":7070544,"data_compressed":112716,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":19130,"internal_metadata":361215302},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":628,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":22,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.025599"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716372+0000","last_change":"2024-04-01T06:54:28.426588+0000","last_active":"2024-04-01T06:55:33.716372+0000","last_peered":"2024-04-01T06:55:33.716372+0000","last_clean":"2024-04-01T06:55:33.716372+0000","last_became_active":"2024-04-01T06:54:28.423723+0000","last_became_peered":"2024-04-01T06:54:28.423723+0000","last_unstale":"2024-04-01T06:55:33.716372+0000","last_undegraded":"2024-04-01T06:55:33.716372+0000","last_fullsized":"2024-04-01T06:55:33.716372+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:52:38.856474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716446+0000","last_change":"2024-04-01T06:54:28.419858+0000","last_active":"2024-04-01T06:55:33.716446+0000","last_peered":"2024-04-01T06:55:33.716446+0000","last_clean":"2024-04-01T06:55:33.716446+0000","last_became_active":"2024-04-01T06:54:28.419534+0000","last_became_peered":"2024-04-01T06:54:28.419534+0000","last_unstale":"2024-04-01T06:55:33.716446+0000","last_undegraded":"2024-04-01T06:55:33.716446+0000","last_fullsized":"2024-04-01T06:55:33.716446+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:26:56.349672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716134+0000","last_change":"2024-04-01T06:54:28.422763+0000","last_active":"2024-04-01T06:55:33.716134+0000","last_peered":"2024-04-01T06:55:33.716134+0000","last_clean":"2024-04-01T06:55:33.716134+0000","last_became_active":"2024-04-01T06:54:28.422439+0000","last_became_peered":"2024-04-01T06:54:28.422439+0000","last_unstale":"2024-04-01T06:55:33.716134+0000","last_undegraded":"2024-04-01T06:55:33.716134+0000","last_fullsized":"2024-04-01T06:55:33.716134+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:55:24.379428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.714265+0000","last_change":"2024-04-01T06:54:28.421996+0000","last_active":"2024-04-01T06:55:33.714265+0000","last_peered":"2024-04-01T06:55:33.714265+0000","last_clean":"2024-04-01T06:55:33.714265+0000","last_became_active":"2024-04-01T06:54:28.421594+0000","last_became_peered":"2024-04-01T06:54:28.421594+0000","last_unstale":"2024-04-01T06:55:33.714265+0000","last_undegraded":"2024-04-01T06:55:33.714265+0000","last_fullsized":"2024-04-01T06:55:33.714265+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:36:53.200615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.714110+0000","last_change":"2024-04-01T06:54:28.415652+0000","last_active":"2024-04-01T06:55:33.714110+0000","last_peered":"2024-04-01T06:55:33.714110+0000","last_clean":"2024-04-01T06:55:33.714110+0000","last_became_active":"2024-04-01T06:54:28.415296+0000","last_became_peered":"2024-04-01T06:54:28.415296+0000","last_unstale":"2024-04-01T06:55:33.714110+0000","last_undegraded":"2024-04-01T06:55:33.714110+0000","last_fullsized":"2024-04-01T06:55:33.714110+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:36:36.967298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.708136+0000","last_change":"2024-04-01T06:54:28.421188+0000","last_active":"2024-04-01T06:55:33.708136+0000","last_peered":"2024-04-01T06:55:33.708136+0000","last_clean":"2024-04-01T06:55:33.708136+0000","last_became_active":"2024-04-01T06:54:28.420863+0000","last_became_peered":"2024-04-01T06:54:28.420863+0000","last_unstale":"2024-04-01T06:55:33.708136+0000","last_undegraded":"2024-04-01T06:55:33.708136+0000","last_fullsized":"2024-04-01T06:55:33.708136+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:40:38.641128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:34.126221+0000","last_change":"2024-04-01T06:54:28.422554+0000","last_active":"2024-04-01T06:55:34.126221+0000","last_peered":"2024-04-01T06:55:34.126221+0000","last_clean":"2024-04-01T06:55:34.126221+0000","last_became_active":"2024-04-01T06:54:28.422209+0000","last_became_peered":"2024-04-01T06:54:28.422209+0000","last_unstale":"2024-04-01T06:55:34.126221+0000","last_undegraded":"2024-04-01T06:55:34.126221+0000","last_fullsized":"2024-04-01T06:55:34.126221+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T14:59:45.017681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.708816+0000","last_change":"2024-04-01T06:54:28.419291+0000","last_active":"2024-04-01T06:55:33.708816+0000","last_peered":"2024-04-01T06:55:33.708816+0000","last_clean":"2024-04-01T06:55:33.708816+0000","last_became_active":"2024-04-01T06:54:28.419013+0000","last_became_peered":"2024-04-01T06:54:28.419013+0000","last_unstale":"2024-04-01T06:55:33.708816+0000","last_undegraded":"2024-04-01T06:55:33.708816+0000","last_fullsized":"2024-04-01T06:55:33.708816+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:45:08.226568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716052+0000","last_change":"2024-04-01T06:54:28.410264+0000","last_active":"2024-04-01T06:55:33.716052+0000","last_peered":"2024-04-01T06:55:33.716052+0000","last_clean":"2024-04-01T06:55:33.716052+0000","last_became_active":"2024-04-01T06:54:28.409959+0000","last_became_peered":"2024-04-01T06:54:28.409959+0000","last_unstale":"2024-04-01T06:55:33.716052+0000","last_undegraded":"2024-04-01T06:55:33.716052+0000","last_fullsized":"2024-04-01T06:55:33.716052+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:14:13.184396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.708298+0000","last_change":"2024-04-01T06:54:28.422115+0000","last_active":"2024-04-01T06:55:33.708298+0000","last_peered":"2024-04-01T06:55:33.708298+0000","last_clean":"2024-04-01T06:55:33.708298+0000","last_became_active":"2024-04-01T06:54:28.421629+0000","last_became_peered":"2024-04-01T06:54:28.421629+0000","last_unstale":"2024-04-01T06:55:33.708298+0000","last_undegraded":"2024-04-01T06:55:33.708298+0000","last_fullsized":"2024-04-01T06:55:33.708298+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:47:03.271557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:34.126524+0000","last_change":"2024-04-01T06:54:28.429652+0000","last_active":"2024-04-01T06:55:34.126524+0000","last_peered":"2024-04-01T06:55:34.126524+0000","last_clean":"2024-04-01T06:55:34.126524+0000","last_became_active":"2024-04-01T06:54:28.429298+0000","last_became_peered":"2024-04-01T06:54:28.429298+0000","last_unstale":"2024-04-01T06:55:34.126524+0000","last_undegraded":"2024-04-01T06:55:34.126524+0000","last_fullsized":"2024-04-01T06:55:34.126524+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:03:16.110580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-01T06:55:34.715630+0000","last_change":"2024-04-01T06:55:34.715262+0000","last_active":"2024-04-01T06:55:34.715630+0000","last_peered":"2024-04-01T06:55:34.715630+0000","last_clean":"2024-04-01T06:55:34.715630+0000","last_became_active":"2024-04-01T06:55:34.714990+0000","last_became_peered":"2024-04-01T06:55:34.714990+0000","last_unstale":"2024-04-01T06:55:34.715630+0000","last_undegraded":"2024-04-01T06:55:34.715630+0000","last_fullsized":"2024-04-01T06:55:34.715630+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:26:24.665741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716196+0000","last_change":"2024-04-01T06:54:28.419390+0000","last_active":"2024-04-01T06:55:33.716196+0000","last_peered":"2024-04-01T06:55:33.716196+0000","last_clean":"2024-04-01T06:55:33.716196+0000","last_became_active":"2024-04-01T06:54:28.419110+0000","last_became_peered":"2024-04-01T06:54:28.419110+0000","last_unstale":"2024-04-01T06:55:33.716196+0000","last_undegraded":"2024-04-01T06:55:33.716196+0000","last_fullsized":"2024-04-01T06:55:33.716196+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:21:52.192681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716042+0000","last_change":"2024-04-01T06:54:28.419416+0000","last_active":"2024-04-01T06:55:33.716042+0000","last_peered":"2024-04-01T06:55:33.716042+0000","last_clean":"2024-04-01T06:55:33.716042+0000","last_became_active":"2024-04-01T06:54:28.419099+0000","last_became_peered":"2024-04-01T06:54:28.419099+0000","last_unstale":"2024-04-01T06:55:33.716042+0000","last_undegraded":"2024-04-01T06:55:33.716042+0000","last_fullsized":"2024-04-01T06:55:33.716042+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:26:44.889806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716363+0000","last_change":"2024-04-01T06:54:28.427391+0000","last_active":"2024-04-01T06:55:33.716363+0000","last_peered":"2024-04-01T06:55:33.716363+0000","last_clean":"2024-04-01T06:55:33.716363+0000","last_became_active":"2024-04-01T06:54:28.427153+0000","last_became_peered":"2024-04-01T06:54:28.427153+0000","last_unstale":"2024-04-01T06:55:33.716363+0000","last_undegraded":"2024-04-01T06:55:33.716363+0000","last_fullsized":"2024-04-01T06:55:33.716363+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:42:41.084729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.715722+0000","last_change":"2024-04-01T06:54:28.417088+0000","last_active":"2024-04-01T06:55:33.715722+0000","last_peered":"2024-04-01T06:55:33.715722+0000","last_clean":"2024-04-01T06:55:33.715722+0000","last_became_active":"2024-04-01T06:54:28.416747+0000","last_became_peered":"2024-04-01T06:54:28.416747+0000","last_unstale":"2024-04-01T06:55:33.715722+0000","last_undegraded":"2024-04-01T06:55:33.715722+0000","last_fullsized":"2024-04-01T06:55:33.715722+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:59:14.069761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716603+0000","last_change":"2024-04-01T06:54:28.426049+0000","last_active":"2024-04-01T06:55:33.716603+0000","last_peered":"2024-04-01T06:55:33.716603+0000","last_clean":"2024-04-01T06:55:33.716603+0000","last_became_active":"2024-04-01T06:54:28.425723+0000","last_became_peered":"2024-04-01T06:54:28.425723+0000","last_unstale":"2024-04-01T06:55:33.716603+0000","last_undegraded":"2024-04-01T06:55:33.716603+0000","last_fullsized":"2024-04-01T06:55:33.716603+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:48:59.394352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.712623+0000","last_change":"2024-04-01T06:54:28.421574+0000","last_active":"2024-04-01T06:55:33.712623+0000","last_peered":"2024-04-01T06:55:33.712623+0000","last_clean":"2024-04-01T06:55:33.712623+0000","last_became_active":"2024-04-01T06:54:28.420852+0000","last_became_peered":"2024-04-01T06:54:28.420852+0000","last_unstale":"2024-04-01T06:55:33.712623+0000","last_undegraded":"2024-04-01T06:55:33.712623+0000","last_fullsized":"2024-04-01T06:55:33.712623+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:20:30.373285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.715566+0000","last_change":"2024-04-01T06:54:28.419249+0000","last_active":"2024-04-01T06:55:33.715566+0000","last_peered":"2024-04-01T06:55:33.715566+0000","last_clean":"2024-04-01T06:55:33.715566+0000","last_became_active":"2024-04-01T06:54:28.418931+0000","last_became_peered":"2024-04-01T06:54:28.418931+0000","last_unstale":"2024-04-01T06:55:33.715566+0000","last_undegraded":"2024-04-01T06:55:33.715566+0000","last_fullsized":"2024-04-01T06:55:33.715566+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:38:04.786657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"79'9","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.712433+0000","last_change":"2024-04-01T06:54:27.993489+0000","last_active":"2024-04-01T06:55:33.712433+0000","last_peered":"2024-04-01T06:55:33.712433+0000","last_clean":"2024-04-01T06:55:33.712433+0000","last_became_active":"2024-04-01T06:54:27.993201+0000","last_became_peered":"2024-04-01T06:54:27.993201+0000","last_unstale":"2024-04-01T06:55:33.712433+0000","last_undegraded":"2024-04-01T06:55:33.712433+0000","last_fullsized":"2024-04-01T06:55:33.712433+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:10:53.897013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.709212+0000","last_change":"2024-04-01T06:54:28.417750+0000","last_active":"2024-04-01T06:55:33.709212+0000","last_peered":"2024-04-01T06:55:33.709212+0000","last_clean":"2024-04-01T06:55:33.709212+0000","last_became_active":"2024-04-01T06:54:28.417470+0000","last_became_peered":"2024-04-01T06:54:28.417470+0000","last_unstale":"2024-04-01T06:55:33.709212+0000","last_undegraded":"2024-04-01T06:55:33.709212+0000","last_fullsized":"2024-04-01T06:55:33.709212+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:06:12.668846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"79'2","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.709258+0000","last_change":"2024-04-01T06:54:27.998302+0000","last_active":"2024-04-01T06:55:33.709258+0000","last_peered":"2024-04-01T06:55:33.709258+0000","last_clean":"2024-04-01T06:55:33.709258+0000","last_became_active":"2024-04-01T06:54:27.997951+0000","last_became_peered":"2024-04-01T06:54:27.997951+0000","last_unstale":"2024-04-01T06:55:33.709258+0000","last_undegraded":"2024-04-01T06:55:33.709258+0000","last_fullsized":"2024-04-01T06:55:33.709258+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:28:45.076734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716591+0000","last_change":"2024-04-01T06:54:28.415641+0000","last_active":"2024-04-01T06:55:33.716591+0000","last_peered":"2024-04-01T06:55:33.716591+0000","last_clean":"2024-04-01T06:55:33.716591+0000","last_became_active":"2024-04-01T06:54:28.415305+0000","last_became_peered":"2024-04-01T06:54:28.415305+0000","last_unstale":"2024-04-01T06:55:33.716591+0000","last_undegraded":"2024-04-01T06:55:33.716591+0000","last_fullsized":"2024-04-01T06:55:33.716591+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:01:46.528332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"79'4","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.714604+0000","last_change":"2024-04-01T06:54:27.990581+0000","last_active":"2024-04-01T06:55:33.714604+0000","last_peered":"2024-04-01T06:55:33.714604+0000","last_clean":"2024-04-01T06:55:33.714604+0000","last_became_active":"2024-04-01T06:54:27.990099+0000","last_became_peered":"2024-04-01T06:54:27.990099+0000","last_unstale":"2024-04-01T06:55:33.714604+0000","last_undegraded":"2024-04-01T06:55:33.714604+0000","last_fullsized":"2024-04-01T06:55:33.714604+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T14:53:49.183394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.715962+0000","last_change":"2024-04-01T06:54:28.423208+0000","last_active":"2024-04-01T06:55:33.715962+0000","last_peered":"2024-04-01T06:55:33.715962+0000","last_clean":"2024-04-01T06:55:33.715962+0000","last_became_active":"2024-04-01T06:54:28.422648+0000","last_became_peered":"2024-04-01T06:54:28.422648+0000","last_unstale":"2024-04-01T06:55:33.715962+0000","last_undegraded":"2024-04-01T06:55:33.715962+0000","last_fullsized":"2024-04-01T06:55:33.715962+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:02:58.380288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-01T06:55:34.718704+0000","last_change":"2024-04-01T06:55:34.718293+0000","last_active":"2024-04-01T06:55:34.718704+0000","last_peered":"2024-04-01T06:55:34.718704+0000","last_clean":"2024-04-01T06:55:34.718704+0000","last_became_active":"2024-04-01T06:55:34.715149+0000","last_became_peered":"2024-04-01T06:55:34.715149+0000","last_unstale":"2024-04-01T06:55:34.718704+0000","last_undegraded":"2024-04-01T06:55:34.718704+0000","last_fullsized":"2024-04-01T06:55:34.718704+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:03:55.371430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.711859+0000","last_change":"2024-04-01T06:54:28.422448+0000","last_active":"2024-04-01T06:55:33.711859+0000","last_peered":"2024-04-01T06:55:33.711859+0000","last_clean":"2024-04-01T06:55:33.711859+0000","last_became_active":"2024-04-01T06:54:28.422080+0000","last_became_peered":"2024-04-01T06:54:28.422080+0000","last_unstale":"2024-04-01T06:55:33.711859+0000","last_undegraded":"2024-04-01T06:55:33.711859+0000","last_fullsized":"2024-04-01T06:55:33.711859+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:03:23.686194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"79'6","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-01T06:55:35.804863+0000","last_change":"2024-04-01T06:54:27.998822+0000","last_active":"2024-04-01T06:55:35.804863+0000","last_peered":"2024-04-01T06:55:35.804863+0000","last_clean":"2024-04-01T06:55:35.804863+0000","last_became_active":"2024-04-01T06:54:27.998514+0000","last_became_peered":"2024-04-01T06:54:27.998514+0000","last_unstale":"2024-04-01T06:55:35.804863+0000","last_undegraded":"2024-04-01T06:55:35.804863+0000","last_fullsized":"2024-04-01T06:55:35.804863+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T14:21:28.340169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.714245+0000","last_change":"2024-04-01T06:54:28.415825+0000","last_active":"2024-04-01T06:55:33.714245+0000","last_peered":"2024-04-01T06:55:33.714245+0000","last_clean":"2024-04-01T06:55:33.714245+0000","last_became_active":"2024-04-01T06:54:28.413679+0000","last_became_peered":"2024-04-01T06:54:28.413679+0000","last_unstale":"2024-04-01T06:55:33.714245+0000","last_undegraded":"2024-04-01T06:55:33.714245+0000","last_fullsized":"2024-04-01T06:55:33.714245+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:13:19.907109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"79'3","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.707943+0000","last_change":"2024-04-01T06:54:27.994194+0000","last_active":"2024-04-01T06:55:33.707943+0000","last_peered":"2024-04-01T06:55:33.707943+0000","last_clean":"2024-04-01T06:55:33.707943+0000","last_became_active":"2024-04-01T06:54:27.993868+0000","last_became_peered":"2024-04-01T06:54:27.993868+0000","last_unstale":"2024-04-01T06:55:33.707943+0000","last_undegraded":"2024-04-01T06:55:33.707943+0000","last_fullsized":"2024-04-01T06:55:33.707943+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:55:17.003472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.711732+0000","last_change":"2024-04-01T06:54:28.412629+0000","last_active":"2024-04-01T06:55:33.711732+0000","last_peered":"2024-04-01T06:55:33.711732+0000","last_clean":"2024-04-01T06:55:33.711732+0000","last_became_active":"2024-04-01T06:54:28.412291+0000","last_became_peered":"2024-04-01T06:54:28.412291+0000","last_unstale":"2024-04-01T06:55:33.711732+0000","last_undegraded":"2024-04-01T06:55:33.711732+0000","last_fullsized":"2024-04-01T06:55:33.711732+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:29:14.007470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"79'2","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716127+0000","last_change":"2024-04-01T06:54:27.996570+0000","last_active":"2024-04-01T06:55:33.716127+0000","last_peered":"2024-04-01T06:55:33.716127+0000","last_clean":"2024-04-01T06:55:33.716127+0000","last_became_active":"2024-04-01T06:54:27.994897+0000","last_became_peered":"2024-04-01T06:54:27.994897+0000","last_unstale":"2024-04-01T06:55:33.716127+0000","last_undegraded":"2024-04-01T06:55:33.716127+0000","last_fullsized":"2024-04-01T06:55:33.716127+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:53:05.733608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.708757+0000","last_change":"2024-04-01T06:54:28.413701+0000","last_active":"2024-04-01T06:55:33.708757+0000","last_peered":"2024-04-01T06:55:33.708757+0000","last_clean":"2024-04-01T06:55:33.708757+0000","last_became_active":"2024-04-01T06:54:28.413435+0000","last_became_peered":"2024-04-01T06:54:28.413435+0000","last_unstale":"2024-04-01T06:55:33.708757+0000","last_undegraded":"2024-04-01T06:55:33.708757+0000","last_fullsized":"2024-04-01T06:55:33.708757+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:43:27.835398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.711515+0000","last_change":"2024-04-01T06:54:28.001115+0000","last_active":"2024-04-01T06:55:33.711515+0000","last_peered":"2024-04-01T06:55:33.711515+0000","last_clean":"2024-04-01T06:55:33.711515+0000","last_became_active":"2024-04-01T06:54:28.000732+0000","last_became_peered":"2024-04-01T06:54:28.000732+0000","last_unstale":"2024-04-01T06:55:33.711515+0000","last_undegraded":"2024-04-01T06:55:33.711515+0000","last_fullsized":"2024-04-01T06:55:33.711515+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:06:02.064402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.712248+0000","last_change":"2024-04-01T06:54:28.421670+0000","last_active":"2024-04-01T06:55:33.712248+0000","last_peered":"2024-04-01T06:55:33.712248+0000","last_clean":"2024-04-01T06:55:33.712248+0000","last_became_active":"2024-04-01T06:54:28.421335+0000","last_became_peered":"2024-04-01T06:54:28.421335+0000","last_unstale":"2024-04-01T06:55:33.712248+0000","last_undegraded":"2024-04-01T06:55:33.712248+0000","last_fullsized":"2024-04-01T06:55:33.712248+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:25:55.223397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"79'3","reported_seq":82,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-01T06:55:36.805774+0000","last_change":"2024-04-01T06:54:27.999413+0000","last_active":"2024-04-01T06:55:36.805774+0000","last_peered":"2024-04-01T06:55:36.805774+0000","last_clean":"2024-04-01T06:55:36.805774+0000","last_became_active":"2024-04-01T06:54:27.999123+0000","last_became_peered":"2024-04-01T06:54:27.999123+0000","last_unstale":"2024-04-01T06:55:36.805774+0000","last_undegraded":"2024-04-01T06:55:36.805774+0000","last_fullsized":"2024-04-01T06:55:36.805774+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:30:06.399907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":65,"num_read_kb":65,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716818+0000","last_change":"2024-04-01T06:54:28.423843+0000","last_active":"2024-04-01T06:55:33.716818+0000","last_peered":"2024-04-01T06:55:33.716818+0000","last_clean":"2024-04-01T06:55:33.716818+0000","last_became_active":"2024-04-01T06:54:28.423538+0000","last_became_peered":"2024-04-01T06:54:28.423538+0000","last_unstale":"2024-04-01T06:55:33.716818+0000","last_undegraded":"2024-04-01T06:55:33.716818+0000","last_fullsized":"2024-04-01T06:55:33.716818+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:51:23.986409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'2","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:34.126438+0000","last_change":"2024-04-01T06:54:27.997137+0000","last_active":"2024-04-01T06:55:34.126438+0000","last_peered":"2024-04-01T06:55:34.126438+0000","last_clean":"2024-04-01T06:55:34.126438+0000","last_became_active":"2024-04-01T06:54:27.996386+0000","last_became_peered":"2024-04-01T06:54:27.996386+0000","last_unstale":"2024-04-01T06:55:34.126438+0000","last_undegraded":"2024-04-01T06:55:34.126438+0000","last_fullsized":"2024-04-01T06:55:34.126438+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:29:57.365756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716556+0000","last_change":"2024-04-01T06:54:28.426837+0000","last_active":"2024-04-01T06:55:33.716556+0000","last_peered":"2024-04-01T06:55:33.716556+0000","last_clean":"2024-04-01T06:55:33.716556+0000","last_became_active":"2024-04-01T06:54:28.426551+0000","last_became_peered":"2024-04-01T06:54:28.426551+0000","last_unstale":"2024-04-01T06:55:33.716556+0000","last_undegraded":"2024-04-01T06:55:33.716556+0000","last_fullsized":"2024-04-01T06:55:33.716556+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:05:50.264912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'4","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.711871+0000","last_change":"2024-04-01T06:54:27.999968+0000","last_active":"2024-04-01T06:55:33.711871+0000","last_peered":"2024-04-01T06:55:33.711871+0000","last_clean":"2024-04-01T06:55:33.711871+0000","last_became_active":"2024-04-01T06:54:27.999415+0000","last_became_peered":"2024-04-01T06:54:27.999415+0000","last_unstale":"2024-04-01T06:55:33.711871+0000","last_undegraded":"2024-04-01T06:55:33.711871+0000","last_fullsized":"2024-04-01T06:55:33.711871+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:31:57.472227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716056+0000","last_change":"2024-04-01T06:54:28.421174+0000","last_active":"2024-04-01T06:55:33.716056+0000","last_peered":"2024-04-01T06:55:33.716056+0000","last_clean":"2024-04-01T06:55:33.716056+0000","last_became_active":"2024-04-01T06:54:28.420841+0000","last_became_peered":"2024-04-01T06:54:28.420841+0000","last_unstale":"2024-04-01T06:55:33.716056+0000","last_undegraded":"2024-04-01T06:55:33.716056+0000","last_fullsized":"2024-04-01T06:55:33.716056+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:05:25.377496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'30","reported_seq":183,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-01T06:55:37.817447+0000","last_change":"2024-04-01T06:54:27.995496+0000","last_active":"2024-04-01T06:55:37.817447+0000","last_peered":"2024-04-01T06:55:37.817447+0000","last_clean":"2024-04-01T06:55:37.817447+0000","last_became_active":"2024-04-01T06:54:27.995131+0000","last_became_peered":"2024-04-01T06:54:27.995131+0000","last_unstale":"2024-04-01T06:55:37.817447+0000","last_undegraded":"2024-04-01T06:55:37.817447+0000","last_fullsized":"2024-04-01T06:55:37.817447+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:36:12.129235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61314,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":129,"num_write":31,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.714386+0000","last_change":"2024-04-01T06:54:28.427835+0000","last_active":"2024-04-01T06:55:33.714386+0000","last_peered":"2024-04-01T06:55:33.714386+0000","last_clean":"2024-04-01T06:55:33.714386+0000","last_became_active":"2024-04-01T06:54:28.426956+0000","last_became_peered":"2024-04-01T06:54:28.426956+0000","last_unstale":"2024-04-01T06:55:33.714386+0000","last_undegraded":"2024-04-01T06:55:33.714386+0000","last_fullsized":"2024-04-01T06:55:33.714386+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:41:17.334977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'6","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.715667+0000","last_change":"2024-04-01T06:54:27.992756+0000","last_active":"2024-04-01T06:55:33.715667+0000","last_peered":"2024-04-01T06:55:33.715667+0000","last_clean":"2024-04-01T06:55:33.715667+0000","last_became_active":"2024-04-01T06:54:27.992403+0000","last_became_peered":"2024-04-01T06:54:27.992403+0000","last_unstale":"2024-04-01T06:55:33.715667+0000","last_undegraded":"2024-04-01T06:55:33.715667+0000","last_fullsized":"2024-04-01T06:55:33.715667+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:40:33.458435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.717383+0000","last_change":"2024-04-01T06:54:28.416750+0000","last_active":"2024-04-01T06:55:33.717383+0000","last_peered":"2024-04-01T06:55:33.717383+0000","last_clean":"2024-04-01T06:55:33.717383+0000","last_became_active":"2024-04-01T06:54:28.416417+0000","last_became_peered":"2024-04-01T06:54:28.416417+0000","last_unstale":"2024-04-01T06:55:33.717383+0000","last_undegraded":"2024-04-01T06:55:33.717383+0000","last_fullsized":"2024-04-01T06:55:33.717383+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:04:41.698842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'3","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.711914+0000","last_change":"2024-04-01T06:54:28.001450+0000","last_active":"2024-04-01T06:55:33.711914+0000","last_peered":"2024-04-01T06:55:33.711914+0000","last_clean":"2024-04-01T06:55:33.711914+0000","last_became_active":"2024-04-01T06:54:28.001165+0000","last_became_peered":"2024-04-01T06:54:28.001165+0000","last_unstale":"2024-04-01T06:55:33.711914+0000","last_undegraded":"2024-04-01T06:55:33.711914+0000","last_fullsized":"2024-04-01T06:55:33.711914+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:20:03.876123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:34.126379+0000","last_change":"2024-04-01T06:54:28.421097+0000","last_active":"2024-04-01T06:55:34.126379+0000","last_peered":"2024-04-01T06:55:34.126379+0000","last_clean":"2024-04-01T06:55:34.126379+0000","last_became_active":"2024-04-01T06:54:28.420781+0000","last_became_peered":"2024-04-01T06:54:28.420781+0000","last_unstale":"2024-04-01T06:55:34.126379+0000","last_undegraded":"2024-04-01T06:55:34.126379+0000","last_fullsized":"2024-04-01T06:55:34.126379+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:11:47.192742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'5","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-01T06:55:39.810949+0000","last_change":"2024-04-01T06:54:27.993832+0000","last_active":"2024-04-01T06:55:39.810949+0000","last_peered":"2024-04-01T06:55:39.810949+0000","last_clean":"2024-04-01T06:55:39.810949+0000","last_became_active":"2024-04-01T06:54:27.993423+0000","last_became_peered":"2024-04-01T06:54:27.993423+0000","last_unstale":"2024-04-01T06:55:39.810949+0000","last_undegraded":"2024-04-01T06:55:39.810949+0000","last_fullsized":"2024-04-01T06:55:39.810949+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:58:37.542214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1247,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":73,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:34.126123+0000","last_change":"2024-04-01T06:54:28.423352+0000","last_active":"2024-04-01T06:55:34.126123+0000","last_peered":"2024-04-01T06:55:34.126123+0000","last_clean":"2024-04-01T06:55:34.126123+0000","last_became_active":"2024-04-01T06:54:28.423049+0000","last_became_peered":"2024-04-01T06:54:28.423049+0000","last_unstale":"2024-04-01T06:55:34.126123+0000","last_undegraded":"2024-04-01T06:55:34.126123+0000","last_fullsized":"2024-04-01T06:55:34.126123+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:07:34.963189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'15","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.714203+0000","last_change":"2024-04-01T06:54:27.990469+0000","last_active":"2024-04-01T06:55:33.714203+0000","last_peered":"2024-04-01T06:55:33.714203+0000","last_clean":"2024-04-01T06:55:33.714203+0000","last_became_active":"2024-04-01T06:54:27.990147+0000","last_became_peered":"2024-04-01T06:54:27.990147+0000","last_unstale":"2024-04-01T06:55:33.714203+0000","last_undegraded":"2024-04-01T06:55:33.714203+0000","last_fullsized":"2024-04-01T06:55:33.714203+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:27:29.415723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-01T06:55:34.794930+0000","last_change":"2024-04-01T06:55:34.794236+0000","last_active":"2024-04-01T06:55:34.794930+0000","last_peered":"2024-04-01T06:55:34.794930+0000","last_clean":"2024-04-01T06:55:34.794930+0000","last_became_active":"2024-04-01T06:55:34.793868+0000","last_became_peered":"2024-04-01T06:55:34.793868+0000","last_unstale":"2024-04-01T06:55:34.794930+0000","last_undegraded":"2024-04-01T06:55:34.794930+0000","last_fullsized":"2024-04-01T06:55:34.794930+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:48:47.178073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"79'2","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.714590+0000","last_change":"2024-04-01T06:54:27.995827+0000","last_active":"2024-04-01T06:55:33.714590+0000","last_peered":"2024-04-01T06:55:33.714590+0000","last_clean":"2024-04-01T06:55:33.714590+0000","last_became_active":"2024-04-01T06:54:27.995450+0000","last_became_peered":"2024-04-01T06:54:27.995450+0000","last_unstale":"2024-04-01T06:55:33.714590+0000","last_undegraded":"2024-04-01T06:55:33.714590+0000","last_fullsized":"2024-04-01T06:55:33.714590+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T14:14:03.935578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716760+0000","last_change":"2024-04-01T06:54:28.425376+0000","last_active":"2024-04-01T06:55:33.716760+0000","last_peered":"2024-04-01T06:55:33.716760+0000","last_clean":"2024-04-01T06:55:33.716760+0000","last_became_active":"2024-04-01T06:54:28.421235+0000","last_became_peered":"2024-04-01T06:54:28.421235+0000","last_unstale":"2024-04-01T06:55:33.716760+0000","last_undegraded":"2024-04-01T06:55:33.716760+0000","last_fullsized":"2024-04-01T06:55:33.716760+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:19:05.244735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-01T06:55:34.794830+0000","last_change":"2024-04-01T06:55:34.794830+0000","last_active":"2024-04-01T06:55:34.794830+0000","last_peered":"2024-04-01T06:55:34.794830+0000","last_clean":"2024-04-01T06:55:34.794830+0000","last_became_active":"2024-04-01T06:55:34.794493+0000","last_became_peered":"2024-04-01T06:55:34.794493+0000","last_unstale":"2024-04-01T06:55:34.794830+0000","last_undegraded":"2024-04-01T06:55:34.794830+0000","last_fullsized":"2024-04-01T06:55:34.794830+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:38:08.508743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"79'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.708230+0000","last_change":"2024-04-01T06:54:28.417654+0000","last_active":"2024-04-01T06:55:33.708230+0000","last_peered":"2024-04-01T06:55:33.708230+0000","last_clean":"2024-04-01T06:55:33.708230+0000","last_became_active":"2024-04-01T06:54:28.417318+0000","last_became_peered":"2024-04-01T06:54:28.417318+0000","last_unstale":"2024-04-01T06:55:33.708230+0000","last_undegraded":"2024-04-01T06:55:33.708230+0000","last_fullsized":"2024-04-01T06:55:33.708230+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:59:25.843730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"79'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:34.126328+0000","last_change":"2024-04-01T06:54:27.998825+0000","last_active":"2024-04-01T06:55:34.126328+0000","last_peered":"2024-04-01T06:55:34.126328+0000","last_clean":"2024-04-01T06:55:34.126328+0000","last_became_active":"2024-04-01T06:54:27.998488+0000","last_became_peered":"2024-04-01T06:54:27.998488+0000","last_unstale":"2024-04-01T06:55:34.126328+0000","last_undegraded":"2024-04-01T06:55:34.126328+0000","last_fullsized":"2024-04-01T06:55:34.126328+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:22:24.878723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.708064+0000","last_change":"2024-04-01T06:54:28.421053+0000","last_active":"2024-04-01T06:55:33.708064+0000","last_peered":"2024-04-01T06:55:33.708064+0000","last_clean":"2024-04-01T06:55:33.708064+0000","last_became_active":"2024-04-01T06:54:28.420718+0000","last_became_peered":"2024-04-01T06:54:28.420718+0000","last_unstale":"2024-04-01T06:55:33.708064+0000","last_undegraded":"2024-04-01T06:55:33.708064+0000","last_fullsized":"2024-04-01T06:55:33.708064+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:58:10.109158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.711707+0000","last_change":"2024-04-01T06:54:28.419126+0000","last_active":"2024-04-01T06:55:33.711707+0000","last_peered":"2024-04-01T06:55:33.711707+0000","last_clean":"2024-04-01T06:55:33.711707+0000","last_became_active":"2024-04-01T06:54:28.418217+0000","last_became_peered":"2024-04-01T06:54:28.418217+0000","last_unstale":"2024-04-01T06:55:33.711707+0000","last_undegraded":"2024-04-01T06:55:33.711707+0000","last_fullsized":"2024-04-01T06:55:33.711707+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T14:02:41.148200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-01T06:55:37.806484+0000","last_change":"2024-04-01T06:54:27.993059+0000","last_active":"2024-04-01T06:55:37.806484+0000","last_peered":"2024-04-01T06:55:37.806484+0000","last_clean":"2024-04-01T06:55:37.806484+0000","last_became_active":"2024-04-01T06:54:27.992471+0000","last_became_peered":"2024-04-01T06:54:27.992471+0000","last_unstale":"2024-04-01T06:55:37.806484+0000","last_undegraded":"2024-04-01T06:55:37.806484+0000","last_fullsized":"2024-04-01T06:55:37.806484+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:27:38.691261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":66,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.708950+0000","last_change":"2024-04-01T06:54:28.411805+0000","last_active":"2024-04-01T06:55:33.708950+0000","last_peered":"2024-04-01T06:55:33.708950+0000","last_clean":"2024-04-01T06:55:33.708950+0000","last_became_active":"2024-04-01T06:54:28.411526+0000","last_became_peered":"2024-04-01T06:54:28.411526+0000","last_unstale":"2024-04-01T06:55:33.708950+0000","last_undegraded":"2024-04-01T06:55:33.708950+0000","last_fullsized":"2024-04-01T06:55:33.708950+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:59:08.223590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"79'3","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.713911+0000","last_change":"2024-04-01T06:54:27.988695+0000","last_active":"2024-04-01T06:55:33.713911+0000","last_peered":"2024-04-01T06:55:33.713911+0000","last_clean":"2024-04-01T06:55:33.713911+0000","last_became_active":"2024-04-01T06:54:27.988069+0000","last_became_peered":"2024-04-01T06:54:27.988069+0000","last_unstale":"2024-04-01T06:55:33.713911+0000","last_undegraded":"2024-04-01T06:55:33.713911+0000","last_fullsized":"2024-04-01T06:55:33.713911+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:27:11.287962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":332,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:34.126362+0000","last_change":"2024-04-01T06:53:41.678430+0000","last_active":"2024-04-01T06:55:34.126362+0000","last_peered":"2024-04-01T06:55:34.126362+0000","last_clean":"2024-04-01T06:55:34.126362+0000","last_became_active":"2024-04-01T06:53:41.677964+0000","last_became_peered":"2024-04-01T06:53:41.677964+0000","last_unstale":"2024-04-01T06:55:34.126362+0000","last_undegraded":"2024-04-01T06:55:34.126362+0000","last_fullsized":"2024-04-01T06:55:34.126362+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:51:21.964420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:51:21.964420+0000","last_clean_scrub_stamp":"2024-04-01T06:51:21.964420+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:24:29.916692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.715961+0000","last_change":"2024-04-01T06:54:28.423775+0000","last_active":"2024-04-01T06:55:33.715961+0000","last_peered":"2024-04-01T06:55:33.715961+0000","last_clean":"2024-04-01T06:55:33.715961+0000","last_became_active":"2024-04-01T06:54:28.423462+0000","last_became_peered":"2024-04-01T06:54:28.423462+0000","last_unstale":"2024-04-01T06:55:33.715961+0000","last_undegraded":"2024-04-01T06:55:33.715961+0000","last_fullsized":"2024-04-01T06:55:33.715961+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:09:38.043033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"79'3","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:34.126308+0000","last_change":"2024-04-01T06:54:27.997801+0000","last_active":"2024-04-01T06:55:34.126308+0000","last_peered":"2024-04-01T06:55:34.126308+0000","last_clean":"2024-04-01T06:55:34.126308+0000","last_became_active":"2024-04-01T06:54:27.997305+0000","last_became_peered":"2024-04-01T06:54:27.997305+0000","last_unstale":"2024-04-01T06:55:34.126308+0000","last_undegraded":"2024-04-01T06:55:34.126308+0000","last_fullsized":"2024-04-01T06:55:34.126308+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:46:09.224535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"79'1","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.714497+0000","last_change":"2024-04-01T06:54:27.994483+0000","last_active":"2024-04-01T06:55:33.714497+0000","last_peered":"2024-04-01T06:55:33.714497+0000","last_clean":"2024-04-01T06:55:33.714497+0000","last_became_active":"2024-04-01T06:54:27.994093+0000","last_became_peered":"2024-04-01T06:54:27.994093+0000","last_unstale":"2024-04-01T06:55:33.714497+0000","last_undegraded":"2024-04-01T06:55:33.714497+0000","last_fullsized":"2024-04-01T06:55:33.714497+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:27:48.272196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716298+0000","last_change":"2024-04-01T06:54:28.423895+0000","last_active":"2024-04-01T06:55:33.716298+0000","last_peered":"2024-04-01T06:55:33.716298+0000","last_clean":"2024-04-01T06:55:33.716298+0000","last_became_active":"2024-04-01T06:54:28.423593+0000","last_became_peered":"2024-04-01T06:54:28.423593+0000","last_unstale":"2024-04-01T06:55:33.716298+0000","last_undegraded":"2024-04-01T06:55:33.716298+0000","last_fullsized":"2024-04-01T06:55:33.716298+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:09:30.414080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"79'5","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.712579+0000","last_change":"2024-04-01T06:54:27.987207+0000","last_active":"2024-04-01T06:55:33.712579+0000","last_peered":"2024-04-01T06:55:33.712579+0000","last_clean":"2024-04-01T06:55:33.712579+0000","last_became_active":"2024-04-01T06:54:27.986537+0000","last_became_peered":"2024-04-01T06:54:27.986537+0000","last_unstale":"2024-04-01T06:55:33.712579+0000","last_undegraded":"2024-04-01T06:55:33.712579+0000","last_fullsized":"2024-04-01T06:55:33.712579+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:26:41.096843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.709381+0000","last_change":"2024-04-01T06:54:28.416591+0000","last_active":"2024-04-01T06:55:33.709381+0000","last_peered":"2024-04-01T06:55:33.709381+0000","last_clean":"2024-04-01T06:55:33.709381+0000","last_became_active":"2024-04-01T06:54:28.416295+0000","last_became_peered":"2024-04-01T06:54:28.416295+0000","last_unstale":"2024-04-01T06:55:33.709381+0000","last_undegraded":"2024-04-01T06:55:33.709381+0000","last_fullsized":"2024-04-01T06:55:33.709381+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:17:24.670572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'4","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.713832+0000","last_change":"2024-04-01T06:54:27.996075+0000","last_active":"2024-04-01T06:55:33.713832+0000","last_peered":"2024-04-01T06:55:33.713832+0000","last_clean":"2024-04-01T06:55:33.713832+0000","last_became_active":"2024-04-01T06:54:27.995664+0000","last_became_peered":"2024-04-01T06:54:27.995664+0000","last_unstale":"2024-04-01T06:55:33.713832+0000","last_undegraded":"2024-04-01T06:55:33.713832+0000","last_fullsized":"2024-04-01T06:55:33.713832+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:17:33.214644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716458+0000","last_change":"2024-04-01T06:54:28.422041+0000","last_active":"2024-04-01T06:55:33.716458+0000","last_peered":"2024-04-01T06:55:33.716458+0000","last_clean":"2024-04-01T06:55:33.716458+0000","last_became_active":"2024-04-01T06:54:28.421743+0000","last_became_peered":"2024-04-01T06:54:28.421743+0000","last_unstale":"2024-04-01T06:55:33.716458+0000","last_undegraded":"2024-04-01T06:55:33.716458+0000","last_fullsized":"2024-04-01T06:55:33.716458+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:23:14.405879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.715836+0000","last_change":"2024-04-01T06:54:27.991734+0000","last_active":"2024-04-01T06:55:33.715836+0000","last_peered":"2024-04-01T06:55:33.715836+0000","last_clean":"2024-04-01T06:55:33.715836+0000","last_became_active":"2024-04-01T06:54:27.991139+0000","last_became_peered":"2024-04-01T06:54:27.991139+0000","last_unstale":"2024-04-01T06:55:33.715836+0000","last_undegraded":"2024-04-01T06:55:33.715836+0000","last_fullsized":"2024-04-01T06:55:33.715836+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:08:49.188179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.714043+0000","last_change":"2024-04-01T06:54:28.428467+0000","last_active":"2024-04-01T06:55:33.714043+0000","last_peered":"2024-04-01T06:55:33.714043+0000","last_clean":"2024-04-01T06:55:33.714043+0000","last_became_active":"2024-04-01T06:54:28.428095+0000","last_became_peered":"2024-04-01T06:54:28.428095+0000","last_unstale":"2024-04-01T06:55:33.714043+0000","last_undegraded":"2024-04-01T06:55:33.714043+0000","last_fullsized":"2024-04-01T06:55:33.714043+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:21:04.500427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'3","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.708832+0000","last_change":"2024-04-01T06:54:27.990321+0000","last_active":"2024-04-01T06:55:33.708832+0000","last_peered":"2024-04-01T06:55:33.708832+0000","last_clean":"2024-04-01T06:55:33.708832+0000","last_became_active":"2024-04-01T06:54:27.989997+0000","last_became_peered":"2024-04-01T06:54:27.989997+0000","last_unstale":"2024-04-01T06:55:33.708832+0000","last_undegraded":"2024-04-01T06:55:33.708832+0000","last_fullsized":"2024-04-01T06:55:33.708832+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:14:04.059812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.715899+0000","last_change":"2024-04-01T06:54:28.416480+0000","last_active":"2024-04-01T06:55:33.715899+0000","last_peered":"2024-04-01T06:55:33.715899+0000","last_clean":"2024-04-01T06:55:33.715899+0000","last_became_active":"2024-04-01T06:54:28.416009+0000","last_became_peered":"2024-04-01T06:54:28.416009+0000","last_unstale":"2024-04-01T06:55:33.715899+0000","last_undegraded":"2024-04-01T06:55:33.715899+0000","last_fullsized":"2024-04-01T06:55:33.715899+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:32:09.759447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"79'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.715352+0000","last_change":"2024-04-01T06:54:27.996538+0000","last_active":"2024-04-01T06:55:33.715352+0000","last_peered":"2024-04-01T06:55:33.715352+0000","last_clean":"2024-04-01T06:55:33.715352+0000","last_became_active":"2024-04-01T06:54:27.996177+0000","last_became_peered":"2024-04-01T06:54:27.996177+0000","last_unstale":"2024-04-01T06:55:33.715352+0000","last_undegraded":"2024-04-01T06:55:33.715352+0000","last_fullsized":"2024-04-01T06:55:33.715352+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:39:45.386450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.709026+0000","last_change":"2024-04-01T06:54:28.419403+0000","last_active":"2024-04-01T06:55:33.709026+0000","last_peered":"2024-04-01T06:55:33.709026+0000","last_clean":"2024-04-01T06:55:33.709026+0000","last_became_active":"2024-04-01T06:54:28.419127+0000","last_became_peered":"2024-04-01T06:54:28.419127+0000","last_unstale":"2024-04-01T06:55:33.709026+0000","last_undegraded":"2024-04-01T06:55:33.709026+0000","last_fullsized":"2024-04-01T06:55:33.709026+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:52:13.510448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.714185+0000","last_change":"2024-04-01T06:54:27.992775+0000","last_active":"2024-04-01T06:55:33.714185+0000","last_peered":"2024-04-01T06:55:33.714185+0000","last_clean":"2024-04-01T06:55:33.714185+0000","last_became_active":"2024-04-01T06:54:27.992356+0000","last_became_peered":"2024-04-01T06:54:27.992356+0000","last_unstale":"2024-04-01T06:55:33.714185+0000","last_undegraded":"2024-04-01T06:55:33.714185+0000","last_fullsized":"2024-04-01T06:55:33.714185+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T14:46:37.302172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:34.126447+0000","last_change":"2024-04-01T06:54:28.430132+0000","last_active":"2024-04-01T06:55:34.126447+0000","last_peered":"2024-04-01T06:55:34.126447+0000","last_clean":"2024-04-01T06:55:34.126447+0000","last_became_active":"2024-04-01T06:54:28.429816+0000","last_became_peered":"2024-04-01T06:54:28.429816+0000","last_unstale":"2024-04-01T06:55:34.126447+0000","last_undegraded":"2024-04-01T06:55:34.126447+0000","last_fullsized":"2024-04-01T06:55:34.126447+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T14:49:58.661275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"79'3","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716010+0000","last_change":"2024-04-01T06:54:27.999460+0000","last_active":"2024-04-01T06:55:33.716010+0000","last_peered":"2024-04-01T06:55:33.716010+0000","last_clean":"2024-04-01T06:55:33.716010+0000","last_became_active":"2024-04-01T06:54:27.999128+0000","last_became_peered":"2024-04-01T06:54:27.999128+0000","last_unstale":"2024-04-01T06:55:33.716010+0000","last_undegraded":"2024-04-01T06:55:33.716010+0000","last_fullsized":"2024-04-01T06:55:33.716010+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:19:24.285698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:34.126610+0000","last_change":"2024-04-01T06:54:28.427720+0000","last_active":"2024-04-01T06:55:34.126610+0000","last_peered":"2024-04-01T06:55:34.126610+0000","last_clean":"2024-04-01T06:55:34.126610+0000","last_became_active":"2024-04-01T06:54:28.427357+0000","last_became_peered":"2024-04-01T06:54:28.427357+0000","last_unstale":"2024-04-01T06:55:34.126610+0000","last_undegraded":"2024-04-01T06:55:34.126610+0000","last_fullsized":"2024-04-01T06:55:34.126610+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:20:56.631811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.711677+0000","last_change":"2024-04-01T06:54:27.997806+0000","last_active":"2024-04-01T06:55:33.711677+0000","last_peered":"2024-04-01T06:55:33.711677+0000","last_clean":"2024-04-01T06:55:33.711677+0000","last_became_active":"2024-04-01T06:54:27.997490+0000","last_became_peered":"2024-04-01T06:54:27.997490+0000","last_unstale":"2024-04-01T06:55:33.711677+0000","last_undegraded":"2024-04-01T06:55:33.711677+0000","last_fullsized":"2024-04-01T06:55:33.711677+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:06:15.099390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"79'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:34.126472+0000","last_change":"2024-04-01T06:54:28.419639+0000","last_active":"2024-04-01T06:55:34.126472+0000","last_peered":"2024-04-01T06:55:34.126472+0000","last_clean":"2024-04-01T06:55:34.126472+0000","last_became_active":"2024-04-01T06:54:28.418081+0000","last_became_peered":"2024-04-01T06:54:28.418081+0000","last_unstale":"2024-04-01T06:55:34.126472+0000","last_undegraded":"2024-04-01T06:55:34.126472+0000","last_fullsized":"2024-04-01T06:55:34.126472+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:15:44.753121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.715887+0000","last_change":"2024-04-01T06:54:27.995854+0000","last_active":"2024-04-01T06:55:33.715887+0000","last_peered":"2024-04-01T06:55:33.715887+0000","last_clean":"2024-04-01T06:55:33.715887+0000","last_became_active":"2024-04-01T06:54:27.995540+0000","last_became_peered":"2024-04-01T06:54:27.995540+0000","last_unstale":"2024-04-01T06:55:33.715887+0000","last_undegraded":"2024-04-01T06:55:33.715887+0000","last_fullsized":"2024-04-01T06:55:33.715887+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:47:15.075909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:34.126624+0000","last_change":"2024-04-01T06:54:28.428100+0000","last_active":"2024-04-01T06:55:34.126624+0000","last_peered":"2024-04-01T06:55:34.126624+0000","last_clean":"2024-04-01T06:55:34.126624+0000","last_became_active":"2024-04-01T06:54:28.427769+0000","last_became_peered":"2024-04-01T06:54:28.427769+0000","last_unstale":"2024-04-01T06:55:34.126624+0000","last_undegraded":"2024-04-01T06:55:34.126624+0000","last_fullsized":"2024-04-01T06:55:34.126624+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:47:18.161878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716007+0000","last_change":"2024-04-01T06:54:28.427557+0000","last_active":"2024-04-01T06:55:33.716007+0000","last_peered":"2024-04-01T06:55:33.716007+0000","last_clean":"2024-04-01T06:55:33.716007+0000","last_became_active":"2024-04-01T06:54:28.427209+0000","last_became_peered":"2024-04-01T06:54:28.427209+0000","last_unstale":"2024-04-01T06:55:33.716007+0000","last_undegraded":"2024-04-01T06:55:33.716007+0000","last_fullsized":"2024-04-01T06:55:33.716007+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:10:06.835360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.715486+0000","last_change":"2024-04-01T06:54:28.423264+0000","last_active":"2024-04-01T06:55:33.715486+0000","last_peered":"2024-04-01T06:55:33.715486+0000","last_clean":"2024-04-01T06:55:33.715486+0000","last_became_active":"2024-04-01T06:54:28.422868+0000","last_became_peered":"2024-04-01T06:54:28.422868+0000","last_unstale":"2024-04-01T06:55:33.715486+0000","last_undegraded":"2024-04-01T06:55:33.715486+0000","last_fullsized":"2024-04-01T06:55:33.715486+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:00:49.784276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.715257+0000","last_change":"2024-04-01T06:54:28.417824+0000","last_active":"2024-04-01T06:55:33.715257+0000","last_peered":"2024-04-01T06:55:33.715257+0000","last_clean":"2024-04-01T06:55:33.715257+0000","last_became_active":"2024-04-01T06:54:28.417510+0000","last_became_peered":"2024-04-01T06:54:28.417510+0000","last_unstale":"2024-04-01T06:55:33.715257+0000","last_undegraded":"2024-04-01T06:55:33.715257+0000","last_fullsized":"2024-04-01T06:55:33.715257+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:40:52.024183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716183+0000","last_change":"2024-04-01T06:54:28.426099+0000","last_active":"2024-04-01T06:55:33.716183+0000","last_peered":"2024-04-01T06:55:33.716183+0000","last_clean":"2024-04-01T06:55:33.716183+0000","last_became_active":"2024-04-01T06:54:28.425745+0000","last_became_peered":"2024-04-01T06:54:28.425745+0000","last_unstale":"2024-04-01T06:55:33.716183+0000","last_undegraded":"2024-04-01T06:55:33.716183+0000","last_fullsized":"2024-04-01T06:55:33.716183+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:13:45.145447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-01T06:55:34.793799+0000","last_change":"2024-04-01T06:55:34.793799+0000","last_active":"2024-04-01T06:55:34.793799+0000","last_peered":"2024-04-01T06:55:34.793799+0000","last_clean":"2024-04-01T06:55:34.793799+0000","last_became_active":"2024-04-01T06:55:34.793425+0000","last_became_peered":"2024-04-01T06:55:34.793425+0000","last_unstale":"2024-04-01T06:55:34.793799+0000","last_undegraded":"2024-04-01T06:55:34.793799+0000","last_fullsized":"2024-04-01T06:55:34.793799+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:40:42.053778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716274+0000","last_change":"2024-04-01T06:54:28.421013+0000","last_active":"2024-04-01T06:55:33.716274+0000","last_peered":"2024-04-01T06:55:33.716274+0000","last_clean":"2024-04-01T06:55:33.716274+0000","last_became_active":"2024-04-01T06:54:28.420339+0000","last_became_peered":"2024-04-01T06:54:28.420339+0000","last_unstale":"2024-04-01T06:55:33.716274+0000","last_undegraded":"2024-04-01T06:55:33.716274+0000","last_fullsized":"2024-04-01T06:55:33.716274+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:59:07.758542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.715886+0000","last_change":"2024-04-01T06:54:28.433203+0000","last_active":"2024-04-01T06:55:33.715886+0000","last_peered":"2024-04-01T06:55:33.715886+0000","last_clean":"2024-04-01T06:55:33.715886+0000","last_became_active":"2024-04-01T06:54:28.431890+0000","last_became_peered":"2024-04-01T06:54:28.431890+0000","last_unstale":"2024-04-01T06:55:33.715886+0000","last_undegraded":"2024-04-01T06:55:33.715886+0000","last_fullsized":"2024-04-01T06:55:33.715886+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:55:33.169722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.709341+0000","last_change":"2024-04-01T06:54:28.418425+0000","last_active":"2024-04-01T06:55:33.709341+0000","last_peered":"2024-04-01T06:55:33.709341+0000","last_clean":"2024-04-01T06:55:33.709341+0000","last_became_active":"2024-04-01T06:54:28.418165+0000","last_became_peered":"2024-04-01T06:54:28.418165+0000","last_unstale":"2024-04-01T06:55:33.709341+0000","last_undegraded":"2024-04-01T06:55:33.709341+0000","last_fullsized":"2024-04-01T06:55:33.709341+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:45:01.425680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.711699+0000","last_change":"2024-04-01T06:54:28.412058+0000","last_active":"2024-04-01T06:55:33.711699+0000","last_peered":"2024-04-01T06:55:33.711699+0000","last_clean":"2024-04-01T06:55:33.711699+0000","last_became_active":"2024-04-01T06:54:28.411680+0000","last_became_peered":"2024-04-01T06:54:28.411680+0000","last_unstale":"2024-04-01T06:55:33.711699+0000","last_undegraded":"2024-04-01T06:55:33.711699+0000","last_fullsized":"2024-04-01T06:55:33.711699+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:21:05.628262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.708907+0000","last_change":"2024-04-01T06:54:28.422304+0000","last_active":"2024-04-01T06:55:33.708907+0000","last_peered":"2024-04-01T06:55:33.708907+0000","last_clean":"2024-04-01T06:55:33.708907+0000","last_became_active":"2024-04-01T06:54:28.422023+0000","last_became_peered":"2024-04-01T06:54:28.422023+0000","last_unstale":"2024-04-01T06:55:33.708907+0000","last_undegraded":"2024-04-01T06:55:33.708907+0000","last_fullsized":"2024-04-01T06:55:33.708907+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:26:45.810780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.715869+0000","last_change":"2024-04-01T06:54:28.420350+0000","last_active":"2024-04-01T06:55:33.715869+0000","last_peered":"2024-04-01T06:55:33.715869+0000","last_clean":"2024-04-01T06:55:33.715869+0000","last_became_active":"2024-04-01T06:54:28.419995+0000","last_became_peered":"2024-04-01T06:54:28.419995+0000","last_unstale":"2024-04-01T06:55:33.715869+0000","last_undegraded":"2024-04-01T06:55:33.715869+0000","last_fullsized":"2024-04-01T06:55:33.715869+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:30:20.831966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716308+0000","last_change":"2024-04-01T06:54:28.417067+0000","last_active":"2024-04-01T06:55:33.716308+0000","last_peered":"2024-04-01T06:55:33.716308+0000","last_clean":"2024-04-01T06:55:33.716308+0000","last_became_active":"2024-04-01T06:54:28.416796+0000","last_became_peered":"2024-04-01T06:54:28.416796+0000","last_unstale":"2024-04-01T06:55:33.716308+0000","last_undegraded":"2024-04-01T06:55:33.716308+0000","last_fullsized":"2024-04-01T06:55:33.716308+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:39:43.396643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716194+0000","last_change":"2024-04-01T06:54:28.424971+0000","last_active":"2024-04-01T06:55:33.716194+0000","last_peered":"2024-04-01T06:55:33.716194+0000","last_clean":"2024-04-01T06:55:33.716194+0000","last_became_active":"2024-04-01T06:54:28.424664+0000","last_became_peered":"2024-04-01T06:54:28.424664+0000","last_unstale":"2024-04-01T06:55:33.716194+0000","last_undegraded":"2024-04-01T06:55:33.716194+0000","last_fullsized":"2024-04-01T06:55:33.716194+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:03:51.434412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":246668,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65928,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":423,"num_read_kb":281,"num_write":155,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":197156,"data_compressed":5598,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579927,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":876544,"data_stored":425769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:54:55 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.69699999999999995}]},{"osd":1,"last update":"Mon Apr 1 06:54:55 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.745},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.60099999999999998}]},{"osd":2,"last update":"Mon Apr 1 06:54:55 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.90600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":4,"last update":"Mon Apr 1 06:54:55 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":3.1970000000000001,"5min":3.1970000000000001,"15min":3.1970000000000001},"last":0.623},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.71899999999999997}]},{"osd":5,"last update":"Mon Apr 1 06:54:55 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.85299999999999998}]},{"osd":6,"last update":"Mon Apr 1 06:54:55 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.77800000000000002}]},{"osd":7,"last update":"Mon Apr 1 06:54:55 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":3.3479999999999999,"5min":3.3479999999999999,"15min":3.3479999999999999},"last":0.873}]},{"osd":8,"last update":"Mon Apr 1 06:55:28 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.82099999999999995}]},{"osd":9,"last update":"Mon Apr 1 06:54:55 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1,"5min":1,"15min":1},"last":1.018}]},{"osd":10,"last update":"Mon Apr 1 06:54:55 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.92300000000000004}]}]},{"osd":10,"up_from":67,"seq":287762808859,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1024000,"data_stored":1079223,"data_compressed":37572,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:55:33 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.54900000000000004}]},{"osd":1,"last update":"Mon Apr 1 06:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.52100000000000002}]},{"osd":2,"last update":"Mon Apr 1 06:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.76400000000000001}]},{"osd":3,"last update":"Mon Apr 1 06:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.69499999999999995}]},{"osd":4,"last update":"Mon Apr 1 06:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.63300000000000001}]},{"osd":5,"last update":"Mon Apr 1 06:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.748},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.83499999999999996}]},{"osd":6,"last update":"Mon Apr 1 06:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.78200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":8,"last update":"Mon Apr 1 06:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.877}]},{"osd":9,"last update":"Mon Apr 1 06:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.81100000000000005}]},{"osd":11,"last update":"Mon Apr 1 06:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.84799999999999998}]}]},{"osd":9,"up_from":62,"seq":266287972384,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31992,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713160,"statfs":{"total":95995035648,"available":95962275840,"internally_reserved":0,"allocated":892928,"data_stored":426005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:55:22 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.41299999999999998,"15min":0.42399999999999999},"min":{"1min":0.27200000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.52200000000000002,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.314},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.41999999999999998,"15min":0.433},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.55700000000000005,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.34799999999999998}]},{"osd":1,"last update":"Mon Apr 1 06:55:22 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.60999999999999999,"15min":0.626},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83099999999999996,"5min":0.873,"15min":0.873},"last":0.434},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.61099999999999999,"15min":0.623},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.442}]},{"osd":2,"last update":"Mon Apr 1 06:55:22 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.58599999999999997,"15min":0.59699999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.85199999999999998,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.505,"5min":0.58399999999999996,"15min":0.59699999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.52600000000000002}]},{"osd":3,"last update":"Mon Apr 1 06:55:22 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.45300000000000001,"15min":0.46700000000000003},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.61899999999999999,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.51400000000000001,"15min":0.53100000000000003},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.58799999999999997,"5min":0.754,"15min":0.754},"last":0.38600000000000001}]},{"osd":4,"last update":"Mon Apr 1 06:55:22 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.61699999999999999,"15min":0.63},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.58999999999999997,"15min":0.60099999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.83799999999999997,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.48399999999999999}]},{"osd":5,"last update":"Mon Apr 1 06:55:22 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.60099999999999998,"15min":0.61299999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.81299999999999994,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.72399999999999998,"15min":0.75},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.79100000000000004,"5min":1.835,"15min":1.835},"last":0.50700000000000001}]},{"osd":6,"last update":"Mon Apr 1 06:55:22 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.64200000000000002,"15min":0.66200000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67100000000000004,"5min":1.048,"15min":1.048},"last":0.379},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.63800000000000001,"15min":0.66500000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.71899999999999997,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.54000000000000004}]},{"osd":7,"last update":"Mon Apr 1 06:55:22 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.65800000000000003,"15min":0.67100000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.89400000000000002,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.72499999999999998,"15min":0.746},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.92600000000000005,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.53700000000000003}]},{"osd":8,"last update":"Mon Apr 1 06:55:22 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.91400000000000003,"15min":0.96399999999999997},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.84499999999999997,"5min":5.6600000000000001,"15min":5.6600000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.90100000000000002,"15min":0.94699999999999995},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.85899999999999999,"5min":5.6070000000000002,"15min":5.6070000000000002},"last":0.57099999999999995}]},{"osd":10,"last update":"Mon Apr 1 06:55:40 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.70199999999999996,"15min":0.71399999999999997},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.94399999999999995,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.69199999999999995,"15min":0.70099999999999996},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.879,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.58599999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]}]},{"osd":8,"up_from":55,"seq":236223201315,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31988,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713164,"statfs":{"total":95995035648,"available":95962279936,"internally_reserved":0,"allocated":888832,"data_stored":425594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:55:08 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52900000000000003,"15min":0.53300000000000003},"min":{"1min":0.379,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.72099999999999997,"5min":0.747,"15min":0.747},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.54000000000000004,"15min":0.54400000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.65600000000000003,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.60599999999999998}]},{"osd":1,"last update":"Mon Apr 1 06:55:08 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.57899999999999996,"15min":0.56699999999999995},"min":{"1min":0.38400000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.58699999999999997,"15min":0.58199999999999996},"min":{"1min":0.35199999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.82999999999999996,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.73599999999999999}]},{"osd":2,"last update":"Mon Apr 1 06:55:08 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.46100000000000002,"15min":0.442},"min":{"1min":0.30199999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.46600000000000003,"15min":0.45100000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.62}]},{"osd":3,"last update":"Mon Apr 1 06:55:08 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.749,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.56000000000000005,"15min":0.55400000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78600000000000003,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.64000000000000001}]},{"osd":4,"last update":"Mon Apr 1 06:55:08 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.58599999999999997,"15min":0.57899999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.85299999999999998,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.61399999999999999,"15min":0.59599999999999997},"min":{"1min":0.47499999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.753}]},{"osd":5,"last update":"Mon Apr 1 06:55:08 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.53400000000000003,"15min":0.52000000000000002},"min":{"1min":0.41199999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.55300000000000005,"15min":0.53700000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.69999999999999996}]},{"osd":6,"last update":"Mon Apr 1 06:55:08 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.64500000000000002,"15min":0.629},"min":{"1min":0.51700000000000002,"5min":0.433,"15min":0.433},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.67200000000000004,"15min":0.66200000000000003},"min":{"1min":0.54000000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.79000000000000004}]},{"osd":7,"last update":"Mon Apr 1 06:55:08 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.68300000000000005,"15min":0.67100000000000004},"min":{"1min":0.50900000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.92700000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.745,"5min":0.68899999999999995,"15min":0.68000000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.81299999999999994}]},{"osd":9,"last update":"Mon Apr 1 06:55:28 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.72099999999999997,"15min":0.69699999999999995},"min":{"1min":0.626,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.871},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.73699999999999999,"15min":0.71099999999999997},"min":{"1min":0.65400000000000003,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.83499999999999996}]},{"osd":10,"last update":"Mon Apr 1 06:54:43 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.89600000000000002}]},{"osd":11,"last update":"Mon Apr 1 06:55:28 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.80200000000000005}]}]},{"osd":7,"up_from":48,"seq":206158430244,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32036,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713116,"statfs":{"total":95995035648,"available":95962230784,"internally_reserved":0,"allocated":942080,"data_stored":1018154,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:53:48 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.41099999999999998}]},{"osd":1,"last update":"Mon Apr 1 06:54:51 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.39400000000000002,"15min":0.38800000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.42399999999999999,"15min":0.41599999999999998},"min":{"1min":0.32700000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.46800000000000003}]},{"osd":2,"last update":"Mon Apr 1 06:54:51 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.56499999999999995,"15min":0.56100000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.56200000000000006,"15min":0.55400000000000005},"min":{"1min":0.42799999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.80200000000000005,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.77900000000000003}]},{"osd":3,"last update":"Mon Apr 1 06:54:51 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.56599999999999995,"15min":0.56000000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.74299999999999999,"5min":0.755,"15min":0.755},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.58799999999999997,"15min":0.58399999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.80300000000000005,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.56699999999999995}]},{"osd":4,"last update":"Mon Apr 1 06:54:51 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.51000000000000001,"15min":0.505},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.51000000000000001,"15min":0.50700000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.49399999999999999}]},{"osd":5,"last update":"Mon Apr 1 06:54:51 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.60599999999999998,"15min":0.59599999999999997},"min":{"1min":0.46700000000000003,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.63600000000000001,"15min":0.63},"min":{"1min":0.501,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.86799999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.81299999999999994}]},{"osd":6,"last update":"Mon Apr 1 06:54:51 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.47599999999999998,"5min":0.443,"15min":0.443},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.439,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.55200000000000005}]},{"osd":8,"last update":"Mon Apr 1 06:55:05 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.68600000000000005,"15min":0.68000000000000005},"min":{"1min":0.56699999999999995,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.52000000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.91300000000000003,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.75900000000000001}]},{"osd":9,"last update":"Mon Apr 1 06:55:27 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.71199999999999997,"15min":0.70799999999999996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.63},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.72599999999999998,"15min":0.72399999999999998},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.95599999999999996,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.83499999999999996}]},{"osd":10,"last update":"Mon Apr 1 06:54:44 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.879}]},{"osd":11,"last update":"Mon Apr 1 06:55:33 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.82399999999999995}]}]},{"osd":6,"up_from":43,"seq":184683593769,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":880640,"data_stored":425394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:55:38 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.375,"15min":0.34300000000000003},"min":{"1min":0.27000000000000002,"5min":0.246,"15min":0.246},"max":{"1min":3.8260000000000001,"5min":3.8260000000000001,"15min":3.8260000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.375,"5min":0.37,"15min":0.36199999999999999},"min":{"1min":0.29299999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.625,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.503}]},{"osd":1,"last update":"Mon Apr 1 06:55:38 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.51600000000000001,"15min":0.48799999999999999},"min":{"1min":0.36199999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.51900000000000002,"15min":0.50700000000000001},"min":{"1min":0.41199999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.58499999999999996}]},{"osd":2,"last update":"Mon Apr 1 06:55:38 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.53100000000000003,"15min":0.51600000000000001},"min":{"1min":0.41899999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.73299999999999998,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.57499999999999996,"15min":0.56699999999999995},"min":{"1min":0.39400000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.81799999999999995,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.81799999999999995}]},{"osd":3,"last update":"Mon Apr 1 06:55:38 2024","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.42599999999999999,"15min":0.42199999999999999},"min":{"1min":0.28799999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.44500000000000001,"15min":0.438},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.52100000000000002}]},{"osd":4,"last update":"Mon Apr 1 06:55:38 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.53000000000000003,"15min":0.51600000000000001},"min":{"1min":0.376,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.67200000000000004,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56599999999999995,"15min":0.54600000000000004},"min":{"1min":0.38300000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.73299999999999998,"5min":0.871,"15min":0.871},"last":0.71099999999999997}]},{"osd":5,"last update":"Mon Apr 1 06:55:38 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.60499999999999998,"15min":0.59999999999999998},"min":{"1min":0.42199999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.71299999999999997,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.61199999999999999,"15min":0.60899999999999999},"min":{"1min":0.39300000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.82899999999999996,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.82899999999999996}]},{"osd":7,"last update":"Mon Apr 1 06:54:49 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.621,"15min":0.625},"min":{"1min":0.437,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.83699999999999997,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.65200000000000002,"15min":0.65000000000000002},"min":{"1min":0.52400000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.82399999999999995,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.77300000000000002}]},{"osd":8,"last update":"Mon Apr 1 06:55:08 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.67600000000000005,"15min":0.68500000000000005},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.88800000000000001,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.755},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.65900000000000003,"15min":0.66300000000000003},"min":{"1min":0.51000000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.80600000000000005,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.83899999999999997}]},{"osd":9,"last update":"Mon Apr 1 06:55:29 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.60599999999999998,"15min":0.626},"min":{"1min":0.39400000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.64700000000000002,"5min":1.004,"15min":1.004},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.505,"5min":0.61699999999999999,"15min":0.63600000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.68100000000000005,"5min":1.048,"15min":1.048},"last":0.72099999999999997}]},{"osd":10,"last update":"Mon Apr 1 06:54:40 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.79500000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574907,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36124,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93709028,"statfs":{"total":95995035648,"available":95958044672,"internally_reserved":0,"allocated":937984,"data_stored":486501,"data_compressed":1866,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:55:17 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.52700000000000002,"15min":0.47999999999999998},"min":{"1min":0.35699999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":4.4249999999999998,"5min":4.4249999999999998,"15min":4.4249999999999998},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.53000000000000003,"15min":0.48999999999999999},"min":{"1min":0.38400000000000001,"5min":0.312,"15min":0.312},"max":{"1min":2.363,"5min":2.363,"15min":2.363},"last":0.54200000000000004}]},{"osd":2,"last update":"Mon Apr 1 06:55:30 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.57799999999999996,"15min":0.54600000000000004},"min":{"1min":0.53700000000000003,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.81000000000000005,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.55300000000000005,"15min":0.52800000000000002},"min":{"1min":0.42899999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.80000000000000004,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.66700000000000004}]},{"osd":3,"last update":"Mon Apr 1 06:54:43 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.55400000000000005,"15min":0.53500000000000003},"min":{"1min":0.39700000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.58199999999999996,"15min":0.55000000000000004},"min":{"1min":0.48499999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.68600000000000005}]},{"osd":4,"last update":"Mon Apr 1 06:55:03 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.443,"15min":0.41199999999999998},"min":{"1min":0.379,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.46200000000000002,"15min":0.42099999999999999},"min":{"1min":0.35599999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.56299999999999994}]},{"osd":5,"last update":"Mon Apr 1 06:55:17 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.60899999999999999,"15min":0.59199999999999997},"min":{"1min":0.47499999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90100000000000002,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.58999999999999997,"15min":0.56699999999999995},"min":{"1min":0.34300000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.89700000000000002,"5min":1.081,"15min":1.081},"last":0.77900000000000003}]},{"osd":6,"last update":"Mon Apr 1 06:55:35 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.61799999999999999,"15min":0.56699999999999995},"min":{"1min":0.41599999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":5.4740000000000002,"5min":5.4740000000000002,"15min":5.4740000000000002},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.64500000000000002,"15min":0.58799999999999997},"min":{"1min":0.46300000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":5.5110000000000001,"5min":5.5110000000000001,"15min":5.5110000000000001},"last":0.63600000000000001}]},{"osd":7,"last update":"Mon Apr 1 06:54:48 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.59599999999999997,"15min":0.58299999999999996},"min":{"1min":0.436,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.63400000000000001,"15min":0.622},"min":{"1min":0.54800000000000004,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.90700000000000003,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.76100000000000001}]},{"osd":8,"last update":"Mon Apr 1 06:55:07 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.69699999999999995,"15min":0.69199999999999995},"min":{"1min":0.499,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.73899999999999999,"15min":0.73099999999999998},"min":{"1min":0.63700000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.94599999999999995,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.81799999999999995}]},{"osd":9,"last update":"Mon Apr 1 06:55:27 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.76900000000000002,"15min":0.745},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":5.6699999999999999,"5min":5.6699999999999999,"15min":5.6699999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.80600000000000005,"15min":0.78100000000000003},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":5.6189999999999998,"5min":5.6189999999999998,"15min":5.6189999999999998},"last":0.80300000000000005}]},{"osd":10,"last update":"Mon Apr 1 06:54:43 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.82799999999999996}]},{"osd":11,"last update":"Mon Apr 1 06:55:30 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.85499999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738430,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":901120,"data_stored":426665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Apr 1 06:55:09 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.48599999999999999,"15min":0.46800000000000003},"min":{"1min":0.379,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.625,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.47699999999999998,"15min":0.47099999999999997},"min":{"1min":0.33400000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.64300000000000002,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.42299999999999999}]},{"osd":2,"last update":"Mon Apr 1 06:55:30 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.48699999999999999,"15min":0.46700000000000003},"min":{"1min":0.33000000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.68000000000000005,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.48399999999999999,"15min":0.47899999999999998},"min":{"1min":0.35599999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.70499999999999996,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.35599999999999998}]},{"osd":3,"last update":"Mon Apr 1 06:55:30 2024","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.313},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.40300000000000002}]},{"osd":4,"last update":"Mon Apr 1 06:55:03 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.50900000000000001,"15min":0.501},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.71099999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.505},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.52500000000000002,"15min":0.51300000000000001},"min":{"1min":0.40799999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.69499999999999995,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.58999999999999997}]},{"osd":5,"last update":"Mon Apr 1 06:55:17 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.52900000000000003,"15min":0.52800000000000002},"min":{"1min":0.41499999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.65600000000000003,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.52100000000000002,"15min":0.52400000000000002},"min":{"1min":0.41999999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.67100000000000004,"5min":0.748,"15min":0.748},"last":0.46800000000000003}]},{"osd":6,"last update":"Mon Apr 1 06:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.44,"15min":0.436},"min":{"1min":0.33200000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.502,"15min":0.50600000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.48899999999999999}]},{"osd":7,"last update":"Mon Apr 1 06:53:50 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.46000000000000002}]},{"osd":8,"last update":"Mon Apr 1 06:55:09 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.623,"15min":0.63200000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.76500000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.623,"15min":0.63300000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.71699999999999997,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.51500000000000001}]},{"osd":9,"last update":"Mon Apr 1 06:55:26 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.56899999999999995,"15min":0.58199999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.71699999999999997,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.621,"15min":0.63600000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73599999999999999,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.52700000000000002}]},{"osd":10,"last update":"Mon Apr 1 06:54:43 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.64500000000000002}]},{"osd":11,"last update":"Mon Apr 1 06:55:03 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.67600000000000005}]}]},{"osd":2,"up_from":18,"seq":77309411383,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":487882,"data_compressed":1866,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:55:30 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.48699999999999999,"15min":0.46800000000000003},"min":{"1min":0.32900000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.70499999999999996,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47399999999999998,"15min":0.45800000000000002},"min":{"1min":0.34599999999999997,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.60299999999999998,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.36799999999999999}]},{"osd":1,"last update":"Mon Apr 1 06:55:30 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.55000000000000004,"15min":0.52200000000000002},"min":{"1min":0.46200000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.55500000000000005,"15min":0.54000000000000004},"min":{"1min":0.40699999999999997,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.63500000000000001}]},{"osd":3,"last update":"Mon Apr 1 06:54:45 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.53500000000000003,"15min":0.52900000000000003},"min":{"1min":0.40899999999999997,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.71199999999999997,"5min":0.748,"15min":0.748},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56200000000000006,"15min":0.54600000000000004},"min":{"1min":0.434,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77500000000000002,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.51000000000000001}]},{"osd":4,"last update":"Mon Apr 1 06:55:30 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.62},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.68400000000000005}]},{"osd":5,"last update":"Mon Apr 1 06:55:17 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.48599999999999999,"15min":0.45900000000000002},"min":{"1min":0.39800000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.81200000000000006,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.48399999999999999,"15min":0.46600000000000003},"min":{"1min":0.35199999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.29999999999999999}]},{"osd":6,"last update":"Mon Apr 1 06:55:33 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.60599999999999998,"15min":0.59799999999999998},"min":{"1min":0.48399999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.83299999999999996,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.63100000000000001,"15min":0.629},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.439}]},{"osd":7,"last update":"Mon Apr 1 06:53:49 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.60099999999999998}]},{"osd":8,"last update":"Mon Apr 1 06:55:06 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.67900000000000005,"15min":0.68200000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60599999999999998,"15min":0.60399999999999998},"min":{"1min":0.438,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.60899999999999999}]},{"osd":9,"last update":"Mon Apr 1 06:55:25 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.65600000000000003,"15min":0.65200000000000002},"min":{"1min":0.47999999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.61799999999999999,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.59499999999999997}]},{"osd":10,"last update":"Mon Apr 1 06:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.66600000000000004}]},{"osd":11,"last update":"Mon Apr 1 06:55:30 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.496}]}]},{"osd":3,"up_from":25,"seq":107374182451,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31992,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713160,"statfs":{"total":95995035648,"available":95962275840,"internally_reserved":0,"allocated":892928,"data_stored":425374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:54:41 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.33900000000000002,"15min":0.33000000000000002},"min":{"1min":0.29499999999999998,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.38},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.34599999999999997,"15min":0.33500000000000002},"min":{"1min":0.26400000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.57999999999999996,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.35899999999999999}]},{"osd":1,"last update":"Mon Apr 1 06:54:41 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.52900000000000003,"15min":0.51600000000000001},"min":{"1min":0.38800000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.51400000000000001,"15min":0.499},"min":{"1min":0.39400000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76900000000000002,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.66700000000000004}]},{"osd":2,"last update":"Mon Apr 1 06:54:41 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.52400000000000002,"15min":0.51400000000000001},"min":{"1min":0.35599999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.68899999999999995,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.54000000000000004,"15min":0.53000000000000003},"min":{"1min":0.41799999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.85199999999999998,"5min":0.874,"15min":0.874},"last":0.46200000000000002}]},{"osd":4,"last update":"Mon Apr 1 06:55:02 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53900000000000003,"15min":0.52700000000000002},"min":{"1min":0.40200000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.745,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56699999999999995,"15min":0.55700000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80600000000000005,"5min":1.131,"15min":1.131},"last":0.73799999999999999}]},{"osd":5,"last update":"Mon Apr 1 06:55:17 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.52100000000000002,"15min":0.51100000000000001},"min":{"1min":0.36899999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.71799999999999997,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.55800000000000005,"15min":0.55100000000000005},"min":{"1min":0.40699999999999997,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.71099999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.502}]},{"osd":6,"last update":"Mon Apr 1 06:55:36 2024","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.42999999999999999,"15min":0.42599999999999999},"min":{"1min":0.31900000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.64000000000000001,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.443,"5min":0.46999999999999997,"15min":0.46600000000000003},"min":{"1min":0.34100000000000003,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.67100000000000004,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.48699999999999999}]},{"osd":7,"last update":"Mon Apr 1 06:54:56 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.42199999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.75700000000000001,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.63300000000000001,"15min":0.63500000000000001},"min":{"1min":0.41499999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.85799999999999998,"5min":1.171,"15min":1.171},"last":0.76400000000000001}]},{"osd":8,"last update":"Mon Apr 1 06:54:04 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.71999999999999997}]},{"osd":9,"last update":"Mon Apr 1 06:55:27 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.628,"15min":0.64400000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.745,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.496,"5min":0.61299999999999999,"15min":0.63300000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68899999999999995,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.40999999999999998}]},{"osd":10,"last update":"Mon Apr 1 06:54:40 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.65600000000000003}]},{"osd":11,"last update":"Mon Apr 1 06:55:31 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.70199999999999996}]}]},{"osd":4,"up_from":32,"seq":137438953521,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":884736,"data_stored":426490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:54:02 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.496,"15min":0.48799999999999999},"min":{"1min":0.34899999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.433},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.48299999999999998,"15min":0.47699999999999998},"min":{"1min":0.30399999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.41799999999999998}]},{"osd":1,"last update":"Mon Apr 1 06:55:03 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.35199999999999998,"15min":0.33400000000000002},"min":{"1min":0.251,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.36499999999999999,"15min":0.35299999999999998},"min":{"1min":0.29099999999999998,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.48199999999999998}]},{"osd":2,"last update":"Mon Apr 1 06:55:03 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.51200000000000001,"15min":0.496},"min":{"1min":0.435,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.52100000000000002,"15min":0.48899999999999999},"min":{"1min":0.40699999999999997,"5min":0.316,"15min":0.316},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.73899999999999999}]},{"osd":3,"last update":"Mon Apr 1 06:55:03 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.53400000000000003,"15min":0.52900000000000003},"min":{"1min":0.36899999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.73499999999999999,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.51400000000000001,"15min":0.498},"min":{"1min":0.39200000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.63900000000000001}]},{"osd":5,"last update":"Mon Apr 1 06:55:17 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.56999999999999995,"15min":0.55200000000000005},"min":{"1min":0.45800000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.84099999999999997,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.628},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.44700000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.74399999999999999}]},{"osd":6,"last update":"Mon Apr 1 06:55:39 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.53500000000000003,"15min":0.53700000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.61599999999999999,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.65500000000000003,"15min":0.66900000000000004},"min":{"1min":0.42999999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.71699999999999997,"5min":2.52,"15min":2.52},"last":0.66800000000000004}]},{"osd":7,"last update":"Mon Apr 1 06:54:48 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.34200000000000003,"5min":0.316,"15min":0.316},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.51500000000000001,"15min":0.51200000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.51100000000000001}]},{"osd":8,"last update":"Mon Apr 1 06:55:06 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.58599999999999997,"15min":0.57699999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.65400000000000003,"15min":0.64300000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.83299999999999996}]},{"osd":9,"last update":"Mon Apr 1 06:55:22 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.65000000000000002,"15min":0.64700000000000002},"min":{"1min":0.53800000000000003,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.72199999999999998,"15min":0.72499999999999998},"min":{"1min":0.60799999999999998,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":0.85499999999999998,"5min":1.119,"15min":1.119},"last":0.71399999999999997}]},{"osd":10,"last update":"Mon Apr 1 06:54:43 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.78400000000000003}]},{"osd":11,"last update":"Mon Apr 1 06:55:27 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.87}]}]},{"osd":5,"up_from":36,"seq":154618822701,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32052,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713100,"statfs":{"total":95995035648,"available":95962214400,"internally_reserved":0,"allocated":954368,"data_stored":1017493,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:55:14 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.501,"15min":0.48499999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.63900000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.498,"5min":0.499,"15min":0.49299999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.69299999999999995,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.52300000000000002}]},{"osd":1,"last update":"Mon Apr 1 06:55:14 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.54800000000000004,"15min":0.53000000000000003},"min":{"1min":0.39800000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.54900000000000004,"15min":0.53300000000000003},"min":{"1min":0.39900000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.75800000000000001}]},{"osd":2,"last update":"Mon Apr 1 06:55:14 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.39800000000000002,"15min":0.38800000000000001},"min":{"1min":0.27500000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.503},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.40799999999999997,"15min":0.40300000000000002},"min":{"1min":0.29499999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.64200000000000002}]},{"osd":3,"last update":"Mon Apr 1 06:55:14 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54500000000000004,"15min":0.54800000000000004},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.67100000000000004,"5min":1.389,"15min":1.389},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.63,"15min":0.66600000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.65400000000000003,"5min":3.9540000000000002,"15min":3.9540000000000002},"last":0.69199999999999995}]},{"osd":4,"last update":"Mon Apr 1 06:55:14 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.57099999999999995,"15min":0.55300000000000005},"min":{"1min":0.39700000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.60199999999999998,"15min":0.59299999999999997},"min":{"1min":0.45600000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.72899999999999998}]},{"osd":6,"last update":"Mon Apr 1 06:55:37 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.56699999999999995,"15min":0.55600000000000005},"min":{"1min":0.42299999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.78900000000000003,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.58299999999999996,"15min":0.57499999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.72799999999999998,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.746}]},{"osd":7,"last update":"Mon Apr 1 06:54:49 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64200000000000002,"15min":0.64000000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.86499999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.65600000000000003,"15min":0.65000000000000002},"min":{"1min":0.53000000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.85799999999999998}]},{"osd":8,"last update":"Mon Apr 1 06:55:05 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.622,"15min":0.623},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.61199999999999999,"15min":0.60799999999999998},"min":{"1min":0.42999999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.621}]},{"osd":9,"last update":"Mon Apr 1 06:55:26 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.65700000000000003,"15min":0.65100000000000002},"min":{"1min":0.50900000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.67200000000000004,"15min":0.66500000000000004},"min":{"1min":0.50700000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.81499999999999995}]},{"osd":10,"last update":"Mon Apr 1 06:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.89000000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34069,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34069,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":61314,"data_compressed":1866,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":62695,"data_compressed":1866,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":63551,"data_compressed":1866,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T06:55:42.333 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-01T06:55:42.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.488+0000 7fcd0fbc7700 1 -- 172.21.15.83:0/3905962098 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcd081016d0 msgr2=0x7fcd08107f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:42.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.488+0000 7fcd0fbc7700 1 --2- 172.21.15.83:0/3905962098 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcd081016d0 0x7fcd08107f80 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fcd0000b0d0 tx=0x7fcd0000b3e0 comp rx=0 tx=0).stop 2024-04-01T06:55:42.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.488+0000 7fcd0fbc7700 1 -- 172.21.15.83:0/3905962098 shutdown_connections 2024-04-01T06:55:42.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.488+0000 7fcd0fbc7700 1 --2- 172.21.15.83:0/3905962098 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcd081016d0 0x7fcd08107f80 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:42.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.488+0000 7fcd0fbc7700 1 --2- 172.21.15.83:0/3905962098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd080ffb40 0x7fcd080fff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:42.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.488+0000 7fcd0fbc7700 1 --2- 172.21.15.83:0/3905962098 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcd08100d30 0x7fcd08101190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:42.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.488+0000 7fcd0fbc7700 1 -- 172.21.15.83:0/3905962098 >> 172.21.15.83:0/3905962098 conn(0x7fcd080fb0b0 msgr2=0x7fcd080fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:42.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.488+0000 7fcd0fbc7700 1 -- 172.21.15.83:0/3905962098 shutdown_connections 2024-04-01T06:55:42.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.488+0000 7fcd0fbc7700 1 -- 172.21.15.83:0/3905962098 wait complete. 2024-04-01T06:55:42.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.489+0000 7fcd0fbc7700 1 Processor -- start 2024-04-01T06:55:42.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.489+0000 7fcd0fbc7700 1 -- start start 2024-04-01T06:55:42.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.489+0000 7fcd0fbc7700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcd080ffb40 0x7fcd08195aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:42.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.489+0000 7fcd0fbc7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd08100d30 0x7fcd08195fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:42.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.489+0000 7fcd0fbc7700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcd081016d0 0x7fcd0819d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:42.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.489+0000 7fcd0fbc7700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0819d5d0 con 0x7fcd080ffb40 2024-04-01T06:55:42.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.489+0000 7fcd0fbc7700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0819d710 con 0x7fcd081016d0 2024-04-01T06:55:42.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.489+0000 7fcd0fbc7700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0819d8a0 con 0x7fcd08100d30 2024-04-01T06:55:42.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.489+0000 7fcd0d963700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcd080ffb40 0x7fcd08195aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:42.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.489+0000 7fcd0d963700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcd080ffb40 0x7fcd08195aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:47086/0 (socket says 172.21.15.83:47086) 2024-04-01T06:55:42.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.489+0000 7fcd0d963700 1 -- 172.21.15.83:0/444095579 learned_addr learned my addr 172.21.15.83:0/444095579 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:42.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.489+0000 7fcd0d162700 1 --2- 172.21.15.83:0/444095579 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd08100d30 0x7fcd08195fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:42.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.489+0000 7fcd0d963700 1 -- 172.21.15.83:0/444095579 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd08100d30 msgr2=0x7fcd08195fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:42.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.489+0000 7fcd0d963700 1 --2- 172.21.15.83:0/444095579 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd08100d30 0x7fcd08195fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:42.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.489+0000 7fcd0d963700 1 -- 172.21.15.83:0/444095579 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcd081016d0 msgr2=0x7fcd0819d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:42.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.489+0000 7fcd0d963700 1 --2- 172.21.15.83:0/444095579 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcd081016d0 0x7fcd0819d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:42.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.489+0000 7fcd0d963700 1 -- 172.21.15.83:0/444095579 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd00009d00 con 0x7fcd080ffb40 2024-04-01T06:55:42.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.490+0000 7fcd0d963700 1 --2- 172.21.15.83:0/444095579 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcd080ffb40 0x7fcd08195aa0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fccfc00c970 tx=0x7fccfc00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:42.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.490+0000 7fccfaffd700 1 -- 172.21.15.83:0/444095579 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccfc004220 con 0x7fcd080ffb40 2024-04-01T06:55:42.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.490+0000 7fccfaffd700 1 -- 172.21.15.83:0/444095579 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fccfc007d60 con 0x7fcd080ffb40 2024-04-01T06:55:42.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.490+0000 7fcd0fbc7700 1 -- 172.21.15.83:0/444095579 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd0819db80 con 0x7fcd080ffb40 2024-04-01T06:55:42.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.490+0000 7fccfaffd700 1 -- 172.21.15.83:0/444095579 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccfc003c90 con 0x7fcd080ffb40 2024-04-01T06:55:42.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.490+0000 7fcd0fbc7700 1 -- 172.21.15.83:0/444095579 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd0819e0e0 con 0x7fcd080ffb40 2024-04-01T06:55:42.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.491+0000 7fcd0fbc7700 1 -- 172.21.15.83:0/444095579 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd08106e90 con 0x7fcd080ffb40 2024-04-01T06:55:42.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.492+0000 7fccfaffd700 1 -- 172.21.15.83:0/444095579 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7fccfc004380 con 0x7fcd080ffb40 2024-04-01T06:55:42.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.492+0000 7fccfaffd700 1 --2- 172.21.15.83:0/444095579 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fccf40a1230 0x7fccf40a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:42.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.492+0000 7fcd0d162700 1 --2- 172.21.15.83:0/444095579 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fccf40a1230 0x7fccf40a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:42.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.492+0000 7fccfaffd700 1 -- 172.21.15.83:0/444095579 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fccfc0cc820 con 0x7fcd080ffb40 2024-04-01T06:55:42.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.493+0000 7fcd0d162700 1 --2- 172.21.15.83:0/444095579 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fccf40a1230 0x7fccf40a36f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fcd0400ac50 tx=0x7fcd0400a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:42.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.496+0000 7fccfaffd700 1 -- 172.21.15.83:0/444095579 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7fccfc095ff0 con 0x7fcd080ffb40 2024-04-01T06:55:42.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.690+0000 7fcd0fbc7700 1 -- 172.21.15.83:0/444095579 --> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcd0802cdc0 con 0x7fccf40a1230 2024-04-01T06:55:42.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.700+0000 7fccfaffd700 1 -- 172.21.15.83:0/444095579 <== mgr.14152 v2:172.21.15.83:6800/3375372052 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344736 (secure 0 0 0) 0x7fcd0802cdc0 con 0x7fccf40a1230 2024-04-01T06:55:42.704 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:55:42.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.704+0000 7fcd0fbc7700 1 -- 172.21.15.83:0/444095579 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fccf40a1230 msgr2=0x7fccf40a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:42.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.704+0000 7fcd0fbc7700 1 --2- 172.21.15.83:0/444095579 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fccf40a1230 0x7fccf40a36f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fcd0400ac50 tx=0x7fcd0400a380 comp rx=0 tx=0).stop 2024-04-01T06:55:42.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.704+0000 7fcd0fbc7700 1 -- 172.21.15.83:0/444095579 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcd080ffb40 msgr2=0x7fcd08195aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:42.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.704+0000 7fcd0fbc7700 1 --2- 172.21.15.83:0/444095579 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcd080ffb40 0x7fcd08195aa0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fccfc00c970 tx=0x7fccfc00cc80 comp rx=0 tx=0).stop 2024-04-01T06:55:42.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.704+0000 7fcd0fbc7700 1 -- 172.21.15.83:0/444095579 shutdown_connections 2024-04-01T06:55:42.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.704+0000 7fcd0fbc7700 1 --2- 172.21.15.83:0/444095579 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcd080ffb40 0x7fcd08195aa0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:42.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.704+0000 7fcd0fbc7700 1 --2- 172.21.15.83:0/444095579 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fccf40a1230 0x7fccf40a36f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:42.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.704+0000 7fcd0fbc7700 1 --2- 172.21.15.83:0/444095579 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcd081016d0 0x7fcd0819d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:42.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.704+0000 7fcd0fbc7700 1 --2- 172.21.15.83:0/444095579 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd08100d30 0x7fcd08195fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:42.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.704+0000 7fcd0fbc7700 1 -- 172.21.15.83:0/444095579 >> 172.21.15.83:0/444095579 conn(0x7fcd080fb0b0 msgr2=0x7fcd08103fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:42.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.704+0000 7fcd0fbc7700 1 -- 172.21.15.83:0/444095579 shutdown_connections 2024-04-01T06:55:42.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.704+0000 7fcd0fbc7700 1 -- 172.21.15.83:0/444095579 wait complete. 2024-04-01T06:55:42.708 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-04-01T06:55:42.716 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":255,"stamp":"2024-04-01T06:55:41.730451+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656530,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":559,"num_read_kb":400,"num_write":338,"num_write_kb":3051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":292,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":363716,"kb_used_data":10780,"kb_used_omap":18,"kb_used_meta":352749,"kb_avail":1124578108,"statfs":{"total":1151940427776,"available":1151567982592,"internally_reserved":0,"allocated":11038720,"data_stored":7070544,"data_compressed":112716,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":19130,"internal_metadata":361215302},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":628,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":22,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.025599"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716372+0000","last_change":"2024-04-01T06:54:28.426588+0000","last_active":"2024-04-01T06:55:33.716372+0000","last_peered":"2024-04-01T06:55:33.716372+0000","last_clean":"2024-04-01T06:55:33.716372+0000","last_became_active":"2024-04-01T06:54:28.423723+0000","last_became_peered":"2024-04-01T06:54:28.423723+0000","last_unstale":"2024-04-01T06:55:33.716372+0000","last_undegraded":"2024-04-01T06:55:33.716372+0000","last_fullsized":"2024-04-01T06:55:33.716372+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:52:38.856474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716446+0000","last_change":"2024-04-01T06:54:28.419858+0000","last_active":"2024-04-01T06:55:33.716446+0000","last_peered":"2024-04-01T06:55:33.716446+0000","last_clean":"2024-04-01T06:55:33.716446+0000","last_became_active":"2024-04-01T06:54:28.419534+0000","last_became_peered":"2024-04-01T06:54:28.419534+0000","last_unstale":"2024-04-01T06:55:33.716446+0000","last_undegraded":"2024-04-01T06:55:33.716446+0000","last_fullsized":"2024-04-01T06:55:33.716446+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:26:56.349672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716134+0000","last_change":"2024-04-01T06:54:28.422763+0000","last_active":"2024-04-01T06:55:33.716134+0000","last_peered":"2024-04-01T06:55:33.716134+0000","last_clean":"2024-04-01T06:55:33.716134+0000","last_became_active":"2024-04-01T06:54:28.422439+0000","last_became_peered":"2024-04-01T06:54:28.422439+0000","last_unstale":"2024-04-01T06:55:33.716134+0000","last_undegraded":"2024-04-01T06:55:33.716134+0000","last_fullsized":"2024-04-01T06:55:33.716134+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:55:24.379428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.714265+0000","last_change":"2024-04-01T06:54:28.421996+0000","last_active":"2024-04-01T06:55:33.714265+0000","last_peered":"2024-04-01T06:55:33.714265+0000","last_clean":"2024-04-01T06:55:33.714265+0000","last_became_active":"2024-04-01T06:54:28.421594+0000","last_became_peered":"2024-04-01T06:54:28.421594+0000","last_unstale":"2024-04-01T06:55:33.714265+0000","last_undegraded":"2024-04-01T06:55:33.714265+0000","last_fullsized":"2024-04-01T06:55:33.714265+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:36:53.200615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.714110+0000","last_change":"2024-04-01T06:54:28.415652+0000","last_active":"2024-04-01T06:55:33.714110+0000","last_peered":"2024-04-01T06:55:33.714110+0000","last_clean":"2024-04-01T06:55:33.714110+0000","last_became_active":"2024-04-01T06:54:28.415296+0000","last_became_peered":"2024-04-01T06:54:28.415296+0000","last_unstale":"2024-04-01T06:55:33.714110+0000","last_undegraded":"2024-04-01T06:55:33.714110+0000","last_fullsized":"2024-04-01T06:55:33.714110+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:36:36.967298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.708136+0000","last_change":"2024-04-01T06:54:28.421188+0000","last_active":"2024-04-01T06:55:33.708136+0000","last_peered":"2024-04-01T06:55:33.708136+0000","last_clean":"2024-04-01T06:55:33.708136+0000","last_became_active":"2024-04-01T06:54:28.420863+0000","last_became_peered":"2024-04-01T06:54:28.420863+0000","last_unstale":"2024-04-01T06:55:33.708136+0000","last_undegraded":"2024-04-01T06:55:33.708136+0000","last_fullsized":"2024-04-01T06:55:33.708136+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:40:38.641128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:34.126221+0000","last_change":"2024-04-01T06:54:28.422554+0000","last_active":"2024-04-01T06:55:34.126221+0000","last_peered":"2024-04-01T06:55:34.126221+0000","last_clean":"2024-04-01T06:55:34.126221+0000","last_became_active":"2024-04-01T06:54:28.422209+0000","last_became_peered":"2024-04-01T06:54:28.422209+0000","last_unstale":"2024-04-01T06:55:34.126221+0000","last_undegraded":"2024-04-01T06:55:34.126221+0000","last_fullsized":"2024-04-01T06:55:34.126221+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T14:59:45.017681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.708816+0000","last_change":"2024-04-01T06:54:28.419291+0000","last_active":"2024-04-01T06:55:33.708816+0000","last_peered":"2024-04-01T06:55:33.708816+0000","last_clean":"2024-04-01T06:55:33.708816+0000","last_became_active":"2024-04-01T06:54:28.419013+0000","last_became_peered":"2024-04-01T06:54:28.419013+0000","last_unstale":"2024-04-01T06:55:33.708816+0000","last_undegraded":"2024-04-01T06:55:33.708816+0000","last_fullsized":"2024-04-01T06:55:33.708816+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:45:08.226568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716052+0000","last_change":"2024-04-01T06:54:28.410264+0000","last_active":"2024-04-01T06:55:33.716052+0000","last_peered":"2024-04-01T06:55:33.716052+0000","last_clean":"2024-04-01T06:55:33.716052+0000","last_became_active":"2024-04-01T06:54:28.409959+0000","last_became_peered":"2024-04-01T06:54:28.409959+0000","last_unstale":"2024-04-01T06:55:33.716052+0000","last_undegraded":"2024-04-01T06:55:33.716052+0000","last_fullsized":"2024-04-01T06:55:33.716052+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:14:13.184396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.708298+0000","last_change":"2024-04-01T06:54:28.422115+0000","last_active":"2024-04-01T06:55:33.708298+0000","last_peered":"2024-04-01T06:55:33.708298+0000","last_clean":"2024-04-01T06:55:33.708298+0000","last_became_active":"2024-04-01T06:54:28.421629+0000","last_became_peered":"2024-04-01T06:54:28.421629+0000","last_unstale":"2024-04-01T06:55:33.708298+0000","last_undegraded":"2024-04-01T06:55:33.708298+0000","last_fullsized":"2024-04-01T06:55:33.708298+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:47:03.271557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:34.126524+0000","last_change":"2024-04-01T06:54:28.429652+0000","last_active":"2024-04-01T06:55:34.126524+0000","last_peered":"2024-04-01T06:55:34.126524+0000","last_clean":"2024-04-01T06:55:34.126524+0000","last_became_active":"2024-04-01T06:54:28.429298+0000","last_became_peered":"2024-04-01T06:54:28.429298+0000","last_unstale":"2024-04-01T06:55:34.126524+0000","last_undegraded":"2024-04-01T06:55:34.126524+0000","last_fullsized":"2024-04-01T06:55:34.126524+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:03:16.110580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-01T06:55:34.715630+0000","last_change":"2024-04-01T06:55:34.715262+0000","last_active":"2024-04-01T06:55:34.715630+0000","last_peered":"2024-04-01T06:55:34.715630+0000","last_clean":"2024-04-01T06:55:34.715630+0000","last_became_active":"2024-04-01T06:55:34.714990+0000","last_became_peered":"2024-04-01T06:55:34.714990+0000","last_unstale":"2024-04-01T06:55:34.715630+0000","last_undegraded":"2024-04-01T06:55:34.715630+0000","last_fullsized":"2024-04-01T06:55:34.715630+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:26:24.665741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716196+0000","last_change":"2024-04-01T06:54:28.419390+0000","last_active":"2024-04-01T06:55:33.716196+0000","last_peered":"2024-04-01T06:55:33.716196+0000","last_clean":"2024-04-01T06:55:33.716196+0000","last_became_active":"2024-04-01T06:54:28.419110+0000","last_became_peered":"2024-04-01T06:54:28.419110+0000","last_unstale":"2024-04-01T06:55:33.716196+0000","last_undegraded":"2024-04-01T06:55:33.716196+0000","last_fullsized":"2024-04-01T06:55:33.716196+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:21:52.192681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716042+0000","last_change":"2024-04-01T06:54:28.419416+0000","last_active":"2024-04-01T06:55:33.716042+0000","last_peered":"2024-04-01T06:55:33.716042+0000","last_clean":"2024-04-01T06:55:33.716042+0000","last_became_active":"2024-04-01T06:54:28.419099+0000","last_became_peered":"2024-04-01T06:54:28.419099+0000","last_unstale":"2024-04-01T06:55:33.716042+0000","last_undegraded":"2024-04-01T06:55:33.716042+0000","last_fullsized":"2024-04-01T06:55:33.716042+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:26:44.889806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716363+0000","last_change":"2024-04-01T06:54:28.427391+0000","last_active":"2024-04-01T06:55:33.716363+0000","last_peered":"2024-04-01T06:55:33.716363+0000","last_clean":"2024-04-01T06:55:33.716363+0000","last_became_active":"2024-04-01T06:54:28.427153+0000","last_became_peered":"2024-04-01T06:54:28.427153+0000","last_unstale":"2024-04-01T06:55:33.716363+0000","last_undegraded":"2024-04-01T06:55:33.716363+0000","last_fullsized":"2024-04-01T06:55:33.716363+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:42:41.084729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.715722+0000","last_change":"2024-04-01T06:54:28.417088+0000","last_active":"2024-04-01T06:55:33.715722+0000","last_peered":"2024-04-01T06:55:33.715722+0000","last_clean":"2024-04-01T06:55:33.715722+0000","last_became_active":"2024-04-01T06:54:28.416747+0000","last_became_peered":"2024-04-01T06:54:28.416747+0000","last_unstale":"2024-04-01T06:55:33.715722+0000","last_undegraded":"2024-04-01T06:55:33.715722+0000","last_fullsized":"2024-04-01T06:55:33.715722+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:59:14.069761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716603+0000","last_change":"2024-04-01T06:54:28.426049+0000","last_active":"2024-04-01T06:55:33.716603+0000","last_peered":"2024-04-01T06:55:33.716603+0000","last_clean":"2024-04-01T06:55:33.716603+0000","last_became_active":"2024-04-01T06:54:28.425723+0000","last_became_peered":"2024-04-01T06:54:28.425723+0000","last_unstale":"2024-04-01T06:55:33.716603+0000","last_undegraded":"2024-04-01T06:55:33.716603+0000","last_fullsized":"2024-04-01T06:55:33.716603+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:48:59.394352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.712623+0000","last_change":"2024-04-01T06:54:28.421574+0000","last_active":"2024-04-01T06:55:33.712623+0000","last_peered":"2024-04-01T06:55:33.712623+0000","last_clean":"2024-04-01T06:55:33.712623+0000","last_became_active":"2024-04-01T06:54:28.420852+0000","last_became_peered":"2024-04-01T06:54:28.420852+0000","last_unstale":"2024-04-01T06:55:33.712623+0000","last_undegraded":"2024-04-01T06:55:33.712623+0000","last_fullsized":"2024-04-01T06:55:33.712623+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:20:30.373285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.715566+0000","last_change":"2024-04-01T06:54:28.419249+0000","last_active":"2024-04-01T06:55:33.715566+0000","last_peered":"2024-04-01T06:55:33.715566+0000","last_clean":"2024-04-01T06:55:33.715566+0000","last_became_active":"2024-04-01T06:54:28.418931+0000","last_became_peered":"2024-04-01T06:54:28.418931+0000","last_unstale":"2024-04-01T06:55:33.715566+0000","last_undegraded":"2024-04-01T06:55:33.715566+0000","last_fullsized":"2024-04-01T06:55:33.715566+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:38:04.786657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"79'9","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.712433+0000","last_change":"2024-04-01T06:54:27.993489+0000","last_active":"2024-04-01T06:55:33.712433+0000","last_peered":"2024-04-01T06:55:33.712433+0000","last_clean":"2024-04-01T06:55:33.712433+0000","last_became_active":"2024-04-01T06:54:27.993201+0000","last_became_peered":"2024-04-01T06:54:27.993201+0000","last_unstale":"2024-04-01T06:55:33.712433+0000","last_undegraded":"2024-04-01T06:55:33.712433+0000","last_fullsized":"2024-04-01T06:55:33.712433+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:10:53.897013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.709212+0000","last_change":"2024-04-01T06:54:28.417750+0000","last_active":"2024-04-01T06:55:33.709212+0000","last_peered":"2024-04-01T06:55:33.709212+0000","last_clean":"2024-04-01T06:55:33.709212+0000","last_became_active":"2024-04-01T06:54:28.417470+0000","last_became_peered":"2024-04-01T06:54:28.417470+0000","last_unstale":"2024-04-01T06:55:33.709212+0000","last_undegraded":"2024-04-01T06:55:33.709212+0000","last_fullsized":"2024-04-01T06:55:33.709212+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:06:12.668846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"79'2","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.709258+0000","last_change":"2024-04-01T06:54:27.998302+0000","last_active":"2024-04-01T06:55:33.709258+0000","last_peered":"2024-04-01T06:55:33.709258+0000","last_clean":"2024-04-01T06:55:33.709258+0000","last_became_active":"2024-04-01T06:54:27.997951+0000","last_became_peered":"2024-04-01T06:54:27.997951+0000","last_unstale":"2024-04-01T06:55:33.709258+0000","last_undegraded":"2024-04-01T06:55:33.709258+0000","last_fullsized":"2024-04-01T06:55:33.709258+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:28:45.076734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716591+0000","last_change":"2024-04-01T06:54:28.415641+0000","last_active":"2024-04-01T06:55:33.716591+0000","last_peered":"2024-04-01T06:55:33.716591+0000","last_clean":"2024-04-01T06:55:33.716591+0000","last_became_active":"2024-04-01T06:54:28.415305+0000","last_became_peered":"2024-04-01T06:54:28.415305+0000","last_unstale":"2024-04-01T06:55:33.716591+0000","last_undegraded":"2024-04-01T06:55:33.716591+0000","last_fullsized":"2024-04-01T06:55:33.716591+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:01:46.528332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"79'4","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.714604+0000","last_change":"2024-04-01T06:54:27.990581+0000","last_active":"2024-04-01T06:55:33.714604+0000","last_peered":"2024-04-01T06:55:33.714604+0000","last_clean":"2024-04-01T06:55:33.714604+0000","last_became_active":"2024-04-01T06:54:27.990099+0000","last_became_peered":"2024-04-01T06:54:27.990099+0000","last_unstale":"2024-04-01T06:55:33.714604+0000","last_undegraded":"2024-04-01T06:55:33.714604+0000","last_fullsized":"2024-04-01T06:55:33.714604+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T14:53:49.183394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.715962+0000","last_change":"2024-04-01T06:54:28.423208+0000","last_active":"2024-04-01T06:55:33.715962+0000","last_peered":"2024-04-01T06:55:33.715962+0000","last_clean":"2024-04-01T06:55:33.715962+0000","last_became_active":"2024-04-01T06:54:28.422648+0000","last_became_peered":"2024-04-01T06:54:28.422648+0000","last_unstale":"2024-04-01T06:55:33.715962+0000","last_undegraded":"2024-04-01T06:55:33.715962+0000","last_fullsized":"2024-04-01T06:55:33.715962+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:02:58.380288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-01T06:55:34.718704+0000","last_change":"2024-04-01T06:55:34.718293+0000","last_active":"2024-04-01T06:55:34.718704+0000","last_peered":"2024-04-01T06:55:34.718704+0000","last_clean":"2024-04-01T06:55:34.718704+0000","last_became_active":"2024-04-01T06:55:34.715149+0000","last_became_peered":"2024-04-01T06:55:34.715149+0000","last_unstale":"2024-04-01T06:55:34.718704+0000","last_undegraded":"2024-04-01T06:55:34.718704+0000","last_fullsized":"2024-04-01T06:55:34.718704+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:03:55.371430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.711859+0000","last_change":"2024-04-01T06:54:28.422448+0000","last_active":"2024-04-01T06:55:33.711859+0000","last_peered":"2024-04-01T06:55:33.711859+0000","last_clean":"2024-04-01T06:55:33.711859+0000","last_became_active":"2024-04-01T06:54:28.422080+0000","last_became_peered":"2024-04-01T06:54:28.422080+0000","last_unstale":"2024-04-01T06:55:33.711859+0000","last_undegraded":"2024-04-01T06:55:33.711859+0000","last_fullsized":"2024-04-01T06:55:33.711859+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:03:23.686194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"79'6","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-01T06:55:35.804863+0000","last_change":"2024-04-01T06:54:27.998822+0000","last_active":"2024-04-01T06:55:35.804863+0000","last_peered":"2024-04-01T06:55:35.804863+0000","last_clean":"2024-04-01T06:55:35.804863+0000","last_became_active":"2024-04-01T06:54:27.998514+0000","last_became_peered":"2024-04-01T06:54:27.998514+0000","last_unstale":"2024-04-01T06:55:35.804863+0000","last_undegraded":"2024-04-01T06:55:35.804863+0000","last_fullsized":"2024-04-01T06:55:35.804863+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T14:21:28.340169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.714245+0000","last_change":"2024-04-01T06:54:28.415825+0000","last_active":"2024-04-01T06:55:33.714245+0000","last_peered":"2024-04-01T06:55:33.714245+0000","last_clean":"2024-04-01T06:55:33.714245+0000","last_became_active":"2024-04-01T06:54:28.413679+0000","last_became_peered":"2024-04-01T06:54:28.413679+0000","last_unstale":"2024-04-01T06:55:33.714245+0000","last_undegraded":"2024-04-01T06:55:33.714245+0000","last_fullsized":"2024-04-01T06:55:33.714245+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:13:19.907109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"79'3","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.707943+0000","last_change":"2024-04-01T06:54:27.994194+0000","last_active":"2024-04-01T06:55:33.707943+0000","last_peered":"2024-04-01T06:55:33.707943+0000","last_clean":"2024-04-01T06:55:33.707943+0000","last_became_active":"2024-04-01T06:54:27.993868+0000","last_became_peered":"2024-04-01T06:54:27.993868+0000","last_unstale":"2024-04-01T06:55:33.707943+0000","last_undegraded":"2024-04-01T06:55:33.707943+0000","last_fullsized":"2024-04-01T06:55:33.707943+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:55:17.003472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.711732+0000","last_change":"2024-04-01T06:54:28.412629+0000","last_active":"2024-04-01T06:55:33.711732+0000","last_peered":"2024-04-01T06:55:33.711732+0000","last_clean":"2024-04-01T06:55:33.711732+0000","last_became_active":"2024-04-01T06:54:28.412291+0000","last_became_peered":"2024-04-01T06:54:28.412291+0000","last_unstale":"2024-04-01T06:55:33.711732+0000","last_undegraded":"2024-04-01T06:55:33.711732+0000","last_fullsized":"2024-04-01T06:55:33.711732+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:29:14.007470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"79'2","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716127+0000","last_change":"2024-04-01T06:54:27.996570+0000","last_active":"2024-04-01T06:55:33.716127+0000","last_peered":"2024-04-01T06:55:33.716127+0000","last_clean":"2024-04-01T06:55:33.716127+0000","last_became_active":"2024-04-01T06:54:27.994897+0000","last_became_peered":"2024-04-01T06:54:27.994897+0000","last_unstale":"2024-04-01T06:55:33.716127+0000","last_undegraded":"2024-04-01T06:55:33.716127+0000","last_fullsized":"2024-04-01T06:55:33.716127+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:53:05.733608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.708757+0000","last_change":"2024-04-01T06:54:28.413701+0000","last_active":"2024-04-01T06:55:33.708757+0000","last_peered":"2024-04-01T06:55:33.708757+0000","last_clean":"2024-04-01T06:55:33.708757+0000","last_became_active":"2024-04-01T06:54:28.413435+0000","last_became_peered":"2024-04-01T06:54:28.413435+0000","last_unstale":"2024-04-01T06:55:33.708757+0000","last_undegraded":"2024-04-01T06:55:33.708757+0000","last_fullsized":"2024-04-01T06:55:33.708757+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:43:27.835398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.711515+0000","last_change":"2024-04-01T06:54:28.001115+0000","last_active":"2024-04-01T06:55:33.711515+0000","last_peered":"2024-04-01T06:55:33.711515+0000","last_clean":"2024-04-01T06:55:33.711515+0000","last_became_active":"2024-04-01T06:54:28.000732+0000","last_became_peered":"2024-04-01T06:54:28.000732+0000","last_unstale":"2024-04-01T06:55:33.711515+0000","last_undegraded":"2024-04-01T06:55:33.711515+0000","last_fullsized":"2024-04-01T06:55:33.711515+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:06:02.064402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.712248+0000","last_change":"2024-04-01T06:54:28.421670+0000","last_active":"2024-04-01T06:55:33.712248+0000","last_peered":"2024-04-01T06:55:33.712248+0000","last_clean":"2024-04-01T06:55:33.712248+0000","last_became_active":"2024-04-01T06:54:28.421335+0000","last_became_peered":"2024-04-01T06:54:28.421335+0000","last_unstale":"2024-04-01T06:55:33.712248+0000","last_undegraded":"2024-04-01T06:55:33.712248+0000","last_fullsized":"2024-04-01T06:55:33.712248+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:25:55.223397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"79'3","reported_seq":82,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-01T06:55:36.805774+0000","last_change":"2024-04-01T06:54:27.999413+0000","last_active":"2024-04-01T06:55:36.805774+0000","last_peered":"2024-04-01T06:55:36.805774+0000","last_clean":"2024-04-01T06:55:36.805774+0000","last_became_active":"2024-04-01T06:54:27.999123+0000","last_became_peered":"2024-04-01T06:54:27.999123+0000","last_unstale":"2024-04-01T06:55:36.805774+0000","last_undegraded":"2024-04-01T06:55:36.805774+0000","last_fullsized":"2024-04-01T06:55:36.805774+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:30:06.399907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":65,"num_read_kb":65,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716818+0000","last_change":"2024-04-01T06:54:28.423843+0000","last_active":"2024-04-01T06:55:33.716818+0000","last_peered":"2024-04-01T06:55:33.716818+0000","last_clean":"2024-04-01T06:55:33.716818+0000","last_became_active":"2024-04-01T06:54:28.423538+0000","last_became_peered":"2024-04-01T06:54:28.423538+0000","last_unstale":"2024-04-01T06:55:33.716818+0000","last_undegraded":"2024-04-01T06:55:33.716818+0000","last_fullsized":"2024-04-01T06:55:33.716818+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:51:23.986409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'2","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:34.126438+0000","last_change":"2024-04-01T06:54:27.997137+0000","last_active":"2024-04-01T06:55:34.126438+0000","last_peered":"2024-04-01T06:55:34.126438+0000","last_clean":"2024-04-01T06:55:34.126438+0000","last_became_active":"2024-04-01T06:54:27.996386+0000","last_became_peered":"2024-04-01T06:54:27.996386+0000","last_unstale":"2024-04-01T06:55:34.126438+0000","last_undegraded":"2024-04-01T06:55:34.126438+0000","last_fullsized":"2024-04-01T06:55:34.126438+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:29:57.365756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716556+0000","last_change":"2024-04-01T06:54:28.426837+0000","last_active":"2024-04-01T06:55:33.716556+0000","last_peered":"2024-04-01T06:55:33.716556+0000","last_clean":"2024-04-01T06:55:33.716556+0000","last_became_active":"2024-04-01T06:54:28.426551+0000","last_became_peered":"2024-04-01T06:54:28.426551+0000","last_unstale":"2024-04-01T06:55:33.716556+0000","last_undegraded":"2024-04-01T06:55:33.716556+0000","last_fullsized":"2024-04-01T06:55:33.716556+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:05:50.264912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'4","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.711871+0000","last_change":"2024-04-01T06:54:27.999968+0000","last_active":"2024-04-01T06:55:33.711871+0000","last_peered":"2024-04-01T06:55:33.711871+0000","last_clean":"2024-04-01T06:55:33.711871+0000","last_became_active":"2024-04-01T06:54:27.999415+0000","last_became_peered":"2024-04-01T06:54:27.999415+0000","last_unstale":"2024-04-01T06:55:33.711871+0000","last_undegraded":"2024-04-01T06:55:33.711871+0000","last_fullsized":"2024-04-01T06:55:33.711871+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:31:57.472227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716056+0000","last_change":"2024-04-01T06:54:28.421174+0000","last_active":"2024-04-01T06:55:33.716056+0000","last_peered":"2024-04-01T06:55:33.716056+0000","last_clean":"2024-04-01T06:55:33.716056+0000","last_became_active":"2024-04-01T06:54:28.420841+0000","last_became_peered":"2024-04-01T06:54:28.420841+0000","last_unstale":"2024-04-01T06:55:33.716056+0000","last_undegraded":"2024-04-01T06:55:33.716056+0000","last_fullsized":"2024-04-01T06:55:33.716056+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:05:25.377496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'30","reported_seq":183,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-01T06:55:37.817447+0000","last_change":"2024-04-01T06:54:27.995496+0000","last_active":"2024-04-01T06:55:37.817447+0000","last_peered":"2024-04-01T06:55:37.817447+0000","last_clean":"2024-04-01T06:55:37.817447+0000","last_became_active":"2024-04-01T06:54:27.995131+0000","last_became_peered":"2024-04-01T06:54:27.995131+0000","last_unstale":"2024-04-01T06:55:37.817447+0000","last_undegraded":"2024-04-01T06:55:37.817447+0000","last_fullsized":"2024-04-01T06:55:37.817447+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:36:12.129235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61314,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":129,"num_write":31,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.714386+0000","last_change":"2024-04-01T06:54:28.427835+0000","last_active":"2024-04-01T06:55:33.714386+0000","last_peered":"2024-04-01T06:55:33.714386+0000","last_clean":"2024-04-01T06:55:33.714386+0000","last_became_active":"2024-04-01T06:54:28.426956+0000","last_became_peered":"2024-04-01T06:54:28.426956+0000","last_unstale":"2024-04-01T06:55:33.714386+0000","last_undegraded":"2024-04-01T06:55:33.714386+0000","last_fullsized":"2024-04-01T06:55:33.714386+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:41:17.334977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'6","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.715667+0000","last_change":"2024-04-01T06:54:27.992756+0000","last_active":"2024-04-01T06:55:33.715667+0000","last_peered":"2024-04-01T06:55:33.715667+0000","last_clean":"2024-04-01T06:55:33.715667+0000","last_became_active":"2024-04-01T06:54:27.992403+0000","last_became_peered":"2024-04-01T06:54:27.992403+0000","last_unstale":"2024-04-01T06:55:33.715667+0000","last_undegraded":"2024-04-01T06:55:33.715667+0000","last_fullsized":"2024-04-01T06:55:33.715667+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:40:33.458435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.717383+0000","last_change":"2024-04-01T06:54:28.416750+0000","last_active":"2024-04-01T06:55:33.717383+0000","last_peered":"2024-04-01T06:55:33.717383+0000","last_clean":"2024-04-01T06:55:33.717383+0000","last_became_active":"2024-04-01T06:54:28.416417+0000","last_became_peered":"2024-04-01T06:54:28.416417+0000","last_unstale":"2024-04-01T06:55:33.717383+0000","last_undegraded":"2024-04-01T06:55:33.717383+0000","last_fullsized":"2024-04-01T06:55:33.717383+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:04:41.698842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'3","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.711914+0000","last_change":"2024-04-01T06:54:28.001450+0000","last_active":"2024-04-01T06:55:33.711914+0000","last_peered":"2024-04-01T06:55:33.711914+0000","last_clean":"2024-04-01T06:55:33.711914+0000","last_became_active":"2024-04-01T06:54:28.001165+0000","last_became_peered":"2024-04-01T06:54:28.001165+0000","last_unstale":"2024-04-01T06:55:33.711914+0000","last_undegraded":"2024-04-01T06:55:33.711914+0000","last_fullsized":"2024-04-01T06:55:33.711914+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:20:03.876123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:34.126379+0000","last_change":"2024-04-01T06:54:28.421097+0000","last_active":"2024-04-01T06:55:34.126379+0000","last_peered":"2024-04-01T06:55:34.126379+0000","last_clean":"2024-04-01T06:55:34.126379+0000","last_became_active":"2024-04-01T06:54:28.420781+0000","last_became_peered":"2024-04-01T06:54:28.420781+0000","last_unstale":"2024-04-01T06:55:34.126379+0000","last_undegraded":"2024-04-01T06:55:34.126379+0000","last_fullsized":"2024-04-01T06:55:34.126379+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:11:47.192742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'5","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-01T06:55:39.810949+0000","last_change":"2024-04-01T06:54:27.993832+0000","last_active":"2024-04-01T06:55:39.810949+0000","last_peered":"2024-04-01T06:55:39.810949+0000","last_clean":"2024-04-01T06:55:39.810949+0000","last_became_active":"2024-04-01T06:54:27.993423+0000","last_became_peered":"2024-04-01T06:54:27.993423+0000","last_unstale":"2024-04-01T06:55:39.810949+0000","last_undegraded":"2024-04-01T06:55:39.810949+0000","last_fullsized":"2024-04-01T06:55:39.810949+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:58:37.542214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1247,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":73,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:34.126123+0000","last_change":"2024-04-01T06:54:28.423352+0000","last_active":"2024-04-01T06:55:34.126123+0000","last_peered":"2024-04-01T06:55:34.126123+0000","last_clean":"2024-04-01T06:55:34.126123+0000","last_became_active":"2024-04-01T06:54:28.423049+0000","last_became_peered":"2024-04-01T06:54:28.423049+0000","last_unstale":"2024-04-01T06:55:34.126123+0000","last_undegraded":"2024-04-01T06:55:34.126123+0000","last_fullsized":"2024-04-01T06:55:34.126123+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:07:34.963189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'15","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.714203+0000","last_change":"2024-04-01T06:54:27.990469+0000","last_active":"2024-04-01T06:55:33.714203+0000","last_peered":"2024-04-01T06:55:33.714203+0000","last_clean":"2024-04-01T06:55:33.714203+0000","last_became_active":"2024-04-01T06:54:27.990147+0000","last_became_peered":"2024-04-01T06:54:27.990147+0000","last_unstale":"2024-04-01T06:55:33.714203+0000","last_undegraded":"2024-04-01T06:55:33.714203+0000","last_fullsized":"2024-04-01T06:55:33.714203+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:27:29.415723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-01T06:55:34.794930+0000","last_change":"2024-04-01T06:55:34.794236+0000","last_active":"2024-04-01T06:55:34.794930+0000","last_peered":"2024-04-01T06:55:34.794930+0000","last_clean":"2024-04-01T06:55:34.794930+0000","last_became_active":"2024-04-01T06:55:34.793868+0000","last_became_peered":"2024-04-01T06:55:34.793868+0000","last_unstale":"2024-04-01T06:55:34.794930+0000","last_undegraded":"2024-04-01T06:55:34.794930+0000","last_fullsized":"2024-04-01T06:55:34.794930+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:48:47.178073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"79'2","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.714590+0000","last_change":"2024-04-01T06:54:27.995827+0000","last_active":"2024-04-01T06:55:33.714590+0000","last_peered":"2024-04-01T06:55:33.714590+0000","last_clean":"2024-04-01T06:55:33.714590+0000","last_became_active":"2024-04-01T06:54:27.995450+0000","last_became_peered":"2024-04-01T06:54:27.995450+0000","last_unstale":"2024-04-01T06:55:33.714590+0000","last_undegraded":"2024-04-01T06:55:33.714590+0000","last_fullsized":"2024-04-01T06:55:33.714590+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T14:14:03.935578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716760+0000","last_change":"2024-04-01T06:54:28.425376+0000","last_active":"2024-04-01T06:55:33.716760+0000","last_peered":"2024-04-01T06:55:33.716760+0000","last_clean":"2024-04-01T06:55:33.716760+0000","last_became_active":"2024-04-01T06:54:28.421235+0000","last_became_peered":"2024-04-01T06:54:28.421235+0000","last_unstale":"2024-04-01T06:55:33.716760+0000","last_undegraded":"2024-04-01T06:55:33.716760+0000","last_fullsized":"2024-04-01T06:55:33.716760+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:19:05.244735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-01T06:55:34.794830+0000","last_change":"2024-04-01T06:55:34.794830+0000","last_active":"2024-04-01T06:55:34.794830+0000","last_peered":"2024-04-01T06:55:34.794830+0000","last_clean":"2024-04-01T06:55:34.794830+0000","last_became_active":"2024-04-01T06:55:34.794493+0000","last_became_peered":"2024-04-01T06:55:34.794493+0000","last_unstale":"2024-04-01T06:55:34.794830+0000","last_undegraded":"2024-04-01T06:55:34.794830+0000","last_fullsized":"2024-04-01T06:55:34.794830+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:38:08.508743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"79'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.708230+0000","last_change":"2024-04-01T06:54:28.417654+0000","last_active":"2024-04-01T06:55:33.708230+0000","last_peered":"2024-04-01T06:55:33.708230+0000","last_clean":"2024-04-01T06:55:33.708230+0000","last_became_active":"2024-04-01T06:54:28.417318+0000","last_became_peered":"2024-04-01T06:54:28.417318+0000","last_unstale":"2024-04-01T06:55:33.708230+0000","last_undegraded":"2024-04-01T06:55:33.708230+0000","last_fullsized":"2024-04-01T06:55:33.708230+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:59:25.843730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"79'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:34.126328+0000","last_change":"2024-04-01T06:54:27.998825+0000","last_active":"2024-04-01T06:55:34.126328+0000","last_peered":"2024-04-01T06:55:34.126328+0000","last_clean":"2024-04-01T06:55:34.126328+0000","last_became_active":"2024-04-01T06:54:27.998488+0000","last_became_peered":"2024-04-01T06:54:27.998488+0000","last_unstale":"2024-04-01T06:55:34.126328+0000","last_undegraded":"2024-04-01T06:55:34.126328+0000","last_fullsized":"2024-04-01T06:55:34.126328+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:22:24.878723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.708064+0000","last_change":"2024-04-01T06:54:28.421053+0000","last_active":"2024-04-01T06:55:33.708064+0000","last_peered":"2024-04-01T06:55:33.708064+0000","last_clean":"2024-04-01T06:55:33.708064+0000","last_became_active":"2024-04-01T06:54:28.420718+0000","last_became_peered":"2024-04-01T06:54:28.420718+0000","last_unstale":"2024-04-01T06:55:33.708064+0000","last_undegraded":"2024-04-01T06:55:33.708064+0000","last_fullsized":"2024-04-01T06:55:33.708064+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:58:10.109158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.711707+0000","last_change":"2024-04-01T06:54:28.419126+0000","last_active":"2024-04-01T06:55:33.711707+0000","last_peered":"2024-04-01T06:55:33.711707+0000","last_clean":"2024-04-01T06:55:33.711707+0000","last_became_active":"2024-04-01T06:54:28.418217+0000","last_became_peered":"2024-04-01T06:54:28.418217+0000","last_unstale":"2024-04-01T06:55:33.711707+0000","last_undegraded":"2024-04-01T06:55:33.711707+0000","last_fullsized":"2024-04-01T06:55:33.711707+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T14:02:41.148200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-01T06:55:37.806484+0000","last_change":"2024-04-01T06:54:27.993059+0000","last_active":"2024-04-01T06:55:37.806484+0000","last_peered":"2024-04-01T06:55:37.806484+0000","last_clean":"2024-04-01T06:55:37.806484+0000","last_became_active":"2024-04-01T06:54:27.992471+0000","last_became_peered":"2024-04-01T06:54:27.992471+0000","last_unstale":"2024-04-01T06:55:37.806484+0000","last_undegraded":"2024-04-01T06:55:37.806484+0000","last_fullsized":"2024-04-01T06:55:37.806484+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:27:38.691261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":66,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.708950+0000","last_change":"2024-04-01T06:54:28.411805+0000","last_active":"2024-04-01T06:55:33.708950+0000","last_peered":"2024-04-01T06:55:33.708950+0000","last_clean":"2024-04-01T06:55:33.708950+0000","last_became_active":"2024-04-01T06:54:28.411526+0000","last_became_peered":"2024-04-01T06:54:28.411526+0000","last_unstale":"2024-04-01T06:55:33.708950+0000","last_undegraded":"2024-04-01T06:55:33.708950+0000","last_fullsized":"2024-04-01T06:55:33.708950+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:59:08.223590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"79'3","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.713911+0000","last_change":"2024-04-01T06:54:27.988695+0000","last_active":"2024-04-01T06:55:33.713911+0000","last_peered":"2024-04-01T06:55:33.713911+0000","last_clean":"2024-04-01T06:55:33.713911+0000","last_became_active":"2024-04-01T06:54:27.988069+0000","last_became_peered":"2024-04-01T06:54:27.988069+0000","last_unstale":"2024-04-01T06:55:33.713911+0000","last_undegraded":"2024-04-01T06:55:33.713911+0000","last_fullsized":"2024-04-01T06:55:33.713911+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:27:11.287962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":332,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:34.126362+0000","last_change":"2024-04-01T06:53:41.678430+0000","last_active":"2024-04-01T06:55:34.126362+0000","last_peered":"2024-04-01T06:55:34.126362+0000","last_clean":"2024-04-01T06:55:34.126362+0000","last_became_active":"2024-04-01T06:53:41.677964+0000","last_became_peered":"2024-04-01T06:53:41.677964+0000","last_unstale":"2024-04-01T06:55:34.126362+0000","last_undegraded":"2024-04-01T06:55:34.126362+0000","last_fullsized":"2024-04-01T06:55:34.126362+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:51:21.964420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:51:21.964420+0000","last_clean_scrub_stamp":"2024-04-01T06:51:21.964420+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:24:29.916692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.715961+0000","last_change":"2024-04-01T06:54:28.423775+0000","last_active":"2024-04-01T06:55:33.715961+0000","last_peered":"2024-04-01T06:55:33.715961+0000","last_clean":"2024-04-01T06:55:33.715961+0000","last_became_active":"2024-04-01T06:54:28.423462+0000","last_became_peered":"2024-04-01T06:54:28.423462+0000","last_unstale":"2024-04-01T06:55:33.715961+0000","last_undegraded":"2024-04-01T06:55:33.715961+0000","last_fullsized":"2024-04-01T06:55:33.715961+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:09:38.043033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"79'3","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:34.126308+0000","last_change":"2024-04-01T06:54:27.997801+0000","last_active":"2024-04-01T06:55:34.126308+0000","last_peered":"2024-04-01T06:55:34.126308+0000","last_clean":"2024-04-01T06:55:34.126308+0000","last_became_active":"2024-04-01T06:54:27.997305+0000","last_became_peered":"2024-04-01T06:54:27.997305+0000","last_unstale":"2024-04-01T06:55:34.126308+0000","last_undegraded":"2024-04-01T06:55:34.126308+0000","last_fullsized":"2024-04-01T06:55:34.126308+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:46:09.224535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"79'1","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.714497+0000","last_change":"2024-04-01T06:54:27.994483+0000","last_active":"2024-04-01T06:55:33.714497+0000","last_peered":"2024-04-01T06:55:33.714497+0000","last_clean":"2024-04-01T06:55:33.714497+0000","last_became_active":"2024-04-01T06:54:27.994093+0000","last_became_peered":"2024-04-01T06:54:27.994093+0000","last_unstale":"2024-04-01T06:55:33.714497+0000","last_undegraded":"2024-04-01T06:55:33.714497+0000","last_fullsized":"2024-04-01T06:55:33.714497+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:27:48.272196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716298+0000","last_change":"2024-04-01T06:54:28.423895+0000","last_active":"2024-04-01T06:55:33.716298+0000","last_peered":"2024-04-01T06:55:33.716298+0000","last_clean":"2024-04-01T06:55:33.716298+0000","last_became_active":"2024-04-01T06:54:28.423593+0000","last_became_peered":"2024-04-01T06:54:28.423593+0000","last_unstale":"2024-04-01T06:55:33.716298+0000","last_undegraded":"2024-04-01T06:55:33.716298+0000","last_fullsized":"2024-04-01T06:55:33.716298+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:09:30.414080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"79'5","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.712579+0000","last_change":"2024-04-01T06:54:27.987207+0000","last_active":"2024-04-01T06:55:33.712579+0000","last_peered":"2024-04-01T06:55:33.712579+0000","last_clean":"2024-04-01T06:55:33.712579+0000","last_became_active":"2024-04-01T06:54:27.986537+0000","last_became_peered":"2024-04-01T06:54:27.986537+0000","last_unstale":"2024-04-01T06:55:33.712579+0000","last_undegraded":"2024-04-01T06:55:33.712579+0000","last_fullsized":"2024-04-01T06:55:33.712579+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:26:41.096843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.709381+0000","last_change":"2024-04-01T06:54:28.416591+0000","last_active":"2024-04-01T06:55:33.709381+0000","last_peered":"2024-04-01T06:55:33.709381+0000","last_clean":"2024-04-01T06:55:33.709381+0000","last_became_active":"2024-04-01T06:54:28.416295+0000","last_became_peered":"2024-04-01T06:54:28.416295+0000","last_unstale":"2024-04-01T06:55:33.709381+0000","last_undegraded":"2024-04-01T06:55:33.709381+0000","last_fullsized":"2024-04-01T06:55:33.709381+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:17:24.670572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'4","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.713832+0000","last_change":"2024-04-01T06:54:27.996075+0000","last_active":"2024-04-01T06:55:33.713832+0000","last_peered":"2024-04-01T06:55:33.713832+0000","last_clean":"2024-04-01T06:55:33.713832+0000","last_became_active":"2024-04-01T06:54:27.995664+0000","last_became_peered":"2024-04-01T06:54:27.995664+0000","last_unstale":"2024-04-01T06:55:33.713832+0000","last_undegraded":"2024-04-01T06:55:33.713832+0000","last_fullsized":"2024-04-01T06:55:33.713832+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:17:33.214644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716458+0000","last_change":"2024-04-01T06:54:28.422041+0000","last_active":"2024-04-01T06:55:33.716458+0000","last_peered":"2024-04-01T06:55:33.716458+0000","last_clean":"2024-04-01T06:55:33.716458+0000","last_became_active":"2024-04-01T06:54:28.421743+0000","last_became_peered":"2024-04-01T06:54:28.421743+0000","last_unstale":"2024-04-01T06:55:33.716458+0000","last_undegraded":"2024-04-01T06:55:33.716458+0000","last_fullsized":"2024-04-01T06:55:33.716458+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:23:14.405879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.715836+0000","last_change":"2024-04-01T06:54:27.991734+0000","last_active":"2024-04-01T06:55:33.715836+0000","last_peered":"2024-04-01T06:55:33.715836+0000","last_clean":"2024-04-01T06:55:33.715836+0000","last_became_active":"2024-04-01T06:54:27.991139+0000","last_became_peered":"2024-04-01T06:54:27.991139+0000","last_unstale":"2024-04-01T06:55:33.715836+0000","last_undegraded":"2024-04-01T06:55:33.715836+0000","last_fullsized":"2024-04-01T06:55:33.715836+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:08:49.188179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.714043+0000","last_change":"2024-04-01T06:54:28.428467+0000","last_active":"2024-04-01T06:55:33.714043+0000","last_peered":"2024-04-01T06:55:33.714043+0000","last_clean":"2024-04-01T06:55:33.714043+0000","last_became_active":"2024-04-01T06:54:28.428095+0000","last_became_peered":"2024-04-01T06:54:28.428095+0000","last_unstale":"2024-04-01T06:55:33.714043+0000","last_undegraded":"2024-04-01T06:55:33.714043+0000","last_fullsized":"2024-04-01T06:55:33.714043+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:21:04.500427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'3","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.708832+0000","last_change":"2024-04-01T06:54:27.990321+0000","last_active":"2024-04-01T06:55:33.708832+0000","last_peered":"2024-04-01T06:55:33.708832+0000","last_clean":"2024-04-01T06:55:33.708832+0000","last_became_active":"2024-04-01T06:54:27.989997+0000","last_became_peered":"2024-04-01T06:54:27.989997+0000","last_unstale":"2024-04-01T06:55:33.708832+0000","last_undegraded":"2024-04-01T06:55:33.708832+0000","last_fullsized":"2024-04-01T06:55:33.708832+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:14:04.059812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.715899+0000","last_change":"2024-04-01T06:54:28.416480+0000","last_active":"2024-04-01T06:55:33.715899+0000","last_peered":"2024-04-01T06:55:33.715899+0000","last_clean":"2024-04-01T06:55:33.715899+0000","last_became_active":"2024-04-01T06:54:28.416009+0000","last_became_peered":"2024-04-01T06:54:28.416009+0000","last_unstale":"2024-04-01T06:55:33.715899+0000","last_undegraded":"2024-04-01T06:55:33.715899+0000","last_fullsized":"2024-04-01T06:55:33.715899+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:32:09.759447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"79'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.715352+0000","last_change":"2024-04-01T06:54:27.996538+0000","last_active":"2024-04-01T06:55:33.715352+0000","last_peered":"2024-04-01T06:55:33.715352+0000","last_clean":"2024-04-01T06:55:33.715352+0000","last_became_active":"2024-04-01T06:54:27.996177+0000","last_became_peered":"2024-04-01T06:54:27.996177+0000","last_unstale":"2024-04-01T06:55:33.715352+0000","last_undegraded":"2024-04-01T06:55:33.715352+0000","last_fullsized":"2024-04-01T06:55:33.715352+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:39:45.386450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.709026+0000","last_change":"2024-04-01T06:54:28.419403+0000","last_active":"2024-04-01T06:55:33.709026+0000","last_peered":"2024-04-01T06:55:33.709026+0000","last_clean":"2024-04-01T06:55:33.709026+0000","last_became_active":"2024-04-01T06:54:28.419127+0000","last_became_peered":"2024-04-01T06:54:28.419127+0000","last_unstale":"2024-04-01T06:55:33.709026+0000","last_undegraded":"2024-04-01T06:55:33.709026+0000","last_fullsized":"2024-04-01T06:55:33.709026+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:52:13.510448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.714185+0000","last_change":"2024-04-01T06:54:27.992775+0000","last_active":"2024-04-01T06:55:33.714185+0000","last_peered":"2024-04-01T06:55:33.714185+0000","last_clean":"2024-04-01T06:55:33.714185+0000","last_became_active":"2024-04-01T06:54:27.992356+0000","last_became_peered":"2024-04-01T06:54:27.992356+0000","last_unstale":"2024-04-01T06:55:33.714185+0000","last_undegraded":"2024-04-01T06:55:33.714185+0000","last_fullsized":"2024-04-01T06:55:33.714185+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T14:46:37.302172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:34.126447+0000","last_change":"2024-04-01T06:54:28.430132+0000","last_active":"2024-04-01T06:55:34.126447+0000","last_peered":"2024-04-01T06:55:34.126447+0000","last_clean":"2024-04-01T06:55:34.126447+0000","last_became_active":"2024-04-01T06:54:28.429816+0000","last_became_peered":"2024-04-01T06:54:28.429816+0000","last_unstale":"2024-04-01T06:55:34.126447+0000","last_undegraded":"2024-04-01T06:55:34.126447+0000","last_fullsized":"2024-04-01T06:55:34.126447+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T14:49:58.661275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"79'3","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716010+0000","last_change":"2024-04-01T06:54:27.999460+0000","last_active":"2024-04-01T06:55:33.716010+0000","last_peered":"2024-04-01T06:55:33.716010+0000","last_clean":"2024-04-01T06:55:33.716010+0000","last_became_active":"2024-04-01T06:54:27.999128+0000","last_became_peered":"2024-04-01T06:54:27.999128+0000","last_unstale":"2024-04-01T06:55:33.716010+0000","last_undegraded":"2024-04-01T06:55:33.716010+0000","last_fullsized":"2024-04-01T06:55:33.716010+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:19:24.285698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:34.126610+0000","last_change":"2024-04-01T06:54:28.427720+0000","last_active":"2024-04-01T06:55:34.126610+0000","last_peered":"2024-04-01T06:55:34.126610+0000","last_clean":"2024-04-01T06:55:34.126610+0000","last_became_active":"2024-04-01T06:54:28.427357+0000","last_became_peered":"2024-04-01T06:54:28.427357+0000","last_unstale":"2024-04-01T06:55:34.126610+0000","last_undegraded":"2024-04-01T06:55:34.126610+0000","last_fullsized":"2024-04-01T06:55:34.126610+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:20:56.631811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.711677+0000","last_change":"2024-04-01T06:54:27.997806+0000","last_active":"2024-04-01T06:55:33.711677+0000","last_peered":"2024-04-01T06:55:33.711677+0000","last_clean":"2024-04-01T06:55:33.711677+0000","last_became_active":"2024-04-01T06:54:27.997490+0000","last_became_peered":"2024-04-01T06:54:27.997490+0000","last_unstale":"2024-04-01T06:55:33.711677+0000","last_undegraded":"2024-04-01T06:55:33.711677+0000","last_fullsized":"2024-04-01T06:55:33.711677+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:06:15.099390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"79'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:34.126472+0000","last_change":"2024-04-01T06:54:28.419639+0000","last_active":"2024-04-01T06:55:34.126472+0000","last_peered":"2024-04-01T06:55:34.126472+0000","last_clean":"2024-04-01T06:55:34.126472+0000","last_became_active":"2024-04-01T06:54:28.418081+0000","last_became_peered":"2024-04-01T06:54:28.418081+0000","last_unstale":"2024-04-01T06:55:34.126472+0000","last_undegraded":"2024-04-01T06:55:34.126472+0000","last_fullsized":"2024-04-01T06:55:34.126472+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:15:44.753121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.715887+0000","last_change":"2024-04-01T06:54:27.995854+0000","last_active":"2024-04-01T06:55:33.715887+0000","last_peered":"2024-04-01T06:55:33.715887+0000","last_clean":"2024-04-01T06:55:33.715887+0000","last_became_active":"2024-04-01T06:54:27.995540+0000","last_became_peered":"2024-04-01T06:54:27.995540+0000","last_unstale":"2024-04-01T06:55:33.715887+0000","last_undegraded":"2024-04-01T06:55:33.715887+0000","last_fullsized":"2024-04-01T06:55:33.715887+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:47:15.075909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:34.126624+0000","last_change":"2024-04-01T06:54:28.428100+0000","last_active":"2024-04-01T06:55:34.126624+0000","last_peered":"2024-04-01T06:55:34.126624+0000","last_clean":"2024-04-01T06:55:34.126624+0000","last_became_active":"2024-04-01T06:54:28.427769+0000","last_became_peered":"2024-04-01T06:54:28.427769+0000","last_unstale":"2024-04-01T06:55:34.126624+0000","last_undegraded":"2024-04-01T06:55:34.126624+0000","last_fullsized":"2024-04-01T06:55:34.126624+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:47:18.161878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716007+0000","last_change":"2024-04-01T06:54:28.427557+0000","last_active":"2024-04-01T06:55:33.716007+0000","last_peered":"2024-04-01T06:55:33.716007+0000","last_clean":"2024-04-01T06:55:33.716007+0000","last_became_active":"2024-04-01T06:54:28.427209+0000","last_became_peered":"2024-04-01T06:54:28.427209+0000","last_unstale":"2024-04-01T06:55:33.716007+0000","last_undegraded":"2024-04-01T06:55:33.716007+0000","last_fullsized":"2024-04-01T06:55:33.716007+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:10:06.835360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.715486+0000","last_change":"2024-04-01T06:54:28.423264+0000","last_active":"2024-04-01T06:55:33.715486+0000","last_peered":"2024-04-01T06:55:33.715486+0000","last_clean":"2024-04-01T06:55:33.715486+0000","last_became_active":"2024-04-01T06:54:28.422868+0000","last_became_peered":"2024-04-01T06:54:28.422868+0000","last_unstale":"2024-04-01T06:55:33.715486+0000","last_undegraded":"2024-04-01T06:55:33.715486+0000","last_fullsized":"2024-04-01T06:55:33.715486+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:00:49.784276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.715257+0000","last_change":"2024-04-01T06:54:28.417824+0000","last_active":"2024-04-01T06:55:33.715257+0000","last_peered":"2024-04-01T06:55:33.715257+0000","last_clean":"2024-04-01T06:55:33.715257+0000","last_became_active":"2024-04-01T06:54:28.417510+0000","last_became_peered":"2024-04-01T06:54:28.417510+0000","last_unstale":"2024-04-01T06:55:33.715257+0000","last_undegraded":"2024-04-01T06:55:33.715257+0000","last_fullsized":"2024-04-01T06:55:33.715257+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:40:52.024183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716183+0000","last_change":"2024-04-01T06:54:28.426099+0000","last_active":"2024-04-01T06:55:33.716183+0000","last_peered":"2024-04-01T06:55:33.716183+0000","last_clean":"2024-04-01T06:55:33.716183+0000","last_became_active":"2024-04-01T06:54:28.425745+0000","last_became_peered":"2024-04-01T06:54:28.425745+0000","last_unstale":"2024-04-01T06:55:33.716183+0000","last_undegraded":"2024-04-01T06:55:33.716183+0000","last_fullsized":"2024-04-01T06:55:33.716183+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:13:45.145447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-01T06:55:34.793799+0000","last_change":"2024-04-01T06:55:34.793799+0000","last_active":"2024-04-01T06:55:34.793799+0000","last_peered":"2024-04-01T06:55:34.793799+0000","last_clean":"2024-04-01T06:55:34.793799+0000","last_became_active":"2024-04-01T06:55:34.793425+0000","last_became_peered":"2024-04-01T06:55:34.793425+0000","last_unstale":"2024-04-01T06:55:34.793799+0000","last_undegraded":"2024-04-01T06:55:34.793799+0000","last_fullsized":"2024-04-01T06:55:34.793799+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:40:42.053778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716274+0000","last_change":"2024-04-01T06:54:28.421013+0000","last_active":"2024-04-01T06:55:33.716274+0000","last_peered":"2024-04-01T06:55:33.716274+0000","last_clean":"2024-04-01T06:55:33.716274+0000","last_became_active":"2024-04-01T06:54:28.420339+0000","last_became_peered":"2024-04-01T06:54:28.420339+0000","last_unstale":"2024-04-01T06:55:33.716274+0000","last_undegraded":"2024-04-01T06:55:33.716274+0000","last_fullsized":"2024-04-01T06:55:33.716274+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:59:07.758542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.715886+0000","last_change":"2024-04-01T06:54:28.433203+0000","last_active":"2024-04-01T06:55:33.715886+0000","last_peered":"2024-04-01T06:55:33.715886+0000","last_clean":"2024-04-01T06:55:33.715886+0000","last_became_active":"2024-04-01T06:54:28.431890+0000","last_became_peered":"2024-04-01T06:54:28.431890+0000","last_unstale":"2024-04-01T06:55:33.715886+0000","last_undegraded":"2024-04-01T06:55:33.715886+0000","last_fullsized":"2024-04-01T06:55:33.715886+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:55:33.169722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.709341+0000","last_change":"2024-04-01T06:54:28.418425+0000","last_active":"2024-04-01T06:55:33.709341+0000","last_peered":"2024-04-01T06:55:33.709341+0000","last_clean":"2024-04-01T06:55:33.709341+0000","last_became_active":"2024-04-01T06:54:28.418165+0000","last_became_peered":"2024-04-01T06:54:28.418165+0000","last_unstale":"2024-04-01T06:55:33.709341+0000","last_undegraded":"2024-04-01T06:55:33.709341+0000","last_fullsized":"2024-04-01T06:55:33.709341+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:45:01.425680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.711699+0000","last_change":"2024-04-01T06:54:28.412058+0000","last_active":"2024-04-01T06:55:33.711699+0000","last_peered":"2024-04-01T06:55:33.711699+0000","last_clean":"2024-04-01T06:55:33.711699+0000","last_became_active":"2024-04-01T06:54:28.411680+0000","last_became_peered":"2024-04-01T06:54:28.411680+0000","last_unstale":"2024-04-01T06:55:33.711699+0000","last_undegraded":"2024-04-01T06:55:33.711699+0000","last_fullsized":"2024-04-01T06:55:33.711699+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:21:05.628262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.708907+0000","last_change":"2024-04-01T06:54:28.422304+0000","last_active":"2024-04-01T06:55:33.708907+0000","last_peered":"2024-04-01T06:55:33.708907+0000","last_clean":"2024-04-01T06:55:33.708907+0000","last_became_active":"2024-04-01T06:54:28.422023+0000","last_became_peered":"2024-04-01T06:54:28.422023+0000","last_unstale":"2024-04-01T06:55:33.708907+0000","last_undegraded":"2024-04-01T06:55:33.708907+0000","last_fullsized":"2024-04-01T06:55:33.708907+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:26:45.810780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.715869+0000","last_change":"2024-04-01T06:54:28.420350+0000","last_active":"2024-04-01T06:55:33.715869+0000","last_peered":"2024-04-01T06:55:33.715869+0000","last_clean":"2024-04-01T06:55:33.715869+0000","last_became_active":"2024-04-01T06:54:28.419995+0000","last_became_peered":"2024-04-01T06:54:28.419995+0000","last_unstale":"2024-04-01T06:55:33.715869+0000","last_undegraded":"2024-04-01T06:55:33.715869+0000","last_fullsized":"2024-04-01T06:55:33.715869+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:30:20.831966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716308+0000","last_change":"2024-04-01T06:54:28.417067+0000","last_active":"2024-04-01T06:55:33.716308+0000","last_peered":"2024-04-01T06:55:33.716308+0000","last_clean":"2024-04-01T06:55:33.716308+0000","last_became_active":"2024-04-01T06:54:28.416796+0000","last_became_peered":"2024-04-01T06:54:28.416796+0000","last_unstale":"2024-04-01T06:55:33.716308+0000","last_undegraded":"2024-04-01T06:55:33.716308+0000","last_fullsized":"2024-04-01T06:55:33.716308+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:39:43.396643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716194+0000","last_change":"2024-04-01T06:54:28.424971+0000","last_active":"2024-04-01T06:55:33.716194+0000","last_peered":"2024-04-01T06:55:33.716194+0000","last_clean":"2024-04-01T06:55:33.716194+0000","last_became_active":"2024-04-01T06:54:28.424664+0000","last_became_peered":"2024-04-01T06:54:28.424664+0000","last_unstale":"2024-04-01T06:55:33.716194+0000","last_undegraded":"2024-04-01T06:55:33.716194+0000","last_fullsized":"2024-04-01T06:55:33.716194+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:03:51.434412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":246668,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65928,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":423,"num_read_kb":281,"num_write":155,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":197156,"data_compressed":5598,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579927,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":876544,"data_stored":425769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:54:55 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.69699999999999995}]},{"osd":1,"last update":"Mon Apr 1 06:54:55 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.745},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.60099999999999998}]},{"osd":2,"last update":"Mon Apr 1 06:54:55 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.90600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":4,"last update":"Mon Apr 1 06:54:55 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":3.1970000000000001,"5min":3.1970000000000001,"15min":3.1970000000000001},"last":0.623},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.71899999999999997}]},{"osd":5,"last update":"Mon Apr 1 06:54:55 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.85299999999999998}]},{"osd":6,"last update":"Mon Apr 1 06:54:55 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.77800000000000002}]},{"osd":7,"last update":"Mon Apr 1 06:54:55 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":3.3479999999999999,"5min":3.3479999999999999,"15min":3.3479999999999999},"last":0.873}]},{"osd":8,"last update":"Mon Apr 1 06:55:28 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.82099999999999995}]},{"osd":9,"last update":"Mon Apr 1 06:54:55 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1,"5min":1,"15min":1},"last":1.018}]},{"osd":10,"last update":"Mon Apr 1 06:54:55 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.92300000000000004}]}]},{"osd":10,"up_from":67,"seq":287762808859,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1024000,"data_stored":1079223,"data_compressed":37572,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:55:33 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.54900000000000004}]},{"osd":1,"last update":"Mon Apr 1 06:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.52100000000000002}]},{"osd":2,"last update":"Mon Apr 1 06:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.76400000000000001}]},{"osd":3,"last update":"Mon Apr 1 06:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.69499999999999995}]},{"osd":4,"last update":"Mon Apr 1 06:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.63300000000000001}]},{"osd":5,"last update":"Mon Apr 1 06:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.748},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.83499999999999996}]},{"osd":6,"last update":"Mon Apr 1 06:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.78200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":8,"last update":"Mon Apr 1 06:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.877}]},{"osd":9,"last update":"Mon Apr 1 06:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.81100000000000005}]},{"osd":11,"last update":"Mon Apr 1 06:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.84799999999999998}]}]},{"osd":9,"up_from":62,"seq":266287972384,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31992,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713160,"statfs":{"total":95995035648,"available":95962275840,"internally_reserved":0,"allocated":892928,"data_stored":426005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:55:22 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.41299999999999998,"15min":0.42399999999999999},"min":{"1min":0.27200000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.52200000000000002,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.314},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.41999999999999998,"15min":0.433},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.55700000000000005,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.34799999999999998}]},{"osd":1,"last update":"Mon Apr 1 06:55:22 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.60999999999999999,"15min":0.626},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83099999999999996,"5min":0.873,"15min":0.873},"last":0.434},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.61099999999999999,"15min":0.623},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.442}]},{"osd":2,"last update":"Mon Apr 1 06:55:22 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.58599999999999997,"15min":0.59699999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.85199999999999998,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.505,"5min":0.58399999999999996,"15min":0.59699999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.52600000000000002}]},{"osd":3,"last update":"Mon Apr 1 06:55:22 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.45300000000000001,"15min":0.46700000000000003},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.61899999999999999,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.51400000000000001,"15min":0.53100000000000003},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.58799999999999997,"5min":0.754,"15min":0.754},"last":0.38600000000000001}]},{"osd":4,"last update":"Mon Apr 1 06:55:22 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.61699999999999999,"15min":0.63},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.58999999999999997,"15min":0.60099999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.83799999999999997,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.48399999999999999}]},{"osd":5,"last update":"Mon Apr 1 06:55:22 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.60099999999999998,"15min":0.61299999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.81299999999999994,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.72399999999999998,"15min":0.75},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.79100000000000004,"5min":1.835,"15min":1.835},"last":0.50700000000000001}]},{"osd":6,"last update":"Mon Apr 1 06:55:22 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.64200000000000002,"15min":0.66200000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67100000000000004,"5min":1.048,"15min":1.048},"last":0.379},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.63800000000000001,"15min":0.66500000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.71899999999999997,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.54000000000000004}]},{"osd":7,"last update":"Mon Apr 1 06:55:22 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.65800000000000003,"15min":0.67100000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.89400000000000002,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.72499999999999998,"15min":0.746},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.92600000000000005,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.53700000000000003}]},{"osd":8,"last update":"Mon Apr 1 06:55:22 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.91400000000000003,"15min":0.96399999999999997},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.84499999999999997,"5min":5.6600000000000001,"15min":5.6600000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.90100000000000002,"15min":0.94699999999999995},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.85899999999999999,"5min":5.6070000000000002,"15min":5.6070000000000002},"last":0.57099999999999995}]},{"osd":10,"last update":"Mon Apr 1 06:55:40 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.70199999999999996,"15min":0.71399999999999997},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.94399999999999995,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.69199999999999995,"15min":0.70099999999999996},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.879,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.58599999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]}]},{"osd":8,"up_from":55,"seq":236223201315,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31988,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713164,"statfs":{"total":95995035648,"available":95962279936,"internally_reserved":0,"allocated":888832,"data_stored":425594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:55:08 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52900000000000003,"15min":0.53300000000000003},"min":{"1min":0.379,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.72099999999999997,"5min":0.747,"15min":0.747},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.54000000000000004,"15min":0.54400000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.65600000000000003,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.60599999999999998}]},{"osd":1,"last update":"Mon Apr 1 06:55:08 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.57899999999999996,"15min":0.56699999999999995},"min":{"1min":0.38400000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.58699999999999997,"15min":0.58199999999999996},"min":{"1min":0.35199999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.82999999999999996,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.73599999999999999}]},{"osd":2,"last update":"Mon Apr 1 06:55:08 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.46100000000000002,"15min":0.442},"min":{"1min":0.30199999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.46600000000000003,"15min":0.45100000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.62}]},{"osd":3,"last update":"Mon Apr 1 06:55:08 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.749,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.56000000000000005,"15min":0.55400000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78600000000000003,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.64000000000000001}]},{"osd":4,"last update":"Mon Apr 1 06:55:08 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.58599999999999997,"15min":0.57899999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.85299999999999998,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.61399999999999999,"15min":0.59599999999999997},"min":{"1min":0.47499999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.753}]},{"osd":5,"last update":"Mon Apr 1 06:55:08 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.53400000000000003,"15min":0.52000000000000002},"min":{"1min":0.41199999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.55300000000000005,"15min":0.53700000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.69999999999999996}]},{"osd":6,"last update":"Mon Apr 1 06:55:08 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.64500000000000002,"15min":0.629},"min":{"1min":0.51700000000000002,"5min":0.433,"15min":0.433},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.67200000000000004,"15min":0.66200000000000003},"min":{"1min":0.54000000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.79000000000000004}]},{"osd":7,"last update":"Mon Apr 1 06:55:08 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.68300000000000005,"15min":0.67100000000000004},"min":{"1min":0.50900000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.92700000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.745,"5min":0.68899999999999995,"15min":0.68000000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.81299999999999994}]},{"osd":9,"last update":"Mon Apr 1 06:55:28 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.72099999999999997,"15min":0.69699999999999995},"min":{"1min":0.626,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.871},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.73699999999999999,"15min":0.71099999999999997},"min":{"1min":0.65400000000000003,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.83499999999999996}]},{"osd":10,"last update":"Mon Apr 1 06:54:43 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.89600000000000002}]},{"osd":11,"last update":"Mon Apr 1 06:55:28 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.80200000000000005}]}]},{"osd":7,"up_from":48,"seq":206158430244,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32036,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713116,"statfs":{"total":95995035648,"available":95962230784,"internally_reserved":0,"allocated":942080,"data_stored":1018154,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:53:48 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.41099999999999998}]},{"osd":1,"last update":"Mon Apr 1 06:54:51 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.39400000000000002,"15min":0.38800000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.42399999999999999,"15min":0.41599999999999998},"min":{"1min":0.32700000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.46800000000000003}]},{"osd":2,"last update":"Mon Apr 1 06:54:51 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.56499999999999995,"15min":0.56100000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.56200000000000006,"15min":0.55400000000000005},"min":{"1min":0.42799999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.80200000000000005,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.77900000000000003}]},{"osd":3,"last update":"Mon Apr 1 06:54:51 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.56599999999999995,"15min":0.56000000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.74299999999999999,"5min":0.755,"15min":0.755},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.58799999999999997,"15min":0.58399999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.80300000000000005,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.56699999999999995}]},{"osd":4,"last update":"Mon Apr 1 06:54:51 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.51000000000000001,"15min":0.505},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.51000000000000001,"15min":0.50700000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.49399999999999999}]},{"osd":5,"last update":"Mon Apr 1 06:54:51 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.60599999999999998,"15min":0.59599999999999997},"min":{"1min":0.46700000000000003,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.63600000000000001,"15min":0.63},"min":{"1min":0.501,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.86799999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.81299999999999994}]},{"osd":6,"last update":"Mon Apr 1 06:54:51 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.47599999999999998,"5min":0.443,"15min":0.443},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.439,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.55200000000000005}]},{"osd":8,"last update":"Mon Apr 1 06:55:05 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.68600000000000005,"15min":0.68000000000000005},"min":{"1min":0.56699999999999995,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.52000000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.91300000000000003,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.75900000000000001}]},{"osd":9,"last update":"Mon Apr 1 06:55:27 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.71199999999999997,"15min":0.70799999999999996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.63},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.72599999999999998,"15min":0.72399999999999998},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.95599999999999996,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.83499999999999996}]},{"osd":10,"last update":"Mon Apr 1 06:54:44 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.879}]},{"osd":11,"last update":"Mon Apr 1 06:55:33 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.82399999999999995}]}]},{"osd":6,"up_from":43,"seq":184683593769,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":880640,"data_stored":425394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:55:38 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.375,"15min":0.34300000000000003},"min":{"1min":0.27000000000000002,"5min":0.246,"15min":0.246},"max":{"1min":3.8260000000000001,"5min":3.8260000000000001,"15min":3.8260000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.375,"5min":0.37,"15min":0.36199999999999999},"min":{"1min":0.29299999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.625,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.503}]},{"osd":1,"last update":"Mon Apr 1 06:55:38 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.51600000000000001,"15min":0.48799999999999999},"min":{"1min":0.36199999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.51900000000000002,"15min":0.50700000000000001},"min":{"1min":0.41199999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.58499999999999996}]},{"osd":2,"last update":"Mon Apr 1 06:55:38 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.53100000000000003,"15min":0.51600000000000001},"min":{"1min":0.41899999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.73299999999999998,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.57499999999999996,"15min":0.56699999999999995},"min":{"1min":0.39400000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.81799999999999995,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.81799999999999995}]},{"osd":3,"last update":"Mon Apr 1 06:55:38 2024","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.42599999999999999,"15min":0.42199999999999999},"min":{"1min":0.28799999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.44500000000000001,"15min":0.438},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.52100000000000002}]},{"osd":4,"last update":"Mon Apr 1 06:55:38 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.53000000000000003,"15min":0.51600000000000001},"min":{"1min":0.376,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.67200000000000004,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56599999999999995,"15min":0.54600000000000004},"min":{"1min":0.38300000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.73299999999999998,"5min":0.871,"15min":0.871},"last":0.71099999999999997}]},{"osd":5,"last update":"Mon Apr 1 06:55:38 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.60499999999999998,"15min":0.59999999999999998},"min":{"1min":0.42199999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.71299999999999997,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.61199999999999999,"15min":0.60899999999999999},"min":{"1min":0.39300000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.82899999999999996,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.82899999999999996}]},{"osd":7,"last update":"Mon Apr 1 06:54:49 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.621,"15min":0.625},"min":{"1min":0.437,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.83699999999999997,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.65200000000000002,"15min":0.65000000000000002},"min":{"1min":0.52400000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.82399999999999995,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.77300000000000002}]},{"osd":8,"last update":"Mon Apr 1 06:55:08 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.67600000000000005,"15min":0.68500000000000005},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.88800000000000001,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.755},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.65900000000000003,"15min":0.66300000000000003},"min":{"1min":0.51000000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.80600000000000005,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.83899999999999997}]},{"osd":9,"last update":"Mon Apr 1 06:55:29 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.60599999999999998,"15min":0.626},"min":{"1min":0.39400000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.64700000000000002,"5min":1.004,"15min":1.004},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.505,"5min":0.61699999999999999,"15min":0.63600000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.68100000000000005,"5min":1.048,"15min":1.048},"last":0.72099999999999997}]},{"osd":10,"last update":"Mon Apr 1 06:54:40 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.79500000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574907,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36124,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93709028,"statfs":{"total":95995035648,"available":95958044672,"internally_reserved":0,"allocated":937984,"data_stored":486501,"data_compressed":1866,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:55:17 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.52700000000000002,"15min":0.47999999999999998},"min":{"1min":0.35699999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":4.4249999999999998,"5min":4.4249999999999998,"15min":4.4249999999999998},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.53000000000000003,"15min":0.48999999999999999},"min":{"1min":0.38400000000000001,"5min":0.312,"15min":0.312},"max":{"1min":2.363,"5min":2.363,"15min":2.363},"last":0.54200000000000004}]},{"osd":2,"last update":"Mon Apr 1 06:55:30 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.57799999999999996,"15min":0.54600000000000004},"min":{"1min":0.53700000000000003,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.81000000000000005,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.55300000000000005,"15min":0.52800000000000002},"min":{"1min":0.42899999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.80000000000000004,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.66700000000000004}]},{"osd":3,"last update":"Mon Apr 1 06:54:43 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.55400000000000005,"15min":0.53500000000000003},"min":{"1min":0.39700000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.58199999999999996,"15min":0.55000000000000004},"min":{"1min":0.48499999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.68600000000000005}]},{"osd":4,"last update":"Mon Apr 1 06:55:03 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.443,"15min":0.41199999999999998},"min":{"1min":0.379,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.46200000000000002,"15min":0.42099999999999999},"min":{"1min":0.35599999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.56299999999999994}]},{"osd":5,"last update":"Mon Apr 1 06:55:17 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.60899999999999999,"15min":0.59199999999999997},"min":{"1min":0.47499999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90100000000000002,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.58999999999999997,"15min":0.56699999999999995},"min":{"1min":0.34300000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.89700000000000002,"5min":1.081,"15min":1.081},"last":0.77900000000000003}]},{"osd":6,"last update":"Mon Apr 1 06:55:35 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.61799999999999999,"15min":0.56699999999999995},"min":{"1min":0.41599999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":5.4740000000000002,"5min":5.4740000000000002,"15min":5.4740000000000002},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.64500000000000002,"15min":0.58799999999999997},"min":{"1min":0.46300000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":5.5110000000000001,"5min":5.5110000000000001,"15min":5.5110000000000001},"last":0.63600000000000001}]},{"osd":7,"last update":"Mon Apr 1 06:54:48 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.59599999999999997,"15min":0.58299999999999996},"min":{"1min":0.436,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.63400000000000001,"15min":0.622},"min":{"1min":0.54800000000000004,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.90700000000000003,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.76100000000000001}]},{"osd":8,"last update":"Mon Apr 1 06:55:07 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.69699999999999995,"15min":0.69199999999999995},"min":{"1min":0.499,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.73899999999999999,"15min":0.73099999999999998},"min":{"1min":0.63700000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.94599999999999995,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.81799999999999995}]},{"osd":9,"last update":"Mon Apr 1 06:55:27 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.76900000000000002,"15min":0.745},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":5.6699999999999999,"5min":5.6699999999999999,"15min":5.6699999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.80600000000000005,"15min":0.78100000000000003},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":5.6189999999999998,"5min":5.6189999999999998,"15min":5.6189999999999998},"last":0.80300000000000005}]},{"osd":10,"last update":"Mon Apr 1 06:54:43 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.82799999999999996}]},{"osd":11,"last update":"Mon Apr 1 06:55:30 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.85499999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738430,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":901120,"data_stored":426665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Apr 1 06:55:09 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.48599999999999999,"15min":0.46800000000000003},"min":{"1min":0.379,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.625,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.47699999999999998,"15min":0.47099999999999997},"min":{"1min":0.33400000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.64300000000000002,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.42299999999999999}]},{"osd":2,"last update":"Mon Apr 1 06:55:30 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.48699999999999999,"15min":0.46700000000000003},"min":{"1min":0.33000000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.68000000000000005,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.48399999999999999,"15min":0.47899999999999998},"min":{"1min":0.35599999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.70499999999999996,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.35599999999999998}]},{"osd":3,"last update":"Mon Apr 1 06:55:30 2024","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.313},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.40300000000000002}]},{"osd":4,"last update":"Mon Apr 1 06:55:03 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.50900000000000001,"15min":0.501},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.71099999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.505},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.52500000000000002,"15min":0.51300000000000001},"min":{"1min":0.40799999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.69499999999999995,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.58999999999999997}]},{"osd":5,"last update":"Mon Apr 1 06:55:17 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.52900000000000003,"15min":0.52800000000000002},"min":{"1min":0.41499999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.65600000000000003,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.52100000000000002,"15min":0.52400000000000002},"min":{"1min":0.41999999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.67100000000000004,"5min":0.748,"15min":0.748},"last":0.46800000000000003}]},{"osd":6,"last update":"Mon Apr 1 06:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.44,"15min":0.436},"min":{"1min":0.33200000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.502,"15min":0.50600000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.48899999999999999}]},{"osd":7,"last update":"Mon Apr 1 06:53:50 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.46000000000000002}]},{"osd":8,"last update":"Mon Apr 1 06:55:09 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.623,"15min":0.63200000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.76500000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.623,"15min":0.63300000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.71699999999999997,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.51500000000000001}]},{"osd":9,"last update":"Mon Apr 1 06:55:26 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.56899999999999995,"15min":0.58199999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.71699999999999997,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.621,"15min":0.63600000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73599999999999999,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.52700000000000002}]},{"osd":10,"last update":"Mon Apr 1 06:54:43 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.64500000000000002}]},{"osd":11,"last update":"Mon Apr 1 06:55:03 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.67600000000000005}]}]},{"osd":2,"up_from":18,"seq":77309411383,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":487882,"data_compressed":1866,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:55:30 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.48699999999999999,"15min":0.46800000000000003},"min":{"1min":0.32900000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.70499999999999996,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47399999999999998,"15min":0.45800000000000002},"min":{"1min":0.34599999999999997,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.60299999999999998,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.36799999999999999}]},{"osd":1,"last update":"Mon Apr 1 06:55:30 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.55000000000000004,"15min":0.52200000000000002},"min":{"1min":0.46200000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.55500000000000005,"15min":0.54000000000000004},"min":{"1min":0.40699999999999997,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.63500000000000001}]},{"osd":3,"last update":"Mon Apr 1 06:54:45 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.53500000000000003,"15min":0.52900000000000003},"min":{"1min":0.40899999999999997,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.71199999999999997,"5min":0.748,"15min":0.748},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56200000000000006,"15min":0.54600000000000004},"min":{"1min":0.434,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77500000000000002,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.51000000000000001}]},{"osd":4,"last update":"Mon Apr 1 06:55:30 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.62},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.68400000000000005}]},{"osd":5,"last update":"Mon Apr 1 06:55:17 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.48599999999999999,"15min":0.45900000000000002},"min":{"1min":0.39800000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.81200000000000006,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.48399999999999999,"15min":0.46600000000000003},"min":{"1min":0.35199999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.29999999999999999}]},{"osd":6,"last update":"Mon Apr 1 06:55:33 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.60599999999999998,"15min":0.59799999999999998},"min":{"1min":0.48399999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.83299999999999996,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.63100000000000001,"15min":0.629},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.439}]},{"osd":7,"last update":"Mon Apr 1 06:53:49 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.60099999999999998}]},{"osd":8,"last update":"Mon Apr 1 06:55:06 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.67900000000000005,"15min":0.68200000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60599999999999998,"15min":0.60399999999999998},"min":{"1min":0.438,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.60899999999999999}]},{"osd":9,"last update":"Mon Apr 1 06:55:25 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.65600000000000003,"15min":0.65200000000000002},"min":{"1min":0.47999999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.61799999999999999,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.59499999999999997}]},{"osd":10,"last update":"Mon Apr 1 06:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.66600000000000004}]},{"osd":11,"last update":"Mon Apr 1 06:55:30 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.496}]}]},{"osd":3,"up_from":25,"seq":107374182451,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31992,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713160,"statfs":{"total":95995035648,"available":95962275840,"internally_reserved":0,"allocated":892928,"data_stored":425374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:54:41 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.33900000000000002,"15min":0.33000000000000002},"min":{"1min":0.29499999999999998,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.38},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.34599999999999997,"15min":0.33500000000000002},"min":{"1min":0.26400000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.57999999999999996,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.35899999999999999}]},{"osd":1,"last update":"Mon Apr 1 06:54:41 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.52900000000000003,"15min":0.51600000000000001},"min":{"1min":0.38800000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.51400000000000001,"15min":0.499},"min":{"1min":0.39400000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76900000000000002,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.66700000000000004}]},{"osd":2,"last update":"Mon Apr 1 06:54:41 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.52400000000000002,"15min":0.51400000000000001},"min":{"1min":0.35599999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.68899999999999995,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.54000000000000004,"15min":0.53000000000000003},"min":{"1min":0.41799999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.85199999999999998,"5min":0.874,"15min":0.874},"last":0.46200000000000002}]},{"osd":4,"last update":"Mon Apr 1 06:55:02 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53900000000000003,"15min":0.52700000000000002},"min":{"1min":0.40200000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.745,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56699999999999995,"15min":0.55700000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80600000000000005,"5min":1.131,"15min":1.131},"last":0.73799999999999999}]},{"osd":5,"last update":"Mon Apr 1 06:55:17 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.52100000000000002,"15min":0.51100000000000001},"min":{"1min":0.36899999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.71799999999999997,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.55800000000000005,"15min":0.55100000000000005},"min":{"1min":0.40699999999999997,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.71099999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.502}]},{"osd":6,"last update":"Mon Apr 1 06:55:36 2024","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.42999999999999999,"15min":0.42599999999999999},"min":{"1min":0.31900000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.64000000000000001,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.443,"5min":0.46999999999999997,"15min":0.46600000000000003},"min":{"1min":0.34100000000000003,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.67100000000000004,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.48699999999999999}]},{"osd":7,"last update":"Mon Apr 1 06:54:56 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.42199999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.75700000000000001,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.63300000000000001,"15min":0.63500000000000001},"min":{"1min":0.41499999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.85799999999999998,"5min":1.171,"15min":1.171},"last":0.76400000000000001}]},{"osd":8,"last update":"Mon Apr 1 06:54:04 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.71999999999999997}]},{"osd":9,"last update":"Mon Apr 1 06:55:27 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.628,"15min":0.64400000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.745,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.496,"5min":0.61299999999999999,"15min":0.63300000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68899999999999995,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.40999999999999998}]},{"osd":10,"last update":"Mon Apr 1 06:54:40 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.65600000000000003}]},{"osd":11,"last update":"Mon Apr 1 06:55:31 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.70199999999999996}]}]},{"osd":4,"up_from":32,"seq":137438953521,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":884736,"data_stored":426490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:54:02 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.496,"15min":0.48799999999999999},"min":{"1min":0.34899999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.433},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.48299999999999998,"15min":0.47699999999999998},"min":{"1min":0.30399999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.41799999999999998}]},{"osd":1,"last update":"Mon Apr 1 06:55:03 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.35199999999999998,"15min":0.33400000000000002},"min":{"1min":0.251,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.36499999999999999,"15min":0.35299999999999998},"min":{"1min":0.29099999999999998,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.48199999999999998}]},{"osd":2,"last update":"Mon Apr 1 06:55:03 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.51200000000000001,"15min":0.496},"min":{"1min":0.435,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.52100000000000002,"15min":0.48899999999999999},"min":{"1min":0.40699999999999997,"5min":0.316,"15min":0.316},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.73899999999999999}]},{"osd":3,"last update":"Mon Apr 1 06:55:03 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.53400000000000003,"15min":0.52900000000000003},"min":{"1min":0.36899999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.73499999999999999,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.51400000000000001,"15min":0.498},"min":{"1min":0.39200000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.63900000000000001}]},{"osd":5,"last update":"Mon Apr 1 06:55:17 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.56999999999999995,"15min":0.55200000000000005},"min":{"1min":0.45800000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.84099999999999997,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.628},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.44700000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.74399999999999999}]},{"osd":6,"last update":"Mon Apr 1 06:55:39 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.53500000000000003,"15min":0.53700000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.61599999999999999,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.65500000000000003,"15min":0.66900000000000004},"min":{"1min":0.42999999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.71699999999999997,"5min":2.52,"15min":2.52},"last":0.66800000000000004}]},{"osd":7,"last update":"Mon Apr 1 06:54:48 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.34200000000000003,"5min":0.316,"15min":0.316},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.51500000000000001,"15min":0.51200000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.51100000000000001}]},{"osd":8,"last update":"Mon Apr 1 06:55:06 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.58599999999999997,"15min":0.57699999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.65400000000000003,"15min":0.64300000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.83299999999999996}]},{"osd":9,"last update":"Mon Apr 1 06:55:22 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.65000000000000002,"15min":0.64700000000000002},"min":{"1min":0.53800000000000003,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.72199999999999998,"15min":0.72499999999999998},"min":{"1min":0.60799999999999998,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":0.85499999999999998,"5min":1.119,"15min":1.119},"last":0.71399999999999997}]},{"osd":10,"last update":"Mon Apr 1 06:54:43 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.78400000000000003}]},{"osd":11,"last update":"Mon Apr 1 06:55:27 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.87}]}]},{"osd":5,"up_from":36,"seq":154618822701,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32052,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713100,"statfs":{"total":95995035648,"available":95962214400,"internally_reserved":0,"allocated":954368,"data_stored":1017493,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:55:14 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.501,"15min":0.48499999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.63900000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.498,"5min":0.499,"15min":0.49299999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.69299999999999995,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.52300000000000002}]},{"osd":1,"last update":"Mon Apr 1 06:55:14 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.54800000000000004,"15min":0.53000000000000003},"min":{"1min":0.39800000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.54900000000000004,"15min":0.53300000000000003},"min":{"1min":0.39900000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.75800000000000001}]},{"osd":2,"last update":"Mon Apr 1 06:55:14 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.39800000000000002,"15min":0.38800000000000001},"min":{"1min":0.27500000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.503},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.40799999999999997,"15min":0.40300000000000002},"min":{"1min":0.29499999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.64200000000000002}]},{"osd":3,"last update":"Mon Apr 1 06:55:14 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54500000000000004,"15min":0.54800000000000004},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.67100000000000004,"5min":1.389,"15min":1.389},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.63,"15min":0.66600000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.65400000000000003,"5min":3.9540000000000002,"15min":3.9540000000000002},"last":0.69199999999999995}]},{"osd":4,"last update":"Mon Apr 1 06:55:14 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.57099999999999995,"15min":0.55300000000000005},"min":{"1min":0.39700000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.60199999999999998,"15min":0.59299999999999997},"min":{"1min":0.45600000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.72899999999999998}]},{"osd":6,"last update":"Mon Apr 1 06:55:37 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.56699999999999995,"15min":0.55600000000000005},"min":{"1min":0.42299999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.78900000000000003,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.58299999999999996,"15min":0.57499999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.72799999999999998,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.746}]},{"osd":7,"last update":"Mon Apr 1 06:54:49 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64200000000000002,"15min":0.64000000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.86499999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.65600000000000003,"15min":0.65000000000000002},"min":{"1min":0.53000000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.85799999999999998}]},{"osd":8,"last update":"Mon Apr 1 06:55:05 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.622,"15min":0.623},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.61199999999999999,"15min":0.60799999999999998},"min":{"1min":0.42999999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.621}]},{"osd":9,"last update":"Mon Apr 1 06:55:26 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.65700000000000003,"15min":0.65100000000000002},"min":{"1min":0.50900000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.67200000000000004,"15min":0.66500000000000004},"min":{"1min":0.50700000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.81499999999999995}]},{"osd":10,"last update":"Mon Apr 1 06:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.89000000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34069,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34069,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":61314,"data_compressed":1866,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":62695,"data_compressed":1866,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":63551,"data_compressed":1866,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T06:55:42.723 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-04-01T06:55:42.723 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-01T06:55:42.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.880+0000 7f0205731700 1 -- 172.21.15.83:0/1003520503 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0200100d80 msgr2=0x7f02001011e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:42.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.880+0000 7f0205731700 1 --2- 172.21.15.83:0/1003520503 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0200100d80 0x7f02001011e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f01e80099c0 tx=0x7f01e8009cd0 comp rx=0 tx=0).stop 2024-04-01T06:55:42.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.880+0000 7f0205731700 1 -- 172.21.15.83:0/1003520503 shutdown_connections 2024-04-01T06:55:42.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.880+0000 7f0205731700 1 --2- 172.21.15.83:0/1003520503 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0200101720 0x7f0200107fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:42.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.880+0000 7f0205731700 1 --2- 172.21.15.83:0/1003520503 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02000ffb90 0x7f02000fffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:42.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.880+0000 7f0205731700 1 --2- 172.21.15.83:0/1003520503 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0200100d80 0x7f02001011e0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:42.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.880+0000 7f0205731700 1 -- 172.21.15.83:0/1003520503 >> 172.21.15.83:0/1003520503 conn(0x7f02000fb100 msgr2=0x7f02000fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:42.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.880+0000 7f0205731700 1 -- 172.21.15.83:0/1003520503 shutdown_connections 2024-04-01T06:55:42.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.880+0000 7f0205731700 1 -- 172.21.15.83:0/1003520503 wait complete. 2024-04-01T06:55:42.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.880+0000 7f0205731700 1 Processor -- start 2024-04-01T06:55:42.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.881+0000 7f0205731700 1 -- start start 2024-04-01T06:55:42.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.881+0000 7f0205731700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f02000ffb90 0x7f0200195b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:42.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.881+0000 7f0205731700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0200100d80 0x7f0200196040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:42.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.881+0000 7f0205731700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0200101720 0x7f020019d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:42.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.881+0000 7f0205731700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020019d630 con 0x7f0200101720 2024-04-01T06:55:42.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.881+0000 7f0205731700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020019d770 con 0x7f02000ffb90 2024-04-01T06:55:42.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.881+0000 7f0205731700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020019d900 con 0x7f0200100d80 2024-04-01T06:55:42.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.881+0000 7f01ff7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0200101720 0x7f020019d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:42.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.881+0000 7f01ff7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0200101720 0x7f020019d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:47102/0 (socket says 172.21.15.83:47102) 2024-04-01T06:55:42.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.881+0000 7f01ff7fe700 1 -- 172.21.15.83:0/1427125244 learned_addr learned my addr 172.21.15.83:0/1427125244 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:42.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.881+0000 7f01fe7fc700 1 --2- 172.21.15.83:0/1427125244 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0200100d80 0x7f0200196040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:42.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.881+0000 7f01feffd700 1 --2- 172.21.15.83:0/1427125244 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f02000ffb90 0x7f0200195b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:42.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.881+0000 7f01ff7fe700 1 -- 172.21.15.83:0/1427125244 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0200100d80 msgr2=0x7f0200196040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:42.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.881+0000 7f01ff7fe700 1 --2- 172.21.15.83:0/1427125244 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0200100d80 0x7f0200196040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:42.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.881+0000 7f01ff7fe700 1 -- 172.21.15.83:0/1427125244 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f02000ffb90 msgr2=0x7f0200195b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:42.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.881+0000 7f01ff7fe700 1 --2- 172.21.15.83:0/1427125244 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f02000ffb90 0x7f0200195b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:42.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.881+0000 7f01ff7fe700 1 -- 172.21.15.83:0/1427125244 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e80095f0 con 0x7f0200101720 2024-04-01T06:55:42.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.881+0000 7f01feffd700 1 --2- 172.21.15.83:0/1427125244 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f02000ffb90 0x7f0200195b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:55:42.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.881+0000 7f01ff7fe700 1 --2- 172.21.15.83:0/1427125244 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0200101720 0x7f020019d060 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f01f800b970 tx=0x7f01f800bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:42.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.881+0000 7f01f7fff700 1 -- 172.21.15.83:0/1427125244 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f800c930 con 0x7f0200101720 2024-04-01T06:55:42.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.882+0000 7f01f7fff700 1 -- 172.21.15.83:0/1427125244 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f01f8014440 con 0x7f0200101720 2024-04-01T06:55:42.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.882+0000 7f01f7fff700 1 -- 172.21.15.83:0/1427125244 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f80075d0 con 0x7f0200101720 2024-04-01T06:55:42.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.882+0000 7f0205731700 1 -- 172.21.15.83:0/1427125244 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f020019dbe0 con 0x7f0200101720 2024-04-01T06:55:42.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.882+0000 7f0205731700 1 -- 172.21.15.83:0/1427125244 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f020019e0a0 con 0x7f0200101720 2024-04-01T06:55:42.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.883+0000 7f0205731700 1 -- 172.21.15.83:0/1427125244 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0200107010 con 0x7f0200101720 2024-04-01T06:55:42.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.884+0000 7f01f7fff700 1 -- 172.21.15.83:0/1427125244 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f01f80145b0 con 0x7f0200101720 2024-04-01T06:55:42.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.884+0000 7f01f7fff700 1 --2- 172.21.15.83:0/1427125244 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f01ec0a11b0 0x7f01ec0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:42.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.884+0000 7f01feffd700 1 --2- 172.21.15.83:0/1427125244 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f01ec0a11b0 0x7f01ec0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:42.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.884+0000 7f01f7fff700 1 -- 172.21.15.83:0/1427125244 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f01f8006e40 con 0x7f0200101720 2024-04-01T06:55:42.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.884+0000 7f01feffd700 1 --2- 172.21.15.83:0/1427125244 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f01ec0a11b0 0x7f01ec0a3670 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f01f0005fd0 tx=0x7f01f0005f00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:42.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:42.888+0000 7f01f7fff700 1 -- 172.21.15.83:0/1427125244 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f01f80cf030 con 0x7f0200101720 2024-04-01T06:55:43.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:42 smithi145 ceph-mon[47816]: pgmap v255: 97 pgs: 97 active+clean; 641 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 510 B/s wr, 5 op/s; 0 B/s, 0 objects/s recovering 2024-04-01T06:55:43.006 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:42 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/4073667491' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:55:43.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:42 smithi083 ceph-mon[43429]: pgmap v255: 97 pgs: 97 active+clean; 641 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 510 B/s wr, 5 op/s; 0 B/s, 0 objects/s recovering 2024-04-01T06:55:43.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:42 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/4073667491' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:55:43.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.080+0000 7f0205731700 1 -- 172.21.15.83:0/1427125244 --> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f020002cd20 con 0x7f01ec0a11b0 2024-04-01T06:55:43.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.090+0000 7f01f7fff700 1 -- 172.21.15.83:0/1427125244 <== mgr.14152 v2:172.21.15.83:6800/3375372052 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344736 (secure 0 0 0) 0x7f020002cd20 con 0x7f01ec0a11b0 2024-04-01T06:55:43.094 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:55:43.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.093+0000 7f0205731700 1 -- 172.21.15.83:0/1427125244 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f01ec0a11b0 msgr2=0x7f01ec0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:43.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.093+0000 7f0205731700 1 --2- 172.21.15.83:0/1427125244 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f01ec0a11b0 0x7f01ec0a3670 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f01f0005fd0 tx=0x7f01f0005f00 comp rx=0 tx=0).stop 2024-04-01T06:55:43.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.094+0000 7f0205731700 1 -- 172.21.15.83:0/1427125244 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0200101720 msgr2=0x7f020019d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:43.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.094+0000 7f0205731700 1 --2- 172.21.15.83:0/1427125244 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0200101720 0x7f020019d060 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f01f800b970 tx=0x7f01f800bc80 comp rx=0 tx=0).stop 2024-04-01T06:55:43.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.094+0000 7f0205731700 1 -- 172.21.15.83:0/1427125244 shutdown_connections 2024-04-01T06:55:43.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.094+0000 7f0205731700 1 --2- 172.21.15.83:0/1427125244 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0200101720 0x7f020019d060 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:43.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.094+0000 7f0205731700 1 --2- 172.21.15.83:0/1427125244 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f01ec0a11b0 0x7f01ec0a3670 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:43.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.094+0000 7f0205731700 1 --2- 172.21.15.83:0/1427125244 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f02000ffb90 0x7f0200195b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:43.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.094+0000 7f0205731700 1 --2- 172.21.15.83:0/1427125244 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0200100d80 0x7f0200196040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:43.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.094+0000 7f0205731700 1 -- 172.21.15.83:0/1427125244 >> 172.21.15.83:0/1427125244 conn(0x7f02000fb100 msgr2=0x7f0200104150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:43.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.094+0000 7f0205731700 1 -- 172.21.15.83:0/1427125244 shutdown_connections 2024-04-01T06:55:43.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.094+0000 7f0205731700 1 -- 172.21.15.83:0/1427125244 wait complete. 2024-04-01T06:55:43.098 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-04-01T06:55:43.106 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":255,"stamp":"2024-04-01T06:55:41.730451+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656530,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":559,"num_read_kb":400,"num_write":338,"num_write_kb":3051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":292,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":363716,"kb_used_data":10780,"kb_used_omap":18,"kb_used_meta":352749,"kb_avail":1124578108,"statfs":{"total":1151940427776,"available":1151567982592,"internally_reserved":0,"allocated":11038720,"data_stored":7070544,"data_compressed":112716,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":19130,"internal_metadata":361215302},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":628,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":22,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.025599"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716372+0000","last_change":"2024-04-01T06:54:28.426588+0000","last_active":"2024-04-01T06:55:33.716372+0000","last_peered":"2024-04-01T06:55:33.716372+0000","last_clean":"2024-04-01T06:55:33.716372+0000","last_became_active":"2024-04-01T06:54:28.423723+0000","last_became_peered":"2024-04-01T06:54:28.423723+0000","last_unstale":"2024-04-01T06:55:33.716372+0000","last_undegraded":"2024-04-01T06:55:33.716372+0000","last_fullsized":"2024-04-01T06:55:33.716372+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:52:38.856474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716446+0000","last_change":"2024-04-01T06:54:28.419858+0000","last_active":"2024-04-01T06:55:33.716446+0000","last_peered":"2024-04-01T06:55:33.716446+0000","last_clean":"2024-04-01T06:55:33.716446+0000","last_became_active":"2024-04-01T06:54:28.419534+0000","last_became_peered":"2024-04-01T06:54:28.419534+0000","last_unstale":"2024-04-01T06:55:33.716446+0000","last_undegraded":"2024-04-01T06:55:33.716446+0000","last_fullsized":"2024-04-01T06:55:33.716446+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:26:56.349672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716134+0000","last_change":"2024-04-01T06:54:28.422763+0000","last_active":"2024-04-01T06:55:33.716134+0000","last_peered":"2024-04-01T06:55:33.716134+0000","last_clean":"2024-04-01T06:55:33.716134+0000","last_became_active":"2024-04-01T06:54:28.422439+0000","last_became_peered":"2024-04-01T06:54:28.422439+0000","last_unstale":"2024-04-01T06:55:33.716134+0000","last_undegraded":"2024-04-01T06:55:33.716134+0000","last_fullsized":"2024-04-01T06:55:33.716134+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:55:24.379428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.714265+0000","last_change":"2024-04-01T06:54:28.421996+0000","last_active":"2024-04-01T06:55:33.714265+0000","last_peered":"2024-04-01T06:55:33.714265+0000","last_clean":"2024-04-01T06:55:33.714265+0000","last_became_active":"2024-04-01T06:54:28.421594+0000","last_became_peered":"2024-04-01T06:54:28.421594+0000","last_unstale":"2024-04-01T06:55:33.714265+0000","last_undegraded":"2024-04-01T06:55:33.714265+0000","last_fullsized":"2024-04-01T06:55:33.714265+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:36:53.200615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.714110+0000","last_change":"2024-04-01T06:54:28.415652+0000","last_active":"2024-04-01T06:55:33.714110+0000","last_peered":"2024-04-01T06:55:33.714110+0000","last_clean":"2024-04-01T06:55:33.714110+0000","last_became_active":"2024-04-01T06:54:28.415296+0000","last_became_peered":"2024-04-01T06:54:28.415296+0000","last_unstale":"2024-04-01T06:55:33.714110+0000","last_undegraded":"2024-04-01T06:55:33.714110+0000","last_fullsized":"2024-04-01T06:55:33.714110+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:36:36.967298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.708136+0000","last_change":"2024-04-01T06:54:28.421188+0000","last_active":"2024-04-01T06:55:33.708136+0000","last_peered":"2024-04-01T06:55:33.708136+0000","last_clean":"2024-04-01T06:55:33.708136+0000","last_became_active":"2024-04-01T06:54:28.420863+0000","last_became_peered":"2024-04-01T06:54:28.420863+0000","last_unstale":"2024-04-01T06:55:33.708136+0000","last_undegraded":"2024-04-01T06:55:33.708136+0000","last_fullsized":"2024-04-01T06:55:33.708136+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:40:38.641128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:34.126221+0000","last_change":"2024-04-01T06:54:28.422554+0000","last_active":"2024-04-01T06:55:34.126221+0000","last_peered":"2024-04-01T06:55:34.126221+0000","last_clean":"2024-04-01T06:55:34.126221+0000","last_became_active":"2024-04-01T06:54:28.422209+0000","last_became_peered":"2024-04-01T06:54:28.422209+0000","last_unstale":"2024-04-01T06:55:34.126221+0000","last_undegraded":"2024-04-01T06:55:34.126221+0000","last_fullsized":"2024-04-01T06:55:34.126221+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T14:59:45.017681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.708816+0000","last_change":"2024-04-01T06:54:28.419291+0000","last_active":"2024-04-01T06:55:33.708816+0000","last_peered":"2024-04-01T06:55:33.708816+0000","last_clean":"2024-04-01T06:55:33.708816+0000","last_became_active":"2024-04-01T06:54:28.419013+0000","last_became_peered":"2024-04-01T06:54:28.419013+0000","last_unstale":"2024-04-01T06:55:33.708816+0000","last_undegraded":"2024-04-01T06:55:33.708816+0000","last_fullsized":"2024-04-01T06:55:33.708816+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:45:08.226568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716052+0000","last_change":"2024-04-01T06:54:28.410264+0000","last_active":"2024-04-01T06:55:33.716052+0000","last_peered":"2024-04-01T06:55:33.716052+0000","last_clean":"2024-04-01T06:55:33.716052+0000","last_became_active":"2024-04-01T06:54:28.409959+0000","last_became_peered":"2024-04-01T06:54:28.409959+0000","last_unstale":"2024-04-01T06:55:33.716052+0000","last_undegraded":"2024-04-01T06:55:33.716052+0000","last_fullsized":"2024-04-01T06:55:33.716052+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:14:13.184396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.708298+0000","last_change":"2024-04-01T06:54:28.422115+0000","last_active":"2024-04-01T06:55:33.708298+0000","last_peered":"2024-04-01T06:55:33.708298+0000","last_clean":"2024-04-01T06:55:33.708298+0000","last_became_active":"2024-04-01T06:54:28.421629+0000","last_became_peered":"2024-04-01T06:54:28.421629+0000","last_unstale":"2024-04-01T06:55:33.708298+0000","last_undegraded":"2024-04-01T06:55:33.708298+0000","last_fullsized":"2024-04-01T06:55:33.708298+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:47:03.271557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:34.126524+0000","last_change":"2024-04-01T06:54:28.429652+0000","last_active":"2024-04-01T06:55:34.126524+0000","last_peered":"2024-04-01T06:55:34.126524+0000","last_clean":"2024-04-01T06:55:34.126524+0000","last_became_active":"2024-04-01T06:54:28.429298+0000","last_became_peered":"2024-04-01T06:54:28.429298+0000","last_unstale":"2024-04-01T06:55:34.126524+0000","last_undegraded":"2024-04-01T06:55:34.126524+0000","last_fullsized":"2024-04-01T06:55:34.126524+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:03:16.110580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-01T06:55:34.715630+0000","last_change":"2024-04-01T06:55:34.715262+0000","last_active":"2024-04-01T06:55:34.715630+0000","last_peered":"2024-04-01T06:55:34.715630+0000","last_clean":"2024-04-01T06:55:34.715630+0000","last_became_active":"2024-04-01T06:55:34.714990+0000","last_became_peered":"2024-04-01T06:55:34.714990+0000","last_unstale":"2024-04-01T06:55:34.715630+0000","last_undegraded":"2024-04-01T06:55:34.715630+0000","last_fullsized":"2024-04-01T06:55:34.715630+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:26:24.665741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716196+0000","last_change":"2024-04-01T06:54:28.419390+0000","last_active":"2024-04-01T06:55:33.716196+0000","last_peered":"2024-04-01T06:55:33.716196+0000","last_clean":"2024-04-01T06:55:33.716196+0000","last_became_active":"2024-04-01T06:54:28.419110+0000","last_became_peered":"2024-04-01T06:54:28.419110+0000","last_unstale":"2024-04-01T06:55:33.716196+0000","last_undegraded":"2024-04-01T06:55:33.716196+0000","last_fullsized":"2024-04-01T06:55:33.716196+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:21:52.192681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716042+0000","last_change":"2024-04-01T06:54:28.419416+0000","last_active":"2024-04-01T06:55:33.716042+0000","last_peered":"2024-04-01T06:55:33.716042+0000","last_clean":"2024-04-01T06:55:33.716042+0000","last_became_active":"2024-04-01T06:54:28.419099+0000","last_became_peered":"2024-04-01T06:54:28.419099+0000","last_unstale":"2024-04-01T06:55:33.716042+0000","last_undegraded":"2024-04-01T06:55:33.716042+0000","last_fullsized":"2024-04-01T06:55:33.716042+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:26:44.889806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716363+0000","last_change":"2024-04-01T06:54:28.427391+0000","last_active":"2024-04-01T06:55:33.716363+0000","last_peered":"2024-04-01T06:55:33.716363+0000","last_clean":"2024-04-01T06:55:33.716363+0000","last_became_active":"2024-04-01T06:54:28.427153+0000","last_became_peered":"2024-04-01T06:54:28.427153+0000","last_unstale":"2024-04-01T06:55:33.716363+0000","last_undegraded":"2024-04-01T06:55:33.716363+0000","last_fullsized":"2024-04-01T06:55:33.716363+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:42:41.084729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.715722+0000","last_change":"2024-04-01T06:54:28.417088+0000","last_active":"2024-04-01T06:55:33.715722+0000","last_peered":"2024-04-01T06:55:33.715722+0000","last_clean":"2024-04-01T06:55:33.715722+0000","last_became_active":"2024-04-01T06:54:28.416747+0000","last_became_peered":"2024-04-01T06:54:28.416747+0000","last_unstale":"2024-04-01T06:55:33.715722+0000","last_undegraded":"2024-04-01T06:55:33.715722+0000","last_fullsized":"2024-04-01T06:55:33.715722+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:59:14.069761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716603+0000","last_change":"2024-04-01T06:54:28.426049+0000","last_active":"2024-04-01T06:55:33.716603+0000","last_peered":"2024-04-01T06:55:33.716603+0000","last_clean":"2024-04-01T06:55:33.716603+0000","last_became_active":"2024-04-01T06:54:28.425723+0000","last_became_peered":"2024-04-01T06:54:28.425723+0000","last_unstale":"2024-04-01T06:55:33.716603+0000","last_undegraded":"2024-04-01T06:55:33.716603+0000","last_fullsized":"2024-04-01T06:55:33.716603+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:48:59.394352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.712623+0000","last_change":"2024-04-01T06:54:28.421574+0000","last_active":"2024-04-01T06:55:33.712623+0000","last_peered":"2024-04-01T06:55:33.712623+0000","last_clean":"2024-04-01T06:55:33.712623+0000","last_became_active":"2024-04-01T06:54:28.420852+0000","last_became_peered":"2024-04-01T06:54:28.420852+0000","last_unstale":"2024-04-01T06:55:33.712623+0000","last_undegraded":"2024-04-01T06:55:33.712623+0000","last_fullsized":"2024-04-01T06:55:33.712623+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:20:30.373285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.715566+0000","last_change":"2024-04-01T06:54:28.419249+0000","last_active":"2024-04-01T06:55:33.715566+0000","last_peered":"2024-04-01T06:55:33.715566+0000","last_clean":"2024-04-01T06:55:33.715566+0000","last_became_active":"2024-04-01T06:54:28.418931+0000","last_became_peered":"2024-04-01T06:54:28.418931+0000","last_unstale":"2024-04-01T06:55:33.715566+0000","last_undegraded":"2024-04-01T06:55:33.715566+0000","last_fullsized":"2024-04-01T06:55:33.715566+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:38:04.786657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"79'9","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.712433+0000","last_change":"2024-04-01T06:54:27.993489+0000","last_active":"2024-04-01T06:55:33.712433+0000","last_peered":"2024-04-01T06:55:33.712433+0000","last_clean":"2024-04-01T06:55:33.712433+0000","last_became_active":"2024-04-01T06:54:27.993201+0000","last_became_peered":"2024-04-01T06:54:27.993201+0000","last_unstale":"2024-04-01T06:55:33.712433+0000","last_undegraded":"2024-04-01T06:55:33.712433+0000","last_fullsized":"2024-04-01T06:55:33.712433+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:10:53.897013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.709212+0000","last_change":"2024-04-01T06:54:28.417750+0000","last_active":"2024-04-01T06:55:33.709212+0000","last_peered":"2024-04-01T06:55:33.709212+0000","last_clean":"2024-04-01T06:55:33.709212+0000","last_became_active":"2024-04-01T06:54:28.417470+0000","last_became_peered":"2024-04-01T06:54:28.417470+0000","last_unstale":"2024-04-01T06:55:33.709212+0000","last_undegraded":"2024-04-01T06:55:33.709212+0000","last_fullsized":"2024-04-01T06:55:33.709212+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:06:12.668846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"79'2","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.709258+0000","last_change":"2024-04-01T06:54:27.998302+0000","last_active":"2024-04-01T06:55:33.709258+0000","last_peered":"2024-04-01T06:55:33.709258+0000","last_clean":"2024-04-01T06:55:33.709258+0000","last_became_active":"2024-04-01T06:54:27.997951+0000","last_became_peered":"2024-04-01T06:54:27.997951+0000","last_unstale":"2024-04-01T06:55:33.709258+0000","last_undegraded":"2024-04-01T06:55:33.709258+0000","last_fullsized":"2024-04-01T06:55:33.709258+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:28:45.076734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716591+0000","last_change":"2024-04-01T06:54:28.415641+0000","last_active":"2024-04-01T06:55:33.716591+0000","last_peered":"2024-04-01T06:55:33.716591+0000","last_clean":"2024-04-01T06:55:33.716591+0000","last_became_active":"2024-04-01T06:54:28.415305+0000","last_became_peered":"2024-04-01T06:54:28.415305+0000","last_unstale":"2024-04-01T06:55:33.716591+0000","last_undegraded":"2024-04-01T06:55:33.716591+0000","last_fullsized":"2024-04-01T06:55:33.716591+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:01:46.528332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"79'4","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.714604+0000","last_change":"2024-04-01T06:54:27.990581+0000","last_active":"2024-04-01T06:55:33.714604+0000","last_peered":"2024-04-01T06:55:33.714604+0000","last_clean":"2024-04-01T06:55:33.714604+0000","last_became_active":"2024-04-01T06:54:27.990099+0000","last_became_peered":"2024-04-01T06:54:27.990099+0000","last_unstale":"2024-04-01T06:55:33.714604+0000","last_undegraded":"2024-04-01T06:55:33.714604+0000","last_fullsized":"2024-04-01T06:55:33.714604+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T14:53:49.183394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.715962+0000","last_change":"2024-04-01T06:54:28.423208+0000","last_active":"2024-04-01T06:55:33.715962+0000","last_peered":"2024-04-01T06:55:33.715962+0000","last_clean":"2024-04-01T06:55:33.715962+0000","last_became_active":"2024-04-01T06:54:28.422648+0000","last_became_peered":"2024-04-01T06:54:28.422648+0000","last_unstale":"2024-04-01T06:55:33.715962+0000","last_undegraded":"2024-04-01T06:55:33.715962+0000","last_fullsized":"2024-04-01T06:55:33.715962+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:02:58.380288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-01T06:55:34.718704+0000","last_change":"2024-04-01T06:55:34.718293+0000","last_active":"2024-04-01T06:55:34.718704+0000","last_peered":"2024-04-01T06:55:34.718704+0000","last_clean":"2024-04-01T06:55:34.718704+0000","last_became_active":"2024-04-01T06:55:34.715149+0000","last_became_peered":"2024-04-01T06:55:34.715149+0000","last_unstale":"2024-04-01T06:55:34.718704+0000","last_undegraded":"2024-04-01T06:55:34.718704+0000","last_fullsized":"2024-04-01T06:55:34.718704+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:03:55.371430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.711859+0000","last_change":"2024-04-01T06:54:28.422448+0000","last_active":"2024-04-01T06:55:33.711859+0000","last_peered":"2024-04-01T06:55:33.711859+0000","last_clean":"2024-04-01T06:55:33.711859+0000","last_became_active":"2024-04-01T06:54:28.422080+0000","last_became_peered":"2024-04-01T06:54:28.422080+0000","last_unstale":"2024-04-01T06:55:33.711859+0000","last_undegraded":"2024-04-01T06:55:33.711859+0000","last_fullsized":"2024-04-01T06:55:33.711859+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:03:23.686194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"79'6","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-01T06:55:35.804863+0000","last_change":"2024-04-01T06:54:27.998822+0000","last_active":"2024-04-01T06:55:35.804863+0000","last_peered":"2024-04-01T06:55:35.804863+0000","last_clean":"2024-04-01T06:55:35.804863+0000","last_became_active":"2024-04-01T06:54:27.998514+0000","last_became_peered":"2024-04-01T06:54:27.998514+0000","last_unstale":"2024-04-01T06:55:35.804863+0000","last_undegraded":"2024-04-01T06:55:35.804863+0000","last_fullsized":"2024-04-01T06:55:35.804863+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T14:21:28.340169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.714245+0000","last_change":"2024-04-01T06:54:28.415825+0000","last_active":"2024-04-01T06:55:33.714245+0000","last_peered":"2024-04-01T06:55:33.714245+0000","last_clean":"2024-04-01T06:55:33.714245+0000","last_became_active":"2024-04-01T06:54:28.413679+0000","last_became_peered":"2024-04-01T06:54:28.413679+0000","last_unstale":"2024-04-01T06:55:33.714245+0000","last_undegraded":"2024-04-01T06:55:33.714245+0000","last_fullsized":"2024-04-01T06:55:33.714245+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:13:19.907109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"79'3","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.707943+0000","last_change":"2024-04-01T06:54:27.994194+0000","last_active":"2024-04-01T06:55:33.707943+0000","last_peered":"2024-04-01T06:55:33.707943+0000","last_clean":"2024-04-01T06:55:33.707943+0000","last_became_active":"2024-04-01T06:54:27.993868+0000","last_became_peered":"2024-04-01T06:54:27.993868+0000","last_unstale":"2024-04-01T06:55:33.707943+0000","last_undegraded":"2024-04-01T06:55:33.707943+0000","last_fullsized":"2024-04-01T06:55:33.707943+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:55:17.003472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.711732+0000","last_change":"2024-04-01T06:54:28.412629+0000","last_active":"2024-04-01T06:55:33.711732+0000","last_peered":"2024-04-01T06:55:33.711732+0000","last_clean":"2024-04-01T06:55:33.711732+0000","last_became_active":"2024-04-01T06:54:28.412291+0000","last_became_peered":"2024-04-01T06:54:28.412291+0000","last_unstale":"2024-04-01T06:55:33.711732+0000","last_undegraded":"2024-04-01T06:55:33.711732+0000","last_fullsized":"2024-04-01T06:55:33.711732+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:29:14.007470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"79'2","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716127+0000","last_change":"2024-04-01T06:54:27.996570+0000","last_active":"2024-04-01T06:55:33.716127+0000","last_peered":"2024-04-01T06:55:33.716127+0000","last_clean":"2024-04-01T06:55:33.716127+0000","last_became_active":"2024-04-01T06:54:27.994897+0000","last_became_peered":"2024-04-01T06:54:27.994897+0000","last_unstale":"2024-04-01T06:55:33.716127+0000","last_undegraded":"2024-04-01T06:55:33.716127+0000","last_fullsized":"2024-04-01T06:55:33.716127+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:53:05.733608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.708757+0000","last_change":"2024-04-01T06:54:28.413701+0000","last_active":"2024-04-01T06:55:33.708757+0000","last_peered":"2024-04-01T06:55:33.708757+0000","last_clean":"2024-04-01T06:55:33.708757+0000","last_became_active":"2024-04-01T06:54:28.413435+0000","last_became_peered":"2024-04-01T06:54:28.413435+0000","last_unstale":"2024-04-01T06:55:33.708757+0000","last_undegraded":"2024-04-01T06:55:33.708757+0000","last_fullsized":"2024-04-01T06:55:33.708757+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:43:27.835398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.711515+0000","last_change":"2024-04-01T06:54:28.001115+0000","last_active":"2024-04-01T06:55:33.711515+0000","last_peered":"2024-04-01T06:55:33.711515+0000","last_clean":"2024-04-01T06:55:33.711515+0000","last_became_active":"2024-04-01T06:54:28.000732+0000","last_became_peered":"2024-04-01T06:54:28.000732+0000","last_unstale":"2024-04-01T06:55:33.711515+0000","last_undegraded":"2024-04-01T06:55:33.711515+0000","last_fullsized":"2024-04-01T06:55:33.711515+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:06:02.064402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.712248+0000","last_change":"2024-04-01T06:54:28.421670+0000","last_active":"2024-04-01T06:55:33.712248+0000","last_peered":"2024-04-01T06:55:33.712248+0000","last_clean":"2024-04-01T06:55:33.712248+0000","last_became_active":"2024-04-01T06:54:28.421335+0000","last_became_peered":"2024-04-01T06:54:28.421335+0000","last_unstale":"2024-04-01T06:55:33.712248+0000","last_undegraded":"2024-04-01T06:55:33.712248+0000","last_fullsized":"2024-04-01T06:55:33.712248+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:25:55.223397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"79'3","reported_seq":82,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-01T06:55:36.805774+0000","last_change":"2024-04-01T06:54:27.999413+0000","last_active":"2024-04-01T06:55:36.805774+0000","last_peered":"2024-04-01T06:55:36.805774+0000","last_clean":"2024-04-01T06:55:36.805774+0000","last_became_active":"2024-04-01T06:54:27.999123+0000","last_became_peered":"2024-04-01T06:54:27.999123+0000","last_unstale":"2024-04-01T06:55:36.805774+0000","last_undegraded":"2024-04-01T06:55:36.805774+0000","last_fullsized":"2024-04-01T06:55:36.805774+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:30:06.399907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":65,"num_read_kb":65,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716818+0000","last_change":"2024-04-01T06:54:28.423843+0000","last_active":"2024-04-01T06:55:33.716818+0000","last_peered":"2024-04-01T06:55:33.716818+0000","last_clean":"2024-04-01T06:55:33.716818+0000","last_became_active":"2024-04-01T06:54:28.423538+0000","last_became_peered":"2024-04-01T06:54:28.423538+0000","last_unstale":"2024-04-01T06:55:33.716818+0000","last_undegraded":"2024-04-01T06:55:33.716818+0000","last_fullsized":"2024-04-01T06:55:33.716818+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:51:23.986409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'2","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:34.126438+0000","last_change":"2024-04-01T06:54:27.997137+0000","last_active":"2024-04-01T06:55:34.126438+0000","last_peered":"2024-04-01T06:55:34.126438+0000","last_clean":"2024-04-01T06:55:34.126438+0000","last_became_active":"2024-04-01T06:54:27.996386+0000","last_became_peered":"2024-04-01T06:54:27.996386+0000","last_unstale":"2024-04-01T06:55:34.126438+0000","last_undegraded":"2024-04-01T06:55:34.126438+0000","last_fullsized":"2024-04-01T06:55:34.126438+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:29:57.365756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716556+0000","last_change":"2024-04-01T06:54:28.426837+0000","last_active":"2024-04-01T06:55:33.716556+0000","last_peered":"2024-04-01T06:55:33.716556+0000","last_clean":"2024-04-01T06:55:33.716556+0000","last_became_active":"2024-04-01T06:54:28.426551+0000","last_became_peered":"2024-04-01T06:54:28.426551+0000","last_unstale":"2024-04-01T06:55:33.716556+0000","last_undegraded":"2024-04-01T06:55:33.716556+0000","last_fullsized":"2024-04-01T06:55:33.716556+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:05:50.264912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'4","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.711871+0000","last_change":"2024-04-01T06:54:27.999968+0000","last_active":"2024-04-01T06:55:33.711871+0000","last_peered":"2024-04-01T06:55:33.711871+0000","last_clean":"2024-04-01T06:55:33.711871+0000","last_became_active":"2024-04-01T06:54:27.999415+0000","last_became_peered":"2024-04-01T06:54:27.999415+0000","last_unstale":"2024-04-01T06:55:33.711871+0000","last_undegraded":"2024-04-01T06:55:33.711871+0000","last_fullsized":"2024-04-01T06:55:33.711871+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:31:57.472227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716056+0000","last_change":"2024-04-01T06:54:28.421174+0000","last_active":"2024-04-01T06:55:33.716056+0000","last_peered":"2024-04-01T06:55:33.716056+0000","last_clean":"2024-04-01T06:55:33.716056+0000","last_became_active":"2024-04-01T06:54:28.420841+0000","last_became_peered":"2024-04-01T06:54:28.420841+0000","last_unstale":"2024-04-01T06:55:33.716056+0000","last_undegraded":"2024-04-01T06:55:33.716056+0000","last_fullsized":"2024-04-01T06:55:33.716056+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:05:25.377496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'30","reported_seq":183,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-01T06:55:37.817447+0000","last_change":"2024-04-01T06:54:27.995496+0000","last_active":"2024-04-01T06:55:37.817447+0000","last_peered":"2024-04-01T06:55:37.817447+0000","last_clean":"2024-04-01T06:55:37.817447+0000","last_became_active":"2024-04-01T06:54:27.995131+0000","last_became_peered":"2024-04-01T06:54:27.995131+0000","last_unstale":"2024-04-01T06:55:37.817447+0000","last_undegraded":"2024-04-01T06:55:37.817447+0000","last_fullsized":"2024-04-01T06:55:37.817447+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:36:12.129235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61314,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":139,"num_read_kb":129,"num_write":31,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.714386+0000","last_change":"2024-04-01T06:54:28.427835+0000","last_active":"2024-04-01T06:55:33.714386+0000","last_peered":"2024-04-01T06:55:33.714386+0000","last_clean":"2024-04-01T06:55:33.714386+0000","last_became_active":"2024-04-01T06:54:28.426956+0000","last_became_peered":"2024-04-01T06:54:28.426956+0000","last_unstale":"2024-04-01T06:55:33.714386+0000","last_undegraded":"2024-04-01T06:55:33.714386+0000","last_fullsized":"2024-04-01T06:55:33.714386+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:41:17.334977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'6","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.715667+0000","last_change":"2024-04-01T06:54:27.992756+0000","last_active":"2024-04-01T06:55:33.715667+0000","last_peered":"2024-04-01T06:55:33.715667+0000","last_clean":"2024-04-01T06:55:33.715667+0000","last_became_active":"2024-04-01T06:54:27.992403+0000","last_became_peered":"2024-04-01T06:54:27.992403+0000","last_unstale":"2024-04-01T06:55:33.715667+0000","last_undegraded":"2024-04-01T06:55:33.715667+0000","last_fullsized":"2024-04-01T06:55:33.715667+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:40:33.458435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.717383+0000","last_change":"2024-04-01T06:54:28.416750+0000","last_active":"2024-04-01T06:55:33.717383+0000","last_peered":"2024-04-01T06:55:33.717383+0000","last_clean":"2024-04-01T06:55:33.717383+0000","last_became_active":"2024-04-01T06:54:28.416417+0000","last_became_peered":"2024-04-01T06:54:28.416417+0000","last_unstale":"2024-04-01T06:55:33.717383+0000","last_undegraded":"2024-04-01T06:55:33.717383+0000","last_fullsized":"2024-04-01T06:55:33.717383+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:04:41.698842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'3","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.711914+0000","last_change":"2024-04-01T06:54:28.001450+0000","last_active":"2024-04-01T06:55:33.711914+0000","last_peered":"2024-04-01T06:55:33.711914+0000","last_clean":"2024-04-01T06:55:33.711914+0000","last_became_active":"2024-04-01T06:54:28.001165+0000","last_became_peered":"2024-04-01T06:54:28.001165+0000","last_unstale":"2024-04-01T06:55:33.711914+0000","last_undegraded":"2024-04-01T06:55:33.711914+0000","last_fullsized":"2024-04-01T06:55:33.711914+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:20:03.876123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:34.126379+0000","last_change":"2024-04-01T06:54:28.421097+0000","last_active":"2024-04-01T06:55:34.126379+0000","last_peered":"2024-04-01T06:55:34.126379+0000","last_clean":"2024-04-01T06:55:34.126379+0000","last_became_active":"2024-04-01T06:54:28.420781+0000","last_became_peered":"2024-04-01T06:54:28.420781+0000","last_unstale":"2024-04-01T06:55:34.126379+0000","last_undegraded":"2024-04-01T06:55:34.126379+0000","last_fullsized":"2024-04-01T06:55:34.126379+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:11:47.192742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'5","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-01T06:55:39.810949+0000","last_change":"2024-04-01T06:54:27.993832+0000","last_active":"2024-04-01T06:55:39.810949+0000","last_peered":"2024-04-01T06:55:39.810949+0000","last_clean":"2024-04-01T06:55:39.810949+0000","last_became_active":"2024-04-01T06:54:27.993423+0000","last_became_peered":"2024-04-01T06:54:27.993423+0000","last_unstale":"2024-04-01T06:55:39.810949+0000","last_undegraded":"2024-04-01T06:55:39.810949+0000","last_fullsized":"2024-04-01T06:55:39.810949+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T06:58:37.542214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1247,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":73,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:34.126123+0000","last_change":"2024-04-01T06:54:28.423352+0000","last_active":"2024-04-01T06:55:34.126123+0000","last_peered":"2024-04-01T06:55:34.126123+0000","last_clean":"2024-04-01T06:55:34.126123+0000","last_became_active":"2024-04-01T06:54:28.423049+0000","last_became_peered":"2024-04-01T06:54:28.423049+0000","last_unstale":"2024-04-01T06:55:34.126123+0000","last_undegraded":"2024-04-01T06:55:34.126123+0000","last_fullsized":"2024-04-01T06:55:34.126123+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:07:34.963189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'15","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.714203+0000","last_change":"2024-04-01T06:54:27.990469+0000","last_active":"2024-04-01T06:55:33.714203+0000","last_peered":"2024-04-01T06:55:33.714203+0000","last_clean":"2024-04-01T06:55:33.714203+0000","last_became_active":"2024-04-01T06:54:27.990147+0000","last_became_peered":"2024-04-01T06:54:27.990147+0000","last_unstale":"2024-04-01T06:55:33.714203+0000","last_undegraded":"2024-04-01T06:55:33.714203+0000","last_fullsized":"2024-04-01T06:55:33.714203+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:27:29.415723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-01T06:55:34.794930+0000","last_change":"2024-04-01T06:55:34.794236+0000","last_active":"2024-04-01T06:55:34.794930+0000","last_peered":"2024-04-01T06:55:34.794930+0000","last_clean":"2024-04-01T06:55:34.794930+0000","last_became_active":"2024-04-01T06:55:34.793868+0000","last_became_peered":"2024-04-01T06:55:34.793868+0000","last_unstale":"2024-04-01T06:55:34.794930+0000","last_undegraded":"2024-04-01T06:55:34.794930+0000","last_fullsized":"2024-04-01T06:55:34.794930+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:48:47.178073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"79'2","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.714590+0000","last_change":"2024-04-01T06:54:27.995827+0000","last_active":"2024-04-01T06:55:33.714590+0000","last_peered":"2024-04-01T06:55:33.714590+0000","last_clean":"2024-04-01T06:55:33.714590+0000","last_became_active":"2024-04-01T06:54:27.995450+0000","last_became_peered":"2024-04-01T06:54:27.995450+0000","last_unstale":"2024-04-01T06:55:33.714590+0000","last_undegraded":"2024-04-01T06:55:33.714590+0000","last_fullsized":"2024-04-01T06:55:33.714590+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T14:14:03.935578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716760+0000","last_change":"2024-04-01T06:54:28.425376+0000","last_active":"2024-04-01T06:55:33.716760+0000","last_peered":"2024-04-01T06:55:33.716760+0000","last_clean":"2024-04-01T06:55:33.716760+0000","last_became_active":"2024-04-01T06:54:28.421235+0000","last_became_peered":"2024-04-01T06:54:28.421235+0000","last_unstale":"2024-04-01T06:55:33.716760+0000","last_undegraded":"2024-04-01T06:55:33.716760+0000","last_fullsized":"2024-04-01T06:55:33.716760+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:19:05.244735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-01T06:55:34.794830+0000","last_change":"2024-04-01T06:55:34.794830+0000","last_active":"2024-04-01T06:55:34.794830+0000","last_peered":"2024-04-01T06:55:34.794830+0000","last_clean":"2024-04-01T06:55:34.794830+0000","last_became_active":"2024-04-01T06:55:34.794493+0000","last_became_peered":"2024-04-01T06:55:34.794493+0000","last_unstale":"2024-04-01T06:55:34.794830+0000","last_undegraded":"2024-04-01T06:55:34.794830+0000","last_fullsized":"2024-04-01T06:55:34.794830+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:38:08.508743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"79'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.708230+0000","last_change":"2024-04-01T06:54:28.417654+0000","last_active":"2024-04-01T06:55:33.708230+0000","last_peered":"2024-04-01T06:55:33.708230+0000","last_clean":"2024-04-01T06:55:33.708230+0000","last_became_active":"2024-04-01T06:54:28.417318+0000","last_became_peered":"2024-04-01T06:54:28.417318+0000","last_unstale":"2024-04-01T06:55:33.708230+0000","last_undegraded":"2024-04-01T06:55:33.708230+0000","last_fullsized":"2024-04-01T06:55:33.708230+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:59:25.843730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"79'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:34.126328+0000","last_change":"2024-04-01T06:54:27.998825+0000","last_active":"2024-04-01T06:55:34.126328+0000","last_peered":"2024-04-01T06:55:34.126328+0000","last_clean":"2024-04-01T06:55:34.126328+0000","last_became_active":"2024-04-01T06:54:27.998488+0000","last_became_peered":"2024-04-01T06:54:27.998488+0000","last_unstale":"2024-04-01T06:55:34.126328+0000","last_undegraded":"2024-04-01T06:55:34.126328+0000","last_fullsized":"2024-04-01T06:55:34.126328+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:22:24.878723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.708064+0000","last_change":"2024-04-01T06:54:28.421053+0000","last_active":"2024-04-01T06:55:33.708064+0000","last_peered":"2024-04-01T06:55:33.708064+0000","last_clean":"2024-04-01T06:55:33.708064+0000","last_became_active":"2024-04-01T06:54:28.420718+0000","last_became_peered":"2024-04-01T06:54:28.420718+0000","last_unstale":"2024-04-01T06:55:33.708064+0000","last_undegraded":"2024-04-01T06:55:33.708064+0000","last_fullsized":"2024-04-01T06:55:33.708064+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:58:10.109158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.711707+0000","last_change":"2024-04-01T06:54:28.419126+0000","last_active":"2024-04-01T06:55:33.711707+0000","last_peered":"2024-04-01T06:55:33.711707+0000","last_clean":"2024-04-01T06:55:33.711707+0000","last_became_active":"2024-04-01T06:54:28.418217+0000","last_became_peered":"2024-04-01T06:54:28.418217+0000","last_unstale":"2024-04-01T06:55:33.711707+0000","last_undegraded":"2024-04-01T06:55:33.711707+0000","last_fullsized":"2024-04-01T06:55:33.711707+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T14:02:41.148200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-01T06:55:37.806484+0000","last_change":"2024-04-01T06:54:27.993059+0000","last_active":"2024-04-01T06:55:37.806484+0000","last_peered":"2024-04-01T06:55:37.806484+0000","last_clean":"2024-04-01T06:55:37.806484+0000","last_became_active":"2024-04-01T06:54:27.992471+0000","last_became_peered":"2024-04-01T06:54:27.992471+0000","last_unstale":"2024-04-01T06:55:37.806484+0000","last_undegraded":"2024-04-01T06:55:37.806484+0000","last_fullsized":"2024-04-01T06:55:37.806484+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:27:38.691261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":66,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.708950+0000","last_change":"2024-04-01T06:54:28.411805+0000","last_active":"2024-04-01T06:55:33.708950+0000","last_peered":"2024-04-01T06:55:33.708950+0000","last_clean":"2024-04-01T06:55:33.708950+0000","last_became_active":"2024-04-01T06:54:28.411526+0000","last_became_peered":"2024-04-01T06:54:28.411526+0000","last_unstale":"2024-04-01T06:55:33.708950+0000","last_undegraded":"2024-04-01T06:55:33.708950+0000","last_fullsized":"2024-04-01T06:55:33.708950+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:59:08.223590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"79'3","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.713911+0000","last_change":"2024-04-01T06:54:27.988695+0000","last_active":"2024-04-01T06:55:33.713911+0000","last_peered":"2024-04-01T06:55:33.713911+0000","last_clean":"2024-04-01T06:55:33.713911+0000","last_became_active":"2024-04-01T06:54:27.988069+0000","last_became_peered":"2024-04-01T06:54:27.988069+0000","last_unstale":"2024-04-01T06:55:33.713911+0000","last_undegraded":"2024-04-01T06:55:33.713911+0000","last_fullsized":"2024-04-01T06:55:33.713911+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:27:11.287962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":332,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:34.126362+0000","last_change":"2024-04-01T06:53:41.678430+0000","last_active":"2024-04-01T06:55:34.126362+0000","last_peered":"2024-04-01T06:55:34.126362+0000","last_clean":"2024-04-01T06:55:34.126362+0000","last_became_active":"2024-04-01T06:53:41.677964+0000","last_became_peered":"2024-04-01T06:53:41.677964+0000","last_unstale":"2024-04-01T06:55:34.126362+0000","last_undegraded":"2024-04-01T06:55:34.126362+0000","last_fullsized":"2024-04-01T06:55:34.126362+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:51:21.964420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:51:21.964420+0000","last_clean_scrub_stamp":"2024-04-01T06:51:21.964420+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:24:29.916692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.715961+0000","last_change":"2024-04-01T06:54:28.423775+0000","last_active":"2024-04-01T06:55:33.715961+0000","last_peered":"2024-04-01T06:55:33.715961+0000","last_clean":"2024-04-01T06:55:33.715961+0000","last_became_active":"2024-04-01T06:54:28.423462+0000","last_became_peered":"2024-04-01T06:54:28.423462+0000","last_unstale":"2024-04-01T06:55:33.715961+0000","last_undegraded":"2024-04-01T06:55:33.715961+0000","last_fullsized":"2024-04-01T06:55:33.715961+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:09:38.043033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"79'3","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:34.126308+0000","last_change":"2024-04-01T06:54:27.997801+0000","last_active":"2024-04-01T06:55:34.126308+0000","last_peered":"2024-04-01T06:55:34.126308+0000","last_clean":"2024-04-01T06:55:34.126308+0000","last_became_active":"2024-04-01T06:54:27.997305+0000","last_became_peered":"2024-04-01T06:54:27.997305+0000","last_unstale":"2024-04-01T06:55:34.126308+0000","last_undegraded":"2024-04-01T06:55:34.126308+0000","last_fullsized":"2024-04-01T06:55:34.126308+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:46:09.224535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"79'1","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.714497+0000","last_change":"2024-04-01T06:54:27.994483+0000","last_active":"2024-04-01T06:55:33.714497+0000","last_peered":"2024-04-01T06:55:33.714497+0000","last_clean":"2024-04-01T06:55:33.714497+0000","last_became_active":"2024-04-01T06:54:27.994093+0000","last_became_peered":"2024-04-01T06:54:27.994093+0000","last_unstale":"2024-04-01T06:55:33.714497+0000","last_undegraded":"2024-04-01T06:55:33.714497+0000","last_fullsized":"2024-04-01T06:55:33.714497+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:27:48.272196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716298+0000","last_change":"2024-04-01T06:54:28.423895+0000","last_active":"2024-04-01T06:55:33.716298+0000","last_peered":"2024-04-01T06:55:33.716298+0000","last_clean":"2024-04-01T06:55:33.716298+0000","last_became_active":"2024-04-01T06:54:28.423593+0000","last_became_peered":"2024-04-01T06:54:28.423593+0000","last_unstale":"2024-04-01T06:55:33.716298+0000","last_undegraded":"2024-04-01T06:55:33.716298+0000","last_fullsized":"2024-04-01T06:55:33.716298+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:09:30.414080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"79'5","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.712579+0000","last_change":"2024-04-01T06:54:27.987207+0000","last_active":"2024-04-01T06:55:33.712579+0000","last_peered":"2024-04-01T06:55:33.712579+0000","last_clean":"2024-04-01T06:55:33.712579+0000","last_became_active":"2024-04-01T06:54:27.986537+0000","last_became_peered":"2024-04-01T06:54:27.986537+0000","last_unstale":"2024-04-01T06:55:33.712579+0000","last_undegraded":"2024-04-01T06:55:33.712579+0000","last_fullsized":"2024-04-01T06:55:33.712579+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:26:41.096843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.709381+0000","last_change":"2024-04-01T06:54:28.416591+0000","last_active":"2024-04-01T06:55:33.709381+0000","last_peered":"2024-04-01T06:55:33.709381+0000","last_clean":"2024-04-01T06:55:33.709381+0000","last_became_active":"2024-04-01T06:54:28.416295+0000","last_became_peered":"2024-04-01T06:54:28.416295+0000","last_unstale":"2024-04-01T06:55:33.709381+0000","last_undegraded":"2024-04-01T06:55:33.709381+0000","last_fullsized":"2024-04-01T06:55:33.709381+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:17:24.670572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'4","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.713832+0000","last_change":"2024-04-01T06:54:27.996075+0000","last_active":"2024-04-01T06:55:33.713832+0000","last_peered":"2024-04-01T06:55:33.713832+0000","last_clean":"2024-04-01T06:55:33.713832+0000","last_became_active":"2024-04-01T06:54:27.995664+0000","last_became_peered":"2024-04-01T06:54:27.995664+0000","last_unstale":"2024-04-01T06:55:33.713832+0000","last_undegraded":"2024-04-01T06:55:33.713832+0000","last_fullsized":"2024-04-01T06:55:33.713832+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:17:33.214644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716458+0000","last_change":"2024-04-01T06:54:28.422041+0000","last_active":"2024-04-01T06:55:33.716458+0000","last_peered":"2024-04-01T06:55:33.716458+0000","last_clean":"2024-04-01T06:55:33.716458+0000","last_became_active":"2024-04-01T06:54:28.421743+0000","last_became_peered":"2024-04-01T06:54:28.421743+0000","last_unstale":"2024-04-01T06:55:33.716458+0000","last_undegraded":"2024-04-01T06:55:33.716458+0000","last_fullsized":"2024-04-01T06:55:33.716458+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:23:14.405879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.715836+0000","last_change":"2024-04-01T06:54:27.991734+0000","last_active":"2024-04-01T06:55:33.715836+0000","last_peered":"2024-04-01T06:55:33.715836+0000","last_clean":"2024-04-01T06:55:33.715836+0000","last_became_active":"2024-04-01T06:54:27.991139+0000","last_became_peered":"2024-04-01T06:54:27.991139+0000","last_unstale":"2024-04-01T06:55:33.715836+0000","last_undegraded":"2024-04-01T06:55:33.715836+0000","last_fullsized":"2024-04-01T06:55:33.715836+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:08:49.188179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.714043+0000","last_change":"2024-04-01T06:54:28.428467+0000","last_active":"2024-04-01T06:55:33.714043+0000","last_peered":"2024-04-01T06:55:33.714043+0000","last_clean":"2024-04-01T06:55:33.714043+0000","last_became_active":"2024-04-01T06:54:28.428095+0000","last_became_peered":"2024-04-01T06:54:28.428095+0000","last_unstale":"2024-04-01T06:55:33.714043+0000","last_undegraded":"2024-04-01T06:55:33.714043+0000","last_fullsized":"2024-04-01T06:55:33.714043+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:21:04.500427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'3","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.708832+0000","last_change":"2024-04-01T06:54:27.990321+0000","last_active":"2024-04-01T06:55:33.708832+0000","last_peered":"2024-04-01T06:55:33.708832+0000","last_clean":"2024-04-01T06:55:33.708832+0000","last_became_active":"2024-04-01T06:54:27.989997+0000","last_became_peered":"2024-04-01T06:54:27.989997+0000","last_unstale":"2024-04-01T06:55:33.708832+0000","last_undegraded":"2024-04-01T06:55:33.708832+0000","last_fullsized":"2024-04-01T06:55:33.708832+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:14:04.059812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.715899+0000","last_change":"2024-04-01T06:54:28.416480+0000","last_active":"2024-04-01T06:55:33.715899+0000","last_peered":"2024-04-01T06:55:33.715899+0000","last_clean":"2024-04-01T06:55:33.715899+0000","last_became_active":"2024-04-01T06:54:28.416009+0000","last_became_peered":"2024-04-01T06:54:28.416009+0000","last_unstale":"2024-04-01T06:55:33.715899+0000","last_undegraded":"2024-04-01T06:55:33.715899+0000","last_fullsized":"2024-04-01T06:55:33.715899+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:32:09.759447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"79'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.715352+0000","last_change":"2024-04-01T06:54:27.996538+0000","last_active":"2024-04-01T06:55:33.715352+0000","last_peered":"2024-04-01T06:55:33.715352+0000","last_clean":"2024-04-01T06:55:33.715352+0000","last_became_active":"2024-04-01T06:54:27.996177+0000","last_became_peered":"2024-04-01T06:54:27.996177+0000","last_unstale":"2024-04-01T06:55:33.715352+0000","last_undegraded":"2024-04-01T06:55:33.715352+0000","last_fullsized":"2024-04-01T06:55:33.715352+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:39:45.386450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.709026+0000","last_change":"2024-04-01T06:54:28.419403+0000","last_active":"2024-04-01T06:55:33.709026+0000","last_peered":"2024-04-01T06:55:33.709026+0000","last_clean":"2024-04-01T06:55:33.709026+0000","last_became_active":"2024-04-01T06:54:28.419127+0000","last_became_peered":"2024-04-01T06:54:28.419127+0000","last_unstale":"2024-04-01T06:55:33.709026+0000","last_undegraded":"2024-04-01T06:55:33.709026+0000","last_fullsized":"2024-04-01T06:55:33.709026+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:52:13.510448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.714185+0000","last_change":"2024-04-01T06:54:27.992775+0000","last_active":"2024-04-01T06:55:33.714185+0000","last_peered":"2024-04-01T06:55:33.714185+0000","last_clean":"2024-04-01T06:55:33.714185+0000","last_became_active":"2024-04-01T06:54:27.992356+0000","last_became_peered":"2024-04-01T06:54:27.992356+0000","last_unstale":"2024-04-01T06:55:33.714185+0000","last_undegraded":"2024-04-01T06:55:33.714185+0000","last_fullsized":"2024-04-01T06:55:33.714185+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T14:46:37.302172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:34.126447+0000","last_change":"2024-04-01T06:54:28.430132+0000","last_active":"2024-04-01T06:55:34.126447+0000","last_peered":"2024-04-01T06:55:34.126447+0000","last_clean":"2024-04-01T06:55:34.126447+0000","last_became_active":"2024-04-01T06:54:28.429816+0000","last_became_peered":"2024-04-01T06:54:28.429816+0000","last_unstale":"2024-04-01T06:55:34.126447+0000","last_undegraded":"2024-04-01T06:55:34.126447+0000","last_fullsized":"2024-04-01T06:55:34.126447+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T14:49:58.661275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"79'3","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716010+0000","last_change":"2024-04-01T06:54:27.999460+0000","last_active":"2024-04-01T06:55:33.716010+0000","last_peered":"2024-04-01T06:55:33.716010+0000","last_clean":"2024-04-01T06:55:33.716010+0000","last_became_active":"2024-04-01T06:54:27.999128+0000","last_became_peered":"2024-04-01T06:54:27.999128+0000","last_unstale":"2024-04-01T06:55:33.716010+0000","last_undegraded":"2024-04-01T06:55:33.716010+0000","last_fullsized":"2024-04-01T06:55:33.716010+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T16:19:24.285698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:34.126610+0000","last_change":"2024-04-01T06:54:28.427720+0000","last_active":"2024-04-01T06:55:34.126610+0000","last_peered":"2024-04-01T06:55:34.126610+0000","last_clean":"2024-04-01T06:55:34.126610+0000","last_became_active":"2024-04-01T06:54:28.427357+0000","last_became_peered":"2024-04-01T06:54:28.427357+0000","last_unstale":"2024-04-01T06:55:34.126610+0000","last_undegraded":"2024-04-01T06:55:34.126610+0000","last_fullsized":"2024-04-01T06:55:34.126610+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:20:56.631811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.711677+0000","last_change":"2024-04-01T06:54:27.997806+0000","last_active":"2024-04-01T06:55:33.711677+0000","last_peered":"2024-04-01T06:55:33.711677+0000","last_clean":"2024-04-01T06:55:33.711677+0000","last_became_active":"2024-04-01T06:54:27.997490+0000","last_became_peered":"2024-04-01T06:54:27.997490+0000","last_unstale":"2024-04-01T06:55:33.711677+0000","last_undegraded":"2024-04-01T06:55:33.711677+0000","last_fullsized":"2024-04-01T06:55:33.711677+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:06:15.099390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"79'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:34.126472+0000","last_change":"2024-04-01T06:54:28.419639+0000","last_active":"2024-04-01T06:55:34.126472+0000","last_peered":"2024-04-01T06:55:34.126472+0000","last_clean":"2024-04-01T06:55:34.126472+0000","last_became_active":"2024-04-01T06:54:28.418081+0000","last_became_peered":"2024-04-01T06:54:28.418081+0000","last_unstale":"2024-04-01T06:55:34.126472+0000","last_undegraded":"2024-04-01T06:55:34.126472+0000","last_fullsized":"2024-04-01T06:55:34.126472+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:15:44.753121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.715887+0000","last_change":"2024-04-01T06:54:27.995854+0000","last_active":"2024-04-01T06:55:33.715887+0000","last_peered":"2024-04-01T06:55:33.715887+0000","last_clean":"2024-04-01T06:55:33.715887+0000","last_became_active":"2024-04-01T06:54:27.995540+0000","last_became_peered":"2024-04-01T06:54:27.995540+0000","last_unstale":"2024-04-01T06:55:33.715887+0000","last_undegraded":"2024-04-01T06:55:33.715887+0000","last_fullsized":"2024-04-01T06:55:33.715887+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:26.970851+0000","last_clean_scrub_stamp":"2024-04-01T06:54:26.970851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:47:15.075909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:34.126624+0000","last_change":"2024-04-01T06:54:28.428100+0000","last_active":"2024-04-01T06:55:34.126624+0000","last_peered":"2024-04-01T06:55:34.126624+0000","last_clean":"2024-04-01T06:55:34.126624+0000","last_became_active":"2024-04-01T06:54:28.427769+0000","last_became_peered":"2024-04-01T06:54:28.427769+0000","last_unstale":"2024-04-01T06:55:34.126624+0000","last_undegraded":"2024-04-01T06:55:34.126624+0000","last_fullsized":"2024-04-01T06:55:34.126624+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:47:18.161878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716007+0000","last_change":"2024-04-01T06:54:28.427557+0000","last_active":"2024-04-01T06:55:33.716007+0000","last_peered":"2024-04-01T06:55:33.716007+0000","last_clean":"2024-04-01T06:55:33.716007+0000","last_became_active":"2024-04-01T06:54:28.427209+0000","last_became_peered":"2024-04-01T06:54:28.427209+0000","last_unstale":"2024-04-01T06:55:33.716007+0000","last_undegraded":"2024-04-01T06:55:33.716007+0000","last_fullsized":"2024-04-01T06:55:33.716007+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T09:10:06.835360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.715486+0000","last_change":"2024-04-01T06:54:28.423264+0000","last_active":"2024-04-01T06:55:33.715486+0000","last_peered":"2024-04-01T06:55:33.715486+0000","last_clean":"2024-04-01T06:55:33.715486+0000","last_became_active":"2024-04-01T06:54:28.422868+0000","last_became_peered":"2024-04-01T06:54:28.422868+0000","last_unstale":"2024-04-01T06:55:33.715486+0000","last_undegraded":"2024-04-01T06:55:33.715486+0000","last_fullsized":"2024-04-01T06:55:33.715486+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:00:49.784276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.715257+0000","last_change":"2024-04-01T06:54:28.417824+0000","last_active":"2024-04-01T06:55:33.715257+0000","last_peered":"2024-04-01T06:55:33.715257+0000","last_clean":"2024-04-01T06:55:33.715257+0000","last_became_active":"2024-04-01T06:54:28.417510+0000","last_became_peered":"2024-04-01T06:54:28.417510+0000","last_unstale":"2024-04-01T06:55:33.715257+0000","last_undegraded":"2024-04-01T06:55:33.715257+0000","last_fullsized":"2024-04-01T06:55:33.715257+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T11:40:52.024183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716183+0000","last_change":"2024-04-01T06:54:28.426099+0000","last_active":"2024-04-01T06:55:33.716183+0000","last_peered":"2024-04-01T06:55:33.716183+0000","last_clean":"2024-04-01T06:55:33.716183+0000","last_became_active":"2024-04-01T06:54:28.425745+0000","last_became_peered":"2024-04-01T06:54:28.425745+0000","last_unstale":"2024-04-01T06:55:33.716183+0000","last_undegraded":"2024-04-01T06:55:33.716183+0000","last_fullsized":"2024-04-01T06:55:33.716183+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:13:45.145447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-01T06:55:34.793799+0000","last_change":"2024-04-01T06:55:34.793799+0000","last_active":"2024-04-01T06:55:34.793799+0000","last_peered":"2024-04-01T06:55:34.793799+0000","last_clean":"2024-04-01T06:55:34.793799+0000","last_became_active":"2024-04-01T06:55:34.793425+0000","last_became_peered":"2024-04-01T06:55:34.793425+0000","last_unstale":"2024-04-01T06:55:34.793799+0000","last_undegraded":"2024-04-01T06:55:34.793799+0000","last_fullsized":"2024-04-01T06:55:34.793799+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:40:42.053778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716274+0000","last_change":"2024-04-01T06:54:28.421013+0000","last_active":"2024-04-01T06:55:33.716274+0000","last_peered":"2024-04-01T06:55:33.716274+0000","last_clean":"2024-04-01T06:55:33.716274+0000","last_became_active":"2024-04-01T06:54:28.420339+0000","last_became_peered":"2024-04-01T06:54:28.420339+0000","last_unstale":"2024-04-01T06:55:33.716274+0000","last_undegraded":"2024-04-01T06:55:33.716274+0000","last_fullsized":"2024-04-01T06:55:33.716274+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T12:59:07.758542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.715886+0000","last_change":"2024-04-01T06:54:28.433203+0000","last_active":"2024-04-01T06:55:33.715886+0000","last_peered":"2024-04-01T06:55:33.715886+0000","last_clean":"2024-04-01T06:55:33.715886+0000","last_became_active":"2024-04-01T06:54:28.431890+0000","last_became_peered":"2024-04-01T06:54:28.431890+0000","last_unstale":"2024-04-01T06:55:33.715886+0000","last_undegraded":"2024-04-01T06:55:33.715886+0000","last_fullsized":"2024-04-01T06:55:33.715886+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T07:55:33.169722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.709341+0000","last_change":"2024-04-01T06:54:28.418425+0000","last_active":"2024-04-01T06:55:33.709341+0000","last_peered":"2024-04-01T06:55:33.709341+0000","last_clean":"2024-04-01T06:55:33.709341+0000","last_became_active":"2024-04-01T06:54:28.418165+0000","last_became_peered":"2024-04-01T06:54:28.418165+0000","last_unstale":"2024-04-01T06:55:33.709341+0000","last_undegraded":"2024-04-01T06:55:33.709341+0000","last_fullsized":"2024-04-01T06:55:33.709341+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T15:45:01.425680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.711699+0000","last_change":"2024-04-01T06:54:28.412058+0000","last_active":"2024-04-01T06:55:33.711699+0000","last_peered":"2024-04-01T06:55:33.711699+0000","last_clean":"2024-04-01T06:55:33.711699+0000","last_became_active":"2024-04-01T06:54:28.411680+0000","last_became_peered":"2024-04-01T06:54:28.411680+0000","last_unstale":"2024-04-01T06:55:33.711699+0000","last_undegraded":"2024-04-01T06:55:33.711699+0000","last_fullsized":"2024-04-01T06:55:33.711699+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T18:21:05.628262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.708907+0000","last_change":"2024-04-01T06:54:28.422304+0000","last_active":"2024-04-01T06:55:33.708907+0000","last_peered":"2024-04-01T06:55:33.708907+0000","last_clean":"2024-04-01T06:55:33.708907+0000","last_became_active":"2024-04-01T06:54:28.422023+0000","last_became_peered":"2024-04-01T06:54:28.422023+0000","last_unstale":"2024-04-01T06:55:33.708907+0000","last_undegraded":"2024-04-01T06:55:33.708907+0000","last_fullsized":"2024-04-01T06:55:33.708907+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T10:26:45.810780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.715869+0000","last_change":"2024-04-01T06:54:28.420350+0000","last_active":"2024-04-01T06:55:33.715869+0000","last_peered":"2024-04-01T06:55:33.715869+0000","last_clean":"2024-04-01T06:55:33.715869+0000","last_became_active":"2024-04-01T06:54:28.419995+0000","last_became_peered":"2024-04-01T06:54:28.419995+0000","last_unstale":"2024-04-01T06:55:33.715869+0000","last_undegraded":"2024-04-01T06:55:33.715869+0000","last_fullsized":"2024-04-01T06:55:33.715869+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T08:30:20.831966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716308+0000","last_change":"2024-04-01T06:54:28.417067+0000","last_active":"2024-04-01T06:55:33.716308+0000","last_peered":"2024-04-01T06:55:33.716308+0000","last_clean":"2024-04-01T06:55:33.716308+0000","last_became_active":"2024-04-01T06:54:28.416796+0000","last_became_peered":"2024-04-01T06:54:28.416796+0000","last_unstale":"2024-04-01T06:55:33.716308+0000","last_undegraded":"2024-04-01T06:55:33.716308+0000","last_fullsized":"2024-04-01T06:55:33.716308+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T17:39:43.396643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-01T06:55:33.716194+0000","last_change":"2024-04-01T06:54:28.424971+0000","last_active":"2024-04-01T06:55:33.716194+0000","last_peered":"2024-04-01T06:55:33.716194+0000","last_clean":"2024-04-01T06:55:33.716194+0000","last_became_active":"2024-04-01T06:54:28.424664+0000","last_became_peered":"2024-04-01T06:54:28.424664+0000","last_unstale":"2024-04-01T06:55:33.716194+0000","last_undegraded":"2024-04-01T06:55:33.716194+0000","last_fullsized":"2024-04-01T06:55:33.716194+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-01T06:54:27.974332+0000","last_clean_scrub_stamp":"2024-04-01T06:54:27.974332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-02T13:03:51.434412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":246668,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65928,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":423,"num_read_kb":281,"num_write":155,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":197156,"data_compressed":5598,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579927,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":876544,"data_stored":425769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:54:55 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.69699999999999995}]},{"osd":1,"last update":"Mon Apr 1 06:54:55 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.745},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.60099999999999998}]},{"osd":2,"last update":"Mon Apr 1 06:54:55 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.90600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":4,"last update":"Mon Apr 1 06:54:55 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":3.1970000000000001,"5min":3.1970000000000001,"15min":3.1970000000000001},"last":0.623},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.71899999999999997}]},{"osd":5,"last update":"Mon Apr 1 06:54:55 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.85299999999999998}]},{"osd":6,"last update":"Mon Apr 1 06:54:55 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.77800000000000002}]},{"osd":7,"last update":"Mon Apr 1 06:54:55 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":3.3479999999999999,"5min":3.3479999999999999,"15min":3.3479999999999999},"last":0.873}]},{"osd":8,"last update":"Mon Apr 1 06:55:28 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.82099999999999995}]},{"osd":9,"last update":"Mon Apr 1 06:54:55 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1,"5min":1,"15min":1},"last":1.018}]},{"osd":10,"last update":"Mon Apr 1 06:54:55 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.92300000000000004}]}]},{"osd":10,"up_from":67,"seq":287762808859,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1024000,"data_stored":1079223,"data_compressed":37572,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:55:33 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.54900000000000004}]},{"osd":1,"last update":"Mon Apr 1 06:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.52100000000000002}]},{"osd":2,"last update":"Mon Apr 1 06:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.76400000000000001}]},{"osd":3,"last update":"Mon Apr 1 06:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.69499999999999995}]},{"osd":4,"last update":"Mon Apr 1 06:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.63300000000000001}]},{"osd":5,"last update":"Mon Apr 1 06:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.748},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.83499999999999996}]},{"osd":6,"last update":"Mon Apr 1 06:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.78200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":8,"last update":"Mon Apr 1 06:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.877}]},{"osd":9,"last update":"Mon Apr 1 06:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.81100000000000005}]},{"osd":11,"last update":"Mon Apr 1 06:54:58 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.84799999999999998}]}]},{"osd":9,"up_from":62,"seq":266287972384,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31992,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713160,"statfs":{"total":95995035648,"available":95962275840,"internally_reserved":0,"allocated":892928,"data_stored":426005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:55:22 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.41299999999999998,"15min":0.42399999999999999},"min":{"1min":0.27200000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.52200000000000002,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.314},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.41999999999999998,"15min":0.433},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.55700000000000005,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.34799999999999998}]},{"osd":1,"last update":"Mon Apr 1 06:55:22 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.60999999999999999,"15min":0.626},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83099999999999996,"5min":0.873,"15min":0.873},"last":0.434},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.61099999999999999,"15min":0.623},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.442}]},{"osd":2,"last update":"Mon Apr 1 06:55:22 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.58599999999999997,"15min":0.59699999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.85199999999999998,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.505,"5min":0.58399999999999996,"15min":0.59699999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.52600000000000002}]},{"osd":3,"last update":"Mon Apr 1 06:55:22 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.45300000000000001,"15min":0.46700000000000003},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.61899999999999999,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.51400000000000001,"15min":0.53100000000000003},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.58799999999999997,"5min":0.754,"15min":0.754},"last":0.38600000000000001}]},{"osd":4,"last update":"Mon Apr 1 06:55:22 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.61699999999999999,"15min":0.63},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.58999999999999997,"15min":0.60099999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.83799999999999997,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.48399999999999999}]},{"osd":5,"last update":"Mon Apr 1 06:55:22 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.60099999999999998,"15min":0.61299999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.81299999999999994,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.72399999999999998,"15min":0.75},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.79100000000000004,"5min":1.835,"15min":1.835},"last":0.50700000000000001}]},{"osd":6,"last update":"Mon Apr 1 06:55:22 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.64200000000000002,"15min":0.66200000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.67100000000000004,"5min":1.048,"15min":1.048},"last":0.379},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.63800000000000001,"15min":0.66500000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.71899999999999997,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.54000000000000004}]},{"osd":7,"last update":"Mon Apr 1 06:55:22 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.65800000000000003,"15min":0.67100000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.89400000000000002,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.72499999999999998,"15min":0.746},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.92600000000000005,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.53700000000000003}]},{"osd":8,"last update":"Mon Apr 1 06:55:22 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.91400000000000003,"15min":0.96399999999999997},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.84499999999999997,"5min":5.6600000000000001,"15min":5.6600000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.90100000000000002,"15min":0.94699999999999995},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.85899999999999999,"5min":5.6070000000000002,"15min":5.6070000000000002},"last":0.57099999999999995}]},{"osd":10,"last update":"Mon Apr 1 06:55:40 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.70199999999999996,"15min":0.71399999999999997},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.94399999999999995,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.69199999999999995,"15min":0.70099999999999996},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.879,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.58599999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]}]},{"osd":8,"up_from":55,"seq":236223201315,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31988,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713164,"statfs":{"total":95995035648,"available":95962279936,"internally_reserved":0,"allocated":888832,"data_stored":425594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:55:08 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52900000000000003,"15min":0.53300000000000003},"min":{"1min":0.379,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.72099999999999997,"5min":0.747,"15min":0.747},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.54000000000000004,"15min":0.54400000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.65600000000000003,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.60599999999999998}]},{"osd":1,"last update":"Mon Apr 1 06:55:08 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.57899999999999996,"15min":0.56699999999999995},"min":{"1min":0.38400000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.58699999999999997,"15min":0.58199999999999996},"min":{"1min":0.35199999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.82999999999999996,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.73599999999999999}]},{"osd":2,"last update":"Mon Apr 1 06:55:08 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.46100000000000002,"15min":0.442},"min":{"1min":0.30199999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.46600000000000003,"15min":0.45100000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.62}]},{"osd":3,"last update":"Mon Apr 1 06:55:08 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.749,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.56000000000000005,"15min":0.55400000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78600000000000003,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.64000000000000001}]},{"osd":4,"last update":"Mon Apr 1 06:55:08 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.58599999999999997,"15min":0.57899999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.85299999999999998,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.61399999999999999,"15min":0.59599999999999997},"min":{"1min":0.47499999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.753}]},{"osd":5,"last update":"Mon Apr 1 06:55:08 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.53400000000000003,"15min":0.52000000000000002},"min":{"1min":0.41199999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.55300000000000005,"15min":0.53700000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.69999999999999996}]},{"osd":6,"last update":"Mon Apr 1 06:55:08 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.64500000000000002,"15min":0.629},"min":{"1min":0.51700000000000002,"5min":0.433,"15min":0.433},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.67200000000000004,"15min":0.66200000000000003},"min":{"1min":0.54000000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.79000000000000004}]},{"osd":7,"last update":"Mon Apr 1 06:55:08 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.68300000000000005,"15min":0.67100000000000004},"min":{"1min":0.50900000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.92700000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.745,"5min":0.68899999999999995,"15min":0.68000000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.81299999999999994}]},{"osd":9,"last update":"Mon Apr 1 06:55:28 2024","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.72099999999999997,"15min":0.69699999999999995},"min":{"1min":0.626,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.871},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.73699999999999999,"15min":0.71099999999999997},"min":{"1min":0.65400000000000003,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.83499999999999996}]},{"osd":10,"last update":"Mon Apr 1 06:54:43 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.89600000000000002}]},{"osd":11,"last update":"Mon Apr 1 06:55:28 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.80200000000000005}]}]},{"osd":7,"up_from":48,"seq":206158430244,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32036,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713116,"statfs":{"total":95995035648,"available":95962230784,"internally_reserved":0,"allocated":942080,"data_stored":1018154,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:53:48 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.41099999999999998}]},{"osd":1,"last update":"Mon Apr 1 06:54:51 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.39400000000000002,"15min":0.38800000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.42399999999999999,"15min":0.41599999999999998},"min":{"1min":0.32700000000000001,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.46800000000000003}]},{"osd":2,"last update":"Mon Apr 1 06:54:51 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.56499999999999995,"15min":0.56100000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.56200000000000006,"15min":0.55400000000000005},"min":{"1min":0.42799999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.80200000000000005,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.77900000000000003}]},{"osd":3,"last update":"Mon Apr 1 06:54:51 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.56599999999999995,"15min":0.56000000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.74299999999999999,"5min":0.755,"15min":0.755},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.58799999999999997,"15min":0.58399999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.80300000000000005,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.56699999999999995}]},{"osd":4,"last update":"Mon Apr 1 06:54:51 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.51000000000000001,"15min":0.505},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.51000000000000001,"15min":0.50700000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.49399999999999999}]},{"osd":5,"last update":"Mon Apr 1 06:54:51 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.60599999999999998,"15min":0.59599999999999997},"min":{"1min":0.46700000000000003,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.63600000000000001,"15min":0.63},"min":{"1min":0.501,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.86799999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.81299999999999994}]},{"osd":6,"last update":"Mon Apr 1 06:54:51 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.47599999999999998,"5min":0.443,"15min":0.443},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.439,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.55200000000000005}]},{"osd":8,"last update":"Mon Apr 1 06:55:05 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.68600000000000005,"15min":0.68000000000000005},"min":{"1min":0.56699999999999995,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.52000000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.91300000000000003,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.75900000000000001}]},{"osd":9,"last update":"Mon Apr 1 06:55:27 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.71199999999999997,"15min":0.70799999999999996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.63},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.72599999999999998,"15min":0.72399999999999998},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.95599999999999996,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.83499999999999996}]},{"osd":10,"last update":"Mon Apr 1 06:54:44 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.879}]},{"osd":11,"last update":"Mon Apr 1 06:55:33 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.82399999999999995}]}]},{"osd":6,"up_from":43,"seq":184683593769,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":880640,"data_stored":425394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:55:38 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.375,"15min":0.34300000000000003},"min":{"1min":0.27000000000000002,"5min":0.246,"15min":0.246},"max":{"1min":3.8260000000000001,"5min":3.8260000000000001,"15min":3.8260000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.375,"5min":0.37,"15min":0.36199999999999999},"min":{"1min":0.29299999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.625,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.503}]},{"osd":1,"last update":"Mon Apr 1 06:55:38 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.51600000000000001,"15min":0.48799999999999999},"min":{"1min":0.36199999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.51900000000000002,"15min":0.50700000000000001},"min":{"1min":0.41199999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.58499999999999996}]},{"osd":2,"last update":"Mon Apr 1 06:55:38 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.53100000000000003,"15min":0.51600000000000001},"min":{"1min":0.41899999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.73299999999999998,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.57499999999999996,"15min":0.56699999999999995},"min":{"1min":0.39400000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.81799999999999995,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.81799999999999995}]},{"osd":3,"last update":"Mon Apr 1 06:55:38 2024","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.42599999999999999,"15min":0.42199999999999999},"min":{"1min":0.28799999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.44500000000000001,"15min":0.438},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.52100000000000002}]},{"osd":4,"last update":"Mon Apr 1 06:55:38 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.53000000000000003,"15min":0.51600000000000001},"min":{"1min":0.376,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.67200000000000004,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56599999999999995,"15min":0.54600000000000004},"min":{"1min":0.38300000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.73299999999999998,"5min":0.871,"15min":0.871},"last":0.71099999999999997}]},{"osd":5,"last update":"Mon Apr 1 06:55:38 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.60499999999999998,"15min":0.59999999999999998},"min":{"1min":0.42199999999999999,"5min":0.378,"15min":0.378},"max":{"1min":0.71299999999999997,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.61199999999999999,"15min":0.60899999999999999},"min":{"1min":0.39300000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.82899999999999996,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.82899999999999996}]},{"osd":7,"last update":"Mon Apr 1 06:54:49 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.621,"15min":0.625},"min":{"1min":0.437,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.83699999999999997,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.65200000000000002,"15min":0.65000000000000002},"min":{"1min":0.52400000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.82399999999999995,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.77300000000000002}]},{"osd":8,"last update":"Mon Apr 1 06:55:08 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.67600000000000005,"15min":0.68500000000000005},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.88800000000000001,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.755},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.65900000000000003,"15min":0.66300000000000003},"min":{"1min":0.51000000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.80600000000000005,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.83899999999999997}]},{"osd":9,"last update":"Mon Apr 1 06:55:29 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.60599999999999998,"15min":0.626},"min":{"1min":0.39400000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.64700000000000002,"5min":1.004,"15min":1.004},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.505,"5min":0.61699999999999999,"15min":0.63600000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.68100000000000005,"5min":1.048,"15min":1.048},"last":0.72099999999999997}]},{"osd":10,"last update":"Mon Apr 1 06:54:40 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.79500000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574907,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36124,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93709028,"statfs":{"total":95995035648,"available":95958044672,"internally_reserved":0,"allocated":937984,"data_stored":486501,"data_compressed":1866,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:55:17 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.52700000000000002,"15min":0.47999999999999998},"min":{"1min":0.35699999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":4.4249999999999998,"5min":4.4249999999999998,"15min":4.4249999999999998},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.53000000000000003,"15min":0.48999999999999999},"min":{"1min":0.38400000000000001,"5min":0.312,"15min":0.312},"max":{"1min":2.363,"5min":2.363,"15min":2.363},"last":0.54200000000000004}]},{"osd":2,"last update":"Mon Apr 1 06:55:30 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.57799999999999996,"15min":0.54600000000000004},"min":{"1min":0.53700000000000003,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.81000000000000005,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.55300000000000005,"15min":0.52800000000000002},"min":{"1min":0.42899999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.80000000000000004,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.66700000000000004}]},{"osd":3,"last update":"Mon Apr 1 06:54:43 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.55400000000000005,"15min":0.53500000000000003},"min":{"1min":0.39700000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.58199999999999996,"15min":0.55000000000000004},"min":{"1min":0.48499999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.68600000000000005}]},{"osd":4,"last update":"Mon Apr 1 06:55:03 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.443,"15min":0.41199999999999998},"min":{"1min":0.379,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.46200000000000002,"15min":0.42099999999999999},"min":{"1min":0.35599999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.56299999999999994}]},{"osd":5,"last update":"Mon Apr 1 06:55:17 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.60899999999999999,"15min":0.59199999999999997},"min":{"1min":0.47499999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90100000000000002,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.58999999999999997,"15min":0.56699999999999995},"min":{"1min":0.34300000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.89700000000000002,"5min":1.081,"15min":1.081},"last":0.77900000000000003}]},{"osd":6,"last update":"Mon Apr 1 06:55:35 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.61799999999999999,"15min":0.56699999999999995},"min":{"1min":0.41599999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":5.4740000000000002,"5min":5.4740000000000002,"15min":5.4740000000000002},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.64500000000000002,"15min":0.58799999999999997},"min":{"1min":0.46300000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":5.5110000000000001,"5min":5.5110000000000001,"15min":5.5110000000000001},"last":0.63600000000000001}]},{"osd":7,"last update":"Mon Apr 1 06:54:48 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.59599999999999997,"15min":0.58299999999999996},"min":{"1min":0.436,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.63400000000000001,"15min":0.622},"min":{"1min":0.54800000000000004,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.90700000000000003,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.76100000000000001}]},{"osd":8,"last update":"Mon Apr 1 06:55:07 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.69699999999999995,"15min":0.69199999999999995},"min":{"1min":0.499,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.73899999999999999,"15min":0.73099999999999998},"min":{"1min":0.63700000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.94599999999999995,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.81799999999999995}]},{"osd":9,"last update":"Mon Apr 1 06:55:27 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.76900000000000002,"15min":0.745},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":5.6699999999999999,"5min":5.6699999999999999,"15min":5.6699999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.80600000000000005,"15min":0.78100000000000003},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":5.6189999999999998,"5min":5.6189999999999998,"15min":5.6189999999999998},"last":0.80300000000000005}]},{"osd":10,"last update":"Mon Apr 1 06:54:43 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.82799999999999996}]},{"osd":11,"last update":"Mon Apr 1 06:55:30 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.85499999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738430,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":901120,"data_stored":426665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Apr 1 06:55:09 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.48599999999999999,"15min":0.46800000000000003},"min":{"1min":0.379,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.625,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.47699999999999998,"15min":0.47099999999999997},"min":{"1min":0.33400000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.64300000000000002,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.42299999999999999}]},{"osd":2,"last update":"Mon Apr 1 06:55:30 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.48699999999999999,"15min":0.46700000000000003},"min":{"1min":0.33000000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.68000000000000005,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.48399999999999999,"15min":0.47899999999999998},"min":{"1min":0.35599999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.70499999999999996,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.35599999999999998}]},{"osd":3,"last update":"Mon Apr 1 06:55:30 2024","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.313},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.40300000000000002}]},{"osd":4,"last update":"Mon Apr 1 06:55:03 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.50900000000000001,"15min":0.501},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.71099999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.505},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.52500000000000002,"15min":0.51300000000000001},"min":{"1min":0.40799999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.69499999999999995,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.58999999999999997}]},{"osd":5,"last update":"Mon Apr 1 06:55:17 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.52900000000000003,"15min":0.52800000000000002},"min":{"1min":0.41499999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.65600000000000003,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.52100000000000002,"15min":0.52400000000000002},"min":{"1min":0.41999999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.67100000000000004,"5min":0.748,"15min":0.748},"last":0.46800000000000003}]},{"osd":6,"last update":"Mon Apr 1 06:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.44,"15min":0.436},"min":{"1min":0.33200000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.502,"15min":0.50600000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.48899999999999999}]},{"osd":7,"last update":"Mon Apr 1 06:53:50 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.46000000000000002}]},{"osd":8,"last update":"Mon Apr 1 06:55:09 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.623,"15min":0.63200000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.76500000000000001,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.623,"15min":0.63300000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.71699999999999997,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.51500000000000001}]},{"osd":9,"last update":"Mon Apr 1 06:55:26 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.56899999999999995,"15min":0.58199999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.71699999999999997,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.621,"15min":0.63600000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73599999999999999,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.52700000000000002}]},{"osd":10,"last update":"Mon Apr 1 06:54:43 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.64500000000000002}]},{"osd":11,"last update":"Mon Apr 1 06:55:03 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.67600000000000005}]}]},{"osd":2,"up_from":18,"seq":77309411383,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":487882,"data_compressed":1866,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:55:30 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.48699999999999999,"15min":0.46800000000000003},"min":{"1min":0.32900000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.70499999999999996,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47399999999999998,"15min":0.45800000000000002},"min":{"1min":0.34599999999999997,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.60299999999999998,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.36799999999999999}]},{"osd":1,"last update":"Mon Apr 1 06:55:30 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.55000000000000004,"15min":0.52200000000000002},"min":{"1min":0.46200000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.55500000000000005,"15min":0.54000000000000004},"min":{"1min":0.40699999999999997,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.63500000000000001}]},{"osd":3,"last update":"Mon Apr 1 06:54:45 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.53500000000000003,"15min":0.52900000000000003},"min":{"1min":0.40899999999999997,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.71199999999999997,"5min":0.748,"15min":0.748},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56200000000000006,"15min":0.54600000000000004},"min":{"1min":0.434,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77500000000000002,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.51000000000000001}]},{"osd":4,"last update":"Mon Apr 1 06:55:30 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.62},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.68400000000000005}]},{"osd":5,"last update":"Mon Apr 1 06:55:17 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.48599999999999999,"15min":0.45900000000000002},"min":{"1min":0.39800000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.81200000000000006,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.48399999999999999,"15min":0.46600000000000003},"min":{"1min":0.35199999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.29999999999999999}]},{"osd":6,"last update":"Mon Apr 1 06:55:33 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.60599999999999998,"15min":0.59799999999999998},"min":{"1min":0.48399999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.83299999999999996,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.63100000000000001,"15min":0.629},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.439}]},{"osd":7,"last update":"Mon Apr 1 06:53:49 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.60099999999999998}]},{"osd":8,"last update":"Mon Apr 1 06:55:06 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.67900000000000005,"15min":0.68200000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60599999999999998,"15min":0.60399999999999998},"min":{"1min":0.438,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.60899999999999999}]},{"osd":9,"last update":"Mon Apr 1 06:55:25 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.65600000000000003,"15min":0.65200000000000002},"min":{"1min":0.47999999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.61799999999999999,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.59499999999999997}]},{"osd":10,"last update":"Mon Apr 1 06:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.66600000000000004}]},{"osd":11,"last update":"Mon Apr 1 06:55:30 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.496}]}]},{"osd":3,"up_from":25,"seq":107374182451,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31992,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713160,"statfs":{"total":95995035648,"available":95962275840,"internally_reserved":0,"allocated":892928,"data_stored":425374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:54:41 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.33900000000000002,"15min":0.33000000000000002},"min":{"1min":0.29499999999999998,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.38},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.34599999999999997,"15min":0.33500000000000002},"min":{"1min":0.26400000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.57999999999999996,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.35899999999999999}]},{"osd":1,"last update":"Mon Apr 1 06:54:41 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.52900000000000003,"15min":0.51600000000000001},"min":{"1min":0.38800000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.51400000000000001,"15min":0.499},"min":{"1min":0.39400000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76900000000000002,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.66700000000000004}]},{"osd":2,"last update":"Mon Apr 1 06:54:41 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.52400000000000002,"15min":0.51400000000000001},"min":{"1min":0.35599999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.68899999999999995,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.54000000000000004,"15min":0.53000000000000003},"min":{"1min":0.41799999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.85199999999999998,"5min":0.874,"15min":0.874},"last":0.46200000000000002}]},{"osd":4,"last update":"Mon Apr 1 06:55:02 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53900000000000003,"15min":0.52700000000000002},"min":{"1min":0.40200000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.745,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56699999999999995,"15min":0.55700000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80600000000000005,"5min":1.131,"15min":1.131},"last":0.73799999999999999}]},{"osd":5,"last update":"Mon Apr 1 06:55:17 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.52100000000000002,"15min":0.51100000000000001},"min":{"1min":0.36899999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.71799999999999997,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.55800000000000005,"15min":0.55100000000000005},"min":{"1min":0.40699999999999997,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.71099999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.502}]},{"osd":6,"last update":"Mon Apr 1 06:55:36 2024","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.42999999999999999,"15min":0.42599999999999999},"min":{"1min":0.31900000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.64000000000000001,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.443,"5min":0.46999999999999997,"15min":0.46600000000000003},"min":{"1min":0.34100000000000003,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.67100000000000004,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.48699999999999999}]},{"osd":7,"last update":"Mon Apr 1 06:54:56 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.42199999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.75700000000000001,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.63300000000000001,"15min":0.63500000000000001},"min":{"1min":0.41499999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.85799999999999998,"5min":1.171,"15min":1.171},"last":0.76400000000000001}]},{"osd":8,"last update":"Mon Apr 1 06:54:04 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.71999999999999997}]},{"osd":9,"last update":"Mon Apr 1 06:55:27 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.628,"15min":0.64400000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.745,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.496,"5min":0.61299999999999999,"15min":0.63300000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68899999999999995,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.40999999999999998}]},{"osd":10,"last update":"Mon Apr 1 06:54:40 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.65600000000000003}]},{"osd":11,"last update":"Mon Apr 1 06:55:31 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.70199999999999996}]}]},{"osd":4,"up_from":32,"seq":137438953521,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":884736,"data_stored":426490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:54:02 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.496,"15min":0.48799999999999999},"min":{"1min":0.34899999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.433},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.48299999999999998,"15min":0.47699999999999998},"min":{"1min":0.30399999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.41799999999999998}]},{"osd":1,"last update":"Mon Apr 1 06:55:03 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.35199999999999998,"15min":0.33400000000000002},"min":{"1min":0.251,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.36499999999999999,"15min":0.35299999999999998},"min":{"1min":0.29099999999999998,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.48199999999999998}]},{"osd":2,"last update":"Mon Apr 1 06:55:03 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.51200000000000001,"15min":0.496},"min":{"1min":0.435,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.52100000000000002,"15min":0.48899999999999999},"min":{"1min":0.40699999999999997,"5min":0.316,"15min":0.316},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.73899999999999999}]},{"osd":3,"last update":"Mon Apr 1 06:55:03 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.53400000000000003,"15min":0.52900000000000003},"min":{"1min":0.36899999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.73499999999999999,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.51400000000000001,"15min":0.498},"min":{"1min":0.39200000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.63900000000000001}]},{"osd":5,"last update":"Mon Apr 1 06:55:17 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.56999999999999995,"15min":0.55200000000000005},"min":{"1min":0.45800000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.84099999999999997,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.628},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.44700000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.74399999999999999}]},{"osd":6,"last update":"Mon Apr 1 06:55:39 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.53500000000000003,"15min":0.53700000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.61599999999999999,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.65500000000000003,"15min":0.66900000000000004},"min":{"1min":0.42999999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.71699999999999997,"5min":2.52,"15min":2.52},"last":0.66800000000000004}]},{"osd":7,"last update":"Mon Apr 1 06:54:48 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.34200000000000003,"5min":0.316,"15min":0.316},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.51500000000000001,"15min":0.51200000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.51100000000000001}]},{"osd":8,"last update":"Mon Apr 1 06:55:06 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.58599999999999997,"15min":0.57699999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.65400000000000003,"15min":0.64300000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.83299999999999996}]},{"osd":9,"last update":"Mon Apr 1 06:55:22 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.65000000000000002,"15min":0.64700000000000002},"min":{"1min":0.53800000000000003,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.72199999999999998,"15min":0.72499999999999998},"min":{"1min":0.60799999999999998,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":0.85499999999999998,"5min":1.119,"15min":1.119},"last":0.71399999999999997}]},{"osd":10,"last update":"Mon Apr 1 06:54:43 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.78400000000000003}]},{"osd":11,"last update":"Mon Apr 1 06:55:27 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.87}]}]},{"osd":5,"up_from":36,"seq":154618822701,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32052,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713100,"statfs":{"total":95995035648,"available":95962214400,"internally_reserved":0,"allocated":954368,"data_stored":1017493,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Apr 1 06:55:14 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.501,"15min":0.48499999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.63900000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.498,"5min":0.499,"15min":0.49299999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.69299999999999995,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.52300000000000002}]},{"osd":1,"last update":"Mon Apr 1 06:55:14 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.54800000000000004,"15min":0.53000000000000003},"min":{"1min":0.39800000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.54900000000000004,"15min":0.53300000000000003},"min":{"1min":0.39900000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.75800000000000001}]},{"osd":2,"last update":"Mon Apr 1 06:55:14 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.39800000000000002,"15min":0.38800000000000001},"min":{"1min":0.27500000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.503},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.40799999999999997,"15min":0.40300000000000002},"min":{"1min":0.29499999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.64200000000000002}]},{"osd":3,"last update":"Mon Apr 1 06:55:14 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54500000000000004,"15min":0.54800000000000004},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.67100000000000004,"5min":1.389,"15min":1.389},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.63,"15min":0.66600000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.65400000000000003,"5min":3.9540000000000002,"15min":3.9540000000000002},"last":0.69199999999999995}]},{"osd":4,"last update":"Mon Apr 1 06:55:14 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.57099999999999995,"15min":0.55300000000000005},"min":{"1min":0.39700000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.60199999999999998,"15min":0.59299999999999997},"min":{"1min":0.45600000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.72899999999999998}]},{"osd":6,"last update":"Mon Apr 1 06:55:37 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.56699999999999995,"15min":0.55600000000000005},"min":{"1min":0.42299999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.78900000000000003,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.58299999999999996,"15min":0.57499999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.72799999999999998,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.746}]},{"osd":7,"last update":"Mon Apr 1 06:54:49 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64200000000000002,"15min":0.64000000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.86499999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.65600000000000003,"15min":0.65000000000000002},"min":{"1min":0.53000000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.85799999999999998}]},{"osd":8,"last update":"Mon Apr 1 06:55:05 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.622,"15min":0.623},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.61199999999999999,"15min":0.60799999999999998},"min":{"1min":0.42999999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.621}]},{"osd":9,"last update":"Mon Apr 1 06:55:26 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.65700000000000003,"15min":0.65100000000000002},"min":{"1min":0.50900000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.67200000000000004,"15min":0.66500000000000004},"min":{"1min":0.50700000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.81499999999999995}]},{"osd":10,"last update":"Mon Apr 1 06:54:38 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.89000000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34069,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34069,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":61314,"data_compressed":1866,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":62695,"data_compressed":1866,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":63551,"data_compressed":1866,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-01T06:55:43.112 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T06:55:43.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:42 smithi153 ceph-mon[48187]: pgmap v255: 97 pgs: 97 active+clean; 641 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 510 B/s wr, 5 op/s; 0 B/s, 0 objects/s recovering 2024-04-01T06:55:43.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:42 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/4073667491' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:55:43.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.267+0000 7fbaa933d700 1 -- 172.21.15.83:0/933930564 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbaa4106a10 msgr2=0x7fbaa4108e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:43.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.267+0000 7fbaa933d700 1 --2- 172.21.15.83:0/933930564 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbaa4106a10 0x7fbaa4108e00 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fba9c00b0a0 tx=0x7fba9c00b3b0 comp rx=0 tx=0).stop 2024-04-01T06:55:43.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.267+0000 7fbaa933d700 1 -- 172.21.15.83:0/933930564 shutdown_connections 2024-04-01T06:55:43.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.267+0000 7fbaa933d700 1 --2- 172.21.15.83:0/933930564 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbaa4106a10 0x7fbaa4108e00 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:43.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.267+0000 7fbaa933d700 1 --2- 172.21.15.83:0/933930564 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbaa41017b0 0x7fbaa4103ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:43.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.267+0000 7fbaa933d700 1 --2- 172.21.15.83:0/933930564 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbaa41040e0 0x7fbaa41064d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:43.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.267+0000 7fbaa933d700 1 -- 172.21.15.83:0/933930564 >> 172.21.15.83:0/933930564 conn(0x7fbaa40fb100 msgr2=0x7fbaa40fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:43.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.267+0000 7fbaa933d700 1 -- 172.21.15.83:0/933930564 shutdown_connections 2024-04-01T06:55:43.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.267+0000 7fbaa933d700 1 -- 172.21.15.83:0/933930564 wait complete. 2024-04-01T06:55:43.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.268+0000 7fbaa933d700 1 Processor -- start 2024-04-01T06:55:43.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.268+0000 7fbaa933d700 1 -- start start 2024-04-01T06:55:43.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.268+0000 7fbaa933d700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbaa41017b0 0x7fbaa4198eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:43.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.268+0000 7fbaa933d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbaa41040e0 0x7fbaa41993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:43.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.268+0000 7fbaa933d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbaa4106a10 0x7fbaa41a0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:43.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.268+0000 7fbaa933d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa41a09e0 con 0x7fbaa41040e0 2024-04-01T06:55:43.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.268+0000 7fbaa933d700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa41a0b20 con 0x7fbaa41017b0 2024-04-01T06:55:43.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.268+0000 7fbaa933d700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa41a0cb0 con 0x7fbaa4106a10 2024-04-01T06:55:43.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.269+0000 7fbaa27fc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbaa41040e0 0x7fbaa41993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:43.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.269+0000 7fbaa27fc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbaa41040e0 0x7fbaa41993f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:34470/0 (socket says 172.21.15.83:34470) 2024-04-01T06:55:43.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.269+0000 7fbaa27fc700 1 -- 172.21.15.83:0/2068893861 learned_addr learned my addr 172.21.15.83:0/2068893861 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:43.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.269+0000 7fbaa37fe700 1 --2- 172.21.15.83:0/2068893861 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbaa4106a10 0x7fbaa41a0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:43.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.269+0000 7fbaa27fc700 1 -- 172.21.15.83:0/2068893861 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbaa4106a10 msgr2=0x7fbaa41a0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:43.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.269+0000 7fbaa27fc700 1 --2- 172.21.15.83:0/2068893861 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbaa4106a10 0x7fbaa41a0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:43.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.269+0000 7fbaa2ffd700 1 --2- 172.21.15.83:0/2068893861 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbaa41017b0 0x7fbaa4198eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:43.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.269+0000 7fbaa27fc700 1 -- 172.21.15.83:0/2068893861 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbaa41017b0 msgr2=0x7fbaa4198eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:43.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.269+0000 7fbaa27fc700 1 --2- 172.21.15.83:0/2068893861 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbaa41017b0 0x7fbaa4198eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:43.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.269+0000 7fbaa27fc700 1 -- 172.21.15.83:0/2068893861 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba9c009d00 con 0x7fbaa41040e0 2024-04-01T06:55:43.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.269+0000 7fbaa37fe700 1 --2- 172.21.15.83:0/2068893861 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbaa4106a10 0x7fbaa41a0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:55:43.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.269+0000 7fbaa27fc700 1 --2- 172.21.15.83:0/2068893861 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbaa41040e0 0x7fbaa41993f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fba9800d950 tx=0x7fba9800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:43.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.269+0000 7fba8bfff700 1 -- 172.21.15.83:0/2068893861 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba98009b40 con 0x7fbaa41040e0 2024-04-01T06:55:43.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.269+0000 7fba8bfff700 1 -- 172.21.15.83:0/2068893861 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fba98009ca0 con 0x7fbaa41040e0 2024-04-01T06:55:43.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.269+0000 7fba8bfff700 1 -- 172.21.15.83:0/2068893861 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9800f620 con 0x7fbaa41040e0 2024-04-01T06:55:43.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.269+0000 7fbaa933d700 1 -- 172.21.15.83:0/2068893861 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaa41a0f90 con 0x7fbaa41040e0 2024-04-01T06:55:43.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.269+0000 7fbaa933d700 1 -- 172.21.15.83:0/2068893861 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaa41a13c0 con 0x7fbaa41040e0 2024-04-01T06:55:43.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.270+0000 7fbaa933d700 1 -- 172.21.15.83:0/2068893861 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaa4108590 con 0x7fbaa41040e0 2024-04-01T06:55:43.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.271+0000 7fba8bfff700 1 -- 172.21.15.83:0/2068893861 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7fba98010460 con 0x7fbaa41040e0 2024-04-01T06:55:43.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.272+0000 7fba8bfff700 1 --2- 172.21.15.83:0/2068893861 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fba8c0a1230 0x7fba8c0a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:43.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.272+0000 7fbaa2ffd700 1 --2- 172.21.15.83:0/2068893861 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fba8c0a1230 0x7fba8c0a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:43.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.272+0000 7fba8bfff700 1 -- 172.21.15.83:0/2068893861 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fba980ccd10 con 0x7fbaa41040e0 2024-04-01T06:55:43.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.272+0000 7fbaa2ffd700 1 --2- 172.21.15.83:0/2068893861 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fba8c0a1230 0x7fba8c0a36f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fba94005950 tx=0x7fba94005cf0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:43.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.275+0000 7fba8bfff700 1 -- 172.21.15.83:0/2068893861 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7fba98096360 con 0x7fbaa41040e0 2024-04-01T06:55:43.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.480+0000 7fbaa933d700 1 -- 172.21.15.83:0/2068893861 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbaa40671d0 con 0x7fbaa41040e0 2024-04-01T06:55:43.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.481+0000 7fba8bfff700 1 -- 172.21.15.83:0/2068893861 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+22425 (secure 0 0 0) 0x7fba98016090 con 0x7fbaa41040e0 2024-04-01T06:55:43.481 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:55:43.481 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":81,"fsid":"c6f8eff4-eff3-11ee-b647-cb9ed24678a4","created":"2024-04-01T06:48:42.033382+0000","modified":"2024-04-01T06:55:34.704509+0000","last_up_change":"2024-04-01T06:53:55.791339+0000","last_in_change":"2024-04-01T06:53:39.777214+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T06:51:21.963996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T06:54:26.450403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T06:54:27.564928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"90b761b0-b06c-4142-854d-38ee42aa6052","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6803","nonce":3253845390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6805","nonce":3253845390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6809","nonce":3253845390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6807","nonce":3253845390}]},"public_addr":"172.21.15.83:6803/3253845390","cluster_addr":"172.21.15.83:6805/3253845390","heartbeat_back_addr":"172.21.15.83:6809/3253845390","heartbeat_front_addr":"172.21.15.83:6807/3253845390","state":["exists","up"]},{"osd":1,"uuid":"4d6ab85b-7088-451e-a829-c9119f35dee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6801","nonce":515889759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6803","nonce":515889759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6807","nonce":515889759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6805","nonce":515889759}]},"public_addr":"172.21.15.145:6801/515889759","cluster_addr":"172.21.15.145:6803/515889759","heartbeat_back_addr":"172.21.15.145:6807/515889759","heartbeat_front_addr":"172.21.15.145:6805/515889759","state":["exists","up"]},{"osd":2,"uuid":"d04c27f3-4972-4061-8bfb-5060645e3883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6801","nonce":3318516728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6803","nonce":3318516728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6807","nonce":3318516728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6805","nonce":3318516728}]},"public_addr":"172.21.15.153:6801/3318516728","cluster_addr":"172.21.15.153:6803/3318516728","heartbeat_back_addr":"172.21.15.153:6807/3318516728","heartbeat_front_addr":"172.21.15.153:6805/3318516728","state":["exists","up"]},{"osd":3,"uuid":"899b6c90-8f2f-44dd-b807-49594aadb443","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6811","nonce":504690234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6813","nonce":504690234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6817","nonce":504690234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6815","nonce":504690234}]},"public_addr":"172.21.15.83:6811/504690234","cluster_addr":"172.21.15.83:6813/504690234","heartbeat_back_addr":"172.21.15.83:6817/504690234","heartbeat_front_addr":"172.21.15.83:6815/504690234","state":["exists","up"]},{"osd":4,"uuid":"5071dd81-804e-4358-bfb6-11e718e9cf4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6809","nonce":2099824730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6811","nonce":2099824730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6815","nonce":2099824730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6813","nonce":2099824730}]},"public_addr":"172.21.15.145:6809/2099824730","cluster_addr":"172.21.15.145:6811/2099824730","heartbeat_back_addr":"172.21.15.145:6815/2099824730","heartbeat_front_addr":"172.21.15.145:6813/2099824730","state":["exists","up"]},{"osd":5,"uuid":"b8442b71-c26e-467f-b0c3-ea9f636f5a00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6809","nonce":3340941443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6811","nonce":3340941443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6815","nonce":3340941443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6813","nonce":3340941443}]},"public_addr":"172.21.15.153:6809/3340941443","cluster_addr":"172.21.15.153:6811/3340941443","heartbeat_back_addr":"172.21.15.153:6815/3340941443","heartbeat_front_addr":"172.21.15.153:6813/3340941443","state":["exists","up"]},{"osd":6,"uuid":"c26bb8cb-ccee-4bfc-91eb-14e1ad8e04df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6819","nonce":2005485079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6821","nonce":2005485079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6825","nonce":2005485079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6823","nonce":2005485079}]},"public_addr":"172.21.15.83:6819/2005485079","cluster_addr":"172.21.15.83:6821/2005485079","heartbeat_back_addr":"172.21.15.83:6825/2005485079","heartbeat_front_addr":"172.21.15.83:6823/2005485079","state":["exists","up"]},{"osd":7,"uuid":"a8940da2-0e79-4606-8d1e-d425afbf5753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6817","nonce":3737505059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6819","nonce":3737505059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6823","nonce":3737505059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6821","nonce":3737505059}]},"public_addr":"172.21.15.145:6817/3737505059","cluster_addr":"172.21.15.145:6819/3737505059","heartbeat_back_addr":"172.21.15.145:6823/3737505059","heartbeat_front_addr":"172.21.15.145:6821/3737505059","state":["exists","up"]},{"osd":8,"uuid":"602d43ac-a189-4da3-9e38-7025d14e0dd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6817","nonce":1031545791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6819","nonce":1031545791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6823","nonce":1031545791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6821","nonce":1031545791}]},"public_addr":"172.21.15.153:6817/1031545791","cluster_addr":"172.21.15.153:6819/1031545791","heartbeat_back_addr":"172.21.15.153:6823/1031545791","heartbeat_front_addr":"172.21.15.153:6821/1031545791","state":["exists","up"]},{"osd":9,"uuid":"08b12d27-1247-45e4-9d09-cacc0fce4bd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6827","nonce":3720996673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6829","nonce":3720996673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6833","nonce":3720996673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6831","nonce":3720996673}]},"public_addr":"172.21.15.83:6827/3720996673","cluster_addr":"172.21.15.83:6829/3720996673","heartbeat_back_addr":"172.21.15.83:6833/3720996673","heartbeat_front_addr":"172.21.15.83:6831/3720996673","state":["exists","up"]},{"osd":10,"uuid":"dd986b50-d68f-446c-9c66-261535880879","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6825","nonce":2671529479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6827","nonce":2671529479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6831","nonce":2671529479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6829","nonce":2671529479}]},"public_addr":"172.21.15.145:6825/2671529479","cluster_addr":"172.21.15.145:6827/2671529479","heartbeat_back_addr":"172.21.15.145:6831/2671529479","heartbeat_front_addr":"172.21.15.145:6829/2671529479","state":["exists","up"]},{"osd":11,"uuid":"d20a49cd-6224-4424-8375-46da791d9931","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6825","nonce":2342548429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6827","nonce":2342548429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6831","nonce":2342548429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6829","nonce":2342548429}]},"public_addr":"172.21.15.153:6825/2342548429","cluster_addr":"172.21.15.153:6827/2342548429","heartbeat_back_addr":"172.21.15.153:6831/2342548429","heartbeat_front_addr":"172.21.15.153:6829/2342548429","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:50:44.539932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:01.990470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:19.054426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:36.616393+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:53.896705+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:10.667502+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:27.880849+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:45.276308+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:02.280615+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:19.555547+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:37.062881+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:54.191589+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.83:6801/1867137261":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/2596683931":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/2125339627":"2024-04-02T06:49:33.656125+0000","172.21.15.83:6800/1644397953":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/690500472":"2024-04-02T06:49:13.456026+0000","172.21.15.83:6801/1644397953":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/785958951":"2024-04-02T06:49:33.656125+0000","172.21.15.83:6800/1867137261":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/2222527447":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/2071592157":"2024-04-02T06:49:13.456026+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T06:55:43.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.483+0000 7fbaa933d700 1 -- 172.21.15.83:0/2068893861 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fba8c0a1230 msgr2=0x7fba8c0a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:43.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.483+0000 7fbaa933d700 1 --2- 172.21.15.83:0/2068893861 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fba8c0a1230 0x7fba8c0a36f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fba94005950 tx=0x7fba94005cf0 comp rx=0 tx=0).stop 2024-04-01T06:55:43.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.483+0000 7fbaa933d700 1 -- 172.21.15.83:0/2068893861 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbaa41040e0 msgr2=0x7fbaa41993f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:43.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.483+0000 7fbaa933d700 1 --2- 172.21.15.83:0/2068893861 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbaa41040e0 0x7fbaa41993f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fba9800d950 tx=0x7fba9800dd10 comp rx=0 tx=0).stop 2024-04-01T06:55:43.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.483+0000 7fbaa933d700 1 -- 172.21.15.83:0/2068893861 shutdown_connections 2024-04-01T06:55:43.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.483+0000 7fbaa933d700 1 --2- 172.21.15.83:0/2068893861 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fba8c0a1230 0x7fba8c0a36f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:43.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.483+0000 7fbaa933d700 1 --2- 172.21.15.83:0/2068893861 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbaa4106a10 0x7fbaa41a0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:43.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.483+0000 7fbaa933d700 1 --2- 172.21.15.83:0/2068893861 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbaa41017b0 0x7fbaa4198eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:43.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.483+0000 7fbaa933d700 1 --2- 172.21.15.83:0/2068893861 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbaa41040e0 0x7fbaa41993f0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:43.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.483+0000 7fbaa933d700 1 -- 172.21.15.83:0/2068893861 >> 172.21.15.83:0/2068893861 conn(0x7fbaa40fb100 msgr2=0x7fbaa4100f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:43.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.483+0000 7fbaa933d700 1 -- 172.21.15.83:0/2068893861 shutdown_connections 2024-04-01T06:55:43.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.483+0000 7fbaa933d700 1 -- 172.21.15.83:0/2068893861 wait complete. 2024-04-01T06:55:43.495 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-01T06:51:21.963996+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-01T06:54:26.450403+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-01T06:54:27.564928+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-01T06:55:43.496 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-01T06:55:43.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.621+0000 7f8fcb6ee700 1 -- 172.21.15.83:0/1053573789 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8fc4101f70 msgr2=0x7f8fc41023d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:43.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.621+0000 7f8fcb6ee700 1 --2- 172.21.15.83:0/1053573789 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8fc4101f70 0x7f8fc41023d0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f8fc00099c0 tx=0x7f8fc0009cd0 comp rx=0 tx=0).stop 2024-04-01T06:55:43.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.621+0000 7f8fcb6ee700 1 -- 172.21.15.83:0/1053573789 shutdown_connections 2024-04-01T06:55:43.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.621+0000 7f8fcb6ee700 1 --2- 172.21.15.83:0/1053573789 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8fc4102910 0x7f8fc41091c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:43.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.621+0000 7f8fcb6ee700 1 --2- 172.21.15.83:0/1053573789 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fc4100d80 0x7f8fc41011a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:43.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.621+0000 7f8fcb6ee700 1 --2- 172.21.15.83:0/1053573789 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8fc4101f70 0x7f8fc41023d0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:43.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.621+0000 7f8fcb6ee700 1 -- 172.21.15.83:0/1053573789 >> 172.21.15.83:0/1053573789 conn(0x7f8fc40fc2f0 msgr2=0x7f8fc40fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:43.624 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.621+0000 7f8fcb6ee700 1 -- 172.21.15.83:0/1053573789 shutdown_connections 2024-04-01T06:55:43.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.621+0000 7f8fcb6ee700 1 -- 172.21.15.83:0/1053573789 wait complete. 2024-04-01T06:55:43.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.622+0000 7f8fcb6ee700 1 Processor -- start 2024-04-01T06:55:43.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.622+0000 7f8fcb6ee700 1 -- start start 2024-04-01T06:55:43.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.622+0000 7f8fcb6ee700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8fc4100d80 0x7f8fc4196d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:43.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.622+0000 7f8fcb6ee700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8fc4101f70 0x7f8fc4197280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:43.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.622+0000 7f8fcb6ee700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fc4102910 0x7f8fc419e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:43.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.622+0000 7f8fcb6ee700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc419e830 con 0x7f8fc4101f70 2024-04-01T06:55:43.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.622+0000 7f8fcb6ee700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc419e9a0 con 0x7f8fc4100d80 2024-04-01T06:55:43.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.622+0000 7f8fcb6ee700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc419eb60 con 0x7f8fc4102910 2024-04-01T06:55:43.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.622+0000 7f8fc8c89700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8fc4101f70 0x7f8fc4197280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:43.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.622+0000 7f8fc8c89700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8fc4101f70 0x7f8fc4197280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:34484/0 (socket says 172.21.15.83:34484) 2024-04-01T06:55:43.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.622+0000 7f8fc8c89700 1 -- 172.21.15.83:0/1631990982 learned_addr learned my addr 172.21.15.83:0/1631990982 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:43.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.622+0000 7f8fc948a700 1 --2- 172.21.15.83:0/1631990982 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8fc4100d80 0x7f8fc4196d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:43.625 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.622+0000 7f8fc9c8b700 1 --2- 172.21.15.83:0/1631990982 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fc4102910 0x7f8fc419e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:43.626 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.622+0000 7f8fc8c89700 1 -- 172.21.15.83:0/1631990982 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fc4102910 msgr2=0x7f8fc419e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:43.626 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.622+0000 7f8fc8c89700 1 --2- 172.21.15.83:0/1631990982 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fc4102910 0x7f8fc419e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:43.626 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.623+0000 7f8fc8c89700 1 -- 172.21.15.83:0/1631990982 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8fc4100d80 msgr2=0x7f8fc4196d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:43.626 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.623+0000 7f8fc8c89700 1 --2- 172.21.15.83:0/1631990982 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8fc4100d80 0x7f8fc4196d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:43.626 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.623+0000 7f8fc8c89700 1 -- 172.21.15.83:0/1631990982 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc00095f0 con 0x7f8fc4101f70 2024-04-01T06:55:43.626 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.623+0000 7f8fc9c8b700 1 --2- 172.21.15.83:0/1631990982 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fc4102910 0x7f8fc419e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:55:43.626 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.623+0000 7f8fc8c89700 1 --2- 172.21.15.83:0/1631990982 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8fc4101f70 0x7f8fc4197280 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0003730 tx=0x7f8fc000fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:43.626 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.623+0000 7f8fb67fc700 1 -- 172.21.15.83:0/1631990982 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc001d070 con 0x7f8fc4101f70 2024-04-01T06:55:43.626 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.623+0000 7f8fb67fc700 1 -- 172.21.15.83:0/1631990982 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8fc000fe70 con 0x7f8fc4101f70 2024-04-01T06:55:43.626 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.623+0000 7f8fcb6ee700 1 -- 172.21.15.83:0/1631990982 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fc419ede0 con 0x7f8fc4101f70 2024-04-01T06:55:43.626 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.623+0000 7f8fb67fc700 1 -- 172.21.15.83:0/1631990982 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc0017650 con 0x7f8fc4101f70 2024-04-01T06:55:43.626 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.623+0000 7f8fcb6ee700 1 -- 172.21.15.83:0/1631990982 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fc419f1b0 con 0x7f8fc4101f70 2024-04-01T06:55:43.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.624+0000 7f8fcb6ee700 1 -- 172.21.15.83:0/1631990982 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fc41081a0 con 0x7f8fc4101f70 2024-04-01T06:55:43.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.625+0000 7f8fb67fc700 1 -- 172.21.15.83:0/1631990982 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f8fc0022470 con 0x7f8fc4101f70 2024-04-01T06:55:43.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.625+0000 7f8fb67fc700 1 --2- 172.21.15.83:0/1631990982 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f8fb00a11b0 0x7f8fb00a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:43.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.625+0000 7f8fb67fc700 1 -- 172.21.15.83:0/1631990982 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f8fc00cdd80 con 0x7f8fc4101f70 2024-04-01T06:55:43.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.625+0000 7f8fc948a700 1 --2- 172.21.15.83:0/1631990982 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f8fb00a11b0 0x7f8fb00a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:43.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.626+0000 7f8fc948a700 1 --2- 172.21.15.83:0/1631990982 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f8fb00a11b0 0x7f8fb00a3670 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8fc41981c0 tx=0x7f8fb8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:43.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.630+0000 7f8fb67fc700 1 -- 172.21.15.83:0/1631990982 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f8fc0097460 con 0x7f8fc4101f70 2024-04-01T06:55:43.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:43 smithi083 ceph-mon[43429]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T06:55:43.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:43 smithi083 ceph-mon[43429]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T06:55:43.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:43 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/2068893861' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T06:55:43.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.828+0000 7f8fcb6ee700 1 -- 172.21.15.83:0/1631990982 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8fc402cd00 con 0x7f8fc4101f70 2024-04-01T06:55:43.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.828+0000 7f8fb67fc700 1 -- 172.21.15.83:0/1631990982 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8fc009aa80 con 0x7f8fc4101f70 2024-04-01T06:55:43.828 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 1 2024-04-01T06:55:43.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.831+0000 7f8fcb6ee700 1 -- 172.21.15.83:0/1631990982 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f8fb00a11b0 msgr2=0x7f8fb00a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:43.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.831+0000 7f8fcb6ee700 1 --2- 172.21.15.83:0/1631990982 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f8fb00a11b0 0x7f8fb00a3670 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8fc41981c0 tx=0x7f8fb8009260 comp rx=0 tx=0).stop 2024-04-01T06:55:43.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.831+0000 7f8fcb6ee700 1 -- 172.21.15.83:0/1631990982 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8fc4101f70 msgr2=0x7f8fc4197280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:43.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.831+0000 7f8fcb6ee700 1 --2- 172.21.15.83:0/1631990982 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8fc4101f70 0x7f8fc4197280 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0003730 tx=0x7f8fc000fa00 comp rx=0 tx=0).stop 2024-04-01T06:55:43.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.831+0000 7f8fcb6ee700 1 -- 172.21.15.83:0/1631990982 shutdown_connections 2024-04-01T06:55:43.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.831+0000 7f8fcb6ee700 1 --2- 172.21.15.83:0/1631990982 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f8fb00a11b0 0x7f8fb00a3670 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:43.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.831+0000 7f8fcb6ee700 1 --2- 172.21.15.83:0/1631990982 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fc4102910 0x7f8fc419e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:43.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.831+0000 7f8fcb6ee700 1 --2- 172.21.15.83:0/1631990982 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8fc4100d80 0x7f8fc4196d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:43.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.831+0000 7f8fcb6ee700 1 --2- 172.21.15.83:0/1631990982 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8fc4101f70 0x7f8fc4197280 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:43.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.831+0000 7f8fcb6ee700 1 -- 172.21.15.83:0/1631990982 >> 172.21.15.83:0/1631990982 conn(0x7f8fc40fc2f0 msgr2=0x7f8fc41052e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:43.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.831+0000 7f8fcb6ee700 1 -- 172.21.15.83:0/1631990982 shutdown_connections 2024-04-01T06:55:43.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.831+0000 7f8fcb6ee700 1 -- 172.21.15.83:0/1631990982 wait complete. 2024-04-01T06:55:43.843 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-01T06:55:43.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.969+0000 7f2955dff700 1 -- 172.21.15.83:0/1579681066 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2950100d80 msgr2=0x7f29501011a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:43.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.969+0000 7f2955dff700 1 --2- 172.21.15.83:0/1579681066 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2950100d80 0x7f29501011a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f29380099c0 tx=0x7f2938009cd0 comp rx=0 tx=0).stop 2024-04-01T06:55:43.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.969+0000 7f2955dff700 1 -- 172.21.15.83:0/1579681066 shutdown_connections 2024-04-01T06:55:43.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.969+0000 7f2955dff700 1 --2- 172.21.15.83:0/1579681066 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2950100d80 0x7f29501011a0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:43.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.969+0000 7f2955dff700 1 --2- 172.21.15.83:0/1579681066 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2950102910 0x7f29501091c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:43.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.969+0000 7f2955dff700 1 --2- 172.21.15.83:0/1579681066 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2950101f70 0x7f29501023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:43.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.969+0000 7f2955dff700 1 -- 172.21.15.83:0/1579681066 >> 172.21.15.83:0/1579681066 conn(0x7f29500fc2f0 msgr2=0x7f29500fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:43.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.969+0000 7f2955dff700 1 -- 172.21.15.83:0/1579681066 shutdown_connections 2024-04-01T06:55:43.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.969+0000 7f2955dff700 1 -- 172.21.15.83:0/1579681066 wait complete. 2024-04-01T06:55:43.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.969+0000 7f2955dff700 1 Processor -- start 2024-04-01T06:55:43.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.970+0000 7f2955dff700 1 -- start start 2024-04-01T06:55:43.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.970+0000 7f2955dff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2950100d80 0x7f2950196df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:43.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.970+0000 7f2955dff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2950101f70 0x7f2950197330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:43.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.970+0000 7f2955dff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2950102910 0x7f295019e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:43.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.970+0000 7f2955dff700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f295019e8e0 con 0x7f2950102910 2024-04-01T06:55:43.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.970+0000 7f2955dff700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f295019ea50 con 0x7f2950100d80 2024-04-01T06:55:43.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.970+0000 7f2955dff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f295019ec10 con 0x7f2950101f70 2024-04-01T06:55:43.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.970+0000 7f294ffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2950102910 0x7f295019e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:43.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.970+0000 7f294ffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2950102910 0x7f295019e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:34504/0 (socket says 172.21.15.83:34504) 2024-04-01T06:55:43.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.970+0000 7f294ffff700 1 -- 172.21.15.83:0/4278567652 learned_addr learned my addr 172.21.15.83:0/4278567652 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:43.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.970+0000 7f294effd700 1 --2- 172.21.15.83:0/4278567652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2950101f70 0x7f2950197330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:43.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.970+0000 7f294f7fe700 1 --2- 172.21.15.83:0/4278567652 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2950100d80 0x7f2950196df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:43.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.970+0000 7f294ffff700 1 -- 172.21.15.83:0/4278567652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2950101f70 msgr2=0x7f2950197330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:43.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.970+0000 7f294ffff700 1 --2- 172.21.15.83:0/4278567652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2950101f70 0x7f2950197330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:43.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.970+0000 7f294ffff700 1 -- 172.21.15.83:0/4278567652 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2950100d80 msgr2=0x7f2950196df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:43.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.970+0000 7f294ffff700 1 --2- 172.21.15.83:0/4278567652 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2950100d80 0x7f2950196df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:43.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.970+0000 7f294ffff700 1 -- 172.21.15.83:0/4278567652 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29380095f0 con 0x7f2950102910 2024-04-01T06:55:43.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.970+0000 7f294f7fe700 1 --2- 172.21.15.83:0/4278567652 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2950100d80 0x7f2950196df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:55:43.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.970+0000 7f294ffff700 1 --2- 172.21.15.83:0/4278567652 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2950102910 0x7f295019e310 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f2948007ee0 tx=0x7f294800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:43.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.971+0000 7f294cff9700 1 -- 172.21.15.83:0/4278567652 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2948017070 con 0x7f2950102910 2024-04-01T06:55:43.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.971+0000 7f294cff9700 1 -- 172.21.15.83:0/4278567652 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f294800f040 con 0x7f2950102910 2024-04-01T06:55:43.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.971+0000 7f2955dff700 1 -- 172.21.15.83:0/4278567652 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f295019eef0 con 0x7f2950102910 2024-04-01T06:55:43.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.971+0000 7f294cff9700 1 -- 172.21.15.83:0/4278567652 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2948005740 con 0x7f2950102910 2024-04-01T06:55:43.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.971+0000 7f2955dff700 1 -- 172.21.15.83:0/4278567652 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f295019f310 con 0x7f2950102910 2024-04-01T06:55:43.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.972+0000 7f2955dff700 1 -- 172.21.15.83:0/4278567652 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2950108220 con 0x7f2950102910 2024-04-01T06:55:43.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.973+0000 7f294cff9700 1 -- 172.21.15.83:0/4278567652 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f294800dc60 con 0x7f2950102910 2024-04-01T06:55:43.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.974+0000 7f294cff9700 1 --2- 172.21.15.83:0/4278567652 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f293c0a1230 0x7f293c0a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:43.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.974+0000 7f294cff9700 1 -- 172.21.15.83:0/4278567652 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f29480cc830 con 0x7f2950102910 2024-04-01T06:55:43.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.974+0000 7f294f7fe700 1 --2- 172.21.15.83:0/4278567652 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f293c0a1230 0x7f293c0a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:43.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.974+0000 7f294f7fe700 1 --2- 172.21.15.83:0/4278567652 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f293c0a1230 0x7f293c0a36f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2938003820 tx=0x7f2938000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:43.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:43.977+0000 7f294cff9700 1 -- 172.21.15.83:0/4278567652 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f2948095e80 con 0x7f2950102910 2024-04-01T06:55:44.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:43 smithi145 ceph-mon[47816]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T06:55:44.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:43 smithi145 ceph-mon[47816]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T06:55:44.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:43 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/2068893861' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T06:55:44.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:43 smithi153 ceph-mon[48187]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T06:55:44.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:43 smithi153 ceph-mon[48187]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T06:55:44.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:43 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/2068893861' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T06:55:44.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.171+0000 7f2955dff700 1 -- 172.21.15.83:0/4278567652 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2950107c00 con 0x7f2950102910 2024-04-01T06:55:44.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.172+0000 7f294cff9700 1 -- 172.21.15.83:0/4278567652 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v81) v1 ==== 104+0+11 (secure 0 0 0) 0x7f29480994a0 con 0x7f2950102910 2024-04-01T06:55:44.172 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 32 2024-04-01T06:55:44.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.174+0000 7f2955dff700 1 -- 172.21.15.83:0/4278567652 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f293c0a1230 msgr2=0x7f293c0a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:44.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.174+0000 7f2955dff700 1 --2- 172.21.15.83:0/4278567652 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f293c0a1230 0x7f293c0a36f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2938003820 tx=0x7f2938000bc0 comp rx=0 tx=0).stop 2024-04-01T06:55:44.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.174+0000 7f2955dff700 1 -- 172.21.15.83:0/4278567652 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2950102910 msgr2=0x7f295019e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:44.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.174+0000 7f2955dff700 1 --2- 172.21.15.83:0/4278567652 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2950102910 0x7f295019e310 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f2948007ee0 tx=0x7f294800d3b0 comp rx=0 tx=0).stop 2024-04-01T06:55:44.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.174+0000 7f2955dff700 1 -- 172.21.15.83:0/4278567652 shutdown_connections 2024-04-01T06:55:44.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.174+0000 7f2955dff700 1 --2- 172.21.15.83:0/4278567652 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2950102910 0x7f295019e310 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:44.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.174+0000 7f2955dff700 1 --2- 172.21.15.83:0/4278567652 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f293c0a1230 0x7f293c0a36f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:44.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.174+0000 7f2955dff700 1 --2- 172.21.15.83:0/4278567652 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2950100d80 0x7f2950196df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:44.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.174+0000 7f2955dff700 1 --2- 172.21.15.83:0/4278567652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2950101f70 0x7f2950197330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:44.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.174+0000 7f2955dff700 1 -- 172.21.15.83:0/4278567652 >> 172.21.15.83:0/4278567652 conn(0x7f29500fc2f0 msgr2=0x7f2950105360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:44.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.174+0000 7f2955dff700 1 -- 172.21.15.83:0/4278567652 shutdown_connections 2024-04-01T06:55:44.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.174+0000 7f2955dff700 1 -- 172.21.15.83:0/4278567652 wait complete. 2024-04-01T06:55:44.186 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-01T06:55:44.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.312+0000 7f8b414e0700 1 -- 172.21.15.83:0/3069007599 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b3c104140 msgr2=0x7f8b3c106530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:44.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.312+0000 7f8b414e0700 1 --2- 172.21.15.83:0/3069007599 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b3c104140 0x7f8b3c106530 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f8b24009990 tx=0x7f8b24009ca0 comp rx=0 tx=0).stop 2024-04-01T06:55:44.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.312+0000 7f8b414e0700 1 -- 172.21.15.83:0/3069007599 shutdown_connections 2024-04-01T06:55:44.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.312+0000 7f8b414e0700 1 --2- 172.21.15.83:0/3069007599 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b3c106a70 0x7f8b3c108ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:44.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.312+0000 7f8b414e0700 1 --2- 172.21.15.83:0/3069007599 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8b3c101810 0x7f8b3c103c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:44.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.312+0000 7f8b414e0700 1 --2- 172.21.15.83:0/3069007599 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b3c104140 0x7f8b3c106530 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:44.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.312+0000 7f8b414e0700 1 -- 172.21.15.83:0/3069007599 >> 172.21.15.83:0/3069007599 conn(0x7f8b3c0fb200 msgr2=0x7f8b3c0fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:44.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.312+0000 7f8b414e0700 1 -- 172.21.15.83:0/3069007599 shutdown_connections 2024-04-01T06:55:44.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.312+0000 7f8b414e0700 1 -- 172.21.15.83:0/3069007599 wait complete. 2024-04-01T06:55:44.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.313+0000 7f8b414e0700 1 Processor -- start 2024-04-01T06:55:44.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.313+0000 7f8b414e0700 1 -- start start 2024-04-01T06:55:44.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.313+0000 7f8b414e0700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8b3c101810 0x7f8b3c196d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:44.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.313+0000 7f8b414e0700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b3c104140 0x7f8b3c197240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:44.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.313+0000 7f8b414e0700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b3c106a70 0x7f8b3c19e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:44.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.313+0000 7f8b414e0700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3c19e820 con 0x7f8b3c104140 2024-04-01T06:55:44.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.313+0000 7f8b414e0700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3c19e990 con 0x7f8b3c101810 2024-04-01T06:55:44.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.313+0000 7f8b414e0700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3c19eb50 con 0x7f8b3c106a70 2024-04-01T06:55:44.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.313+0000 7f8b3a7fc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b3c104140 0x7f8b3c197240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:44.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.313+0000 7f8b3a7fc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b3c104140 0x7f8b3c197240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:34526/0 (socket says 172.21.15.83:34526) 2024-04-01T06:55:44.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.313+0000 7f8b3a7fc700 1 -- 172.21.15.83:0/847363491 learned_addr learned my addr 172.21.15.83:0/847363491 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:44.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.313+0000 7f8b3affd700 1 --2- 172.21.15.83:0/847363491 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8b3c101810 0x7f8b3c196d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:44.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.313+0000 7f8b3b7fe700 1 --2- 172.21.15.83:0/847363491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b3c106a70 0x7f8b3c19e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:44.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.313+0000 7f8b3a7fc700 1 -- 172.21.15.83:0/847363491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b3c106a70 msgr2=0x7f8b3c19e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:44.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.313+0000 7f8b3a7fc700 1 --2- 172.21.15.83:0/847363491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b3c106a70 0x7f8b3c19e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:44.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.313+0000 7f8b3a7fc700 1 -- 172.21.15.83:0/847363491 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8b3c101810 msgr2=0x7f8b3c196d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:44.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.313+0000 7f8b3a7fc700 1 --2- 172.21.15.83:0/847363491 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8b3c101810 0x7f8b3c196d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:44.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.313+0000 7f8b3a7fc700 1 -- 172.21.15.83:0/847363491 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b240095f0 con 0x7f8b3c104140 2024-04-01T06:55:44.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.313+0000 7f8b3b7fe700 1 --2- 172.21.15.83:0/847363491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b3c106a70 0x7f8b3c19e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:55:44.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.314+0000 7f8b3a7fc700 1 --2- 172.21.15.83:0/847363491 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b3c104140 0x7f8b3c197240 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f8b240095c0 tx=0x7f8b2400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:44.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.314+0000 7f8b33fff700 1 -- 172.21.15.83:0/847363491 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2401d070 con 0x7f8b3c104140 2024-04-01T06:55:44.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.314+0000 7f8b33fff700 1 -- 172.21.15.83:0/847363491 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8b24022470 con 0x7f8b3c104140 2024-04-01T06:55:44.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.314+0000 7f8b414e0700 1 -- 172.21.15.83:0/847363491 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b3c19edd0 con 0x7f8b3c104140 2024-04-01T06:55:44.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.314+0000 7f8b33fff700 1 -- 172.21.15.83:0/847363491 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b24017650 con 0x7f8b3c104140 2024-04-01T06:55:44.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.314+0000 7f8b414e0700 1 -- 172.21.15.83:0/847363491 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b3c19f1a0 con 0x7f8b3c104140 2024-04-01T06:55:44.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.315+0000 7f8b414e0700 1 -- 172.21.15.83:0/847363491 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b3c0fcd80 con 0x7f8b3c104140 2024-04-01T06:55:44.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.316+0000 7f8b33fff700 1 -- 172.21.15.83:0/847363491 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f8b24022850 con 0x7f8b3c104140 2024-04-01T06:55:44.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.316+0000 7f8b33fff700 1 --2- 172.21.15.83:0/847363491 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f8b280a11b0 0x7f8b280a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:44.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.317+0000 7f8b3affd700 1 --2- 172.21.15.83:0/847363491 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f8b280a11b0 0x7f8b280a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:44.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.317+0000 7f8b33fff700 1 -- 172.21.15.83:0/847363491 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f8b240cddf0 con 0x7f8b3c104140 2024-04-01T06:55:44.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.317+0000 7f8b3affd700 1 --2- 172.21.15.83:0/847363491 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f8b280a11b0 0x7f8b280a3670 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c102fe0 tx=0x7f8b2c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:44.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.321+0000 7f8b33fff700 1 -- 172.21.15.83:0/847363491 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f8b24097800 con 0x7f8b3c104140 2024-04-01T06:55:44.515 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.515+0000 7f8b414e0700 1 -- 172.21.15.83:0/847363491 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8b3c10c730 con 0x7f8b3c104140 2024-04-01T06:55:44.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.516+0000 7f8b33fff700 1 -- 172.21.15.83:0/847363491 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v81) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8b24027070 con 0x7f8b3c104140 2024-04-01T06:55:44.516 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 64 2024-04-01T06:55:44.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.518+0000 7f8b414e0700 1 -- 172.21.15.83:0/847363491 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f8b280a11b0 msgr2=0x7f8b280a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:44.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.518+0000 7f8b414e0700 1 --2- 172.21.15.83:0/847363491 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f8b280a11b0 0x7f8b280a3670 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c102fe0 tx=0x7f8b2c00b410 comp rx=0 tx=0).stop 2024-04-01T06:55:44.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.518+0000 7f8b414e0700 1 -- 172.21.15.83:0/847363491 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b3c104140 msgr2=0x7f8b3c197240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:44.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.518+0000 7f8b414e0700 1 --2- 172.21.15.83:0/847363491 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b3c104140 0x7f8b3c197240 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f8b240095c0 tx=0x7f8b2400f690 comp rx=0 tx=0).stop 2024-04-01T06:55:44.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.518+0000 7f8b414e0700 1 -- 172.21.15.83:0/847363491 shutdown_connections 2024-04-01T06:55:44.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.518+0000 7f8b414e0700 1 --2- 172.21.15.83:0/847363491 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f8b280a11b0 0x7f8b280a3670 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:44.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.518+0000 7f8b414e0700 1 --2- 172.21.15.83:0/847363491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b3c106a70 0x7f8b3c19e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:44.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.518+0000 7f8b414e0700 1 --2- 172.21.15.83:0/847363491 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8b3c101810 0x7f8b3c196d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:44.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.518+0000 7f8b414e0700 1 --2- 172.21.15.83:0/847363491 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8b3c104140 0x7f8b3c197240 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:44.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.518+0000 7f8b414e0700 1 -- 172.21.15.83:0/847363491 >> 172.21.15.83:0/847363491 conn(0x7f8b3c0fb200 msgr2=0x7f8b3c103700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:44.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.518+0000 7f8b414e0700 1 -- 172.21.15.83:0/847363491 shutdown_connections 2024-04-01T06:55:44.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.518+0000 7f8b414e0700 1 -- 172.21.15.83:0/847363491 wait complete. 2024-04-01T06:55:44.530 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T06:55:44.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.653+0000 7f22dd3bf700 1 -- 172.21.15.83:0/3919671823 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22d8101f00 msgr2=0x7f22d8102360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:44.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.653+0000 7f22dd3bf700 1 --2- 172.21.15.83:0/3919671823 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22d8101f00 0x7f22d8102360 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f22c8009990 tx=0x7f22c8009ca0 comp rx=0 tx=0).stop 2024-04-01T06:55:44.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.653+0000 7f22dd3bf700 1 -- 172.21.15.83:0/3919671823 shutdown_connections 2024-04-01T06:55:44.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.653+0000 7f22dd3bf700 1 --2- 172.21.15.83:0/3919671823 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f22d81028a0 0x7f22d8109150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:44.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.653+0000 7f22dd3bf700 1 --2- 172.21.15.83:0/3919671823 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22d80fef30 0x7f22d80ff350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:44.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.653+0000 7f22dd3bf700 1 --2- 172.21.15.83:0/3919671823 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22d8101f00 0x7f22d8102360 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:44.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.653+0000 7f22dd3bf700 1 -- 172.21.15.83:0/3919671823 >> 172.21.15.83:0/3919671823 conn(0x7f22d80fa880 msgr2=0x7f22d80fcca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:44.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.653+0000 7f22dd3bf700 1 -- 172.21.15.83:0/3919671823 shutdown_connections 2024-04-01T06:55:44.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.653+0000 7f22dd3bf700 1 -- 172.21.15.83:0/3919671823 wait complete. 2024-04-01T06:55:44.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.653+0000 7f22dd3bf700 1 Processor -- start 2024-04-01T06:55:44.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.654+0000 7f22dd3bf700 1 -- start start 2024-04-01T06:55:44.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.654+0000 7f22dd3bf700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f22d80fef30 0x7f22d8196be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:44.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.654+0000 7f22dd3bf700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22d8101f00 0x7f22d8197120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:44.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.654+0000 7f22dd3bf700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22d81028a0 0x7f22d819e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:44.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.654+0000 7f22dd3bf700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d819e710 con 0x7f22d81028a0 2024-04-01T06:55:44.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.654+0000 7f22dd3bf700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d819e850 con 0x7f22d80fef30 2024-04-01T06:55:44.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.654+0000 7f22dd3bf700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d819e9e0 con 0x7f22d8101f00 2024-04-01T06:55:44.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.654+0000 7f22d77fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22d81028a0 0x7f22d819e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:44.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.654+0000 7f22d77fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22d81028a0 0x7f22d819e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:34554/0 (socket says 172.21.15.83:34554) 2024-04-01T06:55:44.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.654+0000 7f22d77fe700 1 -- 172.21.15.83:0/3966523286 learned_addr learned my addr 172.21.15.83:0/3966523286 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:44.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.654+0000 7f22d67fc700 1 --2- 172.21.15.83:0/3966523286 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22d8101f00 0x7f22d8197120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:44.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.654+0000 7f22d6ffd700 1 --2- 172.21.15.83:0/3966523286 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f22d80fef30 0x7f22d8196be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:44.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.654+0000 7f22d77fe700 1 -- 172.21.15.83:0/3966523286 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22d8101f00 msgr2=0x7f22d8197120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:44.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.654+0000 7f22d77fe700 1 --2- 172.21.15.83:0/3966523286 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22d8101f00 0x7f22d8197120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:44.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.654+0000 7f22d77fe700 1 -- 172.21.15.83:0/3966523286 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f22d80fef30 msgr2=0x7f22d8196be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:44.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.654+0000 7f22d77fe700 1 --2- 172.21.15.83:0/3966523286 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f22d80fef30 0x7f22d8196be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:44.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.654+0000 7f22d77fe700 1 -- 172.21.15.83:0/3966523286 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c80095f0 con 0x7f22d81028a0 2024-04-01T06:55:44.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.654+0000 7f22d6ffd700 1 --2- 172.21.15.83:0/3966523286 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f22d80fef30 0x7f22d8196be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:55:44.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.654+0000 7f22d77fe700 1 --2- 172.21.15.83:0/3966523286 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22d81028a0 0x7f22d819e140 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f22d0007ee0 tx=0x7f22d000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:44.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.655+0000 7f22bffff700 1 -- 172.21.15.83:0/3966523286 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d000ddd0 con 0x7f22d81028a0 2024-04-01T06:55:44.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.655+0000 7f22dd3bf700 1 -- 172.21.15.83:0/3966523286 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22d819ecc0 con 0x7f22d81028a0 2024-04-01T06:55:44.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.655+0000 7f22bffff700 1 -- 172.21.15.83:0/3966523286 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f22d000f040 con 0x7f22d81028a0 2024-04-01T06:55:44.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.655+0000 7f22bffff700 1 -- 172.21.15.83:0/3966523286 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d0015400 con 0x7f22d81028a0 2024-04-01T06:55:44.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.655+0000 7f22dd3bf700 1 -- 172.21.15.83:0/3966523286 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22d819f1d0 con 0x7f22d81028a0 2024-04-01T06:55:44.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.655+0000 7f22dd3bf700 1 -- 172.21.15.83:0/3966523286 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22d81081e0 con 0x7f22d81028a0 2024-04-01T06:55:44.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.656+0000 7f22bffff700 1 -- 172.21.15.83:0/3966523286 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f22d0004020 con 0x7f22d81028a0 2024-04-01T06:55:44.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.657+0000 7f22bffff700 1 --2- 172.21.15.83:0/3966523286 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f22c00a11b0 0x7f22c00a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:44.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.657+0000 7f22d6ffd700 1 --2- 172.21.15.83:0/3966523286 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f22c00a11b0 0x7f22c00a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:44.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.657+0000 7f22bffff700 1 -- 172.21.15.83:0/3966523286 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f22d00cca70 con 0x7f22d81028a0 2024-04-01T06:55:44.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.657+0000 7f22d6ffd700 1 --2- 172.21.15.83:0/3966523286 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f22c00a11b0 0x7f22c00a3670 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f22cc005fd0 tx=0x7f22cc005de0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:44.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.660+0000 7f22bffff700 1 -- 172.21.15.83:0/3966523286 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f22d00961c0 con 0x7f22d81028a0 2024-04-01T06:55:44.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.904+0000 7f22dd3bf700 1 -- 172.21.15.83:0/3966523286 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f22d810c490 con 0x7f22d81028a0 2024-04-01T06:55:44.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.905+0000 7f22bffff700 1 -- 172.21.15.83:0/3966523286 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+10876 (secure 0 0 0) 0x7f22d0023090 con 0x7f22d81028a0 2024-04-01T06:55:44.905 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:55:44.905 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1271130478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1271130478},{"type":"v1","addr":"172.21.15.83:6835","nonce":1271130478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2412682983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2412682983},{"type":"v1","addr":"172.21.15.83:6837","nonce":2412682983}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6839/3348145990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":3348145990},{"type":"v1","addr":"172.21.15.83:6839","nonce":3348145990}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6841/1191267445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6840","nonce":1191267445},{"type":"v1","addr":"172.21.15.83:6841","nonce":1191267445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2467459028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2467459028},{"type":"v1","addr":"172.21.15.153:6833","nonce":2467459028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24448,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4092629042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":4092629042},{"type":"v1","addr":"172.21.15.153:6835","nonce":4092629042}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-01T06:54:28.397062+0000","modified":"2024-04-01T06:55:38.703948+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24524,"mds_1":24494,"mds_2":24473},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6833/647005844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":647005844},{"type":"v1","addr":"172.21.15.145:6833","nonce":647005844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24454":{"gid":24454,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6837/1993816527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1993816527},{"type":"v1","addr":"172.21.15.153:6837","nonce":1993816527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6839/1399754640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1399754640},{"type":"v1","addr":"172.21.15.153:6839","nonce":1399754640}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24473":{"gid":24473,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.145:6835/3104241497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":3104241497},{"type":"v1","addr":"172.21.15.145:6835","nonce":3104241497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24494":{"gid":24494,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.145:6837/2687798317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2687798317},{"type":"v1","addr":"172.21.15.145:6837","nonce":2687798317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6839/3886435411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3886435411},{"type":"v1","addr":"172.21.15.145:6839","nonce":3886435411}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-01T06:55:44.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.907+0000 7f22dd3bf700 1 -- 172.21.15.83:0/3966523286 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f22c00a11b0 msgr2=0x7f22c00a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:44.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.907+0000 7f22dd3bf700 1 --2- 172.21.15.83:0/3966523286 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f22c00a11b0 0x7f22c00a3670 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f22cc005fd0 tx=0x7f22cc005de0 comp rx=0 tx=0).stop 2024-04-01T06:55:44.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.907+0000 7f22dd3bf700 1 -- 172.21.15.83:0/3966523286 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22d81028a0 msgr2=0x7f22d819e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:44.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.907+0000 7f22dd3bf700 1 --2- 172.21.15.83:0/3966523286 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22d81028a0 0x7f22d819e140 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f22d0007ee0 tx=0x7f22d000d3b0 comp rx=0 tx=0).stop 2024-04-01T06:55:44.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.907+0000 7f22dd3bf700 1 -- 172.21.15.83:0/3966523286 shutdown_connections 2024-04-01T06:55:44.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.907+0000 7f22dd3bf700 1 --2- 172.21.15.83:0/3966523286 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22d81028a0 0x7f22d819e140 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:44.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.907+0000 7f22dd3bf700 1 --2- 172.21.15.83:0/3966523286 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f22c00a11b0 0x7f22c00a3670 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:44.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.907+0000 7f22dd3bf700 1 --2- 172.21.15.83:0/3966523286 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f22d80fef30 0x7f22d8196be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:44.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.907+0000 7f22dd3bf700 1 --2- 172.21.15.83:0/3966523286 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22d8101f00 0x7f22d8197120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:44.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.907+0000 7f22dd3bf700 1 -- 172.21.15.83:0/3966523286 >> 172.21.15.83:0/3966523286 conn(0x7f22d80fa880 msgr2=0x7f22d8105320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:44.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.907+0000 7f22dd3bf700 1 -- 172.21.15.83:0/3966523286 shutdown_connections 2024-04-01T06:55:44.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:44.907+0000 7f22dd3bf700 1 -- 172.21.15.83:0/3966523286 wait complete. 2024-04-01T06:55:44.908 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 24 2024-04-01T06:55:44.919 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:44 smithi083 ceph-mon[43429]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T06:55:44.919 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:44 smithi083 ceph-mon[43429]: pgmap v256: 97 pgs: 97 active+clean; 645 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 921 B/s wr, 6 op/s; 0 B/s, 0 objects/s recovering 2024-04-01T06:55:44.919 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:44 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/1631990982' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-01T06:55:44.919 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:44 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/4278567652' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-01T06:55:44.919 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:44 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/847363491' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-01T06:55:44.920 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T06:55:45.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:44 smithi145 ceph-mon[47816]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T06:55:45.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:44 smithi145 ceph-mon[47816]: pgmap v256: 97 pgs: 97 active+clean; 645 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 921 B/s wr, 6 op/s; 0 B/s, 0 objects/s recovering 2024-04-01T06:55:45.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:44 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/1631990982' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-01T06:55:45.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:44 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/4278567652' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-01T06:55:45.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:44 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/847363491' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-01T06:55:45.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.043+0000 7fe4730c2700 1 -- 172.21.15.83:0/1257863266 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe46c1016f0 msgr2=0x7fe46c107fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:45.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.043+0000 7fe4730c2700 1 --2- 172.21.15.83:0/1257863266 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe46c1016f0 0x7fe46c107fa0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fe46400b0d0 tx=0x7fe46400b3e0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.043+0000 7fe4730c2700 1 -- 172.21.15.83:0/1257863266 shutdown_connections 2024-04-01T06:55:45.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.043+0000 7fe4730c2700 1 --2- 172.21.15.83:0/1257863266 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe46c1016f0 0x7fe46c107fa0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.043+0000 7fe4730c2700 1 --2- 172.21.15.83:0/1257863266 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe46c0ffb60 0x7fe46c0fff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.043+0000 7fe4730c2700 1 --2- 172.21.15.83:0/1257863266 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe46c100d50 0x7fe46c1011b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.043+0000 7fe4730c2700 1 -- 172.21.15.83:0/1257863266 >> 172.21.15.83:0/1257863266 conn(0x7fe46c0fb0d0 msgr2=0x7fe46c0fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:45.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.043+0000 7fe4730c2700 1 -- 172.21.15.83:0/1257863266 shutdown_connections 2024-04-01T06:55:45.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.043+0000 7fe4730c2700 1 -- 172.21.15.83:0/1257863266 wait complete. 2024-04-01T06:55:45.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.043+0000 7fe4730c2700 1 Processor -- start 2024-04-01T06:55:45.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.044+0000 7fe4730c2700 1 -- start start 2024-04-01T06:55:45.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.044+0000 7fe4730c2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe46c0ffb60 0x7fe46c196e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:45.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.044+0000 7fe4730c2700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe46c100d50 0x7fe46c1973d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:45.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.044+0000 7fe4730c2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe46c1016f0 0x7fe46c19e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:45.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.044+0000 7fe4730c2700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe46c19e970 con 0x7fe46c0ffb60 2024-04-01T06:55:45.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.044+0000 7fe4730c2700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe46c19eab0 con 0x7fe46c100d50 2024-04-01T06:55:45.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.044+0000 7fe4730c2700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe46c19ec40 con 0x7fe46c1016f0 2024-04-01T06:55:45.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.044+0000 7fe470e5e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe46c0ffb60 0x7fe46c196e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:45.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.044+0000 7fe470e5e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe46c0ffb60 0x7fe46c196e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:34570/0 (socket says 172.21.15.83:34570) 2024-04-01T06:55:45.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.044+0000 7fe470e5e700 1 -- 172.21.15.83:0/3495290477 learned_addr learned my addr 172.21.15.83:0/3495290477 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:45.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.044+0000 7fe47165f700 1 --2- 172.21.15.83:0/3495290477 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe46c1016f0 0x7fe46c19e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:45.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.044+0000 7fe46bfff700 1 --2- 172.21.15.83:0/3495290477 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe46c100d50 0x7fe46c1973d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:45.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.044+0000 7fe470e5e700 1 -- 172.21.15.83:0/3495290477 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe46c1016f0 msgr2=0x7fe46c19e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:45.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.044+0000 7fe470e5e700 1 --2- 172.21.15.83:0/3495290477 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe46c1016f0 0x7fe46c19e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.044+0000 7fe470e5e700 1 -- 172.21.15.83:0/3495290477 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe46c100d50 msgr2=0x7fe46c1973d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:45.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.044+0000 7fe470e5e700 1 --2- 172.21.15.83:0/3495290477 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe46c100d50 0x7fe46c1973d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.044+0000 7fe470e5e700 1 -- 172.21.15.83:0/3495290477 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe464009d00 con 0x7fe46c0ffb60 2024-04-01T06:55:45.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.044+0000 7fe470e5e700 1 --2- 172.21.15.83:0/3495290477 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe46c0ffb60 0x7fe46c196e90 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fe46000b500 tx=0x7fe46000b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:45.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.044+0000 7fe469ffb700 1 -- 172.21.15.83:0/3495290477 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe460011830 con 0x7fe46c0ffb60 2024-04-01T06:55:45.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.044+0000 7fe469ffb700 1 -- 172.21.15.83:0/3495290477 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe460011e50 con 0x7fe46c0ffb60 2024-04-01T06:55:45.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.044+0000 7fe4730c2700 1 -- 172.21.15.83:0/3495290477 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe46c19ef20 con 0x7fe46c0ffb60 2024-04-01T06:55:45.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.044+0000 7fe469ffb700 1 -- 172.21.15.83:0/3495290477 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46000f2e0 con 0x7fe46c0ffb60 2024-04-01T06:55:45.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.045+0000 7fe4730c2700 1 -- 172.21.15.83:0/3495290477 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe46c19f3c0 con 0x7fe46c0ffb60 2024-04-01T06:55:45.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.046+0000 7fe4730c2700 1 -- 172.21.15.83:0/3495290477 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe46c067a10 con 0x7fe46c0ffb60 2024-04-01T06:55:45.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.046+0000 7fe469ffb700 1 -- 172.21.15.83:0/3495290477 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7fe460010580 con 0x7fe46c0ffb60 2024-04-01T06:55:45.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.047+0000 7fe469ffb700 1 --2- 172.21.15.83:0/3495290477 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fe45c0a11b0 0x7fe45c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:45.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.047+0000 7fe46bfff700 1 --2- 172.21.15.83:0/3495290477 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fe45c0a11b0 0x7fe45c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:45.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.047+0000 7fe469ffb700 1 -- 172.21.15.83:0/3495290477 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fe4600cc310 con 0x7fe46c0ffb60 2024-04-01T06:55:45.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.047+0000 7fe46bfff700 1 --2- 172.21.15.83:0/3495290477 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fe45c0a11b0 0x7fe45c0a3670 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe458006fd0 tx=0x7fe458008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:45.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.051+0000 7fe469ffb700 1 -- 172.21.15.83:0/3495290477 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7fe460095b70 con 0x7fe46c0ffb60 2024-04-01T06:55:45.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:44 smithi153 ceph-mon[48187]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-01T06:55:45.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:44 smithi153 ceph-mon[48187]: pgmap v256: 97 pgs: 97 active+clean; 645 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 921 B/s wr, 6 op/s; 0 B/s, 0 objects/s recovering 2024-04-01T06:55:45.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:44 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/1631990982' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-01T06:55:45.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:44 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/4278567652' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-01T06:55:45.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:44 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/847363491' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-01T06:55:45.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.256+0000 7fe4730c2700 1 -- 172.21.15.83:0/3495290477 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe46c10b490 con 0x7fe46c0ffb60 2024-04-01T06:55:45.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.258+0000 7fe469ffb700 1 -- 172.21.15.83:0/3495290477 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+22425 (secure 0 0 0) 0x7fe460099190 con 0x7fe46c0ffb60 2024-04-01T06:55:45.258 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:55:45.258 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":81,"fsid":"c6f8eff4-eff3-11ee-b647-cb9ed24678a4","created":"2024-04-01T06:48:42.033382+0000","modified":"2024-04-01T06:55:34.704509+0000","last_up_change":"2024-04-01T06:53:55.791339+0000","last_in_change":"2024-04-01T06:53:39.777214+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T06:51:21.963996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T06:54:26.450403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T06:54:27.564928+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"90b761b0-b06c-4142-854d-38ee42aa6052","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6803","nonce":3253845390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6805","nonce":3253845390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6809","nonce":3253845390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6807","nonce":3253845390}]},"public_addr":"172.21.15.83:6803/3253845390","cluster_addr":"172.21.15.83:6805/3253845390","heartbeat_back_addr":"172.21.15.83:6809/3253845390","heartbeat_front_addr":"172.21.15.83:6807/3253845390","state":["exists","up"]},{"osd":1,"uuid":"4d6ab85b-7088-451e-a829-c9119f35dee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6801","nonce":515889759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6803","nonce":515889759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6807","nonce":515889759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6805","nonce":515889759}]},"public_addr":"172.21.15.145:6801/515889759","cluster_addr":"172.21.15.145:6803/515889759","heartbeat_back_addr":"172.21.15.145:6807/515889759","heartbeat_front_addr":"172.21.15.145:6805/515889759","state":["exists","up"]},{"osd":2,"uuid":"d04c27f3-4972-4061-8bfb-5060645e3883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6801","nonce":3318516728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6803","nonce":3318516728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6807","nonce":3318516728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6805","nonce":3318516728}]},"public_addr":"172.21.15.153:6801/3318516728","cluster_addr":"172.21.15.153:6803/3318516728","heartbeat_back_addr":"172.21.15.153:6807/3318516728","heartbeat_front_addr":"172.21.15.153:6805/3318516728","state":["exists","up"]},{"osd":3,"uuid":"899b6c90-8f2f-44dd-b807-49594aadb443","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6811","nonce":504690234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6813","nonce":504690234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6817","nonce":504690234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6815","nonce":504690234}]},"public_addr":"172.21.15.83:6811/504690234","cluster_addr":"172.21.15.83:6813/504690234","heartbeat_back_addr":"172.21.15.83:6817/504690234","heartbeat_front_addr":"172.21.15.83:6815/504690234","state":["exists","up"]},{"osd":4,"uuid":"5071dd81-804e-4358-bfb6-11e718e9cf4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6809","nonce":2099824730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6811","nonce":2099824730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6815","nonce":2099824730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6813","nonce":2099824730}]},"public_addr":"172.21.15.145:6809/2099824730","cluster_addr":"172.21.15.145:6811/2099824730","heartbeat_back_addr":"172.21.15.145:6815/2099824730","heartbeat_front_addr":"172.21.15.145:6813/2099824730","state":["exists","up"]},{"osd":5,"uuid":"b8442b71-c26e-467f-b0c3-ea9f636f5a00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6809","nonce":3340941443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6811","nonce":3340941443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6815","nonce":3340941443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6813","nonce":3340941443}]},"public_addr":"172.21.15.153:6809/3340941443","cluster_addr":"172.21.15.153:6811/3340941443","heartbeat_back_addr":"172.21.15.153:6815/3340941443","heartbeat_front_addr":"172.21.15.153:6813/3340941443","state":["exists","up"]},{"osd":6,"uuid":"c26bb8cb-ccee-4bfc-91eb-14e1ad8e04df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6819","nonce":2005485079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6821","nonce":2005485079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6825","nonce":2005485079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6823","nonce":2005485079}]},"public_addr":"172.21.15.83:6819/2005485079","cluster_addr":"172.21.15.83:6821/2005485079","heartbeat_back_addr":"172.21.15.83:6825/2005485079","heartbeat_front_addr":"172.21.15.83:6823/2005485079","state":["exists","up"]},{"osd":7,"uuid":"a8940da2-0e79-4606-8d1e-d425afbf5753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6817","nonce":3737505059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6819","nonce":3737505059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6823","nonce":3737505059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6821","nonce":3737505059}]},"public_addr":"172.21.15.145:6817/3737505059","cluster_addr":"172.21.15.145:6819/3737505059","heartbeat_back_addr":"172.21.15.145:6823/3737505059","heartbeat_front_addr":"172.21.15.145:6821/3737505059","state":["exists","up"]},{"osd":8,"uuid":"602d43ac-a189-4da3-9e38-7025d14e0dd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6817","nonce":1031545791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6819","nonce":1031545791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6823","nonce":1031545791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6821","nonce":1031545791}]},"public_addr":"172.21.15.153:6817/1031545791","cluster_addr":"172.21.15.153:6819/1031545791","heartbeat_back_addr":"172.21.15.153:6823/1031545791","heartbeat_front_addr":"172.21.15.153:6821/1031545791","state":["exists","up"]},{"osd":9,"uuid":"08b12d27-1247-45e4-9d09-cacc0fce4bd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6827","nonce":3720996673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6829","nonce":3720996673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6833","nonce":3720996673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6831","nonce":3720996673}]},"public_addr":"172.21.15.83:6827/3720996673","cluster_addr":"172.21.15.83:6829/3720996673","heartbeat_back_addr":"172.21.15.83:6833/3720996673","heartbeat_front_addr":"172.21.15.83:6831/3720996673","state":["exists","up"]},{"osd":10,"uuid":"dd986b50-d68f-446c-9c66-261535880879","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6825","nonce":2671529479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6827","nonce":2671529479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6831","nonce":2671529479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6829","nonce":2671529479}]},"public_addr":"172.21.15.145:6825/2671529479","cluster_addr":"172.21.15.145:6827/2671529479","heartbeat_back_addr":"172.21.15.145:6831/2671529479","heartbeat_front_addr":"172.21.15.145:6829/2671529479","state":["exists","up"]},{"osd":11,"uuid":"d20a49cd-6224-4424-8375-46da791d9931","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6825","nonce":2342548429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6827","nonce":2342548429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6831","nonce":2342548429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6829","nonce":2342548429}]},"public_addr":"172.21.15.153:6825/2342548429","cluster_addr":"172.21.15.153:6827/2342548429","heartbeat_back_addr":"172.21.15.153:6831/2342548429","heartbeat_front_addr":"172.21.15.153:6829/2342548429","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:50:44.539932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:01.990470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:19.054426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:36.616393+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:53.896705+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:10.667502+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:27.880849+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:45.276308+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:02.280615+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:19.555547+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:37.062881+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:54.191589+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.83:6801/1867137261":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/2596683931":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/2125339627":"2024-04-02T06:49:33.656125+0000","172.21.15.83:6800/1644397953":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/690500472":"2024-04-02T06:49:13.456026+0000","172.21.15.83:6801/1644397953":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/785958951":"2024-04-02T06:49:33.656125+0000","172.21.15.83:6800/1867137261":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/2222527447":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/2071592157":"2024-04-02T06:49:13.456026+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T06:55:45.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.260+0000 7fe4730c2700 1 -- 172.21.15.83:0/3495290477 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fe45c0a11b0 msgr2=0x7fe45c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:45.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.260+0000 7fe4730c2700 1 --2- 172.21.15.83:0/3495290477 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fe45c0a11b0 0x7fe45c0a3670 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe458006fd0 tx=0x7fe458008040 comp rx=0 tx=0).stop 2024-04-01T06:55:45.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.260+0000 7fe4730c2700 1 -- 172.21.15.83:0/3495290477 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe46c0ffb60 msgr2=0x7fe46c196e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:45.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.260+0000 7fe4730c2700 1 --2- 172.21.15.83:0/3495290477 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe46c0ffb60 0x7fe46c196e90 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fe46000b500 tx=0x7fe46000b8c0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.260+0000 7fe4730c2700 1 -- 172.21.15.83:0/3495290477 shutdown_connections 2024-04-01T06:55:45.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.260+0000 7fe4730c2700 1 --2- 172.21.15.83:0/3495290477 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe46c0ffb60 0x7fe46c196e90 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.260+0000 7fe4730c2700 1 --2- 172.21.15.83:0/3495290477 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fe45c0a11b0 0x7fe45c0a3670 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.260+0000 7fe4730c2700 1 --2- 172.21.15.83:0/3495290477 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe46c1016f0 0x7fe46c19e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.260+0000 7fe4730c2700 1 --2- 172.21.15.83:0/3495290477 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe46c100d50 0x7fe46c1973d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.260+0000 7fe4730c2700 1 -- 172.21.15.83:0/3495290477 >> 172.21.15.83:0/3495290477 conn(0x7fe46c0fb0d0 msgr2=0x7fe46c067e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:45.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.260+0000 7fe4730c2700 1 -- 172.21.15.83:0/3495290477 shutdown_connections 2024-04-01T06:55:45.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.260+0000 7fe4730c2700 1 -- 172.21.15.83:0/3495290477 wait complete. 2024-04-01T06:55:45.273 DEBUG:tasks.fwd_scrub:Yielding 2024-04-01T06:55:45.273 INFO:teuthology.run_tasks:Running task exec... 2024-04-01T06:55:45.283 INFO:teuthology.task.exec:Executing custom commands... 2024-04-01T06:55:45.283 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi083.front.sepia.ceph.com 2024-04-01T06:55:45.284 DEBUG:teuthology.orchestra.run.smithi083:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-04-01T06:55:45.284 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-04-01T06:55:45.284 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-01T06:55:45.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T06:55:45.285 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-01T06:55:45.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.417+0000 7f22f0adb700 1 -- 172.21.15.83:0/1452632375 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22ec101820 msgr2=0x7f22ec103c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:45.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.417+0000 7f22f0adb700 1 --2- 172.21.15.83:0/1452632375 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22ec101820 0x7f22ec103c10 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f22dc009990 tx=0x7f22dc009ca0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.417+0000 7f22f0adb700 1 -- 172.21.15.83:0/1452632375 shutdown_connections 2024-04-01T06:55:45.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.417+0000 7f22f0adb700 1 --2- 172.21.15.83:0/1452632375 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22ec101820 0x7f22ec103c10 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.417+0000 7f22f0adb700 1 --2- 172.21.15.83:0/1452632375 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f22ec106a80 0x7f22ec108e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.417+0000 7f22f0adb700 1 --2- 172.21.15.83:0/1452632375 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22ec104150 0x7f22ec106540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.417+0000 7f22f0adb700 1 -- 172.21.15.83:0/1452632375 >> 172.21.15.83:0/1452632375 conn(0x7f22ec0fb170 msgr2=0x7f22ec0fd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:45.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.417+0000 7f22f0adb700 1 -- 172.21.15.83:0/1452632375 shutdown_connections 2024-04-01T06:55:45.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.417+0000 7f22f0adb700 1 -- 172.21.15.83:0/1452632375 wait complete. 2024-04-01T06:55:45.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.418+0000 7f22f0adb700 1 Processor -- start 2024-04-01T06:55:45.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.418+0000 7f22f0adb700 1 -- start start 2024-04-01T06:55:45.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.418+0000 7f22f0adb700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22ec101820 0x7f22ec101140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:45.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.418+0000 7f22f0adb700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f22ec104150 0x7f22ec0ff7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:45.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.418+0000 7f22f0adb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22ec106a80 0x7f22ec0ffd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:45.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.418+0000 7f22f0adb700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ec19ab10 con 0x7f22ec101820 2024-04-01T06:55:45.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.418+0000 7f22f0adb700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ec100250 con 0x7f22ec104150 2024-04-01T06:55:45.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.418+0000 7f22f0adb700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ec100410 con 0x7f22ec106a80 2024-04-01T06:55:45.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.418+0000 7f22ea59c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22ec101820 0x7f22ec101140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:45.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.418+0000 7f22ea59c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22ec101820 0x7f22ec101140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:34580/0 (socket says 172.21.15.83:34580) 2024-04-01T06:55:45.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.418+0000 7f22ea59c700 1 -- 172.21.15.83:0/3073377206 learned_addr learned my addr 172.21.15.83:0/3073377206 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:45.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.418+0000 7f22ead9d700 1 --2- 172.21.15.83:0/3073377206 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22ec106a80 0x7f22ec0ffd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:45.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.418+0000 7f22ea59c700 1 -- 172.21.15.83:0/3073377206 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22ec106a80 msgr2=0x7f22ec0ffd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:45.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.418+0000 7f22ea59c700 1 --2- 172.21.15.83:0/3073377206 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22ec106a80 0x7f22ec0ffd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.418+0000 7f22ea59c700 1 -- 172.21.15.83:0/3073377206 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f22ec104150 msgr2=0x7f22ec0ff7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:45.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.418+0000 7f22ea59c700 1 --2- 172.21.15.83:0/3073377206 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f22ec104150 0x7f22ec0ff7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.419+0000 7f22ea59c700 1 -- 172.21.15.83:0/3073377206 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22dc0095f0 con 0x7f22ec101820 2024-04-01T06:55:45.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.419+0000 7f22ea59c700 1 --2- 172.21.15.83:0/3073377206 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22ec101820 0x7f22ec101140 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f22dc006010 tx=0x7f22dc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:45.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.419+0000 7f22db7fe700 1 -- 172.21.15.83:0/3073377206 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22dc01d070 con 0x7f22ec101820 2024-04-01T06:55:45.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.419+0000 7f22db7fe700 1 -- 172.21.15.83:0/3073377206 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f22dc0054f0 con 0x7f22ec101820 2024-04-01T06:55:45.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.419+0000 7f22db7fe700 1 -- 172.21.15.83:0/3073377206 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22dc004ca0 con 0x7f22ec101820 2024-04-01T06:55:45.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.419+0000 7f22f0adb700 1 -- 172.21.15.83:0/3073377206 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22ec100630 con 0x7f22ec101820 2024-04-01T06:55:45.421 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.419+0000 7f22f0adb700 1 -- 172.21.15.83:0/3073377206 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22ec1a5750 con 0x7f22ec101820 2024-04-01T06:55:45.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.420+0000 7f1b9ac15700 1 -- 172.21.15.83:0/1234249194 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1b94100f70 msgr2=0x7f1b94107820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:45.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.420+0000 7f1b9ac15700 1 --2- 172.21.15.83:0/1234249194 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1b94100f70 0x7f1b94107820 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c00b0a0 tx=0x7f1b8c00b3b0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.420+0000 7f1b9ac15700 1 -- 172.21.15.83:0/1234249194 shutdown_connections 2024-04-01T06:55:45.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.420+0000 7f1b9ac15700 1 --2- 172.21.15.83:0/1234249194 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1b94100f70 0x7f1b94107820 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.420+0000 7f1b9ac15700 1 --2- 172.21.15.83:0/1234249194 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b940ff3e0 0x7f1b940ff800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.420+0000 7f1b9ac15700 1 --2- 172.21.15.83:0/1234249194 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b941005d0 0x7f1b94100a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.420+0000 7f1b9ac15700 1 -- 172.21.15.83:0/1234249194 >> 172.21.15.83:0/1234249194 conn(0x7f1b940fa950 msgr2=0x7f1b940fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:45.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.420+0000 7f1b9ac15700 1 -- 172.21.15.83:0/1234249194 shutdown_connections 2024-04-01T06:55:45.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.420+0000 7f1b9ac15700 1 -- 172.21.15.83:0/1234249194 wait complete. 2024-04-01T06:55:45.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.420+0000 7f22f0adb700 1 -- 172.21.15.83:0/3073377206 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22ec0fccf0 con 0x7f22ec101820 2024-04-01T06:55:45.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.420+0000 7f1b9ac15700 1 Processor -- start 2024-04-01T06:55:45.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.420+0000 7f1b9ac15700 1 -- start start 2024-04-01T06:55:45.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.421+0000 7f1b9ac15700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b940ff3e0 0x7f1b9410a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:45.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.421+0000 7f1b9ac15700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1b941005d0 0x7f1b94109030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:45.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.421+0000 7f1b9ac15700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b94100f70 0x7f1b94109570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:45.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.421+0000 7f1b9ac15700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b94109d10 con 0x7f1b941005d0 2024-04-01T06:55:45.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.421+0000 7f1b9ac15700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b94109e80 con 0x7f1b940ff3e0 2024-04-01T06:55:45.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.421+0000 7f1b9ac15700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b941a0e60 con 0x7f1b94100f70 2024-04-01T06:55:45.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.421+0000 7f1b93fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1b941005d0 0x7f1b94109030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:45.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.421+0000 7f1b93fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1b941005d0 0x7f1b94109030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:34604/0 (socket says 172.21.15.83:34604) 2024-04-01T06:55:45.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.421+0000 7f1b93fff700 1 -- 172.21.15.83:0/644335367 learned_addr learned my addr 172.21.15.83:0/644335367 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:45.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.421+0000 7f1b991b2700 1 --2- 172.21.15.83:0/644335367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b94100f70 0x7f1b94109570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:45.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.421+0000 7f1b989b1700 1 --2- 172.21.15.83:0/644335367 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b940ff3e0 0x7f1b9410a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:45.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.421+0000 7f1b93fff700 1 -- 172.21.15.83:0/644335367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b94100f70 msgr2=0x7f1b94109570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:45.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.421+0000 7f1b93fff700 1 --2- 172.21.15.83:0/644335367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b94100f70 0x7f1b94109570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.421+0000 7f1b93fff700 1 -- 172.21.15.83:0/644335367 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b940ff3e0 msgr2=0x7f1b9410a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:45.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.421+0000 7f1b93fff700 1 --2- 172.21.15.83:0/644335367 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b940ff3e0 0x7f1b9410a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.421+0000 7f1b93fff700 1 -- 172.21.15.83:0/644335367 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b8c009d00 con 0x7f1b941005d0 2024-04-01T06:55:45.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.421+0000 7f1b989b1700 1 --2- 172.21.15.83:0/644335367 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b940ff3e0 0x7f1b9410a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:55:45.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.421+0000 7f1b93fff700 1 --2- 172.21.15.83:0/644335367 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1b941005d0 0x7f1b94109030 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f1b8000e9a0 tx=0x7f1b8000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:45.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.421+0000 7f1b91ffb700 1 -- 172.21.15.83:0/644335367 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b80009790 con 0x7f1b941005d0 2024-04-01T06:55:45.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.421+0000 7f1b9ac15700 1 -- 172.21.15.83:0/644335367 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b941a10f0 con 0x7f1b941005d0 2024-04-01T06:55:45.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.421+0000 7f1b91ffb700 1 -- 172.21.15.83:0/644335367 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1b8000cb70 con 0x7f1b941005d0 2024-04-01T06:55:45.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.421+0000 7f1b91ffb700 1 -- 172.21.15.83:0/644335367 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b80010ea0 con 0x7f1b941005d0 2024-04-01T06:55:45.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.422+0000 7f22db7fe700 1 -- 172.21.15.83:0/3073377206 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f22dc00fb80 con 0x7f22ec101820 2024-04-01T06:55:45.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.422+0000 7f22db7fe700 1 --2- 172.21.15.83:0/3073377206 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f22d40a1230 0x7f22d40a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:45.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.422+0000 7f22e9d9b700 1 --2- 172.21.15.83:0/3073377206 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f22d40a1230 0x7f22d40a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:45.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.422+0000 7f22db7fe700 1 -- 172.21.15.83:0/3073377206 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f22dc0cd9b0 con 0x7f22ec101820 2024-04-01T06:55:45.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.422+0000 7f1b9ac15700 1 -- 172.21.15.83:0/644335367 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b941a1650 con 0x7f1b941005d0 2024-04-01T06:55:45.428 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.423+0000 7f22e9d9b700 1 --2- 172.21.15.83:0/3073377206 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f22d40a1230 0x7f22d40a36f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f22e0005950 tx=0x7f22e00058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:45.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.425+0000 7f1b91ffb700 1 -- 172.21.15.83:0/644335367 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7f1b8000cce0 con 0x7f1b941005d0 2024-04-01T06:55:45.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.426+0000 7f1ba6dabb80 1 Processor -- start 2024-04-01T06:55:45.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.426+0000 7f1ba6dabb80 1 -- start start 2024-04-01T06:55:45.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.426+0000 7f1ba6dabb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5638e0cf9850 0x5638e0cf9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:45.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.426+0000 7f1ba6dabb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5638e0cfa1b0 0x5638e0cfaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:45.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.426+0000 7f1ba6dabb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638e0cfb050 0x5638e0cfb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:45.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.426+0000 7f1ba6dabb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638e0c51a10 con 0x5638e0cf9850 2024-04-01T06:55:45.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.426+0000 7f1ba6dabb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638e0c4f3d0 con 0x5638e0cfb050 2024-04-01T06:55:45.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.426+0000 7f1ba6dabb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638e0c4acc0 con 0x5638e0cfa1b0 2024-04-01T06:55:45.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.426+0000 7f1b991b2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5638e0cf9850 0x5638e0cf9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:45.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.426+0000 7f1b991b2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5638e0cf9850 0x5638e0cf9c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:34616/0 (socket says 172.21.15.83:34616) 2024-04-01T06:55:45.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.426+0000 7f1b991b2700 1 -- 172.21.15.83:0/2262530413 learned_addr learned my addr 172.21.15.83:0/2262530413 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:45.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.426+0000 7f1b91ffb700 1 --2- 172.21.15.83:0/644335367 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f1b840a11b0 0x7f1b840a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:45.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.426+0000 7f1b989b1700 1 --2- 172.21.15.83:0/2262530413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5638e0cfa1b0 0x5638e0cfaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:45.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.426+0000 7f1b93fff700 1 --2- 172.21.15.83:0/2262530413 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638e0cfb050 0x5638e0cfb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:45.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.426+0000 7f1b991b2700 1 -- 172.21.15.83:0/2262530413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5638e0cfa1b0 msgr2=0x5638e0cfaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:45.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.426+0000 7f1b991b2700 1 --2- 172.21.15.83:0/2262530413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5638e0cfa1b0 0x5638e0cfaa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.426+0000 7f1b991b2700 1 -- 172.21.15.83:0/2262530413 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638e0cfb050 msgr2=0x5638e0cfb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:45.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.427+0000 7f1b991b2700 1 --2- 172.21.15.83:0/2262530413 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638e0cfb050 0x5638e0cfb4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.427+0000 7f1b991b2700 1 -- 172.21.15.83:0/2262530413 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5638e0acc430 con 0x5638e0cf9850 2024-04-01T06:55:45.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.427+0000 7f1b93fff700 1 --2- 172.21.15.83:0/2262530413 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638e0cfb050 0x5638e0cfb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:55:45.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.427+0000 7f1b991b2700 1 --2- 172.21.15.83:0/644335367 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f1b840a11b0 0x7f1b840a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:45.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.427+0000 7f1b991b2700 1 --2- 172.21.15.83:0/2262530413 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5638e0cf9850 0x5638e0cf9c70 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c015000 tx=0x7f1b8c009c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=496c1442079cf2fd server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:45.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.427+0000 7f1b991b2700 1 --2- 172.21.15.83:0/644335367 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f1b840a11b0 0x7f1b840a3670 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c02a000 tx=0x7f1b8c027000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:45.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.428+0000 7f1b91ffb700 1 -- 172.21.15.83:0/644335367 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f1b80014070 con 0x7f1b941005d0 2024-04-01T06:55:45.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.428+0000 7f1b7effd700 1 -- 172.21.15.83:0/2262530413 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c00e040 con 0x5638e0cf9850 2024-04-01T06:55:45.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.428+0000 7f1b7effd700 1 -- 172.21.15.83:0/2262530413 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1b8c003c00 con 0x5638e0cf9850 2024-04-01T06:55:45.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.428+0000 7f1b7effd700 1 -- 172.21.15.83:0/2262530413 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c0286a0 con 0x5638e0cf9850 2024-04-01T06:55:45.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.428+0000 7f22db7fe700 1 -- 172.21.15.83:0/3073377206 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f22dc097190 con 0x7f22ec101820 2024-04-01T06:55:45.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.429+0000 7f1ba6dabb80 1 -- 172.21.15.83:0/2262530413 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5638e0cf9850 msgr2=0x5638e0cf9c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:45.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.429+0000 7f1ba6dabb80 1 --2- 172.21.15.83:0/2262530413 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5638e0cf9850 0x5638e0cf9c70 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c015000 tx=0x7f1b8c009c90 comp rx=0 tx=0).stop 2024-04-01T06:55:45.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.429+0000 7f1ba6dabb80 1 -- 172.21.15.83:0/2262530413 shutdown_connections 2024-04-01T06:55:45.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.429+0000 7f1ba6dabb80 1 --2- 172.21.15.83:0/2262530413 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5638e0cf9850 0x5638e0cf9c70 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.429+0000 7f1ba6dabb80 1 --2- 172.21.15.83:0/2262530413 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638e0cfb050 0x5638e0cfb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.429+0000 7f1ba6dabb80 1 --2- 172.21.15.83:0/2262530413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5638e0cfa1b0 0x5638e0cfaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.429+0000 7f1ba6dabb80 1 -- 172.21.15.83:0/2262530413 >> 172.21.15.83:0/2262530413 conn(0x5638e0c58720 msgr2=0x5638e0cf4a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:45.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.429+0000 7f1ba6dabb80 1 -- 172.21.15.83:0/2262530413 shutdown_connections 2024-04-01T06:55:45.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.429+0000 7f1ba6dabb80 1 -- 172.21.15.83:0/2262530413 wait complete. 2024-04-01T06:55:45.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.429+0000 7f1ba6dabb80 1 -- start start 2024-04-01T06:55:45.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.430+0000 7f1ba6dabb80 1 Processor -- start 2024-04-01T06:55:45.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.430+0000 7f1ba6dabb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638e0cf9850 0x5638e0d03720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:45.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.430+0000 7f1ba6dabb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5638e0cfa1b0 0x5638e0d03c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:45.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.430+0000 7f1ba6dabb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5638e0cfb050 0x5638e0d0ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:45.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.430+0000 7f1ba6dabb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638e0be6e00 con 0x5638e0cfa1b0 2024-04-01T06:55:45.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.430+0000 7f1ba6dabb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638e0be6aa0 con 0x5638e0cf9850 2024-04-01T06:55:45.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.430+0000 7f1ba6dabb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638e0ace720 con 0x5638e0cfb050 2024-04-01T06:55:45.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.430+0000 7f1ba6dabb80 10 client.0 _ll_register_callbacks cb 0x5638e0bf04f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:55:45.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.430+0000 7f1b93fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5638e0cfa1b0 0x5638e0d03c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:45.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.430+0000 7f1b93fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5638e0cfa1b0 0x5638e0d03c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:34624/0 (socket says 172.21.15.83:34624) 2024-04-01T06:55:45.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.430+0000 7f1b93fff700 1 -- 172.21.15.83:0/2961955593 learned_addr learned my addr 172.21.15.83:0/2961955593 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:45.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.430+0000 7f1b991b2700 1 --2- 172.21.15.83:0/2961955593 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5638e0cfb050 0x5638e0d0ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:45.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.430+0000 7f1b989b1700 1 --2- 172.21.15.83:0/2961955593 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638e0cf9850 0x5638e0d03720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:45.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.430+0000 7f1b93fff700 1 -- 172.21.15.83:0/2961955593 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5638e0cfb050 msgr2=0x5638e0d0ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:45.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.430+0000 7f1b93fff700 1 --2- 172.21.15.83:0/2961955593 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5638e0cfb050 0x5638e0d0ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.430+0000 7f1b93fff700 1 -- 172.21.15.83:0/2961955593 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638e0cf9850 msgr2=0x5638e0d03720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:45.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.430+0000 7f1b93fff700 1 --2- 172.21.15.83:0/2961955593 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638e0cf9850 0x5638e0d03720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.430+0000 7f1b93fff700 1 -- 172.21.15.83:0/2961955593 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b94067a50 con 0x5638e0cfa1b0 2024-04-01T06:55:45.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.431+0000 7f1b93fff700 1 --2- 172.21.15.83:0/2961955593 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5638e0cfa1b0 0x5638e0d03c60 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f1b800a2040 tx=0x7f1b8009a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30d24c49b9d7315 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:45.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.431+0000 7f1b73fff700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:55:45.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.431+0000 7f1b73fff700 1 -- 172.21.15.83:0/2961955593 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8009df20 con 0x5638e0cfa1b0 2024-04-01T06:55:45.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.431+0000 7f1ba6dabb80 1 -- 172.21.15.83:0/2961955593 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5638e0c0b400 con 0x5638e0cfa1b0 2024-04-01T06:55:45.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.431+0000 7f1b73fff700 1 -- 172.21.15.83:0/2961955593 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f1b800a2570 con 0x5638e0cfa1b0 2024-04-01T06:55:45.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.431+0000 7f1b73fff700 1 -- 172.21.15.83:0/2961955593 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1b800a20e0 con 0x5638e0cfa1b0 2024-04-01T06:55:45.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.431+0000 7f1ba6dabb80 10 client.15381 fetch_fsmap learned FSMap version 24 2024-04-01T06:55:45.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.431+0000 7f1ba6dabb80 1 -- 172.21.15.83:0/2961955593 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5638e0a78be0 con 0x5638e0cfa1b0 2024-04-01T06:55:45.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.431+0000 7f1b73fff700 1 -- 172.21.15.83:0/2961955593 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5638e0c0b400 con 0x5638e0cfa1b0 2024-04-01T06:55:45.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.431+0000 7f1b73fff700 1 -- 172.21.15.83:0/2961955593 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f1b80099050 con 0x5638e0cfa1b0 2024-04-01T06:55:45.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.431+0000 7f1ba6dabb80 10 client.15381 fetch_fsmap finished waiting for FSMap version 24 2024-04-01T06:55:45.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.431+0000 7f1ba6dabb80 10 client.15381 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-01T06:55:45.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.431+0000 7f1ba6dabb80 20 client.15381 populate_metadata read hostname 'smithi083' 2024-04-01T06:55:45.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.431+0000 7f1ba6dabb80 1 --2- 172.21.15.83:0/2961955593 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5638e0d0f340 0x5638e0d11760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:45.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.431+0000 7f1ba6dabb80 4 client.15381 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-01T06:55:45.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.431+0000 7f1ba6dabb80 1 -- 172.21.15.83:0/2961955593 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5638e0c43780 con 0x5638e0d0f340 2024-04-01T06:55:45.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.432+0000 7f1b989b1700 1 --2- 172.21.15.83:0/2961955593 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5638e0d0f340 0x5638e0d11760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:45.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.432+0000 7f1b73fff700 10 client.15381 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:55:45.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.432+0000 7f1b989b1700 1 --2- 172.21.15.83:0/2961955593 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5638e0d0f340 0x5638e0d11760 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f87e5b987d6a5b4 server_cookie=6336cfb4ba2315b0 in_seq=0 out_seq=0 2024-04-01T06:55:45.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.433+0000 7f1b73fff700 1 -- 172.21.15.83:0/2961955593 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5638e0c43780 con 0x5638e0d0f340 2024-04-01T06:55:45.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.433+0000 7f1b73fff700 10 client.15381 handle_command_reply: tid=0 2024-04-01T06:55:45.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.433+0000 7f1ba6dabb80 1 client.15381 shutdown 2024-04-01T06:55:45.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.433+0000 7f1ba6dabb80 1 -- 172.21.15.83:0/2961955593 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5638e0cfa1b0 msgr2=0x5638e0d03c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:45.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.433+0000 7f1ba6dabb80 1 --2- 172.21.15.83:0/2961955593 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5638e0cfa1b0 0x5638e0d03c60 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f1b800a2040 tx=0x7f1b8009a630 comp rx=0 tx=0).stop 2024-04-01T06:55:45.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.433+0000 7f1ba6dabb80 1 -- 172.21.15.83:0/2961955593 shutdown_connections 2024-04-01T06:55:45.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.433+0000 7f1ba6dabb80 1 --2- 172.21.15.83:0/2961955593 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5638e0d0f340 0x5638e0d11760 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.433+0000 7f1ba6dabb80 1 --2- 172.21.15.83:0/2961955593 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5638e0cfb050 0x5638e0d0ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.433+0000 7f1b73fff700 0 client.15381 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:55:45.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.433+0000 7f1ba6dabb80 1 --2- 172.21.15.83:0/2961955593 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638e0cf9850 0x5638e0d03720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.433+0000 7f1ba6dabb80 1 --2- 172.21.15.83:0/2961955593 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5638e0cfa1b0 0x5638e0d03c60 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.433+0000 7f1ba6dabb80 1 -- 172.21.15.83:0/2961955593 >> 172.21.15.83:0/2961955593 conn(0x5638e0c58720 msgr2=0x5638e0cf81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:45.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.433+0000 7f1ba6dabb80 1 -- 172.21.15.83:0/2961955593 shutdown_connections 2024-04-01T06:55:45.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.433+0000 7f1ba6dabb80 1 -- 172.21.15.83:0/2961955593 wait complete. 2024-04-01T06:55:45.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.433+0000 7f1ba6dabb80 20 client.15381 trim_cache size 0 max 16384 2024-04-01T06:55:45.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.450+0000 7f1ba6dabb80 1 Processor -- start 2024-04-01T06:55:45.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.450+0000 7f1ba6dabb80 1 -- start start 2024-04-01T06:55:45.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.450+0000 7f1ba6dabb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5638e0cf9850 0x5638e0d03720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:45.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.450+0000 7f1ba6dabb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638e0cfa1b0 0x5638e0d0abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:45.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.450+0000 7f1ba6dabb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5638e0cfb050 0x5638e0cf4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:45.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.450+0000 7f1ba6dabb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638e0c0b400 con 0x5638e0cf9850 2024-04-01T06:55:45.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.450+0000 7f1ba6dabb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638e0cf5530 con 0x5638e0cfa1b0 2024-04-01T06:55:45.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.450+0000 7f1ba6dabb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638e0cfaed0 con 0x5638e0cfb050 2024-04-01T06:55:45.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.450+0000 7f1b989b1700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5638e0cf9850 0x5638e0d03720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:45.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.450+0000 7f1b989b1700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5638e0cf9850 0x5638e0d03720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:34634/0 (socket says 172.21.15.83:34634) 2024-04-01T06:55:45.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.450+0000 7f1b989b1700 1 -- 172.21.15.83:0/4003955698 learned_addr learned my addr 172.21.15.83:0/4003955698 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:45.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.450+0000 7f1b991b2700 1 --2- 172.21.15.83:0/4003955698 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5638e0cfb050 0x5638e0cf4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:45.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.450+0000 7f1b93fff700 1 --2- 172.21.15.83:0/4003955698 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638e0cfa1b0 0x5638e0d0abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:45.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.450+0000 7f1b989b1700 1 -- 172.21.15.83:0/4003955698 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5638e0cfb050 msgr2=0x5638e0cf4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:45.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.450+0000 7f1b989b1700 1 --2- 172.21.15.83:0/4003955698 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5638e0cfb050 0x5638e0cf4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.450+0000 7f1b989b1700 1 -- 172.21.15.83:0/4003955698 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638e0cfa1b0 msgr2=0x5638e0d0abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:45.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.450+0000 7f1b989b1700 1 --2- 172.21.15.83:0/4003955698 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638e0cfa1b0 0x5638e0d0abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.450+0000 7f1b989b1700 1 -- 172.21.15.83:0/4003955698 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5638e0c10f20 con 0x5638e0cf9850 2024-04-01T06:55:45.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.450+0000 7f1b93fff700 1 --2- 172.21.15.83:0/4003955698 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638e0cfa1b0 0x5638e0d0abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:55:45.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.450+0000 7f1b991b2700 1 --2- 172.21.15.83:0/4003955698 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5638e0cfb050 0x5638e0cf4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:55:45.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.450+0000 7f1b989b1700 1 --2- 172.21.15.83:0/4003955698 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5638e0cf9850 0x5638e0d03720 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x5638e0d12040 tx=0x7f1b8801dc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d98e6c7444ae66d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:45.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.451+0000 7f1b7f7fe700 1 -- 172.21.15.83:0/4003955698 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b88017040 con 0x5638e0cf9850 2024-04-01T06:55:45.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.451+0000 7f1b7f7fe700 1 -- 172.21.15.83:0/4003955698 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1b88021070 con 0x5638e0cf9850 2024-04-01T06:55:45.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.451+0000 7f1b7f7fe700 1 -- 172.21.15.83:0/4003955698 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b88003680 con 0x5638e0cf9850 2024-04-01T06:55:45.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.451+0000 7f1ba6dabb80 1 -- 172.21.15.83:0/4003955698 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5638e0cf9850 msgr2=0x5638e0d03720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:45.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.451+0000 7f1ba6dabb80 1 --2- 172.21.15.83:0/4003955698 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5638e0cf9850 0x5638e0d03720 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x5638e0d12040 tx=0x7f1b8801dc50 comp rx=0 tx=0).stop 2024-04-01T06:55:45.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.451+0000 7f1ba6dabb80 1 -- 172.21.15.83:0/4003955698 shutdown_connections 2024-04-01T06:55:45.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.451+0000 7f1ba6dabb80 1 --2- 172.21.15.83:0/4003955698 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5638e0cf9850 0x5638e0d03720 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.451+0000 7f1ba6dabb80 1 --2- 172.21.15.83:0/4003955698 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5638e0cfb050 0x5638e0cf4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.451+0000 7f1ba6dabb80 1 --2- 172.21.15.83:0/4003955698 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638e0cfa1b0 0x5638e0d0abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.451+0000 7f1ba6dabb80 1 -- 172.21.15.83:0/4003955698 >> 172.21.15.83:0/4003955698 conn(0x5638e0c58720 msgr2=0x5638e0d015c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:45.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.451+0000 7f1ba6dabb80 1 -- 172.21.15.83:0/4003955698 shutdown_connections 2024-04-01T06:55:45.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.451+0000 7f1ba6dabb80 1 -- 172.21.15.83:0/4003955698 wait complete. 2024-04-01T06:55:45.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.452+0000 7f1ba6dabb80 1 -- start start 2024-04-01T06:55:45.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.452+0000 7f1ba6dabb80 1 Processor -- start 2024-04-01T06:55:45.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.452+0000 7f1ba6dabb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5638e0cf9850 0x5638e0d5f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:45.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.452+0000 7f1ba6dabb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5638e0cfa1b0 0x5638e0d61880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:45.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.452+0000 7f1ba6dabb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638e0cfb050 0x5638e0d63dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:45.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.452+0000 7f1ba6dabb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638e0d64510 con 0x5638e0cfa1b0 2024-04-01T06:55:45.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.452+0000 7f1ba6dabb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638e0d64680 con 0x5638e0cfb050 2024-04-01T06:55:45.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.452+0000 7f1ba6dabb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638e0d64840 con 0x5638e0cf9850 2024-04-01T06:55:45.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.452+0000 7f1ba6dabb80 10 client.0 _ll_register_callbacks cb 0x5638e0bf04f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:55:45.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.452+0000 7f1b93fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5638e0cfa1b0 0x5638e0d61880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:45.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.452+0000 7f1b93fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5638e0cfa1b0 0x5638e0d61880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:34642/0 (socket says 172.21.15.83:34642) 2024-04-01T06:55:45.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.452+0000 7f1b93fff700 1 -- 172.21.15.83:0/1183192360 learned_addr learned my addr 172.21.15.83:0/1183192360 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:45.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.452+0000 7f1b991b2700 1 --2- 172.21.15.83:0/1183192360 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638e0cfb050 0x5638e0d63dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:45.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.452+0000 7f1b989b1700 1 --2- 172.21.15.83:0/1183192360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5638e0cf9850 0x5638e0d5f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:45.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.453+0000 7f1b93fff700 1 -- 172.21.15.83:0/1183192360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5638e0cf9850 msgr2=0x5638e0d5f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:45.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.453+0000 7f1b93fff700 1 --2- 172.21.15.83:0/1183192360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5638e0cf9850 0x5638e0d5f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.453+0000 7f1b93fff700 1 -- 172.21.15.83:0/1183192360 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638e0cfb050 msgr2=0x5638e0d63dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:45.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.453+0000 7f1b93fff700 1 --2- 172.21.15.83:0/1183192360 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638e0cfb050 0x5638e0d63dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.453+0000 7f1b93fff700 1 -- 172.21.15.83:0/1183192360 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b8800baf0 con 0x5638e0cfa1b0 2024-04-01T06:55:45.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.453+0000 7f1b989b1700 1 --2- 172.21.15.83:0/1183192360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5638e0cf9850 0x5638e0d5f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:55:45.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.453+0000 7f1b991b2700 1 --2- 172.21.15.83:0/1183192360 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638e0cfb050 0x5638e0d63dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:55:45.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.453+0000 7f1b93fff700 1 --2- 172.21.15.83:0/1183192360 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5638e0cfa1b0 0x5638e0d61880 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f1b8000c5b0 tx=0x7f1b800986a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cdd85c4737e00a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:45.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.453+0000 7f1b73fff700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:55:45.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.453+0000 7f1b73fff700 1 -- 172.21.15.83:0/1183192360 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b800a22e0 con 0x5638e0cfa1b0 2024-04-01T06:55:45.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.453+0000 7f1b73fff700 1 -- 172.21.15.83:0/1183192360 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f1b800a2570 con 0x5638e0cfa1b0 2024-04-01T06:55:45.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.453+0000 7f1ba6dabb80 1 -- 172.21.15.83:0/1183192360 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1b8c003c00 con 0x5638e0cfa1b0 2024-04-01T06:55:45.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.453+0000 7f1b73fff700 1 -- 172.21.15.83:0/1183192360 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1b800b84b0 con 0x5638e0cfa1b0 2024-04-01T06:55:45.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.453+0000 7f1ba6dabb80 10 client.15387 fetch_fsmap learned FSMap version 24 2024-04-01T06:55:45.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.453+0000 7f1ba6dabb80 1 -- 172.21.15.83:0/1183192360 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5638e0ad0d50 con 0x5638e0cfa1b0 2024-04-01T06:55:45.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.453+0000 7f1b73fff700 1 -- 172.21.15.83:0/1183192360 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1b800a6070 con 0x5638e0cfa1b0 2024-04-01T06:55:45.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.453+0000 7f1b73fff700 1 -- 172.21.15.83:0/1183192360 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f1b8009aa80 con 0x5638e0cfa1b0 2024-04-01T06:55:45.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.453+0000 7f1ba6dabb80 10 client.15387 fetch_fsmap finished waiting for FSMap version 24 2024-04-01T06:55:45.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.453+0000 7f1ba6dabb80 10 client.15387 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-01T06:55:45.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.453+0000 7f1ba6dabb80 20 client.15387 populate_metadata read hostname 'smithi083' 2024-04-01T06:55:45.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.453+0000 7f1ba6dabb80 1 --2- 172.21.15.83:0/1183192360 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5638e0d65e10 0x5638e0d68230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:45.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.453+0000 7f1ba6dabb80 4 client.15387 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-01T06:55:45.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.453+0000 7f1ba6dabb80 1 -- 172.21.15.83:0/1183192360 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5638e0a99d70 con 0x5638e0d65e10 2024-04-01T06:55:45.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.454+0000 7f1b989b1700 1 --2- 172.21.15.83:0/1183192360 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5638e0d65e10 0x5638e0d68230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:45.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.454+0000 7f1b989b1700 1 --2- 172.21.15.83:0/1183192360 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5638e0d65e10 0x5638e0d68230 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11f28af24d3695a9 server_cookie=d3cd8038e207a539 in_seq=0 out_seq=0 2024-04-01T06:55:45.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.454+0000 7f1b73fff700 10 client.15387 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:55:45.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.455+0000 7f1b73fff700 1 -- 172.21.15.83:0/1183192360 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5638e0a99d70 con 0x5638e0d65e10 2024-04-01T06:55:45.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.455+0000 7f1b73fff700 10 client.15387 handle_command_reply: tid=0 2024-04-01T06:55:45.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.455+0000 7f1ba6dabb80 1 client.15387 shutdown 2024-04-01T06:55:45.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.455+0000 7f1ba6dabb80 1 -- 172.21.15.83:0/1183192360 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5638e0cfa1b0 msgr2=0x5638e0d61880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:45.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.455+0000 7f1ba6dabb80 1 --2- 172.21.15.83:0/1183192360 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5638e0cfa1b0 0x5638e0d61880 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f1b8000c5b0 tx=0x7f1b800986a0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.455+0000 7f1ba6dabb80 1 -- 172.21.15.83:0/1183192360 shutdown_connections 2024-04-01T06:55:45.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.455+0000 7f1ba6dabb80 1 --2- 172.21.15.83:0/1183192360 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5638e0d65e10 0x5638e0d68230 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.455+0000 7f1ba6dabb80 1 --2- 172.21.15.83:0/1183192360 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5638e0cfb050 0x5638e0d63dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.455+0000 7f1ba6dabb80 1 --2- 172.21.15.83:0/1183192360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5638e0cf9850 0x5638e0d5f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.455+0000 7f1ba6dabb80 1 --2- 172.21.15.83:0/1183192360 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5638e0cfa1b0 0x5638e0d61880 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.455+0000 7f1ba6dabb80 1 -- 172.21.15.83:0/1183192360 >> 172.21.15.83:0/1183192360 conn(0x5638e0c58720 msgr2=0x5638e0d036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:45.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.456+0000 7f1b73fff700 0 client.15387 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:55:45.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.456+0000 7f1ba6dabb80 1 -- 172.21.15.83:0/1183192360 shutdown_connections 2024-04-01T06:55:45.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.456+0000 7f1ba6dabb80 1 -- 172.21.15.83:0/1183192360 wait complete. 2024-04-01T06:55:45.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.456+0000 7f1ba6dabb80 20 client.15387 trim_cache size 0 max 16384 2024-04-01T06:55:45.462 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-04-01T06:55:45.462 INFO:teuthology.orchestra.run.smithi083.stdout: "return_code": 0, 2024-04-01T06:55:45.462 INFO:teuthology.orchestra.run.smithi083.stdout: "scrub_tag": "008518ea-6250-4dac-b440-aeb5068180f3", 2024-04-01T06:55:45.462 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": "asynchronous" 2024-04-01T06:55:45.462 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-04-01T06:55:45.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.456+0000 7f1b9ac15700 1 -- 172.21.15.83:0/644335367 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f1b840a11b0 msgr2=0x7f1b840a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:45.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.456+0000 7f1b9ac15700 1 --2- 172.21.15.83:0/644335367 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f1b840a11b0 0x7f1b840a3670 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c02a000 tx=0x7f1b8c027000 comp rx=0 tx=0).stop 2024-04-01T06:55:45.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.456+0000 7f1b9ac15700 1 -- 172.21.15.83:0/644335367 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1b941005d0 msgr2=0x7f1b94109030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:45.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.456+0000 7f1b9ac15700 1 --2- 172.21.15.83:0/644335367 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1b941005d0 0x7f1b94109030 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f1b8000e9a0 tx=0x7f1b8000ecb0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.456+0000 7f1b9ac15700 1 -- 172.21.15.83:0/644335367 shutdown_connections 2024-04-01T06:55:45.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.456+0000 7f1b9ac15700 1 --2- 172.21.15.83:0/644335367 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f1b840a11b0 0x7f1b840a3670 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.456+0000 7f1b9ac15700 1 --2- 172.21.15.83:0/644335367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b94100f70 0x7f1b94109570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.456+0000 7f1b9ac15700 1 --2- 172.21.15.83:0/644335367 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b940ff3e0 0x7f1b9410a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.456+0000 7f1b9ac15700 1 --2- 172.21.15.83:0/644335367 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1b941005d0 0x7f1b94109030 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.456+0000 7f1b9ac15700 1 -- 172.21.15.83:0/644335367 >> 172.21.15.83:0/644335367 conn(0x7f1b940fa950 msgr2=0x7f1b941038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:45.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.456+0000 7f1b9ac15700 1 -- 172.21.15.83:0/644335367 shutdown_connections 2024-04-01T06:55:45.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.456+0000 7f1b9ac15700 1 -- 172.21.15.83:0/644335367 wait complete. 2024-04-01T06:55:45.469 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-01T06:55:45.469 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-01T06:55:45.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.596+0000 7faeb8667700 1 -- 172.21.15.83:0/1981122219 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faeb01041b0 msgr2=0x7faeb01065a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:45.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.596+0000 7faeb8667700 1 --2- 172.21.15.83:0/1981122219 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faeb01041b0 0x7faeb01065a0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7faea0009990 tx=0x7faea0009ca0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.596+0000 7faeb8667700 1 -- 172.21.15.83:0/1981122219 shutdown_connections 2024-04-01T06:55:45.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.596+0000 7faeb8667700 1 --2- 172.21.15.83:0/1981122219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faeb0106ae0 0x7faeb0108ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.596+0000 7faeb8667700 1 --2- 172.21.15.83:0/1981122219 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faeb0101880 0x7faeb0103c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.596+0000 7faeb8667700 1 --2- 172.21.15.83:0/1981122219 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faeb01041b0 0x7faeb01065a0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.596+0000 7faeb8667700 1 -- 172.21.15.83:0/1981122219 >> 172.21.15.83:0/1981122219 conn(0x7faeb00fb1d0 msgr2=0x7faeb00fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:45.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.596+0000 7faeb8667700 1 -- 172.21.15.83:0/1981122219 shutdown_connections 2024-04-01T06:55:45.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.596+0000 7faeb8667700 1 -- 172.21.15.83:0/1981122219 wait complete. 2024-04-01T06:55:45.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.597+0000 7faeb8667700 1 Processor -- start 2024-04-01T06:55:45.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.597+0000 7faeb8667700 1 -- start start 2024-04-01T06:55:45.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.597+0000 7faeb8667700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faeb0101880 0x7faeb01011a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:45.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.597+0000 7faeb8667700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faeb01041b0 0x7faeb00ff830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:45.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.597+0000 7faeb8667700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faeb0106ae0 0x7faeb00ffd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:45.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.597+0000 7faeb8667700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb0100510 con 0x7faeb0101880 2024-04-01T06:55:45.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.597+0000 7faeb8667700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb0100680 con 0x7faeb01041b0 2024-04-01T06:55:45.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.597+0000 7faeb8667700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb01a0d60 con 0x7faeb0106ae0 2024-04-01T06:55:45.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.597+0000 7faeb6403700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faeb0101880 0x7faeb01011a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:45.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.597+0000 7faeb6403700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faeb0101880 0x7faeb01011a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:34664/0 (socket says 172.21.15.83:34664) 2024-04-01T06:55:45.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.597+0000 7faeb6403700 1 -- 172.21.15.83:0/287237064 learned_addr learned my addr 172.21.15.83:0/287237064 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:45.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.597+0000 7faeb6c04700 1 --2- 172.21.15.83:0/287237064 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faeb0106ae0 0x7faeb00ffd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:45.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.597+0000 7faeb5c02700 1 --2- 172.21.15.83:0/287237064 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faeb01041b0 0x7faeb00ff830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:45.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.597+0000 7faeb6403700 1 -- 172.21.15.83:0/287237064 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faeb0106ae0 msgr2=0x7faeb00ffd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:45.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.597+0000 7faeb6403700 1 --2- 172.21.15.83:0/287237064 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faeb0106ae0 0x7faeb00ffd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.597+0000 7faeb6403700 1 -- 172.21.15.83:0/287237064 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faeb01041b0 msgr2=0x7faeb00ff830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:45.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.597+0000 7faeb6403700 1 --2- 172.21.15.83:0/287237064 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faeb01041b0 0x7faeb00ff830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.597+0000 7faeb6403700 1 -- 172.21.15.83:0/287237064 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea00095f0 con 0x7faeb0101880 2024-04-01T06:55:45.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.597+0000 7faeb6403700 1 --2- 172.21.15.83:0/287237064 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faeb0101880 0x7faeb01011a0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7faeac00e9a0 tx=0x7faeac00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:45.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.598+0000 7faea77fe700 1 -- 172.21.15.83:0/287237064 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeac009790 con 0x7faeb0101880 2024-04-01T06:55:45.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.598+0000 7faea77fe700 1 -- 172.21.15.83:0/287237064 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faeac00cb70 con 0x7faeb0101880 2024-04-01T06:55:45.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.598+0000 7faeb8667700 1 -- 172.21.15.83:0/287237064 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeb01a0ff0 con 0x7faeb0101880 2024-04-01T06:55:45.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.598+0000 7faea77fe700 1 -- 172.21.15.83:0/287237064 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeac010ea0 con 0x7faeb0101880 2024-04-01T06:55:45.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.598+0000 7faeb8667700 1 -- 172.21.15.83:0/287237064 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeb01a1420 con 0x7faeb0101880 2024-04-01T06:55:45.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.601+0000 7faea77fe700 1 -- 172.21.15.83:0/287237064 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) v1 ==== 135916+0+0 (secure 0 0 0) 0x7faeac00cce0 con 0x7faeb0101880 2024-04-01T06:55:45.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.601+0000 7faea77fe700 1 --2- 172.21.15.83:0/287237064 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fae9c0a1230 0x7fae9c0a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:45.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.601+0000 7faeb5c02700 1 --2- 172.21.15.83:0/287237064 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fae9c0a1230 0x7fae9c0a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:45.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.601+0000 7faea77fe700 1 -- 172.21.15.83:0/287237064 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8124+0+0 (secure 0 0 0) 0x7faeac014070 con 0x7faeb0101880 2024-04-01T06:55:45.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.602+0000 7faec47fdb80 1 Processor -- start 2024-04-01T06:55:45.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.602+0000 7faec47fdb80 1 -- start start 2024-04-01T06:55:45.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.602+0000 7faeb5c02700 1 --2- 172.21.15.83:0/287237064 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fae9c0a1230 0x7fae9c0a36f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7faea000b7b0 tx=0x7faea0005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:45.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.602+0000 7faec47fdb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561409b2e7d0 0x561409b2ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:45.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.602+0000 7faec47fdb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561409b2f130 0x561409b2f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:45.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.602+0000 7faec47fdb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561409b2ffd0 0x561409b30450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:45.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.602+0000 7faec47fdb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x561409a86990 con 0x561409b2e7d0 2024-04-01T06:55:45.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.602+0000 7faec47fdb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x561409a84350 con 0x561409b2ffd0 2024-04-01T06:55:45.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.602+0000 7faec47fdb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x561409a7fc40 con 0x561409b2f130 2024-04-01T06:55:45.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.602+0000 7faeb6403700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561409b2e7d0 0x561409b2ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:45.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.602+0000 7faeb6403700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561409b2e7d0 0x561409b2ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:34668/0 (socket says 172.21.15.83:34668) 2024-04-01T06:55:45.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.602+0000 7faeb6403700 1 -- 172.21.15.83:0/4281099472 learned_addr learned my addr 172.21.15.83:0/4281099472 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:45.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.602+0000 7faeb6c04700 1 --2- 172.21.15.83:0/4281099472 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561409b2ffd0 0x561409b30450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:45.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.602+0000 7faeb5c02700 1 --2- 172.21.15.83:0/4281099472 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561409b2f130 0x561409b2f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:45.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.602+0000 7faeb6403700 1 -- 172.21.15.83:0/4281099472 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561409b2f130 msgr2=0x561409b2f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:45.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.602+0000 7faeb6403700 1 --2- 172.21.15.83:0/4281099472 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561409b2f130 0x561409b2f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.602+0000 7faeb6403700 1 -- 172.21.15.83:0/4281099472 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561409b2ffd0 msgr2=0x561409b30450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:45.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.602+0000 7faeb6403700 1 --2- 172.21.15.83:0/4281099472 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561409b2ffd0 0x561409b30450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.602+0000 7faeb6403700 1 -- 172.21.15.83:0/4281099472 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5614099013b0 con 0x561409b2e7d0 2024-04-01T06:55:45.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.603+0000 7faeb6c04700 1 --2- 172.21.15.83:0/4281099472 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561409b2ffd0 0x561409b30450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:55:45.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.603+0000 7faeb6403700 1 --2- 172.21.15.83:0/4281099472 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561409b2e7d0 0x561409b2ebf0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7faeac0a1e00 tx=0x7faeac099890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78ee5aeced6f958 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:45.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.603+0000 7faea4ff9700 1 -- 172.21.15.83:0/4281099472 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeac099eb0 con 0x561409b2e7d0 2024-04-01T06:55:45.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.603+0000 7faea4ff9700 1 -- 172.21.15.83:0/4281099472 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faeac09dce0 con 0x561409b2e7d0 2024-04-01T06:55:45.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.603+0000 7faea4ff9700 1 -- 172.21.15.83:0/4281099472 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeac0a2100 con 0x561409b2e7d0 2024-04-01T06:55:45.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.603+0000 7faec47fdb80 1 -- 172.21.15.83:0/4281099472 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561409b2e7d0 msgr2=0x561409b2ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:45.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.603+0000 7faec47fdb80 1 --2- 172.21.15.83:0/4281099472 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561409b2e7d0 0x561409b2ebf0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7faeac0a1e00 tx=0x7faeac099890 comp rx=0 tx=0).stop 2024-04-01T06:55:45.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.604+0000 7faec47fdb80 1 -- 172.21.15.83:0/4281099472 shutdown_connections 2024-04-01T06:55:45.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.604+0000 7faec47fdb80 1 --2- 172.21.15.83:0/4281099472 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561409b2e7d0 0x561409b2ebf0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.604+0000 7faec47fdb80 1 --2- 172.21.15.83:0/4281099472 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561409b2ffd0 0x561409b30450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.604+0000 7faec47fdb80 1 --2- 172.21.15.83:0/4281099472 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561409b2f130 0x561409b2f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.604+0000 7faec47fdb80 1 -- 172.21.15.83:0/4281099472 >> 172.21.15.83:0/4281099472 conn(0x561409a8d6a0 msgr2=0x561409b299a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:45.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.604+0000 7faec47fdb80 1 -- 172.21.15.83:0/4281099472 shutdown_connections 2024-04-01T06:55:45.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.604+0000 7faec47fdb80 1 -- 172.21.15.83:0/4281099472 wait complete. 2024-04-01T06:55:45.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.604+0000 7faec47fdb80 1 -- start start 2024-04-01T06:55:45.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.604+0000 7faec47fdb80 1 Processor -- start 2024-04-01T06:55:45.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.604+0000 7faec47fdb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561409b2e7d0 0x561409b38710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:45.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.604+0000 7faec47fdb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561409b2f130 0x561409b38c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:45.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.604+0000 7faec47fdb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561409b2ffd0 0x561409b3fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:45.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.604+0000 7faec47fdb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x561409a1bd80 con 0x561409b2e7d0 2024-04-01T06:55:45.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.604+0000 7faec47fdb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x561409a1ba20 con 0x561409b2f130 2024-04-01T06:55:45.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.604+0000 7faec47fdb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614099036a0 con 0x561409b2ffd0 2024-04-01T06:55:45.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.604+0000 7faec47fdb80 10 client.0 _ll_register_callbacks cb 0x561409a25470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:55:45.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.604+0000 7faeb6403700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561409b2e7d0 0x561409b38710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:45.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.604+0000 7faeb6403700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561409b2e7d0 0x561409b38710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:34684/0 (socket says 172.21.15.83:34684) 2024-04-01T06:55:45.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.604+0000 7faeb6403700 1 -- 172.21.15.83:0/1337303918 learned_addr learned my addr 172.21.15.83:0/1337303918 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:45.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.605+0000 7faeb6c04700 1 --2- 172.21.15.83:0/1337303918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561409b2ffd0 0x561409b3fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:45.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.605+0000 7faeb5c02700 1 --2- 172.21.15.83:0/1337303918 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561409b2f130 0x561409b38c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:45.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.605+0000 7faeb6403700 1 -- 172.21.15.83:0/1337303918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561409b2ffd0 msgr2=0x561409b3fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:45.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.605+0000 7faeb6403700 1 --2- 172.21.15.83:0/1337303918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561409b2ffd0 0x561409b3fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.605+0000 7faeb6403700 1 -- 172.21.15.83:0/1337303918 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561409b2f130 msgr2=0x561409b38c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:45.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.605+0000 7faeb6403700 1 --2- 172.21.15.83:0/1337303918 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561409b2f130 0x561409b38c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.605+0000 7faeb6403700 1 -- 172.21.15.83:0/1337303918 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeb01a1420 con 0x561409b2e7d0 2024-04-01T06:55:45.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.605+0000 7faeb6403700 1 --2- 172.21.15.83:0/1337303918 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561409b2e7d0 0x561409b38710 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7faeac09a510 tx=0x7faeac0ca4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5be5a82915738c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:45.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.605+0000 7fae99ffb700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:55:45.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.605+0000 7fae99ffb700 1 -- 172.21.15.83:0/1337303918 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeac0995f0 con 0x561409b2e7d0 2024-04-01T06:55:45.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.605+0000 7fae99ffb700 1 -- 172.21.15.83:0/1337303918 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8124+0+0 (secure 0 0 0) 0x7faeac099eb0 con 0x561409b2e7d0 2024-04-01T06:55:45.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.605+0000 7faec47fdb80 1 -- 172.21.15.83:0/1337303918 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561409a40380 con 0x561409b2e7d0 2024-04-01T06:55:45.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.605+0000 7fae99ffb700 1 -- 172.21.15.83:0/1337303918 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7faeac0b8180 con 0x561409b2e7d0 2024-04-01T06:55:45.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.605+0000 7faec47fdb80 10 client.15399 fetch_fsmap learned FSMap version 24 2024-04-01T06:55:45.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.605+0000 7faec47fdb80 1 -- 172.21.15.83:0/1337303918 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5614098adb60 con 0x561409b2e7d0 2024-04-01T06:55:45.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.605+0000 7fae99ffb700 1 -- 172.21.15.83:0/1337303918 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561409a40380 con 0x561409b2e7d0 2024-04-01T06:55:45.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.606+0000 7fae99ffb700 1 -- 172.21.15.83:0/1337303918 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7faeac094c80 con 0x561409b2e7d0 2024-04-01T06:55:45.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.606+0000 7faec47fdb80 10 client.15399 fetch_fsmap finished waiting for FSMap version 24 2024-04-01T06:55:45.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.606+0000 7faec47fdb80 10 client.15399 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-01T06:55:45.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.606+0000 7faec47fdb80 20 client.15399 populate_metadata read hostname 'smithi083' 2024-04-01T06:55:45.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.606+0000 7faec47fdb80 1 --2- 172.21.15.83:0/1337303918 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x561409b43ee0 0x561409b46300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:45.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.606+0000 7faec47fdb80 4 client.15399 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-01T06:55:45.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.606+0000 7faec47fdb80 1 -- 172.21.15.83:0/1337303918 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561409a78700 con 0x561409b43ee0 2024-04-01T06:55:45.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.606+0000 7faeb5c02700 1 --2- 172.21.15.83:0/1337303918 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x561409b43ee0 0x561409b46300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:45.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.606+0000 7fae99ffb700 10 client.15399 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:55:45.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.606+0000 7faeb5c02700 1 --2- 172.21.15.83:0/1337303918 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x561409b43ee0 0x561409b46300 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7112c9974c988886 server_cookie=a7b76a89568b9fd3 in_seq=0 out_seq=0 2024-04-01T06:55:45.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.607+0000 7fae99ffb700 1 -- 172.21.15.83:0/1337303918 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561409a78700 con 0x561409b43ee0 2024-04-01T06:55:45.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.607+0000 7fae99ffb700 10 client.15399 handle_command_reply: tid=0 2024-04-01T06:55:45.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.607+0000 7faec47fdb80 1 client.15399 shutdown 2024-04-01T06:55:45.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.607+0000 7faec47fdb80 1 -- 172.21.15.83:0/1337303918 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561409b2e7d0 msgr2=0x561409b38710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:45.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.607+0000 7faec47fdb80 1 --2- 172.21.15.83:0/1337303918 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561409b2e7d0 0x561409b38710 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7faeac09a510 tx=0x7faeac0ca4e0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.607+0000 7faec47fdb80 1 -- 172.21.15.83:0/1337303918 shutdown_connections 2024-04-01T06:55:45.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.607+0000 7faec47fdb80 1 --2- 172.21.15.83:0/1337303918 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x561409b43ee0 0x561409b46300 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.607+0000 7faec47fdb80 1 --2- 172.21.15.83:0/1337303918 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561409b2e7d0 0x561409b38710 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.607+0000 7faec47fdb80 1 --2- 172.21.15.83:0/1337303918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561409b2ffd0 0x561409b3fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.607+0000 7fae99ffb700 0 client.15399 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:55:45.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.607+0000 7faec47fdb80 1 --2- 172.21.15.83:0/1337303918 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561409b2f130 0x561409b38c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.607+0000 7faec47fdb80 1 -- 172.21.15.83:0/1337303918 >> 172.21.15.83:0/1337303918 conn(0x561409a8d6a0 msgr2=0x561409b2d170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:45.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.607+0000 7faec47fdb80 1 -- 172.21.15.83:0/1337303918 shutdown_connections 2024-04-01T06:55:45.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.607+0000 7faec47fdb80 1 -- 172.21.15.83:0/1337303918 wait complete. 2024-04-01T06:55:45.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.607+0000 7faec47fdb80 20 client.15399 trim_cache size 0 max 16384 2024-04-01T06:55:45.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.624+0000 7faec47fdb80 1 Processor -- start 2024-04-01T06:55:45.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.624+0000 7faec47fdb80 1 -- start start 2024-04-01T06:55:45.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.624+0000 7faec47fdb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561409b2e7d0 0x561409b28f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:45.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.624+0000 7faec47fdb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561409b2f130 0x561409b3fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:45.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.624+0000 7faec47fdb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561409b2ffd0 0x561409b225a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:45.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.624+0000 7faec47fdb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x561409a78700 con 0x561409b2ffd0 2024-04-01T06:55:45.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.624+0000 7faec47fdb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x561409a40380 con 0x561409b2e7d0 2024-04-01T06:55:45.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.624+0000 7faec47fdb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x561409b2a4b0 con 0x561409b2f130 2024-04-01T06:55:45.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.624+0000 7faeb6c04700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561409b2ffd0 0x561409b225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:45.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.624+0000 7faeb6c04700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561409b2ffd0 0x561409b225a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:34696/0 (socket says 172.21.15.83:34696) 2024-04-01T06:55:45.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.624+0000 7faeb6c04700 1 -- 172.21.15.83:0/1949476219 learned_addr learned my addr 172.21.15.83:0/1949476219 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:45.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.624+0000 7faeb5c02700 1 --2- 172.21.15.83:0/1949476219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561409b2f130 0x561409b3fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:45.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.624+0000 7faeb6403700 1 --2- 172.21.15.83:0/1949476219 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561409b2e7d0 0x561409b28f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:45.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.624+0000 7faeb6c04700 1 -- 172.21.15.83:0/1949476219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561409b2f130 msgr2=0x561409b3fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:45.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.624+0000 7faeb6c04700 1 --2- 172.21.15.83:0/1949476219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561409b2f130 0x561409b3fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.624+0000 7faeb6c04700 1 -- 172.21.15.83:0/1949476219 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561409b2e7d0 msgr2=0x561409b28f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:45.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.624+0000 7faeb6c04700 1 --2- 172.21.15.83:0/1949476219 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561409b2e7d0 0x561409b28f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.624+0000 7faeb6c04700 1 -- 172.21.15.83:0/1949476219 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561409a45ea0 con 0x561409b2ffd0 2024-04-01T06:55:45.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.624+0000 7faeb6c04700 1 --2- 172.21.15.83:0/1949476219 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561409b2ffd0 0x561409b225a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7faea8009520 tx=0x7faea800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e0c70148cf48c24 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:45.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.625+0000 7faea57fa700 1 -- 172.21.15.83:0/1949476219 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea800e040 con 0x561409b2ffd0 2024-04-01T06:55:45.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.625+0000 7faea57fa700 1 -- 172.21.15.83:0/1949476219 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faea800f040 con 0x561409b2ffd0 2024-04-01T06:55:45.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.625+0000 7faea57fa700 1 -- 172.21.15.83:0/1949476219 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea801e820 con 0x561409b2ffd0 2024-04-01T06:55:45.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.625+0000 7faec47fdb80 1 -- 172.21.15.83:0/1949476219 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561409b2ffd0 msgr2=0x561409b225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:45.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.625+0000 7faec47fdb80 1 --2- 172.21.15.83:0/1949476219 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561409b2ffd0 0x561409b225a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7faea8009520 tx=0x7faea800b040 comp rx=0 tx=0).stop 2024-04-01T06:55:45.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.625+0000 7faec47fdb80 1 -- 172.21.15.83:0/1949476219 shutdown_connections 2024-04-01T06:55:45.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.625+0000 7faec47fdb80 1 --2- 172.21.15.83:0/1949476219 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561409b2ffd0 0x561409b225a0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.625+0000 7faec47fdb80 1 --2- 172.21.15.83:0/1949476219 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561409b2e7d0 0x561409b28f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.625+0000 7faec47fdb80 1 --2- 172.21.15.83:0/1949476219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561409b2f130 0x561409b3fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.625+0000 7faec47fdb80 1 -- 172.21.15.83:0/1949476219 >> 172.21.15.83:0/1949476219 conn(0x561409a8d6a0 msgr2=0x561409b365a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:45.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.625+0000 7faec47fdb80 1 -- 172.21.15.83:0/1949476219 shutdown_connections 2024-04-01T06:55:45.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.625+0000 7faec47fdb80 1 -- 172.21.15.83:0/1949476219 wait complete. 2024-04-01T06:55:45.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.625+0000 7faec47fdb80 1 -- start start 2024-04-01T06:55:45.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.626+0000 7faec47fdb80 1 Processor -- start 2024-04-01T06:55:45.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.626+0000 7faec47fdb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561409b2e7d0 0x561409b3f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:45.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.626+0000 7faec47fdb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561409b2f130 0x561409b3dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:45.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.626+0000 7faec47fdb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561409b2ffd0 0x561409b3e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:45.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.626+0000 7faec47fdb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x561409b3e940 con 0x561409b2ffd0 2024-04-01T06:55:45.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.626+0000 7faec47fdb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x561409b3eab0 con 0x561409b2e7d0 2024-04-01T06:55:45.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.626+0000 7faec47fdb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x561409b3ec70 con 0x561409b2f130 2024-04-01T06:55:45.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.626+0000 7faec47fdb80 10 client.0 _ll_register_callbacks cb 0x561409a25470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:55:45.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.626+0000 7faeb6c04700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561409b2ffd0 0x561409b3e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:45.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.626+0000 7faeb6c04700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561409b2ffd0 0x561409b3e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:34712/0 (socket says 172.21.15.83:34712) 2024-04-01T06:55:45.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.626+0000 7faeb6c04700 1 -- 172.21.15.83:0/2145442007 learned_addr learned my addr 172.21.15.83:0/2145442007 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:45.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.626+0000 7faeb5c02700 1 --2- 172.21.15.83:0/2145442007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561409b2f130 0x561409b3dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:45.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.626+0000 7faeb6403700 1 --2- 172.21.15.83:0/2145442007 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561409b2e7d0 0x561409b3f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:45.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.626+0000 7faeb6c04700 1 -- 172.21.15.83:0/2145442007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561409b2f130 msgr2=0x561409b3dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:45.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.626+0000 7faeb6c04700 1 --2- 172.21.15.83:0/2145442007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561409b2f130 0x561409b3dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.626+0000 7faeb6c04700 1 -- 172.21.15.83:0/2145442007 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561409b2e7d0 msgr2=0x561409b3f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:55:45.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.626+0000 7faeb6c04700 1 --2- 172.21.15.83:0/2145442007 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561409b2e7d0 0x561409b3f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.626+0000 7faeb6c04700 1 -- 172.21.15.83:0/2145442007 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faea80091d0 con 0x561409b2ffd0 2024-04-01T06:55:45.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.626+0000 7faeb6403700 1 --2- 172.21.15.83:0/2145442007 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561409b2e7d0 0x561409b3f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:55:45.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.626+0000 7faeb6c04700 1 --2- 172.21.15.83:0/2145442007 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561409b2ffd0 0x561409b3e400 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7faea8017b20 tx=0x7faea8017b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca4ce9cc55e258f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:45.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.626+0000 7fae99ffb700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:55:45.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.627+0000 7fae99ffb700 1 -- 172.21.15.83:0/2145442007 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea800e070 con 0x561409b2ffd0 2024-04-01T06:55:45.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.627+0000 7fae99ffb700 1 -- 172.21.15.83:0/2145442007 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8124+0+0 (secure 0 0 0) 0x7faea8004ce0 con 0x561409b2ffd0 2024-04-01T06:55:45.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.627+0000 7faec47fdb80 1 -- 172.21.15.83:0/2145442007 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faeac09dce0 con 0x561409b2ffd0 2024-04-01T06:55:45.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.627+0000 7fae99ffb700 1 -- 172.21.15.83:0/2145442007 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7faea8004ea0 con 0x561409b2ffd0 2024-04-01T06:55:45.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.627+0000 7faec47fdb80 10 client.15405 fetch_fsmap learned FSMap version 24 2024-04-01T06:55:45.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.627+0000 7faec47fdb80 1 -- 172.21.15.83:0/2145442007 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x561409905cd0 con 0x561409b2ffd0 2024-04-01T06:55:45.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.627+0000 7fae99ffb700 1 -- 172.21.15.83:0/2145442007 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faeac09dce0 con 0x561409b2ffd0 2024-04-01T06:55:45.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.627+0000 7fae99ffb700 1 -- 172.21.15.83:0/2145442007 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7faea80054c0 con 0x561409b2ffd0 2024-04-01T06:55:45.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.627+0000 7faec47fdb80 10 client.15405 fetch_fsmap finished waiting for FSMap version 24 2024-04-01T06:55:45.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.627+0000 7faec47fdb80 10 client.15405 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-01T06:55:45.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.627+0000 7faec47fdb80 20 client.15405 populate_metadata read hostname 'smithi083' 2024-04-01T06:55:45.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.627+0000 7faec47fdb80 1 --2- 172.21.15.83:0/2145442007 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x561409b99430 0x561409b9b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:45.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.627+0000 7faec47fdb80 4 client.15405 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-01T06:55:45.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.627+0000 7faec47fdb80 1 -- 172.21.15.83:0/2145442007 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5614098cecf0 con 0x561409b99430 2024-04-01T06:55:45.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.627+0000 7faeb6403700 1 --2- 172.21.15.83:0/2145442007 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x561409b99430 0x561409b9b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:45.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.628+0000 7fae99ffb700 10 client.15405 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:55:45.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.628+0000 7faeb6403700 1 --2- 172.21.15.83:0/2145442007 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x561409b99430 0x561409b9b850 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b26becf2cd9c12c server_cookie=ef95481da511b8ea in_seq=0 out_seq=0 2024-04-01T06:55:45.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.628+0000 7fae99ffb700 1 -- 172.21.15.83:0/2145442007 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5614098cecf0 con 0x561409b99430 2024-04-01T06:55:45.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.628+0000 7fae99ffb700 10 client.15405 handle_command_reply: tid=0 2024-04-01T06:55:45.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.628+0000 7faec47fdb80 1 client.15405 shutdown 2024-04-01T06:55:45.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.628+0000 7faec47fdb80 1 -- 172.21.15.83:0/2145442007 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561409b2ffd0 msgr2=0x561409b3e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:45.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.628+0000 7faec47fdb80 1 --2- 172.21.15.83:0/2145442007 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561409b2ffd0 0x561409b3e400 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7faea8017b20 tx=0x7faea8017b50 comp rx=0 tx=0).stop 2024-04-01T06:55:45.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.628+0000 7faec47fdb80 1 -- 172.21.15.83:0/2145442007 shutdown_connections 2024-04-01T06:55:45.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.628+0000 7faec47fdb80 1 --2- 172.21.15.83:0/2145442007 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x561409b99430 0x561409b9b850 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.628+0000 7faec47fdb80 1 --2- 172.21.15.83:0/2145442007 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x561409b2ffd0 0x561409b3e400 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.646 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.628+0000 7faec47fdb80 1 --2- 172.21.15.83:0/2145442007 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561409b2e7d0 0x561409b3f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.646 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.628+0000 7fae99ffb700 0 client.15405 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:55:45.646 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.628+0000 7faec47fdb80 1 --2- 172.21.15.83:0/2145442007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561409b2f130 0x561409b3dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.646 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.628+0000 7faec47fdb80 1 -- 172.21.15.83:0/2145442007 >> 172.21.15.83:0/2145442007 conn(0x561409a8d6a0 msgr2=0x561409b365a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:45.646 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.628+0000 7faec47fdb80 1 -- 172.21.15.83:0/2145442007 shutdown_connections 2024-04-01T06:55:45.646 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.628+0000 7faec47fdb80 1 -- 172.21.15.83:0/2145442007 wait complete. 2024-04-01T06:55:45.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.628+0000 7faec47fdb80 20 client.15405 trim_cache size 0 max 16384 2024-04-01T06:55:45.647 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-04-01T06:55:45.647 INFO:teuthology.orchestra.run.smithi083.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-01T06:55:45.648 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubs": { 2024-04-01T06:55:45.648 INFO:teuthology.orchestra.run.smithi083.stdout: "008518ea-6250-4dac-b440-aeb5068180f3": { 2024-04-01T06:55:45.648 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/", 2024-04-01T06:55:45.648 INFO:teuthology.orchestra.run.smithi083.stdout: "tag": "008518ea-6250-4dac-b440-aeb5068180f3", 2024-04-01T06:55:45.648 INFO:teuthology.orchestra.run.smithi083.stdout: "options": "recursive,force" 2024-04-01T06:55:45.648 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T06:55:45.649 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T06:55:45.649 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-04-01T06:55:45.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.629+0000 7faeb8667700 1 -- 172.21.15.83:0/287237064 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fae9c0a1230 msgr2=0x7fae9c0a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:45.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.629+0000 7faeb8667700 1 --2- 172.21.15.83:0/287237064 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fae9c0a1230 0x7fae9c0a36f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7faea000b7b0 tx=0x7faea0005fd0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.629+0000 7faeb8667700 1 -- 172.21.15.83:0/287237064 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faeb0101880 msgr2=0x7faeb01011a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:45.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.629+0000 7faeb8667700 1 --2- 172.21.15.83:0/287237064 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faeb0101880 0x7faeb01011a0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7faeac00e9a0 tx=0x7faeac00ecb0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.629+0000 7faeb8667700 1 -- 172.21.15.83:0/287237064 shutdown_connections 2024-04-01T06:55:45.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.629+0000 7faeb8667700 1 --2- 172.21.15.83:0/287237064 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faeb0101880 0x7faeb01011a0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.651 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.629+0000 7faeb8667700 1 --2- 172.21.15.83:0/287237064 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fae9c0a1230 0x7fae9c0a36f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.652 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.629+0000 7faeb8667700 1 --2- 172.21.15.83:0/287237064 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faeb0106ae0 0x7faeb00ffd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.652 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.629+0000 7faeb8667700 1 --2- 172.21.15.83:0/287237064 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faeb01041b0 0x7faeb00ff830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:45.652 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.629+0000 7faeb8667700 1 -- 172.21.15.83:0/287237064 >> 172.21.15.83:0/287237064 conn(0x7faeb00fb1d0 msgr2=0x7faeb01023e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:45.652 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.629+0000 7faeb8667700 1 -- 172.21.15.83:0/287237064 shutdown_connections 2024-04-01T06:55:45.652 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.629+0000 7faeb8667700 1 -- 172.21.15.83:0/287237064 wait complete. 2024-04-01T06:55:45.653 INFO:tasks.cephfs.filesystem:scrub status for tag:008518ea-6250-4dac-b440-aeb5068180f3 - {'path': '/', 'tag': '008518ea-6250-4dac-b440-aeb5068180f3', 'options': 'recursive,force'} 2024-04-01T06:55:45.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:45.700+0000 7f22f0adb700 1 -- 172.21.15.83:0/3073377206 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f22ec10c530 con 0x7f22ec101820 2024-04-01T06:55:46.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:45 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/3966523286' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:55:46.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:45 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/3495290477' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T06:55:46.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:45 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/3073377206' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-04-01T06:55:46.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:45 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/3966523286' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:55:46.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:45 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/3495290477' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T06:55:46.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:45 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/3073377206' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-04-01T06:55:46.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:45 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/3966523286' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:55:46.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:45 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/3495290477' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T06:55:46.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:45 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/3073377206' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-04-01T06:55:46.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:46.718+0000 7f22db7fe700 1 -- 172.21.15.83:0/3073377206 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mgrmap(e 18) v1 ==== 135933+0+0 (secure 0 0 0) 0x7f22dc097560 con 0x7f22ec101820 2024-04-01T06:55:46.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:46.719+0000 7f22db7fe700 1 -- 172.21.15.83:0/3073377206 <== mon.0 v2:172.21.15.83:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v18) v1 ==== 92+0+0 (secure 0 0 0) 0x7f22dc09ac20 con 0x7f22ec101820 2024-04-01T06:55:46.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:46.722+0000 7f22f0adb700 1 -- 172.21.15.83:0/3073377206 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f22d40a1230 msgr2=0x7f22d40a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:46.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:46.722+0000 7f22f0adb700 1 --2- 172.21.15.83:0/3073377206 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f22d40a1230 0x7f22d40a36f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f22e0005950 tx=0x7f22e00058e0 comp rx=0 tx=0).stop 2024-04-01T06:55:46.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:46.722+0000 7f22f0adb700 1 -- 172.21.15.83:0/3073377206 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22ec101820 msgr2=0x7f22ec101140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:46.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:46.722+0000 7f22f0adb700 1 --2- 172.21.15.83:0/3073377206 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22ec101820 0x7f22ec101140 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f22dc006010 tx=0x7f22dc004730 comp rx=0 tx=0).stop 2024-04-01T06:55:46.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:46.722+0000 7f22f0adb700 1 -- 172.21.15.83:0/3073377206 shutdown_connections 2024-04-01T06:55:46.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:46.722+0000 7f22f0adb700 1 --2- 172.21.15.83:0/3073377206 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22ec101820 0x7f22ec101140 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:46.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:46.722+0000 7f22f0adb700 1 --2- 172.21.15.83:0/3073377206 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f22d40a1230 0x7f22d40a36f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:46.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:46.722+0000 7f22f0adb700 1 --2- 172.21.15.83:0/3073377206 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22ec106a80 0x7f22ec0ffd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:46.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:46.722+0000 7f22f0adb700 1 --2- 172.21.15.83:0/3073377206 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f22ec104150 0x7f22ec0ff7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:46.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:46.722+0000 7f22f0adb700 1 -- 172.21.15.83:0/3073377206 >> 172.21.15.83:0/3073377206 conn(0x7f22ec0fb170 msgr2=0x7f22ec102300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:46.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:46.722+0000 7f22f0adb700 1 -- 172.21.15.83:0/3073377206 shutdown_connections 2024-04-01T06:55:46.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:46.722+0000 7f22f0adb700 1 -- 172.21.15.83:0/3073377206 wait complete. 2024-04-01T06:55:46.737 DEBUG:teuthology.orchestra.run.smithi083:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-04-01T06:55:46.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:46.875+0000 7f597f9aa700 1 -- 172.21.15.83:0/3470632046 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5978102a20 msgr2=0x7f59781092d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:46.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:46.875+0000 7f597f9aa700 1 --2- 172.21.15.83:0/3470632046 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5978102a20 0x7f59781092d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f597000b0a0 tx=0x7f597000b3b0 comp rx=0 tx=0).stop 2024-04-01T06:55:46.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:46.875+0000 7f597f9aa700 1 -- 172.21.15.83:0/3470632046 shutdown_connections 2024-04-01T06:55:46.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:46.875+0000 7f597f9aa700 1 --2- 172.21.15.83:0/3470632046 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5978102a20 0x7f59781092d0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:46.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:46.875+0000 7f597f9aa700 1 --2- 172.21.15.83:0/3470632046 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59780ff010 0x7f59780ff430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:46.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:46.875+0000 7f597f9aa700 1 --2- 172.21.15.83:0/3470632046 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5978102080 0x7f59781024e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:46.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:46.875+0000 7f597f9aa700 1 -- 172.21.15.83:0/3470632046 >> 172.21.15.83:0/3470632046 conn(0x7f59780fa940 msgr2=0x7f59780fcd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:46.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:46.875+0000 7f597f9aa700 1 -- 172.21.15.83:0/3470632046 shutdown_connections 2024-04-01T06:55:46.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:46.876+0000 7f597f9aa700 1 -- 172.21.15.83:0/3470632046 wait complete. 2024-04-01T06:55:46.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:46.876+0000 7f597f9aa700 1 Processor -- start 2024-04-01T06:55:46.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:46.876+0000 7f597f9aa700 1 -- start start 2024-04-01T06:55:46.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:46.876+0000 7f597f9aa700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59780ff010 0x7f5978198f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:46.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:46.876+0000 7f597f9aa700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5978102080 0x7f59781994d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:46.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:46.876+0000 7f597f9aa700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5978102a20 0x7f59781a04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:46.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:46.876+0000 7f597f9aa700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59781a0ac0 con 0x7f5978102080 2024-04-01T06:55:46.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:46.876+0000 7f597f9aa700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59781a0c00 con 0x7f5978102a20 2024-04-01T06:55:46.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:46.876+0000 7f597f9aa700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59781a0d90 con 0x7f59780ff010 2024-04-01T06:55:46.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:46.876+0000 7f597cf45700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5978102080 0x7f59781994d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:46.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:46.876+0000 7f597cf45700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5978102080 0x7f59781994d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:34740/0 (socket says 172.21.15.83:34740) 2024-04-01T06:55:46.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:46.876+0000 7f597cf45700 1 -- 172.21.15.83:0/153376332 learned_addr learned my addr 172.21.15.83:0/153376332 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:46.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:46.877+0000 7f597df47700 1 --2- 172.21.15.83:0/153376332 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5978102a20 0x7f59781a04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:46.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:46.877+0000 7f597d746700 1 --2- 172.21.15.83:0/153376332 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59780ff010 0x7f5978198f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:46.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:46.877+0000 7f597cf45700 1 -- 172.21.15.83:0/153376332 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59780ff010 msgr2=0x7f5978198f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:46.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:46.877+0000 7f597cf45700 1 --2- 172.21.15.83:0/153376332 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59780ff010 0x7f5978198f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:46.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:46.877+0000 7f597cf45700 1 -- 172.21.15.83:0/153376332 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5978102a20 msgr2=0x7f59781a04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:46.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:46.877+0000 7f597cf45700 1 --2- 172.21.15.83:0/153376332 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5978102a20 0x7f59781a04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:46.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:46.877+0000 7f597cf45700 1 -- 172.21.15.83:0/153376332 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5970009d00 con 0x7f5978102080 2024-04-01T06:55:46.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:46.877+0000 7f597cf45700 1 --2- 172.21.15.83:0/153376332 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5978102080 0x7f59781994d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f596800e9a0 tx=0x7f596800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:46.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:46.877+0000 7f596e7fc700 1 -- 172.21.15.83:0/153376332 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5968009790 con 0x7f5978102080 2024-04-01T06:55:46.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:46.877+0000 7f597f9aa700 1 -- 172.21.15.83:0/153376332 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59781a1070 con 0x7f5978102080 2024-04-01T06:55:46.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:46.877+0000 7f596e7fc700 1 -- 172.21.15.83:0/153376332 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5968010430 con 0x7f5978102080 2024-04-01T06:55:46.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:46.877+0000 7f596e7fc700 1 -- 172.21.15.83:0/153376332 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5968018680 con 0x7f5978102080 2024-04-01T06:55:46.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:46.877+0000 7f597f9aa700 1 -- 172.21.15.83:0/153376332 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59781a15d0 con 0x7f5978102080 2024-04-01T06:55:46.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:46.878+0000 7f597f9aa700 1 -- 172.21.15.83:0/153376332 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5978068080 con 0x7f5978102080 2024-04-01T06:55:46.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:46.879+0000 7f596e7fc700 1 -- 172.21.15.83:0/153376332 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 18) v1 ==== 135933+0+0 (secure 0 0 0) 0x7f59680105a0 con 0x7f5978102080 2024-04-01T06:55:46.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:46.880+0000 7f596e7fc700 1 --2- 172.21.15.83:0/153376332 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f59640a1280 0x7f59640a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:46.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:46.880+0000 7f597d746700 1 -- 172.21.15.83:0/153376332 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f59640a1280 msgr2=0x7f59640a3740 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.83:6800/3375372052 2024-04-01T06:55:46.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:46.880+0000 7f596e7fc700 1 -- 172.21.15.83:0/153376332 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f5968014070 con 0x7f5978102080 2024-04-01T06:55:46.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:46.880+0000 7f597d746700 1 --2- 172.21.15.83:0/153376332 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f59640a1280 0x7f59640a3740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-01T06:55:46.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:46.883+0000 7f596e7fc700 1 -- 172.21.15.83:0/153376332 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f59680964d0 con 0x7f5978102080 2024-04-01T06:55:47.003 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:55:46 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-y[49294]: ignoring --setuser ceph since I am not root 2024-04-01T06:55:47.003 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:55:46 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-y[49294]: ignoring --setgroup ceph since I am not root 2024-04-01T06:55:47.003 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:55:46 smithi145 ceph-mgr[49317]: -- 172.21.15.145:0/2705948098 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55a811c091e0 con 0x55a811bcac00 2024-04-01T06:55:47.003 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:55:46 smithi145 ceph-mgr[49317]: -- 172.21.15.145:0/2705948098 <== mon.0 v2:172.21.15.83:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a811bf41a0 con 0x55a811bcac00 2024-04-01T06:55:47.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:46 smithi145 ceph-mon[47816]: scrub queued for path: / 2024-04-01T06:55:47.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:46 smithi145 ceph-mon[47816]: scrub summary: idle+waiting paths [/] 2024-04-01T06:55:47.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:46 smithi145 ceph-mon[47816]: scrub summary: active paths [/] 2024-04-01T06:55:47.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:46 smithi145 ceph-mon[47816]: scrub summary: idle+waiting paths [/] 2024-04-01T06:55:47.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:46 smithi145 ceph-mon[47816]: pgmap v257: 97 pgs: 97 active+clean; 645 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 835 B/s wr, 6 op/s; 0 B/s, 0 objects/s recovering 2024-04-01T06:55:47.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:46 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/3073377206' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-04-01T06:55:47.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:46 smithi145 ceph-mon[47816]: mgrmap e18: x(active, since 6m), standbys: z, y 2024-04-01T06:55:47.012 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:55:46 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: ignoring --setuser ceph since I am not root 2024-04-01T06:55:47.012 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:55:46 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: ignoring --setgroup ceph since I am not root 2024-04-01T06:55:47.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:46 smithi083 ceph-mon[43429]: scrub queued for path: / 2024-04-01T06:55:47.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:46 smithi083 ceph-mon[43429]: scrub summary: idle+waiting paths [/] 2024-04-01T06:55:47.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:46 smithi083 ceph-mon[43429]: scrub summary: active paths [/] 2024-04-01T06:55:47.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:46 smithi083 ceph-mon[43429]: scrub summary: idle+waiting paths [/] 2024-04-01T06:55:47.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:46 smithi083 ceph-mon[43429]: pgmap v257: 97 pgs: 97 active+clean; 645 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 835 B/s wr, 6 op/s; 0 B/s, 0 objects/s recovering 2024-04-01T06:55:47.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:46 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/3073377206' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-04-01T06:55:47.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:46 smithi083 ceph-mon[43429]: mgrmap e18: x(active, since 6m), standbys: z, y 2024-04-01T06:55:47.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.081+0000 7f597d746700 1 -- 172.21.15.83:0/153376332 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f59640a1280 msgr2=0x7f59640a3740 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.83:6800/3375372052 2024-04-01T06:55:47.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.081+0000 7f597d746700 1 --2- 172.21.15.83:0/153376332 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f59640a1280 0x7f59640a3740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-01T06:55:47.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.095+0000 7f597f9aa700 1 -- 172.21.15.83:0/153376332 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f59781a1200 con 0x7f5978102080 2024-04-01T06:55:47.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.099+0000 7f596e7fc700 1 -- 172.21.15.83:0/153376332 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v29)=0 v29) v1 ==== 138+0+0 (secure 0 0 0) 0x7f59781a1200 con 0x7f5978102080 2024-04-01T06:55:47.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.102+0000 7f597f9aa700 1 -- 172.21.15.83:0/153376332 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f59640a1280 msgr2=0x7f59640a3740 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-01T06:55:47.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.102+0000 7f597f9aa700 1 --2- 172.21.15.83:0/153376332 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f59640a1280 0x7f59640a3740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:47.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.102+0000 7f597f9aa700 1 -- 172.21.15.83:0/153376332 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5978102080 msgr2=0x7f59781994d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:47.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.102+0000 7f597f9aa700 1 --2- 172.21.15.83:0/153376332 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5978102080 0x7f59781994d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f596800e9a0 tx=0x7f596800ecb0 comp rx=0 tx=0).stop 2024-04-01T06:55:47.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.102+0000 7f597f9aa700 1 -- 172.21.15.83:0/153376332 shutdown_connections 2024-04-01T06:55:47.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.102+0000 7f597f9aa700 1 --2- 172.21.15.83:0/153376332 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f59640a1280 0x7f59640a3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:47.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.102+0000 7f597f9aa700 1 --2- 172.21.15.83:0/153376332 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5978102a20 0x7f59781a04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:47.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.102+0000 7f597f9aa700 1 --2- 172.21.15.83:0/153376332 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59780ff010 0x7f5978198f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:47.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.102+0000 7f597f9aa700 1 --2- 172.21.15.83:0/153376332 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5978102080 0x7f59781994d0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:47.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.102+0000 7f597f9aa700 1 -- 172.21.15.83:0/153376332 >> 172.21.15.83:0/153376332 conn(0x7f59780fa940 msgr2=0x7f59780ffe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:47.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.102+0000 7f597f9aa700 1 -- 172.21.15.83:0/153376332 shutdown_connections 2024-04-01T06:55:47.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.102+0000 7f597f9aa700 1 -- 172.21.15.83:0/153376332 wait complete. 2024-04-01T06:55:47.115 DEBUG:teuthology.orchestra.run.smithi083:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-04-01T06:55:47.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:46 smithi153 ceph-mon[48187]: scrub queued for path: / 2024-04-01T06:55:47.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:46 smithi153 ceph-mon[48187]: scrub summary: idle+waiting paths [/] 2024-04-01T06:55:47.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:46 smithi153 ceph-mon[48187]: scrub summary: active paths [/] 2024-04-01T06:55:47.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:46 smithi153 ceph-mon[48187]: scrub summary: idle+waiting paths [/] 2024-04-01T06:55:47.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:46 smithi153 ceph-mon[48187]: pgmap v257: 97 pgs: 97 active+clean; 645 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 835 B/s wr, 6 op/s; 0 B/s, 0 objects/s recovering 2024-04-01T06:55:47.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:46 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/3073377206' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-04-01T06:55:47.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:46 smithi153 ceph-mon[48187]: mgrmap e18: x(active, since 6m), standbys: z, y 2024-04-01T06:55:47.141 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 06:55:46 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-z[50054]: ignoring --setuser ceph since I am not root 2024-04-01T06:55:47.141 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 06:55:46 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-z[50054]: ignoring --setgroup ceph since I am not root 2024-04-01T06:55:47.141 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 06:55:46 smithi153 ceph-mgr[50077]: -- 172.21.15.153:0/2561611093 <== mon.2 v2:172.21.15.145:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c7afebc1a0 con 0x55c7afe93000 2024-04-01T06:55:47.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.240+0000 7f1178dd3700 1 -- 172.21.15.83:0/2751038043 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1174106a00 msgr2=0x7f1174108e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:47.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.240+0000 7f1178dd3700 1 --2- 172.21.15.83:0/2751038043 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1174106a00 0x7f1174108e70 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f116c00b0a0 tx=0x7f116c00b3b0 comp rx=0 tx=0).stop 2024-04-01T06:55:47.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.240+0000 7f1178dd3700 1 -- 172.21.15.83:0/2751038043 shutdown_connections 2024-04-01T06:55:47.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.240+0000 7f1178dd3700 1 --2- 172.21.15.83:0/2751038043 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1174106a00 0x7f1174108e70 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:47.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.240+0000 7f1178dd3700 1 --2- 172.21.15.83:0/2751038043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11741017a0 0x7f1174103b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:47.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.240+0000 7f1178dd3700 1 --2- 172.21.15.83:0/2751038043 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f11741040d0 0x7f11741064c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:47.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.240+0000 7f1178dd3700 1 -- 172.21.15.83:0/2751038043 >> 172.21.15.83:0/2751038043 conn(0x7f11740fb190 msgr2=0x7f11740fd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:47.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.240+0000 7f1178dd3700 1 -- 172.21.15.83:0/2751038043 shutdown_connections 2024-04-01T06:55:47.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.240+0000 7f1178dd3700 1 -- 172.21.15.83:0/2751038043 wait complete. 2024-04-01T06:55:47.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.241+0000 7f1178dd3700 1 Processor -- start 2024-04-01T06:55:47.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.241+0000 7f1178dd3700 1 -- start start 2024-04-01T06:55:47.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.241+0000 7f1178dd3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11741017a0 0x7f1174196d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:47.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.241+0000 7f1178dd3700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f11741040d0 0x7f11741972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:47.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.241+0000 7f1178dd3700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1174106a00 0x7f117419e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:47.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.241+0000 7f1178dd3700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117419e860 con 0x7f11741040d0 2024-04-01T06:55:47.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.241+0000 7f1178dd3700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117419e9d0 con 0x7f1174106a00 2024-04-01T06:55:47.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.241+0000 7f1178dd3700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117419eb90 con 0x7f11741017a0 2024-04-01T06:55:47.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.241+0000 7f1171d9b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f11741040d0 0x7f11741972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:47.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.241+0000 7f1171d9b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f11741040d0 0x7f11741972b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:34754/0 (socket says 172.21.15.83:34754) 2024-04-01T06:55:47.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.241+0000 7f1171d9b700 1 -- 172.21.15.83:0/1208112930 learned_addr learned my addr 172.21.15.83:0/1208112930 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:47.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.241+0000 7f1172d9d700 1 --2- 172.21.15.83:0/1208112930 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1174106a00 0x7f117419e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:47.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.241+0000 7f117259c700 1 --2- 172.21.15.83:0/1208112930 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11741017a0 0x7f1174196d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:47.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.242+0000 7f1172d9d700 1 -- 172.21.15.83:0/1208112930 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11741017a0 msgr2=0x7f1174196d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:47.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.242+0000 7f1172d9d700 1 --2- 172.21.15.83:0/1208112930 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11741017a0 0x7f1174196d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:47.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.242+0000 7f1172d9d700 1 -- 172.21.15.83:0/1208112930 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f11741040d0 msgr2=0x7f11741972b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:47.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.242+0000 7f1172d9d700 1 --2- 172.21.15.83:0/1208112930 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f11741040d0 0x7f11741972b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:47.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.242+0000 7f1172d9d700 1 -- 172.21.15.83:0/1208112930 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f116c009d00 con 0x7f1174106a00 2024-04-01T06:55:47.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.242+0000 7f1171d9b700 1 --2- 172.21.15.83:0/1208112930 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f11741040d0 0x7f11741972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T06:55:47.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.242+0000 7f1172d9d700 1 --2- 172.21.15.83:0/1208112930 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1174106a00 0x7f117419e290 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f116c007b90 tx=0x7f116c007930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:47.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.242+0000 7f11637fe700 1 -- 172.21.15.83:0/1208112930 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116c00e040 con 0x7f1174106a00 2024-04-01T06:55:47.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.242+0000 7f11637fe700 1 -- 172.21.15.83:0/1208112930 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f116c00be40 con 0x7f1174106a00 2024-04-01T06:55:47.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.242+0000 7f1178dd3700 1 -- 172.21.15.83:0/1208112930 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f117419ee10 con 0x7f1174106a00 2024-04-01T06:55:47.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.242+0000 7f11637fe700 1 -- 172.21.15.83:0/1208112930 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116c01b460 con 0x7f1174106a00 2024-04-01T06:55:47.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.242+0000 7f1178dd3700 1 -- 172.21.15.83:0/1208112930 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f117419f180 con 0x7f1174106a00 2024-04-01T06:55:47.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.243+0000 7f1178dd3700 1 -- 172.21.15.83:0/1208112930 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11740fcd10 con 0x7f1174106a00 2024-04-01T06:55:47.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.244+0000 7f11637fe700 1 -- 172.21.15.83:0/1208112930 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 18) v1 ==== 135933+0+0 (secure 0 0 0) 0x7f116c01d470 con 0x7f1174106a00 2024-04-01T06:55:47.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.245+0000 7f11637fe700 1 --2- 172.21.15.83:0/1208112930 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f115c0a1200 0x7f115c0a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:47.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.245+0000 7f117259c700 1 -- 172.21.15.83:0/1208112930 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f115c0a1200 msgr2=0x7f115c0a36c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.83:6800/3375372052 2024-04-01T06:55:47.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.245+0000 7f11637fe700 1 -- 172.21.15.83:0/1208112930 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f116c0cd930 con 0x7f1174106a00 2024-04-01T06:55:47.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.245+0000 7f117259c700 1 --2- 172.21.15.83:0/1208112930 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f115c0a1200 0x7f115c0a36c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-01T06:55:47.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.249+0000 7f11637fe700 1 -- 172.21.15.83:0/1208112930 <== mon.2 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f116c097090 con 0x7f1174106a00 2024-04-01T06:55:47.413 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:55:47 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-y[49294]: 2024-04-01T06:55:47.149+0000 7f731399d200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-01T06:55:47.414 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:55:47 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-y[49294]: 2024-04-01T06:55:47.241+0000 7f731399d200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-01T06:55:47.414 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:55:47 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-y[49294]: 2024-04-01T06:55:47.329+0000 7f731399d200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-01T06:55:47.420 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 06:55:47 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-z[50054]: 2024-04-01T06:55:47.155+0000 7f7541351200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-01T06:55:47.421 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 06:55:47 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-z[50054]: 2024-04-01T06:55:47.248+0000 7f7541351200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-01T06:55:47.421 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 06:55:47 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-z[50054]: 2024-04-01T06:55:47.335+0000 7f7541351200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-01T06:55:47.421 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 06:55:47 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-z[50054]: 2024-04-01T06:55:47.420+0000 7f7541351200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-01T06:55:47.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.446+0000 7f117259c700 1 -- 172.21.15.83:0/1208112930 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f115c0a1200 msgr2=0x7f115c0a36c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.83:6800/3375372052 2024-04-01T06:55:47.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.446+0000 7f117259c700 1 --2- 172.21.15.83:0/1208112930 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f115c0a1200 0x7f115c0a36c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-01T06:55:47.450 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:55:47 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:55:47.172+0000 7f5739c76200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-01T06:55:47.450 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:55:47 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:55:47.271+0000 7f5739c76200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-01T06:55:47.450 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:55:47 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:55:47.363+0000 7f5739c76200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-01T06:55:47.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.461+0000 7f1178dd3700 1 -- 172.21.15.83:0/1208112930 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f11740673a0 con 0x7f1174106a00 2024-04-01T06:55:47.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.466+0000 7f11637fe700 1 -- 172.21.15.83:0/1208112930 <== mon.2 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v30)=0 v30) v1 ==== 133+0+0 (secure 0 0 0) 0x7f116c09a6b0 con 0x7f1174106a00 2024-04-01T06:55:47.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.469+0000 7f1178dd3700 1 -- 172.21.15.83:0/1208112930 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f115c0a1200 msgr2=0x7f115c0a36c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-01T06:55:47.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.469+0000 7f1178dd3700 1 --2- 172.21.15.83:0/1208112930 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f115c0a1200 0x7f115c0a36c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:47.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.469+0000 7f1178dd3700 1 -- 172.21.15.83:0/1208112930 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1174106a00 msgr2=0x7f117419e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:47.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.469+0000 7f1178dd3700 1 --2- 172.21.15.83:0/1208112930 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1174106a00 0x7f117419e290 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f116c007b90 tx=0x7f116c007930 comp rx=0 tx=0).stop 2024-04-01T06:55:47.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.469+0000 7f1178dd3700 1 -- 172.21.15.83:0/1208112930 shutdown_connections 2024-04-01T06:55:47.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.469+0000 7f1178dd3700 1 --2- 172.21.15.83:0/1208112930 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7f115c0a1200 0x7f115c0a36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:47.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.469+0000 7f1178dd3700 1 --2- 172.21.15.83:0/1208112930 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1174106a00 0x7f117419e290 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:47.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.469+0000 7f1178dd3700 1 --2- 172.21.15.83:0/1208112930 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11741017a0 0x7f1174196d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:47.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.469+0000 7f1178dd3700 1 --2- 172.21.15.83:0/1208112930 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f11741040d0 0x7f11741972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:47.469 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.469+0000 7f1178dd3700 1 -- 172.21.15.83:0/1208112930 >> 172.21.15.83:0/1208112930 conn(0x7f11740fb190 msgr2=0x7f1174102100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:47.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.469+0000 7f1178dd3700 1 -- 172.21.15.83:0/1208112930 shutdown_connections 2024-04-01T06:55:47.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.469+0000 7f1178dd3700 1 -- 172.21.15.83:0/1208112930 wait complete. 2024-04-01T06:55:47.481 DEBUG:teuthology.orchestra.run.smithi083:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-04-01T06:55:47.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.608+0000 7fd09dbda700 1 -- 172.21.15.83:0/3850889402 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd098101f10 msgr2=0x7fd098102370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:47.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.608+0000 7fd09dbda700 1 --2- 172.21.15.83:0/3850889402 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd098101f10 0x7fd098102370 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fd08c0099c0 tx=0x7fd08c009cd0 comp rx=0 tx=0).stop 2024-04-01T06:55:47.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.608+0000 7fd09dbda700 1 -- 172.21.15.83:0/3850889402 shutdown_connections 2024-04-01T06:55:47.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.608+0000 7fd09dbda700 1 --2- 172.21.15.83:0/3850889402 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd0981028b0 0x7fd098109160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:47.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.608+0000 7fd09dbda700 1 --2- 172.21.15.83:0/3850889402 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd098100d20 0x7fd098101140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:47.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.608+0000 7fd09dbda700 1 --2- 172.21.15.83:0/3850889402 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd098101f10 0x7fd098102370 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:47.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.608+0000 7fd09dbda700 1 -- 172.21.15.83:0/3850889402 >> 172.21.15.83:0/3850889402 conn(0x7fd0980fc2b0 msgr2=0x7fd0980fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:47.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.608+0000 7fd09dbda700 1 -- 172.21.15.83:0/3850889402 shutdown_connections 2024-04-01T06:55:47.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.608+0000 7fd09dbda700 1 -- 172.21.15.83:0/3850889402 wait complete. 2024-04-01T06:55:47.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.609+0000 7fd09dbda700 1 Processor -- start 2024-04-01T06:55:47.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.609+0000 7fd09dbda700 1 -- start start 2024-04-01T06:55:47.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.609+0000 7fd09dbda700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd098100d20 0x7fd098198e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:47.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.609+0000 7fd09dbda700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd098101f10 0x7fd098199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:47.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.609+0000 7fd09dbda700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd0981028b0 0x7fd0981a0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:47.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.609+0000 7fd09dbda700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0981a0950 con 0x7fd098100d20 2024-04-01T06:55:47.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.609+0000 7fd09dbda700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0981a0a90 con 0x7fd0981028b0 2024-04-01T06:55:47.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.609+0000 7fd09dbda700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0981a0c20 con 0x7fd098101f10 2024-04-01T06:55:47.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.609+0000 7fd0977fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd098100d20 0x7fd098198e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:47.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.609+0000 7fd0977fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd098100d20 0x7fd098198e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:34766/0 (socket says 172.21.15.83:34766) 2024-04-01T06:55:47.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.609+0000 7fd0977fe700 1 -- 172.21.15.83:0/2150853049 learned_addr learned my addr 172.21.15.83:0/2150853049 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:47.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.609+0000 7fd096ffd700 1 --2- 172.21.15.83:0/2150853049 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd098101f10 0x7fd098199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:47.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.610+0000 7fd097fff700 1 --2- 172.21.15.83:0/2150853049 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd0981028b0 0x7fd0981a0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:47.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.610+0000 7fd0977fe700 1 -- 172.21.15.83:0/2150853049 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd098101f10 msgr2=0x7fd098199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:47.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.610+0000 7fd0977fe700 1 --2- 172.21.15.83:0/2150853049 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd098101f10 0x7fd098199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:47.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.610+0000 7fd0977fe700 1 -- 172.21.15.83:0/2150853049 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd0981028b0 msgr2=0x7fd0981a0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:47.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.610+0000 7fd0977fe700 1 --2- 172.21.15.83:0/2150853049 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd0981028b0 0x7fd0981a0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:47.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.610+0000 7fd0977fe700 1 -- 172.21.15.83:0/2150853049 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd08c0095f0 con 0x7fd098100d20 2024-04-01T06:55:47.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.610+0000 7fd097fff700 1 --2- 172.21.15.83:0/2150853049 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd0981028b0 0x7fd0981a0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:55:47.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.610+0000 7fd0977fe700 1 --2- 172.21.15.83:0/2150853049 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd098100d20 0x7fd098198e20 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fd08800e970 tx=0x7fd08800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:47.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.610+0000 7fd094ff9700 1 -- 172.21.15.83:0/2150853049 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd088009790 con 0x7fd098100d20 2024-04-01T06:55:47.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.610+0000 7fd094ff9700 1 -- 172.21.15.83:0/2150853049 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd08800eec0 con 0x7fd098100d20 2024-04-01T06:55:47.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.610+0000 7fd09dbda700 1 -- 172.21.15.83:0/2150853049 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0981a0f00 con 0x7fd098100d20 2024-04-01T06:55:47.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.610+0000 7fd094ff9700 1 -- 172.21.15.83:0/2150853049 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd088003cf0 con 0x7fd098100d20 2024-04-01T06:55:47.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.610+0000 7fd09dbda700 1 -- 172.21.15.83:0/2150853049 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0981a1330 con 0x7fd098100d20 2024-04-01T06:55:47.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.611+0000 7fd09dbda700 1 -- 172.21.15.83:0/2150853049 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd098067c30 con 0x7fd098100d20 2024-04-01T06:55:47.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.612+0000 7fd094ff9700 1 -- 172.21.15.83:0/2150853049 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 18) v1 ==== 135933+0+0 (secure 0 0 0) 0x7fd08800ccd0 con 0x7fd098100d20 2024-04-01T06:55:47.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.612+0000 7fd094ff9700 1 --2- 172.21.15.83:0/2150853049 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd0800a1300 0x7fd0800a37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:47.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.613+0000 7fd096ffd700 1 -- 172.21.15.83:0/2150853049 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd0800a1300 msgr2=0x7fd0800a37c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.83:6800/3375372052 2024-04-01T06:55:47.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.613+0000 7fd094ff9700 1 -- 172.21.15.83:0/2150853049 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fd088014070 con 0x7fd098100d20 2024-04-01T06:55:47.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.613+0000 7fd096ffd700 1 --2- 172.21.15.83:0/2150853049 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd0800a1300 0x7fd0800a37c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-01T06:55:47.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.617+0000 7fd094ff9700 1 -- 172.21.15.83:0/2150853049 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7fd0880962c0 con 0x7fd098100d20 2024-04-01T06:55:47.752 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:55:47 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-y[49294]: 2024-04-01T06:55:47.414+0000 7f731399d200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-01T06:55:47.844 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:55:47 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:55:47.450+0000 7f5739c76200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-01T06:55:47.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.814+0000 7fd096ffd700 1 -- 172.21.15.83:0/2150853049 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd0800a1300 msgr2=0x7fd0800a37c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.83:6800/3375372052 2024-04-01T06:55:47.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.814+0000 7fd096ffd700 1 --2- 172.21.15.83:0/2150853049 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd0800a1300 0x7fd0800a37c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-01T06:55:47.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:47.850+0000 7fd09dbda700 1 -- 172.21.15.83:0/2150853049 --> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) v1 -- 0x7fd098108e00 con 0x7fd0800a1300 2024-04-01T06:55:48.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:48.215+0000 7fd096ffd700 1 -- 172.21.15.83:0/2150853049 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd0800a1300 msgr2=0x7fd0800a37c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.83:6800/3375372052 2024-04-01T06:55:48.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:48.215+0000 7fd096ffd700 1 --2- 172.21.15.83:0/2150853049 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd0800a1300 0x7fd0800a37c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-01T06:55:48.297 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:55:48 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-y[49294]: 2024-04-01T06:55:48.045+0000 7f731399d200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-01T06:55:48.297 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:48 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/153376332' entity='client.admin' 2024-04-01T06:55:48.297 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:48 smithi145 ceph-mon[47816]: scrub summary: idle 2024-04-01T06:55:48.297 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:48 smithi145 ceph-mon[47816]: from='client.? ' entity='client.admin' 2024-04-01T06:55:48.298 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 06:55:48 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-z[50054]: 2024-04-01T06:55:48.046+0000 7f7541351200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-01T06:55:48.298 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:48 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/153376332' entity='client.admin' 2024-04-01T06:55:48.299 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:48 smithi153 ceph-mon[48187]: scrub summary: idle 2024-04-01T06:55:48.299 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:48 smithi153 ceph-mon[48187]: from='client.? ' entity='client.admin' 2024-04-01T06:55:48.355 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:55:48 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:55:48.103+0000 7f5739c76200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-01T06:55:48.355 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:48 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/153376332' entity='client.admin' 2024-04-01T06:55:48.355 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:48 smithi083 ceph-mon[43429]: scrub summary: idle 2024-04-01T06:55:48.356 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:48 smithi083 ceph-mon[43429]: from='client.? ' entity='client.admin' 2024-04-01T06:55:48.640 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 06:55:48 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-z[50054]: 2024-04-01T06:55:48.298+0000 7f7541351200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-01T06:55:48.640 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 06:55:48 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-z[50054]: 2024-04-01T06:55:48.383+0000 7f7541351200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-01T06:55:48.640 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 06:55:48 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-z[50054]: 2024-04-01T06:55:48.495+0000 7f7541351200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-01T06:55:48.651 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:55:48 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-y[49294]: 2024-04-01T06:55:48.297+0000 7f731399d200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-01T06:55:48.651 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:55:48 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-y[49294]: 2024-04-01T06:55:48.382+0000 7f731399d200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-01T06:55:48.651 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:55:48 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-y[49294]: 2024-04-01T06:55:48.493+0000 7f731399d200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-01T06:55:48.710 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:55:48 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:55:48.355+0000 7f5739c76200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-01T06:55:48.710 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:55:48 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:55:48.442+0000 7f5739c76200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-01T06:55:48.710 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:55:48 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:55:48.551+0000 7f5739c76200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-01T06:55:49.002 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:55:48 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-y[49294]: 2024-04-01T06:55:48.651+0000 7f731399d200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-01T06:55:49.003 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:55:48 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-y[49294]: 2024-04-01T06:55:48.779+0000 7f731399d200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-01T06:55:49.003 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:55:48 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-y[49294]: 2024-04-01T06:55:48.865+0000 7f731399d200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-01T06:55:49.012 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:55:48 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:55:48.710+0000 7f5739c76200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-01T06:55:49.012 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:55:48 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:55:48.837+0000 7f5739c76200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-01T06:55:49.012 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:55:48 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:55:48.921+0000 7f5739c76200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-01T06:55:49.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:49.016+0000 7fd096ffd700 1 -- 172.21.15.83:0/2150853049 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd0800a1300 msgr2=0x7fd0800a37c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.83:6800/3375372052 2024-04-01T06:55:49.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:49.016+0000 7fd096ffd700 1 --2- 172.21.15.83:0/2150853049 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd0800a1300 0x7fd0800a37c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-01T06:55:49.140 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 06:55:48 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-z[50054]: 2024-04-01T06:55:48.653+0000 7f7541351200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-01T06:55:49.140 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 06:55:48 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-z[50054]: 2024-04-01T06:55:48.780+0000 7f7541351200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-01T06:55:49.141 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 06:55:48 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-z[50054]: 2024-04-01T06:55:48.866+0000 7f7541351200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-01T06:55:49.502 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:55:49 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-y[49294]: 2024-04-01T06:55:49.235+0000 7f731399d200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-01T06:55:49.624 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 06:55:49 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-z[50054]: 2024-04-01T06:55:49.236+0000 7f7541351200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-01T06:55:49.678 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:55:49 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:55:49.290+0000 7f5739c76200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-01T06:55:49.890 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 06:55:49 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-z[50054]: 2024-04-01T06:55:49.623+0000 7f7541351200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-01T06:55:49.890 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 06:55:49 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-z[50054]: 2024-04-01T06:55:49.818+0000 7f7541351200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-01T06:55:49.912 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:55:49 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-y[49294]: 2024-04-01T06:55:49.624+0000 7f731399d200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-01T06:55:49.912 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:55:49 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-y[49294]: 2024-04-01T06:55:49.819+0000 7f731399d200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-01T06:55:49.968 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:55:49 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:55:49.679+0000 7f5739c76200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-01T06:55:49.968 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:55:49 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:55:49.874+0000 7f5739c76200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-01T06:55:50.252 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:55:49 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-y[49294]: 2024-04-01T06:55:49.912+0000 7f731399d200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-01T06:55:50.262 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:55:49 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:55:49.968+0000 7f5739c76200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-01T06:55:50.390 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 06:55:49 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-z[50054]: 2024-04-01T06:55:49.912+0000 7f7541351200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-01T06:55:50.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:50.617+0000 7fd096ffd700 1 -- 172.21.15.83:0/2150853049 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd0800a1300 msgr2=0x7fd0800a37c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.83:6800/3375372052 2024-04-01T06:55:50.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:50.617+0000 7fd096ffd700 1 --2- 172.21.15.83:0/2150853049 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd0800a1300 0x7fd0800a37c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-01T06:55:51.002 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:55:50 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-y[49294]: 2024-04-01T06:55:50.675+0000 7f731399d200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-01T06:55:51.002 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:55:50 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-y[49294]: 2024-04-01T06:55:50.773+0000 7f731399d200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-01T06:55:51.003 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:55:50 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-y[49294]: 2024-04-01T06:55:50.921+0000 7f731399d200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-01T06:55:51.012 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:55:50 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:55:50.731+0000 7f5739c76200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-01T06:55:51.012 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:55:50 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:55:50.828+0000 7f5739c76200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-01T06:55:51.012 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:55:50 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:55:50.976+0000 7f5739c76200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-01T06:55:51.140 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 06:55:50 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-z[50054]: 2024-04-01T06:55:50.674+0000 7f7541351200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-01T06:55:51.141 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 06:55:50 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-z[50054]: 2024-04-01T06:55:50.772+0000 7f7541351200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-01T06:55:51.141 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 06:55:50 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-z[50054]: 2024-04-01T06:55:50.920+0000 7f7541351200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-01T06:55:51.890 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 06:55:51 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-z[50054]: 2024-04-01T06:55:51.543+0000 7f7541351200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-01T06:55:51.890 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 06:55:51 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-z[50054]: 2024-04-01T06:55:51.725+0000 7f7541351200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-01T06:55:51.922 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:55:51 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-y[49294]: 2024-04-01T06:55:51.549+0000 7f731399d200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-01T06:55:51.923 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:55:51 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-y[49294]: 2024-04-01T06:55:51.729+0000 7f731399d200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-01T06:55:51.979 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:55:51 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:55:51.599+0000 7f5739c76200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-01T06:55:51.979 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:55:51 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:55:51.781+0000 7f5739c76200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-01T06:55:52.252 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:55:51 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-y[49294]: 2024-04-01T06:55:51.923+0000 7f731399d200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-01T06:55:52.262 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:55:51 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:55:51.978+0000 7f5739c76200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-01T06:55:52.390 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 06:55:51 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-z[50054]: 2024-04-01T06:55:51.920+0000 7f7541351200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-01T06:55:53.140 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 06:55:52 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-z[50054]: 2024-04-01T06:55:52.855+0000 7f7541351200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-01T06:55:53.144 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:55:52 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-y[49294]: 2024-04-01T06:55:52.857+0000 7f731399d200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-01T06:55:53.206 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:55:52 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:55:52.912+0000 7f5739c76200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-01T06:55:53.424 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:55:53 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-y[49294]: 2024-04-01T06:55:53.145+0000 7f731399d200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-01T06:55:53.424 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:55:53 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-y[49294]: 2024-04-01T06:55:53.234+0000 7f731399d200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-01T06:55:53.424 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 06:55:53 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-z[50054]: 2024-04-01T06:55:53.143+0000 7f7541351200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-01T06:55:53.424 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 06:55:53 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-z[50054]: 2024-04-01T06:55:53.233+0000 7f7541351200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-01T06:55:53.495 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:55:53 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:55:53.206+0000 7f5739c76200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-01T06:55:53.495 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:55:53 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:55:53.298+0000 7f5739c76200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-01T06:55:53.495 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:55:53 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:55:53.494+0000 7f5739c76200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-01T06:55:53.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:53.497+0000 7fd094ff9700 1 -- 172.21.15.83:0/2150853049 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mgrmap(e 19) v1 ==== 135933+0+0 (secure 0 0 0) 0x7fd088096690 con 0x7fd098100d20 2024-04-01T06:55:53.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:53.518+0000 7fd094ff9700 1 -- 172.21.15.83:0/2150853049 <== mon.0 v2:172.21.15.83:3300/0 8 ==== mgrmap(e 20) v1 ==== 135550+0+0 (secure 0 0 0) 0x7fd0880a1f70 con 0x7fd098100d20 2024-04-01T06:55:53.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:53.519+0000 7fd094ff9700 1 -- 172.21.15.83:0/2150853049 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd0800a1300 msgr2=0x7fd0800a37c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-01T06:55:53.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:53.519+0000 7fd094ff9700 1 --2- 172.21.15.83:0/2150853049 >> [v2:172.21.15.83:6800/3375372052,v1:172.21.15.83:6801/3375372052] conn(0x7fd0800a1300 0x7fd0800a37c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:53.719 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 06:55:53 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-y[49294]: 2024-04-01T06:55:53.424+0000 7f731399d200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-01T06:55:53.719 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:53 smithi145 ceph-mon[47816]: Standby manager daemon z restarted 2024-04-01T06:55:53.719 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:53 smithi145 ceph-mon[47816]: Standby manager daemon z started 2024-04-01T06:55:53.719 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:53 smithi145 ceph-mon[47816]: Standby manager daemon y restarted 2024-04-01T06:55:53.720 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:53 smithi145 ceph-mon[47816]: Standby manager daemon y started 2024-04-01T06:55:53.720 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:53 smithi145 ceph-mon[47816]: from='mgr.? 172.21.15.145:0/2581690451' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-01T06:55:53.720 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:53 smithi145 ceph-mon[47816]: from='mgr.? 172.21.15.153:0/1998354640' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-01T06:55:53.720 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:53 smithi145 ceph-mon[47816]: from='mgr.? 172.21.15.153:0/1998354640' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-01T06:55:53.720 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:53 smithi145 ceph-mon[47816]: from='mgr.? 172.21.15.145:0/2581690451' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-01T06:55:53.720 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:53 smithi145 ceph-mon[47816]: from='mgr.? 172.21.15.153:0/1998354640' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-01T06:55:53.720 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:53 smithi145 ceph-mon[47816]: from='mgr.? 172.21.15.145:0/2581690451' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-01T06:55:53.720 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:53 smithi145 ceph-mon[47816]: from='mgr.? 172.21.15.145:0/2581690451' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-01T06:55:53.720 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:53 smithi145 ceph-mon[47816]: from='mgr.? 172.21.15.153:0/1998354640' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-01T06:55:53.732 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 06:55:53 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-z[50054]: 2024-04-01T06:55:53.423+0000 7f7541351200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-01T06:55:53.732 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:53 smithi153 ceph-mon[48187]: Standby manager daemon z restarted 2024-04-01T06:55:53.733 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:53 smithi153 ceph-mon[48187]: Standby manager daemon z started 2024-04-01T06:55:53.733 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:53 smithi153 ceph-mon[48187]: Standby manager daemon y restarted 2024-04-01T06:55:53.733 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:53 smithi153 ceph-mon[48187]: Standby manager daemon y started 2024-04-01T06:55:53.733 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:53 smithi153 ceph-mon[48187]: from='mgr.? 172.21.15.145:0/2581690451' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-01T06:55:53.733 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:53 smithi153 ceph-mon[48187]: from='mgr.? 172.21.15.153:0/1998354640' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-01T06:55:53.733 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:53 smithi153 ceph-mon[48187]: from='mgr.? 172.21.15.153:0/1998354640' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-01T06:55:53.733 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:53 smithi153 ceph-mon[48187]: from='mgr.? 172.21.15.145:0/2581690451' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-01T06:55:53.733 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:53 smithi153 ceph-mon[48187]: from='mgr.? 172.21.15.153:0/1998354640' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-01T06:55:53.733 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:53 smithi153 ceph-mon[48187]: from='mgr.? 172.21.15.145:0/2581690451' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-01T06:55:53.733 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:53 smithi153 ceph-mon[48187]: from='mgr.? 172.21.15.145:0/2581690451' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-01T06:55:53.733 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:53 smithi153 ceph-mon[48187]: from='mgr.? 172.21.15.153:0/1998354640' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-01T06:55:53.745 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:53 smithi083 ceph-mon[43429]: Standby manager daemon z restarted 2024-04-01T06:55:53.745 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:53 smithi083 ceph-mon[43429]: Standby manager daemon z started 2024-04-01T06:55:53.745 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:53 smithi083 ceph-mon[43429]: Standby manager daemon y restarted 2024-04-01T06:55:53.745 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:53 smithi083 ceph-mon[43429]: Standby manager daemon y started 2024-04-01T06:55:53.745 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:53 smithi083 ceph-mon[43429]: from='mgr.? 172.21.15.145:0/2581690451' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-01T06:55:53.745 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:53 smithi083 ceph-mon[43429]: from='mgr.? 172.21.15.153:0/1998354640' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-01T06:55:53.745 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:53 smithi083 ceph-mon[43429]: from='mgr.? 172.21.15.153:0/1998354640' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-01T06:55:53.745 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:53 smithi083 ceph-mon[43429]: from='mgr.? 172.21.15.145:0/2581690451' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-01T06:55:53.745 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:53 smithi083 ceph-mon[43429]: from='mgr.? 172.21.15.153:0/1998354640' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-01T06:55:53.745 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:53 smithi083 ceph-mon[43429]: from='mgr.? 172.21.15.145:0/2581690451' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-01T06:55:53.745 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:53 smithi083 ceph-mon[43429]: from='mgr.? 172.21.15.145:0/2581690451' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-01T06:55:53.746 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:53 smithi083 ceph-mon[43429]: from='mgr.? 172.21.15.153:0/1998354640' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-01T06:55:54.012 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:55:53 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:55:53.765+0000 7f569882d700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-01T06:55:54.012 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:55:53 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:55:53.765+0000 7f569882d700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-01T06:55:54.013 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:55:53 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:55:53.765+0000 7f569882d700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-01T06:55:54.013 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:55:53 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:55:53.765+0000 7f569882d700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-01T06:55:54.013 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:55:53 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:55:53.765+0000 7f569882d700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-01T06:55:54.013 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:55:53 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:55:53.765+0000 7f569b833700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-01T06:55:54.013 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:55:53 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:55:53.765+0000 7f569b833700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-01T06:55:54.013 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:55:53 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:55:53.765+0000 7f569b833700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-01T06:55:54.013 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:55:53 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:55:53.765+0000 7f569b833700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-01T06:55:54.013 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:55:53 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:55:53.765+0000 7f569b833700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-01T06:55:54.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:54.524+0000 7fd094ff9700 1 -- 172.21.15.83:0/2150853049 <== mon.0 v2:172.21.15.83:3300/0 9 ==== mgrmap(e 21) v1 ==== 135677+0+0 (secure 0 0 0) 0x7fd0880504d0 con 0x7fd098100d20 2024-04-01T06:55:54.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:54.524+0000 7fd094ff9700 1 --2- 172.21.15.83:0/2150853049 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fd0800346e0 0x7fd080034ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:54.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:54.524+0000 7fd094ff9700 1 -- 172.21.15.83:0/2150853049 --> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) v1 -- 0x7fd098108e00 con 0x7fd0800346e0 2024-04-01T06:55:54.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:54.526+0000 7fd096ffd700 1 --2- 172.21.15.83:0/2150853049 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fd0800346e0 0x7fd080034ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:54.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:54.528+0000 7fd096ffd700 1 --2- 172.21.15.83:0/2150853049 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fd0800346e0 0x7fd080034ac0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd08c009990 tx=0x7fd08c00b7d0 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:54.587 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:54.588+0000 7fd094ff9700 1 -- 172.21.15.83:0/2150853049 <== mgr.15420 v2:172.21.15.83:6800/3294653546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fd098108e00 con 0x7fd0800346e0 2024-04-01T06:55:54.588 INFO:teuthology.orchestra.run.smithi083.stdout:Schedule set for path / 2024-04-01T06:55:54.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:54.590+0000 7fd09dbda700 1 -- 172.21.15.83:0/2150853049 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fd0800346e0 msgr2=0x7fd080034ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:54.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:54.590+0000 7fd09dbda700 1 --2- 172.21.15.83:0/2150853049 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fd0800346e0 0x7fd080034ac0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd08c009990 tx=0x7fd08c00b7d0 comp rx=0 tx=0).stop 2024-04-01T06:55:54.590 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:54.590+0000 7fd09dbda700 1 -- 172.21.15.83:0/2150853049 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd098100d20 msgr2=0x7fd098198e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:54.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:54.590+0000 7fd09dbda700 1 --2- 172.21.15.83:0/2150853049 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd098100d20 0x7fd098198e20 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fd08800e970 tx=0x7fd08800ec80 comp rx=0 tx=0).stop 2024-04-01T06:55:54.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:54.590+0000 7fd097fff700 1 -- 172.21.15.83:0/2150853049 reap_dead start 2024-04-01T06:55:54.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:54.590+0000 7fd09dbda700 1 -- 172.21.15.83:0/2150853049 shutdown_connections 2024-04-01T06:55:54.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:54.591+0000 7fd09dbda700 1 -- 172.21.15.83:0/2150853049 >> 172.21.15.83:0/2150853049 conn(0x7fd0980fc2b0 msgr2=0x7fd0981076e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:54.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:54.591+0000 7fd09dbda700 1 -- 172.21.15.83:0/2150853049 shutdown_connections 2024-04-01T06:55:54.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:54.591+0000 7fd09dbda700 1 -- 172.21.15.83:0/2150853049 wait complete. 2024-04-01T06:55:54.603 DEBUG:teuthology.orchestra.run.smithi083:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-04-01T06:55:54.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:54.750+0000 7f5ca5eca700 1 -- 172.21.15.83:0/962997268 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ca0101790 msgr2=0x7f5ca0108040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:54.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:54.750+0000 7f5ca5eca700 1 --2- 172.21.15.83:0/962997268 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ca0101790 0x7f5ca0108040 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f5c980099c0 tx=0x7f5c98009cd0 comp rx=0 tx=0).stop 2024-04-01T06:55:54.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:54.750+0000 7f5ca5eca700 1 -- 172.21.15.83:0/962997268 shutdown_connections 2024-04-01T06:55:54.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:54.750+0000 7f5ca5eca700 1 --2- 172.21.15.83:0/962997268 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ca0101790 0x7f5ca0108040 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:54.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:54.750+0000 7f5ca5eca700 1 --2- 172.21.15.83:0/962997268 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ca00ffc00 0x7f5ca0100020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:54.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:54.750+0000 7f5ca5eca700 1 --2- 172.21.15.83:0/962997268 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5ca0100df0 0x7f5ca0101250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:54.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:54.750+0000 7f5ca5eca700 1 -- 172.21.15.83:0/962997268 >> 172.21.15.83:0/962997268 conn(0x7f5ca00fb170 msgr2=0x7f5ca00fd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:54.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:54.750+0000 7f5ca5eca700 1 -- 172.21.15.83:0/962997268 shutdown_connections 2024-04-01T06:55:54.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:54.751+0000 7f5ca5eca700 1 -- 172.21.15.83:0/962997268 wait complete. 2024-04-01T06:55:54.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:54.751+0000 7f5ca5eca700 1 Processor -- start 2024-04-01T06:55:54.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:54.751+0000 7f5ca5eca700 1 -- start start 2024-04-01T06:55:54.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:54.751+0000 7f5ca5eca700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5ca00ffc00 0x7f5ca01949e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:54.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:54.751+0000 7f5ca5eca700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ca0100df0 0x7f5ca0194f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:54.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:54.751+0000 7f5ca5eca700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ca0101790 0x7f5ca019bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:54.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:54.751+0000 7f5ca5eca700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca019c510 con 0x7f5ca0100df0 2024-04-01T06:55:54.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:54.752+0000 7f5ca5eca700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca006a7d0 con 0x7f5ca00ffc00 2024-04-01T06:55:54.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:54.752+0000 7f5ca5eca700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca006a960 con 0x7f5ca0101790 2024-04-01T06:55:54.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:54.752+0000 7f5c9f7fe700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5ca00ffc00 0x7f5ca01949e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:54.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:54.752+0000 7f5c9f7fe700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5ca00ffc00 0x7f5ca01949e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.83:42076/0 (socket says 172.21.15.83:42076) 2024-04-01T06:55:54.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:54.752+0000 7f5c9f7fe700 1 -- 172.21.15.83:0/3015117600 learned_addr learned my addr 172.21.15.83:0/3015117600 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:54.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:54.752+0000 7f5c9effd700 1 --2- 172.21.15.83:0/3015117600 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ca0100df0 0x7f5ca0194f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:54.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:54.752+0000 7f5c9ffff700 1 --2- 172.21.15.83:0/3015117600 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ca0101790 0x7f5ca019bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:54.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:54.752+0000 7f5c9f7fe700 1 -- 172.21.15.83:0/3015117600 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ca0101790 msgr2=0x7f5ca019bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:54.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:54.752+0000 7f5c9f7fe700 1 --2- 172.21.15.83:0/3015117600 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ca0101790 0x7f5ca019bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:54.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:54.752+0000 7f5c9f7fe700 1 -- 172.21.15.83:0/3015117600 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ca0100df0 msgr2=0x7f5ca0194f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:54.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:54.752+0000 7f5c9f7fe700 1 --2- 172.21.15.83:0/3015117600 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ca0100df0 0x7f5ca0194f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:54.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:54.752+0000 7f5c9f7fe700 1 -- 172.21.15.83:0/3015117600 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c980095f0 con 0x7f5ca00ffc00 2024-04-01T06:55:54.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:54.752+0000 7f5c9f7fe700 1 --2- 172.21.15.83:0/3015117600 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5ca00ffc00 0x7f5ca01949e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5c9000efc0 tx=0x7f5c9000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:54.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:54.752+0000 7f5c9cff9700 1 -- 172.21.15.83:0/3015117600 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c90018070 con 0x7f5ca00ffc00 2024-04-01T06:55:54.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:54.753+0000 7f5ca5eca700 1 -- 172.21.15.83:0/3015117600 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ca006abe0 con 0x7f5ca00ffc00 2024-04-01T06:55:54.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:54.753+0000 7f5c9cff9700 1 -- 172.21.15.83:0/3015117600 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5c9000f040 con 0x7f5ca00ffc00 2024-04-01T06:55:54.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:54.753+0000 7f5c9cff9700 1 -- 172.21.15.83:0/3015117600 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c90004280 con 0x7f5ca00ffc00 2024-04-01T06:55:54.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:54.753+0000 7f5ca5eca700 1 -- 172.21.15.83:0/3015117600 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ca006b140 con 0x7f5ca00ffc00 2024-04-01T06:55:54.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:54.753+0000 7f5ca5eca700 1 -- 172.21.15.83:0/3015117600 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ca0106fb0 con 0x7f5ca00ffc00 2024-04-01T06:55:54.756 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:54 smithi145 ceph-mon[47816]: mgrmap e19: x(active, since 6m), standbys: z, y 2024-04-01T06:55:54.756 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:54 smithi145 ceph-mon[47816]: Active manager daemon x restarted 2024-04-01T06:55:54.756 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:54 smithi145 ceph-mon[47816]: Activating manager daemon x 2024-04-01T06:55:54.756 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:54 smithi145 ceph-mon[47816]: osdmap e82: 12 total, 12 up, 12 in 2024-04-01T06:55:54.756 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:54 smithi145 ceph-mon[47816]: mgrmap e20: x(active, starting, since 0.0123051s), standbys: z, y 2024-04-01T06:55:54.757 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:54 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T06:55:54.757 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:54 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T06:55:54.757 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:54 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T06:55:54.757 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:54 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-01T06:55:54.757 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:54 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-01T06:55:54.757 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:54 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-01T06:55:54.757 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:54 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-01T06:55:54.757 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:54 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-01T06:55:54.757 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:54 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-01T06:55:54.757 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:54 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-01T06:55:54.758 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:54 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-01T06:55:54.758 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:54 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-01T06:55:54.758 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:54 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-01T06:55:54.758 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:54 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-01T06:55:54.758 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:54 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-01T06:55:54.758 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:54 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-01T06:55:54.758 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:54 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-01T06:55:54.758 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:54 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-01T06:55:54.758 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:54 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-01T06:55:54.758 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:54 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-01T06:55:54.758 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:54 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-01T06:55:54.758 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:54 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-01T06:55:54.758 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:54 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-01T06:55:54.759 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:54 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-01T06:55:54.759 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:54 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-01T06:55:54.759 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:54 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-01T06:55:54.759 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:54 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-01T06:55:54.759 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:54 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-01T06:55:54.759 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:54 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-01T06:55:54.759 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:54 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-01T06:55:54.759 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:54 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-01T06:55:54.759 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:54 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-01T06:55:54.759 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:54 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-01T06:55:54.759 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:54 smithi145 ceph-mon[47816]: Manager daemon x is now available 2024-04-01T06:55:54.759 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:54 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:55:54.759 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:54 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-01T06:55:54.759 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:54 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-01T06:55:54.760 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:54.755+0000 7f5c9cff9700 1 -- 172.21.15.83:0/3015117600 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 21) v1 ==== 135677+0+0 (secure 0 0 0) 0x7f5c90003a00 con 0x7f5ca00ffc00 2024-04-01T06:55:54.760 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:54.755+0000 7f5c9cff9700 1 --2- 172.21.15.83:0/3015117600 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f5c8c0a0f20 0x7f5c8c0a33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:54.760 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:54.756+0000 7f5c9effd700 1 --2- 172.21.15.83:0/3015117600 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f5c8c0a0f20 0x7f5c8c0a33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:54.760 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:54.756+0000 7f5c9cff9700 1 -- 172.21.15.83:0/3015117600 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f5c900cce30 con 0x7f5ca00ffc00 2024-04-01T06:55:54.760 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:54.756+0000 7f5c9effd700 1 --2- 172.21.15.83:0/3015117600 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f5c8c0a0f20 0x7f5c8c0a33e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5c8800be70 tx=0x7f5c8800d040 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:54.760 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:54.759+0000 7f5c9cff9700 1 -- 172.21.15.83:0/3015117600 <== mon.2 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f5c90096840 con 0x7f5ca00ffc00 2024-04-01T06:55:54.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:54 smithi083 ceph-mon[43429]: mgrmap e19: x(active, since 6m), standbys: z, y 2024-04-01T06:55:54.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:54 smithi083 ceph-mon[43429]: Active manager daemon x restarted 2024-04-01T06:55:54.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:54 smithi083 ceph-mon[43429]: Activating manager daemon x 2024-04-01T06:55:54.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:54 smithi083 ceph-mon[43429]: osdmap e82: 12 total, 12 up, 12 in 2024-04-01T06:55:54.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:54 smithi083 ceph-mon[43429]: mgrmap e20: x(active, starting, since 0.0123051s), standbys: z, y 2024-04-01T06:55:54.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:54 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T06:55:54.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:54 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T06:55:54.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:54 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T06:55:54.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:54 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-01T06:55:54.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:54 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-01T06:55:54.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:54 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-01T06:55:54.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:54 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-01T06:55:54.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:54 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-01T06:55:54.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:54 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-01T06:55:54.764 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:54 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-01T06:55:54.764 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:54 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-01T06:55:54.764 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:54 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-01T06:55:54.764 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:54 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-01T06:55:54.764 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:54 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-01T06:55:54.764 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:54 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-01T06:55:54.764 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:54 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-01T06:55:54.764 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:54 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-01T06:55:54.764 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:54 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-01T06:55:54.764 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:54 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-01T06:55:54.764 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:54 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-01T06:55:54.764 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:54 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-01T06:55:54.764 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:54 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-01T06:55:54.764 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:54 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-01T06:55:54.764 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:54 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-01T06:55:54.765 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:54 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-01T06:55:54.765 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:54 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-01T06:55:54.765 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:54 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-01T06:55:54.765 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:54 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-01T06:55:54.765 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:54 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-01T06:55:54.765 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:54 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-01T06:55:54.765 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:54 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-01T06:55:54.765 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:54 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-01T06:55:54.765 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:54 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-01T06:55:54.765 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:54 smithi083 ceph-mon[43429]: Manager daemon x is now available 2024-04-01T06:55:54.765 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:54 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:55:54.765 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:54 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-01T06:55:54.765 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:54 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-01T06:55:54.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:54 smithi153 ceph-mon[48187]: mgrmap e19: x(active, since 6m), standbys: z, y 2024-04-01T06:55:54.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:54 smithi153 ceph-mon[48187]: Active manager daemon x restarted 2024-04-01T06:55:54.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:54 smithi153 ceph-mon[48187]: Activating manager daemon x 2024-04-01T06:55:54.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:54 smithi153 ceph-mon[48187]: osdmap e82: 12 total, 12 up, 12 in 2024-04-01T06:55:54.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:54 smithi153 ceph-mon[48187]: mgrmap e20: x(active, starting, since 0.0123051s), standbys: z, y 2024-04-01T06:55:54.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:54 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-01T06:55:54.892 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:54 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-01T06:55:54.892 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:54 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-01T06:55:54.892 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:54 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-01T06:55:54.892 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:54 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-01T06:55:54.892 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:54 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-01T06:55:54.892 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:54 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-01T06:55:54.892 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:54 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-01T06:55:54.892 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:54 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-01T06:55:54.892 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:54 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-01T06:55:54.892 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:54 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-01T06:55:54.892 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:54 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-01T06:55:54.892 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:54 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-01T06:55:54.892 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:54 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-01T06:55:54.892 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:54 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-01T06:55:54.892 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:54 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-01T06:55:54.893 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:54 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-01T06:55:54.893 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:54 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-01T06:55:54.893 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:54 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-01T06:55:54.893 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:54 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-01T06:55:54.893 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:54 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-01T06:55:54.893 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:54 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-01T06:55:54.893 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:54 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-01T06:55:54.893 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:54 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-01T06:55:54.893 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:54 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-01T06:55:54.893 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:54 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-01T06:55:54.893 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:54 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-01T06:55:54.893 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:54 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-01T06:55:54.893 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:54 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-01T06:55:54.893 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:54 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-01T06:55:54.894 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:54 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-01T06:55:54.894 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:54 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-01T06:55:54.894 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:54 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-01T06:55:54.894 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:54 smithi153 ceph-mon[48187]: Manager daemon x is now available 2024-04-01T06:55:54.894 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:54 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:55:54.894 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:54 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-01T06:55:54.894 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:54 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-01T06:55:55.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.026+0000 7f5ca5eca700 1 -- 172.21.15.83:0/3015117600 --> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) v1 -- 0x7f5ca0061290 con 0x7f5c8c0a0f20 2024-04-01T06:55:55.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.090+0000 7f5c9cff9700 1 -- 172.21.15.83:0/3015117600 <== mgr.15420 v2:172.21.15.83:6800/3294653546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f5ca0061290 con 0x7f5c8c0a0f20 2024-04-01T06:55:55.090 INFO:teuthology.orchestra.run.smithi083.stdout:Retention added to path / 2024-04-01T06:55:55.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.092+0000 7f5ca5eca700 1 -- 172.21.15.83:0/3015117600 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f5c8c0a0f20 msgr2=0x7f5c8c0a33e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:55.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.092+0000 7f5ca5eca700 1 --2- 172.21.15.83:0/3015117600 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f5c8c0a0f20 0x7f5c8c0a33e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5c8800be70 tx=0x7f5c8800d040 comp rx=0 tx=0).stop 2024-04-01T06:55:55.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.092+0000 7f5ca5eca700 1 -- 172.21.15.83:0/3015117600 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5ca00ffc00 msgr2=0x7f5ca01949e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:55.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.092+0000 7f5ca5eca700 1 --2- 172.21.15.83:0/3015117600 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5ca00ffc00 0x7f5ca01949e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5c9000efc0 tx=0x7f5c9000c3a0 comp rx=0 tx=0).stop 2024-04-01T06:55:55.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.092+0000 7f5ca5eca700 1 -- 172.21.15.83:0/3015117600 shutdown_connections 2024-04-01T06:55:55.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.092+0000 7f5ca5eca700 1 --2- 172.21.15.83:0/3015117600 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f5c8c0a0f20 0x7f5c8c0a33e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:55.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.092+0000 7f5ca5eca700 1 --2- 172.21.15.83:0/3015117600 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ca0101790 0x7f5ca019bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:55.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.092+0000 7f5ca5eca700 1 --2- 172.21.15.83:0/3015117600 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5ca00ffc00 0x7f5ca01949e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:55.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.092+0000 7f5ca5eca700 1 --2- 172.21.15.83:0/3015117600 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5ca0100df0 0x7f5ca0194f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:55.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.092+0000 7f5ca5eca700 1 -- 172.21.15.83:0/3015117600 >> 172.21.15.83:0/3015117600 conn(0x7f5ca00fb170 msgr2=0x7f5ca01040f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:55.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.092+0000 7f5ca5eca700 1 -- 172.21.15.83:0/3015117600 shutdown_connections 2024-04-01T06:55:55.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.092+0000 7f5ca5eca700 1 -- 172.21.15.83:0/3015117600 wait complete. 2024-04-01T06:55:55.107 DEBUG:teuthology.orchestra.run.smithi083:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-04-01T06:55:55.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.237+0000 7fac80f07700 1 -- 172.21.15.83:0/381958665 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac7c1069e0 msgr2=0x7fac7c108e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:55.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.237+0000 7fac80f07700 1 --2- 172.21.15.83:0/381958665 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac7c1069e0 0x7fac7c108e50 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fac7400b0a0 tx=0x7fac7400b3b0 comp rx=0 tx=0).stop 2024-04-01T06:55:55.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.237+0000 7fac80f07700 1 -- 172.21.15.83:0/381958665 shutdown_connections 2024-04-01T06:55:55.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.237+0000 7fac80f07700 1 --2- 172.21.15.83:0/381958665 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac7c1069e0 0x7fac7c108e50 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:55.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.237+0000 7fac80f07700 1 --2- 172.21.15.83:0/381958665 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fac7c101780 0x7fac7c103b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:55.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.237+0000 7fac80f07700 1 --2- 172.21.15.83:0/381958665 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac7c1040b0 0x7fac7c1064a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:55.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.237+0000 7fac80f07700 1 -- 172.21.15.83:0/381958665 >> 172.21.15.83:0/381958665 conn(0x7fac7c0fb170 msgr2=0x7fac7c0fd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:55.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.237+0000 7fac80f07700 1 -- 172.21.15.83:0/381958665 shutdown_connections 2024-04-01T06:55:55.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.237+0000 7fac80f07700 1 -- 172.21.15.83:0/381958665 wait complete. 2024-04-01T06:55:55.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.238+0000 7fac80f07700 1 Processor -- start 2024-04-01T06:55:55.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.238+0000 7fac80f07700 1 -- start start 2024-04-01T06:55:55.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.239+0000 7fac80f07700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac7c101780 0x7fac7c1010a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:55.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.239+0000 7fac80f07700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac7c1040b0 0x7fac7c0ff730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:55.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.239+0000 7fac80f07700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fac7c1069e0 0x7fac7c0ffc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:55.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.239+0000 7fac80f07700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac7c100410 con 0x7fac7c1040b0 2024-04-01T06:55:55.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.239+0000 7fac80f07700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac7c100580 con 0x7fac7c1069e0 2024-04-01T06:55:55.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.239+0000 7fac80f07700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac7c1a0dc0 con 0x7fac7c101780 2024-04-01T06:55:55.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.239+0000 7fac79d9b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac7c1040b0 0x7fac7c0ff730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:55.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.239+0000 7fac7a59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac7c101780 0x7fac7c1010a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:55.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.239+0000 7fac79d9b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac7c1040b0 0x7fac7c0ff730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:60208/0 (socket says 172.21.15.83:60208) 2024-04-01T06:55:55.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.239+0000 7fac7a59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac7c101780 0x7fac7c1010a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.83:52538/0 (socket says 172.21.15.83:52538) 2024-04-01T06:55:55.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.239+0000 7fac79d9b700 1 -- 172.21.15.83:0/3433564004 learned_addr learned my addr 172.21.15.83:0/3433564004 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:55.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.239+0000 7fac7ad9d700 1 --2- 172.21.15.83:0/3433564004 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fac7c1069e0 0x7fac7c0ffc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:55.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.239+0000 7fac79d9b700 1 -- 172.21.15.83:0/3433564004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac7c101780 msgr2=0x7fac7c1010a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:55.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.239+0000 7fac79d9b700 1 --2- 172.21.15.83:0/3433564004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac7c101780 0x7fac7c1010a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:55.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.239+0000 7fac79d9b700 1 -- 172.21.15.83:0/3433564004 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fac7c1069e0 msgr2=0x7fac7c0ffc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:55.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.239+0000 7fac79d9b700 1 --2- 172.21.15.83:0/3433564004 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fac7c1069e0 0x7fac7c0ffc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:55.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.239+0000 7fac79d9b700 1 -- 172.21.15.83:0/3433564004 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac74009d00 con 0x7fac7c1040b0 2024-04-01T06:55:55.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.239+0000 7fac7a59c700 1 --2- 172.21.15.83:0/3433564004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac7c101780 0x7fac7c1010a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T06:55:55.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.239+0000 7fac79d9b700 1 --2- 172.21.15.83:0/3433564004 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac7c1040b0 0x7fac7c0ff730 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fac7000e9a0 tx=0x7fac7000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:55.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.239+0000 7fac6b7fe700 1 -- 172.21.15.83:0/3433564004 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac70009790 con 0x7fac7c1040b0 2024-04-01T06:55:55.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.239+0000 7fac80f07700 1 -- 172.21.15.83:0/3433564004 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac7c1a0ff0 con 0x7fac7c1040b0 2024-04-01T06:55:55.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.239+0000 7fac6b7fe700 1 -- 172.21.15.83:0/3433564004 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fac7000ce70 con 0x7fac7c1040b0 2024-04-01T06:55:55.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.240+0000 7fac6b7fe700 1 -- 172.21.15.83:0/3433564004 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac70018420 con 0x7fac7c1040b0 2024-04-01T06:55:55.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.240+0000 7fac80f07700 1 -- 172.21.15.83:0/3433564004 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac7c1a1520 con 0x7fac7c1040b0 2024-04-01T06:55:55.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.240+0000 7fac80f07700 1 -- 172.21.15.83:0/3433564004 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac7c0fccf0 con 0x7fac7c1040b0 2024-04-01T06:55:55.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.242+0000 7fac6b7fe700 1 -- 172.21.15.83:0/3433564004 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 21) v1 ==== 135677+0+0 (secure 0 0 0) 0x7fac700106f0 con 0x7fac7c1040b0 2024-04-01T06:55:55.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.243+0000 7fac6b7fe700 1 --2- 172.21.15.83:0/3433564004 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fac640a0f20 0x7fac640a33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:55.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.243+0000 7fac7a59c700 1 --2- 172.21.15.83:0/3433564004 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fac640a0f20 0x7fac640a33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:55.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.243+0000 7fac6b7fe700 1 -- 172.21.15.83:0/3433564004 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8425+0+0 (secure 0 0 0) 0x7fac70014070 con 0x7fac7c1040b0 2024-04-01T06:55:55.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.243+0000 7fac7a59c700 1 --2- 172.21.15.83:0/3433564004 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fac640a0f20 0x7fac640a33e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fac6c011490 tx=0x7fac6c009260 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:55.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.246+0000 7fac6b7fe700 1 -- 172.21.15.83:0/3433564004 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7fac70096550 con 0x7fac7c1040b0 2024-04-01T06:55:55.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.482+0000 7fac80f07700 1 -- 172.21.15.83:0/3433564004 --> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) v1 -- 0x7fac7c02cd20 con 0x7fac640a0f20 2024-04-01T06:55:55.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.502+0000 7fac6b7fe700 1 -- 172.21.15.83:0/3433564004 <== mgr.15420 v2:172.21.15.83:6800/3294653546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+298 (secure 0 0 0) 0x7fac7c02cd20 con 0x7fac640a0f20 2024-04-01T06:55:55.502 INFO:teuthology.orchestra.run.smithi083.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-04-01T00:00:00", "created": "2024-04-01T06:55:54", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-04-01T06:55:55.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.504+0000 7fac80f07700 1 -- 172.21.15.83:0/3433564004 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fac640a0f20 msgr2=0x7fac640a33e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:55.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.504+0000 7fac80f07700 1 --2- 172.21.15.83:0/3433564004 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fac640a0f20 0x7fac640a33e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fac6c011490 tx=0x7fac6c009260 comp rx=0 tx=0).stop 2024-04-01T06:55:55.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.504+0000 7fac80f07700 1 -- 172.21.15.83:0/3433564004 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac7c1040b0 msgr2=0x7fac7c0ff730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:55.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.504+0000 7fac80f07700 1 --2- 172.21.15.83:0/3433564004 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac7c1040b0 0x7fac7c0ff730 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fac7000e9a0 tx=0x7fac7000ecb0 comp rx=0 tx=0).stop 2024-04-01T06:55:55.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.504+0000 7fac80f07700 1 -- 172.21.15.83:0/3433564004 shutdown_connections 2024-04-01T06:55:55.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.504+0000 7fac80f07700 1 --2- 172.21.15.83:0/3433564004 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fac640a0f20 0x7fac640a33e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:55.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.504+0000 7fac80f07700 1 --2- 172.21.15.83:0/3433564004 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fac7c1069e0 0x7fac7c0ffc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:55.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.504+0000 7fac80f07700 1 --2- 172.21.15.83:0/3433564004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac7c101780 0x7fac7c1010a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:55.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.504+0000 7fac80f07700 1 --2- 172.21.15.83:0/3433564004 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fac7c1040b0 0x7fac7c0ff730 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:55.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.504+0000 7fac80f07700 1 -- 172.21.15.83:0/3433564004 >> 172.21.15.83:0/3433564004 conn(0x7fac7c0fb170 msgr2=0x7fac7c102020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:55.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.505+0000 7fac80f07700 1 -- 172.21.15.83:0/3433564004 shutdown_connections 2024-04-01T06:55:55.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.505+0000 7fac80f07700 1 -- 172.21.15.83:0/3433564004 wait complete. 2024-04-01T06:55:55.520 DEBUG:teuthology.orchestra.run.smithi083:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-04-01T06:55:55.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.655+0000 7fc7f4ead700 1 -- 172.21.15.83:0/480632316 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7f0106a20 msgr2=0x7fc7f0108e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:55.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.655+0000 7fc7f4ead700 1 --2- 172.21.15.83:0/480632316 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7f0106a20 0x7fc7f0108e90 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fc7e800b0a0 tx=0x7fc7e800b3b0 comp rx=0 tx=0).stop 2024-04-01T06:55:55.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.655+0000 7fc7f4ead700 1 -- 172.21.15.83:0/480632316 shutdown_connections 2024-04-01T06:55:55.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.655+0000 7fc7f4ead700 1 --2- 172.21.15.83:0/480632316 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7f0106a20 0x7fc7f0108e90 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:55.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.655+0000 7fc7f4ead700 1 --2- 172.21.15.83:0/480632316 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc7f01017c0 0x7fc7f0103bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:55.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.655+0000 7fc7f4ead700 1 --2- 172.21.15.83:0/480632316 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7f01040f0 0x7fc7f01064e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:55.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.655+0000 7fc7f4ead700 1 -- 172.21.15.83:0/480632316 >> 172.21.15.83:0/480632316 conn(0x7fc7f00fb1b0 msgr2=0x7fc7f00fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:55.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.655+0000 7fc7f4ead700 1 -- 172.21.15.83:0/480632316 shutdown_connections 2024-04-01T06:55:55.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.655+0000 7fc7f4ead700 1 -- 172.21.15.83:0/480632316 wait complete. 2024-04-01T06:55:55.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.656+0000 7fc7f4ead700 1 Processor -- start 2024-04-01T06:55:55.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.656+0000 7fc7f4ead700 1 -- start start 2024-04-01T06:55:55.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.656+0000 7fc7f4ead700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc7f01017c0 0x7fc7f0196d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:55.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.656+0000 7fc7f4ead700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7f01040f0 0x7fc7f01972c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:55.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.656+0000 7fc7f4ead700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7f0106a20 0x7fc7f019e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:55.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.656+0000 7fc7f4ead700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f019e870 con 0x7fc7f0106a20 2024-04-01T06:55:55.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.656+0000 7fc7f4ead700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f019e9e0 con 0x7fc7f01017c0 2024-04-01T06:55:55.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.656+0000 7fc7f4ead700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f019eba0 con 0x7fc7f01040f0 2024-04-01T06:55:55.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.656+0000 7fc7eed9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7f0106a20 0x7fc7f019e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:55.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.656+0000 7fc7ee59c700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc7f01017c0 0x7fc7f0196d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:55.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.656+0000 7fc7ee59c700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc7f01017c0 0x7fc7f0196d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.83:42138/0 (socket says 172.21.15.83:42138) 2024-04-01T06:55:55.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.656+0000 7fc7ee59c700 1 -- 172.21.15.83:0/2647674908 learned_addr learned my addr 172.21.15.83:0/2647674908 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:55:55.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.656+0000 7fc7edd9b700 1 --2- 172.21.15.83:0/2647674908 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7f01040f0 0x7fc7f01972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:55.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.656+0000 7fc7ee59c700 1 -- 172.21.15.83:0/2647674908 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7f01040f0 msgr2=0x7fc7f01972c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:55.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.656+0000 7fc7ee59c700 1 --2- 172.21.15.83:0/2647674908 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7f01040f0 0x7fc7f01972c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:55.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.657+0000 7fc7ee59c700 1 -- 172.21.15.83:0/2647674908 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7f0106a20 msgr2=0x7fc7f019e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:55.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.657+0000 7fc7ee59c700 1 --2- 172.21.15.83:0/2647674908 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7f0106a20 0x7fc7f019e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:55.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.657+0000 7fc7ee59c700 1 -- 172.21.15.83:0/2647674908 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e8009d00 con 0x7fc7f01017c0 2024-04-01T06:55:55.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.657+0000 7fc7eed9d700 1 --2- 172.21.15.83:0/2647674908 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7f0106a20 0x7fc7f019e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T06:55:55.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.657+0000 7fc7ee59c700 1 --2- 172.21.15.83:0/2647674908 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc7f01017c0 0x7fc7f0196d80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc7e000d950 tx=0x7fc7e000dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:55.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.657+0000 7fc7df7fe700 1 -- 172.21.15.83:0/2647674908 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e000f890 con 0x7fc7f01017c0 2024-04-01T06:55:55.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.657+0000 7fc7f4ead700 1 -- 172.21.15.83:0/2647674908 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7f019ee80 con 0x7fc7f01017c0 2024-04-01T06:55:55.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.657+0000 7fc7df7fe700 1 -- 172.21.15.83:0/2647674908 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc7e0010460 con 0x7fc7f01017c0 2024-04-01T06:55:55.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.657+0000 7fc7df7fe700 1 -- 172.21.15.83:0/2647674908 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e000e610 con 0x7fc7f01017c0 2024-04-01T06:55:55.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.657+0000 7fc7f4ead700 1 -- 172.21.15.83:0/2647674908 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7f019f2b0 con 0x7fc7f01017c0 2024-04-01T06:55:55.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.658+0000 7fc7f4ead700 1 -- 172.21.15.83:0/2647674908 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7f00fcd30 con 0x7fc7f01017c0 2024-04-01T06:55:55.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.659+0000 7fc7df7fe700 1 -- 172.21.15.83:0/2647674908 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 21) v1 ==== 135677+0+0 (secure 0 0 0) 0x7fc7e00108d0 con 0x7fc7f01017c0 2024-04-01T06:55:55.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.659+0000 7fc7df7fe700 1 --2- 172.21.15.83:0/2647674908 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fc7d80a0f20 0x7fc7d80a33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:55:55.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.660+0000 7fc7edd9b700 1 --2- 172.21.15.83:0/2647674908 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fc7d80a0f20 0x7fc7d80a33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:55:55.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.660+0000 7fc7df7fe700 1 -- 172.21.15.83:0/2647674908 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8425+0+0 (secure 0 0 0) 0x7fc7e00cc340 con 0x7fc7f01017c0 2024-04-01T06:55:55.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.660+0000 7fc7edd9b700 1 --2- 172.21.15.83:0/2647674908 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fc7d80a0f20 0x7fc7d80a33e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4009c60 tx=0x7fc7e4009260 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:55:55.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.663+0000 7fc7df7fe700 1 -- 172.21.15.83:0/2647674908 <== mon.2 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7fc7e0095cc0 con 0x7fc7f01017c0 2024-04-01T06:55:55.890 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:55 smithi153 ceph-mon[48187]: [01/Apr/2024:06:55:53] ENGINE Bus STARTING 2024-04-01T06:55:55.890 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:55 smithi153 ceph-mon[48187]: [01/Apr/2024:06:55:54] ENGINE Serving on https://172.21.15.83:7150 2024-04-01T06:55:55.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:55 smithi153 ceph-mon[48187]: [01/Apr/2024:06:55:54] ENGINE Serving on http://172.21.15.83:8765 2024-04-01T06:55:55.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:55 smithi153 ceph-mon[48187]: [01/Apr/2024:06:55:54] ENGINE Bus STARTED 2024-04-01T06:55:55.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:55 smithi153 ceph-mon[48187]: mgrmap e21: x(active, since 1.0172s), standbys: z, y 2024-04-01T06:55:55.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:55 smithi153 ceph-mon[48187]: from='client.15441 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:55:55.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:55 smithi153 ceph-mon[48187]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T06:55:55.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:55 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:55.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:55 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:55.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:55 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:55.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:55 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:55.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:55 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:55.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:55 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:55.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.912+0000 7fc7f4ead700 1 -- 172.21.15.83:0/2647674908 --> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fc7f002cdc0 con 0x7fc7d80a0f20 2024-04-01T06:55:55.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.919+0000 7fc7df7fe700 1 -- 172.21.15.83:0/2647674908 <== mgr.15420 v2:172.21.15.83:6800/3294653546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+10 (secure 0 0 0) 0x7fc7f002cdc0 con 0x7fc7d80a0f20 2024-04-01T06:55:55.919 INFO:teuthology.orchestra.run.smithi083.stdout:/ 1m 6m3h 2024-04-01T06:55:55.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.921+0000 7fc7f4ead700 1 -- 172.21.15.83:0/2647674908 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fc7d80a0f20 msgr2=0x7fc7d80a33e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:55.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.921+0000 7fc7f4ead700 1 --2- 172.21.15.83:0/2647674908 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fc7d80a0f20 0x7fc7d80a33e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4009c60 tx=0x7fc7e4009260 comp rx=0 tx=0).stop 2024-04-01T06:55:55.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.921+0000 7fc7f4ead700 1 -- 172.21.15.83:0/2647674908 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc7f01017c0 msgr2=0x7fc7f0196d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:55:55.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.921+0000 7fc7f4ead700 1 --2- 172.21.15.83:0/2647674908 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc7f01017c0 0x7fc7f0196d80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc7e000d950 tx=0x7fc7e000dc60 comp rx=0 tx=0).stop 2024-04-01T06:55:55.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.921+0000 7fc7f4ead700 1 -- 172.21.15.83:0/2647674908 shutdown_connections 2024-04-01T06:55:55.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.921+0000 7fc7f4ead700 1 --2- 172.21.15.83:0/2647674908 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fc7d80a0f20 0x7fc7d80a33e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:55.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.921+0000 7fc7f4ead700 1 --2- 172.21.15.83:0/2647674908 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7f0106a20 0x7fc7f019e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:55.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.921+0000 7fc7f4ead700 1 --2- 172.21.15.83:0/2647674908 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc7f01017c0 0x7fc7f0196d80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:55.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.921+0000 7fc7f4ead700 1 --2- 172.21.15.83:0/2647674908 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7f01040f0 0x7fc7f01972c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:55:55.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.921+0000 7fc7f4ead700 1 -- 172.21.15.83:0/2647674908 >> 172.21.15.83:0/2647674908 conn(0x7fc7f00fb1b0 msgr2=0x7fc7f0102060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:55:55.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.921+0000 7fc7f4ead700 1 -- 172.21.15.83:0/2647674908 shutdown_connections 2024-04-01T06:55:55.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:55:55.921+0000 7fc7f4ead700 1 -- 172.21.15.83:0/2647674908 wait complete. 2024-04-01T06:55:55.933 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:55 smithi083 ceph-mon[43429]: [01/Apr/2024:06:55:53] ENGINE Bus STARTING 2024-04-01T06:55:55.933 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:55 smithi083 ceph-mon[43429]: [01/Apr/2024:06:55:54] ENGINE Serving on https://172.21.15.83:7150 2024-04-01T06:55:55.933 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:55 smithi083 ceph-mon[43429]: [01/Apr/2024:06:55:54] ENGINE Serving on http://172.21.15.83:8765 2024-04-01T06:55:55.933 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:55 smithi083 ceph-mon[43429]: [01/Apr/2024:06:55:54] ENGINE Bus STARTED 2024-04-01T06:55:55.933 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:55 smithi083 ceph-mon[43429]: mgrmap e21: x(active, since 1.0172s), standbys: z, y 2024-04-01T06:55:55.934 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:55 smithi083 ceph-mon[43429]: from='client.15441 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:55:55.934 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:55 smithi083 ceph-mon[43429]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T06:55:55.934 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:55 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:55.934 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:55 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:55.934 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:55 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:55.934 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:55 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:55.934 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:55 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:55.934 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:55 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:55.935 DEBUG:teuthology.orchestra.run.smithi083:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-04-01T06:55:55.963 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-04-01T06:55:55.992 INFO:teuthology.run_tasks:Running task background_exec... 2024-04-01T06:55:56.013 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi083.front.sepia.ceph.com 2024-04-01T06:55:56.013 DEBUG:teuthology.orchestra.run.smithi083:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-04-01T06:55:56.014 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:55 smithi145 ceph-mon[47816]: [01/Apr/2024:06:55:53] ENGINE Bus STARTING 2024-04-01T06:55:56.014 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:55 smithi145 ceph-mon[47816]: [01/Apr/2024:06:55:54] ENGINE Serving on https://172.21.15.83:7150 2024-04-01T06:55:56.014 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:55 smithi145 ceph-mon[47816]: [01/Apr/2024:06:55:54] ENGINE Serving on http://172.21.15.83:8765 2024-04-01T06:55:56.014 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:55 smithi145 ceph-mon[47816]: [01/Apr/2024:06:55:54] ENGINE Bus STARTED 2024-04-01T06:55:56.014 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:55 smithi145 ceph-mon[47816]: mgrmap e21: x(active, since 1.0172s), standbys: z, y 2024-04-01T06:55:56.014 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:55 smithi145 ceph-mon[47816]: from='client.15441 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:55:56.014 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:55 smithi145 ceph-mon[47816]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T06:55:56.014 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:55 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:56.014 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:55 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:56.014 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:55 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:56.014 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:55 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:56.015 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:55 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:56.015 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:55 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:56.016 INFO:teuthology.run_tasks:Running task workunit... 2024-04-01T06:55:56.039 INFO:tasks.workunit:Pulling workunits from ref 5df3435b30085cc9abc1eb282ab0f20651c8a39a 2024-04-01T06:55:56.040 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-01T06:55:56.040 INFO:tasks.workunit:timeout=6h 2024-04-01T06:55:56.040 INFO:tasks.workunit:cleanup=True 2024-04-01T06:55:56.040 DEBUG:teuthology.orchestra.run.smithi083:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-01T06:55:56.059 INFO:teuthology.orchestra.run.smithi083.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-01T06:55:56.059 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-04-01T06:55:56.059 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 7ch/124d Inode: 1099511628283 Links: 2 2024-04-01T06:55:56.059 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-01T06:55:56.059 INFO:teuthology.orchestra.run.smithi083.stdout:Context: system_u:object_r:cephfs_t:s0 2024-04-01T06:55:56.059 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2024-04-01 06:54:35.286179696 +0000 2024-04-01T06:55:56.059 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2024-04-01 06:54:35.286179696 +0000 2024-04-01T06:55:56.060 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2024-04-01 06:55:37.588990570 +0000 2024-04-01T06:55:56.060 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: 2024-04-01 06:54:35.286179696 +0000 2024-04-01T06:55:56.060 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-01T06:55:56.060 DEBUG:teuthology.orchestra.run.smithi083:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-01T06:55:56.133 DEBUG:teuthology.orchestra.run.smithi083:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 5df3435b30085cc9abc1eb282ab0f20651c8a39a 2024-04-01T06:55:56.197 INFO:tasks.workunit.client.0.smithi083.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-01T06:55:56.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:56 smithi153 ceph-mon[48187]: from='client.25052 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:55:56.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:56 smithi153 ceph-mon[48187]: from='client.15489 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:55:56.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:56 smithi153 ceph-mon[48187]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T06:55:56.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:56 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:56.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:56 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:56.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:56 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:55:56.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:56 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:55:56.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:56 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:55:56.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:56 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:55:56.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:56 smithi153 ceph-mon[48187]: Adjusting osd_memory_target on smithi145 to 182.4M 2024-04-01T06:55:56.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:56 smithi153 ceph-mon[48187]: Unable to set osd_memory_target on smithi145 to 191356928: error parsing value: Value '191356928' is below minimum 939524096 2024-04-01T06:55:56.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:56 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:56.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:56 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:56.892 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:56 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:55:56.892 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:56 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:55:56.892 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:56 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:55:56.892 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:56 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:55:56.892 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:56 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:56.892 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:56 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:56.892 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:56 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:55:56.892 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:56 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:55:56.892 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:56 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:55:56.892 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:56 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:55:56.892 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:56 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:55:56.892 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:56 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:55:56.892 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:56 smithi153 ceph-mon[48187]: mgrmap e22: x(active, since 3s), standbys: z, y 2024-04-01T06:55:57.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:56 smithi145 ceph-mon[47816]: from='client.25052 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:55:57.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:56 smithi145 ceph-mon[47816]: from='client.15489 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:55:57.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:56 smithi145 ceph-mon[47816]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T06:55:57.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:56 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:57.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:56 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:57.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:56 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:55:57.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:56 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:55:57.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:56 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:55:57.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:56 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:55:57.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:56 smithi145 ceph-mon[47816]: Adjusting osd_memory_target on smithi145 to 182.4M 2024-04-01T06:55:57.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:56 smithi145 ceph-mon[47816]: Unable to set osd_memory_target on smithi145 to 191356928: error parsing value: Value '191356928' is below minimum 939524096 2024-04-01T06:55:57.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:56 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:57.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:56 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:57.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:56 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:55:57.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:56 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:55:57.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:56 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:55:57.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:56 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:55:57.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:56 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:57.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:56 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:57.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:56 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:55:57.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:56 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:55:57.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:56 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:55:57.005 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:56 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:55:57.005 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:56 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:55:57.005 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:56 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:55:57.005 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:56 smithi145 ceph-mon[47816]: mgrmap e22: x(active, since 3s), standbys: z, y 2024-04-01T06:55:57.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:56 smithi083 ceph-mon[43429]: from='client.25052 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:55:57.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:56 smithi083 ceph-mon[43429]: from='client.15489 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:55:57.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:56 smithi083 ceph-mon[43429]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T06:55:57.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:56 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:57.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:56 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:57.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:56 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:55:57.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:56 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:55:57.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:56 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:55:57.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:56 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:55:57.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:56 smithi083 ceph-mon[43429]: Adjusting osd_memory_target on smithi145 to 182.4M 2024-04-01T06:55:57.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:56 smithi083 ceph-mon[43429]: Unable to set osd_memory_target on smithi145 to 191356928: error parsing value: Value '191356928' is below minimum 939524096 2024-04-01T06:55:57.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:56 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:57.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:56 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:57.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:56 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:55:57.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:56 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:55:57.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:56 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:55:57.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:56 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:55:57.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:56 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:57.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:56 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:57.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:56 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:55:57.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:56 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:55:57.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:56 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:55:57.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:56 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-01T06:55:57.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:56 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:55:57.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:56 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:55:57.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:56 smithi083 ceph-mon[43429]: mgrmap e22: x(active, since 3s), standbys: z, y 2024-04-01T06:55:57.890 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:57 smithi153 ceph-mon[48187]: Adjusting osd_memory_target on smithi083 to 182.5M 2024-04-01T06:55:57.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:57 smithi153 ceph-mon[48187]: Unable to set osd_memory_target on smithi083 to 191370547: error parsing value: Value '191370547' is below minimum 939524096 2024-04-01T06:55:57.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:57 smithi153 ceph-mon[48187]: Adjusting osd_memory_target on smithi153 to 182.5M 2024-04-01T06:55:57.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:57 smithi153 ceph-mon[48187]: Unable to set osd_memory_target on smithi153 to 191374848: error parsing value: Value '191374848' is below minimum 939524096 2024-04-01T06:55:57.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:57 smithi153 ceph-mon[48187]: Updating smithi083:/etc/ceph/ceph.conf 2024-04-01T06:55:57.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:57 smithi153 ceph-mon[48187]: Updating smithi145:/etc/ceph/ceph.conf 2024-04-01T06:55:57.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:57 smithi153 ceph-mon[48187]: Updating smithi153:/etc/ceph/ceph.conf 2024-04-01T06:55:57.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:57 smithi153 ceph-mon[48187]: from='client.25070 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:55:57.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:57 smithi153 ceph-mon[48187]: Updating smithi145:/var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-04-01T06:55:57.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:57 smithi153 ceph-mon[48187]: Updating smithi083:/var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-04-01T06:55:57.892 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:57 smithi153 ceph-mon[48187]: Updating smithi153:/var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-04-01T06:55:57.892 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:57 smithi153 ceph-mon[48187]: Updating smithi145:/etc/ceph/ceph.client.admin.keyring 2024-04-01T06:55:57.892 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:57 smithi153 ceph-mon[48187]: Updating smithi153:/etc/ceph/ceph.client.admin.keyring 2024-04-01T06:55:57.892 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:57 smithi153 ceph-mon[48187]: Updating smithi083:/etc/ceph/ceph.client.admin.keyring 2024-04-01T06:55:57.892 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:57 smithi153 ceph-mon[48187]: Updating smithi153:/var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-01T06:55:57.892 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:57 smithi153 ceph-mon[48187]: Updating smithi145:/var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-01T06:55:57.892 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:57 smithi153 ceph-mon[48187]: Updating smithi083:/var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-01T06:55:57.892 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:57 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:57.892 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:57 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:57.892 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:57 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:57.893 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:57 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:57.893 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:57 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:57.893 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:57 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:57.893 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:57 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:57.893 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:57 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:55:57.893 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:57 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:55:57.893 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:57 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:55:57.893 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:57 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:58.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:57 smithi145 ceph-mon[47816]: Adjusting osd_memory_target on smithi083 to 182.5M 2024-04-01T06:55:58.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:57 smithi145 ceph-mon[47816]: Unable to set osd_memory_target on smithi083 to 191370547: error parsing value: Value '191370547' is below minimum 939524096 2024-04-01T06:55:58.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:57 smithi145 ceph-mon[47816]: Adjusting osd_memory_target on smithi153 to 182.5M 2024-04-01T06:55:58.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:57 smithi145 ceph-mon[47816]: Unable to set osd_memory_target on smithi153 to 191374848: error parsing value: Value '191374848' is below minimum 939524096 2024-04-01T06:55:58.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:57 smithi145 ceph-mon[47816]: Updating smithi083:/etc/ceph/ceph.conf 2024-04-01T06:55:58.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:57 smithi145 ceph-mon[47816]: Updating smithi145:/etc/ceph/ceph.conf 2024-04-01T06:55:58.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:57 smithi145 ceph-mon[47816]: Updating smithi153:/etc/ceph/ceph.conf 2024-04-01T06:55:58.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:57 smithi145 ceph-mon[47816]: from='client.25070 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:55:58.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:57 smithi145 ceph-mon[47816]: Updating smithi145:/var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-04-01T06:55:58.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:57 smithi145 ceph-mon[47816]: Updating smithi083:/var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-04-01T06:55:58.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:57 smithi145 ceph-mon[47816]: Updating smithi153:/var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-04-01T06:55:58.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:57 smithi145 ceph-mon[47816]: Updating smithi145:/etc/ceph/ceph.client.admin.keyring 2024-04-01T06:55:58.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:57 smithi145 ceph-mon[47816]: Updating smithi153:/etc/ceph/ceph.client.admin.keyring 2024-04-01T06:55:58.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:57 smithi145 ceph-mon[47816]: Updating smithi083:/etc/ceph/ceph.client.admin.keyring 2024-04-01T06:55:58.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:57 smithi145 ceph-mon[47816]: Updating smithi153:/var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-01T06:55:58.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:57 smithi145 ceph-mon[47816]: Updating smithi145:/var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-01T06:55:58.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:57 smithi145 ceph-mon[47816]: Updating smithi083:/var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-01T06:55:58.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:57 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:58.005 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:57 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:58.005 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:57 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:58.005 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:57 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:58.005 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:57 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:58.005 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:57 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:58.005 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:57 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:58.005 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:57 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:55:58.005 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:57 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:55:58.005 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:57 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:55:58.005 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:57 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:58.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:57 smithi083 ceph-mon[43429]: Adjusting osd_memory_target on smithi083 to 182.5M 2024-04-01T06:55:58.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:57 smithi083 ceph-mon[43429]: Unable to set osd_memory_target on smithi083 to 191370547: error parsing value: Value '191370547' is below minimum 939524096 2024-04-01T06:55:58.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:57 smithi083 ceph-mon[43429]: Adjusting osd_memory_target on smithi153 to 182.5M 2024-04-01T06:55:58.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:57 smithi083 ceph-mon[43429]: Unable to set osd_memory_target on smithi153 to 191374848: error parsing value: Value '191374848' is below minimum 939524096 2024-04-01T06:55:58.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:57 smithi083 ceph-mon[43429]: Updating smithi083:/etc/ceph/ceph.conf 2024-04-01T06:55:58.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:57 smithi083 ceph-mon[43429]: Updating smithi145:/etc/ceph/ceph.conf 2024-04-01T06:55:58.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:57 smithi083 ceph-mon[43429]: Updating smithi153:/etc/ceph/ceph.conf 2024-04-01T06:55:58.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:57 smithi083 ceph-mon[43429]: from='client.25070 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T06:55:58.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:57 smithi083 ceph-mon[43429]: Updating smithi145:/var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-04-01T06:55:58.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:57 smithi083 ceph-mon[43429]: Updating smithi083:/var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-04-01T06:55:58.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:57 smithi083 ceph-mon[43429]: Updating smithi153:/var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/config/ceph.conf 2024-04-01T06:55:58.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:57 smithi083 ceph-mon[43429]: Updating smithi145:/etc/ceph/ceph.client.admin.keyring 2024-04-01T06:55:58.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:57 smithi083 ceph-mon[43429]: Updating smithi153:/etc/ceph/ceph.client.admin.keyring 2024-04-01T06:55:58.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:57 smithi083 ceph-mon[43429]: Updating smithi083:/etc/ceph/ceph.client.admin.keyring 2024-04-01T06:55:58.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:57 smithi083 ceph-mon[43429]: Updating smithi153:/var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-01T06:55:58.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:57 smithi083 ceph-mon[43429]: Updating smithi145:/var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-01T06:55:58.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:57 smithi083 ceph-mon[43429]: Updating smithi083:/var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/config/ceph.client.admin.keyring 2024-04-01T06:55:58.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:57 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:58.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:57 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:58.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:57 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:58.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:57 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:58.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:57 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:58.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:57 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:58.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:57 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:58.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:57 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:55:58.015 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:57 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:55:58.015 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:57 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:55:58.016 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:57 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:55:58.890 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:58 smithi153 ceph-mon[48187]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T06:55:58.890 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:55:58 smithi153 ceph-mon[48187]: mgrmap e23: x(active, since 4s), standbys: z, y 2024-04-01T06:55:59.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:58 smithi145 ceph-mon[47816]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T06:55:59.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:55:58 smithi145 ceph-mon[47816]: mgrmap e23: x(active, since 4s), standbys: z, y 2024-04-01T06:55:59.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:58 smithi083 ceph-mon[43429]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T06:55:59.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:55:58 smithi083 ceph-mon[43429]: mgrmap e23: x(active, since 4s), standbys: z, y 2024-04-01T06:56:00.512 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:56:00 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:56:00.101+0000 7f567a3f1700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-01T06:56:00.512 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:56:00 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:56:00.101+0000 7f567a3f1700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-01T06:56:00.513 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:56:00 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:56:00.101+0000 7f567a3f1700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-01T06:56:00.513 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:56:00 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:56:00.101+0000 7f567a3f1700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-01T06:56:00.513 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 06:56:00 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T06:56:00.101+0000 7f567a3f1700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-01T06:56:00.890 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:56:00 smithi153 ceph-mon[48187]: pgmap v6: 97 pgs: 97 active+clean; 1.3 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 184 KiB/s wr, 107 op/s 2024-04-01T06:56:01.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:56:00 smithi145 ceph-mon[47816]: pgmap v6: 97 pgs: 97 active+clean; 1.3 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 184 KiB/s wr, 107 op/s 2024-04-01T06:56:01.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:56:00 smithi083 ceph-mon[43429]: pgmap v6: 97 pgs: 97 active+clean; 1.3 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 184 KiB/s wr, 107 op/s 2024-04-01T06:56:03.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:56:02 smithi145 ceph-mon[47816]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 132 KiB/s wr, 76 op/s 2024-04-01T06:56:03.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:56:02 smithi145 ceph-mon[47816]: mgrmap e24: x(active, since 8s), standbys: z, y 2024-04-01T06:56:03.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:56:02 smithi083 ceph-mon[43429]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 132 KiB/s wr, 76 op/s 2024-04-01T06:56:03.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:56:02 smithi083 ceph-mon[43429]: mgrmap e24: x(active, since 8s), standbys: z, y 2024-04-01T06:56:03.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:56:02 smithi153 ceph-mon[48187]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 132 KiB/s wr, 76 op/s 2024-04-01T06:56:03.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:56:02 smithi153 ceph-mon[48187]: mgrmap e24: x(active, since 8s), standbys: z, y 2024-04-01T06:56:05.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:56:04 smithi145 ceph-mon[47816]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 102 KiB/s wr, 59 op/s 2024-04-01T06:56:05.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:56:04 smithi083 ceph-mon[43429]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 102 KiB/s wr, 59 op/s 2024-04-01T06:56:05.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:56:04 smithi153 ceph-mon[48187]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 102 KiB/s wr, 59 op/s 2024-04-01T06:56:07.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:56:06 smithi145 ceph-mon[47816]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 109 KiB/s wr, 68 op/s 2024-04-01T06:56:07.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:56:06 smithi083 ceph-mon[43429]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 109 KiB/s wr, 68 op/s 2024-04-01T06:56:07.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:56:06 smithi153 ceph-mon[48187]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 109 KiB/s wr, 68 op/s 2024-04-01T06:56:09.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:56:08 smithi145 ceph-mon[47816]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 100 KiB/s wr, 62 op/s 2024-04-01T06:56:09.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:56:08 smithi083 ceph-mon[43429]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 100 KiB/s wr, 62 op/s 2024-04-01T06:56:09.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:56:08 smithi153 ceph-mon[48187]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 100 KiB/s wr, 62 op/s 2024-04-01T06:56:09.186 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.183+0000 7f946f8da700 1 -- 172.21.15.83:0/3481486098 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9468105c60 msgr2=0x7f9468106040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:09.186 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.183+0000 7f946f8da700 1 --2- 172.21.15.83:0/3481486098 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9468105c60 0x7f9468106040 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f945c009990 tx=0x7f945c009ca0 comp rx=0 tx=0).stop 2024-04-01T06:56:09.186 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.183+0000 7f946f8da700 1 -- 172.21.15.83:0/3481486098 shutdown_connections 2024-04-01T06:56:09.186 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.183+0000 7f946f8da700 1 --2- 172.21.15.83:0/3481486098 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9468105c60 0x7f9468106040 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:09.186 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.183+0000 7f946f8da700 1 --2- 172.21.15.83:0/3481486098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9468100570 0x7f946810ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:09.186 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.183+0000 7f946f8da700 1 --2- 172.21.15.83:0/3481486098 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f94680ffbb0 0x7f9468100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:09.186 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.183+0000 7f946f8da700 1 -- 172.21.15.83:0/3481486098 >> 172.21.15.83:0/3481486098 conn(0x7f9468076d50 msgr2=0x7f9468077160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:09.186 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.183+0000 7f946f8da700 1 -- 172.21.15.83:0/3481486098 shutdown_connections 2024-04-01T06:56:09.187 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.183+0000 7f946f8da700 1 -- 172.21.15.83:0/3481486098 wait complete. 2024-04-01T06:56:09.187 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.184+0000 7f946f8da700 1 Processor -- start 2024-04-01T06:56:09.187 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.184+0000 7f946f8da700 1 -- start start 2024-04-01T06:56:09.187 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.184+0000 7f946f8da700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f94680ffbb0 0x7f9468197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:09.187 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.184+0000 7f946f8da700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9468100570 0x7f9468198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:09.187 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.184+0000 7f946f8da700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9468105c60 0x7f94681a2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:09.187 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.184+0000 7f946f8da700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9468198d00 con 0x7f9468105c60 2024-04-01T06:56:09.187 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.184+0000 7f946f8da700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94681a3490 con 0x7f94680ffbb0 2024-04-01T06:56:09.187 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.184+0000 7f946f8da700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94681a3600 con 0x7f9468100570 2024-04-01T06:56:09.187 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.184+0000 7f946de77700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9468105c60 0x7f94681a2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:09.187 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.184+0000 7f946de77700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9468105c60 0x7f94681a2f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:40712/0 (socket says 172.21.15.83:40712) 2024-04-01T06:56:09.187 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.184+0000 7f946de77700 1 -- 172.21.15.83:0/1138172908 learned_addr learned my addr 172.21.15.83:0/1138172908 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:09.188 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.184+0000 7f946d676700 1 --2- 172.21.15.83:0/1138172908 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f94680ffbb0 0x7f9468197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:09.188 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.184+0000 7f946ce75700 1 --2- 172.21.15.83:0/1138172908 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9468100570 0x7f9468198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:09.188 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.185+0000 7f946de77700 1 -- 172.21.15.83:0/1138172908 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9468100570 msgr2=0x7f9468198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:09.188 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.185+0000 7f946de77700 1 --2- 172.21.15.83:0/1138172908 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9468100570 0x7f9468198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:09.188 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.185+0000 7f946de77700 1 -- 172.21.15.83:0/1138172908 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f94680ffbb0 msgr2=0x7f9468197ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:09.188 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.185+0000 7f946de77700 1 --2- 172.21.15.83:0/1138172908 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f94680ffbb0 0x7f9468197ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:09.188 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.185+0000 7f946de77700 1 -- 172.21.15.83:0/1138172908 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f945c0095f0 con 0x7f9468105c60 2024-04-01T06:56:09.188 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.185+0000 7f946de77700 1 --2- 172.21.15.83:0/1138172908 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9468105c60 0x7f94681a2f50 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f9460007ee0 tx=0x7f946000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:09.188 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.185+0000 7f945a7fc700 1 -- 172.21.15.83:0/1138172908 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9460017070 con 0x7f9468105c60 2024-04-01T06:56:09.188 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.185+0000 7f945a7fc700 1 -- 172.21.15.83:0/1138172908 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f946000f040 con 0x7f9468105c60 2024-04-01T06:56:09.188 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.185+0000 7f946f8da700 1 -- 172.21.15.83:0/1138172908 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94681a38e0 con 0x7f9468105c60 2024-04-01T06:56:09.188 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.185+0000 7f945a7fc700 1 -- 172.21.15.83:0/1138172908 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9460005580 con 0x7f9468105c60 2024-04-01T06:56:09.188 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.185+0000 7f946f8da700 1 -- 172.21.15.83:0/1138172908 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94681a3df0 con 0x7f9468105c60 2024-04-01T06:56:09.196 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.187+0000 7f945a7fc700 1 -- 172.21.15.83:0/1138172908 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) v1 ==== 136098+0+0 (secure 0 0 0) 0x7f946000db20 con 0x7f9468105c60 2024-04-01T06:56:09.196 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.188+0000 7f945a7fc700 1 --2- 172.21.15.83:0/1138172908 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f94540a13b0 0x7f94540a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:09.196 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.188+0000 7f945a7fc700 1 -- 172.21.15.83:0/1138172908 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f94600cc600 con 0x7f9468105c60 2024-04-01T06:56:09.196 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.188+0000 7f946d676700 1 --2- 172.21.15.83:0/1138172908 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f94540a13b0 0x7f94540a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:09.197 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.188+0000 7f946d676700 1 --2- 172.21.15.83:0/1138172908 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f94540a13b0 0x7f94540a3870 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f945c00b5c0 tx=0x7f945c005960 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:09.197 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.189+0000 7f947ba70b80 1 Processor -- start 2024-04-01T06:56:09.197 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.189+0000 7f947ba70b80 1 -- start start 2024-04-01T06:56:09.197 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.189+0000 7f947ba70b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e852f5100 0x562e852f54e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:09.197 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.189+0000 7f947ba70b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e852f5a20 0x562e85300390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:09.197 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.189+0000 7f947ba70b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562e853008d0 0x562e85302cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:09.197 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.189+0000 7f947ba70b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e8524e930 con 0x562e852f5a20 2024-04-01T06:56:09.197 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.189+0000 7f947ba70b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e8524c2f0 con 0x562e853008d0 2024-04-01T06:56:09.197 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.189+0000 7f947ba70b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e85247be0 con 0x562e852f5100 2024-04-01T06:56:09.197 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.189+0000 7f946ce75700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e852f5a20 0x562e85300390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:09.197 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.189+0000 7f946ce75700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e852f5a20 0x562e85300390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:40722/0 (socket says 172.21.15.83:40722) 2024-04-01T06:56:09.197 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.189+0000 7f946ce75700 1 -- 172.21.15.83:0/1968431779 learned_addr learned my addr 172.21.15.83:0/1968431779 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:09.198 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.190+0000 7f946d676700 1 --2- 172.21.15.83:0/1968431779 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e852f5100 0x562e852f54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:09.198 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.190+0000 7f946de77700 1 --2- 172.21.15.83:0/1968431779 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562e853008d0 0x562e85302cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:09.198 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.190+0000 7f946ce75700 1 -- 172.21.15.83:0/1968431779 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e852f5100 msgr2=0x562e852f54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:09.198 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.190+0000 7f946ce75700 1 --2- 172.21.15.83:0/1968431779 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e852f5100 0x562e852f54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:09.198 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.190+0000 7f946ce75700 1 -- 172.21.15.83:0/1968431779 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562e853008d0 msgr2=0x562e85302cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:09.198 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.190+0000 7f946ce75700 1 --2- 172.21.15.83:0/1968431779 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562e853008d0 0x562e85302cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:09.198 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.190+0000 7f946ce75700 1 -- 172.21.15.83:0/1968431779 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562e850c9350 con 0x562e852f5a20 2024-04-01T06:56:09.198 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.190+0000 7f946d676700 1 --2- 172.21.15.83:0/1968431779 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e852f5100 0x562e852f54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:56:09.198 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.190+0000 7f946de77700 1 --2- 172.21.15.83:0/1968431779 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562e853008d0 0x562e85302cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:56:09.198 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.190+0000 7f946ce75700 1 --2- 172.21.15.83:0/1968431779 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e852f5a20 0x562e85300390 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f946400bcf0 tx=0x7f94640103d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=808f790a946babf3 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:09.198 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.190+0000 7f94537fe700 1 -- 172.21.15.83:0/1968431779 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9464010dc0 con 0x562e852f5a20 2024-04-01T06:56:09.198 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.190+0000 7f94537fe700 1 -- 172.21.15.83:0/1968431779 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9464015070 con 0x562e852f5a20 2024-04-01T06:56:09.199 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.190+0000 7f94537fe700 1 -- 172.21.15.83:0/1968431779 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9464005020 con 0x562e852f5a20 2024-04-01T06:56:09.199 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.191+0000 7f947ba70b80 1 -- 172.21.15.83:0/1968431779 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e852f5a20 msgr2=0x562e85300390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:09.199 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.191+0000 7f947ba70b80 1 --2- 172.21.15.83:0/1968431779 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e852f5a20 0x562e85300390 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f946400bcf0 tx=0x7f94640103d0 comp rx=0 tx=0).stop 2024-04-01T06:56:09.199 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.191+0000 7f947ba70b80 1 -- 172.21.15.83:0/1968431779 shutdown_connections 2024-04-01T06:56:09.199 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.191+0000 7f947ba70b80 1 --2- 172.21.15.83:0/1968431779 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562e853008d0 0x562e85302cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:09.199 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.191+0000 7f947ba70b80 1 --2- 172.21.15.83:0/1968431779 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e852f5100 0x562e852f54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:09.199 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.191+0000 7f947ba70b80 1 --2- 172.21.15.83:0/1968431779 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e852f5a20 0x562e85300390 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:09.199 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.191+0000 7f947ba70b80 1 -- 172.21.15.83:0/1968431779 >> 172.21.15.83:0/1968431779 conn(0x562e85255640 msgr2=0x562e852f1520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:09.199 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.191+0000 7f947ba70b80 1 -- 172.21.15.83:0/1968431779 shutdown_connections 2024-04-01T06:56:09.199 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.191+0000 7f947ba70b80 1 -- 172.21.15.83:0/1968431779 wait complete. 2024-04-01T06:56:09.199 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.191+0000 7f947ba70b80 1 -- start start 2024-04-01T06:56:09.199 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.191+0000 7f947ba70b80 1 Processor -- start 2024-04-01T06:56:09.199 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.192+0000 7f947ba70b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e852f5100 0x562e85300190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:09.200 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.192+0000 7f947ba70b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e852f5a20 0x562e852fd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:09.200 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.192+0000 7f947ba70b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562e853008d0 0x562e852fda60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:09.200 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.192+0000 7f947ba70b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e851e3d20 con 0x562e852f5100 2024-04-01T06:56:09.200 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.192+0000 7f947ba70b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e851e39c0 con 0x562e853008d0 2024-04-01T06:56:09.200 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.192+0000 7f947ba70b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e850cb640 con 0x562e852f5a20 2024-04-01T06:56:09.200 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.192+0000 7f947ba70b80 10 client.0 _ll_register_callbacks cb 0x562e851ed410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:56:09.200 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.192+0000 7f946d676700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e852f5100 0x562e85300190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:09.200 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.192+0000 7f946d676700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e852f5100 0x562e85300190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:40736/0 (socket says 172.21.15.83:40736) 2024-04-01T06:56:09.200 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.192+0000 7f946d676700 1 -- 172.21.15.83:0/2745727278 learned_addr learned my addr 172.21.15.83:0/2745727278 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:09.200 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.192+0000 7f946de77700 1 --2- 172.21.15.83:0/2745727278 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562e853008d0 0x562e852fda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:09.200 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.192+0000 7f946ce75700 1 --2- 172.21.15.83:0/2745727278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e852f5a20 0x562e852fd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:09.200 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.192+0000 7f946d676700 1 -- 172.21.15.83:0/2745727278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e852f5a20 msgr2=0x562e852fd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:09.200 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.192+0000 7f946d676700 1 --2- 172.21.15.83:0/2745727278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e852f5a20 0x562e852fd520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:09.201 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.192+0000 7f946d676700 1 -- 172.21.15.83:0/2745727278 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562e853008d0 msgr2=0x562e852fda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:09.201 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.192+0000 7f946d676700 1 --2- 172.21.15.83:0/2745727278 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562e853008d0 0x562e852fda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:09.201 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.192+0000 7f946d676700 1 -- 172.21.15.83:0/2745727278 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f946400b920 con 0x562e852f5100 2024-04-01T06:56:09.201 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.192+0000 7f946ce75700 1 --2- 172.21.15.83:0/2745727278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e852f5a20 0x562e852fd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:56:09.201 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.192+0000 7f946d676700 1 --2- 172.21.15.83:0/2745727278 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e852f5100 0x562e85300190 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f945c015000 tx=0x7f945c009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=550e626472833c65 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:09.201 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.192+0000 7f9450ff9700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:56:09.201 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.193+0000 7f9450ff9700 1 -- 172.21.15.83:0/2745727278 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945c00f660 con 0x562e852f5100 2024-04-01T06:56:09.201 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.193+0000 7f947ba70b80 1 -- 172.21.15.83:0/2745727278 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562e85208320 con 0x562e852f5100 2024-04-01T06:56:09.201 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.193+0000 7f9450ff9700 1 -- 172.21.15.83:0/2745727278 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f945c003e30 con 0x562e852f5100 2024-04-01T06:56:09.201 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.193+0000 7f9450ff9700 1 -- 172.21.15.83:0/2745727278 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f945c00f7c0 con 0x562e852f5100 2024-04-01T06:56:09.201 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.193+0000 7f947ba70b80 10 client.15519 fetch_fsmap learned FSMap version 24 2024-04-01T06:56:09.201 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.193+0000 7f947ba70b80 1 -- 172.21.15.83:0/2745727278 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x562e85075b00 con 0x562e852f5100 2024-04-01T06:56:09.201 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.193+0000 7f9450ff9700 1 -- 172.21.15.83:0/2745727278 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f945c03c020 con 0x562e852f5100 2024-04-01T06:56:09.201 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.193+0000 7f9450ff9700 1 -- 172.21.15.83:0/2745727278 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f945c0389e0 con 0x562e852f5100 2024-04-01T06:56:09.202 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.193+0000 7f947ba70b80 10 client.15519 fetch_fsmap finished waiting for FSMap version 24 2024-04-01T06:56:09.202 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.193+0000 7f947ba70b80 10 client.15519 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-01T06:56:09.202 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.193+0000 7f947ba70b80 20 client.15519 populate_metadata read hostname 'smithi083' 2024-04-01T06:56:09.202 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.193+0000 7f947ba70b80 1 --2- 172.21.15.83:0/2745727278 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x562e853103c0 0x562e853127e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:09.202 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.193+0000 7f947ba70b80 4 client.15519 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-01T06:56:09.202 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.193+0000 7f947ba70b80 1 -- 172.21.15.83:0/2745727278 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562e852406a0 con 0x562e853103c0 2024-04-01T06:56:09.202 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.193+0000 7f946ce75700 1 --2- 172.21.15.83:0/2745727278 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x562e853103c0 0x562e853127e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:09.202 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.194+0000 7f9450ff9700 10 client.15519 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:56:09.203 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.194+0000 7f946ce75700 1 --2- 172.21.15.83:0/2745727278 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x562e853103c0 0x562e853127e0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9191a5c79c25301 server_cookie=bcdeaa57898ad2b7 in_seq=0 out_seq=0 2024-04-01T06:56:09.203 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.195+0000 7f9450ff9700 1 -- 172.21.15.83:0/2745727278 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562e852406a0 con 0x562e853103c0 2024-04-01T06:56:09.203 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.195+0000 7f9450ff9700 10 client.15519 handle_command_reply: tid=0 2024-04-01T06:56:09.203 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.195+0000 7f947ba70b80 1 client.15519 shutdown 2024-04-01T06:56:09.204 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.195+0000 7f947ba70b80 1 -- 172.21.15.83:0/2745727278 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e852f5100 msgr2=0x562e85300190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:09.204 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.195+0000 7f947ba70b80 1 --2- 172.21.15.83:0/2745727278 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e852f5100 0x562e85300190 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f945c015000 tx=0x7f945c009310 comp rx=0 tx=0).stop 2024-04-01T06:56:09.204 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.195+0000 7f947ba70b80 1 -- 172.21.15.83:0/2745727278 shutdown_connections 2024-04-01T06:56:09.204 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.195+0000 7f947ba70b80 1 --2- 172.21.15.83:0/2745727278 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x562e853103c0 0x562e853127e0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:09.204 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.195+0000 7f947ba70b80 1 --2- 172.21.15.83:0/2745727278 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e852f5100 0x562e85300190 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:09.204 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.195+0000 7f9450ff9700 0 client.15519 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:56:09.204 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.195+0000 7f947ba70b80 1 --2- 172.21.15.83:0/2745727278 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562e853008d0 0x562e852fda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:09.204 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.195+0000 7f947ba70b80 1 --2- 172.21.15.83:0/2745727278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e852f5a20 0x562e852fd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:09.204 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.195+0000 7f947ba70b80 1 -- 172.21.15.83:0/2745727278 >> 172.21.15.83:0/2745727278 conn(0x562e85255640 msgr2=0x562e852f70a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:09.204 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.195+0000 7f947ba70b80 1 -- 172.21.15.83:0/2745727278 shutdown_connections 2024-04-01T06:56:09.204 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.195+0000 7f947ba70b80 1 -- 172.21.15.83:0/2745727278 wait complete. 2024-04-01T06:56:09.204 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.195+0000 7f947ba70b80 20 client.15519 trim_cache size 0 max 16384 2024-04-01T06:56:09.214 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.210+0000 7f947ba70b80 1 Processor -- start 2024-04-01T06:56:09.214 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.210+0000 7f947ba70b80 1 -- start start 2024-04-01T06:56:09.214 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.210+0000 7f947ba70b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e852f5100 0x562e852f8050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:09.214 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.210+0000 7f947ba70b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e852f5a20 0x562e852eb500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:09.214 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.210+0000 7f947ba70b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562e853008d0 0x562e8530c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:09.214 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.210+0000 7f947ba70b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e8530c940 con 0x562e852f5100 2024-04-01T06:56:09.215 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.210+0000 7f947ba70b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e852ed0d0 con 0x562e853008d0 2024-04-01T06:56:09.215 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.210+0000 7f947ba70b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e852f20f0 con 0x562e852f5a20 2024-04-01T06:56:09.215 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.210+0000 7f946d676700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e852f5100 0x562e852f8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:09.215 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.210+0000 7f946d676700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e852f5100 0x562e852f8050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:40746/0 (socket says 172.21.15.83:40746) 2024-04-01T06:56:09.215 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.210+0000 7f946d676700 1 -- 172.21.15.83:0/3989862480 learned_addr learned my addr 172.21.15.83:0/3989862480 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:09.215 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.210+0000 7f946de77700 1 --2- 172.21.15.83:0/3989862480 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562e853008d0 0x562e8530c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:09.215 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.210+0000 7f946d676700 1 -- 172.21.15.83:0/3989862480 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e852f5a20 msgr2=0x562e852eb500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:09.215 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.210+0000 7f946ce75700 1 --2- 172.21.15.83:0/3989862480 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e852f5a20 0x562e852eb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:09.215 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.210+0000 7f946d676700 1 --2- 172.21.15.83:0/3989862480 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e852f5a20 0x562e852eb500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:09.215 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.210+0000 7f946d676700 1 -- 172.21.15.83:0/3989862480 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562e853008d0 msgr2=0x562e8530c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:09.215 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.210+0000 7f946d676700 1 --2- 172.21.15.83:0/3989862480 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562e853008d0 0x562e8530c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:09.215 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.210+0000 7f946d676700 1 -- 172.21.15.83:0/3989862480 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562e8520de40 con 0x562e852f5100 2024-04-01T06:56:09.215 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.210+0000 7f946de77700 1 --2- 172.21.15.83:0/3989862480 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562e853008d0 0x562e8530c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:56:09.215 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.210+0000 7f946ce75700 1 --2- 172.21.15.83:0/3989862480 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e852f5a20 0x562e852eb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:56:09.216 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.210+0000 7f946d676700 1 --2- 172.21.15.83:0/3989862480 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e852f5100 0x562e852f8050 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f945c000c00 tx=0x7f945c00beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=542998ad9d284794 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:09.216 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.211+0000 7f9453fff700 1 -- 172.21.15.83:0/3989862480 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945c038650 con 0x562e852f5100 2024-04-01T06:56:09.216 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.211+0000 7f9453fff700 1 -- 172.21.15.83:0/3989862480 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f945c03c070 con 0x562e852f5100 2024-04-01T06:56:09.216 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.211+0000 7f9453fff700 1 -- 172.21.15.83:0/3989862480 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945c02ec20 con 0x562e852f5100 2024-04-01T06:56:09.216 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.211+0000 7f947ba70b80 1 -- 172.21.15.83:0/3989862480 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e852f5100 msgr2=0x562e852f8050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:09.216 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.211+0000 7f947ba70b80 1 --2- 172.21.15.83:0/3989862480 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e852f5100 0x562e852f8050 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f945c000c00 tx=0x7f945c00beb0 comp rx=0 tx=0).stop 2024-04-01T06:56:09.216 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.211+0000 7f947ba70b80 1 -- 172.21.15.83:0/3989862480 shutdown_connections 2024-04-01T06:56:09.216 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.211+0000 7f947ba70b80 1 --2- 172.21.15.83:0/3989862480 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e852f5100 0x562e852f8050 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:09.216 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.211+0000 7f947ba70b80 1 --2- 172.21.15.83:0/3989862480 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562e853008d0 0x562e8530c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:09.216 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.211+0000 7f947ba70b80 1 --2- 172.21.15.83:0/3989862480 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e852f5a20 0x562e852eb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:09.216 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.211+0000 7f947ba70b80 1 -- 172.21.15.83:0/3989862480 >> 172.21.15.83:0/3989862480 conn(0x562e85255640 msgr2=0x562e8530bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:09.216 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.211+0000 7f947ba70b80 1 -- 172.21.15.83:0/3989862480 shutdown_connections 2024-04-01T06:56:09.216 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.211+0000 7f947ba70b80 1 -- 172.21.15.83:0/3989862480 wait complete. 2024-04-01T06:56:09.216 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.211+0000 7f947ba70b80 1 -- start start 2024-04-01T06:56:09.217 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.212+0000 7f947ba70b80 1 Processor -- start 2024-04-01T06:56:09.217 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.212+0000 7f947ba70b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e852f5100 0x562e85305770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:09.217 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.212+0000 7f947ba70b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562e852f5a20 0x562e85305cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:09.217 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.212+0000 7f947ba70b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e853008d0 0x562e853631b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:09.217 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.212+0000 7f947ba70b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e85306370 con 0x562e852f5100 2024-04-01T06:56:09.217 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.212+0000 7f947ba70b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e853636f0 con 0x562e852f5a20 2024-04-01T06:56:09.217 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.212+0000 7f947ba70b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e85363830 con 0x562e853008d0 2024-04-01T06:56:09.217 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.212+0000 7f947ba70b80 10 client.0 _ll_register_callbacks cb 0x562e851ed410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:56:09.217 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.212+0000 7f946d676700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e852f5100 0x562e85305770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:09.217 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.212+0000 7f946d676700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e852f5100 0x562e85305770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:40762/0 (socket says 172.21.15.83:40762) 2024-04-01T06:56:09.217 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.212+0000 7f946d676700 1 -- 172.21.15.83:0/912760139 learned_addr learned my addr 172.21.15.83:0/912760139 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:09.217 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.212+0000 7f946de77700 1 --2- 172.21.15.83:0/912760139 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e853008d0 0x562e853631b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:09.217 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.212+0000 7f946ce75700 1 --2- 172.21.15.83:0/912760139 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562e852f5a20 0x562e85305cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:09.217 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.212+0000 7f946d676700 1 -- 172.21.15.83:0/912760139 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e853008d0 msgr2=0x562e853631b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:09.218 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.212+0000 7f946d676700 1 --2- 172.21.15.83:0/912760139 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e853008d0 0x562e853631b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:09.218 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.212+0000 7f946d676700 1 -- 172.21.15.83:0/912760139 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562e852f5a20 msgr2=0x562e85305cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:09.218 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.212+0000 7f946d676700 1 --2- 172.21.15.83:0/912760139 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562e852f5a20 0x562e85305cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:09.218 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.212+0000 7f946d676700 1 -- 172.21.15.83:0/912760139 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562e85075b00 con 0x562e852f5100 2024-04-01T06:56:09.218 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.213+0000 7f946d676700 1 --2- 172.21.15.83:0/912760139 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e852f5100 0x562e85305770 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f945c005ae0 tx=0x7f945c02ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fac3b52ca24c395e server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:09.218 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.213+0000 7f9450ff9700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:56:09.218 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.213+0000 7f9450ff9700 1 -- 172.21.15.83:0/912760139 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945c038860 con 0x562e852f5100 2024-04-01T06:56:09.218 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.213+0000 7f9450ff9700 1 -- 172.21.15.83:0/912760139 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f945c03d080 con 0x562e852f5100 2024-04-01T06:56:09.218 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.213+0000 7f947ba70b80 1 -- 172.21.15.83:0/912760139 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9464015070 con 0x562e852f5100 2024-04-01T06:56:09.219 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.213+0000 7f9450ff9700 1 -- 172.21.15.83:0/912760139 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f945c003a70 con 0x562e852f5100 2024-04-01T06:56:09.219 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.213+0000 7f947ba70b80 10 client.15525 fetch_fsmap learned FSMap version 24 2024-04-01T06:56:09.219 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.213+0000 7f947ba70b80 1 -- 172.21.15.83:0/912760139 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x562e850cdc70 con 0x562e852f5100 2024-04-01T06:56:09.219 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.213+0000 7f9450ff9700 1 -- 172.21.15.83:0/912760139 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9464015070 con 0x562e852f5100 2024-04-01T06:56:09.219 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.213+0000 7f9450ff9700 1 -- 172.21.15.83:0/912760139 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f945c04a030 con 0x562e852f5100 2024-04-01T06:56:09.219 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.213+0000 7f947ba70b80 10 client.15525 fetch_fsmap finished waiting for FSMap version 24 2024-04-01T06:56:09.219 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.213+0000 7f947ba70b80 10 client.15525 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-01T06:56:09.219 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.213+0000 7f947ba70b80 20 client.15525 populate_metadata read hostname 'smithi083' 2024-04-01T06:56:09.219 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.213+0000 7f947ba70b80 1 --2- 172.21.15.83:0/912760139 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x562e85364ac0 0x562e85366eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:09.219 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.213+0000 7f947ba70b80 4 client.15525 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-01T06:56:09.219 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.213+0000 7f947ba70b80 1 -- 172.21.15.83:0/912760139 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562e85096c90 con 0x562e85364ac0 2024-04-01T06:56:09.219 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.214+0000 7f946ce75700 1 --2- 172.21.15.83:0/912760139 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x562e85364ac0 0x562e85366eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:09.219 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.214+0000 7f9450ff9700 10 client.15525 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:56:09.219 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.214+0000 7f946ce75700 1 --2- 172.21.15.83:0/912760139 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x562e85364ac0 0x562e85366eb0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f064e5d09ec7e87d server_cookie=e2fd11749d196425 in_seq=0 out_seq=0 2024-04-01T06:56:09.226 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.225+0000 7f9450ff9700 1 -- 172.21.15.83:0/912760139 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562e85096c90 con 0x562e85364ac0 2024-04-01T06:56:09.226 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.225+0000 7f9450ff9700 10 client.15525 handle_command_reply: tid=0 2024-04-01T06:56:09.226 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.225+0000 7f947ba70b80 1 client.15525 shutdown 2024-04-01T06:56:09.226 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.225+0000 7f947ba70b80 1 -- 172.21.15.83:0/912760139 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e852f5100 msgr2=0x562e85305770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:09.226 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.225+0000 7f947ba70b80 1 --2- 172.21.15.83:0/912760139 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e852f5100 0x562e85305770 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f945c005ae0 tx=0x7f945c02ef70 comp rx=0 tx=0).stop 2024-04-01T06:56:09.226 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.226+0000 7f947ba70b80 1 -- 172.21.15.83:0/912760139 shutdown_connections 2024-04-01T06:56:09.226 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.226+0000 7f947ba70b80 1 --2- 172.21.15.83:0/912760139 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x562e85364ac0 0x562e85366eb0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:09.226 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.226+0000 7f947ba70b80 1 --2- 172.21.15.83:0/912760139 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562e852f5100 0x562e85305770 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:09.226 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.226+0000 7f947ba70b80 1 --2- 172.21.15.83:0/912760139 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562e853008d0 0x562e853631b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:09.226 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.226+0000 7f9450ff9700 0 client.15525 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:56:09.226 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.226+0000 7f947ba70b80 1 --2- 172.21.15.83:0/912760139 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562e852f5a20 0x562e85305cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:09.227 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.226+0000 7f947ba70b80 1 -- 172.21.15.83:0/912760139 >> 172.21.15.83:0/912760139 conn(0x562e85255640 msgr2=0x562e852ea3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:09.227 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.226+0000 7f947ba70b80 1 -- 172.21.15.83:0/912760139 shutdown_connections 2024-04-01T06:56:09.227 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.226+0000 7f947ba70b80 1 -- 172.21.15.83:0/912760139 wait complete. 2024-04-01T06:56:09.227 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.226+0000 7f947ba70b80 20 client.15525 trim_cache size 0 max 16384 2024-04-01T06:56:09.227 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout:{ 2024-04-01T06:56:09.227 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout: "message": "", 2024-04-01T06:56:09.227 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout: "return_code": 0 2024-04-01T06:56:09.227 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout:} 2024-04-01T06:56:09.228 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.226+0000 7f946f8da700 1 -- 172.21.15.83:0/1138172908 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f94540a13b0 msgr2=0x7f94540a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:09.229 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.226+0000 7f946f8da700 1 --2- 172.21.15.83:0/1138172908 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f94540a13b0 0x7f94540a3870 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f945c00b5c0 tx=0x7f945c005960 comp rx=0 tx=0).stop 2024-04-01T06:56:09.229 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.226+0000 7f946f8da700 1 -- 172.21.15.83:0/1138172908 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9468105c60 msgr2=0x7f94681a2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:09.229 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.226+0000 7f946f8da700 1 --2- 172.21.15.83:0/1138172908 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9468105c60 0x7f94681a2f50 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f9460007ee0 tx=0x7f946000d3b0 comp rx=0 tx=0).stop 2024-04-01T06:56:09.229 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.226+0000 7f946f8da700 1 -- 172.21.15.83:0/1138172908 shutdown_connections 2024-04-01T06:56:09.229 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.226+0000 7f946f8da700 1 --2- 172.21.15.83:0/1138172908 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f94540a13b0 0x7f94540a3870 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:09.229 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.226+0000 7f946f8da700 1 --2- 172.21.15.83:0/1138172908 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9468105c60 0x7f94681a2f50 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:09.229 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.226+0000 7f946f8da700 1 --2- 172.21.15.83:0/1138172908 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f94680ffbb0 0x7f9468197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:09.229 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.226+0000 7f946f8da700 1 --2- 172.21.15.83:0/1138172908 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9468100570 0x7f9468198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:09.229 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.226+0000 7f946f8da700 1 -- 172.21.15.83:0/1138172908 >> 172.21.15.83:0/1138172908 conn(0x7f9468076d50 msgr2=0x7f94680fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:09.229 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.226+0000 7f946f8da700 1 -- 172.21.15.83:0/1138172908 shutdown_connections 2024-04-01T06:56:09.229 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:09.226+0000 7f946f8da700 1 -- 172.21.15.83:0/1138172908 wait complete. 2024-04-01T06:56:11.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:56:10 smithi145 ceph-mon[47816]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 102 KiB/s wr, 69 op/s 2024-04-01T06:56:11.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:56:10 smithi083 ceph-mon[43429]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 102 KiB/s wr, 69 op/s 2024-04-01T06:56:11.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:56:10 smithi153 ceph-mon[48187]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 102 KiB/s wr, 69 op/s 2024-04-01T06:56:13.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:56:12 smithi145 ceph-mon[47816]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 25 KiB/s wr, 25 op/s 2024-04-01T06:56:13.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:56:12 smithi083 ceph-mon[43429]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 25 KiB/s wr, 25 op/s 2024-04-01T06:56:13.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:56:12 smithi153 ceph-mon[48187]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 25 KiB/s wr, 25 op/s 2024-04-01T06:56:15.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:56:14 smithi145 ceph-mon[47816]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 25 KiB/s wr, 25 op/s 2024-04-01T06:56:15.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:56:14 smithi083 ceph-mon[43429]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 25 KiB/s wr, 25 op/s 2024-04-01T06:56:15.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:56:14 smithi153 ceph-mon[48187]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 25 KiB/s wr, 25 op/s 2024-04-01T06:56:15.653 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-01T06:56:15.654 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-01T06:56:15.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.794+0000 7ff031aa7700 1 -- 172.21.15.83:0/1043281196 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff02c069ef0 msgr2=0x7ff02c105970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:15.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.794+0000 7ff031aa7700 1 --2- 172.21.15.83:0/1043281196 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff02c069ef0 0x7ff02c105970 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7ff0200099c0 tx=0x7ff020009cd0 comp rx=0 tx=0).stop 2024-04-01T06:56:15.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.794+0000 7ff031aa7700 1 -- 172.21.15.83:0/1043281196 shutdown_connections 2024-04-01T06:56:15.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.794+0000 7ff031aa7700 1 --2- 172.21.15.83:0/1043281196 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff02c1060a0 0x7ff02c10dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:15.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.794+0000 7ff031aa7700 1 --2- 172.21.15.83:0/1043281196 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff02c069540 0x7ff02c069920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:15.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.794+0000 7ff031aa7700 1 --2- 172.21.15.83:0/1043281196 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff02c069ef0 0x7ff02c105970 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:15.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.794+0000 7ff031aa7700 1 -- 172.21.15.83:0/1043281196 >> 172.21.15.83:0/1043281196 conn(0x7ff02c076d50 msgr2=0x7ff02c077160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:15.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.794+0000 7ff031aa7700 1 -- 172.21.15.83:0/1043281196 shutdown_connections 2024-04-01T06:56:15.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.794+0000 7ff031aa7700 1 -- 172.21.15.83:0/1043281196 wait complete. 2024-04-01T06:56:15.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.795+0000 7ff031aa7700 1 Processor -- start 2024-04-01T06:56:15.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.795+0000 7ff031aa7700 1 -- start start 2024-04-01T06:56:15.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.795+0000 7ff031aa7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff02c069540 0x7ff02c197160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:15.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.795+0000 7ff031aa7700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff02c1060a0 0x7ff02c1976a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:15.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.795+0000 7ff031aa7700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff02c19ba40 0x7ff02c19bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:15.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.795+0000 7ff031aa7700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff02c19c4c0 con 0x7ff02c1060a0 2024-04-01T06:56:15.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.795+0000 7ff031aa7700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff02c19c630 con 0x7ff02c19ba40 2024-04-01T06:56:15.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.795+0000 7ff031aa7700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff02c19c7f0 con 0x7ff02c069540 2024-04-01T06:56:15.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.795+0000 7ff02affd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff02c1060a0 0x7ff02c1976a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:15.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.795+0000 7ff02affd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff02c1060a0 0x7ff02c1976a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37644/0 (socket says 172.21.15.83:37644) 2024-04-01T06:56:15.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.795+0000 7ff02affd700 1 -- 172.21.15.83:0/4245110565 learned_addr learned my addr 172.21.15.83:0/4245110565 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:15.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.796+0000 7ff02b7fe700 1 --2- 172.21.15.83:0/4245110565 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff02c069540 0x7ff02c197160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:15.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.796+0000 7ff02bfff700 1 --2- 172.21.15.83:0/4245110565 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff02c19ba40 0x7ff02c19bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:15.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.796+0000 7ff02affd700 1 -- 172.21.15.83:0/4245110565 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff02c069540 msgr2=0x7ff02c197160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:15.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.796+0000 7ff02affd700 1 --2- 172.21.15.83:0/4245110565 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff02c069540 0x7ff02c197160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:15.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.796+0000 7ff02affd700 1 -- 172.21.15.83:0/4245110565 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff02c19ba40 msgr2=0x7ff02c19bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:15.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.796+0000 7ff02affd700 1 --2- 172.21.15.83:0/4245110565 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff02c19ba40 0x7ff02c19bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:15.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.796+0000 7ff02affd700 1 -- 172.21.15.83:0/4245110565 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0200095f0 con 0x7ff02c1060a0 2024-04-01T06:56:15.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.796+0000 7ff02bfff700 1 --2- 172.21.15.83:0/4245110565 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff02c19ba40 0x7ff02c19bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:56:15.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.796+0000 7ff02affd700 1 --2- 172.21.15.83:0/4245110565 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff02c1060a0 0x7ff02c1976a0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7ff020006010 tx=0x7ff020005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:15.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.796+0000 7ff028ff9700 1 -- 172.21.15.83:0/4245110565 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02001d070 con 0x7ff02c1060a0 2024-04-01T06:56:15.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.796+0000 7ff028ff9700 1 -- 172.21.15.83:0/4245110565 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff02000fbb0 con 0x7ff02c1060a0 2024-04-01T06:56:15.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.796+0000 7ff031aa7700 1 -- 172.21.15.83:0/4245110565 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff02c1a3cf0 con 0x7ff02c1060a0 2024-04-01T06:56:15.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.796+0000 7ff028ff9700 1 -- 172.21.15.83:0/4245110565 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff020022d40 con 0x7ff02c1060a0 2024-04-01T06:56:15.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.796+0000 7ff031aa7700 1 -- 172.21.15.83:0/4245110565 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff02c1a4110 con 0x7ff02c1060a0 2024-04-01T06:56:15.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.798+0000 7ff028ff9700 1 -- 172.21.15.83:0/4245110565 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) v1 ==== 136098+0+0 (secure 0 0 0) 0x7ff02000fd20 con 0x7ff02c1060a0 2024-04-01T06:56:15.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.799+0000 7ff028ff9700 1 --2- 172.21.15.83:0/4245110565 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7ff0140a13b0 0x7ff0140a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:15.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.799+0000 7ff028ff9700 1 -- 172.21.15.83:0/4245110565 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8425+0+0 (secure 0 0 0) 0x7ff0200ce290 con 0x7ff02c1060a0 2024-04-01T06:56:15.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.799+0000 7ff02b7fe700 1 --2- 172.21.15.83:0/4245110565 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7ff0140a13b0 0x7ff0140a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:15.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.799+0000 7ff02b7fe700 1 --2- 172.21.15.83:0/4245110565 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7ff0140a13b0 0x7ff0140a3870 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff01c005950 tx=0x7ff01c0058e0 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:15.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.800+0000 7ff03dc3db80 1 Processor -- start 2024-04-01T06:56:15.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.800+0000 7ff03dc3db80 1 -- start start 2024-04-01T06:56:15.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.800+0000 7ff03dc3db80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56404ac075d0 0x56404ac079b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:15.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.800+0000 7ff03dc3db80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56404ac07ef0 0x56404ac16cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:15.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.800+0000 7ff03dc3db80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56404ac17200 0x56404ac195f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:15.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.800+0000 7ff03dc3db80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x56404ab60990 con 0x56404ac17200 2024-04-01T06:56:15.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.800+0000 7ff03dc3db80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x56404ab5e350 con 0x56404ac07ef0 2024-04-01T06:56:15.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.800+0000 7ff03dc3db80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x56404ab59c40 con 0x56404ac075d0 2024-04-01T06:56:15.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.800+0000 7ff02bfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56404ac17200 0x56404ac195f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:15.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.800+0000 7ff02bfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56404ac17200 0x56404ac195f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37658/0 (socket says 172.21.15.83:37658) 2024-04-01T06:56:15.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.800+0000 7ff02bfff700 1 -- 172.21.15.83:0/1463271229 learned_addr learned my addr 172.21.15.83:0/1463271229 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:15.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.800+0000 7ff02affd700 1 --2- 172.21.15.83:0/1463271229 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56404ac07ef0 0x56404ac16cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:15.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.800+0000 7ff02b7fe700 1 --2- 172.21.15.83:0/1463271229 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56404ac075d0 0x56404ac079b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:15.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.801+0000 7ff02bfff700 1 -- 172.21.15.83:0/1463271229 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56404ac075d0 msgr2=0x56404ac079b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:15.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.801+0000 7ff02bfff700 1 --2- 172.21.15.83:0/1463271229 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56404ac075d0 0x56404ac079b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:15.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.801+0000 7ff02bfff700 1 -- 172.21.15.83:0/1463271229 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56404ac07ef0 msgr2=0x56404ac16cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:15.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.801+0000 7ff02bfff700 1 --2- 172.21.15.83:0/1463271229 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56404ac07ef0 0x56404ac16cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:15.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.801+0000 7ff02bfff700 1 -- 172.21.15.83:0/1463271229 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56404a9db3b0 con 0x56404ac17200 2024-04-01T06:56:15.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.801+0000 7ff02bfff700 1 --2- 172.21.15.83:0/1463271229 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56404ac17200 0x56404ac195f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7ff024009cd0 tx=0x7ff024007500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cf24f785cb80edd server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:15.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.801+0000 7ff011ffb700 1 -- 172.21.15.83:0/1463271229 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff024014400 con 0x56404ac17200 2024-04-01T06:56:15.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.801+0000 7ff011ffb700 1 -- 172.21.15.83:0/1463271229 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff024014a20 con 0x56404ac17200 2024-04-01T06:56:15.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.801+0000 7ff011ffb700 1 -- 172.21.15.83:0/1463271229 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff024013a00 con 0x56404ac17200 2024-04-01T06:56:15.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.802+0000 7ff03dc3db80 1 -- 172.21.15.83:0/1463271229 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56404ac17200 msgr2=0x56404ac195f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:15.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.802+0000 7ff03dc3db80 1 --2- 172.21.15.83:0/1463271229 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56404ac17200 0x56404ac195f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7ff024009cd0 tx=0x7ff024007500 comp rx=0 tx=0).stop 2024-04-01T06:56:15.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.802+0000 7ff03dc3db80 1 -- 172.21.15.83:0/1463271229 shutdown_connections 2024-04-01T06:56:15.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.802+0000 7ff03dc3db80 1 --2- 172.21.15.83:0/1463271229 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56404ac17200 0x56404ac195f0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:15.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.802+0000 7ff03dc3db80 1 --2- 172.21.15.83:0/1463271229 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56404ac075d0 0x56404ac079b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:15.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.802+0000 7ff03dc3db80 1 --2- 172.21.15.83:0/1463271229 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56404ac07ef0 0x56404ac16cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:15.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.802+0000 7ff03dc3db80 1 -- 172.21.15.83:0/1463271229 >> 172.21.15.83:0/1463271229 conn(0x56404ab676a0 msgr2=0x56404ac03a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:15.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.802+0000 7ff03dc3db80 1 -- 172.21.15.83:0/1463271229 shutdown_connections 2024-04-01T06:56:15.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.802+0000 7ff03dc3db80 1 -- 172.21.15.83:0/1463271229 wait complete. 2024-04-01T06:56:15.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.802+0000 7ff03dc3db80 1 -- start start 2024-04-01T06:56:15.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.802+0000 7ff03dc3db80 1 Processor -- start 2024-04-01T06:56:15.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.803+0000 7ff03dc3db80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56404ac075d0 0x56404ac16bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:15.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.803+0000 7ff03dc3db80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56404ac07ef0 0x56404ac13f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:15.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.803+0000 7ff03dc3db80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56404ac17200 0x56404ac14520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:15.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.803+0000 7ff03dc3db80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x56404aaf5d80 con 0x56404ac17200 2024-04-01T06:56:15.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.803+0000 7ff03dc3db80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x56404aaf5a20 con 0x56404ac07ef0 2024-04-01T06:56:15.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.803+0000 7ff03dc3db80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x56404a9dd6a0 con 0x56404ac075d0 2024-04-01T06:56:15.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.803+0000 7ff03dc3db80 10 client.0 _ll_register_callbacks cb 0x56404aaff470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:56:15.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.803+0000 7ff02bfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56404ac17200 0x56404ac14520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:15.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.803+0000 7ff02bfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56404ac17200 0x56404ac14520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37670/0 (socket says 172.21.15.83:37670) 2024-04-01T06:56:15.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.803+0000 7ff02bfff700 1 -- 172.21.15.83:0/4147579625 learned_addr learned my addr 172.21.15.83:0/4147579625 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:15.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.803+0000 7ff02affd700 1 --2- 172.21.15.83:0/4147579625 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56404ac07ef0 0x56404ac13f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:15.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.803+0000 7ff02b7fe700 1 --2- 172.21.15.83:0/4147579625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56404ac075d0 0x56404ac16bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:15.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.803+0000 7ff02bfff700 1 -- 172.21.15.83:0/4147579625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56404ac075d0 msgr2=0x56404ac16bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:15.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.803+0000 7ff02bfff700 1 --2- 172.21.15.83:0/4147579625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56404ac075d0 0x56404ac16bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:15.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.803+0000 7ff02bfff700 1 -- 172.21.15.83:0/4147579625 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56404ac07ef0 msgr2=0x56404ac13f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:15.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.803+0000 7ff02bfff700 1 --2- 172.21.15.83:0/4147579625 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56404ac07ef0 0x56404ac13f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:15.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.803+0000 7ff02bfff700 1 -- 172.21.15.83:0/4147579625 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff024009900 con 0x56404ac17200 2024-04-01T06:56:15.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.803+0000 7ff02b7fe700 1 --2- 172.21.15.83:0/4147579625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56404ac075d0 0x56404ac16bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:56:15.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.803+0000 7ff02affd700 1 --2- 172.21.15.83:0/4147579625 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56404ac07ef0 0x56404ac13f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:56:15.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.803+0000 7ff02bfff700 1 --2- 172.21.15.83:0/4147579625 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56404ac17200 0x56404ac14520 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ff024008fd0 tx=0x7ff024009690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=844319dc91a3a273 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:15.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.803+0000 7ff00affd700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:56:15.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.803+0000 7ff00affd700 1 -- 172.21.15.83:0/4147579625 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff024014600 con 0x56404ac17200 2024-04-01T06:56:15.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.803+0000 7ff00affd700 1 -- 172.21.15.83:0/4147579625 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8425+0+0 (secure 0 0 0) 0x7ff024004e20 con 0x56404ac17200 2024-04-01T06:56:15.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.803+0000 7ff03dc3db80 1 -- 172.21.15.83:0/4147579625 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56404ab1a380 con 0x56404ac17200 2024-04-01T06:56:15.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.804+0000 7ff00affd700 1 -- 172.21.15.83:0/4147579625 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff024014760 con 0x56404ac17200 2024-04-01T06:56:15.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.804+0000 7ff03dc3db80 10 client.15537 fetch_fsmap learned FSMap version 24 2024-04-01T06:56:15.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.804+0000 7ff03dc3db80 1 -- 172.21.15.83:0/4147579625 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x56404a987b60 con 0x56404ac17200 2024-04-01T06:56:15.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.804+0000 7ff00affd700 1 -- 172.21.15.83:0/4147579625 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56404ab1a380 con 0x56404ac17200 2024-04-01T06:56:15.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.804+0000 7ff00affd700 1 -- 172.21.15.83:0/4147579625 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ff02402c020 con 0x56404ac17200 2024-04-01T06:56:15.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.804+0000 7ff03dc3db80 10 client.15537 fetch_fsmap finished waiting for FSMap version 24 2024-04-01T06:56:15.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.804+0000 7ff03dc3db80 10 client.15537 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-01T06:56:15.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.804+0000 7ff03dc3db80 20 client.15537 populate_metadata read hostname 'smithi083' 2024-04-01T06:56:15.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.804+0000 7ff03dc3db80 1 --2- 172.21.15.83:0/4147579625 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x56404ac26c00 0x56404ac29020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:15.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.804+0000 7ff03dc3db80 4 client.15537 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-01T06:56:15.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.804+0000 7ff03dc3db80 1 -- 172.21.15.83:0/4147579625 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56404ab52700 con 0x56404ac26c00 2024-04-01T06:56:15.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.804+0000 7ff02b7fe700 1 --2- 172.21.15.83:0/4147579625 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x56404ac26c00 0x56404ac29020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:15.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.805+0000 7ff00affd700 10 client.15537 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:56:15.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.805+0000 7ff02b7fe700 1 --2- 172.21.15.83:0/4147579625 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x56404ac26c00 0x56404ac29020 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb305f90bce654a6 server_cookie=99fb4dd59b7b6b5a in_seq=0 out_seq=0 2024-04-01T06:56:15.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.805+0000 7ff00affd700 1 -- 172.21.15.83:0/4147579625 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56404ab52700 con 0x56404ac26c00 2024-04-01T06:56:15.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.805+0000 7ff00affd700 10 client.15537 handle_command_reply: tid=0 2024-04-01T06:56:15.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.805+0000 7ff03dc3db80 1 client.15537 shutdown 2024-04-01T06:56:15.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.806+0000 7ff03dc3db80 1 -- 172.21.15.83:0/4147579625 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56404ac17200 msgr2=0x56404ac14520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:15.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.806+0000 7ff03dc3db80 1 --2- 172.21.15.83:0/4147579625 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56404ac17200 0x56404ac14520 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ff024008fd0 tx=0x7ff024009690 comp rx=0 tx=0).stop 2024-04-01T06:56:15.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.806+0000 7ff03dc3db80 1 -- 172.21.15.83:0/4147579625 shutdown_connections 2024-04-01T06:56:15.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.806+0000 7ff03dc3db80 1 --2- 172.21.15.83:0/4147579625 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x56404ac26c00 0x56404ac29020 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:15.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.806+0000 7ff03dc3db80 1 --2- 172.21.15.83:0/4147579625 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56404ac17200 0x56404ac14520 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:15.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.806+0000 7ff03dc3db80 1 --2- 172.21.15.83:0/4147579625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56404ac075d0 0x56404ac16bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:15.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.806+0000 7ff00affd700 0 client.15537 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:56:15.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.806+0000 7ff03dc3db80 1 --2- 172.21.15.83:0/4147579625 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56404ac07ef0 0x56404ac13f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:15.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.806+0000 7ff03dc3db80 1 -- 172.21.15.83:0/4147579625 >> 172.21.15.83:0/4147579625 conn(0x56404ab676a0 msgr2=0x56404ac096c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:15.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.806+0000 7ff03dc3db80 1 -- 172.21.15.83:0/4147579625 shutdown_connections 2024-04-01T06:56:15.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.806+0000 7ff03dc3db80 1 -- 172.21.15.83:0/4147579625 wait complete. 2024-04-01T06:56:15.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.806+0000 7ff03dc3db80 20 client.15537 trim_cache size 0 max 16384 2024-04-01T06:56:15.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.822+0000 7ff03dc3db80 1 Processor -- start 2024-04-01T06:56:15.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.822+0000 7ff03dc3db80 1 -- start start 2024-04-01T06:56:15.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.823+0000 7ff03dc3db80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56404ac075d0 0x56404ac127e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:15.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.823+0000 7ff03dc3db80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56404ac07ef0 0x56404ac12d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:15.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.823+0000 7ff03dc3db80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56404ac17200 0x56404ac225d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:15.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.823+0000 7ff03dc3db80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x56404ac08880 con 0x56404ac075d0 2024-04-01T06:56:15.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.823+0000 7ff03dc3db80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x56404ac09130 con 0x56404ac17200 2024-04-01T06:56:15.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.823+0000 7ff03dc3db80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x56404ac08f90 con 0x56404ac07ef0 2024-04-01T06:56:15.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.823+0000 7ff02b7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56404ac075d0 0x56404ac127e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:15.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.823+0000 7ff02b7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56404ac075d0 0x56404ac127e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37676/0 (socket says 172.21.15.83:37676) 2024-04-01T06:56:15.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.823+0000 7ff02b7fe700 1 -- 172.21.15.83:0/1692206249 learned_addr learned my addr 172.21.15.83:0/1692206249 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:15.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.823+0000 7ff02affd700 1 --2- 172.21.15.83:0/1692206249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56404ac07ef0 0x56404ac12d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:15.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.823+0000 7ff02b7fe700 1 -- 172.21.15.83:0/1692206249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56404ac07ef0 msgr2=0x56404ac12d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:15.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.823+0000 7ff02b7fe700 1 --2- 172.21.15.83:0/1692206249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56404ac07ef0 0x56404ac12d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:15.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.823+0000 7ff02b7fe700 1 -- 172.21.15.83:0/1692206249 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56404ac17200 msgr2=0x56404ac225d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:15.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.823+0000 7ff02bfff700 1 --2- 172.21.15.83:0/1692206249 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56404ac17200 0x56404ac225d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:15.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.823+0000 7ff02b7fe700 1 --2- 172.21.15.83:0/1692206249 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56404ac17200 0x56404ac225d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:15.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.823+0000 7ff02b7fe700 1 -- 172.21.15.83:0/1692206249 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56404ab1fea0 con 0x56404ac075d0 2024-04-01T06:56:15.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.823+0000 7ff02bfff700 1 --2- 172.21.15.83:0/1692206249 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56404ac17200 0x56404ac225d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:56:15.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.823+0000 7ff02b7fe700 1 --2- 172.21.15.83:0/1692206249 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56404ac075d0 0x56404ac127e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x56404ac29930 tx=0x7ff01c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8833965744da5166 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:15.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.823+0000 7ff0127fc700 1 -- 172.21.15.83:0/1692206249 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01c026070 con 0x56404ac075d0 2024-04-01T06:56:15.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.823+0000 7ff0127fc700 1 -- 172.21.15.83:0/1692206249 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff01c026e90 con 0x56404ac075d0 2024-04-01T06:56:15.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.823+0000 7ff0127fc700 1 -- 172.21.15.83:0/1692206249 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01c020e60 con 0x56404ac075d0 2024-04-01T06:56:15.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.824+0000 7ff03dc3db80 1 -- 172.21.15.83:0/1692206249 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56404ac075d0 msgr2=0x56404ac127e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:15.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.824+0000 7ff03dc3db80 1 --2- 172.21.15.83:0/1692206249 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56404ac075d0 0x56404ac127e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x56404ac29930 tx=0x7ff01c015000 comp rx=0 tx=0).stop 2024-04-01T06:56:15.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.824+0000 7ff03dc3db80 1 -- 172.21.15.83:0/1692206249 shutdown_connections 2024-04-01T06:56:15.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.824+0000 7ff03dc3db80 1 --2- 172.21.15.83:0/1692206249 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56404ac075d0 0x56404ac127e0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:15.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.824+0000 7ff03dc3db80 1 --2- 172.21.15.83:0/1692206249 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56404ac17200 0x56404ac225d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:15.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.824+0000 7ff03dc3db80 1 --2- 172.21.15.83:0/1692206249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56404ac07ef0 0x56404ac12d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:15.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.824+0000 7ff03dc3db80 1 -- 172.21.15.83:0/1692206249 >> 172.21.15.83:0/1692206249 conn(0x56404ab676a0 msgr2=0x56404abfc5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:15.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.824+0000 7ff03dc3db80 1 -- 172.21.15.83:0/1692206249 shutdown_connections 2024-04-01T06:56:15.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.824+0000 7ff03dc3db80 1 -- 172.21.15.83:0/1692206249 wait complete. 2024-04-01T06:56:15.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.824+0000 7ff03dc3db80 1 -- start start 2024-04-01T06:56:15.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.824+0000 7ff03dc3db80 1 Processor -- start 2024-04-01T06:56:15.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.825+0000 7ff03dc3db80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56404ac075d0 0x56404ac1de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:15.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.825+0000 7ff03dc3db80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56404ac07ef0 0x56404ac1c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:15.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.825+0000 7ff03dc3db80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56404ac17200 0x56404ac1c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:15.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.825+0000 7ff03dc3db80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x56404ac1d0d0 con 0x56404ac17200 2024-04-01T06:56:15.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.825+0000 7ff03dc3db80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x56404ac1d240 con 0x56404ac075d0 2024-04-01T06:56:15.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.825+0000 7ff03dc3db80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x56404ac7aa40 con 0x56404ac07ef0 2024-04-01T06:56:15.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.825+0000 7ff03dc3db80 10 client.0 _ll_register_callbacks cb 0x56404aaff470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:56:15.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.825+0000 7ff02bfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56404ac17200 0x56404ac1c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:15.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.825+0000 7ff02bfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56404ac17200 0x56404ac1c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37686/0 (socket says 172.21.15.83:37686) 2024-04-01T06:56:15.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.825+0000 7ff02bfff700 1 -- 172.21.15.83:0/4040137271 learned_addr learned my addr 172.21.15.83:0/4040137271 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:15.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.825+0000 7ff02affd700 1 --2- 172.21.15.83:0/4040137271 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56404ac07ef0 0x56404ac1c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:15.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.825+0000 7ff02b7fe700 1 --2- 172.21.15.83:0/4040137271 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56404ac075d0 0x56404ac1de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:15.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.825+0000 7ff02bfff700 1 -- 172.21.15.83:0/4040137271 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56404ac07ef0 msgr2=0x56404ac1c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:15.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.825+0000 7ff02bfff700 1 --2- 172.21.15.83:0/4040137271 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56404ac07ef0 0x56404ac1c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:15.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.825+0000 7ff02bfff700 1 -- 172.21.15.83:0/4040137271 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56404ac075d0 msgr2=0x56404ac1de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:15.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.825+0000 7ff02bfff700 1 --2- 172.21.15.83:0/4040137271 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56404ac075d0 0x56404ac1de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:15.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.825+0000 7ff02bfff700 1 -- 172.21.15.83:0/4040137271 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56404a9dfcd0 con 0x56404ac17200 2024-04-01T06:56:15.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.825+0000 7ff02affd700 1 --2- 172.21.15.83:0/4040137271 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56404ac07ef0 0x56404ac1c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:56:15.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.825+0000 7ff02bfff700 1 --2- 172.21.15.83:0/4040137271 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56404ac17200 0x56404ac1c9c0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7ff0240050e0 tx=0x7ff0240051c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0aab9d9ee77096c server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:15.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.825+0000 7ff00affd700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:56:15.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.825+0000 7ff00affd700 1 -- 172.21.15.83:0/4040137271 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff024004a30 con 0x56404ac17200 2024-04-01T06:56:15.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.825+0000 7ff00affd700 1 -- 172.21.15.83:0/4040137271 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8425+0+0 (secure 0 0 0) 0x7ff0240055d0 con 0x56404ac17200 2024-04-01T06:56:15.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.826+0000 7ff03dc3db80 1 -- 172.21.15.83:0/4040137271 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff024014a20 con 0x56404ac17200 2024-04-01T06:56:15.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.826+0000 7ff00affd700 1 -- 172.21.15.83:0/4040137271 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff024014610 con 0x56404ac17200 2024-04-01T06:56:15.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.826+0000 7ff03dc3db80 10 client.15543 fetch_fsmap learned FSMap version 24 2024-04-01T06:56:15.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.826+0000 7ff03dc3db80 1 -- 172.21.15.83:0/4040137271 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x56404a986030 con 0x56404ac17200 2024-04-01T06:56:15.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.826+0000 7ff00affd700 1 -- 172.21.15.83:0/4040137271 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff024014a20 con 0x56404ac17200 2024-04-01T06:56:15.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.826+0000 7ff00affd700 1 -- 172.21.15.83:0/4040137271 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ff02402c070 con 0x56404ac17200 2024-04-01T06:56:15.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.826+0000 7ff03dc3db80 10 client.15543 fetch_fsmap finished waiting for FSMap version 24 2024-04-01T06:56:15.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.826+0000 7ff03dc3db80 10 client.15543 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-01T06:56:15.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.826+0000 7ff03dc3db80 20 client.15543 populate_metadata read hostname 'smithi083' 2024-04-01T06:56:15.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.826+0000 7ff03dc3db80 1 --2- 172.21.15.83:0/4040137271 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x56404ac7bd30 0x56404ac7e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:15.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.826+0000 7ff03dc3db80 4 client.15543 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-01T06:56:15.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.826+0000 7ff03dc3db80 1 -- 172.21.15.83:0/4040137271 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56404a9a8cf0 con 0x56404ac7bd30 2024-04-01T06:56:15.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.826+0000 7ff02b7fe700 1 --2- 172.21.15.83:0/4040137271 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x56404ac7bd30 0x56404ac7e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:15.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.827+0000 7ff00affd700 10 client.15543 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:56:15.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.827+0000 7ff02b7fe700 1 --2- 172.21.15.83:0/4040137271 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x56404ac7bd30 0x56404ac7e150 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e5ae324e8835123 server_cookie=89270ef521f40a0c in_seq=0 out_seq=0 2024-04-01T06:56:15.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.827+0000 7ff00affd700 1 -- 172.21.15.83:0/4040137271 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x56404a9a8cf0 con 0x56404ac7bd30 2024-04-01T06:56:15.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.827+0000 7ff00affd700 10 client.15543 handle_command_reply: tid=0 2024-04-01T06:56:15.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.827+0000 7ff03dc3db80 1 client.15543 shutdown 2024-04-01T06:56:15.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.827+0000 7ff03dc3db80 1 -- 172.21.15.83:0/4040137271 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56404ac17200 msgr2=0x56404ac1c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:15.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.827+0000 7ff03dc3db80 1 --2- 172.21.15.83:0/4040137271 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56404ac17200 0x56404ac1c9c0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7ff0240050e0 tx=0x7ff0240051c0 comp rx=0 tx=0).stop 2024-04-01T06:56:15.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.827+0000 7ff03dc3db80 1 -- 172.21.15.83:0/4040137271 shutdown_connections 2024-04-01T06:56:15.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.827+0000 7ff03dc3db80 1 --2- 172.21.15.83:0/4040137271 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x56404ac7bd30 0x56404ac7e150 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:15.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.827+0000 7ff03dc3db80 1 --2- 172.21.15.83:0/4040137271 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56404ac17200 0x56404ac1c9c0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:15.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.827+0000 7ff03dc3db80 1 --2- 172.21.15.83:0/4040137271 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56404ac075d0 0x56404ac1de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:15.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.827+0000 7ff00affd700 0 client.15543 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:56:15.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.827+0000 7ff03dc3db80 1 --2- 172.21.15.83:0/4040137271 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56404ac07ef0 0x56404ac1c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:15.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.827+0000 7ff03dc3db80 1 -- 172.21.15.83:0/4040137271 >> 172.21.15.83:0/4040137271 conn(0x56404ab676a0 msgr2=0x56404ac12670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:15.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.827+0000 7ff03dc3db80 1 -- 172.21.15.83:0/4040137271 shutdown_connections 2024-04-01T06:56:15.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.827+0000 7ff03dc3db80 1 -- 172.21.15.83:0/4040137271 wait complete. 2024-04-01T06:56:15.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.827+0000 7ff03dc3db80 20 client.15543 trim_cache size 0 max 16384 2024-04-01T06:56:15.834 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-04-01T06:56:15.835 INFO:teuthology.orchestra.run.smithi083.stdout: "status": "no active scrubs running", 2024-04-01T06:56:15.835 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubs": {} 2024-04-01T06:56:15.835 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-04-01T06:56:15.835 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.828+0000 7ff031aa7700 1 -- 172.21.15.83:0/4245110565 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7ff0140a13b0 msgr2=0x7ff0140a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:15.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.828+0000 7ff031aa7700 1 --2- 172.21.15.83:0/4245110565 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7ff0140a13b0 0x7ff0140a3870 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff01c005950 tx=0x7ff01c0058e0 comp rx=0 tx=0).stop 2024-04-01T06:56:15.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.828+0000 7ff031aa7700 1 -- 172.21.15.83:0/4245110565 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff02c1060a0 msgr2=0x7ff02c1976a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:15.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.828+0000 7ff031aa7700 1 --2- 172.21.15.83:0/4245110565 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff02c1060a0 0x7ff02c1976a0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7ff020006010 tx=0x7ff020005e80 comp rx=0 tx=0).stop 2024-04-01T06:56:15.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.828+0000 7ff031aa7700 1 -- 172.21.15.83:0/4245110565 shutdown_connections 2024-04-01T06:56:15.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.828+0000 7ff031aa7700 1 --2- 172.21.15.83:0/4245110565 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7ff0140a13b0 0x7ff0140a3870 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:15.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.828+0000 7ff031aa7700 1 --2- 172.21.15.83:0/4245110565 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff02c19ba40 0x7ff02c19bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:15.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.828+0000 7ff031aa7700 1 --2- 172.21.15.83:0/4245110565 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff02c069540 0x7ff02c197160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:15.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.828+0000 7ff031aa7700 1 --2- 172.21.15.83:0/4245110565 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff02c1060a0 0x7ff02c1976a0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:15.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.828+0000 7ff031aa7700 1 -- 172.21.15.83:0/4245110565 >> 172.21.15.83:0/4245110565 conn(0x7ff02c076d50 msgr2=0x7ff02c0fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:15.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.828+0000 7ff031aa7700 1 -- 172.21.15.83:0/4245110565 shutdown_connections 2024-04-01T06:56:15.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.828+0000 7ff031aa7700 1 -- 172.21.15.83:0/4245110565 wait complete. 2024-04-01T06:56:15.839 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-01T06:56:15.839 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T06:56:15.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.962+0000 7f208d609700 1 -- 172.21.15.83:0/1227056180 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2088105fa0 msgr2=0x7f208810db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:15.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.962+0000 7f208d609700 1 --2- 172.21.15.83:0/1227056180 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2088105fa0 0x7f208810db20 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f208000b0a0 tx=0x7f208000b3b0 comp rx=0 tx=0).stop 2024-04-01T06:56:15.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.962+0000 7f208d609700 1 -- 172.21.15.83:0/1227056180 shutdown_connections 2024-04-01T06:56:15.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.962+0000 7f208d609700 1 --2- 172.21.15.83:0/1227056180 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2088105fa0 0x7f208810db20 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:15.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.962+0000 7f208d609700 1 --2- 172.21.15.83:0/1227056180 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2088100e80 0x7f2088101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:15.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.962+0000 7f208d609700 1 --2- 172.21.15.83:0/1227056180 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2088101830 0x7f2088105870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:15.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.962+0000 7f208d609700 1 -- 172.21.15.83:0/1227056180 >> 172.21.15.83:0/1227056180 conn(0x7f20880fc740 msgr2=0x7f20880feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:15.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.962+0000 7f208d609700 1 -- 172.21.15.83:0/1227056180 shutdown_connections 2024-04-01T06:56:15.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.962+0000 7f208d609700 1 -- 172.21.15.83:0/1227056180 wait complete. 2024-04-01T06:56:15.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.963+0000 7f208d609700 1 Processor -- start 2024-04-01T06:56:15.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.963+0000 7f208d609700 1 -- start start 2024-04-01T06:56:15.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.963+0000 7f208d609700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2088100e80 0x7f20880730b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:15.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.963+0000 7f208d609700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2088105fa0 0x7f20880735f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:15.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.963+0000 7f208d609700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2088073b30 0x7f20881a5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:15.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.963+0000 7f208d609700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20881a59d0 con 0x7f2088073b30 2024-04-01T06:56:15.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.963+0000 7f208d609700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20881a5b40 con 0x7f2088105fa0 2024-04-01T06:56:15.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.963+0000 7f208d609700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20881a5d00 con 0x7f2088100e80 2024-04-01T06:56:15.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.963+0000 7f20877fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2088073b30 0x7f20881a5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:15.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.963+0000 7f20877fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2088073b30 0x7f20881a5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37702/0 (socket says 172.21.15.83:37702) 2024-04-01T06:56:15.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.963+0000 7f20877fe700 1 -- 172.21.15.83:0/2090555416 learned_addr learned my addr 172.21.15.83:0/2090555416 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:15.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.963+0000 7f2086ffd700 1 --2- 172.21.15.83:0/2090555416 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2088100e80 0x7f20880730b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:15.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.963+0000 7f20867fc700 1 --2- 172.21.15.83:0/2090555416 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2088105fa0 0x7f20880735f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:15.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.963+0000 7f20877fe700 1 -- 172.21.15.83:0/2090555416 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2088100e80 msgr2=0x7f20880730b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:15.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.963+0000 7f20877fe700 1 --2- 172.21.15.83:0/2090555416 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2088100e80 0x7f20880730b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:15.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.963+0000 7f20877fe700 1 -- 172.21.15.83:0/2090555416 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2088105fa0 msgr2=0x7f20880735f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:15.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.963+0000 7f20877fe700 1 --2- 172.21.15.83:0/2090555416 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2088105fa0 0x7f20880735f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:15.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.963+0000 7f20877fe700 1 -- 172.21.15.83:0/2090555416 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2080009d00 con 0x7f2088073b30 2024-04-01T06:56:15.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.963+0000 7f20867fc700 1 --2- 172.21.15.83:0/2090555416 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2088105fa0 0x7f20880735f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:56:15.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.964+0000 7f20877fe700 1 --2- 172.21.15.83:0/2090555416 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2088073b30 0x7f20881a5400 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f2080006130 tx=0x7f208000bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:15.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.964+0000 7f207ffff700 1 -- 172.21.15.83:0/2090555416 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208000e040 con 0x7f2088073b30 2024-04-01T06:56:15.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.964+0000 7f207ffff700 1 -- 172.21.15.83:0/2090555416 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2080007e50 con 0x7f2088073b30 2024-04-01T06:56:15.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.964+0000 7f208d609700 1 -- 172.21.15.83:0/2090555416 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20881a5f80 con 0x7f2088073b30 2024-04-01T06:56:15.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.964+0000 7f207ffff700 1 -- 172.21.15.83:0/2090555416 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208001b6b0 con 0x7f2088073b30 2024-04-01T06:56:15.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.964+0000 7f208d609700 1 -- 172.21.15.83:0/2090555416 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20881a6400 con 0x7f2088073b30 2024-04-01T06:56:15.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.965+0000 7f208d609700 1 -- 172.21.15.83:0/2090555416 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2088109270 con 0x7f2088073b30 2024-04-01T06:56:15.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.966+0000 7f207ffff700 1 -- 172.21.15.83:0/2090555416 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) v1 ==== 136098+0+0 (secure 0 0 0) 0x7f208001d480 con 0x7f2088073b30 2024-04-01T06:56:15.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.966+0000 7f207ffff700 1 --2- 172.21.15.83:0/2090555416 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f20740a13b0 0x7f20740a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:15.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.967+0000 7f2086ffd700 1 --2- 172.21.15.83:0/2090555416 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f20740a13b0 0x7f20740a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:15.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.967+0000 7f207ffff700 1 -- 172.21.15.83:0/2090555416 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f20800ced00 con 0x7f2088073b30 2024-04-01T06:56:15.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.967+0000 7f2086ffd700 1 --2- 172.21.15.83:0/2090555416 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f20740a13b0 0x7f20740a3870 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2070009c60 tx=0x7f2070009260 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:15.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:15.970+0000 7f207ffff700 1 -- 172.21.15.83:0/2090555416 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f2080097ff0 con 0x7f2088073b30 2024-04-01T06:56:16.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.212+0000 7f208d609700 1 -- 172.21.15.83:0/2090555416 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2088074630 con 0x7f2088073b30 2024-04-01T06:56:16.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.213+0000 7f207ffff700 1 -- 172.21.15.83:0/2090555416 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+10876 (secure 0 0 0) 0x7f208009b610 con 0x7f2088073b30 2024-04-01T06:56:16.213 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:56:16.213 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1271130478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1271130478},{"type":"v1","addr":"172.21.15.83:6835","nonce":1271130478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2412682983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2412682983},{"type":"v1","addr":"172.21.15.83:6837","nonce":2412682983}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6839/3348145990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":3348145990},{"type":"v1","addr":"172.21.15.83:6839","nonce":3348145990}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6841/1191267445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6840","nonce":1191267445},{"type":"v1","addr":"172.21.15.83:6841","nonce":1191267445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2467459028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2467459028},{"type":"v1","addr":"172.21.15.153:6833","nonce":2467459028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24448,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4092629042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":4092629042},{"type":"v1","addr":"172.21.15.153:6835","nonce":4092629042}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-01T06:54:28.397062+0000","modified":"2024-04-01T06:55:38.703948+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24524,"mds_1":24494,"mds_2":24473},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6833/647005844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":647005844},{"type":"v1","addr":"172.21.15.145:6833","nonce":647005844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24454":{"gid":24454,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6837/1993816527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1993816527},{"type":"v1","addr":"172.21.15.153:6837","nonce":1993816527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6839/1399754640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1399754640},{"type":"v1","addr":"172.21.15.153:6839","nonce":1399754640}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24473":{"gid":24473,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.145:6835/3104241497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":3104241497},{"type":"v1","addr":"172.21.15.145:6835","nonce":3104241497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24494":{"gid":24494,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.145:6837/2687798317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2687798317},{"type":"v1","addr":"172.21.15.145:6837","nonce":2687798317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6839/3886435411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3886435411},{"type":"v1","addr":"172.21.15.145:6839","nonce":3886435411}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-01T06:56:16.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.215+0000 7f208d609700 1 -- 172.21.15.83:0/2090555416 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f20740a13b0 msgr2=0x7f20740a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:16.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.215+0000 7f208d609700 1 --2- 172.21.15.83:0/2090555416 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f20740a13b0 0x7f20740a3870 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2070009c60 tx=0x7f2070009260 comp rx=0 tx=0).stop 2024-04-01T06:56:16.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.215+0000 7f208d609700 1 -- 172.21.15.83:0/2090555416 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2088073b30 msgr2=0x7f20881a5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:16.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.215+0000 7f208d609700 1 --2- 172.21.15.83:0/2090555416 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2088073b30 0x7f20881a5400 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f2080006130 tx=0x7f208000bdc0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.215+0000 7f208d609700 1 -- 172.21.15.83:0/2090555416 shutdown_connections 2024-04-01T06:56:16.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.215+0000 7f208d609700 1 --2- 172.21.15.83:0/2090555416 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f20740a13b0 0x7f20740a3870 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.215+0000 7f208d609700 1 --2- 172.21.15.83:0/2090555416 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2088073b30 0x7f20881a5400 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.215+0000 7f208d609700 1 --2- 172.21.15.83:0/2090555416 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2088100e80 0x7f20880730b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.215+0000 7f208d609700 1 --2- 172.21.15.83:0/2090555416 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2088105fa0 0x7f20880735f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.215+0000 7f208d609700 1 -- 172.21.15.83:0/2090555416 >> 172.21.15.83:0/2090555416 conn(0x7f20880fc740 msgr2=0x7f20880fea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:16.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.215+0000 7f208d609700 1 -- 172.21.15.83:0/2090555416 shutdown_connections 2024-04-01T06:56:16.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.215+0000 7f208d609700 1 -- 172.21.15.83:0/2090555416 wait complete. 2024-04-01T06:56:16.216 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 24 2024-04-01T06:56:16.227 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-01T06:56:16.227 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-01T06:56:16.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.351+0000 7fd5f91cd700 1 -- 172.21.15.83:0/1539908549 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd5f40ffe70 msgr2=0x7fd5f4100250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:16.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.351+0000 7fd5f91cd700 1 --2- 172.21.15.83:0/1539908549 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd5f40ffe70 0x7fd5f4100250 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4009990 tx=0x7fd5e4009ca0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.351+0000 7fd5f91cd700 1 -- 172.21.15.83:0/1539908549 shutdown_connections 2024-04-01T06:56:16.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.351+0000 7fd5f91cd700 1 --2- 172.21.15.83:0/1539908549 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd5f40ffe70 0x7fd5f4100250 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.351+0000 7fd5f91cd700 1 --2- 172.21.15.83:0/1539908549 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd5f4104f70 0x7fd5f410caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.351+0000 7fd5f91cd700 1 --2- 172.21.15.83:0/1539908549 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5f4100820 0x7fd5f4104840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.351+0000 7fd5f91cd700 1 -- 172.21.15.83:0/1539908549 >> 172.21.15.83:0/1539908549 conn(0x7fd5f4076d50 msgr2=0x7fd5f4077160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:16.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.351+0000 7fd5f91cd700 1 -- 172.21.15.83:0/1539908549 shutdown_connections 2024-04-01T06:56:16.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.351+0000 7fd5f91cd700 1 -- 172.21.15.83:0/1539908549 wait complete. 2024-04-01T06:56:16.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.352+0000 7fd5f91cd700 1 Processor -- start 2024-04-01T06:56:16.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.352+0000 7fd5f91cd700 1 -- start start 2024-04-01T06:56:16.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.352+0000 7fd5f91cd700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd5f40ffe70 0x7fd5f4198070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:16.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.352+0000 7fd5f91cd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd5f4104f70 0x7fd5f41985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:16.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.352+0000 7fd5f91cd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5f4198af0 0x7fd5f41a30f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:16.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.352+0000 7fd5f91cd700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f41a37d0 con 0x7fd5f4104f70 2024-04-01T06:56:16.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.352+0000 7fd5f91cd700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f41a3940 con 0x7fd5f40ffe70 2024-04-01T06:56:16.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.352+0000 7fd5f91cd700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f41a3b00 con 0x7fd5f4198af0 2024-04-01T06:56:16.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.353+0000 7fd5f259c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd5f4104f70 0x7fd5f41985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:16.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.353+0000 7fd5f259c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd5f4104f70 0x7fd5f41985b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37726/0 (socket says 172.21.15.83:37726) 2024-04-01T06:56:16.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.353+0000 7fd5f259c700 1 -- 172.21.15.83:0/109983693 learned_addr learned my addr 172.21.15.83:0/109983693 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:16.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.353+0000 7fd5f2d9d700 1 --2- 172.21.15.83:0/109983693 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd5f40ffe70 0x7fd5f4198070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:16.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.353+0000 7fd5f359e700 1 --2- 172.21.15.83:0/109983693 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5f4198af0 0x7fd5f41a30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:16.355 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.353+0000 7fd5f259c700 1 -- 172.21.15.83:0/109983693 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5f4198af0 msgr2=0x7fd5f41a30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:16.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.353+0000 7fd5f259c700 1 --2- 172.21.15.83:0/109983693 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5f4198af0 0x7fd5f41a30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.353+0000 7fd5f259c700 1 -- 172.21.15.83:0/109983693 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd5f40ffe70 msgr2=0x7fd5f4198070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:16.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.353+0000 7fd5f259c700 1 --2- 172.21.15.83:0/109983693 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd5f40ffe70 0x7fd5f4198070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.353+0000 7fd5f259c700 1 -- 172.21.15.83:0/109983693 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e40095f0 con 0x7fd5f4104f70 2024-04-01T06:56:16.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.353+0000 7fd5f259c700 1 --2- 172.21.15.83:0/109983693 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd5f4104f70 0x7fd5f41985b0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fd5e800c8f0 tx=0x7fd5e800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:16.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.353+0000 7fd5dbfff700 1 -- 172.21.15.83:0/109983693 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e8007b00 con 0x7fd5f4104f70 2024-04-01T06:56:16.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.353+0000 7fd5f91cd700 1 -- 172.21.15.83:0/109983693 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5f41a3de0 con 0x7fd5f4104f70 2024-04-01T06:56:16.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.353+0000 7fd5dbfff700 1 -- 172.21.15.83:0/109983693 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd5e8007c60 con 0x7fd5f4104f70 2024-04-01T06:56:16.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.353+0000 7fd5dbfff700 1 -- 172.21.15.83:0/109983693 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e8018660 con 0x7fd5f4104f70 2024-04-01T06:56:16.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.353+0000 7fd5f91cd700 1 -- 172.21.15.83:0/109983693 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5f41a4260 con 0x7fd5f4104f70 2024-04-01T06:56:16.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.356+0000 7fd5dbfff700 1 -- 172.21.15.83:0/109983693 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) v1 ==== 136098+0+0 (secure 0 0 0) 0x7fd5e800f450 con 0x7fd5f4104f70 2024-04-01T06:56:16.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.356+0000 7fd5dbfff700 1 --2- 172.21.15.83:0/109983693 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fd5dc0a13b0 0x7fd5dc0a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:16.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.356+0000 7fd5f2d9d700 1 --2- 172.21.15.83:0/109983693 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fd5dc0a13b0 0x7fd5dc0a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:16.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.356+0000 7fd5dbfff700 1 -- 172.21.15.83:0/109983693 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8425+0+0 (secure 0 0 0) 0x7fd5e80ccf00 con 0x7fd5f4104f70 2024-04-01T06:56:16.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.356+0000 7fd5f2d9d700 1 --2- 172.21.15.83:0/109983693 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fd5dc0a13b0 0x7fd5dc0a3870 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4005b40 tx=0x7fd5e4005a90 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:16.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.357+0000 7fd605363b80 1 Processor -- start 2024-04-01T06:56:16.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.357+0000 7fd605363b80 1 -- start start 2024-04-01T06:56:16.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.357+0000 7fd605363b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558b635ae5d0 0x558b635ae9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:16.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.357+0000 7fd605363b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b635aeef0 0x558b635b98b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:16.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.357+0000 7fd605363b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b635b9df0 0x558b635bc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:16.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.357+0000 7fd605363b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b63507990 con 0x558b635ae5d0 2024-04-01T06:56:16.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.357+0000 7fd605363b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b63505350 con 0x558b635b9df0 2024-04-01T06:56:16.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.357+0000 7fd605363b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b63500c40 con 0x558b635aeef0 2024-04-01T06:56:16.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.357+0000 7fd5f2d9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558b635ae5d0 0x558b635ae9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:16.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.357+0000 7fd5f2d9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558b635ae5d0 0x558b635ae9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37738/0 (socket says 172.21.15.83:37738) 2024-04-01T06:56:16.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.357+0000 7fd5f2d9d700 1 -- 172.21.15.83:0/1415535538 learned_addr learned my addr 172.21.15.83:0/1415535538 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:16.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.357+0000 7fd5f359e700 1 --2- 172.21.15.83:0/1415535538 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b635b9df0 0x558b635bc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:16.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.357+0000 7fd5f259c700 1 --2- 172.21.15.83:0/1415535538 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b635aeef0 0x558b635b98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:16.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.357+0000 7fd5f2d9d700 1 -- 172.21.15.83:0/1415535538 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b635aeef0 msgr2=0x558b635b98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:16.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.357+0000 7fd5f2d9d700 1 --2- 172.21.15.83:0/1415535538 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b635aeef0 0x558b635b98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.357+0000 7fd5f2d9d700 1 -- 172.21.15.83:0/1415535538 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b635b9df0 msgr2=0x558b635bc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:16.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.357+0000 7fd5f2d9d700 1 --2- 172.21.15.83:0/1415535538 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b635b9df0 0x558b635bc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.357+0000 7fd5f2d9d700 1 -- 172.21.15.83:0/1415535538 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558b633823b0 con 0x558b635ae5d0 2024-04-01T06:56:16.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.357+0000 7fd5f359e700 1 --2- 172.21.15.83:0/1415535538 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b635b9df0 0x558b635bc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:56:16.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.357+0000 7fd5f259c700 1 --2- 172.21.15.83:0/1415535538 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b635aeef0 0x558b635b98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:56:16.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.358+0000 7fd5f2d9d700 1 --2- 172.21.15.83:0/1415535538 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558b635ae5d0 0x558b635ae9b0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4005480 tx=0x7fd5e401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d0b9eea17aeb134 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:16.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.358+0000 7fd5d97fa700 1 -- 172.21.15.83:0/1415535538 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e402b070 con 0x558b635ae5d0 2024-04-01T06:56:16.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.358+0000 7fd5d97fa700 1 -- 172.21.15.83:0/1415535538 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd5e401e040 con 0x558b635ae5d0 2024-04-01T06:56:16.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.358+0000 7fd5d97fa700 1 -- 172.21.15.83:0/1415535538 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e4004c50 con 0x558b635ae5d0 2024-04-01T06:56:16.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.358+0000 7fd605363b80 1 -- 172.21.15.83:0/1415535538 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558b635ae5d0 msgr2=0x558b635ae9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:16.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.358+0000 7fd605363b80 1 --2- 172.21.15.83:0/1415535538 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558b635ae5d0 0x558b635ae9b0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4005480 tx=0x7fd5e401f000 comp rx=0 tx=0).stop 2024-04-01T06:56:16.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.358+0000 7fd605363b80 1 -- 172.21.15.83:0/1415535538 shutdown_connections 2024-04-01T06:56:16.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.358+0000 7fd605363b80 1 --2- 172.21.15.83:0/1415535538 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558b635ae5d0 0x558b635ae9b0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.358+0000 7fd605363b80 1 --2- 172.21.15.83:0/1415535538 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b635b9df0 0x558b635bc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.358+0000 7fd605363b80 1 --2- 172.21.15.83:0/1415535538 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b635aeef0 0x558b635b98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.358+0000 7fd605363b80 1 -- 172.21.15.83:0/1415535538 >> 172.21.15.83:0/1415535538 conn(0x558b6350e6a0 msgr2=0x558b635aaa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:16.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.359+0000 7fd605363b80 1 -- 172.21.15.83:0/1415535538 shutdown_connections 2024-04-01T06:56:16.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.359+0000 7fd605363b80 1 -- 172.21.15.83:0/1415535538 wait complete. 2024-04-01T06:56:16.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.359+0000 7fd605363b80 1 -- start start 2024-04-01T06:56:16.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.359+0000 7fd605363b80 1 Processor -- start 2024-04-01T06:56:16.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.359+0000 7fd605363b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558b635ae5d0 0x558b635b96f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:16.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.359+0000 7fd605363b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b635aeef0 0x558b635b6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:16.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.359+0000 7fd605363b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b635b9df0 0x558b635b7020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:16.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.359+0000 7fd605363b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b6349cd80 con 0x558b635ae5d0 2024-04-01T06:56:16.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.359+0000 7fd605363b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b6349ca20 con 0x558b635b9df0 2024-04-01T06:56:16.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.359+0000 7fd605363b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b633846a0 con 0x558b635aeef0 2024-04-01T06:56:16.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.359+0000 7fd605363b80 10 client.0 _ll_register_callbacks cb 0x558b634a6470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:56:16.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.359+0000 7fd5f2d9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558b635ae5d0 0x558b635b96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:16.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.359+0000 7fd5f2d9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558b635ae5d0 0x558b635b96f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37744/0 (socket says 172.21.15.83:37744) 2024-04-01T06:56:16.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.359+0000 7fd5f2d9d700 1 -- 172.21.15.83:0/1579211743 learned_addr learned my addr 172.21.15.83:0/1579211743 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:16.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.359+0000 7fd5f359e700 1 --2- 172.21.15.83:0/1579211743 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b635b9df0 0x558b635b7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:16.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.360+0000 7fd5f259c700 1 --2- 172.21.15.83:0/1579211743 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b635aeef0 0x558b635b6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:16.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.360+0000 7fd5f2d9d700 1 -- 172.21.15.83:0/1579211743 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b635aeef0 msgr2=0x558b635b6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:16.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.360+0000 7fd5f2d9d700 1 --2- 172.21.15.83:0/1579211743 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b635aeef0 0x558b635b6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.360+0000 7fd5f2d9d700 1 -- 172.21.15.83:0/1579211743 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b635b9df0 msgr2=0x558b635b7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:16.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.360+0000 7fd5f2d9d700 1 --2- 172.21.15.83:0/1579211743 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b635b9df0 0x558b635b7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.360+0000 7fd5f2d9d700 1 -- 172.21.15.83:0/1579211743 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5f410d360 con 0x558b635ae5d0 2024-04-01T06:56:16.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.360+0000 7fd5f259c700 1 --2- 172.21.15.83:0/1579211743 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b635aeef0 0x558b635b6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:56:16.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.360+0000 7fd5f2d9d700 1 --2- 172.21.15.83:0/1579211743 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558b635ae5d0 0x558b635b96f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4000c00 tx=0x7fd5e4009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df4b829b2facc8fc server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:16.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.360+0000 7fd5d6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:56:16.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.360+0000 7fd5d6ff5700 1 -- 172.21.15.83:0/1579211743 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e402b040 con 0x558b635ae5d0 2024-04-01T06:56:16.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.360+0000 7fd5d6ff5700 1 -- 172.21.15.83:0/1579211743 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8425+0+0 (secure 0 0 0) 0x7fd5e400bcb0 con 0x558b635ae5d0 2024-04-01T06:56:16.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.360+0000 7fd605363b80 1 -- 172.21.15.83:0/1579211743 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558b634c1380 con 0x558b635ae5d0 2024-04-01T06:56:16.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.360+0000 7fd5d6ff5700 1 -- 172.21.15.83:0/1579211743 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd5e400be70 con 0x558b635ae5d0 2024-04-01T06:56:16.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.360+0000 7fd605363b80 10 client.15561 fetch_fsmap learned FSMap version 24 2024-04-01T06:56:16.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.360+0000 7fd605363b80 1 -- 172.21.15.83:0/1579211743 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x558b6332eb60 con 0x558b635ae5d0 2024-04-01T06:56:16.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.360+0000 7fd5d6ff5700 1 -- 172.21.15.83:0/1579211743 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558b634c1380 con 0x558b635ae5d0 2024-04-01T06:56:16.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.360+0000 7fd5d6ff5700 1 -- 172.21.15.83:0/1579211743 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fd5e4024530 con 0x558b635ae5d0 2024-04-01T06:56:16.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.360+0000 7fd605363b80 10 client.15561 fetch_fsmap finished waiting for FSMap version 24 2024-04-01T06:56:16.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.360+0000 7fd605363b80 10 client.15561 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.e 2024-04-01T06:56:16.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.360+0000 7fd605363b80 20 client.15561 populate_metadata read hostname 'smithi083' 2024-04-01T06:56:16.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.360+0000 7fd605363b80 1 --2- 172.21.15.83:0/1579211743 >> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] conn(0x558b635c93f0 0x558b635cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:16.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.361+0000 7fd605363b80 4 client.15561 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-01T06:56:16.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.361+0000 7fd605363b80 1 -- 172.21.15.83:0/1579211743 --> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558b634f9700 con 0x558b635c93f0 2024-04-01T06:56:16.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.361+0000 7fd5f259c700 1 --2- 172.21.15.83:0/1579211743 >> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] conn(0x558b635c93f0 0x558b635cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:16.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.361+0000 7fd5d6ff5700 10 client.15561 ms_handle_connect on v2:172.21.15.145:6834/3104241497 2024-04-01T06:56:16.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.361+0000 7fd5f259c700 1 --2- 172.21.15.83:0/1579211743 >> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] conn(0x558b635c93f0 0x558b635cb7e0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=75d913cfa5e4a99b server_cookie=3e1a4996e7424da6 in_seq=0 out_seq=0 2024-04-01T06:56:16.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.362+0000 7fd5d6ff5700 1 -- 172.21.15.83:0/1579211743 <== mds.2 v2:172.21.15.145:6834/3104241497 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558b634f9700 con 0x558b635c93f0 2024-04-01T06:56:16.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.362+0000 7fd5d6ff5700 10 client.15561 handle_command_reply: tid=0 2024-04-01T06:56:16.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.362+0000 7fd605363b80 1 client.15561 shutdown 2024-04-01T06:56:16.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.362+0000 7fd605363b80 1 -- 172.21.15.83:0/1579211743 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558b635ae5d0 msgr2=0x558b635b96f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:16.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.362+0000 7fd605363b80 1 --2- 172.21.15.83:0/1579211743 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558b635ae5d0 0x558b635b96f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4000c00 tx=0x7fd5e4009310 comp rx=0 tx=0).stop 2024-04-01T06:56:16.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.362+0000 7fd605363b80 1 -- 172.21.15.83:0/1579211743 shutdown_connections 2024-04-01T06:56:16.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.362+0000 7fd605363b80 1 --2- 172.21.15.83:0/1579211743 >> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] conn(0x558b635c93f0 0x558b635cb7e0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.362+0000 7fd605363b80 1 --2- 172.21.15.83:0/1579211743 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558b635ae5d0 0x558b635b96f0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.362+0000 7fd5d6ff5700 0 client.15561 ms_handle_reset on v2:172.21.15.145:6834/3104241497 2024-04-01T06:56:16.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.362+0000 7fd605363b80 1 --2- 172.21.15.83:0/1579211743 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b635b9df0 0x558b635b7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.362+0000 7fd605363b80 1 --2- 172.21.15.83:0/1579211743 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b635aeef0 0x558b635b6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.362+0000 7fd605363b80 1 -- 172.21.15.83:0/1579211743 >> 172.21.15.83:0/1579211743 conn(0x558b6350e6a0 msgr2=0x558b635b06c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:16.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.362+0000 7fd605363b80 1 -- 172.21.15.83:0/1579211743 shutdown_connections 2024-04-01T06:56:16.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.362+0000 7fd605363b80 1 -- 172.21.15.83:0/1579211743 wait complete. 2024-04-01T06:56:16.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.362+0000 7fd605363b80 20 client.15561 trim_cache size 0 max 16384 2024-04-01T06:56:16.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.375+0000 7fd605363b80 1 Processor -- start 2024-04-01T06:56:16.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.375+0000 7fd605363b80 1 -- start start 2024-04-01T06:56:16.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.375+0000 7fd605363b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558b635ae5d0 0x558b635b7020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:16.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.375+0000 7fd605363b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b635aeef0 0x558b635cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:16.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.375+0000 7fd605363b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b635b9df0 0x558b635a9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:16.381 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.375+0000 7fd605363b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b635af340 con 0x558b635ae5d0 2024-04-01T06:56:16.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.375+0000 7fd605363b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b635b4ff0 con 0x558b635b9df0 2024-04-01T06:56:16.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.375+0000 7fd605363b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b635c6020 con 0x558b635aeef0 2024-04-01T06:56:16.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.375+0000 7fd5f2d9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558b635ae5d0 0x558b635b7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:16.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.376+0000 7fd5f2d9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558b635ae5d0 0x558b635b7020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37754/0 (socket says 172.21.15.83:37754) 2024-04-01T06:56:16.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.376+0000 7fd5f2d9d700 1 -- 172.21.15.83:0/318311286 learned_addr learned my addr 172.21.15.83:0/318311286 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:16.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.376+0000 7fd5f359e700 1 --2- 172.21.15.83:0/318311286 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b635b9df0 0x558b635a9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:16.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.376+0000 7fd5f2d9d700 1 -- 172.21.15.83:0/318311286 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b635aeef0 msgr2=0x558b635cb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:16.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.376+0000 7fd5f2d9d700 1 --2- 172.21.15.83:0/318311286 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b635aeef0 0x558b635cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.376+0000 7fd5f2d9d700 1 -- 172.21.15.83:0/318311286 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b635b9df0 msgr2=0x558b635a9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:16.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.376+0000 7fd5f2d9d700 1 --2- 172.21.15.83:0/318311286 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b635b9df0 0x558b635a9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.376+0000 7fd5f2d9d700 1 -- 172.21.15.83:0/318311286 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558b634c6ea0 con 0x558b635ae5d0 2024-04-01T06:56:16.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.376+0000 7fd5f359e700 1 --2- 172.21.15.83:0/318311286 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b635b9df0 0x558b635a9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:56:16.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.376+0000 7fd5f2d9d700 1 --2- 172.21.15.83:0/318311286 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558b635ae5d0 0x558b635b7020 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fd5e40248e0 tx=0x7fd5e401b050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ac0a055ade1608 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:16.382 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.376+0000 7fd5d9ffb700 1 -- 172.21.15.83:0/318311286 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e402b040 con 0x558b635ae5d0 2024-04-01T06:56:16.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.376+0000 7fd5d9ffb700 1 -- 172.21.15.83:0/318311286 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd5e4004500 con 0x558b635ae5d0 2024-04-01T06:56:16.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.376+0000 7fd5d9ffb700 1 -- 172.21.15.83:0/318311286 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e400f7e0 con 0x558b635ae5d0 2024-04-01T06:56:16.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.376+0000 7fd605363b80 1 -- 172.21.15.83:0/318311286 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558b635ae5d0 msgr2=0x558b635b7020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:16.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.376+0000 7fd605363b80 1 --2- 172.21.15.83:0/318311286 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558b635ae5d0 0x558b635b7020 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fd5e40248e0 tx=0x7fd5e401b050 comp rx=0 tx=0).stop 2024-04-01T06:56:16.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.377+0000 7fd605363b80 1 -- 172.21.15.83:0/318311286 shutdown_connections 2024-04-01T06:56:16.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.377+0000 7fd605363b80 1 --2- 172.21.15.83:0/318311286 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558b635ae5d0 0x558b635b7020 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.377+0000 7fd605363b80 1 --2- 172.21.15.83:0/318311286 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b635b9df0 0x558b635a9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.377+0000 7fd605363b80 1 --2- 172.21.15.83:0/318311286 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b635aeef0 0x558b635cb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.377+0000 7fd605363b80 1 -- 172.21.15.83:0/318311286 >> 172.21.15.83:0/318311286 conn(0x558b6350e6a0 msgr2=0x558b635a35a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:16.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.377+0000 7fd605363b80 1 -- 172.21.15.83:0/318311286 shutdown_connections 2024-04-01T06:56:16.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.377+0000 7fd605363b80 1 -- 172.21.15.83:0/318311286 wait complete. 2024-04-01T06:56:16.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.377+0000 7fd605363b80 1 -- start start 2024-04-01T06:56:16.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.377+0000 7fd605363b80 1 Processor -- start 2024-04-01T06:56:16.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.377+0000 7fd605363b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b635ae5d0 0x558b635be530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:16.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.377+0000 7fd605363b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b635aeef0 0x558b635bea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:16.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.377+0000 7fd605363b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558b635b9df0 0x558b636205a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:16.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.377+0000 7fd605363b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b635bf380 con 0x558b635b9df0 2024-04-01T06:56:16.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.377+0000 7fd605363b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b63620ae0 con 0x558b635aeef0 2024-04-01T06:56:16.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.377+0000 7fd605363b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b63620c20 con 0x558b635ae5d0 2024-04-01T06:56:16.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.377+0000 7fd605363b80 10 client.0 _ll_register_callbacks cb 0x558b634a6470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:56:16.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.377+0000 7fd5f359e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558b635b9df0 0x558b636205a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:16.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.377+0000 7fd5f359e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558b635b9df0 0x558b636205a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37768/0 (socket says 172.21.15.83:37768) 2024-04-01T06:56:16.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.377+0000 7fd5f359e700 1 -- 172.21.15.83:0/607122491 learned_addr learned my addr 172.21.15.83:0/607122491 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:16.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.377+0000 7fd5f259c700 1 --2- 172.21.15.83:0/607122491 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b635aeef0 0x558b635bea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:16.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.377+0000 7fd5f2d9d700 1 --2- 172.21.15.83:0/607122491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b635ae5d0 0x558b635be530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:16.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.377+0000 7fd5f359e700 1 -- 172.21.15.83:0/607122491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b635ae5d0 msgr2=0x558b635be530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:16.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.377+0000 7fd5f359e700 1 --2- 172.21.15.83:0/607122491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b635ae5d0 0x558b635be530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.377+0000 7fd5f359e700 1 -- 172.21.15.83:0/607122491 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b635aeef0 msgr2=0x558b635bea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:16.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.377+0000 7fd5f359e700 1 --2- 172.21.15.83:0/607122491 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b635aeef0 0x558b635bea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.378+0000 7fd5f359e700 1 -- 172.21.15.83:0/607122491 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558b6332eb60 con 0x558b635b9df0 2024-04-01T06:56:16.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.378+0000 7fd5f359e700 1 --2- 172.21.15.83:0/607122491 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558b635b9df0 0x558b636205a0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec00aa50 tx=0x7fd5ec00ab30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=990a0db661eec2c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:16.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.378+0000 7fd5d6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:56:16.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.378+0000 7fd5d6ff5700 1 -- 172.21.15.83:0/607122491 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec011040 con 0x558b635b9df0 2024-04-01T06:56:16.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.378+0000 7fd5d6ff5700 1 -- 172.21.15.83:0/607122491 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8425+0+0 (secure 0 0 0) 0x7fd5ec006e40 con 0x558b635b9df0 2024-04-01T06:56:16.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.378+0000 7fd605363b80 1 -- 172.21.15.83:0/607122491 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558b6334fcf0 con 0x558b635b9df0 2024-04-01T06:56:16.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.378+0000 7fd5d6ff5700 1 -- 172.21.15.83:0/607122491 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd5ec0078c0 con 0x558b635b9df0 2024-04-01T06:56:16.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.378+0000 7fd605363b80 10 client.15567 fetch_fsmap learned FSMap version 24 2024-04-01T06:56:16.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.378+0000 7fd605363b80 1 -- 172.21.15.83:0/607122491 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x558b63386cd0 con 0x558b635b9df0 2024-04-01T06:56:16.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.378+0000 7fd5d6ff5700 1 -- 172.21.15.83:0/607122491 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558b6334fcf0 con 0x558b635b9df0 2024-04-01T06:56:16.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.378+0000 7fd5d6ff5700 1 -- 172.21.15.83:0/607122491 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fd5ec017c00 con 0x558b635b9df0 2024-04-01T06:56:16.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.378+0000 7fd605363b80 10 client.15567 fetch_fsmap finished waiting for FSMap version 24 2024-04-01T06:56:16.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.378+0000 7fd605363b80 10 client.15567 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.e 2024-04-01T06:56:16.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.378+0000 7fd605363b80 20 client.15567 populate_metadata read hostname 'smithi083' 2024-04-01T06:56:16.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.378+0000 7fd605363b80 1 --2- 172.21.15.83:0/607122491 >> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] conn(0x558b636223d0 0x558b636247f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:16.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.378+0000 7fd605363b80 4 client.15567 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-01T06:56:16.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.378+0000 7fd605363b80 1 -- 172.21.15.83:0/607122491 --> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x558b63384ce0 con 0x558b636223d0 2024-04-01T06:56:16.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.379+0000 7fd5f2d9d700 1 --2- 172.21.15.83:0/607122491 >> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] conn(0x558b636223d0 0x558b636247f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:16.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.379+0000 7fd5d6ff5700 10 client.15567 ms_handle_connect on v2:172.21.15.145:6834/3104241497 2024-04-01T06:56:16.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.379+0000 7fd5f2d9d700 1 --2- 172.21.15.83:0/607122491 >> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] conn(0x558b636223d0 0x558b636247f0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f2522e74198a943a server_cookie=2b231d60702f8ef1 in_seq=0 out_seq=0 2024-04-01T06:56:16.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.379+0000 7fd5d6ff5700 1 -- 172.21.15.83:0/607122491 <== mds.2 v2:172.21.15.145:6834/3104241497 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x558b63384ce0 con 0x558b636223d0 2024-04-01T06:56:16.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.379+0000 7fd5d6ff5700 10 client.15567 handle_command_reply: tid=0 2024-04-01T06:56:16.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.379+0000 7fd605363b80 1 client.15567 shutdown 2024-04-01T06:56:16.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.379+0000 7fd605363b80 1 -- 172.21.15.83:0/607122491 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558b635b9df0 msgr2=0x558b636205a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:16.387 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.379+0000 7fd605363b80 1 --2- 172.21.15.83:0/607122491 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558b635b9df0 0x558b636205a0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec00aa50 tx=0x7fd5ec00ab30 comp rx=0 tx=0).stop 2024-04-01T06:56:16.387 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.379+0000 7fd605363b80 1 -- 172.21.15.83:0/607122491 shutdown_connections 2024-04-01T06:56:16.387 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.379+0000 7fd605363b80 1 --2- 172.21.15.83:0/607122491 >> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] conn(0x558b636223d0 0x558b636247f0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.387 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.379+0000 7fd605363b80 1 --2- 172.21.15.83:0/607122491 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558b635b9df0 0x558b636205a0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.387 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.379+0000 7fd605363b80 1 --2- 172.21.15.83:0/607122491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558b635ae5d0 0x558b635be530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.387 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.379+0000 7fd5d6ff5700 0 client.15567 ms_handle_reset on v2:172.21.15.145:6834/3104241497 2024-04-01T06:56:16.387 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.379+0000 7fd605363b80 1 --2- 172.21.15.83:0/607122491 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b635aeef0 0x558b635bea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.387 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.379+0000 7fd605363b80 1 -- 172.21.15.83:0/607122491 >> 172.21.15.83:0/607122491 conn(0x558b6350e6a0 msgr2=0x558b635b9390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:16.387 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.379+0000 7fd605363b80 1 -- 172.21.15.83:0/607122491 shutdown_connections 2024-04-01T06:56:16.387 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.379+0000 7fd605363b80 1 -- 172.21.15.83:0/607122491 wait complete. 2024-04-01T06:56:16.387 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.379+0000 7fd605363b80 20 client.15567 trim_cache size 0 max 16384 2024-04-01T06:56:16.387 INFO:teuthology.orchestra.run.smithi083.stdout:[] 2024-04-01T06:56:16.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.380+0000 7fd5f91cd700 1 -- 172.21.15.83:0/109983693 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fd5dc0a13b0 msgr2=0x7fd5dc0a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:16.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.380+0000 7fd5f91cd700 1 --2- 172.21.15.83:0/109983693 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fd5dc0a13b0 0x7fd5dc0a3870 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4005b40 tx=0x7fd5e4005a90 comp rx=0 tx=0).stop 2024-04-01T06:56:16.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.380+0000 7fd5f91cd700 1 -- 172.21.15.83:0/109983693 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd5f4104f70 msgr2=0x7fd5f41985b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:16.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.380+0000 7fd5f91cd700 1 --2- 172.21.15.83:0/109983693 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd5f4104f70 0x7fd5f41985b0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fd5e800c8f0 tx=0x7fd5e800ccb0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.380+0000 7fd5f91cd700 1 -- 172.21.15.83:0/109983693 shutdown_connections 2024-04-01T06:56:16.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.380+0000 7fd5f91cd700 1 --2- 172.21.15.83:0/109983693 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fd5dc0a13b0 0x7fd5dc0a3870 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.380+0000 7fd5f91cd700 1 --2- 172.21.15.83:0/109983693 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5f4198af0 0x7fd5f41a30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.380+0000 7fd5f91cd700 1 --2- 172.21.15.83:0/109983693 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd5f40ffe70 0x7fd5f4198070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.380+0000 7fd5f91cd700 1 --2- 172.21.15.83:0/109983693 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd5f4104f70 0x7fd5f41985b0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.380+0000 7fd5f91cd700 1 -- 172.21.15.83:0/109983693 >> 172.21.15.83:0/109983693 conn(0x7fd5f4076d50 msgr2=0x7fd5f41060f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:16.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.380+0000 7fd5f91cd700 1 -- 172.21.15.83:0/109983693 shutdown_connections 2024-04-01T06:56:16.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.380+0000 7fd5f91cd700 1 -- 172.21.15.83:0/109983693 wait complete. 2024-04-01T06:56:16.391 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-01T06:56:16.392 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-01T06:56:16.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.516+0000 7f27d8229700 1 -- 172.21.15.83:0/1595659476 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27d0105ce0 msgr2=0x7f27d01060c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:16.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.516+0000 7f27d8229700 1 --2- 172.21.15.83:0/1595659476 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27d0105ce0 0x7f27d01060c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f27c4009990 tx=0x7f27c4009ca0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.516+0000 7f27d8229700 1 -- 172.21.15.83:0/1595659476 shutdown_connections 2024-04-01T06:56:16.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.516+0000 7f27d8229700 1 --2- 172.21.15.83:0/1595659476 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27d0105ce0 0x7f27d01060c0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.516+0000 7f27d8229700 1 --2- 172.21.15.83:0/1595659476 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f27d00687f0 0x7f27d010db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.516+0000 7f27d8229700 1 --2- 172.21.15.83:0/1595659476 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27d0067e30 0x7f27d00682b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.516+0000 7f27d8229700 1 -- 172.21.15.83:0/1595659476 >> 172.21.15.83:0/1595659476 conn(0x7f27d0076d40 msgr2=0x7f27d0077150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:16.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.516+0000 7f27d8229700 1 -- 172.21.15.83:0/1595659476 shutdown_connections 2024-04-01T06:56:16.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.516+0000 7f27d8229700 1 -- 172.21.15.83:0/1595659476 wait complete. 2024-04-01T06:56:16.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.517+0000 7f27d8229700 1 Processor -- start 2024-04-01T06:56:16.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.517+0000 7f27d8229700 1 -- start start 2024-04-01T06:56:16.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.517+0000 7f27d8229700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f27d0067e30 0x7f27d0197240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:16.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.517+0000 7f27d8229700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27d00687f0 0x7f27d0197780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:16.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.517+0000 7f27d8229700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27d0105ce0 0x7f27d019bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:16.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.517+0000 7f27d8229700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d019c160 con 0x7f27d0105ce0 2024-04-01T06:56:16.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.517+0000 7f27d8229700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d019c2d0 con 0x7f27d0067e30 2024-04-01T06:56:16.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.517+0000 7f27d8229700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d019c490 con 0x7f27d00687f0 2024-04-01T06:56:16.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.517+0000 7f27d67c6700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27d0105ce0 0x7f27d019bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:16.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.517+0000 7f27d67c6700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27d0105ce0 0x7f27d019bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37784/0 (socket says 172.21.15.83:37784) 2024-04-01T06:56:16.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.517+0000 7f27d67c6700 1 -- 172.21.15.83:0/2453410007 learned_addr learned my addr 172.21.15.83:0/2453410007 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:16.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.517+0000 7f27d5fc5700 1 --2- 172.21.15.83:0/2453410007 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f27d0067e30 0x7f27d0197240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:16.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.517+0000 7f27d57c4700 1 --2- 172.21.15.83:0/2453410007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27d00687f0 0x7f27d0197780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:16.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.518+0000 7f27d67c6700 1 -- 172.21.15.83:0/2453410007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27d00687f0 msgr2=0x7f27d0197780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:16.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.518+0000 7f27d67c6700 1 --2- 172.21.15.83:0/2453410007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27d00687f0 0x7f27d0197780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.518+0000 7f27d67c6700 1 -- 172.21.15.83:0/2453410007 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f27d0067e30 msgr2=0x7f27d0197240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:16.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.518+0000 7f27d67c6700 1 --2- 172.21.15.83:0/2453410007 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f27d0067e30 0x7f27d0197240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.518+0000 7f27d67c6700 1 -- 172.21.15.83:0/2453410007 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c40095f0 con 0x7f27d0105ce0 2024-04-01T06:56:16.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.518+0000 7f27d67c6700 1 --2- 172.21.15.83:0/2453410007 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27d0105ce0 0x7f27d019bb20 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f27c8007ee0 tx=0x7f27c800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:16.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.518+0000 7f27c2ffd700 1 -- 172.21.15.83:0/2453410007 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c8017070 con 0x7f27d0105ce0 2024-04-01T06:56:16.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.518+0000 7f27c2ffd700 1 -- 172.21.15.83:0/2453410007 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f27c800f040 con 0x7f27d0105ce0 2024-04-01T06:56:16.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.518+0000 7f27d8229700 1 -- 172.21.15.83:0/2453410007 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27d019c770 con 0x7f27d0105ce0 2024-04-01T06:56:16.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.518+0000 7f27c2ffd700 1 -- 172.21.15.83:0/2453410007 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c8005740 con 0x7f27d0105ce0 2024-04-01T06:56:16.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.518+0000 7f27d8229700 1 -- 172.21.15.83:0/2453410007 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27d01a3fb0 con 0x7f27d0105ce0 2024-04-01T06:56:16.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.520+0000 7f27c2ffd700 1 -- 172.21.15.83:0/2453410007 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) v1 ==== 136098+0+0 (secure 0 0 0) 0x7f27c800dc60 con 0x7f27d0105ce0 2024-04-01T06:56:16.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.521+0000 7f27c2ffd700 1 --2- 172.21.15.83:0/2453410007 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f27bc0a1430 0x7f27bc0a38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:16.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.521+0000 7f27c2ffd700 1 -- 172.21.15.83:0/2453410007 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f27c80cc710 con 0x7f27d0105ce0 2024-04-01T06:56:16.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.521+0000 7f27d5fc5700 1 --2- 172.21.15.83:0/2453410007 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f27bc0a1430 0x7f27bc0a38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:16.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.521+0000 7f27d5fc5700 1 --2- 172.21.15.83:0/2453410007 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f27bc0a1430 0x7f27bc0a38f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f27c400b5c0 tx=0x7f27c4005fd0 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:16.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.522+0000 7f27e43bfb80 1 Processor -- start 2024-04-01T06:56:16.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.522+0000 7f27e43bfb80 1 -- start start 2024-04-01T06:56:16.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.522+0000 7f27e43bfb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5621d8c935d0 0x5621d8c939b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:16.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.522+0000 7f27e43bfb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5621d8c93ef0 0x5621d8c9e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:16.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.522+0000 7f27e43bfb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5621d8c9edf0 0x5621d8ca11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:16.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.522+0000 7f27e43bfb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621d8bec990 con 0x5621d8c93ef0 2024-04-01T06:56:16.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.522+0000 7f27e43bfb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621d8bea350 con 0x5621d8c935d0 2024-04-01T06:56:16.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.522+0000 7f27e43bfb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621d8be5c40 con 0x5621d8c9edf0 2024-04-01T06:56:16.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.522+0000 7f27d57c4700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5621d8c93ef0 0x5621d8c9e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:16.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.522+0000 7f27d57c4700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5621d8c93ef0 0x5621d8c9e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37796/0 (socket says 172.21.15.83:37796) 2024-04-01T06:56:16.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.522+0000 7f27d57c4700 1 -- 172.21.15.83:0/1692199482 learned_addr learned my addr 172.21.15.83:0/1692199482 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:16.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.522+0000 7f27d5fc5700 1 --2- 172.21.15.83:0/1692199482 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5621d8c935d0 0x5621d8c939b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:16.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.522+0000 7f27d67c6700 1 --2- 172.21.15.83:0/1692199482 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5621d8c9edf0 0x5621d8ca11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:16.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.522+0000 7f27d57c4700 1 -- 172.21.15.83:0/1692199482 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5621d8c9edf0 msgr2=0x5621d8ca11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:16.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.522+0000 7f27d57c4700 1 --2- 172.21.15.83:0/1692199482 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5621d8c9edf0 0x5621d8ca11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.522+0000 7f27d57c4700 1 -- 172.21.15.83:0/1692199482 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5621d8c935d0 msgr2=0x5621d8c939b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:16.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.522+0000 7f27d57c4700 1 --2- 172.21.15.83:0/1692199482 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5621d8c935d0 0x5621d8c939b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.523+0000 7f27d57c4700 1 -- 172.21.15.83:0/1692199482 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621d8a673b0 con 0x5621d8c93ef0 2024-04-01T06:56:16.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.523+0000 7f27d57c4700 1 --2- 172.21.15.83:0/1692199482 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5621d8c93ef0 0x5621d8c9e8b0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f27cc00bd10 tx=0x7f27cc00f640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7fef784e860097e server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:16.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.523+0000 7f27bbfff700 1 -- 172.21.15.83:0/1692199482 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27cc00fe50 con 0x5621d8c93ef0 2024-04-01T06:56:16.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.523+0000 7f27bbfff700 1 -- 172.21.15.83:0/1692199482 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f27cc00be60 con 0x5621d8c93ef0 2024-04-01T06:56:16.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.523+0000 7f27bbfff700 1 -- 172.21.15.83:0/1692199482 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27cc011810 con 0x5621d8c93ef0 2024-04-01T06:56:16.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.523+0000 7f27e43bfb80 1 -- 172.21.15.83:0/1692199482 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5621d8c93ef0 msgr2=0x5621d8c9e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:16.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.523+0000 7f27e43bfb80 1 --2- 172.21.15.83:0/1692199482 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5621d8c93ef0 0x5621d8c9e8b0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f27cc00bd10 tx=0x7f27cc00f640 comp rx=0 tx=0).stop 2024-04-01T06:56:16.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.524+0000 7f27e43bfb80 1 -- 172.21.15.83:0/1692199482 shutdown_connections 2024-04-01T06:56:16.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.524+0000 7f27e43bfb80 1 --2- 172.21.15.83:0/1692199482 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5621d8c9edf0 0x5621d8ca11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.524+0000 7f27e43bfb80 1 --2- 172.21.15.83:0/1692199482 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5621d8c935d0 0x5621d8c939b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.524+0000 7f27e43bfb80 1 --2- 172.21.15.83:0/1692199482 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5621d8c93ef0 0x5621d8c9e8b0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.524+0000 7f27e43bfb80 1 -- 172.21.15.83:0/1692199482 >> 172.21.15.83:0/1692199482 conn(0x5621d8bf36a0 msgr2=0x5621d8c8fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:16.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.524+0000 7f27e43bfb80 1 -- 172.21.15.83:0/1692199482 shutdown_connections 2024-04-01T06:56:16.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.524+0000 7f27e43bfb80 1 -- 172.21.15.83:0/1692199482 wait complete. 2024-04-01T06:56:16.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.524+0000 7f27e43bfb80 1 -- start start 2024-04-01T06:56:16.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.524+0000 7f27e43bfb80 1 Processor -- start 2024-04-01T06:56:16.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.525+0000 7f27e43bfb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5621d8c935d0 0x5621d8c9e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:16.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.525+0000 7f27e43bfb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5621d8c93ef0 0x5621d8c9bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:16.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.525+0000 7f27e43bfb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5621d8c9edf0 0x5621d8c9c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:16.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.525+0000 7f27e43bfb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621d8b81d80 con 0x5621d8c935d0 2024-04-01T06:56:16.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.525+0000 7f27e43bfb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621d8b81a20 con 0x5621d8c93ef0 2024-04-01T06:56:16.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.525+0000 7f27e43bfb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621d8a696a0 con 0x5621d8c9edf0 2024-04-01T06:56:16.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.525+0000 7f27e43bfb80 10 client.0 _ll_register_callbacks cb 0x5621d8b8b470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:56:16.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.525+0000 7f27d5fc5700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5621d8c935d0 0x5621d8c9e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:16.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.525+0000 7f27d5fc5700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5621d8c935d0 0x5621d8c9e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37810/0 (socket says 172.21.15.83:37810) 2024-04-01T06:56:16.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.525+0000 7f27d5fc5700 1 -- 172.21.15.83:0/507673350 learned_addr learned my addr 172.21.15.83:0/507673350 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:16.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.525+0000 7f27d57c4700 1 --2- 172.21.15.83:0/507673350 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5621d8c93ef0 0x5621d8c9bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:16.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.525+0000 7f27d67c6700 1 --2- 172.21.15.83:0/507673350 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5621d8c9edf0 0x5621d8c9c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:16.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.525+0000 7f27d5fc5700 1 -- 172.21.15.83:0/507673350 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5621d8c9edf0 msgr2=0x5621d8c9c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:16.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.525+0000 7f27d5fc5700 1 --2- 172.21.15.83:0/507673350 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5621d8c9edf0 0x5621d8c9c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.525+0000 7f27d5fc5700 1 -- 172.21.15.83:0/507673350 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5621d8c93ef0 msgr2=0x5621d8c9bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:16.531 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.525+0000 7f27d5fc5700 1 --2- 172.21.15.83:0/507673350 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5621d8c93ef0 0x5621d8c9bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.525+0000 7f27d5fc5700 1 -- 172.21.15.83:0/507673350 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27cc00b940 con 0x5621d8c935d0 2024-04-01T06:56:16.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.525+0000 7f27d57c4700 1 --2- 172.21.15.83:0/507673350 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5621d8c93ef0 0x5621d8c9bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:56:16.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.525+0000 7f27d5fc5700 1 --2- 172.21.15.83:0/507673350 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5621d8c935d0 0x5621d8c9e810 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f27c4015000 tx=0x7f27c4009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5d9bf36bdcdd6bf server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:16.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.525+0000 7f27b97fa700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:56:16.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.525+0000 7f27b97fa700 1 -- 172.21.15.83:0/507673350 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c401d040 con 0x5621d8c935d0 2024-04-01T06:56:16.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.525+0000 7f27b97fa700 1 -- 172.21.15.83:0/507673350 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f27c400f460 con 0x5621d8c935d0 2024-04-01T06:56:16.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.525+0000 7f27e43bfb80 1 -- 172.21.15.83:0/507673350 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5621d8ba6380 con 0x5621d8c935d0 2024-04-01T06:56:16.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.526+0000 7f27b97fa700 1 -- 172.21.15.83:0/507673350 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27c400f620 con 0x5621d8c935d0 2024-04-01T06:56:16.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.526+0000 7f27e43bfb80 10 client.15579 fetch_fsmap learned FSMap version 24 2024-04-01T06:56:16.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.526+0000 7f27e43bfb80 1 -- 172.21.15.83:0/507673350 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5621d8a13b60 con 0x5621d8c935d0 2024-04-01T06:56:16.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.526+0000 7f27b97fa700 1 -- 172.21.15.83:0/507673350 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f27c403d020 con 0x5621d8c935d0 2024-04-01T06:56:16.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.526+0000 7f27b97fa700 1 -- 172.21.15.83:0/507673350 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f27c402e070 con 0x5621d8c935d0 2024-04-01T06:56:16.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.526+0000 7f27e43bfb80 10 client.15579 fetch_fsmap finished waiting for FSMap version 24 2024-04-01T06:56:16.532 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.526+0000 7f27e43bfb80 10 client.15579 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-04-01T06:56:16.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.526+0000 7f27e43bfb80 20 client.15579 populate_metadata read hostname 'smithi083' 2024-04-01T06:56:16.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.526+0000 7f27e43bfb80 1 --2- 172.21.15.83:0/507673350 >> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] conn(0x5621d8cae9c0 0x5621d8cb0de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:16.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.526+0000 7f27e43bfb80 4 client.15579 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-01T06:56:16.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.526+0000 7f27e43bfb80 1 -- 172.21.15.83:0/507673350 --> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5621d8bde700 con 0x5621d8cae9c0 2024-04-01T06:56:16.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.526+0000 7f27d57c4700 1 --2- 172.21.15.83:0/507673350 >> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] conn(0x5621d8cae9c0 0x5621d8cb0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:16.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.527+0000 7f27b97fa700 10 client.15579 ms_handle_connect on v2:172.21.15.145:6836/2687798317 2024-04-01T06:56:16.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.527+0000 7f27d57c4700 1 --2- 172.21.15.83:0/507673350 >> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] conn(0x5621d8cae9c0 0x5621d8cb0de0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3c4bb7d3acf5606e server_cookie=30b18a526d1ae898 in_seq=0 out_seq=0 2024-04-01T06:56:16.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.527+0000 7f27b97fa700 1 -- 172.21.15.83:0/507673350 <== mds.1 v2:172.21.15.145:6836/2687798317 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5621d8bde700 con 0x5621d8cae9c0 2024-04-01T06:56:16.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.527+0000 7f27b97fa700 10 client.15579 handle_command_reply: tid=0 2024-04-01T06:56:16.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.527+0000 7f27e43bfb80 1 client.15579 shutdown 2024-04-01T06:56:16.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.527+0000 7f27e43bfb80 1 -- 172.21.15.83:0/507673350 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5621d8c935d0 msgr2=0x5621d8c9e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:16.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.527+0000 7f27e43bfb80 1 --2- 172.21.15.83:0/507673350 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5621d8c935d0 0x5621d8c9e810 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f27c4015000 tx=0x7f27c4009310 comp rx=0 tx=0).stop 2024-04-01T06:56:16.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.527+0000 7f27e43bfb80 1 -- 172.21.15.83:0/507673350 shutdown_connections 2024-04-01T06:56:16.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.527+0000 7f27e43bfb80 1 --2- 172.21.15.83:0/507673350 >> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] conn(0x5621d8cae9c0 0x5621d8cb0de0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.527+0000 7f27e43bfb80 1 --2- 172.21.15.83:0/507673350 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5621d8c935d0 0x5621d8c9e810 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.527+0000 7f27e43bfb80 1 --2- 172.21.15.83:0/507673350 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5621d8c9edf0 0x5621d8c9c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.527+0000 7f27b97fa700 0 client.15579 ms_handle_reset on v2:172.21.15.145:6836/2687798317 2024-04-01T06:56:16.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.527+0000 7f27e43bfb80 1 --2- 172.21.15.83:0/507673350 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5621d8c93ef0 0x5621d8c9bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.527+0000 7f27e43bfb80 1 -- 172.21.15.83:0/507673350 >> 172.21.15.83:0/507673350 conn(0x5621d8bf36a0 msgr2=0x5621d8c95620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:16.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.527+0000 7f27e43bfb80 1 -- 172.21.15.83:0/507673350 shutdown_connections 2024-04-01T06:56:16.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.527+0000 7f27e43bfb80 1 -- 172.21.15.83:0/507673350 wait complete. 2024-04-01T06:56:16.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.528+0000 7f27e43bfb80 20 client.15579 trim_cache size 0 max 16384 2024-04-01T06:56:16.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.540+0000 7f27e43bfb80 1 Processor -- start 2024-04-01T06:56:16.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.540+0000 7f27e43bfb80 1 -- start start 2024-04-01T06:56:16.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.541+0000 7f27e43bfb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5621d8c935d0 0x5621d8c9c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:16.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.541+0000 7f27e43bfb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5621d8c93ef0 0x5621d8cb0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:16.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.541+0000 7f27e43bfb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5621d8c9edf0 0x5621d8ca5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:16.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.541+0000 7f27e43bfb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621d8c8ff20 con 0x5621d8c93ef0 2024-04-01T06:56:16.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.541+0000 7f27e43bfb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621d8c9c710 con 0x5621d8c935d0 2024-04-01T06:56:16.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.541+0000 7f27e43bfb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621d8c8b480 con 0x5621d8c9edf0 2024-04-01T06:56:16.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.541+0000 7f27d57c4700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5621d8c93ef0 0x5621d8cb0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:16.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.541+0000 7f27d57c4700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5621d8c93ef0 0x5621d8cb0db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37812/0 (socket says 172.21.15.83:37812) 2024-04-01T06:56:16.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.541+0000 7f27d57c4700 1 -- 172.21.15.83:0/1327375456 learned_addr learned my addr 172.21.15.83:0/1327375456 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:16.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.541+0000 7f27d67c6700 1 --2- 172.21.15.83:0/1327375456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5621d8c9edf0 0x5621d8ca5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:16.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.541+0000 7f27d57c4700 1 -- 172.21.15.83:0/1327375456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5621d8c9edf0 msgr2=0x5621d8ca5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:16.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.541+0000 7f27d57c4700 1 --2- 172.21.15.83:0/1327375456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5621d8c9edf0 0x5621d8ca5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.541+0000 7f27d57c4700 1 -- 172.21.15.83:0/1327375456 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5621d8c935d0 msgr2=0x5621d8c9c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:16.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.541+0000 7f27d57c4700 1 --2- 172.21.15.83:0/1327375456 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5621d8c935d0 0x5621d8c9c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.541+0000 7f27d57c4700 1 -- 172.21.15.83:0/1327375456 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621d8babea0 con 0x5621d8c93ef0 2024-04-01T06:56:16.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.541+0000 7f27d67c6700 1 --2- 172.21.15.83:0/1327375456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5621d8c9edf0 0x5621d8ca5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:56:16.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.541+0000 7f27d57c4700 1 --2- 172.21.15.83:0/1327375456 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5621d8c93ef0 0x5621d8cb0db0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f27cc00bd10 tx=0x7f27cc01adb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bde4cb34f821ac4b server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:16.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.541+0000 7f27c0ff9700 1 -- 172.21.15.83:0/1327375456 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27cc027b50 con 0x5621d8c93ef0 2024-04-01T06:56:16.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.541+0000 7f27c0ff9700 1 -- 172.21.15.83:0/1327375456 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f27cc00b2c0 con 0x5621d8c93ef0 2024-04-01T06:56:16.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.541+0000 7f27c0ff9700 1 -- 172.21.15.83:0/1327375456 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27cc0053c0 con 0x5621d8c93ef0 2024-04-01T06:56:16.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.542+0000 7f27e43bfb80 1 -- 172.21.15.83:0/1327375456 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5621d8c93ef0 msgr2=0x5621d8cb0db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:16.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.542+0000 7f27e43bfb80 1 --2- 172.21.15.83:0/1327375456 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5621d8c93ef0 0x5621d8cb0db0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f27cc00bd10 tx=0x7f27cc01adb0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.547 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.542+0000 7f27e43bfb80 1 -- 172.21.15.83:0/1327375456 shutdown_connections 2024-04-01T06:56:16.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.542+0000 7f27e43bfb80 1 --2- 172.21.15.83:0/1327375456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5621d8c9edf0 0x5621d8ca5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.542+0000 7f27e43bfb80 1 --2- 172.21.15.83:0/1327375456 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5621d8c935d0 0x5621d8c9c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.542+0000 7f27e43bfb80 1 --2- 172.21.15.83:0/1327375456 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5621d8c93ef0 0x5621d8cb0db0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.542+0000 7f27e43bfb80 1 -- 172.21.15.83:0/1327375456 >> 172.21.15.83:0/1327375456 conn(0x5621d8bf36a0 msgr2=0x5621d8cb5720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:16.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.542+0000 7f27e43bfb80 1 -- 172.21.15.83:0/1327375456 shutdown_connections 2024-04-01T06:56:16.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.542+0000 7f27e43bfb80 1 -- 172.21.15.83:0/1327375456 wait complete. 2024-04-01T06:56:16.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.542+0000 7f27e43bfb80 1 -- start start 2024-04-01T06:56:16.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.542+0000 7f27e43bfb80 1 Processor -- start 2024-04-01T06:56:16.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.543+0000 7f27e43bfb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5621d8c935d0 0x5621d8ca59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:16.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.543+0000 7f27e43bfb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5621d8c93ef0 0x5621d8ca3e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:16.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.543+0000 7f27e43bfb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5621d8c9edf0 0x5621d8ca4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:16.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.543+0000 7f27e43bfb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621d8ca4a90 con 0x5621d8c935d0 2024-04-01T06:56:16.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.543+0000 7f27e43bfb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621d8ca4c00 con 0x5621d8c93ef0 2024-04-01T06:56:16.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.543+0000 7f27e43bfb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621d8d06bf0 con 0x5621d8c9edf0 2024-04-01T06:56:16.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.543+0000 7f27e43bfb80 10 client.0 _ll_register_callbacks cb 0x5621d8b8b470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:56:16.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.543+0000 7f27d5fc5700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5621d8c935d0 0x5621d8ca59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:16.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.543+0000 7f27d5fc5700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5621d8c935d0 0x5621d8ca59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37820/0 (socket says 172.21.15.83:37820) 2024-04-01T06:56:16.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.543+0000 7f27d5fc5700 1 -- 172.21.15.83:0/1226271613 learned_addr learned my addr 172.21.15.83:0/1226271613 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:16.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.543+0000 7f27d67c6700 1 --2- 172.21.15.83:0/1226271613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5621d8c9edf0 0x5621d8ca4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:16.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.543+0000 7f27d57c4700 1 --2- 172.21.15.83:0/1226271613 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5621d8c93ef0 0x5621d8ca3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:16.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.543+0000 7f27d5fc5700 1 -- 172.21.15.83:0/1226271613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5621d8c9edf0 msgr2=0x5621d8ca4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:16.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.543+0000 7f27d5fc5700 1 --2- 172.21.15.83:0/1226271613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5621d8c9edf0 0x5621d8ca4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.543+0000 7f27d5fc5700 1 -- 172.21.15.83:0/1226271613 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5621d8c93ef0 msgr2=0x5621d8ca3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:16.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.543+0000 7f27d5fc5700 1 --2- 172.21.15.83:0/1226271613 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5621d8c93ef0 0x5621d8ca3e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.543+0000 7f27d5fc5700 1 -- 172.21.15.83:0/1226271613 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5621d8a673b0 con 0x5621d8c935d0 2024-04-01T06:56:16.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.543+0000 7f27d67c6700 1 --2- 172.21.15.83:0/1226271613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5621d8c9edf0 0x5621d8ca4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:56:16.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.543+0000 7f27d5fc5700 1 --2- 172.21.15.83:0/1226271613 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5621d8c935d0 0x5621d8ca59a0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f27c4005a60 tx=0x7f27c4039bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f9dce42642c15fe server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:16.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.543+0000 7f27b97fa700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:56:16.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.543+0000 7f27b97fa700 1 -- 172.21.15.83:0/1226271613 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c401d040 con 0x5621d8c935d0 2024-04-01T06:56:16.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.543+0000 7f27b97fa700 1 -- 172.21.15.83:0/1226271613 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f27c403e080 con 0x5621d8c935d0 2024-04-01T06:56:16.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.543+0000 7f27e43bfb80 1 -- 172.21.15.83:0/1226271613 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f27cc00be60 con 0x5621d8c935d0 2024-04-01T06:56:16.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.543+0000 7f27b97fa700 1 -- 172.21.15.83:0/1226271613 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27c400b5f0 con 0x5621d8c935d0 2024-04-01T06:56:16.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.543+0000 7f27e43bfb80 10 client.15585 fetch_fsmap learned FSMap version 24 2024-04-01T06:56:16.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.543+0000 7f27e43bfb80 1 -- 172.21.15.83:0/1226271613 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5621d8a6bcd0 con 0x5621d8c935d0 2024-04-01T06:56:16.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.543+0000 7f27b97fa700 1 -- 172.21.15.83:0/1226271613 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f27cc00be60 con 0x5621d8c935d0 2024-04-01T06:56:16.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.544+0000 7f27b97fa700 1 -- 172.21.15.83:0/1226271613 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f27c402e070 con 0x5621d8c935d0 2024-04-01T06:56:16.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.544+0000 7f27e43bfb80 10 client.15585 fetch_fsmap finished waiting for FSMap version 24 2024-04-01T06:56:16.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.544+0000 7f27e43bfb80 10 client.15585 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-04-01T06:56:16.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.544+0000 7f27e43bfb80 20 client.15585 populate_metadata read hostname 'smithi083' 2024-04-01T06:56:16.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.544+0000 7f27e43bfb80 1 --2- 172.21.15.83:0/1226271613 >> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] conn(0x5621d8d07ec0 0x5621d8d0a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:16.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.544+0000 7f27e43bfb80 4 client.15585 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-01T06:56:16.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.544+0000 7f27e43bfb80 1 -- 172.21.15.83:0/1226271613 --> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5621d8a34cf0 con 0x5621d8d07ec0 2024-04-01T06:56:16.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.544+0000 7f27d57c4700 1 --2- 172.21.15.83:0/1226271613 >> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] conn(0x5621d8d07ec0 0x5621d8d0a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:16.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.544+0000 7f27b97fa700 10 client.15585 ms_handle_connect on v2:172.21.15.145:6836/2687798317 2024-04-01T06:56:16.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.544+0000 7f27d57c4700 1 --2- 172.21.15.83:0/1226271613 >> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] conn(0x5621d8d07ec0 0x5621d8d0a2e0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a4b5a53f9013f8ff server_cookie=e5e9e214244f53c0 in_seq=0 out_seq=0 2024-04-01T06:56:16.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.544+0000 7f27b97fa700 1 -- 172.21.15.83:0/1226271613 <== mds.1 v2:172.21.15.145:6836/2687798317 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5621d8a34cf0 con 0x5621d8d07ec0 2024-04-01T06:56:16.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.545+0000 7f27b97fa700 10 client.15585 handle_command_reply: tid=0 2024-04-01T06:56:16.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.545+0000 7f27e43bfb80 1 client.15585 shutdown 2024-04-01T06:56:16.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.545+0000 7f27e43bfb80 1 -- 172.21.15.83:0/1226271613 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5621d8c935d0 msgr2=0x5621d8ca59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:16.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.545+0000 7f27e43bfb80 1 --2- 172.21.15.83:0/1226271613 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5621d8c935d0 0x5621d8ca59a0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f27c4005a60 tx=0x7f27c4039bc0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.545+0000 7f27e43bfb80 1 -- 172.21.15.83:0/1226271613 shutdown_connections 2024-04-01T06:56:16.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.545+0000 7f27e43bfb80 1 --2- 172.21.15.83:0/1226271613 >> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] conn(0x5621d8d07ec0 0x5621d8d0a2e0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.545+0000 7f27e43bfb80 1 --2- 172.21.15.83:0/1226271613 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5621d8c935d0 0x5621d8ca59a0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.545+0000 7f27e43bfb80 1 --2- 172.21.15.83:0/1226271613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5621d8c9edf0 0x5621d8ca4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.545+0000 7f27b97fa700 0 client.15585 ms_handle_reset on v2:172.21.15.145:6836/2687798317 2024-04-01T06:56:16.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.545+0000 7f27e43bfb80 1 --2- 172.21.15.83:0/1226271613 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5621d8c93ef0 0x5621d8ca3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.545+0000 7f27e43bfb80 1 -- 172.21.15.83:0/1226271613 >> 172.21.15.83:0/1226271613 conn(0x5621d8bf36a0 msgr2=0x5621d8c9a430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:16.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.545+0000 7f27e43bfb80 1 -- 172.21.15.83:0/1226271613 shutdown_connections 2024-04-01T06:56:16.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.545+0000 7f27e43bfb80 1 -- 172.21.15.83:0/1226271613 wait complete. 2024-04-01T06:56:16.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.545+0000 7f27e43bfb80 20 client.15585 trim_cache size 0 max 16384 2024-04-01T06:56:16.552 INFO:teuthology.orchestra.run.smithi083.stdout:[] 2024-04-01T06:56:16.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.545+0000 7f27d8229700 1 -- 172.21.15.83:0/2453410007 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f27bc0a1430 msgr2=0x7f27bc0a38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:16.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.545+0000 7f27d8229700 1 --2- 172.21.15.83:0/2453410007 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f27bc0a1430 0x7f27bc0a38f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f27c400b5c0 tx=0x7f27c4005fd0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.545+0000 7f27d8229700 1 -- 172.21.15.83:0/2453410007 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27d0105ce0 msgr2=0x7f27d019bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:16.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.545+0000 7f27d8229700 1 --2- 172.21.15.83:0/2453410007 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27d0105ce0 0x7f27d019bb20 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f27c8007ee0 tx=0x7f27c800d3b0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.545+0000 7f27d8229700 1 -- 172.21.15.83:0/2453410007 shutdown_connections 2024-04-01T06:56:16.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.545+0000 7f27d8229700 1 --2- 172.21.15.83:0/2453410007 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f27bc0a1430 0x7f27bc0a38f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.545+0000 7f27d8229700 1 --2- 172.21.15.83:0/2453410007 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f27d0105ce0 0x7f27d019bb20 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.545+0000 7f27d8229700 1 --2- 172.21.15.83:0/2453410007 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f27d0067e30 0x7f27d0197240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.545+0000 7f27d8229700 1 --2- 172.21.15.83:0/2453410007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27d00687f0 0x7f27d0197780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.545+0000 7f27d8229700 1 -- 172.21.15.83:0/2453410007 >> 172.21.15.83:0/2453410007 conn(0x7f27d0076d40 msgr2=0x7f27d00fd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:16.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.545+0000 7f27d8229700 1 -- 172.21.15.83:0/2453410007 shutdown_connections 2024-04-01T06:56:16.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.545+0000 7f27d8229700 1 -- 172.21.15.83:0/2453410007 wait complete. 2024-04-01T06:56:16.557 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-01T06:56:16.557 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-01T06:56:16.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.681+0000 7fb6d263d700 1 -- 172.21.15.83:0/1460294693 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb6cc100800 msgr2=0x7fb6cc104830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:16.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.681+0000 7fb6d263d700 1 --2- 172.21.15.83:0/1460294693 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb6cc100800 0x7fb6cc104830 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4009990 tx=0x7fb6b4009ca0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.681+0000 7fb6d263d700 1 -- 172.21.15.83:0/1460294693 shutdown_connections 2024-04-01T06:56:16.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.681+0000 7fb6d263d700 1 --2- 172.21.15.83:0/1460294693 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6cc104f60 0x7fb6cc10cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.681+0000 7fb6d263d700 1 --2- 172.21.15.83:0/1460294693 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb6cc0ffe50 0x7fb6cc100230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.681+0000 7fb6d263d700 1 --2- 172.21.15.83:0/1460294693 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb6cc100800 0x7fb6cc104830 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.681+0000 7fb6d263d700 1 -- 172.21.15.83:0/1460294693 >> 172.21.15.83:0/1460294693 conn(0x7fb6cc076d40 msgr2=0x7fb6cc077150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:16.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.681+0000 7fb6d263d700 1 -- 172.21.15.83:0/1460294693 shutdown_connections 2024-04-01T06:56:16.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.681+0000 7fb6d263d700 1 -- 172.21.15.83:0/1460294693 wait complete. 2024-04-01T06:56:16.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.681+0000 7fb6d263d700 1 Processor -- start 2024-04-01T06:56:16.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.682+0000 7fb6d263d700 1 -- start start 2024-04-01T06:56:16.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.682+0000 7fb6d263d700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb6cc0ffe50 0x7fb6cc1018d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:16.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.682+0000 7fb6d263d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb6cc104f60 0x7fb6cc101e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:16.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.682+0000 7fb6d263d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6cc102350 0x7fb6cc1a5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:16.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.682+0000 7fb6d263d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6cc1a5940 con 0x7fb6cc104f60 2024-04-01T06:56:16.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.682+0000 7fb6d263d700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6cc1a5ab0 con 0x7fb6cc0ffe50 2024-04-01T06:56:16.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.682+0000 7fb6d263d700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6cc1a5c70 con 0x7fb6cc102350 2024-04-01T06:56:16.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.682+0000 7fb6cb7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb6cc104f60 0x7fb6cc101e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:16.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.682+0000 7fb6cb7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb6cc104f60 0x7fb6cc101e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37836/0 (socket says 172.21.15.83:37836) 2024-04-01T06:56:16.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.682+0000 7fb6cb7fe700 1 -- 172.21.15.83:0/2536377798 learned_addr learned my addr 172.21.15.83:0/2536377798 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:16.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.682+0000 7fb6cbfff700 1 --2- 172.21.15.83:0/2536377798 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb6cc0ffe50 0x7fb6cc1018d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:16.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.682+0000 7fb6d0bda700 1 --2- 172.21.15.83:0/2536377798 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6cc102350 0x7fb6cc1a5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:16.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.682+0000 7fb6cb7fe700 1 -- 172.21.15.83:0/2536377798 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6cc102350 msgr2=0x7fb6cc1a5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:16.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.682+0000 7fb6cb7fe700 1 --2- 172.21.15.83:0/2536377798 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6cc102350 0x7fb6cc1a5370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.682+0000 7fb6cb7fe700 1 -- 172.21.15.83:0/2536377798 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb6cc0ffe50 msgr2=0x7fb6cc1018d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:16.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.682+0000 7fb6cb7fe700 1 --2- 172.21.15.83:0/2536377798 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb6cc0ffe50 0x7fb6cc1018d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.682+0000 7fb6cb7fe700 1 -- 172.21.15.83:0/2536377798 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6b40095f0 con 0x7fb6cc104f60 2024-04-01T06:56:16.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.682+0000 7fb6cbfff700 1 --2- 172.21.15.83:0/2536377798 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb6cc0ffe50 0x7fb6cc1018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:56:16.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.682+0000 7fb6cb7fe700 1 --2- 172.21.15.83:0/2536377798 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb6cc104f60 0x7fb6cc101e10 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fb6b40059d0 tx=0x7fb6b400f460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:16.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.683+0000 7fb6c97fa700 1 -- 172.21.15.83:0/2536377798 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b401d070 con 0x7fb6cc104f60 2024-04-01T06:56:16.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.683+0000 7fb6c97fa700 1 -- 172.21.15.83:0/2536377798 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb6b400fe40 con 0x7fb6cc104f60 2024-04-01T06:56:16.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.683+0000 7fb6d263d700 1 -- 172.21.15.83:0/2536377798 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6cc1a5ef0 con 0x7fb6cc104f60 2024-04-01T06:56:16.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.683+0000 7fb6c97fa700 1 -- 172.21.15.83:0/2536377798 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b40039f0 con 0x7fb6cc104f60 2024-04-01T06:56:16.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.683+0000 7fb6d263d700 1 -- 172.21.15.83:0/2536377798 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6cc1a62b0 con 0x7fb6cc104f60 2024-04-01T06:56:16.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.685+0000 7fb6c97fa700 1 -- 172.21.15.83:0/2536377798 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) v1 ==== 136098+0+0 (secure 0 0 0) 0x7fb6b4022470 con 0x7fb6cc104f60 2024-04-01T06:56:16.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.685+0000 7fb6c97fa700 1 --2- 172.21.15.83:0/2536377798 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fb6b80a13b0 0x7fb6b80a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:16.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.686+0000 7fb6cbfff700 1 --2- 172.21.15.83:0/2536377798 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fb6b80a13b0 0x7fb6b80a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:16.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.686+0000 7fb6c97fa700 1 -- 172.21.15.83:0/2536377798 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8425+0+0 (secure 0 0 0) 0x7fb6b4022e40 con 0x7fb6cc104f60 2024-04-01T06:56:16.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.686+0000 7fb6cbfff700 1 --2- 172.21.15.83:0/2536377798 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fb6b80a13b0 0x7fb6b80a3870 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc005fd0 tx=0x7fb6bc005e30 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:16.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.686+0000 7fb6de7d3b80 1 Processor -- start 2024-04-01T06:56:16.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.686+0000 7fb6de7d3b80 1 -- start start 2024-04-01T06:56:16.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.686+0000 7fb6de7d3b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55be500395d0 0x55be500399b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:16.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.686+0000 7fb6de7d3b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55be50039ef0 0x55be500448b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:16.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.686+0000 7fb6de7d3b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55be50044df0 0x55be500471e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:16.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.687+0000 7fb6de7d3b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be4ff92990 con 0x55be50044df0 2024-04-01T06:56:16.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.687+0000 7fb6de7d3b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be4ff90350 con 0x55be500395d0 2024-04-01T06:56:16.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.687+0000 7fb6de7d3b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be4ff8bc40 con 0x55be50039ef0 2024-04-01T06:56:16.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.687+0000 7fb6d0bda700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55be50044df0 0x55be500471e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:16.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.687+0000 7fb6d0bda700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55be50044df0 0x55be500471e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37842/0 (socket says 172.21.15.83:37842) 2024-04-01T06:56:16.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.687+0000 7fb6d0bda700 1 -- 172.21.15.83:0/3628243349 learned_addr learned my addr 172.21.15.83:0/3628243349 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:16.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.687+0000 7fb6cbfff700 1 --2- 172.21.15.83:0/3628243349 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55be500395d0 0x55be500399b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:16.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.687+0000 7fb6cb7fe700 1 --2- 172.21.15.83:0/3628243349 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55be50039ef0 0x55be500448b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:16.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.687+0000 7fb6d0bda700 1 -- 172.21.15.83:0/3628243349 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55be50039ef0 msgr2=0x55be500448b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:16.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.687+0000 7fb6d0bda700 1 --2- 172.21.15.83:0/3628243349 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55be50039ef0 0x55be500448b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.687+0000 7fb6d0bda700 1 -- 172.21.15.83:0/3628243349 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55be500395d0 msgr2=0x55be500399b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:16.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.687+0000 7fb6d0bda700 1 --2- 172.21.15.83:0/3628243349 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55be500395d0 0x55be500399b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.687+0000 7fb6d0bda700 1 -- 172.21.15.83:0/3628243349 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be4fe0d3b0 con 0x55be50044df0 2024-04-01T06:56:16.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.687+0000 7fb6cbfff700 1 --2- 172.21.15.83:0/3628243349 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55be500395d0 0x55be500399b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:56:16.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.687+0000 7fb6cb7fe700 1 --2- 172.21.15.83:0/3628243349 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55be50039ef0 0x55be500448b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:56:16.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.687+0000 7fb6d0bda700 1 --2- 172.21.15.83:0/3628243349 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55be50044df0 0x55be500471e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fb6c4007d90 tx=0x7fb6c400c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2466f3933469576 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:16.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.687+0000 7fb6c27fc700 1 -- 172.21.15.83:0/3628243349 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c4011430 con 0x55be50044df0 2024-04-01T06:56:16.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.687+0000 7fb6c27fc700 1 -- 172.21.15.83:0/3628243349 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb6c4011a50 con 0x55be50044df0 2024-04-01T06:56:16.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.687+0000 7fb6c27fc700 1 -- 172.21.15.83:0/3628243349 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c40107d0 con 0x55be50044df0 2024-04-01T06:56:16.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.688+0000 7fb6de7d3b80 1 -- 172.21.15.83:0/3628243349 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55be50044df0 msgr2=0x55be500471e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:16.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.688+0000 7fb6de7d3b80 1 --2- 172.21.15.83:0/3628243349 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55be50044df0 0x55be500471e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fb6c4007d90 tx=0x7fb6c400c470 comp rx=0 tx=0).stop 2024-04-01T06:56:16.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.688+0000 7fb6de7d3b80 1 -- 172.21.15.83:0/3628243349 shutdown_connections 2024-04-01T06:56:16.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.688+0000 7fb6de7d3b80 1 --2- 172.21.15.83:0/3628243349 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55be50044df0 0x55be500471e0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.688+0000 7fb6de7d3b80 1 --2- 172.21.15.83:0/3628243349 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55be500395d0 0x55be500399b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.688+0000 7fb6de7d3b80 1 --2- 172.21.15.83:0/3628243349 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55be50039ef0 0x55be500448b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.688+0000 7fb6de7d3b80 1 -- 172.21.15.83:0/3628243349 >> 172.21.15.83:0/3628243349 conn(0x55be4ff996a0 msgr2=0x55be50035a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:16.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.688+0000 7fb6de7d3b80 1 -- 172.21.15.83:0/3628243349 shutdown_connections 2024-04-01T06:56:16.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.688+0000 7fb6de7d3b80 1 -- 172.21.15.83:0/3628243349 wait complete. 2024-04-01T06:56:16.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.688+0000 7fb6de7d3b80 1 -- start start 2024-04-01T06:56:16.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.689+0000 7fb6de7d3b80 1 Processor -- start 2024-04-01T06:56:16.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.689+0000 7fb6de7d3b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55be500395d0 0x55be50044730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:16.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.689+0000 7fb6de7d3b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55be50039ef0 0x55be50041a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:16.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.689+0000 7fb6de7d3b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55be50044df0 0x55be50041f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:16.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.689+0000 7fb6de7d3b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be4ff27d80 con 0x55be500395d0 2024-04-01T06:56:16.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.689+0000 7fb6de7d3b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be4ff27a20 con 0x55be50044df0 2024-04-01T06:56:16.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.689+0000 7fb6de7d3b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be4fe0f6a0 con 0x55be50039ef0 2024-04-01T06:56:16.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.689+0000 7fb6de7d3b80 10 client.0 _ll_register_callbacks cb 0x55be4ff31470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:56:16.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.689+0000 7fb6cbfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55be500395d0 0x55be50044730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:16.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.689+0000 7fb6cbfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55be500395d0 0x55be50044730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37848/0 (socket says 172.21.15.83:37848) 2024-04-01T06:56:16.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.689+0000 7fb6cbfff700 1 -- 172.21.15.83:0/2982965508 learned_addr learned my addr 172.21.15.83:0/2982965508 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:16.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.689+0000 7fb6cb7fe700 1 --2- 172.21.15.83:0/2982965508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55be50039ef0 0x55be50041a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:16.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.689+0000 7fb6d0bda700 1 --2- 172.21.15.83:0/2982965508 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55be50044df0 0x55be50041f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:16.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.689+0000 7fb6cbfff700 1 -- 172.21.15.83:0/2982965508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55be50039ef0 msgr2=0x55be50041a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:16.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.689+0000 7fb6cbfff700 1 --2- 172.21.15.83:0/2982965508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55be50039ef0 0x55be50041a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.689+0000 7fb6cbfff700 1 -- 172.21.15.83:0/2982965508 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55be50044df0 msgr2=0x55be50041f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:16.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.689+0000 7fb6cbfff700 1 --2- 172.21.15.83:0/2982965508 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55be50044df0 0x55be50041f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.689+0000 7fb6cbfff700 1 -- 172.21.15.83:0/2982965508 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6c40079c0 con 0x55be500395d0 2024-04-01T06:56:16.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.689+0000 7fb6d0bda700 1 --2- 172.21.15.83:0/2982965508 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55be50044df0 0x55be50041f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:56:16.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.689+0000 7fb6cb7fe700 1 --2- 172.21.15.83:0/2982965508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55be50039ef0 0x55be50041a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:56:16.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.689+0000 7fb6cbfff700 1 --2- 172.21.15.83:0/2982965508 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55be500395d0 0x55be50044730 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc00a5c0 tx=0x7fb6bc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b401620a3d947c5e server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:16.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.689+0000 7fb6ab7fe700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:56:16.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.689+0000 7fb6ab7fe700 1 -- 172.21.15.83:0/2982965508 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc00fa50 con 0x55be500395d0 2024-04-01T06:56:16.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.689+0000 7fb6ab7fe700 1 -- 172.21.15.83:0/2982965508 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8425+0+0 (secure 0 0 0) 0x7fb6bc00fbb0 con 0x55be500395d0 2024-04-01T06:56:16.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.689+0000 7fb6de7d3b80 1 -- 172.21.15.83:0/2982965508 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55be4ff4c380 con 0x55be500395d0 2024-04-01T06:56:16.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.690+0000 7fb6ab7fe700 1 -- 172.21.15.83:0/2982965508 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb6bc00fd70 con 0x55be500395d0 2024-04-01T06:56:16.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.690+0000 7fb6de7d3b80 10 client.15597 fetch_fsmap learned FSMap version 24 2024-04-01T06:56:16.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.690+0000 7fb6de7d3b80 1 -- 172.21.15.83:0/2982965508 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55be4fdb9b60 con 0x55be500395d0 2024-04-01T06:56:16.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.690+0000 7fb6ab7fe700 1 -- 172.21.15.83:0/2982965508 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55be4ff4c380 con 0x55be500395d0 2024-04-01T06:56:16.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.690+0000 7fb6ab7fe700 1 -- 172.21.15.83:0/2982965508 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fb6bc02c020 con 0x55be500395d0 2024-04-01T06:56:16.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.690+0000 7fb6de7d3b80 10 client.15597 fetch_fsmap finished waiting for FSMap version 24 2024-04-01T06:56:16.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.690+0000 7fb6de7d3b80 10 client.15597 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-01T06:56:16.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.690+0000 7fb6de7d3b80 20 client.15597 populate_metadata read hostname 'smithi083' 2024-04-01T06:56:16.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.690+0000 7fb6de7d3b80 1 --2- 172.21.15.83:0/2982965508 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55be50054840 0x55be50056c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:16.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.690+0000 7fb6de7d3b80 4 client.15597 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-01T06:56:16.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.690+0000 7fb6de7d3b80 1 -- 172.21.15.83:0/2982965508 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55be4ff84700 con 0x55be50054840 2024-04-01T06:56:16.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.690+0000 7fb6cb7fe700 1 --2- 172.21.15.83:0/2982965508 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55be50054840 0x55be50056c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:16.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.691+0000 7fb6cb7fe700 1 --2- 172.21.15.83:0/2982965508 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55be50054840 0x55be50056c60 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df13f930344d4ed5 server_cookie=4b7040e9bfab93f9 in_seq=0 out_seq=0 2024-04-01T06:56:16.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.691+0000 7fb6ab7fe700 10 client.15597 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:56:16.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.691+0000 7fb6ab7fe700 1 -- 172.21.15.83:0/2982965508 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55be4ff84700 con 0x55be50054840 2024-04-01T06:56:16.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.691+0000 7fb6ab7fe700 10 client.15597 handle_command_reply: tid=0 2024-04-01T06:56:16.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.691+0000 7fb6de7d3b80 1 client.15597 shutdown 2024-04-01T06:56:16.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.692+0000 7fb6de7d3b80 1 -- 172.21.15.83:0/2982965508 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55be500395d0 msgr2=0x55be50044730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:16.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.692+0000 7fb6de7d3b80 1 --2- 172.21.15.83:0/2982965508 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55be500395d0 0x55be50044730 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc00a5c0 tx=0x7fb6bc004750 comp rx=0 tx=0).stop 2024-04-01T06:56:16.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.692+0000 7fb6de7d3b80 1 -- 172.21.15.83:0/2982965508 shutdown_connections 2024-04-01T06:56:16.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.692+0000 7fb6de7d3b80 1 --2- 172.21.15.83:0/2982965508 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55be50054840 0x55be50056c60 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.692+0000 7fb6de7d3b80 1 --2- 172.21.15.83:0/2982965508 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55be500395d0 0x55be50044730 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.692+0000 7fb6de7d3b80 1 --2- 172.21.15.83:0/2982965508 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55be50044df0 0x55be50041f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.692+0000 7fb6ab7fe700 0 client.15597 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:56:16.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.692+0000 7fb6de7d3b80 1 --2- 172.21.15.83:0/2982965508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55be50039ef0 0x55be50041a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.692+0000 7fb6de7d3b80 1 -- 172.21.15.83:0/2982965508 >> 172.21.15.83:0/2982965508 conn(0x55be4ff996a0 msgr2=0x55be5003b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:16.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.692+0000 7fb6de7d3b80 1 -- 172.21.15.83:0/2982965508 shutdown_connections 2024-04-01T06:56:16.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.692+0000 7fb6de7d3b80 1 -- 172.21.15.83:0/2982965508 wait complete. 2024-04-01T06:56:16.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.692+0000 7fb6de7d3b80 20 client.15597 trim_cache size 0 max 16384 2024-04-01T06:56:16.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.705+0000 7fb6de7d3b80 1 Processor -- start 2024-04-01T06:56:16.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.705+0000 7fb6de7d3b80 1 -- start start 2024-04-01T06:56:16.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.705+0000 7fb6de7d3b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55be500395d0 0x55be50056c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:16.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.705+0000 7fb6de7d3b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55be50039ef0 0x55be5004baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:16.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.705+0000 7fb6de7d3b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55be50044df0 0x55be5002ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:16.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.705+0000 7fb6de7d3b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be50051450 con 0x55be50044df0 2024-04-01T06:56:16.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.705+0000 7fb6de7d3b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be5003b130 con 0x55be50039ef0 2024-04-01T06:56:16.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.705+0000 7fb6de7d3b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be5003af60 con 0x55be500395d0 2024-04-01T06:56:16.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.705+0000 7fb6d0bda700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55be50044df0 0x55be5002ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:16.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.705+0000 7fb6d0bda700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55be50044df0 0x55be5002ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37862/0 (socket says 172.21.15.83:37862) 2024-04-01T06:56:16.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.705+0000 7fb6d0bda700 1 -- 172.21.15.83:0/3576152101 learned_addr learned my addr 172.21.15.83:0/3576152101 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:16.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.705+0000 7fb6cb7fe700 1 --2- 172.21.15.83:0/3576152101 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55be50039ef0 0x55be5004baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:16.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.705+0000 7fb6cbfff700 1 --2- 172.21.15.83:0/3576152101 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55be500395d0 0x55be50056c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:16.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.705+0000 7fb6d0bda700 1 -- 172.21.15.83:0/3576152101 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55be500395d0 msgr2=0x55be50056c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:16.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.705+0000 7fb6d0bda700 1 --2- 172.21.15.83:0/3576152101 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55be500395d0 0x55be50056c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.705+0000 7fb6d0bda700 1 -- 172.21.15.83:0/3576152101 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55be50039ef0 msgr2=0x55be5004baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:16.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.705+0000 7fb6d0bda700 1 --2- 172.21.15.83:0/3576152101 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55be50039ef0 0x55be5004baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.705+0000 7fb6d0bda700 1 -- 172.21.15.83:0/3576152101 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be4ff51ea0 con 0x55be50044df0 2024-04-01T06:56:16.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.705+0000 7fb6d0bda700 1 --2- 172.21.15.83:0/3576152101 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55be50044df0 0x55be5002ef70 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fb6c4007d30 tx=0x7fb6c4007080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6796636de65bba4c server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:16.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.705+0000 7fb6c2ffd700 1 -- 172.21.15.83:0/3576152101 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c400ced0 con 0x55be50044df0 2024-04-01T06:56:16.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.705+0000 7fb6c2ffd700 1 -- 172.21.15.83:0/3576152101 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb6c4011bc0 con 0x55be50044df0 2024-04-01T06:56:16.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.705+0000 7fb6c2ffd700 1 -- 172.21.15.83:0/3576152101 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c401ab20 con 0x55be50044df0 2024-04-01T06:56:16.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.706+0000 7fb6de7d3b80 1 -- 172.21.15.83:0/3576152101 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55be50044df0 msgr2=0x55be5002ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:16.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.706+0000 7fb6de7d3b80 1 --2- 172.21.15.83:0/3576152101 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55be50044df0 0x55be5002ef70 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fb6c4007d30 tx=0x7fb6c4007080 comp rx=0 tx=0).stop 2024-04-01T06:56:16.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.706+0000 7fb6de7d3b80 1 -- 172.21.15.83:0/3576152101 shutdown_connections 2024-04-01T06:56:16.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.706+0000 7fb6de7d3b80 1 --2- 172.21.15.83:0/3576152101 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55be50044df0 0x55be5002ef70 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.706+0000 7fb6de7d3b80 1 --2- 172.21.15.83:0/3576152101 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55be500395d0 0x55be50056c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.706+0000 7fb6de7d3b80 1 --2- 172.21.15.83:0/3576152101 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55be50039ef0 0x55be5004baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.706+0000 7fb6de7d3b80 1 -- 172.21.15.83:0/3576152101 >> 172.21.15.83:0/3576152101 conn(0x55be4ff996a0 msgr2=0x55be5002e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:16.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.706+0000 7fb6de7d3b80 1 -- 172.21.15.83:0/3576152101 shutdown_connections 2024-04-01T06:56:16.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.706+0000 7fb6de7d3b80 1 -- 172.21.15.83:0/3576152101 wait complete. 2024-04-01T06:56:16.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.706+0000 7fb6de7d3b80 1 -- start start 2024-04-01T06:56:16.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.707+0000 7fb6de7d3b80 1 Processor -- start 2024-04-01T06:56:16.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.707+0000 7fb6de7d3b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55be500395d0 0x55be5004b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:16.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.707+0000 7fb6de7d3b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55be50039ef0 0x55be50049d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:16.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.707+0000 7fb6de7d3b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55be50044df0 0x55be5004a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:16.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.707+0000 7fb6de7d3b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be5004a800 con 0x55be50039ef0 2024-04-01T06:56:16.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.707+0000 7fb6de7d3b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be5004a970 con 0x55be500395d0 2024-04-01T06:56:16.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.707+0000 7fb6de7d3b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be5004ab30 con 0x55be50044df0 2024-04-01T06:56:16.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.707+0000 7fb6de7d3b80 10 client.0 _ll_register_callbacks cb 0x55be4ff31470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:56:16.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.707+0000 7fb6cb7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55be50039ef0 0x55be50049d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:16.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.707+0000 7fb6cb7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55be50039ef0 0x55be50049d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37864/0 (socket says 172.21.15.83:37864) 2024-04-01T06:56:16.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.707+0000 7fb6cb7fe700 1 -- 172.21.15.83:0/2636538789 learned_addr learned my addr 172.21.15.83:0/2636538789 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:16.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.707+0000 7fb6d0bda700 1 --2- 172.21.15.83:0/2636538789 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55be50044df0 0x55be5004a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:16.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.707+0000 7fb6cbfff700 1 --2- 172.21.15.83:0/2636538789 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55be500395d0 0x55be5004b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:16.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.707+0000 7fb6cb7fe700 1 -- 172.21.15.83:0/2636538789 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55be50044df0 msgr2=0x55be5004a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:16.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.707+0000 7fb6cb7fe700 1 --2- 172.21.15.83:0/2636538789 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55be50044df0 0x55be5004a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.707+0000 7fb6cb7fe700 1 -- 172.21.15.83:0/2636538789 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55be500395d0 msgr2=0x55be5004b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:16.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.707+0000 7fb6cb7fe700 1 --2- 172.21.15.83:0/2636538789 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55be500395d0 0x55be5004b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.707+0000 7fb6cb7fe700 1 -- 172.21.15.83:0/2636538789 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55be4fe0d3b0 con 0x55be50039ef0 2024-04-01T06:56:16.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.707+0000 7fb6cb7fe700 1 --2- 172.21.15.83:0/2636538789 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55be50039ef0 0x55be50049d80 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fb6b40cc360 tx=0x7fb6b4009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebeb91833d91dcff server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:16.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.707+0000 7fb6ab7fe700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:56:16.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.708+0000 7fb6ab7fe700 1 -- 172.21.15.83:0/2636538789 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b409b560 con 0x55be50039ef0 2024-04-01T06:56:16.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.708+0000 7fb6ab7fe700 1 -- 172.21.15.83:0/2636538789 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8425+0+0 (secure 0 0 0) 0x7fb6b409f390 con 0x55be50039ef0 2024-04-01T06:56:16.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.708+0000 7fb6de7d3b80 1 -- 172.21.15.83:0/2636538789 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb6c4011a50 con 0x55be50039ef0 2024-04-01T06:56:16.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.708+0000 7fb6ab7fe700 1 -- 172.21.15.83:0/2636538789 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb6b40a3950 con 0x55be50039ef0 2024-04-01T06:56:16.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.708+0000 7fb6de7d3b80 10 client.15603 fetch_fsmap learned FSMap version 24 2024-04-01T06:56:16.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.708+0000 7fb6de7d3b80 1 -- 172.21.15.83:0/2636538789 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55be4fe11cd0 con 0x55be50039ef0 2024-04-01T06:56:16.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.708+0000 7fb6ab7fe700 1 -- 172.21.15.83:0/2636538789 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb6c4011a50 con 0x55be50039ef0 2024-04-01T06:56:16.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.708+0000 7fb6ab7fe700 1 -- 172.21.15.83:0/2636538789 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fb6b400fb30 con 0x55be50039ef0 2024-04-01T06:56:16.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.708+0000 7fb6de7d3b80 10 client.15603 fetch_fsmap finished waiting for FSMap version 24 2024-04-01T06:56:16.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.708+0000 7fb6de7d3b80 10 client.15603 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-01T06:56:16.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.708+0000 7fb6de7d3b80 20 client.15603 populate_metadata read hostname 'smithi083' 2024-04-01T06:56:16.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.708+0000 7fb6de7d3b80 1 --2- 172.21.15.83:0/2636538789 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55be500a97a0 0x55be500abbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:16.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.708+0000 7fb6de7d3b80 4 client.15603 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-01T06:56:16.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.708+0000 7fb6de7d3b80 1 -- 172.21.15.83:0/2636538789 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55be4fddacf0 con 0x55be500a97a0 2024-04-01T06:56:16.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.708+0000 7fb6cbfff700 1 --2- 172.21.15.83:0/2636538789 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55be500a97a0 0x55be500abbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:16.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.709+0000 7fb6ab7fe700 10 client.15603 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:56:16.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.709+0000 7fb6cbfff700 1 --2- 172.21.15.83:0/2636538789 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55be500a97a0 0x55be500abbc0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5fd5344bcda2f68 server_cookie=30adbfb2fb52b7f9 in_seq=0 out_seq=0 2024-04-01T06:56:16.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.709+0000 7fb6ab7fe700 1 -- 172.21.15.83:0/2636538789 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55be4fddacf0 con 0x55be500a97a0 2024-04-01T06:56:16.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.709+0000 7fb6ab7fe700 10 client.15603 handle_command_reply: tid=0 2024-04-01T06:56:16.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.709+0000 7fb6de7d3b80 1 client.15603 shutdown 2024-04-01T06:56:16.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.709+0000 7fb6de7d3b80 1 -- 172.21.15.83:0/2636538789 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55be50039ef0 msgr2=0x55be50049d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:16.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.709+0000 7fb6de7d3b80 1 --2- 172.21.15.83:0/2636538789 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55be50039ef0 0x55be50049d80 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fb6b40cc360 tx=0x7fb6b4009310 comp rx=0 tx=0).stop 2024-04-01T06:56:16.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.709+0000 7fb6de7d3b80 1 -- 172.21.15.83:0/2636538789 shutdown_connections 2024-04-01T06:56:16.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.709+0000 7fb6de7d3b80 1 --2- 172.21.15.83:0/2636538789 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55be500a97a0 0x55be500abbc0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.709+0000 7fb6de7d3b80 1 --2- 172.21.15.83:0/2636538789 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55be50044df0 0x55be5004a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.709+0000 7fb6ab7fe700 0 client.15603 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:56:16.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.709+0000 7fb6de7d3b80 1 --2- 172.21.15.83:0/2636538789 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55be500395d0 0x55be5004b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.709+0000 7fb6de7d3b80 1 --2- 172.21.15.83:0/2636538789 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55be50039ef0 0x55be50049d80 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.709+0000 7fb6de7d3b80 1 -- 172.21.15.83:0/2636538789 >> 172.21.15.83:0/2636538789 conn(0x55be4ff996a0 msgr2=0x55be5003ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:16.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.709+0000 7fb6de7d3b80 1 -- 172.21.15.83:0/2636538789 shutdown_connections 2024-04-01T06:56:16.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.709+0000 7fb6de7d3b80 1 -- 172.21.15.83:0/2636538789 wait complete. 2024-04-01T06:56:16.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.709+0000 7fb6de7d3b80 20 client.15603 trim_cache size 0 max 16384 2024-04-01T06:56:16.717 INFO:teuthology.orchestra.run.smithi083.stdout:[] 2024-04-01T06:56:16.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.710+0000 7fb6d263d700 1 -- 172.21.15.83:0/2536377798 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fb6b80a13b0 msgr2=0x7fb6b80a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:16.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.710+0000 7fb6d263d700 1 --2- 172.21.15.83:0/2536377798 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fb6b80a13b0 0x7fb6b80a3870 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc005fd0 tx=0x7fb6bc005e30 comp rx=0 tx=0).stop 2024-04-01T06:56:16.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.710+0000 7fb6d263d700 1 -- 172.21.15.83:0/2536377798 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb6cc104f60 msgr2=0x7fb6cc101e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:16.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.710+0000 7fb6d263d700 1 --2- 172.21.15.83:0/2536377798 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb6cc104f60 0x7fb6cc101e10 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fb6b40059d0 tx=0x7fb6b400f460 comp rx=0 tx=0).stop 2024-04-01T06:56:16.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.710+0000 7fb6d263d700 1 -- 172.21.15.83:0/2536377798 shutdown_connections 2024-04-01T06:56:16.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.710+0000 7fb6d263d700 1 --2- 172.21.15.83:0/2536377798 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fb6b80a13b0 0x7fb6b80a3870 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.710+0000 7fb6d263d700 1 --2- 172.21.15.83:0/2536377798 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6cc102350 0x7fb6cc1a5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.710+0000 7fb6d263d700 1 --2- 172.21.15.83:0/2536377798 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb6cc0ffe50 0x7fb6cc1018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.710+0000 7fb6d263d700 1 --2- 172.21.15.83:0/2536377798 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb6cc104f60 0x7fb6cc101e10 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:16.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.710+0000 7fb6d263d700 1 -- 172.21.15.83:0/2536377798 >> 172.21.15.83:0/2536377798 conn(0x7fb6cc076d40 msgr2=0x7fb6cc068160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:16.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.710+0000 7fb6d263d700 1 -- 172.21.15.83:0/2536377798 shutdown_connections 2024-04-01T06:56:16.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:16.710+0000 7fb6d263d700 1 -- 172.21.15.83:0/2536377798 wait complete. 2024-04-01T06:56:17.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:56:16 smithi145 ceph-mon[47816]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 KiB/s wr, 27 op/s 2024-04-01T06:56:17.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:56:16 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/2090555416' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:56:17.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:56:16 smithi083 ceph-mon[43429]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 KiB/s wr, 27 op/s 2024-04-01T06:56:17.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:56:16 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/2090555416' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:56:17.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:56:16 smithi153 ceph-mon[48187]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 KiB/s wr, 27 op/s 2024-04-01T06:56:17.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:56:16 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/2090555416' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:56:17.722 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-01T06:56:17.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T06:56:17.723 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-01T06:56:17.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.861+0000 7fe26de24700 1 -- 172.21.15.83:0/3294298022 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe2680ffe50 msgr2=0x7fe268100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:17.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.861+0000 7fe26de24700 1 --2- 172.21.15.83:0/3294298022 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe2680ffe50 0x7fe268100230 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fe25c009990 tx=0x7fe25c009ca0 comp rx=0 tx=0).stop 2024-04-01T06:56:17.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.861+0000 7fe26de24700 1 -- 172.21.15.83:0/3294298022 shutdown_connections 2024-04-01T06:56:17.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.861+0000 7fe26de24700 1 --2- 172.21.15.83:0/3294298022 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe2680ffe50 0x7fe268100230 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:17.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.861+0000 7fe26de24700 1 --2- 172.21.15.83:0/3294298022 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe268104f60 0x7fe26810cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:17.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.861+0000 7fe26de24700 1 --2- 172.21.15.83:0/3294298022 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe268100800 0x7fe268104830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:17.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.861+0000 7fe26de24700 1 -- 172.21.15.83:0/3294298022 >> 172.21.15.83:0/3294298022 conn(0x7fe268076d40 msgr2=0x7fe268077150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:17.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.861+0000 7fe26de24700 1 -- 172.21.15.83:0/3294298022 shutdown_connections 2024-04-01T06:56:17.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.861+0000 7fe26de24700 1 -- 172.21.15.83:0/3294298022 wait complete. 2024-04-01T06:56:17.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.862+0000 7fe26de24700 1 Processor -- start 2024-04-01T06:56:17.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.862+0000 7fe26de24700 1 -- start start 2024-04-01T06:56:17.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.862+0000 7fe26de24700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe2680ffe50 0x7fe2681971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:17.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.862+0000 7fe26de24700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe268104f60 0x7fe268197700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:17.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.862+0000 7fe26de24700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe26819baa0 0x7fe26819bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:17.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.862+0000 7fe26de24700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe26819c520 con 0x7fe268104f60 2024-04-01T06:56:17.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.862+0000 7fe26de24700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe26819c690 con 0x7fe2680ffe50 2024-04-01T06:56:17.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.862+0000 7fe26de24700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe26819c850 con 0x7fe26819baa0 2024-04-01T06:56:17.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.862+0000 7fe266ffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe268104f60 0x7fe268197700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:17.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.862+0000 7fe266ffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe268104f60 0x7fe268197700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37876/0 (socket says 172.21.15.83:37876) 2024-04-01T06:56:17.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.862+0000 7fe266ffd700 1 -- 172.21.15.83:0/3787554368 learned_addr learned my addr 172.21.15.83:0/3787554368 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:17.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.862+0000 7fe267fff700 1 --2- 172.21.15.83:0/3787554368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe26819baa0 0x7fe26819bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:17.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.862+0000 7fe2677fe700 1 --2- 172.21.15.83:0/3787554368 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe2680ffe50 0x7fe2681971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:17.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.862+0000 7fe266ffd700 1 -- 172.21.15.83:0/3787554368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe26819baa0 msgr2=0x7fe26819bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:17.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.862+0000 7fe266ffd700 1 --2- 172.21.15.83:0/3787554368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe26819baa0 0x7fe26819bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:17.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.862+0000 7fe266ffd700 1 -- 172.21.15.83:0/3787554368 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe2680ffe50 msgr2=0x7fe2681971c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:17.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.862+0000 7fe266ffd700 1 --2- 172.21.15.83:0/3787554368 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe2680ffe50 0x7fe2681971c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:17.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.862+0000 7fe266ffd700 1 -- 172.21.15.83:0/3787554368 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe25c0095f0 con 0x7fe268104f60 2024-04-01T06:56:17.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.862+0000 7fe2677fe700 1 --2- 172.21.15.83:0/3787554368 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe2680ffe50 0x7fe2681971c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:56:17.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.863+0000 7fe266ffd700 1 --2- 172.21.15.83:0/3787554368 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe268104f60 0x7fe268197700 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fe25800d980 tx=0x7fe25800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:17.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.863+0000 7fe264ff9700 1 -- 172.21.15.83:0/3787554368 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe258009930 con 0x7fe268104f60 2024-04-01T06:56:17.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.863+0000 7fe264ff9700 1 -- 172.21.15.83:0/3787554368 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe258010460 con 0x7fe268104f60 2024-04-01T06:56:17.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.863+0000 7fe26de24700 1 -- 172.21.15.83:0/3787554368 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2681a3db0 con 0x7fe268104f60 2024-04-01T06:56:17.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.863+0000 7fe264ff9700 1 -- 172.21.15.83:0/3787554368 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25800f620 con 0x7fe268104f60 2024-04-01T06:56:17.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.863+0000 7fe26de24700 1 -- 172.21.15.83:0/3787554368 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2681a4230 con 0x7fe268104f60 2024-04-01T06:56:17.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.865+0000 7fe264ff9700 1 -- 172.21.15.83:0/3787554368 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) v1 ==== 136098+0+0 (secure 0 0 0) 0x7fe2580108d0 con 0x7fe268104f60 2024-04-01T06:56:17.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.865+0000 7fe264ff9700 1 --2- 172.21.15.83:0/3787554368 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fe2500a13b0 0x7fe2500a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:17.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.866+0000 7fe264ff9700 1 -- 172.21.15.83:0/3787554368 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8425+0+0 (secure 0 0 0) 0x7fe2580ccd80 con 0x7fe268104f60 2024-04-01T06:56:17.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.866+0000 7fe2677fe700 1 --2- 172.21.15.83:0/3787554368 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fe2500a13b0 0x7fe2500a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:17.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.866+0000 7fe2677fe700 1 --2- 172.21.15.83:0/3787554368 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fe2500a13b0 0x7fe2500a3870 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe25c000c00 tx=0x7fe25c005fb0 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:17.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.867+0000 7fe279fbab80 1 Processor -- start 2024-04-01T06:56:17.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.867+0000 7fe279fbab80 1 -- start start 2024-04-01T06:56:17.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.867+0000 7fe279fbab80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558cdd777650 0x558cdd777a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:17.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.867+0000 7fe279fbab80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558cdd777f70 0x558cdd786d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:17.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.867+0000 7fe279fbab80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558cdd787280 0x558cdd789670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:17.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.867+0000 7fe279fbab80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cdd6d0a10 con 0x558cdd777650 2024-04-01T06:56:17.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.867+0000 7fe279fbab80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cdd6ce3d0 con 0x558cdd777f70 2024-04-01T06:56:17.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.867+0000 7fe279fbab80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cdd6c9cc0 con 0x558cdd787280 2024-04-01T06:56:17.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.867+0000 7fe2677fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558cdd777650 0x558cdd777a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:17.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.867+0000 7fe2677fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558cdd777650 0x558cdd777a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37886/0 (socket says 172.21.15.83:37886) 2024-04-01T06:56:17.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.867+0000 7fe2677fe700 1 -- 172.21.15.83:0/3263882786 learned_addr learned my addr 172.21.15.83:0/3263882786 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:17.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.867+0000 7fe267fff700 1 --2- 172.21.15.83:0/3263882786 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558cdd787280 0x558cdd789670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:17.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.867+0000 7fe266ffd700 1 --2- 172.21.15.83:0/3263882786 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558cdd777f70 0x558cdd786d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:17.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.867+0000 7fe2677fe700 1 -- 172.21.15.83:0/3263882786 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558cdd787280 msgr2=0x558cdd789670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:17.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.867+0000 7fe2677fe700 1 --2- 172.21.15.83:0/3263882786 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558cdd787280 0x558cdd789670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:17.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.867+0000 7fe2677fe700 1 -- 172.21.15.83:0/3263882786 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558cdd777f70 msgr2=0x558cdd786d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:17.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.867+0000 7fe2677fe700 1 --2- 172.21.15.83:0/3263882786 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558cdd777f70 0x558cdd786d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:17.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.867+0000 7fe2677fe700 1 -- 172.21.15.83:0/3263882786 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558cdd54b430 con 0x558cdd777650 2024-04-01T06:56:17.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.868+0000 7fe2677fe700 1 --2- 172.21.15.83:0/3263882786 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558cdd777650 0x558cdd777a30 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe25c0057d0 tx=0x7fe25c01e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37eeb5f75222d58 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:17.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.868+0000 7fe24dffb700 1 -- 172.21.15.83:0/3263882786 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25c02a070 con 0x558cdd777650 2024-04-01T06:56:17.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.868+0000 7fe24dffb700 1 -- 172.21.15.83:0/3263882786 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe25c01d040 con 0x558cdd777650 2024-04-01T06:56:17.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.868+0000 7fe24dffb700 1 -- 172.21.15.83:0/3263882786 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25c00fe40 con 0x558cdd777650 2024-04-01T06:56:17.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.868+0000 7fe279fbab80 1 -- 172.21.15.83:0/3263882786 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558cdd777650 msgr2=0x558cdd777a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:17.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.868+0000 7fe279fbab80 1 --2- 172.21.15.83:0/3263882786 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558cdd777650 0x558cdd777a30 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe25c0057d0 tx=0x7fe25c01e000 comp rx=0 tx=0).stop 2024-04-01T06:56:17.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.868+0000 7fe279fbab80 1 -- 172.21.15.83:0/3263882786 shutdown_connections 2024-04-01T06:56:17.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.868+0000 7fe279fbab80 1 --2- 172.21.15.83:0/3263882786 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558cdd777650 0x558cdd777a30 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:17.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.868+0000 7fe279fbab80 1 --2- 172.21.15.83:0/3263882786 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558cdd787280 0x558cdd789670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:17.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.868+0000 7fe279fbab80 1 --2- 172.21.15.83:0/3263882786 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558cdd777f70 0x558cdd786d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:17.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.868+0000 7fe279fbab80 1 -- 172.21.15.83:0/3263882786 >> 172.21.15.83:0/3263882786 conn(0x558cdd6d7720 msgr2=0x558cdd773b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:17.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.869+0000 7fe279fbab80 1 -- 172.21.15.83:0/3263882786 shutdown_connections 2024-04-01T06:56:17.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.869+0000 7fe279fbab80 1 -- 172.21.15.83:0/3263882786 wait complete. 2024-04-01T06:56:17.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.869+0000 7fe279fbab80 1 -- start start 2024-04-01T06:56:17.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.869+0000 7fe279fbab80 1 Processor -- start 2024-04-01T06:56:17.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.870+0000 7fe279fbab80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558cdd777650 0x558cdd786c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:17.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.870+0000 7fe279fbab80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558cdd777f70 0x558cdd783f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:17.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.870+0000 7fe279fbab80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558cdd787280 0x558cdd784590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:17.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.870+0000 7fe279fbab80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cdd665e00 con 0x558cdd777650 2024-04-01T06:56:17.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.870+0000 7fe279fbab80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cdd665aa0 con 0x558cdd777f70 2024-04-01T06:56:17.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.870+0000 7fe279fbab80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cdd54d720 con 0x558cdd787280 2024-04-01T06:56:17.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.870+0000 7fe279fbab80 10 client.0 _ll_register_callbacks cb 0x558cdd66f4f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:56:17.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.870+0000 7fe2677fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558cdd777650 0x558cdd786c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:17.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.870+0000 7fe2677fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558cdd777650 0x558cdd786c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37894/0 (socket says 172.21.15.83:37894) 2024-04-01T06:56:17.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.870+0000 7fe2677fe700 1 -- 172.21.15.83:0/3017179403 learned_addr learned my addr 172.21.15.83:0/3017179403 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:17.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.870+0000 7fe267fff700 1 --2- 172.21.15.83:0/3017179403 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558cdd787280 0x558cdd784590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:17.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.870+0000 7fe266ffd700 1 --2- 172.21.15.83:0/3017179403 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558cdd777f70 0x558cdd783f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:17.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.870+0000 7fe2677fe700 1 -- 172.21.15.83:0/3017179403 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558cdd787280 msgr2=0x558cdd784590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:17.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.870+0000 7fe2677fe700 1 --2- 172.21.15.83:0/3017179403 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558cdd787280 0x558cdd784590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:17.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.870+0000 7fe2677fe700 1 -- 172.21.15.83:0/3017179403 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558cdd777f70 msgr2=0x558cdd783f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:17.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.870+0000 7fe2677fe700 1 --2- 172.21.15.83:0/3017179403 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558cdd777f70 0x558cdd783f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:17.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.870+0000 7fe2677fe700 1 -- 172.21.15.83:0/3017179403 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe26810d350 con 0x558cdd777650 2024-04-01T06:56:17.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.870+0000 7fe266ffd700 1 --2- 172.21.15.83:0/3017179403 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558cdd777f70 0x558cdd783f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:56:17.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.870+0000 7fe2677fe700 1 --2- 172.21.15.83:0/3017179403 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558cdd777650 0x558cdd786c40 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fe25c009ce0 tx=0x7fe25c00f890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=549b966712f18c28 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:17.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.870+0000 7fe246ffd700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:56:17.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.870+0000 7fe246ffd700 1 -- 172.21.15.83:0/3017179403 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25c02a040 con 0x558cdd777650 2024-04-01T06:56:17.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.870+0000 7fe246ffd700 1 -- 172.21.15.83:0/3017179403 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8425+0+0 (secure 0 0 0) 0x7fe25c005240 con 0x558cdd777650 2024-04-01T06:56:17.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.870+0000 7fe279fbab80 1 -- 172.21.15.83:0/3017179403 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558cdd68a400 con 0x558cdd777650 2024-04-01T06:56:17.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.870+0000 7fe246ffd700 1 -- 172.21.15.83:0/3017179403 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe25c005400 con 0x558cdd777650 2024-04-01T06:56:17.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.870+0000 7fe279fbab80 10 client.15615 fetch_fsmap learned FSMap version 24 2024-04-01T06:56:17.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.870+0000 7fe279fbab80 1 -- 172.21.15.83:0/3017179403 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x558cdd4f7be0 con 0x558cdd777650 2024-04-01T06:56:17.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.871+0000 7fe246ffd700 1 -- 172.21.15.83:0/3017179403 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe25c044020 con 0x558cdd777650 2024-04-01T06:56:17.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.871+0000 7fe246ffd700 1 -- 172.21.15.83:0/3017179403 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fe25c0234b0 con 0x558cdd777650 2024-04-01T06:56:17.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.871+0000 7fe279fbab80 10 client.15615 fetch_fsmap finished waiting for FSMap version 24 2024-04-01T06:56:17.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.871+0000 7fe279fbab80 10 client.15615 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-01T06:56:17.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.871+0000 7fe279fbab80 20 client.15615 populate_metadata read hostname 'smithi083' 2024-04-01T06:56:17.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.871+0000 7fe279fbab80 1 --2- 172.21.15.83:0/3017179403 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x558cdd796a30 0x558cdd798e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:17.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.871+0000 7fe279fbab80 4 client.15615 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-01T06:56:17.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.871+0000 7fe279fbab80 1 -- 172.21.15.83:0/3017179403 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558cdd6c2780 con 0x558cdd796a30 2024-04-01T06:56:17.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.871+0000 7fe266ffd700 1 --2- 172.21.15.83:0/3017179403 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x558cdd796a30 0x558cdd798e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:17.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.872+0000 7fe246ffd700 10 client.15615 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:56:17.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.872+0000 7fe266ffd700 1 --2- 172.21.15.83:0/3017179403 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x558cdd796a30 0x558cdd798e20 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=efaf4533f9176506 server_cookie=7a83b8ccd1a659e in_seq=0 out_seq=0 2024-04-01T06:56:17.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.872+0000 7fe246ffd700 1 -- 172.21.15.83:0/3017179403 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558cdd6c2780 con 0x558cdd796a30 2024-04-01T06:56:17.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.872+0000 7fe246ffd700 10 client.15615 handle_command_reply: tid=0 2024-04-01T06:56:17.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.872+0000 7fe279fbab80 1 client.15615 shutdown 2024-04-01T06:56:17.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.872+0000 7fe279fbab80 1 -- 172.21.15.83:0/3017179403 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558cdd777650 msgr2=0x558cdd786c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:17.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.872+0000 7fe279fbab80 1 --2- 172.21.15.83:0/3017179403 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558cdd777650 0x558cdd786c40 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fe25c009ce0 tx=0x7fe25c00f890 comp rx=0 tx=0).stop 2024-04-01T06:56:17.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.872+0000 7fe279fbab80 1 -- 172.21.15.83:0/3017179403 shutdown_connections 2024-04-01T06:56:17.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.872+0000 7fe279fbab80 1 --2- 172.21.15.83:0/3017179403 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x558cdd796a30 0x558cdd798e20 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:17.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.872+0000 7fe279fbab80 1 --2- 172.21.15.83:0/3017179403 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558cdd777650 0x558cdd786c40 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:17.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.872+0000 7fe279fbab80 1 --2- 172.21.15.83:0/3017179403 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558cdd787280 0x558cdd784590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:17.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.872+0000 7fe279fbab80 1 --2- 172.21.15.83:0/3017179403 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558cdd777f70 0x558cdd783f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:17.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.872+0000 7fe246ffd700 0 client.15615 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:56:17.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.872+0000 7fe279fbab80 1 -- 172.21.15.83:0/3017179403 >> 172.21.15.83:0/3017179403 conn(0x558cdd6d7720 msgr2=0x558cdd779740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:17.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.873+0000 7fe279fbab80 1 -- 172.21.15.83:0/3017179403 shutdown_connections 2024-04-01T06:56:17.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.873+0000 7fe279fbab80 1 -- 172.21.15.83:0/3017179403 wait complete. 2024-04-01T06:56:17.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.873+0000 7fe279fbab80 20 client.15615 trim_cache size 0 max 16384 2024-04-01T06:56:17.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.889+0000 7fe279fbab80 1 Processor -- start 2024-04-01T06:56:17.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.889+0000 7fe279fbab80 1 -- start start 2024-04-01T06:56:17.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.890+0000 7fe279fbab80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558cdd777650 0x558cdd78de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:17.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.890+0000 7fe279fbab80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558cdd777f70 0x558cdd782850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:17.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.890+0000 7fe279fbab80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558cdd787280 0x558cdd782d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:17.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.890+0000 7fe279fbab80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cdd7788d0 con 0x558cdd777f70 2024-04-01T06:56:17.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.890+0000 7fe279fbab80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cdd7832d0 con 0x558cdd787280 2024-04-01T06:56:17.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.890+0000 7fe279fbab80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cdd785500 con 0x558cdd777650 2024-04-01T06:56:17.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.890+0000 7fe266ffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558cdd777f70 0x558cdd782850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:17.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.890+0000 7fe266ffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558cdd777f70 0x558cdd782850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37896/0 (socket says 172.21.15.83:37896) 2024-04-01T06:56:17.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.890+0000 7fe266ffd700 1 -- 172.21.15.83:0/1411362850 learned_addr learned my addr 172.21.15.83:0/1411362850 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:17.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.890+0000 7fe2677fe700 1 --2- 172.21.15.83:0/1411362850 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558cdd777650 0x558cdd78de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:17.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.890+0000 7fe267fff700 1 --2- 172.21.15.83:0/1411362850 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558cdd787280 0x558cdd782d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:17.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.890+0000 7fe266ffd700 1 -- 172.21.15.83:0/1411362850 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558cdd777650 msgr2=0x558cdd78de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:17.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.890+0000 7fe266ffd700 1 --2- 172.21.15.83:0/1411362850 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558cdd777650 0x558cdd78de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:17.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.890+0000 7fe266ffd700 1 -- 172.21.15.83:0/1411362850 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558cdd787280 msgr2=0x558cdd782d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:17.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.890+0000 7fe266ffd700 1 --2- 172.21.15.83:0/1411362850 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558cdd787280 0x558cdd782d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:17.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.890+0000 7fe266ffd700 1 -- 172.21.15.83:0/1411362850 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558cdd68ff20 con 0x558cdd777f70 2024-04-01T06:56:17.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.890+0000 7fe2677fe700 1 --2- 172.21.15.83:0/1411362850 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558cdd777650 0x558cdd78de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:56:17.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.890+0000 7fe266ffd700 1 --2- 172.21.15.83:0/1411362850 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558cdd777f70 0x558cdd782850 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fe2580961a0 tx=0x7fe258099af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fb538f46687f65a server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:17.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.890+0000 7fe24e7fc700 1 -- 172.21.15.83:0/1411362850 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe258097ea0 con 0x558cdd777f70 2024-04-01T06:56:17.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.890+0000 7fe24e7fc700 1 -- 172.21.15.83:0/1411362850 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe2580963b0 con 0x558cdd777f70 2024-04-01T06:56:17.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.890+0000 7fe24e7fc700 1 -- 172.21.15.83:0/1411362850 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2580a1c90 con 0x558cdd777f70 2024-04-01T06:56:17.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.891+0000 7fe279fbab80 1 -- 172.21.15.83:0/1411362850 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558cdd777f70 msgr2=0x558cdd782850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:17.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.891+0000 7fe279fbab80 1 --2- 172.21.15.83:0/1411362850 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558cdd777f70 0x558cdd782850 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fe2580961a0 tx=0x7fe258099af0 comp rx=0 tx=0).stop 2024-04-01T06:56:17.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.891+0000 7fe279fbab80 1 -- 172.21.15.83:0/1411362850 shutdown_connections 2024-04-01T06:56:17.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.891+0000 7fe279fbab80 1 --2- 172.21.15.83:0/1411362850 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558cdd787280 0x558cdd782d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:17.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.891+0000 7fe279fbab80 1 --2- 172.21.15.83:0/1411362850 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558cdd777650 0x558cdd78de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:17.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.891+0000 7fe279fbab80 1 --2- 172.21.15.83:0/1411362850 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558cdd777f70 0x558cdd782850 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:17.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.891+0000 7fe279fbab80 1 -- 172.21.15.83:0/1411362850 >> 172.21.15.83:0/1411362850 conn(0x558cdd6d7720 msgr2=0x558cdd7735b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:17.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.891+0000 7fe279fbab80 1 -- 172.21.15.83:0/1411362850 shutdown_connections 2024-04-01T06:56:17.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.891+0000 7fe279fbab80 1 -- 172.21.15.83:0/1411362850 wait complete. 2024-04-01T06:56:17.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.891+0000 7fe279fbab80 1 -- start start 2024-04-01T06:56:17.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.891+0000 7fe279fbab80 1 Processor -- start 2024-04-01T06:56:17.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.892+0000 7fe279fbab80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558cdd777650 0x558cdd7e4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:17.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.892+0000 7fe279fbab80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558cdd777f70 0x558cdd7e5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:17.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.892+0000 7fe279fbab80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558cdd787280 0x558cdd78d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:17.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.892+0000 7fe279fbab80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cdd78d640 con 0x558cdd777f70 2024-04-01T06:56:17.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.892+0000 7fe279fbab80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cdd78d7b0 con 0x558cdd787280 2024-04-01T06:56:17.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.892+0000 7fe279fbab80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cdd78d970 con 0x558cdd777650 2024-04-01T06:56:17.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.892+0000 7fe279fbab80 10 client.0 _ll_register_callbacks cb 0x558cdd66f4f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:56:17.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.892+0000 7fe266ffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558cdd777f70 0x558cdd7e5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:17.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.892+0000 7fe266ffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558cdd777f70 0x558cdd7e5410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37904/0 (socket says 172.21.15.83:37904) 2024-04-01T06:56:17.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.892+0000 7fe266ffd700 1 -- 172.21.15.83:0/3070634987 learned_addr learned my addr 172.21.15.83:0/3070634987 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:17.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.892+0000 7fe2677fe700 1 --2- 172.21.15.83:0/3070634987 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558cdd777650 0x558cdd7e4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:17.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.892+0000 7fe267fff700 1 --2- 172.21.15.83:0/3070634987 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558cdd787280 0x558cdd78d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:17.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.892+0000 7fe266ffd700 1 -- 172.21.15.83:0/3070634987 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558cdd777650 msgr2=0x558cdd7e4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:17.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.892+0000 7fe266ffd700 1 --2- 172.21.15.83:0/3070634987 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558cdd777650 0x558cdd7e4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:17.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.892+0000 7fe266ffd700 1 -- 172.21.15.83:0/3070634987 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558cdd787280 msgr2=0x558cdd78d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:17.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.892+0000 7fe266ffd700 1 --2- 172.21.15.83:0/3070634987 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558cdd787280 0x558cdd78d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:17.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.892+0000 7fe266ffd700 1 -- 172.21.15.83:0/3070634987 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2681a4230 con 0x558cdd777f70 2024-04-01T06:56:17.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.892+0000 7fe267fff700 1 --2- 172.21.15.83:0/3070634987 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558cdd787280 0x558cdd78d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:56:17.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.892+0000 7fe266ffd700 1 --2- 172.21.15.83:0/3070634987 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558cdd777f70 0x558cdd7e5410 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fe258096090 tx=0x7fe2580ca420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0c47888427bc588 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:17.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.892+0000 7fe246ffd700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:56:17.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.892+0000 7fe246ffd700 1 -- 172.21.15.83:0/3070634987 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe258099190 con 0x558cdd777f70 2024-04-01T06:56:17.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.892+0000 7fe246ffd700 1 -- 172.21.15.83:0/3070634987 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8425+0+0 (secure 0 0 0) 0x7fe2580992f0 con 0x558cdd777f70 2024-04-01T06:56:17.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.892+0000 7fe279fbab80 1 -- 172.21.15.83:0/3070634987 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe25c01d040 con 0x558cdd777f70 2024-04-01T06:56:17.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.892+0000 7fe246ffd700 1 -- 172.21.15.83:0/3070634987 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe2580a1c90 con 0x558cdd777f70 2024-04-01T06:56:17.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.892+0000 7fe279fbab80 10 client.15621 fetch_fsmap learned FSMap version 24 2024-04-01T06:56:17.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.892+0000 7fe279fbab80 1 -- 172.21.15.83:0/3070634987 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x558cdd54fd50 con 0x558cdd777f70 2024-04-01T06:56:17.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.893+0000 7fe246ffd700 1 -- 172.21.15.83:0/3070634987 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe25807c070 con 0x558cdd777f70 2024-04-01T06:56:17.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.893+0000 7fe246ffd700 1 -- 172.21.15.83:0/3070634987 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fe2580adb70 con 0x558cdd777f70 2024-04-01T06:56:17.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.893+0000 7fe279fbab80 10 client.15621 fetch_fsmap finished waiting for FSMap version 24 2024-04-01T06:56:17.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.893+0000 7fe279fbab80 10 client.15621 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-01T06:56:17.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.893+0000 7fe279fbab80 20 client.15621 populate_metadata read hostname 'smithi083' 2024-04-01T06:56:17.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.893+0000 7fe279fbab80 1 --2- 172.21.15.83:0/3070634987 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x558cdd7eca30 0x558cdd7eee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:17.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.893+0000 7fe279fbab80 4 client.15621 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-01T06:56:17.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.893+0000 7fe279fbab80 1 -- 172.21.15.83:0/3070634987 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x558cdd518d70 con 0x558cdd7eca30 2024-04-01T06:56:17.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.893+0000 7fe2677fe700 1 --2- 172.21.15.83:0/3070634987 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x558cdd7eca30 0x558cdd7eee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:17.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.893+0000 7fe246ffd700 10 client.15621 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:56:17.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.893+0000 7fe2677fe700 1 --2- 172.21.15.83:0/3070634987 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x558cdd7eca30 0x558cdd7eee50 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dabd1e1d81173de3 server_cookie=fd316003746b615c in_seq=0 out_seq=0 2024-04-01T06:56:17.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.894+0000 7fe246ffd700 1 -- 172.21.15.83:0/3070634987 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x558cdd518d70 con 0x558cdd7eca30 2024-04-01T06:56:17.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.894+0000 7fe246ffd700 10 client.15621 handle_command_reply: tid=0 2024-04-01T06:56:17.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.894+0000 7fe279fbab80 1 client.15621 shutdown 2024-04-01T06:56:17.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.895+0000 7fe279fbab80 1 -- 172.21.15.83:0/3070634987 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558cdd777f70 msgr2=0x558cdd7e5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:17.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.895+0000 7fe279fbab80 1 --2- 172.21.15.83:0/3070634987 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558cdd777f70 0x558cdd7e5410 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fe258096090 tx=0x7fe2580ca420 comp rx=0 tx=0).stop 2024-04-01T06:56:17.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.895+0000 7fe279fbab80 1 -- 172.21.15.83:0/3070634987 shutdown_connections 2024-04-01T06:56:17.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.895+0000 7fe279fbab80 1 --2- 172.21.15.83:0/3070634987 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x558cdd7eca30 0x558cdd7eee50 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:17.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.895+0000 7fe279fbab80 1 --2- 172.21.15.83:0/3070634987 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558cdd787280 0x558cdd78d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:17.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.895+0000 7fe279fbab80 1 --2- 172.21.15.83:0/3070634987 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558cdd777650 0x558cdd7e4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:17.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.895+0000 7fe246ffd700 0 client.15621 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:56:17.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.895+0000 7fe279fbab80 1 --2- 172.21.15.83:0/3070634987 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558cdd777f70 0x558cdd7e5410 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:17.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.895+0000 7fe279fbab80 1 -- 172.21.15.83:0/3070634987 >> 172.21.15.83:0/3070634987 conn(0x558cdd6d7720 msgr2=0x558cdd773590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:17.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.895+0000 7fe279fbab80 1 -- 172.21.15.83:0/3070634987 shutdown_connections 2024-04-01T06:56:17.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.895+0000 7fe279fbab80 1 -- 172.21.15.83:0/3070634987 wait complete. 2024-04-01T06:56:17.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.895+0000 7fe279fbab80 20 client.15621 trim_cache size 0 max 16384 2024-04-01T06:56:17.901 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-04-01T06:56:17.901 INFO:teuthology.orchestra.run.smithi083.stdout: "return_code": 0, 2024-04-01T06:56:17.901 INFO:teuthology.orchestra.run.smithi083.stdout: "scrub_tag": "0a6a9dde-d9cd-422d-8da7-5502f69193e3", 2024-04-01T06:56:17.901 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": "asynchronous" 2024-04-01T06:56:17.901 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-04-01T06:56:17.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.895+0000 7fe26de24700 1 -- 172.21.15.83:0/3787554368 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fe2500a13b0 msgr2=0x7fe2500a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:17.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.895+0000 7fe26de24700 1 --2- 172.21.15.83:0/3787554368 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fe2500a13b0 0x7fe2500a3870 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe25c000c00 tx=0x7fe25c005fb0 comp rx=0 tx=0).stop 2024-04-01T06:56:17.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.895+0000 7fe26de24700 1 -- 172.21.15.83:0/3787554368 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe268104f60 msgr2=0x7fe268197700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:17.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.895+0000 7fe26de24700 1 --2- 172.21.15.83:0/3787554368 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe268104f60 0x7fe268197700 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fe25800d980 tx=0x7fe25800dc90 comp rx=0 tx=0).stop 2024-04-01T06:56:17.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.895+0000 7fe26de24700 1 -- 172.21.15.83:0/3787554368 shutdown_connections 2024-04-01T06:56:17.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.895+0000 7fe26de24700 1 --2- 172.21.15.83:0/3787554368 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fe2500a13b0 0x7fe2500a3870 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:17.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.895+0000 7fe26de24700 1 --2- 172.21.15.83:0/3787554368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe26819baa0 0x7fe26819bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:17.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.895+0000 7fe26de24700 1 --2- 172.21.15.83:0/3787554368 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe2680ffe50 0x7fe2681971c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:17.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.895+0000 7fe26de24700 1 --2- 172.21.15.83:0/3787554368 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe268104f60 0x7fe268197700 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:17.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.895+0000 7fe26de24700 1 -- 172.21.15.83:0/3787554368 >> 172.21.15.83:0/3787554368 conn(0x7fe268076d40 msgr2=0x7fe268068250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:17.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.895+0000 7fe26de24700 1 -- 172.21.15.83:0/3787554368 shutdown_connections 2024-04-01T06:56:17.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:17.896+0000 7fe26de24700 1 -- 172.21.15.83:0/3787554368 wait complete. 2024-04-01T06:56:17.907 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-01T06:56:17.907 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-01T06:56:18.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.031+0000 7f8de5fa2700 1 -- 172.21.15.83:0/1754384081 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8de00ffa60 msgr2=0x7f8de00ffee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:18.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.031+0000 7f8de5fa2700 1 --2- 172.21.15.83:0/1754384081 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8de00ffa60 0x7f8de00ffee0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f8dc8009990 tx=0x7f8dc8009ca0 comp rx=0 tx=0).stop 2024-04-01T06:56:18.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.031+0000 7f8de5fa2700 1 -- 172.21.15.83:0/1754384081 shutdown_connections 2024-04-01T06:56:18.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.031+0000 7f8de5fa2700 1 --2- 172.21.15.83:0/1754384081 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8de0100420 0x7f8de010c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:18.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.031+0000 7f8de5fa2700 1 --2- 172.21.15.83:0/1754384081 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8de0105a70 0x7f8de0105e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:18.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.031+0000 7f8de5fa2700 1 --2- 172.21.15.83:0/1754384081 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8de00ffa60 0x7f8de00ffee0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:18.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.031+0000 7f8de5fa2700 1 -- 172.21.15.83:0/1754384081 >> 172.21.15.83:0/1754384081 conn(0x7f8de00fb570 msgr2=0x7f8de00fd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:18.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.031+0000 7f8de5fa2700 1 -- 172.21.15.83:0/1754384081 shutdown_connections 2024-04-01T06:56:18.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.031+0000 7f8de5fa2700 1 -- 172.21.15.83:0/1754384081 wait complete. 2024-04-01T06:56:18.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.032+0000 7f8de5fa2700 1 Processor -- start 2024-04-01T06:56:18.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.032+0000 7f8de5fa2700 1 -- start start 2024-04-01T06:56:18.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.032+0000 7f8de5fa2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8de00ffa60 0x7f8de00fbb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:18.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.032+0000 7f8de5fa2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8de0100420 0x7f8de00fc050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:18.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.032+0000 7f8de5fa2700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8de0105a70 0x7f8de00fc590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:18.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.032+0000 7f8de5fa2700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de01a53c0 con 0x7f8de00ffa60 2024-04-01T06:56:18.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.032+0000 7f8de5fa2700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de01a5530 con 0x7f8de0105a70 2024-04-01T06:56:18.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.032+0000 7f8de5fa2700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de01a56f0 con 0x7f8de0100420 2024-04-01T06:56:18.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.032+0000 7f8de4fa0700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8de00ffa60 0x7f8de00fbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:18.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.032+0000 7f8de4fa0700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8de00ffa60 0x7f8de00fbb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37928/0 (socket says 172.21.15.83:37928) 2024-04-01T06:56:18.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.032+0000 7f8de4fa0700 1 -- 172.21.15.83:0/3244904289 learned_addr learned my addr 172.21.15.83:0/3244904289 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:18.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.032+0000 7f8ddffff700 1 --2- 172.21.15.83:0/3244904289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8de0100420 0x7f8de00fc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:18.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.032+0000 7f8de57a1700 1 --2- 172.21.15.83:0/3244904289 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8de0105a70 0x7f8de00fc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:18.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.032+0000 7f8de4fa0700 1 -- 172.21.15.83:0/3244904289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8de0100420 msgr2=0x7f8de00fc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:18.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.032+0000 7f8de4fa0700 1 --2- 172.21.15.83:0/3244904289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8de0100420 0x7f8de00fc050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:18.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.032+0000 7f8de4fa0700 1 -- 172.21.15.83:0/3244904289 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8de0105a70 msgr2=0x7f8de00fc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:18.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.032+0000 7f8de4fa0700 1 --2- 172.21.15.83:0/3244904289 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8de0105a70 0x7f8de00fc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:18.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.032+0000 7f8de4fa0700 1 -- 172.21.15.83:0/3244904289 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc80095f0 con 0x7f8de00ffa60 2024-04-01T06:56:18.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.032+0000 7f8de57a1700 1 --2- 172.21.15.83:0/3244904289 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8de0105a70 0x7f8de00fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:56:18.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.033+0000 7f8de4fa0700 1 --2- 172.21.15.83:0/3244904289 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8de00ffa60 0x7f8de00fbb10 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f8dd80060b0 tx=0x7f8dd800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:18.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.033+0000 7f8dddffb700 1 -- 172.21.15.83:0/3244904289 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd800ddd0 con 0x7f8de00ffa60 2024-04-01T06:56:18.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.033+0000 7f8dddffb700 1 -- 172.21.15.83:0/3244904289 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8dd800f040 con 0x7f8de00ffa60 2024-04-01T06:56:18.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.033+0000 7f8de5fa2700 1 -- 172.21.15.83:0/3244904289 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8de01a59d0 con 0x7f8de00ffa60 2024-04-01T06:56:18.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.033+0000 7f8dddffb700 1 -- 172.21.15.83:0/3244904289 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd8014690 con 0x7f8de00ffa60 2024-04-01T06:56:18.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.033+0000 7f8de5fa2700 1 -- 172.21.15.83:0/3244904289 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8de01a5ee0 con 0x7f8de00ffa60 2024-04-01T06:56:18.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.035+0000 7f8dddffb700 1 -- 172.21.15.83:0/3244904289 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) v1 ==== 136098+0+0 (secure 0 0 0) 0x7f8dd8015400 con 0x7f8de00ffa60 2024-04-01T06:56:18.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.035+0000 7f8dddffb700 1 --2- 172.21.15.83:0/3244904289 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f8dcc0a13b0 0x7f8dcc0a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:18.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.036+0000 7f8ddffff700 1 --2- 172.21.15.83:0/3244904289 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f8dcc0a13b0 0x7f8dcc0a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:18.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.036+0000 7f8dddffb700 1 -- 172.21.15.83:0/3244904289 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f8dd80cc8e0 con 0x7f8de00ffa60 2024-04-01T06:56:18.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.036+0000 7f8ddffff700 1 --2- 172.21.15.83:0/3244904289 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f8dcc0a13b0 0x7f8dcc0a3870 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8de00fd240 tx=0x7f8dc8005fd0 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:18.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.036+0000 7f8df339ab80 1 Processor -- start 2024-04-01T06:56:18.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.036+0000 7f8df339ab80 1 -- start start 2024-04-01T06:56:18.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.037+0000 7f8df339ab80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55866aee07a0 0x55866aee0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:18.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.037+0000 7f8df339ab80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55866aee10c0 0x55866aeeba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:18.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.037+0000 7f8df339ab80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55866aeebfc0 0x55866aeee3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:18.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.037+0000 7f8df339ab80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55866ae39990 con 0x55866aee10c0 2024-04-01T06:56:18.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.037+0000 7f8df339ab80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55866ae37350 con 0x55866aee07a0 2024-04-01T06:56:18.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.037+0000 7f8df339ab80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55866ae32c40 con 0x55866aeebfc0 2024-04-01T06:56:18.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.037+0000 7f8ddffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55866aee10c0 0x55866aeeba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:18.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.037+0000 7f8ddffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55866aee10c0 0x55866aeeba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37938/0 (socket says 172.21.15.83:37938) 2024-04-01T06:56:18.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.037+0000 7f8ddffff700 1 -- 172.21.15.83:0/4068814773 learned_addr learned my addr 172.21.15.83:0/4068814773 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:18.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.037+0000 7f8de4fa0700 1 --2- 172.21.15.83:0/4068814773 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55866aee07a0 0x55866aee0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:18.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.037+0000 7f8ddffff700 1 -- 172.21.15.83:0/4068814773 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55866aeebfc0 msgr2=0x55866aeee3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:18.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.037+0000 7f8ddffff700 1 --2- 172.21.15.83:0/4068814773 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55866aeebfc0 0x55866aeee3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:18.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.037+0000 7f8ddffff700 1 -- 172.21.15.83:0/4068814773 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55866aee07a0 msgr2=0x55866aee0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:18.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.037+0000 7f8ddffff700 1 --2- 172.21.15.83:0/4068814773 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55866aee07a0 0x55866aee0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:18.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.037+0000 7f8ddffff700 1 -- 172.21.15.83:0/4068814773 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55866acb43b0 con 0x55866aee10c0 2024-04-01T06:56:18.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.037+0000 7f8de4fa0700 1 --2- 172.21.15.83:0/4068814773 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55866aee07a0 0x55866aee0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:56:18.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.037+0000 7f8ddffff700 1 --2- 172.21.15.83:0/4068814773 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55866aee10c0 0x55866aeeba80 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f8dc8009990 tx=0x7f8dc8020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25c4dd13a8098c2d server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:18.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.037+0000 7f8dd6ffd700 1 -- 172.21.15.83:0/4068814773 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc8004700 con 0x55866aee10c0 2024-04-01T06:56:18.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.037+0000 7f8dd6ffd700 1 -- 172.21.15.83:0/4068814773 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8dc801e040 con 0x55866aee10c0 2024-04-01T06:56:18.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.037+0000 7f8dd6ffd700 1 -- 172.21.15.83:0/4068814773 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc800f9b0 con 0x55866aee10c0 2024-04-01T06:56:18.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.038+0000 7f8df339ab80 1 -- 172.21.15.83:0/4068814773 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55866aee10c0 msgr2=0x55866aeeba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:18.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.038+0000 7f8df339ab80 1 --2- 172.21.15.83:0/4068814773 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55866aee10c0 0x55866aeeba80 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f8dc8009990 tx=0x7f8dc8020000 comp rx=0 tx=0).stop 2024-04-01T06:56:18.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.038+0000 7f8df339ab80 1 -- 172.21.15.83:0/4068814773 shutdown_connections 2024-04-01T06:56:18.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.038+0000 7f8df339ab80 1 --2- 172.21.15.83:0/4068814773 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55866aeebfc0 0x55866aeee3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:18.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.038+0000 7f8df339ab80 1 --2- 172.21.15.83:0/4068814773 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55866aee07a0 0x55866aee0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:18.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.038+0000 7f8df339ab80 1 --2- 172.21.15.83:0/4068814773 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55866aee10c0 0x55866aeeba80 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:18.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.038+0000 7f8df339ab80 1 -- 172.21.15.83:0/4068814773 >> 172.21.15.83:0/4068814773 conn(0x55866ae406a0 msgr2=0x55866aedcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:18.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.038+0000 7f8df339ab80 1 -- 172.21.15.83:0/4068814773 shutdown_connections 2024-04-01T06:56:18.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.038+0000 7f8df339ab80 1 -- 172.21.15.83:0/4068814773 wait complete. 2024-04-01T06:56:18.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.038+0000 7f8df339ab80 1 -- start start 2024-04-01T06:56:18.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.039+0000 7f8df339ab80 1 Processor -- start 2024-04-01T06:56:18.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.039+0000 7f8df339ab80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55866aee07a0 0x55866aeeba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:18.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.039+0000 7f8df339ab80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55866aee10c0 0x55866aee8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:18.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.039+0000 7f8df339ab80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55866aeebfc0 0x55866aee9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:18.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.039+0000 7f8df339ab80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55866adced80 con 0x55866aee07a0 2024-04-01T06:56:18.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.039+0000 7f8df339ab80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55866adcea20 con 0x55866aeebfc0 2024-04-01T06:56:18.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.039+0000 7f8df339ab80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55866acb66a0 con 0x55866aee10c0 2024-04-01T06:56:18.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.039+0000 7f8df339ab80 10 client.0 _ll_register_callbacks cb 0x55866add8470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:56:18.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.039+0000 7f8de4fa0700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55866aee07a0 0x55866aeeba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:18.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.039+0000 7f8de4fa0700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55866aee07a0 0x55866aeeba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37950/0 (socket says 172.21.15.83:37950) 2024-04-01T06:56:18.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.039+0000 7f8de4fa0700 1 -- 172.21.15.83:0/1631712991 learned_addr learned my addr 172.21.15.83:0/1631712991 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:18.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.039+0000 7f8de57a1700 1 --2- 172.21.15.83:0/1631712991 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55866aeebfc0 0x55866aee9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:18.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.039+0000 7f8ddffff700 1 --2- 172.21.15.83:0/1631712991 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55866aee10c0 0x55866aee8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:18.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.039+0000 7f8de4fa0700 1 -- 172.21.15.83:0/1631712991 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55866aee10c0 msgr2=0x55866aee8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:18.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.039+0000 7f8de4fa0700 1 --2- 172.21.15.83:0/1631712991 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55866aee10c0 0x55866aee8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:18.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.039+0000 7f8de4fa0700 1 -- 172.21.15.83:0/1631712991 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55866aeebfc0 msgr2=0x55866aee9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:18.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.039+0000 7f8de4fa0700 1 --2- 172.21.15.83:0/1631712991 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55866aeebfc0 0x55866aee9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:18.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.039+0000 7f8de4fa0700 1 -- 172.21.15.83:0/1631712991 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8de010d230 con 0x55866aee07a0 2024-04-01T06:56:18.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.040+0000 7f8de4fa0700 1 --2- 172.21.15.83:0/1631712991 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55866aee07a0 0x55866aeeba50 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8099730 tx=0x7f8dd8099180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4bcd5ed4011da45 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:18.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.040+0000 7f8dbffff700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:56:18.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.040+0000 7f8dbffff700 1 -- 172.21.15.83:0/1631712991 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd809d5d0 con 0x55866aee07a0 2024-04-01T06:56:18.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.040+0000 7f8dbffff700 1 -- 172.21.15.83:0/1631712991 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f8dd80a1c20 con 0x55866aee07a0 2024-04-01T06:56:18.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.040+0000 7f8df339ab80 1 -- 172.21.15.83:0/1631712991 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55866adf3380 con 0x55866aee07a0 2024-04-01T06:56:18.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.040+0000 7f8dbffff700 1 -- 172.21.15.83:0/1631712991 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8dd809d170 con 0x55866aee07a0 2024-04-01T06:56:18.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.040+0000 7f8df339ab80 10 client.15633 fetch_fsmap learned FSMap version 24 2024-04-01T06:56:18.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.040+0000 7f8df339ab80 1 -- 172.21.15.83:0/1631712991 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55866ac60b60 con 0x55866aee07a0 2024-04-01T06:56:18.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.040+0000 7f8dbffff700 1 -- 172.21.15.83:0/1631712991 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8dd807c020 con 0x55866aee07a0 2024-04-01T06:56:18.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.040+0000 7f8dbffff700 1 -- 172.21.15.83:0/1631712991 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f8dd8098c90 con 0x55866aee07a0 2024-04-01T06:56:18.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.040+0000 7f8df339ab80 10 client.15633 fetch_fsmap finished waiting for FSMap version 24 2024-04-01T06:56:18.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.040+0000 7f8df339ab80 10 client.15633 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-01T06:56:18.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.040+0000 7f8df339ab80 20 client.15633 populate_metadata read hostname 'smithi083' 2024-04-01T06:56:18.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.040+0000 7f8df339ab80 1 --2- 172.21.15.83:0/1631712991 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55866aefbbd0 0x55866aefdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:18.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.040+0000 7f8df339ab80 4 client.15633 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-01T06:56:18.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.040+0000 7f8df339ab80 1 -- 172.21.15.83:0/1631712991 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55866ae2b700 con 0x55866aefbbd0 2024-04-01T06:56:18.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.041+0000 7f8ddffff700 1 --2- 172.21.15.83:0/1631712991 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55866aefbbd0 0x55866aefdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:18.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.041+0000 7f8dbffff700 10 client.15633 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:56:18.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.041+0000 7f8ddffff700 1 --2- 172.21.15.83:0/1631712991 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55866aefbbd0 0x55866aefdfc0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e9a84a3ea8aa473 server_cookie=111fce27b9b02122 in_seq=0 out_seq=0 2024-04-01T06:56:18.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.042+0000 7f8dbffff700 1 -- 172.21.15.83:0/1631712991 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55866ae2b700 con 0x55866aefbbd0 2024-04-01T06:56:18.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.042+0000 7f8dbffff700 10 client.15633 handle_command_reply: tid=0 2024-04-01T06:56:18.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.042+0000 7f8df339ab80 1 client.15633 shutdown 2024-04-01T06:56:18.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.042+0000 7f8df339ab80 1 -- 172.21.15.83:0/1631712991 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55866aee07a0 msgr2=0x55866aeeba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:18.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.042+0000 7f8df339ab80 1 --2- 172.21.15.83:0/1631712991 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55866aee07a0 0x55866aeeba50 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8099730 tx=0x7f8dd8099180 comp rx=0 tx=0).stop 2024-04-01T06:56:18.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.042+0000 7f8df339ab80 1 -- 172.21.15.83:0/1631712991 shutdown_connections 2024-04-01T06:56:18.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.042+0000 7f8df339ab80 1 --2- 172.21.15.83:0/1631712991 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55866aefbbd0 0x55866aefdfc0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:18.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.042+0000 7f8df339ab80 1 --2- 172.21.15.83:0/1631712991 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55866aee07a0 0x55866aeeba50 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:18.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.042+0000 7f8df339ab80 1 --2- 172.21.15.83:0/1631712991 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55866aeebfc0 0x55866aee9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:18.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.042+0000 7f8dbffff700 0 client.15633 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:56:18.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.042+0000 7f8df339ab80 1 --2- 172.21.15.83:0/1631712991 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55866aee10c0 0x55866aee8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:18.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.042+0000 7f8df339ab80 1 -- 172.21.15.83:0/1631712991 >> 172.21.15.83:0/1631712991 conn(0x55866ae406a0 msgr2=0x55866aee2890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:18.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.042+0000 7f8df339ab80 1 -- 172.21.15.83:0/1631712991 shutdown_connections 2024-04-01T06:56:18.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.042+0000 7f8df339ab80 1 -- 172.21.15.83:0/1631712991 wait complete. 2024-04-01T06:56:18.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.042+0000 7f8df339ab80 20 client.15633 trim_cache size 0 max 16384 2024-04-01T06:56:18.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.059+0000 7f8df339ab80 1 Processor -- start 2024-04-01T06:56:18.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.059+0000 7f8df339ab80 1 -- start start 2024-04-01T06:56:18.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.059+0000 7f8df339ab80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55866aee07a0 0x55866aef2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:18.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.059+0000 7f8df339ab80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55866aee10c0 0x55866aee42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:18.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.059+0000 7f8df339ab80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55866aeebfc0 0x55866aef7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:18.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.059+0000 7f8df339ab80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55866aee1a20 con 0x55866aee10c0 2024-04-01T06:56:18.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.059+0000 7f8df339ab80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55866aee9800 con 0x55866aeebfc0 2024-04-01T06:56:18.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.059+0000 7f8df339ab80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55866aee1740 con 0x55866aee07a0 2024-04-01T06:56:18.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.059+0000 7f8ddffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55866aee10c0 0x55866aee42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:18.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.059+0000 7f8ddffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55866aee10c0 0x55866aee42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37962/0 (socket says 172.21.15.83:37962) 2024-04-01T06:56:18.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.059+0000 7f8ddffff700 1 -- 172.21.15.83:0/1359483057 learned_addr learned my addr 172.21.15.83:0/1359483057 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:18.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.059+0000 7f8de4fa0700 1 --2- 172.21.15.83:0/1359483057 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55866aee07a0 0x55866aef2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:18.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.059+0000 7f8ddffff700 1 -- 172.21.15.83:0/1359483057 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55866aee07a0 msgr2=0x55866aef2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:18.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.059+0000 7f8ddffff700 1 --2- 172.21.15.83:0/1359483057 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55866aee07a0 0x55866aef2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:18.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.059+0000 7f8ddffff700 1 -- 172.21.15.83:0/1359483057 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55866aeebfc0 msgr2=0x55866aef7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:18.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.059+0000 7f8ddffff700 1 --2- 172.21.15.83:0/1359483057 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55866aeebfc0 0x55866aef7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:18.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.059+0000 7f8ddffff700 1 -- 172.21.15.83:0/1359483057 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55866adf8ea0 con 0x55866aee10c0 2024-04-01T06:56:18.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.059+0000 7f8ddffff700 1 --2- 172.21.15.83:0/1359483057 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55866aee10c0 0x55866aee42c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f8dc8009990 tx=0x7f8dc8004fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac0955c7819a9fd3 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:18.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.059+0000 7f8dd77fe700 1 -- 172.21.15.83:0/1359483057 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc803fce0 con 0x55866aee10c0 2024-04-01T06:56:18.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.059+0000 7f8dd77fe700 1 -- 172.21.15.83:0/1359483057 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8dc8029040 con 0x55866aee10c0 2024-04-01T06:56:18.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.059+0000 7f8dd77fe700 1 -- 172.21.15.83:0/1359483057 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc8004aa0 con 0x55866aee10c0 2024-04-01T06:56:18.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.060+0000 7f8df339ab80 1 -- 172.21.15.83:0/1359483057 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55866aee10c0 msgr2=0x55866aee42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:18.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.060+0000 7f8df339ab80 1 --2- 172.21.15.83:0/1359483057 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55866aee10c0 0x55866aee42c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f8dc8009990 tx=0x7f8dc8004fb0 comp rx=0 tx=0).stop 2024-04-01T06:56:18.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.060+0000 7f8df339ab80 1 -- 172.21.15.83:0/1359483057 shutdown_connections 2024-04-01T06:56:18.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.060+0000 7f8df339ab80 1 --2- 172.21.15.83:0/1359483057 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55866aeebfc0 0x55866aef7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:18.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.060+0000 7f8df339ab80 1 --2- 172.21.15.83:0/1359483057 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55866aee07a0 0x55866aef2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:18.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.060+0000 7f8df339ab80 1 --2- 172.21.15.83:0/1359483057 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55866aee10c0 0x55866aee42c0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:18.066 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.060+0000 7f8df339ab80 1 -- 172.21.15.83:0/1359483057 >> 172.21.15.83:0/1359483057 conn(0x55866ae406a0 msgr2=0x55866aee37e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:18.066 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.060+0000 7f8df339ab80 1 -- 172.21.15.83:0/1359483057 shutdown_connections 2024-04-01T06:56:18.066 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.060+0000 7f8df339ab80 1 -- 172.21.15.83:0/1359483057 wait complete. 2024-04-01T06:56:18.066 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.060+0000 7f8df339ab80 1 -- start start 2024-04-01T06:56:18.066 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.060+0000 7f8df339ab80 1 Processor -- start 2024-04-01T06:56:18.066 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.061+0000 7f8df339ab80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55866aee07a0 0x55866aef25b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:18.066 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.061+0000 7f8df339ab80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55866aee10c0 0x55866aef2af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:18.066 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.061+0000 7f8df339ab80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55866aeebfc0 0x55866aef0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:18.066 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.061+0000 7f8df339ab80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55866aef11f0 con 0x55866aee10c0 2024-04-01T06:56:18.066 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.061+0000 7f8df339ab80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55866aef1360 con 0x55866aee07a0 2024-04-01T06:56:18.066 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.061+0000 7f8df339ab80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55866aef1520 con 0x55866aeebfc0 2024-04-01T06:56:18.066 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.061+0000 7f8df339ab80 10 client.0 _ll_register_callbacks cb 0x55866add8470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:56:18.066 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.061+0000 7f8ddffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55866aee10c0 0x55866aef2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:18.066 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.061+0000 7f8ddffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55866aee10c0 0x55866aef2af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37974/0 (socket says 172.21.15.83:37974) 2024-04-01T06:56:18.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.061+0000 7f8ddffff700 1 -- 172.21.15.83:0/3800062065 learned_addr learned my addr 172.21.15.83:0/3800062065 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:18.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.061+0000 7f8de57a1700 1 --2- 172.21.15.83:0/3800062065 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55866aeebfc0 0x55866aef0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:18.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.061+0000 7f8ddffff700 1 -- 172.21.15.83:0/3800062065 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55866aeebfc0 msgr2=0x55866aef0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:18.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.061+0000 7f8ddffff700 1 --2- 172.21.15.83:0/3800062065 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55866aeebfc0 0x55866aef0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:18.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.061+0000 7f8de4fa0700 1 --2- 172.21.15.83:0/3800062065 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55866aee07a0 0x55866aef25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:18.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.061+0000 7f8ddffff700 1 -- 172.21.15.83:0/3800062065 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55866aee07a0 msgr2=0x55866aef25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:18.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.061+0000 7f8ddffff700 1 --2- 172.21.15.83:0/3800062065 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55866aee07a0 0x55866aef25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:18.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.061+0000 7f8ddffff700 1 -- 172.21.15.83:0/3800062065 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55866acb43b0 con 0x55866aee10c0 2024-04-01T06:56:18.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.061+0000 7f8de4fa0700 1 --2- 172.21.15.83:0/3800062065 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55866aee07a0 0x55866aef25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:56:18.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.061+0000 7f8ddffff700 1 --2- 172.21.15.83:0/3800062065 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55866aee10c0 0x55866aef2af0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f8dc80046c0 tx=0x7f8dc80045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84ca93390be70d3b server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:18.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.061+0000 7f8dbffff700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:56:18.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.062+0000 7f8dbffff700 1 -- 172.21.15.83:0/3800062065 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc803f2d0 con 0x55866aee10c0 2024-04-01T06:56:18.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.062+0000 7f8dbffff700 1 -- 172.21.15.83:0/3800062065 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f8dc803f430 con 0x55866aee10c0 2024-04-01T06:56:18.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.062+0000 7f8df339ab80 1 -- 172.21.15.83:0/3800062065 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8dc801e040 con 0x55866aee10c0 2024-04-01T06:56:18.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.062+0000 7f8dbffff700 1 -- 172.21.15.83:0/3800062065 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8dc8004720 con 0x55866aee10c0 2024-04-01T06:56:18.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.062+0000 7f8df339ab80 10 client.15639 fetch_fsmap learned FSMap version 24 2024-04-01T06:56:18.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.062+0000 7f8df339ab80 1 -- 172.21.15.83:0/3800062065 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55866acb8cd0 con 0x55866aee10c0 2024-04-01T06:56:18.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.062+0000 7f8dbffff700 1 -- 172.21.15.83:0/3800062065 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8dc801e040 con 0x55866aee10c0 2024-04-01T06:56:18.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.062+0000 7f8dbffff700 1 -- 172.21.15.83:0/3800062065 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f8dc8051070 con 0x55866aee10c0 2024-04-01T06:56:18.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.062+0000 7f8df339ab80 10 client.15639 fetch_fsmap finished waiting for FSMap version 24 2024-04-01T06:56:18.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.062+0000 7f8df339ab80 10 client.15639 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-01T06:56:18.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.062+0000 7f8df339ab80 20 client.15639 populate_metadata read hostname 'smithi083' 2024-04-01T06:56:18.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.062+0000 7f8df339ab80 1 --2- 172.21.15.83:0/3800062065 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55866af50690 0x55866af52a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:18.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.062+0000 7f8df339ab80 4 client.15639 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-01T06:56:18.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.062+0000 7f8df339ab80 1 -- 172.21.15.83:0/3800062065 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55866ac81cf0 con 0x55866af50690 2024-04-01T06:56:18.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.062+0000 7f8de4fa0700 1 --2- 172.21.15.83:0/3800062065 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55866af50690 0x55866af52a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:18.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.063+0000 7f8dbffff700 10 client.15639 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:56:18.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.063+0000 7f8de4fa0700 1 --2- 172.21.15.83:0/3800062065 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55866af50690 0x55866af52a80 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=304476a97c83be4e server_cookie=ce010d18160474bc in_seq=0 out_seq=0 2024-04-01T06:56:18.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.063+0000 7f8dbffff700 1 -- 172.21.15.83:0/3800062065 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55866ac81cf0 con 0x55866af50690 2024-04-01T06:56:18.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.063+0000 7f8dbffff700 10 client.15639 handle_command_reply: tid=0 2024-04-01T06:56:18.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.063+0000 7f8df339ab80 1 client.15639 shutdown 2024-04-01T06:56:18.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.063+0000 7f8df339ab80 1 -- 172.21.15.83:0/3800062065 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55866aee10c0 msgr2=0x55866aef2af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:18.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.063+0000 7f8df339ab80 1 --2- 172.21.15.83:0/3800062065 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55866aee10c0 0x55866aef2af0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f8dc80046c0 tx=0x7f8dc80045d0 comp rx=0 tx=0).stop 2024-04-01T06:56:18.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.063+0000 7f8df339ab80 1 -- 172.21.15.83:0/3800062065 shutdown_connections 2024-04-01T06:56:18.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.063+0000 7f8df339ab80 1 --2- 172.21.15.83:0/3800062065 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55866af50690 0x55866af52a80 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:18.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.063+0000 7f8df339ab80 1 --2- 172.21.15.83:0/3800062065 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55866aeebfc0 0x55866aef0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:18.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.063+0000 7f8dbffff700 0 client.15639 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:56:18.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.063+0000 7f8df339ab80 1 --2- 172.21.15.83:0/3800062065 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55866aee07a0 0x55866aef25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:18.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.063+0000 7f8df339ab80 1 --2- 172.21.15.83:0/3800062065 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55866aee10c0 0x55866aef2af0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:18.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.063+0000 7f8df339ab80 1 -- 172.21.15.83:0/3800062065 >> 172.21.15.83:0/3800062065 conn(0x55866ae406a0 msgr2=0x55866aef7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:18.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.063+0000 7f8df339ab80 1 -- 172.21.15.83:0/3800062065 shutdown_connections 2024-04-01T06:56:18.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.063+0000 7f8df339ab80 1 -- 172.21.15.83:0/3800062065 wait complete. 2024-04-01T06:56:18.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.063+0000 7f8df339ab80 20 client.15639 trim_cache size 0 max 16384 2024-04-01T06:56:18.070 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-04-01T06:56:18.070 INFO:teuthology.orchestra.run.smithi083.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-01T06:56:18.070 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubs": { 2024-04-01T06:56:18.070 INFO:teuthology.orchestra.run.smithi083.stdout: "0a6a9dde-d9cd-422d-8da7-5502f69193e3": { 2024-04-01T06:56:18.070 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/", 2024-04-01T06:56:18.070 INFO:teuthology.orchestra.run.smithi083.stdout: "tag": "0a6a9dde-d9cd-422d-8da7-5502f69193e3", 2024-04-01T06:56:18.070 INFO:teuthology.orchestra.run.smithi083.stdout: "options": "recursive,force" 2024-04-01T06:56:18.070 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T06:56:18.070 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T06:56:18.070 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-04-01T06:56:18.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.064+0000 7f8de5fa2700 1 -- 172.21.15.83:0/3244904289 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f8dcc0a13b0 msgr2=0x7f8dcc0a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:18.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.064+0000 7f8de5fa2700 1 --2- 172.21.15.83:0/3244904289 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f8dcc0a13b0 0x7f8dcc0a3870 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8de00fd240 tx=0x7f8dc8005fd0 comp rx=0 tx=0).stop 2024-04-01T06:56:18.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.064+0000 7f8de5fa2700 1 -- 172.21.15.83:0/3244904289 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8de00ffa60 msgr2=0x7f8de00fbb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:18.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.064+0000 7f8de5fa2700 1 --2- 172.21.15.83:0/3244904289 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8de00ffa60 0x7f8de00fbb10 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f8dd80060b0 tx=0x7f8dd800d3b0 comp rx=0 tx=0).stop 2024-04-01T06:56:18.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.064+0000 7f8de5fa2700 1 -- 172.21.15.83:0/3244904289 shutdown_connections 2024-04-01T06:56:18.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.064+0000 7f8de5fa2700 1 --2- 172.21.15.83:0/3244904289 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f8dcc0a13b0 0x7f8dcc0a3870 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:18.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.064+0000 7f8de5fa2700 1 --2- 172.21.15.83:0/3244904289 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8de00ffa60 0x7f8de00fbb10 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:18.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.064+0000 7f8de5fa2700 1 --2- 172.21.15.83:0/3244904289 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8de0105a70 0x7f8de00fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:18.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.064+0000 7f8de5fa2700 1 --2- 172.21.15.83:0/3244904289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8de0100420 0x7f8de00fc050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:18.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.064+0000 7f8de5fa2700 1 -- 172.21.15.83:0/3244904289 >> 172.21.15.83:0/3244904289 conn(0x7f8de00fb570 msgr2=0x7f8de0069120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:18.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.064+0000 7f8de5fa2700 1 -- 172.21.15.83:0/3244904289 shutdown_connections 2024-04-01T06:56:18.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:18.064+0000 7f8de5fa2700 1 -- 172.21.15.83:0/3244904289 wait complete. 2024-04-01T06:56:18.075 INFO:tasks.cephfs.filesystem:scrub status for tag:0a6a9dde-d9cd-422d-8da7-5502f69193e3 - {'path': '/', 'tag': '0a6a9dde-d9cd-422d-8da7-5502f69193e3', 'options': 'recursive,force'} 2024-04-01T06:56:19.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:56:18 smithi145 ceph-mon[47816]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-04-01T06:56:19.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:56:18 smithi145 ceph-mon[47816]: scrub queued for path: / 2024-04-01T06:56:19.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:56:18 smithi145 ceph-mon[47816]: scrub summary: idle+waiting paths [/] 2024-04-01T06:56:19.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:56:18 smithi145 ceph-mon[47816]: scrub summary: active paths [/] 2024-04-01T06:56:19.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:56:18 smithi145 ceph-mon[47816]: scrub summary: idle+waiting paths [/] 2024-04-01T06:56:19.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:56:18 smithi083 ceph-mon[43429]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-04-01T06:56:19.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:56:18 smithi083 ceph-mon[43429]: scrub queued for path: / 2024-04-01T06:56:19.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:56:18 smithi083 ceph-mon[43429]: scrub summary: idle+waiting paths [/] 2024-04-01T06:56:19.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:56:18 smithi083 ceph-mon[43429]: scrub summary: active paths [/] 2024-04-01T06:56:19.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:56:18 smithi083 ceph-mon[43429]: scrub summary: idle+waiting paths [/] 2024-04-01T06:56:19.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:56:18 smithi153 ceph-mon[48187]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-04-01T06:56:19.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:56:18 smithi153 ceph-mon[48187]: scrub queued for path: / 2024-04-01T06:56:19.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:56:18 smithi153 ceph-mon[48187]: scrub summary: idle+waiting paths [/] 2024-04-01T06:56:19.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:56:18 smithi153 ceph-mon[48187]: scrub summary: active paths [/] 2024-04-01T06:56:19.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:56:18 smithi153 ceph-mon[48187]: scrub summary: idle+waiting paths [/] 2024-04-01T06:56:21.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:56:20 smithi145 ceph-mon[47816]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-04-01T06:56:21.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:56:20 smithi083 ceph-mon[43429]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-04-01T06:56:21.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:56:20 smithi153 ceph-mon[48187]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-04-01T06:56:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.340+0000 7f9ae05ae700 1 -- 172.21.15.83:0/1660244457 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ad80ff220 msgr2=0x7f9ad80ff6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.340+0000 7f9ae05ae700 1 --2- 172.21.15.83:0/1660244457 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ad80ff220 0x7f9ad80ff6a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f9ac80099c0 tx=0x7f9ac8009cd0 comp rx=0 tx=0).stop 2024-04-01T06:56:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.340+0000 7f9ae05ae700 1 -- 172.21.15.83:0/1660244457 shutdown_connections 2024-04-01T06:56:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.340+0000 7f9ae05ae700 1 --2- 172.21.15.83:0/1660244457 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9ad80ffbe0 0x7f9ad810dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.340+0000 7f9ae05ae700 1 --2- 172.21.15.83:0/1660244457 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ad8106e30 0x7f9ad8107210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.340+0000 7f9ae05ae700 1 --2- 172.21.15.83:0/1660244457 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ad80ff220 0x7f9ad80ff6a0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.340+0000 7f9ae05ae700 1 -- 172.21.15.83:0/1660244457 >> 172.21.15.83:0/1660244457 conn(0x7f9ad80761b0 msgr2=0x7f9ad80fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.340+0000 7f9ae05ae700 1 -- 172.21.15.83:0/1660244457 shutdown_connections 2024-04-01T06:56:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.340+0000 7f9ae05ae700 1 -- 172.21.15.83:0/1660244457 wait complete. 2024-04-01T06:56:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.341+0000 7f9ae05ae700 1 Processor -- start 2024-04-01T06:56:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.341+0000 7f9ae05ae700 1 -- start start 2024-04-01T06:56:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.341+0000 7f9ae05ae700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9ad80ff220 0x7f9ad8197210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.341+0000 7f9ae05ae700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ad80ffbe0 0x7f9ad8197750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.341+0000 7f9ae05ae700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ad8106e30 0x7f9ad819ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.341+0000 7f9ae05ae700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad819c0c0 con 0x7f9ad80ffbe0 2024-04-01T06:56:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.341+0000 7f9ae05ae700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad819c230 con 0x7f9ad80ff220 2024-04-01T06:56:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.341+0000 7f9ae05ae700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad819c3f0 con 0x7f9ad8106e30 2024-04-01T06:56:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.341+0000 7f9addb49700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ad80ffbe0 0x7f9ad8197750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.341+0000 7f9addb49700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ad80ffbe0 0x7f9ad8197750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38004/0 (socket says 172.21.15.83:38004) 2024-04-01T06:56:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.341+0000 7f9addb49700 1 -- 172.21.15.83:0/2835475251 learned_addr learned my addr 172.21.15.83:0/2835475251 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.341+0000 7f9ade34a700 1 --2- 172.21.15.83:0/2835475251 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9ad80ff220 0x7f9ad8197210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.342+0000 7f9adeb4b700 1 --2- 172.21.15.83:0/2835475251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ad8106e30 0x7f9ad819ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.342+0000 7f9addb49700 1 -- 172.21.15.83:0/2835475251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ad8106e30 msgr2=0x7f9ad819ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.342+0000 7f9addb49700 1 --2- 172.21.15.83:0/2835475251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ad8106e30 0x7f9ad819ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.342+0000 7f9addb49700 1 -- 172.21.15.83:0/2835475251 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9ad80ff220 msgr2=0x7f9ad8197210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.342+0000 7f9addb49700 1 --2- 172.21.15.83:0/2835475251 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9ad80ff220 0x7f9ad8197210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.342+0000 7f9addb49700 1 -- 172.21.15.83:0/2835475251 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac80095f0 con 0x7f9ad80ffbe0 2024-04-01T06:56:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.342+0000 7f9adeb4b700 1 --2- 172.21.15.83:0/2835475251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ad8106e30 0x7f9ad819ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:56:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.342+0000 7f9addb49700 1 --2- 172.21.15.83:0/2835475251 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ad80ffbe0 0x7f9ad8197750 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f9ac800b580 tx=0x7f9ac8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.342+0000 7f9acf7fe700 1 -- 172.21.15.83:0/2835475251 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac801d070 con 0x7f9ad80ffbe0 2024-04-01T06:56:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.342+0000 7f9acf7fe700 1 -- 172.21.15.83:0/2835475251 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9ac800fb30 con 0x7f9ad80ffbe0 2024-04-01T06:56:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.342+0000 7f9ae05ae700 1 -- 172.21.15.83:0/2835475251 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ad819c670 con 0x7f9ad80ffbe0 2024-04-01T06:56:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.342+0000 7f9acf7fe700 1 -- 172.21.15.83:0/2835475251 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac8022c60 con 0x7f9ad80ffbe0 2024-04-01T06:56:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.342+0000 7f9ae05ae700 1 -- 172.21.15.83:0/2835475251 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ad81a3f10 con 0x7f9ad80ffbe0 2024-04-01T06:56:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.344+0000 7f9acf7fe700 1 -- 172.21.15.83:0/2835475251 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) v1 ==== 136098+0+0 (secure 0 0 0) 0x7f9ac800fca0 con 0x7f9ad80ffbe0 2024-04-01T06:56:22.348 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.345+0000 7f9acf7fe700 1 --2- 172.21.15.83:0/2835475251 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f9ac40a13b0 0x7f9ac40a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:22.348 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.345+0000 7f9ade34a700 1 --2- 172.21.15.83:0/2835475251 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f9ac40a13b0 0x7f9ac40a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:22.348 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.345+0000 7f9acf7fe700 1 -- 172.21.15.83:0/2835475251 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f9ac80cdff0 con 0x7f9ad80ffbe0 2024-04-01T06:56:22.348 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.345+0000 7f9ade34a700 1 --2- 172.21.15.83:0/2835475251 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f9ac40a13b0 0x7f9ac40a3870 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9ad4005950 tx=0x7f9ad400b410 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:22.354 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.346+0000 7f9aec744b80 1 Processor -- start 2024-04-01T06:56:22.354 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.346+0000 7f9aec744b80 1 -- start start 2024-04-01T06:56:22.354 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.346+0000 7f9aec744b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5594587ab100 0x5594587ab4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:22.354 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.346+0000 7f9aec744b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5594587aba20 0x5594587b6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:22.354 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.346+0000 7f9aec744b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594587b68d0 0x5594587b8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:22.354 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.346+0000 7f9aec744b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x559458704930 con 0x5594587aba20 2024-04-01T06:56:22.354 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.346+0000 7f9aec744b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594587022f0 con 0x5594587b68d0 2024-04-01T06:56:22.354 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.346+0000 7f9aec744b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594586fdbe0 con 0x5594587ab100 2024-04-01T06:56:22.354 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.347+0000 7f9addb49700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5594587aba20 0x5594587b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:22.354 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.347+0000 7f9addb49700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5594587aba20 0x5594587b6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38006/0 (socket says 172.21.15.83:38006) 2024-04-01T06:56:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.347+0000 7f9addb49700 1 -- 172.21.15.83:0/3936755075 learned_addr learned my addr 172.21.15.83:0/3936755075 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.347+0000 7f9ade34a700 1 --2- 172.21.15.83:0/3936755075 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5594587ab100 0x5594587ab4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.347+0000 7f9adeb4b700 1 --2- 172.21.15.83:0/3936755075 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594587b68d0 0x5594587b8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.347+0000 7f9addb49700 1 -- 172.21.15.83:0/3936755075 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5594587ab100 msgr2=0x5594587ab4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.347+0000 7f9addb49700 1 --2- 172.21.15.83:0/3936755075 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5594587ab100 0x5594587ab4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.347+0000 7f9addb49700 1 -- 172.21.15.83:0/3936755075 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594587b68d0 msgr2=0x5594587b8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.347+0000 7f9addb49700 1 --2- 172.21.15.83:0/3936755075 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594587b68d0 0x5594587b8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.347+0000 7f9addb49700 1 -- 172.21.15.83:0/3936755075 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55945857f350 con 0x5594587aba20 2024-04-01T06:56:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.347+0000 7f9addb49700 1 --2- 172.21.15.83:0/3936755075 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5594587aba20 0x5594587b6390 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f9ac809af10 tx=0x7f9ac809a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=760f31bae6d8d266 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.347+0000 7f9accff9700 1 -- 172.21.15.83:0/3936755075 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac80a10e0 con 0x5594587aba20 2024-04-01T06:56:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.347+0000 7f9accff9700 1 -- 172.21.15.83:0/3936755075 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9ac809af80 con 0x5594587aba20 2024-04-01T06:56:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.347+0000 7f9accff9700 1 -- 172.21.15.83:0/3936755075 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac80a2ee0 con 0x5594587aba20 2024-04-01T06:56:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.348+0000 7f9aec744b80 1 -- 172.21.15.83:0/3936755075 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5594587aba20 msgr2=0x5594587b6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.348+0000 7f9aec744b80 1 --2- 172.21.15.83:0/3936755075 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5594587aba20 0x5594587b6390 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f9ac809af10 tx=0x7f9ac809a8e0 comp rx=0 tx=0).stop 2024-04-01T06:56:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.348+0000 7f9aec744b80 1 -- 172.21.15.83:0/3936755075 shutdown_connections 2024-04-01T06:56:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.348+0000 7f9aec744b80 1 --2- 172.21.15.83:0/3936755075 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594587b68d0 0x5594587b8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.348+0000 7f9aec744b80 1 --2- 172.21.15.83:0/3936755075 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5594587ab100 0x5594587ab4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.348+0000 7f9aec744b80 1 --2- 172.21.15.83:0/3936755075 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5594587aba20 0x5594587b6390 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.348+0000 7f9aec744b80 1 -- 172.21.15.83:0/3936755075 >> 172.21.15.83:0/3936755075 conn(0x55945870b640 msgr2=0x5594587a7520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.348+0000 7f9aec744b80 1 -- 172.21.15.83:0/3936755075 shutdown_connections 2024-04-01T06:56:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.349+0000 7f9aec744b80 1 -- 172.21.15.83:0/3936755075 wait complete. 2024-04-01T06:56:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.349+0000 7f9aec744b80 1 -- start start 2024-04-01T06:56:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.349+0000 7f9aec744b80 1 Processor -- start 2024-04-01T06:56:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.349+0000 7f9aec744b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5594587ab100 0x5594587b6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.349+0000 7f9aec744b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594587aba20 0x5594587b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.350+0000 7f9aec744b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5594587b68d0 0x5594587b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.350+0000 7f9aec744b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x559458699d20 con 0x5594587b68d0 2024-04-01T06:56:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.350+0000 7f9aec744b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594586999c0 con 0x5594587aba20 2024-04-01T06:56:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.350+0000 7f9aec744b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x559458581640 con 0x5594587ab100 2024-04-01T06:56:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.350+0000 7f9aec744b80 10 client.0 _ll_register_callbacks cb 0x5594586a3410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:56:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.350+0000 7f9adeb4b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5594587b68d0 0x5594587b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.350+0000 7f9adeb4b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5594587b68d0 0x5594587b3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38020/0 (socket says 172.21.15.83:38020) 2024-04-01T06:56:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.350+0000 7f9adeb4b700 1 -- 172.21.15.83:0/1248742913 learned_addr learned my addr 172.21.15.83:0/1248742913 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.350+0000 7f9ade34a700 1 --2- 172.21.15.83:0/1248742913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5594587ab100 0x5594587b6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.350+0000 7f9addb49700 1 --2- 172.21.15.83:0/1248742913 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594587aba20 0x5594587b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.350+0000 7f9adeb4b700 1 -- 172.21.15.83:0/1248742913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5594587ab100 msgr2=0x5594587b6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.350+0000 7f9adeb4b700 1 --2- 172.21.15.83:0/1248742913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5594587ab100 0x5594587b6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.350+0000 7f9adeb4b700 1 -- 172.21.15.83:0/1248742913 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594587aba20 msgr2=0x5594587b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.350+0000 7f9adeb4b700 1 --2- 172.21.15.83:0/1248742913 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594587aba20 0x5594587b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.350+0000 7f9adeb4b700 1 -- 172.21.15.83:0/1248742913 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ad81a3f10 con 0x5594587b68d0 2024-04-01T06:56:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.350+0000 7f9adeb4b700 1 --2- 172.21.15.83:0/1248742913 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5594587b68d0 0x5594587b3cd0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f9ad0008f50 tx=0x7f9ad0008f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4abcba5a2e25b72 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.350+0000 7f9ac1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:56:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.350+0000 7f9ac1ffb700 1 -- 172.21.15.83:0/1248742913 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad000f980 con 0x5594587b68d0 2024-04-01T06:56:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.350+0000 7f9ac1ffb700 1 -- 172.21.15.83:0/1248742913 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f9ad000fae0 con 0x5594587b68d0 2024-04-01T06:56:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.350+0000 7f9aec744b80 1 -- 172.21.15.83:0/1248742913 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5594586be320 con 0x5594587b68d0 2024-04-01T06:56:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.351+0000 7f9ac1ffb700 1 -- 172.21.15.83:0/1248742913 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ad0007b90 con 0x5594587b68d0 2024-04-01T06:56:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.351+0000 7f9aec744b80 10 client.15651 fetch_fsmap learned FSMap version 24 2024-04-01T06:56:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.351+0000 7f9aec744b80 1 -- 172.21.15.83:0/1248742913 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55945852bb00 con 0x5594587b68d0 2024-04-01T06:56:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.351+0000 7f9ac1ffb700 1 -- 172.21.15.83:0/1248742913 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5594586be320 con 0x5594587b68d0 2024-04-01T06:56:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.351+0000 7f9ac1ffb700 1 -- 172.21.15.83:0/1248742913 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f9ad00143e0 con 0x5594587b68d0 2024-04-01T06:56:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.351+0000 7f9aec744b80 10 client.15651 fetch_fsmap finished waiting for FSMap version 24 2024-04-01T06:56:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.351+0000 7f9aec744b80 10 client.15651 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-01T06:56:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.351+0000 7f9aec744b80 20 client.15651 populate_metadata read hostname 'smithi083' 2024-04-01T06:56:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.351+0000 7f9aec744b80 1 --2- 172.21.15.83:0/1248742913 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5594587c62c0 0x5594587c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.351+0000 7f9aec744b80 4 client.15651 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-01T06:56:22.359 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.351+0000 7f9aec744b80 1 -- 172.21.15.83:0/1248742913 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5594586f66a0 con 0x5594587c62c0 2024-04-01T06:56:22.359 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.351+0000 7f9ade34a700 1 --2- 172.21.15.83:0/1248742913 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5594587c62c0 0x5594587c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:22.359 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.352+0000 7f9ac1ffb700 10 client.15651 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:56:22.359 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.352+0000 7f9ade34a700 1 --2- 172.21.15.83:0/1248742913 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5594587c62c0 0x5594587c86e0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e73a54d5b0498588 server_cookie=6f16ff17e130bf22 in_seq=0 out_seq=0 2024-04-01T06:56:22.359 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.352+0000 7f9ac1ffb700 1 -- 172.21.15.83:0/1248742913 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5594586f66a0 con 0x5594587c62c0 2024-04-01T06:56:22.359 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.352+0000 7f9ac1ffb700 10 client.15651 handle_command_reply: tid=0 2024-04-01T06:56:22.359 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.352+0000 7f9aec744b80 1 client.15651 shutdown 2024-04-01T06:56:22.359 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.352+0000 7f9aec744b80 1 -- 172.21.15.83:0/1248742913 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5594587b68d0 msgr2=0x5594587b3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:22.359 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.352+0000 7f9aec744b80 1 --2- 172.21.15.83:0/1248742913 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5594587b68d0 0x5594587b3cd0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f9ad0008f50 tx=0x7f9ad0008f80 comp rx=0 tx=0).stop 2024-04-01T06:56:22.359 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.352+0000 7f9aec744b80 1 -- 172.21.15.83:0/1248742913 shutdown_connections 2024-04-01T06:56:22.359 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.352+0000 7f9aec744b80 1 --2- 172.21.15.83:0/1248742913 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5594587c62c0 0x5594587c86e0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:22.359 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.352+0000 7f9aec744b80 1 --2- 172.21.15.83:0/1248742913 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5594587b68d0 0x5594587b3cd0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:22.359 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.352+0000 7f9ac1ffb700 0 client.15651 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:56:22.359 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.352+0000 7f9aec744b80 1 --2- 172.21.15.83:0/1248742913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5594587ab100 0x5594587b6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:22.360 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.352+0000 7f9aec744b80 1 --2- 172.21.15.83:0/1248742913 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594587aba20 0x5594587b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:22.360 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.352+0000 7f9aec744b80 1 -- 172.21.15.83:0/1248742913 >> 172.21.15.83:0/1248742913 conn(0x55945870b640 msgr2=0x5594587ad080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:22.360 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.352+0000 7f9aec744b80 1 -- 172.21.15.83:0/1248742913 shutdown_connections 2024-04-01T06:56:22.360 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.352+0000 7f9aec744b80 1 -- 172.21.15.83:0/1248742913 wait complete. 2024-04-01T06:56:22.360 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.353+0000 7f9aec744b80 20 client.15651 trim_cache size 0 max 16384 2024-04-01T06:56:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.367+0000 7f9aec744b80 1 Processor -- start 2024-04-01T06:56:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.367+0000 7f9aec744b80 1 -- start start 2024-04-01T06:56:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.367+0000 7f9aec744b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594587ab100 0x5594587bd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.367+0000 7f9aec744b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5594587aba20 0x5594587b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.368+0000 7f9aec744b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5594587b68d0 0x5594587b6380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.368+0000 7f9aec744b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594587a3450 con 0x5594587aba20 2024-04-01T06:56:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.368+0000 7f9aec744b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594587af250 con 0x5594587ab100 2024-04-01T06:56:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.368+0000 7f9aec744b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594587c3980 con 0x5594587b68d0 2024-04-01T06:56:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.368+0000 7f9addb49700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5594587aba20 0x5594587b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.368+0000 7f9addb49700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5594587aba20 0x5594587b5e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38024/0 (socket says 172.21.15.83:38024) 2024-04-01T06:56:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.368+0000 7f9addb49700 1 -- 172.21.15.83:0/2863022167 learned_addr learned my addr 172.21.15.83:0/2863022167 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.368+0000 7f9ade34a700 1 --2- 172.21.15.83:0/2863022167 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594587ab100 0x5594587bd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.368+0000 7f9adeb4b700 1 --2- 172.21.15.83:0/2863022167 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5594587b68d0 0x5594587b6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.368+0000 7f9addb49700 1 -- 172.21.15.83:0/2863022167 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5594587b68d0 msgr2=0x5594587b6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.368+0000 7f9addb49700 1 --2- 172.21.15.83:0/2863022167 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5594587b68d0 0x5594587b6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.368+0000 7f9addb49700 1 -- 172.21.15.83:0/2863022167 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594587ab100 msgr2=0x5594587bd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.368+0000 7f9addb49700 1 --2- 172.21.15.83:0/2863022167 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594587ab100 0x5594587bd2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.368+0000 7f9addb49700 1 -- 172.21.15.83:0/2863022167 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5594586c3e40 con 0x5594587aba20 2024-04-01T06:56:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.368+0000 7f9ade34a700 1 --2- 172.21.15.83:0/2863022167 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594587ab100 0x5594587bd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:56:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.368+0000 7f9addb49700 1 --2- 172.21.15.83:0/2863022167 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5594587aba20 0x5594587b5e40 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f9ac809b830 tx=0x7f9ac8009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a02ed0ef42756395 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.368+0000 7f9acd7fa700 1 -- 172.21.15.83:0/2863022167 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac80a3370 con 0x5594587aba20 2024-04-01T06:56:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.368+0000 7f9acd7fa700 1 -- 172.21.15.83:0/2863022167 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9ac809edb0 con 0x5594587aba20 2024-04-01T06:56:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.368+0000 7f9acd7fa700 1 -- 172.21.15.83:0/2863022167 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac80a3140 con 0x5594587aba20 2024-04-01T06:56:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.369+0000 7f9aec744b80 1 -- 172.21.15.83:0/2863022167 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5594587aba20 msgr2=0x5594587b5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.369+0000 7f9aec744b80 1 --2- 172.21.15.83:0/2863022167 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5594587aba20 0x5594587b5e40 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f9ac809b830 tx=0x7f9ac8009cd0 comp rx=0 tx=0).stop 2024-04-01T06:56:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.369+0000 7f9aec744b80 1 -- 172.21.15.83:0/2863022167 shutdown_connections 2024-04-01T06:56:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.369+0000 7f9aec744b80 1 --2- 172.21.15.83:0/2863022167 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5594587b68d0 0x5594587b6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.369+0000 7f9aec744b80 1 --2- 172.21.15.83:0/2863022167 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594587ab100 0x5594587bd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.369+0000 7f9aec744b80 1 --2- 172.21.15.83:0/2863022167 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5594587aba20 0x5594587b5e40 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.369+0000 7f9aec744b80 1 -- 172.21.15.83:0/2863022167 >> 172.21.15.83:0/2863022167 conn(0x55945870b640 msgr2=0x5594587ade30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.369+0000 7f9aec744b80 1 -- 172.21.15.83:0/2863022167 shutdown_connections 2024-04-01T06:56:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.369+0000 7f9aec744b80 1 -- 172.21.15.83:0/2863022167 wait complete. 2024-04-01T06:56:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.369+0000 7f9aec744b80 1 -- start start 2024-04-01T06:56:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.369+0000 7f9aec744b80 1 Processor -- start 2024-04-01T06:56:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.369+0000 7f9aec744b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5594587ab100 0x5594587bb490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.369+0000 7f9aec744b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5594587aba20 0x5594587bb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.369+0000 7f9aec744b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594587b68d0 0x5594588190f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.370+0000 7f9aec744b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594587bc100 con 0x5594587aba20 2024-04-01T06:56:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.370+0000 7f9aec744b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x559458819630 con 0x5594587b68d0 2024-04-01T06:56:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.370+0000 7f9aec744b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594588197c0 con 0x5594587ab100 2024-04-01T06:56:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.370+0000 7f9aec744b80 10 client.0 _ll_register_callbacks cb 0x5594586a3410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:56:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.370+0000 7f9addb49700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5594587aba20 0x5594587bb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.370+0000 7f9addb49700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5594587aba20 0x5594587bb9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38032/0 (socket says 172.21.15.83:38032) 2024-04-01T06:56:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.370+0000 7f9addb49700 1 -- 172.21.15.83:0/4217852194 learned_addr learned my addr 172.21.15.83:0/4217852194 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.370+0000 7f9ade34a700 1 --2- 172.21.15.83:0/4217852194 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5594587ab100 0x5594587bb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.370+0000 7f9adeb4b700 1 --2- 172.21.15.83:0/4217852194 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594587b68d0 0x5594588190f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.370+0000 7f9addb49700 1 -- 172.21.15.83:0/4217852194 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5594587ab100 msgr2=0x5594587bb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.370+0000 7f9addb49700 1 --2- 172.21.15.83:0/4217852194 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5594587ab100 0x5594587bb490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.370+0000 7f9addb49700 1 -- 172.21.15.83:0/4217852194 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594587b68d0 msgr2=0x5594588190f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.370+0000 7f9addb49700 1 --2- 172.21.15.83:0/4217852194 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594587b68d0 0x5594588190f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.370+0000 7f9addb49700 1 -- 172.21.15.83:0/4217852194 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55945857f350 con 0x5594587aba20 2024-04-01T06:56:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.370+0000 7f9addb49700 1 --2- 172.21.15.83:0/4217852194 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5594587aba20 0x5594587bb9d0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f9ac80992d0 tx=0x7f9ac809a470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df46fd825e4284bd server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:22.376 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.370+0000 7f9ac1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:56:22.376 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.370+0000 7f9ac1ffb700 1 -- 172.21.15.83:0/4217852194 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac8095d90 con 0x5594587aba20 2024-04-01T06:56:22.376 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.370+0000 7f9ac1ffb700 1 -- 172.21.15.83:0/4217852194 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f9ac800f670 con 0x5594587aba20 2024-04-01T06:56:22.376 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.370+0000 7f9aec744b80 1 -- 172.21.15.83:0/4217852194 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9ac809af80 con 0x5594587aba20 2024-04-01T06:56:22.376 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.370+0000 7f9ac1ffb700 1 -- 172.21.15.83:0/4217852194 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ac80b92c0 con 0x5594587aba20 2024-04-01T06:56:22.376 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.370+0000 7f9aec744b80 10 client.15657 fetch_fsmap learned FSMap version 24 2024-04-01T06:56:22.376 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.370+0000 7f9aec744b80 1 -- 172.21.15.83:0/4217852194 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x559458583c70 con 0x5594587aba20 2024-04-01T06:56:22.376 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.370+0000 7f9ac1ffb700 1 -- 172.21.15.83:0/4217852194 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9ac809af80 con 0x5594587aba20 2024-04-01T06:56:22.376 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.371+0000 7f9ac1ffb700 1 -- 172.21.15.83:0/4217852194 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f9ac8099ee0 con 0x5594587aba20 2024-04-01T06:56:22.376 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.371+0000 7f9aec744b80 10 client.15657 fetch_fsmap finished waiting for FSMap version 24 2024-04-01T06:56:22.376 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.371+0000 7f9aec744b80 10 client.15657 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-01T06:56:22.376 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.371+0000 7f9aec744b80 20 client.15657 populate_metadata read hostname 'smithi083' 2024-04-01T06:56:22.376 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.371+0000 7f9aec744b80 1 --2- 172.21.15.83:0/4217852194 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55945881ab10 0x55945881cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:22.376 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.371+0000 7f9aec744b80 4 client.15657 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-01T06:56:22.376 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.371+0000 7f9aec744b80 1 -- 172.21.15.83:0/4217852194 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55945854cc90 con 0x55945881ab10 2024-04-01T06:56:22.377 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.371+0000 7f9ade34a700 1 --2- 172.21.15.83:0/4217852194 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55945881ab10 0x55945881cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:22.377 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.371+0000 7f9ac1ffb700 10 client.15657 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:56:22.377 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.371+0000 7f9ade34a700 1 --2- 172.21.15.83:0/4217852194 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55945881ab10 0x55945881cf00 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3597ed9b3c81fbb9 server_cookie=3dc633ad47bd7b51 in_seq=0 out_seq=0 2024-04-01T06:56:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.375+0000 7f9ac1ffb700 1 -- 172.21.15.83:0/4217852194 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55945854cc90 con 0x55945881ab10 2024-04-01T06:56:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.375+0000 7f9ac1ffb700 10 client.15657 handle_command_reply: tid=0 2024-04-01T06:56:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.375+0000 7f9aec744b80 1 client.15657 shutdown 2024-04-01T06:56:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.375+0000 7f9aec744b80 1 -- 172.21.15.83:0/4217852194 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5594587aba20 msgr2=0x5594587bb9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.375+0000 7f9aec744b80 1 --2- 172.21.15.83:0/4217852194 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5594587aba20 0x5594587bb9d0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f9ac80992d0 tx=0x7f9ac809a470 comp rx=0 tx=0).stop 2024-04-01T06:56:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.375+0000 7f9aec744b80 1 -- 172.21.15.83:0/4217852194 shutdown_connections 2024-04-01T06:56:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.375+0000 7f9aec744b80 1 --2- 172.21.15.83:0/4217852194 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55945881ab10 0x55945881cf00 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.375+0000 7f9aec744b80 1 --2- 172.21.15.83:0/4217852194 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594587b68d0 0x5594588190f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.375+0000 7f9aec744b80 1 --2- 172.21.15.83:0/4217852194 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5594587ab100 0x5594587bb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.375+0000 7f9ac1ffb700 0 client.15657 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:56:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.375+0000 7f9aec744b80 1 --2- 172.21.15.83:0/4217852194 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5594587aba20 0x5594587bb9d0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.375+0000 7f9aec744b80 1 -- 172.21.15.83:0/4217852194 >> 172.21.15.83:0/4217852194 conn(0x55945870b640 msgr2=0x5594587a03e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.375+0000 7f9aec744b80 1 -- 172.21.15.83:0/4217852194 shutdown_connections 2024-04-01T06:56:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.375+0000 7f9aec744b80 1 -- 172.21.15.83:0/4217852194 wait complete. 2024-04-01T06:56:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.375+0000 7f9aec744b80 20 client.15657 trim_cache size 0 max 16384 2024-04-01T06:56:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout:{ 2024-04-01T06:56:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout: "message": "", 2024-04-01T06:56:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout: "return_code": 0 2024-04-01T06:56:22.380 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout:} 2024-04-01T06:56:22.381 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.376+0000 7f9ae05ae700 1 -- 172.21.15.83:0/2835475251 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f9ac40a13b0 msgr2=0x7f9ac40a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:22.381 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.376+0000 7f9ae05ae700 1 --2- 172.21.15.83:0/2835475251 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f9ac40a13b0 0x7f9ac40a3870 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9ad4005950 tx=0x7f9ad400b410 comp rx=0 tx=0).stop 2024-04-01T06:56:22.381 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.376+0000 7f9ae05ae700 1 -- 172.21.15.83:0/2835475251 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ad80ffbe0 msgr2=0x7f9ad8197750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:22.381 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.376+0000 7f9ae05ae700 1 --2- 172.21.15.83:0/2835475251 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ad80ffbe0 0x7f9ad8197750 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f9ac800b580 tx=0x7f9ac8004730 comp rx=0 tx=0).stop 2024-04-01T06:56:22.381 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.376+0000 7f9ae05ae700 1 -- 172.21.15.83:0/2835475251 shutdown_connections 2024-04-01T06:56:22.381 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.376+0000 7f9ae05ae700 1 --2- 172.21.15.83:0/2835475251 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f9ac40a13b0 0x7f9ac40a3870 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:22.381 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.376+0000 7f9ae05ae700 1 --2- 172.21.15.83:0/2835475251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ad8106e30 0x7f9ad819ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:22.381 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.376+0000 7f9ae05ae700 1 --2- 172.21.15.83:0/2835475251 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9ad80ff220 0x7f9ad8197210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:22.381 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.376+0000 7f9ae05ae700 1 --2- 172.21.15.83:0/2835475251 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9ad80ffbe0 0x7f9ad8197750 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:22.381 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.376+0000 7f9ae05ae700 1 -- 172.21.15.83:0/2835475251 >> 172.21.15.83:0/2835475251 conn(0x7f9ad80761b0 msgr2=0x7f9ad8103f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:22.381 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.376+0000 7f9ae05ae700 1 -- 172.21.15.83:0/2835475251 shutdown_connections 2024-04-01T06:56:22.381 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:22.376+0000 7f9ae05ae700 1 -- 172.21.15.83:0/2835475251 wait complete. 2024-04-01T06:56:23.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:56:22 smithi145 ceph-mon[47816]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-01T06:56:23.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:56:22 smithi145 ceph-mon[47816]: scrub summary: idle 2024-04-01T06:56:23.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:56:22 smithi083 ceph-mon[43429]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-01T06:56:23.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:56:22 smithi083 ceph-mon[43429]: scrub summary: idle 2024-04-01T06:56:23.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:56:22 smithi153 ceph-mon[48187]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-01T06:56:23.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:56:22 smithi153 ceph-mon[48187]: scrub summary: idle 2024-04-01T06:56:25.006 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:56:24 smithi145 ceph-mon[47816]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-01T06:56:25.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:56:24 smithi083 ceph-mon[43429]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-01T06:56:25.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:56:24 smithi153 ceph-mon[48187]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-01T06:56:27.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:56:26 smithi145 ceph-mon[47816]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 9 op/s 2024-04-01T06:56:27.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:56:26 smithi083 ceph-mon[43429]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 9 op/s 2024-04-01T06:56:27.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:56:26 smithi153 ceph-mon[48187]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 9 op/s 2024-04-01T06:56:29.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:56:28 smithi145 ceph-mon[47816]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-04-01T06:56:29.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:56:28 smithi083 ceph-mon[43429]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-04-01T06:56:29.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:56:28 smithi153 ceph-mon[48187]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-04-01T06:56:31.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:56:30 smithi083 ceph-mon[43429]: pgmap v21: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-04-01T06:56:31.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:56:30 smithi153 ceph-mon[48187]: pgmap v21: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-04-01T06:56:31.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:56:30 smithi145 ceph-mon[47816]: pgmap v21: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-04-01T06:56:33.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:56:32 smithi083 ceph-mon[43429]: pgmap v22: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2024-04-01T06:56:33.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:56:32 smithi153 ceph-mon[48187]: pgmap v22: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2024-04-01T06:56:33.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:56:32 smithi145 ceph-mon[47816]: pgmap v22: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2024-04-01T06:56:35.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:56:34 smithi083 ceph-mon[43429]: pgmap v23: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2024-04-01T06:56:35.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:56:34 smithi153 ceph-mon[48187]: pgmap v23: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2024-04-01T06:56:35.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:56:34 smithi145 ceph-mon[47816]: pgmap v23: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2024-04-01T06:56:35.496 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.496+0000 7fad480a4700 1 -- 172.21.15.83:0/1522919356 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad40100f10 msgr2=0x7fad401012f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:35.497 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.496+0000 7fad480a4700 1 --2- 172.21.15.83:0/1522919356 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad40100f10 0x7fad401012f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fad3c009990 tx=0x7fad3c009ca0 comp rx=0 tx=0).stop 2024-04-01T06:56:35.497 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.496+0000 7fad480a4700 1 -- 172.21.15.83:0/1522919356 shutdown_connections 2024-04-01T06:56:35.497 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.496+0000 7fad480a4700 1 --2- 172.21.15.83:0/1522919356 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad40100f10 0x7fad401012f0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:35.497 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.496+0000 7fad480a4700 1 --2- 172.21.15.83:0/1522919356 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad40106030 0x7fad4010dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:35.497 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.496+0000 7fad480a4700 1 --2- 172.21.15.83:0/1522919356 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fad401018c0 0x7fad40105900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:35.497 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.496+0000 7fad480a4700 1 -- 172.21.15.83:0/1522919356 >> 172.21.15.83:0/1522919356 conn(0x7fad400fc7b0 msgr2=0x7fad400febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:35.497 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.496+0000 7fad480a4700 1 -- 172.21.15.83:0/1522919356 shutdown_connections 2024-04-01T06:56:35.497 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.496+0000 7fad480a4700 1 -- 172.21.15.83:0/1522919356 wait complete. 2024-04-01T06:56:35.497 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.497+0000 7fad480a4700 1 Processor -- start 2024-04-01T06:56:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.497+0000 7fad480a4700 1 -- start start 2024-04-01T06:56:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.497+0000 7fad480a4700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fad40100f10 0x7fad401971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.497+0000 7fad480a4700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad40106030 0x7fad40197700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.497+0000 7fad480a4700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad4019baa0 0x7fad4019bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.497+0000 7fad480a4700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad4019c520 con 0x7fad40106030 2024-04-01T06:56:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.497+0000 7fad480a4700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad4019c660 con 0x7fad40100f10 2024-04-01T06:56:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.497+0000 7fad480a4700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad4019c7d0 con 0x7fad4019baa0 2024-04-01T06:56:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.498+0000 7fad4563f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad40106030 0x7fad40197700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.498+0000 7fad4563f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad40106030 0x7fad40197700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:35418/0 (socket says 172.21.15.83:35418) 2024-04-01T06:56:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.498+0000 7fad4563f700 1 -- 172.21.15.83:0/790852078 learned_addr learned my addr 172.21.15.83:0/790852078 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.498+0000 7fad46641700 1 --2- 172.21.15.83:0/790852078 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad4019baa0 0x7fad4019bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.498+0000 7fad45e40700 1 --2- 172.21.15.83:0/790852078 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fad40100f10 0x7fad401971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.498+0000 7fad4563f700 1 -- 172.21.15.83:0/790852078 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad4019baa0 msgr2=0x7fad4019bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.498+0000 7fad4563f700 1 --2- 172.21.15.83:0/790852078 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad4019baa0 0x7fad4019bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.498+0000 7fad4563f700 1 -- 172.21.15.83:0/790852078 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fad40100f10 msgr2=0x7fad401971c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.498+0000 7fad4563f700 1 --2- 172.21.15.83:0/790852078 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fad40100f10 0x7fad401971c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.498+0000 7fad4563f700 1 -- 172.21.15.83:0/790852078 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad3c0095f0 con 0x7fad40106030 2024-04-01T06:56:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.498+0000 7fad4563f700 1 --2- 172.21.15.83:0/790852078 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad40106030 0x7fad40197700 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fad3000be80 tx=0x7fad3000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.498+0000 7fad36ffd700 1 -- 172.21.15.83:0/790852078 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad30012b70 con 0x7fad40106030 2024-04-01T06:56:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.498+0000 7fad480a4700 1 -- 172.21.15.83:0/790852078 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad4006a7d0 con 0x7fad40106030 2024-04-01T06:56:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.498+0000 7fad480a4700 1 -- 172.21.15.83:0/790852078 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad4006ad30 con 0x7fad40106030 2024-04-01T06:56:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.498+0000 7fad36ffd700 1 -- 172.21.15.83:0/790852078 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fad30016070 con 0x7fad40106030 2024-04-01T06:56:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.498+0000 7fad36ffd700 1 -- 172.21.15.83:0/790852078 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad300256a0 con 0x7fad40106030 2024-04-01T06:56:35.502 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.501+0000 7fad36ffd700 1 -- 172.21.15.83:0/790852078 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) v1 ==== 136098+0+0 (secure 0 0 0) 0x7fad30012cd0 con 0x7fad40106030 2024-04-01T06:56:35.502 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.501+0000 7fad36ffd700 1 --2- 172.21.15.83:0/790852078 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fad2c0a13b0 0x7fad2c0a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:35.502 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.501+0000 7fad45e40700 1 --2- 172.21.15.83:0/790852078 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fad2c0a13b0 0x7fad2c0a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:35.502 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.501+0000 7fad36ffd700 1 -- 172.21.15.83:0/790852078 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8425+0+0 (secure 0 0 0) 0x7fad300d0a40 con 0x7fad40106030 2024-04-01T06:56:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.502+0000 7fad45e40700 1 --2- 172.21.15.83:0/790852078 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fad2c0a13b0 0x7fad2c0a3870 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fad3c006010 tx=0x7fad3c00b540 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.503+0000 7fad5423ab80 1 Processor -- start 2024-04-01T06:56:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.503+0000 7fad5423ab80 1 -- start start 2024-04-01T06:56:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.504+0000 7fad5423ab80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a748398100 0x55a7483984e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.504+0000 7fad5423ab80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a748398a20 0x55a7483a3390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.504+0000 7fad5423ab80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a7483a38d0 0x55a7483a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.504+0000 7fad5423ab80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7482f1930 con 0x55a748398100 2024-04-01T06:56:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.504+0000 7fad5423ab80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7482ef2f0 con 0x55a748398a20 2024-04-01T06:56:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.504+0000 7fad5423ab80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7482eabe0 con 0x55a7483a38d0 2024-04-01T06:56:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.504+0000 7fad45e40700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a748398100 0x55a7483984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.504+0000 7fad45e40700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a748398100 0x55a7483984e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:35422/0 (socket says 172.21.15.83:35422) 2024-04-01T06:56:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.504+0000 7fad45e40700 1 -- 172.21.15.83:0/771274383 learned_addr learned my addr 172.21.15.83:0/771274383 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.504+0000 7fad46641700 1 --2- 172.21.15.83:0/771274383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a7483a38d0 0x55a7483a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.504+0000 7fad4563f700 1 --2- 172.21.15.83:0/771274383 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a748398a20 0x55a7483a3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.504+0000 7fad45e40700 1 -- 172.21.15.83:0/771274383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a7483a38d0 msgr2=0x55a7483a5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.504+0000 7fad45e40700 1 --2- 172.21.15.83:0/771274383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a7483a38d0 0x55a7483a5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.504+0000 7fad45e40700 1 -- 172.21.15.83:0/771274383 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a748398a20 msgr2=0x55a7483a3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.504+0000 7fad45e40700 1 --2- 172.21.15.83:0/771274383 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a748398a20 0x55a7483a3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.504+0000 7fad45e40700 1 -- 172.21.15.83:0/771274383 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a74816c350 con 0x55a748398100 2024-04-01T06:56:35.506 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.504+0000 7fad45e40700 1 --2- 172.21.15.83:0/771274383 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a748398100 0x55a7483984e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fad3c0052b0 tx=0x7fad3c01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af7b898a711a62ba server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:35.506 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.504+0000 7fad2bfff700 1 -- 172.21.15.83:0/771274383 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c02b070 con 0x55a748398100 2024-04-01T06:56:35.506 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.505+0000 7fad2bfff700 1 -- 172.21.15.83:0/771274383 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fad3c01e040 con 0x55a748398100 2024-04-01T06:56:35.506 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.505+0000 7fad2bfff700 1 -- 172.21.15.83:0/771274383 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c004af0 con 0x55a748398100 2024-04-01T06:56:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.505+0000 7fad5423ab80 1 -- 172.21.15.83:0/771274383 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a748398100 msgr2=0x55a7483984e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.505+0000 7fad5423ab80 1 --2- 172.21.15.83:0/771274383 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a748398100 0x55a7483984e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fad3c0052b0 tx=0x7fad3c01f000 comp rx=0 tx=0).stop 2024-04-01T06:56:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.505+0000 7fad5423ab80 1 -- 172.21.15.83:0/771274383 shutdown_connections 2024-04-01T06:56:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.505+0000 7fad5423ab80 1 --2- 172.21.15.83:0/771274383 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a748398100 0x55a7483984e0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.505+0000 7fad5423ab80 1 --2- 172.21.15.83:0/771274383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a7483a38d0 0x55a7483a5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.505+0000 7fad5423ab80 1 --2- 172.21.15.83:0/771274383 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a748398a20 0x55a7483a3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.505+0000 7fad5423ab80 1 -- 172.21.15.83:0/771274383 >> 172.21.15.83:0/771274383 conn(0x55a7482f8640 msgr2=0x55a748394520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.505+0000 7fad5423ab80 1 -- 172.21.15.83:0/771274383 shutdown_connections 2024-04-01T06:56:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.506+0000 7fad5423ab80 1 -- 172.21.15.83:0/771274383 wait complete. 2024-04-01T06:56:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.506+0000 7fad5423ab80 1 -- start start 2024-04-01T06:56:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.506+0000 7fad5423ab80 1 Processor -- start 2024-04-01T06:56:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.506+0000 7fad5423ab80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a748398100 0x55a7483a3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:35.510 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.506+0000 7fad5423ab80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a748398a20 0x55a7483a0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:35.510 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.506+0000 7fad5423ab80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a7483a38d0 0x55a7483a0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:35.510 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.506+0000 7fad5423ab80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a748286d20 con 0x55a748398a20 2024-04-01T06:56:35.510 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.506+0000 7fad5423ab80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7482869c0 con 0x55a7483a38d0 2024-04-01T06:56:35.510 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.506+0000 7fad5423ab80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a74816e640 con 0x55a748398100 2024-04-01T06:56:35.510 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.506+0000 7fad5423ab80 10 client.0 _ll_register_callbacks cb 0x55a748290410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:56:35.510 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.507+0000 7fad4563f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a748398a20 0x55a7483a0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:35.510 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.507+0000 7fad4563f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a748398a20 0x55a7483a0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:35434/0 (socket says 172.21.15.83:35434) 2024-04-01T06:56:35.510 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.507+0000 7fad4563f700 1 -- 172.21.15.83:0/1910109069 learned_addr learned my addr 172.21.15.83:0/1910109069 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:35.510 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.507+0000 7fad46641700 1 --2- 172.21.15.83:0/1910109069 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a7483a38d0 0x55a7483a0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:35.510 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.507+0000 7fad45e40700 1 --2- 172.21.15.83:0/1910109069 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a748398100 0x55a7483a3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:35.510 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.507+0000 7fad4563f700 1 -- 172.21.15.83:0/1910109069 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a748398100 msgr2=0x55a7483a3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:35.510 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.507+0000 7fad4563f700 1 --2- 172.21.15.83:0/1910109069 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a748398100 0x55a7483a3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:35.511 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.507+0000 7fad4563f700 1 -- 172.21.15.83:0/1910109069 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a7483a38d0 msgr2=0x55a7483a0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:35.511 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.507+0000 7fad4563f700 1 --2- 172.21.15.83:0/1910109069 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a7483a38d0 0x55a7483a0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:35.511 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.507+0000 7fad4563f700 1 -- 172.21.15.83:0/1910109069 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad4010e420 con 0x55a748398a20 2024-04-01T06:56:35.511 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.507+0000 7fad4563f700 1 --2- 172.21.15.83:0/1910109069 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a748398a20 0x55a7483a0570 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fad300ce290 tx=0x7fad3009c020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24047739b24d8b5d server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:35.511 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.507+0000 7fad297fa700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:56:35.511 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.508+0000 7fad297fa700 1 -- 172.21.15.83:0/1910109069 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3009ded0 con 0x55a748398a20 2024-04-01T06:56:35.511 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.508+0000 7fad297fa700 1 -- 172.21.15.83:0/1910109069 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8425+0+0 (secure 0 0 0) 0x7fad300a5ef0 con 0x55a748398a20 2024-04-01T06:56:35.511 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.508+0000 7fad5423ab80 1 -- 172.21.15.83:0/1910109069 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a7482ab320 con 0x55a748398a20 2024-04-01T06:56:35.511 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.508+0000 7fad297fa700 1 -- 172.21.15.83:0/1910109069 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fad300b6260 con 0x55a748398a20 2024-04-01T06:56:35.511 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.508+0000 7fad5423ab80 10 client.15669 fetch_fsmap learned FSMap version 24 2024-04-01T06:56:35.512 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.508+0000 7fad5423ab80 1 -- 172.21.15.83:0/1910109069 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55a748118b00 con 0x55a748398a20 2024-04-01T06:56:35.512 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.508+0000 7fad297fa700 1 -- 172.21.15.83:0/1910109069 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fad300ba080 con 0x55a748398a20 2024-04-01T06:56:35.512 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.508+0000 7fad297fa700 1 -- 172.21.15.83:0/1910109069 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fad300a5a60 con 0x55a748398a20 2024-04-01T06:56:35.512 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.508+0000 7fad5423ab80 10 client.15669 fetch_fsmap finished waiting for FSMap version 24 2024-04-01T06:56:35.512 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.508+0000 7fad5423ab80 10 client.15669 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-01T06:56:35.512 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.508+0000 7fad5423ab80 20 client.15669 populate_metadata read hostname 'smithi083' 2024-04-01T06:56:35.512 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.508+0000 7fad5423ab80 1 --2- 172.21.15.83:0/1910109069 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55a7483bbd80 0x55a7483be1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:35.512 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.508+0000 7fad5423ab80 4 client.15669 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-01T06:56:35.512 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.508+0000 7fad5423ab80 1 -- 172.21.15.83:0/1910109069 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a7482e36a0 con 0x55a7483bbd80 2024-04-01T06:56:35.512 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.509+0000 7fad45e40700 1 --2- 172.21.15.83:0/1910109069 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55a7483bbd80 0x55a7483be1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:35.512 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.509+0000 7fad297fa700 10 client.15669 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:56:35.512 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.509+0000 7fad45e40700 1 --2- 172.21.15.83:0/1910109069 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55a7483bbd80 0x55a7483be1a0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9994e863982a403 server_cookie=ace7c5fc95522f09 in_seq=0 out_seq=0 2024-04-01T06:56:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.510+0000 7fad297fa700 1 -- 172.21.15.83:0/1910109069 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a7482e36a0 con 0x55a7483bbd80 2024-04-01T06:56:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.510+0000 7fad297fa700 10 client.15669 handle_command_reply: tid=0 2024-04-01T06:56:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.510+0000 7fad5423ab80 1 client.15669 shutdown 2024-04-01T06:56:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.510+0000 7fad5423ab80 1 -- 172.21.15.83:0/1910109069 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a748398a20 msgr2=0x55a7483a0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.510+0000 7fad5423ab80 1 --2- 172.21.15.83:0/1910109069 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a748398a20 0x55a7483a0570 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fad300ce290 tx=0x7fad3009c020 comp rx=0 tx=0).stop 2024-04-01T06:56:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.510+0000 7fad5423ab80 1 -- 172.21.15.83:0/1910109069 shutdown_connections 2024-04-01T06:56:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.510+0000 7fad5423ab80 1 --2- 172.21.15.83:0/1910109069 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55a7483bbd80 0x55a7483be1a0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.510+0000 7fad5423ab80 1 --2- 172.21.15.83:0/1910109069 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a7483a38d0 0x55a7483a0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.510+0000 7fad5423ab80 1 --2- 172.21.15.83:0/1910109069 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a748398100 0x55a7483a3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.510+0000 7fad5423ab80 1 --2- 172.21.15.83:0/1910109069 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a748398a20 0x55a7483a0570 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.510+0000 7fad5423ab80 1 -- 172.21.15.83:0/1910109069 >> 172.21.15.83:0/1910109069 conn(0x55a7482f8640 msgr2=0x55a74839a060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.510+0000 7fad297fa700 0 client.15669 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:56:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.510+0000 7fad5423ab80 1 -- 172.21.15.83:0/1910109069 shutdown_connections 2024-04-01T06:56:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.510+0000 7fad5423ab80 1 -- 172.21.15.83:0/1910109069 wait complete. 2024-04-01T06:56:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.510+0000 7fad5423ab80 20 client.15669 trim_cache size 0 max 16384 2024-04-01T06:56:35.529 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.528+0000 7fad5423ab80 1 Processor -- start 2024-04-01T06:56:35.529 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.528+0000 7fad5423ab80 1 -- start start 2024-04-01T06:56:35.529 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.528+0000 7fad5423ab80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a748398100 0x55a7483af3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:35.529 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.528+0000 7fad5423ab80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a748398a20 0x55a7483aa580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:35.529 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.528+0000 7fad5423ab80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a7483a38d0 0x55a748393d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:35.529 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.528+0000 7fad5423ab80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a748390400 con 0x55a748398a20 2024-04-01T06:56:35.529 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.528+0000 7fad5423ab80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7483a1150 con 0x55a7483a38d0 2024-04-01T06:56:35.529 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.528+0000 7fad5423ab80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a748398fd0 con 0x55a748398100 2024-04-01T06:56:35.529 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.528+0000 7fad4563f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a748398a20 0x55a7483aa580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:35.529 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.528+0000 7fad4563f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a748398a20 0x55a7483aa580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:35442/0 (socket says 172.21.15.83:35442) 2024-04-01T06:56:35.529 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.528+0000 7fad4563f700 1 -- 172.21.15.83:0/2668428799 learned_addr learned my addr 172.21.15.83:0/2668428799 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:35.530 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.529+0000 7fad46641700 1 --2- 172.21.15.83:0/2668428799 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a7483a38d0 0x55a748393d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:35.530 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.529+0000 7fad45e40700 1 --2- 172.21.15.83:0/2668428799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a748398100 0x55a7483af3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:35.530 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.529+0000 7fad4563f700 1 -- 172.21.15.83:0/2668428799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a748398100 msgr2=0x55a7483af3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:35.530 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.529+0000 7fad4563f700 1 --2- 172.21.15.83:0/2668428799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a748398100 0x55a7483af3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:35.530 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.529+0000 7fad4563f700 1 -- 172.21.15.83:0/2668428799 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a7483a38d0 msgr2=0x55a748393d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:35.530 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.529+0000 7fad4563f700 1 --2- 172.21.15.83:0/2668428799 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a7483a38d0 0x55a748393d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:35.530 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.529+0000 7fad4563f700 1 -- 172.21.15.83:0/2668428799 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a7482b0e40 con 0x55a748398a20 2024-04-01T06:56:35.530 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.529+0000 7fad46641700 1 --2- 172.21.15.83:0/2668428799 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a7483a38d0 0x55a748393d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:56:35.530 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.529+0000 7fad4563f700 1 --2- 172.21.15.83:0/2668428799 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a748398a20 0x55a7483aa580 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fad30009de0 tx=0x7fad30099e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea46de86fc5f2a78 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:35.530 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.529+0000 7fad34ff9700 1 -- 172.21.15.83:0/2668428799 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad300ce3f0 con 0x55a748398a20 2024-04-01T06:56:35.530 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.529+0000 7fad34ff9700 1 -- 172.21.15.83:0/2668428799 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a7482ab320 con 0x55a748398a20 2024-04-01T06:56:35.530 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.529+0000 7fad34ff9700 1 -- 172.21.15.83:0/2668428799 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3009d1c0 con 0x55a748398a20 2024-04-01T06:56:35.533 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.530+0000 7fad5423ab80 1 -- 172.21.15.83:0/2668428799 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a748398a20 msgr2=0x55a7483aa580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:35.533 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.530+0000 7fad5423ab80 1 --2- 172.21.15.83:0/2668428799 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a748398a20 0x55a7483aa580 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fad30009de0 tx=0x7fad30099e30 comp rx=0 tx=0).stop 2024-04-01T06:56:35.534 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.530+0000 7fad5423ab80 1 -- 172.21.15.83:0/2668428799 shutdown_connections 2024-04-01T06:56:35.534 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.530+0000 7fad5423ab80 1 --2- 172.21.15.83:0/2668428799 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a7483a38d0 0x55a748393d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:35.534 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.530+0000 7fad5423ab80 1 --2- 172.21.15.83:0/2668428799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a748398100 0x55a7483af3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:35.534 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.530+0000 7fad5423ab80 1 --2- 172.21.15.83:0/2668428799 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a748398a20 0x55a7483aa580 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:35.534 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.530+0000 7fad5423ab80 1 -- 172.21.15.83:0/2668428799 >> 172.21.15.83:0/2668428799 conn(0x55a7482f8640 msgr2=0x55a7483aecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:35.534 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.530+0000 7fad5423ab80 1 -- 172.21.15.83:0/2668428799 shutdown_connections 2024-04-01T06:56:35.534 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.530+0000 7fad5423ab80 1 -- 172.21.15.83:0/2668428799 wait complete. 2024-04-01T06:56:35.534 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.530+0000 7fad5423ab80 1 -- start start 2024-04-01T06:56:35.534 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.530+0000 7fad5423ab80 1 Processor -- start 2024-04-01T06:56:35.534 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.531+0000 7fad5423ab80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a748398100 0x55a7483a8750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:35.534 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.531+0000 7fad5423ab80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a748398a20 0x55a7483a8c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:35.534 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.531+0000 7fad5423ab80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a7483a38d0 0x55a748408c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:35.534 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.531+0000 7fad5423ab80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7484091a0 con 0x55a7483a38d0 2024-04-01T06:56:35.535 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.531+0000 7fad5423ab80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a748409310 con 0x55a748398a20 2024-04-01T06:56:35.535 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.531+0000 7fad5423ab80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a748409450 con 0x55a748398100 2024-04-01T06:56:35.535 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.531+0000 7fad5423ab80 10 client.0 _ll_register_callbacks cb 0x55a748290410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:56:35.535 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.531+0000 7fad46641700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a7483a38d0 0x55a748408c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:35.535 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.531+0000 7fad4563f700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a748398a20 0x55a7483a8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:35.535 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.531+0000 7fad46641700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a7483a38d0 0x55a748408c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:35448/0 (socket says 172.21.15.83:35448) 2024-04-01T06:56:35.535 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.531+0000 7fad46641700 1 -- 172.21.15.83:0/4057173492 learned_addr learned my addr 172.21.15.83:0/4057173492 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:35.535 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.531+0000 7fad45e40700 1 --2- 172.21.15.83:0/4057173492 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a748398100 0x55a7483a8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:35.535 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.531+0000 7fad46641700 1 -- 172.21.15.83:0/4057173492 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a748398100 msgr2=0x55a7483a8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:35.535 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.531+0000 7fad46641700 1 --2- 172.21.15.83:0/4057173492 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a748398100 0x55a7483a8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:35.535 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.531+0000 7fad46641700 1 -- 172.21.15.83:0/4057173492 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a748398a20 msgr2=0x55a7483a8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:35.535 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.531+0000 7fad46641700 1 --2- 172.21.15.83:0/4057173492 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a748398a20 0x55a7483a8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:35.535 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.531+0000 7fad46641700 1 -- 172.21.15.83:0/4057173492 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a748118b00 con 0x55a7483a38d0 2024-04-01T06:56:35.535 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.531+0000 7fad46641700 1 --2- 172.21.15.83:0/4057173492 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a7483a38d0 0x55a748408c60 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fad38007a30 tx=0x7fad38007d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c45dec72d333d4b server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:35.536 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.531+0000 7fad297fa700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:56:35.536 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.532+0000 7fad297fa700 1 -- 172.21.15.83:0/4057173492 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad380157c0 con 0x55a7483a38d0 2024-04-01T06:56:35.536 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.532+0000 7fad297fa700 1 -- 172.21.15.83:0/4057173492 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8425+0+0 (secure 0 0 0) 0x7fad38015920 con 0x55a7483a38d0 2024-04-01T06:56:35.536 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.532+0000 7fad5423ab80 1 -- 172.21.15.83:0/4057173492 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fad3c01e040 con 0x55a7483a38d0 2024-04-01T06:56:35.536 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.532+0000 7fad297fa700 1 -- 172.21.15.83:0/4057173492 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fad38015ae0 con 0x55a7483a38d0 2024-04-01T06:56:35.536 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.532+0000 7fad5423ab80 10 client.15675 fetch_fsmap learned FSMap version 24 2024-04-01T06:56:35.536 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.532+0000 7fad5423ab80 1 -- 172.21.15.83:0/4057173492 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55a748170c70 con 0x55a7483a38d0 2024-04-01T06:56:35.536 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.532+0000 7fad297fa700 1 -- 172.21.15.83:0/4057173492 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fad3c01e040 con 0x55a7483a38d0 2024-04-01T06:56:35.536 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.532+0000 7fad297fa700 1 -- 172.21.15.83:0/4057173492 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fad38028020 con 0x55a7483a38d0 2024-04-01T06:56:35.536 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.532+0000 7fad5423ab80 10 client.15675 fetch_fsmap finished waiting for FSMap version 24 2024-04-01T06:56:35.536 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.532+0000 7fad5423ab80 10 client.15675 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-01T06:56:35.536 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.532+0000 7fad5423ab80 20 client.15675 populate_metadata read hostname 'smithi083' 2024-04-01T06:56:35.536 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.532+0000 7fad5423ab80 1 --2- 172.21.15.83:0/4057173492 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55a7483b1b50 0x55a7483b3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:35.536 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.532+0000 7fad5423ab80 4 client.15675 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-01T06:56:35.536 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.532+0000 7fad5423ab80 1 -- 172.21.15.83:0/4057173492 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a748139c90 con 0x55a7483b1b50 2024-04-01T06:56:35.537 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.533+0000 7fad45e40700 1 --2- 172.21.15.83:0/4057173492 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55a7483b1b50 0x55a7483b3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:35.537 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.533+0000 7fad297fa700 10 client.15675 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:56:35.537 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.533+0000 7fad45e40700 1 --2- 172.21.15.83:0/4057173492 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55a7483b1b50 0x55a7483b3f70 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2d1a600f8904a7f server_cookie=c6809dc131eab8e4 in_seq=0 out_seq=0 2024-04-01T06:56:35.540 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.540+0000 7fad297fa700 1 -- 172.21.15.83:0/4057173492 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a748139c90 con 0x55a7483b1b50 2024-04-01T06:56:35.541 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.540+0000 7fad297fa700 10 client.15675 handle_command_reply: tid=0 2024-04-01T06:56:35.541 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.540+0000 7fad5423ab80 1 client.15675 shutdown 2024-04-01T06:56:35.541 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.540+0000 7fad5423ab80 1 -- 172.21.15.83:0/4057173492 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a7483a38d0 msgr2=0x55a748408c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:35.541 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.540+0000 7fad5423ab80 1 --2- 172.21.15.83:0/4057173492 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a7483a38d0 0x55a748408c60 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fad38007a30 tx=0x7fad38007d40 comp rx=0 tx=0).stop 2024-04-01T06:56:35.541 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.540+0000 7fad5423ab80 1 -- 172.21.15.83:0/4057173492 shutdown_connections 2024-04-01T06:56:35.541 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.540+0000 7fad5423ab80 1 --2- 172.21.15.83:0/4057173492 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55a7483b1b50 0x55a7483b3f70 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:35.541 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.540+0000 7fad5423ab80 1 --2- 172.21.15.83:0/4057173492 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a7483a38d0 0x55a748408c60 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:35.541 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.540+0000 7fad5423ab80 1 --2- 172.21.15.83:0/4057173492 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a748398100 0x55a7483a8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:35.541 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.540+0000 7fad5423ab80 1 --2- 172.21.15.83:0/4057173492 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a748398a20 0x55a7483a8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:35.541 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.541+0000 7fad5423ab80 1 -- 172.21.15.83:0/4057173492 >> 172.21.15.83:0/4057173492 conn(0x55a7482f8640 msgr2=0x55a74838d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:35.541 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.541+0000 7fad297fa700 0 client.15675 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:56:35.541 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.541+0000 7fad5423ab80 1 -- 172.21.15.83:0/4057173492 shutdown_connections 2024-04-01T06:56:35.541 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.541+0000 7fad5423ab80 1 -- 172.21.15.83:0/4057173492 wait complete. 2024-04-01T06:56:35.541 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.541+0000 7fad5423ab80 20 client.15675 trim_cache size 0 max 16384 2024-04-01T06:56:35.542 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout:{ 2024-04-01T06:56:35.542 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout: "message": "", 2024-04-01T06:56:35.542 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout: "return_code": 0 2024-04-01T06:56:35.542 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout:} 2024-04-01T06:56:35.542 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.541+0000 7fad480a4700 1 -- 172.21.15.83:0/790852078 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fad2c0a13b0 msgr2=0x7fad2c0a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.541+0000 7fad480a4700 1 --2- 172.21.15.83:0/790852078 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fad2c0a13b0 0x7fad2c0a3870 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fad3c006010 tx=0x7fad3c00b540 comp rx=0 tx=0).stop 2024-04-01T06:56:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.541+0000 7fad480a4700 1 -- 172.21.15.83:0/790852078 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad40106030 msgr2=0x7fad40197700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.541+0000 7fad480a4700 1 --2- 172.21.15.83:0/790852078 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad40106030 0x7fad40197700 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fad3000be80 tx=0x7fad3000dc60 comp rx=0 tx=0).stop 2024-04-01T06:56:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.541+0000 7fad480a4700 1 -- 172.21.15.83:0/790852078 shutdown_connections 2024-04-01T06:56:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.541+0000 7fad480a4700 1 --2- 172.21.15.83:0/790852078 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fad2c0a13b0 0x7fad2c0a3870 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.541+0000 7fad480a4700 1 --2- 172.21.15.83:0/790852078 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad4019baa0 0x7fad4019bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.541+0000 7fad480a4700 1 --2- 172.21.15.83:0/790852078 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fad40100f10 0x7fad401971c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.541+0000 7fad480a4700 1 --2- 172.21.15.83:0/790852078 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fad40106030 0x7fad40197700 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.541+0000 7fad480a4700 1 -- 172.21.15.83:0/790852078 >> 172.21.15.83:0/790852078 conn(0x7fad400fc7b0 msgr2=0x7fad400fdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.541+0000 7fad480a4700 1 -- 172.21.15.83:0/790852078 shutdown_connections 2024-04-01T06:56:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:35.541+0000 7fad480a4700 1 -- 172.21.15.83:0/790852078 wait complete. 2024-04-01T06:56:37.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:56:36 smithi153 ceph-mon[48187]: pgmap v24: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-04-01T06:56:37.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:56:36 smithi145 ceph-mon[47816]: pgmap v24: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-04-01T06:56:37.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:56:36 smithi083 ceph-mon[43429]: pgmap v24: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-04-01T06:56:39.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:56:38 smithi153 ceph-mon[48187]: pgmap v25: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-04-01T06:56:39.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:56:38 smithi145 ceph-mon[47816]: pgmap v25: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-04-01T06:56:39.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:56:38 smithi083 ceph-mon[43429]: pgmap v25: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-04-01T06:56:41.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:56:40 smithi153 ceph-mon[48187]: pgmap v26: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.5 KiB/s wr, 9 op/s 2024-04-01T06:56:41.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:56:40 smithi145 ceph-mon[47816]: pgmap v26: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.5 KiB/s wr, 9 op/s 2024-04-01T06:56:41.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:56:40 smithi083 ceph-mon[43429]: pgmap v26: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.5 KiB/s wr, 9 op/s 2024-04-01T06:56:43.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:56:42 smithi153 ceph-mon[48187]: pgmap v27: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-04-01T06:56:43.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:56:42 smithi145 ceph-mon[47816]: pgmap v27: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-04-01T06:56:43.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:56:42 smithi083 ceph-mon[43429]: pgmap v27: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-04-01T06:56:45.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:56:44 smithi153 ceph-mon[48187]: pgmap v28: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-04-01T06:56:45.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:56:44 smithi145 ceph-mon[47816]: pgmap v28: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-04-01T06:56:45.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:56:44 smithi083 ceph-mon[43429]: pgmap v28: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-04-01T06:56:47.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:56:46 smithi153 ceph-mon[48187]: pgmap v29: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-04-01T06:56:47.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:56:46 smithi145 ceph-mon[47816]: pgmap v29: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-04-01T06:56:47.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:56:46 smithi083 ceph-mon[43429]: pgmap v29: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-04-01T06:56:48.076 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-01T06:56:48.077 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-01T06:56:48.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.215+0000 7f2450055700 1 -- 172.21.15.83:0/727252321 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f24480ffe70 msgr2=0x7f2448100250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:48.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.215+0000 7f2450055700 1 --2- 172.21.15.83:0/727252321 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f24480ffe70 0x7f2448100250 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f2444009990 tx=0x7f2444009ca0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.215+0000 7f2450055700 1 -- 172.21.15.83:0/727252321 shutdown_connections 2024-04-01T06:56:48.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.215+0000 7f2450055700 1 --2- 172.21.15.83:0/727252321 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f24480ffe70 0x7f2448100250 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.215+0000 7f2450055700 1 --2- 172.21.15.83:0/727252321 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2448104f90 0x7f244810cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.215+0000 7f2450055700 1 --2- 172.21.15.83:0/727252321 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2448100820 0x7f2448104860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.215+0000 7f2450055700 1 -- 172.21.15.83:0/727252321 >> 172.21.15.83:0/727252321 conn(0x7f2448076d80 msgr2=0x7f2448077190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:48.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.216+0000 7f2450055700 1 -- 172.21.15.83:0/727252321 shutdown_connections 2024-04-01T06:56:48.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.216+0000 7f2450055700 1 -- 172.21.15.83:0/727252321 wait complete. 2024-04-01T06:56:48.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.216+0000 7f2450055700 1 Processor -- start 2024-04-01T06:56:48.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.217+0000 7f2450055700 1 -- start start 2024-04-01T06:56:48.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.217+0000 7f2450055700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f24480ffe70 0x7f24480724b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:48.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.217+0000 7f2450055700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2448104f90 0x7f24480729f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:48.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.217+0000 7f2450055700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f244806b450 0x7f244806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:48.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.217+0000 7f2450055700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f244806bfc0 con 0x7f24480ffe70 2024-04-01T06:56:48.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.217+0000 7f2450055700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f244806c130 con 0x7f2448104f90 2024-04-01T06:56:48.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.217+0000 7f2450055700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f244806c2f0 con 0x7f244806b450 2024-04-01T06:56:48.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.217+0000 7f244ddf1700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f24480ffe70 0x7f24480724b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:48.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.217+0000 7f244ddf1700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f24480ffe70 0x7f24480724b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58062/0 (socket says 172.21.15.83:58062) 2024-04-01T06:56:48.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.217+0000 7f244ddf1700 1 -- 172.21.15.83:0/3276722538 learned_addr learned my addr 172.21.15.83:0/3276722538 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:48.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.217+0000 7f244d5f0700 1 --2- 172.21.15.83:0/3276722538 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2448104f90 0x7f24480729f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:48.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.217+0000 7f244ddf1700 1 -- 172.21.15.83:0/3276722538 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f244806b450 msgr2=0x7f244806b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:48.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.217+0000 7f244ddf1700 1 --2- 172.21.15.83:0/3276722538 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f244806b450 0x7f244806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.217+0000 7f244ddf1700 1 -- 172.21.15.83:0/3276722538 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2448104f90 msgr2=0x7f24480729f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:48.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.217+0000 7f244ddf1700 1 --2- 172.21.15.83:0/3276722538 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2448104f90 0x7f24480729f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.217+0000 7f244ddf1700 1 -- 172.21.15.83:0/3276722538 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24440095f0 con 0x7f24480ffe70 2024-04-01T06:56:48.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.217+0000 7f244d5f0700 1 --2- 172.21.15.83:0/3276722538 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2448104f90 0x7f24480729f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:56:48.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.218+0000 7f244ddf1700 1 --2- 172.21.15.83:0/3276722538 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f24480ffe70 0x7f24480724b0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f2444005910 tx=0x7f2444009570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:48.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.218+0000 7f243effd700 1 -- 172.21.15.83:0/3276722538 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244401d070 con 0x7f24480ffe70 2024-04-01T06:56:48.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.218+0000 7f2450055700 1 -- 172.21.15.83:0/3276722538 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24481a6360 con 0x7f24480ffe70 2024-04-01T06:56:48.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.218+0000 7f2450055700 1 -- 172.21.15.83:0/3276722538 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24481a6860 con 0x7f24480ffe70 2024-04-01T06:56:48.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.220+0000 7f243effd700 1 -- 172.21.15.83:0/3276722538 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2444022470 con 0x7f24480ffe70 2024-04-01T06:56:48.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.220+0000 7f243effd700 1 -- 172.21.15.83:0/3276722538 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2444017650 con 0x7f24480ffe70 2024-04-01T06:56:48.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.221+0000 7f245c1ebb80 1 Processor -- start 2024-04-01T06:56:48.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.221+0000 7f243effd700 1 -- 172.21.15.83:0/3276722538 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) v1 ==== 136098+0+0 (secure 0 0 0) 0x7f2444017870 con 0x7f24480ffe70 2024-04-01T06:56:48.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.222+0000 7f245c1ebb80 1 -- start start 2024-04-01T06:56:48.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.222+0000 7f245c1ebb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7a9d055d0 0x55f7a9d059b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:48.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.223+0000 7f245c1ebb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f7a9d05ef0 0x55f7a9d108b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:48.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.223+0000 7f245c1ebb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f7a9d10df0 0x55f7a9d131e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:48.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.223+0000 7f245c1ebb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7a9c5e990 con 0x55f7a9d10df0 2024-04-01T06:56:48.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.223+0000 7f245c1ebb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7a9c5c350 con 0x55f7a9d05ef0 2024-04-01T06:56:48.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.223+0000 7f245c1ebb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7a9c57c40 con 0x55f7a9d055d0 2024-04-01T06:56:48.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.223+0000 7f244e5f2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7a9d055d0 0x55f7a9d059b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:48.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.223+0000 7f244e5f2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7a9d055d0 0x55f7a9d059b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.83:54106/0 (socket says 172.21.15.83:54106) 2024-04-01T06:56:48.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.223+0000 7f244e5f2700 1 -- 172.21.15.83:0/2237233103 learned_addr learned my addr 172.21.15.83:0/2237233103 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:48.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.223+0000 7f244ddf1700 1 --2- 172.21.15.83:0/2237233103 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f7a9d05ef0 0x55f7a9d108b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:48.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.223+0000 7f244d5f0700 1 --2- 172.21.15.83:0/2237233103 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f7a9d10df0 0x55f7a9d131e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:48.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.223+0000 7f243effd700 1 --2- 172.21.15.83:0/3276722538 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f24340a14b0 0x7f24340a3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:48.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.223+0000 7f244e5f2700 1 -- 172.21.15.83:0/2237233103 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f7a9d05ef0 msgr2=0x55f7a9d108b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:48.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.223+0000 7f244e5f2700 1 --2- 172.21.15.83:0/2237233103 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f7a9d05ef0 0x55f7a9d108b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.223+0000 7f244e5f2700 1 -- 172.21.15.83:0/2237233103 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f7a9d10df0 msgr2=0x55f7a9d131e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:48.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.223+0000 7f244e5f2700 1 --2- 172.21.15.83:0/2237233103 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f7a9d10df0 0x55f7a9d131e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.223+0000 7f244e5f2700 1 -- 172.21.15.83:0/2237233103 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f7a9ad93b0 con 0x55f7a9d055d0 2024-04-01T06:56:48.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.223+0000 7f243effd700 1 -- 172.21.15.83:0/3276722538 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f244400fb20 con 0x7f24480ffe70 2024-04-01T06:56:48.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.224+0000 7f244e5f2700 1 --2- 172.21.15.83:0/3276722538 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f24340a14b0 0x7f24340a3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:48.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.224+0000 7f244d5f0700 1 --2- 172.21.15.83:0/2237233103 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f7a9d10df0 0x55f7a9d131e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:56:48.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.224+0000 7f244e5f2700 1 --2- 172.21.15.83:0/2237233103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7a9d055d0 0x55f7a9d059b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f244000e4d0 tx=0x7f244000e7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd5ab346c5f84902 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:48.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.224+0000 7f2433fff700 1 -- 172.21.15.83:0/2237233103 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2440007700 con 0x55f7a9d055d0 2024-04-01T06:56:48.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.224+0000 7f2433fff700 1 -- 172.21.15.83:0/2237233103 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2440007d20 con 0x55f7a9d055d0 2024-04-01T06:56:48.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.224+0000 7f2433fff700 1 -- 172.21.15.83:0/2237233103 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2440015380 con 0x55f7a9d055d0 2024-04-01T06:56:48.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.225+0000 7f245c1ebb80 1 -- 172.21.15.83:0/2237233103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7a9d055d0 msgr2=0x55f7a9d059b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:48.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.225+0000 7f245c1ebb80 1 --2- 172.21.15.83:0/2237233103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7a9d055d0 0x55f7a9d059b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f244000e4d0 tx=0x7f244000e7e0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.226+0000 7f245c1ebb80 1 -- 172.21.15.83:0/2237233103 shutdown_connections 2024-04-01T06:56:48.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.226+0000 7f245c1ebb80 1 --2- 172.21.15.83:0/2237233103 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f7a9d10df0 0x55f7a9d131e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.226+0000 7f245c1ebb80 1 --2- 172.21.15.83:0/2237233103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7a9d055d0 0x55f7a9d059b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.226+0000 7f245c1ebb80 1 --2- 172.21.15.83:0/2237233103 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f7a9d05ef0 0x55f7a9d108b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.226+0000 7f245c1ebb80 1 -- 172.21.15.83:0/2237233103 >> 172.21.15.83:0/2237233103 conn(0x55f7a9c656a0 msgr2=0x55f7a9d01a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:48.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.227+0000 7f244e5f2700 1 --2- 172.21.15.83:0/3276722538 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f24340a14b0 0x7f24340a3970 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f244001d000 tx=0x7f2440015a40 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:48.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.227+0000 7f245c1ebb80 1 -- 172.21.15.83:0/2237233103 shutdown_connections 2024-04-01T06:56:48.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.227+0000 7f245c1ebb80 1 -- 172.21.15.83:0/2237233103 wait complete. 2024-04-01T06:56:48.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.228+0000 7f245c1ebb80 1 -- start start 2024-04-01T06:56:48.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.228+0000 7f245c1ebb80 1 Processor -- start 2024-04-01T06:56:48.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.229+0000 7f245c1ebb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f7a9d055d0 0x55f7a9d10660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:48.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.229+0000 7f245c1ebb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7a9d05ef0 0x55f7a9d0d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:48.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.229+0000 7f245c1ebb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f7a9d10df0 0x55f7a9d0de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:48.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.229+0000 7f245c1ebb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7a9bf3d80 con 0x55f7a9d055d0 2024-04-01T06:56:48.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.229+0000 7f245c1ebb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7a9bf3a20 con 0x55f7a9d10df0 2024-04-01T06:56:48.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.229+0000 7f245c1ebb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7a9adb6a0 con 0x55f7a9d05ef0 2024-04-01T06:56:48.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.229+0000 7f245c1ebb80 10 client.0 _ll_register_callbacks cb 0x55f7a9bfd470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:56:48.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.229+0000 7f244ddf1700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f7a9d055d0 0x55f7a9d10660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:48.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.229+0000 7f244ddf1700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f7a9d055d0 0x55f7a9d10660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58072/0 (socket says 172.21.15.83:58072) 2024-04-01T06:56:48.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.229+0000 7f244e5f2700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f7a9d10df0 0x55f7a9d0de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:48.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.229+0000 7f244ddf1700 1 -- 172.21.15.83:0/1182071843 learned_addr learned my addr 172.21.15.83:0/1182071843 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:48.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.230+0000 7f244d5f0700 1 --2- 172.21.15.83:0/1182071843 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7a9d05ef0 0x55f7a9d0d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:48.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.230+0000 7f244e5f2700 1 -- 172.21.15.83:0/1182071843 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7a9d05ef0 msgr2=0x55f7a9d0d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:48.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.230+0000 7f244e5f2700 1 --2- 172.21.15.83:0/1182071843 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7a9d05ef0 0x55f7a9d0d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.230+0000 7f244e5f2700 1 -- 172.21.15.83:0/1182071843 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f7a9d055d0 msgr2=0x55f7a9d10660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:48.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.230+0000 7f244e5f2700 1 --2- 172.21.15.83:0/1182071843 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f7a9d055d0 0x55f7a9d10660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.230+0000 7f244e5f2700 1 -- 172.21.15.83:0/1182071843 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f244000e0c0 con 0x55f7a9d10df0 2024-04-01T06:56:48.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.230+0000 7f244d5f0700 1 --2- 172.21.15.83:0/1182071843 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7a9d05ef0 0x55f7a9d0d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:56:48.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.230+0000 7f244e5f2700 1 --2- 172.21.15.83:0/1182071843 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f7a9d10df0 0x55f7a9d0de70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f244000e4a0 tx=0x7f2440022070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce46346e0d22d5df server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:48.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.230+0000 7f24317fa700 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-04-01T06:56:48.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.230+0000 7f24317fa700 1 -- 172.21.15.83:0/1182071843 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2440010030 con 0x55f7a9d10df0 2024-04-01T06:56:48.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.230+0000 7f24317fa700 1 -- 172.21.15.83:0/1182071843 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f2440011070 con 0x55f7a9d10df0 2024-04-01T06:56:48.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.230+0000 7f245c1ebb80 1 -- 172.21.15.83:0/1182071843 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f7a9c18380 con 0x55f7a9d10df0 2024-04-01T06:56:48.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.230+0000 7f24317fa700 1 -- 172.21.15.83:0/1182071843 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2440015380 con 0x55f7a9d10df0 2024-04-01T06:56:48.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.230+0000 7f245c1ebb80 10 client.25199 fetch_fsmap learned FSMap version 24 2024-04-01T06:56:48.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.230+0000 7f245c1ebb80 1 -- 172.21.15.83:0/1182071843 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55f7a9a85b60 con 0x55f7a9d10df0 2024-04-01T06:56:48.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.231+0000 7f24317fa700 1 -- 172.21.15.83:0/1182071843 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f7a9c18380 con 0x55f7a9d10df0 2024-04-01T06:56:48.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.231+0000 7f24317fa700 1 -- 172.21.15.83:0/1182071843 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f244000e500 con 0x55f7a9d10df0 2024-04-01T06:56:48.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.232+0000 7f245c1ebb80 10 client.25199 fetch_fsmap finished waiting for FSMap version 24 2024-04-01T06:56:48.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.232+0000 7f245c1ebb80 10 client.25199 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-01T06:56:48.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.232+0000 7f245c1ebb80 20 client.25199 populate_metadata read hostname 'smithi083' 2024-04-01T06:56:48.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.232+0000 7f245c1ebb80 1 --2- 172.21.15.83:0/1182071843 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55f7a9d20740 0x55f7a9d22b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:48.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.232+0000 7f245c1ebb80 4 client.25199 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-01T06:56:48.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.232+0000 7f245c1ebb80 1 -- 172.21.15.83:0/1182071843 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f7a9c50700 con 0x55f7a9d20740 2024-04-01T06:56:48.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.232+0000 7f244ddf1700 1 --2- 172.21.15.83:0/1182071843 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55f7a9d20740 0x55f7a9d22b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:48.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.232+0000 7f24317fa700 10 client.25199 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:56:48.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.232+0000 7f244ddf1700 1 --2- 172.21.15.83:0/1182071843 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55f7a9d20740 0x55f7a9d22b60 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dbcb564695f0b778 server_cookie=8b8e13160ad8210d in_seq=0 out_seq=0 2024-04-01T06:56:48.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.233+0000 7f24317fa700 1 -- 172.21.15.83:0/1182071843 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f7a9c50700 con 0x55f7a9d20740 2024-04-01T06:56:48.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.233+0000 7f24317fa700 10 client.25199 handle_command_reply: tid=0 2024-04-01T06:56:48.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.233+0000 7f245c1ebb80 1 client.25199 shutdown 2024-04-01T06:56:48.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.233+0000 7f245c1ebb80 1 -- 172.21.15.83:0/1182071843 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f7a9d10df0 msgr2=0x55f7a9d0de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:48.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.233+0000 7f245c1ebb80 1 --2- 172.21.15.83:0/1182071843 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f7a9d10df0 0x55f7a9d0de70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f244000e4a0 tx=0x7f2440022070 comp rx=0 tx=0).stop 2024-04-01T06:56:48.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.233+0000 7f245c1ebb80 1 -- 172.21.15.83:0/1182071843 shutdown_connections 2024-04-01T06:56:48.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.233+0000 7f245c1ebb80 1 --2- 172.21.15.83:0/1182071843 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55f7a9d20740 0x55f7a9d22b60 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.233+0000 7f245c1ebb80 1 --2- 172.21.15.83:0/1182071843 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f7a9d055d0 0x55f7a9d10660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.233+0000 7f245c1ebb80 1 --2- 172.21.15.83:0/1182071843 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f7a9d10df0 0x55f7a9d0de70 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.233+0000 7f245c1ebb80 1 --2- 172.21.15.83:0/1182071843 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7a9d05ef0 0x55f7a9d0d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.233+0000 7f245c1ebb80 1 -- 172.21.15.83:0/1182071843 >> 172.21.15.83:0/1182071843 conn(0x55f7a9c656a0 msgr2=0x55f7a9d076c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:48.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.233+0000 7f24317fa700 0 client.25199 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:56:48.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.234+0000 7f245c1ebb80 1 -- 172.21.15.83:0/1182071843 shutdown_connections 2024-04-01T06:56:48.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.234+0000 7f245c1ebb80 1 -- 172.21.15.83:0/1182071843 wait complete. 2024-04-01T06:56:48.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.235+0000 7f245c1ebb80 20 client.25199 trim_cache size 0 max 16384 2024-04-01T06:56:48.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.251+0000 7f245c1ebb80 1 Processor -- start 2024-04-01T06:56:48.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.251+0000 7f245c1ebb80 1 -- start start 2024-04-01T06:56:48.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.251+0000 7f245c1ebb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f7a9d055d0 0x55f7a9d17b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:48.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.251+0000 7f245c1ebb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7a9d05ef0 0x55f7a9d10190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:48.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.252+0000 7f245c1ebb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f7a9d10df0 0x55f7a9d0c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:48.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.252+0000 7f245c1ebb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7a9d1d3e0 con 0x55f7a9d10df0 2024-04-01T06:56:48.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.252+0000 7f245c1ebb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7a9d0ef50 con 0x55f7a9d055d0 2024-04-01T06:56:48.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.252+0000 7f245c1ebb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7a9d062d0 con 0x55f7a9d05ef0 2024-04-01T06:56:48.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.252+0000 7f244e5f2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f7a9d10df0 0x55f7a9d0c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:48.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.252+0000 7f244e5f2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f7a9d10df0 0x55f7a9d0c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58084/0 (socket says 172.21.15.83:58084) 2024-04-01T06:56:48.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.252+0000 7f244e5f2700 1 -- 172.21.15.83:0/497439927 learned_addr learned my addr 172.21.15.83:0/497439927 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:48.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.252+0000 7f244ddf1700 1 --2- 172.21.15.83:0/497439927 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f7a9d055d0 0x55f7a9d17b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:48.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.252+0000 7f244e5f2700 1 -- 172.21.15.83:0/497439927 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7a9d05ef0 msgr2=0x55f7a9d10190 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-01T06:56:48.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.252+0000 7f244e5f2700 1 --2- 172.21.15.83:0/497439927 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7a9d05ef0 0x55f7a9d10190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.252+0000 7f244e5f2700 1 -- 172.21.15.83:0/497439927 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f7a9d055d0 msgr2=0x55f7a9d17b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:48.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.252+0000 7f244e5f2700 1 --2- 172.21.15.83:0/497439927 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f7a9d055d0 0x55f7a9d17b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.252+0000 7f244e5f2700 1 -- 172.21.15.83:0/497439927 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f7a9c1dea0 con 0x55f7a9d10df0 2024-04-01T06:56:48.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.252+0000 7f244e5f2700 1 --2- 172.21.15.83:0/497439927 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f7a9d10df0 0x55f7a9d0c200 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f2440015e40 tx=0x7f2440009740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73692839abfccbbf server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:48.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.252+0000 7f243cff9700 1 -- 172.21.15.83:0/497439927 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2440010070 con 0x55f7a9d10df0 2024-04-01T06:56:48.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.253+0000 7f243cff9700 1 -- 172.21.15.83:0/497439927 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2440007e90 con 0x55f7a9d10df0 2024-04-01T06:56:48.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.253+0000 7f243cff9700 1 -- 172.21.15.83:0/497439927 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24400077f0 con 0x55f7a9d10df0 2024-04-01T06:56:48.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.253+0000 7f245c1ebb80 1 -- 172.21.15.83:0/497439927 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f7a9d10df0 msgr2=0x55f7a9d0c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:48.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.253+0000 7f245c1ebb80 1 --2- 172.21.15.83:0/497439927 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f7a9d10df0 0x55f7a9d0c200 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f2440015e40 tx=0x7f2440009740 comp rx=0 tx=0).stop 2024-04-01T06:56:48.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.253+0000 7f245c1ebb80 1 -- 172.21.15.83:0/497439927 shutdown_connections 2024-04-01T06:56:48.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.253+0000 7f245c1ebb80 1 --2- 172.21.15.83:0/497439927 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f7a9d10df0 0x55f7a9d0c200 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.253+0000 7f245c1ebb80 1 --2- 172.21.15.83:0/497439927 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f7a9d055d0 0x55f7a9d17b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.253+0000 7f245c1ebb80 1 --2- 172.21.15.83:0/497439927 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7a9d05ef0 0x55f7a9d10190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.253+0000 7f245c1ebb80 1 -- 172.21.15.83:0/497439927 >> 172.21.15.83:0/497439927 conn(0x55f7a9c656a0 msgr2=0x55f7a9cfaf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:48.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.253+0000 7f245c1ebb80 1 -- 172.21.15.83:0/497439927 shutdown_connections 2024-04-01T06:56:48.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.253+0000 7f245c1ebb80 1 -- 172.21.15.83:0/497439927 wait complete. 2024-04-01T06:56:48.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.254+0000 7f245c1ebb80 1 -- start start 2024-04-01T06:56:48.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.254+0000 7f245c1ebb80 1 Processor -- start 2024-04-01T06:56:48.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.254+0000 7f245c1ebb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f7a9d055d0 0x55f7a9d159d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:48.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.254+0000 7f245c1ebb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7a9d05ef0 0x55f7a9d15f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:48.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.254+0000 7f245c1ebb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f7a9d10df0 0x55f7a9d73530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:48.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.254+0000 7f245c1ebb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7a9d166a0 con 0x55f7a9d10df0 2024-04-01T06:56:48.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.254+0000 7f245c1ebb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7a9d73aa0 con 0x55f7a9d055d0 2024-04-01T06:56:48.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.254+0000 7f245c1ebb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7a9d73c60 con 0x55f7a9d05ef0 2024-04-01T06:56:48.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.254+0000 7f245c1ebb80 10 client.0 _ll_register_callbacks cb 0x55f7a9bfd470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:56:48.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.255+0000 7f244e5f2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f7a9d10df0 0x55f7a9d73530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:48.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.255+0000 7f244e5f2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f7a9d10df0 0x55f7a9d73530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58090/0 (socket says 172.21.15.83:58090) 2024-04-01T06:56:48.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.255+0000 7f244e5f2700 1 -- 172.21.15.83:0/1578474148 learned_addr learned my addr 172.21.15.83:0/1578474148 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:48.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.255+0000 7f244e5f2700 1 -- 172.21.15.83:0/1578474148 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7a9d05ef0 msgr2=0x55f7a9d15f10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-01T06:56:48.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.255+0000 7f244e5f2700 1 --2- 172.21.15.83:0/1578474148 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7a9d05ef0 0x55f7a9d15f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.255+0000 7f244e5f2700 1 -- 172.21.15.83:0/1578474148 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f7a9d055d0 msgr2=0x55f7a9d159d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-01T06:56:48.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.255+0000 7f244e5f2700 1 --2- 172.21.15.83:0/1578474148 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f7a9d055d0 0x55f7a9d159d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.255+0000 7f244e5f2700 1 -- 172.21.15.83:0/1578474148 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f7a9a85b60 con 0x55f7a9d10df0 2024-04-01T06:56:48.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.255+0000 7f244e5f2700 1 --2- 172.21.15.83:0/1578474148 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f7a9d10df0 0x55f7a9d73530 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f244000e4a0 tx=0x7f2440016ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d117b5d812eb7f67 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:48.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.255+0000 7f24317fa700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:56:48.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.255+0000 7f24317fa700 1 -- 172.21.15.83:0/1578474148 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2440010070 con 0x55f7a9d10df0 2024-04-01T06:56:48.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.255+0000 7f24317fa700 1 -- 172.21.15.83:0/1578474148 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f2440016900 con 0x55f7a9d10df0 2024-04-01T06:56:48.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.255+0000 7f245c1ebb80 1 -- 172.21.15.83:0/1578474148 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2440007d20 con 0x55f7a9d10df0 2024-04-01T06:56:48.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.256+0000 7f24317fa700 1 -- 172.21.15.83:0/1578474148 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2440007500 con 0x55f7a9d10df0 2024-04-01T06:56:48.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.256+0000 7f245c1ebb80 10 client.15693 fetch_fsmap learned FSMap version 24 2024-04-01T06:56:48.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.256+0000 7f245c1ebb80 1 -- 172.21.15.83:0/1578474148 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55f7a9addcd0 con 0x55f7a9d10df0 2024-04-01T06:56:48.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.256+0000 7f24317fa700 1 -- 172.21.15.83:0/1578474148 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2440007d20 con 0x55f7a9d10df0 2024-04-01T06:56:48.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.257+0000 7f24317fa700 1 -- 172.21.15.83:0/1578474148 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f244003fca0 con 0x55f7a9d10df0 2024-04-01T06:56:48.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.257+0000 7f245c1ebb80 10 client.15693 fetch_fsmap finished waiting for FSMap version 24 2024-04-01T06:56:48.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.257+0000 7f245c1ebb80 10 client.15693 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-01T06:56:48.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.257+0000 7f245c1ebb80 20 client.15693 populate_metadata read hostname 'smithi083' 2024-04-01T06:56:48.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.257+0000 7f245c1ebb80 1 --2- 172.21.15.83:0/1578474148 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55f7a9d75050 0x55f7a9d77440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:48.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.257+0000 7f245c1ebb80 4 client.15693 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-01T06:56:48.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.257+0000 7f245c1ebb80 1 -- 172.21.15.83:0/1578474148 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f7a9aa6cf0 con 0x55f7a9d75050 2024-04-01T06:56:48.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.257+0000 7f244ddf1700 1 --2- 172.21.15.83:0/1578474148 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55f7a9d75050 0x55f7a9d77440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:48.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.257+0000 7f24317fa700 10 client.15693 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:56:48.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.257+0000 7f244ddf1700 1 --2- 172.21.15.83:0/1578474148 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55f7a9d75050 0x55f7a9d77440 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3a2d2fbbf0ab64c server_cookie=e0f0a27d28b8a800 in_seq=0 out_seq=0 2024-04-01T06:56:48.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.258+0000 7f24317fa700 1 -- 172.21.15.83:0/1578474148 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55f7a9aa6cf0 con 0x55f7a9d75050 2024-04-01T06:56:48.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.258+0000 7f24317fa700 10 client.15693 handle_command_reply: tid=0 2024-04-01T06:56:48.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.258+0000 7f245c1ebb80 1 client.15693 shutdown 2024-04-01T06:56:48.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.258+0000 7f245c1ebb80 1 -- 172.21.15.83:0/1578474148 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f7a9d10df0 msgr2=0x55f7a9d73530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:48.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.258+0000 7f245c1ebb80 1 --2- 172.21.15.83:0/1578474148 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f7a9d10df0 0x55f7a9d73530 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f244000e4a0 tx=0x7f2440016ec0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.258+0000 7f245c1ebb80 1 -- 172.21.15.83:0/1578474148 shutdown_connections 2024-04-01T06:56:48.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.258+0000 7f245c1ebb80 1 --2- 172.21.15.83:0/1578474148 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55f7a9d75050 0x55f7a9d77440 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.258+0000 7f245c1ebb80 1 --2- 172.21.15.83:0/1578474148 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f7a9d10df0 0x55f7a9d73530 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.258+0000 7f24317fa700 0 client.15693 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:56:48.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.258+0000 7f245c1ebb80 1 --2- 172.21.15.83:0/1578474148 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f7a9d055d0 0x55f7a9d159d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.258+0000 7f245c1ebb80 1 --2- 172.21.15.83:0/1578474148 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f7a9d05ef0 0x55f7a9d15f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.258+0000 7f245c1ebb80 1 -- 172.21.15.83:0/1578474148 >> 172.21.15.83:0/1578474148 conn(0x55f7a9c656a0 msgr2=0x55f7a9d0c140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:48.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.258+0000 7f245c1ebb80 1 -- 172.21.15.83:0/1578474148 shutdown_connections 2024-04-01T06:56:48.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.258+0000 7f245c1ebb80 1 -- 172.21.15.83:0/1578474148 wait complete. 2024-04-01T06:56:48.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.258+0000 7f245c1ebb80 20 client.15693 trim_cache size 0 max 16384 2024-04-01T06:56:48.262 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-04-01T06:56:48.262 INFO:teuthology.orchestra.run.smithi083.stdout: "status": "no active scrubs running", 2024-04-01T06:56:48.262 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubs": {} 2024-04-01T06:56:48.262 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-04-01T06:56:48.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.259+0000 7f2450055700 1 -- 172.21.15.83:0/3276722538 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f24340a14b0 msgr2=0x7f24340a3970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:48.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.259+0000 7f2450055700 1 --2- 172.21.15.83:0/3276722538 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f24340a14b0 0x7f24340a3970 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f244001d000 tx=0x7f2440015a40 comp rx=0 tx=0).stop 2024-04-01T06:56:48.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.259+0000 7f2450055700 1 -- 172.21.15.83:0/3276722538 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f24480ffe70 msgr2=0x7f24480724b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:48.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.259+0000 7f2450055700 1 --2- 172.21.15.83:0/3276722538 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f24480ffe70 0x7f24480724b0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f2444005910 tx=0x7f2444009570 comp rx=0 tx=0).stop 2024-04-01T06:56:48.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.259+0000 7f2450055700 1 -- 172.21.15.83:0/3276722538 shutdown_connections 2024-04-01T06:56:48.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.259+0000 7f2450055700 1 --2- 172.21.15.83:0/3276722538 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f24340a14b0 0x7f24340a3970 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.259+0000 7f2450055700 1 --2- 172.21.15.83:0/3276722538 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f24480ffe70 0x7f24480724b0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.259+0000 7f2450055700 1 --2- 172.21.15.83:0/3276722538 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f244806b450 0x7f244806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.259+0000 7f2450055700 1 --2- 172.21.15.83:0/3276722538 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2448104f90 0x7f24480729f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.259+0000 7f2450055700 1 -- 172.21.15.83:0/3276722538 >> 172.21.15.83:0/3276722538 conn(0x7f2448076d80 msgr2=0x7f2448106110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:48.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.259+0000 7f2450055700 1 -- 172.21.15.83:0/3276722538 shutdown_connections 2024-04-01T06:56:48.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.259+0000 7f2450055700 1 -- 172.21.15.83:0/3276722538 wait complete. 2024-04-01T06:56:48.274 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-01T06:56:48.275 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T06:56:48.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.399+0000 7f71a5d85700 1 -- 172.21.15.83:0/250171241 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f71a00ffae0 msgr2=0x7f71a00fff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:48.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.399+0000 7f71a5d85700 1 --2- 172.21.15.83:0/250171241 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f71a00ffae0 0x7f71a00fff60 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f7194009990 tx=0x7f7194009ca0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.400+0000 7f71a5d85700 1 -- 172.21.15.83:0/250171241 shutdown_connections 2024-04-01T06:56:48.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.400+0000 7f71a5d85700 1 --2- 172.21.15.83:0/250171241 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f71a01004a0 0x7f71a010c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.400+0000 7f71a5d85700 1 --2- 172.21.15.83:0/250171241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71a0105b80 0x7f71a0105f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.400+0000 7f71a5d85700 1 --2- 172.21.15.83:0/250171241 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f71a00ffae0 0x7f71a00fff60 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.400+0000 7f71a5d85700 1 -- 172.21.15.83:0/250171241 >> 172.21.15.83:0/250171241 conn(0x7f71a00fb5f0 msgr2=0x7f71a00fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:48.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.400+0000 7f71a5d85700 1 -- 172.21.15.83:0/250171241 shutdown_connections 2024-04-01T06:56:48.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.400+0000 7f71a5d85700 1 -- 172.21.15.83:0/250171241 wait complete. 2024-04-01T06:56:48.401 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.400+0000 7f71a5d85700 1 Processor -- start 2024-04-01T06:56:48.402 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.401+0000 7f71a5d85700 1 -- start start 2024-04-01T06:56:48.402 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.401+0000 7f71a5d85700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71a00ffae0 0x7f71a0194e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:48.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.401+0000 7f71a5d85700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f71a01004a0 0x7f71a0195350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:48.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.401+0000 7f71a5d85700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f71a0105b80 0x7f71a01996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:48.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.401+0000 7f71a5d85700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a0199d30 con 0x7f71a01004a0 2024-04-01T06:56:48.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.401+0000 7f71a5d85700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a0199ea0 con 0x7f71a0105b80 2024-04-01T06:56:48.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.401+0000 7f71a5d85700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a019a060 con 0x7f71a00ffae0 2024-04-01T06:56:48.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.401+0000 7f719f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71a00ffae0 0x7f71a0194e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:48.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.401+0000 7f719effd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f71a01004a0 0x7f71a0195350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:48.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.401+0000 7f719f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71a00ffae0 0x7f71a0194e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.83:54148/0 (socket says 172.21.15.83:54148) 2024-04-01T06:56:48.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.401+0000 7f719f7fe700 1 -- 172.21.15.83:0/1392698269 learned_addr learned my addr 172.21.15.83:0/1392698269 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:48.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.401+0000 7f719ffff700 1 --2- 172.21.15.83:0/1392698269 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f71a0105b80 0x7f71a01996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:48.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.401+0000 7f719effd700 1 -- 172.21.15.83:0/1392698269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71a00ffae0 msgr2=0x7f71a0194e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:48.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.401+0000 7f719effd700 1 --2- 172.21.15.83:0/1392698269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71a00ffae0 0x7f71a0194e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.401+0000 7f719effd700 1 -- 172.21.15.83:0/1392698269 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f71a0105b80 msgr2=0x7f71a01996f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:48.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.401+0000 7f719effd700 1 --2- 172.21.15.83:0/1392698269 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f71a0105b80 0x7f71a01996f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.402+0000 7f719effd700 1 -- 172.21.15.83:0/1392698269 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71940095f0 con 0x7f71a01004a0 2024-04-01T06:56:48.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.402+0000 7f719f7fe700 1 --2- 172.21.15.83:0/1392698269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71a00ffae0 0x7f71a0194e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T06:56:48.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.402+0000 7f719ffff700 1 --2- 172.21.15.83:0/1392698269 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f71a0105b80 0x7f71a01996f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T06:56:48.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.402+0000 7f719effd700 1 --2- 172.21.15.83:0/1392698269 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f71a01004a0 0x7f71a0195350 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f71940059d0 tx=0x7f7194004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:48.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.402+0000 7f719cff9700 1 -- 172.21.15.83:0/1392698269 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719401d070 con 0x7f71a01004a0 2024-04-01T06:56:48.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.402+0000 7f71a5d85700 1 -- 172.21.15.83:0/1392698269 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71a019a2e0 con 0x7f71a01004a0 2024-04-01T06:56:48.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.402+0000 7f719cff9700 1 -- 172.21.15.83:0/1392698269 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7194022470 con 0x7f71a01004a0 2024-04-01T06:56:48.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.402+0000 7f719cff9700 1 -- 172.21.15.83:0/1392698269 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7194017650 con 0x7f71a01004a0 2024-04-01T06:56:48.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.402+0000 7f71a5d85700 1 -- 172.21.15.83:0/1392698269 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71a01a1b80 con 0x7f71a01004a0 2024-04-01T06:56:48.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.404+0000 7f71a5d85700 1 -- 172.21.15.83:0/1392698269 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71a0108070 con 0x7f71a01004a0 2024-04-01T06:56:48.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.404+0000 7f719cff9700 1 -- 172.21.15.83:0/1392698269 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) v1 ==== 136098+0+0 (secure 0 0 0) 0x7f71940225e0 con 0x7f71a01004a0 2024-04-01T06:56:48.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.405+0000 7f719cff9700 1 --2- 172.21.15.83:0/1392698269 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f71880a1430 0x7f71880a38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:48.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.405+0000 7f719cff9700 1 -- 172.21.15.83:0/1392698269 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f71940d53b0 con 0x7f71a01004a0 2024-04-01T06:56:48.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.406+0000 7f719f7fe700 1 --2- 172.21.15.83:0/1392698269 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f71880a1430 0x7f71880a38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:48.406 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.406+0000 7f719f7fe700 1 --2- 172.21.15.83:0/1392698269 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f71880a1430 0x7f71880a38f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7190011550 tx=0x7f7190009260 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:48.409 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.409+0000 7f719cff9700 1 -- 172.21.15.83:0/1392698269 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f7194097080 con 0x7f71a01004a0 2024-04-01T06:56:48.704 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.704+0000 7fe128cde700 1 -- 172.21.15.83:0/3972093314 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe1240694b0 msgr2=0x7fe124069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:48.704 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.704+0000 7fe128cde700 1 --2- 172.21.15.83:0/3972093314 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe1240694b0 0x7fe124069930 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fe118009990 tx=0x7fe118009ca0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.704 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.704+0000 7fe128cde700 1 -- 172.21.15.83:0/3972093314 shutdown_connections 2024-04-01T06:56:48.704 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.704+0000 7fe128cde700 1 --2- 172.21.15.83:0/3972093314 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe12410d720 0x7fe12410fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.704 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.704+0000 7fe128cde700 1 --2- 172.21.15.83:0/3972093314 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe124101be0 0x7fe124068f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.704 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.704+0000 7fe128cde700 1 --2- 172.21.15.83:0/3972093314 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe1240694b0 0x7fe124069930 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.704 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.704+0000 7fe128cde700 1 -- 172.21.15.83:0/3972093314 >> 172.21.15.83:0/3972093314 conn(0x7fe124076a20 msgr2=0x7fe124076e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:48.704 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.704+0000 7fe128cde700 1 -- 172.21.15.83:0/3972093314 shutdown_connections 2024-04-01T06:56:48.704 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.704+0000 7fe128cde700 1 -- 172.21.15.83:0/3972093314 wait complete. 2024-04-01T06:56:48.706 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.705+0000 7fe128cde700 1 Processor -- start 2024-04-01T06:56:48.706 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.705+0000 7fe128cde700 1 -- start start 2024-04-01T06:56:48.706 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.705+0000 7fe128cde700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe1240694b0 0x7fe124199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:48.707 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.705+0000 7fe128cde700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe124101be0 0x7fe1241998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:48.707 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.705+0000 7fe128cde700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe12410d720 0x7fe12419dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:48.707 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.705+0000 7fe128cde700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe12419e2a0 con 0x7fe1240694b0 2024-04-01T06:56:48.707 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.705+0000 7fe128cde700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe12419e410 con 0x7fe12410d720 2024-04-01T06:56:48.707 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.705+0000 7fe128cde700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe12419e5d0 con 0x7fe124101be0 2024-04-01T06:56:48.707 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.705+0000 7fe12259c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe1240694b0 0x7fe124199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:48.707 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.705+0000 7fe12259c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe1240694b0 0x7fe124199380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58140/0 (socket says 172.21.15.83:58140) 2024-04-01T06:56:48.707 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.705+0000 7fe12259c700 1 -- 172.21.15.83:0/625531917 learned_addr learned my addr 172.21.15.83:0/625531917 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:48.707 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.705+0000 7fe122d9d700 1 --2- 172.21.15.83:0/625531917 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe12410d720 0x7fe12419dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:48.707 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.706+0000 7fe12259c700 1 -- 172.21.15.83:0/625531917 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe124101be0 msgr2=0x7fe1241998c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-01T06:56:48.707 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.706+0000 7fe12259c700 1 --2- 172.21.15.83:0/625531917 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe124101be0 0x7fe1241998c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.707 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.706+0000 7fe12259c700 1 -- 172.21.15.83:0/625531917 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe12410d720 msgr2=0x7fe12419dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:48.707 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.706+0000 7fe12259c700 1 --2- 172.21.15.83:0/625531917 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe12410d720 0x7fe12419dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.707 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.706+0000 7fe12259c700 1 -- 172.21.15.83:0/625531917 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1180095f0 con 0x7fe1240694b0 2024-04-01T06:56:48.708 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.706+0000 7fe12259c700 1 --2- 172.21.15.83:0/625531917 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe1240694b0 0x7fe124199380 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fe11400e9a0 tx=0x7fe11400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:48.708 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.706+0000 7fe1137fe700 1 -- 172.21.15.83:0/625531917 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe114009790 con 0x7fe1240694b0 2024-04-01T06:56:48.708 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.706+0000 7fe1137fe700 1 -- 172.21.15.83:0/625531917 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe11400cbd0 con 0x7fe1240694b0 2024-04-01T06:56:48.708 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.706+0000 7fe128cde700 1 -- 172.21.15.83:0/625531917 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe12419e8b0 con 0x7fe1240694b0 2024-04-01T06:56:48.708 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.706+0000 7fe1137fe700 1 -- 172.21.15.83:0/625531917 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe114018680 con 0x7fe1240694b0 2024-04-01T06:56:48.708 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.706+0000 7fe128cde700 1 -- 172.21.15.83:0/625531917 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1241a60f0 con 0x7fe1240694b0 2024-04-01T06:56:48.709 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.710+0000 7fe1137fe700 1 -- 172.21.15.83:0/625531917 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) v1 ==== 136098+0+0 (secure 0 0 0) 0x7fe1140187e0 con 0x7fe1240694b0 2024-04-01T06:56:48.710 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.710+0000 7fe1137fe700 1 --2- 172.21.15.83:0/625531917 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fe10c0a13b0 0x7fe10c0a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:48.710 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.711+0000 7fe1137fe700 1 -- 172.21.15.83:0/625531917 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8425+0+0 (secure 0 0 0) 0x7fe1140d2060 con 0x7fe1240694b0 2024-04-01T06:56:48.710 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.711+0000 7fe134e74b80 1 Processor -- start 2024-04-01T06:56:48.711 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.711+0000 7fe134e74b80 1 -- start start 2024-04-01T06:56:48.711 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.711+0000 7fe134e74b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e5226a3100 0x55e5226a34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:48.712 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.711+0000 7fe134e74b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e5226a3a20 0x55e5226ae390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:48.712 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.711+0000 7fe134e74b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e5226ae8d0 0x55e5226b0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:48.712 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.711+0000 7fe134e74b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5225fc930 con 0x55e5226ae8d0 2024-04-01T06:56:48.712 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.711+0000 7fe134e74b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5225fa2f0 con 0x55e5226a3100 2024-04-01T06:56:48.712 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.711+0000 7fe134e74b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5225f5be0 con 0x55e5226a3a20 2024-04-01T06:56:48.712 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.712+0000 7fe12259c700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e5226a3100 0x55e5226a34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:48.712 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.712+0000 7fe122d9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e5226ae8d0 0x55e5226b0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:48.712 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.712+0000 7fe122d9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e5226ae8d0 0x55e5226b0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58142/0 (socket says 172.21.15.83:58142) 2024-04-01T06:56:48.712 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.712+0000 7fe122d9d700 1 -- 172.21.15.83:0/2090584109 learned_addr learned my addr 172.21.15.83:0/2090584109 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:48.713 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.712+0000 7fe122d9d700 1 -- 172.21.15.83:0/2090584109 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e5226a3a20 msgr2=0x55e5226ae390 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-01T06:56:48.713 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.712+0000 7fe122d9d700 1 --2- 172.21.15.83:0/2090584109 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e5226a3a20 0x55e5226ae390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.713 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.712+0000 7fe122d9d700 1 -- 172.21.15.83:0/2090584109 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e5226a3100 msgr2=0x55e5226a34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:48.713 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.712+0000 7fe122d9d700 1 --2- 172.21.15.83:0/2090584109 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e5226a3100 0x55e5226a34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.713 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.712+0000 7fe122d9d700 1 -- 172.21.15.83:0/2090584109 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e522477350 con 0x55e5226ae8d0 2024-04-01T06:56:48.713 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.712+0000 7fe122d9d700 1 --2- 172.21.15.83:0/2090584109 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e5226ae8d0 0x55e5226b0cc0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fe11c011600 tx=0x7fe11c009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d057cf54287d507a server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:48.713 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.713+0000 7fe110ff9700 1 -- 172.21.15.83:0/2090584109 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11c00e040 con 0x55e5226ae8d0 2024-04-01T06:56:48.713 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.713+0000 7fe110ff9700 1 -- 172.21.15.83:0/2090584109 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe11c00f040 con 0x55e5226ae8d0 2024-04-01T06:56:48.713 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.713+0000 7fe110ff9700 1 -- 172.21.15.83:0/2090584109 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11c004830 con 0x55e5226ae8d0 2024-04-01T06:56:48.714 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.714+0000 7fe134e74b80 1 -- 172.21.15.83:0/2090584109 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e5226ae8d0 msgr2=0x55e5226b0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:48.714 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.714+0000 7fe134e74b80 1 --2- 172.21.15.83:0/2090584109 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e5226ae8d0 0x55e5226b0cc0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fe11c011600 tx=0x7fe11c009920 comp rx=0 tx=0).stop 2024-04-01T06:56:48.714 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.714+0000 7fe134e74b80 1 -- 172.21.15.83:0/2090584109 shutdown_connections 2024-04-01T06:56:48.714 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.714+0000 7fe134e74b80 1 --2- 172.21.15.83:0/2090584109 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e5226ae8d0 0x55e5226b0cc0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.714 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.714+0000 7fe134e74b80 1 --2- 172.21.15.83:0/2090584109 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e5226a3100 0x55e5226a34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.714 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.714+0000 7fe134e74b80 1 --2- 172.21.15.83:0/2090584109 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e5226a3a20 0x55e5226ae390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.714 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.714+0000 7fe134e74b80 1 -- 172.21.15.83:0/2090584109 >> 172.21.15.83:0/2090584109 conn(0x55e522603640 msgr2=0x55e52269f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:48.717 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.717+0000 7fe134e74b80 1 -- 172.21.15.83:0/2090584109 shutdown_connections 2024-04-01T06:56:48.717 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.717+0000 7fe121d9b700 1 --2- 172.21.15.83:0/625531917 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fe10c0a13b0 0x7fe10c0a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:48.717 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.717+0000 7fe134e74b80 1 -- 172.21.15.83:0/2090584109 wait complete. 2024-04-01T06:56:48.717 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.717+0000 7fe134e74b80 1 -- start start 2024-04-01T06:56:48.717 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.718+0000 7fe134e74b80 1 Processor -- start 2024-04-01T06:56:48.718 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.718+0000 7fe134e74b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e5226a3100 0x55e5226ab7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:48.719 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.718+0000 7fe134e74b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e5226ae8d0 0x55e5226abd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:48.719 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.718+0000 7fe134e74b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e5226ac250 0x55e5226ba6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:48.719 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.718+0000 7fe134e74b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e522591d20 con 0x55e5226a3100 2024-04-01T06:56:48.719 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.718+0000 7fe134e74b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5225919c0 con 0x55e5226ae8d0 2024-04-01T06:56:48.719 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.718+0000 7fe134e74b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e522479640 con 0x55e5226ac250 2024-04-01T06:56:48.719 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.718+0000 7fe134e74b80 10 client.0 _ll_register_callbacks cb 0x55e52259b410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:56:48.719 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.718+0000 7fe122d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e5226ac250 0x55e5226ba6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:48.719 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.718+0000 7fe122d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e5226ac250 0x55e5226ba6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.83:54166/0 (socket says 172.21.15.83:54166) 2024-04-01T06:56:48.719 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.718+0000 7fe122d9d700 1 -- 172.21.15.83:0/2125891776 learned_addr learned my addr 172.21.15.83:0/2125891776 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:48.719 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.719+0000 7fe122d9d700 1 -- 172.21.15.83:0/2125891776 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e5226ae8d0 msgr2=0x55e5226abd10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-01T06:56:48.719 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.719+0000 7fe122d9d700 1 --2- 172.21.15.83:0/2125891776 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e5226ae8d0 0x55e5226abd10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.720 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.719+0000 7fe122d9d700 1 -- 172.21.15.83:0/2125891776 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e5226a3100 msgr2=0x55e5226ab7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:48.720 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.719+0000 7fe122d9d700 1 --2- 172.21.15.83:0/2125891776 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e5226a3100 0x55e5226ab7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.720 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.719+0000 7fe122d9d700 1 -- 172.21.15.83:0/2125891776 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe11c0112b0 con 0x55e5226ac250 2024-04-01T06:56:48.720 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.719+0000 7fe122d9d700 1 --2- 172.21.15.83:0/2125891776 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e5226ac250 0x55e5226ba6c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe11c012000 tx=0x7fe11c004a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50e0251a13c86112 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:48.721 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.719+0000 7fe109ffb700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-04-01T06:56:48.722 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.719+0000 7fe109ffb700 1 -- 172.21.15.83:0/2125891776 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11c00e070 con 0x55e5226ac250 2024-04-01T06:56:48.722 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.719+0000 7fe109ffb700 1 -- 172.21.15.83:0/2125891776 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8425+0+0 (secure 0 0 0) 0x7fe11c003c10 con 0x55e5226ac250 2024-04-01T06:56:48.722 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.719+0000 7fe134e74b80 1 -- 172.21.15.83:0/2125891776 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e5225b6320 con 0x55e5226ac250 2024-04-01T06:56:48.722 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.720+0000 7fe109ffb700 1 -- 172.21.15.83:0/2125891776 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe11c003dd0 con 0x55e5226ac250 2024-04-01T06:56:48.722 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.720+0000 7fe134e74b80 10 client.25180 fetch_fsmap learned FSMap version 24 2024-04-01T06:56:48.722 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.720+0000 7fe134e74b80 1 -- 172.21.15.83:0/2125891776 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55e522423b00 con 0x55e5226ac250 2024-04-01T06:56:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.720+0000 7fe109ffb700 1 -- 172.21.15.83:0/2125891776 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e5225b6320 con 0x55e5226ac250 2024-04-01T06:56:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.720+0000 7fe109ffb700 1 -- 172.21.15.83:0/2125891776 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fe11c027560 con 0x55e5226ac250 2024-04-01T06:56:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.720+0000 7fe134e74b80 10 client.25180 fetch_fsmap finished waiting for FSMap version 24 2024-04-01T06:56:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.720+0000 7fe134e74b80 10 client.25180 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-01T06:56:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.720+0000 7fe134e74b80 20 client.25180 populate_metadata read hostname 'smithi083' 2024-04-01T06:56:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.720+0000 7fe134e74b80 1 --2- 172.21.15.83:0/2125891776 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55e5226bea10 0x55e5226c0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.720+0000 7fe134e74b80 4 client.25180 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-01T06:56:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.720+0000 7fe134e74b80 1 -- 172.21.15.83:0/2125891776 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e5225ee6a0 con 0x55e5226bea10 2024-04-01T06:56:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.721+0000 7fe12259c700 1 --2- 172.21.15.83:0/2125891776 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55e5226bea10 0x55e5226c0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.721+0000 7fe109ffb700 10 client.25180 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:56:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.721+0000 7fe12259c700 1 --2- 172.21.15.83:0/2125891776 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55e5226bea10 0x55e5226c0e50 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d761f5e5632bc47 server_cookie=9e6a3045a1683446 in_seq=0 out_seq=0 2024-04-01T06:56:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.722+0000 7fe109ffb700 1 -- 172.21.15.83:0/2125891776 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e5225ee6a0 con 0x55e5226bea10 2024-04-01T06:56:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.722+0000 7fe109ffb700 10 client.25180 handle_command_reply: tid=0 2024-04-01T06:56:48.723 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.722+0000 7fe134e74b80 1 client.25180 shutdown 2024-04-01T06:56:48.724 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.722+0000 7fe121d9b700 1 --2- 172.21.15.83:0/625531917 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fe10c0a13b0 0x7fe10c0a3870 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe11800b2e0 tx=0x7fe118000bc0 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:48.726 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.726+0000 7fe134e74b80 1 -- 172.21.15.83:0/2125891776 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e5226ac250 msgr2=0x55e5226ba6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:48.726 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.726+0000 7fe134e74b80 1 --2- 172.21.15.83:0/2125891776 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e5226ac250 0x55e5226ba6c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe11c012000 tx=0x7fe11c004a00 comp rx=0 tx=0).stop 2024-04-01T06:56:48.726 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.726+0000 7fe134e74b80 1 -- 172.21.15.83:0/2125891776 shutdown_connections 2024-04-01T06:56:48.726 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.726+0000 7fe134e74b80 1 --2- 172.21.15.83:0/2125891776 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55e5226bea10 0x55e5226c0e50 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.726 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.726+0000 7fe134e74b80 1 --2- 172.21.15.83:0/2125891776 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e5226a3100 0x55e5226ab7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.726 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.726+0000 7fe134e74b80 1 --2- 172.21.15.83:0/2125891776 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e5226ac250 0x55e5226ba6c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.726 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.726+0000 7fe134e74b80 1 --2- 172.21.15.83:0/2125891776 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e5226ae8d0 0x55e5226abd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.726 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.726+0000 7fe134e74b80 1 -- 172.21.15.83:0/2125891776 >> 172.21.15.83:0/2125891776 conn(0x55e522603640 msgr2=0x55e5226a50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:48.726 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.726+0000 7fe109ffb700 0 client.25180 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:56:48.727 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.726+0000 7fe134e74b80 1 -- 172.21.15.83:0/2125891776 shutdown_connections 2024-04-01T06:56:48.727 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.726+0000 7fe134e74b80 1 -- 172.21.15.83:0/2125891776 wait complete. 2024-04-01T06:56:48.727 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.726+0000 7fe134e74b80 20 client.25180 trim_cache size 0 max 16384 2024-04-01T06:56:48.753 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.754+0000 7fe134e74b80 1 Processor -- start 2024-04-01T06:56:48.754 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.754+0000 7fe134e74b80 1 -- start start 2024-04-01T06:56:48.754 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.754+0000 7fe134e74b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e5226a3100 0x55e5226c0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:48.754 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.754+0000 7fe134e74b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e5226ac250 0x55e5226b5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:48.754 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.754+0000 7fe134e74b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e5226ae8d0 0x55e52269f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:48.754 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.754+0000 7fe134e74b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5226bb640 con 0x55e5226ae8d0 2024-04-01T06:56:48.754 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.754+0000 7fe134e74b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5226a41a0 con 0x55e5226a3100 2024-04-01T06:56:48.755 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.754+0000 7fe134e74b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5226ab610 con 0x55e5226ac250 2024-04-01T06:56:48.755 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.755+0000 7fe12259c700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e5226a3100 0x55e5226c0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:48.755 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.755+0000 7fe12259c700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e5226a3100 0x55e5226c0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.83:53058/0 (socket says 172.21.15.83:53058) 2024-04-01T06:56:48.755 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.755+0000 7fe12259c700 1 -- 172.21.15.83:0/3865896168 learned_addr learned my addr 172.21.15.83:0/3865896168 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:48.756 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.755+0000 7fe122d9d700 1 --2- 172.21.15.83:0/3865896168 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e5226ae8d0 0x55e52269f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:48.756 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.755+0000 7fe121d9b700 1 --2- 172.21.15.83:0/3865896168 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e5226ac250 0x55e5226b5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:48.756 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.755+0000 7fe122d9d700 1 -- 172.21.15.83:0/3865896168 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e5226ac250 msgr2=0x55e5226b5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:48.756 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.755+0000 7fe122d9d700 1 --2- 172.21.15.83:0/3865896168 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e5226ac250 0x55e5226b5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.756 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.755+0000 7fe122d9d700 1 -- 172.21.15.83:0/3865896168 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e5226a3100 msgr2=0x55e5226c0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:48.756 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.755+0000 7fe122d9d700 1 --2- 172.21.15.83:0/3865896168 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e5226a3100 0x55e5226c0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.756 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.755+0000 7fe122d9d700 1 -- 172.21.15.83:0/3865896168 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e5225bbe40 con 0x55e5226ae8d0 2024-04-01T06:56:48.756 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.756+0000 7fe122d9d700 1 --2- 172.21.15.83:0/3865896168 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e5226ae8d0 0x55e52269f050 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fe11c011600 tx=0x7fe11c0061a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9879dcc66f7044b server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:48.756 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.756+0000 7fe1117fa700 1 -- 172.21.15.83:0/3865896168 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11c00e040 con 0x55e5226ae8d0 2024-04-01T06:56:48.756 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.756+0000 7fe1117fa700 1 -- 172.21.15.83:0/3865896168 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe11c027b90 con 0x55e5226ae8d0 2024-04-01T06:56:48.756 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.756+0000 7fe1117fa700 1 -- 172.21.15.83:0/3865896168 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11c031b70 con 0x55e5226ae8d0 2024-04-01T06:56:48.757 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.757+0000 7fe134e74b80 1 -- 172.21.15.83:0/3865896168 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e5226ae8d0 msgr2=0x55e52269f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:48.757 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.757+0000 7fe134e74b80 1 --2- 172.21.15.83:0/3865896168 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e5226ae8d0 0x55e52269f050 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fe11c011600 tx=0x7fe11c0061a0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.757 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.757+0000 7fe134e74b80 1 -- 172.21.15.83:0/3865896168 shutdown_connections 2024-04-01T06:56:48.757 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.757+0000 7fe134e74b80 1 --2- 172.21.15.83:0/3865896168 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e5226ae8d0 0x55e52269f050 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.757 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.757+0000 7fe134e74b80 1 --2- 172.21.15.83:0/3865896168 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e5226a3100 0x55e5226c0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.757 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.757+0000 7fe134e74b80 1 --2- 172.21.15.83:0/3865896168 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e5226ac250 0x55e5226b5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.757 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.757+0000 7fe134e74b80 1 -- 172.21.15.83:0/3865896168 >> 172.21.15.83:0/3865896168 conn(0x55e522603640 msgr2=0x55e5226a6a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:48.757 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.757+0000 7fe134e74b80 1 -- 172.21.15.83:0/3865896168 shutdown_connections 2024-04-01T06:56:48.759 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.757+0000 7fe134e74b80 1 -- 172.21.15.83:0/3865896168 wait complete. 2024-04-01T06:56:48.759 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.757+0000 7fe134e74b80 1 -- start start 2024-04-01T06:56:48.760 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.758+0000 7fe134e74b80 1 Processor -- start 2024-04-01T06:56:48.762 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.759+0000 7fe134e74b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e5226a3100 0x55e5226b35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:48.763 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.759+0000 7fe134e74b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e5226ac250 0x55e5226b3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:48.763 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.759+0000 7fe134e74b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e5226ae8d0 0x55e5226b4070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:48.763 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.759+0000 7fe134e74b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5227160d0 con 0x55e5226ac250 2024-04-01T06:56:48.763 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.759+0000 7fe134e74b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e522716240 con 0x55e5226ae8d0 2024-04-01T06:56:48.763 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.759+0000 7fe134e74b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e522716400 con 0x55e5226a3100 2024-04-01T06:56:48.763 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.759+0000 7fe134e74b80 10 client.0 _ll_register_callbacks cb 0x55e52259b410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:56:48.764 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.759+0000 7fe121d9b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e5226ac250 0x55e5226b3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:48.764 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.759+0000 7fe122d9d700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e5226ae8d0 0x55e5226b4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:48.764 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.759+0000 7fe121d9b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e5226ac250 0x55e5226b3b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58176/0 (socket says 172.21.15.83:58176) 2024-04-01T06:56:48.764 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.759+0000 7fe121d9b700 1 -- 172.21.15.83:0/654868802 learned_addr learned my addr 172.21.15.83:0/654868802 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:48.764 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.760+0000 7fe122d9d700 1 -- 172.21.15.83:0/654868802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e5226a3100 msgr2=0x55e5226b35f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-01T06:56:48.764 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.760+0000 7fe122d9d700 1 --2- 172.21.15.83:0/654868802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e5226a3100 0x55e5226b35f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.765 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.760+0000 7fe122d9d700 1 -- 172.21.15.83:0/654868802 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e5226ac250 msgr2=0x55e5226b3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:48.765 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.760+0000 7fe122d9d700 1 --2- 172.21.15.83:0/654868802 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e5226ac250 0x55e5226b3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.765 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.760+0000 7fe122d9d700 1 -- 172.21.15.83:0/654868802 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e522423b00 con 0x55e5226ae8d0 2024-04-01T06:56:48.765 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.760+0000 7fe122d9d700 1 --2- 172.21.15.83:0/654868802 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e5226ae8d0 0x55e5226b4070 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe11c027920 tx=0x7fe11c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=507df53f38e97a5f server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:48.765 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.760+0000 7fe109ffb700 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-04-01T06:56:48.765 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.760+0000 7fe109ffb700 1 -- 172.21.15.83:0/654868802 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11c004970 con 0x55e5226ae8d0 2024-04-01T06:56:48.765 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.760+0000 7fe109ffb700 1 -- 172.21.15.83:0/654868802 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8425+0+0 (secure 0 0 0) 0x7fe11c004ad0 con 0x55e5226ae8d0 2024-04-01T06:56:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.760+0000 7fe134e74b80 1 -- 172.21.15.83:0/654868802 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe11c00f040 con 0x55e5226ae8d0 2024-04-01T06:56:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.761+0000 7fe109ffb700 1 -- 172.21.15.83:0/654868802 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe11c004c90 con 0x55e5226ae8d0 2024-04-01T06:56:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.761+0000 7fe134e74b80 10 client.25223 fetch_fsmap learned FSMap version 24 2024-04-01T06:56:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.761+0000 7fe134e74b80 1 -- 172.21.15.83:0/654868802 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55e52247bc70 con 0x55e5226ae8d0 2024-04-01T06:56:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.761+0000 7fe109ffb700 1 -- 172.21.15.83:0/654868802 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe11c00f040 con 0x55e5226ae8d0 2024-04-01T06:56:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.762+0000 7fe109ffb700 1 -- 172.21.15.83:0/654868802 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fe11c007500 con 0x55e5226ae8d0 2024-04-01T06:56:48.767 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.762+0000 7fe134e74b80 10 client.25223 fetch_fsmap finished waiting for FSMap version 24 2024-04-01T06:56:48.767 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.762+0000 7fe134e74b80 10 client.25223 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-01T06:56:48.767 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.762+0000 7fe134e74b80 20 client.25223 populate_metadata read hostname 'smithi083' 2024-04-01T06:56:48.767 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.762+0000 7fe134e74b80 1 --2- 172.21.15.83:0/654868802 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55e5227176a0 0x55e522717a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:48.767 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.762+0000 7fe134e74b80 4 client.25223 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-01T06:56:48.767 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.762+0000 7fe134e74b80 1 -- 172.21.15.83:0/654868802 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e522444c90 con 0x55e5227176a0 2024-04-01T06:56:48.767 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.762+0000 7fe12259c700 1 --2- 172.21.15.83:0/654868802 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55e5227176a0 0x55e522717a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:48.768 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.763+0000 7fe12259c700 1 --2- 172.21.15.83:0/654868802 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55e5227176a0 0x55e522717a80 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e2bf79ef86cb408 server_cookie=32e8813cb1580881 in_seq=0 out_seq=0 2024-04-01T06:56:48.768 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.763+0000 7fe109ffb700 10 client.25223 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:56:48.770 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.766+0000 7fe109ffb700 1 -- 172.21.15.83:0/654868802 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e522444c90 con 0x55e5227176a0 2024-04-01T06:56:48.771 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.766+0000 7fe109ffb700 10 client.25223 handle_command_reply: tid=0 2024-04-01T06:56:48.771 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.766+0000 7fe134e74b80 1 client.25223 shutdown 2024-04-01T06:56:48.771 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.767+0000 7fe134e74b80 1 -- 172.21.15.83:0/654868802 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e5226ae8d0 msgr2=0x55e5226b4070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:48.771 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.767+0000 7fe134e74b80 1 --2- 172.21.15.83:0/654868802 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e5226ae8d0 0x55e5226b4070 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe11c027920 tx=0x7fe11c009b90 comp rx=0 tx=0).stop 2024-04-01T06:56:48.771 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.767+0000 7fe134e74b80 1 -- 172.21.15.83:0/654868802 shutdown_connections 2024-04-01T06:56:48.771 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.767+0000 7fe134e74b80 1 --2- 172.21.15.83:0/654868802 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55e5227176a0 0x55e522717a80 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.772 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.767+0000 7fe134e74b80 1 --2- 172.21.15.83:0/654868802 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e5226ae8d0 0x55e5226b4070 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.772 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.767+0000 7fe134e74b80 1 --2- 172.21.15.83:0/654868802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e5226a3100 0x55e5226b35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.772 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.767+0000 7fe134e74b80 1 --2- 172.21.15.83:0/654868802 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e5226ac250 0x55e5226b3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.772 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.767+0000 7fe134e74b80 1 -- 172.21.15.83:0/654868802 >> 172.21.15.83:0/654868802 conn(0x55e522603640 msgr2=0x55e52269efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:48.772 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.767+0000 7fe109ffb700 0 client.25223 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:56:48.772 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.768+0000 7fe134e74b80 1 -- 172.21.15.83:0/654868802 shutdown_connections 2024-04-01T06:56:48.772 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.768+0000 7fe134e74b80 1 -- 172.21.15.83:0/654868802 wait complete. 2024-04-01T06:56:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.768+0000 7fe134e74b80 20 client.25223 trim_cache size 0 max 16384 2024-04-01T06:56:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout:{ 2024-04-01T06:56:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout: "message": "", 2024-04-01T06:56:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout: "return_code": 0 2024-04-01T06:56:48.774 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout:} 2024-04-01T06:56:48.775 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.769+0000 7fe128cde700 1 -- 172.21.15.83:0/625531917 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fe10c0a13b0 msgr2=0x7fe10c0a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:48.775 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.769+0000 7fe128cde700 1 --2- 172.21.15.83:0/625531917 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fe10c0a13b0 0x7fe10c0a3870 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe11800b2e0 tx=0x7fe118000bc0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.775 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.769+0000 7fe128cde700 1 -- 172.21.15.83:0/625531917 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe1240694b0 msgr2=0x7fe124199380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:48.775 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.769+0000 7fe128cde700 1 --2- 172.21.15.83:0/625531917 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe1240694b0 0x7fe124199380 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fe11400e9a0 tx=0x7fe11400ecb0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.775 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.769+0000 7fe128cde700 1 -- 172.21.15.83:0/625531917 shutdown_connections 2024-04-01T06:56:48.775 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.769+0000 7fe128cde700 1 --2- 172.21.15.83:0/625531917 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fe10c0a13b0 0x7fe10c0a3870 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.775 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.769+0000 7fe128cde700 1 --2- 172.21.15.83:0/625531917 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe1240694b0 0x7fe124199380 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.776 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.769+0000 7fe128cde700 1 --2- 172.21.15.83:0/625531917 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe12410d720 0x7fe12419dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.776 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.769+0000 7fe128cde700 1 --2- 172.21.15.83:0/625531917 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe124101be0 0x7fe1241998c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.776 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.769+0000 7fe128cde700 1 -- 172.21.15.83:0/625531917 >> 172.21.15.83:0/625531917 conn(0x7fe124076a20 msgr2=0x7fe1240ff0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:48.776 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.769+0000 7fe128cde700 1 -- 172.21.15.83:0/625531917 shutdown_connections 2024-04-01T06:56:48.776 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:56:48.769+0000 7fe128cde700 1 -- 172.21.15.83:0/625531917 wait complete. 2024-04-01T06:56:48.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.822+0000 7f71a5d85700 1 -- 172.21.15.83:0/1392698269 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f71a0196110 con 0x7f71a01004a0 2024-04-01T06:56:48.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.824+0000 7f719cff9700 1 -- 172.21.15.83:0/1392698269 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+10876 (secure 0 0 0) 0x7f719409a6a0 con 0x7f71a01004a0 2024-04-01T06:56:48.824 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:56:48.824 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1271130478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1271130478},{"type":"v1","addr":"172.21.15.83:6835","nonce":1271130478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2412682983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2412682983},{"type":"v1","addr":"172.21.15.83:6837","nonce":2412682983}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6839/3348145990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":3348145990},{"type":"v1","addr":"172.21.15.83:6839","nonce":3348145990}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6841/1191267445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6840","nonce":1191267445},{"type":"v1","addr":"172.21.15.83:6841","nonce":1191267445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2467459028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2467459028},{"type":"v1","addr":"172.21.15.153:6833","nonce":2467459028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24448,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4092629042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":4092629042},{"type":"v1","addr":"172.21.15.153:6835","nonce":4092629042}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-01T06:54:28.397062+0000","modified":"2024-04-01T06:55:38.703948+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24524,"mds_1":24494,"mds_2":24473},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6833/647005844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":647005844},{"type":"v1","addr":"172.21.15.145:6833","nonce":647005844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24454":{"gid":24454,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6837/1993816527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1993816527},{"type":"v1","addr":"172.21.15.153:6837","nonce":1993816527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24472":{"gid":24472,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6839/1399754640","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1399754640},{"type":"v1","addr":"172.21.15.153:6839","nonce":1399754640}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24473":{"gid":24473,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.145:6835/3104241497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":3104241497},{"type":"v1","addr":"172.21.15.145:6835","nonce":3104241497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24494":{"gid":24494,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.145:6837/2687798317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2687798317},{"type":"v1","addr":"172.21.15.145:6837","nonce":2687798317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6839/3886435411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3886435411},{"type":"v1","addr":"172.21.15.145:6839","nonce":3886435411}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-01T06:56:48.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.826+0000 7f71a5d85700 1 -- 172.21.15.83:0/1392698269 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f71880a1430 msgr2=0x7f71880a38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:48.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.826+0000 7f71a5d85700 1 --2- 172.21.15.83:0/1392698269 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f71880a1430 0x7f71880a38f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7190011550 tx=0x7f7190009260 comp rx=0 tx=0).stop 2024-04-01T06:56:48.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.826+0000 7f71a5d85700 1 -- 172.21.15.83:0/1392698269 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f71a01004a0 msgr2=0x7f71a0195350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:48.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.826+0000 7f71a5d85700 1 --2- 172.21.15.83:0/1392698269 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f71a01004a0 0x7f71a0195350 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f71940059d0 tx=0x7f7194004730 comp rx=0 tx=0).stop 2024-04-01T06:56:48.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.829+0000 7f71a5d85700 1 -- 172.21.15.83:0/1392698269 shutdown_connections 2024-04-01T06:56:48.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.829+0000 7f71a5d85700 1 --2- 172.21.15.83:0/1392698269 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f71880a1430 0x7f71880a38f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.829+0000 7f71a5d85700 1 --2- 172.21.15.83:0/1392698269 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f71a0105b80 0x7f71a01996f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.829+0000 7f71a5d85700 1 --2- 172.21.15.83:0/1392698269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71a00ffae0 0x7f71a0194e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.829+0000 7f71a5d85700 1 --2- 172.21.15.83:0/1392698269 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f71a01004a0 0x7f71a0195350 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:48.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.829+0000 7f71a5d85700 1 -- 172.21.15.83:0/1392698269 >> 172.21.15.83:0/1392698269 conn(0x7f71a00fb5f0 msgr2=0x7f71a00fbed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:48.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.829+0000 7f71a5d85700 1 -- 172.21.15.83:0/1392698269 shutdown_connections 2024-04-01T06:56:48.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:48.829+0000 7f71a5d85700 1 -- 172.21.15.83:0/1392698269 wait complete. 2024-04-01T06:56:48.830 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 24 2024-04-01T06:56:48.844 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-01T06:56:48.844 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-01T06:56:49.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.037+0000 7fdb7c4e6700 1 -- 172.21.15.83:0/3465652986 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdb74104c20 msgr2=0x7fdb74105000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:49.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.037+0000 7fdb7c4e6700 1 --2- 172.21.15.83:0/3465652986 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdb74104c20 0x7fdb74105000 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fdb700099c0 tx=0x7fdb70009cd0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.037+0000 7fdb7c4e6700 1 -- 172.21.15.83:0/3465652986 shutdown_connections 2024-04-01T06:56:49.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.037+0000 7fdb7c4e6700 1 --2- 172.21.15.83:0/3465652986 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdb74104c20 0x7fdb74105000 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.037+0000 7fdb7c4e6700 1 --2- 172.21.15.83:0/3465652986 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdb74100d90 0x7fdb7410cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.037+0000 7fdb7c4e6700 1 --2- 172.21.15.83:0/3465652986 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb741003d0 0x7fdb74100850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.037+0000 7fdb7c4e6700 1 -- 172.21.15.83:0/3465652986 >> 172.21.15.83:0/3465652986 conn(0x7fdb740761e0 msgr2=0x7fdb740fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:49.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.037+0000 7fdb7c4e6700 1 -- 172.21.15.83:0/3465652986 shutdown_connections 2024-04-01T06:56:49.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.037+0000 7fdb7c4e6700 1 -- 172.21.15.83:0/3465652986 wait complete. 2024-04-01T06:56:49.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.038+0000 7fdb7c4e6700 1 Processor -- start 2024-04-01T06:56:49.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.038+0000 7fdb7c4e6700 1 -- start start 2024-04-01T06:56:49.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.038+0000 7fdb7c4e6700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdb741003d0 0x7fdb74197130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:49.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.038+0000 7fdb7c4e6700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdb74100d90 0x7fdb74197670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:49.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.038+0000 7fdb7c4e6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb74104c20 0x7fdb7419b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:49.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.038+0000 7fdb7c4e6700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7419c000 con 0x7fdb74100d90 2024-04-01T06:56:49.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.038+0000 7fdb7c4e6700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7419c170 con 0x7fdb741003d0 2024-04-01T06:56:49.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.038+0000 7fdb7c4e6700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7419c330 con 0x7fdb74104c20 2024-04-01T06:56:49.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.038+0000 7fdb7a282700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdb741003d0 0x7fdb74197130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:49.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.038+0000 7fdb7a282700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdb741003d0 0x7fdb74197130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.83:53078/0 (socket says 172.21.15.83:53078) 2024-04-01T06:56:49.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.038+0000 7fdb7a282700 1 -- 172.21.15.83:0/3369567301 learned_addr learned my addr 172.21.15.83:0/3369567301 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:49.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.039+0000 7fdb79a81700 1 --2- 172.21.15.83:0/3369567301 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdb74100d90 0x7fdb74197670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:49.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.039+0000 7fdb7a282700 1 -- 172.21.15.83:0/3369567301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb74104c20 msgr2=0x7fdb7419b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:49.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.039+0000 7fdb7a282700 1 --2- 172.21.15.83:0/3369567301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb74104c20 0x7fdb7419b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.039+0000 7fdb7a282700 1 -- 172.21.15.83:0/3369567301 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdb74100d90 msgr2=0x7fdb74197670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:49.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.039+0000 7fdb7a282700 1 --2- 172.21.15.83:0/3369567301 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdb74100d90 0x7fdb74197670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.039+0000 7fdb7a282700 1 -- 172.21.15.83:0/3369567301 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb700095f0 con 0x7fdb741003d0 2024-04-01T06:56:49.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.039+0000 7fdb79a81700 1 --2- 172.21.15.83:0/3369567301 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdb74100d90 0x7fdb74197670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:56:49.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.039+0000 7fdb7a282700 1 --2- 172.21.15.83:0/3369567301 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdb741003d0 0x7fdb74197130 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdb7000f690 tx=0x7fdb7000bfd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:49.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.039+0000 7fdb6b7fe700 1 -- 172.21.15.83:0/3369567301 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7001c070 con 0x7fdb741003d0 2024-04-01T06:56:49.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.039+0000 7fdb7c4e6700 1 -- 172.21.15.83:0/3369567301 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb7419c5b0 con 0x7fdb741003d0 2024-04-01T06:56:49.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.039+0000 7fdb6b7fe700 1 -- 172.21.15.83:0/3369567301 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdb7000fdd0 con 0x7fdb741003d0 2024-04-01T06:56:49.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.039+0000 7fdb7c4e6700 1 -- 172.21.15.83:0/3369567301 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb7406a9b0 con 0x7fdb741003d0 2024-04-01T06:56:49.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.039+0000 7fdb6b7fe700 1 -- 172.21.15.83:0/3369567301 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb70022d40 con 0x7fdb741003d0 2024-04-01T06:56:49.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.041+0000 7fdb6b7fe700 1 -- 172.21.15.83:0/3369567301 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 24) v1 ==== 136098+0+0 (secure 0 0 0) 0x7fdb70020070 con 0x7fdb741003d0 2024-04-01T06:56:49.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.042+0000 7fdb6b7fe700 1 --2- 172.21.15.83:0/3369567301 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fdb600a1430 0x7fdb600a38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:49.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.042+0000 7fdb79a81700 1 --2- 172.21.15.83:0/3369567301 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fdb600a1430 0x7fdb600a38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:49.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.042+0000 7fdb6b7fe700 1 -- 172.21.15.83:0/3369567301 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8425+0+0 (secure 0 0 0) 0x7fdb700cdba0 con 0x7fdb741003d0 2024-04-01T06:56:49.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.043+0000 7fdb79a81700 1 --2- 172.21.15.83:0/3369567301 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fdb600a1430 0x7fdb600a38f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdb74198630 tx=0x7fdb64009260 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:49.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.044+0000 7fdb8867cb80 1 Processor -- start 2024-04-01T06:56:49.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.044+0000 7fdb8867cb80 1 -- start start 2024-04-01T06:56:49.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.044+0000 7fdb8867cb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c7cd6441c0 0x55c7cd6425d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:49.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.044+0000 7fdb8867cb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c7cd642b10 0x55c7cd642f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:49.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.044+0000 7fdb8867cb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7cd656490 0x55c7cd658880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:49.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.044+0000 7fdb8867cb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7cd59b990 con 0x55c7cd642b10 2024-04-01T06:56:49.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.044+0000 7fdb8867cb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7cd599350 con 0x55c7cd656490 2024-04-01T06:56:49.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.045+0000 7fdb8867cb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7cd594c40 con 0x55c7cd6441c0 2024-04-01T06:56:49.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.045+0000 7fdb79a81700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c7cd642b10 0x55c7cd642f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:49.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.045+0000 7fdb7a282700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c7cd6441c0 0x55c7cd6425d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:49.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.045+0000 7fdb79a81700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c7cd642b10 0x55c7cd642f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58192/0 (socket says 172.21.15.83:58192) 2024-04-01T06:56:49.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.045+0000 7fdb79a81700 1 -- 172.21.15.83:0/4179847434 learned_addr learned my addr 172.21.15.83:0/4179847434 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:49.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.045+0000 7fdb7aa83700 1 --2- 172.21.15.83:0/4179847434 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7cd656490 0x55c7cd658880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:49.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.045+0000 7fdb7a282700 1 -- 172.21.15.83:0/4179847434 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7cd656490 msgr2=0x55c7cd658880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:49.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.045+0000 7fdb7a282700 1 --2- 172.21.15.83:0/4179847434 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7cd656490 0x55c7cd658880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.045+0000 7fdb7a282700 1 -- 172.21.15.83:0/4179847434 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c7cd642b10 msgr2=0x55c7cd642f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:49.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.045+0000 7fdb7a282700 1 --2- 172.21.15.83:0/4179847434 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c7cd642b10 0x55c7cd642f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.045+0000 7fdb7a282700 1 -- 172.21.15.83:0/4179847434 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7cd4163b0 con 0x55c7cd6441c0 2024-04-01T06:56:49.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.045+0000 7fdb79a81700 1 --2- 172.21.15.83:0/4179847434 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c7cd642b10 0x55c7cd642f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T06:56:49.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.045+0000 7fdb7a282700 1 --2- 172.21.15.83:0/4179847434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c7cd6441c0 0x55c7cd6425d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdb700cb1d0 tx=0x7fdb7009aa10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d0f3d1312a9b622 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:49.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.046+0000 7fdb68ff9700 1 -- 172.21.15.83:0/4179847434 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7009b250 con 0x55c7cd6441c0 2024-04-01T06:56:49.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.046+0000 7fdb68ff9700 1 -- 172.21.15.83:0/4179847434 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdb7009ab50 con 0x55c7cd6441c0 2024-04-01T06:56:49.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.046+0000 7fdb68ff9700 1 -- 172.21.15.83:0/4179847434 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7009a2a0 con 0x55c7cd6441c0 2024-04-01T06:56:49.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.046+0000 7fdb8867cb80 1 -- 172.21.15.83:0/4179847434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c7cd6441c0 msgr2=0x55c7cd6425d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:49.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.046+0000 7fdb8867cb80 1 --2- 172.21.15.83:0/4179847434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c7cd6441c0 0x55c7cd6425d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdb700cb1d0 tx=0x7fdb7009aa10 comp rx=0 tx=0).stop 2024-04-01T06:56:49.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.046+0000 7fdb8867cb80 1 -- 172.21.15.83:0/4179847434 shutdown_connections 2024-04-01T06:56:49.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.046+0000 7fdb8867cb80 1 --2- 172.21.15.83:0/4179847434 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7cd656490 0x55c7cd658880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.046+0000 7fdb8867cb80 1 --2- 172.21.15.83:0/4179847434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c7cd6441c0 0x55c7cd6425d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.046+0000 7fdb8867cb80 1 --2- 172.21.15.83:0/4179847434 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c7cd642b10 0x55c7cd642f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.047+0000 7fdb8867cb80 1 -- 172.21.15.83:0/4179847434 >> 172.21.15.83:0/4179847434 conn(0x55c7cd5a26a0 msgr2=0x55c7cd63ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:49.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.047+0000 7fdb8867cb80 1 -- 172.21.15.83:0/4179847434 shutdown_connections 2024-04-01T06:56:49.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.047+0000 7fdb8867cb80 1 -- 172.21.15.83:0/4179847434 wait complete. 2024-04-01T06:56:49.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.047+0000 7fdb8867cb80 1 -- start start 2024-04-01T06:56:49.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.047+0000 7fdb8867cb80 1 Processor -- start 2024-04-01T06:56:49.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.048+0000 7fdb8867cb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7cd642b10 0x55c7cd64f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:49.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.048+0000 7fdb8867cb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c7cd6441c0 0x55c7cd64fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:49.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.048+0000 7fdb8867cb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c7cd656490 0x55c7cd64aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:49.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.048+0000 7fdb8867cb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7cd530d80 con 0x55c7cd6441c0 2024-04-01T06:56:49.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.048+0000 7fdb8867cb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7cd530a20 con 0x55c7cd642b10 2024-04-01T06:56:49.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.048+0000 7fdb8867cb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7cd4186a0 con 0x55c7cd656490 2024-04-01T06:56:49.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.048+0000 7fdb8867cb80 10 client.0 _ll_register_callbacks cb 0x55c7cd53a470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:56:49.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.049+0000 7fdb7a282700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7cd642b10 0x55c7cd64f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:49.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.049+0000 7fdb79a81700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c7cd6441c0 0x55c7cd64fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:49.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.049+0000 7fdb7a282700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7cd642b10 0x55c7cd64f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.83:53100/0 (socket says 172.21.15.83:53100) 2024-04-01T06:56:49.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.049+0000 7fdb7a282700 1 -- 172.21.15.83:0/3874953055 learned_addr learned my addr 172.21.15.83:0/3874953055 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:49.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.049+0000 7fdb79a81700 1 --2- 172.21.15.83:0/3874953055 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c7cd6441c0 0x55c7cd64fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58194/0 (socket says 172.21.15.83:58194) 2024-04-01T06:56:49.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.049+0000 7fdb7aa83700 1 --2- 172.21.15.83:0/3874953055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c7cd656490 0x55c7cd64aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:49.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.049+0000 7fdb79a81700 1 -- 172.21.15.83:0/3874953055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c7cd656490 msgr2=0x55c7cd64aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:49.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.049+0000 7fdb79a81700 1 --2- 172.21.15.83:0/3874953055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c7cd656490 0x55c7cd64aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.049+0000 7fdb79a81700 1 -- 172.21.15.83:0/3874953055 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7cd642b10 msgr2=0x55c7cd64f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:49.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.049+0000 7fdb79a81700 1 --2- 172.21.15.83:0/3874953055 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7cd642b10 0x55c7cd64f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.049+0000 7fdb79a81700 1 -- 172.21.15.83:0/3874953055 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb64011c60 con 0x55c7cd6441c0 2024-04-01T06:56:49.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.049+0000 7fdb79a81700 1 --2- 172.21.15.83:0/3874953055 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c7cd6441c0 0x55c7cd64fc60 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fdb64009a00 tx=0x7fdb640047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e39a9a51e7ac0ba8 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:49.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.049+0000 7fdb5dffb700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:56:49.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.049+0000 7fdb5dffb700 1 -- 172.21.15.83:0/3874953055 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb640045b0 con 0x55c7cd6441c0 2024-04-01T06:56:49.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.049+0000 7fdb5dffb700 1 -- 172.21.15.83:0/3874953055 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8425+0+0 (secure 0 0 0) 0x7fdb64018070 con 0x55c7cd6441c0 2024-04-01T06:56:49.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.050+0000 7fdb8867cb80 1 -- 172.21.15.83:0/3874953055 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c7cd555380 con 0x55c7cd6441c0 2024-04-01T06:56:49.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.050+0000 7fdb5dffb700 1 -- 172.21.15.83:0/3874953055 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb64011e90 con 0x55c7cd6441c0 2024-04-01T06:56:49.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.050+0000 7fdb8867cb80 10 client.15726 fetch_fsmap learned FSMap version 24 2024-04-01T06:56:49.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.050+0000 7fdb8867cb80 1 -- 172.21.15.83:0/3874953055 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7fdb7406a9b0 con 0x55c7cd6441c0 2024-04-01T06:56:49.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.050+0000 7fdb5dffb700 1 -- 172.21.15.83:0/3874953055 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c7cd555380 con 0x55c7cd6441c0 2024-04-01T06:56:49.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.050+0000 7fdb5dffb700 1 -- 172.21.15.83:0/3874953055 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fdb6402a900 con 0x55c7cd6441c0 2024-04-01T06:56:49.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.051+0000 7fdb8867cb80 10 client.15726 fetch_fsmap finished waiting for FSMap version 24 2024-04-01T06:56:49.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.051+0000 7fdb8867cb80 10 client.15726 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.e 2024-04-01T06:56:49.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.051+0000 7fdb8867cb80 20 client.15726 populate_metadata read hostname 'smithi083' 2024-04-01T06:56:49.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.051+0000 7fdb8867cb80 1 --2- 172.21.15.83:0/3874953055 >> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] conn(0x55c7cd66e6f0 0x55c7cd670b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:49.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.051+0000 7fdb8867cb80 4 client.15726 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-01T06:56:49.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.051+0000 7fdb8867cb80 1 -- 172.21.15.83:0/3874953055 --> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c7cd58d700 con 0x55c7cd66e6f0 2024-04-01T06:56:49.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.051+0000 7fdb7a282700 1 --2- 172.21.15.83:0/3874953055 >> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] conn(0x55c7cd66e6f0 0x55c7cd670b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:49.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.051+0000 7fdb5dffb700 10 client.15726 ms_handle_connect on v2:172.21.15.145:6834/3104241497 2024-04-01T06:56:49.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.051+0000 7fdb7a282700 1 --2- 172.21.15.83:0/3874953055 >> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] conn(0x55c7cd66e6f0 0x55c7cd670b10 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e45d7820d7811746 server_cookie=de7a86e18273d661 in_seq=0 out_seq=0 2024-04-01T06:56:49.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.052+0000 7fdb5dffb700 1 -- 172.21.15.83:0/3874953055 <== mds.2 v2:172.21.15.145:6834/3104241497 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c7cd58d700 con 0x55c7cd66e6f0 2024-04-01T06:56:49.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.052+0000 7fdb5dffb700 10 client.15726 handle_command_reply: tid=0 2024-04-01T06:56:49.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.052+0000 7fdb8867cb80 1 client.15726 shutdown 2024-04-01T06:56:49.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.052+0000 7fdb8867cb80 1 -- 172.21.15.83:0/3874953055 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c7cd6441c0 msgr2=0x55c7cd64fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:49.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.052+0000 7fdb8867cb80 1 --2- 172.21.15.83:0/3874953055 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c7cd6441c0 0x55c7cd64fc60 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fdb64009a00 tx=0x7fdb640047c0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.052+0000 7fdb8867cb80 1 -- 172.21.15.83:0/3874953055 shutdown_connections 2024-04-01T06:56:49.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.052+0000 7fdb8867cb80 1 --2- 172.21.15.83:0/3874953055 >> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] conn(0x55c7cd66e6f0 0x55c7cd670b10 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.052+0000 7fdb8867cb80 1 --2- 172.21.15.83:0/3874953055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c7cd656490 0x55c7cd64aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.052+0000 7fdb8867cb80 1 --2- 172.21.15.83:0/3874953055 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7cd642b10 0x55c7cd64f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.052+0000 7fdb8867cb80 1 --2- 172.21.15.83:0/3874953055 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c7cd6441c0 0x55c7cd64fc60 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.052+0000 7fdb8867cb80 1 -- 172.21.15.83:0/3874953055 >> 172.21.15.83:0/3874953055 conn(0x55c7cd5a26a0 msgr2=0x55c7cd644640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:49.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.052+0000 7fdb5dffb700 0 client.15726 ms_handle_reset on v2:172.21.15.145:6834/3104241497 2024-04-01T06:56:49.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.052+0000 7fdb8867cb80 1 -- 172.21.15.83:0/3874953055 shutdown_connections 2024-04-01T06:56:49.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.053+0000 7fdb8867cb80 1 -- 172.21.15.83:0/3874953055 wait complete. 2024-04-01T06:56:49.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.053+0000 7fdb8867cb80 20 client.15726 trim_cache size 0 max 16384 2024-04-01T06:56:49.066 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.066+0000 7fdb8867cb80 1 Processor -- start 2024-04-01T06:56:49.066 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.066+0000 7fdb8867cb80 1 -- start start 2024-04-01T06:56:49.066 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.066+0000 7fdb8867cb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c7cd642b10 0x55c7cd645b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:49.066 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.066+0000 7fdb8867cb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c7cd6441c0 0x55c7cd649f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:49.066 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.066+0000 7fdb8867cb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7cd656490 0x55c7cd648e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:49.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.066+0000 7fdb8867cb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7cd649d50 con 0x55c7cd642b10 2024-04-01T06:56:49.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.066+0000 7fdb8867cb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7cd648ad0 con 0x55c7cd656490 2024-04-01T06:56:49.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.066+0000 7fdb8867cb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7cd64b2f0 con 0x55c7cd6441c0 2024-04-01T06:56:49.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.066+0000 7fdb7a282700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c7cd642b10 0x55c7cd645b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:49.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.066+0000 7fdb7a282700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c7cd642b10 0x55c7cd645b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58198/0 (socket says 172.21.15.83:58198) 2024-04-01T06:56:49.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.066+0000 7fdb7a282700 1 -- 172.21.15.83:0/3417681618 learned_addr learned my addr 172.21.15.83:0/3417681618 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:49.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.066+0000 7fdb7aa83700 1 --2- 172.21.15.83:0/3417681618 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7cd656490 0x55c7cd648e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:49.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.066+0000 7fdb7a282700 1 -- 172.21.15.83:0/3417681618 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c7cd6441c0 msgr2=0x55c7cd649f90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-01T06:56:49.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.066+0000 7fdb7a282700 1 --2- 172.21.15.83:0/3417681618 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c7cd6441c0 0x55c7cd649f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.066+0000 7fdb7a282700 1 -- 172.21.15.83:0/3417681618 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7cd656490 msgr2=0x55c7cd648e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:49.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.066+0000 7fdb7a282700 1 --2- 172.21.15.83:0/3417681618 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7cd656490 0x55c7cd648e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.066+0000 7fdb7a282700 1 -- 172.21.15.83:0/3417681618 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7cd3c2b60 con 0x55c7cd642b10 2024-04-01T06:56:49.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.066+0000 7fdb7aa83700 1 --2- 172.21.15.83:0/3417681618 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7cd656490 0x55c7cd648e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:56:49.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.067+0000 7fdb7a282700 1 --2- 172.21.15.83:0/3417681618 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c7cd642b10 0x55c7cd645b50 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fdb7000f820 tx=0x7fdb7009acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c3ae6aaed11e5b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:49.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.067+0000 7fdb697fa700 1 -- 172.21.15.83:0/3417681618 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb700cb110 con 0x55c7cd642b10 2024-04-01T06:56:49.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.067+0000 7fdb697fa700 1 -- 172.21.15.83:0/3417681618 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdb700a2f40 con 0x55c7cd642b10 2024-04-01T06:56:49.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.067+0000 7fdb697fa700 1 -- 172.21.15.83:0/3417681618 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7009a2a0 con 0x55c7cd642b10 2024-04-01T06:56:49.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.068+0000 7fdb8867cb80 1 -- 172.21.15.83:0/3417681618 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c7cd642b10 msgr2=0x55c7cd645b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:49.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.068+0000 7fdb8867cb80 1 --2- 172.21.15.83:0/3417681618 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c7cd642b10 0x55c7cd645b50 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fdb7000f820 tx=0x7fdb7009acc0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.069+0000 7fdb8867cb80 1 -- 172.21.15.83:0/3417681618 shutdown_connections 2024-04-01T06:56:49.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.069+0000 7fdb8867cb80 1 --2- 172.21.15.83:0/3417681618 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c7cd642b10 0x55c7cd645b50 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.069+0000 7fdb8867cb80 1 --2- 172.21.15.83:0/3417681618 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7cd656490 0x55c7cd648e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.069+0000 7fdb8867cb80 1 --2- 172.21.15.83:0/3417681618 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c7cd6441c0 0x55c7cd649f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.069+0000 7fdb8867cb80 1 -- 172.21.15.83:0/3417681618 >> 172.21.15.83:0/3417681618 conn(0x55c7cd5a26a0 msgr2=0x55c7cd637f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:49.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.069+0000 7fdb8867cb80 1 -- 172.21.15.83:0/3417681618 shutdown_connections 2024-04-01T06:56:49.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.069+0000 7fdb8867cb80 1 -- 172.21.15.83:0/3417681618 wait complete. 2024-04-01T06:56:49.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.069+0000 7fdb8867cb80 1 -- start start 2024-04-01T06:56:49.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.069+0000 7fdb8867cb80 1 Processor -- start 2024-04-01T06:56:49.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.069+0000 7fdb8867cb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c7cd642b10 0x55c7cd6551e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:49.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.069+0000 7fdb8867cb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c7cd6441c0 0x55c7cd652890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:49.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.069+0000 7fdb8867cb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7cd656490 0x55c7cd652e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:49.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.070+0000 7fdb8867cb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7cd653540 con 0x55c7cd6441c0 2024-04-01T06:56:49.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.070+0000 7fdb8867cb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7cd6536b0 con 0x55c7cd656490 2024-04-01T06:56:49.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.070+0000 7fdb8867cb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7cd6c1520 con 0x55c7cd642b10 2024-04-01T06:56:49.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.070+0000 7fdb8867cb80 10 client.0 _ll_register_callbacks cb 0x55c7cd53a470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:56:49.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.070+0000 7fdb7a282700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c7cd642b10 0x55c7cd6551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:49.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.070+0000 7fdb7a282700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c7cd642b10 0x55c7cd6551e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.83:54226/0 (socket says 172.21.15.83:54226) 2024-04-01T06:56:49.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.070+0000 7fdb7a282700 1 -- 172.21.15.83:0/228731036 learned_addr learned my addr 172.21.15.83:0/228731036 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:49.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.070+0000 7fdb7aa83700 1 --2- 172.21.15.83:0/228731036 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7cd656490 0x55c7cd652e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:49.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.070+0000 7fdb7a282700 1 -- 172.21.15.83:0/228731036 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7cd656490 msgr2=0x55c7cd652e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:49.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.070+0000 7fdb7a282700 1 --2- 172.21.15.83:0/228731036 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7cd656490 0x55c7cd652e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.070+0000 7fdb7a282700 1 -- 172.21.15.83:0/228731036 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c7cd6441c0 msgr2=0x55c7cd652890 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-01T06:56:49.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.070+0000 7fdb7a282700 1 --2- 172.21.15.83:0/228731036 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c7cd6441c0 0x55c7cd652890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.070+0000 7fdb7a282700 1 -- 172.21.15.83:0/228731036 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb700b2040 con 0x55c7cd642b10 2024-04-01T06:56:49.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.070+0000 7fdb7aa83700 1 --2- 172.21.15.83:0/228731036 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7cd656490 0x55c7cd652e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:56:49.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.070+0000 7fdb7a282700 1 --2- 172.21.15.83:0/228731036 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c7cd642b10 0x55c7cd6551e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdb70009fd0 tx=0x7fdb700227d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6039b672d90cff8b server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:49.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.070+0000 7fdb5dffb700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-04-01T06:56:49.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.070+0000 7fdb5dffb700 1 -- 172.21.15.83:0/228731036 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb700b3240 con 0x55c7cd642b10 2024-04-01T06:56:49.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.071+0000 7fdb5dffb700 1 -- 172.21.15.83:0/228731036 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8425+0+0 (secure 0 0 0) 0x7fdb700b33a0 con 0x55c7cd642b10 2024-04-01T06:56:49.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.071+0000 7fdb8867cb80 1 -- 172.21.15.83:0/228731036 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdb7009ab50 con 0x55c7cd642b10 2024-04-01T06:56:49.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.071+0000 7fdb5dffb700 1 -- 172.21.15.83:0/228731036 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb70084020 con 0x55c7cd642b10 2024-04-01T06:56:49.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.071+0000 7fdb8867cb80 10 client.25195 fetch_fsmap learned FSMap version 24 2024-04-01T06:56:49.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.071+0000 7fdb8867cb80 1 -- 172.21.15.83:0/228731036 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55c7cd55aea0 con 0x55c7cd642b10 2024-04-01T06:56:49.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.071+0000 7fdb5dffb700 1 -- 172.21.15.83:0/228731036 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdb7009ab50 con 0x55c7cd642b10 2024-04-01T06:56:49.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.071+0000 7fdb5dffb700 1 -- 172.21.15.83:0/228731036 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fdb7009a160 con 0x55c7cd642b10 2024-04-01T06:56:49.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.071+0000 7fdb8867cb80 10 client.25195 fetch_fsmap finished waiting for FSMap version 24 2024-04-01T06:56:49.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.071+0000 7fdb8867cb80 10 client.25195 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.e 2024-04-01T06:56:49.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.071+0000 7fdb8867cb80 20 client.25195 populate_metadata read hostname 'smithi083' 2024-04-01T06:56:49.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.071+0000 7fdb8867cb80 1 --2- 172.21.15.83:0/228731036 >> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] conn(0x55c7cd6c2790 0x55c7cd6c4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:49.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.071+0000 7fdb8867cb80 4 client.25195 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-01T06:56:49.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.071+0000 7fdb8867cb80 1 -- 172.21.15.83:0/228731036 --> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55c7cd3e3cf0 con 0x55c7cd6c2790 2024-04-01T06:56:49.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.072+0000 7fdb79a81700 1 --2- 172.21.15.83:0/228731036 >> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] conn(0x55c7cd6c2790 0x55c7cd6c4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:49.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.072+0000 7fdb5dffb700 10 client.25195 ms_handle_connect on v2:172.21.15.145:6834/3104241497 2024-04-01T06:56:49.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.072+0000 7fdb79a81700 1 --2- 172.21.15.83:0/228731036 >> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] conn(0x55c7cd6c2790 0x55c7cd6c4b80 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=adead5de71556d67 server_cookie=7419b805389bc16d in_seq=0 out_seq=0 2024-04-01T06:56:49.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.072+0000 7fdb5dffb700 1 -- 172.21.15.83:0/228731036 <== mds.2 v2:172.21.15.145:6834/3104241497 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55c7cd3e3cf0 con 0x55c7cd6c2790 2024-04-01T06:56:49.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.072+0000 7fdb5dffb700 10 client.25195 handle_command_reply: tid=0 2024-04-01T06:56:49.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.072+0000 7fdb8867cb80 1 client.25195 shutdown 2024-04-01T06:56:49.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.072+0000 7fdb8867cb80 1 -- 172.21.15.83:0/228731036 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c7cd642b10 msgr2=0x55c7cd6551e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:49.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.072+0000 7fdb8867cb80 1 --2- 172.21.15.83:0/228731036 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c7cd642b10 0x55c7cd6551e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdb70009fd0 tx=0x7fdb700227d0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.072+0000 7fdb8867cb80 1 -- 172.21.15.83:0/228731036 shutdown_connections 2024-04-01T06:56:49.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.072+0000 7fdb8867cb80 1 --2- 172.21.15.83:0/228731036 >> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] conn(0x55c7cd6c2790 0x55c7cd6c4b80 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.072+0000 7fdb8867cb80 1 --2- 172.21.15.83:0/228731036 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c7cd656490 0x55c7cd652e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.072+0000 7fdb8867cb80 1 --2- 172.21.15.83:0/228731036 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c7cd642b10 0x55c7cd6551e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.072+0000 7fdb8867cb80 1 --2- 172.21.15.83:0/228731036 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c7cd6441c0 0x55c7cd652890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.072+0000 7fdb5dffb700 0 client.25195 ms_handle_reset on v2:172.21.15.145:6834/3104241497 2024-04-01T06:56:49.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.072+0000 7fdb8867cb80 1 -- 172.21.15.83:0/228731036 >> 172.21.15.83:0/228731036 conn(0x55c7cd5a26a0 msgr2=0x55c7cd645b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:49.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.073+0000 7fdb8867cb80 1 -- 172.21.15.83:0/228731036 shutdown_connections 2024-04-01T06:56:49.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.073+0000 7fdb8867cb80 1 -- 172.21.15.83:0/228731036 wait complete. 2024-04-01T06:56:49.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.073+0000 7fdb8867cb80 20 client.25195 trim_cache size 0 max 16384 2024-04-01T06:56:49.077 INFO:teuthology.orchestra.run.smithi083.stdout:[] 2024-04-01T06:56:49.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.073+0000 7fdb7c4e6700 1 -- 172.21.15.83:0/3369567301 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fdb600a1430 msgr2=0x7fdb600a38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:49.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.073+0000 7fdb7c4e6700 1 --2- 172.21.15.83:0/3369567301 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fdb600a1430 0x7fdb600a38f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdb74198630 tx=0x7fdb64009260 comp rx=0 tx=0).stop 2024-04-01T06:56:49.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.073+0000 7fdb7c4e6700 1 -- 172.21.15.83:0/3369567301 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdb741003d0 msgr2=0x7fdb74197130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:49.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.073+0000 7fdb7c4e6700 1 --2- 172.21.15.83:0/3369567301 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdb741003d0 0x7fdb74197130 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdb7000f690 tx=0x7fdb7000bfd0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.073+0000 7fdb7c4e6700 1 -- 172.21.15.83:0/3369567301 shutdown_connections 2024-04-01T06:56:49.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.073+0000 7fdb7c4e6700 1 --2- 172.21.15.83:0/3369567301 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fdb600a1430 0x7fdb600a38f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.073+0000 7fdb7c4e6700 1 --2- 172.21.15.83:0/3369567301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb74104c20 0x7fdb7419b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.073+0000 7fdb7c4e6700 1 --2- 172.21.15.83:0/3369567301 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdb741003d0 0x7fdb74197130 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.073+0000 7fdb7c4e6700 1 --2- 172.21.15.83:0/3369567301 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdb74100d90 0x7fdb74197670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.073+0000 7fdb7c4e6700 1 -- 172.21.15.83:0/3369567301 >> 172.21.15.83:0/3369567301 conn(0x7fdb740761e0 msgr2=0x7fdb74102d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:49.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.073+0000 7fdb7c4e6700 1 -- 172.21.15.83:0/3369567301 shutdown_connections 2024-04-01T06:56:49.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.074+0000 7fdb7c4e6700 1 -- 172.21.15.83:0/3369567301 wait complete. 2024-04-01T06:56:49.088 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:56:48 smithi083 ceph-mon[43429]: pgmap v30: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-04-01T06:56:49.089 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-01T06:56:49.089 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-01T06:56:49.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:56:48 smithi153 ceph-mon[48187]: pgmap v30: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-04-01T06:56:49.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.226+0000 7f6648b90700 1 -- 172.21.15.83:0/2015967656 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6644100800 msgr2=0x7f6644104830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:49.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.226+0000 7f6648b90700 1 --2- 172.21.15.83:0/2015967656 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6644100800 0x7f6644104830 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f66380098f0 tx=0x7f6638009c00 comp rx=0 tx=0).stop 2024-04-01T06:56:49.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.226+0000 7f6648b90700 1 -- 172.21.15.83:0/2015967656 shutdown_connections 2024-04-01T06:56:49.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.226+0000 7f6648b90700 1 --2- 172.21.15.83:0/2015967656 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6644104f60 0x7f664410cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.226+0000 7f6648b90700 1 --2- 172.21.15.83:0/2015967656 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66440ffe50 0x7f6644100230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.226+0000 7f6648b90700 1 --2- 172.21.15.83:0/2015967656 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6644100800 0x7f6644104830 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.226+0000 7f6648b90700 1 -- 172.21.15.83:0/2015967656 >> 172.21.15.83:0/2015967656 conn(0x7f6644076d40 msgr2=0x7f6644077150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:49.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.226+0000 7f6648b90700 1 -- 172.21.15.83:0/2015967656 shutdown_connections 2024-04-01T06:56:49.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.226+0000 7f6648b90700 1 -- 172.21.15.83:0/2015967656 wait complete. 2024-04-01T06:56:49.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.227+0000 7f6648b90700 1 Processor -- start 2024-04-01T06:56:49.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.227+0000 7f6648b90700 1 -- start start 2024-04-01T06:56:49.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.227+0000 7f6648b90700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f66440ffe50 0x7f6644199480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:49.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.227+0000 7f6648b90700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6644104f60 0x7f66441999c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:49.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.227+0000 7f6648b90700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f664419dd10 0x7f664419e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:49.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.227+0000 7f6648b90700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f664419e790 con 0x7f6644104f60 2024-04-01T06:56:49.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.227+0000 7f6648b90700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f664419e900 con 0x7f66440ffe50 2024-04-01T06:56:49.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.227+0000 7f6648b90700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f664419eac0 con 0x7f664419dd10 2024-04-01T06:56:49.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.228+0000 7f6641d9b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6644104f60 0x7f66441999c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:49.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.228+0000 7f664259c700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f66440ffe50 0x7f6644199480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:49.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.228+0000 7f6641d9b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6644104f60 0x7f66441999c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58204/0 (socket says 172.21.15.83:58204) 2024-04-01T06:56:49.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.228+0000 7f664259c700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f66440ffe50 0x7f6644199480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.83:53120/0 (socket says 172.21.15.83:53120) 2024-04-01T06:56:49.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.228+0000 7f6641d9b700 1 -- 172.21.15.83:0/4203503080 learned_addr learned my addr 172.21.15.83:0/4203503080 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:49.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.228+0000 7f6642d9d700 1 --2- 172.21.15.83:0/4203503080 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f664419dd10 0x7f664419e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:49.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.228+0000 7f6641d9b700 1 -- 172.21.15.83:0/4203503080 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f664419dd10 msgr2=0x7f664419e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:49.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.228+0000 7f6641d9b700 1 --2- 172.21.15.83:0/4203503080 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f664419dd10 0x7f664419e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.228+0000 7f6641d9b700 1 -- 172.21.15.83:0/4203503080 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f66440ffe50 msgr2=0x7f6644199480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:49.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.228+0000 7f6641d9b700 1 --2- 172.21.15.83:0/4203503080 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f66440ffe50 0x7f6644199480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.228+0000 7f6641d9b700 1 -- 172.21.15.83:0/4203503080 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f663400b800 con 0x7f6644104f60 2024-04-01T06:56:49.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.228+0000 7f664259c700 1 --2- 172.21.15.83:0/4203503080 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f66440ffe50 0x7f6644199480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T06:56:49.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.228+0000 7f6641d9b700 1 --2- 172.21.15.83:0/4203503080 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6644104f60 0x7f66441999c0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f6638009230 tx=0x7f663800fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:49.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.228+0000 7f66337fe700 1 -- 172.21.15.83:0/4203503080 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663801c070 con 0x7f6644104f60 2024-04-01T06:56:49.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.228+0000 7f6648b90700 1 -- 172.21.15.83:0/4203503080 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6638009520 con 0x7f6644104f60 2024-04-01T06:56:49.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.228+0000 7f66337fe700 1 -- 172.21.15.83:0/4203503080 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f663800bba0 con 0x7f6644104f60 2024-04-01T06:56:49.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.228+0000 7f66337fe700 1 -- 172.21.15.83:0/4203503080 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66380038c0 con 0x7f6644104f60 2024-04-01T06:56:49.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.229+0000 7f6648b90700 1 -- 172.21.15.83:0/4203503080 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66441a6250 con 0x7f6644104f60 2024-04-01T06:56:49.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.232+0000 7f6654d26b80 1 Processor -- start 2024-04-01T06:56:49.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.232+0000 7f6654d26b80 1 -- start start 2024-04-01T06:56:49.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.233+0000 7f6654d26b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a07a9ed5d0 0x55a07a9ed9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:49.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.233+0000 7f6654d26b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a07a9edef0 0x55a07a9f88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:49.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.233+0000 7f6654d26b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a07a9f8df0 0x55a07a9fb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:49.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.233+0000 7f6654d26b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a07a946990 con 0x55a07a9f8df0 2024-04-01T06:56:49.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.233+0000 7f6654d26b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a07a944350 con 0x55a07a9ed5d0 2024-04-01T06:56:49.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.233+0000 7f6654d26b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a07a93fc40 con 0x55a07a9edef0 2024-04-01T06:56:49.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.233+0000 7f6641d9b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a07a9f8df0 0x55a07a9fb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:49.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.233+0000 7f6641d9b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a07a9f8df0 0x55a07a9fb1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58222/0 (socket says 172.21.15.83:58222) 2024-04-01T06:56:49.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.233+0000 7f6641d9b700 1 -- 172.21.15.83:0/1229959665 learned_addr learned my addr 172.21.15.83:0/1229959665 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:49.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.233+0000 7f6642d9d700 1 --2- 172.21.15.83:0/1229959665 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a07a9ed5d0 0x55a07a9ed9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:49.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.233+0000 7f664259c700 1 --2- 172.21.15.83:0/1229959665 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a07a9edef0 0x55a07a9f88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:49.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.233+0000 7f66337fe700 1 -- 172.21.15.83:0/4203503080 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) v1 ==== 136098+0+0 (secure 0 0 0) 0x7f6638020070 con 0x7f6644104f60 2024-04-01T06:56:49.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.233+0000 7f6641d9b700 1 -- 172.21.15.83:0/1229959665 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a07a9edef0 msgr2=0x55a07a9f88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:49.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.233+0000 7f6641d9b700 1 --2- 172.21.15.83:0/1229959665 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a07a9edef0 0x55a07a9f88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.233+0000 7f6641d9b700 1 -- 172.21.15.83:0/1229959665 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a07a9ed5d0 msgr2=0x55a07a9ed9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:49.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.233+0000 7f6641d9b700 1 --2- 172.21.15.83:0/1229959665 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a07a9ed5d0 0x55a07a9ed9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.233+0000 7f6641d9b700 1 -- 172.21.15.83:0/1229959665 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a07a7c13b0 con 0x55a07a9f8df0 2024-04-01T06:56:49.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.234+0000 7f6641d9b700 1 --2- 172.21.15.83:0/1229959665 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a07a9f8df0 0x55a07a9fb1e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f66380cb070 tx=0x7f66380d39c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fcb30d02ab93d39 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:49.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.234+0000 7f664259c700 1 --2- 172.21.15.83:0/1229959665 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a07a9edef0 0x55a07a9f88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:56:49.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.234+0000 7f6630ff9700 1 -- 172.21.15.83:0/1229959665 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66380d7630 con 0x55a07a9f8df0 2024-04-01T06:56:49.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.234+0000 7f6630ff9700 1 -- 172.21.15.83:0/1229959665 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f66380d7c50 con 0x55a07a9f8df0 2024-04-01T06:56:49.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.234+0000 7f6630ff9700 1 -- 172.21.15.83:0/1229959665 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66380d8aa0 con 0x55a07a9f8df0 2024-04-01T06:56:49.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.234+0000 7f66337fe700 1 --2- 172.21.15.83:0/4203503080 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f662c0a1430 0x7f662c0a38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:49.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.234+0000 7f6642d9d700 1 --2- 172.21.15.83:0/4203503080 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f662c0a1430 0x7f662c0a38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:49.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.234+0000 7f66337fe700 1 -- 172.21.15.83:0/4203503080 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f66380cda10 con 0x7f6644104f60 2024-04-01T06:56:49.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.235+0000 7f6642d9d700 1 --2- 172.21.15.83:0/4203503080 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f662c0a1430 0x7f662c0a38f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f663c009d90 tx=0x7f663c009040 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:49.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.235+0000 7f6654d26b80 1 -- 172.21.15.83:0/1229959665 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a07a9f8df0 msgr2=0x55a07a9fb1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:49.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.235+0000 7f6654d26b80 1 --2- 172.21.15.83:0/1229959665 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a07a9f8df0 0x55a07a9fb1e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f66380cb070 tx=0x7f66380d39c0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.235+0000 7f6654d26b80 1 -- 172.21.15.83:0/1229959665 shutdown_connections 2024-04-01T06:56:49.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.235+0000 7f6654d26b80 1 --2- 172.21.15.83:0/1229959665 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a07a9f8df0 0x55a07a9fb1e0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.235+0000 7f6654d26b80 1 --2- 172.21.15.83:0/1229959665 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a07a9ed5d0 0x55a07a9ed9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.235+0000 7f6654d26b80 1 --2- 172.21.15.83:0/1229959665 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a07a9edef0 0x55a07a9f88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.235+0000 7f6654d26b80 1 -- 172.21.15.83:0/1229959665 >> 172.21.15.83:0/1229959665 conn(0x55a07a94d6a0 msgr2=0x55a07a9e9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:49.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.235+0000 7f6654d26b80 1 -- 172.21.15.83:0/1229959665 shutdown_connections 2024-04-01T06:56:49.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.235+0000 7f6654d26b80 1 -- 172.21.15.83:0/1229959665 wait complete. 2024-04-01T06:56:49.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.235+0000 7f6654d26b80 1 -- start start 2024-04-01T06:56:49.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.235+0000 7f6654d26b80 1 Processor -- start 2024-04-01T06:56:49.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.236+0000 7f6654d26b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a07a9ed5d0 0x55a07a9f8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:49.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.236+0000 7f6654d26b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a07a9edef0 0x55a07a9f5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:49.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.236+0000 7f6654d26b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a07a9f8df0 0x55a07a9f60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:49.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.236+0000 7f6654d26b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a07a8dbd80 con 0x55a07a9edef0 2024-04-01T06:56:49.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.236+0000 7f6654d26b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a07a8dba20 con 0x55a07a9f8df0 2024-04-01T06:56:49.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.236+0000 7f6654d26b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a07a7c36a0 con 0x55a07a9ed5d0 2024-04-01T06:56:49.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.236+0000 7f6654d26b80 10 client.0 _ll_register_callbacks cb 0x55a07a8e5470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:56:49.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.236+0000 7f6641d9b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a07a9edef0 0x55a07a9f5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:49.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.236+0000 7f6641d9b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a07a9edef0 0x55a07a9f5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58228/0 (socket says 172.21.15.83:58228) 2024-04-01T06:56:49.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.236+0000 7f6641d9b700 1 -- 172.21.15.83:0/1390627937 learned_addr learned my addr 172.21.15.83:0/1390627937 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:49.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.236+0000 7f664259c700 1 --2- 172.21.15.83:0/1390627937 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a07a9ed5d0 0x55a07a9f8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:49.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.236+0000 7f6642d9d700 1 --2- 172.21.15.83:0/1390627937 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a07a9f8df0 0x55a07a9f60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:49.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.236+0000 7f6641d9b700 1 -- 172.21.15.83:0/1390627937 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a07a9ed5d0 msgr2=0x55a07a9f8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:49.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.236+0000 7f6641d9b700 1 --2- 172.21.15.83:0/1390627937 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a07a9ed5d0 0x55a07a9f8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.236+0000 7f6641d9b700 1 -- 172.21.15.83:0/1390627937 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a07a9f8df0 msgr2=0x55a07a9f60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:49.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.236+0000 7f6641d9b700 1 --2- 172.21.15.83:0/1390627937 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a07a9f8df0 0x55a07a9f60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.236+0000 7f6641d9b700 1 -- 172.21.15.83:0/1390627937 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66441a6250 con 0x55a07a9edef0 2024-04-01T06:56:49.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.236+0000 7f6641d9b700 1 --2- 172.21.15.83:0/1390627937 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a07a9edef0 0x55a07a9f5b70 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f6638096e60 tx=0x7f6638005550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9647aef01f3fc711 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:49.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.236+0000 7f6629ffb700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:56:49.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.237+0000 7f6629ffb700 1 -- 172.21.15.83:0/1390627937 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66380cdc20 con 0x55a07a9edef0 2024-04-01T06:56:49.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.237+0000 7f6654d26b80 1 -- 172.21.15.83:0/1390627937 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a07a900380 con 0x55a07a9edef0 2024-04-01T06:56:49.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.237+0000 7f6629ffb700 1 -- 172.21.15.83:0/1390627937 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f66380d7dc0 con 0x55a07a9edef0 2024-04-01T06:56:49.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.237+0000 7f6629ffb700 1 -- 172.21.15.83:0/1390627937 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6638096ca0 con 0x55a07a9edef0 2024-04-01T06:56:49.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.237+0000 7f6654d26b80 10 client.15741 fetch_fsmap learned FSMap version 24 2024-04-01T06:56:49.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.237+0000 7f6654d26b80 1 -- 172.21.15.83:0/1390627937 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55a07a76db60 con 0x55a07a9edef0 2024-04-01T06:56:49.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.237+0000 7f6629ffb700 1 -- 172.21.15.83:0/1390627937 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a07a900380 con 0x55a07a9edef0 2024-04-01T06:56:49.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.237+0000 7f6629ffb700 1 -- 172.21.15.83:0/1390627937 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f6638097070 con 0x55a07a9edef0 2024-04-01T06:56:49.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.237+0000 7f6654d26b80 10 client.15741 fetch_fsmap finished waiting for FSMap version 24 2024-04-01T06:56:49.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.237+0000 7f6654d26b80 10 client.15741 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-04-01T06:56:49.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.237+0000 7f6654d26b80 20 client.15741 populate_metadata read hostname 'smithi083' 2024-04-01T06:56:49.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.237+0000 7f6654d26b80 1 --2- 172.21.15.83:0/1390627937 >> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] conn(0x55a07aa08100 0x55a07aa0a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:49.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.237+0000 7f6654d26b80 4 client.15741 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-01T06:56:49.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.237+0000 7f6654d26b80 1 -- 172.21.15.83:0/1390627937 --> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a07a938700 con 0x55a07aa08100 2024-04-01T06:56:49.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.238+0000 7f664259c700 1 --2- 172.21.15.83:0/1390627937 >> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] conn(0x55a07aa08100 0x55a07aa0a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:49.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.238+0000 7f6629ffb700 10 client.15741 ms_handle_connect on v2:172.21.15.145:6836/2687798317 2024-04-01T06:56:49.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.238+0000 7f664259c700 1 --2- 172.21.15.83:0/1390627937 >> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] conn(0x55a07aa08100 0x55a07aa0a520 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=47862e26d6685a97 server_cookie=a51d9e06626f764a in_seq=0 out_seq=0 2024-04-01T06:56:49.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.239+0000 7f6629ffb700 1 -- 172.21.15.83:0/1390627937 <== mds.1 v2:172.21.15.145:6836/2687798317 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a07a938700 con 0x55a07aa08100 2024-04-01T06:56:49.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.239+0000 7f6629ffb700 10 client.15741 handle_command_reply: tid=0 2024-04-01T06:56:49.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.239+0000 7f6654d26b80 1 client.15741 shutdown 2024-04-01T06:56:49.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.239+0000 7f6654d26b80 1 -- 172.21.15.83:0/1390627937 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a07a9edef0 msgr2=0x55a07a9f5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:49.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.239+0000 7f6654d26b80 1 --2- 172.21.15.83:0/1390627937 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a07a9edef0 0x55a07a9f5b70 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f6638096e60 tx=0x7f6638005550 comp rx=0 tx=0).stop 2024-04-01T06:56:49.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.239+0000 7f6654d26b80 1 -- 172.21.15.83:0/1390627937 shutdown_connections 2024-04-01T06:56:49.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.239+0000 7f6654d26b80 1 --2- 172.21.15.83:0/1390627937 >> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] conn(0x55a07aa08100 0x55a07aa0a520 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.239+0000 7f6654d26b80 1 --2- 172.21.15.83:0/1390627937 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a07a9f8df0 0x55a07a9f60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.239+0000 7f6654d26b80 1 --2- 172.21.15.83:0/1390627937 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a07a9ed5d0 0x55a07a9f8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.239+0000 7f6654d26b80 1 --2- 172.21.15.83:0/1390627937 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a07a9edef0 0x55a07a9f5b70 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.239+0000 7f6629ffb700 0 client.15741 ms_handle_reset on v2:172.21.15.145:6836/2687798317 2024-04-01T06:56:49.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.239+0000 7f6654d26b80 1 -- 172.21.15.83:0/1390627937 >> 172.21.15.83:0/1390627937 conn(0x55a07a94d6a0 msgr2=0x55a07a9ef6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:49.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.239+0000 7f6654d26b80 1 -- 172.21.15.83:0/1390627937 shutdown_connections 2024-04-01T06:56:49.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.239+0000 7f6654d26b80 1 -- 172.21.15.83:0/1390627937 wait complete. 2024-04-01T06:56:49.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.239+0000 7f6654d26b80 20 client.15741 trim_cache size 0 max 16384 2024-04-01T06:56:49.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:56:48 smithi145 ceph-mon[47816]: pgmap v30: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-04-01T06:56:49.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.260+0000 7f6654d26b80 1 Processor -- start 2024-04-01T06:56:49.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.260+0000 7f6654d26b80 1 -- start start 2024-04-01T06:56:49.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.260+0000 7f6654d26b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a07a9ed5d0 0x55a07a9e5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:49.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.260+0000 7f6654d26b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a07a9edef0 0x55a07a9ff7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:49.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.260+0000 7f6654d26b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a07a9f8df0 0x55a07a9e25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:49.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.260+0000 7f6654d26b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a07a9eb190 con 0x55a07a9f8df0 2024-04-01T06:56:49.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.260+0000 7f6654d26b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a07a9ee850 con 0x55a07a9ed5d0 2024-04-01T06:56:49.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.260+0000 7f6654d26b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a07a9ef140 con 0x55a07a9edef0 2024-04-01T06:56:49.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.261+0000 7f6642d9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a07a9f8df0 0x55a07a9e25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:49.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.261+0000 7f6642d9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a07a9f8df0 0x55a07a9e25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58240/0 (socket says 172.21.15.83:58240) 2024-04-01T06:56:49.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.261+0000 7f6642d9d700 1 -- 172.21.15.83:0/120730547 learned_addr learned my addr 172.21.15.83:0/120730547 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:49.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.261+0000 7f664259c700 1 --2- 172.21.15.83:0/120730547 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a07a9ed5d0 0x55a07a9e5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:49.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.261+0000 7f6642d9d700 1 -- 172.21.15.83:0/120730547 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a07a9edef0 msgr2=0x55a07a9ff7e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-01T06:56:49.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.261+0000 7f6642d9d700 1 --2- 172.21.15.83:0/120730547 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a07a9edef0 0x55a07a9ff7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.261+0000 7f6642d9d700 1 -- 172.21.15.83:0/120730547 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a07a9ed5d0 msgr2=0x55a07a9e5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:49.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.261+0000 7f6642d9d700 1 --2- 172.21.15.83:0/120730547 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a07a9ed5d0 0x55a07a9e5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.261+0000 7f6642d9d700 1 -- 172.21.15.83:0/120730547 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a07a905ea0 con 0x55a07a9f8df0 2024-04-01T06:56:49.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.261+0000 7f6642d9d700 1 --2- 172.21.15.83:0/120730547 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a07a9f8df0 0x55a07a9e25a0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f663c018790 tx=0x7f663c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=609556fb56af40de server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:49.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.261+0000 7f66317fa700 1 -- 172.21.15.83:0/120730547 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663c018dd0 con 0x55a07a9f8df0 2024-04-01T06:56:49.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.261+0000 7f66317fa700 1 -- 172.21.15.83:0/120730547 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f663c01c070 con 0x55a07a9f8df0 2024-04-01T06:56:49.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.261+0000 7f66317fa700 1 -- 172.21.15.83:0/120730547 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663c0247f0 con 0x55a07a9f8df0 2024-04-01T06:56:49.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.262+0000 7f6654d26b80 1 -- 172.21.15.83:0/120730547 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a07a9f8df0 msgr2=0x55a07a9e25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:49.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.262+0000 7f6654d26b80 1 --2- 172.21.15.83:0/120730547 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a07a9f8df0 0x55a07a9e25a0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f663c018790 tx=0x7f663c015000 comp rx=0 tx=0).stop 2024-04-01T06:56:49.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.262+0000 7f6654d26b80 1 -- 172.21.15.83:0/120730547 shutdown_connections 2024-04-01T06:56:49.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.262+0000 7f6654d26b80 1 --2- 172.21.15.83:0/120730547 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a07a9f8df0 0x55a07a9e25a0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.262+0000 7f6654d26b80 1 --2- 172.21.15.83:0/120730547 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a07a9ed5d0 0x55a07a9e5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.262+0000 7f6654d26b80 1 --2- 172.21.15.83:0/120730547 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a07a9edef0 0x55a07a9ff7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.262+0000 7f6654d26b80 1 -- 172.21.15.83:0/120730547 >> 172.21.15.83:0/120730547 conn(0x55a07a94d6a0 msgr2=0x55a07a9e2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:49.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.262+0000 7f6654d26b80 1 -- 172.21.15.83:0/120730547 shutdown_connections 2024-04-01T06:56:49.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.262+0000 7f6654d26b80 1 -- 172.21.15.83:0/120730547 wait complete. 2024-04-01T06:56:49.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.263+0000 7f6654d26b80 1 -- start start 2024-04-01T06:56:49.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.263+0000 7f6654d26b80 1 Processor -- start 2024-04-01T06:56:49.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.263+0000 7f6654d26b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a07a9ed5d0 0x55a07a9ff560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:49.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.263+0000 7f6654d26b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a07a9edef0 0x55a07a9fdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:49.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.263+0000 7f6654d26b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a07a9f8df0 0x55a07a9fe110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:49.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.263+0000 7f6654d26b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a07a9fe820 con 0x55a07a9f8df0 2024-04-01T06:56:49.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.263+0000 7f6654d26b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a07a9fe990 con 0x55a07a9edef0 2024-04-01T06:56:49.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.263+0000 7f6654d26b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a07aa5bf00 con 0x55a07a9ed5d0 2024-04-01T06:56:49.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.263+0000 7f6654d26b80 10 client.0 _ll_register_callbacks cb 0x55a07a8e5470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:56:49.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.263+0000 7f6642d9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a07a9f8df0 0x55a07a9fe110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:49.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.263+0000 7f6642d9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a07a9f8df0 0x55a07a9fe110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58242/0 (socket says 172.21.15.83:58242) 2024-04-01T06:56:49.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.263+0000 7f6642d9d700 1 -- 172.21.15.83:0/614702364 learned_addr learned my addr 172.21.15.83:0/614702364 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:49.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.263+0000 7f664259c700 1 --2- 172.21.15.83:0/614702364 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a07a9ed5d0 0x55a07a9ff560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:49.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.263+0000 7f6642d9d700 1 -- 172.21.15.83:0/614702364 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a07a9ed5d0 msgr2=0x55a07a9ff560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:49.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.263+0000 7f6642d9d700 1 --2- 172.21.15.83:0/614702364 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a07a9ed5d0 0x55a07a9ff560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.263+0000 7f6642d9d700 1 -- 172.21.15.83:0/614702364 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a07a9edef0 msgr2=0x55a07a9fdbd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-01T06:56:49.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.263+0000 7f6642d9d700 1 --2- 172.21.15.83:0/614702364 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a07a9edef0 0x55a07a9fdbd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.264+0000 7f6642d9d700 1 -- 172.21.15.83:0/614702364 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f663c018470 con 0x55a07a9f8df0 2024-04-01T06:56:49.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.264+0000 7f664259c700 1 --2- 172.21.15.83:0/614702364 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a07a9ed5d0 0x55a07a9ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T06:56:49.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.264+0000 7f6642d9d700 1 --2- 172.21.15.83:0/614702364 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a07a9f8df0 0x55a07a9fe110 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f663c007b70 tx=0x7f663c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd73b9af9b7bde76 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:49.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.264+0000 7f6629ffb700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:56:49.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.264+0000 7f6629ffb700 1 -- 172.21.15.83:0/614702364 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663c032070 con 0x55a07a9f8df0 2024-04-01T06:56:49.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.264+0000 7f6654d26b80 1 -- 172.21.15.83:0/614702364 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f66380d7c50 con 0x55a07a9f8df0 2024-04-01T06:56:49.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.264+0000 7f6629ffb700 1 -- 172.21.15.83:0/614702364 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f663c004e20 con 0x55a07a9f8df0 2024-04-01T06:56:49.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.264+0000 7f6629ffb700 1 -- 172.21.15.83:0/614702364 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f663c003a00 con 0x55a07a9f8df0 2024-04-01T06:56:49.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.264+0000 7f6654d26b80 10 client.15747 fetch_fsmap learned FSMap version 24 2024-04-01T06:56:49.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.264+0000 7f6654d26b80 1 -- 172.21.15.83:0/614702364 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55a07a7c5cd0 con 0x55a07a9f8df0 2024-04-01T06:56:49.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.265+0000 7f6629ffb700 1 -- 172.21.15.83:0/614702364 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f663c044080 con 0x55a07a9f8df0 2024-04-01T06:56:49.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.265+0000 7f6629ffb700 1 -- 172.21.15.83:0/614702364 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f663c03e030 con 0x55a07a9f8df0 2024-04-01T06:56:49.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.265+0000 7f6654d26b80 10 client.15747 fetch_fsmap finished waiting for FSMap version 24 2024-04-01T06:56:49.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.265+0000 7f6654d26b80 10 client.15747 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-04-01T06:56:49.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.265+0000 7f6654d26b80 20 client.15747 populate_metadata read hostname 'smithi083' 2024-04-01T06:56:49.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.265+0000 7f6654d26b80 1 --2- 172.21.15.83:0/614702364 >> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] conn(0x55a07aa5d4c0 0x55a07aa5f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:49.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.265+0000 7f6654d26b80 4 client.15747 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-01T06:56:49.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.265+0000 7f6654d26b80 1 -- 172.21.15.83:0/614702364 --> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55a07a78ecf0 con 0x55a07aa5d4c0 2024-04-01T06:56:49.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.265+0000 7f664259c700 1 --2- 172.21.15.83:0/614702364 >> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] conn(0x55a07aa5d4c0 0x55a07aa5f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:49.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.266+0000 7f6629ffb700 10 client.15747 ms_handle_connect on v2:172.21.15.145:6836/2687798317 2024-04-01T06:56:49.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.266+0000 7f664259c700 1 --2- 172.21.15.83:0/614702364 >> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] conn(0x55a07aa5d4c0 0x55a07aa5f8e0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=367c720a6e5511b9 server_cookie=4e545183ca1879c in_seq=0 out_seq=0 2024-04-01T06:56:49.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.266+0000 7f6629ffb700 1 -- 172.21.15.83:0/614702364 <== mds.1 v2:172.21.15.145:6836/2687798317 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55a07a78ecf0 con 0x55a07aa5d4c0 2024-04-01T06:56:49.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.266+0000 7f6629ffb700 10 client.15747 handle_command_reply: tid=0 2024-04-01T06:56:49.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.266+0000 7f6654d26b80 1 client.15747 shutdown 2024-04-01T06:56:49.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.266+0000 7f6654d26b80 1 -- 172.21.15.83:0/614702364 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a07a9f8df0 msgr2=0x55a07a9fe110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:49.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.266+0000 7f6654d26b80 1 --2- 172.21.15.83:0/614702364 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a07a9f8df0 0x55a07a9fe110 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f663c007b70 tx=0x7f663c004ad0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.266+0000 7f6654d26b80 1 -- 172.21.15.83:0/614702364 shutdown_connections 2024-04-01T06:56:49.272 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.266+0000 7f6654d26b80 1 --2- 172.21.15.83:0/614702364 >> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] conn(0x55a07aa5d4c0 0x55a07aa5f8e0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.266+0000 7f6654d26b80 1 --2- 172.21.15.83:0/614702364 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a07a9f8df0 0x55a07a9fe110 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.266+0000 7f6654d26b80 1 --2- 172.21.15.83:0/614702364 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a07a9ed5d0 0x55a07a9ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.266+0000 7f6654d26b80 1 --2- 172.21.15.83:0/614702364 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a07a9edef0 0x55a07a9fdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.266+0000 7f6654d26b80 1 -- 172.21.15.83:0/614702364 >> 172.21.15.83:0/614702364 conn(0x55a07a94d6a0 msgr2=0x55a07a9f0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:49.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.266+0000 7f6629ffb700 0 client.15747 ms_handle_reset on v2:172.21.15.145:6836/2687798317 2024-04-01T06:56:49.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.266+0000 7f6654d26b80 1 -- 172.21.15.83:0/614702364 shutdown_connections 2024-04-01T06:56:49.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.266+0000 7f6654d26b80 1 -- 172.21.15.83:0/614702364 wait complete. 2024-04-01T06:56:49.273 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.267+0000 7f6654d26b80 20 client.15747 trim_cache size 0 max 16384 2024-04-01T06:56:49.273 INFO:teuthology.orchestra.run.smithi083.stdout:[] 2024-04-01T06:56:49.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.268+0000 7f6648b90700 1 -- 172.21.15.83:0/4203503080 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f662c0a1430 msgr2=0x7f662c0a38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:49.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.268+0000 7f6648b90700 1 --2- 172.21.15.83:0/4203503080 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f662c0a1430 0x7f662c0a38f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f663c009d90 tx=0x7f663c009040 comp rx=0 tx=0).stop 2024-04-01T06:56:49.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.268+0000 7f6648b90700 1 -- 172.21.15.83:0/4203503080 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6644104f60 msgr2=0x7f66441999c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:49.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.268+0000 7f6648b90700 1 --2- 172.21.15.83:0/4203503080 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6644104f60 0x7f66441999c0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f6638009230 tx=0x7f663800fa00 comp rx=0 tx=0).stop 2024-04-01T06:56:49.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.268+0000 7f6648b90700 1 -- 172.21.15.83:0/4203503080 shutdown_connections 2024-04-01T06:56:49.274 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.268+0000 7f6648b90700 1 --2- 172.21.15.83:0/4203503080 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f662c0a1430 0x7f662c0a38f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.268+0000 7f6648b90700 1 --2- 172.21.15.83:0/4203503080 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f664419dd10 0x7f664419e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.268+0000 7f6648b90700 1 --2- 172.21.15.83:0/4203503080 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f66440ffe50 0x7f6644199480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.268+0000 7f6648b90700 1 --2- 172.21.15.83:0/4203503080 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6644104f60 0x7f66441999c0 secure :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f6638009230 tx=0x7f663800fa00 comp rx=0 tx=0).stop 2024-04-01T06:56:49.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.268+0000 7f6648b90700 1 -- 172.21.15.83:0/4203503080 >> 172.21.15.83:0/4203503080 conn(0x7f6644076d40 msgr2=0x7f66440fe070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:49.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.268+0000 7f6648b90700 1 -- 172.21.15.83:0/4203503080 shutdown_connections 2024-04-01T06:56:49.275 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.268+0000 7f6648b90700 1 -- 172.21.15.83:0/4203503080 wait complete. 2024-04-01T06:56:49.279 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-01T06:56:49.279 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-01T06:56:49.409 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.409+0000 7f3b87a2f700 1 -- 172.21.15.83:0/3769559875 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b80067e30 msgr2=0x7f3b800682b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:49.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.409+0000 7f3b87a2f700 1 --2- 172.21.15.83:0/3769559875 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b80067e30 0x7f3b800682b0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f3b70009990 tx=0x7f3b70009ca0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.409+0000 7f3b87a2f700 1 -- 172.21.15.83:0/3769559875 shutdown_connections 2024-04-01T06:56:49.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.409+0000 7f3b87a2f700 1 --2- 172.21.15.83:0/3769559875 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b800687f0 0x7f3b8010db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.409+0000 7f3b87a2f700 1 --2- 172.21.15.83:0/3769559875 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b80105ce0 0x7f3b801060c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.409+0000 7f3b87a2f700 1 --2- 172.21.15.83:0/3769559875 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b80067e30 0x7f3b800682b0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.409+0000 7f3b87a2f700 1 -- 172.21.15.83:0/3769559875 >> 172.21.15.83:0/3769559875 conn(0x7f3b80076d40 msgr2=0x7f3b80077150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:49.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.409+0000 7f3b87a2f700 1 -- 172.21.15.83:0/3769559875 shutdown_connections 2024-04-01T06:56:49.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.409+0000 7f3b87a2f700 1 -- 172.21.15.83:0/3769559875 wait complete. 2024-04-01T06:56:49.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.409+0000 7f3b87a2f700 1 Processor -- start 2024-04-01T06:56:49.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.409+0000 7f3b87a2f700 1 -- start start 2024-04-01T06:56:49.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.410+0000 7f3b87a2f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b80067e30 0x7f3b80197250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:49.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.410+0000 7f3b87a2f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b800687f0 0x7f3b80197790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:49.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.410+0000 7f3b87a2f700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b80105ce0 0x7f3b8019bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:49.411 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.410+0000 7f3b87a2f700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8019c170 con 0x7f3b800687f0 2024-04-01T06:56:49.411 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.410+0000 7f3b87a2f700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8019c2e0 con 0x7f3b80105ce0 2024-04-01T06:56:49.411 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.410+0000 7f3b87a2f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8019c4a0 con 0x7f3b80067e30 2024-04-01T06:56:49.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.410+0000 7f3b857cb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b80067e30 0x7f3b80197250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:49.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.410+0000 7f3b857cb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b80067e30 0x7f3b80197250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.83:54324/0 (socket says 172.21.15.83:54324) 2024-04-01T06:56:49.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.410+0000 7f3b857cb700 1 -- 172.21.15.83:0/3947078390 learned_addr learned my addr 172.21.15.83:0/3947078390 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:49.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.410+0000 7f3b85fcc700 1 --2- 172.21.15.83:0/3947078390 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b80105ce0 0x7f3b8019bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:49.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.410+0000 7f3b857cb700 1 -- 172.21.15.83:0/3947078390 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b80105ce0 msgr2=0x7f3b8019bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:49.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.410+0000 7f3b857cb700 1 --2- 172.21.15.83:0/3947078390 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b80105ce0 0x7f3b8019bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.410+0000 7f3b857cb700 1 -- 172.21.15.83:0/3947078390 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b800687f0 msgr2=0x7f3b80197790 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-01T06:56:49.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.410+0000 7f3b857cb700 1 --2- 172.21.15.83:0/3947078390 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b800687f0 0x7f3b80197790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.413 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.410+0000 7f3b857cb700 1 -- 172.21.15.83:0/3947078390 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b700095f0 con 0x7f3b80067e30 2024-04-01T06:56:49.413 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.411+0000 7f3b857cb700 1 --2- 172.21.15.83:0/3947078390 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b80067e30 0x7f3b80197250 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c00d950 tx=0x7f3b7c00dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:49.413 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.411+0000 7f3b767fc700 1 -- 172.21.15.83:0/3947078390 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c009940 con 0x7f3b80067e30 2024-04-01T06:56:49.413 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.411+0000 7f3b767fc700 1 -- 172.21.15.83:0/3947078390 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3b7c010460 con 0x7f3b80067e30 2024-04-01T06:56:49.413 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.411+0000 7f3b767fc700 1 -- 172.21.15.83:0/3947078390 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c00f620 con 0x7f3b80067e30 2024-04-01T06:56:49.413 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.411+0000 7f3b87a2f700 1 -- 172.21.15.83:0/3947078390 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b8019c720 con 0x7f3b80067e30 2024-04-01T06:56:49.413 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.411+0000 7f3b87a2f700 1 -- 172.21.15.83:0/3947078390 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b800ffd80 con 0x7f3b80067e30 2024-04-01T06:56:49.413 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.414+0000 7f3b767fc700 1 -- 172.21.15.83:0/3947078390 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) v1 ==== 136098+0+0 (secure 0 0 0) 0x7f3b7c0108d0 con 0x7f3b80067e30 2024-04-01T06:56:49.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.414+0000 7f3b767fc700 1 --2- 172.21.15.83:0/3947078390 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f3b6c0a13b0 0x7f3b6c0a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:49.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.415+0000 7f3b767fc700 1 -- 172.21.15.83:0/3947078390 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f3b7c0ccd40 con 0x7f3b80067e30 2024-04-01T06:56:49.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.416+0000 7f3b93bc5b80 1 Processor -- start 2024-04-01T06:56:49.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.416+0000 7f3b84fca700 1 --2- 172.21.15.83:0/3947078390 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f3b6c0a13b0 0x7f3b6c0a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:49.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.416+0000 7f3b93bc5b80 1 -- start start 2024-04-01T06:56:49.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.416+0000 7f3b93bc5b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5620a70405d0 0x5620a70409b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:49.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.416+0000 7f3b93bc5b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5620a7040ef0 0x5620a704b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:49.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.416+0000 7f3b93bc5b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620a704bdf0 0x5620a704e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:49.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.416+0000 7f3b93bc5b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620a6f99990 con 0x5620a70405d0 2024-04-01T06:56:49.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.416+0000 7f3b93bc5b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620a6f97350 con 0x5620a7040ef0 2024-04-01T06:56:49.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.416+0000 7f3b93bc5b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620a6f92c40 con 0x5620a704bdf0 2024-04-01T06:56:49.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.417+0000 7f3b84fca700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5620a7040ef0 0x5620a704b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:49.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.417+0000 7f3b85fcc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620a704bdf0 0x5620a704e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:49.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.417+0000 7f3b85fcc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620a704bdf0 0x5620a704e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.83:54340/0 (socket says 172.21.15.83:54340) 2024-04-01T06:56:49.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.417+0000 7f3b85fcc700 1 -- 172.21.15.83:0/4285398458 learned_addr learned my addr 172.21.15.83:0/4285398458 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:49.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.417+0000 7f3b84fca700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5620a7040ef0 0x5620a704b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.83:53172/0 (socket says 172.21.15.83:53172) 2024-04-01T06:56:49.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.417+0000 7f3b85fcc700 1 -- 172.21.15.83:0/4285398458 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5620a7040ef0 msgr2=0x5620a704b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:49.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.417+0000 7f3b85fcc700 1 --2- 172.21.15.83:0/4285398458 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5620a7040ef0 0x5620a704b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.417+0000 7f3b85fcc700 1 -- 172.21.15.83:0/4285398458 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5620a70405d0 msgr2=0x5620a70409b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:49.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.417+0000 7f3b85fcc700 1 --2- 172.21.15.83:0/4285398458 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5620a70405d0 0x5620a70409b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.417+0000 7f3b85fcc700 1 -- 172.21.15.83:0/4285398458 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5620a6e143b0 con 0x5620a704bdf0 2024-04-01T06:56:49.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.417+0000 7f3b84fca700 1 --2- 172.21.15.83:0/3947078390 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f3b6c0a13b0 0x7f3b6c0a3870 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3b70005b40 tx=0x7f3b7000be00 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:49.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.417+0000 7f3b85fcc700 1 --2- 172.21.15.83:0/4285398458 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620a704bdf0 0x5620a704e1e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3b78009970 tx=0x7f3b78009c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4878013a5b5259b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:49.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.417+0000 7f3b6b7fe700 1 -- 172.21.15.83:0/4285398458 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b780046f0 con 0x5620a704bdf0 2024-04-01T06:56:49.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.417+0000 7f3b6b7fe700 1 -- 172.21.15.83:0/4285398458 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3b7800f040 con 0x5620a704bdf0 2024-04-01T06:56:49.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.417+0000 7f3b6b7fe700 1 -- 172.21.15.83:0/4285398458 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b78015770 con 0x5620a704bdf0 2024-04-01T06:56:49.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.418+0000 7f3b93bc5b80 1 -- 172.21.15.83:0/4285398458 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620a704bdf0 msgr2=0x5620a704e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:49.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.418+0000 7f3b93bc5b80 1 --2- 172.21.15.83:0/4285398458 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620a704bdf0 0x5620a704e1e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3b78009970 tx=0x7f3b78009c80 comp rx=0 tx=0).stop 2024-04-01T06:56:49.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.418+0000 7f3b93bc5b80 1 -- 172.21.15.83:0/4285398458 shutdown_connections 2024-04-01T06:56:49.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.418+0000 7f3b93bc5b80 1 --2- 172.21.15.83:0/4285398458 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5620a70405d0 0x5620a70409b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.418+0000 7f3b93bc5b80 1 --2- 172.21.15.83:0/4285398458 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620a704bdf0 0x5620a704e1e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.418+0000 7f3b93bc5b80 1 --2- 172.21.15.83:0/4285398458 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5620a7040ef0 0x5620a704b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.418+0000 7f3b93bc5b80 1 -- 172.21.15.83:0/4285398458 >> 172.21.15.83:0/4285398458 conn(0x5620a6fa06a0 msgr2=0x5620a703ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:49.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.418+0000 7f3b93bc5b80 1 -- 172.21.15.83:0/4285398458 shutdown_connections 2024-04-01T06:56:49.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.418+0000 7f3b93bc5b80 1 -- 172.21.15.83:0/4285398458 wait complete. 2024-04-01T06:56:49.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.419+0000 7f3b93bc5b80 1 -- start start 2024-04-01T06:56:49.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.419+0000 7f3b93bc5b80 1 Processor -- start 2024-04-01T06:56:49.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.419+0000 7f3b93bc5b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5620a70405d0 0x5620a704b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:49.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.419+0000 7f3b93bc5b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620a7040ef0 0x5620a7048b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:49.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.419+0000 7f3b93bc5b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5620a704bdf0 0x5620a70492b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:49.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.419+0000 7f3b93bc5b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620a6f2ed80 con 0x5620a704bdf0 2024-04-01T06:56:49.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.419+0000 7f3b93bc5b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620a6f2ea20 con 0x5620a70405d0 2024-04-01T06:56:49.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.419+0000 7f3b93bc5b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620a6e166a0 con 0x5620a7040ef0 2024-04-01T06:56:49.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.420+0000 7f3b93bc5b80 10 client.0 _ll_register_callbacks cb 0x5620a6f38470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:56:49.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.420+0000 7f3b84fca700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620a7040ef0 0x5620a7048b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:49.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.420+0000 7f3b84fca700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620a7040ef0 0x5620a7048b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.83:54356/0 (socket says 172.21.15.83:54356) 2024-04-01T06:56:49.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.420+0000 7f3b84fca700 1 -- 172.21.15.83:0/1076970378 learned_addr learned my addr 172.21.15.83:0/1076970378 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:49.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.420+0000 7f3b857cb700 1 --2- 172.21.15.83:0/1076970378 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5620a70405d0 0x5620a704b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:49.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.420+0000 7f3b84fca700 1 -- 172.21.15.83:0/1076970378 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5620a70405d0 msgr2=0x5620a704b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:49.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.420+0000 7f3b84fca700 1 --2- 172.21.15.83:0/1076970378 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5620a70405d0 0x5620a704b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.420+0000 7f3b84fca700 1 -- 172.21.15.83:0/1076970378 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5620a704bdf0 msgr2=0x5620a70492b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:49.423 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.420+0000 7f3b84fca700 1 --2- 172.21.15.83:0/1076970378 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5620a704bdf0 0x5620a70492b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.420+0000 7f3b84fca700 1 -- 172.21.15.83:0/1076970378 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b78003c50 con 0x5620a7040ef0 2024-04-01T06:56:49.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.420+0000 7f3b84fca700 1 --2- 172.21.15.83:0/1076970378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620a7040ef0 0x5620a7048b70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3b700095c0 tx=0x7f3b70009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c85d0d9708dd90a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:49.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.420+0000 7f3b68ff9700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-04-01T06:56:49.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.421+0000 7f3b68ff9700 1 -- 172.21.15.83:0/1076970378 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7000f660 con 0x5620a7040ef0 2024-04-01T06:56:49.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.421+0000 7f3b68ff9700 1 -- 172.21.15.83:0/1076970378 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f3b7000f7c0 con 0x5620a7040ef0 2024-04-01T06:56:49.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.421+0000 7f3b93bc5b80 1 -- 172.21.15.83:0/1076970378 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5620a6f53380 con 0x5620a7040ef0 2024-04-01T06:56:49.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.421+0000 7f3b68ff9700 1 -- 172.21.15.83:0/1076970378 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b70003e50 con 0x5620a7040ef0 2024-04-01T06:56:49.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.421+0000 7f3b93bc5b80 10 client.25222 fetch_fsmap learned FSMap version 24 2024-04-01T06:56:49.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.421+0000 7f3b93bc5b80 1 -- 172.21.15.83:0/1076970378 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5620a6dc0b60 con 0x5620a7040ef0 2024-04-01T06:56:49.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.421+0000 7f3b68ff9700 1 -- 172.21.15.83:0/1076970378 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5620a6f53380 con 0x5620a7040ef0 2024-04-01T06:56:49.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.421+0000 7f3b68ff9700 1 -- 172.21.15.83:0/1076970378 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f3b70026a30 con 0x5620a7040ef0 2024-04-01T06:56:49.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.422+0000 7f3b93bc5b80 10 client.25222 fetch_fsmap finished waiting for FSMap version 24 2024-04-01T06:56:49.424 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.422+0000 7f3b93bc5b80 10 client.25222 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-01T06:56:49.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.422+0000 7f3b93bc5b80 20 client.25222 populate_metadata read hostname 'smithi083' 2024-04-01T06:56:49.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.422+0000 7f3b93bc5b80 1 --2- 172.21.15.83:0/1076970378 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5620a7064280 0x5620a70666a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:49.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.422+0000 7f3b93bc5b80 4 client.25222 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-01T06:56:49.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.422+0000 7f3b93bc5b80 1 -- 172.21.15.83:0/1076970378 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5620a6f8b700 con 0x5620a7064280 2024-04-01T06:56:49.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.422+0000 7f3b857cb700 1 --2- 172.21.15.83:0/1076970378 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5620a7064280 0x5620a70666a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:49.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.423+0000 7f3b68ff9700 10 client.25222 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:56:49.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.423+0000 7f3b857cb700 1 --2- 172.21.15.83:0/1076970378 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5620a7064280 0x5620a70666a0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9324814236b4c733 server_cookie=3758cd35f0aeafae in_seq=0 out_seq=0 2024-04-01T06:56:49.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.423+0000 7f3b68ff9700 1 -- 172.21.15.83:0/1076970378 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5620a6f8b700 con 0x5620a7064280 2024-04-01T06:56:49.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.423+0000 7f3b68ff9700 10 client.25222 handle_command_reply: tid=0 2024-04-01T06:56:49.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.423+0000 7f3b93bc5b80 1 client.25222 shutdown 2024-04-01T06:56:49.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.424+0000 7f3b93bc5b80 1 -- 172.21.15.83:0/1076970378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620a7040ef0 msgr2=0x5620a7048b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:49.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.424+0000 7f3b93bc5b80 1 --2- 172.21.15.83:0/1076970378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620a7040ef0 0x5620a7048b70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3b700095c0 tx=0x7f3b70009310 comp rx=0 tx=0).stop 2024-04-01T06:56:49.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.424+0000 7f3b93bc5b80 1 -- 172.21.15.83:0/1076970378 shutdown_connections 2024-04-01T06:56:49.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.424+0000 7f3b93bc5b80 1 --2- 172.21.15.83:0/1076970378 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5620a7064280 0x5620a70666a0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.424+0000 7f3b93bc5b80 1 --2- 172.21.15.83:0/1076970378 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5620a704bdf0 0x5620a70492b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.424+0000 7f3b68ff9700 0 client.25222 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:56:49.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.424+0000 7f3b93bc5b80 1 --2- 172.21.15.83:0/1076970378 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5620a70405d0 0x5620a704b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.424+0000 7f3b93bc5b80 1 --2- 172.21.15.83:0/1076970378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620a7040ef0 0x5620a7048b70 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.424+0000 7f3b93bc5b80 1 -- 172.21.15.83:0/1076970378 >> 172.21.15.83:0/1076970378 conn(0x5620a6fa06a0 msgr2=0x5620a70426c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:49.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.424+0000 7f3b93bc5b80 1 -- 172.21.15.83:0/1076970378 shutdown_connections 2024-04-01T06:56:49.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.424+0000 7f3b93bc5b80 1 -- 172.21.15.83:0/1076970378 wait complete. 2024-04-01T06:56:49.427 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.424+0000 7f3b93bc5b80 20 client.25222 trim_cache size 0 max 16384 2024-04-01T06:56:49.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.446+0000 7f3b93bc5b80 1 Processor -- start 2024-04-01T06:56:49.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.447+0000 7f3b93bc5b80 1 -- start start 2024-04-01T06:56:49.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.447+0000 7f3b93bc5b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5620a70405d0 0x5620a7048420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:49.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.447+0000 7f3b93bc5b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620a7040ef0 0x5620a705b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:49.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.447+0000 7f3b93bc5b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5620a704bdf0 0x5620a7035f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:49.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.447+0000 7f3b93bc5b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620a704a120 con 0x5620a704bdf0 2024-04-01T06:56:49.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.447+0000 7f3b93bc5b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620a7041850 con 0x5620a70405d0 2024-04-01T06:56:49.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.447+0000 7f3b93bc5b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620a7042130 con 0x5620a7040ef0 2024-04-01T06:56:49.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.447+0000 7f3b84fca700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620a7040ef0 0x5620a705b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:49.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.447+0000 7f3b84fca700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620a7040ef0 0x5620a705b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.83:54370/0 (socket says 172.21.15.83:54370) 2024-04-01T06:56:49.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.447+0000 7f3b84fca700 1 -- 172.21.15.83:0/2044374553 learned_addr learned my addr 172.21.15.83:0/2044374553 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:49.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.447+0000 7f3b85fcc700 1 --2- 172.21.15.83:0/2044374553 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5620a704bdf0 0x5620a7035f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:49.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.448+0000 7f3b84fca700 1 -- 172.21.15.83:0/2044374553 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5620a70405d0 msgr2=0x5620a7048420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:49.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.448+0000 7f3b84fca700 1 --2- 172.21.15.83:0/2044374553 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5620a70405d0 0x5620a7048420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.448+0000 7f3b84fca700 1 -- 172.21.15.83:0/2044374553 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5620a704bdf0 msgr2=0x5620a7035f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:49.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.448+0000 7f3b84fca700 1 --2- 172.21.15.83:0/2044374553 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5620a704bdf0 0x5620a7035f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.448+0000 7f3b84fca700 1 -- 172.21.15.83:0/2044374553 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5620a6f58ea0 con 0x5620a7040ef0 2024-04-01T06:56:49.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.448+0000 7f3b84fca700 1 --2- 172.21.15.83:0/2044374553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620a7040ef0 0x5620a705b330 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3b70026eb0 tx=0x7f3b70005ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae5f08070896a713 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:49.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.448+0000 7f3b6bfff700 1 -- 172.21.15.83:0/2044374553 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b70003e50 con 0x5620a7040ef0 2024-04-01T06:56:49.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.448+0000 7f3b6bfff700 1 -- 172.21.15.83:0/2044374553 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3b700268c0 con 0x5620a7040ef0 2024-04-01T06:56:49.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.448+0000 7f3b6bfff700 1 -- 172.21.15.83:0/2044374553 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7000fa20 con 0x5620a7040ef0 2024-04-01T06:56:49.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.449+0000 7f3b93bc5b80 1 -- 172.21.15.83:0/2044374553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620a7040ef0 msgr2=0x5620a705b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:49.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.449+0000 7f3b93bc5b80 1 --2- 172.21.15.83:0/2044374553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620a7040ef0 0x5620a705b330 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3b70026eb0 tx=0x7f3b70005ad0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.449+0000 7f3b93bc5b80 1 -- 172.21.15.83:0/2044374553 shutdown_connections 2024-04-01T06:56:49.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.449+0000 7f3b93bc5b80 1 --2- 172.21.15.83:0/2044374553 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5620a704bdf0 0x5620a7035f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.449+0000 7f3b93bc5b80 1 --2- 172.21.15.83:0/2044374553 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5620a70405d0 0x5620a7048420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.449+0000 7f3b93bc5b80 1 --2- 172.21.15.83:0/2044374553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620a7040ef0 0x5620a705b330 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.449+0000 7f3b93bc5b80 1 -- 172.21.15.83:0/2044374553 >> 172.21.15.83:0/2044374553 conn(0x5620a6fa06a0 msgr2=0x5620a706b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:49.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.449+0000 7f3b93bc5b80 1 -- 172.21.15.83:0/2044374553 shutdown_connections 2024-04-01T06:56:49.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.449+0000 7f3b93bc5b80 1 -- 172.21.15.83:0/2044374553 wait complete. 2024-04-01T06:56:49.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.449+0000 7f3b93bc5b80 1 -- start start 2024-04-01T06:56:49.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.449+0000 7f3b93bc5b80 1 Processor -- start 2024-04-01T06:56:49.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.450+0000 7f3b93bc5b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620a70405d0 0x5620a7059500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:49.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.450+0000 7f3b93bc5b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5620a7040ef0 0x5620a7059a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:49.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.450+0000 7f3b93bc5b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5620a704bdf0 0x5620a70b70b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:49.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.450+0000 7f3b93bc5b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620a705a190 con 0x5620a7040ef0 2024-04-01T06:56:49.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.450+0000 7f3b93bc5b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620a70b75f0 con 0x5620a704bdf0 2024-04-01T06:56:49.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.450+0000 7f3b93bc5b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620a70b77b0 con 0x5620a70405d0 2024-04-01T06:56:49.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.450+0000 7f3b93bc5b80 10 client.0 _ll_register_callbacks cb 0x5620a6f38470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:56:49.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.450+0000 7f3b857cb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620a70405d0 0x5620a7059500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:49.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.450+0000 7f3b857cb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620a70405d0 0x5620a7059500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.83:54386/0 (socket says 172.21.15.83:54386) 2024-04-01T06:56:49.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.450+0000 7f3b857cb700 1 -- 172.21.15.83:0/2638006555 learned_addr learned my addr 172.21.15.83:0/2638006555 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:49.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.450+0000 7f3b85fcc700 1 --2- 172.21.15.83:0/2638006555 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5620a704bdf0 0x5620a70b70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:49.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.450+0000 7f3b857cb700 1 -- 172.21.15.83:0/2638006555 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5620a704bdf0 msgr2=0x5620a70b70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:49.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.450+0000 7f3b857cb700 1 --2- 172.21.15.83:0/2638006555 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5620a704bdf0 0x5620a70b70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.450+0000 7f3b857cb700 1 -- 172.21.15.83:0/2638006555 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5620a7040ef0 msgr2=0x5620a7059a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:49.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.450+0000 7f3b857cb700 1 --2- 172.21.15.83:0/2638006555 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5620a7040ef0 0x5620a7059a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.450+0000 7f3b857cb700 1 -- 172.21.15.83:0/2638006555 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5620a6dc0b60 con 0x5620a70405d0 2024-04-01T06:56:49.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.451+0000 7f3b857cb700 1 --2- 172.21.15.83:0/2638006555 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620a70405d0 0x5620a7059500 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c099bf0 tx=0x7f3b7c0996d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52458b18de495b37 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:49.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.451+0000 7f3b68ff9700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-04-01T06:56:49.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.451+0000 7f3b68ff9700 1 -- 172.21.15.83:0/2638006555 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c09a0c0 con 0x5620a70405d0 2024-04-01T06:56:49.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.451+0000 7f3b68ff9700 1 -- 172.21.15.83:0/2638006555 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f3b7c0a20e0 con 0x5620a70405d0 2024-04-01T06:56:49.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.451+0000 7f3b93bc5b80 1 -- 172.21.15.83:0/2638006555 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3b7800f040 con 0x5620a70405d0 2024-04-01T06:56:49.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.451+0000 7f3b68ff9700 1 -- 172.21.15.83:0/2638006555 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b7c099150 con 0x5620a70405d0 2024-04-01T06:56:49.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.451+0000 7f3b93bc5b80 10 client.25228 fetch_fsmap learned FSMap version 24 2024-04-01T06:56:49.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.451+0000 7f3b93bc5b80 1 -- 172.21.15.83:0/2638006555 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5620a6e18cd0 con 0x5620a70405d0 2024-04-01T06:56:49.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.451+0000 7f3b68ff9700 1 -- 172.21.15.83:0/2638006555 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3b7800f040 con 0x5620a70405d0 2024-04-01T06:56:49.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.451+0000 7f3b68ff9700 1 -- 172.21.15.83:0/2638006555 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f3b7c0ca650 con 0x5620a70405d0 2024-04-01T06:56:49.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.452+0000 7f3b93bc5b80 10 client.25228 fetch_fsmap finished waiting for FSMap version 24 2024-04-01T06:56:49.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.452+0000 7f3b93bc5b80 10 client.25228 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-01T06:56:49.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.452+0000 7f3b93bc5b80 20 client.25228 populate_metadata read hostname 'smithi083' 2024-04-01T06:56:49.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.452+0000 7f3b93bc5b80 1 --2- 172.21.15.83:0/2638006555 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5620a70b8e80 0x5620a70bb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:49.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.452+0000 7f3b93bc5b80 4 client.25228 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-01T06:56:49.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.452+0000 7f3b93bc5b80 1 -- 172.21.15.83:0/2638006555 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5620a6de1cf0 con 0x5620a70b8e80 2024-04-01T06:56:49.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.452+0000 7f3b84fca700 1 --2- 172.21.15.83:0/2638006555 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5620a70b8e80 0x5620a70bb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:49.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.452+0000 7f3b68ff9700 10 client.25228 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:56:49.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.452+0000 7f3b84fca700 1 --2- 172.21.15.83:0/2638006555 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5620a70b8e80 0x5620a70bb2a0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb93b2aa6d224618 server_cookie=96ce33469bda4c1c in_seq=0 out_seq=0 2024-04-01T06:56:49.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.452+0000 7f3b68ff9700 1 -- 172.21.15.83:0/2638006555 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5620a6de1cf0 con 0x5620a70b8e80 2024-04-01T06:56:49.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.452+0000 7f3b68ff9700 10 client.25228 handle_command_reply: tid=0 2024-04-01T06:56:49.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.452+0000 7f3b93bc5b80 1 client.25228 shutdown 2024-04-01T06:56:49.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.453+0000 7f3b93bc5b80 1 -- 172.21.15.83:0/2638006555 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620a70405d0 msgr2=0x5620a7059500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:49.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.453+0000 7f3b93bc5b80 1 --2- 172.21.15.83:0/2638006555 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620a70405d0 0x5620a7059500 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c099bf0 tx=0x7f3b7c0996d0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.453+0000 7f3b93bc5b80 1 -- 172.21.15.83:0/2638006555 shutdown_connections 2024-04-01T06:56:49.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.453+0000 7f3b93bc5b80 1 --2- 172.21.15.83:0/2638006555 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5620a70b8e80 0x5620a70bb2a0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.453+0000 7f3b93bc5b80 1 --2- 172.21.15.83:0/2638006555 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5620a704bdf0 0x5620a70b70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.453+0000 7f3b93bc5b80 1 --2- 172.21.15.83:0/2638006555 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620a70405d0 0x5620a7059500 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.453+0000 7f3b93bc5b80 1 --2- 172.21.15.83:0/2638006555 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5620a7040ef0 0x5620a7059a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.453+0000 7f3b93bc5b80 1 -- 172.21.15.83:0/2638006555 >> 172.21.15.83:0/2638006555 conn(0x5620a6fa06a0 msgr2=0x5620a70355a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:49.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.453+0000 7f3b68ff9700 0 client.25228 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:56:49.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.453+0000 7f3b93bc5b80 1 -- 172.21.15.83:0/2638006555 shutdown_connections 2024-04-01T06:56:49.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.453+0000 7f3b93bc5b80 1 -- 172.21.15.83:0/2638006555 wait complete. 2024-04-01T06:56:49.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.453+0000 7f3b93bc5b80 20 client.25228 trim_cache size 0 max 16384 2024-04-01T06:56:49.460 INFO:teuthology.orchestra.run.smithi083.stdout:[] 2024-04-01T06:56:49.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.454+0000 7f3b87a2f700 1 -- 172.21.15.83:0/3947078390 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f3b6c0a13b0 msgr2=0x7f3b6c0a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:49.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.454+0000 7f3b87a2f700 1 --2- 172.21.15.83:0/3947078390 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f3b6c0a13b0 0x7f3b6c0a3870 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3b70005b40 tx=0x7f3b7000be00 comp rx=0 tx=0).stop 2024-04-01T06:56:49.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.454+0000 7f3b87a2f700 1 -- 172.21.15.83:0/3947078390 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b80067e30 msgr2=0x7f3b80197250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:49.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.454+0000 7f3b87a2f700 1 --2- 172.21.15.83:0/3947078390 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b80067e30 0x7f3b80197250 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c00d950 tx=0x7f3b7c00dc60 comp rx=0 tx=0).stop 2024-04-01T06:56:49.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.454+0000 7f3b87a2f700 1 -- 172.21.15.83:0/3947078390 shutdown_connections 2024-04-01T06:56:49.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.454+0000 7f3b87a2f700 1 --2- 172.21.15.83:0/3947078390 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f3b6c0a13b0 0x7f3b6c0a3870 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.454+0000 7f3b87a2f700 1 --2- 172.21.15.83:0/3947078390 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b80105ce0 0x7f3b8019bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.454+0000 7f3b87a2f700 1 --2- 172.21.15.83:0/3947078390 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b80067e30 0x7f3b80197250 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.454+0000 7f3b87a2f700 1 --2- 172.21.15.83:0/3947078390 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b800687f0 0x7f3b80197790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:49.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.454+0000 7f3b87a2f700 1 -- 172.21.15.83:0/3947078390 >> 172.21.15.83:0/3947078390 conn(0x7f3b80076d40 msgr2=0x7f3b800fe9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:49.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.454+0000 7f3b87a2f700 1 -- 172.21.15.83:0/3947078390 shutdown_connections 2024-04-01T06:56:49.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:49.454+0000 7f3b87a2f700 1 -- 172.21.15.83:0/3947078390 wait complete. 2024-04-01T06:56:50.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:56:49 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/1392698269' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:56:50.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:56:49 smithi153 ceph-mon[48187]: pgmap v31: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.4 KiB/s wr, 9 op/s 2024-04-01T06:56:50.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:56:49 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/1392698269' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:56:50.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:56:49 smithi145 ceph-mon[47816]: pgmap v31: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.4 KiB/s wr, 9 op/s 2024-04-01T06:56:50.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:56:49 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/1392698269' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:56:50.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:56:49 smithi083 ceph-mon[43429]: pgmap v31: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.4 KiB/s wr, 9 op/s 2024-04-01T06:56:50.469 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-01T06:56:50.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T06:56:50.470 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-01T06:56:50.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.600+0000 7f463b59d700 1 -- 172.21.15.83:0/169548614 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4634100f50 msgr2=0x7f4634104860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:50.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.600+0000 7f463b59d700 1 --2- 172.21.15.83:0/169548614 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4634100f50 0x7f4634104860 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f46240099c0 tx=0x7f4624009cd0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.600+0000 7f463b59d700 1 -- 172.21.15.83:0/169548614 shutdown_connections 2024-04-01T06:56:50.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.600+0000 7f463b59d700 1 --2- 172.21.15.83:0/169548614 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4634104f90 0x7f463410cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.600+0000 7f463b59d700 1 --2- 172.21.15.83:0/169548614 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46341005a0 0x7f4634100980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.600+0000 7f463b59d700 1 --2- 172.21.15.83:0/169548614 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4634100f50 0x7f4634104860 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.600+0000 7f463b59d700 1 -- 172.21.15.83:0/169548614 >> 172.21.15.83:0/169548614 conn(0x7f46340761e0 msgr2=0x7f46340fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:50.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.601+0000 7f463b59d700 1 -- 172.21.15.83:0/169548614 shutdown_connections 2024-04-01T06:56:50.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.601+0000 7f463b59d700 1 -- 172.21.15.83:0/169548614 wait complete. 2024-04-01T06:56:50.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.601+0000 7f463b59d700 1 Processor -- start 2024-04-01T06:56:50.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.601+0000 7f463b59d700 1 -- start start 2024-04-01T06:56:50.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.601+0000 7f463b59d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46341005a0 0x7f463410d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:50.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.602+0000 7f463b59d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4634104f90 0x7f463410d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:50.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.602+0000 7f463b59d700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f463410dce0 0x7f46341a5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:50.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.602+0000 7f463b59d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46341a5930 con 0x7f4634104f90 2024-04-01T06:56:50.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.602+0000 7f463b59d700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46341a5aa0 con 0x7f463410dce0 2024-04-01T06:56:50.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.602+0000 7f463b59d700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46341a5c60 con 0x7f46341005a0 2024-04-01T06:56:50.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.602+0000 7f4638b38700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4634104f90 0x7f463410d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:50.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.602+0000 7f4638b38700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4634104f90 0x7f463410d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58302/0 (socket says 172.21.15.83:58302) 2024-04-01T06:56:50.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.602+0000 7f4638b38700 1 -- 172.21.15.83:0/4275879298 learned_addr learned my addr 172.21.15.83:0/4275879298 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:50.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.602+0000 7f4639b3a700 1 --2- 172.21.15.83:0/4275879298 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f463410dce0 0x7f46341a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:50.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.602+0000 7f4638b38700 1 -- 172.21.15.83:0/4275879298 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46341005a0 msgr2=0x7f463410d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:50.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.602+0000 7f4638b38700 1 --2- 172.21.15.83:0/4275879298 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46341005a0 0x7f463410d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.602+0000 7f4638b38700 1 -- 172.21.15.83:0/4275879298 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f463410dce0 msgr2=0x7f46341a5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:50.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.602+0000 7f4638b38700 1 --2- 172.21.15.83:0/4275879298 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f463410dce0 0x7f46341a5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.602+0000 7f4638b38700 1 -- 172.21.15.83:0/4275879298 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46240095f0 con 0x7f4634104f90 2024-04-01T06:56:50.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.602+0000 7f4638b38700 1 --2- 172.21.15.83:0/4275879298 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4634104f90 0x7f463410d7a0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f462400b580 tx=0x7f462400f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:50.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.602+0000 7f462a7fc700 1 -- 172.21.15.83:0/4275879298 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462401c070 con 0x7f4634104f90 2024-04-01T06:56:50.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.602+0000 7f463b59d700 1 -- 172.21.15.83:0/4275879298 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46341a5ee0 con 0x7f4634104f90 2024-04-01T06:56:50.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.602+0000 7f462a7fc700 1 -- 172.21.15.83:0/4275879298 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4624022420 con 0x7f4634104f90 2024-04-01T06:56:50.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.602+0000 7f462a7fc700 1 -- 172.21.15.83:0/4275879298 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4624017650 con 0x7f4634104f90 2024-04-01T06:56:50.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.603+0000 7f463b59d700 1 -- 172.21.15.83:0/4275879298 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46341a6300 con 0x7f4634104f90 2024-04-01T06:56:50.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.605+0000 7f462a7fc700 1 -- 172.21.15.83:0/4275879298 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) v1 ==== 136098+0+0 (secure 0 0 0) 0x7f4624020070 con 0x7f4634104f90 2024-04-01T06:56:50.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.606+0000 7f462a7fc700 1 --2- 172.21.15.83:0/4275879298 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f46200a13b0 0x7f46200a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:50.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.606+0000 7f462a7fc700 1 -- 172.21.15.83:0/4275879298 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f46240cda60 con 0x7f4634104f90 2024-04-01T06:56:50.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.607+0000 7f4639339700 1 --2- 172.21.15.83:0/4275879298 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f46200a13b0 0x7f46200a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:50.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.607+0000 7f4647733b80 1 Processor -- start 2024-04-01T06:56:50.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.607+0000 7f4647733b80 1 -- start start 2024-04-01T06:56:50.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.607+0000 7f4647733b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55eee341c650 0x55eee341ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:50.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.607+0000 7f4647733b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55eee341cf70 0x55eee3427930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:50.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.607+0000 7f4647733b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eee3427e70 0x55eee342a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:50.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.607+0000 7f4647733b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eee3375a10 con 0x55eee341c650 2024-04-01T06:56:50.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.607+0000 7f4647733b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eee33733d0 con 0x55eee341cf70 2024-04-01T06:56:50.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.607+0000 7f4647733b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eee336ecc0 con 0x55eee3427e70 2024-04-01T06:56:50.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.608+0000 7f4638b38700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55eee341cf70 0x55eee3427930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:50.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.608+0000 7f4638b38700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55eee341cf70 0x55eee3427930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.83:53226/0 (socket says 172.21.15.83:53226) 2024-04-01T06:56:50.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.608+0000 7f4638b38700 1 -- 172.21.15.83:0/1188851009 learned_addr learned my addr 172.21.15.83:0/1188851009 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:50.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.608+0000 7f4639b3a700 1 --2- 172.21.15.83:0/1188851009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eee3427e70 0x55eee342a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:50.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.608+0000 7f4639339700 1 --2- 172.21.15.83:0/1188851009 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55eee341c650 0x55eee341ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:50.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.608+0000 7f4639339700 1 --2- 172.21.15.83:0/4275879298 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f46200a13b0 0x7f46200a3870 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4630005950 tx=0x7f4630009f70 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:50.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.608+0000 7f4638b38700 1 -- 172.21.15.83:0/1188851009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eee3427e70 msgr2=0x55eee342a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:50.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.608+0000 7f4638b38700 1 --2- 172.21.15.83:0/1188851009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eee3427e70 0x55eee342a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.608+0000 7f4638b38700 1 -- 172.21.15.83:0/1188851009 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55eee341c650 msgr2=0x55eee341ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:50.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.608+0000 7f4638b38700 1 --2- 172.21.15.83:0/1188851009 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55eee341c650 0x55eee341ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.608+0000 7f4638b38700 1 -- 172.21.15.83:0/1188851009 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eee31f0430 con 0x55eee341cf70 2024-04-01T06:56:50.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.608+0000 7f4638b38700 1 --2- 172.21.15.83:0/1188851009 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55eee341cf70 0x55eee3427930 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4624009520 tx=0x7f462409a3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3cb2b25cfd15e8a server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:50.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.609+0000 7f461f7fe700 1 -- 172.21.15.83:0/1188851009 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462409e840 con 0x55eee341cf70 2024-04-01T06:56:50.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.609+0000 7f461f7fe700 1 -- 172.21.15.83:0/1188851009 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f46240a2e00 con 0x55eee341cf70 2024-04-01T06:56:50.609 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.609+0000 7f461f7fe700 1 -- 172.21.15.83:0/1188851009 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462409a140 con 0x55eee341cf70 2024-04-01T06:56:50.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.609+0000 7f4647733b80 1 -- 172.21.15.83:0/1188851009 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55eee341cf70 msgr2=0x55eee3427930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:50.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.609+0000 7f4647733b80 1 --2- 172.21.15.83:0/1188851009 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55eee341cf70 0x55eee3427930 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4624009520 tx=0x7f462409a3f0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.609+0000 7f4647733b80 1 -- 172.21.15.83:0/1188851009 shutdown_connections 2024-04-01T06:56:50.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.609+0000 7f4647733b80 1 --2- 172.21.15.83:0/1188851009 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55eee341c650 0x55eee341ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.609+0000 7f4647733b80 1 --2- 172.21.15.83:0/1188851009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eee3427e70 0x55eee342a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.609+0000 7f4647733b80 1 --2- 172.21.15.83:0/1188851009 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55eee341cf70 0x55eee3427930 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.609+0000 7f4647733b80 1 -- 172.21.15.83:0/1188851009 >> 172.21.15.83:0/1188851009 conn(0x55eee337c720 msgr2=0x55eee3418b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:50.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.609+0000 7f4647733b80 1 -- 172.21.15.83:0/1188851009 shutdown_connections 2024-04-01T06:56:50.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.610+0000 7f4647733b80 1 -- 172.21.15.83:0/1188851009 wait complete. 2024-04-01T06:56:50.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.610+0000 7f4647733b80 1 -- start start 2024-04-01T06:56:50.611 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.610+0000 7f4647733b80 1 Processor -- start 2024-04-01T06:56:50.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.611+0000 7f4647733b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55eee341c650 0x55eee34277c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:50.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.611+0000 7f4647733b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55eee341cf70 0x55eee3424b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:50.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.611+0000 7f4647733b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eee3427e70 0x55eee3425080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:50.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.611+0000 7f4647733b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eee330ae00 con 0x55eee341c650 2024-04-01T06:56:50.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.611+0000 7f4647733b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eee330aaa0 con 0x55eee341cf70 2024-04-01T06:56:50.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.611+0000 7f4647733b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eee31f2720 con 0x55eee3427e70 2024-04-01T06:56:50.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.611+0000 7f4647733b80 10 client.0 _ll_register_callbacks cb 0x55eee33144f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:56:50.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.611+0000 7f4638b38700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55eee341cf70 0x55eee3424b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:50.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.611+0000 7f4638b38700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55eee341cf70 0x55eee3424b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.83:53230/0 (socket says 172.21.15.83:53230) 2024-04-01T06:56:50.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.611+0000 7f4638b38700 1 -- 172.21.15.83:0/4078415723 learned_addr learned my addr 172.21.15.83:0/4078415723 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:50.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.612+0000 7f4639b3a700 1 --2- 172.21.15.83:0/4078415723 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eee3427e70 0x55eee3425080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:50.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.612+0000 7f4639339700 1 --2- 172.21.15.83:0/4078415723 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55eee341c650 0x55eee34277c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:50.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.612+0000 7f4638b38700 1 -- 172.21.15.83:0/4078415723 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eee3427e70 msgr2=0x55eee3425080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:50.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.612+0000 7f4638b38700 1 --2- 172.21.15.83:0/4078415723 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eee3427e70 0x55eee3425080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.612+0000 7f4638b38700 1 -- 172.21.15.83:0/4078415723 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55eee341c650 msgr2=0x55eee34277c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:50.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.612+0000 7f4638b38700 1 --2- 172.21.15.83:0/4078415723 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55eee341c650 0x55eee34277c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.612+0000 7f4638b38700 1 -- 172.21.15.83:0/4078415723 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46341a6300 con 0x55eee341cf70 2024-04-01T06:56:50.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.612+0000 7f4639339700 1 --2- 172.21.15.83:0/4078415723 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55eee341c650 0x55eee34277c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:56:50.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.612+0000 7f4638b38700 1 --2- 172.21.15.83:0/4078415723 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55eee341cf70 0x55eee3424b00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4624000c00 tx=0x7f46240cb000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3af7656ba46a5501 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:50.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.612+0000 7f461cff9700 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-04-01T06:56:50.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.612+0000 7f461cff9700 1 -- 172.21.15.83:0/4078415723 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462409ac70 con 0x55eee341cf70 2024-04-01T06:56:50.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.612+0000 7f4647733b80 1 -- 172.21.15.83:0/4078415723 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55eee332f400 con 0x55eee341cf70 2024-04-01T06:56:50.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.612+0000 7f461cff9700 1 -- 172.21.15.83:0/4078415723 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f462409add0 con 0x55eee341cf70 2024-04-01T06:56:50.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.612+0000 7f461cff9700 1 -- 172.21.15.83:0/4078415723 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46240a2970 con 0x55eee341cf70 2024-04-01T06:56:50.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.612+0000 7f4647733b80 10 client.25283 fetch_fsmap learned FSMap version 24 2024-04-01T06:56:50.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.612+0000 7f4647733b80 1 -- 172.21.15.83:0/4078415723 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55eee319cbe0 con 0x55eee341cf70 2024-04-01T06:56:50.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.612+0000 7f461cff9700 1 -- 172.21.15.83:0/4078415723 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55eee332f400 con 0x55eee341cf70 2024-04-01T06:56:50.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.613+0000 7f461cff9700 1 -- 172.21.15.83:0/4078415723 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4624096800 con 0x55eee341cf70 2024-04-01T06:56:50.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.613+0000 7f4647733b80 10 client.25283 fetch_fsmap finished waiting for FSMap version 24 2024-04-01T06:56:50.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.613+0000 7f4647733b80 10 client.25283 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-01T06:56:50.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.613+0000 7f4647733b80 20 client.25283 populate_metadata read hostname 'smithi083' 2024-04-01T06:56:50.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.613+0000 7f4647733b80 1 --2- 172.21.15.83:0/4078415723 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55eee342e1e0 0x55eee3430600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:50.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.613+0000 7f4647733b80 4 client.25283 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-01T06:56:50.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.613+0000 7f4647733b80 1 -- 172.21.15.83:0/4078415723 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55eee3367780 con 0x55eee342e1e0 2024-04-01T06:56:50.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.613+0000 7f4639339700 1 --2- 172.21.15.83:0/4078415723 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55eee342e1e0 0x55eee3430600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:50.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.613+0000 7f4639339700 1 --2- 172.21.15.83:0/4078415723 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55eee342e1e0 0x55eee3430600 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3dbeecf68c9aa1a server_cookie=3b183ea2fd104408 in_seq=0 out_seq=0 2024-04-01T06:56:50.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.613+0000 7f461cff9700 10 client.25283 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:56:50.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.614+0000 7f461cff9700 1 -- 172.21.15.83:0/4078415723 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55eee3367780 con 0x55eee342e1e0 2024-04-01T06:56:50.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.614+0000 7f461cff9700 10 client.25283 handle_command_reply: tid=0 2024-04-01T06:56:50.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.614+0000 7f4647733b80 1 client.25283 shutdown 2024-04-01T06:56:50.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.614+0000 7f4647733b80 1 -- 172.21.15.83:0/4078415723 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55eee341cf70 msgr2=0x55eee3424b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:50.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.614+0000 7f4647733b80 1 --2- 172.21.15.83:0/4078415723 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55eee341cf70 0x55eee3424b00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4624000c00 tx=0x7f46240cb000 comp rx=0 tx=0).stop 2024-04-01T06:56:50.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.614+0000 7f4647733b80 1 -- 172.21.15.83:0/4078415723 shutdown_connections 2024-04-01T06:56:50.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.614+0000 7f4647733b80 1 --2- 172.21.15.83:0/4078415723 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55eee342e1e0 0x55eee3430600 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.614+0000 7f4647733b80 1 --2- 172.21.15.83:0/4078415723 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55eee341c650 0x55eee34277c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.614+0000 7f4647733b80 1 --2- 172.21.15.83:0/4078415723 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eee3427e70 0x55eee3425080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.614+0000 7f4647733b80 1 --2- 172.21.15.83:0/4078415723 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55eee341cf70 0x55eee3424b00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.614+0000 7f4647733b80 1 -- 172.21.15.83:0/4078415723 >> 172.21.15.83:0/4078415723 conn(0x55eee337c720 msgr2=0x55eee341e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:50.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.614+0000 7f461cff9700 0 client.25283 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:56:50.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.614+0000 7f4647733b80 1 -- 172.21.15.83:0/4078415723 shutdown_connections 2024-04-01T06:56:50.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.614+0000 7f4647733b80 1 -- 172.21.15.83:0/4078415723 wait complete. 2024-04-01T06:56:50.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.615+0000 7f4647733b80 20 client.25283 trim_cache size 0 max 16384 2024-04-01T06:56:50.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.631+0000 7f4647733b80 1 Processor -- start 2024-04-01T06:56:50.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.631+0000 7f4647733b80 1 -- start start 2024-04-01T06:56:50.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.632+0000 7f4647733b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eee341c650 0x55eee341ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:50.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.632+0000 7f4647733b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55eee341cf70 0x55eee34272f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:50.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.632+0000 7f4647733b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55eee3427e70 0x55eee3421d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:50.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.632+0000 7f4647733b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eee341d8d0 con 0x55eee341cf70 2024-04-01T06:56:50.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.632+0000 7f4647733b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eee341f1a0 con 0x55eee3427e70 2024-04-01T06:56:50.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.632+0000 7f4647733b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eee341f8d0 con 0x55eee341c650 2024-04-01T06:56:50.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.632+0000 7f4639b3a700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55eee3427e70 0x55eee3421d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:50.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.632+0000 7f4639b3a700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55eee3427e70 0x55eee3421d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.83:53246/0 (socket says 172.21.15.83:53246) 2024-04-01T06:56:50.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.632+0000 7f4639b3a700 1 -- 172.21.15.83:0/2482251486 learned_addr learned my addr 172.21.15.83:0/2482251486 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:50.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.632+0000 7f4638b38700 1 --2- 172.21.15.83:0/2482251486 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55eee341cf70 0x55eee34272f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:50.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.632+0000 7f4639339700 1 --2- 172.21.15.83:0/2482251486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eee341c650 0x55eee341ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:50.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.633+0000 7f4639b3a700 1 -- 172.21.15.83:0/2482251486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eee341c650 msgr2=0x55eee341ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:50.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.633+0000 7f4639b3a700 1 --2- 172.21.15.83:0/2482251486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eee341c650 0x55eee341ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.633+0000 7f4639b3a700 1 -- 172.21.15.83:0/2482251486 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55eee341cf70 msgr2=0x55eee34272f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:50.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.633+0000 7f4639b3a700 1 --2- 172.21.15.83:0/2482251486 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55eee341cf70 0x55eee34272f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.633+0000 7f4639b3a700 1 -- 172.21.15.83:0/2482251486 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eee34513a0 con 0x55eee3427e70 2024-04-01T06:56:50.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.633+0000 7f4639b3a700 1 --2- 172.21.15.83:0/2482251486 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55eee3427e70 0x55eee3421d60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f462c009d00 tx=0x7f462c0077e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=643ae1e51a9f2a40 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:50.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.633+0000 7f461ffff700 1 -- 172.21.15.83:0/2482251486 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c039650 con 0x55eee3427e70 2024-04-01T06:56:50.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.633+0000 7f461ffff700 1 -- 172.21.15.83:0/2482251486 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f462c00f040 con 0x55eee3427e70 2024-04-01T06:56:50.634 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.633+0000 7f461ffff700 1 -- 172.21.15.83:0/2482251486 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c038910 con 0x55eee3427e70 2024-04-01T06:56:50.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.634+0000 7f4647733b80 1 -- 172.21.15.83:0/2482251486 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55eee3427e70 msgr2=0x55eee3421d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:50.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.634+0000 7f4647733b80 1 --2- 172.21.15.83:0/2482251486 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55eee3427e70 0x55eee3421d60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f462c009d00 tx=0x7f462c0077e0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.634+0000 7f4647733b80 1 -- 172.21.15.83:0/2482251486 shutdown_connections 2024-04-01T06:56:50.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.634+0000 7f4647733b80 1 --2- 172.21.15.83:0/2482251486 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55eee3427e70 0x55eee3421d60 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.634+0000 7f4647733b80 1 --2- 172.21.15.83:0/2482251486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eee341c650 0x55eee341ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.634+0000 7f4647733b80 1 --2- 172.21.15.83:0/2482251486 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55eee341cf70 0x55eee34272f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.634+0000 7f4647733b80 1 -- 172.21.15.83:0/2482251486 >> 172.21.15.83:0/2482251486 conn(0x55eee337c720 msgr2=0x55eee341e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:50.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.634+0000 7f4647733b80 1 -- 172.21.15.83:0/2482251486 shutdown_connections 2024-04-01T06:56:50.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.634+0000 7f4647733b80 1 -- 172.21.15.83:0/2482251486 wait complete. 2024-04-01T06:56:50.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.634+0000 7f4647733b80 1 -- start start 2024-04-01T06:56:50.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.635+0000 7f4647733b80 1 Processor -- start 2024-04-01T06:56:50.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.635+0000 7f4647733b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eee341c650 0x55eee3433b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:50.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.635+0000 7f4647733b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55eee341cf70 0x55eee3434050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:50.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.635+0000 7f4647733b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55eee3427e70 0x55eee3446090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:50.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.635+0000 7f4647733b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eee3434940 con 0x55eee3427e70 2024-04-01T06:56:50.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.635+0000 7f4647733b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eee34465d0 con 0x55eee341cf70 2024-04-01T06:56:50.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.635+0000 7f4647733b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eee3446790 con 0x55eee341c650 2024-04-01T06:56:50.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.635+0000 7f4647733b80 10 client.0 _ll_register_callbacks cb 0x55eee33144f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:56:50.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.635+0000 7f4638b38700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55eee341cf70 0x55eee3434050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:50.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.635+0000 7f4638b38700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55eee341cf70 0x55eee3434050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.83:53250/0 (socket says 172.21.15.83:53250) 2024-04-01T06:56:50.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.635+0000 7f4638b38700 1 -- 172.21.15.83:0/1200213053 learned_addr learned my addr 172.21.15.83:0/1200213053 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:50.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.636+0000 7f4638b38700 1 -- 172.21.15.83:0/1200213053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eee341c650 msgr2=0x55eee3433b10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-01T06:56:50.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.636+0000 7f4638b38700 1 --2- 172.21.15.83:0/1200213053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eee341c650 0x55eee3433b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.636+0000 7f4638b38700 1 -- 172.21.15.83:0/1200213053 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55eee3427e70 msgr2=0x55eee3446090 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-01T06:56:50.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.636+0000 7f4638b38700 1 --2- 172.21.15.83:0/1200213053 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55eee3427e70 0x55eee3446090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.636+0000 7f4638b38700 1 -- 172.21.15.83:0/1200213053 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f462c0099b0 con 0x55eee341cf70 2024-04-01T06:56:50.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.636+0000 7f4638b38700 1 --2- 172.21.15.83:0/1200213053 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55eee341cf70 0x55eee3434050 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4624096c50 tx=0x7f4624096d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d005e1df244bcd54 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:50.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.636+0000 7f461cff9700 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-04-01T06:56:50.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.636+0000 7f461cff9700 1 -- 172.21.15.83:0/1200213053 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46240a2b70 con 0x55eee341cf70 2024-04-01T06:56:50.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.636+0000 7f4647733b80 1 -- 172.21.15.83:0/1200213053 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f46240a2e00 con 0x55eee341cf70 2024-04-01T06:56:50.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.636+0000 7f461cff9700 1 -- 172.21.15.83:0/1200213053 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f462409b110 con 0x55eee341cf70 2024-04-01T06:56:50.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.637+0000 7f461cff9700 1 -- 172.21.15.83:0/1200213053 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46240cb370 con 0x55eee341cf70 2024-04-01T06:56:50.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.637+0000 7f4647733b80 10 client.25289 fetch_fsmap learned FSMap version 24 2024-04-01T06:56:50.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.637+0000 7f4647733b80 1 -- 172.21.15.83:0/1200213053 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55eee3334f20 con 0x55eee341cf70 2024-04-01T06:56:50.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.637+0000 7f461cff9700 1 -- 172.21.15.83:0/1200213053 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f46240a2e00 con 0x55eee341cf70 2024-04-01T06:56:50.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.637+0000 7f461cff9700 1 -- 172.21.15.83:0/1200213053 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4624099970 con 0x55eee341cf70 2024-04-01T06:56:50.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.637+0000 7f4647733b80 10 client.25289 fetch_fsmap finished waiting for FSMap version 24 2024-04-01T06:56:50.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.637+0000 7f4647733b80 10 client.25289 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-01T06:56:50.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.637+0000 7f4647733b80 20 client.25289 populate_metadata read hostname 'smithi083' 2024-04-01T06:56:50.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.637+0000 7f4647733b80 1 --2- 172.21.15.83:0/1200213053 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55eee3447ac0 0x55eee3449ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:50.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.637+0000 7f4647733b80 4 client.25289 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-01T06:56:50.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.637+0000 7f4647733b80 1 -- 172.21.15.83:0/1200213053 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55eee31bdd70 con 0x55eee3447ac0 2024-04-01T06:56:50.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.637+0000 7f4639339700 1 --2- 172.21.15.83:0/1200213053 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55eee3447ac0 0x55eee3449ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:50.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.638+0000 7f461cff9700 10 client.25289 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:56:50.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.638+0000 7f4639339700 1 --2- 172.21.15.83:0/1200213053 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55eee3447ac0 0x55eee3449ee0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e0525774fa95b7d server_cookie=15864474edd8008d in_seq=0 out_seq=0 2024-04-01T06:56:50.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.639+0000 7f461cff9700 1 -- 172.21.15.83:0/1200213053 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55eee31bdd70 con 0x55eee3447ac0 2024-04-01T06:56:50.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.639+0000 7f461cff9700 10 client.25289 handle_command_reply: tid=0 2024-04-01T06:56:50.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.639+0000 7f4647733b80 1 client.25289 shutdown 2024-04-01T06:56:50.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.639+0000 7f4647733b80 1 -- 172.21.15.83:0/1200213053 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55eee341cf70 msgr2=0x55eee3434050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:50.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.639+0000 7f4647733b80 1 --2- 172.21.15.83:0/1200213053 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55eee341cf70 0x55eee3434050 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4624096c50 tx=0x7f4624096d50 comp rx=0 tx=0).stop 2024-04-01T06:56:50.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.639+0000 7f4647733b80 1 -- 172.21.15.83:0/1200213053 shutdown_connections 2024-04-01T06:56:50.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.639+0000 7f4647733b80 1 --2- 172.21.15.83:0/1200213053 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55eee3447ac0 0x55eee3449ee0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.639+0000 7f4647733b80 1 --2- 172.21.15.83:0/1200213053 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55eee3427e70 0x55eee3446090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.639+0000 7f461cff9700 0 client.25289 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:56:50.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.639+0000 7f4647733b80 1 --2- 172.21.15.83:0/1200213053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55eee341c650 0x55eee3433b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.639+0000 7f4647733b80 1 --2- 172.21.15.83:0/1200213053 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55eee341cf70 0x55eee3434050 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.639+0000 7f4647733b80 1 -- 172.21.15.83:0/1200213053 >> 172.21.15.83:0/1200213053 conn(0x55eee337c720 msgr2=0x55eee34232a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:50.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.640+0000 7f4647733b80 1 -- 172.21.15.83:0/1200213053 shutdown_connections 2024-04-01T06:56:50.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.640+0000 7f4647733b80 1 -- 172.21.15.83:0/1200213053 wait complete. 2024-04-01T06:56:50.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.640+0000 7f4647733b80 20 client.25289 trim_cache size 0 max 16384 2024-04-01T06:56:50.643 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-04-01T06:56:50.643 INFO:teuthology.orchestra.run.smithi083.stdout: "return_code": 0, 2024-04-01T06:56:50.643 INFO:teuthology.orchestra.run.smithi083.stdout: "scrub_tag": "e82e13b1-338a-4337-8850-730deef0797b", 2024-04-01T06:56:50.643 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": "asynchronous" 2024-04-01T06:56:50.643 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-04-01T06:56:50.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.640+0000 7f463b59d700 1 -- 172.21.15.83:0/4275879298 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f46200a13b0 msgr2=0x7f46200a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:50.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.640+0000 7f463b59d700 1 --2- 172.21.15.83:0/4275879298 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f46200a13b0 0x7f46200a3870 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4630005950 tx=0x7f4630009f70 comp rx=0 tx=0).stop 2024-04-01T06:56:50.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.640+0000 7f463b59d700 1 -- 172.21.15.83:0/4275879298 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4634104f90 msgr2=0x7f463410d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:50.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.640+0000 7f463b59d700 1 --2- 172.21.15.83:0/4275879298 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4634104f90 0x7f463410d7a0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f462400b580 tx=0x7f462400f740 comp rx=0 tx=0).stop 2024-04-01T06:56:50.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.640+0000 7f463b59d700 1 -- 172.21.15.83:0/4275879298 shutdown_connections 2024-04-01T06:56:50.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.640+0000 7f463b59d700 1 --2- 172.21.15.83:0/4275879298 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f46200a13b0 0x7f46200a3870 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.640+0000 7f463b59d700 1 --2- 172.21.15.83:0/4275879298 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f463410dce0 0x7f46341a5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.640+0000 7f463b59d700 1 --2- 172.21.15.83:0/4275879298 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46341005a0 0x7f463410d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.640+0000 7f463b59d700 1 --2- 172.21.15.83:0/4275879298 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4634104f90 0x7f463410d7a0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.640+0000 7f463b59d700 1 -- 172.21.15.83:0/4275879298 >> 172.21.15.83:0/4275879298 conn(0x7f46340761e0 msgr2=0x7f46341032e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:50.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.640+0000 7f463b59d700 1 -- 172.21.15.83:0/4275879298 shutdown_connections 2024-04-01T06:56:50.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.640+0000 7f463b59d700 1 -- 172.21.15.83:0/4275879298 wait complete. 2024-04-01T06:56:50.652 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-01T06:56:50.652 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-01T06:56:50.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.786+0000 7f017e365700 1 -- 172.21.15.83:0/2978598803 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f01780687f0 msgr2=0x7f017810db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:50.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.786+0000 7f017e365700 1 --2- 172.21.15.83:0/2978598803 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f01780687f0 0x7f017810db50 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f017000b0a0 tx=0x7f017000b3b0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.787+0000 7f017e365700 1 -- 172.21.15.83:0/2978598803 shutdown_connections 2024-04-01T06:56:50.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.787+0000 7f017e365700 1 --2- 172.21.15.83:0/2978598803 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f01780687f0 0x7f017810db50 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.787+0000 7f017e365700 1 --2- 172.21.15.83:0/2978598803 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0178105ce0 0x7f01781060c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.787+0000 7f017e365700 1 --2- 172.21.15.83:0/2978598803 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0178067e30 0x7f01780682b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.787+0000 7f017e365700 1 -- 172.21.15.83:0/2978598803 >> 172.21.15.83:0/2978598803 conn(0x7f0178076d40 msgr2=0x7f0178077150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:50.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.789+0000 7f017e365700 1 -- 172.21.15.83:0/2978598803 shutdown_connections 2024-04-01T06:56:50.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.789+0000 7f017e365700 1 -- 172.21.15.83:0/2978598803 wait complete. 2024-04-01T06:56:50.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.789+0000 7f017e365700 1 Processor -- start 2024-04-01T06:56:50.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.789+0000 7f017e365700 1 -- start start 2024-04-01T06:56:50.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.790+0000 7f017e365700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0178067e30 0x7f01781a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:50.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.790+0000 7f017e365700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01780687f0 0x7f01781a3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:50.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.790+0000 7f017e365700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0178105ce0 0x7f017810cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:50.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.790+0000 7f017e365700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f017810d250 con 0x7f0178105ce0 2024-04-01T06:56:50.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.790+0000 7f017e365700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f017810d3c0 con 0x7f0178067e30 2024-04-01T06:56:50.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.790+0000 7f017e365700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f017810d580 con 0x7f01780687f0 2024-04-01T06:56:50.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.790+0000 7f016ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01780687f0 0x7f01781a3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:50.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.790+0000 7f016ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01780687f0 0x7f01781a3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.83:54422/0 (socket says 172.21.15.83:54422) 2024-04-01T06:56:50.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.790+0000 7f016ffff700 1 -- 172.21.15.83:0/1544780902 learned_addr learned my addr 172.21.15.83:0/1544780902 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:50.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.790+0000 7f017c902700 1 --2- 172.21.15.83:0/1544780902 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0178105ce0 0x7f017810cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:50.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.790+0000 7f0177fff700 1 --2- 172.21.15.83:0/1544780902 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0178067e30 0x7f01781a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:50.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.790+0000 7f016ffff700 1 -- 172.21.15.83:0/1544780902 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0178067e30 msgr2=0x7f01781a35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:50.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.790+0000 7f016ffff700 1 --2- 172.21.15.83:0/1544780902 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0178067e30 0x7f01781a35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.790+0000 7f016ffff700 1 -- 172.21.15.83:0/1544780902 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0178105ce0 msgr2=0x7f017810cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:50.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.790+0000 7f016ffff700 1 --2- 172.21.15.83:0/1544780902 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0178105ce0 0x7f017810cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.790+0000 7f016ffff700 1 -- 172.21.15.83:0/1544780902 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0170009d00 con 0x7f01780687f0 2024-04-01T06:56:50.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.791+0000 7f016ffff700 1 --2- 172.21.15.83:0/1544780902 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01780687f0 0x7f01781a3b10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f016000e9a0 tx=0x7f016000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:50.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.791+0000 7f0175ffb700 1 -- 172.21.15.83:0/1544780902 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0160009790 con 0x7f01780687f0 2024-04-01T06:56:50.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.791+0000 7f0175ffb700 1 -- 172.21.15.83:0/1544780902 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0160010430 con 0x7f01780687f0 2024-04-01T06:56:50.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.791+0000 7f0175ffb700 1 -- 172.21.15.83:0/1544780902 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0160018680 con 0x7f01780687f0 2024-04-01T06:56:50.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.791+0000 7f017e365700 1 -- 172.21.15.83:0/1544780902 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f017810d860 con 0x7f01780687f0 2024-04-01T06:56:50.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.791+0000 7f017e365700 1 -- 172.21.15.83:0/1544780902 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01781aa620 con 0x7f01780687f0 2024-04-01T06:56:50.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.794+0000 7f0175ffb700 1 -- 172.21.15.83:0/1544780902 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) v1 ==== 136098+0+0 (secure 0 0 0) 0x7f01600105a0 con 0x7f01780687f0 2024-04-01T06:56:50.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.795+0000 7f0175ffb700 1 --2- 172.21.15.83:0/1544780902 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f01640a1430 0x7f01640a38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:50.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.795+0000 7f0175ffb700 1 -- 172.21.15.83:0/1544780902 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f0160014070 con 0x7f01780687f0 2024-04-01T06:56:50.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.795+0000 7f0177fff700 1 --2- 172.21.15.83:0/1544780902 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f01640a1430 0x7f01640a38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:50.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.796+0000 7f018a4fbb80 1 Processor -- start 2024-04-01T06:56:50.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.796+0000 7f018a4fbb80 1 -- start start 2024-04-01T06:56:50.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.796+0000 7f0177fff700 1 --2- 172.21.15.83:0/1544780902 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f01640a1430 0x7f01640a38f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0168009be0 tx=0x7f0168009260 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:50.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.796+0000 7f018a4fbb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c05a00a5d0 0x55c05a00a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:50.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.796+0000 7f018a4fbb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c05a00aef0 0x55c05a0158b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:50.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.796+0000 7f018a4fbb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c05a015df0 0x55c05a0181e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:50.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.796+0000 7f018a4fbb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c059f63990 con 0x55c05a00aef0 2024-04-01T06:56:50.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.796+0000 7f018a4fbb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c059f61350 con 0x55c05a00a5d0 2024-04-01T06:56:50.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.796+0000 7f018a4fbb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c059f5cc40 con 0x55c05a015df0 2024-04-01T06:56:50.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.796+0000 7f016ffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c05a00aef0 0x55c05a0158b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:50.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.796+0000 7f016ffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c05a00aef0 0x55c05a0158b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58348/0 (socket says 172.21.15.83:58348) 2024-04-01T06:56:50.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.796+0000 7f016ffff700 1 -- 172.21.15.83:0/2619176301 learned_addr learned my addr 172.21.15.83:0/2619176301 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:50.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.796+0000 7f0177fff700 1 --2- 172.21.15.83:0/2619176301 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c05a00a5d0 0x55c05a00a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:50.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.797+0000 7f016ffff700 1 -- 172.21.15.83:0/2619176301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c05a015df0 msgr2=0x55c05a0181e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-01T06:56:50.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.797+0000 7f016ffff700 1 --2- 172.21.15.83:0/2619176301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c05a015df0 0x55c05a0181e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.797+0000 7f016ffff700 1 -- 172.21.15.83:0/2619176301 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c05a00a5d0 msgr2=0x55c05a00a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:50.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.797+0000 7f016ffff700 1 --2- 172.21.15.83:0/2619176301 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c05a00a5d0 0x55c05a00a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.797+0000 7f016ffff700 1 -- 172.21.15.83:0/2619176301 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c059dde3b0 con 0x55c05a00aef0 2024-04-01T06:56:50.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.797+0000 7f016ffff700 1 --2- 172.21.15.83:0/2619176301 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c05a00aef0 0x55c05a0158b0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f016000c2d0 tx=0x7f0160099bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4437ed72d6ad872b server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:50.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.797+0000 7f016e7fc700 1 -- 172.21.15.83:0/2619176301 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016009ddd0 con 0x55c05a00aef0 2024-04-01T06:56:50.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.797+0000 7f016e7fc700 1 -- 172.21.15.83:0/2619176301 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f01600a2420 con 0x55c05a00aef0 2024-04-01T06:56:50.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.797+0000 7f016e7fc700 1 -- 172.21.15.83:0/2619176301 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01600a21f0 con 0x55c05a00aef0 2024-04-01T06:56:50.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.798+0000 7f018a4fbb80 1 -- 172.21.15.83:0/2619176301 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c05a00aef0 msgr2=0x55c05a0158b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:50.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.798+0000 7f018a4fbb80 1 --2- 172.21.15.83:0/2619176301 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c05a00aef0 0x55c05a0158b0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f016000c2d0 tx=0x7f0160099bf0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.798+0000 7f018a4fbb80 1 -- 172.21.15.83:0/2619176301 shutdown_connections 2024-04-01T06:56:50.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.798+0000 7f018a4fbb80 1 --2- 172.21.15.83:0/2619176301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c05a015df0 0x55c05a0181e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.798+0000 7f018a4fbb80 1 --2- 172.21.15.83:0/2619176301 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c05a00a5d0 0x55c05a00a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.798+0000 7f018a4fbb80 1 --2- 172.21.15.83:0/2619176301 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c05a00aef0 0x55c05a0158b0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.798+0000 7f018a4fbb80 1 -- 172.21.15.83:0/2619176301 >> 172.21.15.83:0/2619176301 conn(0x55c059f6a6a0 msgr2=0x55c05a006a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:50.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.798+0000 7f018a4fbb80 1 -- 172.21.15.83:0/2619176301 shutdown_connections 2024-04-01T06:56:50.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.798+0000 7f018a4fbb80 1 -- 172.21.15.83:0/2619176301 wait complete. 2024-04-01T06:56:50.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.799+0000 7f018a4fbb80 1 -- start start 2024-04-01T06:56:50.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.799+0000 7f018a4fbb80 1 Processor -- start 2024-04-01T06:56:50.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.799+0000 7f018a4fbb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c05a00a5d0 0x55c05a0158a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:50.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.799+0000 7f018a4fbb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c05a00aef0 0x55c05a012b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:50.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.799+0000 7f018a4fbb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c05a015df0 0x55c05a0132d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:50.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.799+0000 7f018a4fbb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c059ef8d80 con 0x55c05a00a5d0 2024-04-01T06:56:50.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.799+0000 7f018a4fbb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c059ef8a20 con 0x55c05a00aef0 2024-04-01T06:56:50.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.799+0000 7f018a4fbb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c059de06a0 con 0x55c05a015df0 2024-04-01T06:56:50.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.799+0000 7f018a4fbb80 10 client.0 _ll_register_callbacks cb 0x55c059f02470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:56:50.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.800+0000 7f016ffff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c05a00aef0 0x55c05a012b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:50.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.800+0000 7f0177fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c05a00a5d0 0x55c05a0158a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:50.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.800+0000 7f016ffff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c05a00aef0 0x55c05a012b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.83:53292/0 (socket says 172.21.15.83:53292) 2024-04-01T06:56:50.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.800+0000 7f016ffff700 1 -- 172.21.15.83:0/2725303632 learned_addr learned my addr 172.21.15.83:0/2725303632 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:50.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.800+0000 7f017c902700 1 --2- 172.21.15.83:0/2725303632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c05a015df0 0x55c05a0132d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:50.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.800+0000 7f0177fff700 1 -- 172.21.15.83:0/2725303632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c05a015df0 msgr2=0x55c05a0132d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:50.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.800+0000 7f0177fff700 1 --2- 172.21.15.83:0/2725303632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c05a015df0 0x55c05a0132d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.800+0000 7f0177fff700 1 -- 172.21.15.83:0/2725303632 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c05a00aef0 msgr2=0x55c05a012b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:50.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.800+0000 7f0177fff700 1 --2- 172.21.15.83:0/2725303632 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c05a00aef0 0x55c05a012b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.800+0000 7f0177fff700 1 -- 172.21.15.83:0/2725303632 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01781aa620 con 0x55c05a00a5d0 2024-04-01T06:56:50.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.800+0000 7f0177fff700 1 --2- 172.21.15.83:0/2725303632 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c05a00a5d0 0x55c05a0158a0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f0168005950 tx=0x7f01680047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16844ec4368dab0d server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:50.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.800+0000 7f01577fe700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:56:50.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.801+0000 7f01577fe700 1 -- 172.21.15.83:0/2725303632 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0168028430 con 0x55c05a00a5d0 2024-04-01T06:56:50.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.801+0000 7f01577fe700 1 -- 172.21.15.83:0/2725303632 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f016801f430 con 0x55c05a00a5d0 2024-04-01T06:56:50.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.801+0000 7f018a4fbb80 1 -- 172.21.15.83:0/2725303632 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c059f1d380 con 0x55c05a00a5d0 2024-04-01T06:56:50.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.801+0000 7f01577fe700 1 -- 172.21.15.83:0/2725303632 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f016801f5f0 con 0x55c05a00a5d0 2024-04-01T06:56:50.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.801+0000 7f018a4fbb80 10 client.15777 fetch_fsmap learned FSMap version 24 2024-04-01T06:56:50.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.801+0000 7f018a4fbb80 1 -- 172.21.15.83:0/2725303632 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55c059d8ab60 con 0x55c05a00a5d0 2024-04-01T06:56:50.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.801+0000 7f01577fe700 1 -- 172.21.15.83:0/2725303632 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c059f1d380 con 0x55c05a00a5d0 2024-04-01T06:56:50.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.801+0000 7f01577fe700 1 -- 172.21.15.83:0/2725303632 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f0168028a00 con 0x55c05a00a5d0 2024-04-01T06:56:50.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.801+0000 7f018a4fbb80 10 client.15777 fetch_fsmap finished waiting for FSMap version 24 2024-04-01T06:56:50.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.801+0000 7f018a4fbb80 10 client.15777 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-01T06:56:50.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.801+0000 7f018a4fbb80 20 client.15777 populate_metadata read hostname 'smithi083' 2024-04-01T06:56:50.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.801+0000 7f018a4fbb80 1 --2- 172.21.15.83:0/2725303632 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55c05a024320 0x55c05a026760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:50.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.801+0000 7f018a4fbb80 4 client.15777 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-01T06:56:50.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.801+0000 7f018a4fbb80 1 -- 172.21.15.83:0/2725303632 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c059f55700 con 0x55c05a024320 2024-04-01T06:56:50.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.802+0000 7f016ffff700 1 --2- 172.21.15.83:0/2725303632 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55c05a024320 0x55c05a026760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:50.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.802+0000 7f016ffff700 1 --2- 172.21.15.83:0/2725303632 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55c05a024320 0x55c05a026760 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a6da6bce0069f0c server_cookie=5110ff8321acc89 in_seq=0 out_seq=0 2024-04-01T06:56:50.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.802+0000 7f01577fe700 10 client.15777 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:56:50.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.803+0000 7f01577fe700 1 -- 172.21.15.83:0/2725303632 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c059f55700 con 0x55c05a024320 2024-04-01T06:56:50.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.803+0000 7f01577fe700 10 client.15777 handle_command_reply: tid=0 2024-04-01T06:56:50.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.803+0000 7f018a4fbb80 1 client.15777 shutdown 2024-04-01T06:56:50.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.803+0000 7f018a4fbb80 1 -- 172.21.15.83:0/2725303632 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c05a00a5d0 msgr2=0x55c05a0158a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:50.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.803+0000 7f018a4fbb80 1 --2- 172.21.15.83:0/2725303632 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c05a00a5d0 0x55c05a0158a0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f0168005950 tx=0x7f01680047c0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.803+0000 7f018a4fbb80 1 -- 172.21.15.83:0/2725303632 shutdown_connections 2024-04-01T06:56:50.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.803+0000 7f018a4fbb80 1 --2- 172.21.15.83:0/2725303632 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55c05a024320 0x55c05a026760 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.803+0000 7f018a4fbb80 1 --2- 172.21.15.83:0/2725303632 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c05a00a5d0 0x55c05a0158a0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.803+0000 7f01577fe700 0 client.15777 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:56:50.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.803+0000 7f018a4fbb80 1 --2- 172.21.15.83:0/2725303632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c05a015df0 0x55c05a0132d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.803+0000 7f018a4fbb80 1 --2- 172.21.15.83:0/2725303632 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c05a00aef0 0x55c05a012b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.803+0000 7f018a4fbb80 1 -- 172.21.15.83:0/2725303632 >> 172.21.15.83:0/2725303632 conn(0x55c059f6a6a0 msgr2=0x55c05a00c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:50.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.803+0000 7f018a4fbb80 1 -- 172.21.15.83:0/2725303632 shutdown_connections 2024-04-01T06:56:50.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.804+0000 7f018a4fbb80 1 -- 172.21.15.83:0/2725303632 wait complete. 2024-04-01T06:56:50.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.804+0000 7f018a4fbb80 20 client.15777 trim_cache size 0 max 16384 2024-04-01T06:56:50.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.835+0000 7f018a4fbb80 1 Processor -- start 2024-04-01T06:56:50.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.835+0000 7f018a4fbb80 1 -- start start 2024-04-01T06:56:50.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.835+0000 7f018a4fbb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c05a00a5d0 0x55c05a01ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:50.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.835+0000 7f018a4fbb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c05a00aef0 0x55c05a0153d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:50.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.835+0000 7f018a4fbb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c05a015df0 0x55c05a00def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:50.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.835+0000 7f018a4fbb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c05a00b850 con 0x55c05a00aef0 2024-04-01T06:56:50.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.835+0000 7f018a4fbb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c05a026ad0 con 0x55c05a015df0 2024-04-01T06:56:50.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.835+0000 7f018a4fbb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c05a01cfb0 con 0x55c05a00a5d0 2024-04-01T06:56:50.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.836+0000 7f016ffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c05a00aef0 0x55c05a0153d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:50.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.836+0000 7f016ffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c05a00aef0 0x55c05a0153d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58358/0 (socket says 172.21.15.83:58358) 2024-04-01T06:56:50.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.836+0000 7f016ffff700 1 -- 172.21.15.83:0/4151918342 learned_addr learned my addr 172.21.15.83:0/4151918342 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:50.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.836+0000 7f0177fff700 1 --2- 172.21.15.83:0/4151918342 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c05a00a5d0 0x55c05a01ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:50.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.836+0000 7f017c902700 1 --2- 172.21.15.83:0/4151918342 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c05a015df0 0x55c05a00def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:50.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.836+0000 7f016ffff700 1 -- 172.21.15.83:0/4151918342 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c05a00a5d0 msgr2=0x55c05a01ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:50.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.836+0000 7f016ffff700 1 --2- 172.21.15.83:0/4151918342 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c05a00a5d0 0x55c05a01ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.836+0000 7f016ffff700 1 -- 172.21.15.83:0/4151918342 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c05a015df0 msgr2=0x55c05a00def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:50.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.836+0000 7f016ffff700 1 --2- 172.21.15.83:0/4151918342 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c05a015df0 0x55c05a00def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.836+0000 7f016ffff700 1 -- 172.21.15.83:0/4151918342 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c059f22ea0 con 0x55c05a00aef0 2024-04-01T06:56:50.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.836+0000 7f017c902700 1 --2- 172.21.15.83:0/4151918342 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c05a015df0 0x55c05a00def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:56:50.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.836+0000 7f016ffff700 1 --2- 172.21.15.83:0/4151918342 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c05a00aef0 0x55c05a0153d0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f01600982f0 tx=0x7f016000c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f774081b67b43a69 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:50.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.836+0000 7f016effd700 1 -- 172.21.15.83:0/4151918342 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0160098440 con 0x55c05a00aef0 2024-04-01T06:56:50.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.836+0000 7f016effd700 1 -- 172.21.15.83:0/4151918342 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0160099490 con 0x55c05a00aef0 2024-04-01T06:56:50.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.836+0000 7f016effd700 1 -- 172.21.15.83:0/4151918342 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0160094bb0 con 0x55c05a00aef0 2024-04-01T06:56:50.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.837+0000 7f018a4fbb80 1 -- 172.21.15.83:0/4151918342 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c05a00aef0 msgr2=0x55c05a0153d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:50.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.837+0000 7f018a4fbb80 1 --2- 172.21.15.83:0/4151918342 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c05a00aef0 0x55c05a0153d0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f01600982f0 tx=0x7f016000c480 comp rx=0 tx=0).stop 2024-04-01T06:56:50.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.837+0000 7f018a4fbb80 1 -- 172.21.15.83:0/4151918342 shutdown_connections 2024-04-01T06:56:50.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.837+0000 7f018a4fbb80 1 --2- 172.21.15.83:0/4151918342 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c05a015df0 0x55c05a00def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.837+0000 7f018a4fbb80 1 --2- 172.21.15.83:0/4151918342 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c05a00a5d0 0x55c05a01ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.837+0000 7f018a4fbb80 1 --2- 172.21.15.83:0/4151918342 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c05a00aef0 0x55c05a0153d0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.837+0000 7f018a4fbb80 1 -- 172.21.15.83:0/4151918342 >> 172.21.15.83:0/4151918342 conn(0x55c059f6a6a0 msgr2=0x55c05a006530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:50.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.838+0000 7f018a4fbb80 1 -- 172.21.15.83:0/4151918342 shutdown_connections 2024-04-01T06:56:50.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.838+0000 7f018a4fbb80 1 -- 172.21.15.83:0/4151918342 wait complete. 2024-04-01T06:56:50.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.838+0000 7f018a4fbb80 1 -- start start 2024-04-01T06:56:50.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.838+0000 7f018a4fbb80 1 Processor -- start 2024-04-01T06:56:50.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.839+0000 7f018a4fbb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c05a00a5d0 0x55c05a01aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:50.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.839+0000 7f018a4fbb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c05a00aef0 0x55c05a01af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:50.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.839+0000 7f018a4fbb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c05a015df0 0x55c05a01b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:50.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.839+0000 7f018a4fbb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c05a01ce20 con 0x55c05a00a5d0 2024-04-01T06:56:50.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.839+0000 7f018a4fbb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c05a079400 con 0x55c05a00aef0 2024-04-01T06:56:50.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.839+0000 7f018a4fbb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c05a0795c0 con 0x55c05a015df0 2024-04-01T06:56:50.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.839+0000 7f018a4fbb80 10 client.0 _ll_register_callbacks cb 0x55c059f02470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:56:50.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.839+0000 7f0177fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c05a00a5d0 0x55c05a01aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:50.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.839+0000 7f0177fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c05a00a5d0 0x55c05a01aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58374/0 (socket says 172.21.15.83:58374) 2024-04-01T06:56:50.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.839+0000 7f0177fff700 1 -- 172.21.15.83:0/1082284950 learned_addr learned my addr 172.21.15.83:0/1082284950 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:56:50.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.839+0000 7f016ffff700 1 --2- 172.21.15.83:0/1082284950 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c05a00aef0 0x55c05a01af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:50.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.839+0000 7f0177fff700 1 -- 172.21.15.83:0/1082284950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c05a015df0 msgr2=0x55c05a01b4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-01T06:56:50.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.839+0000 7f0177fff700 1 --2- 172.21.15.83:0/1082284950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c05a015df0 0x55c05a01b4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.839+0000 7f0177fff700 1 -- 172.21.15.83:0/1082284950 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c05a00aef0 msgr2=0x55c05a01af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:56:50.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.839+0000 7f0177fff700 1 --2- 172.21.15.83:0/1082284950 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c05a00aef0 0x55c05a01af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.839+0000 7f0177fff700 1 -- 172.21.15.83:0/1082284950 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c059dde3b0 con 0x55c05a00a5d0 2024-04-01T06:56:50.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.839+0000 7f016ffff700 1 --2- 172.21.15.83:0/1082284950 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c05a00aef0 0x55c05a01af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T06:56:50.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.840+0000 7f0177fff700 1 --2- 172.21.15.83:0/1082284950 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c05a00a5d0 0x55c05a01aa50 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f0168028d30 tx=0x7f0168031460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=966563125b0380a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:56:50.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.840+0000 7f01577fe700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:56:50.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.840+0000 7f01577fe700 1 -- 172.21.15.83:0/1082284950 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0168004240 con 0x55c05a00a5d0 2024-04-01T06:56:50.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.840+0000 7f018a4fbb80 1 -- 172.21.15.83:0/1082284950 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f01600a2420 con 0x55c05a00a5d0 2024-04-01T06:56:50.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.840+0000 7f01577fe700 1 -- 172.21.15.83:0/1082284950 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f0168036070 con 0x55c05a00a5d0 2024-04-01T06:56:50.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.840+0000 7f01577fe700 1 -- 172.21.15.83:0/1082284950 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f01680043a0 con 0x55c05a00a5d0 2024-04-01T06:56:50.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.840+0000 7f018a4fbb80 10 client.15783 fetch_fsmap learned FSMap version 24 2024-04-01T06:56:50.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.840+0000 7f018a4fbb80 1 -- 172.21.15.83:0/1082284950 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55c059de2cd0 con 0x55c05a00a5d0 2024-04-01T06:56:50.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.840+0000 7f01577fe700 1 -- 172.21.15.83:0/1082284950 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0168047020 con 0x55c05a00a5d0 2024-04-01T06:56:50.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.841+0000 7f01577fe700 1 -- 172.21.15.83:0/1082284950 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f01680038f0 con 0x55c05a00a5d0 2024-04-01T06:56:50.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.841+0000 7f018a4fbb80 10 client.15783 fetch_fsmap finished waiting for FSMap version 24 2024-04-01T06:56:50.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.841+0000 7f018a4fbb80 10 client.15783 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-01T06:56:50.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.841+0000 7f018a4fbb80 20 client.15783 populate_metadata read hostname 'smithi083' 2024-04-01T06:56:50.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.841+0000 7f018a4fbb80 1 --2- 172.21.15.83:0/1082284950 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55c05a07ace0 0x55c05a07d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:56:50.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.841+0000 7f018a4fbb80 4 client.15783 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-01T06:56:50.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.841+0000 7f018a4fbb80 1 -- 172.21.15.83:0/1082284950 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c059dabcf0 con 0x55c05a07ace0 2024-04-01T06:56:50.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.841+0000 7f016ffff700 1 --2- 172.21.15.83:0/1082284950 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55c05a07ace0 0x55c05a07d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:56:50.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.841+0000 7f016ffff700 1 --2- 172.21.15.83:0/1082284950 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55c05a07ace0 0x55c05a07d100 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3175ea772311616e server_cookie=20a910da747f11d0 in_seq=0 out_seq=0 2024-04-01T06:56:50.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.841+0000 7f01577fe700 10 client.15783 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:56:50.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.842+0000 7f01577fe700 1 -- 172.21.15.83:0/1082284950 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55c059dabcf0 con 0x55c05a07ace0 2024-04-01T06:56:50.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.842+0000 7f01577fe700 10 client.15783 handle_command_reply: tid=0 2024-04-01T06:56:50.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.842+0000 7f018a4fbb80 1 client.15783 shutdown 2024-04-01T06:56:50.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.842+0000 7f018a4fbb80 1 -- 172.21.15.83:0/1082284950 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c05a00a5d0 msgr2=0x55c05a01aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:50.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.842+0000 7f018a4fbb80 1 --2- 172.21.15.83:0/1082284950 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c05a00a5d0 0x55c05a01aa50 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f0168028d30 tx=0x7f0168031460 comp rx=0 tx=0).stop 2024-04-01T06:56:50.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.842+0000 7f018a4fbb80 1 -- 172.21.15.83:0/1082284950 shutdown_connections 2024-04-01T06:56:50.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.842+0000 7f018a4fbb80 1 --2- 172.21.15.83:0/1082284950 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55c05a07ace0 0x55c05a07d100 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.842+0000 7f018a4fbb80 1 --2- 172.21.15.83:0/1082284950 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c05a00a5d0 0x55c05a01aa50 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.842+0000 7f018a4fbb80 1 --2- 172.21.15.83:0/1082284950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c05a015df0 0x55c05a01b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.842+0000 7f018a4fbb80 1 --2- 172.21.15.83:0/1082284950 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c05a00aef0 0x55c05a01af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.842+0000 7f018a4fbb80 1 -- 172.21.15.83:0/1082284950 >> 172.21.15.83:0/1082284950 conn(0x55c059f6a6a0 msgr2=0x55c05a00def0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:50.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.842+0000 7f01577fe700 0 client.15783 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:56:50.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.843+0000 7f018a4fbb80 1 -- 172.21.15.83:0/1082284950 shutdown_connections 2024-04-01T06:56:50.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.843+0000 7f018a4fbb80 1 -- 172.21.15.83:0/1082284950 wait complete. 2024-04-01T06:56:50.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.843+0000 7f018a4fbb80 20 client.15783 trim_cache size 0 max 16384 2024-04-01T06:56:50.847 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-04-01T06:56:50.847 INFO:teuthology.orchestra.run.smithi083.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-01T06:56:50.847 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubs": { 2024-04-01T06:56:50.847 INFO:teuthology.orchestra.run.smithi083.stdout: "e82e13b1-338a-4337-8850-730deef0797b": { 2024-04-01T06:56:50.847 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/", 2024-04-01T06:56:50.847 INFO:teuthology.orchestra.run.smithi083.stdout: "tag": "e82e13b1-338a-4337-8850-730deef0797b", 2024-04-01T06:56:50.847 INFO:teuthology.orchestra.run.smithi083.stdout: "options": "recursive,force" 2024-04-01T06:56:50.847 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T06:56:50.848 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T06:56:50.848 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-04-01T06:56:50.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.844+0000 7f017e365700 1 -- 172.21.15.83:0/1544780902 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f01640a1430 msgr2=0x7f01640a38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:50.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.844+0000 7f017e365700 1 --2- 172.21.15.83:0/1544780902 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f01640a1430 0x7f01640a38f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0168009be0 tx=0x7f0168009260 comp rx=0 tx=0).stop 2024-04-01T06:56:50.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.844+0000 7f017e365700 1 -- 172.21.15.83:0/1544780902 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01780687f0 msgr2=0x7f01781a3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:56:50.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.844+0000 7f017e365700 1 --2- 172.21.15.83:0/1544780902 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01780687f0 0x7f01781a3b10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f016000e9a0 tx=0x7f016000ecb0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.844+0000 7f017e365700 1 -- 172.21.15.83:0/1544780902 shutdown_connections 2024-04-01T06:56:50.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.844+0000 7f017e365700 1 --2- 172.21.15.83:0/1544780902 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f01640a1430 0x7f01640a38f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.844+0000 7f017e365700 1 --2- 172.21.15.83:0/1544780902 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0178105ce0 0x7f017810cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.844+0000 7f017e365700 1 --2- 172.21.15.83:0/1544780902 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0178067e30 0x7f01781a35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.844+0000 7f017e365700 1 --2- 172.21.15.83:0/1544780902 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01780687f0 0x7f01781a3b10 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:56:50.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.844+0000 7f017e365700 1 -- 172.21.15.83:0/1544780902 >> 172.21.15.83:0/1544780902 conn(0x7f0178076d40 msgr2=0x7f0178104d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:56:50.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.844+0000 7f017e365700 1 -- 172.21.15.83:0/1544780902 shutdown_connections 2024-04-01T06:56:50.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:56:50.844+0000 7f017e365700 1 -- 172.21.15.83:0/1544780902 wait complete. 2024-04-01T06:56:50.860 INFO:tasks.cephfs.filesystem:scrub status for tag:e82e13b1-338a-4337-8850-730deef0797b - {'path': '/', 'tag': 'e82e13b1-338a-4337-8850-730deef0797b', 'options': 'recursive,force'} 2024-04-01T06:56:52.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:56:51 smithi145 ceph-mon[47816]: scrub queued for path: / 2024-04-01T06:56:52.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:56:51 smithi145 ceph-mon[47816]: scrub summary: idle+waiting paths [/] 2024-04-01T06:56:52.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:56:51 smithi145 ceph-mon[47816]: scrub summary: active paths [/] 2024-04-01T06:56:52.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:56:51 smithi145 ceph-mon[47816]: scrub summary: idle+waiting paths [/] 2024-04-01T06:56:52.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:56:51 smithi083 ceph-mon[43429]: scrub queued for path: / 2024-04-01T06:56:52.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:56:51 smithi083 ceph-mon[43429]: scrub summary: idle+waiting paths [/] 2024-04-01T06:56:52.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:56:51 smithi083 ceph-mon[43429]: scrub summary: active paths [/] 2024-04-01T06:56:52.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:56:51 smithi083 ceph-mon[43429]: scrub summary: idle+waiting paths [/] 2024-04-01T06:56:52.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:56:51 smithi153 ceph-mon[48187]: scrub queued for path: / 2024-04-01T06:56:52.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:56:51 smithi153 ceph-mon[48187]: scrub summary: idle+waiting paths [/] 2024-04-01T06:56:52.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:56:51 smithi153 ceph-mon[48187]: scrub summary: active paths [/] 2024-04-01T06:56:52.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:56:51 smithi153 ceph-mon[48187]: scrub summary: idle+waiting paths [/] 2024-04-01T06:56:53.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:56:52 smithi145 ceph-mon[47816]: pgmap v32: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-01T06:56:53.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:56:52 smithi145 ceph-mon[47816]: scrub summary: idle 2024-04-01T06:56:53.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:56:52 smithi083 ceph-mon[43429]: pgmap v32: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-01T06:56:53.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:56:52 smithi083 ceph-mon[43429]: scrub summary: idle 2024-04-01T06:56:53.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:56:52 smithi153 ceph-mon[48187]: pgmap v32: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-01T06:56:53.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:56:52 smithi153 ceph-mon[48187]: scrub summary: idle 2024-04-01T06:56:55.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:56:54 smithi145 ceph-mon[47816]: pgmap v33: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-01T06:56:55.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:56:54 smithi083 ceph-mon[43429]: pgmap v33: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-01T06:56:55.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:56:54 smithi153 ceph-mon[48187]: pgmap v33: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-04-01T06:56:57.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:56:56 smithi145 ceph-mon[47816]: pgmap v34: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-01T06:56:57.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:56:56 smithi083 ceph-mon[43429]: pgmap v34: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-01T06:56:57.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:56:56 smithi153 ceph-mon[48187]: pgmap v34: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-01T06:56:58.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:56:57 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:56:58.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:56:57 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:56:58.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:56:57 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:56:59.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:56:58 smithi145 ceph-mon[47816]: pgmap v35: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-04-01T06:56:59.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:56:58 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:56:59.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:56:58 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:56:59.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:56:58 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:56:59.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:56:58 smithi083 ceph-mon[43429]: pgmap v35: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-04-01T06:56:59.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:56:58 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:56:59.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:56:58 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:56:59.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:56:58 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:56:59.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:56:58 smithi153 ceph-mon[48187]: pgmap v35: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-04-01T06:56:59.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:56:58 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:56:59.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:56:58 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:56:59.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:56:58 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:57:01.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:00 smithi145 ceph-mon[47816]: pgmap v36: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-01T06:57:01.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:00 smithi083 ceph-mon[43429]: pgmap v36: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-01T06:57:01.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:00 smithi153 ceph-mon[48187]: pgmap v36: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-01T06:57:01.888 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.886+0000 7f2b538be700 1 -- 172.21.15.83:0/22110695 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b4c100cf0 msgr2=0x7f2b4c10ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:01.888 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.886+0000 7f2b538be700 1 --2- 172.21.15.83:0/22110695 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b4c100cf0 0x7f2b4c10ca00 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f2b4400b0a0 tx=0x7f2b4400b3b0 comp rx=0 tx=0).stop 2024-04-01T06:57:01.888 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.886+0000 7f2b538be700 1 -- 172.21.15.83:0/22110695 shutdown_connections 2024-04-01T06:57:01.888 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.886+0000 7f2b538be700 1 --2- 172.21.15.83:0/22110695 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b4c100cf0 0x7f2b4c10ca00 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:01.888 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.886+0000 7f2b538be700 1 --2- 172.21.15.83:0/22110695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b4c104b90 0x7f2b4c104f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:01.888 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.886+0000 7f2b538be700 1 --2- 172.21.15.83:0/22110695 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2b4c100330 0x7f2b4c1007b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:01.888 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.886+0000 7f2b538be700 1 -- 172.21.15.83:0/22110695 >> 172.21.15.83:0/22110695 conn(0x7f2b4c0761b0 msgr2=0x7f2b4c0fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:01.888 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.886+0000 7f2b538be700 1 -- 172.21.15.83:0/22110695 shutdown_connections 2024-04-01T06:57:01.889 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.886+0000 7f2b538be700 1 -- 172.21.15.83:0/22110695 wait complete. 2024-04-01T06:57:01.889 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.887+0000 7f2b538be700 1 Processor -- start 2024-04-01T06:57:01.889 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.887+0000 7f2b538be700 1 -- start start 2024-04-01T06:57:01.889 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.887+0000 7f2b538be700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2b4c100330 0x7f2b4c1972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:01.889 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.887+0000 7f2b538be700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b4c100cf0 0x7f2b4c1977f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:01.889 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.887+0000 7f2b538be700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b4c104b90 0x7f2b4c19bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:01.889 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.887+0000 7f2b538be700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4c19c1d0 con 0x7f2b4c100cf0 2024-04-01T06:57:01.889 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.887+0000 7f2b538be700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4c19c340 con 0x7f2b4c100330 2024-04-01T06:57:01.889 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.887+0000 7f2b538be700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4c19c500 con 0x7f2b4c104b90 2024-04-01T06:57:01.889 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.887+0000 7f2b50e59700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b4c100cf0 0x7f2b4c1977f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:01.889 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.887+0000 7f2b50e59700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b4c100cf0 0x7f2b4c1977f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57748/0 (socket says 172.21.15.83:57748) 2024-04-01T06:57:01.889 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.887+0000 7f2b50e59700 1 -- 172.21.15.83:0/2236399138 learned_addr learned my addr 172.21.15.83:0/2236399138 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:01.889 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.887+0000 7f2b51e5b700 1 --2- 172.21.15.83:0/2236399138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b4c104b90 0x7f2b4c19bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:01.889 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.887+0000 7f2b5165a700 1 --2- 172.21.15.83:0/2236399138 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2b4c100330 0x7f2b4c1972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:01.890 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.887+0000 7f2b50e59700 1 -- 172.21.15.83:0/2236399138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b4c104b90 msgr2=0x7f2b4c19bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:01.890 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.887+0000 7f2b50e59700 1 --2- 172.21.15.83:0/2236399138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b4c104b90 0x7f2b4c19bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:01.890 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.887+0000 7f2b50e59700 1 -- 172.21.15.83:0/2236399138 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2b4c100330 msgr2=0x7f2b4c1972b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:01.890 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.887+0000 7f2b50e59700 1 --2- 172.21.15.83:0/2236399138 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2b4c100330 0x7f2b4c1972b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:01.890 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.887+0000 7f2b50e59700 1 -- 172.21.15.83:0/2236399138 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b44009d00 con 0x7f2b4c100cf0 2024-04-01T06:57:01.890 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.887+0000 7f2b50e59700 1 --2- 172.21.15.83:0/2236399138 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b4c100cf0 0x7f2b4c1977f0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c00d950 tx=0x7f2b3c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:01.890 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.888+0000 7f2b427fc700 1 -- 172.21.15.83:0/2236399138 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c009940 con 0x7f2b4c100cf0 2024-04-01T06:57:01.890 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.888+0000 7f2b427fc700 1 -- 172.21.15.83:0/2236399138 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2b3c010460 con 0x7f2b4c100cf0 2024-04-01T06:57:01.890 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.888+0000 7f2b538be700 1 -- 172.21.15.83:0/2236399138 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b4c19c7e0 con 0x7f2b4c100cf0 2024-04-01T06:57:01.890 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.888+0000 7f2b427fc700 1 -- 172.21.15.83:0/2236399138 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c00f620 con 0x7f2b4c100cf0 2024-04-01T06:57:01.890 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.888+0000 7f2b538be700 1 -- 172.21.15.83:0/2236399138 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b4c1a4020 con 0x7f2b4c100cf0 2024-04-01T06:57:01.891 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.891+0000 7f2b5fa54b80 1 Processor -- start 2024-04-01T06:57:01.893 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.891+0000 7f2b5fa54b80 1 -- start start 2024-04-01T06:57:01.893 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.891+0000 7f2b5fa54b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c1a81b1d20 0x55c1a81b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:01.894 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.892+0000 7f2b5fa54b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c1a81b0640 0x55c1a81b0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:01.894 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.892+0000 7f2b5fa54b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c1a81c3f70 0x55c1a81c6360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:01.894 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.892+0000 7f2b5fa54b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1a8109930 con 0x55c1a81b0640 2024-04-01T06:57:01.894 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.892+0000 7f2b5fa54b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1a81072f0 con 0x55c1a81c3f70 2024-04-01T06:57:01.894 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.892+0000 7f2b5fa54b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1a8102be0 con 0x55c1a81b1d20 2024-04-01T06:57:01.894 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.892+0000 7f2b5165a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c1a81b0640 0x55c1a81b0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:01.894 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.892+0000 7f2b5165a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c1a81b0640 0x55c1a81b0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57754/0 (socket says 172.21.15.83:57754) 2024-04-01T06:57:01.894 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.892+0000 7f2b5165a700 1 -- 172.21.15.83:0/1331290742 learned_addr learned my addr 172.21.15.83:0/1331290742 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:01.894 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.892+0000 7f2b50e59700 1 --2- 172.21.15.83:0/1331290742 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c1a81c3f70 0x55c1a81c6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:01.894 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.892+0000 7f2b5165a700 1 -- 172.21.15.83:0/1331290742 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c1a81b1d20 msgr2=0x55c1a81b0100 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-01T06:57:01.894 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.892+0000 7f2b5165a700 1 --2- 172.21.15.83:0/1331290742 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c1a81b1d20 0x55c1a81b0100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:01.894 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.892+0000 7f2b5165a700 1 -- 172.21.15.83:0/1331290742 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c1a81c3f70 msgr2=0x55c1a81c6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:01.894 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.892+0000 7f2b5165a700 1 --2- 172.21.15.83:0/1331290742 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c1a81c3f70 0x55c1a81c6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:01.895 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.892+0000 7f2b5165a700 1 -- 172.21.15.83:0/1331290742 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c1a7f84350 con 0x55c1a81b0640 2024-04-01T06:57:01.895 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.892+0000 7f2b50e59700 1 --2- 172.21.15.83:0/1331290742 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c1a81c3f70 0x55c1a81c6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:57:01.895 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.892+0000 7f2b5165a700 1 --2- 172.21.15.83:0/1331290742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c1a81b0640 0x55c1a81b0ac0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f2b4800bd70 tx=0x7f2b4800f640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb6a7a0fa9414ca7 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:01.895 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.892+0000 7f2b377fe700 1 -- 172.21.15.83:0/1331290742 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4800fe50 con 0x55c1a81b0640 2024-04-01T06:57:01.895 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.892+0000 7f2b377fe700 1 -- 172.21.15.83:0/1331290742 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2b4801a920 con 0x55c1a81b0640 2024-04-01T06:57:01.895 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.892+0000 7f2b377fe700 1 -- 172.21.15.83:0/1331290742 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b48011800 con 0x55c1a81b0640 2024-04-01T06:57:01.895 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.893+0000 7f2b5fa54b80 1 -- 172.21.15.83:0/1331290742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c1a81b0640 msgr2=0x55c1a81b0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:01.895 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.893+0000 7f2b5fa54b80 1 --2- 172.21.15.83:0/1331290742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c1a81b0640 0x55c1a81b0ac0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f2b4800bd70 tx=0x7f2b4800f640 comp rx=0 tx=0).stop 2024-04-01T06:57:01.895 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.893+0000 7f2b5fa54b80 1 -- 172.21.15.83:0/1331290742 shutdown_connections 2024-04-01T06:57:01.895 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.893+0000 7f2b5fa54b80 1 --2- 172.21.15.83:0/1331290742 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c1a81c3f70 0x55c1a81c6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:01.895 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.893+0000 7f2b5fa54b80 1 --2- 172.21.15.83:0/1331290742 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c1a81b1d20 0x55c1a81b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:01.895 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.893+0000 7f2b5fa54b80 1 --2- 172.21.15.83:0/1331290742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c1a81b0640 0x55c1a81b0ac0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:01.895 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.893+0000 7f2b5fa54b80 1 -- 172.21.15.83:0/1331290742 >> 172.21.15.83:0/1331290742 conn(0x55c1a8110640 msgr2=0x55c1a81ac520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:01.895 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.893+0000 7f2b427fc700 1 -- 172.21.15.83:0/2236399138 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) v1 ==== 136098+0+0 (secure 0 0 0) 0x7f2b3c0108d0 con 0x7f2b4c100cf0 2024-04-01T06:57:01.895 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.893+0000 7f2b5fa54b80 1 -- 172.21.15.83:0/1331290742 shutdown_connections 2024-04-01T06:57:01.896 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.893+0000 7f2b5fa54b80 1 -- 172.21.15.83:0/1331290742 wait complete. 2024-04-01T06:57:01.896 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.894+0000 7f2b5fa54b80 1 -- start start 2024-04-01T06:57:01.896 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.894+0000 7f2b5fa54b80 1 Processor -- start 2024-04-01T06:57:01.899 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.894+0000 7f2b427fc700 1 --2- 172.21.15.83:0/2236399138 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f2b380a12c0 0x7f2b380a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:01.899 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.894+0000 7f2b5fa54b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c1a81b0640 0x55c1a81bd610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:01.900 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.894+0000 7f2b5fa54b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c1a81b1d20 0x55c1a81bdb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:01.900 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.894+0000 7f2b51e5b700 1 --2- 172.21.15.83:0/2236399138 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f2b380a12c0 0x7f2b380a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:01.900 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.894+0000 7f2b5fa54b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c1a81c3f70 0x55c1a81c3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:01.900 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.894+0000 7f2b5fa54b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1a809ed20 con 0x55c1a81c3f70 2024-04-01T06:57:01.900 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.894+0000 7f2b5fa54b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1a809e9c0 con 0x55c1a81b1d20 2024-04-01T06:57:01.900 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.894+0000 7f2b5fa54b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1a7f86640 con 0x55c1a81b0640 2024-04-01T06:57:01.900 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.894+0000 7f2b427fc700 1 -- 172.21.15.83:0/2236399138 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f2b3c0ccda0 con 0x7f2b4c100cf0 2024-04-01T06:57:01.900 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.894+0000 7f2b5fa54b80 10 client.0 _ll_register_callbacks cb 0x55c1a80a8410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:57:01.900 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.894+0000 7f2b51e5b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c1a81c3f70 0x55c1a81c3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:01.900 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.894+0000 7f2b51e5b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c1a81c3f70 0x55c1a81c3380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57762/0 (socket says 172.21.15.83:57762) 2024-04-01T06:57:01.900 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.894+0000 7f2b51e5b700 1 -- 172.21.15.83:0/1524917456 learned_addr learned my addr 172.21.15.83:0/1524917456 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:01.900 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.894+0000 7f2b5165a700 1 --2- 172.21.15.83:0/1524917456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c1a81b0640 0x55c1a81bd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:01.900 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.895+0000 7f2b50e59700 1 --2- 172.21.15.83:0/1524917456 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c1a81b1d20 0x55c1a81bdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:01.901 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.895+0000 7f2b51e5b700 1 --2- 172.21.15.83:0/2236399138 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f2b380a12c0 0x7f2b380a3780 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2b44007e40 tx=0x7f2b44007e70 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:01.901 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.895+0000 7f2b51e5b700 1 -- 172.21.15.83:0/1524917456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c1a81b0640 msgr2=0x55c1a81bd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:01.901 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.895+0000 7f2b51e5b700 1 --2- 172.21.15.83:0/1524917456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c1a81b0640 0x55c1a81bd610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:01.901 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.895+0000 7f2b51e5b700 1 -- 172.21.15.83:0/1524917456 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c1a81b1d20 msgr2=0x55c1a81bdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:01.901 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.895+0000 7f2b51e5b700 1 --2- 172.21.15.83:0/1524917456 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c1a81b1d20 0x55c1a81bdb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:01.901 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.895+0000 7f2b51e5b700 1 -- 172.21.15.83:0/1524917456 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b4800b9a0 con 0x55c1a81c3f70 2024-04-01T06:57:01.901 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.895+0000 7f2b50e59700 1 --2- 172.21.15.83:0/1524917456 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c1a81b1d20 0x55c1a81bdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:57:01.901 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.895+0000 7f2b51e5b700 1 --2- 172.21.15.83:0/1524917456 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c1a81c3f70 0x55c1a81c3380 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f2b44007ee0 tx=0x7f2b44023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2e386d083c45e0b server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:01.901 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.895+0000 7f2b34ff9700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:57:01.901 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.895+0000 7f2b34ff9700 1 -- 172.21.15.83:0/1524917456 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4400e040 con 0x55c1a81c3f70 2024-04-01T06:57:01.901 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.895+0000 7f2b34ff9700 1 -- 172.21.15.83:0/1524917456 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f2b4401f470 con 0x55c1a81c3f70 2024-04-01T06:57:01.901 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.895+0000 7f2b5fa54b80 1 -- 172.21.15.83:0/1524917456 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c1a80c3320 con 0x55c1a81c3f70 2024-04-01T06:57:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.895+0000 7f2b34ff9700 1 -- 172.21.15.83:0/1524917456 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b44009490 con 0x55c1a81c3f70 2024-04-01T06:57:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.895+0000 7f2b5fa54b80 10 client.15795 fetch_fsmap learned FSMap version 24 2024-04-01T06:57:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.895+0000 7f2b5fa54b80 1 -- 172.21.15.83:0/1524917456 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55c1a7f30b00 con 0x55c1a81c3f70 2024-04-01T06:57:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.895+0000 7f2b34ff9700 1 -- 172.21.15.83:0/1524917456 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c1a80c3320 con 0x55c1a81c3f70 2024-04-01T06:57:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.896+0000 7f2b34ff9700 1 -- 172.21.15.83:0/1524917456 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f2b44031060 con 0x55c1a81c3f70 2024-04-01T06:57:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.896+0000 7f2b5fa54b80 10 client.15795 fetch_fsmap finished waiting for FSMap version 24 2024-04-01T06:57:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.896+0000 7f2b5fa54b80 10 client.15795 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-01T06:57:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.896+0000 7f2b5fa54b80 20 client.15795 populate_metadata read hostname 'smithi083' 2024-04-01T06:57:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.896+0000 7f2b5fa54b80 1 --2- 172.21.15.83:0/1524917456 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55c1a81dc540 0x55c1a81de960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.896+0000 7f2b5fa54b80 4 client.15795 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-01T06:57:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.896+0000 7f2b5fa54b80 1 -- 172.21.15.83:0/1524917456 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c1a80fb6a0 con 0x55c1a81dc540 2024-04-01T06:57:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.896+0000 7f2b5165a700 1 --2- 172.21.15.83:0/1524917456 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55c1a81dc540 0x55c1a81de960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.896+0000 7f2b34ff9700 10 client.15795 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:57:01.903 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.896+0000 7f2b5165a700 1 --2- 172.21.15.83:0/1524917456 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55c1a81dc540 0x55c1a81de960 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84b37134aeceea56 server_cookie=4bdd1815913d4b21 in_seq=0 out_seq=0 2024-04-01T06:57:01.903 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.897+0000 7f2b34ff9700 1 -- 172.21.15.83:0/1524917456 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c1a80fb6a0 con 0x55c1a81dc540 2024-04-01T06:57:01.903 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.897+0000 7f2b34ff9700 10 client.15795 handle_command_reply: tid=0 2024-04-01T06:57:01.903 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.897+0000 7f2b5fa54b80 1 client.15795 shutdown 2024-04-01T06:57:01.903 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.897+0000 7f2b5fa54b80 1 -- 172.21.15.83:0/1524917456 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c1a81c3f70 msgr2=0x55c1a81c3380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:01.903 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.897+0000 7f2b5fa54b80 1 --2- 172.21.15.83:0/1524917456 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c1a81c3f70 0x55c1a81c3380 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f2b44007ee0 tx=0x7f2b44023000 comp rx=0 tx=0).stop 2024-04-01T06:57:01.903 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.897+0000 7f2b5fa54b80 1 -- 172.21.15.83:0/1524917456 shutdown_connections 2024-04-01T06:57:01.903 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.897+0000 7f2b5fa54b80 1 --2- 172.21.15.83:0/1524917456 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55c1a81dc540 0x55c1a81de960 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:01.903 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.897+0000 7f2b5fa54b80 1 --2- 172.21.15.83:0/1524917456 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c1a81c3f70 0x55c1a81c3380 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:01.903 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.897+0000 7f2b34ff9700 0 client.15795 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:57:01.903 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.897+0000 7f2b5fa54b80 1 --2- 172.21.15.83:0/1524917456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c1a81b0640 0x55c1a81bd610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:01.903 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.897+0000 7f2b5fa54b80 1 --2- 172.21.15.83:0/1524917456 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c1a81b1d20 0x55c1a81bdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:01.904 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.897+0000 7f2b5fa54b80 1 -- 172.21.15.83:0/1524917456 >> 172.21.15.83:0/1524917456 conn(0x55c1a8110640 msgr2=0x55c1a81b21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:01.904 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.897+0000 7f2b5fa54b80 1 -- 172.21.15.83:0/1524917456 shutdown_connections 2024-04-01T06:57:01.904 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.897+0000 7f2b5fa54b80 1 -- 172.21.15.83:0/1524917456 wait complete. 2024-04-01T06:57:01.904 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.897+0000 7f2b5fa54b80 20 client.15795 trim_cache size 0 max 16384 2024-04-01T06:57:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.912+0000 7f2b5fa54b80 1 Processor -- start 2024-04-01T06:57:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.912+0000 7f2b5fa54b80 1 -- start start 2024-04-01T06:57:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.912+0000 7f2b5fa54b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c1a81b0640 0x55c1a81bdb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.912+0000 7f2b5fa54b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c1a81b1d20 0x55c1a81c3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.912+0000 7f2b5fa54b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c1a81c3f70 0x55c1a81b6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.912+0000 7f2b5fa54b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1a81b8b10 con 0x55c1a81b0640 2024-04-01T06:57:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.912+0000 7f2b5fa54b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1a81b3110 con 0x55c1a81c3f70 2024-04-01T06:57:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.912+0000 7f2b5fa54b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1a81c66e0 con 0x55c1a81b1d20 2024-04-01T06:57:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.912+0000 7f2b5165a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c1a81b0640 0x55c1a81bdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.912+0000 7f2b5165a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c1a81b0640 0x55c1a81bdb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57764/0 (socket says 172.21.15.83:57764) 2024-04-01T06:57:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.912+0000 7f2b5165a700 1 -- 172.21.15.83:0/751730647 learned_addr learned my addr 172.21.15.83:0/751730647 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.912+0000 7f2b51e5b700 1 --2- 172.21.15.83:0/751730647 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c1a81c3f70 0x55c1a81b6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.912+0000 7f2b50e59700 1 --2- 172.21.15.83:0/751730647 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c1a81b1d20 0x55c1a81c3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.913+0000 7f2b5165a700 1 -- 172.21.15.83:0/751730647 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c1a81b1d20 msgr2=0x55c1a81c3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.913+0000 7f2b5165a700 1 --2- 172.21.15.83:0/751730647 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c1a81b1d20 0x55c1a81c3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.913+0000 7f2b5165a700 1 -- 172.21.15.83:0/751730647 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c1a81c3f70 msgr2=0x55c1a81b6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.913+0000 7f2b5165a700 1 --2- 172.21.15.83:0/751730647 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c1a81c3f70 0x55c1a81b6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.913+0000 7f2b5165a700 1 -- 172.21.15.83:0/751730647 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c1a80c8e40 con 0x55c1a81b0640 2024-04-01T06:57:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.913+0000 7f2b5165a700 1 --2- 172.21.15.83:0/751730647 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c1a81b0640 0x55c1a81bdb10 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f2b4800bd70 tx=0x7f2b48011440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a335105754beaad server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.913+0000 7f2b37fff700 1 -- 172.21.15.83:0/751730647 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4801a660 con 0x55c1a81b0640 2024-04-01T06:57:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.913+0000 7f2b37fff700 1 -- 172.21.15.83:0/751730647 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2b48005b00 con 0x55c1a81b0640 2024-04-01T06:57:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.913+0000 7f2b37fff700 1 -- 172.21.15.83:0/751730647 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b48004290 con 0x55c1a81b0640 2024-04-01T06:57:01.921 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.914+0000 7f2b5fa54b80 1 -- 172.21.15.83:0/751730647 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c1a81b0640 msgr2=0x55c1a81bdb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:01.921 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.914+0000 7f2b5fa54b80 1 --2- 172.21.15.83:0/751730647 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c1a81b0640 0x55c1a81bdb10 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f2b4800bd70 tx=0x7f2b48011440 comp rx=0 tx=0).stop 2024-04-01T06:57:01.921 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.914+0000 7f2b5fa54b80 1 -- 172.21.15.83:0/751730647 shutdown_connections 2024-04-01T06:57:01.921 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.914+0000 7f2b5fa54b80 1 --2- 172.21.15.83:0/751730647 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c1a81b0640 0x55c1a81bdb10 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:01.921 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.914+0000 7f2b5fa54b80 1 --2- 172.21.15.83:0/751730647 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c1a81c3f70 0x55c1a81b6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:01.921 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.914+0000 7f2b5fa54b80 1 --2- 172.21.15.83:0/751730647 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c1a81b1d20 0x55c1a81c3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:01.921 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.914+0000 7f2b5fa54b80 1 -- 172.21.15.83:0/751730647 >> 172.21.15.83:0/751730647 conn(0x55c1a8110640 msgr2=0x55c1a81bd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:01.921 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.914+0000 7f2b5fa54b80 1 -- 172.21.15.83:0/751730647 shutdown_connections 2024-04-01T06:57:01.921 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.914+0000 7f2b5fa54b80 1 -- 172.21.15.83:0/751730647 wait complete. 2024-04-01T06:57:01.921 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.914+0000 7f2b5fa54b80 1 -- start start 2024-04-01T06:57:01.922 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.914+0000 7f2b5fa54b80 1 Processor -- start 2024-04-01T06:57:01.922 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.915+0000 7f2b5fa54b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c1a81b0640 0x55c1a81c3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:01.922 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.915+0000 7f2b5fa54b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c1a81b1d20 0x55c1a81c1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:01.922 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.915+0000 7f2b5fa54b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c1a81c3f70 0x55c1a81c1c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:01.922 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.915+0000 7f2b5fa54b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1a81c2360 con 0x55c1a81c3f70 2024-04-01T06:57:01.922 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.915+0000 7f2b5fa54b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1a8230340 con 0x55c1a81b1d20 2024-04-01T06:57:01.922 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.915+0000 7f2b5fa54b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1a8230480 con 0x55c1a81b0640 2024-04-01T06:57:01.922 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.915+0000 7f2b5fa54b80 10 client.0 _ll_register_callbacks cb 0x55c1a80a8410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:57:01.922 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.915+0000 7f2b51e5b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c1a81c3f70 0x55c1a81c1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:01.922 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.915+0000 7f2b51e5b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c1a81c3f70 0x55c1a81c1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57766/0 (socket says 172.21.15.83:57766) 2024-04-01T06:57:01.922 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.915+0000 7f2b51e5b700 1 -- 172.21.15.83:0/1175715813 learned_addr learned my addr 172.21.15.83:0/1175715813 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:01.922 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.915+0000 7f2b5165a700 1 --2- 172.21.15.83:0/1175715813 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c1a81b0640 0x55c1a81c3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:01.922 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.915+0000 7f2b50e59700 1 --2- 172.21.15.83:0/1175715813 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c1a81b1d20 0x55c1a81c1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:01.923 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.915+0000 7f2b51e5b700 1 -- 172.21.15.83:0/1175715813 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c1a81b0640 msgr2=0x55c1a81c3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:01.923 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.915+0000 7f2b51e5b700 1 --2- 172.21.15.83:0/1175715813 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c1a81b0640 0x55c1a81c3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:01.923 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.915+0000 7f2b51e5b700 1 -- 172.21.15.83:0/1175715813 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c1a81b1d20 msgr2=0x55c1a81c1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:01.923 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.915+0000 7f2b51e5b700 1 --2- 172.21.15.83:0/1175715813 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c1a81b1d20 0x55c1a81c1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:01.923 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.915+0000 7f2b51e5b700 1 -- 172.21.15.83:0/1175715813 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c1a7f84350 con 0x55c1a81c3f70 2024-04-01T06:57:01.923 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.915+0000 7f2b50e59700 1 --2- 172.21.15.83:0/1175715813 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c1a81b1d20 0x55c1a81c1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:57:01.923 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.915+0000 7f2b51e5b700 1 --2- 172.21.15.83:0/1175715813 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c1a81c3f70 0x55c1a81c1c50 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f2b440051a0 tx=0x7f2b44005980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10611513e9d9a63c server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:01.923 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.915+0000 7f2b34ff9700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:57:01.923 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.915+0000 7f2b34ff9700 1 -- 172.21.15.83:0/1175715813 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b44007bb0 con 0x55c1a81c3f70 2024-04-01T06:57:01.923 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.915+0000 7f2b34ff9700 1 -- 172.21.15.83:0/1175715813 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f2b44005490 con 0x55c1a81c3f70 2024-04-01T06:57:01.923 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.915+0000 7f2b5fa54b80 1 -- 172.21.15.83:0/1175715813 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c1a7f51c90 con 0x55c1a81c3f70 2024-04-01T06:57:01.923 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.916+0000 7f2b34ff9700 1 -- 172.21.15.83:0/1175715813 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b44009490 con 0x55c1a81c3f70 2024-04-01T06:57:01.923 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.916+0000 7f2b5fa54b80 10 client.15801 fetch_fsmap learned FSMap version 24 2024-04-01T06:57:01.923 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.916+0000 7f2b5fa54b80 1 -- 172.21.15.83:0/1175715813 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55c1a7f88c70 con 0x55c1a81c3f70 2024-04-01T06:57:01.923 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.916+0000 7f2b34ff9700 1 -- 172.21.15.83:0/1175715813 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2b4404a020 con 0x55c1a81c3f70 2024-04-01T06:57:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.916+0000 7f2b34ff9700 1 -- 172.21.15.83:0/1175715813 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f2b44031040 con 0x55c1a81c3f70 2024-04-01T06:57:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.916+0000 7f2b5fa54b80 10 client.15801 fetch_fsmap finished waiting for FSMap version 24 2024-04-01T06:57:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.916+0000 7f2b5fa54b80 10 client.15801 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-01T06:57:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.916+0000 7f2b5fa54b80 20 client.15801 populate_metadata read hostname 'smithi083' 2024-04-01T06:57:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.916+0000 7f2b5fa54b80 1 --2- 172.21.15.83:0/1175715813 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55c1a8231720 0x55c1a8233b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.916+0000 7f2b5fa54b80 4 client.15801 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-01T06:57:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.916+0000 7f2b5fa54b80 1 -- 172.21.15.83:0/1175715813 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c1a7f86c80 con 0x55c1a8231720 2024-04-01T06:57:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.916+0000 7f2b5165a700 1 --2- 172.21.15.83:0/1175715813 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55c1a8231720 0x55c1a8233b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.917+0000 7f2b34ff9700 10 client.15801 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:57:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:01.917+0000 7f2b5165a700 1 --2- 172.21.15.83:0/1175715813 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55c1a8231720 0x55c1a8233b10 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d07b524fdec82177 server_cookie=dcb86480a8be832f in_seq=0 out_seq=0 2024-04-01T06:57:02.147 INFO:tasks.workunit.client.0.smithi083.stderr:Note: switching to '5df3435b30085cc9abc1eb282ab0f20651c8a39a'. 2024-04-01T06:57:02.147 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-04-01T06:57:02.148 INFO:tasks.workunit.client.0.smithi083.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-01T06:57:02.148 INFO:tasks.workunit.client.0.smithi083.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-01T06:57:02.148 INFO:tasks.workunit.client.0.smithi083.stderr:state without impacting any branches by switching back to a branch. 2024-04-01T06:57:02.148 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-04-01T06:57:02.148 INFO:tasks.workunit.client.0.smithi083.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-01T06:57:02.148 INFO:tasks.workunit.client.0.smithi083.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-01T06:57:02.148 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-04-01T06:57:02.148 INFO:tasks.workunit.client.0.smithi083.stderr: git switch -c 2024-04-01T06:57:02.148 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-04-01T06:57:02.148 INFO:tasks.workunit.client.0.smithi083.stderr:Or undo this operation with: 2024-04-01T06:57:02.148 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-04-01T06:57:02.148 INFO:tasks.workunit.client.0.smithi083.stderr: git switch - 2024-04-01T06:57:02.148 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-04-01T06:57:02.148 INFO:tasks.workunit.client.0.smithi083.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-01T06:57:02.148 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-04-01T06:57:02.149 INFO:tasks.workunit.client.0.smithi083.stderr:HEAD is now at 5df3435b300 Merge pull request #56120 from mkogan1/wip-64766-reef 2024-04-01T06:57:02.153 DEBUG:teuthology.orchestra.run.smithi083:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-01T06:57:02.184 INFO:tasks.workunit.client.0.smithi083.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-01T06:57:02.186 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-01T06:57:02.186 INFO:tasks.workunit.client.0.smithi083.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-01T06:57:02.299 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:02.298+0000 7f2b34ff9700 1 -- 172.21.15.83:0/1175715813 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c1a7f86c80 con 0x55c1a8231720 2024-04-01T06:57:02.299 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:02.298+0000 7f2b34ff9700 10 client.15801 handle_command_reply: tid=0 2024-04-01T06:57:02.300 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:02.298+0000 7f2b5fa54b80 1 client.15801 shutdown 2024-04-01T06:57:02.300 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:02.298+0000 7f2b5fa54b80 1 -- 172.21.15.83:0/1175715813 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c1a81c3f70 msgr2=0x55c1a81c1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:02.300 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:02.298+0000 7f2b5fa54b80 1 --2- 172.21.15.83:0/1175715813 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c1a81c3f70 0x55c1a81c1c50 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f2b440051a0 tx=0x7f2b44005980 comp rx=0 tx=0).stop 2024-04-01T06:57:02.300 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:02.298+0000 7f2b5fa54b80 1 -- 172.21.15.83:0/1175715813 shutdown_connections 2024-04-01T06:57:02.300 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:02.298+0000 7f2b5fa54b80 1 --2- 172.21.15.83:0/1175715813 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55c1a8231720 0x55c1a8233b10 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:02.300 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:02.298+0000 7f2b5fa54b80 1 --2- 172.21.15.83:0/1175715813 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c1a81c3f70 0x55c1a81c1c50 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:02.300 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:02.298+0000 7f2b5fa54b80 1 --2- 172.21.15.83:0/1175715813 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c1a81b0640 0x55c1a81c3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:02.301 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:02.298+0000 7f2b5fa54b80 1 --2- 172.21.15.83:0/1175715813 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c1a81b1d20 0x55c1a81c1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:02.301 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:02.298+0000 7f2b34ff9700 0 client.15801 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:57:02.301 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:02.298+0000 7f2b5fa54b80 1 -- 172.21.15.83:0/1175715813 >> 172.21.15.83:0/1175715813 conn(0x55c1a8110640 msgr2=0x55c1a81abd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:02.301 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:02.298+0000 7f2b5fa54b80 1 -- 172.21.15.83:0/1175715813 shutdown_connections 2024-04-01T06:57:02.301 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:02.298+0000 7f2b5fa54b80 1 -- 172.21.15.83:0/1175715813 wait complete. 2024-04-01T06:57:02.301 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:02.298+0000 7f2b5fa54b80 20 client.15801 trim_cache size 0 max 16384 2024-04-01T06:57:02.302 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout:{ 2024-04-01T06:57:02.302 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout: "message": "", 2024-04-01T06:57:02.302 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout: "return_code": 0 2024-04-01T06:57:02.303 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout:} 2024-04-01T06:57:02.304 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:02.299+0000 7f2b538be700 1 -- 172.21.15.83:0/2236399138 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f2b380a12c0 msgr2=0x7f2b380a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:02.304 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:02.299+0000 7f2b538be700 1 --2- 172.21.15.83:0/2236399138 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f2b380a12c0 0x7f2b380a3780 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2b44007e40 tx=0x7f2b44007e70 comp rx=0 tx=0).stop 2024-04-01T06:57:02.304 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:02.299+0000 7f2b538be700 1 -- 172.21.15.83:0/2236399138 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b4c100cf0 msgr2=0x7f2b4c1977f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:02.304 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:02.299+0000 7f2b538be700 1 --2- 172.21.15.83:0/2236399138 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b4c100cf0 0x7f2b4c1977f0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c00d950 tx=0x7f2b3c00dc60 comp rx=0 tx=0).stop 2024-04-01T06:57:02.304 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:02.299+0000 7f2b538be700 1 -- 172.21.15.83:0/2236399138 shutdown_connections 2024-04-01T06:57:02.305 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:02.299+0000 7f2b538be700 1 --2- 172.21.15.83:0/2236399138 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f2b380a12c0 0x7f2b380a3780 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:02.305 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:02.299+0000 7f2b538be700 1 --2- 172.21.15.83:0/2236399138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b4c104b90 0x7f2b4c19bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:02.305 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:02.299+0000 7f2b538be700 1 --2- 172.21.15.83:0/2236399138 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2b4c100330 0x7f2b4c1972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:02.305 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:02.299+0000 7f2b538be700 1 --2- 172.21.15.83:0/2236399138 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b4c100cf0 0x7f2b4c1977f0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:02.305 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:02.299+0000 7f2b538be700 1 -- 172.21.15.83:0/2236399138 >> 172.21.15.83:0/2236399138 conn(0x7f2b4c0761b0 msgr2=0x7f2b4c0fd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:02.305 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:02.299+0000 7f2b538be700 1 -- 172.21.15.83:0/2236399138 shutdown_connections 2024-04-01T06:57:02.305 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:02.299+0000 7f2b538be700 1 -- 172.21.15.83:0/2236399138 wait complete. 2024-04-01T06:57:02.650 INFO:tasks.workunit.client.0.smithi083.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-01T06:57:02.716 INFO:tasks.workunit.client.0.smithi083.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-01T06:57:02.753 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-01T06:57:02.755 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-01T06:57:02.755 INFO:tasks.workunit.client.0.smithi083.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-01T06:57:02.792 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-01T06:57:02.795 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-04-01T06:57:02.795 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-01T06:57:02.852 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-04-01T06:57:02.853 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-04-01T06:57:02.853 DEBUG:teuthology.orchestra.run.smithi083:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5df3435b30085cc9abc1eb282ab0f20651c8a39a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-04-01T06:57:02.914 INFO:tasks.workunit.client.0.smithi083.stderr:+ mkdir -p fsstress 2024-04-01T06:57:02.916 INFO:tasks.workunit.client.0.smithi083.stderr:+ pushd fsstress 2024-04-01T06:57:02.917 INFO:tasks.workunit.client.0.smithi083.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-01T06:57:02.917 INFO:tasks.workunit.client.0.smithi083.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-04-01T06:57:03.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:02 smithi145 ceph-mon[47816]: pgmap v37: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-01T06:57:03.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:02 smithi083 ceph-mon[43429]: pgmap v37: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-01T06:57:03.103 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:02 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[85695]: *** Caught signal (Segmentation fault) ** 2024-04-01T06:57:03.104 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:02 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[85695]: in thread 7fb237704700 thread_name:md_log_replay 2024-04-01T06:57:03.104 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:02 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[85695]: ceph version 18.2.2-1001-g9d2ee692 (9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12) reef (stable) 2024-04-01T06:57:03.104 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:02 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[85695]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fb2482c4d20] 2024-04-01T06:57:03.104 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:02 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[85695]: 2: /usr/bin/ceph-mds(+0x4c645f) [0x55d1ac7d245f] 2024-04-01T06:57:03.104 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:02 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[85695]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x55d1ac7d4693] 2024-04-01T06:57:03.104 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:02 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[85695]: 4: (MDLog::_replay_thread()+0x6c9) [0x55d1ac83d3e9] 2024-04-01T06:57:03.104 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:02 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[85695]: 5: (MDLog::ReplayThread::entry()+0x11) [0x55d1ac4ec571] 2024-04-01T06:57:03.104 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:02 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[85695]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7fb2482ba1ca] 2024-04-01T06:57:03.104 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:02 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[85695]: 7: clone() 2024-04-01T06:57:03.104 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:02 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[85695]: 2024-04-01T06:57:02.949+0000 7fb237704700 -1 *** Caught signal (Segmentation fault) ** 2024-04-01T06:57:03.104 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:02 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[85695]: in thread 7fb237704700 thread_name:md_log_replay 2024-04-01T06:57:03.104 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:02 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[85695]: 2024-04-01T06:57:03.105 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:02 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[85695]: ceph version 18.2.2-1001-g9d2ee692 (9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12) reef (stable) 2024-04-01T06:57:03.105 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:02 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[85695]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fb2482c4d20] 2024-04-01T06:57:03.105 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:02 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[85695]: 2: /usr/bin/ceph-mds(+0x4c645f) [0x55d1ac7d245f] 2024-04-01T06:57:03.105 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:02 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[85695]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x55d1ac7d4693] 2024-04-01T06:57:03.105 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:02 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[85695]: 4: (MDLog::_replay_thread()+0x6c9) [0x55d1ac83d3e9] 2024-04-01T06:57:03.105 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:02 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[85695]: 5: (MDLog::ReplayThread::entry()+0x11) [0x55d1ac4ec571] 2024-04-01T06:57:03.105 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:02 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[85695]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7fb2482ba1ca] 2024-04-01T06:57:03.105 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:02 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[85695]: 7: clone() 2024-04-01T06:57:03.105 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:02 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[85695]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-01T06:57:03.105 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:02 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[85695]: 2024-04-01T06:57:03.105 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:02 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[85695]: 0> 2024-04-01T06:57:02.949+0000 7fb237704700 -1 *** Caught signal (Segmentation fault) ** 2024-04-01T06:57:03.105 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:02 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[85695]: in thread 7fb237704700 thread_name:md_log_replay 2024-04-01T06:57:03.105 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:02 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[85695]: 2024-04-01T06:57:03.105 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:02 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[85695]: ceph version 18.2.2-1001-g9d2ee692 (9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12) reef (stable) 2024-04-01T06:57:03.105 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:02 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[85695]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fb2482c4d20] 2024-04-01T06:57:03.106 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:02 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[85695]: 2: /usr/bin/ceph-mds(+0x4c645f) [0x55d1ac7d245f] 2024-04-01T06:57:03.106 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:02 smithi153 ceph-mon[48187]: pgmap v37: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-01T06:57:03.106 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:02 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[85695]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x55d1ac7d4693] 2024-04-01T06:57:03.106 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:02 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[85695]: 4: (MDLog::_replay_thread()+0x6c9) [0x55d1ac83d3e9] 2024-04-01T06:57:03.106 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:02 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[85695]: 5: (MDLog::ReplayThread::entry()+0x11) [0x55d1ac4ec571] 2024-04-01T06:57:03.106 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:02 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[85695]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7fb2482ba1ca] 2024-04-01T06:57:03.106 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:02 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[85695]: 7: clone() 2024-04-01T06:57:03.106 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:02 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[85695]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-01T06:57:03.107 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:02 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[85695]: 2024-04-01T06:57:03.107 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:02 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[85695]: 0> 2024-04-01T06:57:02.949+0000 7fb237704700 -1 *** Caught signal (Segmentation fault) ** 2024-04-01T06:57:03.107 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:02 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[85695]: in thread 7fb237704700 thread_name:md_log_replay 2024-04-01T06:57:03.107 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:02 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[85695]: 2024-04-01T06:57:03.107 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:02 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[85695]: ceph version 18.2.2-1001-g9d2ee692 (9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12) reef (stable) 2024-04-01T06:57:03.107 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:02 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[85695]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fb2482c4d20] 2024-04-01T06:57:03.107 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:02 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[85695]: 2: /usr/bin/ceph-mds(+0x4c645f) [0x55d1ac7d245f] 2024-04-01T06:57:03.107 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:02 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[85695]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x55d1ac7d4693] 2024-04-01T06:57:03.107 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:02 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[85695]: 4: (MDLog::_replay_thread()+0x6c9) [0x55d1ac83d3e9] 2024-04-01T06:57:03.107 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:02 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[85695]: 5: (MDLog::ReplayThread::entry()+0x11) [0x55d1ac4ec571] 2024-04-01T06:57:03.107 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:02 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[85695]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7fb2482ba1ca] 2024-04-01T06:57:03.107 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:02 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[85695]: 7: clone() 2024-04-01T06:57:03.107 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:02 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[85695]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-01T06:57:03.107 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:02 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[85695]: 2024-04-01T06:57:03.390 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:03 smithi153 systemd[1]: ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mds.i.service: Main process exited, code=exited, status=139/n/a 2024-04-01T06:57:03.891 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:03 smithi153 systemd[1]: ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mds.i.service: Failed with result 'exit-code'. 2024-04-01T06:57:04.329 INFO:tasks.workunit.client.0.smithi083.stderr:+ tar xzf ltp-full.tgz 2024-04-01T06:57:05.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:04 smithi145 ceph-mon[47816]: pgmap v38: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-01T06:57:05.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:04 smithi083 ceph-mon[43429]: pgmap v38: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-01T06:57:05.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:04 smithi153 ceph-mon[48187]: pgmap v38: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-04-01T06:57:07.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:06 smithi145 ceph-mon[47816]: pgmap v39: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 KiB/s wr, 24 op/s 2024-04-01T06:57:07.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:06 smithi083 ceph-mon[43429]: pgmap v39: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 KiB/s wr, 24 op/s 2024-04-01T06:57:07.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:06 smithi153 ceph-mon[48187]: pgmap v39: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 26 KiB/s wr, 24 op/s 2024-04-01T06:57:09.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:08 smithi083 ceph-mon[43429]: pgmap v40: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 26 KiB/s wr, 20 op/s 2024-04-01T06:57:09.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:08 smithi153 ceph-mon[48187]: pgmap v40: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 26 KiB/s wr, 20 op/s 2024-04-01T06:57:09.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:08 smithi145 ceph-mon[47816]: pgmap v40: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 26 KiB/s wr, 20 op/s 2024-04-01T06:57:11.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:10 smithi083 ceph-mon[43429]: pgmap v41: 97 pgs: 97 active+clean; 41 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 3.5 MiB/s wr, 314 op/s 2024-04-01T06:57:11.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:10 smithi153 ceph-mon[48187]: pgmap v41: 97 pgs: 97 active+clean; 41 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 3.5 MiB/s wr, 314 op/s 2024-04-01T06:57:11.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:10 smithi145 ceph-mon[47816]: pgmap v41: 97 pgs: 97 active+clean; 41 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 3.5 MiB/s wr, 314 op/s 2024-04-01T06:57:13.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:12 smithi083 ceph-mon[43429]: pgmap v42: 97 pgs: 97 active+clean; 41 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.5 MiB/s wr, 311 op/s 2024-04-01T06:57:13.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:12 smithi153 ceph-mon[48187]: pgmap v42: 97 pgs: 97 active+clean; 41 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.5 MiB/s wr, 311 op/s 2024-04-01T06:57:13.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:12 smithi145 ceph-mon[47816]: pgmap v42: 97 pgs: 97 active+clean; 41 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.5 MiB/s wr, 311 op/s 2024-04-01T06:57:13.893 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:13 smithi153 systemd[1]: ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mds.i.service: Service RestartSec=10s expired, scheduling restart. 2024-04-01T06:57:13.893 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:13 smithi153 systemd[1]: ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mds.i.service: Scheduled restart job, restart counter is at 1. 2024-04-01T06:57:13.893 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:13 smithi153 systemd[1]: Stopped Ceph mds.i for c6f8eff4-eff3-11ee-b647-cb9ed24678a4. 2024-04-01T06:57:13.893 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:13 smithi153 systemd[1]: Starting Ceph mds.i for c6f8eff4-eff3-11ee-b647-cb9ed24678a4... 2024-04-01T06:57:14.390 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:14 smithi153 ceph-mds[88898]: -- 172.21.15.153:0/3370787233 <== mon.1 v2:172.21.15.153:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a5c42641a0 con 0x55a5c423a800 2024-04-01T06:57:14.391 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:14 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[88867]: starting mds.i at 2024-04-01T06:57:14.391 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:14 smithi153 bash[88852]: 6b21267368022ba4d92aee80e2d78738c94bf5e1ee29dc582f6e52a02f983b05 2024-04-01T06:57:14.391 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:57:14 smithi153 systemd[1]: Started Ceph mds.i for c6f8eff4-eff3-11ee-b647-cb9ed24678a4. 2024-04-01T06:57:15.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:14 smithi083 ceph-mon[43429]: pgmap v43: 97 pgs: 97 active+clean; 41 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.5 MiB/s wr, 311 op/s 2024-04-01T06:57:15.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:14 smithi083 ceph-mon[43429]: daemon mds.i restarted 2024-04-01T06:57:15.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:14 smithi083 ceph-mon[43429]: osdmap e83: 12 total, 12 up, 12 in 2024-04-01T06:57:15.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:14 smithi153 ceph-mon[48187]: pgmap v43: 97 pgs: 97 active+clean; 41 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.5 MiB/s wr, 311 op/s 2024-04-01T06:57:15.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:14 smithi153 ceph-mon[48187]: daemon mds.i restarted 2024-04-01T06:57:15.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:14 smithi153 ceph-mon[48187]: osdmap e83: 12 total, 12 up, 12 in 2024-04-01T06:57:15.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:14 smithi145 ceph-mon[47816]: pgmap v43: 97 pgs: 97 active+clean; 41 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.5 MiB/s wr, 311 op/s 2024-04-01T06:57:15.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:14 smithi145 ceph-mon[47816]: daemon mds.i restarted 2024-04-01T06:57:15.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:14 smithi145 ceph-mon[47816]: osdmap e83: 12 total, 12 up, 12 in 2024-04-01T06:57:15.419 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.416+0000 7f415fb32700 1 -- 172.21.15.83:0/1682258808 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f41580ffbb0 msgr2=0x7f4158100030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:15.419 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.416+0000 7f415fb32700 1 --2- 172.21.15.83:0/1682258808 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f41580ffbb0 0x7f4158100030 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f414c009990 tx=0x7f414c009ca0 comp rx=0 tx=0).stop 2024-04-01T06:57:15.419 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.416+0000 7f415fb32700 1 -- 172.21.15.83:0/1682258808 shutdown_connections 2024-04-01T06:57:15.419 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.416+0000 7f415fb32700 1 --2- 172.21.15.83:0/1682258808 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4158100570 0x7f415810ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:15.419 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.416+0000 7f415fb32700 1 --2- 172.21.15.83:0/1682258808 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4158105c60 0x7f4158106040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:15.419 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.416+0000 7f415fb32700 1 --2- 172.21.15.83:0/1682258808 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f41580ffbb0 0x7f4158100030 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:15.419 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.416+0000 7f415fb32700 1 -- 172.21.15.83:0/1682258808 >> 172.21.15.83:0/1682258808 conn(0x7f4158076d50 msgr2=0x7f4158077160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:15.420 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.417+0000 7f415fb32700 1 -- 172.21.15.83:0/1682258808 shutdown_connections 2024-04-01T06:57:15.420 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.417+0000 7f415fb32700 1 -- 172.21.15.83:0/1682258808 wait complete. 2024-04-01T06:57:15.420 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.417+0000 7f415fb32700 1 Processor -- start 2024-04-01T06:57:15.420 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.417+0000 7f415fb32700 1 -- start start 2024-04-01T06:57:15.420 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.418+0000 7f415fb32700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f41580ffbb0 0x7f4158195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:15.420 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.418+0000 7f415fb32700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4158100570 0x7f4158196510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:15.420 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.418+0000 7f415fb32700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4158105c60 0x7f415819a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:15.420 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.418+0000 7f415fb32700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f415819aef0 con 0x7f41580ffbb0 2024-04-01T06:57:15.420 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.418+0000 7f415fb32700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f415819b060 con 0x7f4158105c60 2024-04-01T06:57:15.420 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.418+0000 7f415fb32700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f415819b220 con 0x7f4158100570 2024-04-01T06:57:15.420 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.418+0000 7f415d8ce700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f41580ffbb0 0x7f4158195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:15.420 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.418+0000 7f415d8ce700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f41580ffbb0 0x7f4158195fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55788/0 (socket says 172.21.15.83:55788) 2024-04-01T06:57:15.420 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.418+0000 7f415d8ce700 1 -- 172.21.15.83:0/119825358 learned_addr learned my addr 172.21.15.83:0/119825358 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:15.420 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.418+0000 7f415d0cd700 1 --2- 172.21.15.83:0/119825358 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4158100570 0x7f4158196510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:15.421 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.418+0000 7f415e0cf700 1 --2- 172.21.15.83:0/119825358 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4158105c60 0x7f415819a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:15.421 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.418+0000 7f415d8ce700 1 -- 172.21.15.83:0/119825358 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4158100570 msgr2=0x7f4158196510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:15.421 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.418+0000 7f415d8ce700 1 --2- 172.21.15.83:0/119825358 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4158100570 0x7f4158196510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:15.421 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.418+0000 7f415d8ce700 1 -- 172.21.15.83:0/119825358 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4158105c60 msgr2=0x7f415819a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:15.421 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.418+0000 7f415d8ce700 1 --2- 172.21.15.83:0/119825358 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4158105c60 0x7f415819a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:15.421 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.418+0000 7f415d8ce700 1 -- 172.21.15.83:0/119825358 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f414c0095f0 con 0x7f41580ffbb0 2024-04-01T06:57:15.421 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.418+0000 7f415e0cf700 1 --2- 172.21.15.83:0/119825358 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4158105c60 0x7f415819a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:57:15.421 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.418+0000 7f415d8ce700 1 --2- 172.21.15.83:0/119825358 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f41580ffbb0 0x7f4158195fd0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f415400e9a0 tx=0x7f415400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:15.421 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.418+0000 7f414affd700 1 -- 172.21.15.83:0/119825358 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4154009790 con 0x7f41580ffbb0 2024-04-01T06:57:15.421 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.418+0000 7f414affd700 1 -- 172.21.15.83:0/119825358 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f415400cbd0 con 0x7f41580ffbb0 2024-04-01T06:57:15.421 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.418+0000 7f415fb32700 1 -- 172.21.15.83:0/119825358 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f415819b500 con 0x7f41580ffbb0 2024-04-01T06:57:15.421 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.418+0000 7f414affd700 1 -- 172.21.15.83:0/119825358 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4154018680 con 0x7f41580ffbb0 2024-04-01T06:57:15.421 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.419+0000 7f415fb32700 1 -- 172.21.15.83:0/119825358 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41581a2d40 con 0x7f41580ffbb0 2024-04-01T06:57:15.428 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.421+0000 7f414affd700 1 -- 172.21.15.83:0/119825358 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) v1 ==== 136098+0+0 (secure 0 0 0) 0x7f415400cd40 con 0x7f41580ffbb0 2024-04-01T06:57:15.429 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.421+0000 7f414affd700 1 --2- 172.21.15.83:0/119825358 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f41440a13b0 0x7f41440a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:15.429 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.422+0000 7f414affd700 1 -- 172.21.15.83:0/119825358 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f4154014070 con 0x7f41580ffbb0 2024-04-01T06:57:15.429 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.422+0000 7f415d0cd700 1 --2- 172.21.15.83:0/119825358 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f41440a13b0 0x7f41440a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:15.429 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.422+0000 7f415d0cd700 1 --2- 172.21.15.83:0/119825358 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f41440a13b0 0x7f41440a3870 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f414c00b2e0 tx=0x7f414c005960 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:15.430 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.422+0000 7f416bcc8b80 1 Processor -- start 2024-04-01T06:57:15.430 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.423+0000 7f416bcc8b80 1 -- start start 2024-04-01T06:57:15.430 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.423+0000 7f416bcc8b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559b615e4100 0x559b615e44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:15.430 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.423+0000 7f416bcc8b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559b615e4a20 0x559b615f15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:15.430 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.423+0000 7f416bcc8b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559b615f1ae0 0x559b615f3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:15.430 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.423+0000 7f416bcc8b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b6153d930 con 0x559b615e4100 2024-04-01T06:57:15.430 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.423+0000 7f416bcc8b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b6153b2f0 con 0x559b615e4a20 2024-04-01T06:57:15.430 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.423+0000 7f416bcc8b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b61536be0 con 0x559b615f1ae0 2024-04-01T06:57:15.430 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.423+0000 7f415d8ce700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559b615e4100 0x559b615e44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:15.430 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.423+0000 7f415d8ce700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559b615e4100 0x559b615e44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55802/0 (socket says 172.21.15.83:55802) 2024-04-01T06:57:15.430 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.423+0000 7f415d8ce700 1 -- 172.21.15.83:0/1998969745 learned_addr learned my addr 172.21.15.83:0/1998969745 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:15.430 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.423+0000 7f415e0cf700 1 --2- 172.21.15.83:0/1998969745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559b615f1ae0 0x559b615f3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:15.430 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.423+0000 7f415d0cd700 1 --2- 172.21.15.83:0/1998969745 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559b615e4a20 0x559b615f15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:15.431 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.423+0000 7f415d8ce700 1 -- 172.21.15.83:0/1998969745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559b615f1ae0 msgr2=0x559b615f3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:15.431 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.423+0000 7f415d8ce700 1 --2- 172.21.15.83:0/1998969745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559b615f1ae0 0x559b615f3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:15.431 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.423+0000 7f415d8ce700 1 -- 172.21.15.83:0/1998969745 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559b615e4a20 msgr2=0x559b615f15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:15.431 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.423+0000 7f415d8ce700 1 --2- 172.21.15.83:0/1998969745 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559b615e4a20 0x559b615f15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:15.431 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.423+0000 7f415d8ce700 1 -- 172.21.15.83:0/1998969745 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559b613b8350 con 0x559b615e4100 2024-04-01T06:57:15.431 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.423+0000 7f415d0cd700 1 --2- 172.21.15.83:0/1998969745 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559b615e4a20 0x559b615f15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:57:15.431 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.423+0000 7f415d8ce700 1 --2- 172.21.15.83:0/1998969745 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559b615e4100 0x559b615e44e0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f415400c5b0 tx=0x7f4154099ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c25b93ad0b210c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:15.431 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.423+0000 7f4143fff700 1 -- 172.21.15.83:0/1998969745 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41540cd050 con 0x559b615e4100 2024-04-01T06:57:15.431 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.424+0000 7f4143fff700 1 -- 172.21.15.83:0/1998969745 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f415409d070 con 0x559b615e4100 2024-04-01T06:57:15.431 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.424+0000 7f4143fff700 1 -- 172.21.15.83:0/1998969745 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41540a2320 con 0x559b615e4100 2024-04-01T06:57:15.431 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.424+0000 7f416bcc8b80 1 -- 172.21.15.83:0/1998969745 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559b615e4100 msgr2=0x559b615e44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:15.431 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.424+0000 7f416bcc8b80 1 --2- 172.21.15.83:0/1998969745 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559b615e4100 0x559b615e44e0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f415400c5b0 tx=0x7f4154099ab0 comp rx=0 tx=0).stop 2024-04-01T06:57:15.431 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.424+0000 7f416bcc8b80 1 -- 172.21.15.83:0/1998969745 shutdown_connections 2024-04-01T06:57:15.431 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.424+0000 7f416bcc8b80 1 --2- 172.21.15.83:0/1998969745 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559b615e4100 0x559b615e44e0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:15.431 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.424+0000 7f416bcc8b80 1 --2- 172.21.15.83:0/1998969745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559b615f1ae0 0x559b615f3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:15.432 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.424+0000 7f416bcc8b80 1 --2- 172.21.15.83:0/1998969745 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559b615e4a20 0x559b615f15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:15.432 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.424+0000 7f416bcc8b80 1 -- 172.21.15.83:0/1998969745 >> 172.21.15.83:0/1998969745 conn(0x559b61544640 msgr2=0x559b615e0520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:15.432 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.424+0000 7f416bcc8b80 1 -- 172.21.15.83:0/1998969745 shutdown_connections 2024-04-01T06:57:15.432 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.424+0000 7f416bcc8b80 1 -- 172.21.15.83:0/1998969745 wait complete. 2024-04-01T06:57:15.432 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.425+0000 7f416bcc8b80 1 -- start start 2024-04-01T06:57:15.432 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.425+0000 7f416bcc8b80 1 Processor -- start 2024-04-01T06:57:15.432 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.425+0000 7f416bcc8b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559b615e4100 0x559b615f1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:15.432 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.425+0000 7f416bcc8b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559b615e4a20 0x559b615ee850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:15.432 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.425+0000 7f416bcc8b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559b615f1ae0 0x559b615eef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:15.432 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.425+0000 7f416bcc8b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b614d2d20 con 0x559b615e4100 2024-04-01T06:57:15.432 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.425+0000 7f416bcc8b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b614d29c0 con 0x559b615e4a20 2024-04-01T06:57:15.432 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.425+0000 7f416bcc8b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b613ba640 con 0x559b615f1ae0 2024-04-01T06:57:15.432 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.425+0000 7f416bcc8b80 10 client.0 _ll_register_callbacks cb 0x559b614dc410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:57:15.432 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.425+0000 7f415d8ce700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559b615e4100 0x559b615f1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:15.433 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.425+0000 7f415d8ce700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559b615e4100 0x559b615f1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55806/0 (socket says 172.21.15.83:55806) 2024-04-01T06:57:15.433 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.425+0000 7f415d8ce700 1 -- 172.21.15.83:0/1444816680 learned_addr learned my addr 172.21.15.83:0/1444816680 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:15.433 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.426+0000 7f415e0cf700 1 --2- 172.21.15.83:0/1444816680 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559b615f1ae0 0x559b615eef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:15.433 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.426+0000 7f415d0cd700 1 --2- 172.21.15.83:0/1444816680 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559b615e4a20 0x559b615ee850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:15.433 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.426+0000 7f415d8ce700 1 -- 172.21.15.83:0/1444816680 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559b615f1ae0 msgr2=0x559b615eef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:15.433 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.426+0000 7f415d8ce700 1 --2- 172.21.15.83:0/1444816680 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559b615f1ae0 0x559b615eef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:15.433 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.426+0000 7f415d8ce700 1 -- 172.21.15.83:0/1444816680 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559b615e4a20 msgr2=0x559b615ee850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:15.433 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.426+0000 7f415d8ce700 1 --2- 172.21.15.83:0/1444816680 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559b615e4a20 0x559b615ee850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:15.433 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.426+0000 7f415d8ce700 1 -- 172.21.15.83:0/1444816680 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41581a2d40 con 0x559b615e4100 2024-04-01T06:57:15.433 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.426+0000 7f415e0cf700 1 --2- 172.21.15.83:0/1444816680 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559b615f1ae0 0x559b615eef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T06:57:15.433 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.426+0000 7f415d0cd700 1 --2- 172.21.15.83:0/1444816680 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559b615e4a20 0x559b615ee850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:57:15.433 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.426+0000 7f415d8ce700 1 --2- 172.21.15.83:0/1444816680 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559b615e4100 0x559b615f1580 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f41540a2020 tx=0x7f41540ca7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b7e506ff5aeeb01 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:15.433 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.426+0000 7f41417fa700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:57:15.433 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.426+0000 7f41417fa700 1 -- 172.21.15.83:0/1444816680 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415409df00 con 0x559b615e4100 2024-04-01T06:57:15.434 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.426+0000 7f41417fa700 1 -- 172.21.15.83:0/1444816680 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f41540a2550 con 0x559b615e4100 2024-04-01T06:57:15.434 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.426+0000 7f416bcc8b80 1 -- 172.21.15.83:0/1444816680 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559b614f7320 con 0x559b615e4100 2024-04-01T06:57:15.434 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.426+0000 7f41417fa700 1 -- 172.21.15.83:0/1444816680 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f41540cacd0 con 0x559b615e4100 2024-04-01T06:57:15.434 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.426+0000 7f416bcc8b80 10 client.15816 fetch_fsmap learned FSMap version 26 2024-04-01T06:57:15.434 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.426+0000 7f416bcc8b80 1 -- 172.21.15.83:0/1444816680 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x559b61364b00 con 0x559b615e4100 2024-04-01T06:57:15.434 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.426+0000 7f41417fa700 1 -- 172.21.15.83:0/1444816680 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559b614f7320 con 0x559b615e4100 2024-04-01T06:57:15.434 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.427+0000 7f41417fa700 1 -- 172.21.15.83:0/1444816680 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4154099110 con 0x559b615e4100 2024-04-01T06:57:15.434 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.427+0000 7f416bcc8b80 10 client.15816 fetch_fsmap finished waiting for FSMap version 26 2024-04-01T06:57:15.434 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.427+0000 7f416bcc8b80 10 client.15816 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-01T06:57:15.434 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.427+0000 7f416bcc8b80 20 client.15816 populate_metadata read hostname 'smithi083' 2024-04-01T06:57:15.434 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.427+0000 7f416bcc8b80 1 --2- 172.21.15.83:0/1444816680 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x559b61601410 0x559b61603830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:15.434 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.427+0000 7f416bcc8b80 4 client.15816 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-01T06:57:15.434 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.427+0000 7f416bcc8b80 1 -- 172.21.15.83:0/1444816680 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559b6152f6a0 con 0x559b61601410 2024-04-01T06:57:15.434 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.427+0000 7f415d0cd700 1 --2- 172.21.15.83:0/1444816680 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x559b61601410 0x559b61603830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:15.434 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.427+0000 7f415d0cd700 1 --2- 172.21.15.83:0/1444816680 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x559b61601410 0x559b61603830 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=420a88eafb1d1f45 server_cookie=7e6842a5e43fffe4 in_seq=0 out_seq=0 2024-04-01T06:57:15.435 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.427+0000 7f41417fa700 10 client.15816 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:57:15.435 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.428+0000 7f41417fa700 1 -- 172.21.15.83:0/1444816680 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559b6152f6a0 con 0x559b61601410 2024-04-01T06:57:15.435 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.428+0000 7f41417fa700 10 client.15816 handle_command_reply: tid=0 2024-04-01T06:57:15.435 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.428+0000 7f416bcc8b80 1 client.15816 shutdown 2024-04-01T06:57:15.435 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.428+0000 7f416bcc8b80 1 -- 172.21.15.83:0/1444816680 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559b615e4100 msgr2=0x559b615f1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:15.435 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.428+0000 7f416bcc8b80 1 --2- 172.21.15.83:0/1444816680 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559b615e4100 0x559b615f1580 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f41540a2020 tx=0x7f41540ca7b0 comp rx=0 tx=0).stop 2024-04-01T06:57:15.435 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.428+0000 7f416bcc8b80 1 -- 172.21.15.83:0/1444816680 shutdown_connections 2024-04-01T06:57:15.435 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.428+0000 7f416bcc8b80 1 --2- 172.21.15.83:0/1444816680 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x559b61601410 0x559b61603830 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:15.435 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.428+0000 7f416bcc8b80 1 --2- 172.21.15.83:0/1444816680 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559b615e4100 0x559b615f1580 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:15.435 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.428+0000 7f416bcc8b80 1 --2- 172.21.15.83:0/1444816680 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559b615f1ae0 0x559b615eef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:15.437 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.428+0000 7f416bcc8b80 1 --2- 172.21.15.83:0/1444816680 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559b615e4a20 0x559b615ee850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:15.438 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.428+0000 7f41417fa700 0 client.15816 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:57:15.438 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.428+0000 7f416bcc8b80 1 -- 172.21.15.83:0/1444816680 >> 172.21.15.83:0/1444816680 conn(0x559b61544640 msgr2=0x559b615e6080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:15.438 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.428+0000 7f416bcc8b80 1 -- 172.21.15.83:0/1444816680 shutdown_connections 2024-04-01T06:57:15.438 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.428+0000 7f416bcc8b80 1 -- 172.21.15.83:0/1444816680 wait complete. 2024-04-01T06:57:15.438 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.429+0000 7f416bcc8b80 20 client.15816 trim_cache size 0 max 16384 2024-04-01T06:57:15.448 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.443+0000 7f416bcc8b80 1 Processor -- start 2024-04-01T06:57:15.448 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.443+0000 7f416bcc8b80 1 -- start start 2024-04-01T06:57:15.448 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.443+0000 7f416bcc8b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559b615e4100 0x559b615e6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:15.448 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.444+0000 7f416bcc8b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559b615e4a20 0x559b615e6750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:15.449 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.444+0000 7f416bcc8b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559b615f1ae0 0x559b615da500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:15.449 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.444+0000 7f416bcc8b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b615efe70 con 0x559b615f1ae0 2024-04-01T06:57:15.449 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.444+0000 7f416bcc8b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b615e53b0 con 0x559b615e4100 2024-04-01T06:57:15.449 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.444+0000 7f416bcc8b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b61603bc0 con 0x559b615e4a20 2024-04-01T06:57:15.449 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.444+0000 7f415e0cf700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559b615f1ae0 0x559b615da500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:15.449 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.444+0000 7f415e0cf700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559b615f1ae0 0x559b615da500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55816/0 (socket says 172.21.15.83:55816) 2024-04-01T06:57:15.449 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.444+0000 7f415e0cf700 1 -- 172.21.15.83:0/3586466041 learned_addr learned my addr 172.21.15.83:0/3586466041 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:15.449 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.444+0000 7f415d0cd700 1 --2- 172.21.15.83:0/3586466041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559b615e4a20 0x559b615e6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:15.449 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.444+0000 7f415d8ce700 1 --2- 172.21.15.83:0/3586466041 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559b615e4100 0x559b615e6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:15.449 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.444+0000 7f415e0cf700 1 -- 172.21.15.83:0/3586466041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559b615e4a20 msgr2=0x559b615e6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:15.449 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.444+0000 7f415e0cf700 1 --2- 172.21.15.83:0/3586466041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559b615e4a20 0x559b615e6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:15.450 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.444+0000 7f415e0cf700 1 -- 172.21.15.83:0/3586466041 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559b615e4100 msgr2=0x559b615e6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:15.450 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.444+0000 7f415e0cf700 1 --2- 172.21.15.83:0/3586466041 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559b615e4100 0x559b615e6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:15.450 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.444+0000 7f415e0cf700 1 -- 172.21.15.83:0/3586466041 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559b614fce40 con 0x559b615f1ae0 2024-04-01T06:57:15.450 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.444+0000 7f415d8ce700 1 --2- 172.21.15.83:0/3586466041 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559b615e4100 0x559b615e6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:57:15.450 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.444+0000 7f415e0cf700 1 --2- 172.21.15.83:0/3586466041 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559b615f1ae0 0x559b615da500 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f4150007880 tx=0x7f41500078b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32125af5dddae3c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:15.450 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.444+0000 7f4148da8700 1 -- 172.21.15.83:0/3586466041 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4150017610 con 0x559b615f1ae0 2024-04-01T06:57:15.450 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.444+0000 7f4148da8700 1 -- 172.21.15.83:0/3586466041 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f415000f040 con 0x559b615f1ae0 2024-04-01T06:57:15.450 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.444+0000 7f4148da8700 1 -- 172.21.15.83:0/3586466041 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415001fb40 con 0x559b615f1ae0 2024-04-01T06:57:15.450 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.445+0000 7f416bcc8b80 1 -- 172.21.15.83:0/3586466041 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559b615f1ae0 msgr2=0x559b615da500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:15.450 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.445+0000 7f416bcc8b80 1 --2- 172.21.15.83:0/3586466041 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559b615f1ae0 0x559b615da500 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f4150007880 tx=0x7f41500078b0 comp rx=0 tx=0).stop 2024-04-01T06:57:15.450 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.445+0000 7f416bcc8b80 1 -- 172.21.15.83:0/3586466041 shutdown_connections 2024-04-01T06:57:15.450 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.445+0000 7f416bcc8b80 1 --2- 172.21.15.83:0/3586466041 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559b615f1ae0 0x559b615da500 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:15.450 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.445+0000 7f416bcc8b80 1 --2- 172.21.15.83:0/3586466041 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559b615e4100 0x559b615e6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:15.451 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.445+0000 7f416bcc8b80 1 --2- 172.21.15.83:0/3586466041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559b615e4a20 0x559b615e6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:15.451 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.445+0000 7f416bcc8b80 1 -- 172.21.15.83:0/3586466041 >> 172.21.15.83:0/3586466041 conn(0x559b61544640 msgr2=0x559b615e6040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:15.451 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.445+0000 7f416bcc8b80 1 -- 172.21.15.83:0/3586466041 shutdown_connections 2024-04-01T06:57:15.451 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.445+0000 7f416bcc8b80 1 -- 172.21.15.83:0/3586466041 wait complete. 2024-04-01T06:57:15.451 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.445+0000 7f416bcc8b80 1 -- start start 2024-04-01T06:57:15.451 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.445+0000 7f416bcc8b80 1 Processor -- start 2024-04-01T06:57:15.451 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.446+0000 7f416bcc8b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559b615e4100 0x559b615f6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:15.451 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.446+0000 7f416bcc8b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559b615e4a20 0x559b615f6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:15.451 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.446+0000 7f416bcc8b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559b615f1ae0 0x559b61654200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:15.451 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.446+0000 7f416bcc8b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b61654740 con 0x559b615e4a20 2024-04-01T06:57:15.451 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.446+0000 7f416bcc8b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b61654880 con 0x559b615e4100 2024-04-01T06:57:15.451 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.446+0000 7f416bcc8b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b61654a40 con 0x559b615f1ae0 2024-04-01T06:57:15.451 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.446+0000 7f416bcc8b80 10 client.0 _ll_register_callbacks cb 0x559b614dc410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:57:15.451 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.446+0000 7f415d0cd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559b615e4a20 0x559b615f6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:15.452 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.446+0000 7f415d0cd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559b615e4a20 0x559b615f6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55824/0 (socket says 172.21.15.83:55824) 2024-04-01T06:57:15.452 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.446+0000 7f415d0cd700 1 -- 172.21.15.83:0/2924153527 learned_addr learned my addr 172.21.15.83:0/2924153527 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:15.452 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.446+0000 7f415e0cf700 1 --2- 172.21.15.83:0/2924153527 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559b615f1ae0 0x559b61654200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:15.452 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.446+0000 7f415d8ce700 1 --2- 172.21.15.83:0/2924153527 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559b615e4100 0x559b615f6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:15.452 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.446+0000 7f415d0cd700 1 -- 172.21.15.83:0/2924153527 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559b615f1ae0 msgr2=0x559b61654200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:15.452 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.446+0000 7f415d0cd700 1 --2- 172.21.15.83:0/2924153527 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559b615f1ae0 0x559b61654200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:15.452 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.446+0000 7f415d0cd700 1 -- 172.21.15.83:0/2924153527 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559b615e4100 msgr2=0x559b615f6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:15.452 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.446+0000 7f415d0cd700 1 --2- 172.21.15.83:0/2924153527 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559b615e4100 0x559b615f6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:15.452 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.446+0000 7f415d0cd700 1 -- 172.21.15.83:0/2924153527 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4150007500 con 0x559b615e4a20 2024-04-01T06:57:15.452 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.446+0000 7f415d8ce700 1 --2- 172.21.15.83:0/2924153527 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559b615e4100 0x559b615f6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:57:15.452 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.446+0000 7f415d0cd700 1 --2- 172.21.15.83:0/2924153527 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559b615e4a20 0x559b615f6b70 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f414c009990 tx=0x7f414c009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbb8e56160d70706 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:15.452 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.446+0000 7f41417fa700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:57:15.452 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.446+0000 7f41417fa700 1 -- 172.21.15.83:0/2924153527 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414c033420 con 0x559b615e4a20 2024-04-01T06:57:15.452 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.446+0000 7f41417fa700 1 -- 172.21.15.83:0/2924153527 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f414c00b8d0 con 0x559b615e4a20 2024-04-01T06:57:15.453 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.446+0000 7f416bcc8b80 1 -- 172.21.15.83:0/2924153527 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f415409d070 con 0x559b615e4a20 2024-04-01T06:57:15.453 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.446+0000 7f41417fa700 1 -- 172.21.15.83:0/2924153527 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f414c033580 con 0x559b615e4a20 2024-04-01T06:57:15.453 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.447+0000 7f416bcc8b80 10 client.15822 fetch_fsmap learned FSMap version 26 2024-04-01T06:57:15.453 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.447+0000 7f416bcc8b80 1 -- 172.21.15.83:0/2924153527 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x559b613bcc70 con 0x559b615e4a20 2024-04-01T06:57:15.453 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.447+0000 7f41417fa700 1 -- 172.21.15.83:0/2924153527 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f415409d070 con 0x559b615e4a20 2024-04-01T06:57:15.454 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.447+0000 7f41417fa700 1 -- 172.21.15.83:0/2924153527 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f414c043070 con 0x559b615e4a20 2024-04-01T06:57:15.454 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.447+0000 7f416bcc8b80 10 client.15822 fetch_fsmap finished waiting for FSMap version 26 2024-04-01T06:57:15.454 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.447+0000 7f416bcc8b80 10 client.15822 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-01T06:57:15.454 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.447+0000 7f416bcc8b80 20 client.15822 populate_metadata read hostname 'smithi083' 2024-04-01T06:57:15.454 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.447+0000 7f416bcc8b80 1 --2- 172.21.15.83:0/2924153527 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x559b61656240 0x559b61658660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:15.454 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.447+0000 7f416bcc8b80 4 client.15822 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-01T06:57:15.454 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.447+0000 7f416bcc8b80 1 -- 172.21.15.83:0/2924153527 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559b61385c90 con 0x559b61656240 2024-04-01T06:57:15.454 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.447+0000 7f415d8ce700 1 --2- 172.21.15.83:0/2924153527 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x559b61656240 0x559b61658660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:15.454 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.447+0000 7f41417fa700 10 client.15822 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:57:15.454 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:15.447+0000 7f415d8ce700 1 --2- 172.21.15.83:0/2924153527 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x559b61656240 0x559b61658660 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80143437dc91cd76 server_cookie=e920cc8e2c2b8c50 in_seq=0 out_seq=0 2024-04-01T06:57:16.145 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:15 smithi153 ceph-mon[48187]: mds.? [v2:172.21.15.153:6838/2570595837,v1:172.21.15.153:6839/2570595837] up:boot 2024-04-01T06:57:16.145 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:15 smithi153 ceph-mon[48187]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-04-01T06:57:16.145 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:15 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-01T06:57:16.145 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:15 smithi153 ceph-mon[48187]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-04-01T06:57:16.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:15 smithi145 ceph-mon[47816]: mds.? [v2:172.21.15.153:6838/2570595837,v1:172.21.15.153:6839/2570595837] up:boot 2024-04-01T06:57:16.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:15 smithi145 ceph-mon[47816]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-04-01T06:57:16.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:15 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-01T06:57:16.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:15 smithi145 ceph-mon[47816]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-04-01T06:57:16.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:15 smithi083 ceph-mon[43429]: mds.? [v2:172.21.15.153:6838/2570595837,v1:172.21.15.153:6839/2570595837] up:boot 2024-04-01T06:57:16.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:15 smithi083 ceph-mon[43429]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-04-01T06:57:16.264 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:15 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-01T06:57:16.264 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:15 smithi083 ceph-mon[43429]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-04-01T06:57:16.589 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:16.587+0000 7f41417fa700 1 -- 172.21.15.83:0/2924153527 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559b61385c90 con 0x559b61656240 2024-04-01T06:57:16.589 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:16.587+0000 7f41417fa700 10 client.15822 handle_command_reply: tid=0 2024-04-01T06:57:16.589 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:16.587+0000 7f416bcc8b80 1 client.15822 shutdown 2024-04-01T06:57:16.589 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:16.588+0000 7f416bcc8b80 1 -- 172.21.15.83:0/2924153527 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559b615e4a20 msgr2=0x559b615f6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:16.589 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:16.588+0000 7f416bcc8b80 1 --2- 172.21.15.83:0/2924153527 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559b615e4a20 0x559b615f6b70 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f414c009990 tx=0x7f414c009ca0 comp rx=0 tx=0).stop 2024-04-01T06:57:16.589 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:16.588+0000 7f416bcc8b80 1 -- 172.21.15.83:0/2924153527 shutdown_connections 2024-04-01T06:57:16.589 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:16.588+0000 7f416bcc8b80 1 --2- 172.21.15.83:0/2924153527 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x559b61656240 0x559b61658660 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:16.589 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:16.588+0000 7f416bcc8b80 1 --2- 172.21.15.83:0/2924153527 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559b615f1ae0 0x559b61654200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:16.590 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:16.588+0000 7f416bcc8b80 1 --2- 172.21.15.83:0/2924153527 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559b615e4100 0x559b615f6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:16.590 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:16.588+0000 7f416bcc8b80 1 --2- 172.21.15.83:0/2924153527 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559b615e4a20 0x559b615f6b70 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:16.590 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:16.588+0000 7f41417fa700 0 client.15822 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:57:16.590 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:16.588+0000 7f416bcc8b80 1 -- 172.21.15.83:0/2924153527 >> 172.21.15.83:0/2924153527 conn(0x559b61544640 msgr2=0x559b615d93e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:16.590 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:16.588+0000 7f416bcc8b80 1 -- 172.21.15.83:0/2924153527 shutdown_connections 2024-04-01T06:57:16.590 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:16.588+0000 7f416bcc8b80 1 -- 172.21.15.83:0/2924153527 wait complete. 2024-04-01T06:57:16.590 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:16.588+0000 7f416bcc8b80 20 client.15822 trim_cache size 0 max 16384 2024-04-01T06:57:16.591 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout:{ 2024-04-01T06:57:16.591 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout: "message": "", 2024-04-01T06:57:16.591 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout: "return_code": 0 2024-04-01T06:57:16.591 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout:} 2024-04-01T06:57:16.592 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:16.588+0000 7f415fb32700 1 -- 172.21.15.83:0/119825358 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f41440a13b0 msgr2=0x7f41440a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:16.592 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:16.588+0000 7f415fb32700 1 --2- 172.21.15.83:0/119825358 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f41440a13b0 0x7f41440a3870 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f414c00b2e0 tx=0x7f414c005960 comp rx=0 tx=0).stop 2024-04-01T06:57:16.592 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:16.588+0000 7f415fb32700 1 -- 172.21.15.83:0/119825358 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f41580ffbb0 msgr2=0x7f4158195fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:16.592 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:16.589+0000 7f415fb32700 1 --2- 172.21.15.83:0/119825358 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f41580ffbb0 0x7f4158195fd0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f415400e9a0 tx=0x7f415400ecb0 comp rx=0 tx=0).stop 2024-04-01T06:57:16.592 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:16.589+0000 7f415fb32700 1 -- 172.21.15.83:0/119825358 shutdown_connections 2024-04-01T06:57:16.592 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:16.589+0000 7f415fb32700 1 --2- 172.21.15.83:0/119825358 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f41440a13b0 0x7f41440a3870 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:16.592 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:16.589+0000 7f415fb32700 1 --2- 172.21.15.83:0/119825358 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f41580ffbb0 0x7f4158195fd0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:16.592 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:16.589+0000 7f415fb32700 1 --2- 172.21.15.83:0/119825358 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4158105c60 0x7f415819a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:16.592 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:16.589+0000 7f415fb32700 1 --2- 172.21.15.83:0/119825358 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4158100570 0x7f4158196510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:16.593 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:16.589+0000 7f415fb32700 1 -- 172.21.15.83:0/119825358 >> 172.21.15.83:0/119825358 conn(0x7f4158076d50 msgr2=0x7f41580fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:16.593 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:16.589+0000 7f415fb32700 1 -- 172.21.15.83:0/119825358 shutdown_connections 2024-04-01T06:57:16.593 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:16.589+0000 7f415fb32700 1 -- 172.21.15.83:0/119825358 wait complete. 2024-04-01T06:57:17.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:16 smithi153 ceph-mon[48187]: pgmap v45: 97 pgs: 97 active+clean; 50 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 5.2 MiB/s wr, 369 op/s 2024-04-01T06:57:17.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:16 smithi145 ceph-mon[47816]: pgmap v45: 97 pgs: 97 active+clean; 50 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 5.2 MiB/s wr, 369 op/s 2024-04-01T06:57:17.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:16 smithi083 ceph-mon[43429]: pgmap v45: 97 pgs: 97 active+clean; 50 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 5.2 MiB/s wr, 369 op/s 2024-04-01T06:57:19.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:18 smithi153 ceph-mon[48187]: pgmap v46: 97 pgs: 97 active+clean; 50 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 5.2 MiB/s wr, 369 op/s 2024-04-01T06:57:19.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:18 smithi145 ceph-mon[47816]: pgmap v46: 97 pgs: 97 active+clean; 50 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 5.2 MiB/s wr, 369 op/s 2024-04-01T06:57:19.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:18 smithi083 ceph-mon[43429]: pgmap v46: 97 pgs: 97 active+clean; 50 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 5.2 MiB/s wr, 369 op/s 2024-04-01T06:57:20.861 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-01T06:57:20.861 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-01T06:57:20.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.993+0000 7f2ba6e0d700 1 -- 172.21.15.83:0/4201768977 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ba00ffe70 msgr2=0x7f2ba0100250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:20.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.993+0000 7f2ba6e0d700 1 --2- 172.21.15.83:0/4201768977 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ba00ffe70 0x7f2ba0100250 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f2b94009990 tx=0x7f2b94009ca0 comp rx=0 tx=0).stop 2024-04-01T06:57:20.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.993+0000 7f2ba6e0d700 1 -- 172.21.15.83:0/4201768977 shutdown_connections 2024-04-01T06:57:20.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.993+0000 7f2ba6e0d700 1 --2- 172.21.15.83:0/4201768977 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ba00ffe70 0x7f2ba0100250 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:20.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.993+0000 7f2ba6e0d700 1 --2- 172.21.15.83:0/4201768977 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2ba0104f70 0x7f2ba010caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:20.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.993+0000 7f2ba6e0d700 1 --2- 172.21.15.83:0/4201768977 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ba0100820 0x7f2ba0104840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:20.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.993+0000 7f2ba6e0d700 1 -- 172.21.15.83:0/4201768977 >> 172.21.15.83:0/4201768977 conn(0x7f2ba0076d50 msgr2=0x7f2ba0077160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:20.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.993+0000 7f2ba6e0d700 1 -- 172.21.15.83:0/4201768977 shutdown_connections 2024-04-01T06:57:20.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.993+0000 7f2ba6e0d700 1 -- 172.21.15.83:0/4201768977 wait complete. 2024-04-01T06:57:20.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.994+0000 7f2ba6e0d700 1 Processor -- start 2024-04-01T06:57:20.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.994+0000 7f2ba6e0d700 1 -- start start 2024-04-01T06:57:20.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.994+0000 7f2ba6e0d700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2ba00ffe70 0x7f2ba0197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:20.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.994+0000 7f2ba6e0d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ba0104f70 0x7f2ba01984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:20.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.994+0000 7f2ba6e0d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ba01989e0 0x7f2ba01a2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:20.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.994+0000 7f2ba6e0d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba01a36c0 con 0x7f2ba0104f70 2024-04-01T06:57:20.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.994+0000 7f2ba6e0d700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba01a3830 con 0x7f2ba00ffe70 2024-04-01T06:57:20.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.994+0000 7f2ba6e0d700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba01a39f0 con 0x7f2ba01989e0 2024-04-01T06:57:20.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.994+0000 7f2b9ffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ba0104f70 0x7f2ba01984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:20.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.994+0000 7f2b9ffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ba0104f70 0x7f2ba01984a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55836/0 (socket says 172.21.15.83:55836) 2024-04-01T06:57:20.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.994+0000 7f2b9ffff700 1 -- 172.21.15.83:0/737707056 learned_addr learned my addr 172.21.15.83:0/737707056 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:20.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.994+0000 7f2ba4ba9700 1 --2- 172.21.15.83:0/737707056 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2ba00ffe70 0x7f2ba0197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:20.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.994+0000 7f2ba53aa700 1 --2- 172.21.15.83:0/737707056 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ba01989e0 0x7f2ba01a2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:20.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.994+0000 7f2b9ffff700 1 -- 172.21.15.83:0/737707056 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ba01989e0 msgr2=0x7f2ba01a2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:20.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.994+0000 7f2b9ffff700 1 --2- 172.21.15.83:0/737707056 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ba01989e0 0x7f2ba01a2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:20.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.994+0000 7f2b9ffff700 1 -- 172.21.15.83:0/737707056 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2ba00ffe70 msgr2=0x7f2ba0197f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:20.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.994+0000 7f2b9ffff700 1 --2- 172.21.15.83:0/737707056 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2ba00ffe70 0x7f2ba0197f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:20.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.994+0000 7f2b9ffff700 1 -- 172.21.15.83:0/737707056 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b940095f0 con 0x7f2ba0104f70 2024-04-01T06:57:20.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.994+0000 7f2ba53aa700 1 --2- 172.21.15.83:0/737707056 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ba01989e0 0x7f2ba01a2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:57:20.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.995+0000 7f2b9ffff700 1 --2- 172.21.15.83:0/737707056 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ba0104f70 0x7f2ba01984a0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c00c9e0 tx=0x7f2b8c00ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:20.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.995+0000 7f2b9dffb700 1 -- 172.21.15.83:0/737707056 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c007aa0 con 0x7f2ba0104f70 2024-04-01T06:57:20.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.995+0000 7f2b9dffb700 1 -- 172.21.15.83:0/737707056 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2b8c007c00 con 0x7f2ba0104f70 2024-04-01T06:57:20.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.995+0000 7f2ba6e0d700 1 -- 172.21.15.83:0/737707056 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ba01a3cd0 con 0x7f2ba0104f70 2024-04-01T06:57:20.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.995+0000 7f2b9dffb700 1 -- 172.21.15.83:0/737707056 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c018660 con 0x7f2ba0104f70 2024-04-01T06:57:20.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.995+0000 7f2ba6e0d700 1 -- 172.21.15.83:0/737707056 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ba01a4190 con 0x7f2ba0104f70 2024-04-01T06:57:21.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.997+0000 7f2b9dffb700 1 -- 172.21.15.83:0/737707056 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) v1 ==== 136098+0+0 (secure 0 0 0) 0x7f2b8c00f450 con 0x7f2ba0104f70 2024-04-01T06:57:21.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.997+0000 7f2b9dffb700 1 --2- 172.21.15.83:0/737707056 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f2b900a13b0 0x7f2b900a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.998+0000 7f2ba4ba9700 1 --2- 172.21.15.83:0/737707056 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f2b900a13b0 0x7f2b900a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.998+0000 7f2b9dffb700 1 -- 172.21.15.83:0/737707056 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f2b8c0ccef0 con 0x7f2ba0104f70 2024-04-01T06:57:21.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.998+0000 7f2ba4ba9700 1 --2- 172.21.15.83:0/737707056 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f2b900a13b0 0x7f2b900a3870 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2b94006010 tx=0x7f2b94005960 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:21.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.999+0000 7f2bb2fa3b80 1 Processor -- start 2024-04-01T06:57:21.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.999+0000 7f2bb2fa3b80 1 -- start start 2024-04-01T06:57:21.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.999+0000 7f2bb2fa3b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5568e47be5d0 0x5568e47be9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.999+0000 7f2bb2fa3b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5568e47beef0 0x5568e47c98b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.999+0000 7f2bb2fa3b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5568e47c9df0 0x5568e47cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.999+0000 7f2bb2fa3b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568e4717990 con 0x5568e47beef0 2024-04-01T06:57:21.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.999+0000 7f2bb2fa3b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568e4715350 con 0x5568e47c9df0 2024-04-01T06:57:21.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.999+0000 7f2bb2fa3b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568e4710c40 con 0x5568e47be5d0 2024-04-01T06:57:21.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.999+0000 7f2b9ffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5568e47beef0 0x5568e47c98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.999+0000 7f2b9ffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5568e47beef0 0x5568e47c98b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55842/0 (socket says 172.21.15.83:55842) 2024-04-01T06:57:21.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.999+0000 7f2b9ffff700 1 -- 172.21.15.83:0/3557766751 learned_addr learned my addr 172.21.15.83:0/3557766751 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:21.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.999+0000 7f2ba4ba9700 1 --2- 172.21.15.83:0/3557766751 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5568e47be5d0 0x5568e47be9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.999+0000 7f2ba53aa700 1 --2- 172.21.15.83:0/3557766751 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5568e47c9df0 0x5568e47cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.999+0000 7f2b9ffff700 1 -- 172.21.15.83:0/3557766751 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5568e47be5d0 msgr2=0x5568e47be9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:21.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.999+0000 7f2b9ffff700 1 --2- 172.21.15.83:0/3557766751 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5568e47be5d0 0x5568e47be9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.999+0000 7f2b9ffff700 1 -- 172.21.15.83:0/3557766751 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5568e47c9df0 msgr2=0x5568e47cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:21.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.999+0000 7f2b9ffff700 1 --2- 172.21.15.83:0/3557766751 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5568e47c9df0 0x5568e47cc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.999+0000 7f2b9ffff700 1 -- 172.21.15.83:0/3557766751 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568e45923b0 con 0x5568e47beef0 2024-04-01T06:57:21.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.999+0000 7f2b9ffff700 1 --2- 172.21.15.83:0/3557766751 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5568e47beef0 0x5568e47c98b0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c099da0 tx=0x7f2b8c0997f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56c3c681432d0588 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:21.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:20.999+0000 7f2b8affd700 1 -- 172.21.15.83:0/3557766751 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c09dc40 con 0x5568e47beef0 2024-04-01T06:57:21.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.000+0000 7f2b8affd700 1 -- 172.21.15.83:0/3557766751 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2b8c0a2290 con 0x5568e47beef0 2024-04-01T06:57:21.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.000+0000 7f2b8affd700 1 -- 172.21.15.83:0/3557766751 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c09a070 con 0x5568e47beef0 2024-04-01T06:57:21.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.000+0000 7f2bb2fa3b80 1 -- 172.21.15.83:0/3557766751 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5568e47beef0 msgr2=0x5568e47c98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:21.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.000+0000 7f2bb2fa3b80 1 --2- 172.21.15.83:0/3557766751 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5568e47beef0 0x5568e47c98b0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c099da0 tx=0x7f2b8c0997f0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.000+0000 7f2bb2fa3b80 1 -- 172.21.15.83:0/3557766751 shutdown_connections 2024-04-01T06:57:21.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.000+0000 7f2bb2fa3b80 1 --2- 172.21.15.83:0/3557766751 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5568e47c9df0 0x5568e47cc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.000+0000 7f2bb2fa3b80 1 --2- 172.21.15.83:0/3557766751 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5568e47be5d0 0x5568e47be9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.000+0000 7f2bb2fa3b80 1 --2- 172.21.15.83:0/3557766751 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5568e47beef0 0x5568e47c98b0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.000+0000 7f2bb2fa3b80 1 -- 172.21.15.83:0/3557766751 >> 172.21.15.83:0/3557766751 conn(0x5568e471e6a0 msgr2=0x5568e47baa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:21.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.000+0000 7f2bb2fa3b80 1 -- 172.21.15.83:0/3557766751 shutdown_connections 2024-04-01T06:57:21.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.000+0000 7f2bb2fa3b80 1 -- 172.21.15.83:0/3557766751 wait complete. 2024-04-01T06:57:21.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.001+0000 7f2bb2fa3b80 1 -- start start 2024-04-01T06:57:21.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.001+0000 7f2bb2fa3b80 1 Processor -- start 2024-04-01T06:57:21.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.001+0000 7f2bb2fa3b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5568e47be5d0 0x5568e47c9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.001+0000 7f2bb2fa3b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5568e47beef0 0x5568e47c6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.001+0000 7f2bb2fa3b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5568e47c9df0 0x5568e47c7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.001+0000 7f2bb2fa3b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568e46acd80 con 0x5568e47beef0 2024-04-01T06:57:21.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.001+0000 7f2bb2fa3b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568e46aca20 con 0x5568e47c9df0 2024-04-01T06:57:21.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.001+0000 7f2bb2fa3b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568e45946a0 con 0x5568e47be5d0 2024-04-01T06:57:21.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.001+0000 7f2bb2fa3b80 10 client.0 _ll_register_callbacks cb 0x5568e46b6470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:57:21.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.001+0000 7f2b9ffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5568e47beef0 0x5568e47c6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.001+0000 7f2b9ffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5568e47beef0 0x5568e47c6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55854/0 (socket says 172.21.15.83:55854) 2024-04-01T06:57:21.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.001+0000 7f2ba53aa700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5568e47c9df0 0x5568e47c7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.001+0000 7f2b9ffff700 1 -- 172.21.15.83:0/1855347385 learned_addr learned my addr 172.21.15.83:0/1855347385 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:21.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.001+0000 7f2ba4ba9700 1 --2- 172.21.15.83:0/1855347385 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5568e47be5d0 0x5568e47c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.002+0000 7f2ba53aa700 1 -- 172.21.15.83:0/1855347385 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5568e47be5d0 msgr2=0x5568e47c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:21.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.002+0000 7f2ba53aa700 1 --2- 172.21.15.83:0/1855347385 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5568e47be5d0 0x5568e47c9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.002+0000 7f2ba53aa700 1 -- 172.21.15.83:0/1855347385 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5568e47beef0 msgr2=0x5568e47c6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:21.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.002+0000 7f2ba53aa700 1 --2- 172.21.15.83:0/1855347385 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5568e47beef0 0x5568e47c6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.002+0000 7f2ba53aa700 1 -- 172.21.15.83:0/1855347385 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ba01a4190 con 0x5568e47c9df0 2024-04-01T06:57:21.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.002+0000 7f2b9ffff700 1 --2- 172.21.15.83:0/1855347385 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5568e47beef0 0x5568e47c6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T06:57:21.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.002+0000 7f2ba53aa700 1 --2- 172.21.15.83:0/1855347385 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5568e47c9df0 0x5568e47c7260 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2b98007a70 tx=0x7f2b98007aa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac9a0d34b94c2b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:21.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.002+0000 7f2b7ffff700 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-04-01T06:57:21.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.002+0000 7f2b7ffff700 1 -- 172.21.15.83:0/1855347385 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9800e030 con 0x5568e47c9df0 2024-04-01T06:57:21.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.002+0000 7f2b7ffff700 1 -- 172.21.15.83:0/1855347385 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f2b98003c00 con 0x5568e47c9df0 2024-04-01T06:57:21.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.002+0000 7f2bb2fa3b80 1 -- 172.21.15.83:0/1855347385 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5568e46d1380 con 0x5568e47c9df0 2024-04-01T06:57:21.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.002+0000 7f2b7ffff700 1 -- 172.21.15.83:0/1855347385 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b98003dc0 con 0x5568e47c9df0 2024-04-01T06:57:21.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.002+0000 7f2bb2fa3b80 10 client.25352 fetch_fsmap learned FSMap version 26 2024-04-01T06:57:21.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.002+0000 7f2bb2fa3b80 1 -- 172.21.15.83:0/1855347385 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5568e453eb60 con 0x5568e47c9df0 2024-04-01T06:57:21.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.002+0000 7f2b7ffff700 1 -- 172.21.15.83:0/1855347385 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5568e46d1380 con 0x5568e47c9df0 2024-04-01T06:57:21.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.002+0000 7f2b7ffff700 1 -- 172.21.15.83:0/1855347385 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f2b98004410 con 0x5568e47c9df0 2024-04-01T06:57:21.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.002+0000 7f2bb2fa3b80 10 client.25352 fetch_fsmap finished waiting for FSMap version 26 2024-04-01T06:57:21.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.002+0000 7f2bb2fa3b80 10 client.25352 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-01T06:57:21.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.002+0000 7f2bb2fa3b80 20 client.25352 populate_metadata read hostname 'smithi083' 2024-04-01T06:57:21.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.003+0000 7f2bb2fa3b80 1 --2- 172.21.15.83:0/1855347385 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5568e47d9a60 0x5568e47dbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.003+0000 7f2bb2fa3b80 4 client.25352 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-01T06:57:21.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.003+0000 7f2bb2fa3b80 1 -- 172.21.15.83:0/1855347385 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5568e4709700 con 0x5568e47d9a60 2024-04-01T06:57:21.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.003+0000 7f2ba4ba9700 1 --2- 172.21.15.83:0/1855347385 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5568e47d9a60 0x5568e47dbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.003+0000 7f2b7ffff700 10 client.25352 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:57:21.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.003+0000 7f2ba4ba9700 1 --2- 172.21.15.83:0/1855347385 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5568e47d9a60 0x5568e47dbe80 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9524c013eaec264f server_cookie=23d82429f6fc9a35 in_seq=0 out_seq=0 2024-04-01T06:57:21.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.004+0000 7f2b7ffff700 1 -- 172.21.15.83:0/1855347385 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5568e4709700 con 0x5568e47d9a60 2024-04-01T06:57:21.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.004+0000 7f2b7ffff700 10 client.25352 handle_command_reply: tid=0 2024-04-01T06:57:21.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.004+0000 7f2bb2fa3b80 1 client.25352 shutdown 2024-04-01T06:57:21.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.004+0000 7f2bb2fa3b80 1 -- 172.21.15.83:0/1855347385 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5568e47c9df0 msgr2=0x5568e47c7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:21.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.004+0000 7f2bb2fa3b80 1 --2- 172.21.15.83:0/1855347385 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5568e47c9df0 0x5568e47c7260 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2b98007a70 tx=0x7f2b98007aa0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.004+0000 7f2bb2fa3b80 1 -- 172.21.15.83:0/1855347385 shutdown_connections 2024-04-01T06:57:21.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.004+0000 7f2bb2fa3b80 1 --2- 172.21.15.83:0/1855347385 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5568e47d9a60 0x5568e47dbe80 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.004+0000 7f2bb2fa3b80 1 --2- 172.21.15.83:0/1855347385 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5568e47c9df0 0x5568e47c7260 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.004+0000 7f2bb2fa3b80 1 --2- 172.21.15.83:0/1855347385 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5568e47be5d0 0x5568e47c9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.004+0000 7f2b7ffff700 0 client.25352 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:57:21.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.004+0000 7f2bb2fa3b80 1 --2- 172.21.15.83:0/1855347385 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5568e47beef0 0x5568e47c6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.004+0000 7f2bb2fa3b80 1 -- 172.21.15.83:0/1855347385 >> 172.21.15.83:0/1855347385 conn(0x5568e471e6a0 msgr2=0x5568e47c0670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:21.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.004+0000 7f2bb2fa3b80 1 -- 172.21.15.83:0/1855347385 shutdown_connections 2024-04-01T06:57:21.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.004+0000 7f2bb2fa3b80 1 -- 172.21.15.83:0/1855347385 wait complete. 2024-04-01T06:57:21.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.004+0000 7f2bb2fa3b80 20 client.25352 trim_cache size 0 max 16384 2024-04-01T06:57:21.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.023+0000 7f2bb2fa3b80 1 Processor -- start 2024-04-01T06:57:21.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.023+0000 7f2bb2fa3b80 1 -- start start 2024-04-01T06:57:21.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.023+0000 7f2bb2fa3b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5568e47be5d0 0x5568e47d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.023+0000 7f2bb2fa3b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5568e47beef0 0x5568e47c1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.023+0000 7f2bb2fa3b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5568e47c9df0 0x5568e47c2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.023+0000 7f2bb2fa3b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568e47d7170 con 0x5568e47be5d0 2024-04-01T06:57:21.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.023+0000 7f2bb2fa3b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568e47d6560 con 0x5568e47beef0 2024-04-01T06:57:21.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.023+0000 7f2bb2fa3b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568e47bc1e0 con 0x5568e47c9df0 2024-04-01T06:57:21.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.023+0000 7f2ba4ba9700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5568e47be5d0 0x5568e47d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.023+0000 7f2ba4ba9700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5568e47be5d0 0x5568e47d0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55856/0 (socket says 172.21.15.83:55856) 2024-04-01T06:57:21.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.023+0000 7f2ba4ba9700 1 -- 172.21.15.83:0/2775746164 learned_addr learned my addr 172.21.15.83:0/2775746164 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:21.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.023+0000 7f2b9ffff700 1 --2- 172.21.15.83:0/2775746164 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5568e47beef0 0x5568e47c1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.023+0000 7f2ba53aa700 1 --2- 172.21.15.83:0/2775746164 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5568e47c9df0 0x5568e47c2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.023+0000 7f2ba4ba9700 1 -- 172.21.15.83:0/2775746164 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5568e47c9df0 msgr2=0x5568e47c2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:21.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.023+0000 7f2ba4ba9700 1 --2- 172.21.15.83:0/2775746164 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5568e47c9df0 0x5568e47c2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.023+0000 7f2ba4ba9700 1 -- 172.21.15.83:0/2775746164 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5568e47beef0 msgr2=0x5568e47c1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:21.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.023+0000 7f2ba4ba9700 1 --2- 172.21.15.83:0/2775746164 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5568e47beef0 0x5568e47c1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.023+0000 7f2ba4ba9700 1 -- 172.21.15.83:0/2775746164 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568e46d6ea0 con 0x5568e47be5d0 2024-04-01T06:57:21.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.023+0000 7f2ba4ba9700 1 --2- 172.21.15.83:0/2775746164 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5568e47be5d0 0x5568e47d0a10 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f2b94000c00 tx=0x7f2b94023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=437f1c038e152f58 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:21.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.024+0000 7f2b8b7fe700 1 -- 172.21.15.83:0/2775746164 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9400b9f0 con 0x5568e47be5d0 2024-04-01T06:57:21.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.024+0000 7f2b8b7fe700 1 -- 172.21.15.83:0/2775746164 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2b9401e040 con 0x5568e47be5d0 2024-04-01T06:57:21.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.024+0000 7f2b8b7fe700 1 -- 172.21.15.83:0/2775746164 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b94004de0 con 0x5568e47be5d0 2024-04-01T06:57:21.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.024+0000 7f2bb2fa3b80 1 -- 172.21.15.83:0/2775746164 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5568e47be5d0 msgr2=0x5568e47d0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:21.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.024+0000 7f2bb2fa3b80 1 --2- 172.21.15.83:0/2775746164 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5568e47be5d0 0x5568e47d0a10 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f2b94000c00 tx=0x7f2b94023000 comp rx=0 tx=0).stop 2024-04-01T06:57:21.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.024+0000 7f2bb2fa3b80 1 -- 172.21.15.83:0/2775746164 shutdown_connections 2024-04-01T06:57:21.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.024+0000 7f2bb2fa3b80 1 --2- 172.21.15.83:0/2775746164 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5568e47be5d0 0x5568e47d0a10 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.024+0000 7f2bb2fa3b80 1 --2- 172.21.15.83:0/2775746164 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5568e47c9df0 0x5568e47c2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.024+0000 7f2bb2fa3b80 1 --2- 172.21.15.83:0/2775746164 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5568e47beef0 0x5568e47c1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.024+0000 7f2bb2fa3b80 1 -- 172.21.15.83:0/2775746164 >> 172.21.15.83:0/2775746164 conn(0x5568e471e6a0 msgr2=0x5568e47c9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:21.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.024+0000 7f2bb2fa3b80 1 -- 172.21.15.83:0/2775746164 shutdown_connections 2024-04-01T06:57:21.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.024+0000 7f2bb2fa3b80 1 -- 172.21.15.83:0/2775746164 wait complete. 2024-04-01T06:57:21.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.025+0000 7f2bb2fa3b80 1 -- start start 2024-04-01T06:57:21.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.025+0000 7f2bb2fa3b80 1 Processor -- start 2024-04-01T06:57:21.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.025+0000 7f2bb2fa3b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5568e47be5d0 0x5568e47d0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.025+0000 7f2bb2fa3b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5568e47beef0 0x5568e47d09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.025+0000 7f2bb2fa3b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5568e47c9df0 0x5568e47ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.025+0000 7f2bb2fa3b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568e47cf240 con 0x5568e47c9df0 2024-04-01T06:57:21.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.025+0000 7f2bb2fa3b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568e47cf3b0 con 0x5568e47be5d0 2024-04-01T06:57:21.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.025+0000 7f2bb2fa3b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568e47cf570 con 0x5568e47beef0 2024-04-01T06:57:21.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.025+0000 7f2bb2fa3b80 10 client.0 _ll_register_callbacks cb 0x5568e46b6470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:57:21.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.025+0000 7f2ba53aa700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5568e47c9df0 0x5568e47ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.025+0000 7f2ba53aa700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5568e47c9df0 0x5568e47ceb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55868/0 (socket says 172.21.15.83:55868) 2024-04-01T06:57:21.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.025+0000 7f2ba53aa700 1 -- 172.21.15.83:0/3202246841 learned_addr learned my addr 172.21.15.83:0/3202246841 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:21.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.025+0000 7f2ba4ba9700 1 --2- 172.21.15.83:0/3202246841 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5568e47be5d0 0x5568e47d0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.025+0000 7f2b9ffff700 1 --2- 172.21.15.83:0/3202246841 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5568e47beef0 0x5568e47d09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.026+0000 7f2ba53aa700 1 -- 172.21.15.83:0/3202246841 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5568e47beef0 msgr2=0x5568e47d09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:21.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.026+0000 7f2ba53aa700 1 --2- 172.21.15.83:0/3202246841 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5568e47beef0 0x5568e47d09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.026+0000 7f2ba53aa700 1 -- 172.21.15.83:0/3202246841 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5568e47be5d0 msgr2=0x5568e47d0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:21.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.026+0000 7f2ba53aa700 1 --2- 172.21.15.83:0/3202246841 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5568e47be5d0 0x5568e47d0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.026+0000 7f2ba53aa700 1 -- 172.21.15.83:0/3202246841 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ba010d360 con 0x5568e47c9df0 2024-04-01T06:57:21.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.026+0000 7f2ba4ba9700 1 --2- 172.21.15.83:0/3202246841 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5568e47be5d0 0x5568e47d0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T06:57:21.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.026+0000 7f2ba53aa700 1 --2- 172.21.15.83:0/3202246841 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5568e47c9df0 0x5568e47ceb70 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f2b980047a0 tx=0x7f2b98004ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49cb6f4b6ec3209e server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:21.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.026+0000 7f2b7ffff700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:57:21.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.026+0000 7f2b7ffff700 1 -- 172.21.15.83:0/3202246841 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9800e040 con 0x5568e47c9df0 2024-04-01T06:57:21.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.026+0000 7f2bb2fa3b80 1 -- 172.21.15.83:0/3202246841 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2b8c0a2290 con 0x5568e47c9df0 2024-04-01T06:57:21.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.026+0000 7f2b7ffff700 1 -- 172.21.15.83:0/3202246841 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f2b9800ae40 con 0x5568e47c9df0 2024-04-01T06:57:21.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.026+0000 7f2b7ffff700 1 -- 172.21.15.83:0/3202246841 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b98004e90 con 0x5568e47c9df0 2024-04-01T06:57:21.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.026+0000 7f2bb2fa3b80 10 client.15840 fetch_fsmap learned FSMap version 26 2024-04-01T06:57:21.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.026+0000 7f2bb2fa3b80 1 -- 172.21.15.83:0/3202246841 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5568e4596cd0 con 0x5568e47c9df0 2024-04-01T06:57:21.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.026+0000 7f2b7ffff700 1 -- 172.21.15.83:0/3202246841 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2b98036020 con 0x5568e47c9df0 2024-04-01T06:57:21.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.026+0000 7f2b7ffff700 1 -- 172.21.15.83:0/3202246841 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f2b98030070 con 0x5568e47c9df0 2024-04-01T06:57:21.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.026+0000 7f2bb2fa3b80 10 client.15840 fetch_fsmap finished waiting for FSMap version 26 2024-04-01T06:57:21.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.026+0000 7f2bb2fa3b80 10 client.15840 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-01T06:57:21.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.026+0000 7f2bb2fa3b80 20 client.15840 populate_metadata read hostname 'smithi083' 2024-04-01T06:57:21.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.026+0000 7f2bb2fa3b80 1 --2- 172.21.15.83:0/3202246841 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5568e482eb60 0x5568e4830f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.026+0000 7f2bb2fa3b80 4 client.15840 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-01T06:57:21.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.027+0000 7f2bb2fa3b80 1 -- 172.21.15.83:0/3202246841 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5568e455fcf0 con 0x5568e482eb60 2024-04-01T06:57:21.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.027+0000 7f2ba4ba9700 1 --2- 172.21.15.83:0/3202246841 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5568e482eb60 0x5568e4830f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.027+0000 7f2b7ffff700 10 client.15840 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:57:21.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.027+0000 7f2ba4ba9700 1 --2- 172.21.15.83:0/3202246841 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5568e482eb60 0x5568e4830f80 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a12febc21da2f84 server_cookie=f05616f706a6d10f in_seq=0 out_seq=0 2024-04-01T06:57:21.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.030+0000 7f2b7ffff700 1 -- 172.21.15.83:0/3202246841 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5568e455fcf0 con 0x5568e482eb60 2024-04-01T06:57:21.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.030+0000 7f2b7ffff700 10 client.15840 handle_command_reply: tid=0 2024-04-01T06:57:21.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.030+0000 7f2bb2fa3b80 1 client.15840 shutdown 2024-04-01T06:57:21.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.030+0000 7f2bb2fa3b80 1 -- 172.21.15.83:0/3202246841 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5568e47c9df0 msgr2=0x5568e47ceb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:21.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.030+0000 7f2bb2fa3b80 1 --2- 172.21.15.83:0/3202246841 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5568e47c9df0 0x5568e47ceb70 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f2b980047a0 tx=0x7f2b98004ca0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.030+0000 7f2bb2fa3b80 1 -- 172.21.15.83:0/3202246841 shutdown_connections 2024-04-01T06:57:21.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.030+0000 7f2bb2fa3b80 1 --2- 172.21.15.83:0/3202246841 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5568e482eb60 0x5568e4830f80 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.030+0000 7f2bb2fa3b80 1 --2- 172.21.15.83:0/3202246841 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5568e47c9df0 0x5568e47ceb70 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.030+0000 7f2b7ffff700 0 client.15840 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:57:21.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.030+0000 7f2bb2fa3b80 1 --2- 172.21.15.83:0/3202246841 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5568e47be5d0 0x5568e47d0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.030+0000 7f2bb2fa3b80 1 --2- 172.21.15.83:0/3202246841 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5568e47beef0 0x5568e47d09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.030+0000 7f2bb2fa3b80 1 -- 172.21.15.83:0/3202246841 >> 172.21.15.83:0/3202246841 conn(0x5568e471e6a0 msgr2=0x5568e47c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:21.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.030+0000 7f2bb2fa3b80 1 -- 172.21.15.83:0/3202246841 shutdown_connections 2024-04-01T06:57:21.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.030+0000 7f2bb2fa3b80 1 -- 172.21.15.83:0/3202246841 wait complete. 2024-04-01T06:57:21.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.030+0000 7f2bb2fa3b80 20 client.15840 trim_cache size 0 max 16384 2024-04-01T06:57:21.035 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-04-01T06:57:21.035 INFO:teuthology.orchestra.run.smithi083.stdout: "status": "no active scrubs running", 2024-04-01T06:57:21.035 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubs": {} 2024-04-01T06:57:21.036 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-04-01T06:57:21.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.031+0000 7f2ba6e0d700 1 -- 172.21.15.83:0/737707056 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f2b900a13b0 msgr2=0x7f2b900a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:21.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.031+0000 7f2ba6e0d700 1 --2- 172.21.15.83:0/737707056 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f2b900a13b0 0x7f2b900a3870 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2b94006010 tx=0x7f2b94005960 comp rx=0 tx=0).stop 2024-04-01T06:57:21.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.031+0000 7f2ba6e0d700 1 -- 172.21.15.83:0/737707056 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ba0104f70 msgr2=0x7f2ba01984a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:21.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.031+0000 7f2ba6e0d700 1 --2- 172.21.15.83:0/737707056 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ba0104f70 0x7f2ba01984a0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c00c9e0 tx=0x7f2b8c00ccf0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.031+0000 7f2ba6e0d700 1 -- 172.21.15.83:0/737707056 shutdown_connections 2024-04-01T06:57:21.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.031+0000 7f2ba6e0d700 1 --2- 172.21.15.83:0/737707056 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f2b900a13b0 0x7f2b900a3870 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.031+0000 7f2ba6e0d700 1 --2- 172.21.15.83:0/737707056 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ba01989e0 0x7f2ba01a2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.031+0000 7f2ba6e0d700 1 --2- 172.21.15.83:0/737707056 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2ba00ffe70 0x7f2ba0197f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.031+0000 7f2ba6e0d700 1 --2- 172.21.15.83:0/737707056 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ba0104f70 0x7f2ba01984a0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.031+0000 7f2ba6e0d700 1 -- 172.21.15.83:0/737707056 >> 172.21.15.83:0/737707056 conn(0x7f2ba0076d50 msgr2=0x7f2ba00ff360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:21.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.031+0000 7f2ba6e0d700 1 -- 172.21.15.83:0/737707056 shutdown_connections 2024-04-01T06:57:21.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.031+0000 7f2ba6e0d700 1 -- 172.21.15.83:0/737707056 wait complete. 2024-04-01T06:57:21.042 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:20 smithi083 ceph-mon[43429]: pgmap v47: 97 pgs: 97 active+clean; 36 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.0 MiB/s wr, 1.52k op/s 2024-04-01T06:57:21.043 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-01T06:57:21.044 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T06:57:21.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:20 smithi153 ceph-mon[48187]: pgmap v47: 97 pgs: 97 active+clean; 36 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.0 MiB/s wr, 1.52k op/s 2024-04-01T06:57:21.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.172+0000 7efe9d829700 1 -- 172.21.15.83:0/3775546355 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efe98100870 msgr2=0x7efe98100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:21.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.172+0000 7efe9d829700 1 --2- 172.21.15.83:0/3775546355 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efe98100870 0x7efe98100c50 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7efe88009990 tx=0x7efe88009ca0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.172+0000 7efe9d829700 1 -- 172.21.15.83:0/3775546355 shutdown_connections 2024-04-01T06:57:21.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.172+0000 7efe9d829700 1 --2- 172.21.15.83:0/3775546355 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efe98100870 0x7efe98100c50 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.172+0000 7efe9d829700 1 --2- 172.21.15.83:0/3775546355 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe98104ea0 0x7efe9810ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.172+0000 7efe9d829700 1 --2- 172.21.15.83:0/3775546355 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efe98101220 0x7efe981047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.172+0000 7efe9d829700 1 -- 172.21.15.83:0/3775546355 >> 172.21.15.83:0/3775546355 conn(0x7efe98074de0 msgr2=0x7efe980751f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:21.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.172+0000 7efe9d829700 1 -- 172.21.15.83:0/3775546355 shutdown_connections 2024-04-01T06:57:21.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.172+0000 7efe9d829700 1 -- 172.21.15.83:0/3775546355 wait complete. 2024-04-01T06:57:21.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.173+0000 7efe9d829700 1 Processor -- start 2024-04-01T06:57:21.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.173+0000 7efe9d829700 1 -- start start 2024-04-01T06:57:21.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.173+0000 7efe9d829700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe98100870 0x7efe98197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.173+0000 7efe9d829700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efe98104ea0 0x7efe981983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.173+0000 7efe9d829700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efe98198910 0x7efe981a2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.173+0000 7efe9d829700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe981a35f0 con 0x7efe98198910 2024-04-01T06:57:21.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.173+0000 7efe9d829700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe981a3760 con 0x7efe98104ea0 2024-04-01T06:57:21.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.173+0000 7efe9d829700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe981a3920 con 0x7efe98100870 2024-04-01T06:57:21.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.173+0000 7efe977fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efe98198910 0x7efe981a2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.173+0000 7efe967fc700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efe98104ea0 0x7efe981983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.173+0000 7efe977fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efe98198910 0x7efe981a2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55880/0 (socket says 172.21.15.83:55880) 2024-04-01T06:57:21.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.173+0000 7efe977fe700 1 -- 172.21.15.83:0/3790829055 learned_addr learned my addr 172.21.15.83:0/3790829055 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:21.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.173+0000 7efe96ffd700 1 --2- 172.21.15.83:0/3790829055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe98100870 0x7efe98197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.173+0000 7efe977fe700 1 -- 172.21.15.83:0/3790829055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe98100870 msgr2=0x7efe98197e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:21.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.173+0000 7efe977fe700 1 --2- 172.21.15.83:0/3790829055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe98100870 0x7efe98197e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.173+0000 7efe977fe700 1 -- 172.21.15.83:0/3790829055 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efe98104ea0 msgr2=0x7efe981983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:21.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.173+0000 7efe977fe700 1 --2- 172.21.15.83:0/3790829055 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efe98104ea0 0x7efe981983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.173+0000 7efe977fe700 1 -- 172.21.15.83:0/3790829055 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe880095f0 con 0x7efe98198910 2024-04-01T06:57:21.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.173+0000 7efe967fc700 1 --2- 172.21.15.83:0/3790829055 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efe98104ea0 0x7efe981983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T06:57:21.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.174+0000 7efe977fe700 1 --2- 172.21.15.83:0/3790829055 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efe98198910 0x7efe981a2f10 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7efe90007ee0 tx=0x7efe9000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:21.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.174+0000 7efe9c827700 1 -- 172.21.15.83:0/3790829055 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe90017070 con 0x7efe98198910 2024-04-01T06:57:21.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.174+0000 7efe9d829700 1 -- 172.21.15.83:0/3790829055 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe981a3c00 con 0x7efe98198910 2024-04-01T06:57:21.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.174+0000 7efe9c827700 1 -- 172.21.15.83:0/3790829055 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efe9000f040 con 0x7efe98198910 2024-04-01T06:57:21.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.174+0000 7efe9c827700 1 -- 172.21.15.83:0/3790829055 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe90005580 con 0x7efe98198910 2024-04-01T06:57:21.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.174+0000 7efe9d829700 1 -- 172.21.15.83:0/3790829055 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe981a40c0 con 0x7efe98198910 2024-04-01T06:57:21.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.175+0000 7efe9d829700 1 -- 172.21.15.83:0/3790829055 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe98108140 con 0x7efe98198910 2024-04-01T06:57:21.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.176+0000 7efe9c827700 1 -- 172.21.15.83:0/3790829055 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) v1 ==== 136098+0+0 (secure 0 0 0) 0x7efe90005760 con 0x7efe98198910 2024-04-01T06:57:21.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.176+0000 7efe9c827700 1 --2- 172.21.15.83:0/3790829055 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7efe800a13b0 0x7efe800a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.177+0000 7efe96ffd700 1 --2- 172.21.15.83:0/3790829055 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7efe800a13b0 0x7efe800a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.177+0000 7efe9c827700 1 -- 172.21.15.83:0/3790829055 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7efe900cc750 con 0x7efe98198910 2024-04-01T06:57:21.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.177+0000 7efe96ffd700 1 --2- 172.21.15.83:0/3790829055 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7efe800a13b0 0x7efe800a3870 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7efe8800b2e0 tx=0x7efe88005960 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:21.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.181+0000 7efe9c827700 1 -- 172.21.15.83:0/3790829055 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7efe90095950 con 0x7efe98198910 2024-04-01T06:57:21.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:20 smithi145 ceph-mon[47816]: pgmap v47: 97 pgs: 97 active+clean; 36 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.0 MiB/s wr, 1.52k op/s 2024-04-01T06:57:21.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.437+0000 7efe9d829700 1 -- 172.21.15.83:0/3790829055 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efe980ffab0 con 0x7efe98198910 2024-04-01T06:57:21.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.438+0000 7efe9c827700 1 -- 172.21.15.83:0/3790829055 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+10876 (secure 0 0 0) 0x7efe90098f70 con 0x7efe98198910 2024-04-01T06:57:21.438 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:57:21.438 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1271130478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1271130478},{"type":"v1","addr":"172.21.15.83:6835","nonce":1271130478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2412682983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2412682983},{"type":"v1","addr":"172.21.15.83:6837","nonce":2412682983}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6839/3348145990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":3348145990},{"type":"v1","addr":"172.21.15.83:6839","nonce":3348145990}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6841/1191267445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6840","nonce":1191267445},{"type":"v1","addr":"172.21.15.83:6841","nonce":1191267445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2467459028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2467459028},{"type":"v1","addr":"172.21.15.153:6833","nonce":2467459028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24448,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4092629042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":4092629042},{"type":"v1","addr":"172.21.15.153:6835","nonce":4092629042}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-01T06:54:28.397062+0000","modified":"2024-04-01T06:57:14.770195+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24524,"mds_1":24494,"mds_2":24473},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6833/647005844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":647005844},{"type":"v1","addr":"172.21.15.145:6833","nonce":647005844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24454":{"gid":24454,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6837/1993816527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1993816527},{"type":"v1","addr":"172.21.15.153:6837","nonce":1993816527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24473":{"gid":24473,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.145:6835/3104241497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":3104241497},{"type":"v1","addr":"172.21.15.145:6835","nonce":3104241497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24494":{"gid":24494,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.145:6837/2687798317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2687798317},{"type":"v1","addr":"172.21.15.145:6837","nonce":2687798317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6839/3886435411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3886435411},{"type":"v1","addr":"172.21.15.145:6839","nonce":3886435411}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_25273":{"gid":25273,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6839/2570595837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":2570595837},{"type":"v1","addr":"172.21.15.153:6839","nonce":2570595837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-01T06:57:21.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.440+0000 7efe9d829700 1 -- 172.21.15.83:0/3790829055 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7efe800a13b0 msgr2=0x7efe800a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:21.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.440+0000 7efe9d829700 1 --2- 172.21.15.83:0/3790829055 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7efe800a13b0 0x7efe800a3870 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7efe8800b2e0 tx=0x7efe88005960 comp rx=0 tx=0).stop 2024-04-01T06:57:21.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.440+0000 7efe9d829700 1 -- 172.21.15.83:0/3790829055 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efe98198910 msgr2=0x7efe981a2f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:21.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.440+0000 7efe9d829700 1 --2- 172.21.15.83:0/3790829055 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efe98198910 0x7efe981a2f10 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7efe90007ee0 tx=0x7efe9000d3b0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.440+0000 7efe9d829700 1 -- 172.21.15.83:0/3790829055 shutdown_connections 2024-04-01T06:57:21.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.440+0000 7efe9d829700 1 --2- 172.21.15.83:0/3790829055 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7efe800a13b0 0x7efe800a3870 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.440+0000 7efe9d829700 1 --2- 172.21.15.83:0/3790829055 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efe98198910 0x7efe981a2f10 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.440+0000 7efe9d829700 1 --2- 172.21.15.83:0/3790829055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe98100870 0x7efe98197e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.440+0000 7efe9d829700 1 --2- 172.21.15.83:0/3790829055 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efe98104ea0 0x7efe981983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.440+0000 7efe9d829700 1 -- 172.21.15.83:0/3790829055 >> 172.21.15.83:0/3790829055 conn(0x7efe98074de0 msgr2=0x7efe980fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:21.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.440+0000 7efe9d829700 1 -- 172.21.15.83:0/3790829055 shutdown_connections 2024-04-01T06:57:21.442 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.440+0000 7efe9d829700 1 -- 172.21.15.83:0/3790829055 wait complete. 2024-04-01T06:57:21.443 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 26 2024-04-01T06:57:21.452 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-01T06:57:21.452 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-01T06:57:21.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.584+0000 7ff651393700 1 -- 172.21.15.83:0/141124262 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff64c100820 msgr2=0x7ff64c104840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:21.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.584+0000 7ff651393700 1 --2- 172.21.15.83:0/141124262 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff64c100820 0x7ff64c104840 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7ff63c009990 tx=0x7ff63c009ca0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.584+0000 7ff651393700 1 -- 172.21.15.83:0/141124262 shutdown_connections 2024-04-01T06:57:21.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.584+0000 7ff651393700 1 --2- 172.21.15.83:0/141124262 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff64c104f70 0x7ff64c10caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.584+0000 7ff651393700 1 --2- 172.21.15.83:0/141124262 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff64c0ffe70 0x7ff64c100250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.584+0000 7ff651393700 1 --2- 172.21.15.83:0/141124262 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff64c100820 0x7ff64c104840 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.584+0000 7ff651393700 1 -- 172.21.15.83:0/141124262 >> 172.21.15.83:0/141124262 conn(0x7ff64c076d50 msgr2=0x7ff64c077160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:21.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.584+0000 7ff651393700 1 -- 172.21.15.83:0/141124262 shutdown_connections 2024-04-01T06:57:21.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.584+0000 7ff651393700 1 -- 172.21.15.83:0/141124262 wait complete. 2024-04-01T06:57:21.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.585+0000 7ff651393700 1 Processor -- start 2024-04-01T06:57:21.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.585+0000 7ff651393700 1 -- start start 2024-04-01T06:57:21.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.586+0000 7ff651393700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff64c0ffe70 0x7ff64c197270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.586+0000 7ff651393700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff64c104f70 0x7ff64c1977b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.586+0000 7ff651393700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff64c19bb00 0x7ff64c19bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.586+0000 7ff651393700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64c19c580 con 0x7ff64c0ffe70 2024-04-01T06:57:21.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.586+0000 7ff651393700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64c19c6f0 con 0x7ff64c19bb00 2024-04-01T06:57:21.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.586+0000 7ff651393700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64c19c8b0 con 0x7ff64c104f70 2024-04-01T06:57:21.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.586+0000 7ff64affd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff64c0ffe70 0x7ff64c197270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.586+0000 7ff64affd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff64c0ffe70 0x7ff64c197270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55890/0 (socket says 172.21.15.83:55890) 2024-04-01T06:57:21.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.586+0000 7ff64affd700 1 -- 172.21.15.83:0/4036349659 learned_addr learned my addr 172.21.15.83:0/4036349659 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:21.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.586+0000 7ff64b7fe700 1 --2- 172.21.15.83:0/4036349659 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff64c19bb00 0x7ff64c19bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.586+0000 7ff64a7fc700 1 --2- 172.21.15.83:0/4036349659 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff64c104f70 0x7ff64c1977b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.586+0000 7ff64affd700 1 -- 172.21.15.83:0/4036349659 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff64c104f70 msgr2=0x7ff64c1977b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:21.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.586+0000 7ff64affd700 1 --2- 172.21.15.83:0/4036349659 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff64c104f70 0x7ff64c1977b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.586+0000 7ff64affd700 1 -- 172.21.15.83:0/4036349659 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff64c19bb00 msgr2=0x7ff64c19bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:21.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.586+0000 7ff64affd700 1 --2- 172.21.15.83:0/4036349659 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff64c19bb00 0x7ff64c19bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.586+0000 7ff64affd700 1 -- 172.21.15.83:0/4036349659 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff63c0095f0 con 0x7ff64c0ffe70 2024-04-01T06:57:21.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.586+0000 7ff64affd700 1 --2- 172.21.15.83:0/4036349659 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff64c0ffe70 0x7ff64c197270 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7ff64000e9a0 tx=0x7ff64000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:21.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.586+0000 7ff633fff700 1 -- 172.21.15.83:0/4036349659 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff640009790 con 0x7ff64c0ffe70 2024-04-01T06:57:21.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.586+0000 7ff633fff700 1 -- 172.21.15.83:0/4036349659 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff64000cbd0 con 0x7ff64c0ffe70 2024-04-01T06:57:21.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.586+0000 7ff651393700 1 -- 172.21.15.83:0/4036349659 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff64c1a3e10 con 0x7ff64c0ffe70 2024-04-01T06:57:21.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.586+0000 7ff633fff700 1 -- 172.21.15.83:0/4036349659 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff640018680 con 0x7ff64c0ffe70 2024-04-01T06:57:21.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.586+0000 7ff651393700 1 -- 172.21.15.83:0/4036349659 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff64c1a4290 con 0x7ff64c0ffe70 2024-04-01T06:57:21.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.589+0000 7ff633fff700 1 -- 172.21.15.83:0/4036349659 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) v1 ==== 136098+0+0 (secure 0 0 0) 0x7ff64000cd40 con 0x7ff64c0ffe70 2024-04-01T06:57:21.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.590+0000 7ff633fff700 1 --2- 172.21.15.83:0/4036349659 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7ff6340a13b0 0x7ff6340a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.590+0000 7ff65d529b80 1 Processor -- start 2024-04-01T06:57:21.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.590+0000 7ff64a7fc700 1 --2- 172.21.15.83:0/4036349659 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7ff6340a13b0 0x7ff6340a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.590+0000 7ff633fff700 1 -- 172.21.15.83:0/4036349659 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7ff640014070 con 0x7ff64c0ffe70 2024-04-01T06:57:21.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.590+0000 7ff65d529b80 1 -- start start 2024-04-01T06:57:21.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.590+0000 7ff65d529b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558d31ceb5d0 0x558d31ceb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.590+0000 7ff65d529b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558d31cebef0 0x558d31cf68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.590+0000 7ff65d529b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558d31cf6df0 0x558d31cf91e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.590+0000 7ff65d529b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d31c44990 con 0x558d31cebef0 2024-04-01T06:57:21.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.590+0000 7ff65d529b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d31c42350 con 0x558d31ceb5d0 2024-04-01T06:57:21.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.590+0000 7ff65d529b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d31c3dc40 con 0x558d31cf6df0 2024-04-01T06:57:21.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.590+0000 7ff64a7fc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558d31cebef0 0x558d31cf68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.590+0000 7ff64affd700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558d31ceb5d0 0x558d31ceb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.590+0000 7ff64a7fc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558d31cebef0 0x558d31cf68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55892/0 (socket says 172.21.15.83:55892) 2024-04-01T06:57:21.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.590+0000 7ff64a7fc700 1 -- 172.21.15.83:0/4129602557 learned_addr learned my addr 172.21.15.83:0/4129602557 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:21.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.590+0000 7ff64a7fc700 1 --2- 172.21.15.83:0/4036349659 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7ff6340a13b0 0x7ff6340a3870 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff63c00b2e0 tx=0x7ff63c005fd0 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:21.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.590+0000 7ff64b7fe700 1 --2- 172.21.15.83:0/4129602557 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558d31cf6df0 0x558d31cf91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.590+0000 7ff64a7fc700 1 -- 172.21.15.83:0/4129602557 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558d31cf6df0 msgr2=0x558d31cf91e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:21.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.590+0000 7ff64a7fc700 1 --2- 172.21.15.83:0/4129602557 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558d31cf6df0 0x558d31cf91e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.590+0000 7ff64a7fc700 1 -- 172.21.15.83:0/4129602557 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558d31ceb5d0 msgr2=0x558d31ceb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:21.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.590+0000 7ff64a7fc700 1 --2- 172.21.15.83:0/4129602557 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558d31ceb5d0 0x558d31ceb9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.590+0000 7ff64a7fc700 1 -- 172.21.15.83:0/4129602557 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d31abf3b0 con 0x558d31cebef0 2024-04-01T06:57:21.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.590+0000 7ff64affd700 1 --2- 172.21.15.83:0/4129602557 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558d31ceb5d0 0x558d31ceb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T06:57:21.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.590+0000 7ff64b7fe700 1 --2- 172.21.15.83:0/4129602557 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558d31cf6df0 0x558d31cf91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:57:21.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.591+0000 7ff64a7fc700 1 --2- 172.21.15.83:0/4129602557 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558d31cebef0 0x558d31cf68b0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7ff63c015000 tx=0x7ff63c01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f3a4df7dcc0d35f server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:21.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.591+0000 7ff6317fa700 1 -- 172.21.15.83:0/4129602557 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63c02b070 con 0x558d31cebef0 2024-04-01T06:57:21.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.591+0000 7ff6317fa700 1 -- 172.21.15.83:0/4129602557 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff63c01e040 con 0x558d31cebef0 2024-04-01T06:57:21.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.591+0000 7ff6317fa700 1 -- 172.21.15.83:0/4129602557 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63c004d50 con 0x558d31cebef0 2024-04-01T06:57:21.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.591+0000 7ff65d529b80 1 -- 172.21.15.83:0/4129602557 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558d31cebef0 msgr2=0x558d31cf68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:21.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.591+0000 7ff65d529b80 1 --2- 172.21.15.83:0/4129602557 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558d31cebef0 0x558d31cf68b0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7ff63c015000 tx=0x7ff63c01f000 comp rx=0 tx=0).stop 2024-04-01T06:57:21.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.592+0000 7ff65d529b80 1 -- 172.21.15.83:0/4129602557 shutdown_connections 2024-04-01T06:57:21.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.592+0000 7ff65d529b80 1 --2- 172.21.15.83:0/4129602557 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558d31cf6df0 0x558d31cf91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.592+0000 7ff65d529b80 1 --2- 172.21.15.83:0/4129602557 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558d31ceb5d0 0x558d31ceb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.592+0000 7ff65d529b80 1 --2- 172.21.15.83:0/4129602557 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558d31cebef0 0x558d31cf68b0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.592+0000 7ff65d529b80 1 -- 172.21.15.83:0/4129602557 >> 172.21.15.83:0/4129602557 conn(0x558d31c4b6a0 msgr2=0x558d31ce7a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:21.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.592+0000 7ff65d529b80 1 -- 172.21.15.83:0/4129602557 shutdown_connections 2024-04-01T06:57:21.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.592+0000 7ff65d529b80 1 -- 172.21.15.83:0/4129602557 wait complete. 2024-04-01T06:57:21.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.592+0000 7ff65d529b80 1 -- start start 2024-04-01T06:57:21.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.592+0000 7ff65d529b80 1 Processor -- start 2024-04-01T06:57:21.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.592+0000 7ff65d529b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558d31ceb5d0 0x558d31cf67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.592+0000 7ff65d529b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558d31cebef0 0x558d31cf3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.592+0000 7ff65d529b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558d31cf6df0 0x558d31cf4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.592+0000 7ff65d529b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d31bd9d80 con 0x558d31ceb5d0 2024-04-01T06:57:21.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.592+0000 7ff65d529b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d31bd9a20 con 0x558d31cf6df0 2024-04-01T06:57:21.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.592+0000 7ff65d529b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d31ac16a0 con 0x558d31cebef0 2024-04-01T06:57:21.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.592+0000 7ff65d529b80 10 client.0 _ll_register_callbacks cb 0x558d31be3470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:57:21.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.592+0000 7ff64affd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558d31ceb5d0 0x558d31cf67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.593+0000 7ff64b7fe700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558d31cf6df0 0x558d31cf4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.593+0000 7ff64affd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558d31ceb5d0 0x558d31cf67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55900/0 (socket says 172.21.15.83:55900) 2024-04-01T06:57:21.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.593+0000 7ff64affd700 1 -- 172.21.15.83:0/612759202 learned_addr learned my addr 172.21.15.83:0/612759202 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:21.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.593+0000 7ff64a7fc700 1 --2- 172.21.15.83:0/612759202 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558d31cebef0 0x558d31cf3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.593+0000 7ff64affd700 1 -- 172.21.15.83:0/612759202 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558d31cebef0 msgr2=0x558d31cf3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:21.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.593+0000 7ff64affd700 1 --2- 172.21.15.83:0/612759202 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558d31cebef0 0x558d31cf3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.593+0000 7ff64affd700 1 -- 172.21.15.83:0/612759202 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558d31cf6df0 msgr2=0x558d31cf4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:21.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.593+0000 7ff64affd700 1 --2- 172.21.15.83:0/612759202 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558d31cf6df0 0x558d31cf4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.593+0000 7ff64affd700 1 -- 172.21.15.83:0/612759202 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff64c1a4290 con 0x558d31ceb5d0 2024-04-01T06:57:21.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.593+0000 7ff64affd700 1 --2- 172.21.15.83:0/612759202 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558d31ceb5d0 0x558d31cf67e0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7ff64000e970 tx=0x7ff64009a600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca62770663621b77 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:21.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.593+0000 7ff62eff5700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:57:21.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.593+0000 7ff62eff5700 1 -- 172.21.15.83:0/612759202 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64009def0 con 0x558d31ceb5d0 2024-04-01T06:57:21.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.593+0000 7ff62eff5700 1 -- 172.21.15.83:0/612759202 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7ff6400a2540 con 0x558d31ceb5d0 2024-04-01T06:57:21.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.593+0000 7ff65d529b80 1 -- 172.21.15.83:0/612759202 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558d31bfe380 con 0x558d31ceb5d0 2024-04-01T06:57:21.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.593+0000 7ff62eff5700 1 -- 172.21.15.83:0/612759202 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff6400caab0 con 0x558d31ceb5d0 2024-04-01T06:57:21.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.593+0000 7ff65d529b80 10 client.15858 fetch_fsmap learned FSMap version 26 2024-04-01T06:57:21.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.593+0000 7ff65d529b80 1 -- 172.21.15.83:0/612759202 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7ff64c10d360 con 0x558d31ceb5d0 2024-04-01T06:57:21.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.593+0000 7ff62eff5700 1 -- 172.21.15.83:0/612759202 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558d31bfe380 con 0x558d31ceb5d0 2024-04-01T06:57:21.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.594+0000 7ff62eff5700 1 -- 172.21.15.83:0/612759202 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ff640099020 con 0x558d31ceb5d0 2024-04-01T06:57:21.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.594+0000 7ff65d529b80 10 client.15858 fetch_fsmap finished waiting for FSMap version 26 2024-04-01T06:57:21.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.594+0000 7ff65d529b80 10 client.15858 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.e 2024-04-01T06:57:21.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.594+0000 7ff65d529b80 20 client.15858 populate_metadata read hostname 'smithi083' 2024-04-01T06:57:21.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.594+0000 7ff65d529b80 1 --2- 172.21.15.83:0/612759202 >> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] conn(0x558d31d06880 0x558d31d08c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.594+0000 7ff65d529b80 4 client.15858 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-01T06:57:21.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.594+0000 7ff65d529b80 1 -- 172.21.15.83:0/612759202 --> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558d31c36700 con 0x558d31d06880 2024-04-01T06:57:21.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.594+0000 7ff64a7fc700 1 --2- 172.21.15.83:0/612759202 >> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] conn(0x558d31d06880 0x558d31d08c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.594+0000 7ff62eff5700 10 client.15858 ms_handle_connect on v2:172.21.15.145:6834/3104241497 2024-04-01T06:57:21.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.594+0000 7ff64a7fc700 1 --2- 172.21.15.83:0/612759202 >> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] conn(0x558d31d06880 0x558d31d08c70 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=690b17a28a4eb077 server_cookie=16e4425a6befd6cb in_seq=0 out_seq=0 2024-04-01T06:57:21.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.595+0000 7ff62eff5700 1 -- 172.21.15.83:0/612759202 <== mds.2 v2:172.21.15.145:6834/3104241497 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558d31c36700 con 0x558d31d06880 2024-04-01T06:57:21.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.595+0000 7ff62eff5700 10 client.15858 handle_command_reply: tid=0 2024-04-01T06:57:21.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.595+0000 7ff65d529b80 1 client.15858 shutdown 2024-04-01T06:57:21.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.595+0000 7ff65d529b80 1 -- 172.21.15.83:0/612759202 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558d31ceb5d0 msgr2=0x558d31cf67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:21.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.595+0000 7ff65d529b80 1 --2- 172.21.15.83:0/612759202 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558d31ceb5d0 0x558d31cf67e0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7ff64000e970 tx=0x7ff64009a600 comp rx=0 tx=0).stop 2024-04-01T06:57:21.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.595+0000 7ff65d529b80 1 -- 172.21.15.83:0/612759202 shutdown_connections 2024-04-01T06:57:21.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.595+0000 7ff65d529b80 1 --2- 172.21.15.83:0/612759202 >> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] conn(0x558d31d06880 0x558d31d08c70 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.595+0000 7ff65d529b80 1 --2- 172.21.15.83:0/612759202 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558d31ceb5d0 0x558d31cf67e0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.595+0000 7ff65d529b80 1 --2- 172.21.15.83:0/612759202 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558d31cf6df0 0x558d31cf4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.595+0000 7ff65d529b80 1 --2- 172.21.15.83:0/612759202 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558d31cebef0 0x558d31cf3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.595+0000 7ff62eff5700 0 client.15858 ms_handle_reset on v2:172.21.15.145:6834/3104241497 2024-04-01T06:57:21.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.595+0000 7ff65d529b80 1 -- 172.21.15.83:0/612759202 >> 172.21.15.83:0/612759202 conn(0x558d31c4b6a0 msgr2=0x558d31ced6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:21.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.595+0000 7ff65d529b80 1 -- 172.21.15.83:0/612759202 shutdown_connections 2024-04-01T06:57:21.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.595+0000 7ff65d529b80 1 -- 172.21.15.83:0/612759202 wait complete. 2024-04-01T06:57:21.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.595+0000 7ff65d529b80 20 client.15858 trim_cache size 0 max 16384 2024-04-01T06:57:21.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.608+0000 7ff65d529b80 1 Processor -- start 2024-04-01T06:57:21.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.608+0000 7ff65d529b80 1 -- start start 2024-04-01T06:57:21.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.609+0000 7ff65d529b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558d31ceb5d0 0x558d31cfda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.609+0000 7ff65d529b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558d31cebef0 0x558d31cf33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.609+0000 7ff65d529b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558d31cf6df0 0x558d31cf38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.609+0000 7ff65d529b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d31ced070 con 0x558d31cebef0 2024-04-01T06:57:21.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.609+0000 7ff65d529b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d31ce87d0 con 0x558d31cf6df0 2024-04-01T06:57:21.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.609+0000 7ff65d529b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d31cf4470 con 0x558d31ceb5d0 2024-04-01T06:57:21.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.609+0000 7ff64a7fc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558d31cebef0 0x558d31cf33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.609+0000 7ff64a7fc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558d31cebef0 0x558d31cf33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55912/0 (socket says 172.21.15.83:55912) 2024-04-01T06:57:21.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.609+0000 7ff64a7fc700 1 -- 172.21.15.83:0/3124016509 learned_addr learned my addr 172.21.15.83:0/3124016509 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:21.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.609+0000 7ff64b7fe700 1 --2- 172.21.15.83:0/3124016509 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558d31cf6df0 0x558d31cf38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.609+0000 7ff64a7fc700 1 -- 172.21.15.83:0/3124016509 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558d31ceb5d0 msgr2=0x558d31cfda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:21.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.609+0000 7ff64a7fc700 1 --2- 172.21.15.83:0/3124016509 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558d31ceb5d0 0x558d31cfda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.609+0000 7ff64a7fc700 1 -- 172.21.15.83:0/3124016509 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558d31cf6df0 msgr2=0x558d31cf38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:21.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.609+0000 7ff64a7fc700 1 --2- 172.21.15.83:0/3124016509 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558d31cf6df0 0x558d31cf38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.609+0000 7ff64a7fc700 1 -- 172.21.15.83:0/3124016509 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d31a6bb60 con 0x558d31cebef0 2024-04-01T06:57:21.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.609+0000 7ff64b7fe700 1 --2- 172.21.15.83:0/3124016509 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558d31cf6df0 0x558d31cf38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:57:21.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.609+0000 7ff64a7fc700 1 --2- 172.21.15.83:0/3124016509 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558d31cebef0 0x558d31cf33b0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7ff63c0048c0 tx=0x7ff63c004500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73ab0820f49afb6e server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:21.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.609+0000 7ff631ffb700 1 -- 172.21.15.83:0/3124016509 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63c02b040 con 0x558d31cebef0 2024-04-01T06:57:21.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.609+0000 7ff631ffb700 1 -- 172.21.15.83:0/3124016509 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff63c02c040 con 0x558d31cebef0 2024-04-01T06:57:21.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.609+0000 7ff631ffb700 1 -- 172.21.15.83:0/3124016509 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63c004bc0 con 0x558d31cebef0 2024-04-01T06:57:21.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.610+0000 7ff65d529b80 1 -- 172.21.15.83:0/3124016509 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558d31cebef0 msgr2=0x558d31cf33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:21.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.610+0000 7ff65d529b80 1 --2- 172.21.15.83:0/3124016509 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558d31cebef0 0x558d31cf33b0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7ff63c0048c0 tx=0x7ff63c004500 comp rx=0 tx=0).stop 2024-04-01T06:57:21.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.610+0000 7ff65d529b80 1 -- 172.21.15.83:0/3124016509 shutdown_connections 2024-04-01T06:57:21.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.610+0000 7ff65d529b80 1 --2- 172.21.15.83:0/3124016509 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558d31cf6df0 0x558d31cf38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.610+0000 7ff65d529b80 1 --2- 172.21.15.83:0/3124016509 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558d31ceb5d0 0x558d31cfda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.610+0000 7ff65d529b80 1 --2- 172.21.15.83:0/3124016509 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558d31cebef0 0x558d31cf33b0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.610+0000 7ff65d529b80 1 -- 172.21.15.83:0/3124016509 >> 172.21.15.83:0/3124016509 conn(0x558d31c4b6a0 msgr2=0x558d31ce0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:21.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.610+0000 7ff65d529b80 1 -- 172.21.15.83:0/3124016509 shutdown_connections 2024-04-01T06:57:21.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.610+0000 7ff65d529b80 1 -- 172.21.15.83:0/3124016509 wait complete. 2024-04-01T06:57:21.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.610+0000 7ff65d529b80 1 -- start start 2024-04-01T06:57:21.616 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.610+0000 7ff65d529b80 1 Processor -- start 2024-04-01T06:57:21.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.611+0000 7ff65d529b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558d31ceb5d0 0x558d31cfd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.611+0000 7ff65d529b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558d31cebef0 0x558d31cfbe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.611+0000 7ff65d529b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558d31cf6df0 0x558d31cfc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.611+0000 7ff65d529b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d31cfca40 con 0x558d31cebef0 2024-04-01T06:57:21.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.611+0000 7ff65d529b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d31cfcbb0 con 0x558d31cf6df0 2024-04-01T06:57:21.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.611+0000 7ff65d529b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d31d5a620 con 0x558d31ceb5d0 2024-04-01T06:57:21.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.611+0000 7ff64a7fc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558d31cebef0 0x558d31cfbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.611+0000 7ff65d529b80 10 client.0 _ll_register_callbacks cb 0x558d31be3470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:57:21.617 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.611+0000 7ff64a7fc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558d31cebef0 0x558d31cfbe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55924/0 (socket says 172.21.15.83:55924) 2024-04-01T06:57:21.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.611+0000 7ff64a7fc700 1 -- 172.21.15.83:0/675034160 learned_addr learned my addr 172.21.15.83:0/675034160 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:21.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.611+0000 7ff64b7fe700 1 --2- 172.21.15.83:0/675034160 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558d31cf6df0 0x558d31cfc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.611+0000 7ff64affd700 1 --2- 172.21.15.83:0/675034160 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558d31ceb5d0 0x558d31cfd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.611+0000 7ff64a7fc700 1 -- 172.21.15.83:0/675034160 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558d31ceb5d0 msgr2=0x558d31cfd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:21.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.611+0000 7ff64a7fc700 1 --2- 172.21.15.83:0/675034160 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558d31ceb5d0 0x558d31cfd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.611+0000 7ff64a7fc700 1 -- 172.21.15.83:0/675034160 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558d31cf6df0 msgr2=0x558d31cfc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:21.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.611+0000 7ff64a7fc700 1 --2- 172.21.15.83:0/675034160 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558d31cf6df0 0x558d31cfc360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.611+0000 7ff64a7fc700 1 -- 172.21.15.83:0/675034160 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558d31abf3b0 con 0x558d31cebef0 2024-04-01T06:57:21.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.611+0000 7ff64affd700 1 --2- 172.21.15.83:0/675034160 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558d31ceb5d0 0x558d31cfd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:57:21.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.611+0000 7ff64a7fc700 1 --2- 172.21.15.83:0/675034160 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558d31cebef0 0x558d31cfbe20 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7ff63c009990 tx=0x7ff63c004850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99ed393fe2e0b5ef server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:21.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.611+0000 7ff62eff5700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:57:21.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.611+0000 7ff62eff5700 1 -- 172.21.15.83:0/675034160 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63c02b040 con 0x558d31cebef0 2024-04-01T06:57:21.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.611+0000 7ff62eff5700 1 -- 172.21.15.83:0/675034160 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7ff63c036250 con 0x558d31cebef0 2024-04-01T06:57:21.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.611+0000 7ff65d529b80 1 -- 172.21.15.83:0/675034160 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff63c01e040 con 0x558d31cebef0 2024-04-01T06:57:21.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.612+0000 7ff62eff5700 1 -- 172.21.15.83:0/675034160 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff63c036410 con 0x558d31cebef0 2024-04-01T06:57:21.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.612+0000 7ff65d529b80 10 client.15864 fetch_fsmap learned FSMap version 26 2024-04-01T06:57:21.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.612+0000 7ff65d529b80 1 -- 172.21.15.83:0/675034160 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x558d31c03ea0 con 0x558d31cebef0 2024-04-01T06:57:21.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.612+0000 7ff62eff5700 1 -- 172.21.15.83:0/675034160 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff63c01e040 con 0x558d31cebef0 2024-04-01T06:57:21.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.612+0000 7ff62eff5700 1 -- 172.21.15.83:0/675034160 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ff63c046020 con 0x558d31cebef0 2024-04-01T06:57:21.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.612+0000 7ff65d529b80 10 client.15864 fetch_fsmap finished waiting for FSMap version 26 2024-04-01T06:57:21.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.612+0000 7ff65d529b80 10 client.15864 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.e 2024-04-01T06:57:21.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.612+0000 7ff65d529b80 20 client.15864 populate_metadata read hostname 'smithi083' 2024-04-01T06:57:21.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.612+0000 7ff65d529b80 1 --2- 172.21.15.83:0/675034160 >> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] conn(0x558d31d5b860 0x558d31d5dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.612+0000 7ff65d529b80 4 client.15864 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-01T06:57:21.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.612+0000 7ff65d529b80 1 -- 172.21.15.83:0/675034160 --> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x558d31a8ccf0 con 0x558d31d5b860 2024-04-01T06:57:21.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.612+0000 7ff64affd700 1 --2- 172.21.15.83:0/675034160 >> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] conn(0x558d31d5b860 0x558d31d5dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.613+0000 7ff62eff5700 10 client.15864 ms_handle_connect on v2:172.21.15.145:6834/3104241497 2024-04-01T06:57:21.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.613+0000 7ff64affd700 1 --2- 172.21.15.83:0/675034160 >> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] conn(0x558d31d5b860 0x558d31d5dc80 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f79766138b034c3d server_cookie=e46a6e207d223354 in_seq=0 out_seq=0 2024-04-01T06:57:21.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.613+0000 7ff62eff5700 1 -- 172.21.15.83:0/675034160 <== mds.2 v2:172.21.15.145:6834/3104241497 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x558d31a8ccf0 con 0x558d31d5b860 2024-04-01T06:57:21.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.613+0000 7ff62eff5700 10 client.15864 handle_command_reply: tid=0 2024-04-01T06:57:21.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.613+0000 7ff65d529b80 1 client.15864 shutdown 2024-04-01T06:57:21.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.613+0000 7ff65d529b80 1 -- 172.21.15.83:0/675034160 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558d31cebef0 msgr2=0x558d31cfbe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:21.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.613+0000 7ff65d529b80 1 --2- 172.21.15.83:0/675034160 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558d31cebef0 0x558d31cfbe20 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7ff63c009990 tx=0x7ff63c004850 comp rx=0 tx=0).stop 2024-04-01T06:57:21.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.613+0000 7ff65d529b80 1 -- 172.21.15.83:0/675034160 shutdown_connections 2024-04-01T06:57:21.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.613+0000 7ff65d529b80 1 --2- 172.21.15.83:0/675034160 >> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] conn(0x558d31d5b860 0x558d31d5dc80 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.613+0000 7ff65d529b80 1 --2- 172.21.15.83:0/675034160 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558d31cf6df0 0x558d31cfc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.613+0000 7ff65d529b80 1 --2- 172.21.15.83:0/675034160 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558d31ceb5d0 0x558d31cfd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.613+0000 7ff65d529b80 1 --2- 172.21.15.83:0/675034160 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558d31cebef0 0x558d31cfbe20 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.613+0000 7ff62eff5700 0 client.15864 ms_handle_reset on v2:172.21.15.145:6834/3104241497 2024-04-01T06:57:21.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.613+0000 7ff65d529b80 1 -- 172.21.15.83:0/675034160 >> 172.21.15.83:0/675034160 conn(0x558d31c4b6a0 msgr2=0x558d31cf3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:21.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.613+0000 7ff65d529b80 1 -- 172.21.15.83:0/675034160 shutdown_connections 2024-04-01T06:57:21.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.613+0000 7ff65d529b80 1 -- 172.21.15.83:0/675034160 wait complete. 2024-04-01T06:57:21.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.613+0000 7ff65d529b80 20 client.15864 trim_cache size 0 max 16384 2024-04-01T06:57:21.621 INFO:teuthology.orchestra.run.smithi083.stdout:[] 2024-04-01T06:57:21.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.613+0000 7ff651393700 1 -- 172.21.15.83:0/4036349659 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7ff6340a13b0 msgr2=0x7ff6340a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:21.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.613+0000 7ff651393700 1 --2- 172.21.15.83:0/4036349659 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7ff6340a13b0 0x7ff6340a3870 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff63c00b2e0 tx=0x7ff63c005fd0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.613+0000 7ff651393700 1 -- 172.21.15.83:0/4036349659 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff64c0ffe70 msgr2=0x7ff64c197270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:21.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.613+0000 7ff651393700 1 --2- 172.21.15.83:0/4036349659 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff64c0ffe70 0x7ff64c197270 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7ff64000e9a0 tx=0x7ff64000ecb0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.613+0000 7ff651393700 1 -- 172.21.15.83:0/4036349659 shutdown_connections 2024-04-01T06:57:21.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.614+0000 7ff651393700 1 --2- 172.21.15.83:0/4036349659 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7ff6340a13b0 0x7ff6340a3870 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.614+0000 7ff651393700 1 --2- 172.21.15.83:0/4036349659 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff64c0ffe70 0x7ff64c197270 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.614+0000 7ff651393700 1 --2- 172.21.15.83:0/4036349659 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff64c19bb00 0x7ff64c19bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.614+0000 7ff651393700 1 --2- 172.21.15.83:0/4036349659 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff64c104f70 0x7ff64c1977b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.614+0000 7ff651393700 1 -- 172.21.15.83:0/4036349659 >> 172.21.15.83:0/4036349659 conn(0x7ff64c076d50 msgr2=0x7ff64c069690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:21.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.614+0000 7ff651393700 1 -- 172.21.15.83:0/4036349659 shutdown_connections 2024-04-01T06:57:21.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.614+0000 7ff651393700 1 -- 172.21.15.83:0/4036349659 wait complete. 2024-04-01T06:57:21.625 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-01T06:57:21.625 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-01T06:57:21.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.753+0000 7f14171d5700 1 -- 172.21.15.83:0/589039162 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1410101900 msgr2=0x7f1410105940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:21.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.753+0000 7f14171d5700 1 --2- 172.21.15.83:0/589039162 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1410101900 0x7f1410105940 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f140000b0a0 tx=0x7f140000b3b0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.753+0000 7f14171d5700 1 -- 172.21.15.83:0/589039162 shutdown_connections 2024-04-01T06:57:21.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.753+0000 7f14171d5700 1 --2- 172.21.15.83:0/589039162 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1410106070 0x7f141010dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.753+0000 7f14171d5700 1 --2- 172.21.15.83:0/589039162 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1410100f50 0x7f1410101330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.753+0000 7f14171d5700 1 --2- 172.21.15.83:0/589039162 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1410101900 0x7f1410105940 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.753+0000 7f14171d5700 1 -- 172.21.15.83:0/589039162 >> 172.21.15.83:0/589039162 conn(0x7f14100fc7f0 msgr2=0x7f14100fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:21.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.753+0000 7f14171d5700 1 -- 172.21.15.83:0/589039162 shutdown_connections 2024-04-01T06:57:21.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.753+0000 7f14171d5700 1 -- 172.21.15.83:0/589039162 wait complete. 2024-04-01T06:57:21.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.754+0000 7f14171d5700 1 Processor -- start 2024-04-01T06:57:21.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.754+0000 7f14171d5700 1 -- start start 2024-04-01T06:57:21.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.754+0000 7f14171d5700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1410100f50 0x7f1410197360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.754+0000 7f14171d5700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1410106070 0x7f14101978a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.754+0000 7f14171d5700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f141019bbf0 0x7f141019c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.754+0000 7f14171d5700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141019c670 con 0x7f141019bbf0 2024-04-01T06:57:21.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.754+0000 7f14171d5700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141019c7e0 con 0x7f1410106070 2024-04-01T06:57:21.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.754+0000 7f14171d5700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141019c9a0 con 0x7f1410100f50 2024-04-01T06:57:21.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.754+0000 7f1415772700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f141019bbf0 0x7f141019c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.754+0000 7f1415772700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f141019bbf0 0x7f141019c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55950/0 (socket says 172.21.15.83:55950) 2024-04-01T06:57:21.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.754+0000 7f1415772700 1 -- 172.21.15.83:0/595479454 learned_addr learned my addr 172.21.15.83:0/595479454 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:21.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.754+0000 7f1414f71700 1 --2- 172.21.15.83:0/595479454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1410100f50 0x7f1410197360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.755+0000 7f140ffff700 1 --2- 172.21.15.83:0/595479454 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1410106070 0x7f14101978a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.755+0000 7f1415772700 1 -- 172.21.15.83:0/595479454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1410100f50 msgr2=0x7f1410197360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:21.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.755+0000 7f1415772700 1 --2- 172.21.15.83:0/595479454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1410100f50 0x7f1410197360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.755+0000 7f1415772700 1 -- 172.21.15.83:0/595479454 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1410106070 msgr2=0x7f14101978a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:21.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.755+0000 7f1415772700 1 --2- 172.21.15.83:0/595479454 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1410106070 0x7f14101978a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.755+0000 7f1415772700 1 -- 172.21.15.83:0/595479454 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1400009d00 con 0x7f141019bbf0 2024-04-01T06:57:21.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.755+0000 7f1415772700 1 --2- 172.21.15.83:0/595479454 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f141019bbf0 0x7f141019c070 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f13f800e940 tx=0x7f13f800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:21.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.755+0000 7f140dffb700 1 -- 172.21.15.83:0/595479454 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f80097b0 con 0x7f141019bbf0 2024-04-01T06:57:21.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.755+0000 7f140dffb700 1 -- 172.21.15.83:0/595479454 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f13f8005020 con 0x7f141019bbf0 2024-04-01T06:57:21.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.755+0000 7f14171d5700 1 -- 172.21.15.83:0/595479454 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14101a3f00 con 0x7f141019bbf0 2024-04-01T06:57:21.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.755+0000 7f140dffb700 1 -- 172.21.15.83:0/595479454 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f800cc40 con 0x7f141019bbf0 2024-04-01T06:57:21.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.755+0000 7f14171d5700 1 -- 172.21.15.83:0/595479454 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14101a43e0 con 0x7f141019bbf0 2024-04-01T06:57:21.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.757+0000 7f140dffb700 1 -- 172.21.15.83:0/595479454 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) v1 ==== 136098+0+0 (secure 0 0 0) 0x7f13f8005400 con 0x7f141019bbf0 2024-04-01T06:57:21.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.758+0000 7f140dffb700 1 --2- 172.21.15.83:0/595479454 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f13fc0a1430 0x7f13fc0a38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.758+0000 7f1414f71700 1 --2- 172.21.15.83:0/595479454 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f13fc0a1430 0x7f13fc0a38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.758+0000 7f140dffb700 1 -- 172.21.15.83:0/595479454 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f13f8014070 con 0x7f141019bbf0 2024-04-01T06:57:21.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.758+0000 7f1414f71700 1 --2- 172.21.15.83:0/595479454 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f13fc0a1430 0x7f13fc0a38f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1408005950 tx=0x7f140800b410 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:21.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.759+0000 7f142336bb80 1 Processor -- start 2024-04-01T06:57:21.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.759+0000 7f142336bb80 1 -- start start 2024-04-01T06:57:21.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.759+0000 7f142336bb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558924a515d0 0x558924a519b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.759+0000 7f142336bb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558924a51ef0 0x558924a5c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.759+0000 7f142336bb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558924a5cdf0 0x558924a5f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.759+0000 7f142336bb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589249aa990 con 0x558924a515d0 2024-04-01T06:57:21.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.759+0000 7f142336bb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589249a8350 con 0x558924a5cdf0 2024-04-01T06:57:21.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.759+0000 7f142336bb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589249a3c40 con 0x558924a51ef0 2024-04-01T06:57:21.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.759+0000 7f1414f71700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558924a515d0 0x558924a519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.759+0000 7f1414f71700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558924a515d0 0x558924a519b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55956/0 (socket says 172.21.15.83:55956) 2024-04-01T06:57:21.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.759+0000 7f1414f71700 1 -- 172.21.15.83:0/3670608195 learned_addr learned my addr 172.21.15.83:0/3670608195 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:21.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.759+0000 7f1415772700 1 --2- 172.21.15.83:0/3670608195 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558924a5cdf0 0x558924a5f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.759+0000 7f1414f71700 1 -- 172.21.15.83:0/3670608195 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558924a51ef0 msgr2=0x558924a5c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:21.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.759+0000 7f140ffff700 1 --2- 172.21.15.83:0/3670608195 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558924a51ef0 0x558924a5c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.759+0000 7f1414f71700 1 --2- 172.21.15.83:0/3670608195 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558924a51ef0 0x558924a5c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.760+0000 7f1414f71700 1 -- 172.21.15.83:0/3670608195 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558924a5cdf0 msgr2=0x558924a5f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:21.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.760+0000 7f1414f71700 1 --2- 172.21.15.83:0/3670608195 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558924a5cdf0 0x558924a5f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.760+0000 7f1414f71700 1 -- 172.21.15.83:0/3670608195 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5589248253b0 con 0x558924a515d0 2024-04-01T06:57:21.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.760+0000 7f1414f71700 1 --2- 172.21.15.83:0/3670608195 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558924a515d0 0x558924a519b0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f1408010fa0 tx=0x7f1408013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3455a388f3711995 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:21.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.760+0000 7f1406ffd700 1 -- 172.21.15.83:0/3670608195 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1408011db0 con 0x558924a515d0 2024-04-01T06:57:21.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.760+0000 7f1406ffd700 1 -- 172.21.15.83:0/3670608195 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1408015070 con 0x558924a515d0 2024-04-01T06:57:21.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.760+0000 7f1406ffd700 1 -- 172.21.15.83:0/3670608195 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140801c610 con 0x558924a515d0 2024-04-01T06:57:21.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.761+0000 7f142336bb80 1 -- 172.21.15.83:0/3670608195 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558924a515d0 msgr2=0x558924a519b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:21.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.761+0000 7f142336bb80 1 --2- 172.21.15.83:0/3670608195 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558924a515d0 0x558924a519b0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f1408010fa0 tx=0x7f1408013000 comp rx=0 tx=0).stop 2024-04-01T06:57:21.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.761+0000 7f142336bb80 1 -- 172.21.15.83:0/3670608195 shutdown_connections 2024-04-01T06:57:21.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.761+0000 7f142336bb80 1 --2- 172.21.15.83:0/3670608195 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558924a515d0 0x558924a519b0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.761+0000 7f142336bb80 1 --2- 172.21.15.83:0/3670608195 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558924a5cdf0 0x558924a5f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.761+0000 7f142336bb80 1 --2- 172.21.15.83:0/3670608195 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558924a51ef0 0x558924a5c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.761+0000 7f142336bb80 1 -- 172.21.15.83:0/3670608195 >> 172.21.15.83:0/3670608195 conn(0x5589249b16a0 msgr2=0x558924a4da90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:21.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.761+0000 7f142336bb80 1 -- 172.21.15.83:0/3670608195 shutdown_connections 2024-04-01T06:57:21.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.761+0000 7f142336bb80 1 -- 172.21.15.83:0/3670608195 wait complete. 2024-04-01T06:57:21.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.761+0000 7f142336bb80 1 -- start start 2024-04-01T06:57:21.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.761+0000 7f142336bb80 1 Processor -- start 2024-04-01T06:57:21.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.761+0000 7f142336bb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558924a515d0 0x558924a5c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.761+0000 7f142336bb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558924a51ef0 0x558924a59ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.761+0000 7f142336bb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558924a5cdf0 0x558924a5a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.761+0000 7f142336bb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55892493fd80 con 0x558924a51ef0 2024-04-01T06:57:21.771 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.761+0000 7f142336bb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55892493fa20 con 0x558924a515d0 2024-04-01T06:57:21.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.761+0000 7f142336bb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589248276a0 con 0x558924a5cdf0 2024-04-01T06:57:21.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.762+0000 7f142336bb80 10 client.0 _ll_register_callbacks cb 0x558924949470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:57:21.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.762+0000 7f140ffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558924a51ef0 0x558924a59ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.762+0000 7f140ffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558924a51ef0 0x558924a59ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55962/0 (socket says 172.21.15.83:55962) 2024-04-01T06:57:21.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.762+0000 7f140ffff700 1 -- 172.21.15.83:0/3367014682 learned_addr learned my addr 172.21.15.83:0/3367014682 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:21.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.762+0000 7f1414f71700 1 --2- 172.21.15.83:0/3367014682 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558924a515d0 0x558924a5c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.762+0000 7f1415772700 1 --2- 172.21.15.83:0/3367014682 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558924a5cdf0 0x558924a5a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.762+0000 7f140ffff700 1 -- 172.21.15.83:0/3367014682 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558924a5cdf0 msgr2=0x558924a5a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:21.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.762+0000 7f140ffff700 1 --2- 172.21.15.83:0/3367014682 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558924a5cdf0 0x558924a5a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.762+0000 7f140ffff700 1 -- 172.21.15.83:0/3367014682 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558924a515d0 msgr2=0x558924a5c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:21.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.762+0000 7f140ffff700 1 --2- 172.21.15.83:0/3367014682 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558924a515d0 0x558924a5c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.772 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.762+0000 7f140ffff700 1 -- 172.21.15.83:0/3367014682 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1408010c50 con 0x558924a51ef0 2024-04-01T06:57:21.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.762+0000 7f140ffff700 1 --2- 172.21.15.83:0/3367014682 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558924a51ef0 0x558924a59ac0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f140000b0a0 tx=0x7f1400007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bf508dd785e46db server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:21.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.762+0000 7f13effff700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:57:21.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.762+0000 7f13effff700 1 -- 172.21.15.83:0/3367014682 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140000e070 con 0x558924a51ef0 2024-04-01T06:57:21.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.762+0000 7f13effff700 1 -- 172.21.15.83:0/3367014682 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f14000076e0 con 0x558924a51ef0 2024-04-01T06:57:21.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.762+0000 7f142336bb80 1 -- 172.21.15.83:0/3367014682 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558924964380 con 0x558924a51ef0 2024-04-01T06:57:21.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.762+0000 7f13effff700 1 -- 172.21.15.83:0/3367014682 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f14000078a0 con 0x558924a51ef0 2024-04-01T06:57:21.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.762+0000 7f142336bb80 10 client.15876 fetch_fsmap learned FSMap version 26 2024-04-01T06:57:21.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.762+0000 7f142336bb80 1 -- 172.21.15.83:0/3367014682 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5589247d1b60 con 0x558924a51ef0 2024-04-01T06:57:21.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.763+0000 7f13effff700 1 -- 172.21.15.83:0/3367014682 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558924964380 con 0x558924a51ef0 2024-04-01T06:57:21.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.763+0000 7f13effff700 1 -- 172.21.15.83:0/3367014682 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f140002b020 con 0x558924a51ef0 2024-04-01T06:57:21.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.763+0000 7f142336bb80 10 client.15876 fetch_fsmap finished waiting for FSMap version 26 2024-04-01T06:57:21.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.763+0000 7f142336bb80 10 client.15876 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-04-01T06:57:21.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.763+0000 7f142336bb80 20 client.15876 populate_metadata read hostname 'smithi083' 2024-04-01T06:57:21.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.763+0000 7f142336bb80 1 --2- 172.21.15.83:0/3367014682 >> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] conn(0x558924a6c8d0 0x558924a6ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.763+0000 7f142336bb80 4 client.15876 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-01T06:57:21.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.763+0000 7f142336bb80 1 -- 172.21.15.83:0/3367014682 --> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55892499c700 con 0x558924a6c8d0 2024-04-01T06:57:21.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.763+0000 7f1414f71700 1 --2- 172.21.15.83:0/3367014682 >> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] conn(0x558924a6c8d0 0x558924a6ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.763+0000 7f13effff700 10 client.15876 ms_handle_connect on v2:172.21.15.145:6836/2687798317 2024-04-01T06:57:21.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.763+0000 7f1414f71700 1 --2- 172.21.15.83:0/3367014682 >> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] conn(0x558924a6c8d0 0x558924a6ecf0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=88dcd1090ece5f88 server_cookie=48fa81f9c8ed9013 in_seq=0 out_seq=0 2024-04-01T06:57:21.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.764+0000 7f13effff700 1 -- 172.21.15.83:0/3367014682 <== mds.1 v2:172.21.15.145:6836/2687798317 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55892499c700 con 0x558924a6c8d0 2024-04-01T06:57:21.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.764+0000 7f13effff700 10 client.15876 handle_command_reply: tid=0 2024-04-01T06:57:21.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.764+0000 7f142336bb80 1 client.15876 shutdown 2024-04-01T06:57:21.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.764+0000 7f142336bb80 1 -- 172.21.15.83:0/3367014682 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558924a51ef0 msgr2=0x558924a59ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:21.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.764+0000 7f142336bb80 1 --2- 172.21.15.83:0/3367014682 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558924a51ef0 0x558924a59ac0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f140000b0a0 tx=0x7f1400007ec0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.764+0000 7f142336bb80 1 -- 172.21.15.83:0/3367014682 shutdown_connections 2024-04-01T06:57:21.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.764+0000 7f142336bb80 1 --2- 172.21.15.83:0/3367014682 >> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] conn(0x558924a6c8d0 0x558924a6ecf0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.764+0000 7f142336bb80 1 --2- 172.21.15.83:0/3367014682 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558924a5cdf0 0x558924a5a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.764+0000 7f13effff700 0 client.15876 ms_handle_reset on v2:172.21.15.145:6836/2687798317 2024-04-01T06:57:21.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.764+0000 7f142336bb80 1 --2- 172.21.15.83:0/3367014682 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558924a515d0 0x558924a5c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.764+0000 7f142336bb80 1 --2- 172.21.15.83:0/3367014682 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558924a51ef0 0x558924a59ac0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.764+0000 7f142336bb80 1 -- 172.21.15.83:0/3367014682 >> 172.21.15.83:0/3367014682 conn(0x5589249b16a0 msgr2=0x558924a536c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:21.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.764+0000 7f142336bb80 1 -- 172.21.15.83:0/3367014682 shutdown_connections 2024-04-01T06:57:21.775 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.764+0000 7f142336bb80 1 -- 172.21.15.83:0/3367014682 wait complete. 2024-04-01T06:57:21.776 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.764+0000 7f142336bb80 20 client.15876 trim_cache size 0 max 16384 2024-04-01T06:57:21.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.778+0000 7f142336bb80 1 Processor -- start 2024-04-01T06:57:21.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.778+0000 7f142336bb80 1 -- start start 2024-04-01T06:57:21.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.778+0000 7f142336bb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558924a515d0 0x558924a49480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.778+0000 7f142336bb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558924a51ef0 0x558924a63a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.778+0000 7f142336bb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558924a5cdf0 0x558924a5c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.778+0000 7f142336bb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x558924a52850 con 0x558924a51ef0 2024-04-01T06:57:21.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.778+0000 7f142336bb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x558924a54570 con 0x558924a5cdf0 2024-04-01T06:57:21.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.778+0000 7f142336bb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x558924a4f340 con 0x558924a515d0 2024-04-01T06:57:21.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.778+0000 7f140ffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558924a51ef0 0x558924a63a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.778+0000 7f140ffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558924a51ef0 0x558924a63a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55964/0 (socket says 172.21.15.83:55964) 2024-04-01T06:57:21.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.778+0000 7f140ffff700 1 -- 172.21.15.83:0/106392432 learned_addr learned my addr 172.21.15.83:0/106392432 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:21.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.778+0000 7f1414f71700 1 --2- 172.21.15.83:0/106392432 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558924a515d0 0x558924a49480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.778+0000 7f1415772700 1 --2- 172.21.15.83:0/106392432 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558924a5cdf0 0x558924a5c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.778+0000 7f140ffff700 1 -- 172.21.15.83:0/106392432 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558924a515d0 msgr2=0x558924a49480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:21.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.778+0000 7f140ffff700 1 --2- 172.21.15.83:0/106392432 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558924a515d0 0x558924a49480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.778+0000 7f140ffff700 1 -- 172.21.15.83:0/106392432 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558924a5cdf0 msgr2=0x558924a5c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:21.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.778+0000 7f140ffff700 1 --2- 172.21.15.83:0/106392432 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558924a5cdf0 0x558924a5c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.778+0000 7f140ffff700 1 -- 172.21.15.83:0/106392432 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558924969ea0 con 0x558924a51ef0 2024-04-01T06:57:21.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.778+0000 7f140ffff700 1 --2- 172.21.15.83:0/106392432 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558924a51ef0 0x558924a63a70 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f1400009a20 tx=0x7f1400005b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=444f12a3b5665a6d server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:21.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.779+0000 7f14077fe700 1 -- 172.21.15.83:0/106392432 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140000e070 con 0x558924a51ef0 2024-04-01T06:57:21.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.779+0000 7f14077fe700 1 -- 172.21.15.83:0/106392432 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1400006140 con 0x558924a51ef0 2024-04-01T06:57:21.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.779+0000 7f14077fe700 1 -- 172.21.15.83:0/106392432 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1400005240 con 0x558924a51ef0 2024-04-01T06:57:21.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.779+0000 7f142336bb80 1 -- 172.21.15.83:0/106392432 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558924a51ef0 msgr2=0x558924a63a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:21.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.779+0000 7f142336bb80 1 --2- 172.21.15.83:0/106392432 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558924a51ef0 0x558924a63a70 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f1400009a20 tx=0x7f1400005b70 comp rx=0 tx=0).stop 2024-04-01T06:57:21.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.780+0000 7f142336bb80 1 -- 172.21.15.83:0/106392432 shutdown_connections 2024-04-01T06:57:21.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.780+0000 7f142336bb80 1 --2- 172.21.15.83:0/106392432 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558924a5cdf0 0x558924a5c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.780+0000 7f142336bb80 1 --2- 172.21.15.83:0/106392432 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558924a515d0 0x558924a49480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.780+0000 7f142336bb80 1 --2- 172.21.15.83:0/106392432 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558924a51ef0 0x558924a63a70 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.780+0000 7f142336bb80 1 -- 172.21.15.83:0/106392432 >> 172.21.15.83:0/106392432 conn(0x5589249b16a0 msgr2=0x558924a465a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:21.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.780+0000 7f142336bb80 1 -- 172.21.15.83:0/106392432 shutdown_connections 2024-04-01T06:57:21.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.780+0000 7f142336bb80 1 -- 172.21.15.83:0/106392432 wait complete. 2024-04-01T06:57:21.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.780+0000 7f142336bb80 1 -- start start 2024-04-01T06:57:21.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.780+0000 7f142336bb80 1 Processor -- start 2024-04-01T06:57:21.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.781+0000 7f142336bb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558924a515d0 0x558924a63490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.781+0000 7f142336bb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558924a51ef0 0x558924a639d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.781+0000 7f142336bb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558924a5cdf0 0x558924a61a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.781+0000 7f142336bb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x558924a62160 con 0x558924a515d0 2024-04-01T06:57:21.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.781+0000 7f142336bb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x558924a622d0 con 0x558924a5cdf0 2024-04-01T06:57:21.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.781+0000 7f142336bb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x558924a62490 con 0x558924a51ef0 2024-04-01T06:57:21.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.781+0000 7f142336bb80 10 client.0 _ll_register_callbacks cb 0x558924949470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:57:21.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.781+0000 7f1414f71700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558924a515d0 0x558924a63490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.781+0000 7f1414f71700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558924a515d0 0x558924a63490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55970/0 (socket says 172.21.15.83:55970) 2024-04-01T06:57:21.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.781+0000 7f1414f71700 1 -- 172.21.15.83:0/3668254840 learned_addr learned my addr 172.21.15.83:0/3668254840 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:21.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.781+0000 7f140ffff700 1 --2- 172.21.15.83:0/3668254840 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558924a51ef0 0x558924a639d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.781+0000 7f1415772700 1 --2- 172.21.15.83:0/3668254840 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558924a5cdf0 0x558924a61a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.781+0000 7f1414f71700 1 -- 172.21.15.83:0/3668254840 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558924a51ef0 msgr2=0x558924a639d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:21.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.781+0000 7f1414f71700 1 --2- 172.21.15.83:0/3668254840 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558924a51ef0 0x558924a639d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.781+0000 7f1414f71700 1 -- 172.21.15.83:0/3668254840 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558924a5cdf0 msgr2=0x558924a61a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:21.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.781+0000 7f1414f71700 1 --2- 172.21.15.83:0/3668254840 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558924a5cdf0 0x558924a61a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.781+0000 7f1414f71700 1 -- 172.21.15.83:0/3668254840 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5589247d1b60 con 0x558924a515d0 2024-04-01T06:57:21.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.781+0000 7f1414f71700 1 --2- 172.21.15.83:0/3668254840 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558924a515d0 0x558924a63490 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f1408000c00 tx=0x7f1408010fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e889d143be15396 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:21.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.781+0000 7f13effff700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:57:21.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.783+0000 7f13effff700 1 -- 172.21.15.83:0/3668254840 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140802c040 con 0x558924a515d0 2024-04-01T06:57:21.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.783+0000 7f142336bb80 1 -- 172.21.15.83:0/3668254840 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1408015070 con 0x558924a515d0 2024-04-01T06:57:21.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.783+0000 7f13effff700 1 -- 172.21.15.83:0/3668254840 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f1408017070 con 0x558924a515d0 2024-04-01T06:57:21.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.783+0000 7f13effff700 1 -- 172.21.15.83:0/3668254840 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1408035e70 con 0x558924a515d0 2024-04-01T06:57:21.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.783+0000 7f142336bb80 10 client.15882 fetch_fsmap learned FSMap version 26 2024-04-01T06:57:21.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.783+0000 7f142336bb80 1 -- 172.21.15.83:0/3668254840 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x558924829cd0 con 0x558924a515d0 2024-04-01T06:57:21.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.784+0000 7f13effff700 1 -- 172.21.15.83:0/3668254840 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1408015070 con 0x558924a515d0 2024-04-01T06:57:21.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.784+0000 7f13effff700 1 -- 172.21.15.83:0/3668254840 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f140801e950 con 0x558924a515d0 2024-04-01T06:57:21.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.784+0000 7f142336bb80 10 client.15882 fetch_fsmap finished waiting for FSMap version 26 2024-04-01T06:57:21.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.784+0000 7f142336bb80 10 client.15882 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-04-01T06:57:21.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.784+0000 7f142336bb80 20 client.15882 populate_metadata read hostname 'smithi083' 2024-04-01T06:57:21.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.784+0000 7f142336bb80 1 --2- 172.21.15.83:0/3668254840 >> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] conn(0x558924a6c8d0 0x558924ac3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.784+0000 7f142336bb80 4 client.15882 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-01T06:57:21.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.784+0000 7f142336bb80 1 -- 172.21.15.83:0/3668254840 --> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5589247f2cf0 con 0x558924a6c8d0 2024-04-01T06:57:21.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.784+0000 7f140ffff700 1 --2- 172.21.15.83:0/3668254840 >> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] conn(0x558924a6c8d0 0x558924ac3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.784+0000 7f140ffff700 1 --2- 172.21.15.83:0/3668254840 >> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] conn(0x558924a6c8d0 0x558924ac3780 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8c7d74d1cf0d965b server_cookie=9d9a4259fe8da938 in_seq=0 out_seq=0 2024-04-01T06:57:21.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.784+0000 7f13effff700 10 client.15882 ms_handle_connect on v2:172.21.15.145:6836/2687798317 2024-04-01T06:57:21.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.785+0000 7f13effff700 1 -- 172.21.15.83:0/3668254840 <== mds.1 v2:172.21.15.145:6836/2687798317 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5589247f2cf0 con 0x558924a6c8d0 2024-04-01T06:57:21.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.785+0000 7f13effff700 10 client.15882 handle_command_reply: tid=0 2024-04-01T06:57:21.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.785+0000 7f142336bb80 1 client.15882 shutdown 2024-04-01T06:57:21.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.785+0000 7f142336bb80 1 -- 172.21.15.83:0/3668254840 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558924a515d0 msgr2=0x558924a63490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:21.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.785+0000 7f142336bb80 1 --2- 172.21.15.83:0/3668254840 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558924a515d0 0x558924a63490 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f1408000c00 tx=0x7f1408010fd0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.785+0000 7f142336bb80 1 -- 172.21.15.83:0/3668254840 shutdown_connections 2024-04-01T06:57:21.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.785+0000 7f142336bb80 1 --2- 172.21.15.83:0/3668254840 >> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] conn(0x558924a6c8d0 0x558924ac3780 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.785+0000 7f142336bb80 1 --2- 172.21.15.83:0/3668254840 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x558924a515d0 0x558924a63490 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.785+0000 7f142336bb80 1 --2- 172.21.15.83:0/3668254840 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558924a5cdf0 0x558924a61a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.785+0000 7f13effff700 0 client.15882 ms_handle_reset on v2:172.21.15.145:6836/2687798317 2024-04-01T06:57:21.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.785+0000 7f142336bb80 1 --2- 172.21.15.83:0/3668254840 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558924a51ef0 0x558924a639d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.785+0000 7f142336bb80 1 -- 172.21.15.83:0/3668254840 >> 172.21.15.83:0/3668254840 conn(0x5589249b16a0 msgr2=0x558924a58330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:21.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.785+0000 7f142336bb80 1 -- 172.21.15.83:0/3668254840 shutdown_connections 2024-04-01T06:57:21.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.785+0000 7f142336bb80 1 -- 172.21.15.83:0/3668254840 wait complete. 2024-04-01T06:57:21.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.785+0000 7f142336bb80 20 client.15882 trim_cache size 0 max 16384 2024-04-01T06:57:21.793 INFO:teuthology.orchestra.run.smithi083.stdout:[] 2024-04-01T06:57:21.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.786+0000 7f14171d5700 1 -- 172.21.15.83:0/595479454 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f13fc0a1430 msgr2=0x7f13fc0a38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:21.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.786+0000 7f14171d5700 1 --2- 172.21.15.83:0/595479454 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f13fc0a1430 0x7f13fc0a38f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1408005950 tx=0x7f140800b410 comp rx=0 tx=0).stop 2024-04-01T06:57:21.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.786+0000 7f14171d5700 1 -- 172.21.15.83:0/595479454 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f141019bbf0 msgr2=0x7f141019c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:21.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.786+0000 7f14171d5700 1 --2- 172.21.15.83:0/595479454 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f141019bbf0 0x7f141019c070 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f13f800e940 tx=0x7f13f800ec50 comp rx=0 tx=0).stop 2024-04-01T06:57:21.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.786+0000 7f14171d5700 1 -- 172.21.15.83:0/595479454 shutdown_connections 2024-04-01T06:57:21.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.786+0000 7f14171d5700 1 --2- 172.21.15.83:0/595479454 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f13fc0a1430 0x7f13fc0a38f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.786+0000 7f14171d5700 1 --2- 172.21.15.83:0/595479454 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f141019bbf0 0x7f141019c070 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.786+0000 7f14171d5700 1 --2- 172.21.15.83:0/595479454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1410100f50 0x7f1410197360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.786+0000 7f14171d5700 1 --2- 172.21.15.83:0/595479454 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1410106070 0x7f14101978a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.786+0000 7f14171d5700 1 -- 172.21.15.83:0/595479454 >> 172.21.15.83:0/595479454 conn(0x7f14100fc7f0 msgr2=0x7f14100fdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:21.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.786+0000 7f14171d5700 1 -- 172.21.15.83:0/595479454 shutdown_connections 2024-04-01T06:57:21.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.786+0000 7f14171d5700 1 -- 172.21.15.83:0/595479454 wait complete. 2024-04-01T06:57:21.798 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-01T06:57:21.798 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-01T06:57:21.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.931+0000 7fc9298c2700 1 -- 172.21.15.83:0/1824242380 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9240ffe50 msgr2=0x7fc924100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:21.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.931+0000 7fc9298c2700 1 --2- 172.21.15.83:0/1824242380 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9240ffe50 0x7fc924100230 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fc91400b0a0 tx=0x7fc91400b3b0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.931+0000 7fc9298c2700 1 -- 172.21.15.83:0/1824242380 shutdown_connections 2024-04-01T06:57:21.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.931+0000 7fc9298c2700 1 --2- 172.21.15.83:0/1824242380 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc9240ffe50 0x7fc924100230 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.931+0000 7fc9298c2700 1 --2- 172.21.15.83:0/1824242380 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc924104f60 0x7fc92410cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.931+0000 7fc9298c2700 1 --2- 172.21.15.83:0/1824242380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc924100800 0x7fc924104830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.931+0000 7fc9298c2700 1 -- 172.21.15.83:0/1824242380 >> 172.21.15.83:0/1824242380 conn(0x7fc924076d40 msgr2=0x7fc924077150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:21.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.931+0000 7fc9298c2700 1 -- 172.21.15.83:0/1824242380 shutdown_connections 2024-04-01T06:57:21.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.931+0000 7fc9298c2700 1 -- 172.21.15.83:0/1824242380 wait complete. 2024-04-01T06:57:21.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.931+0000 7fc9298c2700 1 Processor -- start 2024-04-01T06:57:21.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.932+0000 7fc9298c2700 1 -- start start 2024-04-01T06:57:21.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.932+0000 7fc9298c2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9240ffe50 0x7fc92410d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.932+0000 7fc9298c2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc924104f60 0x7fc92410d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.932+0000 7fc9298c2700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc92410dea0 0x7fc9241a5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.932+0000 7fc9298c2700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9241a5b40 con 0x7fc924104f60 2024-04-01T06:57:21.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.932+0000 7fc9298c2700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9241a5c80 con 0x7fc92410dea0 2024-04-01T06:57:21.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.932+0000 7fc9298c2700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9241a5e40 con 0x7fc9240ffe50 2024-04-01T06:57:21.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.932+0000 7fc9227fc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc924104f60 0x7fc92410d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.932+0000 7fc9227fc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc924104f60 0x7fc92410d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55992/0 (socket says 172.21.15.83:55992) 2024-04-01T06:57:21.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.932+0000 7fc9227fc700 1 -- 172.21.15.83:0/1553188451 learned_addr learned my addr 172.21.15.83:0/1553188451 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:21.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.932+0000 7fc9237fe700 1 --2- 172.21.15.83:0/1553188451 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc92410dea0 0x7fc9241a5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.932+0000 7fc922ffd700 1 --2- 172.21.15.83:0/1553188451 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9240ffe50 0x7fc92410d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.932+0000 7fc9227fc700 1 -- 172.21.15.83:0/1553188451 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9240ffe50 msgr2=0x7fc92410d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:21.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.932+0000 7fc9227fc700 1 --2- 172.21.15.83:0/1553188451 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9240ffe50 0x7fc92410d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.932+0000 7fc9227fc700 1 -- 172.21.15.83:0/1553188451 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc92410dea0 msgr2=0x7fc9241a5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:21.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.932+0000 7fc9227fc700 1 --2- 172.21.15.83:0/1553188451 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc92410dea0 0x7fc9241a5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.932+0000 7fc9227fc700 1 -- 172.21.15.83:0/1553188451 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc914009d00 con 0x7fc924104f60 2024-04-01T06:57:21.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.932+0000 7fc9227fc700 1 --2- 172.21.15.83:0/1553188451 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc924104f60 0x7fc92410d960 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fc91800d950 tx=0x7fc91800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:21.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.933+0000 7fc9288c0700 1 -- 172.21.15.83:0/1553188451 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc918004220 con 0x7fc924104f60 2024-04-01T06:57:21.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.933+0000 7fc9298c2700 1 -- 172.21.15.83:0/1553188451 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9241a6120 con 0x7fc924104f60 2024-04-01T06:57:21.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.933+0000 7fc9288c0700 1 -- 172.21.15.83:0/1553188451 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc918007620 con 0x7fc924104f60 2024-04-01T06:57:21.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.933+0000 7fc9288c0700 1 -- 172.21.15.83:0/1553188451 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc918005670 con 0x7fc924104f60 2024-04-01T06:57:21.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.933+0000 7fc9298c2700 1 -- 172.21.15.83:0/1553188451 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9241a6630 con 0x7fc924104f60 2024-04-01T06:57:21.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.935+0000 7fc9288c0700 1 -- 172.21.15.83:0/1553188451 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) v1 ==== 136098+0+0 (secure 0 0 0) 0x7fc918003680 con 0x7fc924104f60 2024-04-01T06:57:21.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.935+0000 7fc9288c0700 1 --2- 172.21.15.83:0/1553188451 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fc90c0a13b0 0x7fc90c0a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.936+0000 7fc9288c0700 1 -- 172.21.15.83:0/1553188451 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7fc9180ccc50 con 0x7fc924104f60 2024-04-01T06:57:21.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.936+0000 7fc922ffd700 1 --2- 172.21.15.83:0/1553188451 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fc90c0a13b0 0x7fc90c0a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.936+0000 7fc922ffd700 1 --2- 172.21.15.83:0/1553188451 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fc90c0a13b0 0x7fc90c0a3870 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc9140062a0 tx=0x7fc914006210 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:21.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.936+0000 7fc935a58b80 1 Processor -- start 2024-04-01T06:57:21.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.936+0000 7fc935a58b80 1 -- start start 2024-04-01T06:57:21.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.936+0000 7fc935a58b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e666de85d0 0x55e666de89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.936+0000 7fc935a58b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e666de8ef0 0x55e666df38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.936+0000 7fc935a58b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e666df3df0 0x55e666df61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.936+0000 7fc935a58b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e666d41990 con 0x55e666df3df0 2024-04-01T06:57:21.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.936+0000 7fc935a58b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e666d3f350 con 0x55e666de85d0 2024-04-01T06:57:21.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.936+0000 7fc935a58b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e666d3ac40 con 0x55e666de8ef0 2024-04-01T06:57:21.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.936+0000 7fc9237fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e666df3df0 0x55e666df61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.936+0000 7fc922ffd700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e666de85d0 0x55e666de89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.936+0000 7fc9237fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e666df3df0 0x55e666df61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55998/0 (socket says 172.21.15.83:55998) 2024-04-01T06:57:21.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.936+0000 7fc9237fe700 1 -- 172.21.15.83:0/1524386234 learned_addr learned my addr 172.21.15.83:0/1524386234 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:21.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.936+0000 7fc9227fc700 1 --2- 172.21.15.83:0/1524386234 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e666de8ef0 0x55e666df38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.937+0000 7fc922ffd700 1 -- 172.21.15.83:0/1524386234 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e666de8ef0 msgr2=0x55e666df38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:21.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.937+0000 7fc922ffd700 1 --2- 172.21.15.83:0/1524386234 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e666de8ef0 0x55e666df38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.937+0000 7fc922ffd700 1 -- 172.21.15.83:0/1524386234 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e666df3df0 msgr2=0x55e666df61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:21.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.937+0000 7fc922ffd700 1 --2- 172.21.15.83:0/1524386234 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e666df3df0 0x55e666df61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.937+0000 7fc922ffd700 1 -- 172.21.15.83:0/1524386234 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e666bbc3b0 con 0x55e666de85d0 2024-04-01T06:57:21.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.937+0000 7fc9237fe700 1 --2- 172.21.15.83:0/1524386234 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e666df3df0 0x55e666df61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T06:57:21.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.937+0000 7fc922ffd700 1 --2- 172.21.15.83:0/1524386234 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e666de85d0 0x55e666de89b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc91400b070 tx=0x7fc91401c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a53f470925ca3dd server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:21.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.937+0000 7fc909ffb700 1 -- 172.21.15.83:0/1524386234 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc914023040 con 0x55e666de85d0 2024-04-01T06:57:21.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.937+0000 7fc909ffb700 1 -- 172.21.15.83:0/1524386234 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc914007e10 con 0x55e666de85d0 2024-04-01T06:57:21.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.937+0000 7fc909ffb700 1 -- 172.21.15.83:0/1524386234 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91400e040 con 0x55e666de85d0 2024-04-01T06:57:21.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.938+0000 7fc935a58b80 1 -- 172.21.15.83:0/1524386234 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e666de85d0 msgr2=0x55e666de89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:21.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.938+0000 7fc935a58b80 1 --2- 172.21.15.83:0/1524386234 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e666de85d0 0x55e666de89b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc91400b070 tx=0x7fc91401c000 comp rx=0 tx=0).stop 2024-04-01T06:57:21.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.938+0000 7fc935a58b80 1 -- 172.21.15.83:0/1524386234 shutdown_connections 2024-04-01T06:57:21.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.938+0000 7fc935a58b80 1 --2- 172.21.15.83:0/1524386234 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e666df3df0 0x55e666df61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.938+0000 7fc935a58b80 1 --2- 172.21.15.83:0/1524386234 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e666de85d0 0x55e666de89b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.938+0000 7fc935a58b80 1 --2- 172.21.15.83:0/1524386234 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e666de8ef0 0x55e666df38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.938+0000 7fc935a58b80 1 -- 172.21.15.83:0/1524386234 >> 172.21.15.83:0/1524386234 conn(0x55e666d486a0 msgr2=0x55e666de4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:21.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.938+0000 7fc935a58b80 1 -- 172.21.15.83:0/1524386234 shutdown_connections 2024-04-01T06:57:21.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.938+0000 7fc935a58b80 1 -- 172.21.15.83:0/1524386234 wait complete. 2024-04-01T06:57:21.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.938+0000 7fc935a58b80 1 -- start start 2024-04-01T06:57:21.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.939+0000 7fc935a58b80 1 Processor -- start 2024-04-01T06:57:21.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.939+0000 7fc935a58b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e666de85d0 0x55e666df3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.939+0000 7fc935a58b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e666de8ef0 0x55e666df0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.939+0000 7fc935a58b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e666df3df0 0x55e666df1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.939+0000 7fc935a58b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e666cd6d80 con 0x55e666df3df0 2024-04-01T06:57:21.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.939+0000 7fc935a58b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e666cd6a20 con 0x55e666de85d0 2024-04-01T06:57:21.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.939+0000 7fc935a58b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e666bbe6a0 con 0x55e666de8ef0 2024-04-01T06:57:21.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.939+0000 7fc9237fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e666df3df0 0x55e666df1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.939+0000 7fc935a58b80 10 client.0 _ll_register_callbacks cb 0x55e666ce0470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:57:21.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.939+0000 7fc9237fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e666df3df0 0x55e666df1120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:56014/0 (socket says 172.21.15.83:56014) 2024-04-01T06:57:21.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.939+0000 7fc9237fe700 1 -- 172.21.15.83:0/2056454793 learned_addr learned my addr 172.21.15.83:0/2056454793 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:21.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.939+0000 7fc922ffd700 1 --2- 172.21.15.83:0/2056454793 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e666de85d0 0x55e666df3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.939+0000 7fc9227fc700 1 --2- 172.21.15.83:0/2056454793 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e666de8ef0 0x55e666df0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.939+0000 7fc9237fe700 1 -- 172.21.15.83:0/2056454793 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e666de8ef0 msgr2=0x55e666df0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:21.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.939+0000 7fc9237fe700 1 --2- 172.21.15.83:0/2056454793 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e666de8ef0 0x55e666df0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.939+0000 7fc9237fe700 1 -- 172.21.15.83:0/2056454793 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e666de85d0 msgr2=0x55e666df3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:21.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.939+0000 7fc9237fe700 1 --2- 172.21.15.83:0/2056454793 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e666de85d0 0x55e666df3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.939+0000 7fc9237fe700 1 -- 172.21.15.83:0/2056454793 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc91c009960 con 0x55e666df3df0 2024-04-01T06:57:21.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.940+0000 7fc9237fe700 1 --2- 172.21.15.83:0/2056454793 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e666df3df0 0x55e666df1120 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fc91c011d00 tx=0x7fc91c011d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfe878c40f029a68 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:21.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.940+0000 7fc902ffd700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:57:21.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.940+0000 7fc902ffd700 1 -- 172.21.15.83:0/2056454793 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91c016070 con 0x55e666df3df0 2024-04-01T06:57:21.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.940+0000 7fc935a58b80 1 -- 172.21.15.83:0/2056454793 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e666cfb380 con 0x55e666df3df0 2024-04-01T06:57:21.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.940+0000 7fc902ffd700 1 -- 172.21.15.83:0/2056454793 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7fc91c004320 con 0x55e666df3df0 2024-04-01T06:57:21.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.940+0000 7fc902ffd700 1 -- 172.21.15.83:0/2056454793 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc91c0044e0 con 0x55e666df3df0 2024-04-01T06:57:21.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.940+0000 7fc935a58b80 10 client.15894 fetch_fsmap learned FSMap version 26 2024-04-01T06:57:21.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.940+0000 7fc935a58b80 1 -- 172.21.15.83:0/2056454793 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7fc924067df0 con 0x55e666df3df0 2024-04-01T06:57:21.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.940+0000 7fc902ffd700 1 -- 172.21.15.83:0/2056454793 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e666cfb380 con 0x55e666df3df0 2024-04-01T06:57:21.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.940+0000 7fc902ffd700 1 -- 172.21.15.83:0/2056454793 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fc91c003ac0 con 0x55e666df3df0 2024-04-01T06:57:21.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.940+0000 7fc935a58b80 10 client.15894 fetch_fsmap finished waiting for FSMap version 26 2024-04-01T06:57:21.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.940+0000 7fc935a58b80 10 client.15894 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-01T06:57:21.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.940+0000 7fc935a58b80 20 client.15894 populate_metadata read hostname 'smithi083' 2024-04-01T06:57:21.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.940+0000 7fc935a58b80 1 --2- 172.21.15.83:0/2056454793 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55e666e039c0 0x55e666e05de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.940+0000 7fc935a58b80 4 client.15894 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-01T06:57:21.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.940+0000 7fc935a58b80 1 -- 172.21.15.83:0/2056454793 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e666d33700 con 0x55e666e039c0 2024-04-01T06:57:21.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.940+0000 7fc922ffd700 1 --2- 172.21.15.83:0/2056454793 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55e666e039c0 0x55e666e05de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.941+0000 7fc902ffd700 10 client.15894 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:57:21.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.941+0000 7fc922ffd700 1 --2- 172.21.15.83:0/2056454793 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55e666e039c0 0x55e666e05de0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f6d2d9373e30f9e server_cookie=a48412e223d9d145 in_seq=0 out_seq=0 2024-04-01T06:57:21.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.942+0000 7fc902ffd700 1 -- 172.21.15.83:0/2056454793 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e666d33700 con 0x55e666e039c0 2024-04-01T06:57:21.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.942+0000 7fc902ffd700 10 client.15894 handle_command_reply: tid=0 2024-04-01T06:57:21.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.942+0000 7fc935a58b80 1 client.15894 shutdown 2024-04-01T06:57:21.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.942+0000 7fc935a58b80 1 -- 172.21.15.83:0/2056454793 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e666df3df0 msgr2=0x55e666df1120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:21.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.942+0000 7fc935a58b80 1 --2- 172.21.15.83:0/2056454793 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e666df3df0 0x55e666df1120 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fc91c011d00 tx=0x7fc91c011d30 comp rx=0 tx=0).stop 2024-04-01T06:57:21.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.942+0000 7fc935a58b80 1 -- 172.21.15.83:0/2056454793 shutdown_connections 2024-04-01T06:57:21.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.942+0000 7fc935a58b80 1 --2- 172.21.15.83:0/2056454793 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55e666e039c0 0x55e666e05de0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.942+0000 7fc935a58b80 1 --2- 172.21.15.83:0/2056454793 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e666df3df0 0x55e666df1120 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.942+0000 7fc935a58b80 1 --2- 172.21.15.83:0/2056454793 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e666de85d0 0x55e666df3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.942+0000 7fc935a58b80 1 --2- 172.21.15.83:0/2056454793 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e666de8ef0 0x55e666df0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.942+0000 7fc935a58b80 1 -- 172.21.15.83:0/2056454793 >> 172.21.15.83:0/2056454793 conn(0x55e666d486a0 msgr2=0x55e666dea530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:21.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.942+0000 7fc902ffd700 0 client.15894 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:57:21.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.942+0000 7fc935a58b80 1 -- 172.21.15.83:0/2056454793 shutdown_connections 2024-04-01T06:57:21.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.942+0000 7fc935a58b80 1 -- 172.21.15.83:0/2056454793 wait complete. 2024-04-01T06:57:21.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.942+0000 7fc935a58b80 20 client.15894 trim_cache size 0 max 16384 2024-04-01T06:57:21.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.956+0000 7fc935a58b80 1 Processor -- start 2024-04-01T06:57:21.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.956+0000 7fc935a58b80 1 -- start start 2024-04-01T06:57:21.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.956+0000 7fc935a58b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e666de85d0 0x55e666df1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.956+0000 7fc935a58b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e666de8ef0 0x55e666dfaa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.956+0000 7fc935a58b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e666df3df0 0x55e666def3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.956+0000 7fc935a58b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e666de9f60 con 0x55e666df3df0 2024-04-01T06:57:21.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.956+0000 7fc935a58b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e666deb970 con 0x55e666de8ef0 2024-04-01T06:57:21.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.956+0000 7fc935a58b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e666dfaf50 con 0x55e666de85d0 2024-04-01T06:57:21.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.956+0000 7fc9237fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e666df3df0 0x55e666def3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.956+0000 7fc9237fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e666df3df0 0x55e666def3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:56026/0 (socket says 172.21.15.83:56026) 2024-04-01T06:57:21.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.956+0000 7fc9227fc700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e666de8ef0 0x55e666dfaa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.956+0000 7fc9237fe700 1 -- 172.21.15.83:0/2432297570 learned_addr learned my addr 172.21.15.83:0/2432297570 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:21.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.957+0000 7fc922ffd700 1 --2- 172.21.15.83:0/2432297570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e666de85d0 0x55e666df1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.957+0000 7fc9237fe700 1 -- 172.21.15.83:0/2432297570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e666de85d0 msgr2=0x55e666df1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:21.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.957+0000 7fc9237fe700 1 --2- 172.21.15.83:0/2432297570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e666de85d0 0x55e666df1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.957+0000 7fc9237fe700 1 -- 172.21.15.83:0/2432297570 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e666de8ef0 msgr2=0x55e666dfaa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:21.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.957+0000 7fc9237fe700 1 --2- 172.21.15.83:0/2432297570 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e666de8ef0 0x55e666dfaa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.957+0000 7fc9237fe700 1 -- 172.21.15.83:0/2432297570 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e666b68b60 con 0x55e666df3df0 2024-04-01T06:57:21.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.957+0000 7fc9227fc700 1 --2- 172.21.15.83:0/2432297570 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e666de8ef0 0x55e666dfaa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T06:57:21.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.957+0000 7fc9237fe700 1 --2- 172.21.15.83:0/2432297570 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e666df3df0 0x55e666def3c0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fc91c005c50 tx=0x7fc91c0096b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ce80194d3e17c70 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:21.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.957+0000 7fc90a7fc700 1 -- 172.21.15.83:0/2432297570 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91c016040 con 0x55e666df3df0 2024-04-01T06:57:21.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.957+0000 7fc90a7fc700 1 -- 172.21.15.83:0/2432297570 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc91c019430 con 0x55e666df3df0 2024-04-01T06:57:21.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.957+0000 7fc90a7fc700 1 -- 172.21.15.83:0/2432297570 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91c00fa10 con 0x55e666df3df0 2024-04-01T06:57:21.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.958+0000 7fc935a58b80 1 -- 172.21.15.83:0/2432297570 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e666df3df0 msgr2=0x55e666def3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:21.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.958+0000 7fc935a58b80 1 --2- 172.21.15.83:0/2432297570 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e666df3df0 0x55e666def3c0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fc91c005c50 tx=0x7fc91c0096b0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.958+0000 7fc935a58b80 1 -- 172.21.15.83:0/2432297570 shutdown_connections 2024-04-01T06:57:21.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.958+0000 7fc935a58b80 1 --2- 172.21.15.83:0/2432297570 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e666df3df0 0x55e666def3c0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.958+0000 7fc935a58b80 1 --2- 172.21.15.83:0/2432297570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e666de85d0 0x55e666df1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.958+0000 7fc935a58b80 1 --2- 172.21.15.83:0/2432297570 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e666de8ef0 0x55e666dfaa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.958+0000 7fc935a58b80 1 -- 172.21.15.83:0/2432297570 >> 172.21.15.83:0/2432297570 conn(0x55e666d486a0 msgr2=0x55e666debe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:21.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.958+0000 7fc935a58b80 1 -- 172.21.15.83:0/2432297570 shutdown_connections 2024-04-01T06:57:21.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.958+0000 7fc935a58b80 1 -- 172.21.15.83:0/2432297570 wait complete. 2024-04-01T06:57:21.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.958+0000 7fc935a58b80 1 -- start start 2024-04-01T06:57:21.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.958+0000 7fc935a58b80 1 Processor -- start 2024-04-01T06:57:21.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.959+0000 7fc935a58b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e666de85d0 0x55e666df8380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.959+0000 7fc935a58b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e666de8ef0 0x55e666df88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.959+0000 7fc935a58b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e666df3df0 0x55e666e567b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.959+0000 7fc935a58b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e666df9060 con 0x55e666de8ef0 2024-04-01T06:57:21.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.959+0000 7fc935a58b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e666df91d0 con 0x55e666de85d0 2024-04-01T06:57:21.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.959+0000 7fc935a58b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e666e56cf0 con 0x55e666df3df0 2024-04-01T06:57:21.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.959+0000 7fc935a58b80 10 client.0 _ll_register_callbacks cb 0x55e666ce0470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:57:21.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.959+0000 7fc9227fc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e666de8ef0 0x55e666df88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.959+0000 7fc9227fc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e666de8ef0 0x55e666df88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:56036/0 (socket says 172.21.15.83:56036) 2024-04-01T06:57:21.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.959+0000 7fc922ffd700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e666de85d0 0x55e666df8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.959+0000 7fc9227fc700 1 -- 172.21.15.83:0/3838048103 learned_addr learned my addr 172.21.15.83:0/3838048103 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:21.968 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.959+0000 7fc9237fe700 1 --2- 172.21.15.83:0/3838048103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e666df3df0 0x55e666e567b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.959+0000 7fc9227fc700 1 -- 172.21.15.83:0/3838048103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e666df3df0 msgr2=0x55e666e567b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:21.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.959+0000 7fc9227fc700 1 --2- 172.21.15.83:0/3838048103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e666df3df0 0x55e666e567b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.959+0000 7fc9227fc700 1 -- 172.21.15.83:0/3838048103 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e666de85d0 msgr2=0x55e666df8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:21.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.959+0000 7fc9227fc700 1 --2- 172.21.15.83:0/3838048103 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e666de85d0 0x55e666df8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.959+0000 7fc9227fc700 1 -- 172.21.15.83:0/3838048103 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9180b9040 con 0x55e666de8ef0 2024-04-01T06:57:21.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.959+0000 7fc9237fe700 1 --2- 172.21.15.83:0/3838048103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e666df3df0 0x55e666e567b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:57:21.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.959+0000 7fc9227fc700 1 --2- 172.21.15.83:0/3838048103 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e666de8ef0 0x55e666df88c0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fc9180046a0 tx=0x7fc918099cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f657b757183052f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:21.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.959+0000 7fc902ffd700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:57:21.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.959+0000 7fc902ffd700 1 -- 172.21.15.83:0/3838048103 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc918099260 con 0x55e666de8ef0 2024-04-01T06:57:21.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.959+0000 7fc902ffd700 1 -- 172.21.15.83:0/3838048103 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7fc9180a1b60 con 0x55e666de8ef0 2024-04-01T06:57:21.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.959+0000 7fc935a58b80 1 -- 172.21.15.83:0/3838048103 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc914007e10 con 0x55e666de8ef0 2024-04-01T06:57:21.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.959+0000 7fc902ffd700 1 -- 172.21.15.83:0/3838048103 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc9180a1d20 con 0x55e666de8ef0 2024-04-01T06:57:21.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.959+0000 7fc935a58b80 10 client.15900 fetch_fsmap learned FSMap version 26 2024-04-01T06:57:21.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.959+0000 7fc935a58b80 1 -- 172.21.15.83:0/3838048103 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7fc924067df0 con 0x55e666de8ef0 2024-04-01T06:57:21.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.960+0000 7fc902ffd700 1 -- 172.21.15.83:0/3838048103 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc914007e10 con 0x55e666de8ef0 2024-04-01T06:57:21.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.960+0000 7fc902ffd700 1 -- 172.21.15.83:0/3838048103 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fc91809ab80 con 0x55e666de8ef0 2024-04-01T06:57:21.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.960+0000 7fc935a58b80 10 client.15900 fetch_fsmap finished waiting for FSMap version 26 2024-04-01T06:57:21.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.960+0000 7fc935a58b80 10 client.15900 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-01T06:57:21.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.960+0000 7fc935a58b80 20 client.15900 populate_metadata read hostname 'smithi083' 2024-04-01T06:57:21.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.960+0000 7fc935a58b80 1 --2- 172.21.15.83:0/3838048103 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55e666e583f0 0x55e666e5a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:21.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.960+0000 7fc935a58b80 4 client.15900 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-01T06:57:21.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.960+0000 7fc935a58b80 1 -- 172.21.15.83:0/3838048103 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55e666b89cf0 con 0x55e666e583f0 2024-04-01T06:57:21.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.960+0000 7fc922ffd700 1 --2- 172.21.15.83:0/3838048103 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55e666e583f0 0x55e666e5a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:21.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.960+0000 7fc922ffd700 1 --2- 172.21.15.83:0/3838048103 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55e666e583f0 0x55e666e5a810 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8682e9f9df94a423 server_cookie=6f5fae1ba7c220ef in_seq=0 out_seq=0 2024-04-01T06:57:21.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.960+0000 7fc902ffd700 10 client.15900 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:57:21.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.961+0000 7fc902ffd700 1 -- 172.21.15.83:0/3838048103 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55e666b89cf0 con 0x55e666e583f0 2024-04-01T06:57:21.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.961+0000 7fc902ffd700 10 client.15900 handle_command_reply: tid=0 2024-04-01T06:57:21.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.961+0000 7fc935a58b80 1 client.15900 shutdown 2024-04-01T06:57:21.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.961+0000 7fc935a58b80 1 -- 172.21.15.83:0/3838048103 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e666de8ef0 msgr2=0x55e666df88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:21.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.961+0000 7fc935a58b80 1 --2- 172.21.15.83:0/3838048103 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e666de8ef0 0x55e666df88c0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fc9180046a0 tx=0x7fc918099cd0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.961+0000 7fc935a58b80 1 -- 172.21.15.83:0/3838048103 shutdown_connections 2024-04-01T06:57:21.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.961+0000 7fc935a58b80 1 --2- 172.21.15.83:0/3838048103 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55e666e583f0 0x55e666e5a810 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.961+0000 7fc935a58b80 1 --2- 172.21.15.83:0/3838048103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e666df3df0 0x55e666e567b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.961+0000 7fc935a58b80 1 --2- 172.21.15.83:0/3838048103 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e666de85d0 0x55e666df8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.961+0000 7fc902ffd700 0 client.15900 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:57:21.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.961+0000 7fc935a58b80 1 --2- 172.21.15.83:0/3838048103 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55e666de8ef0 0x55e666df88c0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.961+0000 7fc935a58b80 1 -- 172.21.15.83:0/3838048103 >> 172.21.15.83:0/3838048103 conn(0x55e666d486a0 msgr2=0x55e666def300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:21.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.961+0000 7fc935a58b80 1 -- 172.21.15.83:0/3838048103 shutdown_connections 2024-04-01T06:57:21.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.961+0000 7fc935a58b80 1 -- 172.21.15.83:0/3838048103 wait complete. 2024-04-01T06:57:21.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.961+0000 7fc935a58b80 20 client.15900 trim_cache size 0 max 16384 2024-04-01T06:57:21.973 INFO:teuthology.orchestra.run.smithi083.stdout:[] 2024-04-01T06:57:21.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.961+0000 7fc9298c2700 1 -- 172.21.15.83:0/1553188451 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fc90c0a13b0 msgr2=0x7fc90c0a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:21.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.961+0000 7fc9298c2700 1 --2- 172.21.15.83:0/1553188451 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fc90c0a13b0 0x7fc90c0a3870 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc9140062a0 tx=0x7fc914006210 comp rx=0 tx=0).stop 2024-04-01T06:57:21.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.961+0000 7fc9298c2700 1 -- 172.21.15.83:0/1553188451 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc924104f60 msgr2=0x7fc92410d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:21.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.961+0000 7fc9298c2700 1 --2- 172.21.15.83:0/1553188451 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc924104f60 0x7fc92410d960 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fc91800d950 tx=0x7fc91800dc60 comp rx=0 tx=0).stop 2024-04-01T06:57:21.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.961+0000 7fc9298c2700 1 -- 172.21.15.83:0/1553188451 shutdown_connections 2024-04-01T06:57:21.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.961+0000 7fc9298c2700 1 --2- 172.21.15.83:0/1553188451 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fc90c0a13b0 0x7fc90c0a3870 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.961+0000 7fc9298c2700 1 --2- 172.21.15.83:0/1553188451 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc92410dea0 0x7fc9241a5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.961+0000 7fc9298c2700 1 --2- 172.21.15.83:0/1553188451 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9240ffe50 0x7fc92410d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.961+0000 7fc9298c2700 1 --2- 172.21.15.83:0/1553188451 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc924104f60 0x7fc92410d960 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:21.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.961+0000 7fc9298c2700 1 -- 172.21.15.83:0/1553188451 >> 172.21.15.83:0/1553188451 conn(0x7fc924076d40 msgr2=0x7fc924103b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:21.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.962+0000 7fc9298c2700 1 -- 172.21.15.83:0/1553188451 shutdown_connections 2024-04-01T06:57:21.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:21.962+0000 7fc9298c2700 1 -- 172.21.15.83:0/1553188451 wait complete. 2024-04-01T06:57:22.018 INFO:tasks.workunit.client.0.smithi083.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-04-01T06:57:22.019 INFO:tasks.workunit.client.0.smithi083.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-01T06:57:22.019 INFO:tasks.workunit.client.0.smithi083.stderr:+ make 2024-04-01T06:57:22.101 INFO:tasks.workunit.client.0.smithi083.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-04-01T06:57:22.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:21 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/3790829055' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:57:22.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:21 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/3790829055' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:57:22.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:21 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/3790829055' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:57:22.349 INFO:tasks.workunit.client.0.smithi083.stderr:++ readlink -f fsstress 2024-04-01T06:57:22.349 INFO:tasks.workunit.client.0.smithi083.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-04-01T06:57:22.349 INFO:tasks.workunit.client.0.smithi083.stderr:+ popd 2024-04-01T06:57:22.350 INFO:tasks.workunit.client.0.smithi083.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-01T06:57:22.350 INFO:tasks.workunit.client.0.smithi083.stderr:+ popd 2024-04-01T06:57:22.350 INFO:tasks.workunit.client.0.smithi083.stdout:~/cephtest/mnt.0/client.0/tmp 2024-04-01T06:57:22.350 INFO:tasks.workunit.client.0.smithi083.stderr:++ mktemp -d -p . 2024-04-01T06:57:22.352 INFO:tasks.workunit.client.0.smithi083.stderr:+ T=./tmp.byu7WIgLhr 2024-04-01T06:57:22.352 INFO:tasks.workunit.client.0.smithi083.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.byu7WIgLhr -l 1 -n 1000 -p 10 -v 2024-04-01T06:57:22.354 INFO:tasks.workunit.client.0.smithi083.stdout:seed = 1712273291 2024-04-01T06:57:22.358 INFO:tasks.workunit.client.0.smithi083.stdout:2/0: stat - no entries 2024-04-01T06:57:22.358 INFO:tasks.workunit.client.0.smithi083.stdout:1/0: creat f0 x:0 0 0 2024-04-01T06:57:22.359 INFO:tasks.workunit.client.0.smithi083.stdout:3/0: rename - no filename 2024-04-01T06:57:22.359 INFO:tasks.workunit.client.0.smithi083.stdout:3/1: write - no filename 2024-04-01T06:57:22.359 INFO:tasks.workunit.client.0.smithi083.stdout:3/2: truncate - no filename 2024-04-01T06:57:22.359 INFO:tasks.workunit.client.0.smithi083.stdout:3/3: getdents . 0 2024-04-01T06:57:22.359 INFO:tasks.workunit.client.0.smithi083.stdout:2/1: creat f0 x:0 0 0 2024-04-01T06:57:22.360 INFO:tasks.workunit.client.0.smithi083.stdout:4/0: dwrite - no filename 2024-04-01T06:57:22.360 INFO:tasks.workunit.client.0.smithi083.stdout:4/1: chown . 2 1 2024-04-01T06:57:22.360 INFO:tasks.workunit.client.0.smithi083.stdout:4/2: dread - no filename 2024-04-01T06:57:22.360 INFO:tasks.workunit.client.0.smithi083.stdout:4/3: rmdir - no directory 2024-04-01T06:57:22.361 INFO:tasks.workunit.client.0.smithi083.stdout:3/4: creat f0 x:0 0 0 2024-04-01T06:57:22.361 INFO:tasks.workunit.client.0.smithi083.stdout:2/2: creat f1 x:0 0 0 2024-04-01T06:57:22.362 INFO:tasks.workunit.client.0.smithi083.stdout:5/0: dread - no filename 2024-04-01T06:57:22.362 INFO:tasks.workunit.client.0.smithi083.stdout:5/1: fsync - no filename 2024-04-01T06:57:22.362 INFO:tasks.workunit.client.0.smithi083.stdout:5/2: dwrite - no filename 2024-04-01T06:57:22.362 INFO:tasks.workunit.client.0.smithi083.stdout:5/3: chown . 66 1 2024-04-01T06:57:22.362 INFO:tasks.workunit.client.0.smithi083.stdout:5/4: chown . 1 1 2024-04-01T06:57:22.363 INFO:tasks.workunit.client.0.smithi083.stdout:4/4: mknod c0 0 2024-04-01T06:57:22.363 INFO:tasks.workunit.client.0.smithi083.stdout:3/5: link f0 f1 0 2024-04-01T06:57:22.364 INFO:tasks.workunit.client.0.smithi083.stdout:3/6: truncate f1 283756 0 2024-04-01T06:57:22.365 INFO:tasks.workunit.client.0.smithi083.stdout:6/0: unlink - no file 2024-04-01T06:57:22.365 INFO:tasks.workunit.client.0.smithi083.stdout:6/1: write - no filename 2024-04-01T06:57:22.365 INFO:tasks.workunit.client.0.smithi083.stdout:5/5: creat f0 x:0 0 0 2024-04-01T06:57:22.365 INFO:tasks.workunit.client.0.smithi083.stdout:5/6: chown f0 234 1 2024-04-01T06:57:22.366 INFO:tasks.workunit.client.0.smithi083.stdout:4/5: mkdir d1 0 2024-04-01T06:57:22.368 INFO:tasks.workunit.client.0.smithi083.stdout:6/2: symlink l0 0 2024-04-01T06:57:22.373 INFO:tasks.workunit.client.0.smithi083.stdout:5/7: unlink f0 0 2024-04-01T06:57:22.373 INFO:tasks.workunit.client.0.smithi083.stdout:4/6: creat d1/f2 x:0 0 0 2024-04-01T06:57:22.374 INFO:tasks.workunit.client.0.smithi083.stdout:8/0: dwrite - no filename 2024-04-01T06:57:22.374 INFO:tasks.workunit.client.0.smithi083.stdout:8/1: chown . 64238830 1 2024-04-01T06:57:22.374 INFO:tasks.workunit.client.0.smithi083.stdout:8/2: link - no file 2024-04-01T06:57:22.374 INFO:tasks.workunit.client.0.smithi083.stdout:8/3: rename - no filename 2024-04-01T06:57:22.374 INFO:tasks.workunit.client.0.smithi083.stdout:4/7: write d1/f2 [20302,108700] 0 2024-04-01T06:57:22.374 INFO:tasks.workunit.client.0.smithi083.stdout:7/0: mkdir d0 0 2024-04-01T06:57:22.374 INFO:tasks.workunit.client.0.smithi083.stdout:7/1: dwrite - no filename 2024-04-01T06:57:22.374 INFO:tasks.workunit.client.0.smithi083.stdout:7/2: read - no filename 2024-04-01T06:57:22.376 INFO:tasks.workunit.client.0.smithi083.stdout:8/4: symlink l0 0 2024-04-01T06:57:22.380 INFO:tasks.workunit.client.0.smithi083.stdout:7/3: creat d0/f1 x:0 0 0 2024-04-01T06:57:22.380 INFO:tasks.workunit.client.0.smithi083.stdout:7/4: readlink - no filename 2024-04-01T06:57:22.380 INFO:tasks.workunit.client.0.smithi083.stdout:7/5: dread - d0/f1 zero size 2024-04-01T06:57:22.380 INFO:tasks.workunit.client.0.smithi083.stdout:7/6: fdatasync d0/f1 0 2024-04-01T06:57:22.380 INFO:tasks.workunit.client.0.smithi083.stdout:7/7: chown d0/f1 288025 1 2024-04-01T06:57:22.381 INFO:tasks.workunit.client.0.smithi083.stdout:8/5: mknod c1 0 2024-04-01T06:57:22.381 INFO:tasks.workunit.client.0.smithi083.stdout:8/6: chown l0 1 1 2024-04-01T06:57:22.381 INFO:tasks.workunit.client.0.smithi083.stdout:8/7: dwrite - no filename 2024-04-01T06:57:22.381 INFO:tasks.workunit.client.0.smithi083.stdout:7/8: creat d0/f2 x:0 0 0 2024-04-01T06:57:22.382 INFO:tasks.workunit.client.0.smithi083.stdout:5/8: mknod c1 0 2024-04-01T06:57:22.382 INFO:tasks.workunit.client.0.smithi083.stdout:5/9: truncate - no filename 2024-04-01T06:57:22.383 INFO:tasks.workunit.client.0.smithi083.stdout:8/8: symlink l2 0 2024-04-01T06:57:22.383 INFO:tasks.workunit.client.0.smithi083.stdout:8/9: chown c1 53948335 1 2024-04-01T06:57:22.384 INFO:tasks.workunit.client.0.smithi083.stdout:9/0: symlink l0 0 2024-04-01T06:57:22.384 INFO:tasks.workunit.client.0.smithi083.stdout:9/1: truncate - no filename 2024-04-01T06:57:22.384 INFO:tasks.workunit.client.0.smithi083.stdout:9/2: chown l0 302205 1 2024-04-01T06:57:22.384 INFO:tasks.workunit.client.0.smithi083.stdout:9/3: dwrite - no filename 2024-04-01T06:57:22.384 INFO:tasks.workunit.client.0.smithi083.stdout:9/4: write - no filename 2024-04-01T06:57:22.384 INFO:tasks.workunit.client.0.smithi083.stdout:9/5: dread - no filename 2024-04-01T06:57:22.386 INFO:tasks.workunit.client.0.smithi083.stdout:7/9: unlink d0/f2 0 2024-04-01T06:57:22.389 INFO:tasks.workunit.client.0.smithi083.stdout:8/10: unlink l2 0 2024-04-01T06:57:22.390 INFO:tasks.workunit.client.0.smithi083.stdout:8/11: stat c1 0 2024-04-01T06:57:22.390 INFO:tasks.workunit.client.0.smithi083.stdout:8/12: write - no filename 2024-04-01T06:57:22.390 INFO:tasks.workunit.client.0.smithi083.stdout:8/13: dread - no filename 2024-04-01T06:57:22.390 INFO:tasks.workunit.client.0.smithi083.stdout:9/6: symlink l1 0 2024-04-01T06:57:22.390 INFO:tasks.workunit.client.0.smithi083.stdout:9/7: write - no filename 2024-04-01T06:57:22.401 INFO:tasks.workunit.client.0.smithi083.stdout:7/10: rename d0/f1 to d0/f3 0 2024-04-01T06:57:22.401 INFO:tasks.workunit.client.0.smithi083.stdout:8/14: link l0 l3 0 2024-04-01T06:57:22.401 INFO:tasks.workunit.client.0.smithi083.stdout:9/8: rename l1 to l2 0 2024-04-01T06:57:22.401 INFO:tasks.workunit.client.0.smithi083.stdout:9/9: chown l2 4014 1 2024-04-01T06:57:22.401 INFO:tasks.workunit.client.0.smithi083.stdout:9/10: truncate - no filename 2024-04-01T06:57:22.404 INFO:tasks.workunit.client.0.smithi083.stdout:9/11: chown l0 11365 1 2024-04-01T06:57:22.404 INFO:tasks.workunit.client.0.smithi083.stdout:9/12: dread - no filename 2024-04-01T06:57:22.407 INFO:tasks.workunit.client.0.smithi083.stdout:7/11: mkdir d0/d4 0 2024-04-01T06:57:22.407 INFO:tasks.workunit.client.0.smithi083.stdout:8/15: creat f4 x:0 0 0 2024-04-01T06:57:22.418 INFO:tasks.workunit.client.0.smithi083.stdout:8/16: symlink l5 0 2024-04-01T06:57:22.418 INFO:tasks.workunit.client.0.smithi083.stdout:9/13: link l0 l3 0 2024-04-01T06:57:22.418 INFO:tasks.workunit.client.0.smithi083.stdout:9/14: truncate - no filename 2024-04-01T06:57:22.428 INFO:tasks.workunit.client.0.smithi083.stdout:9/15: link l0 l4 0 2024-04-01T06:57:22.976 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-01T06:57:22.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T06:57:22.977 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-01T06:57:23.026 INFO:tasks.workunit.client.0.smithi083.stdout:1/1: dwrite f0 [0,4194304] 0 2024-04-01T06:57:23.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:22 smithi153 ceph-mon[48187]: pgmap v48: 97 pgs: 97 active+clean; 36 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.0 MiB/s wr, 1.52k op/s 2024-04-01T06:57:23.191 INFO:tasks.workunit.client.0.smithi083.stdout:3/7: write f1 [27464,122555] 0 2024-04-01T06:57:23.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.210+0000 7fd0b75d3700 1 -- 172.21.15.83:0/4240496378 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd0b0104f90 msgr2=0x7fd0b010cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:23.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.210+0000 7fd0b75d3700 1 --2- 172.21.15.83:0/4240496378 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd0b0104f90 0x7fd0b010cb10 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fd0a800b0a0 tx=0x7fd0a800b3b0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.210+0000 7fd0b75d3700 1 -- 172.21.15.83:0/4240496378 shutdown_connections 2024-04-01T06:57:23.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.210+0000 7fd0b75d3700 1 --2- 172.21.15.83:0/4240496378 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd0b0104f90 0x7fd0b010cb10 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.210+0000 7fd0b75d3700 1 --2- 172.21.15.83:0/4240496378 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd0b00ffe70 0x7fd0b0100250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.210+0000 7fd0b75d3700 1 --2- 172.21.15.83:0/4240496378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd0b0100820 0x7fd0b0104860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.211+0000 7fd0b75d3700 1 -- 172.21.15.83:0/4240496378 >> 172.21.15.83:0/4240496378 conn(0x7fd0b0076d80 msgr2=0x7fd0b0077190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:23.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.211+0000 7fd0b75d3700 1 -- 172.21.15.83:0/4240496378 shutdown_connections 2024-04-01T06:57:23.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.211+0000 7fd0b75d3700 1 -- 172.21.15.83:0/4240496378 wait complete. 2024-04-01T06:57:23.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.211+0000 7fd0b75d3700 1 Processor -- start 2024-04-01T06:57:23.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.211+0000 7fd0b75d3700 1 -- start start 2024-04-01T06:57:23.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.212+0000 7fd0b75d3700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd0b00ffe70 0x7fd0b0108c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:23.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.212+0000 7fd0b75d3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd0b0104f90 0x7fd0b0109190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:23.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.212+0000 7fd0b75d3700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd0b01096d0 0x7fd0b0072820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:23.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.212+0000 7fd0b75d3700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b010ccf0 con 0x7fd0b01096d0 2024-04-01T06:57:23.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.212+0000 7fd0b75d3700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b010ce30 con 0x7fd0b00ffe70 2024-04-01T06:57:23.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.212+0000 7fd0b75d3700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b01146f0 con 0x7fd0b0104f90 2024-04-01T06:57:23.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.212+0000 7fd0b5b70700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd0b01096d0 0x7fd0b0072820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:23.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.212+0000 7fd0b5b70700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd0b01096d0 0x7fd0b0072820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:56054/0 (socket says 172.21.15.83:56054) 2024-04-01T06:57:23.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.212+0000 7fd0b5b70700 1 -- 172.21.15.83:0/2025377992 learned_addr learned my addr 172.21.15.83:0/2025377992 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:23.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.212+0000 7fd0b5b70700 1 -- 172.21.15.83:0/2025377992 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd0b0104f90 msgr2=0x7fd0b0109190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:23.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.212+0000 7fd0b5b70700 1 --2- 172.21.15.83:0/2025377992 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd0b0104f90 0x7fd0b0109190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.212+0000 7fd0b5b70700 1 -- 172.21.15.83:0/2025377992 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd0b00ffe70 msgr2=0x7fd0b0108c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:23.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.212+0000 7fd0b5b70700 1 --2- 172.21.15.83:0/2025377992 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd0b00ffe70 0x7fd0b0108c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.212+0000 7fd0b5b70700 1 -- 172.21.15.83:0/2025377992 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a8009d00 con 0x7fd0b01096d0 2024-04-01T06:57:23.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.213+0000 7fd0b5b70700 1 --2- 172.21.15.83:0/2025377992 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd0b01096d0 0x7fd0b0072820 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fd0a800b070 tx=0x7fd0a80093b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:23.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.213+0000 7fd0a67fc700 1 -- 172.21.15.83:0/2025377992 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a800e040 con 0x7fd0b01096d0 2024-04-01T06:57:23.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.213+0000 7fd0a67fc700 1 -- 172.21.15.83:0/2025377992 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd0a8003e10 con 0x7fd0b01096d0 2024-04-01T06:57:23.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.213+0000 7fd0a67fc700 1 -- 172.21.15.83:0/2025377992 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a8005330 con 0x7fd0b01096d0 2024-04-01T06:57:23.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.213+0000 7fd0b75d3700 1 -- 172.21.15.83:0/2025377992 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0b0114910 con 0x7fd0b01096d0 2024-04-01T06:57:23.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.213+0000 7fd0b75d3700 1 -- 172.21.15.83:0/2025377992 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0b0114d70 con 0x7fd0b01096d0 2024-04-01T06:57:23.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.216+0000 7fd0a67fc700 1 -- 172.21.15.83:0/2025377992 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) v1 ==== 136098+0+0 (secure 0 0 0) 0x7fd0a801da40 con 0x7fd0b01096d0 2024-04-01T06:57:23.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.216+0000 7fd0a67fc700 1 --2- 172.21.15.83:0/2025377992 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fd09c0a14b0 0x7fd09c0a3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:23.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.217+0000 7fd0a67fc700 1 -- 172.21.15.83:0/2025377992 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7fd0a80ce0e0 con 0x7fd0b01096d0 2024-04-01T06:57:23.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.217+0000 7fd0b536f700 1 --2- 172.21.15.83:0/2025377992 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fd09c0a14b0 0x7fd09c0a3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:23.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.219+0000 7fd0b536f700 1 --2- 172.21.15.83:0/2025377992 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fd09c0a14b0 0x7fd09c0a3970 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac0097b0 tx=0x7fd0ac006d20 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:23.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.219+0000 7fd0c3769b80 1 Processor -- start 2024-04-01T06:57:23.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.219+0000 7fd0c3769b80 1 -- start start 2024-04-01T06:57:23.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.219+0000 7fd0c3769b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55751a0bd650 0x55751a0bda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:23.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.219+0000 7fd0c3769b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55751a0bdf70 0x55751a0c8930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:23.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.219+0000 7fd0c3769b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55751a0c8e70 0x55751a0cb260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:23.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.219+0000 7fd0c3769b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55751a016a10 con 0x55751a0bdf70 2024-04-01T06:57:23.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.219+0000 7fd0c3769b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55751a0143d0 con 0x55751a0c8e70 2024-04-01T06:57:23.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.219+0000 7fd0c3769b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55751a00fcc0 con 0x55751a0bd650 2024-04-01T06:57:23.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.220+0000 7fd0b4b6e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55751a0bdf70 0x55751a0c8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:23.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.220+0000 7fd0b4b6e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55751a0bdf70 0x55751a0c8930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:56064/0 (socket says 172.21.15.83:56064) 2024-04-01T06:57:23.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.220+0000 7fd0b4b6e700 1 -- 172.21.15.83:0/895303338 learned_addr learned my addr 172.21.15.83:0/895303338 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:23.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.220+0000 7fd0b4b6e700 1 -- 172.21.15.83:0/895303338 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55751a0bd650 msgr2=0x55751a0bda30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-01T06:57:23.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.220+0000 7fd0b4b6e700 1 --2- 172.21.15.83:0/895303338 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55751a0bd650 0x55751a0bda30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.220+0000 7fd0b4b6e700 1 -- 172.21.15.83:0/895303338 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55751a0c8e70 msgr2=0x55751a0cb260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-01T06:57:23.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.220+0000 7fd0b4b6e700 1 --2- 172.21.15.83:0/895303338 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55751a0c8e70 0x55751a0cb260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.220+0000 7fd0b4b6e700 1 -- 172.21.15.83:0/895303338 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557519e91430 con 0x55751a0bdf70 2024-04-01T06:57:23.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.221+0000 7fd0b4b6e700 1 --2- 172.21.15.83:0/895303338 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55751a0bdf70 0x55751a0c8930 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fd0a000aa00 tx=0x7fd0a000ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acb7bed973c935ba server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:23.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.221+0000 7fd09b7fe700 1 -- 172.21.15.83:0/895303338 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a000cc10 con 0x55751a0bdf70 2024-04-01T06:57:23.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.221+0000 7fd09b7fe700 1 -- 172.21.15.83:0/895303338 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd0a00044e0 con 0x55751a0bdf70 2024-04-01T06:57:23.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.222+0000 7fd09b7fe700 1 -- 172.21.15.83:0/895303338 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a0003e90 con 0x55751a0bdf70 2024-04-01T06:57:23.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.222+0000 7fd0c3769b80 1 -- 172.21.15.83:0/895303338 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55751a0bdf70 msgr2=0x55751a0c8930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:23.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.222+0000 7fd0c3769b80 1 --2- 172.21.15.83:0/895303338 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55751a0bdf70 0x55751a0c8930 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fd0a000aa00 tx=0x7fd0a000ad10 comp rx=0 tx=0).stop 2024-04-01T06:57:23.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.223+0000 7fd0c3769b80 1 -- 172.21.15.83:0/895303338 shutdown_connections 2024-04-01T06:57:23.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.223+0000 7fd0c3769b80 1 --2- 172.21.15.83:0/895303338 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55751a0c8e70 0x55751a0cb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.223+0000 7fd0c3769b80 1 --2- 172.21.15.83:0/895303338 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55751a0bd650 0x55751a0bda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.223+0000 7fd0c3769b80 1 --2- 172.21.15.83:0/895303338 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55751a0bdf70 0x55751a0c8930 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.223+0000 7fd0c3769b80 1 -- 172.21.15.83:0/895303338 >> 172.21.15.83:0/895303338 conn(0x55751a01d720 msgr2=0x55751a0b9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:23.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.223+0000 7fd0c3769b80 1 -- 172.21.15.83:0/895303338 shutdown_connections 2024-04-01T06:57:23.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.223+0000 7fd0c3769b80 1 -- 172.21.15.83:0/895303338 wait complete. 2024-04-01T06:57:23.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.223+0000 7fd0c3769b80 1 -- start start 2024-04-01T06:57:23.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.223+0000 7fd0c3769b80 1 Processor -- start 2024-04-01T06:57:23.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.224+0000 7fd0c3769b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55751a0bd650 0x55751a0c8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:23.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.224+0000 7fd0c3769b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55751a0bdf70 0x55751a0c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:23.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.224+0000 7fd0c3769b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55751a0c8e70 0x55751a0c6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:23.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.224+0000 7fd0c3769b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x557519fabe00 con 0x55751a0bdf70 2024-04-01T06:57:23.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.224+0000 7fd0c3769b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x557519fabaa0 con 0x55751a0bd650 2024-04-01T06:57:23.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.224+0000 7fd0c3769b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x557519e93720 con 0x55751a0c8e70 2024-04-01T06:57:23.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.224+0000 7fd0c3769b80 10 client.0 _ll_register_callbacks cb 0x557519fb54f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:57:23.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.224+0000 7fd0b4b6e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55751a0bdf70 0x55751a0c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:23.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.224+0000 7fd0b4b6e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55751a0bdf70 0x55751a0c5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:56076/0 (socket says 172.21.15.83:56076) 2024-04-01T06:57:23.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.224+0000 7fd0b4b6e700 1 -- 172.21.15.83:0/3378877107 learned_addr learned my addr 172.21.15.83:0/3378877107 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:23.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.225+0000 7fd0b4b6e700 1 -- 172.21.15.83:0/3378877107 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55751a0c8e70 msgr2=0x55751a0c6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:23.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.225+0000 7fd0b4b6e700 1 --2- 172.21.15.83:0/3378877107 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55751a0c8e70 0x55751a0c6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.225+0000 7fd0b4b6e700 1 -- 172.21.15.83:0/3378877107 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55751a0bd650 msgr2=0x55751a0c8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:23.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.225+0000 7fd0b4b6e700 1 --2- 172.21.15.83:0/3378877107 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55751a0bd650 0x55751a0c8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.225+0000 7fd0b4b6e700 1 -- 172.21.15.83:0/3378877107 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0a000a660 con 0x55751a0bdf70 2024-04-01T06:57:23.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.225+0000 7fd0b4b6e700 1 --2- 172.21.15.83:0/3378877107 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55751a0bdf70 0x55751a0c5c00 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0003ab0 tx=0x7fd0a0003dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae692bb4bbc6bfc4 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:23.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.225+0000 7fd098ff9700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:57:23.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.225+0000 7fd098ff9700 1 -- 172.21.15.83:0/3378877107 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a001e070 con 0x55751a0bdf70 2024-04-01T06:57:23.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.225+0000 7fd098ff9700 1 -- 172.21.15.83:0/3378877107 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7fd0a0005bc0 con 0x55751a0bdf70 2024-04-01T06:57:23.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.225+0000 7fd0c3769b80 1 -- 172.21.15.83:0/3378877107 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557519fd0400 con 0x55751a0bdf70 2024-04-01T06:57:23.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.226+0000 7fd098ff9700 1 -- 172.21.15.83:0/3378877107 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd0a000cc20 con 0x55751a0bdf70 2024-04-01T06:57:23.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.226+0000 7fd0c3769b80 10 client.15912 fetch_fsmap learned FSMap version 26 2024-04-01T06:57:23.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.226+0000 7fd0c3769b80 1 -- 172.21.15.83:0/3378877107 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x557519e3dbe0 con 0x55751a0bdf70 2024-04-01T06:57:23.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.226+0000 7fd098ff9700 1 -- 172.21.15.83:0/3378877107 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557519fd0400 con 0x55751a0bdf70 2024-04-01T06:57:23.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.226+0000 7fd098ff9700 1 -- 172.21.15.83:0/3378877107 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fd0a0016030 con 0x55751a0bdf70 2024-04-01T06:57:23.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.226+0000 7fd0c3769b80 10 client.15912 fetch_fsmap finished waiting for FSMap version 26 2024-04-01T06:57:23.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.226+0000 7fd0c3769b80 10 client.15912 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-01T06:57:23.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.226+0000 7fd0c3769b80 20 client.15912 populate_metadata read hostname 'smithi083' 2024-04-01T06:57:23.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.226+0000 7fd0c3769b80 1 --2- 172.21.15.83:0/3378877107 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55751a0d8950 0x55751a0dad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:23.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.226+0000 7fd0c3769b80 4 client.15912 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-01T06:57:23.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.226+0000 7fd0c3769b80 1 -- 172.21.15.83:0/3378877107 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55751a008780 con 0x55751a0d8950 2024-04-01T06:57:23.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.226+0000 7fd0b536f700 1 --2- 172.21.15.83:0/3378877107 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55751a0d8950 0x55751a0dad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:23.242 INFO:tasks.workunit.client.0.smithi083.stdout:7/12: dwrite d0/f3 [0,4194304] 0 2024-04-01T06:57:23.243 INFO:tasks.workunit.client.0.smithi083.stdout:8/17: dwrite f4 [0,4194304] 0 2024-04-01T06:57:23.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.250+0000 7fd098ff9700 10 client.15912 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:57:23.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.250+0000 7fd0b536f700 1 --2- 172.21.15.83:0/3378877107 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55751a0d8950 0x55751a0dad70 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8fb519d136cbfe9 server_cookie=3cb05333c58c6a95 in_seq=0 out_seq=0 2024-04-01T06:57:23.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:22 smithi145 ceph-mon[47816]: pgmap v48: 97 pgs: 97 active+clean; 36 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.0 MiB/s wr, 1.52k op/s 2024-04-01T06:57:23.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.258+0000 7fd098ff9700 1 -- 172.21.15.83:0/3378877107 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55751a008780 con 0x55751a0d8950 2024-04-01T06:57:23.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.258+0000 7fd098ff9700 10 client.15912 handle_command_reply: tid=0 2024-04-01T06:57:23.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.258+0000 7fd0c3769b80 1 client.15912 shutdown 2024-04-01T06:57:23.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.259+0000 7fd0c3769b80 1 -- 172.21.15.83:0/3378877107 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55751a0bdf70 msgr2=0x55751a0c5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:23.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.259+0000 7fd0c3769b80 1 --2- 172.21.15.83:0/3378877107 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55751a0bdf70 0x55751a0c5c00 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0003ab0 tx=0x7fd0a0003dd0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.259+0000 7fd0c3769b80 1 -- 172.21.15.83:0/3378877107 shutdown_connections 2024-04-01T06:57:23.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.259+0000 7fd0c3769b80 1 --2- 172.21.15.83:0/3378877107 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55751a0d8950 0x55751a0dad70 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.259+0000 7fd0c3769b80 1 --2- 172.21.15.83:0/3378877107 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55751a0c8e70 0x55751a0c6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.259+0000 7fd0c3769b80 1 --2- 172.21.15.83:0/3378877107 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55751a0bd650 0x55751a0c8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.259+0000 7fd0c3769b80 1 --2- 172.21.15.83:0/3378877107 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55751a0bdf70 0x55751a0c5c00 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.259+0000 7fd0c3769b80 1 -- 172.21.15.83:0/3378877107 >> 172.21.15.83:0/3378877107 conn(0x55751a01d720 msgr2=0x55751a0bf740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:23.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.259+0000 7fd098ff9700 0 client.15912 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:57:23.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.262+0000 7fd0c3769b80 1 -- 172.21.15.83:0/3378877107 shutdown_connections 2024-04-01T06:57:23.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.263+0000 7fd0c3769b80 1 -- 172.21.15.83:0/3378877107 wait complete. 2024-04-01T06:57:23.262 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.263+0000 7fd0c3769b80 20 client.15912 trim_cache size 0 max 16384 2024-04-01T06:57:23.264 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:22 smithi083 ceph-mon[43429]: pgmap v48: 97 pgs: 97 active+clean; 36 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.0 MiB/s wr, 1.52k op/s 2024-04-01T06:57:23.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.291+0000 7fd0c3769b80 1 Processor -- start 2024-04-01T06:57:23.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.291+0000 7fd0c3769b80 1 -- start start 2024-04-01T06:57:23.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.291+0000 7fd0c3769b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55751a0bd650 0x55751a0cfb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:23.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.291+0000 7fd0c3769b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55751a0bdf70 0x55751a0c5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:23.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.291+0000 7fd0c3769b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55751a0c8e70 0x55751a0c59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:23.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.291+0000 7fd0c3769b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55751a0c6700 con 0x55751a0c8e70 2024-04-01T06:57:23.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.291+0000 7fd0c3769b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55751a0c7200 con 0x55751a0bdf70 2024-04-01T06:57:23.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.291+0000 7fd0c3769b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55751a0bf1c0 con 0x55751a0bd650 2024-04-01T06:57:23.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.291+0000 7fd0b536f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55751a0bd650 0x55751a0cfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:23.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.291+0000 7fd0b536f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55751a0bd650 0x55751a0cfb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.83:33154/0 (socket says 172.21.15.83:33154) 2024-04-01T06:57:23.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.291+0000 7fd0b536f700 1 -- 172.21.15.83:0/3346906596 learned_addr learned my addr 172.21.15.83:0/3346906596 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:23.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.292+0000 7fd0b5b70700 1 --2- 172.21.15.83:0/3346906596 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55751a0c8e70 0x55751a0c59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:23.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.292+0000 7fd0b4b6e700 1 --2- 172.21.15.83:0/3346906596 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55751a0bdf70 0x55751a0c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:23.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.292+0000 7fd0b536f700 1 -- 172.21.15.83:0/3346906596 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55751a0bdf70 msgr2=0x55751a0c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:23.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.292+0000 7fd0b536f700 1 --2- 172.21.15.83:0/3346906596 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55751a0bdf70 0x55751a0c5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.292+0000 7fd0b536f700 1 -- 172.21.15.83:0/3346906596 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55751a0c8e70 msgr2=0x55751a0c59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:23.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.292+0000 7fd0b536f700 1 --2- 172.21.15.83:0/3346906596 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55751a0c8e70 0x55751a0c59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.292+0000 7fd0b536f700 1 -- 172.21.15.83:0/3346906596 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557519fd5f20 con 0x55751a0bd650 2024-04-01T06:57:23.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.293+0000 7fd0b536f700 1 --2- 172.21.15.83:0/3346906596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55751a0bd650 0x55751a0cfb20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac01fcd0 tx=0x7fd0ac00e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae2f7723a3b25a9f server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:23.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.294+0000 7fd09bfff700 1 -- 172.21.15.83:0/3346906596 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac01a040 con 0x55751a0bd650 2024-04-01T06:57:23.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.294+0000 7fd09bfff700 1 -- 172.21.15.83:0/3346906596 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd0ac013d30 con 0x55751a0bd650 2024-04-01T06:57:23.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.294+0000 7fd09bfff700 1 -- 172.21.15.83:0/3346906596 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac012b70 con 0x55751a0bd650 2024-04-01T06:57:23.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.294+0000 7fd0c3769b80 1 -- 172.21.15.83:0/3346906596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55751a0bd650 msgr2=0x55751a0cfb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:23.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.294+0000 7fd0c3769b80 1 --2- 172.21.15.83:0/3346906596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55751a0bd650 0x55751a0cfb20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac01fcd0 tx=0x7fd0ac00e000 comp rx=0 tx=0).stop 2024-04-01T06:57:23.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.295+0000 7fd0c3769b80 1 -- 172.21.15.83:0/3346906596 shutdown_connections 2024-04-01T06:57:23.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.295+0000 7fd0c3769b80 1 --2- 172.21.15.83:0/3346906596 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55751a0c8e70 0x55751a0c59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.295+0000 7fd0c3769b80 1 --2- 172.21.15.83:0/3346906596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55751a0bd650 0x55751a0cfb20 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.295+0000 7fd0c3769b80 1 --2- 172.21.15.83:0/3346906596 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55751a0bdf70 0x55751a0c5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.295+0000 7fd0c3769b80 1 -- 172.21.15.83:0/3346906596 >> 172.21.15.83:0/3346906596 conn(0x55751a01d720 msgr2=0x55751a0c0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:23.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.295+0000 7fd0c3769b80 1 -- 172.21.15.83:0/3346906596 shutdown_connections 2024-04-01T06:57:23.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.295+0000 7fd0c3769b80 1 -- 172.21.15.83:0/3346906596 wait complete. 2024-04-01T06:57:23.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.295+0000 7fd0c3769b80 1 -- start start 2024-04-01T06:57:23.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.295+0000 7fd0c3769b80 1 Processor -- start 2024-04-01T06:57:23.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.296+0000 7fd0c3769b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55751a0bd650 0x55751a0ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:23.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.296+0000 7fd0c3769b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55751a0bdf70 0x55751a0ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:23.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.296+0000 7fd0c3769b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55751a0c8e70 0x55751a12c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:23.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.296+0000 7fd0c3769b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55751a12cc90 con 0x55751a0c8e70 2024-04-01T06:57:23.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.296+0000 7fd0c3769b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55751a12cdd0 con 0x55751a0bd650 2024-04-01T06:57:23.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.296+0000 7fd0c3769b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55751a12cf10 con 0x55751a0bdf70 2024-04-01T06:57:23.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.296+0000 7fd0c3769b80 10 client.0 _ll_register_callbacks cb 0x557519fb54f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:57:23.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.296+0000 7fd0b536f700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55751a0bd650 0x55751a0ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:23.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.296+0000 7fd0b536f700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55751a0bd650 0x55751a0ce820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.83:46858/0 (socket says 172.21.15.83:46858) 2024-04-01T06:57:23.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.296+0000 7fd0b536f700 1 -- 172.21.15.83:0/3731417666 learned_addr learned my addr 172.21.15.83:0/3731417666 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:23.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.297+0000 7fd0b4b6e700 1 --2- 172.21.15.83:0/3731417666 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55751a0bdf70 0x55751a0ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:23.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.297+0000 7fd0b5b70700 1 --2- 172.21.15.83:0/3731417666 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55751a0c8e70 0x55751a12c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:23.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.298+0000 7fd0b536f700 1 -- 172.21.15.83:0/3731417666 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55751a0bdf70 msgr2=0x55751a0ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:23.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.298+0000 7fd0b536f700 1 --2- 172.21.15.83:0/3731417666 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55751a0bdf70 0x55751a0ced60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.298+0000 7fd0b536f700 1 -- 172.21.15.83:0/3731417666 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55751a0c8e70 msgr2=0x55751a12c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:23.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.298+0000 7fd0b536f700 1 --2- 172.21.15.83:0/3731417666 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55751a0c8e70 0x55751a12c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.298+0000 7fd0b536f700 1 -- 172.21.15.83:0/3731417666 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0ac01f9b0 con 0x55751a0bd650 2024-04-01T06:57:23.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.306+0000 7fd0b536f700 1 --2- 172.21.15.83:0/3731417666 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55751a0bd650 0x55751a0ce820 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac009f40 tx=0x7fd0ac0094b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39d6fdf1bc1b8d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:23.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.306+0000 7fd098ff9700 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-04-01T06:57:23.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.306+0000 7fd098ff9700 1 -- 172.21.15.83:0/3731417666 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac01a040 con 0x55751a0bd650 2024-04-01T06:57:23.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.306+0000 7fd0c3769b80 1 -- 172.21.15.83:0/3731417666 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd0a00044e0 con 0x55751a0bd650 2024-04-01T06:57:23.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.306+0000 7fd098ff9700 1 -- 172.21.15.83:0/3731417666 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7fd0ac013a70 con 0x55751a0bd650 2024-04-01T06:57:23.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.306+0000 7fd098ff9700 1 -- 172.21.15.83:0/3731417666 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd0ac005ac0 con 0x55751a0bd650 2024-04-01T06:57:23.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.306+0000 7fd0c3769b80 10 client.25424 fetch_fsmap learned FSMap version 26 2024-04-01T06:57:23.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.306+0000 7fd0c3769b80 1 -- 172.21.15.83:0/3731417666 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x557519e95d50 con 0x55751a0bd650 2024-04-01T06:57:23.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.307+0000 7fd098ff9700 1 -- 172.21.15.83:0/3731417666 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd0a00044e0 con 0x55751a0bd650 2024-04-01T06:57:23.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.307+0000 7fd098ff9700 1 -- 172.21.15.83:0/3731417666 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fd0ac031020 con 0x55751a0bd650 2024-04-01T06:57:23.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.307+0000 7fd0c3769b80 10 client.25424 fetch_fsmap finished waiting for FSMap version 26 2024-04-01T06:57:23.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.307+0000 7fd0c3769b80 10 client.25424 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-01T06:57:23.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.307+0000 7fd0c3769b80 20 client.25424 populate_metadata read hostname 'smithi083' 2024-04-01T06:57:23.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.307+0000 7fd0c3769b80 1 --2- 172.21.15.83:0/3731417666 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55751a12e6a0 0x55751a130ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:23.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.307+0000 7fd0c3769b80 4 client.25424 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-01T06:57:23.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.307+0000 7fd0c3769b80 1 -- 172.21.15.83:0/3731417666 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x557519e5ed70 con 0x55751a12e6a0 2024-04-01T06:57:23.309 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.308+0000 7fd0b4b6e700 1 --2- 172.21.15.83:0/3731417666 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55751a12e6a0 0x55751a130ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:23.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.310+0000 7fd0b4b6e700 1 --2- 172.21.15.83:0/3731417666 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55751a12e6a0 0x55751a130ac0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83084bbd1f29ed95 server_cookie=fe7f6298404a60c5 in_seq=0 out_seq=0 2024-04-01T06:57:23.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.311+0000 7fd098ff9700 10 client.25424 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:57:23.312 INFO:tasks.workunit.client.0.smithi083.stdout:7/13: write d0/f3 [1556617,80318] 0 2024-04-01T06:57:23.317 INFO:tasks.workunit.client.0.smithi083.stdout:6/3: getdents . 0 2024-04-01T06:57:23.323 INFO:tasks.workunit.client.0.smithi083.stdout:4/8: rmdir d1 39 2024-04-01T06:57:23.377 INFO:tasks.workunit.client.0.smithi083.stdout:9/16: getdents . 0 2024-04-01T06:57:23.413 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.412+0000 7fd098ff9700 1 -- 172.21.15.83:0/3731417666 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x557519e5ed70 con 0x55751a12e6a0 2024-04-01T06:57:23.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.412+0000 7fd098ff9700 10 client.25424 handle_command_reply: tid=0 2024-04-01T06:57:23.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.412+0000 7fd0c3769b80 1 client.25424 shutdown 2024-04-01T06:57:23.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.412+0000 7fd0c3769b80 1 -- 172.21.15.83:0/3731417666 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55751a0bd650 msgr2=0x55751a0ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:23.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.412+0000 7fd0c3769b80 1 --2- 172.21.15.83:0/3731417666 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55751a0bd650 0x55751a0ce820 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac009f40 tx=0x7fd0ac0094b0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.413+0000 7fd0c3769b80 1 -- 172.21.15.83:0/3731417666 shutdown_connections 2024-04-01T06:57:23.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.413+0000 7fd0c3769b80 1 --2- 172.21.15.83:0/3731417666 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55751a12e6a0 0x55751a130ac0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.413+0000 7fd0c3769b80 1 --2- 172.21.15.83:0/3731417666 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55751a0c8e70 0x55751a12c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.413+0000 7fd0c3769b80 1 --2- 172.21.15.83:0/3731417666 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55751a0bd650 0x55751a0ce820 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.413+0000 7fd0c3769b80 1 --2- 172.21.15.83:0/3731417666 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55751a0bdf70 0x55751a0ced60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.413+0000 7fd0c3769b80 1 -- 172.21.15.83:0/3731417666 >> 172.21.15.83:0/3731417666 conn(0x55751a01d720 msgr2=0x55751a0c5490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:23.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.413+0000 7fd098ff9700 0 client.25424 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:57:23.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.413+0000 7fd0c3769b80 1 -- 172.21.15.83:0/3731417666 shutdown_connections 2024-04-01T06:57:23.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.413+0000 7fd0c3769b80 1 -- 172.21.15.83:0/3731417666 wait complete. 2024-04-01T06:57:23.417 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-04-01T06:57:23.418 INFO:teuthology.orchestra.run.smithi083.stdout: "return_code": 0, 2024-04-01T06:57:23.418 INFO:teuthology.orchestra.run.smithi083.stdout: "scrub_tag": "0f72e254-c91a-40c1-b6a5-6d116ce4248a", 2024-04-01T06:57:23.418 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": "asynchronous" 2024-04-01T06:57:23.418 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-04-01T06:57:23.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.414+0000 7fd0c3769b80 20 client.25424 trim_cache size 0 max 16384 2024-04-01T06:57:23.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.416+0000 7fd0b75d3700 1 -- 172.21.15.83:0/2025377992 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fd09c0a14b0 msgr2=0x7fd09c0a3970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:23.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.416+0000 7fd0b75d3700 1 --2- 172.21.15.83:0/2025377992 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fd09c0a14b0 0x7fd09c0a3970 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac0097b0 tx=0x7fd0ac006d20 comp rx=0 tx=0).stop 2024-04-01T06:57:23.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.416+0000 7fd0b75d3700 1 -- 172.21.15.83:0/2025377992 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd0b01096d0 msgr2=0x7fd0b0072820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:23.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.416+0000 7fd0b75d3700 1 --2- 172.21.15.83:0/2025377992 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd0b01096d0 0x7fd0b0072820 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fd0a800b070 tx=0x7fd0a80093b0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.416+0000 7fd0b75d3700 1 -- 172.21.15.83:0/2025377992 shutdown_connections 2024-04-01T06:57:23.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.416+0000 7fd0b75d3700 1 --2- 172.21.15.83:0/2025377992 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fd09c0a14b0 0x7fd09c0a3970 secure :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac0097b0 tx=0x7fd0ac006d20 comp rx=0 tx=0).stop 2024-04-01T06:57:23.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.416+0000 7fd0b75d3700 1 --2- 172.21.15.83:0/2025377992 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd0b01096d0 0x7fd0b0072820 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.416+0000 7fd0b75d3700 1 --2- 172.21.15.83:0/2025377992 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd0b00ffe70 0x7fd0b0108c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.416+0000 7fd0b75d3700 1 --2- 172.21.15.83:0/2025377992 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd0b0104f90 0x7fd0b0109190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.416+0000 7fd0b75d3700 1 -- 172.21.15.83:0/2025377992 >> 172.21.15.83:0/2025377992 conn(0x7fd0b0076d80 msgr2=0x7fd0b00ff340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:23.419 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.418+0000 7fd0b75d3700 1 -- 172.21.15.83:0/2025377992 shutdown_connections 2024-04-01T06:57:23.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.420+0000 7fd0b75d3700 1 -- 172.21.15.83:0/2025377992 wait complete. 2024-04-01T06:57:23.446 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-01T06:57:23.446 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-01T06:57:23.552 INFO:tasks.workunit.client.0.smithi083.stdout:2/3: dwrite f0 [0,4194304] 0 2024-04-01T06:57:23.630 INFO:tasks.workunit.client.0.smithi083.stdout:4/9: dread d1/f2 [0,4194304] 0 2024-04-01T06:57:23.630 INFO:tasks.workunit.client.0.smithi083.stdout:4/10: fsync d1/f2 0 2024-04-01T06:57:23.631 INFO:tasks.workunit.client.0.smithi083.stdout:4/11: write d1/f2 [2598,24370] 0 2024-04-01T06:57:23.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.661+0000 7f04974a5700 1 -- 172.21.15.83:0/2287015492 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f04900ffc10 msgr2=0x7f0490100090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:23.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.661+0000 7f04974a5700 1 --2- 172.21.15.83:0/2287015492 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f04900ffc10 0x7f0490100090 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f0480009990 tx=0x7f0480009ca0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.661+0000 7f04974a5700 1 -- 172.21.15.83:0/2287015492 shutdown_connections 2024-04-01T06:57:23.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.661+0000 7f04974a5700 1 --2- 172.21.15.83:0/2287015492 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f04901005d0 0x7f049010ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.661+0000 7f04974a5700 1 --2- 172.21.15.83:0/2287015492 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0490105cd0 0x7f04901060b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.661+0000 7f04974a5700 1 --2- 172.21.15.83:0/2287015492 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f04900ffc10 0x7f0490100090 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.661+0000 7f04974a5700 1 -- 172.21.15.83:0/2287015492 >> 172.21.15.83:0/2287015492 conn(0x7f0490076d20 msgr2=0x7f0490077130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:23.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.662+0000 7f04974a5700 1 -- 172.21.15.83:0/2287015492 shutdown_connections 2024-04-01T06:57:23.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.662+0000 7f04974a5700 1 -- 172.21.15.83:0/2287015492 wait complete. 2024-04-01T06:57:23.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.662+0000 7f04974a5700 1 Processor -- start 2024-04-01T06:57:23.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.662+0000 7f04974a5700 1 -- start start 2024-04-01T06:57:23.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.663+0000 7f04974a5700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f04900ffc10 0x7f04901971a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:23.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.663+0000 7f04974a5700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f04901005d0 0x7f04901976e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:23.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.663+0000 7f04974a5700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0490105cd0 0x7f049019ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:23.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.663+0000 7f04974a5700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f049019c0c0 con 0x7f04900ffc10 2024-04-01T06:57:23.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.663+0000 7f04974a5700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f049019c230 con 0x7f04901005d0 2024-04-01T06:57:23.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.663+0000 7f04974a5700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f049019c3f0 con 0x7f0490105cd0 2024-04-01T06:57:23.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.663+0000 7f0495a42700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0490105cd0 0x7f049019ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:23.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.663+0000 7f0495241700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f04900ffc10 0x7f04901971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:23.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.663+0000 7f0495a42700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0490105cd0 0x7f049019ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.83:33198/0 (socket says 172.21.15.83:33198) 2024-04-01T06:57:23.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.663+0000 7f0495a42700 1 -- 172.21.15.83:0/2976485128 learned_addr learned my addr 172.21.15.83:0/2976485128 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:23.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.663+0000 7f0495a42700 1 -- 172.21.15.83:0/2976485128 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f04901005d0 msgr2=0x7f04901976e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:23.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.663+0000 7f0495a42700 1 --2- 172.21.15.83:0/2976485128 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f04901005d0 0x7f04901976e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.663+0000 7f0495a42700 1 -- 172.21.15.83:0/2976485128 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f04900ffc10 msgr2=0x7f04901971a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:23.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.663+0000 7f0495a42700 1 --2- 172.21.15.83:0/2976485128 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f04900ffc10 0x7f04901971a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.663+0000 7f0495a42700 1 -- 172.21.15.83:0/2976485128 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04800095f0 con 0x7f0490105cd0 2024-04-01T06:57:23.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.664+0000 7f0495a42700 1 --2- 172.21.15.83:0/2976485128 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0490105cd0 0x7f049019ba80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0488009f60 tx=0x7f0488009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:23.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.664+0000 7f04867fc700 1 -- 172.21.15.83:0/2976485128 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0488010970 con 0x7f0490105cd0 2024-04-01T06:57:23.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.664+0000 7f04974a5700 1 -- 172.21.15.83:0/2976485128 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f049019c6d0 con 0x7f0490105cd0 2024-04-01T06:57:23.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.664+0000 7f04974a5700 1 -- 172.21.15.83:0/2976485128 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04901019d0 con 0x7f0490105cd0 2024-04-01T06:57:23.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.664+0000 7f04867fc700 1 -- 172.21.15.83:0/2976485128 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0488018440 con 0x7f0490105cd0 2024-04-01T06:57:23.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.664+0000 7f04867fc700 1 -- 172.21.15.83:0/2976485128 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04880165a0 con 0x7f0490105cd0 2024-04-01T06:57:23.670 INFO:tasks.workunit.client.0.smithi083.stdout:4/12: fdatasync d1/f2 0 2024-04-01T06:57:23.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.668+0000 7f04867fc700 1 -- 172.21.15.83:0/2976485128 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) v1 ==== 136098+0+0 (secure 0 0 0) 0x7f0488010ad0 con 0x7f0490105cd0 2024-04-01T06:57:23.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.669+0000 7f04867fc700 1 --2- 172.21.15.83:0/2976485128 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f047c0a1430 0x7f047c0a38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:23.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.669+0000 7f04867fc700 1 -- 172.21.15.83:0/2976485128 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f04880d0230 con 0x7f0490105cd0 2024-04-01T06:57:23.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.670+0000 7f04a363bb80 1 Processor -- start 2024-04-01T06:57:23.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.670+0000 7f04a363bb80 1 -- start start 2024-04-01T06:57:23.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.671+0000 7f04a363bb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bc2343d5d0 0x55bc2343d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:23.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.671+0000 7f04a363bb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc2343def0 0x55bc234510c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:23.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.671+0000 7f04a363bb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bc23451600 0x55bc234539f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:23.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.671+0000 7f04a363bb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc23396990 con 0x55bc2343d5d0 2024-04-01T06:57:23.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.671+0000 7f04a363bb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc23394350 con 0x55bc23451600 2024-04-01T06:57:23.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.671+0000 7f04a363bb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc2338fc40 con 0x55bc2343def0 2024-04-01T06:57:23.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.671+0000 7f0495241700 1 --2- 172.21.15.83:0/2976485128 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f047c0a1430 0x7f047c0a38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:23.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.671+0000 7f0494a40700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc2343def0 0x55bc234510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:23.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.671+0000 7f0494a40700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc2343def0 0x55bc234510c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.83:33206/0 (socket says 172.21.15.83:33206) 2024-04-01T06:57:23.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.671+0000 7f0494a40700 1 -- 172.21.15.83:0/2702792010 learned_addr learned my addr 172.21.15.83:0/2702792010 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:23.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.672+0000 7f0495241700 1 --2- 172.21.15.83:0/2702792010 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bc2343d5d0 0x55bc2343d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:23.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.672+0000 7f0495241700 1 --2- 172.21.15.83:0/2976485128 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f047c0a1430 0x7f047c0a38f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f048c009550 tx=0x7f048c007b00 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:23.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.672+0000 7f0495241700 1 -- 172.21.15.83:0/2702792010 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc2343def0 msgr2=0x55bc234510c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:23.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.672+0000 7f0495241700 1 --2- 172.21.15.83:0/2702792010 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc2343def0 0x55bc234510c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.672+0000 7f0495241700 1 -- 172.21.15.83:0/2702792010 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bc23451600 msgr2=0x55bc234539f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:23.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.672+0000 7f0495241700 1 --2- 172.21.15.83:0/2702792010 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bc23451600 0x55bc234539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.672+0000 7f0495241700 1 -- 172.21.15.83:0/2702792010 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc232113b0 con 0x55bc2343d5d0 2024-04-01T06:57:23.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.673+0000 7f0495241700 1 --2- 172.21.15.83:0/2702792010 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bc2343d5d0 0x55bc2343d9b0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f048c0099d0 tx=0x7f048c01d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d86543a95ee8b9f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:23.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.673+0000 7f047b7fe700 1 -- 172.21.15.83:0/2702792010 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048c026070 con 0x55bc2343d5d0 2024-04-01T06:57:23.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.673+0000 7f047b7fe700 1 -- 172.21.15.83:0/2702792010 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f048c01e070 con 0x55bc2343d5d0 2024-04-01T06:57:23.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.674+0000 7f047b7fe700 1 -- 172.21.15.83:0/2702792010 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048c022800 con 0x55bc2343d5d0 2024-04-01T06:57:23.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.675+0000 7f04a363bb80 1 -- 172.21.15.83:0/2702792010 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bc2343d5d0 msgr2=0x55bc2343d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:23.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.675+0000 7f04a363bb80 1 --2- 172.21.15.83:0/2702792010 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bc2343d5d0 0x55bc2343d9b0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f048c0099d0 tx=0x7f048c01d000 comp rx=0 tx=0).stop 2024-04-01T06:57:23.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.675+0000 7f04a363bb80 1 -- 172.21.15.83:0/2702792010 shutdown_connections 2024-04-01T06:57:23.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.675+0000 7f04a363bb80 1 --2- 172.21.15.83:0/2702792010 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bc2343d5d0 0x55bc2343d9b0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.675+0000 7f04a363bb80 1 --2- 172.21.15.83:0/2702792010 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bc23451600 0x55bc234539f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.675+0000 7f04a363bb80 1 --2- 172.21.15.83:0/2702792010 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc2343def0 0x55bc234510c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.675+0000 7f04a363bb80 1 -- 172.21.15.83:0/2702792010 >> 172.21.15.83:0/2702792010 conn(0x55bc2339d6a0 msgr2=0x55bc23439a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:23.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.675+0000 7f04a363bb80 1 -- 172.21.15.83:0/2702792010 shutdown_connections 2024-04-01T06:57:23.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.675+0000 7f04a363bb80 1 -- 172.21.15.83:0/2702792010 wait complete. 2024-04-01T06:57:23.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.675+0000 7f04a363bb80 1 -- start start 2024-04-01T06:57:23.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.675+0000 7f04a363bb80 1 Processor -- start 2024-04-01T06:57:23.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.676+0000 7f04a363bb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc2343d5d0 0x55bc2344ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:23.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.676+0000 7f04a363bb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bc2343def0 0x55bc2344b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:23.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.676+0000 7f04a363bb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bc23451600 0x55bc23450920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:23.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.676+0000 7f04a363bb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc2332bd80 con 0x55bc23451600 2024-04-01T06:57:23.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.676+0000 7f04a363bb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc2332ba20 con 0x55bc2343def0 2024-04-01T06:57:23.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.676+0000 7f04a363bb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc232136a0 con 0x55bc2343d5d0 2024-04-01T06:57:23.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.676+0000 7f04a363bb80 10 client.0 _ll_register_callbacks cb 0x55bc23335470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:57:23.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.676+0000 7f0495a42700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bc23451600 0x55bc23450920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:23.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.676+0000 7f0495a42700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bc23451600 0x55bc23450920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57254/0 (socket says 172.21.15.83:57254) 2024-04-01T06:57:23.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.676+0000 7f0495a42700 1 -- 172.21.15.83:0/2069609370 learned_addr learned my addr 172.21.15.83:0/2069609370 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:23.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.676+0000 7f0495241700 1 --2- 172.21.15.83:0/2069609370 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc2343d5d0 0x55bc2344ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:23.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.677+0000 7f0494a40700 1 --2- 172.21.15.83:0/2069609370 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bc2343def0 0x55bc2344b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:23.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.677+0000 7f0495a42700 1 -- 172.21.15.83:0/2069609370 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc2343d5d0 msgr2=0x55bc2344ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:23.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.677+0000 7f0495a42700 1 --2- 172.21.15.83:0/2069609370 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc2343d5d0 0x55bc2344ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.677+0000 7f0495a42700 1 -- 172.21.15.83:0/2069609370 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bc2343def0 msgr2=0x55bc2344b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:23.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.677+0000 7f0495a42700 1 --2- 172.21.15.83:0/2069609370 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bc2343def0 0x55bc2344b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.677+0000 7f0495a42700 1 -- 172.21.15.83:0/2069609370 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f048c011040 con 0x55bc23451600 2024-04-01T06:57:23.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.677+0000 7f0495a42700 1 --2- 172.21.15.83:0/2069609370 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bc23451600 0x55bc23450920 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f048800b520 tx=0x7f048809d740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58840c2d28682f0c server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:23.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.677+0000 7f0478ff9700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:57:23.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.677+0000 7f0478ff9700 1 -- 172.21.15.83:0/2069609370 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04880a1030 con 0x55bc23451600 2024-04-01T06:57:23.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.677+0000 7f04a363bb80 1 -- 172.21.15.83:0/2069609370 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bc23350380 con 0x55bc23451600 2024-04-01T06:57:23.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.677+0000 7f0478ff9700 1 -- 172.21.15.83:0/2069609370 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f04880a5680 con 0x55bc23451600 2024-04-01T06:57:23.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.677+0000 7f0478ff9700 1 -- 172.21.15.83:0/2069609370 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f04880a51f0 con 0x55bc23451600 2024-04-01T06:57:23.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.677+0000 7f04a363bb80 10 client.15930 fetch_fsmap learned FSMap version 26 2024-04-01T06:57:23.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.677+0000 7f04a363bb80 1 -- 172.21.15.83:0/2069609370 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55bc231bdb60 con 0x55bc23451600 2024-04-01T06:57:23.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.678+0000 7f0478ff9700 1 -- 172.21.15.83:0/2069609370 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55bc23350380 con 0x55bc23451600 2024-04-01T06:57:23.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.678+0000 7f0478ff9700 1 -- 172.21.15.83:0/2069609370 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f04880a0070 con 0x55bc23451600 2024-04-01T06:57:23.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.678+0000 7f04a363bb80 10 client.15930 fetch_fsmap finished waiting for FSMap version 26 2024-04-01T06:57:23.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.678+0000 7f04a363bb80 10 client.15930 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-01T06:57:23.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.678+0000 7f04a363bb80 20 client.15930 populate_metadata read hostname 'smithi083' 2024-04-01T06:57:23.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.678+0000 7f04a363bb80 1 --2- 172.21.15.83:0/2069609370 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55bc23469bb0 0x55bc2346bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:23.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.678+0000 7f04a363bb80 4 client.15930 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-01T06:57:23.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.678+0000 7f04a363bb80 1 -- 172.21.15.83:0/2069609370 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bc23388700 con 0x55bc23469bb0 2024-04-01T06:57:23.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.685+0000 7f0495241700 1 --2- 172.21.15.83:0/2069609370 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55bc23469bb0 0x55bc2346bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:23.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.688+0000 7f0478ff9700 10 client.15930 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:57:23.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.688+0000 7f0495241700 1 --2- 172.21.15.83:0/2069609370 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55bc23469bb0 0x55bc2346bfd0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=263836bf50443ab6 server_cookie=8f7b7bab29fc9f26 in_seq=0 out_seq=0 2024-04-01T06:57:23.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.691+0000 7f0478ff9700 1 -- 172.21.15.83:0/2069609370 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55bc23388700 con 0x55bc23469bb0 2024-04-01T06:57:23.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.691+0000 7f0478ff9700 10 client.15930 handle_command_reply: tid=0 2024-04-01T06:57:23.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.691+0000 7f04a363bb80 1 client.15930 shutdown 2024-04-01T06:57:23.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.691+0000 7f04a363bb80 1 -- 172.21.15.83:0/2069609370 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bc23451600 msgr2=0x55bc23450920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:23.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.691+0000 7f04a363bb80 1 --2- 172.21.15.83:0/2069609370 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bc23451600 0x55bc23450920 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f048800b520 tx=0x7f048809d740 comp rx=0 tx=0).stop 2024-04-01T06:57:23.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.691+0000 7f04a363bb80 1 -- 172.21.15.83:0/2069609370 shutdown_connections 2024-04-01T06:57:23.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.691+0000 7f04a363bb80 1 --2- 172.21.15.83:0/2069609370 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55bc23469bb0 0x55bc2346bfd0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.691+0000 7f04a363bb80 1 --2- 172.21.15.83:0/2069609370 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bc23451600 0x55bc23450920 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.691+0000 7f04a363bb80 1 --2- 172.21.15.83:0/2069609370 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc2343d5d0 0x55bc2344ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.691+0000 7f04a363bb80 1 --2- 172.21.15.83:0/2069609370 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bc2343def0 0x55bc2344b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.691+0000 7f04a363bb80 1 -- 172.21.15.83:0/2069609370 >> 172.21.15.83:0/2069609370 conn(0x55bc2339d6a0 msgr2=0x55bc2343f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:23.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.691+0000 7f0478ff9700 0 client.15930 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:57:23.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.691+0000 7f04a363bb80 1 -- 172.21.15.83:0/2069609370 shutdown_connections 2024-04-01T06:57:23.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.692+0000 7f04a363bb80 1 -- 172.21.15.83:0/2069609370 wait complete. 2024-04-01T06:57:23.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.692+0000 7f04a363bb80 20 client.15930 trim_cache size 0 max 16384 2024-04-01T06:57:23.693 INFO:tasks.workunit.client.0.smithi083.stdout:3/8: fsync f0 0 2024-04-01T06:57:23.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.712+0000 7f04a363bb80 1 Processor -- start 2024-04-01T06:57:23.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.713+0000 7f04a363bb80 1 -- start start 2024-04-01T06:57:23.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.713+0000 7f04a363bb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc2343d5d0 0x55bc234325a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:23.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.713+0000 7f04a363bb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bc2343def0 0x55bc23444830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:23.714 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.713+0000 7f04a363bb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bc23451600 0x55bc23444d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:23.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.713+0000 7f04a363bb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc23447560 con 0x55bc23451600 2024-04-01T06:57:23.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.713+0000 7f04a363bb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc2343f4d0 con 0x55bc2343def0 2024-04-01T06:57:23.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.713+0000 7f04a363bb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc2343f140 con 0x55bc2343d5d0 2024-04-01T06:57:23.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.713+0000 7f0495241700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc2343d5d0 0x55bc234325a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:23.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.713+0000 7f0495241700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc2343d5d0 0x55bc234325a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.83:33216/0 (socket says 172.21.15.83:33216) 2024-04-01T06:57:23.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.713+0000 7f0495241700 1 -- 172.21.15.83:0/554555934 learned_addr learned my addr 172.21.15.83:0/554555934 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:23.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.714+0000 7f0495a42700 1 --2- 172.21.15.83:0/554555934 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bc23451600 0x55bc23444d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:23.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.714+0000 7f0494a40700 1 --2- 172.21.15.83:0/554555934 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bc2343def0 0x55bc23444830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:23.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.714+0000 7f0495241700 1 -- 172.21.15.83:0/554555934 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bc2343def0 msgr2=0x55bc23444830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:23.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.714+0000 7f0495241700 1 --2- 172.21.15.83:0/554555934 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bc2343def0 0x55bc23444830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.714+0000 7f0495241700 1 -- 172.21.15.83:0/554555934 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bc23451600 msgr2=0x55bc23444d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:23.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.714+0000 7f0495241700 1 --2- 172.21.15.83:0/554555934 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bc23451600 0x55bc23444d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.714+0000 7f0495241700 1 -- 172.21.15.83:0/554555934 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc23355ea0 con 0x55bc2343d5d0 2024-04-01T06:57:23.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.714+0000 7f0494a40700 1 --2- 172.21.15.83:0/554555934 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bc2343def0 0x55bc23444830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:57:23.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.714+0000 7f0495a42700 1 --2- 172.21.15.83:0/554555934 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bc23451600 0x55bc23444d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:57:23.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.714+0000 7f0495241700 1 --2- 172.21.15.83:0/554555934 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc2343d5d0 0x55bc234325a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f048c000f80 tx=0x7f048c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb689de9550f8322 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:23.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.714+0000 7f047bfff700 1 -- 172.21.15.83:0/554555934 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048c031070 con 0x55bc2343d5d0 2024-04-01T06:57:23.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.714+0000 7f047bfff700 1 -- 172.21.15.83:0/554555934 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f048c027040 con 0x55bc2343d5d0 2024-04-01T06:57:23.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.714+0000 7f047bfff700 1 -- 172.21.15.83:0/554555934 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048c026040 con 0x55bc2343d5d0 2024-04-01T06:57:23.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.715+0000 7f04a363bb80 1 -- 172.21.15.83:0/554555934 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc2343d5d0 msgr2=0x55bc234325a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:23.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.715+0000 7f04a363bb80 1 --2- 172.21.15.83:0/554555934 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc2343d5d0 0x55bc234325a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f048c000f80 tx=0x7f048c00b040 comp rx=0 tx=0).stop 2024-04-01T06:57:23.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.715+0000 7f04a363bb80 1 -- 172.21.15.83:0/554555934 shutdown_connections 2024-04-01T06:57:23.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.715+0000 7f04a363bb80 1 --2- 172.21.15.83:0/554555934 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bc23451600 0x55bc23444d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.715+0000 7f04a363bb80 1 --2- 172.21.15.83:0/554555934 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc2343d5d0 0x55bc234325a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.716+0000 7f04a363bb80 1 --2- 172.21.15.83:0/554555934 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bc2343def0 0x55bc23444830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.716+0000 7f04a363bb80 1 -- 172.21.15.83:0/554555934 >> 172.21.15.83:0/554555934 conn(0x55bc2339d6a0 msgr2=0x55bc234457f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:23.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.716+0000 7f04a363bb80 1 -- 172.21.15.83:0/554555934 shutdown_connections 2024-04-01T06:57:23.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.716+0000 7f04a363bb80 1 -- 172.21.15.83:0/554555934 wait complete. 2024-04-01T06:57:23.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.716+0000 7f04a363bb80 1 -- start start 2024-04-01T06:57:23.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.716+0000 7f04a363bb80 1 Processor -- start 2024-04-01T06:57:23.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.716+0000 7f04a363bb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bc2343d5d0 0x55bc2344e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:23.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.716+0000 7f04a363bb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc2343def0 0x55bc2344e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:23.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.716+0000 7f04a363bb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bc23451600 0x55bc234bc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:23.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.717+0000 7f04a363bb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc2344f150 con 0x55bc23451600 2024-04-01T06:57:23.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.717+0000 7f04a363bb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc234bcee0 con 0x55bc2343d5d0 2024-04-01T06:57:23.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.717+0000 7f04a363bb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc234bd020 con 0x55bc2343def0 2024-04-01T06:57:23.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.717+0000 7f04a363bb80 10 client.0 _ll_register_callbacks cb 0x55bc23335470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:57:23.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.717+0000 7f0495241700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bc2343d5d0 0x55bc2344e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:23.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.717+0000 7f0495241700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bc2343d5d0 0x55bc2344e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.83:46900/0 (socket says 172.21.15.83:46900) 2024-04-01T06:57:23.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.717+0000 7f0495241700 1 -- 172.21.15.83:0/3450497429 learned_addr learned my addr 172.21.15.83:0/3450497429 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:23.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.717+0000 7f0495241700 1 -- 172.21.15.83:0/3450497429 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc2343def0 msgr2=0x55bc2344e870 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-01T06:57:23.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.717+0000 7f0495241700 1 --2- 172.21.15.83:0/3450497429 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc2343def0 0x55bc2344e870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.717+0000 7f0495241700 1 -- 172.21.15.83:0/3450497429 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bc23451600 msgr2=0x55bc234bc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:23.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.717+0000 7f0495241700 1 --2- 172.21.15.83:0/3450497429 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bc23451600 0x55bc234bc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.717+0000 7f0495241700 1 -- 172.21.15.83:0/3450497429 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bc232113b0 con 0x55bc2343d5d0 2024-04-01T06:57:23.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.717+0000 7f0495241700 1 --2- 172.21.15.83:0/3450497429 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bc2343d5d0 0x55bc2344e330 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f048c006130 tx=0x7f048c004e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aec8d8464cbd585b server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:23.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.717+0000 7f0478ff9700 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-04-01T06:57:23.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.718+0000 7f0478ff9700 1 -- 172.21.15.83:0/3450497429 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048c031050 con 0x55bc2343d5d0 2024-04-01T06:57:23.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.718+0000 7f0478ff9700 1 -- 172.21.15.83:0/3450497429 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f048c0175b0 con 0x55bc2343d5d0 2024-04-01T06:57:23.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.718+0000 7f04a363bb80 1 -- 172.21.15.83:0/3450497429 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f048c01e070 con 0x55bc2343d5d0 2024-04-01T06:57:23.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.718+0000 7f0478ff9700 1 -- 172.21.15.83:0/3450497429 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f048c026040 con 0x55bc2343d5d0 2024-04-01T06:57:23.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.718+0000 7f04a363bb80 10 client.25430 fetch_fsmap learned FSMap version 26 2024-04-01T06:57:23.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.718+0000 7f04a363bb80 1 -- 172.21.15.83:0/3450497429 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55bc23215cd0 con 0x55bc2343d5d0 2024-04-01T06:57:23.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.718+0000 7f0478ff9700 1 -- 172.21.15.83:0/3450497429 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f048c01e070 con 0x55bc2343d5d0 2024-04-01T06:57:23.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.718+0000 7f0478ff9700 1 -- 172.21.15.83:0/3450497429 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f048c03b9e0 con 0x55bc2343d5d0 2024-04-01T06:57:23.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.718+0000 7f04a363bb80 10 client.25430 fetch_fsmap finished waiting for FSMap version 26 2024-04-01T06:57:23.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.718+0000 7f04a363bb80 10 client.25430 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-01T06:57:23.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.718+0000 7f04a363bb80 20 client.25430 populate_metadata read hostname 'smithi083' 2024-04-01T06:57:23.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.718+0000 7f04a363bb80 1 --2- 172.21.15.83:0/3450497429 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55bc234be460 0x55bc234c0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:23.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.718+0000 7f04a363bb80 4 client.25430 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-01T06:57:23.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.718+0000 7f04a363bb80 1 -- 172.21.15.83:0/3450497429 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55bc231decf0 con 0x55bc234be460 2024-04-01T06:57:23.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.719+0000 7f0494a40700 1 --2- 172.21.15.83:0/3450497429 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55bc234be460 0x55bc234c0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:23.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.719+0000 7f0478ff9700 10 client.25430 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:57:23.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.719+0000 7f0494a40700 1 --2- 172.21.15.83:0/3450497429 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55bc234be460 0x55bc234c0880 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e1ef6c90d3cd34c server_cookie=dced15f32ec765fe in_seq=0 out_seq=0 2024-04-01T06:57:23.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.721+0000 7f0478ff9700 1 -- 172.21.15.83:0/3450497429 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+266 (crc 0 0 0) 0x55bc231decf0 con 0x55bc234be460 2024-04-01T06:57:23.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.721+0000 7f0478ff9700 10 client.25430 handle_command_reply: tid=0 2024-04-01T06:57:23.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.721+0000 7f04a363bb80 1 client.25430 shutdown 2024-04-01T06:57:23.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.722+0000 7f04a363bb80 1 -- 172.21.15.83:0/3450497429 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bc2343d5d0 msgr2=0x55bc2344e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:23.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.722+0000 7f04a363bb80 1 --2- 172.21.15.83:0/3450497429 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bc2343d5d0 0x55bc2344e330 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f048c006130 tx=0x7f048c004e50 comp rx=0 tx=0).stop 2024-04-01T06:57:23.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.723+0000 7f04a363bb80 1 -- 172.21.15.83:0/3450497429 shutdown_connections 2024-04-01T06:57:23.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.723+0000 7f04a363bb80 1 --2- 172.21.15.83:0/3450497429 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55bc234be460 0x55bc234c0880 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.723+0000 7f04a363bb80 1 --2- 172.21.15.83:0/3450497429 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55bc23451600 0x55bc234bc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.723+0000 7f0478ff9700 0 client.25430 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:57:23.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.723+0000 7f04a363bb80 1 --2- 172.21.15.83:0/3450497429 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bc2343d5d0 0x55bc2344e330 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.723+0000 7f04a363bb80 1 --2- 172.21.15.83:0/3450497429 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bc2343def0 0x55bc2344e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.723+0000 7f04a363bb80 1 -- 172.21.15.83:0/3450497429 >> 172.21.15.83:0/3450497429 conn(0x55bc2339d6a0 msgr2=0x55bc234325a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:23.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.724+0000 7f04a363bb80 1 -- 172.21.15.83:0/3450497429 shutdown_connections 2024-04-01T06:57:23.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.724+0000 7f04a363bb80 1 -- 172.21.15.83:0/3450497429 wait complete. 2024-04-01T06:57:23.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.724+0000 7f04a363bb80 20 client.25430 trim_cache size 0 max 16384 2024-04-01T06:57:23.726 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-04-01T06:57:23.726 INFO:teuthology.orchestra.run.smithi083.stdout: "status": "scrub active (16 inodes in the stack)", 2024-04-01T06:57:23.726 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubs": { 2024-04-01T06:57:23.726 INFO:teuthology.orchestra.run.smithi083.stdout: "0f72e254-c91a-40c1-b6a5-6d116ce4248a": { 2024-04-01T06:57:23.726 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/", 2024-04-01T06:57:23.726 INFO:teuthology.orchestra.run.smithi083.stdout: "tag": "0f72e254-c91a-40c1-b6a5-6d116ce4248a", 2024-04-01T06:57:23.726 INFO:teuthology.orchestra.run.smithi083.stdout: "options": "recursive,force" 2024-04-01T06:57:23.726 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T06:57:23.726 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T06:57:23.726 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-04-01T06:57:23.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.724+0000 7f04974a5700 1 -- 172.21.15.83:0/2976485128 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f047c0a1430 msgr2=0x7f047c0a38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:23.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.724+0000 7f04974a5700 1 --2- 172.21.15.83:0/2976485128 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f047c0a1430 0x7f047c0a38f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f048c009550 tx=0x7f048c007b00 comp rx=0 tx=0).stop 2024-04-01T06:57:23.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.724+0000 7f04974a5700 1 -- 172.21.15.83:0/2976485128 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0490105cd0 msgr2=0x7f049019ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:23.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.724+0000 7f04974a5700 1 --2- 172.21.15.83:0/2976485128 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0490105cd0 0x7f049019ba80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0488009f60 tx=0x7f0488009f90 comp rx=0 tx=0).stop 2024-04-01T06:57:23.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.724+0000 7f04974a5700 1 -- 172.21.15.83:0/2976485128 shutdown_connections 2024-04-01T06:57:23.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.724+0000 7f04974a5700 1 --2- 172.21.15.83:0/2976485128 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f047c0a1430 0x7f047c0a38f0 secure :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f048c009550 tx=0x7f048c007b00 comp rx=0 tx=0).stop 2024-04-01T06:57:23.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.724+0000 7f04974a5700 1 --2- 172.21.15.83:0/2976485128 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f04900ffc10 0x7f04901971a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.724+0000 7f04974a5700 1 --2- 172.21.15.83:0/2976485128 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0490105cd0 0x7f049019ba80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.724+0000 7f04974a5700 1 --2- 172.21.15.83:0/2976485128 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f04901005d0 0x7f04901976e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:23.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.724+0000 7f04974a5700 1 -- 172.21.15.83:0/2976485128 >> 172.21.15.83:0/2976485128 conn(0x7f0490076d20 msgr2=0x7f0490069470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:23.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.726+0000 7f04974a5700 1 -- 172.21.15.83:0/2976485128 shutdown_connections 2024-04-01T06:57:23.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:23.726+0000 7f04974a5700 1 -- 172.21.15.83:0/2976485128 wait complete. 2024-04-01T06:57:23.729 INFO:tasks.workunit.client.0.smithi083.stdout:4/13: dwrite d1/f2 [0,4194304] 0 2024-04-01T06:57:23.745 INFO:tasks.cephfs.filesystem:scrub status for tag:0f72e254-c91a-40c1-b6a5-6d116ce4248a - {'path': '/', 'tag': '0f72e254-c91a-40c1-b6a5-6d116ce4248a', 'options': 'recursive,force'} 2024-04-01T06:57:23.753 INFO:tasks.workunit.client.0.smithi083.stdout:4/14: dread d1/f2 [0,4194304] 0 2024-04-01T06:57:23.753 INFO:tasks.workunit.client.0.smithi083.stdout:4/15: chown d1 216 1 2024-04-01T06:57:23.753 INFO:tasks.workunit.client.0.smithi083.stdout:4/16: chown d1/f2 171 1 2024-04-01T06:57:23.779 INFO:tasks.workunit.client.0.smithi083.stdout:4/17: dwrite d1/f2 [0,4194304] 0 2024-04-01T06:57:24.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:23 smithi083 ceph-mon[43429]: pgmap v49: 97 pgs: 97 active+clean; 36 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.0 MiB/s wr, 1.52k op/s 2024-04-01T06:57:24.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:23 smithi153 ceph-mon[48187]: pgmap v49: 97 pgs: 97 active+clean; 36 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.0 MiB/s wr, 1.52k op/s 2024-04-01T06:57:24.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:23 smithi145 ceph-mon[47816]: pgmap v49: 97 pgs: 97 active+clean; 36 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.0 MiB/s wr, 1.52k op/s 2024-04-01T06:57:25.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:24 smithi153 ceph-mon[48187]: scrub queued for path: / 2024-04-01T06:57:25.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:24 smithi153 ceph-mon[48187]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:25.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:24 smithi153 ceph-mon[48187]: scrub summary: active paths [/] 2024-04-01T06:57:25.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:24 smithi145 ceph-mon[47816]: scrub queued for path: / 2024-04-01T06:57:25.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:24 smithi145 ceph-mon[47816]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:25.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:24 smithi145 ceph-mon[47816]: scrub summary: active paths [/] 2024-04-01T06:57:25.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:24 smithi083 ceph-mon[43429]: scrub queued for path: / 2024-04-01T06:57:25.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:24 smithi083 ceph-mon[43429]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:25.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:24 smithi083 ceph-mon[43429]: scrub summary: active paths [/] 2024-04-01T06:57:27.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:26 smithi145 ceph-mon[47816]: pgmap v50: 97 pgs: 97 active+clean; 104 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 8.4 MiB/s wr, 1.96k op/s 2024-04-01T06:57:27.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:26 smithi083 ceph-mon[43429]: pgmap v50: 97 pgs: 97 active+clean; 104 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 8.4 MiB/s wr, 1.96k op/s 2024-04-01T06:57:27.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:26 smithi153 ceph-mon[48187]: pgmap v50: 97 pgs: 97 active+clean; 104 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 8.4 MiB/s wr, 1.96k op/s 2024-04-01T06:57:27.889 INFO:tasks.workunit.client.0.smithi083.stdout:1/2: creat f1 x:0 0 0 2024-04-01T06:57:27.890 INFO:tasks.workunit.client.0.smithi083.stdout:1/3: truncate f1 667899 0 2024-04-01T06:57:27.917 INFO:tasks.workunit.client.0.smithi083.stdout:1/4: dwrite f1 [0,4194304] 0 2024-04-01T06:57:27.917 INFO:tasks.workunit.client.0.smithi083.stdout:1/5: rmdir - no directory 2024-04-01T06:57:28.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:27 smithi153 ceph-mon[48187]: mgrmap e25: x(active, since 93s), standbys: z, y 2024-04-01T06:57:28.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:27 smithi153 ceph-mon[48187]: pgmap v51: 97 pgs: 97 active+clean; 104 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.2 MiB/s wr, 1.86k op/s 2024-04-01T06:57:28.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:27 smithi145 ceph-mon[47816]: mgrmap e25: x(active, since 93s), standbys: z, y 2024-04-01T06:57:28.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:27 smithi145 ceph-mon[47816]: pgmap v51: 97 pgs: 97 active+clean; 104 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.2 MiB/s wr, 1.86k op/s 2024-04-01T06:57:28.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:27 smithi083 ceph-mon[43429]: mgrmap e25: x(active, since 93s), standbys: z, y 2024-04-01T06:57:28.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:27 smithi083 ceph-mon[43429]: pgmap v51: 97 pgs: 97 active+clean; 104 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.2 MiB/s wr, 1.86k op/s 2024-04-01T06:57:28.407 INFO:tasks.workunit.client.0.smithi083.stdout:8/18: rename l5 to l6 0 2024-04-01T06:57:28.499 INFO:tasks.workunit.client.0.smithi083.stdout:7/14: creat d0/d4/f5 x:0 0 0 2024-04-01T06:57:28.499 INFO:tasks.workunit.client.0.smithi083.stdout:7/15: dread - d0/d4/f5 zero size 2024-04-01T06:57:28.499 INFO:tasks.workunit.client.0.smithi083.stdout:7/16: fdatasync d0/f3 0 2024-04-01T06:57:28.499 INFO:tasks.workunit.client.0.smithi083.stdout:7/17: chown d0/d4 15976 1 2024-04-01T06:57:28.499 INFO:tasks.workunit.client.0.smithi083.stdout:7/18: fdatasync d0/d4/f5 0 2024-04-01T06:57:28.499 INFO:tasks.workunit.client.0.smithi083.stdout:7/19: chown d0/d4/f5 7 1 2024-04-01T06:57:28.502 INFO:tasks.workunit.client.0.smithi083.stdout:6/4: unlink l0 0 2024-04-01T06:57:28.502 INFO:tasks.workunit.client.0.smithi083.stdout:6/5: chown . 13181538 1 2024-04-01T06:57:28.502 INFO:tasks.workunit.client.0.smithi083.stdout:6/6: chown . 97 1 2024-04-01T06:57:28.502 INFO:tasks.workunit.client.0.smithi083.stdout:6/7: dwrite - no filename 2024-04-01T06:57:28.502 INFO:tasks.workunit.client.0.smithi083.stdout:6/8: dread - no filename 2024-04-01T06:57:28.615 INFO:tasks.workunit.client.0.smithi083.stdout:9/17: creat f5 x:0 0 0 2024-04-01T06:57:28.999 INFO:tasks.workunit.client.0.smithi083.stdout:2/4: creat f2 x:0 0 0 2024-04-01T06:57:29.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:28 smithi153 ceph-mon[48187]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-04-01T06:57:29.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:28 smithi145 ceph-mon[47816]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-04-01T06:57:29.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:28 smithi083 ceph-mon[43429]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-04-01T06:57:29.294 INFO:tasks.workunit.client.0.smithi083.stdout:3/9: rename f1 to f2 0 2024-04-01T06:57:29.294 INFO:tasks.workunit.client.0.smithi083.stdout:3/10: stat f2 0 2024-04-01T06:57:29.354 INFO:tasks.workunit.client.0.smithi083.stdout:4/18: creat d1/f3 x:0 0 0 2024-04-01T06:57:29.708 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.708+0000 7f36fac82700 1 -- 172.21.15.83:0/1956809835 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36f40680e0 msgr2=0x7f36f4068560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:29.708 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.708+0000 7f36fac82700 1 --2- 172.21.15.83:0/1956809835 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36f40680e0 0x7f36f4068560 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f36e0009990 tx=0x7f36e0009ca0 comp rx=0 tx=0).stop 2024-04-01T06:57:29.708 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.708+0000 7f36fac82700 1 -- 172.21.15.83:0/1956809835 shutdown_connections 2024-04-01T06:57:29.708 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.708+0000 7f36fac82700 1 --2- 172.21.15.83:0/1956809835 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f36f4068aa0 0x7f36f410dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:29.708 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.708+0000 7f36fac82700 1 --2- 172.21.15.83:0/1956809835 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36f4106e10 0x7f36f41071f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:29.708 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.708+0000 7f36fac82700 1 --2- 172.21.15.83:0/1956809835 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36f40680e0 0x7f36f4068560 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:29.708 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.708+0000 7f36fac82700 1 -- 172.21.15.83:0/1956809835 >> 172.21.15.83:0/1956809835 conn(0x7f36f4076d50 msgr2=0x7f36f4077160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:29.709 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.708+0000 7f36fac82700 1 -- 172.21.15.83:0/1956809835 shutdown_connections 2024-04-01T06:57:29.709 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.708+0000 7f36fac82700 1 -- 172.21.15.83:0/1956809835 wait complete. 2024-04-01T06:57:29.711 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.709+0000 7f36fac82700 1 Processor -- start 2024-04-01T06:57:29.711 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.709+0000 7f36fac82700 1 -- start start 2024-04-01T06:57:29.711 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.709+0000 7f36fac82700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f36f40680e0 0x7f36f4199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:29.711 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.709+0000 7f36fac82700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36f4068aa0 0x7f36f41997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:29.711 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.709+0000 7f36fac82700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36f4106e10 0x7f36f419db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:29.711 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.709+0000 7f36fac82700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f419e190 con 0x7f36f4106e10 2024-04-01T06:57:29.711 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.709+0000 7f36fac82700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f419e300 con 0x7f36f40680e0 2024-04-01T06:57:29.711 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.709+0000 7f36fac82700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f419e4c0 con 0x7f36f4068aa0 2024-04-01T06:57:29.711 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.709+0000 7f36f921f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36f4106e10 0x7f36f419db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:29.711 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.709+0000 7f36f8a1e700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f36f40680e0 0x7f36f4199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:29.711 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.709+0000 7f36f921f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36f4106e10 0x7f36f419db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57268/0 (socket says 172.21.15.83:57268) 2024-04-01T06:57:29.711 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.709+0000 7f36f921f700 1 -- 172.21.15.83:0/1301891147 learned_addr learned my addr 172.21.15.83:0/1301891147 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:29.712 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.710+0000 7f36f3fff700 1 --2- 172.21.15.83:0/1301891147 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36f4068aa0 0x7f36f41997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:29.712 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.710+0000 7f36f921f700 1 -- 172.21.15.83:0/1301891147 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36f4068aa0 msgr2=0x7f36f41997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:29.712 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.710+0000 7f36f921f700 1 --2- 172.21.15.83:0/1301891147 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36f4068aa0 0x7f36f41997b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:29.712 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.710+0000 7f36f921f700 1 -- 172.21.15.83:0/1301891147 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f36f40680e0 msgr2=0x7f36f4199270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:29.712 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.710+0000 7f36f921f700 1 --2- 172.21.15.83:0/1301891147 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f36f40680e0 0x7f36f4199270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:29.712 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.710+0000 7f36f921f700 1 -- 172.21.15.83:0/1301891147 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e00095f0 con 0x7f36f4106e10 2024-04-01T06:57:29.712 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.710+0000 7f36f921f700 1 --2- 172.21.15.83:0/1301891147 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36f4106e10 0x7f36f419db50 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f36ec00ef30 tx=0x7f36ec00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:29.712 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.710+0000 7f36f1ffb700 1 -- 172.21.15.83:0/1301891147 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec018070 con 0x7f36f4106e10 2024-04-01T06:57:29.712 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.710+0000 7f36fac82700 1 -- 172.21.15.83:0/1301891147 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36f419e740 con 0x7f36f4106e10 2024-04-01T06:57:29.712 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.710+0000 7f36f1ffb700 1 -- 172.21.15.83:0/1301891147 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f36ec00f040 con 0x7f36f4106e10 2024-04-01T06:57:29.712 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.710+0000 7f36f1ffb700 1 -- 172.21.15.83:0/1301891147 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec00cdb0 con 0x7f36f4106e10 2024-04-01T06:57:29.712 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.710+0000 7f36fac82700 1 -- 172.21.15.83:0/1301891147 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36f41a5fe0 con 0x7f36f4106e10 2024-04-01T06:57:29.713 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.712+0000 7f36f1ffb700 1 -- 172.21.15.83:0/1301891147 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 25) v1 ==== 135996+0+0 (secure 0 0 0) 0x7f36ec003a00 con 0x7f36f4106e10 2024-04-01T06:57:29.713 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.713+0000 7f36f1ffb700 1 --2- 172.21.15.83:0/1301891147 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f36e40a1290 0x7f36e40a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:29.713 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.713+0000 7f36f1ffb700 1 -- 172.21.15.83:0/1301891147 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f36ec0cc8a0 con 0x7f36f4106e10 2024-04-01T06:57:29.713 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.713+0000 7f36f8a1e700 1 --2- 172.21.15.83:0/1301891147 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f36e40a1290 0x7f36e40a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:29.714 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.713+0000 7f36f8a1e700 1 --2- 172.21.15.83:0/1301891147 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f36e40a1290 0x7f36e40a3750 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f36e800ac50 tx=0x7f36e800a380 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:29.719 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.714+0000 7f3706e18b80 1 Processor -- start 2024-04-01T06:57:29.719 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.714+0000 7f3706e18b80 1 -- start start 2024-04-01T06:57:29.719 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.714+0000 7f3706e18b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55876d79d100 0x55876d79d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:29.719 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.714+0000 7f3706e18b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55876d79da20 0x55876d7a8390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:29.720 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.714+0000 7f3706e18b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55876d7a88d0 0x55876d7aacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:29.720 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.714+0000 7f3706e18b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55876d6f6930 con 0x55876d79da20 2024-04-01T06:57:29.720 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.714+0000 7f3706e18b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55876d6f42f0 con 0x55876d79d100 2024-04-01T06:57:29.720 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.714+0000 7f3706e18b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55876d6efbe0 con 0x55876d7a88d0 2024-04-01T06:57:29.720 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.714+0000 7f36f8a1e700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55876d79d100 0x55876d79d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:29.720 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.714+0000 7f36f3fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55876d79da20 0x55876d7a8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:29.720 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.714+0000 7f36f8a1e700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55876d79d100 0x55876d79d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.83:46932/0 (socket says 172.21.15.83:46932) 2024-04-01T06:57:29.720 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.714+0000 7f36f8a1e700 1 -- 172.21.15.83:0/3618753363 learned_addr learned my addr 172.21.15.83:0/3618753363 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:29.720 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.715+0000 7f36f921f700 1 --2- 172.21.15.83:0/3618753363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55876d7a88d0 0x55876d7aacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:29.720 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.715+0000 7f36f8a1e700 1 -- 172.21.15.83:0/3618753363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55876d7a88d0 msgr2=0x55876d7aacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:29.720 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.715+0000 7f36f8a1e700 1 --2- 172.21.15.83:0/3618753363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55876d7a88d0 0x55876d7aacc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:29.720 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.715+0000 7f36f8a1e700 1 -- 172.21.15.83:0/3618753363 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55876d79da20 msgr2=0x55876d7a8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:29.720 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.715+0000 7f36f8a1e700 1 --2- 172.21.15.83:0/3618753363 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55876d79da20 0x55876d7a8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:29.720 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.715+0000 7f36f8a1e700 1 -- 172.21.15.83:0/3618753363 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55876d571350 con 0x55876d79d100 2024-04-01T06:57:29.721 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.715+0000 7f36f3fff700 1 --2- 172.21.15.83:0/3618753363 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55876d79da20 0x55876d7a8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T06:57:29.721 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.715+0000 7f36f921f700 1 --2- 172.21.15.83:0/3618753363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55876d7a88d0 0x55876d7aacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:57:29.721 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.715+0000 7f36f8a1e700 1 --2- 172.21.15.83:0/3618753363 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55876d79d100 0x55876d79d4e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f36e800ff90 tx=0x7f36e8012000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b31289ce3fe6184 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:29.721 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.715+0000 7f36deffd700 1 -- 172.21.15.83:0/3618753363 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e8003a90 con 0x55876d79d100 2024-04-01T06:57:29.721 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.715+0000 7f36deffd700 1 -- 172.21.15.83:0/3618753363 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f36e8003bf0 con 0x55876d79d100 2024-04-01T06:57:29.721 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.715+0000 7f36deffd700 1 -- 172.21.15.83:0/3618753363 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e801d660 con 0x55876d79d100 2024-04-01T06:57:29.721 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.716+0000 7f3706e18b80 1 -- 172.21.15.83:0/3618753363 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55876d79d100 msgr2=0x55876d79d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:29.721 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.716+0000 7f3706e18b80 1 --2- 172.21.15.83:0/3618753363 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55876d79d100 0x55876d79d4e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f36e800ff90 tx=0x7f36e8012000 comp rx=0 tx=0).stop 2024-04-01T06:57:29.721 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.716+0000 7f3706e18b80 1 -- 172.21.15.83:0/3618753363 shutdown_connections 2024-04-01T06:57:29.721 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.716+0000 7f3706e18b80 1 --2- 172.21.15.83:0/3618753363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55876d7a88d0 0x55876d7aacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:29.721 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.716+0000 7f3706e18b80 1 --2- 172.21.15.83:0/3618753363 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55876d79d100 0x55876d79d4e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:29.721 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.716+0000 7f3706e18b80 1 --2- 172.21.15.83:0/3618753363 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55876d79da20 0x55876d7a8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:29.721 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.716+0000 7f3706e18b80 1 -- 172.21.15.83:0/3618753363 >> 172.21.15.83:0/3618753363 conn(0x55876d6fd640 msgr2=0x55876d799520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:29.721 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.716+0000 7f3706e18b80 1 -- 172.21.15.83:0/3618753363 shutdown_connections 2024-04-01T06:57:29.722 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.716+0000 7f3706e18b80 1 -- 172.21.15.83:0/3618753363 wait complete. 2024-04-01T06:57:29.722 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.716+0000 7f3706e18b80 1 -- start start 2024-04-01T06:57:29.722 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.716+0000 7f3706e18b80 1 Processor -- start 2024-04-01T06:57:29.722 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.717+0000 7f3706e18b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55876d79d100 0x55876d7a8340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:29.722 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.717+0000 7f3706e18b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55876d79da20 0x55876d7a5680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:29.722 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.717+0000 7f3706e18b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55876d7a88d0 0x55876d7a5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:29.722 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.717+0000 7f3706e18b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55876d68bd20 con 0x55876d79d100 2024-04-01T06:57:29.722 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.717+0000 7f3706e18b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55876d68b9c0 con 0x55876d79da20 2024-04-01T06:57:29.722 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.717+0000 7f3706e18b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55876d573640 con 0x55876d7a88d0 2024-04-01T06:57:29.722 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.717+0000 7f3706e18b80 10 client.0 _ll_register_callbacks cb 0x55876d695410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:57:29.722 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.717+0000 7f36f8a1e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55876d79d100 0x55876d7a8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:29.722 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.717+0000 7f36f8a1e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55876d79d100 0x55876d7a8340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57284/0 (socket says 172.21.15.83:57284) 2024-04-01T06:57:29.722 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.717+0000 7f36f8a1e700 1 -- 172.21.15.83:0/4185526245 learned_addr learned my addr 172.21.15.83:0/4185526245 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:29.722 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.717+0000 7f36f3fff700 1 --2- 172.21.15.83:0/4185526245 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55876d79da20 0x55876d7a5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:29.723 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.717+0000 7f36f921f700 1 --2- 172.21.15.83:0/4185526245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55876d7a88d0 0x55876d7a5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:29.723 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.717+0000 7f36f8a1e700 1 -- 172.21.15.83:0/4185526245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55876d7a88d0 msgr2=0x55876d7a5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:29.723 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.717+0000 7f36f8a1e700 1 --2- 172.21.15.83:0/4185526245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55876d7a88d0 0x55876d7a5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:29.723 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.717+0000 7f36f8a1e700 1 -- 172.21.15.83:0/4185526245 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55876d79da20 msgr2=0x55876d7a5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:29.723 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.717+0000 7f36f8a1e700 1 --2- 172.21.15.83:0/4185526245 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55876d79da20 0x55876d7a5680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:29.723 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.717+0000 7f36f8a1e700 1 -- 172.21.15.83:0/4185526245 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36f410e440 con 0x55876d79d100 2024-04-01T06:57:29.723 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.717+0000 7f36f8a1e700 1 --2- 172.21.15.83:0/4185526245 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55876d79d100 0x55876d7a8340 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f36e800fa30 tx=0x7f36e8005720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dab063da7a191d78 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:29.723 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.717+0000 7f36d3fff700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:57:29.723 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.717+0000 7f36d3fff700 1 -- 172.21.15.83:0/4185526245 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e802b070 con 0x55876d79d100 2024-04-01T06:57:29.723 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.718+0000 7f3706e18b80 1 -- 172.21.15.83:0/4185526245 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55876d6b0320 con 0x55876d79d100 2024-04-01T06:57:29.723 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.718+0000 7f36d3fff700 1 -- 172.21.15.83:0/4185526245 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f36e8010430 con 0x55876d79d100 2024-04-01T06:57:29.723 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.718+0000 7f36d3fff700 1 -- 172.21.15.83:0/4185526245 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f36e80105f0 con 0x55876d79d100 2024-04-01T06:57:29.723 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.718+0000 7f3706e18b80 10 client.15945 fetch_fsmap learned FSMap version 27 2024-04-01T06:57:29.723 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.718+0000 7f3706e18b80 1 -- 172.21.15.83:0/4185526245 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f36e800fc40 con 0x55876d79d100 2024-04-01T06:57:29.724 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.718+0000 7f36d3fff700 1 -- 172.21.15.83:0/4185526245 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55876d6b0320 con 0x55876d79d100 2024-04-01T06:57:29.724 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.718+0000 7f36d3fff700 1 -- 172.21.15.83:0/4185526245 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f36e80253f0 con 0x55876d79d100 2024-04-01T06:57:29.724 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.718+0000 7f3706e18b80 10 client.15945 fetch_fsmap finished waiting for FSMap version 27 2024-04-01T06:57:29.724 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.718+0000 7f3706e18b80 10 client.15945 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-01T06:57:29.724 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.718+0000 7f3706e18b80 20 client.15945 populate_metadata read hostname 'smithi083' 2024-04-01T06:57:29.724 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.718+0000 7f3706e18b80 1 --2- 172.21.15.83:0/4185526245 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55876d7b8460 0x55876d7ba880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:29.724 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.718+0000 7f3706e18b80 4 client.15945 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-01T06:57:29.724 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.718+0000 7f3706e18b80 1 -- 172.21.15.83:0/4185526245 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55876d6e86a0 con 0x55876d7b8460 2024-04-01T06:57:29.724 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.718+0000 7f36f3fff700 1 --2- 172.21.15.83:0/4185526245 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55876d7b8460 0x55876d7ba880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:29.724 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.719+0000 7f36d3fff700 10 client.15945 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:57:29.724 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.719+0000 7f36f3fff700 1 --2- 172.21.15.83:0/4185526245 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55876d7b8460 0x55876d7ba880 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8dc6ca3634f27294 server_cookie=575e0ed8e2cab5f1 in_seq=0 out_seq=0 2024-04-01T06:57:29.833 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.832+0000 7f36d3fff700 1 -- 172.21.15.83:0/4185526245 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55876d6e86a0 con 0x55876d7b8460 2024-04-01T06:57:29.834 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.832+0000 7f36d3fff700 10 client.15945 handle_command_reply: tid=0 2024-04-01T06:57:29.834 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.832+0000 7f3706e18b80 1 client.15945 shutdown 2024-04-01T06:57:29.834 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.832+0000 7f3706e18b80 1 -- 172.21.15.83:0/4185526245 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55876d79d100 msgr2=0x55876d7a8340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:29.834 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.832+0000 7f3706e18b80 1 --2- 172.21.15.83:0/4185526245 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55876d79d100 0x55876d7a8340 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f36e800fa30 tx=0x7f36e8005720 comp rx=0 tx=0).stop 2024-04-01T06:57:29.834 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.832+0000 7f3706e18b80 1 -- 172.21.15.83:0/4185526245 shutdown_connections 2024-04-01T06:57:29.834 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.832+0000 7f3706e18b80 1 --2- 172.21.15.83:0/4185526245 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55876d7b8460 0x55876d7ba880 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:29.834 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.832+0000 7f3706e18b80 1 --2- 172.21.15.83:0/4185526245 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55876d79d100 0x55876d7a8340 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:29.834 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.832+0000 7f36d3fff700 0 client.15945 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:57:29.834 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.832+0000 7f3706e18b80 1 --2- 172.21.15.83:0/4185526245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55876d7a88d0 0x55876d7a5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:29.834 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.832+0000 7f3706e18b80 1 --2- 172.21.15.83:0/4185526245 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55876d79da20 0x55876d7a5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:29.834 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.832+0000 7f3706e18b80 1 -- 172.21.15.83:0/4185526245 >> 172.21.15.83:0/4185526245 conn(0x55876d6fd640 msgr2=0x55876d79f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:29.835 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.832+0000 7f3706e18b80 1 -- 172.21.15.83:0/4185526245 shutdown_connections 2024-04-01T06:57:29.835 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.832+0000 7f3706e18b80 1 -- 172.21.15.83:0/4185526245 wait complete. 2024-04-01T06:57:29.835 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.832+0000 7f3706e18b80 20 client.15945 trim_cache size 0 max 16384 2024-04-01T06:57:29.835 INFO:tasks.workunit.client.0.smithi083.stdout:1/6: creat f2 x:0 0 0 2024-04-01T06:57:29.837 INFO:tasks.workunit.client.0.smithi083.stdout:8/19: creat f7 x:0 0 0 2024-04-01T06:57:29.838 INFO:tasks.workunit.client.0.smithi083.stdout:7/20: creat d0/d4/f6 x:0 0 0 2024-04-01T06:57:29.839 INFO:tasks.workunit.client.0.smithi083.stdout:6/9: creat f1 x:0 0 0 2024-04-01T06:57:29.840 INFO:tasks.workunit.client.0.smithi083.stdout:9/18: mkdir d6 0 2024-04-01T06:57:29.840 INFO:tasks.workunit.client.0.smithi083.stdout:9/19: truncate f5 987624 0 2024-04-01T06:57:29.841 INFO:tasks.workunit.client.0.smithi083.stdout:2/5: mkdir d3 0 2024-04-01T06:57:29.841 INFO:tasks.workunit.client.0.smithi083.stdout:3/11: creat f3 x:0 0 0 2024-04-01T06:57:29.842 INFO:tasks.workunit.client.0.smithi083.stdout:4/19: mkdir d1/d4 0 2024-04-01T06:57:29.843 INFO:tasks.workunit.client.0.smithi083.stdout:4/20: write d1/f3 [865054,116924] 0 2024-04-01T06:57:29.843 INFO:tasks.workunit.client.0.smithi083.stdout:4/21: fsync d1/f2 0 2024-04-01T06:57:29.843 INFO:tasks.workunit.client.0.smithi083.stdout:1/7: rename f2 to f3 0 2024-04-01T06:57:29.844 INFO:tasks.workunit.client.0.smithi083.stdout:1/8: fdatasync f3 0 2024-04-01T06:57:29.845 INFO:tasks.workunit.client.0.smithi083.stdout:7/21: rename d0/d4/f6 to d0/f7 0 2024-04-01T06:57:29.845 INFO:tasks.workunit.client.0.smithi083.stdout:7/22: chown d0/d4 3208 1 2024-04-01T06:57:29.846 INFO:tasks.workunit.client.0.smithi083.stdout:6/10: creat f2 x:0 0 0 2024-04-01T06:57:29.848 INFO:tasks.workunit.client.0.smithi083.stdout:1/9: link f1 f4 0 2024-04-01T06:57:29.848 INFO:tasks.workunit.client.0.smithi083.stdout:1/10: write f3 [209810,47797] 0 2024-04-01T06:57:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.850+0000 7f3706e18b80 1 Processor -- start 2024-04-01T06:57:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.850+0000 7f3706e18b80 1 -- start start 2024-04-01T06:57:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.850+0000 7f3706e18b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55876d79d100 0x55876d7ba850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.850+0000 7f3706e18b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55876d79da20 0x55876d793500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.850+0000 7f3706e18b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55876d7a88d0 0x55876d79f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:29.851 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.850+0000 7f3706e18b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55876d795430 con 0x55876d79da20 2024-04-01T06:57:29.851 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.850+0000 7f3706e18b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55876d7a6370 con 0x55876d79d100 2024-04-01T06:57:29.851 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.850+0000 7f3706e18b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55876d7a6c00 con 0x55876d7a88d0 2024-04-01T06:57:29.851 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.850+0000 7f36f3fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55876d79da20 0x55876d793500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:29.851 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.851+0000 7f36f3fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55876d79da20 0x55876d793500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57300/0 (socket says 172.21.15.83:57300) 2024-04-01T06:57:29.851 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.851+0000 7f36f921f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55876d7a88d0 0x55876d79f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:29.851 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.851+0000 7f36f3fff700 1 -- 172.21.15.83:0/1759449309 learned_addr learned my addr 172.21.15.83:0/1759449309 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.851+0000 7f36f8a1e700 1 --2- 172.21.15.83:0/1759449309 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55876d79d100 0x55876d7ba850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.851+0000 7f36f3fff700 1 -- 172.21.15.83:0/1759449309 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55876d7a88d0 msgr2=0x55876d79f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.851+0000 7f36f3fff700 1 --2- 172.21.15.83:0/1759449309 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55876d7a88d0 0x55876d79f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.851+0000 7f36f3fff700 1 -- 172.21.15.83:0/1759449309 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55876d79d100 msgr2=0x55876d7ba850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.851+0000 7f36f3fff700 1 --2- 172.21.15.83:0/1759449309 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55876d79d100 0x55876d7ba850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.851+0000 7f36f3fff700 1 -- 172.21.15.83:0/1759449309 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55876d51db00 con 0x55876d79da20 2024-04-01T06:57:29.853 INFO:tasks.workunit.client.0.smithi083.stdout:6/11: symlink l3 0 2024-04-01T06:57:29.853 INFO:tasks.workunit.client.0.smithi083.stdout:6/12: read - f2 zero size 2024-04-01T06:57:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.851+0000 7f36f3fff700 1 --2- 172.21.15.83:0/1759449309 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55876d79da20 0x55876d793500 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f36f419a7c0 tx=0x7f36e000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bce34c3ee9bda6b server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.851+0000 7f36df7fe700 1 -- 172.21.15.83:0/1759449309 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e001e040 con 0x55876d79da20 2024-04-01T06:57:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.851+0000 7f36df7fe700 1 -- 172.21.15.83:0/1759449309 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f36e001f040 con 0x55876d79da20 2024-04-01T06:57:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.851+0000 7f36df7fe700 1 -- 172.21.15.83:0/1759449309 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e000bd10 con 0x55876d79da20 2024-04-01T06:57:29.854 INFO:tasks.workunit.client.0.smithi083.stdout:1/11: creat f5 x:0 0 0 2024-04-01T06:57:29.854 INFO:tasks.workunit.client.0.smithi083.stdout:1/12: rmdir - no directory 2024-04-01T06:57:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.852+0000 7f3706e18b80 1 -- 172.21.15.83:0/1759449309 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55876d79da20 msgr2=0x55876d793500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.852+0000 7f3706e18b80 1 --2- 172.21.15.83:0/1759449309 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55876d79da20 0x55876d793500 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f36f419a7c0 tx=0x7f36e000b260 comp rx=0 tx=0).stop 2024-04-01T06:57:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.852+0000 7f3706e18b80 1 -- 172.21.15.83:0/1759449309 shutdown_connections 2024-04-01T06:57:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.852+0000 7f3706e18b80 1 --2- 172.21.15.83:0/1759449309 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55876d7a88d0 0x55876d79f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.852+0000 7f3706e18b80 1 --2- 172.21.15.83:0/1759449309 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55876d79d100 0x55876d7ba850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.852+0000 7f3706e18b80 1 --2- 172.21.15.83:0/1759449309 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55876d79da20 0x55876d793500 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.852+0000 7f3706e18b80 1 -- 172.21.15.83:0/1759449309 >> 172.21.15.83:0/1759449309 conn(0x55876d6fd640 msgr2=0x55876d79f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.852+0000 7f3706e18b80 1 -- 172.21.15.83:0/1759449309 shutdown_connections 2024-04-01T06:57:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.852+0000 7f3706e18b80 1 -- 172.21.15.83:0/1759449309 wait complete. 2024-04-01T06:57:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.853+0000 7f3706e18b80 1 -- start start 2024-04-01T06:57:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.853+0000 7f3706e18b80 1 Processor -- start 2024-04-01T06:57:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.853+0000 7f3706e18b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55876d79d100 0x55876d7ad770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.853+0000 7f3706e18b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55876d79da20 0x55876d7adcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.853+0000 7f3706e18b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55876d7a88d0 0x55876d80b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.853+0000 7f3706e18b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55876d80b790 con 0x55876d7a88d0 2024-04-01T06:57:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.853+0000 7f3706e18b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55876d80b8d0 con 0x55876d79da20 2024-04-01T06:57:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.853+0000 7f3706e18b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55876d80ba60 con 0x55876d79d100 2024-04-01T06:57:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.853+0000 7f3706e18b80 10 client.0 _ll_register_callbacks cb 0x55876d695410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:57:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.854+0000 7f36f921f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55876d7a88d0 0x55876d80b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.854+0000 7f36f921f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55876d7a88d0 0x55876d80b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57306/0 (socket says 172.21.15.83:57306) 2024-04-01T06:57:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.854+0000 7f36f3fff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55876d79da20 0x55876d7adcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.854+0000 7f36f921f700 1 -- 172.21.15.83:0/3128283151 learned_addr learned my addr 172.21.15.83:0/3128283151 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.854+0000 7f36f8a1e700 1 --2- 172.21.15.83:0/3128283151 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55876d79d100 0x55876d7ad770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.854+0000 7f36f921f700 1 -- 172.21.15.83:0/3128283151 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55876d79d100 msgr2=0x55876d7ad770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.854+0000 7f36f921f700 1 --2- 172.21.15.83:0/3128283151 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55876d79d100 0x55876d7ad770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.854+0000 7f36f921f700 1 -- 172.21.15.83:0/3128283151 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55876d79da20 msgr2=0x55876d7adcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.854+0000 7f36f921f700 1 --2- 172.21.15.83:0/3128283151 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55876d79da20 0x55876d7adcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.854+0000 7f36f921f700 1 -- 172.21.15.83:0/3128283151 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36e0029ae0 con 0x55876d7a88d0 2024-04-01T06:57:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.854+0000 7f36f8a1e700 1 --2- 172.21.15.83:0/3128283151 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55876d79d100 0x55876d7ad770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:57:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.854+0000 7f36f3fff700 1 --2- 172.21.15.83:0/3128283151 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55876d79da20 0x55876d7adcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T06:57:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.854+0000 7f36f921f700 1 --2- 172.21.15.83:0/3128283151 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55876d7a88d0 0x55876d80b250 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f36ec096510 tx=0x7f36ec004bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb906e74c048ec78 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.854+0000 7f36d3fff700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:57:29.859 INFO:tasks.workunit.client.0.smithi083.stdout:6/13: creat f4 x:0 0 0 2024-04-01T06:57:29.860 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.854+0000 7f36d3fff700 1 -- 172.21.15.83:0/3128283151 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec09d8d0 con 0x55876d7a88d0 2024-04-01T06:57:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.855+0000 7f36d3fff700 1 -- 172.21.15.83:0/3128283151 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f36ec0a1e90 con 0x55876d7a88d0 2024-04-01T06:57:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.855+0000 7f3706e18b80 1 -- 172.21.15.83:0/3128283151 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f36e8003bf0 con 0x55876d7a88d0 2024-04-01T06:57:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.855+0000 7f36d3fff700 1 -- 172.21.15.83:0/3128283151 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f36ec0b2200 con 0x55876d7a88d0 2024-04-01T06:57:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.855+0000 7f3706e18b80 10 client.15951 fetch_fsmap learned FSMap version 27 2024-04-01T06:57:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.855+0000 7f3706e18b80 1 -- 172.21.15.83:0/3128283151 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55876d6b5e40 con 0x55876d7a88d0 2024-04-01T06:57:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.855+0000 7f36d3fff700 1 -- 172.21.15.83:0/3128283151 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f36e8003bf0 con 0x55876d7a88d0 2024-04-01T06:57:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.855+0000 7f36d3fff700 1 -- 172.21.15.83:0/3128283151 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f36ec0a1a00 con 0x55876d7a88d0 2024-04-01T06:57:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.855+0000 7f3706e18b80 10 client.15951 fetch_fsmap finished waiting for FSMap version 27 2024-04-01T06:57:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.855+0000 7f3706e18b80 10 client.15951 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-01T06:57:29.862 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.855+0000 7f3706e18b80 20 client.15951 populate_metadata read hostname 'smithi083' 2024-04-01T06:57:29.862 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.855+0000 7f3706e18b80 1 --2- 172.21.15.83:0/3128283151 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55876d80d270 0x55876d80f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:29.862 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.855+0000 7f3706e18b80 4 client.15951 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-01T06:57:29.862 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.855+0000 7f3706e18b80 1 -- 172.21.15.83:0/3128283151 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55876d53ec90 con 0x55876d80d270 2024-04-01T06:57:29.862 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.855+0000 7f36f8a1e700 1 --2- 172.21.15.83:0/3128283151 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55876d80d270 0x55876d80f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:29.862 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.856+0000 7f36d3fff700 10 client.15951 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:57:29.862 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:29.856+0000 7f36f8a1e700 1 --2- 172.21.15.83:0/3128283151 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55876d80d270 0x55876d80f690 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fca16cd3215d84e9 server_cookie=cd8ff5d4166b6b6 in_seq=0 out_seq=0 2024-04-01T06:57:29.863 INFO:tasks.workunit.client.0.smithi083.stdout:6/14: mknod c5 0 2024-04-01T06:57:29.863 INFO:tasks.workunit.client.0.smithi083.stdout:6/15: chown f1 131535 1 2024-04-01T06:57:29.863 INFO:tasks.workunit.client.0.smithi083.stdout:6/16: write f1 [56551,68755] 0 2024-04-01T06:57:29.863 INFO:tasks.workunit.client.0.smithi083.stdout:6/17: write f2 [699008,56849] 0 2024-04-01T06:57:29.863 INFO:tasks.workunit.client.0.smithi083.stdout:6/18: write f4 [690733,68453] 0 2024-04-01T06:57:29.863 INFO:tasks.workunit.client.0.smithi083.stdout:6/19: link f2 f6 0 2024-04-01T06:57:29.863 INFO:tasks.workunit.client.0.smithi083.stdout:6/20: write f6 [22790,77951] 0 2024-04-01T06:57:29.864 INFO:tasks.workunit.client.0.smithi083.stdout:3/12: dwrite f0 [0,4194304] 0 2024-04-01T06:57:29.864 INFO:tasks.workunit.client.0.smithi083.stdout:3/13: chown f3 2 1 2024-04-01T06:57:29.864 INFO:tasks.workunit.client.0.smithi083.stdout:4/22: dwrite d1/f2 [0,4194304] 0 2024-04-01T06:57:29.864 INFO:tasks.workunit.client.0.smithi083.stdout:3/14: write f2 [73345,4790] 0 2024-04-01T06:57:29.865 INFO:tasks.workunit.client.0.smithi083.stdout:4/23: write d1/f2 [2173290,82610] 0 2024-04-01T06:57:29.866 INFO:tasks.workunit.client.0.smithi083.stdout:4/24: creat d1/f5 x:0 0 0 2024-04-01T06:57:29.867 INFO:tasks.workunit.client.0.smithi083.stdout:4/25: unlink d1/f5 0 2024-04-01T06:57:29.873 INFO:tasks.workunit.client.0.smithi083.stdout:3/15: dread f0 [0,4194304] 0 2024-04-01T06:57:29.873 INFO:tasks.workunit.client.0.smithi083.stdout:3/16: chown f0 260962726 1 2024-04-01T06:57:29.873 INFO:tasks.workunit.client.0.smithi083.stdout:3/17: chown f0 0 1 2024-04-01T06:57:29.893 INFO:tasks.workunit.client.0.smithi083.stdout:3/18: dwrite f0 [0,4194304] 0 2024-04-01T06:57:29.893 INFO:tasks.workunit.client.0.smithi083.stdout:4/26: dread d1/f2 [0,4194304] 0 2024-04-01T06:57:29.893 INFO:tasks.workunit.client.0.smithi083.stdout:3/19: mkdir d4 0 2024-04-01T06:57:29.895 INFO:tasks.workunit.client.0.smithi083.stdout:3/20: rmdir d4 0 2024-04-01T06:57:29.896 INFO:tasks.workunit.client.0.smithi083.stdout:3/21: symlink l5 0 2024-04-01T06:57:29.908 INFO:tasks.workunit.client.0.smithi083.stdout:3/22: dwrite f3 [0,4194304] 0 2024-04-01T06:57:29.913 INFO:tasks.workunit.client.0.smithi083.stdout:3/23: dread f2 [0,4194304] 0 2024-04-01T06:57:29.914 INFO:tasks.workunit.client.0.smithi083.stdout:3/24: mkdir d6 0 2024-04-01T06:57:30.066 INFO:tasks.workunit.client.0.smithi083.stdout:2/6: dwrite f0 [4194304,4194304] 0 2024-04-01T06:57:30.066 INFO:tasks.workunit.client.0.smithi083.stdout:2/7: dread - f2 zero size 2024-04-01T06:57:30.067 INFO:tasks.workunit.client.0.smithi083.stdout:2/8: write f1 [852036,75426] 0 2024-04-01T06:57:30.083 INFO:tasks.workunit.client.0.smithi083.stdout:2/9: dwrite f1 [0,4194304] 0 2024-04-01T06:57:30.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:29 smithi153 ceph-mon[48187]: pgmap v52: 97 pgs: 97 active+clean; 125 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 8.9 MiB/s wr, 1.90k op/s 2024-04-01T06:57:30.169 INFO:tasks.workunit.client.0.smithi083.stdout:4/27: fsync d1/f3 0 2024-04-01T06:57:30.170 INFO:tasks.workunit.client.0.smithi083.stdout:4/28: creat d1/f6 x:0 0 0 2024-04-01T06:57:30.171 INFO:tasks.workunit.client.0.smithi083.stdout:4/29: creat d1/f7 x:0 0 0 2024-04-01T06:57:30.174 INFO:tasks.workunit.client.0.smithi083.stdout:4/30: mkdir d1/d8 0 2024-04-01T06:57:30.175 INFO:tasks.workunit.client.0.smithi083.stdout:4/31: creat d1/d8/f9 x:0 0 0 2024-04-01T06:57:30.198 INFO:tasks.workunit.client.0.smithi083.stdout:4/32: dwrite d1/f3 [0,4194304] 0 2024-04-01T06:57:30.198 INFO:tasks.workunit.client.0.smithi083.stdout:4/33: chown d1/f6 3606264 1 2024-04-01T06:57:30.198 INFO:tasks.workunit.client.0.smithi083.stdout:4/34: stat d1/d4 0 2024-04-01T06:57:30.199 INFO:tasks.workunit.client.0.smithi083.stdout:4/35: mkdir d1/d4/da 0 2024-04-01T06:57:30.200 INFO:tasks.workunit.client.0.smithi083.stdout:4/36: mkdir d1/d4/db 0 2024-04-01T06:57:30.201 INFO:tasks.workunit.client.0.smithi083.stdout:4/37: symlink d1/d4/da/lc 0 2024-04-01T06:57:30.201 INFO:tasks.workunit.client.0.smithi083.stdout:4/38: dread - d1/f6 zero size 2024-04-01T06:57:30.202 INFO:tasks.workunit.client.0.smithi083.stdout:4/39: write d1/f3 [2838947,98496] 0 2024-04-01T06:57:30.204 INFO:tasks.workunit.client.0.smithi083.stdout:4/40: fdatasync d1/f3 0 2024-04-01T06:57:30.205 INFO:tasks.workunit.client.0.smithi083.stdout:4/41: symlink d1/d8/ld 0 2024-04-01T06:57:30.206 INFO:tasks.workunit.client.0.smithi083.stdout:4/42: write d1/f6 [214405,90362] 0 2024-04-01T06:57:30.206 INFO:tasks.workunit.client.0.smithi083.stdout:4/43: creat d1/d8/fe x:0 0 0 2024-04-01T06:57:30.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:29 smithi145 ceph-mon[47816]: pgmap v52: 97 pgs: 97 active+clean; 125 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 8.9 MiB/s wr, 1.90k op/s 2024-04-01T06:57:30.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:29 smithi083 ceph-mon[43429]: pgmap v52: 97 pgs: 97 active+clean; 125 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 8.9 MiB/s wr, 1.90k op/s 2024-04-01T06:57:30.296 INFO:tasks.workunit.client.0.smithi083.stdout:8/20: fsync f7 0 2024-04-01T06:57:30.297 INFO:tasks.workunit.client.0.smithi083.stdout:8/21: link l6 l8 0 2024-04-01T06:57:30.298 INFO:tasks.workunit.client.0.smithi083.stdout:8/22: creat f9 x:0 0 0 2024-04-01T06:57:30.298 INFO:tasks.workunit.client.0.smithi083.stdout:8/23: fsync f4 0 2024-04-01T06:57:30.303 INFO:tasks.workunit.client.0.smithi083.stdout:7/23: rmdir d0 39 2024-04-01T06:57:30.303 INFO:tasks.workunit.client.0.smithi083.stdout:7/24: stat d0 0 2024-04-01T06:57:30.303 INFO:tasks.workunit.client.0.smithi083.stdout:7/25: write d0/f3 [4387935,57047] 0 2024-04-01T06:57:30.303 INFO:tasks.workunit.client.0.smithi083.stdout:7/26: dread - d0/f7 zero size 2024-04-01T06:57:30.305 INFO:tasks.workunit.client.0.smithi083.stdout:6/21: fsync f2 0 2024-04-01T06:57:30.305 INFO:tasks.workunit.client.0.smithi083.stdout:6/22: chown f6 104525 1 2024-04-01T06:57:30.306 INFO:tasks.workunit.client.0.smithi083.stdout:6/23: symlink l7 0 2024-04-01T06:57:30.306 INFO:tasks.workunit.client.0.smithi083.stdout:6/24: chown c5 4812005 1 2024-04-01T06:57:30.311 INFO:tasks.workunit.client.0.smithi083.stdout:1/13: dwrite f4 [4194304,4194304] 0 2024-04-01T06:57:30.314 INFO:tasks.workunit.client.0.smithi083.stdout:1/14: mknod c6 0 2024-04-01T06:57:30.314 INFO:tasks.workunit.client.0.smithi083.stdout:1/15: read - f5 zero size 2024-04-01T06:57:30.314 INFO:tasks.workunit.client.0.smithi083.stdout:1/16: write f3 [871192,77185] 0 2024-04-01T06:57:30.314 INFO:tasks.workunit.client.0.smithi083.stdout:1/17: creat f7 x:0 0 0 2024-04-01T06:57:30.317 INFO:tasks.workunit.client.0.smithi083.stdout:1/18: rename f5 to f8 0 2024-04-01T06:57:30.320 INFO:tasks.workunit.client.0.smithi083.stdout:1/19: unlink f0 0 2024-04-01T06:57:30.321 INFO:tasks.workunit.client.0.smithi083.stdout:1/20: creat f9 x:0 0 0 2024-04-01T06:57:30.321 INFO:tasks.workunit.client.0.smithi083.stdout:2/10: write f1 [4188338,107212] 0 2024-04-01T06:57:30.322 INFO:tasks.workunit.client.0.smithi083.stdout:2/11: write f0 [2934529,20275] 0 2024-04-01T06:57:30.323 INFO:tasks.workunit.client.0.smithi083.stdout:1/21: rename f9 to fa 0 2024-04-01T06:57:30.325 INFO:tasks.workunit.client.0.smithi083.stdout:2/12: fdatasync f1 0 2024-04-01T06:57:30.325 INFO:tasks.workunit.client.0.smithi083.stdout:2/13: chown d3 10826948 1 2024-04-01T06:57:30.326 INFO:tasks.workunit.client.0.smithi083.stdout:1/22: mkdir db 0 2024-04-01T06:57:30.327 INFO:tasks.workunit.client.0.smithi083.stdout:1/23: mknod db/cc 0 2024-04-01T06:57:30.327 INFO:tasks.workunit.client.0.smithi083.stdout:1/24: dread - fa zero size 2024-04-01T06:57:30.330 INFO:tasks.workunit.client.0.smithi083.stdout:4/44: fsync d1/d8/f9 0 2024-04-01T06:57:30.331 INFO:tasks.workunit.client.0.smithi083.stdout:4/45: creat d1/d4/ff x:0 0 0 2024-04-01T06:57:30.334 INFO:tasks.workunit.client.0.smithi083.stdout:4/46: truncate d1/f2 3099735 0 2024-04-01T06:57:30.334 INFO:tasks.workunit.client.0.smithi083.stdout:2/14: dread f0 [0,4194304] 0 2024-04-01T06:57:30.335 INFO:tasks.workunit.client.0.smithi083.stdout:2/15: read f0 [6140180,1176] 0 2024-04-01T06:57:30.335 INFO:tasks.workunit.client.0.smithi083.stdout:2/16: fsync f0 0 2024-04-01T06:57:30.335 INFO:tasks.workunit.client.0.smithi083.stdout:1/25: dread f3 [0,4194304] 0 2024-04-01T06:57:30.335 INFO:tasks.workunit.client.0.smithi083.stdout:7/27: dwrite d0/d4/f5 [0,4194304] 0 2024-04-01T06:57:30.335 INFO:tasks.workunit.client.0.smithi083.stdout:4/47: link d1/d8/ld d1/d4/l10 0 2024-04-01T06:57:30.336 INFO:tasks.workunit.client.0.smithi083.stdout:1/26: dread f3 [0,4194304] 0 2024-04-01T06:57:30.337 INFO:tasks.workunit.client.0.smithi083.stdout:2/17: symlink d3/l4 0 2024-04-01T06:57:30.337 INFO:tasks.workunit.client.0.smithi083.stdout:2/18: fdatasync f0 0 2024-04-01T06:57:30.338 INFO:tasks.workunit.client.0.smithi083.stdout:8/24: dwrite f9 [0,4194304] 0 2024-04-01T06:57:30.339 INFO:tasks.workunit.client.0.smithi083.stdout:6/25: getdents . 0 2024-04-01T06:57:30.341 INFO:tasks.workunit.client.0.smithi083.stdout:7/28: getdents d0/d4 0 2024-04-01T06:57:30.341 INFO:tasks.workunit.client.0.smithi083.stdout:6/26: dread f6 [0,4194304] 0 2024-04-01T06:57:30.341 INFO:tasks.workunit.client.0.smithi083.stdout:4/48: dread d1/f6 [0,4194304] 0 2024-04-01T06:57:30.342 INFO:tasks.workunit.client.0.smithi083.stdout:1/27: rmdir db 39 2024-04-01T06:57:30.355 INFO:tasks.workunit.client.0.smithi083.stdout:1/28: dwrite f1 [0,4194304] 0 2024-04-01T06:57:30.369 INFO:tasks.workunit.client.0.smithi083.stdout:1/29: dwrite f7 [0,4194304] 0 2024-04-01T06:57:30.372 INFO:tasks.workunit.client.0.smithi083.stdout:5/10: sync 2024-04-01T06:57:30.372 INFO:tasks.workunit.client.0.smithi083.stdout:9/20: sync 2024-04-01T06:57:30.372 INFO:tasks.workunit.client.0.smithi083.stdout:3/25: sync 2024-04-01T06:57:30.372 INFO:tasks.workunit.client.0.smithi083.stdout:0/0: sync 2024-04-01T06:57:30.372 INFO:tasks.workunit.client.0.smithi083.stdout:0/1: dread - no filename 2024-04-01T06:57:30.372 INFO:tasks.workunit.client.0.smithi083.stdout:0/2: write - no filename 2024-04-01T06:57:30.372 INFO:tasks.workunit.client.0.smithi083.stdout:0/3: unlink - no file 2024-04-01T06:57:30.372 INFO:tasks.workunit.client.0.smithi083.stdout:0/4: read - no filename 2024-04-01T06:57:30.372 INFO:tasks.workunit.client.0.smithi083.stdout:0/5: rename - no filename 2024-04-01T06:57:30.372 INFO:tasks.workunit.client.0.smithi083.stdout:0/6: unlink - no file 2024-04-01T06:57:30.373 INFO:tasks.workunit.client.0.smithi083.stdout:9/21: dread f5 [0,4194304] 0 2024-04-01T06:57:30.385 INFO:tasks.workunit.client.0.smithi083.stdout:3/26: dwrite f3 [0,4194304] 0 2024-04-01T06:57:30.385 INFO:tasks.workunit.client.0.smithi083.stdout:3/27: fsync f0 0 2024-04-01T06:57:30.386 INFO:tasks.workunit.client.0.smithi083.stdout:1/30: dwrite f3 [0,4194304] 0 2024-04-01T06:57:30.386 INFO:tasks.workunit.client.0.smithi083.stdout:1/31: write fa [1027392,15805] 0 2024-04-01T06:57:30.402 INFO:tasks.workunit.client.0.smithi083.stdout:3/28: dwrite f0 [0,4194304] 0 2024-04-01T06:57:30.402 INFO:tasks.workunit.client.0.smithi083.stdout:3/29: getdents d6 0 2024-04-01T06:57:30.402 INFO:tasks.workunit.client.0.smithi083.stdout:3/30: chown d6 65922015 1 2024-04-01T06:57:30.772 INFO:tasks.workunit.client.0.smithi083.stdout:8/25: creat fa x:0 0 0 2024-04-01T06:57:30.772 INFO:tasks.workunit.client.0.smithi083.stdout:8/26: dread - f7 zero size 2024-04-01T06:57:30.773 INFO:tasks.workunit.client.0.smithi083.stdout:8/27: write f4 [589797,9209] 0 2024-04-01T06:57:30.773 INFO:tasks.workunit.client.0.smithi083.stdout:8/28: dread - fa zero size 2024-04-01T06:57:30.776 INFO:tasks.workunit.client.0.smithi083.stdout:6/27: creat f8 x:0 0 0 2024-04-01T06:57:30.780 INFO:tasks.workunit.client.0.smithi083.stdout:4/49: unlink d1/f7 0 2024-04-01T06:57:30.780 INFO:tasks.workunit.client.0.smithi083.stdout:4/50: chown d1/d4/db 333 1 2024-04-01T06:57:30.780 INFO:tasks.workunit.client.0.smithi083.stdout:4/51: read - d1/d8/f9 zero size 2024-04-01T06:57:30.780 INFO:tasks.workunit.client.0.smithi083.stdout:4/52: fsync d1/f2 0 2024-04-01T06:57:30.780 INFO:tasks.workunit.client.0.smithi083.stdout:2/19: getdents d3 0 2024-04-01T06:57:30.781 INFO:tasks.workunit.client.0.smithi083.stdout:2/20: fsync f1 0 2024-04-01T06:57:30.798 INFO:tasks.workunit.client.0.smithi083.stdout:9/22: creat d6/f7 x:0 0 0 2024-04-01T06:57:30.798 INFO:tasks.workunit.client.0.smithi083.stdout:9/23: readlink l2 0 2024-04-01T06:57:30.798 INFO:tasks.workunit.client.0.smithi083.stdout:0/7: symlink l0 0 2024-04-01T06:57:30.798 INFO:tasks.workunit.client.0.smithi083.stdout:0/8: rmdir - no directory 2024-04-01T06:57:30.798 INFO:tasks.workunit.client.0.smithi083.stdout:0/9: truncate - no filename 2024-04-01T06:57:30.798 INFO:tasks.workunit.client.0.smithi083.stdout:5/11: creat f2 x:0 0 0 2024-04-01T06:57:30.798 INFO:tasks.workunit.client.0.smithi083.stdout:0/10: chown l0 176655 1 2024-04-01T06:57:30.798 INFO:tasks.workunit.client.0.smithi083.stdout:5/12: chown f2 0 1 2024-04-01T06:57:30.799 INFO:tasks.workunit.client.0.smithi083.stdout:1/32: creat db/fd x:0 0 0 2024-04-01T06:57:30.799 INFO:tasks.workunit.client.0.smithi083.stdout:8/29: mknod cb 0 2024-04-01T06:57:30.799 INFO:tasks.workunit.client.0.smithi083.stdout:3/31: mknod d6/c7 0 2024-04-01T06:57:30.808 INFO:tasks.workunit.client.0.smithi083.stdout:4/53: rename d1/f3 to d1/d4/db/f11 0 2024-04-01T06:57:30.808 INFO:tasks.workunit.client.0.smithi083.stdout:5/13: unlink f2 0 2024-04-01T06:57:30.808 INFO:tasks.workunit.client.0.smithi083.stdout:5/14: dread - no filename 2024-04-01T06:57:30.808 INFO:tasks.workunit.client.0.smithi083.stdout:5/15: dread - no filename 2024-04-01T06:57:30.809 INFO:tasks.workunit.client.0.smithi083.stdout:9/24: creat d6/f8 x:0 0 0 2024-04-01T06:57:30.809 INFO:tasks.workunit.client.0.smithi083.stdout:9/25: rename d6 to d6/d9 22 2024-04-01T06:57:30.813 INFO:tasks.workunit.client.0.smithi083.stdout:8/30: rename l3 to lc 0 2024-04-01T06:57:30.813 INFO:tasks.workunit.client.0.smithi083.stdout:6/28: mkdir d9 0 2024-04-01T06:57:30.813 INFO:tasks.workunit.client.0.smithi083.stdout:1/33: creat db/fe x:0 0 0 2024-04-01T06:57:30.813 INFO:tasks.workunit.client.0.smithi083.stdout:1/34: dread - db/fd zero size 2024-04-01T06:57:30.814 INFO:tasks.workunit.client.0.smithi083.stdout:0/11: creat f1 x:0 0 0 2024-04-01T06:57:30.814 INFO:tasks.workunit.client.0.smithi083.stdout:0/12: dread - f1 zero size 2024-04-01T06:57:30.814 INFO:tasks.workunit.client.0.smithi083.stdout:0/13: chown l0 15 1 2024-04-01T06:57:30.814 INFO:tasks.workunit.client.0.smithi083.stdout:0/14: truncate f1 131566 0 2024-04-01T06:57:30.814 INFO:tasks.workunit.client.0.smithi083.stdout:0/15: truncate f1 1140063 0 2024-04-01T06:57:30.815 INFO:tasks.workunit.client.0.smithi083.stdout:0/16: chown l0 6037742 1 2024-04-01T06:57:30.820 INFO:tasks.workunit.client.0.smithi083.stdout:3/32: creat d6/f8 x:0 0 0 2024-04-01T06:57:30.821 INFO:tasks.workunit.client.0.smithi083.stdout:5/16: mknod c3 0 2024-04-01T06:57:30.822 INFO:tasks.workunit.client.0.smithi083.stdout:9/26: mkdir d6/da 0 2024-04-01T06:57:30.822 INFO:tasks.workunit.client.0.smithi083.stdout:9/27: dread - d6/f8 zero size 2024-04-01T06:57:30.822 INFO:tasks.workunit.client.0.smithi083.stdout:9/28: truncate d6/f8 646901 0 2024-04-01T06:57:30.823 INFO:tasks.workunit.client.0.smithi083.stdout:8/31: rename cb to cd 0 2024-04-01T06:57:30.823 INFO:tasks.workunit.client.0.smithi083.stdout:6/29: chown l7 161 1 2024-04-01T06:57:30.823 INFO:tasks.workunit.client.0.smithi083.stdout:1/35: creat db/ff x:0 0 0 2024-04-01T06:57:30.829 INFO:tasks.workunit.client.0.smithi083.stdout:2/21: dread f0 [4194304,4194304] 0 2024-04-01T06:57:30.833 INFO:tasks.workunit.client.0.smithi083.stdout:9/29: mknod d6/cb 0 2024-04-01T06:57:30.833 INFO:tasks.workunit.client.0.smithi083.stdout:8/32: creat fe x:0 0 0 2024-04-01T06:57:30.833 INFO:tasks.workunit.client.0.smithi083.stdout:8/33: dread - fa zero size 2024-04-01T06:57:30.833 INFO:tasks.workunit.client.0.smithi083.stdout:9/30: write d6/f7 [777923,53440] 0 2024-04-01T06:57:30.833 INFO:tasks.workunit.client.0.smithi083.stdout:8/34: write f7 [730829,98591] 0 2024-04-01T06:57:30.834 INFO:tasks.workunit.client.0.smithi083.stdout:5/17: unlink c1 0 2024-04-01T06:57:30.834 INFO:tasks.workunit.client.0.smithi083.stdout:5/18: read - no filename 2024-04-01T06:57:30.834 INFO:tasks.workunit.client.0.smithi083.stdout:5/19: dwrite - no filename 2024-04-01T06:57:30.834 INFO:tasks.workunit.client.0.smithi083.stdout:5/20: dwrite - no filename 2024-04-01T06:57:30.834 INFO:tasks.workunit.client.0.smithi083.stdout:5/21: dread - no filename 2024-04-01T06:57:30.835 INFO:tasks.workunit.client.0.smithi083.stdout:2/22: symlink d3/l5 0 2024-04-01T06:57:30.835 INFO:tasks.workunit.client.0.smithi083.stdout:2/23: dread - f2 zero size 2024-04-01T06:57:30.835 INFO:tasks.workunit.client.0.smithi083.stdout:1/36: creat db/f10 x:0 0 0 2024-04-01T06:57:30.840 INFO:tasks.workunit.client.0.smithi083.stdout:9/31: mknod d6/da/cc 0 2024-04-01T06:57:30.840 INFO:tasks.workunit.client.0.smithi083.stdout:9/32: chown l0 220 1 2024-04-01T06:57:30.840 INFO:tasks.workunit.client.0.smithi083.stdout:9/33: fdatasync f5 0 2024-04-01T06:57:30.843 INFO:tasks.workunit.client.0.smithi083.stdout:5/22: mkdir d4 0 2024-04-01T06:57:30.844 INFO:tasks.workunit.client.0.smithi083.stdout:5/23: fdatasync - no filename 2024-04-01T06:57:30.844 INFO:tasks.workunit.client.0.smithi083.stdout:1/37: unlink db/ff 0 2024-04-01T06:57:30.847 INFO:tasks.workunit.client.0.smithi083.stdout:2/24: mknod d3/c6 0 2024-04-01T06:57:30.853 INFO:tasks.workunit.client.0.smithi083.stdout:9/34: rename d6/f8 to d6/da/fd 0 2024-04-01T06:57:30.853 INFO:tasks.workunit.client.0.smithi083.stdout:5/24: mknod d4/c5 0 2024-04-01T06:57:30.859 INFO:tasks.workunit.client.0.smithi083.stdout:2/25: creat d3/f7 x:0 0 0 2024-04-01T06:57:30.859 INFO:tasks.workunit.client.0.smithi083.stdout:2/26: chown f1 800609 1 2024-04-01T06:57:30.861 INFO:tasks.workunit.client.0.smithi083.stdout:9/35: link d6/f7 d6/da/fe 0 2024-04-01T06:57:30.864 INFO:tasks.workunit.client.0.smithi083.stdout:1/38: rename f4 to db/f11 0 2024-04-01T06:57:30.869 INFO:tasks.workunit.client.0.smithi083.stdout:5/25: rmdir d4 39 2024-04-01T06:57:30.871 INFO:tasks.workunit.client.0.smithi083.stdout:2/27: symlink d3/l8 0 2024-04-01T06:57:30.887 INFO:tasks.workunit.client.0.smithi083.stdout:9/36: mknod d6/cf 0 2024-04-01T06:57:30.888 INFO:tasks.workunit.client.0.smithi083.stdout:1/39: creat db/f12 x:0 0 0 2024-04-01T06:57:30.889 INFO:tasks.workunit.client.0.smithi083.stdout:9/37: dread d6/da/fd [0,4194304] 0 2024-04-01T06:57:30.894 INFO:tasks.workunit.client.0.smithi083.stdout:5/26: creat d4/f6 x:0 0 0 2024-04-01T06:57:30.894 INFO:tasks.workunit.client.0.smithi083.stdout:5/27: truncate d4/f6 641038 0 2024-04-01T06:57:30.897 INFO:tasks.workunit.client.0.smithi083.stdout:2/28: mknod d3/c9 0 2024-04-01T06:57:30.897 INFO:tasks.workunit.client.0.smithi083.stdout:2/29: dread - f2 zero size 2024-04-01T06:57:30.904 INFO:tasks.workunit.client.0.smithi083.stdout:5/28: symlink d4/l7 0 2024-04-01T06:57:30.904 INFO:tasks.workunit.client.0.smithi083.stdout:5/29: chown d4/l7 104948418 1 2024-04-01T06:57:30.904 INFO:tasks.workunit.client.0.smithi083.stdout:5/30: stat d4/f6 0 2024-04-01T06:57:30.908 INFO:tasks.workunit.client.0.smithi083.stdout:2/30: mknod d3/ca 0 2024-04-01T06:57:30.908 INFO:tasks.workunit.client.0.smithi083.stdout:2/31: dread - f2 zero size 2024-04-01T06:57:30.912 INFO:tasks.workunit.client.0.smithi083.stdout:3/33: write f2 [335305,81975] 0 2024-04-01T06:57:30.914 INFO:tasks.workunit.client.0.smithi083.stdout:9/38: dread f5 [0,4194304] 0 2024-04-01T06:57:30.914 INFO:tasks.workunit.client.0.smithi083.stdout:9/39: write d6/da/fe [1376482,92659] 0 2024-04-01T06:57:30.914 INFO:tasks.workunit.client.0.smithi083.stdout:2/32: mkdir d3/db 0 2024-04-01T06:57:30.914 INFO:tasks.workunit.client.0.smithi083.stdout:2/33: chown d3/c6 7072374 1 2024-04-01T06:57:30.914 INFO:tasks.workunit.client.0.smithi083.stdout:2/34: dread - d3/f7 zero size 2024-04-01T06:57:30.914 INFO:tasks.workunit.client.0.smithi083.stdout:2/35: read - d3/f7 zero size 2024-04-01T06:57:30.914 INFO:tasks.workunit.client.0.smithi083.stdout:2/36: getdents d3/db 0 2024-04-01T06:57:30.920 INFO:tasks.workunit.client.0.smithi083.stdout:9/40: dread d6/da/fd [0,4194304] 0 2024-04-01T06:57:30.922 INFO:tasks.workunit.client.0.smithi083.stdout:8/35: read f4 [3012651,41543] 0 2024-04-01T06:57:30.922 INFO:tasks.workunit.client.0.smithi083.stdout:8/36: read f4 [2812497,29966] 0 2024-04-01T06:57:30.925 INFO:tasks.workunit.client.0.smithi083.stdout:8/37: dread f7 [0,4194304] 0 2024-04-01T06:57:30.925 INFO:tasks.workunit.client.0.smithi083.stdout:8/38: read - fe zero size 2024-04-01T06:57:30.925 INFO:tasks.workunit.client.0.smithi083.stdout:9/41: rename d6/cb to d6/da/c10 0 2024-04-01T06:57:30.928 INFO:tasks.workunit.client.0.smithi083.stdout:5/31: dwrite d4/f6 [0,4194304] 0 2024-04-01T06:57:30.935 INFO:tasks.workunit.client.0.smithi083.stdout:8/39: dwrite fa [0,4194304] 0 2024-04-01T06:57:30.936 INFO:tasks.workunit.client.0.smithi083.stdout:2/37: rmdir d3/db 0 2024-04-01T06:57:30.936 INFO:tasks.workunit.client.0.smithi083.stdout:2/38: readlink d3/l5 0 2024-04-01T06:57:30.936 INFO:tasks.workunit.client.0.smithi083.stdout:2/39: readlink d3/l8 0 2024-04-01T06:57:30.941 INFO:tasks.workunit.client.0.smithi083.stdout:8/40: symlink lf 0 2024-04-01T06:57:30.941 INFO:tasks.workunit.client.0.smithi083.stdout:8/41: stat f9 0 2024-04-01T06:57:30.941 INFO:tasks.workunit.client.0.smithi083.stdout:8/42: dread - fe zero size 2024-04-01T06:57:30.943 INFO:tasks.workunit.client.0.smithi083.stdout:8/43: unlink l0 0 2024-04-01T06:57:30.943 INFO:tasks.workunit.client.0.smithi083.stdout:8/44: rmdir - no directory 2024-04-01T06:57:30.945 INFO:tasks.workunit.client.0.smithi083.stdout:8/45: write fa [4019860,12366] 0 2024-04-01T06:57:30.951 INFO:tasks.workunit.client.0.smithi083.stdout:9/42: dwrite d6/f7 [0,4194304] 0 2024-04-01T06:57:30.951 INFO:tasks.workunit.client.0.smithi083.stdout:9/43: write d6/da/fd [591877,121957] 0 2024-04-01T06:57:30.952 INFO:tasks.workunit.client.0.smithi083.stdout:2/40: dread f1 [0,4194304] 0 2024-04-01T06:57:30.952 INFO:tasks.workunit.client.0.smithi083.stdout:9/44: write d6/f7 [1363094,8187] 0 2024-04-01T06:57:30.954 INFO:tasks.workunit.client.0.smithi083.stdout:2/41: creat d3/fc x:0 0 0 2024-04-01T06:57:30.955 INFO:tasks.workunit.client.0.smithi083.stdout:2/42: mknod d3/cd 0 2024-04-01T06:57:30.956 INFO:tasks.workunit.client.0.smithi083.stdout:9/45: dread d6/da/fd [0,4194304] 0 2024-04-01T06:57:30.957 INFO:tasks.workunit.client.0.smithi083.stdout:2/43: creat d3/fe x:0 0 0 2024-04-01T06:57:30.957 INFO:tasks.workunit.client.0.smithi083.stdout:2/44: dread - d3/fe zero size 2024-04-01T06:57:30.957 INFO:tasks.workunit.client.0.smithi083.stdout:2/45: truncate d3/fc 270494 0 2024-04-01T06:57:31.288 INFO:tasks.workunit.client.0.smithi083.stdout:9/46: symlink d6/l11 0 2024-04-01T06:57:31.291 INFO:tasks.workunit.client.0.smithi083.stdout:2/46: creat d3/ff x:0 0 0 2024-04-01T06:57:31.291 INFO:tasks.workunit.client.0.smithi083.stdout:2/47: write d3/fe [573242,64512] 0 2024-04-01T06:57:31.298 INFO:tasks.workunit.client.0.smithi083.stdout:2/48: dread f1 [0,4194304] 0 2024-04-01T06:57:31.352 INFO:tasks.workunit.client.0.smithi083.stdout:9/47: rename d6/da/cc to d6/da/c12 0 2024-04-01T06:57:31.353 INFO:tasks.workunit.client.0.smithi083.stdout:2/49: link f0 d3/f10 0 2024-04-01T06:57:31.358 INFO:tasks.workunit.client.0.smithi083.stdout:2/50: dread d3/f10 [4194304,4194304] 0 2024-04-01T06:57:31.678 INFO:tasks.workunit.client.0.smithi083.stdout:2/51: symlink d3/l11 0 2024-04-01T06:57:31.679 INFO:tasks.workunit.client.0.smithi083.stdout:2/52: truncate f2 272443 0 2024-04-01T06:57:31.679 INFO:tasks.workunit.client.0.smithi083.stdout:2/53: write f2 [501857,46453] 0 2024-04-01T06:57:31.693 INFO:tasks.workunit.client.0.smithi083.stdout:2/54: dwrite f0 [4194304,4194304] 0 2024-04-01T06:57:31.695 INFO:tasks.workunit.client.0.smithi083.stdout:2/55: creat d3/f12 x:0 0 0 2024-04-01T06:57:31.696 INFO:tasks.workunit.client.0.smithi083.stdout:2/56: rename d3/l8 to d3/l13 0 2024-04-01T06:57:31.722 INFO:tasks.workunit.client.0.smithi083.stdout:2/57: dwrite d3/fc [0,4194304] 0 2024-04-01T06:57:31.733 INFO:tasks.workunit.client.0.smithi083.stdout:2/58: dwrite d3/f7 [0,4194304] 0 2024-04-01T06:57:31.744 INFO:tasks.workunit.client.0.smithi083.stdout:2/59: symlink d3/l14 0 2024-04-01T06:57:31.746 INFO:tasks.workunit.client.0.smithi083.stdout:2/60: unlink d3/l11 0 2024-04-01T06:57:31.749 INFO:tasks.workunit.client.0.smithi083.stdout:2/61: dread d3/f10 [0,4194304] 0 2024-04-01T06:57:31.750 INFO:tasks.workunit.client.0.smithi083.stdout:3/34: getdents d6 0 2024-04-01T06:57:31.757 INFO:tasks.workunit.client.0.smithi083.stdout:3/35: creat d6/f9 x:0 0 0 2024-04-01T06:57:31.757 INFO:tasks.workunit.client.0.smithi083.stdout:0/17: truncate f1 1138901 0 2024-04-01T06:57:31.757 INFO:tasks.workunit.client.0.smithi083.stdout:2/62: dwrite d3/f12 [0,4194304] 0 2024-04-01T06:57:31.759 INFO:tasks.workunit.client.0.smithi083.stdout:3/36: creat d6/fa x:0 0 0 2024-04-01T06:57:31.763 INFO:tasks.workunit.client.0.smithi083.stdout:1/40: getdents db 0 2024-04-01T06:57:31.766 INFO:tasks.workunit.client.0.smithi083.stdout:1/41: rmdir db 39 2024-04-01T06:57:31.768 INFO:tasks.workunit.client.0.smithi083.stdout:1/42: creat db/f13 x:0 0 0 2024-04-01T06:57:31.768 INFO:tasks.workunit.client.0.smithi083.stdout:1/43: write db/f12 [955029,72127] 0 2024-04-01T06:57:31.768 INFO:tasks.workunit.client.0.smithi083.stdout:2/63: dread d3/fc [0,4194304] 0 2024-04-01T06:57:31.769 INFO:tasks.workunit.client.0.smithi083.stdout:1/44: creat db/f14 x:0 0 0 2024-04-01T06:57:31.769 INFO:tasks.workunit.client.0.smithi083.stdout:1/45: chown db/f12 2690 1 2024-04-01T06:57:31.770 INFO:tasks.workunit.client.0.smithi083.stdout:2/64: mknod d3/c15 0 2024-04-01T06:57:31.772 INFO:tasks.workunit.client.0.smithi083.stdout:1/46: creat db/f15 x:0 0 0 2024-04-01T06:57:31.772 INFO:tasks.workunit.client.0.smithi083.stdout:1/47: chown db/fd 25 1 2024-04-01T06:57:31.772 INFO:tasks.workunit.client.0.smithi083.stdout:1/48: chown f1 589 1 2024-04-01T06:57:31.772 INFO:tasks.workunit.client.0.smithi083.stdout:1/49: chown db 3 1 2024-04-01T06:57:31.772 INFO:tasks.workunit.client.0.smithi083.stdout:1/50: write f3 [3342514,25911] 0 2024-04-01T06:57:31.774 INFO:tasks.workunit.client.0.smithi083.stdout:2/65: rename d3/f10 to d3/f16 0 2024-04-01T06:57:31.777 INFO:tasks.workunit.client.0.smithi083.stdout:5/32: truncate d4/f6 921787 0 2024-04-01T06:57:31.777 INFO:tasks.workunit.client.0.smithi083.stdout:5/33: chown d4/f6 757712599 1 2024-04-01T06:57:31.780 INFO:tasks.workunit.client.0.smithi083.stdout:8/46: getdents . 0 2024-04-01T06:57:31.781 INFO:tasks.workunit.client.0.smithi083.stdout:8/47: read f9 [1967852,46722] 0 2024-04-01T06:57:31.791 INFO:tasks.workunit.client.0.smithi083.stdout:5/34: getdents d4 0 2024-04-01T06:57:31.792 INFO:tasks.workunit.client.0.smithi083.stdout:5/35: chown d4/c5 1340 1 2024-04-01T06:57:31.792 INFO:tasks.workunit.client.0.smithi083.stdout:5/36: chown d4/f6 118610525 1 2024-04-01T06:57:31.792 INFO:tasks.workunit.client.0.smithi083.stdout:5/37: rename d4 to d4/d8 22 2024-04-01T06:57:31.797 INFO:tasks.workunit.client.0.smithi083.stdout:9/48: truncate d6/f7 3053056 0 2024-04-01T06:57:31.799 INFO:tasks.workunit.client.0.smithi083.stdout:5/38: mkdir d4/d9 0 2024-04-01T06:57:31.804 INFO:tasks.workunit.client.0.smithi083.stdout:9/49: rename f5 to d6/f13 0 2024-04-01T06:57:31.811 INFO:tasks.workunit.client.0.smithi083.stdout:0/18: read f1 [798947,53282] 0 2024-04-01T06:57:31.811 INFO:tasks.workunit.client.0.smithi083.stdout:3/37: rmdir d6 39 2024-04-01T06:57:31.814 INFO:tasks.workunit.client.0.smithi083.stdout:0/19: link f1 f2 0 2024-04-01T06:57:31.814 INFO:tasks.workunit.client.0.smithi083.stdout:0/20: readlink l0 0 2024-04-01T06:57:31.814 INFO:tasks.workunit.client.0.smithi083.stdout:0/21: truncate f1 1872958 0 2024-04-01T06:57:31.814 INFO:tasks.workunit.client.0.smithi083.stdout:0/22: read f2 [1324202,18802] 0 2024-04-01T06:57:31.814 INFO:tasks.workunit.client.0.smithi083.stdout:3/38: creat d6/fb x:0 0 0 2024-04-01T06:57:31.817 INFO:tasks.workunit.client.0.smithi083.stdout:1/51: truncate f3 3638295 0 2024-04-01T06:57:31.817 INFO:tasks.workunit.client.0.smithi083.stdout:1/52: chown db 1715076540 1 2024-04-01T06:57:31.817 INFO:tasks.workunit.client.0.smithi083.stdout:1/53: truncate db/fe 1006022 0 2024-04-01T06:57:31.819 INFO:tasks.workunit.client.0.smithi083.stdout:3/39: creat d6/fc x:0 0 0 2024-04-01T06:57:31.821 INFO:tasks.workunit.client.0.smithi083.stdout:1/54: rename db/f12 to db/f16 0 2024-04-01T06:57:31.821 INFO:tasks.workunit.client.0.smithi083.stdout:1/55: write f8 [667858,7110] 0 2024-04-01T06:57:31.824 INFO:tasks.workunit.client.0.smithi083.stdout:8/48: symlink l10 0 2024-04-01T06:57:31.826 INFO:tasks.workunit.client.0.smithi083.stdout:3/40: rename d6/fa to d6/fd 0 2024-04-01T06:57:31.828 INFO:tasks.workunit.client.0.smithi083.stdout:8/49: chown f9 23986491 1 2024-04-01T06:57:31.831 INFO:tasks.workunit.client.0.smithi083.stdout:0/23: dwrite f1 [0,4194304] 0 2024-04-01T06:57:31.833 INFO:tasks.workunit.client.0.smithi083.stdout:3/41: dread - d6/f8 zero size 2024-04-01T06:57:31.833 INFO:tasks.workunit.client.0.smithi083.stdout:3/42: chown f2 0 1 2024-04-01T06:57:31.833 INFO:tasks.workunit.client.0.smithi083.stdout:3/43: dread - d6/f9 zero size 2024-04-01T06:57:31.833 INFO:tasks.workunit.client.0.smithi083.stdout:5/39: dwrite d4/f6 [0,4194304] 0 2024-04-01T06:57:31.837 INFO:tasks.workunit.client.0.smithi083.stdout:0/24: creat f3 x:0 0 0 2024-04-01T06:57:31.837 INFO:tasks.workunit.client.0.smithi083.stdout:0/25: fsync f1 0 2024-04-01T06:57:31.839 INFO:tasks.workunit.client.0.smithi083.stdout:9/50: unlink d6/da/fe 0 2024-04-01T06:57:31.840 INFO:tasks.workunit.client.0.smithi083.stdout:1/56: dwrite fa [0,4194304] 0 2024-04-01T06:57:31.840 INFO:tasks.workunit.client.0.smithi083.stdout:1/57: fsync f7 0 2024-04-01T06:57:31.841 INFO:tasks.workunit.client.0.smithi083.stdout:8/50: mknod c11 0 2024-04-01T06:57:31.844 INFO:tasks.workunit.client.0.smithi083.stdout:5/40: creat d4/fa x:0 0 0 2024-04-01T06:57:31.847 INFO:tasks.workunit.client.0.smithi083.stdout:0/26: link l0 l4 0 2024-04-01T06:57:31.847 INFO:tasks.workunit.client.0.smithi083.stdout:0/27: chown f1 5947 1 2024-04-01T06:57:31.847 INFO:tasks.workunit.client.0.smithi083.stdout:3/44: rmdir d6 39 2024-04-01T06:57:31.848 INFO:tasks.workunit.client.0.smithi083.stdout:3/45: dread - d6/f8 zero size 2024-04-01T06:57:31.849 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:31.848+0000 7f36d3fff700 1 -- 172.21.15.83:0/3128283151 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55876d53ec90 con 0x55876d80d270 2024-04-01T06:57:31.849 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:31.848+0000 7f36d3fff700 10 client.15951 handle_command_reply: tid=0 2024-04-01T06:57:31.849 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:31.849+0000 7f3706e18b80 1 client.15951 shutdown 2024-04-01T06:57:31.849 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:31.849+0000 7f3706e18b80 1 -- 172.21.15.83:0/3128283151 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55876d7a88d0 msgr2=0x55876d80b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:31.850 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:31.849+0000 7f3706e18b80 1 --2- 172.21.15.83:0/3128283151 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55876d7a88d0 0x55876d80b250 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f36ec096510 tx=0x7f36ec004bc0 comp rx=0 tx=0).stop 2024-04-01T06:57:31.850 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:31.849+0000 7f3706e18b80 1 -- 172.21.15.83:0/3128283151 shutdown_connections 2024-04-01T06:57:31.850 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:31.849+0000 7f3706e18b80 1 --2- 172.21.15.83:0/3128283151 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55876d80d270 0x55876d80f690 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:31.850 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:31.849+0000 7f3706e18b80 1 --2- 172.21.15.83:0/3128283151 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55876d7a88d0 0x55876d80b250 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:31.850 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:31.849+0000 7f36d3fff700 0 client.15951 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:57:31.850 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:31.849+0000 7f3706e18b80 1 --2- 172.21.15.83:0/3128283151 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55876d79d100 0x55876d7ad770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:31.850 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:31.849+0000 7f3706e18b80 1 --2- 172.21.15.83:0/3128283151 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55876d79da20 0x55876d7adcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:31.850 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:31.849+0000 7f3706e18b80 1 -- 172.21.15.83:0/3128283151 >> 172.21.15.83:0/3128283151 conn(0x55876d6fd640 msgr2=0x55876d798d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:31.850 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:31.849+0000 7f3706e18b80 1 -- 172.21.15.83:0/3128283151 shutdown_connections 2024-04-01T06:57:31.850 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:31.849+0000 7f3706e18b80 1 -- 172.21.15.83:0/3128283151 wait complete. 2024-04-01T06:57:31.850 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:31.849+0000 7f3706e18b80 20 client.15951 trim_cache size 0 max 16384 2024-04-01T06:57:31.851 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout:{ 2024-04-01T06:57:31.851 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout: "message": "", 2024-04-01T06:57:31.851 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout: "return_code": 0 2024-04-01T06:57:31.851 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout:} 2024-04-01T06:57:31.851 INFO:tasks.workunit.client.0.smithi083.stdout:9/51: rename d6/da/fd to d6/f14 0 2024-04-01T06:57:31.852 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:31.850+0000 7f36fac82700 1 -- 172.21.15.83:0/1301891147 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f36e40a1290 msgr2=0x7f36e40a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:31.852 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:31.850+0000 7f36fac82700 1 --2- 172.21.15.83:0/1301891147 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f36e40a1290 0x7f36e40a3750 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f36e800ac50 tx=0x7f36e800a380 comp rx=0 tx=0).stop 2024-04-01T06:57:31.852 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:31.850+0000 7f36fac82700 1 -- 172.21.15.83:0/1301891147 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36f4106e10 msgr2=0x7f36f419db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:31.852 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:31.850+0000 7f36fac82700 1 --2- 172.21.15.83:0/1301891147 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36f4106e10 0x7f36f419db50 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f36ec00ef30 tx=0x7f36ec00c3a0 comp rx=0 tx=0).stop 2024-04-01T06:57:31.852 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:31.850+0000 7f36fac82700 1 -- 172.21.15.83:0/1301891147 shutdown_connections 2024-04-01T06:57:31.852 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:31.850+0000 7f36fac82700 1 --2- 172.21.15.83:0/1301891147 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f36e40a1290 0x7f36e40a3750 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:31.852 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:31.850+0000 7f36fac82700 1 --2- 172.21.15.83:0/1301891147 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f36f4106e10 0x7f36f419db50 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:31.853 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:31.850+0000 7f36fac82700 1 --2- 172.21.15.83:0/1301891147 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f36f40680e0 0x7f36f4199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:31.853 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:31.850+0000 7f36fac82700 1 --2- 172.21.15.83:0/1301891147 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36f4068aa0 0x7f36f41997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:31.853 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:31.850+0000 7f36fac82700 1 -- 172.21.15.83:0/1301891147 >> 172.21.15.83:0/1301891147 conn(0x7f36f4076d50 msgr2=0x7f36f410be00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:31.853 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:31.850+0000 7f36fac82700 1 -- 172.21.15.83:0/1301891147 shutdown_connections 2024-04-01T06:57:31.853 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:31.850+0000 7f36fac82700 1 -- 172.21.15.83:0/1301891147 wait complete. 2024-04-01T06:57:31.853 INFO:tasks.workunit.client.0.smithi083.stdout:1/58: truncate db/f16 315359 0 2024-04-01T06:57:31.853 INFO:tasks.workunit.client.0.smithi083.stdout:8/51: fsync fa 0 2024-04-01T06:57:31.855 INFO:tasks.workunit.client.0.smithi083.stdout:0/28: symlink l5 0 2024-04-01T06:57:31.858 INFO:tasks.workunit.client.0.smithi083.stdout:3/46: rmdir d6 39 2024-04-01T06:57:31.858 INFO:tasks.workunit.client.0.smithi083.stdout:3/47: write d6/f8 [21256,40059] 0 2024-04-01T06:57:31.859 INFO:tasks.workunit.client.0.smithi083.stdout:9/52: truncate d6/f13 593216 0 2024-04-01T06:57:31.862 INFO:tasks.workunit.client.0.smithi083.stdout:1/59: creat db/f17 x:0 0 0 2024-04-01T06:57:31.862 INFO:tasks.workunit.client.0.smithi083.stdout:1/60: read f3 [1198685,46409] 0 2024-04-01T06:57:31.864 INFO:tasks.workunit.client.0.smithi083.stdout:8/52: stat f4 0 2024-04-01T06:57:31.865 INFO:tasks.workunit.client.0.smithi083.stdout:0/29: creat f6 x:0 0 0 2024-04-01T06:57:31.867 INFO:tasks.workunit.client.0.smithi083.stdout:3/48: rmdir d6 39 2024-04-01T06:57:31.871 INFO:tasks.workunit.client.0.smithi083.stdout:1/61: creat db/f18 x:0 0 0 2024-04-01T06:57:31.871 INFO:tasks.workunit.client.0.smithi083.stdout:1/62: chown f3 1 1 2024-04-01T06:57:31.871 INFO:tasks.workunit.client.0.smithi083.stdout:1/63: truncate db/f17 1019383 0 2024-04-01T06:57:31.871 INFO:tasks.workunit.client.0.smithi083.stdout:9/53: rmdir d6 39 2024-04-01T06:57:31.871 INFO:tasks.workunit.client.0.smithi083.stdout:9/54: fsync d6/f14 0 2024-04-01T06:57:31.871 INFO:tasks.workunit.client.0.smithi083.stdout:9/55: truncate d6/f14 975798 0 2024-04-01T06:57:31.871 INFO:tasks.workunit.client.0.smithi083.stdout:8/53: chown fe 3660 1 2024-04-01T06:57:31.873 INFO:tasks.workunit.client.0.smithi083.stdout:0/30: creat f7 x:0 0 0 2024-04-01T06:57:31.874 INFO:tasks.workunit.client.0.smithi083.stdout:3/49: rmdir d6 39 2024-04-01T06:57:31.876 INFO:tasks.workunit.client.0.smithi083.stdout:1/64: symlink db/l19 0 2024-04-01T06:57:31.876 INFO:tasks.workunit.client.0.smithi083.stdout:1/65: truncate db/f10 118765 0 2024-04-01T06:57:31.877 INFO:tasks.workunit.client.0.smithi083.stdout:9/56: write d6/f7 [3632268,111364] 0 2024-04-01T06:57:31.877 INFO:tasks.workunit.client.0.smithi083.stdout:8/54: truncate f7 1010097 0 2024-04-01T06:57:31.879 INFO:tasks.workunit.client.0.smithi083.stdout:0/31: rename l4 to l8 0 2024-04-01T06:57:31.879 INFO:tasks.workunit.client.0.smithi083.stdout:0/32: write f6 [704610,89188] 0 2024-04-01T06:57:31.880 INFO:tasks.workunit.client.0.smithi083.stdout:3/50: creat d6/fe x:0 0 0 2024-04-01T06:57:31.881 INFO:tasks.workunit.client.0.smithi083.stdout:1/66: symlink db/l1a 0 2024-04-01T06:57:31.882 INFO:tasks.workunit.client.0.smithi083.stdout:1/67: readlink db/l19 0 2024-04-01T06:57:31.884 INFO:tasks.workunit.client.0.smithi083.stdout:9/57: stat l0 0 2024-04-01T06:57:31.884 INFO:tasks.workunit.client.0.smithi083.stdout:8/55: stat l8 0 2024-04-01T06:57:31.885 INFO:tasks.workunit.client.0.smithi083.stdout:1/68: creat db/f1b x:0 0 0 2024-04-01T06:57:31.885 INFO:tasks.workunit.client.0.smithi083.stdout:1/69: write db/f16 [425463,46421] 0 2024-04-01T06:57:31.885 INFO:tasks.workunit.client.0.smithi083.stdout:1/70: dread - db/f14 zero size 2024-04-01T06:57:31.889 INFO:tasks.workunit.client.0.smithi083.stdout:1/71: mkdir db/d1c 0 2024-04-01T06:57:31.889 INFO:tasks.workunit.client.0.smithi083.stdout:3/51: dread f0 [0,4194304] 0 2024-04-01T06:57:31.889 INFO:tasks.workunit.client.0.smithi083.stdout:3/52: read - d6/fc zero size 2024-04-01T06:57:31.890 INFO:tasks.workunit.client.0.smithi083.stdout:8/56: link l8 l12 0 2024-04-01T06:57:31.890 INFO:tasks.workunit.client.0.smithi083.stdout:1/72: mkdir db/d1c/d1d 0 2024-04-01T06:57:31.893 INFO:tasks.workunit.client.0.smithi083.stdout:3/53: mkdir d6/df 0 2024-04-01T06:57:31.894 INFO:tasks.workunit.client.0.smithi083.stdout:8/57: symlink l13 0 2024-04-01T06:57:31.895 INFO:tasks.workunit.client.0.smithi083.stdout:0/33: dwrite f3 [0,4194304] 0 2024-04-01T06:57:31.896 INFO:tasks.workunit.client.0.smithi083.stdout:3/54: rename d6/f8 to d6/df/f10 0 2024-04-01T06:57:31.896 INFO:tasks.workunit.client.0.smithi083.stdout:3/55: truncate d6/f9 679649 0 2024-04-01T06:57:31.896 INFO:tasks.workunit.client.0.smithi083.stdout:3/56: read - d6/fb zero size 2024-04-01T06:57:31.896 INFO:tasks.workunit.client.0.smithi083.stdout:3/57: read f0 [2759426,66986] 0 2024-04-01T06:57:31.897 INFO:tasks.workunit.client.0.smithi083.stdout:8/58: creat f14 x:0 0 0 2024-04-01T06:57:31.897 INFO:tasks.workunit.client.0.smithi083.stdout:8/59: rmdir - no directory 2024-04-01T06:57:31.899 INFO:tasks.workunit.client.0.smithi083.stdout:3/58: dread f2 [0,4194304] 0 2024-04-01T06:57:31.904 INFO:tasks.workunit.client.0.smithi083.stdout:0/34: mknod c9 0 2024-04-01T06:57:31.905 INFO:tasks.workunit.client.0.smithi083.stdout:3/59: creat d6/df/f11 x:0 0 0 2024-04-01T06:57:31.905 INFO:tasks.workunit.client.0.smithi083.stdout:9/58: dwrite d6/f13 [0,4194304] 0 2024-04-01T06:57:31.906 INFO:tasks.workunit.client.0.smithi083.stdout:9/59: write d6/f14 [210027,106914] 0 2024-04-01T06:57:31.906 INFO:tasks.workunit.client.0.smithi083.stdout:9/60: stat d6/cf 0 2024-04-01T06:57:31.908 INFO:tasks.workunit.client.0.smithi083.stdout:9/61: fsync d6/f7 0 2024-04-01T06:57:31.909 INFO:tasks.workunit.client.0.smithi083.stdout:9/62: write d6/f13 [244247,10780] 0 2024-04-01T06:57:31.910 INFO:tasks.workunit.client.0.smithi083.stdout:0/35: unlink f3 0 2024-04-01T06:57:31.912 INFO:tasks.workunit.client.0.smithi083.stdout:1/73: dwrite f8 [0,4194304] 0 2024-04-01T06:57:31.919 INFO:tasks.workunit.client.0.smithi083.stdout:3/60: dwrite d6/fb [0,4194304] 0 2024-04-01T06:57:31.920 INFO:tasks.workunit.client.0.smithi083.stdout:0/36: rename f1 to fa 0 2024-04-01T06:57:31.922 INFO:tasks.workunit.client.0.smithi083.stdout:1/74: symlink db/l1e 0 2024-04-01T06:57:31.923 INFO:tasks.workunit.client.0.smithi083.stdout:9/63: dread d6/f13 [0,4194304] 0 2024-04-01T06:57:31.923 INFO:tasks.workunit.client.0.smithi083.stdout:1/75: write db/f11 [5006468,14822] 0 2024-04-01T06:57:31.928 INFO:tasks.workunit.client.0.smithi083.stdout:8/60: dwrite f4 [4194304,4194304] 0 2024-04-01T06:57:31.928 INFO:tasks.workunit.client.0.smithi083.stdout:8/61: read - fe zero size 2024-04-01T06:57:31.928 INFO:tasks.workunit.client.0.smithi083.stdout:8/62: fdatasync fe 0 2024-04-01T06:57:31.941 INFO:tasks.workunit.client.0.smithi083.stdout:1/76: dwrite db/f16 [0,4194304] 0 2024-04-01T06:57:31.950 INFO:tasks.workunit.client.0.smithi083.stdout:0/37: fsync f2 0 2024-04-01T06:57:31.952 INFO:tasks.workunit.client.0.smithi083.stdout:9/64: mkdir d6/d15 0 2024-04-01T06:57:32.002 INFO:tasks.workunit.client.0.smithi083.stdout:1/77: rmdir db 39 2024-04-01T06:57:32.002 INFO:tasks.workunit.client.0.smithi083.stdout:1/78: write db/f10 [263610,107480] 0 2024-04-01T06:57:32.003 INFO:tasks.workunit.client.0.smithi083.stdout:3/61: mkdir d6/d12 0 2024-04-01T06:57:32.003 INFO:tasks.workunit.client.0.smithi083.stdout:3/62: readlink l5 0 2024-04-01T06:57:32.003 INFO:tasks.workunit.client.0.smithi083.stdout:0/38: symlink lb 0 2024-04-01T06:57:32.004 INFO:tasks.workunit.client.0.smithi083.stdout:9/65: unlink l2 0 2024-04-01T06:57:32.006 INFO:tasks.workunit.client.0.smithi083.stdout:8/63: mkdir d15 0 2024-04-01T06:57:32.006 INFO:tasks.workunit.client.0.smithi083.stdout:8/64: dread - fe zero size 2024-04-01T06:57:32.007 INFO:tasks.workunit.client.0.smithi083.stdout:1/79: truncate f7 3399234 0 2024-04-01T06:57:32.009 INFO:tasks.workunit.client.0.smithi083.stdout:3/63: creat d6/d12/f13 x:0 0 0 2024-04-01T06:57:32.013 INFO:tasks.workunit.client.0.smithi083.stdout:8/65: symlink d15/l16 0 2024-04-01T06:57:32.013 INFO:tasks.workunit.client.0.smithi083.stdout:8/66: dread - fe zero size 2024-04-01T06:57:32.014 INFO:tasks.workunit.client.0.smithi083.stdout:0/39: getdents . 0 2024-04-01T06:57:32.014 INFO:tasks.workunit.client.0.smithi083.stdout:0/40: stat c9 0 2024-04-01T06:57:32.015 INFO:tasks.workunit.client.0.smithi083.stdout:0/41: chown l0 603 1 2024-04-01T06:57:32.015 INFO:tasks.workunit.client.0.smithi083.stdout:0/42: write f2 [631419,1753] 0 2024-04-01T06:57:32.016 INFO:tasks.workunit.client.0.smithi083.stdout:1/80: truncate db/f11 3758304 0 2024-04-01T06:57:32.019 INFO:tasks.workunit.client.0.smithi083.stdout:8/67: truncate fa 3467730 0 2024-04-01T06:57:32.022 INFO:tasks.workunit.client.0.smithi083.stdout:3/64: dwrite d6/df/f11 [0,4194304] 0 2024-04-01T06:57:32.023 INFO:tasks.workunit.client.0.smithi083.stdout:3/65: chown d6/fd 122338623 1 2024-04-01T06:57:32.023 INFO:tasks.workunit.client.0.smithi083.stdout:1/81: creat db/d1c/d1d/f1f x:0 0 0 2024-04-01T06:57:32.024 INFO:tasks.workunit.client.0.smithi083.stdout:8/68: creat d15/f17 x:0 0 0 2024-04-01T06:57:32.029 INFO:tasks.workunit.client.0.smithi083.stdout:3/66: creat d6/df/f14 x:0 0 0 2024-04-01T06:57:32.038 INFO:tasks.workunit.client.0.smithi083.stdout:3/67: rename d6/df to d6/d15 0 2024-04-01T06:57:32.039 INFO:tasks.workunit.client.0.smithi083.stdout:3/68: symlink d6/d12/l16 0 2024-04-01T06:57:32.043 INFO:tasks.workunit.client.0.smithi083.stdout:1/82: dwrite db/f17 [0,4194304] 0 2024-04-01T06:57:32.043 INFO:tasks.workunit.client.0.smithi083.stdout:1/83: truncate db/f18 553640 0 2024-04-01T06:57:32.049 INFO:tasks.workunit.client.0.smithi083.stdout:1/84: rename db/f16 to db/d1c/d1d/f20 0 2024-04-01T06:57:32.051 INFO:tasks.workunit.client.0.smithi083.stdout:1/85: creat db/d1c/f21 x:0 0 0 2024-04-01T06:57:32.051 INFO:tasks.workunit.client.0.smithi083.stdout:1/86: dread - db/f15 zero size 2024-04-01T06:57:32.052 INFO:tasks.workunit.client.0.smithi083.stdout:3/69: dwrite d6/fb [0,4194304] 0 2024-04-01T06:57:32.053 INFO:tasks.workunit.client.0.smithi083.stdout:3/70: chown d6 1233065648 1 2024-04-01T06:57:32.053 INFO:tasks.workunit.client.0.smithi083.stdout:3/71: chown d6 35788809 1 2024-04-01T06:57:32.053 INFO:tasks.workunit.client.0.smithi083.stdout:1/87: creat db/d1c/f22 x:0 0 0 2024-04-01T06:57:32.054 INFO:tasks.workunit.client.0.smithi083.stdout:1/88: write f1 [3617137,31952] 0 2024-04-01T06:57:32.056 INFO:tasks.workunit.client.0.smithi083.stdout:1/89: link db/f14 db/f23 0 2024-04-01T06:57:32.056 INFO:tasks.workunit.client.0.smithi083.stdout:1/90: write db/d1c/f22 [420271,111480] 0 2024-04-01T06:57:32.057 INFO:tasks.workunit.client.0.smithi083.stdout:1/91: creat db/d1c/f24 x:0 0 0 2024-04-01T06:57:32.058 INFO:tasks.workunit.client.0.smithi083.stdout:1/92: creat db/d1c/f25 x:0 0 0 2024-04-01T06:57:32.059 INFO:tasks.workunit.client.0.smithi083.stdout:1/93: mkdir db/d26 0 2024-04-01T06:57:32.061 INFO:tasks.workunit.client.0.smithi083.stdout:3/72: dread d6/fb [0,4194304] 0 2024-04-01T06:57:32.075 INFO:tasks.workunit.client.0.smithi083.stdout:1/94: dwrite db/f23 [0,4194304] 0 2024-04-01T06:57:32.080 INFO:tasks.workunit.client.0.smithi083.stdout:3/73: dwrite d6/fe [0,4194304] 0 2024-04-01T06:57:32.086 INFO:tasks.workunit.client.0.smithi083.stdout:3/74: symlink d6/d15/l17 0 2024-04-01T06:57:32.086 INFO:tasks.workunit.client.0.smithi083.stdout:3/75: write d6/fd [266178,108813] 0 2024-04-01T06:57:32.088 INFO:tasks.workunit.client.0.smithi083.stdout:3/76: rename d6/c7 to d6/d12/c18 0 2024-04-01T06:57:32.088 INFO:tasks.workunit.client.0.smithi083.stdout:3/77: chown d6/fb 242 1 2024-04-01T06:57:32.095 INFO:tasks.workunit.client.0.smithi083.stdout:3/78: dread d6/d15/f11 [0,4194304] 0 2024-04-01T06:57:32.095 INFO:tasks.workunit.client.0.smithi083.stdout:3/79: write f0 [2945063,47420] 0 2024-04-01T06:57:32.096 INFO:tasks.workunit.client.0.smithi083.stdout:3/80: write f2 [1825611,70572] 0 2024-04-01T06:57:32.114 INFO:tasks.workunit.client.0.smithi083.stdout:3/81: dwrite d6/fd [0,4194304] 0 2024-04-01T06:57:32.114 INFO:tasks.workunit.client.0.smithi083.stdout:3/82: write d6/fd [3030036,64755] 0 2024-04-01T06:57:32.116 INFO:tasks.workunit.client.0.smithi083.stdout:3/83: creat d6/d15/f19 x:0 0 0 2024-04-01T06:57:32.123 INFO:tasks.workunit.client.0.smithi083.stdout:7/29: rmdir d0 39 2024-04-01T06:57:32.125 INFO:tasks.workunit.client.0.smithi083.stdout:4/54: sync 2024-04-01T06:57:32.125 INFO:tasks.workunit.client.0.smithi083.stdout:6/30: sync 2024-04-01T06:57:32.125 INFO:tasks.workunit.client.0.smithi083.stdout:5/41: sync 2024-04-01T06:57:32.125 INFO:tasks.workunit.client.0.smithi083.stdout:2/66: sync 2024-04-01T06:57:32.125 INFO:tasks.workunit.client.0.smithi083.stdout:4/55: write d1/d4/ff [700072,54407] 0 2024-04-01T06:57:32.127 INFO:tasks.workunit.client.0.smithi083.stdout:6/31: read f1 [25318,45745] 0 2024-04-01T06:57:32.127 INFO:tasks.workunit.client.0.smithi083.stdout:2/67: truncate d3/f7 1143396 0 2024-04-01T06:57:32.127 INFO:tasks.workunit.client.0.smithi083.stdout:9/66: sync 2024-04-01T06:57:32.127 INFO:tasks.workunit.client.0.smithi083.stdout:9/67: chown l0 1639433 1 2024-04-01T06:57:32.127 INFO:tasks.workunit.client.0.smithi083.stdout:2/68: write d3/f16 [3331284,53507] 0 2024-04-01T06:57:32.129 INFO:tasks.workunit.client.0.smithi083.stdout:9/68: write d6/f13 [3797065,113913] 0 2024-04-01T06:57:32.136 INFO:tasks.workunit.client.0.smithi083.stdout:3/84: dwrite d6/fe [0,4194304] 0 2024-04-01T06:57:32.149 INFO:tasks.workunit.client.0.smithi083.stdout:5/42: dwrite d4/f6 [0,4194304] 0 2024-04-01T06:57:32.149 INFO:tasks.workunit.client.0.smithi083.stdout:5/43: write d4/fa [754857,118346] 0 2024-04-01T06:57:32.152 INFO:tasks.workunit.client.0.smithi083.stdout:4/56: dwrite d1/d4/db/f11 [0,4194304] 0 2024-04-01T06:57:32.155 INFO:tasks.workunit.client.0.smithi083.stdout:7/30: dwrite d0/d4/f5 [0,4194304] 0 2024-04-01T06:57:32.162 INFO:tasks.workunit.client.0.smithi083.stdout:2/69: dwrite d3/fc [0,4194304] 0 2024-04-01T06:57:32.163 INFO:tasks.workunit.client.0.smithi083.stdout:6/32: symlink d9/la 0 2024-04-01T06:57:32.164 INFO:tasks.workunit.client.0.smithi083.stdout:9/69: getdents d6/da 0 2024-04-01T06:57:32.165 INFO:tasks.workunit.client.0.smithi083.stdout:9/70: read d6/f7 [747164,14175] 0 2024-04-01T06:57:32.166 INFO:tasks.workunit.client.0.smithi083.stdout:3/85: rmdir d6/d12 39 2024-04-01T06:57:32.168 INFO:tasks.workunit.client.0.smithi083.stdout:5/44: readlink d4/l7 0 2024-04-01T06:57:32.168 INFO:tasks.workunit.client.0.smithi083.stdout:5/45: stat d4/fa 0 2024-04-01T06:57:32.168 INFO:tasks.workunit.client.0.smithi083.stdout:5/46: chown d4 75929226 1 2024-04-01T06:57:32.169 INFO:tasks.workunit.client.0.smithi083.stdout:4/57: mknod d1/c12 0 2024-04-01T06:57:32.172 INFO:tasks.workunit.client.0.smithi083.stdout:3/86: dread f0 [0,4194304] 0 2024-04-01T06:57:32.178 INFO:tasks.workunit.client.0.smithi083.stdout:7/31: getdents d0 0 2024-04-01T06:57:32.180 INFO:tasks.workunit.client.0.smithi083.stdout:2/70: mknod d3/c17 0 2024-04-01T06:57:32.181 INFO:tasks.workunit.client.0.smithi083.stdout:2/71: write d3/f7 [1417860,101100] 0 2024-04-01T06:57:32.182 INFO:tasks.workunit.client.0.smithi083.stdout:6/33: creat d9/fb x:0 0 0 2024-04-01T06:57:32.183 INFO:tasks.workunit.client.0.smithi083.stdout:9/71: symlink d6/l16 0 2024-04-01T06:57:32.184 INFO:tasks.workunit.client.0.smithi083.stdout:4/58: mknod d1/d4/c13 0 2024-04-01T06:57:32.185 INFO:tasks.workunit.client.0.smithi083.stdout:3/87: creat d6/d15/f1a x:0 0 0 2024-04-01T06:57:32.185 INFO:tasks.workunit.client.0.smithi083.stdout:3/88: fdatasync f0 0 2024-04-01T06:57:32.186 INFO:tasks.workunit.client.0.smithi083.stdout:0/43: sync 2024-04-01T06:57:32.186 INFO:tasks.workunit.client.0.smithi083.stdout:0/44: write f2 [5158247,87467] 0 2024-04-01T06:57:32.186 INFO:tasks.workunit.client.0.smithi083.stdout:0/45: readlink l0 0 2024-04-01T06:57:32.186 INFO:tasks.workunit.client.0.smithi083.stdout:0/46: chown c9 3892 1 2024-04-01T06:57:32.187 INFO:tasks.workunit.client.0.smithi083.stdout:2/72: creat d3/f18 x:0 0 0 2024-04-01T06:57:32.189 INFO:tasks.workunit.client.0.smithi083.stdout:0/47: fsync f2 0 2024-04-01T06:57:32.189 INFO:tasks.workunit.client.0.smithi083.stdout:0/48: truncate f7 628849 0 2024-04-01T06:57:32.189 INFO:tasks.workunit.client.0.smithi083.stdout:6/34: mkdir d9/dc 0 2024-04-01T06:57:32.189 INFO:tasks.workunit.client.0.smithi083.stdout:3/89: dread f0 [0,4194304] 0 2024-04-01T06:57:32.189 INFO:tasks.workunit.client.0.smithi083.stdout:0/49: write f7 [82324,16162] 0 2024-04-01T06:57:32.190 INFO:tasks.workunit.client.0.smithi083.stdout:0/50: write f2 [1458564,35783] 0 2024-04-01T06:57:32.190 INFO:tasks.workunit.client.0.smithi083.stdout:9/72: truncate d6/f14 318022 0 2024-04-01T06:57:32.190 INFO:tasks.workunit.client.0.smithi083.stdout:9/73: truncate d6/f7 4325549 0 2024-04-01T06:57:32.191 INFO:tasks.workunit.client.0.smithi083.stdout:5/47: link d4/fa d4/fb 0 2024-04-01T06:57:32.192 INFO:tasks.workunit.client.0.smithi083.stdout:5/48: chown d4/d9 5 1 2024-04-01T06:57:32.193 INFO:tasks.workunit.client.0.smithi083.stdout:4/59: rename d1/d8/f9 to d1/d8/f14 0 2024-04-01T06:57:32.194 INFO:tasks.workunit.client.0.smithi083.stdout:8/69: sync 2024-04-01T06:57:32.195 INFO:tasks.workunit.client.0.smithi083.stdout:1/95: sync 2024-04-01T06:57:32.195 INFO:tasks.workunit.client.0.smithi083.stdout:2/73: creat d3/f19 x:0 0 0 2024-04-01T06:57:32.195 INFO:tasks.workunit.client.0.smithi083.stdout:2/74: chown d3/c17 214633 1 2024-04-01T06:57:32.196 INFO:tasks.workunit.client.0.smithi083.stdout:6/35: mknod d9/cd 0 2024-04-01T06:57:32.198 INFO:tasks.workunit.client.0.smithi083.stdout:3/90: getdents d6 0 2024-04-01T06:57:32.202 INFO:tasks.workunit.client.0.smithi083.stdout:9/74: creat d6/d15/f17 x:0 0 0 2024-04-01T06:57:32.202 INFO:tasks.workunit.client.0.smithi083.stdout:9/75: fsync d6/f7 0 2024-04-01T06:57:32.202 INFO:tasks.workunit.client.0.smithi083.stdout:2/75: dread d3/f16 [0,4194304] 0 2024-04-01T06:57:32.203 INFO:tasks.workunit.client.0.smithi083.stdout:9/76: read d6/f7 [46227,130503] 0 2024-04-01T06:57:32.203 INFO:tasks.workunit.client.0.smithi083.stdout:9/77: readlink l0 0 2024-04-01T06:57:32.203 INFO:tasks.workunit.client.0.smithi083.stdout:9/78: chown d6/da 2668467 1 2024-04-01T06:57:32.204 INFO:tasks.workunit.client.0.smithi083.stdout:5/49: mknod d4/d9/cc 0 2024-04-01T06:57:32.204 INFO:tasks.workunit.client.0.smithi083.stdout:5/50: chown d4/d9/cc 415272160 1 2024-04-01T06:57:32.204 INFO:tasks.workunit.client.0.smithi083.stdout:5/51: read d4/f6 [737976,32197] 0 2024-04-01T06:57:32.204 INFO:tasks.workunit.client.0.smithi083.stdout:0/51: dwrite f6 [0,4194304] 0 2024-04-01T06:57:32.207 INFO:tasks.workunit.client.0.smithi083.stdout:4/60: mknod d1/c15 0 2024-04-01T06:57:32.207 INFO:tasks.workunit.client.0.smithi083.stdout:4/61: chown d1/d8/f14 28975516 1 2024-04-01T06:57:32.207 INFO:tasks.workunit.client.0.smithi083.stdout:4/62: fdatasync d1/d8/f14 0 2024-04-01T06:57:32.207 INFO:tasks.workunit.client.0.smithi083.stdout:4/63: fdatasync d1/d4/db/f11 0 2024-04-01T06:57:32.209 INFO:tasks.workunit.client.0.smithi083.stdout:1/96: creat db/d26/f27 x:0 0 0 2024-04-01T06:57:32.210 INFO:tasks.workunit.client.0.smithi083.stdout:6/36: creat d9/dc/fe x:0 0 0 2024-04-01T06:57:32.211 INFO:tasks.workunit.client.0.smithi083.stdout:3/91: creat d6/d15/f1b x:0 0 0 2024-04-01T06:57:32.211 INFO:tasks.workunit.client.0.smithi083.stdout:3/92: chown f2 30865 1 2024-04-01T06:57:32.214 INFO:tasks.workunit.client.0.smithi083.stdout:2/76: creat d3/f1a x:0 0 0 2024-04-01T06:57:32.215 INFO:tasks.workunit.client.0.smithi083.stdout:2/77: write d3/f12 [3115336,101550] 0 2024-04-01T06:57:32.215 INFO:tasks.workunit.client.0.smithi083.stdout:2/78: chown f2 949 1 2024-04-01T06:57:32.215 INFO:tasks.workunit.client.0.smithi083.stdout:2/79: truncate d3/fe 1680007 0 2024-04-01T06:57:32.216 INFO:tasks.workunit.client.0.smithi083.stdout:9/79: creat d6/da/f18 x:0 0 0 2024-04-01T06:57:32.221 INFO:tasks.workunit.client.0.smithi083.stdout:4/64: rename d1/c12 to d1/d4/da/c16 0 2024-04-01T06:57:32.222 INFO:tasks.workunit.client.0.smithi083.stdout:1/97: symlink db/d1c/l28 0 2024-04-01T06:57:32.222 INFO:tasks.workunit.client.0.smithi083.stdout:1/98: fdatasync db/fd 0 2024-04-01T06:57:32.223 INFO:tasks.workunit.client.0.smithi083.stdout:3/93: unlink d6/d12/c18 0 2024-04-01T06:57:32.223 INFO:tasks.workunit.client.0.smithi083.stdout:0/52: write f6 [4253774,75606] 0 2024-04-01T06:57:32.224 INFO:tasks.workunit.client.0.smithi083.stdout:8/70: dwrite f9 [0,4194304] 0 2024-04-01T06:57:32.224 INFO:tasks.workunit.client.0.smithi083.stdout:8/71: chown f9 161 1 2024-04-01T06:57:32.225 INFO:tasks.workunit.client.0.smithi083.stdout:4/65: mknod d1/d4/db/c17 0 2024-04-01T06:57:32.228 INFO:tasks.workunit.client.0.smithi083.stdout:8/72: unlink fe 0 2024-04-01T06:57:32.228 INFO:tasks.workunit.client.0.smithi083.stdout:8/73: readlink l8 0 2024-04-01T06:57:32.230 INFO:tasks.workunit.client.0.smithi083.stdout:2/80: dwrite f0 [0,4194304] 0 2024-04-01T06:57:32.230 INFO:tasks.workunit.client.0.smithi083.stdout:2/81: write d3/f18 [383689,13255] 0 2024-04-01T06:57:32.231 INFO:tasks.workunit.client.0.smithi083.stdout:4/66: rename d1/d8/fe to d1/d4/db/f18 0 2024-04-01T06:57:32.232 INFO:tasks.workunit.client.0.smithi083.stdout:8/74: mkdir d15/d18 0 2024-04-01T06:57:32.234 INFO:tasks.workunit.client.0.smithi083.stdout:2/82: mkdir d3/d1b 0 2024-04-01T06:57:32.238 INFO:tasks.workunit.client.0.smithi083.stdout:1/99: dwrite db/d1c/f25 [0,4194304] 0 2024-04-01T06:57:32.238 INFO:tasks.workunit.client.0.smithi083.stdout:1/100: truncate db/f13 194700 0 2024-04-01T06:57:32.238 INFO:tasks.workunit.client.0.smithi083.stdout:1/101: dread - db/fd zero size 2024-04-01T06:57:32.241 INFO:tasks.workunit.client.0.smithi083.stdout:1/102: mkdir db/d1c/d29 0 2024-04-01T06:57:32.242 INFO:tasks.workunit.client.0.smithi083.stdout:1/103: symlink db/d1c/d29/l2a 0 2024-04-01T06:57:32.244 INFO:tasks.workunit.client.0.smithi083.stdout:9/80: dwrite d6/d15/f17 [0,4194304] 0 2024-04-01T06:57:32.245 INFO:tasks.workunit.client.0.smithi083.stdout:0/53: dread f2 [0,4194304] 0 2024-04-01T06:57:32.245 INFO:tasks.workunit.client.0.smithi083.stdout:1/104: link db/d1c/d1d/f20 db/d1c/f2b 0 2024-04-01T06:57:32.247 INFO:tasks.workunit.client.0.smithi083.stdout:7/32: rename d0/f7 to d0/f8 0 2024-04-01T06:57:32.248 INFO:tasks.workunit.client.0.smithi083.stdout:4/67: dwrite d1/f6 [0,4194304] 0 2024-04-01T06:57:32.248 INFO:tasks.workunit.client.0.smithi083.stdout:4/68: chown d1/f2 44102 1 2024-04-01T06:57:32.248 INFO:tasks.workunit.client.0.smithi083.stdout:3/94: rmdir d6/d15 39 2024-04-01T06:57:32.251 INFO:tasks.workunit.client.0.smithi083.stdout:8/75: rmdir d15 39 2024-04-01T06:57:32.252 INFO:tasks.workunit.client.0.smithi083.stdout:2/83: getdents d3 0 2024-04-01T06:57:32.253 INFO:tasks.workunit.client.0.smithi083.stdout:2/84: truncate f1 4724437 0 2024-04-01T06:57:32.255 INFO:tasks.workunit.client.0.smithi083.stdout:0/54: link fa fc 0 2024-04-01T06:57:32.257 INFO:tasks.workunit.client.0.smithi083.stdout:1/105: creat db/d26/f2c x:0 0 0 2024-04-01T06:57:32.261 INFO:tasks.workunit.client.0.smithi083.stdout:4/69: truncate d1/f2 1219144 0 2024-04-01T06:57:32.261 INFO:tasks.workunit.client.0.smithi083.stdout:3/95: getdents d6 0 2024-04-01T06:57:32.262 INFO:tasks.workunit.client.0.smithi083.stdout:8/76: mkdir d15/d18/d19 0 2024-04-01T06:57:32.262 INFO:tasks.workunit.client.0.smithi083.stdout:8/77: write f14 [8590,93230] 0 2024-04-01T06:57:32.263 INFO:tasks.workunit.client.0.smithi083.stdout:9/81: dwrite d6/d15/f17 [0,4194304] 0 2024-04-01T06:57:32.264 INFO:tasks.workunit.client.0.smithi083.stdout:2/85: creat d3/f1c x:0 0 0 2024-04-01T06:57:32.265 INFO:tasks.workunit.client.0.smithi083.stdout:0/55: creat fd x:0 0 0 2024-04-01T06:57:32.266 INFO:tasks.workunit.client.0.smithi083.stdout:7/33: mkdir d0/d4/d9 0 2024-04-01T06:57:32.267 INFO:tasks.workunit.client.0.smithi083.stdout:3/96: creat d6/d15/f1c x:0 0 0 2024-04-01T06:57:32.269 INFO:tasks.workunit.client.0.smithi083.stdout:2/86: fsync d3/fe 0 2024-04-01T06:57:32.270 INFO:tasks.workunit.client.0.smithi083.stdout:1/106: dread f7 [0,4194304] 0 2024-04-01T06:57:32.270 INFO:tasks.workunit.client.0.smithi083.stdout:0/56: creat fe x:0 0 0 2024-04-01T06:57:32.271 INFO:tasks.workunit.client.0.smithi083.stdout:7/34: creat d0/d4/fa x:0 0 0 2024-04-01T06:57:32.272 INFO:tasks.workunit.client.0.smithi083.stdout:3/97: mknod d6/d15/c1d 0 2024-04-01T06:57:32.276 INFO:tasks.workunit.client.0.smithi083.stdout:1/107: creat db/d1c/d29/f2d x:0 0 0 2024-04-01T06:57:32.276 INFO:tasks.workunit.client.0.smithi083.stdout:1/108: dread - db/d1c/f24 zero size 2024-04-01T06:57:32.277 INFO:tasks.workunit.client.0.smithi083.stdout:0/57: mknod cf 0 2024-04-01T06:57:32.277 INFO:tasks.workunit.client.0.smithi083.stdout:0/58: write f6 [4730313,95708] 0 2024-04-01T06:57:32.278 INFO:tasks.workunit.client.0.smithi083.stdout:8/78: dread f9 [0,4194304] 0 2024-04-01T06:57:32.279 INFO:tasks.workunit.client.0.smithi083.stdout:7/35: unlink d0/f8 0 2024-04-01T06:57:32.280 INFO:tasks.workunit.client.0.smithi083.stdout:3/98: mkdir d6/d1e 0 2024-04-01T06:57:32.281 INFO:tasks.workunit.client.0.smithi083.stdout:9/82: dwrite d6/f14 [0,4194304] 0 2024-04-01T06:57:32.283 INFO:tasks.workunit.client.0.smithi083.stdout:0/59: link fe f10 0 2024-04-01T06:57:32.283 INFO:tasks.workunit.client.0.smithi083.stdout:0/60: fsync f2 0 2024-04-01T06:57:32.283 INFO:tasks.workunit.client.0.smithi083.stdout:0/61: fsync f2 0 2024-04-01T06:57:32.283 INFO:tasks.workunit.client.0.smithi083.stdout:0/62: write f10 [289762,27541] 0 2024-04-01T06:57:32.283 INFO:tasks.workunit.client.0.smithi083.stdout:0/63: stat c9 0 2024-04-01T06:57:32.283 INFO:tasks.workunit.client.0.smithi083.stdout:0/64: chown l0 86 1 2024-04-01T06:57:32.283 INFO:tasks.workunit.client.0.smithi083.stdout:8/79: creat d15/d18/d19/f1a x:0 0 0 2024-04-01T06:57:32.285 INFO:tasks.workunit.client.0.smithi083.stdout:0/65: fsync f6 0 2024-04-01T06:57:32.287 INFO:tasks.workunit.client.0.smithi083.stdout:2/87: rename d3/d1b to d3/d1d 0 2024-04-01T06:57:32.291 INFO:tasks.workunit.client.0.smithi083.stdout:4/70: dwrite d1/f2 [0,4194304] 0 2024-04-01T06:57:32.300 INFO:tasks.workunit.client.0.smithi083.stdout:1/109: dread db/d1c/f2b [0,4194304] 0 2024-04-01T06:57:32.301 INFO:tasks.workunit.client.0.smithi083.stdout:1/110: read db/f18 [323374,14925] 0 2024-04-01T06:57:32.302 INFO:tasks.workunit.client.0.smithi083.stdout:1/111: read fa [1461877,57784] 0 2024-04-01T06:57:32.311 INFO:tasks.workunit.client.0.smithi083.stdout:3/99: dwrite d6/d15/f11 [4194304,4194304] 0 2024-04-01T06:57:32.311 INFO:tasks.workunit.client.0.smithi083.stdout:8/80: dwrite d15/f17 [0,4194304] 0 2024-04-01T06:57:32.311 INFO:tasks.workunit.client.0.smithi083.stdout:8/81: fsync f4 0 2024-04-01T06:57:32.475 INFO:tasks.workunit.client.0.smithi083.stdout:9/83: creat d6/f19 x:0 0 0 2024-04-01T06:57:32.475 INFO:tasks.workunit.client.0.smithi083.stdout:9/84: fsync d6/f7 0 2024-04-01T06:57:32.475 INFO:tasks.workunit.client.0.smithi083.stdout:7/36: mknod d0/cb 0 2024-04-01T06:57:32.475 INFO:tasks.workunit.client.0.smithi083.stdout:7/37: stat d0/cb 0 2024-04-01T06:57:32.475 INFO:tasks.workunit.client.0.smithi083.stdout:7/38: fsync d0/d4/f5 0 2024-04-01T06:57:32.476 INFO:tasks.workunit.client.0.smithi083.stdout:0/66: creat f11 x:0 0 0 2024-04-01T06:57:32.483 INFO:tasks.workunit.client.0.smithi083.stdout:4/71: symlink d1/d4/da/l19 0 2024-04-01T06:57:32.483 INFO:tasks.workunit.client.0.smithi083.stdout:4/72: truncate d1/d4/db/f18 333849 0 2024-04-01T06:57:32.484 INFO:tasks.workunit.client.0.smithi083.stdout:1/112: mkdir db/d1c/d2e 0 2024-04-01T06:57:32.485 INFO:tasks.workunit.client.0.smithi083.stdout:3/100: mknod d6/d1e/c1f 0 2024-04-01T06:57:32.488 INFO:tasks.workunit.client.0.smithi083.stdout:8/82: mkdir d15/d1b 0 2024-04-01T06:57:32.489 INFO:tasks.workunit.client.0.smithi083.stdout:2/88: mknod d3/c1e 0 2024-04-01T06:57:32.490 INFO:tasks.workunit.client.0.smithi083.stdout:1/113: creat db/d1c/d2e/f2f x:0 0 0 2024-04-01T06:57:32.491 INFO:tasks.workunit.client.0.smithi083.stdout:3/101: chown d6/fb 244 1 2024-04-01T06:57:32.492 INFO:tasks.workunit.client.0.smithi083.stdout:9/85: dwrite d6/f7 [0,4194304] 0 2024-04-01T06:57:32.492 INFO:tasks.workunit.client.0.smithi083.stdout:8/83: mkdir d15/d18/d19/d1c 0 2024-04-01T06:57:32.492 INFO:tasks.workunit.client.0.smithi083.stdout:8/84: truncate d15/f17 4233003 0 2024-04-01T06:57:32.493 INFO:tasks.workunit.client.0.smithi083.stdout:5/52: sync 2024-04-01T06:57:32.493 INFO:tasks.workunit.client.0.smithi083.stdout:6/37: sync 2024-04-01T06:57:32.494 INFO:tasks.workunit.client.0.smithi083.stdout:0/67: dread fe [0,4194304] 0 2024-04-01T06:57:32.494 INFO:tasks.workunit.client.0.smithi083.stdout:5/53: write d4/fb [880278,47502] 0 2024-04-01T06:57:32.494 INFO:tasks.workunit.client.0.smithi083.stdout:2/89: rmdir d3/d1d 0 2024-04-01T06:57:32.495 INFO:tasks.workunit.client.0.smithi083.stdout:0/68: dread f7 [0,4194304] 0 2024-04-01T06:57:32.496 INFO:tasks.workunit.client.0.smithi083.stdout:1/114: mkdir db/d1c/d2e/d30 0 2024-04-01T06:57:32.496 INFO:tasks.workunit.client.0.smithi083.stdout:1/115: stat db/d1c/d2e 0 2024-04-01T06:57:32.497 INFO:tasks.workunit.client.0.smithi083.stdout:8/85: dread f14 [0,4194304] 0 2024-04-01T06:57:32.498 INFO:tasks.workunit.client.0.smithi083.stdout:9/86: creat d6/d15/f1a x:0 0 0 2024-04-01T06:57:32.498 INFO:tasks.workunit.client.0.smithi083.stdout:9/87: write d6/d15/f1a [297576,60163] 0 2024-04-01T06:57:32.499 INFO:tasks.workunit.client.0.smithi083.stdout:6/38: mkdir d9/dc/df 0 2024-04-01T06:57:32.500 INFO:tasks.workunit.client.0.smithi083.stdout:8/86: readlink l6 0 2024-04-01T06:57:32.500 INFO:tasks.workunit.client.0.smithi083.stdout:8/87: chown fa 254924111 1 2024-04-01T06:57:32.500 INFO:tasks.workunit.client.0.smithi083.stdout:5/54: dread d4/fb [0,4194304] 0 2024-04-01T06:57:32.501 INFO:tasks.workunit.client.0.smithi083.stdout:4/73: dread d1/d4/db/f11 [0,4194304] 0 2024-04-01T06:57:32.501 INFO:tasks.workunit.client.0.smithi083.stdout:1/116: write db/f13 [76896,60132] 0 2024-04-01T06:57:32.501 INFO:tasks.workunit.client.0.smithi083.stdout:6/39: mkdir d9/dc/d10 0 2024-04-01T06:57:32.501 INFO:tasks.workunit.client.0.smithi083.stdout:6/40: truncate d9/dc/fe 650587 0 2024-04-01T06:57:32.502 INFO:tasks.workunit.client.0.smithi083.stdout:6/41: dread - f8 zero size 2024-04-01T06:57:32.502 INFO:tasks.workunit.client.0.smithi083.stdout:7/39: dread d0/f3 [0,4194304] 0 2024-04-01T06:57:32.503 INFO:tasks.workunit.client.0.smithi083.stdout:2/90: dread d3/fe [0,4194304] 0 2024-04-01T06:57:32.503 INFO:tasks.workunit.client.0.smithi083.stdout:2/91: fsync d3/f1c 0 2024-04-01T06:57:32.508 INFO:tasks.workunit.client.0.smithi083.stdout:4/74: creat d1/d4/db/f1a x:0 0 0 2024-04-01T06:57:32.508 INFO:tasks.workunit.client.0.smithi083.stdout:8/88: rmdir d15/d18/d19/d1c 0 2024-04-01T06:57:32.508 INFO:tasks.workunit.client.0.smithi083.stdout:1/117: getdents db 0 2024-04-01T06:57:32.508 INFO:tasks.workunit.client.0.smithi083.stdout:8/89: readlink l13 0 2024-04-01T06:57:32.508 INFO:tasks.workunit.client.0.smithi083.stdout:8/90: fsync d15/f17 0 2024-04-01T06:57:32.510 INFO:tasks.workunit.client.0.smithi083.stdout:6/42: rmdir d9/dc/d10 0 2024-04-01T06:57:32.511 INFO:tasks.workunit.client.0.smithi083.stdout:4/75: dread d1/d4/ff [0,4194304] 0 2024-04-01T06:57:32.514 INFO:tasks.workunit.client.0.smithi083.stdout:7/40: link d0/d4/f5 d0/d4/fc 0 2024-04-01T06:57:32.514 INFO:tasks.workunit.client.0.smithi083.stdout:7/41: fdatasync d0/d4/fa 0 2024-04-01T06:57:32.515 INFO:tasks.workunit.client.0.smithi083.stdout:9/88: dwrite d6/d15/f1a [0,4194304] 0 2024-04-01T06:57:32.515 INFO:tasks.workunit.client.0.smithi083.stdout:9/89: truncate d6/f13 5228476 0 2024-04-01T06:57:32.517 INFO:tasks.workunit.client.0.smithi083.stdout:0/69: dwrite fe [0,4194304] 0 2024-04-01T06:57:32.519 INFO:tasks.workunit.client.0.smithi083.stdout:5/55: unlink d4/c5 0 2024-04-01T06:57:32.520 INFO:tasks.workunit.client.0.smithi083.stdout:5/56: write d4/fa [517975,78367] 0 2024-04-01T06:57:32.522 INFO:tasks.workunit.client.0.smithi083.stdout:3/102: rmdir d6 39 2024-04-01T06:57:32.527 INFO:tasks.workunit.client.0.smithi083.stdout:8/91: mkdir d15/d18/d19/d1d 0 2024-04-01T06:57:32.528 INFO:tasks.workunit.client.0.smithi083.stdout:6/43: chown f2 18518463 1 2024-04-01T06:57:32.533 INFO:tasks.workunit.client.0.smithi083.stdout:7/42: rename d0 to d0/dd 22 2024-04-01T06:57:32.536 INFO:tasks.workunit.client.0.smithi083.stdout:9/90: creat d6/d15/f1b x:0 0 0 2024-04-01T06:57:32.536 INFO:tasks.workunit.client.0.smithi083.stdout:1/118: rmdir db 39 2024-04-01T06:57:32.537 INFO:tasks.workunit.client.0.smithi083.stdout:2/92: mkdir d3/d1f 0 2024-04-01T06:57:32.540 INFO:tasks.workunit.client.0.smithi083.stdout:0/70: creat f12 x:0 0 0 2024-04-01T06:57:32.540 INFO:tasks.workunit.client.0.smithi083.stdout:0/71: fdatasync f6 0 2024-04-01T06:57:32.540 INFO:tasks.workunit.client.0.smithi083.stdout:5/57: dwrite d4/fa [0,4194304] 0 2024-04-01T06:57:32.541 INFO:tasks.workunit.client.0.smithi083.stdout:3/103: creat d6/d1e/f20 x:0 0 0 2024-04-01T06:57:32.542 INFO:tasks.workunit.client.0.smithi083.stdout:8/92: chown lc 28 1 2024-04-01T06:57:32.542 INFO:tasks.workunit.client.0.smithi083.stdout:6/44: creat d9/dc/f11 x:0 0 0 2024-04-01T06:57:32.544 INFO:tasks.workunit.client.0.smithi083.stdout:4/76: unlink d1/d4/db/f1a 0 2024-04-01T06:57:32.546 INFO:tasks.workunit.client.0.smithi083.stdout:9/91: link d6/da/c12 d6/da/c1c 0 2024-04-01T06:57:32.550 INFO:tasks.workunit.client.0.smithi083.stdout:1/119: symlink db/d1c/d2e/d30/l31 0 2024-04-01T06:57:32.551 INFO:tasks.workunit.client.0.smithi083.stdout:0/72: truncate f2 2299882 0 2024-04-01T06:57:32.552 INFO:tasks.workunit.client.0.smithi083.stdout:8/93: dread f9 [0,4194304] 0 2024-04-01T06:57:32.552 INFO:tasks.workunit.client.0.smithi083.stdout:8/94: fdatasync fa 0 2024-04-01T06:57:32.555 INFO:tasks.workunit.client.0.smithi083.stdout:4/77: getdents d1 0 2024-04-01T06:57:32.556 INFO:tasks.workunit.client.0.smithi083.stdout:4/78: chown d1/d8/ld 2568 1 2024-04-01T06:57:32.558 INFO:tasks.workunit.client.0.smithi083.stdout:7/43: dwrite d0/d4/fc [0,4194304] 0 2024-04-01T06:57:32.562 INFO:tasks.workunit.client.0.smithi083.stdout:1/120: unlink f8 0 2024-04-01T06:57:32.563 INFO:tasks.workunit.client.0.smithi083.stdout:1/121: write db/d1c/f24 [756548,39215] 0 2024-04-01T06:57:32.565 INFO:tasks.workunit.client.0.smithi083.stdout:9/92: link l3 d6/d15/l1d 0 2024-04-01T06:57:32.565 INFO:tasks.workunit.client.0.smithi083.stdout:9/93: readlink l3 0 2024-04-01T06:57:32.565 INFO:tasks.workunit.client.0.smithi083.stdout:9/94: dread - d6/f19 zero size 2024-04-01T06:57:32.565 INFO:tasks.workunit.client.0.smithi083.stdout:9/95: rename d6 to d6/d15/d1e 22 2024-04-01T06:57:32.565 INFO:tasks.workunit.client.0.smithi083.stdout:2/93: truncate d3/f12 969031 0 2024-04-01T06:57:32.566 INFO:tasks.workunit.client.0.smithi083.stdout:2/94: write f0 [3251779,23437] 0 2024-04-01T06:57:32.567 INFO:tasks.workunit.client.0.smithi083.stdout:0/73: creat f13 x:0 0 0 2024-04-01T06:57:32.568 INFO:tasks.workunit.client.0.smithi083.stdout:8/95: mkdir d15/d18/d1e 0 2024-04-01T06:57:32.571 INFO:tasks.workunit.client.0.smithi083.stdout:0/74: dread fc [0,4194304] 0 2024-04-01T06:57:32.572 INFO:tasks.workunit.client.0.smithi083.stdout:4/79: mknod d1/d4/c1b 0 2024-04-01T06:57:32.574 INFO:tasks.workunit.client.0.smithi083.stdout:1/122: symlink db/d1c/d1d/l32 0 2024-04-01T06:57:32.575 INFO:tasks.workunit.client.0.smithi083.stdout:9/96: truncate d6/f7 2690648 0 2024-04-01T06:57:32.576 INFO:tasks.workunit.client.0.smithi083.stdout:8/96: creat d15/d18/d1e/f1f x:0 0 0 2024-04-01T06:57:32.577 INFO:tasks.workunit.client.0.smithi083.stdout:3/104: rename d6/fc to d6/f21 0 2024-04-01T06:57:32.577 INFO:tasks.workunit.client.0.smithi083.stdout:3/105: chown f2 42424 1 2024-04-01T06:57:32.578 INFO:tasks.workunit.client.0.smithi083.stdout:2/95: dwrite d3/f1c [0,4194304] 0 2024-04-01T06:57:32.579 INFO:tasks.workunit.client.0.smithi083.stdout:0/75: rename fc to f14 0 2024-04-01T06:57:32.581 INFO:tasks.workunit.client.0.smithi083.stdout:4/80: rename d1/d4/da/lc to d1/d4/db/l1c 0 2024-04-01T06:57:32.586 INFO:tasks.workunit.client.0.smithi083.stdout:1/123: rmdir db/d1c 39 2024-04-01T06:57:32.591 INFO:tasks.workunit.client.0.smithi083.stdout:3/106: unlink l5 0 2024-04-01T06:57:32.591 INFO:tasks.workunit.client.0.smithi083.stdout:3/107: dread - d6/d15/f1a zero size 2024-04-01T06:57:32.595 INFO:tasks.workunit.client.0.smithi083.stdout:2/96: getdents d3 0 2024-04-01T06:57:32.595 INFO:tasks.workunit.client.0.smithi083.stdout:7/44: rmdir d0 39 2024-04-01T06:57:32.597 INFO:tasks.workunit.client.0.smithi083.stdout:0/76: mknod c15 0 2024-04-01T06:57:32.601 INFO:tasks.workunit.client.0.smithi083.stdout:8/97: rename l10 to d15/d18/d19/l20 0 2024-04-01T06:57:32.601 INFO:tasks.workunit.client.0.smithi083.stdout:8/98: chown d15/d1b 6 1 2024-04-01T06:57:32.602 INFO:tasks.workunit.client.0.smithi083.stdout:3/108: mknod d6/d15/c22 0 2024-04-01T06:57:32.603 INFO:tasks.workunit.client.0.smithi083.stdout:0/77: mkdir d16 0 2024-04-01T06:57:32.603 INFO:tasks.workunit.client.0.smithi083.stdout:4/81: dwrite d1/d4/ff [0,4194304] 0 2024-04-01T06:57:32.606 INFO:tasks.workunit.client.0.smithi083.stdout:3/109: rename d6/d15/f1b to d6/d1e/f23 0 2024-04-01T06:57:32.608 INFO:tasks.workunit.client.0.smithi083.stdout:8/99: getdents d15/d18/d19 0 2024-04-01T06:57:32.612 INFO:tasks.workunit.client.0.smithi083.stdout:7/45: dread d0/f3 [0,4194304] 0 2024-04-01T06:57:32.613 INFO:tasks.workunit.client.0.smithi083.stdout:4/82: rename d1/d4/c13 to d1/d8/c1d 0 2024-04-01T06:57:32.613 INFO:tasks.workunit.client.0.smithi083.stdout:3/110: write d6/fd [4812808,8163] 0 2024-04-01T06:57:32.615 INFO:tasks.workunit.client.0.smithi083.stdout:8/100: mkdir d15/d21 0 2024-04-01T06:57:32.619 INFO:tasks.workunit.client.0.smithi083.stdout:1/124: dwrite db/fe [0,4194304] 0 2024-04-01T06:57:32.619 INFO:tasks.workunit.client.0.smithi083.stdout:1/125: dread - db/d1c/d2e/f2f zero size 2024-04-01T06:57:32.619 INFO:tasks.workunit.client.0.smithi083.stdout:9/97: dwrite d6/f7 [0,4194304] 0 2024-04-01T06:57:32.622 INFO:tasks.workunit.client.0.smithi083.stdout:8/101: creat d15/d21/f22 x:0 0 0 2024-04-01T06:57:32.622 INFO:tasks.workunit.client.0.smithi083.stdout:8/102: fsync f4 0 2024-04-01T06:57:32.625 INFO:tasks.workunit.client.0.smithi083.stdout:7/46: symlink d0/le 0 2024-04-01T06:57:32.627 INFO:tasks.workunit.client.0.smithi083.stdout:3/111: link f0 d6/f24 0 2024-04-01T06:57:32.627 INFO:tasks.workunit.client.0.smithi083.stdout:3/112: stat d6/d15/f19 0 2024-04-01T06:57:32.627 INFO:tasks.workunit.client.0.smithi083.stdout:3/113: write d6/d15/f1c [852402,120173] 0 2024-04-01T06:57:32.628 INFO:tasks.workunit.client.0.smithi083.stdout:4/83: getdents d1/d8 0 2024-04-01T06:57:32.631 INFO:tasks.workunit.client.0.smithi083.stdout:2/97: dwrite d3/f19 [0,4194304] 0 2024-04-01T06:57:32.632 INFO:tasks.workunit.client.0.smithi083.stdout:8/103: link d15/d18/d19/f1a d15/d18/d19/f23 0 2024-04-01T06:57:32.634 INFO:tasks.workunit.client.0.smithi083.stdout:9/98: dread d6/d15/f17 [0,4194304] 0 2024-04-01T06:57:32.634 INFO:tasks.workunit.client.0.smithi083.stdout:0/78: dwrite f12 [0,4194304] 0 2024-04-01T06:57:32.634 INFO:tasks.workunit.client.0.smithi083.stdout:0/79: truncate f7 1284038 0 2024-04-01T06:57:32.634 INFO:tasks.workunit.client.0.smithi083.stdout:0/80: write fd [687438,127815] 0 2024-04-01T06:57:32.638 INFO:tasks.workunit.client.0.smithi083.stdout:4/84: rmdir d1/d8 39 2024-04-01T06:57:32.640 INFO:tasks.workunit.client.0.smithi083.stdout:7/47: dwrite d0/d4/fa [0,4194304] 0 2024-04-01T06:57:32.640 INFO:tasks.workunit.client.0.smithi083.stdout:7/48: truncate d0/d4/fa 4283320 0 2024-04-01T06:57:32.640 INFO:tasks.workunit.client.0.smithi083.stdout:1/126: dread db/fe [0,4194304] 0 2024-04-01T06:57:32.640 INFO:tasks.workunit.client.0.smithi083.stdout:2/98: mkdir d3/d20 0 2024-04-01T06:57:32.643 INFO:tasks.workunit.client.0.smithi083.stdout:3/114: truncate d6/fe 3942641 0 2024-04-01T06:57:32.646 INFO:tasks.workunit.client.0.smithi083.stdout:9/99: creat d6/da/f1f x:0 0 0 2024-04-01T06:57:32.646 INFO:tasks.workunit.client.0.smithi083.stdout:9/100: dread - d6/f19 zero size 2024-04-01T06:57:32.648 INFO:tasks.workunit.client.0.smithi083.stdout:8/104: rmdir d15 39 2024-04-01T06:57:32.648 INFO:tasks.workunit.client.0.smithi083.stdout:7/49: dread d0/d4/fc [0,4194304] 0 2024-04-01T06:57:32.648 INFO:tasks.workunit.client.0.smithi083.stdout:8/105: dread f14 [0,4194304] 0 2024-04-01T06:57:32.649 INFO:tasks.workunit.client.0.smithi083.stdout:7/50: read d0/d4/fc [3844681,126393] 0 2024-04-01T06:57:32.652 INFO:tasks.workunit.client.0.smithi083.stdout:4/85: creat d1/f1e x:0 0 0 2024-04-01T06:57:32.654 INFO:tasks.workunit.client.0.smithi083.stdout:1/127: truncate db/f11 1945540 0 2024-04-01T06:57:32.656 INFO:tasks.workunit.client.0.smithi083.stdout:2/99: creat d3/d20/f21 x:0 0 0 2024-04-01T06:57:32.657 INFO:tasks.workunit.client.0.smithi083.stdout:2/100: write d3/f1c [3089505,28214] 0 2024-04-01T06:57:32.660 INFO:tasks.workunit.client.0.smithi083.stdout:8/106: unlink lc 0 2024-04-01T06:57:32.660 INFO:tasks.workunit.client.0.smithi083.stdout:8/107: write f14 [258452,98596] 0 2024-04-01T06:57:32.660 INFO:tasks.workunit.client.0.smithi083.stdout:8/108: read f4 [378023,59114] 0 2024-04-01T06:57:32.661 INFO:tasks.workunit.client.0.smithi083.stdout:4/86: getdents d1/d4/db 0 2024-04-01T06:57:32.669 INFO:tasks.workunit.client.0.smithi083.stdout:3/115: mkdir d6/d12/d25 0 2024-04-01T06:57:32.669 INFO:tasks.workunit.client.0.smithi083.stdout:3/116: chown d6/d12 9495263 1 2024-04-01T06:57:32.669 INFO:tasks.workunit.client.0.smithi083.stdout:3/117: chown d6/d15/l17 119580642 1 2024-04-01T06:57:32.669 INFO:tasks.workunit.client.0.smithi083.stdout:3/118: chown d6/d15/f19 200429 1 2024-04-01T06:57:32.669 INFO:tasks.workunit.client.0.smithi083.stdout:3/119: readlink d6/d12/l16 0 2024-04-01T06:57:32.669 INFO:tasks.workunit.client.0.smithi083.stdout:3/120: read - d6/d12/f13 zero size 2024-04-01T06:57:32.670 INFO:tasks.workunit.client.0.smithi083.stdout:1/128: dwrite db/f15 [0,4194304] 0 2024-04-01T06:57:32.671 INFO:tasks.workunit.client.0.smithi083.stdout:1/129: write db/d1c/d1d/f20 [3780536,82799] 0 2024-04-01T06:57:32.671 INFO:tasks.workunit.client.0.smithi083.stdout:1/130: fsync db/d1c/d29/f2d 0 2024-04-01T06:57:32.672 INFO:tasks.workunit.client.0.smithi083.stdout:2/101: unlink d3/l14 0 2024-04-01T06:57:32.673 INFO:tasks.workunit.client.0.smithi083.stdout:4/87: getdents d1/d4/da 0 2024-04-01T06:57:32.673 INFO:tasks.workunit.client.0.smithi083.stdout:4/88: readlink d1/d4/db/l1c 0 2024-04-01T06:57:32.673 INFO:tasks.workunit.client.0.smithi083.stdout:4/89: chown d1/d8 13817 1 2024-04-01T06:57:32.675 INFO:tasks.workunit.client.0.smithi083.stdout:8/109: dwrite d15/d18/d19/f23 [0,4194304] 0 2024-04-01T06:57:32.676 INFO:tasks.workunit.client.0.smithi083.stdout:3/121: dread d6/fe [0,4194304] 0 2024-04-01T06:57:32.678 INFO:tasks.workunit.client.0.smithi083.stdout:1/131: getdents db/d1c 0 2024-04-01T06:57:32.680 INFO:tasks.workunit.client.0.smithi083.stdout:2/102: symlink d3/d1f/l22 0 2024-04-01T06:57:32.687 INFO:tasks.workunit.client.0.smithi083.stdout:8/110: getdents d15/d18/d1e 0 2024-04-01T06:57:32.689 INFO:tasks.workunit.client.0.smithi083.stdout:1/132: mkdir db/d1c/d29/d33 0 2024-04-01T06:57:32.690 INFO:tasks.workunit.client.0.smithi083.stdout:3/122: rmdir d6 39 2024-04-01T06:57:32.692 INFO:tasks.workunit.client.0.smithi083.stdout:2/103: rmdir d3/d1f 39 2024-04-01T06:57:32.694 INFO:tasks.workunit.client.0.smithi083.stdout:8/111: mkdir d15/d18/d19/d24 0 2024-04-01T06:57:32.695 INFO:tasks.workunit.client.0.smithi083.stdout:3/123: unlink d6/d15/c1d 0 2024-04-01T06:57:32.697 INFO:tasks.workunit.client.0.smithi083.stdout:2/104: symlink d3/d20/l23 0 2024-04-01T06:57:32.700 INFO:tasks.workunit.client.0.smithi083.stdout:2/105: creat d3/d1f/f24 x:0 0 0 2024-04-01T06:57:32.700 INFO:tasks.workunit.client.0.smithi083.stdout:1/133: dwrite db/d26/f27 [0,4194304] 0 2024-04-01T06:57:32.701 INFO:tasks.workunit.client.0.smithi083.stdout:8/112: rmdir d15 39 2024-04-01T06:57:32.701 INFO:tasks.workunit.client.0.smithi083.stdout:8/113: stat f7 0 2024-04-01T06:57:32.702 INFO:tasks.workunit.client.0.smithi083.stdout:3/124: symlink d6/l26 0 2024-04-01T06:57:32.706 INFO:tasks.workunit.client.0.smithi083.stdout:1/134: creat db/d1c/d2e/f34 x:0 0 0 2024-04-01T06:57:32.707 INFO:tasks.workunit.client.0.smithi083.stdout:8/114: mknod d15/d18/d19/d1d/c25 0 2024-04-01T06:57:32.709 INFO:tasks.workunit.client.0.smithi083.stdout:1/135: rename db/f18 to db/d1c/f35 0 2024-04-01T06:57:32.711 INFO:tasks.workunit.client.0.smithi083.stdout:8/115: symlink d15/d18/d19/l26 0 2024-04-01T06:57:32.713 INFO:tasks.workunit.client.0.smithi083.stdout:1/136: creat db/d1c/f36 x:0 0 0 2024-04-01T06:57:32.715 INFO:tasks.workunit.client.0.smithi083.stdout:8/116: creat d15/f27 x:0 0 0 2024-04-01T06:57:32.716 INFO:tasks.workunit.client.0.smithi083.stdout:8/117: write fa [1738283,34342] 0 2024-04-01T06:57:32.719 INFO:tasks.workunit.client.0.smithi083.stdout:1/137: symlink db/d1c/d2e/d30/l37 0 2024-04-01T06:57:32.719 INFO:tasks.workunit.client.0.smithi083.stdout:1/138: chown db/d1c/f24 1435809 1 2024-04-01T06:57:32.719 INFO:tasks.workunit.client.0.smithi083.stdout:8/118: truncate f7 904352 0 2024-04-01T06:57:32.721 INFO:tasks.workunit.client.0.smithi083.stdout:2/106: dwrite d3/fe [0,4194304] 0 2024-04-01T06:57:32.721 INFO:tasks.workunit.client.0.smithi083.stdout:1/139: creat db/d1c/d2e/f38 x:0 0 0 2024-04-01T06:57:32.721 INFO:tasks.workunit.client.0.smithi083.stdout:1/140: stat db/d1c/f2b 0 2024-04-01T06:57:32.723 INFO:tasks.workunit.client.0.smithi083.stdout:3/125: dwrite d6/d1e/f23 [0,4194304] 0 2024-04-01T06:57:32.725 INFO:tasks.workunit.client.0.smithi083.stdout:2/107: mknod d3/d1f/c25 0 2024-04-01T06:57:32.731 INFO:tasks.workunit.client.0.smithi083.stdout:1/141: dread db/d1c/f25 [0,4194304] 0 2024-04-01T06:57:32.731 INFO:tasks.workunit.client.0.smithi083.stdout:1/142: chown db/d26 1039017 1 2024-04-01T06:57:32.732 INFO:tasks.workunit.client.0.smithi083.stdout:8/119: dread d15/f17 [0,4194304] 0 2024-04-01T06:57:32.733 INFO:tasks.workunit.client.0.smithi083.stdout:2/108: truncate f0 404923 0 2024-04-01T06:57:32.733 INFO:tasks.workunit.client.0.smithi083.stdout:2/109: fsync d3/f12 0 2024-04-01T06:57:32.734 INFO:tasks.workunit.client.0.smithi083.stdout:8/120: creat d15/d18/d1e/f28 x:0 0 0 2024-04-01T06:57:32.736 INFO:tasks.workunit.client.0.smithi083.stdout:2/110: mkdir d3/d26 0 2024-04-01T06:57:32.743 INFO:tasks.workunit.client.0.smithi083.stdout:3/126: dwrite d6/fe [0,4194304] 0 2024-04-01T06:57:32.743 INFO:tasks.workunit.client.0.smithi083.stdout:8/121: dread fa [0,4194304] 0 2024-04-01T06:57:32.745 INFO:tasks.workunit.client.0.smithi083.stdout:8/122: unlink l13 0 2024-04-01T06:57:32.747 INFO:tasks.workunit.client.0.smithi083.stdout:6/45: sync 2024-04-01T06:57:32.747 INFO:tasks.workunit.client.0.smithi083.stdout:5/58: sync 2024-04-01T06:57:32.748 INFO:tasks.workunit.client.0.smithi083.stdout:6/46: symlink d9/l12 0 2024-04-01T06:57:32.752 INFO:tasks.workunit.client.0.smithi083.stdout:6/47: dread f1 [0,4194304] 0 2024-04-01T06:57:32.753 INFO:tasks.workunit.client.0.smithi083.stdout:6/48: truncate d9/dc/fe 1609518 0 2024-04-01T06:57:32.753 INFO:tasks.workunit.client.0.smithi083.stdout:5/59: symlink d4/ld 0 2024-04-01T06:57:32.753 INFO:tasks.workunit.client.0.smithi083.stdout:8/123: dread f4 [0,4194304] 0 2024-04-01T06:57:32.753 INFO:tasks.workunit.client.0.smithi083.stdout:2/111: dwrite f2 [0,4194304] 0 2024-04-01T06:57:32.753 INFO:tasks.workunit.client.0.smithi083.stdout:2/112: write d3/ff [295690,53819] 0 2024-04-01T06:57:32.754 INFO:tasks.workunit.client.0.smithi083.stdout:1/143: dwrite db/d26/f2c [0,4194304] 0 2024-04-01T06:57:32.754 INFO:tasks.workunit.client.0.smithi083.stdout:1/144: truncate db/d1c/d2e/f2f 1045427 0 2024-04-01T06:57:32.755 INFO:tasks.workunit.client.0.smithi083.stdout:6/49: dread f2 [0,4194304] 0 2024-04-01T06:57:32.755 INFO:tasks.workunit.client.0.smithi083.stdout:6/50: fdatasync f8 0 2024-04-01T06:57:32.755 INFO:tasks.workunit.client.0.smithi083.stdout:6/51: chown f1 431705111 1 2024-04-01T06:57:32.755 INFO:tasks.workunit.client.0.smithi083.stdout:6/52: fsync f2 0 2024-04-01T06:57:32.755 INFO:tasks.workunit.client.0.smithi083.stdout:6/53: write f1 [487317,30891] 0 2024-04-01T06:57:32.755 INFO:tasks.workunit.client.0.smithi083.stdout:5/60: creat d4/d9/fe x:0 0 0 2024-04-01T06:57:32.756 INFO:tasks.workunit.client.0.smithi083.stdout:8/124: creat d15/d1b/f29 x:0 0 0 2024-04-01T06:57:32.756 INFO:tasks.workunit.client.0.smithi083.stdout:8/125: chown d15/d18/d19 49691 1 2024-04-01T06:57:32.758 INFO:tasks.workunit.client.0.smithi083.stdout:1/145: write f3 [2653708,63918] 0 2024-04-01T06:57:32.763 INFO:tasks.workunit.client.0.smithi083.stdout:5/61: creat d4/ff x:0 0 0 2024-04-01T06:57:32.763 INFO:tasks.workunit.client.0.smithi083.stdout:5/62: fsync d4/fb 0 2024-04-01T06:57:32.765 INFO:tasks.workunit.client.0.smithi083.stdout:1/146: dread db/d26/f27 [0,4194304] 0 2024-04-01T06:57:32.765 INFO:tasks.workunit.client.0.smithi083.stdout:6/54: dread f6 [0,4194304] 0 2024-04-01T06:57:32.767 INFO:tasks.workunit.client.0.smithi083.stdout:6/55: mknod d9/dc/df/c13 0 2024-04-01T06:57:32.770 INFO:tasks.workunit.client.0.smithi083.stdout:6/56: dread f2 [0,4194304] 0 2024-04-01T06:57:32.770 INFO:tasks.workunit.client.0.smithi083.stdout:6/57: write d9/dc/fe [1954756,70896] 0 2024-04-01T06:57:32.770 INFO:tasks.workunit.client.0.smithi083.stdout:6/58: truncate d9/dc/f11 105829 0 2024-04-01T06:57:32.770 INFO:tasks.workunit.client.0.smithi083.stdout:2/113: dwrite f0 [0,4194304] 0 2024-04-01T06:57:32.770 INFO:tasks.workunit.client.0.smithi083.stdout:2/114: chown d3/f1a 77729814 1 2024-04-01T06:57:32.773 INFO:tasks.workunit.client.0.smithi083.stdout:3/127: dwrite d6/d15/f1a [0,4194304] 0 2024-04-01T06:57:32.774 INFO:tasks.workunit.client.0.smithi083.stdout:3/128: getdents d6/d12/d25 0 2024-04-01T06:57:32.776 INFO:tasks.workunit.client.0.smithi083.stdout:6/59: truncate f4 519432 0 2024-04-01T06:57:32.776 INFO:tasks.workunit.client.0.smithi083.stdout:8/126: dwrite d15/d21/f22 [0,4194304] 0 2024-04-01T06:57:32.778 INFO:tasks.workunit.client.0.smithi083.stdout:6/60: dread f2 [0,4194304] 0 2024-04-01T06:57:32.778 INFO:tasks.workunit.client.0.smithi083.stdout:6/61: write f1 [496203,101250] 0 2024-04-01T06:57:32.780 INFO:tasks.workunit.client.0.smithi083.stdout:3/129: getdents d6/d12 0 2024-04-01T06:57:32.781 INFO:tasks.workunit.client.0.smithi083.stdout:3/130: read d6/f24 [65205,122576] 0 2024-04-01T06:57:32.783 INFO:tasks.workunit.client.0.smithi083.stdout:5/63: dwrite d4/f6 [0,4194304] 0 2024-04-01T06:57:32.788 INFO:tasks.workunit.client.0.smithi083.stdout:2/115: rmdir d3 39 2024-04-01T06:57:32.789 INFO:tasks.workunit.client.0.smithi083.stdout:3/131: dread d6/f9 [0,4194304] 0 2024-04-01T06:57:32.790 INFO:tasks.workunit.client.0.smithi083.stdout:6/62: rename f4 to d9/dc/f14 0 2024-04-01T06:57:32.790 INFO:tasks.workunit.client.0.smithi083.stdout:6/63: write f1 [828846,89043] 0 2024-04-01T06:57:32.791 INFO:tasks.workunit.client.0.smithi083.stdout:5/64: dread d4/fa [0,4194304] 0 2024-04-01T06:57:32.791 INFO:tasks.workunit.client.0.smithi083.stdout:5/65: fdatasync d4/d9/fe 0 2024-04-01T06:57:32.793 INFO:tasks.workunit.client.0.smithi083.stdout:2/116: mkdir d3/d1f/d27 0 2024-04-01T06:57:32.794 INFO:tasks.workunit.client.0.smithi083.stdout:3/132: mknod d6/d12/c27 0 2024-04-01T06:57:32.794 INFO:tasks.workunit.client.0.smithi083.stdout:3/133: chown d6 1298376666 1 2024-04-01T06:57:32.794 INFO:tasks.workunit.client.0.smithi083.stdout:3/134: write d6/f21 [649334,10226] 0 2024-04-01T06:57:32.794 INFO:tasks.workunit.client.0.smithi083.stdout:3/135: getdents d6/d12/d25 0 2024-04-01T06:57:32.794 INFO:tasks.workunit.client.0.smithi083.stdout:6/64: creat d9/dc/df/f15 x:0 0 0 2024-04-01T06:57:32.796 INFO:tasks.workunit.client.0.smithi083.stdout:3/136: fsync d6/f21 0 2024-04-01T06:57:32.797 INFO:tasks.workunit.client.0.smithi083.stdout:1/147: dwrite db/d1c/f22 [0,4194304] 0 2024-04-01T06:57:32.797 INFO:tasks.workunit.client.0.smithi083.stdout:1/148: chown db 4756565 1 2024-04-01T06:57:32.798 INFO:tasks.workunit.client.0.smithi083.stdout:2/117: unlink d3/c15 0 2024-04-01T06:57:32.798 INFO:tasks.workunit.client.0.smithi083.stdout:2/118: fdatasync d3/f19 0 2024-04-01T06:57:32.799 INFO:tasks.workunit.client.0.smithi083.stdout:8/127: rmdir d15/d18/d19 39 2024-04-01T06:57:32.799 INFO:tasks.workunit.client.0.smithi083.stdout:8/128: write d15/d1b/f29 [879216,30162] 0 2024-04-01T06:57:32.799 INFO:tasks.workunit.client.0.smithi083.stdout:8/129: truncate d15/d18/d1e/f28 673521 0 2024-04-01T06:57:32.799 INFO:tasks.workunit.client.0.smithi083.stdout:8/130: readlink d15/d18/d19/l26 0 2024-04-01T06:57:32.801 INFO:tasks.workunit.client.0.smithi083.stdout:6/65: creat d9/dc/f16 x:0 0 0 2024-04-01T06:57:32.806 INFO:tasks.workunit.client.0.smithi083.stdout:3/137: creat d6/f28 x:0 0 0 2024-04-01T06:57:32.806 INFO:tasks.workunit.client.0.smithi083.stdout:3/138: stat d6/f21 0 2024-04-01T06:57:32.806 INFO:tasks.workunit.client.0.smithi083.stdout:3/139: stat d6/d12/f13 0 2024-04-01T06:57:32.808 INFO:tasks.workunit.client.0.smithi083.stdout:8/131: dwrite fa [0,4194304] 0 2024-04-01T06:57:32.808 INFO:tasks.workunit.client.0.smithi083.stdout:2/119: rename d3/fe to d3/d26/f28 0 2024-04-01T06:57:32.809 INFO:tasks.workunit.client.0.smithi083.stdout:6/66: creat d9/dc/df/f17 x:0 0 0 2024-04-01T06:57:32.810 INFO:tasks.workunit.client.0.smithi083.stdout:6/67: fdatasync f1 0 2024-04-01T06:57:32.811 INFO:tasks.workunit.client.0.smithi083.stdout:1/149: dwrite db/d1c/d29/f2d [0,4194304] 0 2024-04-01T06:57:32.811 INFO:tasks.workunit.client.0.smithi083.stdout:3/140: creat d6/f29 x:0 0 0 2024-04-01T06:57:32.812 INFO:tasks.workunit.client.0.smithi083.stdout:1/150: write db/f14 [1367072,86914] 0 2024-04-01T06:57:32.813 INFO:tasks.workunit.client.0.smithi083.stdout:3/141: dread d6/d15/f1c [0,4194304] 0 2024-04-01T06:57:32.813 INFO:tasks.workunit.client.0.smithi083.stdout:3/142: stat d6/d1e/f20 0 2024-04-01T06:57:32.819 INFO:tasks.workunit.client.0.smithi083.stdout:3/143: dread d6/fb [0,4194304] 0 2024-04-01T06:57:32.821 INFO:tasks.workunit.client.0.smithi083.stdout:2/120: symlink d3/d26/l29 0 2024-04-01T06:57:32.823 INFO:tasks.workunit.client.0.smithi083.stdout:1/151: dwrite db/d1c/d2e/f38 [0,4194304] 0 2024-04-01T06:57:32.823 INFO:tasks.workunit.client.0.smithi083.stdout:1/152: stat db/l1e 0 2024-04-01T06:57:32.823 INFO:tasks.workunit.client.0.smithi083.stdout:1/153: write db/d1c/d2e/f2f [1707232,3767] 0 2024-04-01T06:57:32.823 INFO:tasks.workunit.client.0.smithi083.stdout:8/132: rename c1 to d15/d1b/c2a 0 2024-04-01T06:57:32.825 INFO:tasks.workunit.client.0.smithi083.stdout:3/144: mknod d6/d1e/c2a 0 2024-04-01T06:57:32.825 INFO:tasks.workunit.client.0.smithi083.stdout:3/145: chown d6/f24 146277 1 2024-04-01T06:57:32.826 INFO:tasks.workunit.client.0.smithi083.stdout:2/121: unlink d3/f1a 0 2024-04-01T06:57:32.830 INFO:tasks.workunit.client.0.smithi083.stdout:8/133: dread d15/d18/d19/f23 [0,4194304] 0 2024-04-01T06:57:32.834 INFO:tasks.workunit.client.0.smithi083.stdout:1/154: rename db/f23 to db/f39 0 2024-04-01T06:57:32.834 INFO:tasks.workunit.client.0.smithi083.stdout:1/155: write f3 [4639847,17784] 0 2024-04-01T06:57:32.834 INFO:tasks.workunit.client.0.smithi083.stdout:1/156: fsync db/d26/f27 0 2024-04-01T06:57:32.834 INFO:tasks.workunit.client.0.smithi083.stdout:3/146: creat d6/d1e/f2b x:0 0 0 2024-04-01T06:57:32.836 INFO:tasks.workunit.client.0.smithi083.stdout:6/68: dwrite f8 [0,4194304] 0 2024-04-01T06:57:32.836 INFO:tasks.workunit.client.0.smithi083.stdout:6/69: write d9/dc/f16 [535141,14485] 0 2024-04-01T06:57:32.836 INFO:tasks.workunit.client.0.smithi083.stdout:2/122: creat d3/d20/f2a x:0 0 0 2024-04-01T06:57:32.838 INFO:tasks.workunit.client.0.smithi083.stdout:2/123: write d3/f16 [3567498,100399] 0 2024-04-01T06:57:32.839 INFO:tasks.workunit.client.0.smithi083.stdout:8/134: mkdir d15/d18/d19/d1d/d2b 0 2024-04-01T06:57:32.841 INFO:tasks.workunit.client.0.smithi083.stdout:1/157: link db/d26/f2c db/d1c/d2e/d30/f3a 0 2024-04-01T06:57:32.847 INFO:tasks.workunit.client.0.smithi083.stdout:6/70: mknod d9/dc/df/c18 0 2024-04-01T06:57:32.849 INFO:tasks.workunit.client.0.smithi083.stdout:2/124: mkdir d3/d1f/d2b 0 2024-04-01T06:57:32.851 INFO:tasks.workunit.client.0.smithi083.stdout:8/135: link f7 d15/d21/f2c 0 2024-04-01T06:57:32.855 INFO:tasks.workunit.client.0.smithi083.stdout:3/147: dwrite d6/d15/f19 [0,4194304] 0 2024-04-01T06:57:32.855 INFO:tasks.workunit.client.0.smithi083.stdout:1/158: dwrite db/f15 [0,4194304] 0 2024-04-01T06:57:32.855 INFO:tasks.workunit.client.0.smithi083.stdout:6/71: creat d9/f19 x:0 0 0 2024-04-01T06:57:32.857 INFO:tasks.workunit.client.0.smithi083.stdout:2/125: symlink d3/l2c 0 2024-04-01T06:57:32.857 INFO:tasks.workunit.client.0.smithi083.stdout:2/126: rename d3/d1f/d2b to d3/d1f/d2b/d2d 22 2024-04-01T06:57:32.858 INFO:tasks.workunit.client.0.smithi083.stdout:1/159: dread db/d26/f27 [0,4194304] 0 2024-04-01T06:57:32.859 INFO:tasks.workunit.client.0.smithi083.stdout:1/160: write db/d1c/f35 [254895,46680] 0 2024-04-01T06:57:32.859 INFO:tasks.workunit.client.0.smithi083.stdout:1/161: stat db/d1c/f2b 0 2024-04-01T06:57:32.860 INFO:tasks.workunit.client.0.smithi083.stdout:8/136: unlink d15/d18/d1e/f28 0 2024-04-01T06:57:32.862 INFO:tasks.workunit.client.0.smithi083.stdout:0/81: sync 2024-04-01T06:57:32.864 INFO:tasks.workunit.client.0.smithi083.stdout:3/148: creat d6/d12/f2c x:0 0 0 2024-04-01T06:57:32.864 INFO:tasks.workunit.client.0.smithi083.stdout:3/149: dread - d6/d1e/f20 zero size 2024-04-01T06:57:32.864 INFO:tasks.workunit.client.0.smithi083.stdout:3/150: fdatasync d6/d15/f10 0 2024-04-01T06:57:32.864 INFO:tasks.workunit.client.0.smithi083.stdout:3/151: chown d6/d1e/f23 0 1 2024-04-01T06:57:32.867 INFO:tasks.workunit.client.0.smithi083.stdout:1/162: dread db/f39 [0,4194304] 0 2024-04-01T06:57:32.868 INFO:tasks.workunit.client.0.smithi083.stdout:6/72: unlink f1 0 2024-04-01T06:57:32.868 INFO:tasks.workunit.client.0.smithi083.stdout:6/73: write d9/dc/df/f15 [685050,123560] 0 2024-04-01T06:57:32.872 INFO:tasks.workunit.client.0.smithi083.stdout:2/127: dwrite d3/f18 [0,4194304] 0 2024-04-01T06:57:32.872 INFO:tasks.workunit.client.0.smithi083.stdout:8/137: rename d15/f17 to d15/d18/d19/d1d/f2d 0 2024-04-01T06:57:32.874 INFO:tasks.workunit.client.0.smithi083.stdout:1/163: creat db/f3b x:0 0 0 2024-04-01T06:57:32.879 INFO:tasks.workunit.client.0.smithi083.stdout:2/128: symlink d3/d20/l2e 0 2024-04-01T06:57:32.880 INFO:tasks.workunit.client.0.smithi083.stdout:6/74: dwrite d9/dc/fe [0,4194304] 0 2024-04-01T06:57:32.881 INFO:tasks.workunit.client.0.smithi083.stdout:8/138: creat d15/d18/d19/d1d/d2b/f2e x:0 0 0 2024-04-01T06:57:32.881 INFO:tasks.workunit.client.0.smithi083.stdout:8/139: getdents d15/d18/d19/d24 0 2024-04-01T06:57:32.882 INFO:tasks.workunit.client.0.smithi083.stdout:0/82: dwrite fd [0,4194304] 0 2024-04-01T06:57:32.882 INFO:tasks.workunit.client.0.smithi083.stdout:0/83: fsync fa 0 2024-04-01T06:57:32.882 INFO:tasks.workunit.client.0.smithi083.stdout:0/84: fsync fd 0 2024-04-01T06:57:32.882 INFO:tasks.workunit.client.0.smithi083.stdout:1/164: mknod db/d1c/d1d/c3c 0 2024-04-01T06:57:32.885 INFO:tasks.workunit.client.0.smithi083.stdout:2/129: creat d3/f2f x:0 0 0 2024-04-01T06:57:32.888 INFO:tasks.workunit.client.0.smithi083.stdout:6/75: rename d9/dc/df/f15 to d9/f1a 0 2024-04-01T06:57:32.888 INFO:tasks.workunit.client.0.smithi083.stdout:6/76: chown d9 645991 1 2024-04-01T06:57:32.890 INFO:tasks.workunit.client.0.smithi083.stdout:8/140: getdents d15/d1b 0 2024-04-01T06:57:32.896 INFO:tasks.workunit.client.0.smithi083.stdout:0/85: mknod d16/c17 0 2024-04-01T06:57:32.897 INFO:tasks.workunit.client.0.smithi083.stdout:1/165: mknod db/d1c/d2e/c3d 0 2024-04-01T06:57:32.899 INFO:tasks.workunit.client.0.smithi083.stdout:2/130: creat d3/d1f/f30 x:0 0 0 2024-04-01T06:57:32.899 INFO:tasks.workunit.client.0.smithi083.stdout:2/131: stat d3/c9 0 2024-04-01T06:57:32.901 INFO:tasks.workunit.client.0.smithi083.stdout:6/77: rename d9/dc/df to d9/dc/d1b 0 2024-04-01T06:57:32.902 INFO:tasks.workunit.client.0.smithi083.stdout:8/141: link d15/l16 d15/d1b/l2f 0 2024-04-01T06:57:32.903 INFO:tasks.workunit.client.0.smithi083.stdout:8/142: write d15/f27 [282186,89990] 0 2024-04-01T06:57:32.903 INFO:tasks.workunit.client.0.smithi083.stdout:8/143: dread - d15/d18/d1e/f1f zero size 2024-04-01T06:57:32.903 INFO:tasks.workunit.client.0.smithi083.stdout:6/78: read d9/dc/f16 [78004,119143] 0 2024-04-01T06:57:32.903 INFO:tasks.workunit.client.0.smithi083.stdout:6/79: chown d9/fb 395 1 2024-04-01T06:57:32.904 INFO:tasks.workunit.client.0.smithi083.stdout:6/80: fdatasync d9/f1a 0 2024-04-01T06:57:32.905 INFO:tasks.workunit.client.0.smithi083.stdout:0/86: dwrite f11 [0,4194304] 0 2024-04-01T06:57:32.906 INFO:tasks.workunit.client.0.smithi083.stdout:1/166: link db/d1c/d29/f2d db/d1c/d29/f3e 0 2024-04-01T06:57:32.908 INFO:tasks.workunit.client.0.smithi083.stdout:2/132: link d3/d26/f28 d3/d1f/f31 0 2024-04-01T06:57:32.908 INFO:tasks.workunit.client.0.smithi083.stdout:0/87: dread f14 [0,4194304] 0 2024-04-01T06:57:32.909 INFO:tasks.workunit.client.0.smithi083.stdout:8/144: creat d15/d18/d19/f30 x:0 0 0 2024-04-01T06:57:32.911 INFO:tasks.workunit.client.0.smithi083.stdout:6/81: getdents d9 0 2024-04-01T06:57:32.918 INFO:tasks.workunit.client.0.smithi083.stdout:1/167: symlink db/d1c/d2e/d30/l3f 0 2024-04-01T06:57:32.918 INFO:tasks.workunit.client.0.smithi083.stdout:1/168: dread - db/d1c/f21 zero size 2024-04-01T06:57:32.920 INFO:tasks.workunit.client.0.smithi083.stdout:0/88: creat d16/f18 x:0 0 0 2024-04-01T06:57:32.920 INFO:tasks.workunit.client.0.smithi083.stdout:8/145: rmdir d15/d18/d19/d1d 39 2024-04-01T06:57:32.922 INFO:tasks.workunit.client.0.smithi083.stdout:6/82: mknod d9/dc/d1b/c1c 0 2024-04-01T06:57:32.924 INFO:tasks.workunit.client.0.smithi083.stdout:1/169: creat db/d1c/d1d/f40 x:0 0 0 2024-04-01T06:57:32.924 INFO:tasks.workunit.client.0.smithi083.stdout:6/83: dread d9/dc/f14 [0,4194304] 0 2024-04-01T06:57:32.924 INFO:tasks.workunit.client.0.smithi083.stdout:1/170: fsync db/d26/f27 0 2024-04-01T06:57:32.924 INFO:tasks.workunit.client.0.smithi083.stdout:6/84: write d9/dc/d1b/f17 [29803,65520] 0 2024-04-01T06:57:32.925 INFO:tasks.workunit.client.0.smithi083.stdout:0/89: truncate f2 1303267 0 2024-04-01T06:57:32.925 INFO:tasks.workunit.client.0.smithi083.stdout:0/90: stat d16/c17 0 2024-04-01T06:57:32.926 INFO:tasks.workunit.client.0.smithi083.stdout:2/133: dwrite d3/d26/f28 [0,4194304] 0 2024-04-01T06:57:32.927 INFO:tasks.workunit.client.0.smithi083.stdout:8/146: creat d15/d18/f31 x:0 0 0 2024-04-01T06:57:32.928 INFO:tasks.workunit.client.0.smithi083.stdout:1/171: getdents db/d26 0 2024-04-01T06:57:32.929 INFO:tasks.workunit.client.0.smithi083.stdout:1/172: readlink db/d1c/d29/l2a 0 2024-04-01T06:57:32.929 INFO:tasks.workunit.client.0.smithi083.stdout:1/173: read db/f13 [161553,62837] 0 2024-04-01T06:57:32.929 INFO:tasks.workunit.client.0.smithi083.stdout:1/174: chown db/d1c/f2b 0 1 2024-04-01T06:57:32.929 INFO:tasks.workunit.client.0.smithi083.stdout:1/175: truncate db/d1c/d2e/f34 733960 0 2024-04-01T06:57:32.932 INFO:tasks.workunit.client.0.smithi083.stdout:6/85: link d9/dc/f11 d9/f1d 0 2024-04-01T06:57:32.934 INFO:tasks.workunit.client.0.smithi083.stdout:0/91: creat d16/f19 x:0 0 0 2024-04-01T06:57:32.934 INFO:tasks.workunit.client.0.smithi083.stdout:0/92: truncate f2 1401492 0 2024-04-01T06:57:32.936 INFO:tasks.workunit.client.0.smithi083.stdout:2/134: getdents d3/d1f 0 2024-04-01T06:57:32.938 INFO:tasks.workunit.client.0.smithi083.stdout:8/147: symlink d15/d18/l32 0 2024-04-01T06:57:32.939 INFO:tasks.workunit.client.0.smithi083.stdout:1/176: symlink db/d1c/d2e/l41 0 2024-04-01T06:57:32.941 INFO:tasks.workunit.client.0.smithi083.stdout:6/86: creat d9/dc/d1b/f1e x:0 0 0 2024-04-01T06:57:32.942 INFO:tasks.workunit.client.0.smithi083.stdout:2/135: getdents d3/d20 0 2024-04-01T06:57:32.943 INFO:tasks.workunit.client.0.smithi083.stdout:8/148: creat d15/f33 x:0 0 0 2024-04-01T06:57:32.945 INFO:tasks.workunit.client.0.smithi083.stdout:2/136: creat d3/d1f/d2b/f32 x:0 0 0 2024-04-01T06:57:32.947 INFO:tasks.workunit.client.0.smithi083.stdout:2/137: mknod d3/d1f/d27/c33 0 2024-04-01T06:57:32.949 INFO:tasks.workunit.client.0.smithi083.stdout:0/93: dwrite f12 [0,4194304] 0 2024-04-01T06:57:32.953 INFO:tasks.workunit.client.0.smithi083.stdout:2/138: creat d3/d20/f34 x:0 0 0 2024-04-01T06:57:32.953 INFO:tasks.workunit.client.0.smithi083.stdout:1/177: rmdir db/d1c 39 2024-04-01T06:57:32.954 INFO:tasks.workunit.client.0.smithi083.stdout:6/87: dwrite d9/dc/f11 [0,4194304] 0 2024-04-01T06:57:32.957 INFO:tasks.workunit.client.0.smithi083.stdout:2/139: unlink f0 0 2024-04-01T06:57:32.959 INFO:tasks.workunit.client.0.smithi083.stdout:8/149: dwrite d15/d18/d19/f1a [0,4194304] 0 2024-04-01T06:57:32.960 INFO:tasks.workunit.client.0.smithi083.stdout:1/178: symlink db/l42 0 2024-04-01T06:57:32.964 INFO:tasks.workunit.client.0.smithi083.stdout:6/88: unlink d9/fb 0 2024-04-01T06:57:32.964 INFO:tasks.workunit.client.0.smithi083.stdout:6/89: fdatasync f6 0 2024-04-01T06:57:32.964 INFO:tasks.workunit.client.0.smithi083.stdout:6/90: fdatasync f8 0 2024-04-01T06:57:32.967 INFO:tasks.workunit.client.0.smithi083.stdout:8/150: dread d15/d18/d19/f1a [0,4194304] 0 2024-04-01T06:57:32.967 INFO:tasks.workunit.client.0.smithi083.stdout:8/151: chown d15/d18/d19/d1d/d2b/f2e 3 1 2024-04-01T06:57:32.969 INFO:tasks.workunit.client.0.smithi083.stdout:1/179: rename db/l19 to db/l43 0 2024-04-01T06:57:32.969 INFO:tasks.workunit.client.0.smithi083.stdout:1/180: chown db/d1c/d2e/d30/l3f 7894 1 2024-04-01T06:57:32.970 INFO:tasks.workunit.client.0.smithi083.stdout:1/181: dread - db/d1c/f21 zero size 2024-04-01T06:57:32.970 INFO:tasks.workunit.client.0.smithi083.stdout:1/182: chown db/fe 84300 1 2024-04-01T06:57:32.970 INFO:tasks.workunit.client.0.smithi083.stdout:2/140: dread d3/f19 [0,4194304] 0 2024-04-01T06:57:32.971 INFO:tasks.workunit.client.0.smithi083.stdout:0/94: dwrite fd [4194304,4194304] 0 2024-04-01T06:57:32.974 INFO:tasks.workunit.client.0.smithi083.stdout:1/183: mknod db/d1c/c44 0 2024-04-01T06:57:32.974 INFO:tasks.workunit.client.0.smithi083.stdout:1/184: chown fa 2586803 1 2024-04-01T06:57:32.974 INFO:tasks.workunit.client.0.smithi083.stdout:1/185: chown db/d1c/f24 47054294 1 2024-04-01T06:57:32.975 INFO:tasks.workunit.client.0.smithi083.stdout:6/91: dwrite f6 [0,4194304] 0 2024-04-01T06:57:32.975 INFO:tasks.workunit.client.0.smithi083.stdout:6/92: write d9/dc/f14 [728375,44881] 0 2024-04-01T06:57:32.977 INFO:tasks.workunit.client.0.smithi083.stdout:2/141: dread d3/ff [0,4194304] 0 2024-04-01T06:57:32.979 INFO:tasks.workunit.client.0.smithi083.stdout:0/95: creat d16/f1a x:0 0 0 2024-04-01T06:57:32.980 INFO:tasks.workunit.client.0.smithi083.stdout:1/186: link db/d1c/d29/f2d db/d1c/d1d/f45 0 2024-04-01T06:57:32.981 INFO:tasks.workunit.client.0.smithi083.stdout:9/101: sync 2024-04-01T06:57:32.981 INFO:tasks.workunit.client.0.smithi083.stdout:4/90: sync 2024-04-01T06:57:32.981 INFO:tasks.workunit.client.0.smithi083.stdout:7/51: sync 2024-04-01T06:57:32.981 INFO:tasks.workunit.client.0.smithi083.stdout:9/102: chown d6/da/f1f 1392 1 2024-04-01T06:57:32.981 INFO:tasks.workunit.client.0.smithi083.stdout:9/103: read - d6/da/f1f zero size 2024-04-01T06:57:32.982 INFO:tasks.workunit.client.0.smithi083.stdout:9/104: dread - d6/f19 zero size 2024-04-01T06:57:32.982 INFO:tasks.workunit.client.0.smithi083.stdout:9/105: read - d6/da/f1f zero size 2024-04-01T06:57:32.982 INFO:tasks.workunit.client.0.smithi083.stdout:9/106: write d6/da/f1f [976154,35258] 0 2024-04-01T06:57:32.982 INFO:tasks.workunit.client.0.smithi083.stdout:9/107: write d6/da/f1f [1859824,54499] 0 2024-04-01T06:57:32.982 INFO:tasks.workunit.client.0.smithi083.stdout:6/93: dread f6 [0,4194304] 0 2024-04-01T06:57:32.982 INFO:tasks.workunit.client.0.smithi083.stdout:6/94: truncate d9/dc/f14 1187529 0 2024-04-01T06:57:32.983 INFO:tasks.workunit.client.0.smithi083.stdout:6/95: readlink d9/la 0 2024-04-01T06:57:32.987 INFO:tasks.workunit.client.0.smithi083.stdout:2/142: chown d3/d20/l23 736 1 2024-04-01T06:57:32.988 INFO:tasks.workunit.client.0.smithi083.stdout:0/96: rename fa to d16/f1b 0 2024-04-01T06:57:32.991 INFO:tasks.workunit.client.0.smithi083.stdout:1/187: creat db/d1c/d29/f46 x:0 0 0 2024-04-01T06:57:32.992 INFO:tasks.workunit.client.0.smithi083.stdout:3/152: sync 2024-04-01T06:57:32.992 INFO:tasks.workunit.client.0.smithi083.stdout:5/66: sync 2024-04-01T06:57:32.992 INFO:tasks.workunit.client.0.smithi083.stdout:5/67: chown c3 1470837201 1 2024-04-01T06:57:32.992 INFO:tasks.workunit.client.0.smithi083.stdout:5/68: write d4/d9/fe [621190,105224] 0 2024-04-01T06:57:32.992 INFO:tasks.workunit.client.0.smithi083.stdout:5/69: chown d4 3 1 2024-04-01T06:57:32.993 INFO:tasks.workunit.client.0.smithi083.stdout:7/52: rename d0/d4/fa to d0/d4/ff 0 2024-04-01T06:57:32.994 INFO:tasks.workunit.client.0.smithi083.stdout:7/53: write d0/f3 [4326152,64645] 0 2024-04-01T06:57:32.994 INFO:tasks.workunit.client.0.smithi083.stdout:6/96: creat d9/dc/d1b/f1f x:0 0 0 2024-04-01T06:57:32.998 INFO:tasks.workunit.client.0.smithi083.stdout:3/153: rename d6/d12/d25 to d6/d15/d2d 0 2024-04-01T06:57:32.998 INFO:tasks.workunit.client.0.smithi083.stdout:3/154: truncate d6/f29 270340 0 2024-04-01T06:57:32.999 INFO:tasks.workunit.client.0.smithi083.stdout:5/70: mkdir d4/d9/d10 0 2024-04-01T06:57:32.999 INFO:tasks.workunit.client.0.smithi083.stdout:5/71: rename d4/d9/d10 to d4/d9/d10/d11 22 2024-04-01T06:57:32.999 INFO:tasks.workunit.client.0.smithi083.stdout:5/72: chown d4/ld 14995870 1 2024-04-01T06:57:33.002 INFO:tasks.workunit.client.0.smithi083.stdout:6/97: creat d9/f20 x:0 0 0 2024-04-01T06:57:33.002 INFO:tasks.workunit.client.0.smithi083.stdout:4/91: dwrite d1/f2 [0,4194304] 0 2024-04-01T06:57:33.002 INFO:tasks.workunit.client.0.smithi083.stdout:0/97: dread fe [0,4194304] 0 2024-04-01T06:57:33.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:32 smithi145 ceph-mon[47816]: pgmap v53: 97 pgs: 97 active+clean; 125 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.1 MiB/s wr, 648 op/s 2024-04-01T06:57:33.005 INFO:tasks.workunit.client.0.smithi083.stdout:2/143: mknod d3/d1f/c35 0 2024-04-01T06:57:33.005 INFO:tasks.workunit.client.0.smithi083.stdout:6/98: creat d9/f21 x:0 0 0 2024-04-01T06:57:33.007 INFO:tasks.workunit.client.0.smithi083.stdout:0/98: mknod d16/c1c 0 2024-04-01T06:57:33.007 INFO:tasks.workunit.client.0.smithi083.stdout:0/99: stat fe 0 2024-04-01T06:57:33.007 INFO:tasks.workunit.client.0.smithi083.stdout:0/100: chown d16/f1b 5382 1 2024-04-01T06:57:33.008 INFO:tasks.workunit.client.0.smithi083.stdout:4/92: mkdir d1/d4/d1f 0 2024-04-01T06:57:33.010 INFO:tasks.workunit.client.0.smithi083.stdout:6/99: creat d9/dc/d1b/f22 x:0 0 0 2024-04-01T06:57:33.010 INFO:tasks.workunit.client.0.smithi083.stdout:7/54: mkdir d0/d10 0 2024-04-01T06:57:33.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:32 smithi083 ceph-mon[43429]: pgmap v53: 97 pgs: 97 active+clean; 125 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.1 MiB/s wr, 648 op/s 2024-04-01T06:57:33.014 INFO:tasks.workunit.client.0.smithi083.stdout:0/101: mkdir d16/d1d 0 2024-04-01T06:57:33.014 INFO:tasks.workunit.client.0.smithi083.stdout:7/55: symlink d0/d4/d9/l11 0 2024-04-01T06:57:33.014 INFO:tasks.workunit.client.0.smithi083.stdout:1/188: dwrite f1 [0,4194304] 0 2024-04-01T06:57:33.014 INFO:tasks.workunit.client.0.smithi083.stdout:1/189: readlink db/l1a 0 2024-04-01T06:57:33.014 INFO:tasks.workunit.client.0.smithi083.stdout:1/190: stat db/f13 0 2024-04-01T06:57:33.015 INFO:tasks.workunit.client.0.smithi083.stdout:7/56: write d0/d4/ff [3503342,57681] 0 2024-04-01T06:57:33.015 INFO:tasks.workunit.client.0.smithi083.stdout:7/57: chown d0/f3 0 1 2024-04-01T06:57:33.018 INFO:tasks.workunit.client.0.smithi083.stdout:3/155: dwrite d6/d15/f1c [0,4194304] 0 2024-04-01T06:57:33.018 INFO:tasks.workunit.client.0.smithi083.stdout:3/156: write d6/d15/f14 [943976,120469] 0 2024-04-01T06:57:33.026 INFO:tasks.workunit.client.0.smithi083.stdout:5/73: dwrite d4/fa [0,4194304] 0 2024-04-01T06:57:33.029 INFO:tasks.workunit.client.0.smithi083.stdout:3/157: dwrite d6/d15/f19 [4194304,4194304] 0 2024-04-01T06:57:33.029 INFO:tasks.workunit.client.0.smithi083.stdout:0/102: read fd [2406493,4614] 0 2024-04-01T06:57:33.030 INFO:tasks.workunit.client.0.smithi083.stdout:0/103: dread - d16/f18 zero size 2024-04-01T06:57:33.030 INFO:tasks.workunit.client.0.smithi083.stdout:7/58: dread d0/d4/f5 [0,4194304] 0 2024-04-01T06:57:33.030 INFO:tasks.workunit.client.0.smithi083.stdout:7/59: rename d0/d4 to d0/d4/d9/d12 22 2024-04-01T06:57:33.030 INFO:tasks.workunit.client.0.smithi083.stdout:7/60: fdatasync d0/d4/f5 0 2024-04-01T06:57:33.030 INFO:tasks.workunit.client.0.smithi083.stdout:1/191: dread db/f10 [0,4194304] 0 2024-04-01T06:57:33.030 INFO:tasks.workunit.client.0.smithi083.stdout:1/192: read db/fe [3940644,65172] 0 2024-04-01T06:57:33.032 INFO:tasks.workunit.client.0.smithi083.stdout:5/74: creat d4/d9/f12 x:0 0 0 2024-04-01T06:57:33.035 INFO:tasks.workunit.client.0.smithi083.stdout:4/93: dwrite d1/d4/db/f11 [4194304,4194304] 0 2024-04-01T06:57:33.035 INFO:tasks.workunit.client.0.smithi083.stdout:4/94: write d1/f6 [449110,116480] 0 2024-04-01T06:57:33.036 INFO:tasks.workunit.client.0.smithi083.stdout:3/158: creat d6/d12/f2e x:0 0 0 2024-04-01T06:57:33.036 INFO:tasks.workunit.client.0.smithi083.stdout:3/159: dread - d6/d12/f13 zero size 2024-04-01T06:57:33.038 INFO:tasks.workunit.client.0.smithi083.stdout:2/144: dwrite d3/d1f/f31 [4194304,4194304] 0 2024-04-01T06:57:33.039 INFO:tasks.workunit.client.0.smithi083.stdout:7/61: symlink d0/d4/d9/l13 0 2024-04-01T06:57:33.039 INFO:tasks.workunit.client.0.smithi083.stdout:7/62: stat d0/d4 0 2024-04-01T06:57:33.039 INFO:tasks.workunit.client.0.smithi083.stdout:5/75: dread d4/fa [0,4194304] 0 2024-04-01T06:57:33.041 INFO:tasks.workunit.client.0.smithi083.stdout:5/76: read d4/fb [4134838,105369] 0 2024-04-01T06:57:33.041 INFO:tasks.workunit.client.0.smithi083.stdout:1/193: mkdir db/d1c/d29/d33/d47 0 2024-04-01T06:57:33.041 INFO:tasks.workunit.client.0.smithi083.stdout:1/194: write db/f14 [5037951,127552] 0 2024-04-01T06:57:33.041 INFO:tasks.workunit.client.0.smithi083.stdout:7/63: write d0/d4/fc [676128,46774] 0 2024-04-01T06:57:33.046 INFO:tasks.workunit.client.0.smithi083.stdout:5/77: dread d4/fb [0,4194304] 0 2024-04-01T06:57:33.048 INFO:tasks.workunit.client.0.smithi083.stdout:4/95: rename d1/f1e to d1/d4/db/f20 0 2024-04-01T06:57:33.048 INFO:tasks.workunit.client.0.smithi083.stdout:4/96: fdatasync d1/d4/ff 0 2024-04-01T06:57:33.049 INFO:tasks.workunit.client.0.smithi083.stdout:4/97: write d1/d4/ff [1355011,108249] 0 2024-04-01T06:57:33.049 INFO:tasks.workunit.client.0.smithi083.stdout:4/98: dread - d1/d4/db/f20 zero size 2024-04-01T06:57:33.050 INFO:tasks.workunit.client.0.smithi083.stdout:3/160: mkdir d6/d15/d2d/d2f 0 2024-04-01T06:57:33.050 INFO:tasks.workunit.client.0.smithi083.stdout:3/161: truncate d6/d12/f2e 307511 0 2024-04-01T06:57:33.054 INFO:tasks.workunit.client.0.smithi083.stdout:2/145: dwrite f2 [0,4194304] 0 2024-04-01T06:57:33.055 INFO:tasks.workunit.client.0.smithi083.stdout:1/195: unlink db/d1c/d1d/l32 0 2024-04-01T06:57:33.057 INFO:tasks.workunit.client.0.smithi083.stdout:7/64: symlink d0/d4/d9/l14 0 2024-04-01T06:57:33.059 INFO:tasks.workunit.client.0.smithi083.stdout:5/78: rename d4/d9/fe to d4/d9/d10/f13 0 2024-04-01T06:57:33.061 INFO:tasks.workunit.client.0.smithi083.stdout:4/99: mknod d1/d8/c21 0 2024-04-01T06:57:33.062 INFO:tasks.workunit.client.0.smithi083.stdout:3/162: creat d6/d12/f30 x:0 0 0 2024-04-01T06:57:33.062 INFO:tasks.workunit.client.0.smithi083.stdout:3/163: chown d6/d12/f2e 3332099 1 2024-04-01T06:57:33.065 INFO:tasks.workunit.client.0.smithi083.stdout:1/196: rename db/d1c/d2e/c3d to db/d26/c48 0 2024-04-01T06:57:33.065 INFO:tasks.workunit.client.0.smithi083.stdout:1/197: write db/d1c/d2e/f2f [2012113,91857] 0 2024-04-01T06:57:33.065 INFO:tasks.workunit.client.0.smithi083.stdout:1/198: readlink db/d1c/d2e/d30/l31 0 2024-04-01T06:57:33.065 INFO:tasks.workunit.client.0.smithi083.stdout:1/199: stat db/f15 0 2024-04-01T06:57:33.065 INFO:tasks.workunit.client.0.smithi083.stdout:1/200: readlink db/l1a 0 2024-04-01T06:57:33.067 INFO:tasks.workunit.client.0.smithi083.stdout:5/79: mkdir d4/d9/d14 0 2024-04-01T06:57:33.067 INFO:tasks.workunit.client.0.smithi083.stdout:5/80: write d4/d9/d10/f13 [1185803,95018] 0 2024-04-01T06:57:33.067 INFO:tasks.workunit.client.0.smithi083.stdout:4/100: symlink d1/d4/l22 0 2024-04-01T06:57:33.068 INFO:tasks.workunit.client.0.smithi083.stdout:3/164: link d6/d1e/f23 d6/d1e/f31 0 2024-04-01T06:57:33.070 INFO:tasks.workunit.client.0.smithi083.stdout:2/146: link d3/d1f/f24 d3/d26/f36 0 2024-04-01T06:57:33.070 INFO:tasks.workunit.client.0.smithi083.stdout:2/147: chown d3/d1f/f31 2244 1 2024-04-01T06:57:33.070 INFO:tasks.workunit.client.0.smithi083.stdout:2/148: stat d3/d1f/c25 0 2024-04-01T06:57:33.073 INFO:tasks.workunit.client.0.smithi083.stdout:5/81: mknod d4/d9/c15 0 2024-04-01T06:57:33.073 INFO:tasks.workunit.client.0.smithi083.stdout:5/82: write d4/ff [892730,105580] 0 2024-04-01T06:57:33.074 INFO:tasks.workunit.client.0.smithi083.stdout:4/101: creat d1/f23 x:0 0 0 2024-04-01T06:57:33.075 INFO:tasks.workunit.client.0.smithi083.stdout:2/149: mkdir d3/d26/d37 0 2024-04-01T06:57:33.077 INFO:tasks.workunit.client.0.smithi083.stdout:7/65: rename d0/d4/d9/l14 to d0/l15 0 2024-04-01T06:57:33.078 INFO:tasks.workunit.client.0.smithi083.stdout:4/102: mknod d1/d4/db/c24 0 2024-04-01T06:57:33.078 INFO:tasks.workunit.client.0.smithi083.stdout:5/83: dread d4/d9/d10/f13 [0,4194304] 0 2024-04-01T06:57:33.080 INFO:tasks.workunit.client.0.smithi083.stdout:1/201: dwrite f7 [0,4194304] 0 2024-04-01T06:57:33.081 INFO:tasks.workunit.client.0.smithi083.stdout:2/150: unlink d3/f18 0 2024-04-01T06:57:33.081 INFO:tasks.workunit.client.0.smithi083.stdout:5/84: dread d4/d9/d10/f13 [0,4194304] 0 2024-04-01T06:57:33.081 INFO:tasks.workunit.client.0.smithi083.stdout:2/151: fsync f1 0 2024-04-01T06:57:33.082 INFO:tasks.workunit.client.0.smithi083.stdout:5/85: write d4/fb [2169299,34935] 0 2024-04-01T06:57:33.085 INFO:tasks.workunit.client.0.smithi083.stdout:7/66: dread d0/d4/fc [0,4194304] 0 2024-04-01T06:57:33.085 INFO:tasks.workunit.client.0.smithi083.stdout:7/67: chown d0/d4/d9/l13 0 1 2024-04-01T06:57:33.085 INFO:tasks.workunit.client.0.smithi083.stdout:7/68: getdents d0/d10 0 2024-04-01T06:57:33.085 INFO:tasks.workunit.client.0.smithi083.stdout:7/69: getdents d0/d10 0 2024-04-01T06:57:33.089 INFO:tasks.workunit.client.0.smithi083.stdout:1/202: mkdir db/d1c/d49 0 2024-04-01T06:57:33.092 INFO:tasks.workunit.client.0.smithi083.stdout:3/165: fsync d6/d1e/f23 0 2024-04-01T06:57:33.094 INFO:tasks.workunit.client.0.smithi083.stdout:4/103: dwrite d1/f2 [4194304,4194304] 0 2024-04-01T06:57:33.095 INFO:tasks.workunit.client.0.smithi083.stdout:1/203: creat db/d1c/d29/d33/f4a x:0 0 0 2024-04-01T06:57:33.095 INFO:tasks.workunit.client.0.smithi083.stdout:1/204: fdatasync db/d1c/d29/f2d 0 2024-04-01T06:57:33.095 INFO:tasks.workunit.client.0.smithi083.stdout:1/205: chown db/f17 48 1 2024-04-01T06:57:33.095 INFO:tasks.workunit.client.0.smithi083.stdout:1/206: fdatasync db/fe 0 2024-04-01T06:57:33.096 INFO:tasks.workunit.client.0.smithi083.stdout:2/152: dread d3/f16 [0,4194304] 0 2024-04-01T06:57:33.102 INFO:tasks.workunit.client.0.smithi083.stdout:3/166: rename d6/fd to d6/d15/d2d/d2f/f32 0 2024-04-01T06:57:33.102 INFO:tasks.workunit.client.0.smithi083.stdout:1/207: mkdir db/d1c/d29/d33/d4b 0 2024-04-01T06:57:33.103 INFO:tasks.workunit.client.0.smithi083.stdout:7/70: rmdir d0 39 2024-04-01T06:57:33.106 INFO:tasks.workunit.client.0.smithi083.stdout:1/208: dread db/d1c/f25 [0,4194304] 0 2024-04-01T06:57:33.107 INFO:tasks.workunit.client.0.smithi083.stdout:3/167: mknod d6/d15/d2d/d2f/c33 0 2024-04-01T06:57:33.109 INFO:tasks.workunit.client.0.smithi083.stdout:2/153: dwrite d3/d20/f34 [0,4194304] 0 2024-04-01T06:57:33.115 INFO:tasks.workunit.client.0.smithi083.stdout:3/168: creat d6/d12/f34 x:0 0 0 2024-04-01T06:57:33.115 INFO:tasks.workunit.client.0.smithi083.stdout:5/86: truncate d4/fb 202937 0 2024-04-01T06:57:33.115 INFO:tasks.workunit.client.0.smithi083.stdout:5/87: dread - d4/d9/f12 zero size 2024-04-01T06:57:33.115 INFO:tasks.workunit.client.0.smithi083.stdout:7/71: dread d0/d4/fc [0,4194304] 0 2024-04-01T06:57:33.116 INFO:tasks.workunit.client.0.smithi083.stdout:2/154: dread f2 [0,4194304] 0 2024-04-01T06:57:33.119 INFO:tasks.workunit.client.0.smithi083.stdout:5/88: mkdir d4/d9/d16 0 2024-04-01T06:57:33.120 INFO:tasks.workunit.client.0.smithi083.stdout:7/72: truncate d0/f3 3498097 0 2024-04-01T06:57:33.122 INFO:tasks.workunit.client.0.smithi083.stdout:1/209: dwrite db/d1c/d1d/f20 [4194304,4194304] 0 2024-04-01T06:57:33.122 INFO:tasks.workunit.client.0.smithi083.stdout:1/210: readlink db/d1c/d2e/d30/l37 0 2024-04-01T06:57:33.122 INFO:tasks.workunit.client.0.smithi083.stdout:1/211: stat db/d1c/d29 0 2024-04-01T06:57:33.124 INFO:tasks.workunit.client.0.smithi083.stdout:7/73: creat d0/d4/f16 x:0 0 0 2024-04-01T06:57:33.124 INFO:tasks.workunit.client.0.smithi083.stdout:7/74: chown d0/d4/d9 427952 1 2024-04-01T06:57:33.124 INFO:tasks.workunit.client.0.smithi083.stdout:7/75: chown d0/d4/fc 23117 1 2024-04-01T06:57:33.126 INFO:tasks.workunit.client.0.smithi083.stdout:7/76: write d0/d4/ff [775681,36085] 0 2024-04-01T06:57:33.126 INFO:tasks.workunit.client.0.smithi083.stdout:5/89: dread d4/f6 [0,4194304] 0 2024-04-01T06:57:33.136 INFO:tasks.workunit.client.0.smithi083.stdout:1/212: dwrite db/d1c/f25 [0,4194304] 0 2024-04-01T06:57:33.136 INFO:tasks.workunit.client.0.smithi083.stdout:1/213: getdents db/d1c/d29/d33/d47 0 2024-04-01T06:57:33.137 INFO:tasks.workunit.client.0.smithi083.stdout:2/155: symlink d3/l38 0 2024-04-01T06:57:33.140 INFO:tasks.workunit.client.0.smithi083.stdout:7/77: link d0/d4/d9/l11 d0/d10/l17 0 2024-04-01T06:57:33.140 INFO:tasks.workunit.client.0.smithi083.stdout:7/78: readlink d0/d4/d9/l13 0 2024-04-01T06:57:33.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:32 smithi153 ceph-mon[48187]: pgmap v53: 97 pgs: 97 active+clean; 125 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.1 MiB/s wr, 648 op/s 2024-04-01T06:57:33.142 INFO:tasks.workunit.client.0.smithi083.stdout:5/90: rename d4/ld to d4/d9/l17 0 2024-04-01T06:57:33.142 INFO:tasks.workunit.client.0.smithi083.stdout:5/91: read d4/ff [432821,61041] 0 2024-04-01T06:57:33.144 INFO:tasks.workunit.client.0.smithi083.stdout:1/214: creat db/d1c/d1d/f4c x:0 0 0 2024-04-01T06:57:33.146 INFO:tasks.workunit.client.0.smithi083.stdout:2/156: rmdir d3/d26/d37 0 2024-04-01T06:57:33.147 INFO:tasks.workunit.client.0.smithi083.stdout:2/157: stat d3/d26 0 2024-04-01T06:57:33.149 INFO:tasks.workunit.client.0.smithi083.stdout:7/79: unlink d0/d4/d9/l11 0 2024-04-01T06:57:33.150 INFO:tasks.workunit.client.0.smithi083.stdout:5/92: creat d4/d9/f18 x:0 0 0 2024-04-01T06:57:33.153 INFO:tasks.workunit.client.0.smithi083.stdout:2/158: rename d3/d1f/f24 to d3/d1f/d2b/f39 0 2024-04-01T06:57:33.159 INFO:tasks.workunit.client.0.smithi083.stdout:1/215: dwrite db/f11 [0,4194304] 0 2024-04-01T06:57:33.160 INFO:tasks.workunit.client.0.smithi083.stdout:1/216: write f1 [367228,105624] 0 2024-04-01T06:57:33.161 INFO:tasks.workunit.client.0.smithi083.stdout:2/159: creat d3/d26/f3a x:0 0 0 2024-04-01T06:57:33.165 INFO:tasks.workunit.client.0.smithi083.stdout:7/80: link d0/d10/l17 d0/l18 0 2024-04-01T06:57:33.168 INFO:tasks.workunit.client.0.smithi083.stdout:5/93: dwrite d4/d9/f12 [0,4194304] 0 2024-04-01T06:57:33.168 INFO:tasks.workunit.client.0.smithi083.stdout:5/94: fdatasync d4/f6 0 2024-04-01T06:57:33.168 INFO:tasks.workunit.client.0.smithi083.stdout:5/95: truncate d4/d9/f18 650310 0 2024-04-01T06:57:33.168 INFO:tasks.workunit.client.0.smithi083.stdout:1/217: mkdir db/d26/d4d 0 2024-04-01T06:57:33.169 INFO:tasks.workunit.client.0.smithi083.stdout:1/218: chown db/d1c/d2e 37082415 1 2024-04-01T06:57:33.171 INFO:tasks.workunit.client.0.smithi083.stdout:2/160: creat d3/d1f/d27/f3b x:0 0 0 2024-04-01T06:57:33.175 INFO:tasks.workunit.client.0.smithi083.stdout:5/96: mkdir d4/d9/d16/d19 0 2024-04-01T06:57:33.176 INFO:tasks.workunit.client.0.smithi083.stdout:7/81: dread d0/d4/ff [0,4194304] 0 2024-04-01T06:57:33.176 INFO:tasks.workunit.client.0.smithi083.stdout:7/82: write d0/d4/f16 [831543,72576] 0 2024-04-01T06:57:33.176 INFO:tasks.workunit.client.0.smithi083.stdout:5/97: dread d4/fb [0,4194304] 0 2024-04-01T06:57:33.177 INFO:tasks.workunit.client.0.smithi083.stdout:1/219: rename db/d1c/f21 to db/d1c/f4e 0 2024-04-01T06:57:33.184 INFO:tasks.workunit.client.0.smithi083.stdout:7/83: readlink d0/d10/l17 0 2024-04-01T06:57:33.184 INFO:tasks.workunit.client.0.smithi083.stdout:7/84: chown d0/d4 0 1 2024-04-01T06:57:33.185 INFO:tasks.workunit.client.0.smithi083.stdout:7/85: write d0/d4/f5 [1024390,77878] 0 2024-04-01T06:57:33.185 INFO:tasks.workunit.client.0.smithi083.stdout:7/86: write d0/f3 [3588759,90730] 0 2024-04-01T06:57:33.185 INFO:tasks.workunit.client.0.smithi083.stdout:7/87: stat d0/d4/f16 0 2024-04-01T06:57:33.185 INFO:tasks.workunit.client.0.smithi083.stdout:7/88: readlink d0/l18 0 2024-04-01T06:57:33.185 INFO:tasks.workunit.client.0.smithi083.stdout:5/98: mkdir d4/d9/d16/d1a 0 2024-04-01T06:57:33.185 INFO:tasks.workunit.client.0.smithi083.stdout:5/99: chown d4/l7 2013 1 2024-04-01T06:57:33.186 INFO:tasks.workunit.client.0.smithi083.stdout:1/220: truncate db/d26/f2c 26848 0 2024-04-01T06:57:33.186 INFO:tasks.workunit.client.0.smithi083.stdout:1/221: chown db/d1c/d29/f2d 5231137 1 2024-04-01T06:57:33.186 INFO:tasks.workunit.client.0.smithi083.stdout:1/222: read db/d1c/f24 [236302,103218] 0 2024-04-01T06:57:33.186 INFO:tasks.workunit.client.0.smithi083.stdout:1/223: readlink db/l43 0 2024-04-01T06:57:33.187 INFO:tasks.workunit.client.0.smithi083.stdout:7/89: symlink d0/d4/d9/l19 0 2024-04-01T06:57:33.188 INFO:tasks.workunit.client.0.smithi083.stdout:2/161: dread d3/f19 [0,4194304] 0 2024-04-01T06:57:33.189 INFO:tasks.workunit.client.0.smithi083.stdout:1/224: creat db/d26/d4d/f4f x:0 0 0 2024-04-01T06:57:33.189 INFO:tasks.workunit.client.0.smithi083.stdout:1/225: chown db/f15 0 1 2024-04-01T06:57:33.190 INFO:tasks.workunit.client.0.smithi083.stdout:7/90: link d0/d4/fc d0/d4/d9/f1a 0 2024-04-01T06:57:33.192 INFO:tasks.workunit.client.0.smithi083.stdout:5/100: link d4/d9/d10/f13 d4/f1b 0 2024-04-01T06:57:33.193 INFO:tasks.workunit.client.0.smithi083.stdout:2/162: fsync d3/f7 0 2024-04-01T06:57:33.193 INFO:tasks.workunit.client.0.smithi083.stdout:2/163: readlink d3/d20/l2e 0 2024-04-01T06:57:33.196 INFO:tasks.workunit.client.0.smithi083.stdout:5/101: creat d4/f1c x:0 0 0 2024-04-01T06:57:33.198 INFO:tasks.workunit.client.0.smithi083.stdout:2/164: rmdir d3/d1f/d2b 39 2024-04-01T06:57:33.200 INFO:tasks.workunit.client.0.smithi083.stdout:7/91: getdents d0/d4/d9 0 2024-04-01T06:57:33.205 INFO:tasks.workunit.client.0.smithi083.stdout:5/102: link d4/d9/l17 d4/d9/d14/l1d 0 2024-04-01T06:57:33.210 INFO:tasks.workunit.client.0.smithi083.stdout:2/165: dwrite d3/f7 [0,4194304] 0 2024-04-01T06:57:33.219 INFO:tasks.workunit.client.0.smithi083.stdout:1/226: rename db/d26 to db/d1c/d29/d33/d50 0 2024-04-01T06:57:33.221 INFO:tasks.workunit.client.0.smithi083.stdout:1/227: rename db/f17 to db/d1c/d29/d33/d4b/f51 0 2024-04-01T06:57:33.221 INFO:tasks.workunit.client.0.smithi083.stdout:1/228: rename db to db/d52 22 2024-04-01T06:57:33.221 INFO:tasks.workunit.client.0.smithi083.stdout:1/229: chown db/d1c/f25 557 1 2024-04-01T06:57:33.227 INFO:tasks.workunit.client.0.smithi083.stdout:1/230: getdents db 0 2024-04-01T06:57:33.229 INFO:tasks.workunit.client.0.smithi083.stdout:1/231: getdents db/d1c/d29/d33 0 2024-04-01T06:57:33.229 INFO:tasks.workunit.client.0.smithi083.stdout:1/232: chown db/d1c/d2e/d30/l31 4080 1 2024-04-01T06:57:33.229 INFO:tasks.workunit.client.0.smithi083.stdout:1/233: dread - db/d1c/d29/d33/f4a zero size 2024-04-01T06:57:33.231 INFO:tasks.workunit.client.0.smithi083.stdout:7/92: dwrite d0/d4/f5 [0,4194304] 0 2024-04-01T06:57:33.231 INFO:tasks.workunit.client.0.smithi083.stdout:7/93: write d0/f3 [3760178,96368] 0 2024-04-01T06:57:33.231 INFO:tasks.workunit.client.0.smithi083.stdout:7/94: stat d0/d4/d9 0 2024-04-01T06:57:33.233 INFO:tasks.workunit.client.0.smithi083.stdout:7/95: unlink d0/d4/d9/f1a 0 2024-04-01T06:57:33.233 INFO:tasks.workunit.client.0.smithi083.stdout:7/96: readlink d0/d4/d9/l13 0 2024-04-01T06:57:33.235 INFO:tasks.workunit.client.0.smithi083.stdout:7/97: rename d0/d4/d9/l19 to d0/d10/l1b 0 2024-04-01T06:57:33.237 INFO:tasks.workunit.client.0.smithi083.stdout:5/103: dwrite d4/d9/d10/f13 [0,4194304] 0 2024-04-01T06:57:33.237 INFO:tasks.workunit.client.0.smithi083.stdout:5/104: write d4/f1c [505518,18162] 0 2024-04-01T06:57:33.237 INFO:tasks.workunit.client.0.smithi083.stdout:5/105: write d4/ff [1701084,2162] 0 2024-04-01T06:57:33.237 INFO:tasks.workunit.client.0.smithi083.stdout:7/98: creat d0/d4/d9/f1c x:0 0 0 2024-04-01T06:57:33.240 INFO:tasks.workunit.client.0.smithi083.stdout:5/106: rename d4/d9/f18 to d4/d9/d16/d19/f1e 0 2024-04-01T06:57:33.242 INFO:tasks.workunit.client.0.smithi083.stdout:1/234: dwrite db/d1c/d29/d33/d50/d4d/f4f [0,4194304] 0 2024-04-01T06:57:33.242 INFO:tasks.workunit.client.0.smithi083.stdout:1/235: chown db/d1c/f35 16 1 2024-04-01T06:57:33.242 INFO:tasks.workunit.client.0.smithi083.stdout:5/107: fdatasync d4/f1c 0 2024-04-01T06:57:33.252 INFO:tasks.workunit.client.0.smithi083.stdout:1/236: creat db/d1c/d29/d33/d50/f53 x:0 0 0 2024-04-01T06:57:33.252 INFO:tasks.workunit.client.0.smithi083.stdout:5/108: mkdir d4/d9/d16/d1f 0 2024-04-01T06:57:33.252 INFO:tasks.workunit.client.0.smithi083.stdout:2/166: dwrite d3/d1f/f31 [0,4194304] 0 2024-04-01T06:57:33.252 INFO:tasks.workunit.client.0.smithi083.stdout:5/109: symlink d4/d9/d10/l20 0 2024-04-01T06:57:33.253 INFO:tasks.workunit.client.0.smithi083.stdout:2/167: mknod d3/d1f/d2b/c3c 0 2024-04-01T06:57:33.254 INFO:tasks.workunit.client.0.smithi083.stdout:2/168: symlink d3/d26/l3d 0 2024-04-01T06:57:33.255 INFO:tasks.workunit.client.0.smithi083.stdout:2/169: chown d3/f1c 189481 1 2024-04-01T06:57:33.257 INFO:tasks.workunit.client.0.smithi083.stdout:2/170: mknod d3/d1f/d2b/c3e 0 2024-04-01T06:57:33.257 INFO:tasks.workunit.client.0.smithi083.stdout:2/171: dread - d3/d20/f21 zero size 2024-04-01T06:57:33.257 INFO:tasks.workunit.client.0.smithi083.stdout:2/172: stat d3/d20/l2e 0 2024-04-01T06:57:33.257 INFO:tasks.workunit.client.0.smithi083.stdout:2/173: readlink d3/d1f/l22 0 2024-04-01T06:57:33.257 INFO:tasks.workunit.client.0.smithi083.stdout:2/174: truncate d3/f19 4378688 0 2024-04-01T06:57:33.257 INFO:tasks.workunit.client.0.smithi083.stdout:2/175: readlink d3/d20/l2e 0 2024-04-01T06:57:33.257 INFO:tasks.workunit.client.0.smithi083.stdout:2/176: chown d3/d1f/f30 3 1 2024-04-01T06:57:33.257 INFO:tasks.workunit.client.0.smithi083.stdout:2/177: stat d3/f1c 0 2024-04-01T06:57:33.263 INFO:tasks.workunit.client.0.smithi083.stdout:7/99: dwrite d0/d4/fc [0,4194304] 0 2024-04-01T06:57:33.266 INFO:tasks.workunit.client.0.smithi083.stdout:7/100: symlink d0/d10/l1d 0 2024-04-01T06:57:33.266 INFO:tasks.workunit.client.0.smithi083.stdout:7/101: write d0/d4/d9/f1c [1045443,126896] 0 2024-04-01T06:57:33.267 INFO:tasks.workunit.client.0.smithi083.stdout:7/102: creat d0/d4/f1e x:0 0 0 2024-04-01T06:57:33.267 INFO:tasks.workunit.client.0.smithi083.stdout:7/103: truncate d0/d4/d9/f1c 1851259 0 2024-04-01T06:57:33.271 INFO:tasks.workunit.client.0.smithi083.stdout:7/104: dread d0/d4/ff [0,4194304] 0 2024-04-01T06:57:33.272 INFO:tasks.workunit.client.0.smithi083.stdout:7/105: fdatasync d0/d4/fc 0 2024-04-01T06:57:33.272 INFO:tasks.workunit.client.0.smithi083.stdout:7/106: chown d0/d10 242 1 2024-04-01T06:57:33.272 INFO:tasks.workunit.client.0.smithi083.stdout:7/107: symlink d0/d4/l1f 0 2024-04-01T06:57:33.272 INFO:tasks.workunit.client.0.smithi083.stdout:7/108: chown d0/d4/d9 21847968 1 2024-04-01T06:57:33.277 INFO:tasks.workunit.client.0.smithi083.stdout:5/110: dwrite d4/d9/f12 [0,4194304] 0 2024-04-01T06:57:33.278 INFO:tasks.workunit.client.0.smithi083.stdout:2/178: dwrite d3/d1f/f31 [4194304,4194304] 0 2024-04-01T06:57:33.278 INFO:tasks.workunit.client.0.smithi083.stdout:1/237: dwrite db/d1c/d1d/f4c [0,4194304] 0 2024-04-01T06:57:33.279 INFO:tasks.workunit.client.0.smithi083.stdout:5/111: rename d4/d9/d14 to d4/d9/d10/d21 0 2024-04-01T06:57:33.280 INFO:tasks.workunit.client.0.smithi083.stdout:1/238: write db/d1c/d1d/f4c [1305815,33380] 0 2024-04-01T06:57:33.280 INFO:tasks.workunit.client.0.smithi083.stdout:2/179: readlink d3/l4 0 2024-04-01T06:57:33.280 INFO:tasks.workunit.client.0.smithi083.stdout:7/109: dread d0/d4/d9/f1c [0,4194304] 0 2024-04-01T06:57:33.281 INFO:tasks.workunit.client.0.smithi083.stdout:7/110: write d0/d4/f5 [2216270,112956] 0 2024-04-01T06:57:33.291 INFO:tasks.workunit.client.0.smithi083.stdout:7/111: dread d0/f3 [0,4194304] 0 2024-04-01T06:57:33.300 INFO:tasks.workunit.client.0.smithi083.stdout:1/239: symlink db/d1c/d29/d33/d50/d4d/l54 0 2024-04-01T06:57:33.300 INFO:tasks.workunit.client.0.smithi083.stdout:1/240: stat db/d1c/d2e/d30/l3f 0 2024-04-01T06:57:33.300 INFO:tasks.workunit.client.0.smithi083.stdout:5/112: creat d4/d9/d16/d1f/f22 x:0 0 0 2024-04-01T06:57:33.300 INFO:tasks.workunit.client.0.smithi083.stdout:5/113: chown d4/f6 198 1 2024-04-01T06:57:33.300 INFO:tasks.workunit.client.0.smithi083.stdout:5/114: truncate d4/fb 377046 0 2024-04-01T06:57:33.301 INFO:tasks.workunit.client.0.smithi083.stdout:1/241: write db/f15 [2096341,43126] 0 2024-04-01T06:57:33.301 INFO:tasks.workunit.client.0.smithi083.stdout:1/242: getdents db 0 2024-04-01T06:57:33.302 INFO:tasks.workunit.client.0.smithi083.stdout:7/112: dwrite d0/d4/f1e [0,4194304] 0 2024-04-01T06:57:33.302 INFO:tasks.workunit.client.0.smithi083.stdout:7/113: fsync d0/d4/ff 0 2024-04-01T06:57:33.303 INFO:tasks.workunit.client.0.smithi083.stdout:2/180: unlink d3/d1f/d2b/c3c 0 2024-04-01T06:57:33.303 INFO:tasks.workunit.client.0.smithi083.stdout:2/181: readlink d3/d1f/l22 0 2024-04-01T06:57:33.303 INFO:tasks.workunit.client.0.smithi083.stdout:2/182: write d3/d1f/d2b/f32 [319827,28121] 0 2024-04-01T06:57:33.309 INFO:tasks.workunit.client.0.smithi083.stdout:1/243: link db/d1c/d29/f2d db/d1c/d29/d33/d47/f55 0 2024-04-01T06:57:33.314 INFO:tasks.workunit.client.0.smithi083.stdout:7/114: creat d0/d10/f20 x:0 0 0 2024-04-01T06:57:33.314 INFO:tasks.workunit.client.0.smithi083.stdout:6/100: sync 2024-04-01T06:57:33.314 INFO:tasks.workunit.client.0.smithi083.stdout:4/104: sync 2024-04-01T06:57:33.314 INFO:tasks.workunit.client.0.smithi083.stdout:0/104: sync 2024-04-01T06:57:33.314 INFO:tasks.workunit.client.0.smithi083.stdout:4/105: fsync d1/d4/ff 0 2024-04-01T06:57:33.314 INFO:tasks.workunit.client.0.smithi083.stdout:9/108: sync 2024-04-01T06:57:33.314 INFO:tasks.workunit.client.0.smithi083.stdout:9/109: dread - d6/da/f18 zero size 2024-04-01T06:57:33.314 INFO:tasks.workunit.client.0.smithi083.stdout:8/152: sync 2024-04-01T06:57:33.314 INFO:tasks.workunit.client.0.smithi083.stdout:3/169: sync 2024-04-01T06:57:33.314 INFO:tasks.workunit.client.0.smithi083.stdout:3/170: write d6/d15/f1a [5121608,104077] 0 2024-04-01T06:57:33.314 INFO:tasks.workunit.client.0.smithi083.stdout:3/171: chown d6/d12/l16 1664877177 1 2024-04-01T06:57:33.315 INFO:tasks.workunit.client.0.smithi083.stdout:7/115: write d0/d4/f1e [408678,96385] 0 2024-04-01T06:57:33.315 INFO:tasks.workunit.client.0.smithi083.stdout:2/183: creat d3/d20/f3f x:0 0 0 2024-04-01T06:57:33.315 INFO:tasks.workunit.client.0.smithi083.stdout:2/184: write d3/d20/f21 [567937,56148] 0 2024-04-01T06:57:33.316 INFO:tasks.workunit.client.0.smithi083.stdout:5/115: mkdir d4/d23 0 2024-04-01T06:57:33.316 INFO:tasks.workunit.client.0.smithi083.stdout:5/116: fsync d4/fb 0 2024-04-01T06:57:33.317 INFO:tasks.workunit.client.0.smithi083.stdout:1/244: mknod db/d1c/d49/c56 0 2024-04-01T06:57:33.320 INFO:tasks.workunit.client.0.smithi083.stdout:0/105: rmdir d16 39 2024-04-01T06:57:33.322 INFO:tasks.workunit.client.0.smithi083.stdout:6/101: creat d9/dc/f23 x:0 0 0 2024-04-01T06:57:33.322 INFO:tasks.workunit.client.0.smithi083.stdout:6/102: fdatasync d9/dc/d1b/f1f 0 2024-04-01T06:57:33.322 INFO:tasks.workunit.client.0.smithi083.stdout:6/103: truncate d9/dc/f23 29515 0 2024-04-01T06:57:33.324 INFO:tasks.workunit.client.0.smithi083.stdout:9/110: rename l0 to d6/l20 0 2024-04-01T06:57:33.326 INFO:tasks.workunit.client.0.smithi083.stdout:8/153: creat d15/d21/f34 x:0 0 0 2024-04-01T06:57:33.326 INFO:tasks.workunit.client.0.smithi083.stdout:8/154: write d15/d1b/f29 [1042711,28306] 0 2024-04-01T06:57:33.326 INFO:tasks.workunit.client.0.smithi083.stdout:3/172: rmdir d6/d15/d2d/d2f 39 2024-04-01T06:57:33.329 INFO:tasks.workunit.client.0.smithi083.stdout:2/185: creat d3/d1f/d2b/f40 x:0 0 0 2024-04-01T06:57:33.331 INFO:tasks.workunit.client.0.smithi083.stdout:7/116: rmdir d0 39 2024-04-01T06:57:33.332 INFO:tasks.workunit.client.0.smithi083.stdout:1/245: dwrite db/d1c/d2e/f34 [0,4194304] 0 2024-04-01T06:57:33.333 INFO:tasks.workunit.client.0.smithi083.stdout:5/117: getdents d4/d9/d16/d19 0 2024-04-01T06:57:33.333 INFO:tasks.workunit.client.0.smithi083.stdout:5/118: write d4/f6 [3167980,55891] 0 2024-04-01T06:57:33.334 INFO:tasks.workunit.client.0.smithi083.stdout:5/119: write d4/d9/d10/f13 [3691401,40269] 0 2024-04-01T06:57:33.340 INFO:tasks.workunit.client.0.smithi083.stdout:0/106: link c9 d16/d1d/c1e 0 2024-04-01T06:57:33.344 INFO:tasks.workunit.client.0.smithi083.stdout:6/104: rename d9/dc/d1b/c18 to d9/dc/c24 0 2024-04-01T06:57:33.344 INFO:tasks.workunit.client.0.smithi083.stdout:9/111: mknod d6/c21 0 2024-04-01T06:57:33.347 INFO:tasks.workunit.client.0.smithi083.stdout:8/155: unlink d15/d21/f34 0 2024-04-01T06:57:33.347 INFO:tasks.workunit.client.0.smithi083.stdout:8/156: write f14 [419276,27017] 0 2024-04-01T06:57:33.347 INFO:tasks.workunit.client.0.smithi083.stdout:8/157: fsync f7 0 2024-04-01T06:57:33.348 INFO:tasks.workunit.client.0.smithi083.stdout:3/173: creat d6/d15/f35 x:0 0 0 2024-04-01T06:57:33.352 INFO:tasks.workunit.client.0.smithi083.stdout:0/107: dwrite f7 [0,4194304] 0 2024-04-01T06:57:33.352 INFO:tasks.workunit.client.0.smithi083.stdout:0/108: chown d16/c1c 983643415 1 2024-04-01T06:57:33.352 INFO:tasks.workunit.client.0.smithi083.stdout:0/109: chown d16 3323362 1 2024-04-01T06:57:33.354 INFO:tasks.workunit.client.0.smithi083.stdout:2/186: creat d3/d1f/f41 x:0 0 0 2024-04-01T06:57:33.354 INFO:tasks.workunit.client.0.smithi083.stdout:2/187: chown d3/d1f/d2b/f40 484311933 1 2024-04-01T06:57:33.355 INFO:tasks.workunit.client.0.smithi083.stdout:1/246: symlink db/d1c/l57 0 2024-04-01T06:57:33.357 INFO:tasks.workunit.client.0.smithi083.stdout:5/120: creat d4/d9/d10/f24 x:0 0 0 2024-04-01T06:57:33.359 INFO:tasks.workunit.client.0.smithi083.stdout:3/174: dwrite d6/d1e/f20 [0,4194304] 0 2024-04-01T06:57:33.359 INFO:tasks.workunit.client.0.smithi083.stdout:3/175: dread - d6/d1e/f2b zero size 2024-04-01T06:57:33.359 INFO:tasks.workunit.client.0.smithi083.stdout:9/112: stat l3 0 2024-04-01T06:57:33.359 INFO:tasks.workunit.client.0.smithi083.stdout:9/113: write d6/f19 [126942,32210] 0 2024-04-01T06:57:33.360 INFO:tasks.workunit.client.0.smithi083.stdout:8/158: creat d15/f35 x:0 0 0 2024-04-01T06:57:33.366 INFO:tasks.workunit.client.0.smithi083.stdout:0/110: symlink d16/l1f 0 2024-04-01T06:57:33.368 INFO:tasks.workunit.client.0.smithi083.stdout:2/188: mkdir d3/d20/d42 0 2024-04-01T06:57:33.368 INFO:tasks.workunit.client.0.smithi083.stdout:2/189: fdatasync d3/d26/f3a 0 2024-04-01T06:57:33.368 INFO:tasks.workunit.client.0.smithi083.stdout:2/190: write d3/d1f/d2b/f40 [824834,88048] 0 2024-04-01T06:57:33.369 INFO:tasks.workunit.client.0.smithi083.stdout:1/247: truncate db/d1c/f2b 4352764 0 2024-04-01T06:57:33.369 INFO:tasks.workunit.client.0.smithi083.stdout:1/248: dread - db/d1c/d29/d33/f4a zero size 2024-04-01T06:57:33.371 INFO:tasks.workunit.client.0.smithi083.stdout:6/105: rmdir d9 39 2024-04-01T06:57:33.371 INFO:tasks.workunit.client.0.smithi083.stdout:6/106: dread - d9/dc/d1b/f1f zero size 2024-04-01T06:57:33.373 INFO:tasks.workunit.client.0.smithi083.stdout:5/121: rmdir d4/d9/d16/d1a 0 2024-04-01T06:57:33.373 INFO:tasks.workunit.client.0.smithi083.stdout:5/122: write d4/d9/d16/d19/f1e [109174,46337] 0 2024-04-01T06:57:33.378 INFO:tasks.workunit.client.0.smithi083.stdout:3/176: unlink d6/f29 0 2024-04-01T06:57:33.380 INFO:tasks.workunit.client.0.smithi083.stdout:8/159: creat d15/d18/d19/d1d/f36 x:0 0 0 2024-04-01T06:57:33.381 INFO:tasks.workunit.client.0.smithi083.stdout:9/114: dwrite d6/d15/f1a [4194304,4194304] 0 2024-04-01T06:57:33.381 INFO:tasks.workunit.client.0.smithi083.stdout:1/249: rmdir db/d1c/d29/d33/d4b 39 2024-04-01T06:57:33.383 INFO:tasks.workunit.client.0.smithi083.stdout:6/107: rename d9/f1d to d9/dc/f25 0 2024-04-01T06:57:33.385 INFO:tasks.workunit.client.0.smithi083.stdout:0/111: dwrite d16/f19 [0,4194304] 0 2024-04-01T06:57:33.385 INFO:tasks.workunit.client.0.smithi083.stdout:0/112: chown c9 134 1 2024-04-01T06:57:33.388 INFO:tasks.workunit.client.0.smithi083.stdout:5/123: mknod d4/d9/d16/d1f/c25 0 2024-04-01T06:57:33.391 INFO:tasks.workunit.client.0.smithi083.stdout:3/177: mknod d6/d15/d2d/c36 0 2024-04-01T06:57:33.392 INFO:tasks.workunit.client.0.smithi083.stdout:8/160: creat d15/d18/f37 x:0 0 0 2024-04-01T06:57:33.393 INFO:tasks.workunit.client.0.smithi083.stdout:8/161: readlink l12 0 2024-04-01T06:57:33.394 INFO:tasks.workunit.client.0.smithi083.stdout:8/162: write d15/d21/f22 [2919743,77251] 0 2024-04-01T06:57:33.396 INFO:tasks.workunit.client.0.smithi083.stdout:9/115: link l3 d6/d15/l22 0 2024-04-01T06:57:33.396 INFO:tasks.workunit.client.0.smithi083.stdout:6/108: dwrite d9/dc/d1b/f17 [0,4194304] 0 2024-04-01T06:57:33.396 INFO:tasks.workunit.client.0.smithi083.stdout:9/116: write d6/f14 [4809978,53349] 0 2024-04-01T06:57:33.398 INFO:tasks.workunit.client.0.smithi083.stdout:1/250: symlink db/l58 0 2024-04-01T06:57:33.398 INFO:tasks.workunit.client.0.smithi083.stdout:1/251: fsync db/f14 0 2024-04-01T06:57:33.401 INFO:tasks.workunit.client.0.smithi083.stdout:0/113: creat d16/d1d/f20 x:0 0 0 2024-04-01T06:57:33.403 INFO:tasks.workunit.client.0.smithi083.stdout:5/124: mknod d4/d9/d10/d21/c26 0 2024-04-01T06:57:33.405 INFO:tasks.workunit.client.0.smithi083.stdout:3/178: mknod d6/d15/c37 0 2024-04-01T06:57:33.407 INFO:tasks.workunit.client.0.smithi083.stdout:8/163: mkdir d15/d18/d19/d24/d38 0 2024-04-01T06:57:33.413 INFO:tasks.workunit.client.0.smithi083.stdout:6/109: rename d9/cd to d9/dc/c26 0 2024-04-01T06:57:33.414 INFO:tasks.workunit.client.0.smithi083.stdout:9/117: getdents d6/da 0 2024-04-01T06:57:33.418 INFO:tasks.workunit.client.0.smithi083.stdout:1/252: creat db/d1c/d29/d33/f59 x:0 0 0 2024-04-01T06:57:33.418 INFO:tasks.workunit.client.0.smithi083.stdout:1/253: chown db/d1c/f22 519601692 1 2024-04-01T06:57:33.419 INFO:tasks.workunit.client.0.smithi083.stdout:9/118: dread d6/da/f1f [0,4194304] 0 2024-04-01T06:57:33.419 INFO:tasks.workunit.client.0.smithi083.stdout:9/119: fsync d6/f13 0 2024-04-01T06:57:33.419 INFO:tasks.workunit.client.0.smithi083.stdout:0/114: symlink d16/d1d/l21 0 2024-04-01T06:57:33.423 INFO:tasks.workunit.client.0.smithi083.stdout:3/179: mknod d6/d15/d2d/c38 0 2024-04-01T06:57:33.424 INFO:tasks.workunit.client.0.smithi083.stdout:1/254: creat db/d1c/d29/d33/d47/f5a x:0 0 0 2024-04-01T06:57:33.425 INFO:tasks.workunit.client.0.smithi083.stdout:8/164: dwrite d15/d18/d19/d1d/f2d [4194304,4194304] 0 2024-04-01T06:57:33.425 INFO:tasks.workunit.client.0.smithi083.stdout:8/165: dread - d15/d18/d1e/f1f zero size 2024-04-01T06:57:33.426 INFO:tasks.workunit.client.0.smithi083.stdout:0/115: creat d16/f22 x:0 0 0 2024-04-01T06:57:33.426 INFO:tasks.workunit.client.0.smithi083.stdout:0/116: chown f2 724098703 1 2024-04-01T06:57:33.426 INFO:tasks.workunit.client.0.smithi083.stdout:0/117: read - d16/f1a zero size 2024-04-01T06:57:33.428 INFO:tasks.workunit.client.0.smithi083.stdout:5/125: symlink d4/l27 0 2024-04-01T06:57:33.430 INFO:tasks.workunit.client.0.smithi083.stdout:6/110: dwrite d9/dc/fe [4194304,4194304] 0 2024-04-01T06:57:33.431 INFO:tasks.workunit.client.0.smithi083.stdout:3/180: creat d6/d1e/f39 x:0 0 0 2024-04-01T06:57:33.431 INFO:tasks.workunit.client.0.smithi083.stdout:3/181: fdatasync d6/d1e/f23 0 2024-04-01T06:57:33.431 INFO:tasks.workunit.client.0.smithi083.stdout:3/182: chown d6/d1e/f39 703 1 2024-04-01T06:57:33.433 INFO:tasks.workunit.client.0.smithi083.stdout:5/126: mknod d4/d9/d10/d21/c28 0 2024-04-01T06:57:33.433 INFO:tasks.workunit.client.0.smithi083.stdout:5/127: fsync d4/ff 0 2024-04-01T06:57:33.433 INFO:tasks.workunit.client.0.smithi083.stdout:5/128: chown d4/d9/d10/d21/l1d 98674 1 2024-04-01T06:57:33.443 INFO:tasks.workunit.client.0.smithi083.stdout:9/120: dwrite d6/f7 [0,4194304] 0 2024-04-01T06:57:33.444 INFO:tasks.workunit.client.0.smithi083.stdout:3/183: unlink d6/d1e/c2a 0 2024-04-01T06:57:33.450 INFO:tasks.workunit.client.0.smithi083.stdout:9/121: rename l3 to d6/l23 0 2024-04-01T06:57:33.450 INFO:tasks.workunit.client.0.smithi083.stdout:9/122: fsync d6/f19 0 2024-04-01T06:57:33.452 INFO:tasks.workunit.client.0.smithi083.stdout:3/184: link d6/d15/f1a d6/d15/f3a 0 2024-04-01T06:57:33.452 INFO:tasks.workunit.client.0.smithi083.stdout:3/185: chown d6/d12/l16 3514169 1 2024-04-01T06:57:33.454 INFO:tasks.workunit.client.0.smithi083.stdout:9/123: mknod d6/c24 0 2024-04-01T06:57:33.454 INFO:tasks.workunit.client.0.smithi083.stdout:5/129: dwrite d4/d9/d10/f24 [0,4194304] 0 2024-04-01T06:57:33.457 INFO:tasks.workunit.client.0.smithi083.stdout:0/118: dwrite f6 [4194304,4194304] 0 2024-04-01T06:57:33.458 INFO:tasks.workunit.client.0.smithi083.stdout:0/119: write f10 [3445592,113613] 0 2024-04-01T06:57:33.459 INFO:tasks.workunit.client.0.smithi083.stdout:8/166: dwrite d15/d18/d19/d1d/f36 [0,4194304] 0 2024-04-01T06:57:33.459 INFO:tasks.workunit.client.0.smithi083.stdout:6/111: dwrite d9/f19 [0,4194304] 0 2024-04-01T06:57:33.459 INFO:tasks.workunit.client.0.smithi083.stdout:0/120: fdatasync fe 0 2024-04-01T06:57:33.459 INFO:tasks.workunit.client.0.smithi083.stdout:3/186: symlink d6/d15/d2d/l3b 0 2024-04-01T06:57:33.460 INFO:tasks.workunit.client.0.smithi083.stdout:9/124: creat d6/d15/f25 x:0 0 0 2024-04-01T06:57:33.460 INFO:tasks.workunit.client.0.smithi083.stdout:9/125: fsync d6/f19 0 2024-04-01T06:57:33.467 INFO:tasks.workunit.client.0.smithi083.stdout:6/112: creat d9/dc/f27 x:0 0 0 2024-04-01T06:57:33.468 INFO:tasks.workunit.client.0.smithi083.stdout:6/113: readlink d9/l12 0 2024-04-01T06:57:33.468 INFO:tasks.workunit.client.0.smithi083.stdout:3/187: dread d6/d15/f19 [4194304,4194304] 0 2024-04-01T06:57:33.470 INFO:tasks.workunit.client.0.smithi083.stdout:0/121: rename f2 to d16/d1d/f23 0 2024-04-01T06:57:33.472 INFO:tasks.workunit.client.0.smithi083.stdout:8/167: dwrite d15/d18/d19/f23 [0,4194304] 0 2024-04-01T06:57:33.472 INFO:tasks.workunit.client.0.smithi083.stdout:9/126: unlink d6/c24 0 2024-04-01T06:57:33.473 INFO:tasks.workunit.client.0.smithi083.stdout:6/114: link d9/dc/f23 d9/dc/d1b/f28 0 2024-04-01T06:57:33.475 INFO:tasks.workunit.client.0.smithi083.stdout:0/122: creat d16/d1d/f24 x:0 0 0 2024-04-01T06:57:33.475 INFO:tasks.workunit.client.0.smithi083.stdout:6/115: dread d9/f1a [0,4194304] 0 2024-04-01T06:57:33.476 INFO:tasks.workunit.client.0.smithi083.stdout:8/168: mkdir d15/d1b/d39 0 2024-04-01T06:57:33.477 INFO:tasks.workunit.client.0.smithi083.stdout:9/127: mkdir d6/d15/d26 0 2024-04-01T06:57:33.477 INFO:tasks.workunit.client.0.smithi083.stdout:3/188: mkdir d6/d3c 0 2024-04-01T06:57:33.478 INFO:tasks.workunit.client.0.smithi083.stdout:3/189: write d6/d12/f2e [625322,85524] 0 2024-04-01T06:57:33.479 INFO:tasks.workunit.client.0.smithi083.stdout:0/123: link fd d16/d1d/f25 0 2024-04-01T06:57:33.479 INFO:tasks.workunit.client.0.smithi083.stdout:0/124: write d16/f22 [870327,83440] 0 2024-04-01T06:57:33.480 INFO:tasks.workunit.client.0.smithi083.stdout:8/169: creat d15/d1b/d39/f3a x:0 0 0 2024-04-01T06:57:33.480 INFO:tasks.workunit.client.0.smithi083.stdout:8/170: write d15/f27 [711482,24504] 0 2024-04-01T06:57:33.481 INFO:tasks.workunit.client.0.smithi083.stdout:9/128: creat d6/f27 x:0 0 0 2024-04-01T06:57:33.481 INFO:tasks.workunit.client.0.smithi083.stdout:9/129: fsync d6/da/f1f 0 2024-04-01T06:57:33.482 INFO:tasks.workunit.client.0.smithi083.stdout:3/190: creat d6/d1e/f3d x:0 0 0 2024-04-01T06:57:33.484 INFO:tasks.workunit.client.0.smithi083.stdout:8/171: creat d15/d1b/f3b x:0 0 0 2024-04-01T06:57:33.486 INFO:tasks.workunit.client.0.smithi083.stdout:9/130: mknod d6/d15/d26/c28 0 2024-04-01T06:57:33.487 INFO:tasks.workunit.client.0.smithi083.stdout:3/191: mkdir d6/d15/d2d/d2f/d3e 0 2024-04-01T06:57:33.491 INFO:tasks.workunit.client.0.smithi083.stdout:3/192: mknod d6/d15/c3f 0 2024-04-01T06:57:33.491 INFO:tasks.workunit.client.0.smithi083.stdout:0/125: dread fd [0,4194304] 0 2024-04-01T06:57:33.493 INFO:tasks.workunit.client.0.smithi083.stdout:0/126: mknod d16/d1d/c26 0 2024-04-01T06:57:33.494 INFO:tasks.workunit.client.0.smithi083.stdout:0/127: symlink d16/d1d/l27 0 2024-04-01T06:57:33.496 INFO:tasks.workunit.client.0.smithi083.stdout:0/128: write f12 [1508548,118493] 0 2024-04-01T06:57:33.500 INFO:tasks.workunit.client.0.smithi083.stdout:6/116: dwrite d9/dc/f16 [0,4194304] 0 2024-04-01T06:57:33.501 INFO:tasks.workunit.client.0.smithi083.stdout:6/117: fdatasync d9/dc/d1b/f28 0 2024-04-01T06:57:33.506 INFO:tasks.workunit.client.0.smithi083.stdout:3/193: dread d6/d1e/f31 [0,4194304] 0 2024-04-01T06:57:33.507 INFO:tasks.workunit.client.0.smithi083.stdout:3/194: creat d6/f40 x:0 0 0 2024-04-01T06:57:33.508 INFO:tasks.workunit.client.0.smithi083.stdout:3/195: symlink d6/d3c/l41 0 2024-04-01T06:57:33.509 INFO:tasks.workunit.client.0.smithi083.stdout:9/131: dwrite d6/d15/f25 [0,4194304] 0 2024-04-01T06:57:33.510 INFO:tasks.workunit.client.0.smithi083.stdout:9/132: readlink d6/l23 0 2024-04-01T06:57:33.510 INFO:tasks.workunit.client.0.smithi083.stdout:9/133: truncate d6/d15/f17 4452926 0 2024-04-01T06:57:33.510 INFO:tasks.workunit.client.0.smithi083.stdout:9/134: dread - d6/f27 zero size 2024-04-01T06:57:33.510 INFO:tasks.workunit.client.0.smithi083.stdout:9/135: readlink d6/l16 0 2024-04-01T06:57:33.513 INFO:tasks.workunit.client.0.smithi083.stdout:9/136: mkdir d6/d29 0 2024-04-01T06:57:33.513 INFO:tasks.workunit.client.0.smithi083.stdout:6/118: dwrite d9/dc/d1b/f17 [0,4194304] 0 2024-04-01T06:57:33.514 INFO:tasks.workunit.client.0.smithi083.stdout:0/129: rmdir d16 39 2024-04-01T06:57:33.515 INFO:tasks.workunit.client.0.smithi083.stdout:9/137: link d6/c21 d6/d29/c2a 0 2024-04-01T06:57:33.516 INFO:tasks.workunit.client.0.smithi083.stdout:0/130: symlink d16/d1d/l28 0 2024-04-01T06:57:33.517 INFO:tasks.workunit.client.0.smithi083.stdout:9/138: creat d6/d15/f2b x:0 0 0 2024-04-01T06:57:33.517 INFO:tasks.workunit.client.0.smithi083.stdout:9/139: chown d6/f7 253193963 1 2024-04-01T06:57:33.517 INFO:tasks.workunit.client.0.smithi083.stdout:9/140: write d6/d15/f2b [249780,76707] 0 2024-04-01T06:57:33.518 INFO:tasks.workunit.client.0.smithi083.stdout:0/131: rename d16/f19 to d16/f29 0 2024-04-01T06:57:33.518 INFO:tasks.workunit.client.0.smithi083.stdout:0/132: truncate d16/f1a 989041 0 2024-04-01T06:57:33.518 INFO:tasks.workunit.client.0.smithi083.stdout:0/133: chown fd 7977 1 2024-04-01T06:57:33.519 INFO:tasks.workunit.client.0.smithi083.stdout:0/134: dread - f13 zero size 2024-04-01T06:57:33.521 INFO:tasks.workunit.client.0.smithi083.stdout:0/135: rename f13 to d16/d1d/f2a 0 2024-04-01T06:57:33.521 INFO:tasks.workunit.client.0.smithi083.stdout:6/119: dread d9/dc/f11 [0,4194304] 0 2024-04-01T06:57:33.522 INFO:tasks.workunit.client.0.smithi083.stdout:6/120: truncate f6 4180882 0 2024-04-01T06:57:33.524 INFO:tasks.workunit.client.0.smithi083.stdout:6/121: mkdir d9/dc/d29 0 2024-04-01T06:57:33.524 INFO:tasks.workunit.client.0.smithi083.stdout:6/122: chown d9/f1a 150 1 2024-04-01T06:57:33.524 INFO:tasks.workunit.client.0.smithi083.stdout:6/123: fdatasync d9/dc/d1b/f17 0 2024-04-01T06:57:33.524 INFO:tasks.workunit.client.0.smithi083.stdout:6/124: write d9/dc/d1b/f22 [830516,127921] 0 2024-04-01T06:57:33.524 INFO:tasks.workunit.client.0.smithi083.stdout:6/125: fdatasync d9/dc/f11 0 2024-04-01T06:57:33.524 INFO:tasks.workunit.client.0.smithi083.stdout:9/141: dread d6/d15/f17 [0,4194304] 0 2024-04-01T06:57:33.524 INFO:tasks.workunit.client.0.smithi083.stdout:9/142: truncate d6/da/f18 220680 0 2024-04-01T06:57:33.525 INFO:tasks.workunit.client.0.smithi083.stdout:3/196: dread d6/d15/f3a [0,4194304] 0 2024-04-01T06:57:33.525 INFO:tasks.workunit.client.0.smithi083.stdout:0/136: dread d16/f1b [0,4194304] 0 2024-04-01T06:57:33.525 INFO:tasks.workunit.client.0.smithi083.stdout:9/143: rename d6/l23 to d6/d15/d26/l2c 0 2024-04-01T06:57:33.526 INFO:tasks.workunit.client.0.smithi083.stdout:3/197: mkdir d6/d15/d2d/d2f/d42 0 2024-04-01T06:57:33.526 INFO:tasks.workunit.client.0.smithi083.stdout:3/198: chown d6/f28 105 1 2024-04-01T06:57:33.537 INFO:tasks.workunit.client.0.smithi083.stdout:0/137: unlink l5 0 2024-04-01T06:57:33.537 INFO:tasks.workunit.client.0.smithi083.stdout:6/126: write f2 [5099578,80945] 0 2024-04-01T06:57:33.539 INFO:tasks.workunit.client.0.smithi083.stdout:0/138: creat d16/d1d/f2b x:0 0 0 2024-04-01T06:57:33.550 INFO:tasks.workunit.client.0.smithi083.stdout:6/127: dwrite f2 [0,4194304] 0 2024-04-01T06:57:33.550 INFO:tasks.workunit.client.0.smithi083.stdout:6/128: dread - d9/dc/f27 zero size 2024-04-01T06:57:33.550 INFO:tasks.workunit.client.0.smithi083.stdout:6/129: chown d9/dc/d1b/c1c 6138 1 2024-04-01T06:57:33.550 INFO:tasks.workunit.client.0.smithi083.stdout:0/139: dread fd [4194304,4194304] 0 2024-04-01T06:57:33.552 INFO:tasks.workunit.client.0.smithi083.stdout:0/140: creat d16/f2c x:0 0 0 2024-04-01T06:57:33.552 INFO:tasks.workunit.client.0.smithi083.stdout:0/141: dread - d16/d1d/f2b zero size 2024-04-01T06:57:33.554 INFO:tasks.workunit.client.0.smithi083.stdout:9/144: rename d6/da to d6/d15/d26/d2d 0 2024-04-01T06:57:33.556 INFO:tasks.workunit.client.0.smithi083.stdout:0/142: dread f14 [0,4194304] 0 2024-04-01T06:57:33.556 INFO:tasks.workunit.client.0.smithi083.stdout:0/143: chown f12 7653903 1 2024-04-01T06:57:33.556 INFO:tasks.workunit.client.0.smithi083.stdout:3/199: rename d6/d12/f13 to d6/d1e/f43 0 2024-04-01T06:57:33.558 INFO:tasks.workunit.client.0.smithi083.stdout:9/145: creat d6/f2e x:0 0 0 2024-04-01T06:57:33.558 INFO:tasks.workunit.client.0.smithi083.stdout:9/146: getdents d6/d15/d26/d2d 0 2024-04-01T06:57:33.558 INFO:tasks.workunit.client.0.smithi083.stdout:3/200: truncate d6/fe 2042775 0 2024-04-01T06:57:33.559 INFO:tasks.workunit.client.0.smithi083.stdout:9/147: creat d6/f2f x:0 0 0 2024-04-01T06:57:33.561 INFO:tasks.workunit.client.0.smithi083.stdout:6/130: dwrite d9/dc/d1b/f1f [0,4194304] 0 2024-04-01T06:57:33.561 INFO:tasks.workunit.client.0.smithi083.stdout:3/201: mknod d6/d1e/c44 0 2024-04-01T06:57:33.561 INFO:tasks.workunit.client.0.smithi083.stdout:3/202: dread - d6/d12/f30 zero size 2024-04-01T06:57:33.562 INFO:tasks.workunit.client.0.smithi083.stdout:0/144: dread d16/d1d/f25 [4194304,4194304] 0 2024-04-01T06:57:33.562 INFO:tasks.workunit.client.0.smithi083.stdout:0/145: stat f14 0 2024-04-01T06:57:33.562 INFO:tasks.workunit.client.0.smithi083.stdout:3/203: read d6/f21 [609888,27330] 0 2024-04-01T06:57:33.562 INFO:tasks.workunit.client.0.smithi083.stdout:9/148: creat d6/d15/d26/d2d/f30 x:0 0 0 2024-04-01T06:57:33.564 INFO:tasks.workunit.client.0.smithi083.stdout:0/146: dread f14 [0,4194304] 0 2024-04-01T06:57:33.564 INFO:tasks.workunit.client.0.smithi083.stdout:0/147: chown d16/d1d/f20 38782007 1 2024-04-01T06:57:33.565 INFO:tasks.workunit.client.0.smithi083.stdout:3/204: creat d6/d15/d2d/d2f/d42/f45 x:0 0 0 2024-04-01T06:57:33.566 INFO:tasks.workunit.client.0.smithi083.stdout:0/148: write f12 [482098,57532] 0 2024-04-01T06:57:33.572 INFO:tasks.workunit.client.0.smithi083.stdout:0/149: truncate f10 1494835 0 2024-04-01T06:57:33.572 INFO:tasks.workunit.client.0.smithi083.stdout:6/131: dwrite d9/dc/d1b/f17 [4194304,4194304] 0 2024-04-01T06:57:33.575 INFO:tasks.workunit.client.0.smithi083.stdout:0/150: creat d16/f2d x:0 0 0 2024-04-01T06:57:33.575 INFO:tasks.workunit.client.0.smithi083.stdout:0/151: write d16/f18 [698110,77072] 0 2024-04-01T06:57:33.577 INFO:tasks.workunit.client.0.smithi083.stdout:6/132: link f8 d9/dc/d29/f2a 0 2024-04-01T06:57:33.578 INFO:tasks.workunit.client.0.smithi083.stdout:0/152: mkdir d16/d2e 0 2024-04-01T06:57:33.581 INFO:tasks.workunit.client.0.smithi083.stdout:6/133: unlink f2 0 2024-04-01T06:57:33.582 INFO:tasks.workunit.client.0.smithi083.stdout:0/153: creat d16/d2e/f2f x:0 0 0 2024-04-01T06:57:33.582 INFO:tasks.workunit.client.0.smithi083.stdout:3/205: dwrite d6/f40 [0,4194304] 0 2024-04-01T06:57:33.582 INFO:tasks.workunit.client.0.smithi083.stdout:6/134: readlink l3 0 2024-04-01T06:57:33.583 INFO:tasks.workunit.client.0.smithi083.stdout:6/135: read d9/dc/d29/f2a [2166057,36498] 0 2024-04-01T06:57:33.584 INFO:tasks.workunit.client.0.smithi083.stdout:6/136: write d9/dc/f16 [4763528,64429] 0 2024-04-01T06:57:33.585 INFO:tasks.workunit.client.0.smithi083.stdout:0/154: symlink d16/l30 0 2024-04-01T06:57:33.585 INFO:tasks.workunit.client.0.smithi083.stdout:0/155: chown d16 0 1 2024-04-01T06:57:33.586 INFO:tasks.workunit.client.0.smithi083.stdout:4/106: sync 2024-04-01T06:57:33.586 INFO:tasks.workunit.client.0.smithi083.stdout:4/107: fdatasync d1/d4/db/f18 0 2024-04-01T06:57:33.590 INFO:tasks.workunit.client.0.smithi083.stdout:3/206: mkdir d6/d15/d2d/d2f/d42/d46 0 2024-04-01T06:57:33.590 INFO:tasks.workunit.client.0.smithi083.stdout:3/207: read - d6/d12/f34 zero size 2024-04-01T06:57:33.590 INFO:tasks.workunit.client.0.smithi083.stdout:3/208: chown d6/d1e/c1f 162769 1 2024-04-01T06:57:33.590 INFO:tasks.workunit.client.0.smithi083.stdout:3/209: chown d6/d12/c27 358249 1 2024-04-01T06:57:33.591 INFO:tasks.workunit.client.0.smithi083.stdout:6/137: mknod d9/dc/d29/c2b 0 2024-04-01T06:57:33.591 INFO:tasks.workunit.client.0.smithi083.stdout:0/156: mknod d16/c31 0 2024-04-01T06:57:33.592 INFO:tasks.workunit.client.0.smithi083.stdout:4/108: creat d1/d4/f25 x:0 0 0 2024-04-01T06:57:33.598 INFO:tasks.workunit.client.0.smithi083.stdout:6/138: chown d9/dc/f16 4 1 2024-04-01T06:57:33.600 INFO:tasks.workunit.client.0.smithi083.stdout:0/157: dread d16/d1d/f25 [0,4194304] 0 2024-04-01T06:57:33.600 INFO:tasks.workunit.client.0.smithi083.stdout:6/139: dread d9/f1a [0,4194304] 0 2024-04-01T06:57:33.601 INFO:tasks.workunit.client.0.smithi083.stdout:3/210: dwrite d6/f9 [0,4194304] 0 2024-04-01T06:57:33.604 INFO:tasks.workunit.client.0.smithi083.stdout:6/140: mknod d9/c2c 0 2024-04-01T06:57:33.604 INFO:tasks.workunit.client.0.smithi083.stdout:6/141: fdatasync d9/dc/f25 0 2024-04-01T06:57:33.604 INFO:tasks.workunit.client.0.smithi083.stdout:6/142: write d9/dc/d1b/f28 [218928,110273] 0 2024-04-01T06:57:33.606 INFO:tasks.workunit.client.0.smithi083.stdout:3/211: creat d6/d12/f47 x:0 0 0 2024-04-01T06:57:33.608 INFO:tasks.workunit.client.0.smithi083.stdout:3/212: unlink d6/d12/f34 0 2024-04-01T06:57:33.613 INFO:tasks.workunit.client.0.smithi083.stdout:0/158: dwrite f7 [4194304,4194304] 0 2024-04-01T06:57:33.613 INFO:tasks.workunit.client.0.smithi083.stdout:0/159: write d16/f22 [1389486,50150] 0 2024-04-01T06:57:33.615 INFO:tasks.workunit.client.0.smithi083.stdout:0/160: creat d16/d2e/f32 x:0 0 0 2024-04-01T06:57:33.615 INFO:tasks.workunit.client.0.smithi083.stdout:0/161: truncate d16/f2c 952524 0 2024-04-01T06:57:33.616 INFO:tasks.workunit.client.0.smithi083.stdout:0/162: mkdir d16/d1d/d33 0 2024-04-01T06:57:33.617 INFO:tasks.workunit.client.0.smithi083.stdout:0/163: write f14 [729227,37534] 0 2024-04-01T06:57:33.621 INFO:tasks.workunit.client.0.smithi083.stdout:0/164: rename d16/f18 to d16/f34 0 2024-04-01T06:57:33.621 INFO:tasks.workunit.client.0.smithi083.stdout:0/165: write d16/d1d/f20 [130981,89514] 0 2024-04-01T06:57:33.621 INFO:tasks.workunit.client.0.smithi083.stdout:0/166: write d16/d2e/f32 [1047297,8789] 0 2024-04-01T06:57:33.622 INFO:tasks.workunit.client.0.smithi083.stdout:0/167: unlink d16/d2e/f32 0 2024-04-01T06:57:33.623 INFO:tasks.workunit.client.0.smithi083.stdout:0/168: dread d16/f2c [0,4194304] 0 2024-04-01T06:57:33.623 INFO:tasks.workunit.client.0.smithi083.stdout:0/169: chown fe 2 1 2024-04-01T06:57:33.623 INFO:tasks.workunit.client.0.smithi083.stdout:0/170: chown d16/f34 32 1 2024-04-01T06:57:33.624 INFO:tasks.workunit.client.0.smithi083.stdout:0/171: dread d16/f2c [0,4194304] 0 2024-04-01T06:57:33.625 INFO:tasks.workunit.client.0.smithi083.stdout:0/172: rename d16/l1f to d16/d1d/l35 0 2024-04-01T06:57:33.638 INFO:tasks.workunit.client.0.smithi083.stdout:0/173: dwrite f12 [0,4194304] 0 2024-04-01T06:57:33.651 INFO:tasks.workunit.client.0.smithi083.stdout:7/117: sync 2024-04-01T06:57:33.651 INFO:tasks.workunit.client.0.smithi083.stdout:2/191: sync 2024-04-01T06:57:33.651 INFO:tasks.workunit.client.0.smithi083.stdout:7/118: fdatasync d0/f3 0 2024-04-01T06:57:33.651 INFO:tasks.workunit.client.0.smithi083.stdout:7/119: readlink d0/d4/l1f 0 2024-04-01T06:57:33.652 INFO:tasks.workunit.client.0.smithi083.stdout:2/192: truncate d3/d26/f28 864253 0 2024-04-01T06:57:33.653 INFO:tasks.workunit.client.0.smithi083.stdout:2/193: creat d3/f43 x:0 0 0 2024-04-01T06:57:33.656 INFO:tasks.workunit.client.0.smithi083.stdout:2/194: mknod d3/d20/c44 0 2024-04-01T06:57:33.659 INFO:tasks.workunit.client.0.smithi083.stdout:7/120: dread d0/d4/f5 [0,4194304] 0 2024-04-01T06:57:33.659 INFO:tasks.workunit.client.0.smithi083.stdout:7/121: write d0/d10/f20 [872061,26227] 0 2024-04-01T06:57:33.661 INFO:tasks.workunit.client.0.smithi083.stdout:7/122: creat d0/d10/f21 x:0 0 0 2024-04-01T06:57:33.672 INFO:tasks.workunit.client.0.smithi083.stdout:2/195: dwrite d3/d20/f3f [0,4194304] 0 2024-04-01T06:57:33.680 INFO:tasks.workunit.client.0.smithi083.stdout:7/123: dwrite d0/d4/fc [0,4194304] 0 2024-04-01T06:57:33.686 INFO:tasks.workunit.client.0.smithi083.stdout:2/196: dwrite d3/d1f/d2b/f39 [0,4194304] 0 2024-04-01T06:57:33.686 INFO:tasks.workunit.client.0.smithi083.stdout:2/197: dread - d3/d20/f2a zero size 2024-04-01T06:57:33.686 INFO:tasks.workunit.client.0.smithi083.stdout:2/198: stat f1 0 2024-04-01T06:57:33.689 INFO:tasks.workunit.client.0.smithi083.stdout:2/199: unlink d3/d1f/f41 0 2024-04-01T06:57:33.690 INFO:tasks.workunit.client.0.smithi083.stdout:2/200: unlink d3/d26/l29 0 2024-04-01T06:57:33.692 INFO:tasks.workunit.client.0.smithi083.stdout:2/201: symlink d3/d26/l45 0 2024-04-01T06:57:33.693 INFO:tasks.workunit.client.0.smithi083.stdout:2/202: mknod d3/d20/d42/c46 0 2024-04-01T06:57:33.694 INFO:tasks.workunit.client.0.smithi083.stdout:7/124: dwrite d0/d4/d9/f1c [0,4194304] 0 2024-04-01T06:57:33.697 INFO:tasks.workunit.client.0.smithi083.stdout:7/125: creat d0/d4/d9/f22 x:0 0 0 2024-04-01T06:57:33.697 INFO:tasks.workunit.client.0.smithi083.stdout:7/126: fdatasync d0/d10/f21 0 2024-04-01T06:57:33.699 INFO:tasks.workunit.client.0.smithi083.stdout:7/127: rename d0/d4/f5 to d0/f23 0 2024-04-01T06:57:33.710 INFO:tasks.workunit.client.0.smithi083.stdout:2/203: dwrite d3/d1f/d27/f3b [0,4194304] 0 2024-04-01T06:57:33.713 INFO:tasks.workunit.client.0.smithi083.stdout:7/128: dwrite d0/d10/f20 [0,4194304] 0 2024-04-01T06:57:33.717 INFO:tasks.workunit.client.0.smithi083.stdout:2/204: rename d3/c9 to d3/d26/c47 0 2024-04-01T06:57:33.717 INFO:tasks.workunit.client.0.smithi083.stdout:2/205: chown d3/d1f/f31 258655661 1 2024-04-01T06:57:33.718 INFO:tasks.workunit.client.0.smithi083.stdout:7/129: mknod d0/d10/c24 0 2024-04-01T06:57:33.719 INFO:tasks.workunit.client.0.smithi083.stdout:7/130: creat d0/d4/d9/f25 x:0 0 0 2024-04-01T06:57:33.730 INFO:tasks.workunit.client.0.smithi083.stdout:7/131: rmdir d0/d4 39 2024-04-01T06:57:33.730 INFO:tasks.workunit.client.0.smithi083.stdout:7/132: readlink d0/d10/l1d 0 2024-04-01T06:57:33.731 INFO:tasks.workunit.client.0.smithi083.stdout:2/206: dwrite d3/d26/f36 [0,4194304] 0 2024-04-01T06:57:33.732 INFO:tasks.workunit.client.0.smithi083.stdout:2/207: read d3/f19 [2986121,30785] 0 2024-04-01T06:57:33.732 INFO:tasks.workunit.client.0.smithi083.stdout:7/133: rename d0/d4/l1f to d0/l26 0 2024-04-01T06:57:33.733 INFO:tasks.workunit.client.0.smithi083.stdout:7/134: chown d0/d10 29860880 1 2024-04-01T06:57:33.734 INFO:tasks.workunit.client.0.smithi083.stdout:2/208: dread d3/d1f/d2b/f32 [0,4194304] 0 2024-04-01T06:57:33.738 INFO:tasks.workunit.client.0.smithi083.stdout:2/209: symlink d3/d1f/d2b/l48 0 2024-04-01T06:57:33.751 INFO:tasks.workunit.client.0.smithi083.stdout:7/135: dwrite d0/d4/f16 [0,4194304] 0 2024-04-01T06:57:33.754 INFO:tasks.workunit.client.0.smithi083.stdout:7/136: unlink d0/d10/c24 0 2024-04-01T06:57:33.785 INFO:tasks.workunit.client.0.smithi083.stdout:7/137: dwrite d0/d4/ff [0,4194304] 0 2024-04-01T06:57:33.788 INFO:tasks.workunit.client.0.smithi083.stdout:7/138: rename d0/f23 to d0/d10/f27 0 2024-04-01T06:57:33.788 INFO:tasks.workunit.client.0.smithi083.stdout:7/139: truncate d0/d4/f1e 4858543 0 2024-04-01T06:57:33.788 INFO:tasks.workunit.client.0.smithi083.stdout:7/140: truncate d0/d4/d9/f22 1015143 0 2024-04-01T06:57:33.844 INFO:tasks.workunit.client.0.smithi083.stdout:5/130: sync 2024-04-01T06:57:33.845 INFO:tasks.workunit.client.0.smithi083.stdout:8/172: sync 2024-04-01T06:57:33.845 INFO:tasks.workunit.client.0.smithi083.stdout:1/255: sync 2024-04-01T06:57:33.845 INFO:tasks.workunit.client.0.smithi083.stdout:1/256: chown db/d1c/d2e/d30/l37 11221000 1 2024-04-01T06:57:33.846 INFO:tasks.workunit.client.0.smithi083.stdout:8/173: creat d15/f3c x:0 0 0 2024-04-01T06:57:33.846 INFO:tasks.workunit.client.0.smithi083.stdout:8/174: readlink l6 0 2024-04-01T06:57:33.847 INFO:tasks.workunit.client.0.smithi083.stdout:1/257: symlink db/d1c/d49/l5b 0 2024-04-01T06:57:33.848 INFO:tasks.workunit.client.0.smithi083.stdout:8/175: truncate d15/d18/d19/f1a 1957250 0 2024-04-01T06:57:33.849 INFO:tasks.workunit.client.0.smithi083.stdout:1/258: mkdir db/d1c/d29/d33/d50/d5c 0 2024-04-01T06:57:33.850 INFO:tasks.workunit.client.0.smithi083.stdout:8/176: creat d15/d21/f3d x:0 0 0 2024-04-01T06:57:33.851 INFO:tasks.workunit.client.0.smithi083.stdout:8/177: mknod d15/d18/d1e/c3e 0 2024-04-01T06:57:33.856 INFO:tasks.workunit.client.0.smithi083.stdout:1/259: dread db/d1c/f25 [0,4194304] 0 2024-04-01T06:57:33.858 INFO:tasks.workunit.client.0.smithi083.stdout:1/260: mkdir db/d1c/d29/d33/d50/d5d 0 2024-04-01T06:57:33.860 INFO:tasks.workunit.client.0.smithi083.stdout:1/261: mknod db/d1c/d29/d33/d50/d4d/c5e 0 2024-04-01T06:57:33.863 INFO:tasks.workunit.client.0.smithi083.stdout:1/262: unlink db/d1c/d29/d33/d50/f53 0 2024-04-01T06:57:33.870 INFO:tasks.workunit.client.0.smithi083.stdout:8/178: dwrite d15/f33 [0,4194304] 0 2024-04-01T06:57:33.871 INFO:tasks.workunit.client.0.smithi083.stdout:8/179: symlink d15/d18/d1e/l3f 0 2024-04-01T06:57:33.873 INFO:tasks.workunit.client.0.smithi083.stdout:8/180: mknod d15/d18/d19/d1d/c40 0 2024-04-01T06:57:33.888 INFO:tasks.workunit.client.0.smithi083.stdout:8/181: dwrite d15/d18/d19/d1d/f36 [0,4194304] 0 2024-04-01T06:57:33.888 INFO:tasks.workunit.client.0.smithi083.stdout:8/182: stat f7 0 2024-04-01T06:57:33.901 INFO:tasks.workunit.client.0.smithi083.stdout:8/183: dwrite f7 [0,4194304] 0 2024-04-01T06:57:33.906 INFO:tasks.workunit.client.0.smithi083.stdout:6/143: sync 2024-04-01T06:57:33.907 INFO:tasks.workunit.client.0.smithi083.stdout:4/109: sync 2024-04-01T06:57:33.907 INFO:tasks.workunit.client.0.smithi083.stdout:9/149: sync 2024-04-01T06:57:33.907 INFO:tasks.workunit.client.0.smithi083.stdout:4/110: readlink d1/d4/l22 0 2024-04-01T06:57:33.907 INFO:tasks.workunit.client.0.smithi083.stdout:4/111: readlink d1/d4/l22 0 2024-04-01T06:57:33.907 INFO:tasks.workunit.client.0.smithi083.stdout:4/112: chown d1/d4/c1b 4172799 1 2024-04-01T06:57:33.907 INFO:tasks.workunit.client.0.smithi083.stdout:4/113: fdatasync d1/f2 0 2024-04-01T06:57:33.907 INFO:tasks.workunit.client.0.smithi083.stdout:8/184: creat d15/d18/d19/d24/d38/f41 x:0 0 0 2024-04-01T06:57:33.908 INFO:tasks.workunit.client.0.smithi083.stdout:8/185: dread - d15/d18/d19/f30 zero size 2024-04-01T06:57:33.909 INFO:tasks.workunit.client.0.smithi083.stdout:8/186: write d15/d21/f22 [3624819,13169] 0 2024-04-01T06:57:33.909 INFO:tasks.workunit.client.0.smithi083.stdout:9/150: mknod d6/d29/c31 0 2024-04-01T06:57:33.909 INFO:tasks.workunit.client.0.smithi083.stdout:9/151: chown d6/f27 5 1 2024-04-01T06:57:33.912 INFO:tasks.workunit.client.0.smithi083.stdout:8/187: rename d15/d1b/l2f to d15/d18/l42 0 2024-04-01T06:57:33.921 INFO:tasks.workunit.client.0.smithi083.stdout:9/152: rename d6/d15 to d6/d32 0 2024-04-01T06:57:33.922 INFO:tasks.workunit.client.0.smithi083.stdout:4/114: dwrite d1/d4/db/f20 [0,4194304] 0 2024-04-01T06:57:33.932 INFO:tasks.workunit.client.0.smithi083.stdout:8/188: dwrite d15/f33 [0,4194304] 0 2024-04-01T06:57:33.933 INFO:tasks.workunit.client.0.smithi083.stdout:8/189: symlink d15/d21/l43 0 2024-04-01T06:57:33.935 INFO:tasks.workunit.client.0.smithi083.stdout:8/190: mkdir d15/d18/d19/d24/d44 0 2024-04-01T06:57:33.937 INFO:tasks.workunit.client.0.smithi083.stdout:8/191: rename f4 to d15/f45 0 2024-04-01T06:57:33.937 INFO:tasks.workunit.client.0.smithi083.stdout:8/192: rename d15 to d15/d18/d1e/d46 22 2024-04-01T06:57:33.937 INFO:tasks.workunit.client.0.smithi083.stdout:9/153: dwrite d6/d32/d26/d2d/f18 [0,4194304] 0 2024-04-01T06:57:33.943 INFO:tasks.workunit.client.0.smithi083.stdout:9/154: symlink d6/d29/l33 0 2024-04-01T06:57:33.943 INFO:tasks.workunit.client.0.smithi083.stdout:9/155: fdatasync d6/d32/f17 0 2024-04-01T06:57:33.943 INFO:tasks.workunit.client.0.smithi083.stdout:9/156: fsync d6/d32/f1b 0 2024-04-01T06:57:33.952 INFO:tasks.workunit.client.0.smithi083.stdout:8/193: dwrite d15/f33 [4194304,4194304] 0 2024-04-01T06:57:33.954 INFO:tasks.workunit.client.0.smithi083.stdout:8/194: creat d15/d18/d19/d24/d38/f47 x:0 0 0 2024-04-01T06:57:33.954 INFO:tasks.workunit.client.0.smithi083.stdout:8/195: write d15/d18/d1e/f1f [684539,55271] 0 2024-04-01T06:57:33.955 INFO:tasks.workunit.client.0.smithi083.stdout:8/196: mkdir d15/d1b/d39/d48 0 2024-04-01T06:57:33.956 INFO:tasks.workunit.client.0.smithi083.stdout:8/197: write d15/d18/d19/f1a [1299787,37925] 0 2024-04-01T06:57:33.957 INFO:tasks.workunit.client.0.smithi083.stdout:8/198: stat f7 0 2024-04-01T06:57:33.957 INFO:tasks.workunit.client.0.smithi083.stdout:8/199: readlink d15/d18/d19/l20 0 2024-04-01T06:57:33.957 INFO:tasks.workunit.client.0.smithi083.stdout:8/200: creat d15/d18/d1e/f49 x:0 0 0 2024-04-01T06:57:33.959 INFO:tasks.workunit.client.0.smithi083.stdout:8/201: creat d15/d18/d19/d1d/d2b/f4a x:0 0 0 2024-04-01T06:57:33.960 INFO:tasks.workunit.client.0.smithi083.stdout:9/157: dwrite d6/f7 [4194304,4194304] 0 2024-04-01T06:57:33.960 INFO:tasks.workunit.client.0.smithi083.stdout:8/202: creat d15/d18/d19/d24/f4b x:0 0 0 2024-04-01T06:57:33.962 INFO:tasks.workunit.client.0.smithi083.stdout:8/203: write d15/f45 [7563094,82495] 0 2024-04-01T06:57:33.962 INFO:tasks.workunit.client.0.smithi083.stdout:8/204: dread - d15/d18/d1e/f49 zero size 2024-04-01T06:57:33.963 INFO:tasks.workunit.client.0.smithi083.stdout:9/158: mkdir d6/d32/d26/d2d/d34 0 2024-04-01T06:57:33.978 INFO:tasks.workunit.client.0.smithi083.stdout:8/205: dwrite d15/f35 [0,4194304] 0 2024-04-01T06:57:33.983 INFO:tasks.workunit.client.0.smithi083.stdout:9/159: dwrite d6/d32/d26/d2d/f18 [0,4194304] 0 2024-04-01T06:57:33.993 INFO:tasks.workunit.client.0.smithi083.stdout:8/206: rename d15/d1b/f3b to d15/d18/d19/d1d/d2b/f4c 0 2024-04-01T06:57:33.993 INFO:tasks.workunit.client.0.smithi083.stdout:8/207: chown d15/d21/f22 162 1 2024-04-01T06:57:33.996 INFO:tasks.workunit.client.0.smithi083.stdout:9/160: link d6/c21 d6/d32/c35 0 2024-04-01T06:57:34.001 INFO:tasks.workunit.client.0.smithi083.stdout:8/208: unlink d15/d18/d1e/l3f 0 2024-04-01T06:57:34.002 INFO:tasks.workunit.client.0.smithi083.stdout:9/161: creat d6/d32/f36 x:0 0 0 2024-04-01T06:57:34.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:33 smithi145 ceph-mon[47816]: scrub summary: active paths [/] 2024-04-01T06:57:34.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:33 smithi145 ceph-mon[47816]: scrub summary: active paths [/] 2024-04-01T06:57:34.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:33 smithi145 ceph-mon[47816]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:34.004 INFO:tasks.workunit.client.0.smithi083.stdout:8/209: symlink d15/d18/d19/d24/l4d 0 2024-04-01T06:57:34.011 INFO:tasks.workunit.client.0.smithi083.stdout:8/210: dread d15/f33 [4194304,4194304] 0 2024-04-01T06:57:34.012 INFO:tasks.workunit.client.0.smithi083.stdout:8/211: chown c11 853793 1 2024-04-01T06:57:34.012 INFO:tasks.workunit.client.0.smithi083.stdout:8/212: fsync d15/d1b/f29 0 2024-04-01T06:57:34.012 INFO:tasks.workunit.client.0.smithi083.stdout:8/213: truncate d15/d18/d19/f1a 2368525 0 2024-04-01T06:57:34.012 INFO:tasks.workunit.client.0.smithi083.stdout:8/214: dread - d15/d18/d19/d1d/d2b/f2e zero size 2024-04-01T06:57:34.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:33 smithi083 ceph-mon[43429]: scrub summary: active paths [/] 2024-04-01T06:57:34.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:33 smithi083 ceph-mon[43429]: scrub summary: active paths [/] 2024-04-01T06:57:34.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:33 smithi083 ceph-mon[43429]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:34.013 INFO:tasks.workunit.client.0.smithi083.stdout:8/215: symlink d15/d1b/d39/d48/l4e 0 2024-04-01T06:57:34.014 INFO:tasks.workunit.client.0.smithi083.stdout:8/216: mknod d15/d18/d19/d24/d38/c4f 0 2024-04-01T06:57:34.015 INFO:tasks.workunit.client.0.smithi083.stdout:8/217: read d15/f33 [4282974,47920] 0 2024-04-01T06:57:34.016 INFO:tasks.workunit.client.0.smithi083.stdout:8/218: creat d15/d21/f50 x:0 0 0 2024-04-01T06:57:34.016 INFO:tasks.workunit.client.0.smithi083.stdout:8/219: fdatasync d15/d18/d19/d1d/f2d 0 2024-04-01T06:57:34.017 INFO:tasks.workunit.client.0.smithi083.stdout:8/220: creat d15/d21/f51 x:0 0 0 2024-04-01T06:57:34.022 INFO:tasks.workunit.client.0.smithi083.stdout:9/162: dwrite d6/d32/f17 [0,4194304] 0 2024-04-01T06:57:34.022 INFO:tasks.workunit.client.0.smithi083.stdout:9/163: chown d6/d32/d26/d2d/c1c 1048757612 1 2024-04-01T06:57:34.022 INFO:tasks.workunit.client.0.smithi083.stdout:9/164: fdatasync d6/f19 0 2024-04-01T06:57:34.034 INFO:tasks.workunit.client.0.smithi083.stdout:9/165: dwrite d6/d32/f36 [0,4194304] 0 2024-04-01T06:57:34.034 INFO:tasks.workunit.client.0.smithi083.stdout:9/166: chown d6/d32/f1a 682 1 2024-04-01T06:57:34.046 INFO:tasks.workunit.client.0.smithi083.stdout:8/221: dwrite d15/d21/f51 [0,4194304] 0 2024-04-01T06:57:34.048 INFO:tasks.workunit.client.0.smithi083.stdout:9/167: dwrite d6/f7 [4194304,4194304] 0 2024-04-01T06:57:34.049 INFO:tasks.workunit.client.0.smithi083.stdout:8/222: symlink d15/d21/l52 0 2024-04-01T06:57:34.049 INFO:tasks.workunit.client.0.smithi083.stdout:8/223: write d15/d18/f31 [702929,56147] 0 2024-04-01T06:57:34.049 INFO:tasks.workunit.client.0.smithi083.stdout:8/224: dread - d15/d1b/d39/f3a zero size 2024-04-01T06:57:34.050 INFO:tasks.workunit.client.0.smithi083.stdout:9/168: symlink d6/d32/d26/d2d/d34/l37 0 2024-04-01T06:57:34.051 INFO:tasks.workunit.client.0.smithi083.stdout:8/225: symlink d15/d18/d19/d1d/d2b/l53 0 2024-04-01T06:57:34.053 INFO:tasks.workunit.client.0.smithi083.stdout:9/169: unlink d6/d32/d26/d2d/c12 0 2024-04-01T06:57:34.055 INFO:tasks.workunit.client.0.smithi083.stdout:9/170: symlink d6/d32/d26/d2d/d34/l38 0 2024-04-01T06:57:34.055 INFO:tasks.workunit.client.0.smithi083.stdout:9/171: fdatasync d6/f7 0 2024-04-01T06:57:34.063 INFO:tasks.workunit.client.0.smithi083.stdout:9/172: dread d6/d32/f1a [0,4194304] 0 2024-04-01T06:57:34.064 INFO:tasks.workunit.client.0.smithi083.stdout:9/173: symlink d6/d32/d26/d2d/d34/l39 0 2024-04-01T06:57:34.065 INFO:tasks.workunit.client.0.smithi083.stdout:8/226: dwrite f7 [0,4194304] 0 2024-04-01T06:57:34.069 INFO:tasks.workunit.client.0.smithi083.stdout:8/227: creat d15/d18/d19/d1d/f54 x:0 0 0 2024-04-01T06:57:34.069 INFO:tasks.workunit.client.0.smithi083.stdout:8/228: read - d15/d18/d19/d24/d38/f47 zero size 2024-04-01T06:57:34.070 INFO:tasks.workunit.client.0.smithi083.stdout:8/229: mknod d15/d18/d19/d1d/c55 0 2024-04-01T06:57:34.070 INFO:tasks.workunit.client.0.smithi083.stdout:8/230: chown d15/d1b/d39/d48/l4e 11204 1 2024-04-01T06:57:34.072 INFO:tasks.workunit.client.0.smithi083.stdout:8/231: creat d15/d1b/d39/d48/f56 x:0 0 0 2024-04-01T06:57:34.074 INFO:tasks.workunit.client.0.smithi083.stdout:8/232: symlink d15/d1b/d39/d48/l57 0 2024-04-01T06:57:34.075 INFO:tasks.workunit.client.0.smithi083.stdout:8/233: rename d15/d21/f3d to d15/d1b/d39/d48/f58 0 2024-04-01T06:57:34.078 INFO:tasks.workunit.client.0.smithi083.stdout:8/234: rename d15/f45 to d15/d1b/d39/d48/f59 0 2024-04-01T06:57:34.078 INFO:tasks.workunit.client.0.smithi083.stdout:8/235: write d15/d1b/d39/d48/f56 [894971,48093] 0 2024-04-01T06:57:34.079 INFO:tasks.workunit.client.0.smithi083.stdout:9/174: dwrite d6/f13 [0,4194304] 0 2024-04-01T06:57:34.079 INFO:tasks.workunit.client.0.smithi083.stdout:9/175: truncate d6/d32/d26/d2d/f18 4698230 0 2024-04-01T06:57:34.080 INFO:tasks.workunit.client.0.smithi083.stdout:8/236: symlink d15/d1b/d39/d48/l5a 0 2024-04-01T06:57:34.080 INFO:tasks.workunit.client.0.smithi083.stdout:8/237: chown d15/d18/d19/f30 52034 1 2024-04-01T06:57:34.081 INFO:tasks.workunit.client.0.smithi083.stdout:9/176: symlink d6/d32/d26/d2d/d34/l3a 0 2024-04-01T06:57:34.083 INFO:tasks.workunit.client.0.smithi083.stdout:8/238: link d15/f27 d15/d18/d1e/f5b 0 2024-04-01T06:57:34.083 INFO:tasks.workunit.client.0.smithi083.stdout:8/239: dread - d15/d18/d1e/f49 zero size 2024-04-01T06:57:34.084 INFO:tasks.workunit.client.0.smithi083.stdout:9/177: creat d6/d32/d26/d2d/d34/f3b x:0 0 0 2024-04-01T06:57:34.084 INFO:tasks.workunit.client.0.smithi083.stdout:9/178: fdatasync d6/d32/d26/d2d/f18 0 2024-04-01T06:57:34.084 INFO:tasks.workunit.client.0.smithi083.stdout:9/179: write d6/d32/d26/d2d/f18 [4813695,116236] 0 2024-04-01T06:57:34.085 INFO:tasks.workunit.client.0.smithi083.stdout:8/240: dread d15/d18/d1e/f1f [0,4194304] 0 2024-04-01T06:57:34.087 INFO:tasks.workunit.client.0.smithi083.stdout:8/241: rename d15/d1b/d39/f3a to d15/f5c 0 2024-04-01T06:57:34.101 INFO:tasks.workunit.client.0.smithi083.stdout:9/180: dwrite d6/f7 [4194304,4194304] 0 2024-04-01T06:57:34.107 INFO:tasks.workunit.client.0.smithi083.stdout:8/242: dwrite d15/d18/d19/d24/f4b [0,4194304] 0 2024-04-01T06:57:34.115 INFO:tasks.workunit.client.0.smithi083.stdout:9/181: dwrite d6/f19 [0,4194304] 0 2024-04-01T06:57:34.115 INFO:tasks.workunit.client.0.smithi083.stdout:9/182: fdatasync d6/f2e 0 2024-04-01T06:57:34.118 INFO:tasks.workunit.client.0.smithi083.stdout:9/183: write d6/d32/d26/d2d/f18 [3703310,66323] 0 2024-04-01T06:57:34.119 INFO:tasks.workunit.client.0.smithi083.stdout:9/184: unlink d6/f2e 0 2024-04-01T06:57:34.126 INFO:tasks.workunit.client.0.smithi083.stdout:9/185: dread d6/f14 [0,4194304] 0 2024-04-01T06:57:34.126 INFO:tasks.workunit.client.0.smithi083.stdout:8/243: dwrite d15/d18/d1e/f5b [0,4194304] 0 2024-04-01T06:57:34.130 INFO:tasks.workunit.client.0.smithi083.stdout:9/186: mkdir d6/d32/d3c 0 2024-04-01T06:57:34.131 INFO:tasks.workunit.client.0.smithi083.stdout:8/244: stat cd 0 2024-04-01T06:57:34.132 INFO:tasks.workunit.client.0.smithi083.stdout:9/187: write d6/d32/d26/d2d/d34/f3b [394388,51576] 0 2024-04-01T06:57:34.133 INFO:tasks.workunit.client.0.smithi083.stdout:8/245: link f14 d15/d18/d19/f5d 0 2024-04-01T06:57:34.136 INFO:tasks.workunit.client.0.smithi083.stdout:0/174: sync 2024-04-01T06:57:34.136 INFO:tasks.workunit.client.0.smithi083.stdout:3/213: sync 2024-04-01T06:57:34.136 INFO:tasks.workunit.client.0.smithi083.stdout:2/210: sync 2024-04-01T06:57:34.136 INFO:tasks.workunit.client.0.smithi083.stdout:0/175: read - d16/d1d/f2a zero size 2024-04-01T06:57:34.137 INFO:tasks.workunit.client.0.smithi083.stdout:2/211: link f2 d3/d1f/d2b/f49 0 2024-04-01T06:57:34.138 INFO:tasks.workunit.client.0.smithi083.stdout:3/214: mknod d6/d15/d2d/d2f/d3e/c48 0 2024-04-01T06:57:34.138 INFO:tasks.workunit.client.0.smithi083.stdout:0/176: creat d16/d2e/f36 x:0 0 0 2024-04-01T06:57:34.138 INFO:tasks.workunit.client.0.smithi083.stdout:0/177: truncate f14 1597704 0 2024-04-01T06:57:34.140 INFO:tasks.workunit.client.0.smithi083.stdout:2/212: creat d3/d1f/d2b/f4a x:0 0 0 2024-04-01T06:57:34.140 INFO:tasks.workunit.client.0.smithi083.stdout:2/213: chown f2 2463865 1 2024-04-01T06:57:34.140 INFO:tasks.workunit.client.0.smithi083.stdout:2/214: dread - d3/d20/f2a zero size 2024-04-01T06:57:34.140 INFO:tasks.workunit.client.0.smithi083.stdout:2/215: truncate d3/d1f/f31 1271184 0 2024-04-01T06:57:34.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:33 smithi153 ceph-mon[48187]: scrub summary: active paths [/] 2024-04-01T06:57:34.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:33 smithi153 ceph-mon[48187]: scrub summary: active paths [/] 2024-04-01T06:57:34.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:33 smithi153 ceph-mon[48187]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:34.141 INFO:tasks.workunit.client.0.smithi083.stdout:0/178: read f10 [474984,106497] 0 2024-04-01T06:57:34.143 INFO:tasks.workunit.client.0.smithi083.stdout:0/179: rename d16/f1a to d16/d1d/f37 0 2024-04-01T06:57:34.143 INFO:tasks.workunit.client.0.smithi083.stdout:9/188: dwrite d6/d32/f2b [0,4194304] 0 2024-04-01T06:57:34.143 INFO:tasks.workunit.client.0.smithi083.stdout:9/189: fdatasync d6/f19 0 2024-04-01T06:57:34.145 INFO:tasks.workunit.client.0.smithi083.stdout:0/180: write f6 [3950222,29791] 0 2024-04-01T06:57:34.146 INFO:tasks.workunit.client.0.smithi083.stdout:9/190: truncate d6/f7 8084252 0 2024-04-01T06:57:34.163 INFO:tasks.workunit.client.0.smithi083.stdout:8/246: dwrite d15/d1b/d39/d48/f56 [0,4194304] 0 2024-04-01T06:57:34.165 INFO:tasks.workunit.client.0.smithi083.stdout:3/215: dwrite d6/d15/d2d/d2f/f32 [0,4194304] 0 2024-04-01T06:57:34.165 INFO:tasks.workunit.client.0.smithi083.stdout:2/216: dwrite d3/d1f/d2b/f39 [0,4194304] 0 2024-04-01T06:57:34.165 INFO:tasks.workunit.client.0.smithi083.stdout:2/217: read - d3/f43 zero size 2024-04-01T06:57:34.165 INFO:tasks.workunit.client.0.smithi083.stdout:2/218: truncate d3/d1f/d2b/f49 5096125 0 2024-04-01T06:57:34.165 INFO:tasks.workunit.client.0.smithi083.stdout:2/219: chown d3/d1f/d2b/f32 0 1 2024-04-01T06:57:34.165 INFO:tasks.workunit.client.0.smithi083.stdout:2/220: fdatasync d3/f1c 0 2024-04-01T06:57:34.166 INFO:tasks.workunit.client.0.smithi083.stdout:3/216: dread d6/f21 [0,4194304] 0 2024-04-01T06:57:34.168 INFO:tasks.workunit.client.0.smithi083.stdout:8/247: getdents d15/d1b 0 2024-04-01T06:57:34.169 INFO:tasks.workunit.client.0.smithi083.stdout:0/181: dwrite d16/d2e/f36 [0,4194304] 0 2024-04-01T06:57:34.169 INFO:tasks.workunit.client.0.smithi083.stdout:3/217: mknod d6/d1e/c49 0 2024-04-01T06:57:34.169 INFO:tasks.workunit.client.0.smithi083.stdout:3/218: chown d6/d1e/f23 100206 1 2024-04-01T06:57:34.169 INFO:tasks.workunit.client.0.smithi083.stdout:3/219: truncate d6/d12/f30 8952 0 2024-04-01T06:57:34.169 INFO:tasks.workunit.client.0.smithi083.stdout:3/220: readlink d6/d12/l16 0 2024-04-01T06:57:34.170 INFO:tasks.workunit.client.0.smithi083.stdout:3/221: write f2 [1802088,129352] 0 2024-04-01T06:57:34.170 INFO:tasks.workunit.client.0.smithi083.stdout:8/248: mkdir d15/d1b/d39/d48/d5e 0 2024-04-01T06:57:34.173 INFO:tasks.workunit.client.0.smithi083.stdout:3/222: mkdir d6/d1e/d4a 0 2024-04-01T06:57:34.173 INFO:tasks.workunit.client.0.smithi083.stdout:3/223: write d6/d1e/f23 [5231969,38442] 0 2024-04-01T06:57:34.174 INFO:tasks.workunit.client.0.smithi083.stdout:3/224: write d6/d1e/f20 [1384467,12321] 0 2024-04-01T06:57:34.174 INFO:tasks.workunit.client.0.smithi083.stdout:8/249: mknod d15/d18/c5f 0 2024-04-01T06:57:34.174 INFO:tasks.workunit.client.0.smithi083.stdout:8/250: stat d15/d18/d1e 0 2024-04-01T06:57:34.178 INFO:tasks.workunit.client.0.smithi083.stdout:2/221: dwrite d3/d1f/d2b/f39 [0,4194304] 0 2024-04-01T06:57:34.178 INFO:tasks.workunit.client.0.smithi083.stdout:8/251: creat d15/d18/d19/d1d/f60 x:0 0 0 2024-04-01T06:57:34.183 INFO:tasks.workunit.client.0.smithi083.stdout:2/222: mkdir d3/d1f/d27/d4b 0 2024-04-01T06:57:34.183 INFO:tasks.workunit.client.0.smithi083.stdout:8/252: creat d15/d1b/d39/f61 x:0 0 0 2024-04-01T06:57:34.187 INFO:tasks.workunit.client.0.smithi083.stdout:2/223: creat d3/d26/f4c x:0 0 0 2024-04-01T06:57:34.188 INFO:tasks.workunit.client.0.smithi083.stdout:2/224: chown d3/ca 2162 1 2024-04-01T06:57:34.188 INFO:tasks.workunit.client.0.smithi083.stdout:2/225: chown d3/f1c 2453 1 2024-04-01T06:57:34.189 INFO:tasks.workunit.client.0.smithi083.stdout:3/225: rmdir d6 39 2024-04-01T06:57:34.190 INFO:tasks.workunit.client.0.smithi083.stdout:8/253: dread d15/d18/d1e/f5b [0,4194304] 0 2024-04-01T06:57:34.190 INFO:tasks.workunit.client.0.smithi083.stdout:8/254: fsync f7 0 2024-04-01T06:57:34.190 INFO:tasks.workunit.client.0.smithi083.stdout:0/182: truncate d16/d1d/f23 1154155 0 2024-04-01T06:57:34.193 INFO:tasks.workunit.client.0.smithi083.stdout:0/183: mknod d16/d2e/c38 0 2024-04-01T06:57:34.193 INFO:tasks.workunit.client.0.smithi083.stdout:0/184: stat f7 0 2024-04-01T06:57:34.193 INFO:tasks.workunit.client.0.smithi083.stdout:0/185: write d16/d1d/f2a [932197,78455] 0 2024-04-01T06:57:34.193 INFO:tasks.workunit.client.0.smithi083.stdout:3/226: dread f2 [0,4194304] 0 2024-04-01T06:57:34.194 INFO:tasks.workunit.client.0.smithi083.stdout:0/186: mknod d16/d2e/c39 0 2024-04-01T06:57:34.194 INFO:tasks.workunit.client.0.smithi083.stdout:8/255: rmdir d15/d18/d1e 39 2024-04-01T06:57:34.195 INFO:tasks.workunit.client.0.smithi083.stdout:3/227: mknod d6/d15/c4b 0 2024-04-01T06:57:34.196 INFO:tasks.workunit.client.0.smithi083.stdout:3/228: chown d6/d1e/c44 60444618 1 2024-04-01T06:57:34.198 INFO:tasks.workunit.client.0.smithi083.stdout:8/256: rename d15/d18/d19/d1d/d2b to d15/d18/d19/d24/d38/d62 0 2024-04-01T06:57:34.200 INFO:tasks.workunit.client.0.smithi083.stdout:2/226: dwrite d3/f43 [0,4194304] 0 2024-04-01T06:57:34.201 INFO:tasks.workunit.client.0.smithi083.stdout:3/229: dread d6/d15/f1a [0,4194304] 0 2024-04-01T06:57:34.203 INFO:tasks.workunit.client.0.smithi083.stdout:0/187: write f14 [1002017,35308] 0 2024-04-01T06:57:34.203 INFO:tasks.workunit.client.0.smithi083.stdout:3/230: symlink d6/d15/l4c 0 2024-04-01T06:57:34.204 INFO:tasks.workunit.client.0.smithi083.stdout:0/188: mkdir d16/d3a 0 2024-04-01T06:57:34.204 INFO:tasks.workunit.client.0.smithi083.stdout:0/189: chown d16/d2e/f2f 124955126 1 2024-04-01T06:57:34.204 INFO:tasks.workunit.client.0.smithi083.stdout:0/190: fdatasync d16/f22 0 2024-04-01T06:57:34.205 INFO:tasks.workunit.client.0.smithi083.stdout:3/231: symlink d6/d15/d2d/d2f/l4d 0 2024-04-01T06:57:34.205 INFO:tasks.workunit.client.0.smithi083.stdout:3/232: write d6/d12/f2e [329959,46207] 0 2024-04-01T06:57:34.206 INFO:tasks.workunit.client.0.smithi083.stdout:0/191: rmdir d16/d1d/d33 0 2024-04-01T06:57:34.207 INFO:tasks.workunit.client.0.smithi083.stdout:3/233: mknod d6/d15/d2d/c4e 0 2024-04-01T06:57:34.209 INFO:tasks.workunit.client.0.smithi083.stdout:0/192: rmdir d16/d2e 39 2024-04-01T06:57:34.209 INFO:tasks.workunit.client.0.smithi083.stdout:0/193: getdents d16/d3a 0 2024-04-01T06:57:34.210 INFO:tasks.workunit.client.0.smithi083.stdout:3/234: rename d6/d15/d2d/c38 to d6/d15/d2d/d2f/d42/d46/c4f 0 2024-04-01T06:57:34.211 INFO:tasks.workunit.client.0.smithi083.stdout:0/194: mknod d16/d1d/c3b 0 2024-04-01T06:57:34.214 INFO:tasks.workunit.client.0.smithi083.stdout:3/235: dread d6/f24 [0,4194304] 0 2024-04-01T06:57:34.215 INFO:tasks.workunit.client.0.smithi083.stdout:3/236: write d6/fb [863226,43685] 0 2024-04-01T06:57:34.224 INFO:tasks.workunit.client.0.smithi083.stdout:0/195: dwrite d16/f22 [0,4194304] 0 2024-04-01T06:57:34.227 INFO:tasks.workunit.client.0.smithi083.stdout:0/196: creat d16/d3a/f3c x:0 0 0 2024-04-01T06:57:34.229 INFO:tasks.workunit.client.0.smithi083.stdout:0/197: mkdir d16/d2e/d3d 0 2024-04-01T06:57:34.229 INFO:tasks.workunit.client.0.smithi083.stdout:0/198: creat d16/d3a/f3e x:0 0 0 2024-04-01T06:57:34.233 INFO:tasks.workunit.client.0.smithi083.stdout:3/237: dwrite d6/d12/f30 [0,4194304] 0 2024-04-01T06:57:34.236 INFO:tasks.workunit.client.0.smithi083.stdout:3/238: mknod d6/d15/d2d/d2f/d42/d46/c50 0 2024-04-01T06:57:34.238 INFO:tasks.workunit.client.0.smithi083.stdout:3/239: rename d6/d15/d2d/d2f/f32 to d6/d1e/f51 0 2024-04-01T06:57:34.241 INFO:tasks.workunit.client.0.smithi083.stdout:0/199: dread f6 [4194304,4194304] 0 2024-04-01T06:57:34.242 INFO:tasks.workunit.client.0.smithi083.stdout:0/200: link d16/d1d/l21 d16/l3f 0 2024-04-01T06:57:34.256 INFO:tasks.workunit.client.0.smithi083.stdout:3/240: dwrite d6/f9 [4194304,4194304] 0 2024-04-01T06:57:34.258 INFO:tasks.workunit.client.0.smithi083.stdout:3/241: mknod d6/d12/c52 0 2024-04-01T06:57:34.259 INFO:tasks.workunit.client.0.smithi083.stdout:3/242: write d6/d15/f19 [4056641,81276] 0 2024-04-01T06:57:34.259 INFO:tasks.workunit.client.0.smithi083.stdout:0/201: dwrite d16/d2e/f36 [0,4194304] 0 2024-04-01T06:57:34.262 INFO:tasks.workunit.client.0.smithi083.stdout:0/202: creat d16/d2e/d3d/f40 x:0 0 0 2024-04-01T06:57:34.270 INFO:tasks.workunit.client.0.smithi083.stdout:0/203: dread d16/d1d/f25 [0,4194304] 0 2024-04-01T06:57:34.270 INFO:tasks.workunit.client.0.smithi083.stdout:0/204: fdatasync d16/f2c 0 2024-04-01T06:57:34.271 INFO:tasks.workunit.client.0.smithi083.stdout:0/205: creat d16/d2e/f41 x:0 0 0 2024-04-01T06:57:34.278 INFO:tasks.workunit.client.0.smithi083.stdout:3/243: dwrite d6/d15/f3a [0,4194304] 0 2024-04-01T06:57:34.279 INFO:tasks.workunit.client.0.smithi083.stdout:3/244: mkdir d6/d15/d2d/d2f/d53 0 2024-04-01T06:57:34.280 INFO:tasks.workunit.client.0.smithi083.stdout:3/245: write d6/f24 [168993,72093] 0 2024-04-01T06:57:34.282 INFO:tasks.workunit.client.0.smithi083.stdout:3/246: creat d6/d15/d2d/d2f/d3e/f54 x:0 0 0 2024-04-01T06:57:34.298 INFO:tasks.workunit.client.0.smithi083.stdout:3/247: dwrite d6/d15/d2d/d2f/d3e/f54 [0,4194304] 0 2024-04-01T06:57:34.301 INFO:tasks.workunit.client.0.smithi083.stdout:3/248: rename d6/d3c to d6/d15/d2d/d2f/d42/d46/d55 0 2024-04-01T06:57:34.302 INFO:tasks.workunit.client.0.smithi083.stdout:3/249: rename d6/d1e/f51 to d6/d1e/f56 0 2024-04-01T06:57:34.306 INFO:tasks.workunit.client.0.smithi083.stdout:3/250: creat d6/d15/d2d/d2f/d42/d46/f57 x:0 0 0 2024-04-01T06:57:34.309 INFO:tasks.workunit.client.0.smithi083.stdout:3/251: truncate d6/d12/f2e 529001 0 2024-04-01T06:57:34.322 INFO:tasks.workunit.client.0.smithi083.stdout:3/252: dwrite d6/d1e/f39 [0,4194304] 0 2024-04-01T06:57:34.325 INFO:tasks.workunit.client.0.smithi083.stdout:3/253: rename d6/d12/f2e to d6/d15/d2d/d2f/d42/d46/f58 0 2024-04-01T06:57:34.337 INFO:tasks.workunit.client.0.smithi083.stdout:3/254: dwrite d6/f21 [0,4194304] 0 2024-04-01T06:57:34.338 INFO:tasks.workunit.client.0.smithi083.stdout:3/255: read d6/d15/d2d/d2f/d3e/f54 [1836009,191] 0 2024-04-01T06:57:34.348 INFO:tasks.workunit.client.0.smithi083.stdout:3/256: dwrite d6/d1e/f20 [0,4194304] 0 2024-04-01T06:57:34.350 INFO:tasks.workunit.client.0.smithi083.stdout:3/257: rename d6/f9 to d6/d15/d2d/d2f/d42/f59 0 2024-04-01T06:57:34.351 INFO:tasks.workunit.client.0.smithi083.stdout:3/258: creat d6/d15/f5a x:0 0 0 2024-04-01T06:57:34.351 INFO:tasks.workunit.client.0.smithi083.stdout:3/259: write d6/d12/f47 [504619,18435] 0 2024-04-01T06:57:34.352 INFO:tasks.workunit.client.0.smithi083.stdout:3/260: creat d6/d15/d2d/f5b x:0 0 0 2024-04-01T06:57:34.353 INFO:tasks.workunit.client.0.smithi083.stdout:3/261: mkdir d6/d15/d2d/d2f/d42/d5c 0 2024-04-01T06:57:34.370 INFO:tasks.workunit.client.0.smithi083.stdout:3/262: dwrite d6/d1e/f56 [0,4194304] 0 2024-04-01T06:57:34.371 INFO:tasks.workunit.client.0.smithi083.stdout:3/263: symlink d6/d15/d2d/d2f/d42/d46/d55/l5d 0 2024-04-01T06:57:34.371 INFO:tasks.workunit.client.0.smithi083.stdout:3/264: stat d6/fb 0 2024-04-01T06:57:34.371 INFO:tasks.workunit.client.0.smithi083.stdout:3/265: truncate d6/d15/d2d/d2f/d42/d46/f58 596107 0 2024-04-01T06:57:34.372 INFO:tasks.workunit.client.0.smithi083.stdout:3/266: creat d6/d15/d2d/d2f/d42/d46/f5e x:0 0 0 2024-04-01T06:57:34.373 INFO:tasks.workunit.client.0.smithi083.stdout:3/267: getdents d6/d15/d2d 0 2024-04-01T06:57:34.374 INFO:tasks.workunit.client.0.smithi083.stdout:3/268: dread - d6/d15/d2d/d2f/d42/d46/f57 zero size 2024-04-01T06:57:34.374 INFO:tasks.workunit.client.0.smithi083.stdout:3/269: read d6/d15/f1a [1320960,65249] 0 2024-04-01T06:57:34.375 INFO:tasks.workunit.client.0.smithi083.stdout:3/270: link d6/d1e/f2b d6/d15/f5f 0 2024-04-01T06:57:34.377 INFO:tasks.workunit.client.0.smithi083.stdout:3/271: unlink d6/d15/d2d/d2f/d42/f45 0 2024-04-01T06:57:34.377 INFO:tasks.workunit.client.0.smithi083.stdout:3/272: write d6/f21 [4669656,114336] 0 2024-04-01T06:57:34.379 INFO:tasks.workunit.client.0.smithi083.stdout:3/273: dread d6/d15/f14 [0,4194304] 0 2024-04-01T06:57:34.380 INFO:tasks.workunit.client.0.smithi083.stdout:3/274: getdents d6/d12 0 2024-04-01T06:57:34.380 INFO:tasks.workunit.client.0.smithi083.stdout:3/275: truncate d6/d12/f47 354927 0 2024-04-01T06:57:34.382 INFO:tasks.workunit.client.0.smithi083.stdout:3/276: mkdir d6/d1e/d4a/d60 0 2024-04-01T06:57:34.391 INFO:tasks.workunit.client.0.smithi083.stdout:3/277: dread d6/d15/f3a [0,4194304] 0 2024-04-01T06:57:34.391 INFO:tasks.workunit.client.0.smithi083.stdout:3/278: rmdir d6/d15/d2d/d2f 39 2024-04-01T06:57:34.391 INFO:tasks.workunit.client.0.smithi083.stdout:3/279: readlink d6/d15/d2d/d2f/d42/d46/d55/l41 0 2024-04-01T06:57:34.392 INFO:tasks.workunit.client.0.smithi083.stdout:3/280: symlink d6/d15/d2d/d2f/d53/l61 0 2024-04-01T06:57:34.394 INFO:tasks.workunit.client.0.smithi083.stdout:3/281: dread d6/d15/d2d/d2f/d42/d46/f58 [0,4194304] 0 2024-04-01T06:57:34.394 INFO:tasks.workunit.client.0.smithi083.stdout:3/282: chown d6/f24 93176 1 2024-04-01T06:57:34.395 INFO:tasks.workunit.client.0.smithi083.stdout:3/283: mknod d6/c62 0 2024-04-01T06:57:34.396 INFO:tasks.workunit.client.0.smithi083.stdout:3/284: creat d6/d15/d2d/d2f/d42/f63 x:0 0 0 2024-04-01T06:57:34.396 INFO:tasks.workunit.client.0.smithi083.stdout:3/285: fdatasync d6/d15/d2d/d2f/d42/f59 0 2024-04-01T06:57:34.397 INFO:tasks.workunit.client.0.smithi083.stdout:1/263: sync 2024-04-01T06:57:34.397 INFO:tasks.workunit.client.0.smithi083.stdout:6/144: sync 2024-04-01T06:57:34.397 INFO:tasks.workunit.client.0.smithi083.stdout:5/131: sync 2024-04-01T06:57:34.397 INFO:tasks.workunit.client.0.smithi083.stdout:7/141: sync 2024-04-01T06:57:34.397 INFO:tasks.workunit.client.0.smithi083.stdout:7/142: write d0/d4/d9/f22 [1139780,9812] 0 2024-04-01T06:57:34.397 INFO:tasks.workunit.client.0.smithi083.stdout:1/264: write db/d1c/d29/d33/f4a [838541,130609] 0 2024-04-01T06:57:34.397 INFO:tasks.workunit.client.0.smithi083.stdout:1/265: write db/f39 [3565862,15526] 0 2024-04-01T06:57:34.398 INFO:tasks.workunit.client.0.smithi083.stdout:7/143: write d0/d4/fc [1847388,13919] 0 2024-04-01T06:57:34.398 INFO:tasks.workunit.client.0.smithi083.stdout:6/145: symlink d9/dc/l2d 0 2024-04-01T06:57:34.398 INFO:tasks.workunit.client.0.smithi083.stdout:5/132: rmdir d4/d9/d16/d1f 39 2024-04-01T06:57:34.400 INFO:tasks.workunit.client.0.smithi083.stdout:1/266: rename db/l1a to db/d1c/d2e/l5f 0 2024-04-01T06:57:34.401 INFO:tasks.workunit.client.0.smithi083.stdout:6/146: truncate d9/dc/d1b/f1f 1066104 0 2024-04-01T06:57:34.401 INFO:tasks.workunit.client.0.smithi083.stdout:6/147: fdatasync d9/f1a 0 2024-04-01T06:57:34.402 INFO:tasks.workunit.client.0.smithi083.stdout:6/148: read d9/dc/f14 [102477,64226] 0 2024-04-01T06:57:34.403 INFO:tasks.workunit.client.0.smithi083.stdout:6/149: dread d9/dc/d1b/f28 [0,4194304] 0 2024-04-01T06:57:34.403 INFO:tasks.workunit.client.0.smithi083.stdout:5/133: creat d4/d23/f29 x:0 0 0 2024-04-01T06:57:34.404 INFO:tasks.workunit.client.0.smithi083.stdout:7/144: rename d0/d10 to d0/d10/d28 22 2024-04-01T06:57:34.404 INFO:tasks.workunit.client.0.smithi083.stdout:7/145: chown d0/l26 1 1 2024-04-01T06:57:34.405 INFO:tasks.workunit.client.0.smithi083.stdout:7/146: write d0/d4/f1e [655363,18153] 0 2024-04-01T06:57:34.405 INFO:tasks.workunit.client.0.smithi083.stdout:1/267: getdents db/d1c/d29/d33/d47 0 2024-04-01T06:57:34.407 INFO:tasks.workunit.client.0.smithi083.stdout:5/134: dread d4/ff [0,4194304] 0 2024-04-01T06:57:34.409 INFO:tasks.workunit.client.0.smithi083.stdout:1/268: mknod db/d1c/d29/d33/d50/d4d/c60 0 2024-04-01T06:57:34.409 INFO:tasks.workunit.client.0.smithi083.stdout:7/147: unlink d0/d10/l1b 0 2024-04-01T06:57:34.410 INFO:tasks.workunit.client.0.smithi083.stdout:5/135: mknod d4/d9/d10/c2a 0 2024-04-01T06:57:34.411 INFO:tasks.workunit.client.0.smithi083.stdout:1/269: mkdir db/d61 0 2024-04-01T06:57:34.412 INFO:tasks.workunit.client.0.smithi083.stdout:7/148: creat d0/d4/f29 x:0 0 0 2024-04-01T06:57:34.413 INFO:tasks.workunit.client.0.smithi083.stdout:7/149: truncate d0/d10/f21 710199 0 2024-04-01T06:57:34.413 INFO:tasks.workunit.client.0.smithi083.stdout:7/150: fsync d0/d4/ff 0 2024-04-01T06:57:34.413 INFO:tasks.workunit.client.0.smithi083.stdout:6/150: dwrite d9/dc/f23 [0,4194304] 0 2024-04-01T06:57:34.413 INFO:tasks.workunit.client.0.smithi083.stdout:6/151: stat d9/dc/d29/c2b 0 2024-04-01T06:57:34.414 INFO:tasks.workunit.client.0.smithi083.stdout:7/151: fdatasync d0/d10/f27 0 2024-04-01T06:57:34.415 INFO:tasks.workunit.client.0.smithi083.stdout:1/270: truncate db/d1c/d1d/f45 936828 0 2024-04-01T06:57:34.418 INFO:tasks.workunit.client.0.smithi083.stdout:5/136: rename d4/d9/d10 to d4/d2b 0 2024-04-01T06:57:34.419 INFO:tasks.workunit.client.0.smithi083.stdout:5/137: write d4/d9/d16/d1f/f22 [734154,37382] 0 2024-04-01T06:57:34.419 INFO:tasks.workunit.client.0.smithi083.stdout:5/138: truncate d4/d9/d16/d19/f1e 968205 0 2024-04-01T06:57:34.420 INFO:tasks.workunit.client.0.smithi083.stdout:5/139: read d4/f6 [2945724,32212] 0 2024-04-01T06:57:34.420 INFO:tasks.workunit.client.0.smithi083.stdout:5/140: chown d4/d2b/d21 0 1 2024-04-01T06:57:34.420 INFO:tasks.workunit.client.0.smithi083.stdout:5/141: write d4/d2b/f24 [591865,16215] 0 2024-04-01T06:57:34.421 INFO:tasks.workunit.client.0.smithi083.stdout:6/152: getdents d9/dc/d29 0 2024-04-01T06:57:34.422 INFO:tasks.workunit.client.0.smithi083.stdout:1/271: mknod db/d1c/d29/d33/d50/d5d/c62 0 2024-04-01T06:57:34.422 INFO:tasks.workunit.client.0.smithi083.stdout:1/272: write db/f10 [572276,124839] 0 2024-04-01T06:57:34.423 INFO:tasks.workunit.client.0.smithi083.stdout:1/273: dread - db/d1c/d29/d33/d47/f5a zero size 2024-04-01T06:57:34.427 INFO:tasks.workunit.client.0.smithi083.stdout:5/142: rmdir d4/d9/d16 39 2024-04-01T06:57:34.427 INFO:tasks.workunit.client.0.smithi083.stdout:5/143: truncate d4/fa 1179185 0 2024-04-01T06:57:34.428 INFO:tasks.workunit.client.0.smithi083.stdout:7/152: dwrite d0/d4/d9/f1c [0,4194304] 0 2024-04-01T06:57:34.428 INFO:tasks.workunit.client.0.smithi083.stdout:5/144: symlink d4/d23/l2c 0 2024-04-01T06:57:34.428 INFO:tasks.workunit.client.0.smithi083.stdout:7/153: creat d0/d4/f2a x:0 0 0 2024-04-01T06:57:34.431 INFO:tasks.workunit.client.0.smithi083.stdout:7/154: link d0/d4/ff d0/f2b 0 2024-04-01T06:57:34.432 INFO:tasks.workunit.client.0.smithi083.stdout:5/145: dread d4/f6 [0,4194304] 0 2024-04-01T06:57:34.432 INFO:tasks.workunit.client.0.smithi083.stdout:5/146: chown d4/f1c 11 1 2024-04-01T06:57:34.432 INFO:tasks.workunit.client.0.smithi083.stdout:5/147: write d4/d23/f29 [876524,79639] 0 2024-04-01T06:57:34.432 INFO:tasks.workunit.client.0.smithi083.stdout:7/155: link d0/d4/d9/f25 d0/d4/f2c 0 2024-04-01T06:57:34.435 INFO:tasks.workunit.client.0.smithi083.stdout:7/156: rename d0/d4/f29 to d0/d10/f2d 0 2024-04-01T06:57:34.435 INFO:tasks.workunit.client.0.smithi083.stdout:7/157: stat d0/cb 0 2024-04-01T06:57:34.439 INFO:tasks.workunit.client.0.smithi083.stdout:6/153: dwrite d9/f19 [0,4194304] 0 2024-04-01T06:57:34.449 INFO:tasks.workunit.client.0.smithi083.stdout:6/154: unlink d9/f20 0 2024-04-01T06:57:34.449 INFO:tasks.workunit.client.0.smithi083.stdout:6/155: write d9/dc/f25 [4658688,29510] 0 2024-04-01T06:57:34.451 INFO:tasks.workunit.client.0.smithi083.stdout:6/156: creat d9/dc/f2e x:0 0 0 2024-04-01T06:57:34.451 INFO:tasks.workunit.client.0.smithi083.stdout:6/157: chown d9/f19 98 1 2024-04-01T06:57:34.451 INFO:tasks.workunit.client.0.smithi083.stdout:5/148: dwrite d4/fb [0,4194304] 0 2024-04-01T06:57:34.451 INFO:tasks.workunit.client.0.smithi083.stdout:5/149: write d4/d9/d16/d1f/f22 [1810095,6006] 0 2024-04-01T06:57:34.452 INFO:tasks.workunit.client.0.smithi083.stdout:6/158: write d9/f1a [113948,7088] 0 2024-04-01T06:57:34.453 INFO:tasks.workunit.client.0.smithi083.stdout:5/150: symlink d4/l2d 0 2024-04-01T06:57:34.454 INFO:tasks.workunit.client.0.smithi083.stdout:6/159: dread d9/dc/d1b/f22 [0,4194304] 0 2024-04-01T06:57:34.454 INFO:tasks.workunit.client.0.smithi083.stdout:5/151: write d4/f1b [1977109,123233] 0 2024-04-01T06:57:34.456 INFO:tasks.workunit.client.0.smithi083.stdout:6/160: mknod d9/dc/c2f 0 2024-04-01T06:57:34.456 INFO:tasks.workunit.client.0.smithi083.stdout:6/161: truncate d9/dc/f27 137288 0 2024-04-01T06:57:34.458 INFO:tasks.workunit.client.0.smithi083.stdout:6/162: rename d9/dc/d1b/f17 to d9/dc/f30 0 2024-04-01T06:57:34.458 INFO:tasks.workunit.client.0.smithi083.stdout:6/163: write d9/dc/d1b/f28 [4257020,129548] 0 2024-04-01T06:57:34.459 INFO:tasks.workunit.client.0.smithi083.stdout:1/274: dwrite db/d1c/d29/d33/f4a [0,4194304] 0 2024-04-01T06:57:34.459 INFO:tasks.workunit.client.0.smithi083.stdout:1/275: write db/f13 [917040,123913] 0 2024-04-01T06:57:34.459 INFO:tasks.workunit.client.0.smithi083.stdout:1/276: chown db/d61 243328665 1 2024-04-01T06:57:34.459 INFO:tasks.workunit.client.0.smithi083.stdout:1/277: chown db/d1c/d2e/l41 90270 1 2024-04-01T06:57:34.460 INFO:tasks.workunit.client.0.smithi083.stdout:6/164: rename d9/dc/l2d to d9/l31 0 2024-04-01T06:57:34.460 INFO:tasks.workunit.client.0.smithi083.stdout:6/165: fdatasync d9/dc/f25 0 2024-04-01T06:57:34.462 INFO:tasks.workunit.client.0.smithi083.stdout:1/278: creat db/d1c/d29/d33/d50/d4d/f63 x:0 0 0 2024-04-01T06:57:34.463 INFO:tasks.workunit.client.0.smithi083.stdout:6/166: creat d9/dc/f32 x:0 0 0 2024-04-01T06:57:34.463 INFO:tasks.workunit.client.0.smithi083.stdout:1/279: mknod db/d1c/d29/d33/c64 0 2024-04-01T06:57:34.463 INFO:tasks.workunit.client.0.smithi083.stdout:1/280: stat db/d1c/d2e/d30/f3a 0 2024-04-01T06:57:34.464 INFO:tasks.workunit.client.0.smithi083.stdout:6/167: write d9/f19 [180303,21408] 0 2024-04-01T06:57:34.464 INFO:tasks.workunit.client.0.smithi083.stdout:1/281: creat db/d1c/d49/f65 x:0 0 0 2024-04-01T06:57:34.467 INFO:tasks.workunit.client.0.smithi083.stdout:1/282: link db/d1c/d49/c56 db/d1c/d1d/c66 0 2024-04-01T06:57:34.468 INFO:tasks.workunit.client.0.smithi083.stdout:1/283: rename db/d1c/d2e/d30/l37 to db/d1c/d1d/l67 0 2024-04-01T06:57:34.476 INFO:tasks.workunit.client.0.smithi083.stdout:6/168: dread d9/f19 [0,4194304] 0 2024-04-01T06:57:34.477 INFO:tasks.workunit.client.0.smithi083.stdout:6/169: mknod d9/dc/d29/c33 0 2024-04-01T06:57:34.483 INFO:tasks.workunit.client.0.smithi083.stdout:1/284: dread db/d1c/d29/d33/d4b/f51 [0,4194304] 0 2024-04-01T06:57:34.483 INFO:tasks.workunit.client.0.smithi083.stdout:1/285: write db/d1c/d1d/f1f [678442,66970] 0 2024-04-01T06:57:34.483 INFO:tasks.workunit.client.0.smithi083.stdout:1/286: write f3 [3238868,74504] 0 2024-04-01T06:57:34.483 INFO:tasks.workunit.client.0.smithi083.stdout:1/287: mknod db/d61/c68 0 2024-04-01T06:57:34.492 INFO:tasks.workunit.client.0.smithi083.stdout:1/288: dwrite db/d1c/d29/d33/d4b/f51 [4194304,4194304] 0 2024-04-01T06:57:34.494 INFO:tasks.workunit.client.0.smithi083.stdout:1/289: rename db/d1c/d2e/l41 to db/d1c/d2e/d30/l69 0 2024-04-01T06:57:34.495 INFO:tasks.workunit.client.0.smithi083.stdout:1/290: creat db/d1c/d2e/d30/f6a x:0 0 0 2024-04-01T06:57:34.497 INFO:tasks.workunit.client.0.smithi083.stdout:1/291: rename db/f1b to db/d1c/d1d/f6b 0 2024-04-01T06:57:34.497 INFO:tasks.workunit.client.0.smithi083.stdout:1/292: truncate db/d1c/d29/d33/d47/f5a 894152 0 2024-04-01T06:57:34.498 INFO:tasks.workunit.client.0.smithi083.stdout:1/293: mkdir db/d1c/d29/d33/d50/d5d/d6c 0 2024-04-01T06:57:34.499 INFO:tasks.workunit.client.0.smithi083.stdout:1/294: creat db/d61/f6d x:0 0 0 2024-04-01T06:57:34.500 INFO:tasks.workunit.client.0.smithi083.stdout:6/170: dwrite d9/f19 [4194304,4194304] 0 2024-04-01T06:57:34.501 INFO:tasks.workunit.client.0.smithi083.stdout:1/295: creat db/d1c/d2e/f6e x:0 0 0 2024-04-01T06:57:34.502 INFO:tasks.workunit.client.0.smithi083.stdout:6/171: creat d9/dc/d29/f34 x:0 0 0 2024-04-01T06:57:34.502 INFO:tasks.workunit.client.0.smithi083.stdout:1/296: truncate db/d1c/d1d/f45 694569 0 2024-04-01T06:57:34.504 INFO:tasks.workunit.client.0.smithi083.stdout:6/172: mkdir d9/dc/d1b/d35 0 2024-04-01T06:57:34.511 INFO:tasks.workunit.client.0.smithi083.stdout:1/297: getdents db 0 2024-04-01T06:57:34.514 INFO:tasks.workunit.client.0.smithi083.stdout:9/191: sync 2024-04-01T06:57:34.514 INFO:tasks.workunit.client.0.smithi083.stdout:4/115: sync 2024-04-01T06:57:34.514 INFO:tasks.workunit.client.0.smithi083.stdout:4/116: truncate d1/d4/db/f18 560685 0 2024-04-01T06:57:34.516 INFO:tasks.workunit.client.0.smithi083.stdout:6/173: rmdir d9 39 2024-04-01T06:57:34.521 INFO:tasks.workunit.client.0.smithi083.stdout:9/192: mkdir d6/d32/d3c/d3d 0 2024-04-01T06:57:34.522 INFO:tasks.workunit.client.0.smithi083.stdout:4/117: symlink d1/d4/db/l26 0 2024-04-01T06:57:34.522 INFO:tasks.workunit.client.0.smithi083.stdout:4/118: dread - d1/d4/f25 zero size 2024-04-01T06:57:34.523 INFO:tasks.workunit.client.0.smithi083.stdout:6/174: fsync d9/dc/f32 0 2024-04-01T06:57:34.524 INFO:tasks.workunit.client.0.smithi083.stdout:9/193: rmdir d6/d32/d26/d2d/d34 39 2024-04-01T06:57:34.526 INFO:tasks.workunit.client.0.smithi083.stdout:4/119: creat d1/d4/d1f/f27 x:0 0 0 2024-04-01T06:57:34.526 INFO:tasks.workunit.client.0.smithi083.stdout:4/120: chown d1/d4 0 1 2024-04-01T06:57:34.526 INFO:tasks.workunit.client.0.smithi083.stdout:4/121: write d1/d4/f25 [879506,71113] 0 2024-04-01T06:57:34.527 INFO:tasks.workunit.client.0.smithi083.stdout:4/122: write d1/d4/db/f20 [190368,103309] 0 2024-04-01T06:57:34.527 INFO:tasks.workunit.client.0.smithi083.stdout:4/123: chown d1/d4/l22 8450692 1 2024-04-01T06:57:34.527 INFO:tasks.workunit.client.0.smithi083.stdout:4/124: chown d1/d4/db/c24 51493827 1 2024-04-01T06:57:34.527 INFO:tasks.workunit.client.0.smithi083.stdout:4/125: dread - d1/f23 zero size 2024-04-01T06:57:34.527 INFO:tasks.workunit.client.0.smithi083.stdout:4/126: readlink d1/d4/da/l19 0 2024-04-01T06:57:34.527 INFO:tasks.workunit.client.0.smithi083.stdout:4/127: truncate d1/d4/d1f/f27 852888 0 2024-04-01T06:57:34.527 INFO:tasks.workunit.client.0.smithi083.stdout:4/128: chown d1/d4/da/c16 1 1 2024-04-01T06:57:34.528 INFO:tasks.workunit.client.0.smithi083.stdout:9/194: mknod d6/d32/c3e 0 2024-04-01T06:57:34.528 INFO:tasks.workunit.client.0.smithi083.stdout:4/129: write d1/f2 [3272729,21211] 0 2024-04-01T06:57:34.529 INFO:tasks.workunit.client.0.smithi083.stdout:9/195: creat d6/d32/d26/d2d/f3f x:0 0 0 2024-04-01T06:57:34.529 INFO:tasks.workunit.client.0.smithi083.stdout:9/196: dread - d6/f2f zero size 2024-04-01T06:57:34.529 INFO:tasks.workunit.client.0.smithi083.stdout:9/197: fsync d6/d32/f1a 0 2024-04-01T06:57:34.530 INFO:tasks.workunit.client.0.smithi083.stdout:4/130: creat d1/d4/da/f28 x:0 0 0 2024-04-01T06:57:34.530 INFO:tasks.workunit.client.0.smithi083.stdout:4/131: write d1/d4/f25 [79005,129927] 0 2024-04-01T06:57:34.531 INFO:tasks.workunit.client.0.smithi083.stdout:9/198: creat d6/d32/d26/d2d/d34/f40 x:0 0 0 2024-04-01T06:57:34.532 INFO:tasks.workunit.client.0.smithi083.stdout:9/199: write d6/f19 [3176452,106900] 0 2024-04-01T06:57:34.533 INFO:tasks.workunit.client.0.smithi083.stdout:9/200: symlink d6/d32/d3c/l41 0 2024-04-01T06:57:34.534 INFO:tasks.workunit.client.0.smithi083.stdout:9/201: mknod d6/d32/d3c/d3d/c42 0 2024-04-01T06:57:34.534 INFO:tasks.workunit.client.0.smithi083.stdout:6/175: dread f6 [0,4194304] 0 2024-04-01T06:57:34.535 INFO:tasks.workunit.client.0.smithi083.stdout:9/202: unlink d6/d32/c3e 0 2024-04-01T06:57:34.535 INFO:tasks.workunit.client.0.smithi083.stdout:9/203: chown d6/d32/d26/c28 271047 1 2024-04-01T06:57:34.535 INFO:tasks.workunit.client.0.smithi083.stdout:6/176: mknod d9/dc/d1b/d35/c36 0 2024-04-01T06:57:34.538 INFO:tasks.workunit.client.0.smithi083.stdout:6/177: dread f6 [4194304,4194304] 0 2024-04-01T06:57:34.538 INFO:tasks.workunit.client.0.smithi083.stdout:4/132: dread d1/d4/db/f11 [4194304,4194304] 0 2024-04-01T06:57:34.540 INFO:tasks.workunit.client.0.smithi083.stdout:4/133: creat d1/d4/da/f29 x:0 0 0 2024-04-01T06:57:34.553 INFO:tasks.workunit.client.0.smithi083.stdout:4/134: dwrite d1/f6 [0,4194304] 0 2024-04-01T06:57:34.565 INFO:tasks.workunit.client.0.smithi083.stdout:4/135: dwrite d1/d4/f25 [0,4194304] 0 2024-04-01T06:57:34.570 INFO:tasks.workunit.client.0.smithi083.stdout:4/136: dread d1/d4/db/f11 [0,4194304] 0 2024-04-01T06:57:34.582 INFO:tasks.workunit.client.0.smithi083.stdout:4/137: dread d1/f2 [0,4194304] 0 2024-04-01T06:57:34.582 INFO:tasks.workunit.client.0.smithi083.stdout:4/138: readlink d1/d4/l22 0 2024-04-01T06:57:34.588 INFO:tasks.workunit.client.0.smithi083.stdout:4/139: rmdir d1/d4/da 39 2024-04-01T06:57:34.589 INFO:tasks.workunit.client.0.smithi083.stdout:4/140: chown d1/d4/da/c16 64662920 1 2024-04-01T06:57:34.595 INFO:tasks.workunit.client.0.smithi083.stdout:9/204: dwrite d6/d32/f25 [0,4194304] 0 2024-04-01T06:57:34.595 INFO:tasks.workunit.client.0.smithi083.stdout:9/205: dread - d6/d32/d26/d2d/f3f zero size 2024-04-01T06:57:34.595 INFO:tasks.workunit.client.0.smithi083.stdout:9/206: fsync d6/d32/d26/d2d/f3f 0 2024-04-01T06:57:34.596 INFO:tasks.workunit.client.0.smithi083.stdout:9/207: creat d6/d32/d26/d2d/d34/f43 x:0 0 0 2024-04-01T06:57:34.597 INFO:tasks.workunit.client.0.smithi083.stdout:4/141: dread d1/d4/ff [0,4194304] 0 2024-04-01T06:57:34.597 INFO:tasks.workunit.client.0.smithi083.stdout:2/227: sync 2024-04-01T06:57:34.597 INFO:tasks.workunit.client.0.smithi083.stdout:0/206: sync 2024-04-01T06:57:34.597 INFO:tasks.workunit.client.0.smithi083.stdout:8/257: sync 2024-04-01T06:57:34.597 INFO:tasks.workunit.client.0.smithi083.stdout:2/228: read - d3/d1f/f30 zero size 2024-04-01T06:57:34.598 INFO:tasks.workunit.client.0.smithi083.stdout:4/142: mkdir d1/d4/d1f/d2a 0 2024-04-01T06:57:34.598 INFO:tasks.workunit.client.0.smithi083.stdout:4/143: chown d1/c15 493 1 2024-04-01T06:57:34.598 INFO:tasks.workunit.client.0.smithi083.stdout:8/258: symlink d15/d18/d19/d24/l63 0 2024-04-01T06:57:34.599 INFO:tasks.workunit.client.0.smithi083.stdout:0/207: creat d16/f42 x:0 0 0 2024-04-01T06:57:34.600 INFO:tasks.workunit.client.0.smithi083.stdout:8/259: dread d15/d18/d19/f5d [0,4194304] 0 2024-04-01T06:57:34.600 INFO:tasks.workunit.client.0.smithi083.stdout:4/144: unlink d1/f6 0 2024-04-01T06:57:34.602 INFO:tasks.workunit.client.0.smithi083.stdout:0/208: mknod d16/d1d/c43 0 2024-04-01T06:57:34.602 INFO:tasks.workunit.client.0.smithi083.stdout:0/209: truncate d16/d3a/f3e 968146 0 2024-04-01T06:57:34.602 INFO:tasks.workunit.client.0.smithi083.stdout:0/210: read - d16/d1d/f24 zero size 2024-04-01T06:57:34.602 INFO:tasks.workunit.client.0.smithi083.stdout:2/229: mkdir d3/d4d 0 2024-04-01T06:57:34.602 INFO:tasks.workunit.client.0.smithi083.stdout:2/230: getdents d3/d4d 0 2024-04-01T06:57:34.602 INFO:tasks.workunit.client.0.smithi083.stdout:0/211: dread d16/d3a/f3e [0,4194304] 0 2024-04-01T06:57:34.603 INFO:tasks.workunit.client.0.smithi083.stdout:2/231: creat d3/d20/d42/f4e x:0 0 0 2024-04-01T06:57:34.604 INFO:tasks.workunit.client.0.smithi083.stdout:2/232: creat d3/d4d/f4f x:0 0 0 2024-04-01T06:57:34.605 INFO:tasks.workunit.client.0.smithi083.stdout:4/145: getdents d1/d4/d1f 0 2024-04-01T06:57:34.605 INFO:tasks.workunit.client.0.smithi083.stdout:4/146: getdents d1/d4/d1f/d2a 0 2024-04-01T06:57:34.607 INFO:tasks.workunit.client.0.smithi083.stdout:4/147: symlink d1/d4/db/l2b 0 2024-04-01T06:57:34.608 INFO:tasks.workunit.client.0.smithi083.stdout:4/148: write d1/d4/db/f20 [1112237,68399] 0 2024-04-01T06:57:34.610 INFO:tasks.workunit.client.0.smithi083.stdout:4/149: rename d1/d4/da/c16 to d1/d4/db/c2c 0 2024-04-01T06:57:34.612 INFO:tasks.workunit.client.0.smithi083.stdout:4/150: mknod d1/d4/d1f/c2d 0 2024-04-01T06:57:34.618 INFO:tasks.workunit.client.0.smithi083.stdout:4/151: rmdir d1/d4 39 2024-04-01T06:57:34.618 INFO:tasks.workunit.client.0.smithi083.stdout:0/212: dwrite f10 [0,4194304] 0 2024-04-01T06:57:34.618 INFO:tasks.workunit.client.0.smithi083.stdout:2/233: dwrite d3/f43 [4194304,4194304] 0 2024-04-01T06:57:34.619 INFO:tasks.workunit.client.0.smithi083.stdout:2/234: read d3/f19 [2602071,16919] 0 2024-04-01T06:57:34.619 INFO:tasks.workunit.client.0.smithi083.stdout:0/213: symlink d16/d1d/l44 0 2024-04-01T06:57:34.619 INFO:tasks.workunit.client.0.smithi083.stdout:0/214: dread - d16/d3a/f3c zero size 2024-04-01T06:57:34.621 INFO:tasks.workunit.client.0.smithi083.stdout:0/215: symlink d16/d2e/d3d/l45 0 2024-04-01T06:57:34.622 INFO:tasks.workunit.client.0.smithi083.stdout:2/235: dread d3/d1f/d2b/f49 [0,4194304] 0 2024-04-01T06:57:34.622 INFO:tasks.workunit.client.0.smithi083.stdout:0/216: dread d16/f1b [0,4194304] 0 2024-04-01T06:57:34.623 INFO:tasks.workunit.client.0.smithi083.stdout:2/236: creat d3/d20/d42/f50 x:0 0 0 2024-04-01T06:57:34.624 INFO:tasks.workunit.client.0.smithi083.stdout:0/217: link fd d16/d1d/f46 0 2024-04-01T06:57:34.624 INFO:tasks.workunit.client.0.smithi083.stdout:0/218: chown d16/d2e/d3d 1 1 2024-04-01T06:57:34.624 INFO:tasks.workunit.client.0.smithi083.stdout:0/219: stat d16/d1d/f24 0 2024-04-01T06:57:34.625 INFO:tasks.workunit.client.0.smithi083.stdout:0/220: symlink d16/d3a/l47 0 2024-04-01T06:57:34.626 INFO:tasks.workunit.client.0.smithi083.stdout:4/152: dread d1/f2 [4194304,4194304] 0 2024-04-01T06:57:34.627 INFO:tasks.workunit.client.0.smithi083.stdout:0/221: rename d16/d1d/c3b to d16/d3a/c48 0 2024-04-01T06:57:34.627 INFO:tasks.workunit.client.0.smithi083.stdout:2/237: dread d3/d1f/d2b/f32 [0,4194304] 0 2024-04-01T06:57:34.633 INFO:tasks.workunit.client.0.smithi083.stdout:4/153: dread d1/d4/db/f11 [0,4194304] 0 2024-04-01T06:57:34.634 INFO:tasks.workunit.client.0.smithi083.stdout:4/154: creat d1/d4/d1f/d2a/f2e x:0 0 0 2024-04-01T06:57:34.635 INFO:tasks.workunit.client.0.smithi083.stdout:4/155: creat d1/d4/d1f/d2a/f2f x:0 0 0 2024-04-01T06:57:34.635 INFO:tasks.workunit.client.0.smithi083.stdout:2/238: dwrite d3/ff [0,4194304] 0 2024-04-01T06:57:34.636 INFO:tasks.workunit.client.0.smithi083.stdout:2/239: truncate d3/d4d/f4f 28298 0 2024-04-01T06:57:34.636 INFO:tasks.workunit.client.0.smithi083.stdout:0/222: dread d16/f22 [0,4194304] 0 2024-04-01T06:57:34.636 INFO:tasks.workunit.client.0.smithi083.stdout:0/223: truncate d16/d3a/f3c 730471 0 2024-04-01T06:57:34.636 INFO:tasks.workunit.client.0.smithi083.stdout:4/156: symlink d1/d4/d1f/d2a/l30 0 2024-04-01T06:57:34.638 INFO:tasks.workunit.client.0.smithi083.stdout:2/240: creat d3/d1f/d27/d4b/f51 x:0 0 0 2024-04-01T06:57:34.639 INFO:tasks.workunit.client.0.smithi083.stdout:2/241: fdatasync d3/d26/f4c 0 2024-04-01T06:57:34.639 INFO:tasks.workunit.client.0.smithi083.stdout:2/242: chown d3/d26/f36 929770 1 2024-04-01T06:57:34.639 INFO:tasks.workunit.client.0.smithi083.stdout:2/243: truncate d3/d20/d42/f4e 495202 0 2024-04-01T06:57:34.639 INFO:tasks.workunit.client.0.smithi083.stdout:0/224: rename d16/f1b to d16/d1d/f49 0 2024-04-01T06:57:34.639 INFO:tasks.workunit.client.0.smithi083.stdout:0/225: rename d16 to d16/d3a/d4a 22 2024-04-01T06:57:34.640 INFO:tasks.workunit.client.0.smithi083.stdout:4/157: creat d1/d4/d1f/d2a/f31 x:0 0 0 2024-04-01T06:57:34.640 INFO:tasks.workunit.client.0.smithi083.stdout:4/158: write d1/d4/db/f11 [8155647,44109] 0 2024-04-01T06:57:34.642 INFO:tasks.workunit.client.0.smithi083.stdout:2/244: creat d3/d4d/f52 x:0 0 0 2024-04-01T06:57:34.642 INFO:tasks.workunit.client.0.smithi083.stdout:2/245: dread - d3/d1f/d27/d4b/f51 zero size 2024-04-01T06:57:34.643 INFO:tasks.workunit.client.0.smithi083.stdout:2/246: mkdir d3/d1f/d27/d4b/d53 0 2024-04-01T06:57:34.644 INFO:tasks.workunit.client.0.smithi083.stdout:2/247: chown d3/l38 480771534 1 2024-04-01T06:57:34.645 INFO:tasks.workunit.client.0.smithi083.stdout:0/226: dread fd [4194304,4194304] 0 2024-04-01T06:57:34.660 INFO:tasks.workunit.client.0.smithi083.stdout:2/248: dwrite d3/d4d/f4f [0,4194304] 0 2024-04-01T06:57:34.661 INFO:tasks.workunit.client.0.smithi083.stdout:2/249: fdatasync d3/d1f/d27/d4b/f51 0 2024-04-01T06:57:34.662 INFO:tasks.workunit.client.0.smithi083.stdout:2/250: creat d3/d1f/d2b/f54 x:0 0 0 2024-04-01T06:57:34.663 INFO:tasks.workunit.client.0.smithi083.stdout:0/227: dwrite d16/f22 [0,4194304] 0 2024-04-01T06:57:34.664 INFO:tasks.workunit.client.0.smithi083.stdout:2/251: rename d3/d1f/d27/c33 to d3/d1f/d27/d4b/c55 0 2024-04-01T06:57:34.665 INFO:tasks.workunit.client.0.smithi083.stdout:0/228: unlink l8 0 2024-04-01T06:57:34.668 INFO:tasks.workunit.client.0.smithi083.stdout:2/252: write d3/d4d/f4f [4445655,121394] 0 2024-04-01T06:57:34.669 INFO:tasks.workunit.client.0.smithi083.stdout:2/253: mknod d3/d1f/c56 0 2024-04-01T06:57:34.670 INFO:tasks.workunit.client.0.smithi083.stdout:2/254: mkdir d3/d4d/d57 0 2024-04-01T06:57:34.678 INFO:tasks.workunit.client.0.smithi083.stdout:2/255: rmdir d3 39 2024-04-01T06:57:34.678 INFO:tasks.workunit.client.0.smithi083.stdout:2/256: symlink d3/d1f/d27/d4b/d53/l58 0 2024-04-01T06:57:34.684 INFO:tasks.workunit.client.0.smithi083.stdout:2/257: rename d3/d1f to d3/d26/d59 0 2024-04-01T06:57:34.684 INFO:tasks.workunit.client.0.smithi083.stdout:2/258: mkdir d3/d26/d5a 0 2024-04-01T06:57:34.690 INFO:tasks.workunit.client.0.smithi083.stdout:2/259: link d3/l2c d3/d4d/l5b 0 2024-04-01T06:57:34.690 INFO:tasks.workunit.client.0.smithi083.stdout:2/260: write f2 [4229250,128192] 0 2024-04-01T06:57:34.691 INFO:tasks.workunit.client.0.smithi083.stdout:2/261: creat d3/d26/d5a/f5c x:0 0 0 2024-04-01T06:57:34.691 INFO:tasks.workunit.client.0.smithi083.stdout:2/262: fdatasync d3/d26/d59/f30 0 2024-04-01T06:57:34.694 INFO:tasks.workunit.client.0.smithi083.stdout:2/263: mkdir d3/d4d/d5d 0 2024-04-01T06:57:34.694 INFO:tasks.workunit.client.0.smithi083.stdout:2/264: readlink d3/d26/l45 0 2024-04-01T06:57:34.714 INFO:tasks.workunit.client.0.smithi083.stdout:2/265: dwrite d3/f7 [4194304,4194304] 0 2024-04-01T06:57:34.715 INFO:tasks.workunit.client.0.smithi083.stdout:2/266: dread d3/d26/d59/d2b/f40 [0,4194304] 0 2024-04-01T06:57:34.716 INFO:tasks.workunit.client.0.smithi083.stdout:2/267: mkdir d3/d26/d59/d27/d4b/d53/d5e 0 2024-04-01T06:57:34.717 INFO:tasks.workunit.client.0.smithi083.stdout:2/268: write d3/d26/f36 [3095041,9503] 0 2024-04-01T06:57:34.724 INFO:tasks.workunit.client.0.smithi083.stdout:3/286: sync 2024-04-01T06:57:34.724 INFO:tasks.workunit.client.0.smithi083.stdout:3/287: readlink d6/d15/d2d/d2f/d53/l61 0 2024-04-01T06:57:34.725 INFO:tasks.workunit.client.0.smithi083.stdout:3/288: chown d6/d15/l17 831 1 2024-04-01T06:57:34.725 INFO:tasks.workunit.client.0.smithi083.stdout:3/289: truncate d6/d1e/f56 2330134 0 2024-04-01T06:57:34.727 INFO:tasks.workunit.client.0.smithi083.stdout:3/290: rmdir d6/d15/d2d/d2f 39 2024-04-01T06:57:34.728 INFO:tasks.workunit.client.0.smithi083.stdout:3/291: write d6/d12/f47 [253073,10905] 0 2024-04-01T06:57:34.728 INFO:tasks.workunit.client.0.smithi083.stdout:3/292: creat d6/d15/f64 x:0 0 0 2024-04-01T06:57:34.729 INFO:tasks.workunit.client.0.smithi083.stdout:3/293: rename d6/d15 to d6/d15/d2d/d2f/d42/d65 22 2024-04-01T06:57:34.732 INFO:tasks.workunit.client.0.smithi083.stdout:2/269: dwrite d3/d20/f2a [0,4194304] 0 2024-04-01T06:57:34.742 INFO:tasks.workunit.client.0.smithi083.stdout:2/270: dwrite d3/d26/d5a/f5c [0,4194304] 0 2024-04-01T06:57:34.744 INFO:tasks.workunit.client.0.smithi083.stdout:3/294: dwrite d6/d12/f30 [0,4194304] 0 2024-04-01T06:57:34.745 INFO:tasks.workunit.client.0.smithi083.stdout:3/295: chown d6/d12/f47 2 1 2024-04-01T06:57:34.745 INFO:tasks.workunit.client.0.smithi083.stdout:2/271: mkdir d3/d26/d59/d27/d4b/d53/d5f 0 2024-04-01T06:57:34.745 INFO:tasks.workunit.client.0.smithi083.stdout:2/272: read - d3/d20/d42/f50 zero size 2024-04-01T06:57:34.745 INFO:tasks.workunit.client.0.smithi083.stdout:2/273: write d3/d26/d5a/f5c [1092369,47375] 0 2024-04-01T06:57:34.746 INFO:tasks.workunit.client.0.smithi083.stdout:2/274: dread - d3/d26/f3a zero size 2024-04-01T06:57:34.746 INFO:tasks.workunit.client.0.smithi083.stdout:2/275: dread - d3/d26/d59/d2b/f4a zero size 2024-04-01T06:57:34.746 INFO:tasks.workunit.client.0.smithi083.stdout:2/276: fsync d3/d26/d59/d2b/f40 0 2024-04-01T06:57:34.746 INFO:tasks.workunit.client.0.smithi083.stdout:3/296: rename d6/d1e/c1f to d6/d15/d2d/d2f/d3e/c66 0 2024-04-01T06:57:34.747 INFO:tasks.workunit.client.0.smithi083.stdout:2/277: creat d3/d26/d59/d27/d4b/d53/f60 x:0 0 0 2024-04-01T06:57:34.747 INFO:tasks.workunit.client.0.smithi083.stdout:2/278: dread - d3/d20/d42/f50 zero size 2024-04-01T06:57:34.748 INFO:tasks.workunit.client.0.smithi083.stdout:3/297: mkdir d6/d15/d2d/d2f/d42/d46/d55/d67 0 2024-04-01T06:57:34.748 INFO:tasks.workunit.client.0.smithi083.stdout:2/279: mknod d3/d4d/c61 0 2024-04-01T06:57:34.749 INFO:tasks.workunit.client.0.smithi083.stdout:2/280: write d3/d20/f21 [73479,38156] 0 2024-04-01T06:57:34.758 INFO:tasks.workunit.client.0.smithi083.stdout:2/281: dwrite d3/d26/d59/d2b/f54 [0,4194304] 0 2024-04-01T06:57:34.759 INFO:tasks.workunit.client.0.smithi083.stdout:2/282: write d3/d4d/f52 [684878,46992] 0 2024-04-01T06:57:34.759 INFO:tasks.workunit.client.0.smithi083.stdout:3/298: dread d6/d1e/f39 [0,4194304] 0 2024-04-01T06:57:34.760 INFO:tasks.workunit.client.0.smithi083.stdout:2/283: symlink d3/d26/d5a/l62 0 2024-04-01T06:57:34.761 INFO:tasks.workunit.client.0.smithi083.stdout:3/299: rename d6/d12/f30 to d6/d15/d2d/d2f/d42/d5c/f68 0 2024-04-01T06:57:34.762 INFO:tasks.workunit.client.0.smithi083.stdout:2/284: creat d3/d26/f63 x:0 0 0 2024-04-01T06:57:34.764 INFO:tasks.workunit.client.0.smithi083.stdout:3/300: unlink d6/d15/d2d/c36 0 2024-04-01T06:57:34.765 INFO:tasks.workunit.client.0.smithi083.stdout:3/301: write d6/d15/f3a [3600489,8295] 0 2024-04-01T06:57:34.765 INFO:tasks.workunit.client.0.smithi083.stdout:2/285: creat d3/d26/d59/d27/d4b/f64 x:0 0 0 2024-04-01T06:57:34.766 INFO:tasks.workunit.client.0.smithi083.stdout:3/302: getdents d6/d1e/d4a 0 2024-04-01T06:57:34.768 INFO:tasks.workunit.client.0.smithi083.stdout:2/286: mkdir d3/d26/d59/d27/d4b/d53/d5e/d65 0 2024-04-01T06:57:34.770 INFO:tasks.workunit.client.0.smithi083.stdout:3/303: creat d6/d15/d2d/d2f/d42/d46/f69 x:0 0 0 2024-04-01T06:57:34.770 INFO:tasks.workunit.client.0.smithi083.stdout:3/304: chown d6/d15/d2d/d2f/d42/d46/f69 61 1 2024-04-01T06:57:34.770 INFO:tasks.workunit.client.0.smithi083.stdout:2/287: mkdir d3/d26/d59/d27/d4b/d53/d66 0 2024-04-01T06:57:34.771 INFO:tasks.workunit.client.0.smithi083.stdout:2/288: read d3/d20/f21 [65763,26162] 0 2024-04-01T06:57:34.771 INFO:tasks.workunit.client.0.smithi083.stdout:3/305: rmdir d6/d1e/d4a/d60 0 2024-04-01T06:57:34.773 INFO:tasks.workunit.client.0.smithi083.stdout:2/289: unlink d3/f12 0 2024-04-01T06:57:34.774 INFO:tasks.workunit.client.0.smithi083.stdout:2/290: rename d3/d20/l2e to d3/d26/d59/d2b/l67 0 2024-04-01T06:57:34.777 INFO:tasks.workunit.client.0.smithi083.stdout:2/291: rmdir d3/d26/d59/d27/d4b/d53/d5e/d65 0 2024-04-01T06:57:34.782 INFO:tasks.workunit.client.0.smithi083.stdout:2/292: fsync d3/d26/f63 0 2024-04-01T06:57:34.783 INFO:tasks.workunit.client.0.smithi083.stdout:2/293: write f1 [4643234,94576] 0 2024-04-01T06:57:34.783 INFO:tasks.workunit.client.0.smithi083.stdout:2/294: dread - d3/d26/d59/f30 zero size 2024-04-01T06:57:34.783 INFO:tasks.workunit.client.0.smithi083.stdout:2/295: chown d3/d26 858466611 1 2024-04-01T06:57:34.783 INFO:tasks.workunit.client.0.smithi083.stdout:2/296: dread - d3/d26/f63 zero size 2024-04-01T06:57:34.783 INFO:tasks.workunit.client.0.smithi083.stdout:2/297: readlink d3/d26/l45 0 2024-04-01T06:57:34.785 INFO:tasks.workunit.client.0.smithi083.stdout:3/306: dwrite d6/fe [0,4194304] 0 2024-04-01T06:57:34.786 INFO:tasks.workunit.client.0.smithi083.stdout:2/298: rename d3/d26/d5a to d3/d26/d59/d27/d4b/d53/d68 0 2024-04-01T06:57:34.788 INFO:tasks.workunit.client.0.smithi083.stdout:3/307: rename d6/d15/l17 to d6/d15/d2d/d2f/d42/d46/d55/d67/l6a 0 2024-04-01T06:57:34.797 INFO:tasks.workunit.client.0.smithi083.stdout:7/158: sync 2024-04-01T06:57:34.797 INFO:tasks.workunit.client.0.smithi083.stdout:5/152: sync 2024-04-01T06:57:34.801 INFO:tasks.workunit.client.0.smithi083.stdout:5/153: mknod d4/d9/c2e 0 2024-04-01T06:57:34.802 INFO:tasks.workunit.client.0.smithi083.stdout:5/154: mkdir d4/d9/d16/d1f/d2f 0 2024-04-01T06:57:34.804 INFO:tasks.workunit.client.0.smithi083.stdout:5/155: rename d4/f6 to d4/d23/f30 0 2024-04-01T06:57:34.804 INFO:tasks.workunit.client.0.smithi083.stdout:5/156: stat d4/d9/cc 0 2024-04-01T06:57:34.806 INFO:tasks.workunit.client.0.smithi083.stdout:2/299: dwrite d3/f19 [0,4194304] 0 2024-04-01T06:57:34.806 INFO:tasks.workunit.client.0.smithi083.stdout:2/300: fdatasync d3/d26/f4c 0 2024-04-01T06:57:34.806 INFO:tasks.workunit.client.0.smithi083.stdout:2/301: read - d3/d26/d59/f30 zero size 2024-04-01T06:57:34.807 INFO:tasks.workunit.client.0.smithi083.stdout:2/302: truncate d3/d26/d59/d27/d4b/f64 105744 0 2024-04-01T06:57:34.807 INFO:tasks.workunit.client.0.smithi083.stdout:5/157: write d4/d2b/f13 [2876403,130026] 0 2024-04-01T06:57:34.807 INFO:tasks.workunit.client.0.smithi083.stdout:7/159: dwrite d0/d4/ff [4194304,4194304] 0 2024-04-01T06:57:34.807 INFO:tasks.workunit.client.0.smithi083.stdout:2/303: unlink d3/d20/f34 0 2024-04-01T06:57:34.807 INFO:tasks.workunit.client.0.smithi083.stdout:7/160: fsync d0/d4/f16 0 2024-04-01T06:57:34.807 INFO:tasks.workunit.client.0.smithi083.stdout:2/304: dread - d3/d26/d59/d2b/f4a zero size 2024-04-01T06:57:34.808 INFO:tasks.workunit.client.0.smithi083.stdout:5/158: creat d4/d2b/f31 x:0 0 0 2024-04-01T06:57:34.808 INFO:tasks.workunit.client.0.smithi083.stdout:3/308: dwrite d6/f24 [4194304,4194304] 0 2024-04-01T06:57:34.809 INFO:tasks.workunit.client.0.smithi083.stdout:3/309: write d6/d15/f1a [4407775,5672] 0 2024-04-01T06:57:34.809 INFO:tasks.workunit.client.0.smithi083.stdout:7/161: rename d0/l18 to d0/d4/l2e 0 2024-04-01T06:57:34.811 INFO:tasks.workunit.client.0.smithi083.stdout:7/162: write d0/d4/fc [2619692,41045] 0 2024-04-01T06:57:34.811 INFO:tasks.workunit.client.0.smithi083.stdout:7/163: chown d0/l26 88984905 1 2024-04-01T06:57:34.812 INFO:tasks.workunit.client.0.smithi083.stdout:7/164: dread - d0/d10/f2d zero size 2024-04-01T06:57:34.812 INFO:tasks.workunit.client.0.smithi083.stdout:5/159: link d4/d2b/d21/l1d d4/d9/d16/d19/l32 0 2024-04-01T06:57:34.816 INFO:tasks.workunit.client.0.smithi083.stdout:5/160: mknod d4/d9/c33 0 2024-04-01T06:57:34.820 INFO:tasks.workunit.client.0.smithi083.stdout:7/165: rmdir d0/d4 39 2024-04-01T06:57:34.823 INFO:tasks.workunit.client.0.smithi083.stdout:5/161: rename d4/d2b/d21/l1d to d4/l34 0 2024-04-01T06:57:34.824 INFO:tasks.workunit.client.0.smithi083.stdout:7/166: rename d0/d10 to d0/d10/d2f 22 2024-04-01T06:57:34.825 INFO:tasks.workunit.client.0.smithi083.stdout:7/167: symlink d0/d4/l30 0 2024-04-01T06:57:34.826 INFO:tasks.workunit.client.0.smithi083.stdout:2/305: dwrite d3/f2f [0,4194304] 0 2024-04-01T06:57:34.826 INFO:tasks.workunit.client.0.smithi083.stdout:2/306: chown d3/d26/d59/d2b/f4a 7557846 1 2024-04-01T06:57:34.827 INFO:tasks.workunit.client.0.smithi083.stdout:7/168: mknod d0/c31 0 2024-04-01T06:57:34.829 INFO:tasks.workunit.client.0.smithi083.stdout:2/307: creat d3/d26/d59/d27/d4b/d53/d5e/f69 x:0 0 0 2024-04-01T06:57:34.829 INFO:tasks.workunit.client.0.smithi083.stdout:2/308: truncate d3/d20/d42/f4e 640268 0 2024-04-01T06:57:34.830 INFO:tasks.workunit.client.0.smithi083.stdout:3/310: dwrite d6/d15/f10 [0,4194304] 0 2024-04-01T06:57:34.831 INFO:tasks.workunit.client.0.smithi083.stdout:7/169: rename d0/d10/f21 to d0/d4/f32 0 2024-04-01T06:57:34.835 INFO:tasks.workunit.client.0.smithi083.stdout:3/311: link d6/d15/d2d/d2f/d42/d46/c4f d6/d15/d2d/d2f/d42/d46/d55/c6b 0 2024-04-01T06:57:34.836 INFO:tasks.workunit.client.0.smithi083.stdout:3/312: mknod d6/d15/d2d/d2f/d42/d46/c6c 0 2024-04-01T06:57:34.836 INFO:tasks.workunit.client.0.smithi083.stdout:5/162: dwrite d4/f1c [0,4194304] 0 2024-04-01T06:57:34.836 INFO:tasks.workunit.client.0.smithi083.stdout:5/163: write d4/d9/d16/d19/f1e [1083226,70740] 0 2024-04-01T06:57:34.836 INFO:tasks.workunit.client.0.smithi083.stdout:5/164: write d4/d23/f30 [4418206,33599] 0 2024-04-01T06:57:34.837 INFO:tasks.workunit.client.0.smithi083.stdout:2/309: dread d3/ff [0,4194304] 0 2024-04-01T06:57:34.837 INFO:tasks.workunit.client.0.smithi083.stdout:3/313: truncate d6/d15/d2d/d2f/d42/d5c/f68 1373700 0 2024-04-01T06:57:34.837 INFO:tasks.workunit.client.0.smithi083.stdout:3/314: chown d6/d15/d2d/d2f/d53/l61 128894 1 2024-04-01T06:57:34.839 INFO:tasks.workunit.client.0.smithi083.stdout:7/170: dread d0/f3 [0,4194304] 0 2024-04-01T06:57:34.847 INFO:tasks.workunit.client.0.smithi083.stdout:2/310: creat d3/d4d/d57/f6a x:0 0 0 2024-04-01T06:57:34.848 INFO:tasks.workunit.client.0.smithi083.stdout:3/315: mknod d6/d15/c6d 0 2024-04-01T06:57:34.851 INFO:tasks.workunit.client.0.smithi083.stdout:2/311: readlink d3/l5 0 2024-04-01T06:57:34.852 INFO:tasks.workunit.client.0.smithi083.stdout:6/178: sync 2024-04-01T06:57:34.852 INFO:tasks.workunit.client.0.smithi083.stdout:1/298: sync 2024-04-01T06:57:34.852 INFO:tasks.workunit.client.0.smithi083.stdout:9/208: sync 2024-04-01T06:57:34.852 INFO:tasks.workunit.client.0.smithi083.stdout:7/171: symlink d0/l33 0 2024-04-01T06:57:34.854 INFO:tasks.workunit.client.0.smithi083.stdout:1/299: mknod db/d1c/d1d/c6f 0 2024-04-01T06:57:34.854 INFO:tasks.workunit.client.0.smithi083.stdout:1/300: truncate db/fe 4427213 0 2024-04-01T06:57:34.856 INFO:tasks.workunit.client.0.smithi083.stdout:9/209: link d6/d32/d26/d2d/d34/l37 d6/d32/d26/d2d/d34/l44 0 2024-04-01T06:57:34.856 INFO:tasks.workunit.client.0.smithi083.stdout:9/210: read d6/d32/d26/d2d/d34/f3b [356908,35546] 0 2024-04-01T06:57:34.857 INFO:tasks.workunit.client.0.smithi083.stdout:9/211: stat d6/d32/d26/d2d/d34/l3a 0 2024-04-01T06:57:34.857 INFO:tasks.workunit.client.0.smithi083.stdout:6/179: creat d9/dc/d1b/f37 x:0 0 0 2024-04-01T06:57:34.857 INFO:tasks.workunit.client.0.smithi083.stdout:6/180: write d9/dc/f14 [1756959,33451] 0 2024-04-01T06:57:34.859 INFO:tasks.workunit.client.0.smithi083.stdout:1/301: symlink db/d1c/d2e/d30/l70 0 2024-04-01T06:57:34.860 INFO:tasks.workunit.client.0.smithi083.stdout:6/181: getdents d9/dc/d29 0 2024-04-01T06:57:34.861 INFO:tasks.workunit.client.0.smithi083.stdout:7/172: mkdir d0/d10/d34 0 2024-04-01T06:57:34.862 INFO:tasks.workunit.client.0.smithi083.stdout:9/212: rename d6/d32/f2b to d6/d32/d26/d2d/f45 0 2024-04-01T06:57:34.863 INFO:tasks.workunit.client.0.smithi083.stdout:7/173: creat d0/d10/f35 x:0 0 0 2024-04-01T06:57:34.865 INFO:tasks.workunit.client.0.smithi083.stdout:6/182: rename d9/dc/d29/c33 to d9/c38 0 2024-04-01T06:57:34.865 INFO:tasks.workunit.client.0.smithi083.stdout:9/213: symlink d6/l46 0 2024-04-01T06:57:34.867 INFO:tasks.workunit.client.0.smithi083.stdout:9/214: read d6/f19 [1459968,128235] 0 2024-04-01T06:57:34.867 INFO:tasks.workunit.client.0.smithi083.stdout:9/215: readlink d6/d32/l22 0 2024-04-01T06:57:34.867 INFO:tasks.workunit.client.0.smithi083.stdout:9/216: fdatasync d6/f2f 0 2024-04-01T06:57:34.869 INFO:tasks.workunit.client.0.smithi083.stdout:2/312: dwrite d3/fc [4194304,4194304] 0 2024-04-01T06:57:34.869 INFO:tasks.workunit.client.0.smithi083.stdout:2/313: write d3/d26/f28 [1301334,16847] 0 2024-04-01T06:57:34.872 INFO:tasks.workunit.client.0.smithi083.stdout:3/316: dwrite d6/d15/f5f [0,4194304] 0 2024-04-01T06:57:34.872 INFO:tasks.workunit.client.0.smithi083.stdout:1/302: dread fa [0,4194304] 0 2024-04-01T06:57:34.872 INFO:tasks.workunit.client.0.smithi083.stdout:3/317: write d6/d15/d2d/d2f/d42/d46/f57 [970078,86687] 0 2024-04-01T06:57:34.872 INFO:tasks.workunit.client.0.smithi083.stdout:3/318: write d6/fb [2569305,85844] 0 2024-04-01T06:57:34.873 INFO:tasks.workunit.client.0.smithi083.stdout:2/314: creat d3/d4d/d57/f6b x:0 0 0 2024-04-01T06:57:34.875 INFO:tasks.workunit.client.0.smithi083.stdout:3/319: rmdir d6/d15/d2d/d2f 39 2024-04-01T06:57:34.876 INFO:tasks.workunit.client.0.smithi083.stdout:3/320: mknod d6/d15/d2d/d2f/d42/d5c/c6e 0 2024-04-01T06:57:34.876 INFO:tasks.workunit.client.0.smithi083.stdout:3/321: stat d6/d15/f5f 0 2024-04-01T06:57:34.876 INFO:tasks.workunit.client.0.smithi083.stdout:3/322: readlink d6/d15/d2d/l3b 0 2024-04-01T06:57:34.877 INFO:tasks.workunit.client.0.smithi083.stdout:7/174: dwrite d0/d10/f2d [0,4194304] 0 2024-04-01T06:57:34.880 INFO:tasks.workunit.client.0.smithi083.stdout:3/323: mkdir d6/d1e/d6f 0 2024-04-01T06:57:34.883 INFO:tasks.workunit.client.0.smithi083.stdout:2/315: dread d3/f19 [0,4194304] 0 2024-04-01T06:57:34.884 INFO:tasks.workunit.client.0.smithi083.stdout:7/175: symlink d0/d4/d9/l36 0 2024-04-01T06:57:34.885 INFO:tasks.workunit.client.0.smithi083.stdout:3/324: symlink d6/d1e/d6f/l70 0 2024-04-01T06:57:34.887 INFO:tasks.workunit.client.0.smithi083.stdout:2/316: creat d3/d20/d42/f6c x:0 0 0 2024-04-01T06:57:34.887 INFO:tasks.workunit.client.0.smithi083.stdout:9/217: dwrite d6/d32/d26/d2d/f18 [4194304,4194304] 0 2024-04-01T06:57:34.888 INFO:tasks.workunit.client.0.smithi083.stdout:7/176: creat d0/f37 x:0 0 0 2024-04-01T06:57:34.890 INFO:tasks.workunit.client.0.smithi083.stdout:3/325: creat d6/d15/d2d/d2f/d42/f71 x:0 0 0 2024-04-01T06:57:34.890 INFO:tasks.workunit.client.0.smithi083.stdout:2/317: symlink d3/d26/d59/l6d 0 2024-04-01T06:57:34.893 INFO:tasks.workunit.client.0.smithi083.stdout:9/218: symlink d6/d32/d3c/l47 0 2024-04-01T06:57:34.894 INFO:tasks.workunit.client.0.smithi083.stdout:3/326: rename d6/d15/f14 to d6/d15/d2d/d2f/d42/d5c/f72 0 2024-04-01T06:57:34.895 INFO:tasks.workunit.client.0.smithi083.stdout:2/318: symlink d3/d26/d59/d2b/l6e 0 2024-04-01T06:57:34.895 INFO:tasks.workunit.client.0.smithi083.stdout:1/303: dwrite db/d1c/d2e/f2f [0,4194304] 0 2024-04-01T06:57:34.898 INFO:tasks.workunit.client.0.smithi083.stdout:7/177: mkdir d0/d10/d38 0 2024-04-01T06:57:34.899 INFO:tasks.workunit.client.0.smithi083.stdout:2/319: mknod d3/d4d/c6f 0 2024-04-01T06:57:34.899 INFO:tasks.workunit.client.0.smithi083.stdout:7/178: read - d0/d4/f2c zero size 2024-04-01T06:57:34.900 INFO:tasks.workunit.client.0.smithi083.stdout:2/320: getdents d3/d26 0 2024-04-01T06:57:34.900 INFO:tasks.workunit.client.0.smithi083.stdout:3/327: dread d6/fe [0,4194304] 0 2024-04-01T06:57:34.901 INFO:tasks.workunit.client.0.smithi083.stdout:7/179: getdents d0/d4 0 2024-04-01T06:57:34.901 INFO:tasks.workunit.client.0.smithi083.stdout:7/180: dread - d0/d10/f35 zero size 2024-04-01T06:57:34.903 INFO:tasks.workunit.client.0.smithi083.stdout:3/328: symlink d6/d15/d2d/d2f/d42/l73 0 2024-04-01T06:57:34.906 INFO:tasks.workunit.client.0.smithi083.stdout:7/181: mkdir d0/d4/d9/d39 0 2024-04-01T06:57:34.906 INFO:tasks.workunit.client.0.smithi083.stdout:7/182: readlink d0/d4/l30 0 2024-04-01T06:57:34.908 INFO:tasks.workunit.client.0.smithi083.stdout:3/329: getdents d6/d12 0 2024-04-01T06:57:34.908 INFO:tasks.workunit.client.0.smithi083.stdout:1/304: dread db/d1c/d29/d33/f4a [0,4194304] 0 2024-04-01T06:57:34.909 INFO:tasks.workunit.client.0.smithi083.stdout:3/330: write d6/f40 [3507365,50642] 0 2024-04-01T06:57:34.909 INFO:tasks.workunit.client.0.smithi083.stdout:7/183: mknod d0/d10/d38/c3a 0 2024-04-01T06:57:34.912 INFO:tasks.workunit.client.0.smithi083.stdout:1/305: rmdir db/d1c/d29/d33/d4b 39 2024-04-01T06:57:34.912 INFO:tasks.workunit.client.0.smithi083.stdout:2/321: dwrite d3/d26/d59/d2b/f32 [0,4194304] 0 2024-04-01T06:57:34.913 INFO:tasks.workunit.client.0.smithi083.stdout:3/331: mkdir d6/d15/d2d/d2f/d3e/d74 0 2024-04-01T06:57:34.914 INFO:tasks.workunit.client.0.smithi083.stdout:7/184: symlink d0/d4/l3b 0 2024-04-01T06:57:34.914 INFO:tasks.workunit.client.0.smithi083.stdout:7/185: chown d0/l26 48 1 2024-04-01T06:57:34.915 INFO:tasks.workunit.client.0.smithi083.stdout:1/306: creat db/d1c/d29/d33/d50/d5d/d6c/f71 x:0 0 0 2024-04-01T06:57:34.919 INFO:tasks.workunit.client.0.smithi083.stdout:7/186: creat d0/d10/f3c x:0 0 0 2024-04-01T06:57:34.919 INFO:tasks.workunit.client.0.smithi083.stdout:1/307: creat db/d1c/d1d/f72 x:0 0 0 2024-04-01T06:57:34.920 INFO:tasks.workunit.client.0.smithi083.stdout:1/308: mkdir db/d1c/d29/d33/d50/d4d/d73 0 2024-04-01T06:57:34.921 INFO:tasks.workunit.client.0.smithi083.stdout:1/309: dread db/d1c/d2e/d30/f3a [0,4194304] 0 2024-04-01T06:57:34.930 INFO:tasks.workunit.client.0.smithi083.stdout:3/332: dwrite d6/d15/d2d/d2f/d42/d46/f58 [0,4194304] 0 2024-04-01T06:57:34.936 INFO:tasks.workunit.client.0.smithi083.stdout:7/187: dread d0/d4/d9/f1c [0,4194304] 0 2024-04-01T06:57:34.937 INFO:tasks.workunit.client.0.smithi083.stdout:1/310: dread db/d1c/d1d/f4c [0,4194304] 0 2024-04-01T06:57:34.938 INFO:tasks.workunit.client.0.smithi083.stdout:2/322: dwrite d3/d4d/d57/f6b [0,4194304] 0 2024-04-01T06:57:34.938 INFO:tasks.workunit.client.0.smithi083.stdout:2/323: write d3/d4d/f52 [1697052,36150] 0 2024-04-01T06:57:34.938 INFO:tasks.workunit.client.0.smithi083.stdout:1/311: read db/d1c/d29/d33/d4b/f51 [2082918,39586] 0 2024-04-01T06:57:34.938 INFO:tasks.workunit.client.0.smithi083.stdout:1/312: chown db/d61/c68 302388240 1 2024-04-01T06:57:34.939 INFO:tasks.workunit.client.0.smithi083.stdout:3/333: dread d6/d15/f3a [0,4194304] 0 2024-04-01T06:57:34.942 INFO:tasks.workunit.client.0.smithi083.stdout:7/188: dread d0/d4/ff [0,4194304] 0 2024-04-01T06:57:34.945 INFO:tasks.workunit.client.0.smithi083.stdout:2/324: rename d3/d26/d59/d27/d4b to d3/d26/d59/d70 0 2024-04-01T06:57:34.947 INFO:tasks.workunit.client.0.smithi083.stdout:3/334: creat d6/d15/d2d/d2f/d3e/d74/f75 x:0 0 0 2024-04-01T06:57:34.950 INFO:tasks.workunit.client.0.smithi083.stdout:1/313: rename db/d1c/f36 to db/d1c/d29/d33/d50/d5d/d6c/f74 0 2024-04-01T06:57:34.951 INFO:tasks.workunit.client.0.smithi083.stdout:3/335: getdents d6/d15/d2d/d2f/d42/d46/d55 0 2024-04-01T06:57:34.951 INFO:tasks.workunit.client.0.smithi083.stdout:3/336: truncate d6/d15/d2d/d2f/d42/d46/f5e 504780 0 2024-04-01T06:57:34.953 INFO:tasks.workunit.client.0.smithi083.stdout:1/314: mknod db/d1c/d29/d33/d50/d5d/c75 0 2024-04-01T06:57:34.955 INFO:tasks.workunit.client.0.smithi083.stdout:1/315: mkdir db/d1c/d29/d33/d47/d76 0 2024-04-01T06:57:34.956 INFO:tasks.workunit.client.0.smithi083.stdout:1/316: symlink db/d1c/d29/d33/d4b/l77 0 2024-04-01T06:57:34.957 INFO:tasks.workunit.client.0.smithi083.stdout:1/317: write db/d1c/d29/d33/d50/f27 [3637613,51756] 0 2024-04-01T06:57:34.957 INFO:tasks.workunit.client.0.smithi083.stdout:1/318: write db/d1c/d29/d33/f59 [447058,43108] 0 2024-04-01T06:57:34.958 INFO:tasks.workunit.client.0.smithi083.stdout:1/319: read db/fe [2423100,36871] 0 2024-04-01T06:57:34.958 INFO:tasks.workunit.client.0.smithi083.stdout:1/320: chown db/d1c/d2e/d30/l3f 1858854 1 2024-04-01T06:57:34.958 INFO:tasks.workunit.client.0.smithi083.stdout:1/321: write db/f10 [1285414,16019] 0 2024-04-01T06:57:34.963 INFO:tasks.workunit.client.0.smithi083.stdout:2/325: dwrite d3/d26/d59/d70/d53/f60 [0,4194304] 0 2024-04-01T06:57:34.964 INFO:tasks.workunit.client.0.smithi083.stdout:1/322: dread db/d1c/d2e/f34 [0,4194304] 0 2024-04-01T06:57:34.965 INFO:tasks.workunit.client.0.smithi083.stdout:3/337: dwrite d6/d15/f1c [0,4194304] 0 2024-04-01T06:57:34.966 INFO:tasks.workunit.client.0.smithi083.stdout:1/323: dread db/d1c/f24 [0,4194304] 0 2024-04-01T06:57:34.966 INFO:tasks.workunit.client.0.smithi083.stdout:2/326: mkdir d3/d71 0 2024-04-01T06:57:34.967 INFO:tasks.workunit.client.0.smithi083.stdout:1/324: write db/d1c/d2e/f34 [2239109,71059] 0 2024-04-01T06:57:34.967 INFO:tasks.workunit.client.0.smithi083.stdout:1/325: chown db/l43 21 1 2024-04-01T06:57:34.967 INFO:tasks.workunit.client.0.smithi083.stdout:1/326: chown db/d1c/d1d/c6f 75 1 2024-04-01T06:57:34.971 INFO:tasks.workunit.client.0.smithi083.stdout:1/327: mknod db/d1c/d49/c78 0 2024-04-01T06:57:34.974 INFO:tasks.workunit.client.0.smithi083.stdout:1/328: creat db/d1c/d29/d33/d50/d4d/d73/f79 x:0 0 0 2024-04-01T06:57:34.974 INFO:tasks.workunit.client.0.smithi083.stdout:1/329: fsync db/d1c/f35 0 2024-04-01T06:57:34.974 INFO:tasks.workunit.client.0.smithi083.stdout:1/330: chown db/d1c/f25 171692867 1 2024-04-01T06:57:34.975 INFO:tasks.workunit.client.0.smithi083.stdout:1/331: mknod db/d1c/d29/c7a 0 2024-04-01T06:57:34.976 INFO:tasks.workunit.client.0.smithi083.stdout:1/332: link db/d1c/d2e/f38 db/d1c/d29/d33/d50/f7b 0 2024-04-01T06:57:34.978 INFO:tasks.workunit.client.0.smithi083.stdout:1/333: rename db/d1c/d1d/f72 to db/d1c/d29/d33/d50/d5d/d6c/f7c 0 2024-04-01T06:57:34.978 INFO:tasks.workunit.client.0.smithi083.stdout:3/338: dwrite d6/d15/d2d/d2f/d42/d46/f69 [0,4194304] 0 2024-04-01T06:57:34.980 INFO:tasks.workunit.client.0.smithi083.stdout:4/159: sync 2024-04-01T06:57:34.980 INFO:tasks.workunit.client.0.smithi083.stdout:8/260: sync 2024-04-01T06:57:34.980 INFO:tasks.workunit.client.0.smithi083.stdout:4/160: stat c0 0 2024-04-01T06:57:34.980 INFO:tasks.workunit.client.0.smithi083.stdout:8/261: chown d15/d18/d19/d24/d38/d62/f4c 6231100 1 2024-04-01T06:57:34.980 INFO:tasks.workunit.client.0.smithi083.stdout:8/262: fsync d15/d18/d19/d24/d38/f47 0 2024-04-01T06:57:34.980 INFO:tasks.workunit.client.0.smithi083.stdout:8/263: dread - d15/d18/d19/d24/d38/f47 zero size 2024-04-01T06:57:34.980 INFO:tasks.workunit.client.0.smithi083.stdout:3/339: creat d6/d15/d2d/d2f/d42/f76 x:0 0 0 2024-04-01T06:57:34.980 INFO:tasks.workunit.client.0.smithi083.stdout:4/161: symlink d1/d4/da/l32 0 2024-04-01T06:57:34.981 INFO:tasks.workunit.client.0.smithi083.stdout:8/264: rename d15/f33 to d15/d18/f64 0 2024-04-01T06:57:34.981 INFO:tasks.workunit.client.0.smithi083.stdout:4/162: write d1/d4/f25 [1033309,56289] 0 2024-04-01T06:57:34.982 INFO:tasks.workunit.client.0.smithi083.stdout:3/340: mknod d6/d15/d2d/d2f/d53/c77 0 2024-04-01T06:57:34.983 INFO:tasks.workunit.client.0.smithi083.stdout:8/265: mknod d15/d18/d19/d24/c65 0 2024-04-01T06:57:34.983 INFO:tasks.workunit.client.0.smithi083.stdout:8/266: chown d15/d1b/d39/d48/f56 20538258 1 2024-04-01T06:57:34.984 INFO:tasks.workunit.client.0.smithi083.stdout:8/267: write d15/d18/d19/d1d/f36 [3028765,70762] 0 2024-04-01T06:57:34.984 INFO:tasks.workunit.client.0.smithi083.stdout:4/163: mkdir d1/d4/d33 0 2024-04-01T06:57:34.986 INFO:tasks.workunit.client.0.smithi083.stdout:3/341: link d6/d1e/f2b d6/d15/d2d/d2f/d42/d5c/f78 0 2024-04-01T06:57:34.987 INFO:tasks.workunit.client.0.smithi083.stdout:8/268: creat d15/d1b/d39/d48/d5e/f66 x:0 0 0 2024-04-01T06:57:34.988 INFO:tasks.workunit.client.0.smithi083.stdout:8/269: creat d15/f67 x:0 0 0 2024-04-01T06:57:34.990 INFO:tasks.workunit.client.0.smithi083.stdout:8/270: creat d15/d1b/d39/d48/f68 x:0 0 0 2024-04-01T06:57:34.991 INFO:tasks.workunit.client.0.smithi083.stdout:8/271: mknod d15/d1b/c69 0 2024-04-01T06:57:34.993 INFO:tasks.workunit.client.0.smithi083.stdout:8/272: symlink d15/d21/l6a 0 2024-04-01T06:57:34.994 INFO:tasks.workunit.client.0.smithi083.stdout:4/164: dread d1/f2 [0,4194304] 0 2024-04-01T06:57:34.994 INFO:tasks.workunit.client.0.smithi083.stdout:4/165: readlink d1/d4/da/l32 0 2024-04-01T06:57:34.994 INFO:tasks.workunit.client.0.smithi083.stdout:8/273: mkdir d15/d1b/d39/d48/d5e/d6b 0 2024-04-01T06:57:34.996 INFO:tasks.workunit.client.0.smithi083.stdout:4/166: mknod d1/d4/d1f/d2a/c34 0 2024-04-01T06:57:34.999 INFO:tasks.workunit.client.0.smithi083.stdout:1/334: dwrite db/d1c/d2e/d30/f3a [0,4194304] 0 2024-04-01T06:57:34.999 INFO:tasks.workunit.client.0.smithi083.stdout:1/335: readlink db/d1c/d2e/l5f 0 2024-04-01T06:57:34.999 INFO:tasks.workunit.client.0.smithi083.stdout:1/336: write db/fd [182325,123086] 0 2024-04-01T06:57:35.000 INFO:tasks.workunit.client.0.smithi083.stdout:1/337: creat db/d1c/d49/f7d x:0 0 0 2024-04-01T06:57:35.002 INFO:tasks.workunit.client.0.smithi083.stdout:3/342: dwrite d6/d15/f11 [4194304,4194304] 0 2024-04-01T06:57:35.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:34 smithi145 ceph-mon[47816]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:35.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:34 smithi145 ceph-mon[47816]: scrub summary: active paths [/] 2024-04-01T06:57:35.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:34 smithi145 ceph-mon[47816]: pgmap v54: 97 pgs: 97 active+clean; 125 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.1 MiB/s wr, 648 op/s 2024-04-01T06:57:35.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:34 smithi145 ceph-mon[47816]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:35.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:34 smithi145 ceph-mon[47816]: scrub summary: active paths [/] 2024-04-01T06:57:35.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:34 smithi145 ceph-mon[47816]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:35.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:34 smithi145 ceph-mon[47816]: scrub summary: active paths [/] 2024-04-01T06:57:35.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:34 smithi145 ceph-mon[47816]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:35.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:34 smithi145 ceph-mon[47816]: scrub summary: active paths [/] 2024-04-01T06:57:35.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:34 smithi145 ceph-mon[47816]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:35.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:34 smithi145 ceph-mon[47816]: scrub summary: active paths [/] 2024-04-01T06:57:35.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:34 smithi145 ceph-mon[47816]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:35.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:34 smithi145 ceph-mon[47816]: scrub summary: active paths [/] 2024-04-01T06:57:35.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:34 smithi145 ceph-mon[47816]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:35.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:34 smithi145 ceph-mon[47816]: scrub summary: active paths [/] 2024-04-01T06:57:35.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:34 smithi145 ceph-mon[47816]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:35.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:34 smithi145 ceph-mon[47816]: scrub summary: active paths [/] 2024-04-01T06:57:35.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:34 smithi145 ceph-mon[47816]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:35.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:34 smithi145 ceph-mon[47816]: scrub summary: active paths [/] 2024-04-01T06:57:35.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:34 smithi145 ceph-mon[47816]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:35.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:34 smithi145 ceph-mon[47816]: scrub summary: active paths [/] 2024-04-01T06:57:35.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:34 smithi145 ceph-mon[47816]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:35.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:34 smithi145 ceph-mon[47816]: scrub summary: active paths [/] 2024-04-01T06:57:35.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:34 smithi145 ceph-mon[47816]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:35.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:34 smithi145 ceph-mon[47816]: scrub summary: active paths [/] 2024-04-01T06:57:35.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:34 smithi145 ceph-mon[47816]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:35.005 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:34 smithi145 ceph-mon[47816]: scrub summary: active paths [/] 2024-04-01T06:57:35.005 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:34 smithi145 ceph-mon[47816]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:35.005 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:34 smithi145 ceph-mon[47816]: scrub summary: active paths [/] 2024-04-01T06:57:35.005 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:34 smithi145 ceph-mon[47816]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:35.005 INFO:tasks.workunit.client.0.smithi083.stdout:3/343: rmdir d6/d12 39 2024-04-01T06:57:35.007 INFO:tasks.workunit.client.0.smithi083.stdout:3/344: creat d6/d15/d2d/d2f/d42/d46/d55/f79 x:0 0 0 2024-04-01T06:57:35.008 INFO:tasks.workunit.client.0.smithi083.stdout:3/345: mknod d6/d15/d2d/d2f/d53/c7a 0 2024-04-01T06:57:35.008 INFO:tasks.workunit.client.0.smithi083.stdout:3/346: truncate d6/d15/f5f 372144 0 2024-04-01T06:57:35.010 INFO:tasks.workunit.client.0.smithi083.stdout:3/347: rename d6/d1e/f3d to d6/d1e/f7b 0 2024-04-01T06:57:35.011 INFO:tasks.workunit.client.0.smithi083.stdout:3/348: symlink d6/d15/d2d/d2f/d42/d46/d55/d67/l7c 0 2024-04-01T06:57:35.012 INFO:tasks.workunit.client.0.smithi083.stdout:8/274: dwrite d15/d1b/d39/d48/d5e/f66 [0,4194304] 0 2024-04-01T06:57:35.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:34 smithi083 ceph-mon[43429]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:35.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:34 smithi083 ceph-mon[43429]: scrub summary: active paths [/] 2024-04-01T06:57:35.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:34 smithi083 ceph-mon[43429]: pgmap v54: 97 pgs: 97 active+clean; 125 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.1 MiB/s wr, 648 op/s 2024-04-01T06:57:35.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:34 smithi083 ceph-mon[43429]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:35.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:34 smithi083 ceph-mon[43429]: scrub summary: active paths [/] 2024-04-01T06:57:35.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:34 smithi083 ceph-mon[43429]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:35.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:34 smithi083 ceph-mon[43429]: scrub summary: active paths [/] 2024-04-01T06:57:35.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:34 smithi083 ceph-mon[43429]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:35.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:34 smithi083 ceph-mon[43429]: scrub summary: active paths [/] 2024-04-01T06:57:35.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:34 smithi083 ceph-mon[43429]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:35.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:34 smithi083 ceph-mon[43429]: scrub summary: active paths [/] 2024-04-01T06:57:35.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:34 smithi083 ceph-mon[43429]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:35.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:34 smithi083 ceph-mon[43429]: scrub summary: active paths [/] 2024-04-01T06:57:35.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:34 smithi083 ceph-mon[43429]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:35.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:34 smithi083 ceph-mon[43429]: scrub summary: active paths [/] 2024-04-01T06:57:35.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:34 smithi083 ceph-mon[43429]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:35.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:34 smithi083 ceph-mon[43429]: scrub summary: active paths [/] 2024-04-01T06:57:35.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:34 smithi083 ceph-mon[43429]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:35.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:34 smithi083 ceph-mon[43429]: scrub summary: active paths [/] 2024-04-01T06:57:35.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:34 smithi083 ceph-mon[43429]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:35.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:34 smithi083 ceph-mon[43429]: scrub summary: active paths [/] 2024-04-01T06:57:35.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:34 smithi083 ceph-mon[43429]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:35.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:34 smithi083 ceph-mon[43429]: scrub summary: active paths [/] 2024-04-01T06:57:35.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:34 smithi083 ceph-mon[43429]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:35.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:34 smithi083 ceph-mon[43429]: scrub summary: active paths [/] 2024-04-01T06:57:35.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:34 smithi083 ceph-mon[43429]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:35.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:34 smithi083 ceph-mon[43429]: scrub summary: active paths [/] 2024-04-01T06:57:35.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:34 smithi083 ceph-mon[43429]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:35.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:34 smithi083 ceph-mon[43429]: scrub summary: active paths [/] 2024-04-01T06:57:35.015 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:34 smithi083 ceph-mon[43429]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:35.015 INFO:tasks.workunit.client.0.smithi083.stdout:4/167: rmdir d1 39 2024-04-01T06:57:35.016 INFO:tasks.workunit.client.0.smithi083.stdout:4/168: link d1/d8/c21 d1/d4/d1f/d2a/c35 0 2024-04-01T06:57:35.017 INFO:tasks.workunit.client.0.smithi083.stdout:4/169: write d1/d4/d1f/d2a/f2f [270079,125928] 0 2024-04-01T06:57:35.020 INFO:tasks.workunit.client.0.smithi083.stdout:1/338: dwrite db/f11 [0,4194304] 0 2024-04-01T06:57:35.022 INFO:tasks.workunit.client.0.smithi083.stdout:1/339: symlink db/d1c/d29/d33/l7e 0 2024-04-01T06:57:35.022 INFO:tasks.workunit.client.0.smithi083.stdout:1/340: chown db/d1c/d1d/f40 105 1 2024-04-01T06:57:35.023 INFO:tasks.workunit.client.0.smithi083.stdout:1/341: truncate db/d1c/d29/d33/d50/d5d/d6c/f71 556220 0 2024-04-01T06:57:35.023 INFO:tasks.workunit.client.0.smithi083.stdout:3/349: dread d6/f40 [0,4194304] 0 2024-04-01T06:57:35.023 INFO:tasks.workunit.client.0.smithi083.stdout:4/170: dread d1/d4/d1f/d2a/f2f [0,4194304] 0 2024-04-01T06:57:35.024 INFO:tasks.workunit.client.0.smithi083.stdout:4/171: chown d1/c15 1805974 1 2024-04-01T06:57:35.024 INFO:tasks.workunit.client.0.smithi083.stdout:4/172: write d1/d8/f14 [140232,4198] 0 2024-04-01T06:57:35.025 INFO:tasks.workunit.client.0.smithi083.stdout:4/173: creat d1/d4/d1f/d2a/f36 x:0 0 0 2024-04-01T06:57:35.027 INFO:tasks.workunit.client.0.smithi083.stdout:4/174: creat d1/f37 x:0 0 0 2024-04-01T06:57:35.027 INFO:tasks.workunit.client.0.smithi083.stdout:4/175: stat d1/d4/da 0 2024-04-01T06:57:35.037 INFO:tasks.workunit.client.0.smithi083.stdout:8/275: dwrite d15/d18/f64 [0,4194304] 0 2024-04-01T06:57:35.037 INFO:tasks.workunit.client.0.smithi083.stdout:8/276: write d15/d18/f37 [411804,76256] 0 2024-04-01T06:57:35.039 INFO:tasks.workunit.client.0.smithi083.stdout:1/342: dwrite db/d1c/d29/d33/d50/f27 [0,4194304] 0 2024-04-01T06:57:35.039 INFO:tasks.workunit.client.0.smithi083.stdout:1/343: write db/fd [257572,69178] 0 2024-04-01T06:57:35.040 INFO:tasks.workunit.client.0.smithi083.stdout:3/350: dwrite d6/f40 [0,4194304] 0 2024-04-01T06:57:35.040 INFO:tasks.workunit.client.0.smithi083.stdout:3/351: fsync d6/d15/d2d/d2f/d42/d46/f69 0 2024-04-01T06:57:35.043 INFO:tasks.workunit.client.0.smithi083.stdout:8/277: mkdir d15/d18/d19/d6c 0 2024-04-01T06:57:35.045 INFO:tasks.workunit.client.0.smithi083.stdout:1/344: rename db/d1c/d29/d33/l7e to db/d1c/d1d/l7f 0 2024-04-01T06:57:35.046 INFO:tasks.workunit.client.0.smithi083.stdout:3/352: creat d6/d12/f7d x:0 0 0 2024-04-01T06:57:35.048 INFO:tasks.workunit.client.0.smithi083.stdout:8/278: mknod d15/d18/d19/d24/c6d 0 2024-04-01T06:57:35.048 INFO:tasks.workunit.client.0.smithi083.stdout:8/279: dread - d15/d18/d19/d24/d38/f41 zero size 2024-04-01T06:57:35.049 INFO:tasks.workunit.client.0.smithi083.stdout:8/280: readlink l8 0 2024-04-01T06:57:35.049 INFO:tasks.workunit.client.0.smithi083.stdout:3/353: creat d6/d15/d2d/d2f/d42/d46/f7e x:0 0 0 2024-04-01T06:57:35.049 INFO:tasks.workunit.client.0.smithi083.stdout:8/281: creat d15/d1b/d39/d48/f6e x:0 0 0 2024-04-01T06:57:35.051 INFO:tasks.workunit.client.0.smithi083.stdout:3/354: unlink d6/d15/d2d/d2f/d42/d46/d55/l5d 0 2024-04-01T06:57:35.051 INFO:tasks.workunit.client.0.smithi083.stdout:3/355: fsync d6/d12/f47 0 2024-04-01T06:57:35.051 INFO:tasks.workunit.client.0.smithi083.stdout:8/282: stat d15/l16 0 2024-04-01T06:57:35.055 INFO:tasks.workunit.client.0.smithi083.stdout:0/229: sync 2024-04-01T06:57:35.058 INFO:tasks.workunit.client.0.smithi083.stdout:8/283: dread f9 [0,4194304] 0 2024-04-01T06:57:35.059 INFO:tasks.workunit.client.0.smithi083.stdout:8/284: mkdir d15/d1b/d39/d48/d5e/d6b/d6f 0 2024-04-01T06:57:35.060 INFO:tasks.workunit.client.0.smithi083.stdout:8/285: mkdir d15/d1b/d39/d48/d5e/d70 0 2024-04-01T06:57:35.060 INFO:tasks.workunit.client.0.smithi083.stdout:8/286: chown f7 269981 1 2024-04-01T06:57:35.061 INFO:tasks.workunit.client.0.smithi083.stdout:8/287: creat d15/d18/d19/f71 x:0 0 0 2024-04-01T06:57:35.061 INFO:tasks.workunit.client.0.smithi083.stdout:8/288: getdents d15/d18/d19/d24/d44 0 2024-04-01T06:57:35.061 INFO:tasks.workunit.client.0.smithi083.stdout:8/289: read - d15/d18/d19/f71 zero size 2024-04-01T06:57:35.062 INFO:tasks.workunit.client.0.smithi083.stdout:8/290: rename d15/d18/d19/d24/l4d to d15/d18/d1e/l72 0 2024-04-01T06:57:35.062 INFO:tasks.workunit.client.0.smithi083.stdout:8/291: stat d15/d18 0 2024-04-01T06:57:35.063 INFO:tasks.workunit.client.0.smithi083.stdout:3/356: dwrite d6/d12/f7d [0,4194304] 0 2024-04-01T06:57:35.064 INFO:tasks.workunit.client.0.smithi083.stdout:0/230: dread f10 [0,4194304] 0 2024-04-01T06:57:35.067 INFO:tasks.workunit.client.0.smithi083.stdout:0/231: mkdir d16/d3a/d4b 0 2024-04-01T06:57:35.068 INFO:tasks.workunit.client.0.smithi083.stdout:0/232: creat d16/f4c x:0 0 0 2024-04-01T06:57:35.068 INFO:tasks.workunit.client.0.smithi083.stdout:0/233: stat d16/d1d/l44 0 2024-04-01T06:57:35.068 INFO:tasks.workunit.client.0.smithi083.stdout:0/234: truncate d16/d2e/d3d/f40 913714 0 2024-04-01T06:57:35.090 INFO:tasks.workunit.client.0.smithi083.stdout:8/292: dwrite d15/d18/d19/d1d/f2d [0,4194304] 0 2024-04-01T06:57:35.091 INFO:tasks.workunit.client.0.smithi083.stdout:8/293: chown d15/d18/d19/d24/l63 10 1 2024-04-01T06:57:35.091 INFO:tasks.workunit.client.0.smithi083.stdout:3/357: dwrite d6/d1e/f23 [0,4194304] 0 2024-04-01T06:57:35.093 INFO:tasks.workunit.client.0.smithi083.stdout:0/235: dwrite d16/d3a/f3c [0,4194304] 0 2024-04-01T06:57:35.098 INFO:tasks.workunit.client.0.smithi083.stdout:0/236: link d16/d1d/f46 d16/d2e/d3d/f4d 0 2024-04-01T06:57:35.098 INFO:tasks.workunit.client.0.smithi083.stdout:0/237: chown d16/d1d/l27 2 1 2024-04-01T06:57:35.098 INFO:tasks.workunit.client.0.smithi083.stdout:0/238: rename d16/d1d/f24 to d16/d2e/d3d/f4e 0 2024-04-01T06:57:35.098 INFO:tasks.workunit.client.0.smithi083.stdout:0/239: write fd [184962,48167] 0 2024-04-01T06:57:35.103 INFO:tasks.workunit.client.0.smithi083.stdout:8/294: dwrite d15/f3c [0,4194304] 0 2024-04-01T06:57:35.105 INFO:tasks.workunit.client.0.smithi083.stdout:8/295: link fa d15/d1b/d39/d48/d5e/f73 0 2024-04-01T06:57:35.108 INFO:tasks.workunit.client.0.smithi083.stdout:8/296: creat d15/f74 x:0 0 0 2024-04-01T06:57:35.109 INFO:tasks.workunit.client.0.smithi083.stdout:8/297: mkdir d15/d18/d19/d24/d44/d75 0 2024-04-01T06:57:35.111 INFO:tasks.workunit.client.0.smithi083.stdout:8/298: mknod d15/d1b/d39/c76 0 2024-04-01T06:57:35.111 INFO:tasks.workunit.client.0.smithi083.stdout:8/299: fsync d15/f5c 0 2024-04-01T06:57:35.112 INFO:tasks.workunit.client.0.smithi083.stdout:8/300: creat d15/d1b/d39/d48/d5e/d70/f77 x:0 0 0 2024-04-01T06:57:35.112 INFO:tasks.workunit.client.0.smithi083.stdout:8/301: chown d15/d18/d19/d1d/f2d 234972958 1 2024-04-01T06:57:35.112 INFO:tasks.workunit.client.0.smithi083.stdout:8/302: fsync d15/d18/d19/d24/d38/f41 0 2024-04-01T06:57:35.121 INFO:tasks.workunit.client.0.smithi083.stdout:8/303: dread d15/d1b/d39/d48/d5e/f66 [0,4194304] 0 2024-04-01T06:57:35.121 INFO:tasks.workunit.client.0.smithi083.stdout:8/304: dread - d15/d1b/d39/d48/f68 zero size 2024-04-01T06:57:35.121 INFO:tasks.workunit.client.0.smithi083.stdout:8/305: readlink d15/d1b/d39/d48/l57 0 2024-04-01T06:57:35.121 INFO:tasks.workunit.client.0.smithi083.stdout:8/306: dread - d15/d18/d19/d1d/f60 zero size 2024-04-01T06:57:35.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:34 smithi153 ceph-mon[48187]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:35.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:34 smithi153 ceph-mon[48187]: scrub summary: active paths [/] 2024-04-01T06:57:35.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:34 smithi153 ceph-mon[48187]: pgmap v54: 97 pgs: 97 active+clean; 125 MiB data, 658 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.1 MiB/s wr, 648 op/s 2024-04-01T06:57:35.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:34 smithi153 ceph-mon[48187]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:35.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:34 smithi153 ceph-mon[48187]: scrub summary: active paths [/] 2024-04-01T06:57:35.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:34 smithi153 ceph-mon[48187]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:35.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:34 smithi153 ceph-mon[48187]: scrub summary: active paths [/] 2024-04-01T06:57:35.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:34 smithi153 ceph-mon[48187]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:35.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:34 smithi153 ceph-mon[48187]: scrub summary: active paths [/] 2024-04-01T06:57:35.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:34 smithi153 ceph-mon[48187]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:35.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:34 smithi153 ceph-mon[48187]: scrub summary: active paths [/] 2024-04-01T06:57:35.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:34 smithi153 ceph-mon[48187]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:35.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:34 smithi153 ceph-mon[48187]: scrub summary: active paths [/] 2024-04-01T06:57:35.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:34 smithi153 ceph-mon[48187]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:35.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:34 smithi153 ceph-mon[48187]: scrub summary: active paths [/] 2024-04-01T06:57:35.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:34 smithi153 ceph-mon[48187]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:35.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:34 smithi153 ceph-mon[48187]: scrub summary: active paths [/] 2024-04-01T06:57:35.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:34 smithi153 ceph-mon[48187]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:35.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:34 smithi153 ceph-mon[48187]: scrub summary: active paths [/] 2024-04-01T06:57:35.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:34 smithi153 ceph-mon[48187]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:35.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:34 smithi153 ceph-mon[48187]: scrub summary: active paths [/] 2024-04-01T06:57:35.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:34 smithi153 ceph-mon[48187]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:35.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:34 smithi153 ceph-mon[48187]: scrub summary: active paths [/] 2024-04-01T06:57:35.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:34 smithi153 ceph-mon[48187]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:35.143 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:34 smithi153 ceph-mon[48187]: scrub summary: active paths [/] 2024-04-01T06:57:35.143 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:34 smithi153 ceph-mon[48187]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:35.143 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:34 smithi153 ceph-mon[48187]: scrub summary: active paths [/] 2024-04-01T06:57:35.143 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:34 smithi153 ceph-mon[48187]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:35.143 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:34 smithi153 ceph-mon[48187]: scrub summary: active paths [/] 2024-04-01T06:57:35.143 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:34 smithi153 ceph-mon[48187]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:35.848 INFO:tasks.workunit.client.0.smithi083.stdout:6/183: sync 2024-04-01T06:57:35.848 INFO:tasks.workunit.client.0.smithi083.stdout:8/307: sync 2024-04-01T06:57:35.848 INFO:tasks.workunit.client.0.smithi083.stdout:4/176: sync 2024-04-01T06:57:35.848 INFO:tasks.workunit.client.0.smithi083.stdout:5/165: sync 2024-04-01T06:57:35.848 INFO:tasks.workunit.client.0.smithi083.stdout:2/327: sync 2024-04-01T06:57:35.848 INFO:tasks.workunit.client.0.smithi083.stdout:1/345: sync 2024-04-01T06:57:35.848 INFO:tasks.workunit.client.0.smithi083.stdout:7/189: sync 2024-04-01T06:57:35.848 INFO:tasks.workunit.client.0.smithi083.stdout:9/219: sync 2024-04-01T06:57:35.848 INFO:tasks.workunit.client.0.smithi083.stdout:0/240: sync 2024-04-01T06:57:35.848 INFO:tasks.workunit.client.0.smithi083.stdout:3/358: sync 2024-04-01T06:57:35.848 INFO:tasks.workunit.client.0.smithi083.stdout:9/220: chown d6/d32/d26/d2d/d34/l3a 31106 1 2024-04-01T06:57:35.849 INFO:tasks.workunit.client.0.smithi083.stdout:5/166: write d4/d23/f30 [1670293,106300] 0 2024-04-01T06:57:35.849 INFO:tasks.workunit.client.0.smithi083.stdout:5/167: write d4/d23/f29 [1385474,59660] 0 2024-04-01T06:57:35.849 INFO:tasks.workunit.client.0.smithi083.stdout:5/168: chown d4/fb 2441396 1 2024-04-01T06:57:35.849 INFO:tasks.workunit.client.0.smithi083.stdout:6/184: write d9/f19 [4770542,121802] 0 2024-04-01T06:57:35.849 INFO:tasks.workunit.client.0.smithi083.stdout:2/328: write d3/d20/f3f [828052,114573] 0 2024-04-01T06:57:35.861 INFO:tasks.workunit.client.0.smithi083.stdout:8/308: symlink d15/d1b/d39/d48/d5e/d6b/d6f/l78 0 2024-04-01T06:57:35.863 INFO:tasks.workunit.client.0.smithi083.stdout:1/346: symlink db/d1c/d29/d33/l80 0 2024-04-01T06:57:35.864 INFO:tasks.workunit.client.0.smithi083.stdout:7/190: rename d0/d4/d9/l13 to d0/d4/d9/l3d 0 2024-04-01T06:57:35.866 INFO:tasks.workunit.client.0.smithi083.stdout:0/241: symlink d16/d1d/l4f 0 2024-04-01T06:57:35.868 INFO:tasks.workunit.client.0.smithi083.stdout:0/242: dread d16/d1d/f23 [0,4194304] 0 2024-04-01T06:57:35.868 INFO:tasks.workunit.client.0.smithi083.stdout:0/243: write d16/d1d/f2b [950763,90330] 0 2024-04-01T06:57:35.870 INFO:tasks.workunit.client.0.smithi083.stdout:0/244: write d16/d2e/d3d/f4d [7090747,48808] 0 2024-04-01T06:57:35.875 INFO:tasks.workunit.client.0.smithi083.stdout:1/347: dread db/d1c/d29/d33/f4a [0,4194304] 0 2024-04-01T06:57:35.878 INFO:tasks.workunit.client.0.smithi083.stdout:8/309: dwrite d15/d21/f2c [4194304,4194304] 0 2024-04-01T06:57:35.878 INFO:tasks.workunit.client.0.smithi083.stdout:7/191: dwrite d0/d4/f1e [0,4194304] 0 2024-04-01T06:57:35.897 INFO:tasks.workunit.client.0.smithi083.stdout:8/310: dwrite fa [4194304,4194304] 0 2024-04-01T06:57:35.897 INFO:tasks.workunit.client.0.smithi083.stdout:7/192: dwrite d0/d4/d9/f22 [0,4194304] 0 2024-04-01T06:57:35.897 INFO:tasks.workunit.client.0.smithi083.stdout:7/193: chown d0/l26 28 1 2024-04-01T06:57:35.980 INFO:tasks.workunit.client.0.smithi083.stdout:3/359: rename d6/d15/d2d/c4e to d6/d15/d2d/d2f/d53/c7f 0 2024-04-01T06:57:35.981 INFO:tasks.workunit.client.0.smithi083.stdout:9/221: rmdir d6/d32/d3c/d3d 39 2024-04-01T06:57:35.982 INFO:tasks.workunit.client.0.smithi083.stdout:6/185: unlink d9/dc/f16 0 2024-04-01T06:57:35.982 INFO:tasks.workunit.client.0.smithi083.stdout:6/186: truncate d9/dc/f23 4575247 0 2024-04-01T06:57:35.983 INFO:tasks.workunit.client.0.smithi083.stdout:2/329: creat d3/f72 x:0 0 0 2024-04-01T06:57:35.987 INFO:tasks.workunit.client.0.smithi083.stdout:1/348: mkdir db/d1c/d29/d33/d50/d5d/d81 0 2024-04-01T06:57:35.987 INFO:tasks.workunit.client.0.smithi083.stdout:1/349: chown fa 36364 1 2024-04-01T06:57:35.992 INFO:tasks.workunit.client.0.smithi083.stdout:6/187: dwrite d9/dc/d1b/f28 [0,4194304] 0 2024-04-01T06:57:35.997 INFO:tasks.workunit.client.0.smithi083.stdout:0/245: rename d16/d2e/c38 to d16/d3a/c50 0 2024-04-01T06:57:35.998 INFO:tasks.workunit.client.0.smithi083.stdout:0/246: chown f6 443383344 1 2024-04-01T06:57:35.999 INFO:tasks.workunit.client.0.smithi083.stdout:3/360: mknod d6/d12/c80 0 2024-04-01T06:57:36.000 INFO:tasks.workunit.client.0.smithi083.stdout:9/222: symlink d6/d32/d3c/l48 0 2024-04-01T06:57:36.000 INFO:tasks.workunit.client.0.smithi083.stdout:3/361: write d6/d15/f19 [8045575,26103] 0 2024-04-01T06:57:36.001 INFO:tasks.workunit.client.0.smithi083.stdout:2/330: creat d3/d26/d59/d2b/f73 x:0 0 0 2024-04-01T06:57:36.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:35 smithi145 ceph-mon[47816]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:36.003 INFO:tasks.workunit.client.0.smithi083.stdout:5/169: rename d4/l34 to d4/l35 0 2024-04-01T06:57:36.003 INFO:tasks.workunit.client.0.smithi083.stdout:3/362: dread d6/d15/f5f [0,4194304] 0 2024-04-01T06:57:36.004 INFO:tasks.workunit.client.0.smithi083.stdout:1/350: mkdir db/d1c/d2e/d30/d82 0 2024-04-01T06:57:36.006 INFO:tasks.workunit.client.0.smithi083.stdout:7/194: rename d0/d4/f1e to d0/d4/d9/f3e 0 2024-04-01T06:57:36.007 INFO:tasks.workunit.client.0.smithi083.stdout:9/223: mknod d6/d32/d3c/c49 0 2024-04-01T06:57:36.009 INFO:tasks.workunit.client.0.smithi083.stdout:5/170: symlink d4/d9/d16/d19/l36 0 2024-04-01T06:57:36.011 INFO:tasks.workunit.client.0.smithi083.stdout:3/363: creat d6/d15/d2d/d2f/d42/f81 x:0 0 0 2024-04-01T06:57:36.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:35 smithi083 ceph-mon[43429]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:36.012 INFO:tasks.workunit.client.0.smithi083.stdout:1/351: mknod db/d1c/d29/d33/d50/d5d/d6c/c83 0 2024-04-01T06:57:36.013 INFO:tasks.workunit.client.0.smithi083.stdout:1/352: fsync db/fd 0 2024-04-01T06:57:36.013 INFO:tasks.workunit.client.0.smithi083.stdout:1/353: stat db/f13 0 2024-04-01T06:57:36.013 INFO:tasks.workunit.client.0.smithi083.stdout:7/195: creat d0/f3f x:0 0 0 2024-04-01T06:57:36.013 INFO:tasks.workunit.client.0.smithi083.stdout:7/196: stat d0/d4/d9/d39 0 2024-04-01T06:57:36.013 INFO:tasks.workunit.client.0.smithi083.stdout:0/247: dwrite d16/d2e/d3d/f4e [0,4194304] 0 2024-04-01T06:57:36.014 INFO:tasks.workunit.client.0.smithi083.stdout:9/224: creat d6/d32/d26/d2d/f4a x:0 0 0 2024-04-01T06:57:36.015 INFO:tasks.workunit.client.0.smithi083.stdout:9/225: fsync d6/d32/f1b 0 2024-04-01T06:57:36.015 INFO:tasks.workunit.client.0.smithi083.stdout:4/177: sync 2024-04-01T06:57:36.026 INFO:tasks.workunit.client.0.smithi083.stdout:2/331: dwrite d3/d26/d59/f31 [0,4194304] 0 2024-04-01T06:57:36.029 INFO:tasks.workunit.client.0.smithi083.stdout:5/171: dwrite d4/d9/d16/d1f/f22 [0,4194304] 0 2024-04-01T06:57:36.038 INFO:tasks.workunit.client.0.smithi083.stdout:5/172: dread d4/f1c [0,4194304] 0 2024-04-01T06:57:36.038 INFO:tasks.workunit.client.0.smithi083.stdout:5/173: dread - d4/d2b/f31 zero size 2024-04-01T06:57:36.048 INFO:tasks.workunit.client.0.smithi083.stdout:3/364: mknod d6/d15/d2d/d2f/d42/d46/c82 0 2024-04-01T06:57:36.049 INFO:tasks.workunit.client.0.smithi083.stdout:1/354: unlink db/d1c/d29/d33/f4a 0 2024-04-01T06:57:36.049 INFO:tasks.workunit.client.0.smithi083.stdout:1/355: stat db/l42 0 2024-04-01T06:57:36.058 INFO:tasks.workunit.client.0.smithi083.stdout:0/248: creat d16/d1d/f51 x:0 0 0 2024-04-01T06:57:36.058 INFO:tasks.workunit.client.0.smithi083.stdout:0/249: readlink d16/d1d/l44 0 2024-04-01T06:57:36.058 INFO:tasks.workunit.client.0.smithi083.stdout:7/197: rmdir d0/d4 39 2024-04-01T06:57:36.060 INFO:tasks.workunit.client.0.smithi083.stdout:9/226: mkdir d6/d32/d4b 0 2024-04-01T06:57:36.060 INFO:tasks.workunit.client.0.smithi083.stdout:8/311: sync 2024-04-01T06:57:36.060 INFO:tasks.workunit.client.0.smithi083.stdout:6/188: rmdir d9/dc 39 2024-04-01T06:57:36.063 INFO:tasks.workunit.client.0.smithi083.stdout:4/178: symlink d1/d4/l38 0 2024-04-01T06:57:36.063 INFO:tasks.workunit.client.0.smithi083.stdout:4/179: chown d1/d4/f25 123547718 1 2024-04-01T06:57:36.065 INFO:tasks.workunit.client.0.smithi083.stdout:2/332: unlink d3/d4d/c6f 0 2024-04-01T06:57:36.069 INFO:tasks.workunit.client.0.smithi083.stdout:5/174: rename d4/d23/l2c to d4/d9/d16/d19/l37 0 2024-04-01T06:57:36.070 INFO:tasks.workunit.client.0.smithi083.stdout:3/365: mkdir d6/d15/d2d/d2f/d42/d83 0 2024-04-01T06:57:36.070 INFO:tasks.workunit.client.0.smithi083.stdout:3/366: read d6/d15/d2d/d2f/d42/d46/f57 [1047213,8120] 0 2024-04-01T06:57:36.073 INFO:tasks.workunit.client.0.smithi083.stdout:1/356: getdents db/d1c/d29/d33/d50 0 2024-04-01T06:57:36.073 INFO:tasks.workunit.client.0.smithi083.stdout:1/357: stat db/d1c/f4e 0 2024-04-01T06:57:36.074 INFO:tasks.workunit.client.0.smithi083.stdout:6/189: mkdir d9/dc/d1b/d39 0 2024-04-01T06:57:36.074 INFO:tasks.workunit.client.0.smithi083.stdout:6/190: write d9/dc/f32 [468853,104248] 0 2024-04-01T06:57:36.074 INFO:tasks.workunit.client.0.smithi083.stdout:6/191: fdatasync d9/dc/f14 0 2024-04-01T06:57:36.074 INFO:tasks.workunit.client.0.smithi083.stdout:6/192: readlink d9/l31 0 2024-04-01T06:57:36.074 INFO:tasks.workunit.client.0.smithi083.stdout:6/193: write d9/dc/fe [2845417,9534] 0 2024-04-01T06:57:36.076 INFO:tasks.workunit.client.0.smithi083.stdout:4/180: stat d1/d8/c21 0 2024-04-01T06:57:36.077 INFO:tasks.workunit.client.0.smithi083.stdout:2/333: creat d3/d4d/d5d/f74 x:0 0 0 2024-04-01T06:57:36.078 INFO:tasks.workunit.client.0.smithi083.stdout:9/227: dwrite d6/d32/d26/d2d/f3f [0,4194304] 0 2024-04-01T06:57:36.081 INFO:tasks.workunit.client.0.smithi083.stdout:6/194: dread d9/dc/d1b/f28 [0,4194304] 0 2024-04-01T06:57:36.081 INFO:tasks.workunit.client.0.smithi083.stdout:0/250: rename f6 to d16/f52 0 2024-04-01T06:57:36.082 INFO:tasks.workunit.client.0.smithi083.stdout:0/251: write d16/f52 [4187696,111235] 0 2024-04-01T06:57:36.083 INFO:tasks.workunit.client.0.smithi083.stdout:5/175: symlink d4/d9/d16/d1f/l38 0 2024-04-01T06:57:36.083 INFO:tasks.workunit.client.0.smithi083.stdout:3/367: truncate d6/d15/d2d/d2f/d3e/f54 43806 0 2024-04-01T06:57:36.084 INFO:tasks.workunit.client.0.smithi083.stdout:3/368: fdatasync f2 0 2024-04-01T06:57:36.085 INFO:tasks.workunit.client.0.smithi083.stdout:7/198: link d0/d10/l1d d0/l40 0 2024-04-01T06:57:36.085 INFO:tasks.workunit.client.0.smithi083.stdout:7/199: dread - d0/d4/d9/f25 zero size 2024-04-01T06:57:36.087 INFO:tasks.workunit.client.0.smithi083.stdout:1/358: unlink db/d1c/f4e 0 2024-04-01T06:57:36.088 INFO:tasks.workunit.client.0.smithi083.stdout:4/181: creat d1/d4/da/f39 x:0 0 0 2024-04-01T06:57:36.092 INFO:tasks.workunit.client.0.smithi083.stdout:7/200: dread d0/d4/f16 [0,4194304] 0 2024-04-01T06:57:36.092 INFO:tasks.workunit.client.0.smithi083.stdout:9/228: mkdir d6/d32/d3c/d4c 0 2024-04-01T06:57:36.093 INFO:tasks.workunit.client.0.smithi083.stdout:6/195: creat d9/dc/d1b/d39/f3a x:0 0 0 2024-04-01T06:57:36.093 INFO:tasks.workunit.client.0.smithi083.stdout:6/196: truncate d9/dc/d1b/f37 599336 0 2024-04-01T06:57:36.095 INFO:tasks.workunit.client.0.smithi083.stdout:3/369: dread d6/d15/f19 [0,4194304] 0 2024-04-01T06:57:36.095 INFO:tasks.workunit.client.0.smithi083.stdout:3/370: fdatasync d6/d12/f47 0 2024-04-01T06:57:36.095 INFO:tasks.workunit.client.0.smithi083.stdout:3/371: readlink d6/d15/d2d/d2f/d42/d46/d55/d67/l7c 0 2024-04-01T06:57:36.095 INFO:tasks.workunit.client.0.smithi083.stdout:3/372: readlink d6/d15/l4c 0 2024-04-01T06:57:36.095 INFO:tasks.workunit.client.0.smithi083.stdout:3/373: truncate d6/d15/f5a 969729 0 2024-04-01T06:57:36.095 INFO:tasks.workunit.client.0.smithi083.stdout:3/374: write d6/d15/d2d/d2f/d42/f71 [697078,63327] 0 2024-04-01T06:57:36.095 INFO:tasks.workunit.client.0.smithi083.stdout:3/375: write d6/d1e/f2b [939727,97460] 0 2024-04-01T06:57:36.095 INFO:tasks.workunit.client.0.smithi083.stdout:3/376: chown d6/d12/f7d 2741560 1 2024-04-01T06:57:36.095 INFO:tasks.workunit.client.0.smithi083.stdout:3/377: chown d6/d12/c27 29667762 1 2024-04-01T06:57:36.096 INFO:tasks.workunit.client.0.smithi083.stdout:0/252: dwrite f12 [0,4194304] 0 2024-04-01T06:57:36.096 INFO:tasks.workunit.client.0.smithi083.stdout:2/334: rename d3/d26/f63 to d3/d20/d42/f75 0 2024-04-01T06:57:36.096 INFO:tasks.workunit.client.0.smithi083.stdout:4/182: dread d1/d4/db/f20 [0,4194304] 0 2024-04-01T06:57:36.098 INFO:tasks.workunit.client.0.smithi083.stdout:1/359: symlink db/d1c/d29/l84 0 2024-04-01T06:57:36.099 INFO:tasks.workunit.client.0.smithi083.stdout:1/360: fsync db/d1c/f24 0 2024-04-01T06:57:36.099 INFO:tasks.workunit.client.0.smithi083.stdout:1/361: fdatasync db/d1c/d29/d33/d50/f27 0 2024-04-01T06:57:36.100 INFO:tasks.workunit.client.0.smithi083.stdout:7/201: truncate d0/d4/d9/f3e 1842090 0 2024-04-01T06:57:36.104 INFO:tasks.workunit.client.0.smithi083.stdout:5/176: rmdir d4 39 2024-04-01T06:57:36.106 INFO:tasks.workunit.client.0.smithi083.stdout:6/197: mkdir d9/dc/d3b 0 2024-04-01T06:57:36.110 INFO:tasks.workunit.client.0.smithi083.stdout:0/253: truncate fe 3484967 0 2024-04-01T06:57:36.112 INFO:tasks.workunit.client.0.smithi083.stdout:2/335: mknod d3/d4d/c76 0 2024-04-01T06:57:36.114 INFO:tasks.workunit.client.0.smithi083.stdout:4/183: symlink d1/d4/d1f/l3a 0 2024-04-01T06:57:36.114 INFO:tasks.workunit.client.0.smithi083.stdout:4/184: stat d1/d4/f25 0 2024-04-01T06:57:36.115 INFO:tasks.workunit.client.0.smithi083.stdout:1/362: mknod db/d1c/d29/d33/d50/d5c/c85 0 2024-04-01T06:57:36.116 INFO:tasks.workunit.client.0.smithi083.stdout:7/202: mknod d0/d10/d34/c41 0 2024-04-01T06:57:36.116 INFO:tasks.workunit.client.0.smithi083.stdout:1/363: write db/d1c/d2e/f2f [1393617,102546] 0 2024-04-01T06:57:36.117 INFO:tasks.workunit.client.0.smithi083.stdout:3/378: dwrite d6/d15/d2d/d2f/d3e/f54 [0,4194304] 0 2024-04-01T06:57:36.117 INFO:tasks.workunit.client.0.smithi083.stdout:5/177: link d4/d9/d16/d19/f1e d4/d2b/f39 0 2024-04-01T06:57:36.117 INFO:tasks.workunit.client.0.smithi083.stdout:5/178: chown d4/d9/c2e 0 1 2024-04-01T06:57:36.118 INFO:tasks.workunit.client.0.smithi083.stdout:1/364: dread db/d1c/f24 [0,4194304] 0 2024-04-01T06:57:36.120 INFO:tasks.workunit.client.0.smithi083.stdout:0/254: link d16/d1d/c1e d16/d3a/d4b/c53 0 2024-04-01T06:57:36.122 INFO:tasks.workunit.client.0.smithi083.stdout:4/185: unlink d1/d4/c1b 0 2024-04-01T06:57:36.123 INFO:tasks.workunit.client.0.smithi083.stdout:7/203: creat d0/d10/f42 x:0 0 0 2024-04-01T06:57:36.124 INFO:tasks.workunit.client.0.smithi083.stdout:7/204: read d0/f3 [1758917,27855] 0 2024-04-01T06:57:36.124 INFO:tasks.workunit.client.0.smithi083.stdout:7/205: write d0/d10/f35 [436271,79553] 0 2024-04-01T06:57:36.124 INFO:tasks.workunit.client.0.smithi083.stdout:7/206: chown d0/d4/f2a 303931 1 2024-04-01T06:57:36.124 INFO:tasks.workunit.client.0.smithi083.stdout:7/207: stat d0/d4/ff 0 2024-04-01T06:57:36.125 INFO:tasks.workunit.client.0.smithi083.stdout:3/379: symlink d6/d15/d2d/l84 0 2024-04-01T06:57:36.125 INFO:tasks.workunit.client.0.smithi083.stdout:3/380: write d6/d1e/f31 [5843682,39600] 0 2024-04-01T06:57:36.126 INFO:tasks.workunit.client.0.smithi083.stdout:6/198: mkdir d9/dc/d29/d3c 0 2024-04-01T06:57:36.128 INFO:tasks.workunit.client.0.smithi083.stdout:0/255: creat d16/d1d/f54 x:0 0 0 2024-04-01T06:57:36.128 INFO:tasks.workunit.client.0.smithi083.stdout:0/256: stat cf 0 2024-04-01T06:57:36.130 INFO:tasks.workunit.client.0.smithi083.stdout:7/208: mkdir d0/d4/d9/d43 0 2024-04-01T06:57:36.131 INFO:tasks.workunit.client.0.smithi083.stdout:7/209: dread d0/d4/f32 [0,4194304] 0 2024-04-01T06:57:36.131 INFO:tasks.workunit.client.0.smithi083.stdout:7/210: read - d0/d4/d9/f25 zero size 2024-04-01T06:57:36.131 INFO:tasks.workunit.client.0.smithi083.stdout:7/211: stat d0/d10/f3c 0 2024-04-01T06:57:36.132 INFO:tasks.workunit.client.0.smithi083.stdout:2/336: dwrite d3/d26/d59/d70/f64 [0,4194304] 0 2024-04-01T06:57:36.132 INFO:tasks.workunit.client.0.smithi083.stdout:3/381: symlink d6/d15/d2d/d2f/d42/d46/d55/d67/l85 0 2024-04-01T06:57:36.133 INFO:tasks.workunit.client.0.smithi083.stdout:6/199: creat d9/dc/d1b/f3d x:0 0 0 2024-04-01T06:57:36.133 INFO:tasks.workunit.client.0.smithi083.stdout:0/257: dread fe [0,4194304] 0 2024-04-01T06:57:36.135 INFO:tasks.workunit.client.0.smithi083.stdout:7/212: rename d0/l33 to d0/d4/d9/d39/l44 0 2024-04-01T06:57:36.135 INFO:tasks.workunit.client.0.smithi083.stdout:7/213: readlink d0/d4/l2e 0 2024-04-01T06:57:36.137 INFO:tasks.workunit.client.0.smithi083.stdout:2/337: truncate d3/d26/d59/f31 3403960 0 2024-04-01T06:57:36.138 INFO:tasks.workunit.client.0.smithi083.stdout:3/382: truncate d6/d15/f5f 428815 0 2024-04-01T06:57:36.138 INFO:tasks.workunit.client.0.smithi083.stdout:3/383: write d6/d15/f5a [1696929,40564] 0 2024-04-01T06:57:36.138 INFO:tasks.workunit.client.0.smithi083.stdout:3/384: chown d6/d1e/c49 288896 1 2024-04-01T06:57:36.138 INFO:tasks.workunit.client.0.smithi083.stdout:3/385: chown d6/d15/d2d/l84 51 1 2024-04-01T06:57:36.138 INFO:tasks.workunit.client.0.smithi083.stdout:6/200: dread - d9/dc/d29/f34 zero size 2024-04-01T06:57:36.139 INFO:tasks.workunit.client.0.smithi083.stdout:6/201: read d9/dc/f23 [1791852,36912] 0 2024-04-01T06:57:36.139 INFO:tasks.workunit.client.0.smithi083.stdout:0/258: stat d16/l3f 0 2024-04-01T06:57:36.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:35 smithi153 ceph-mon[48187]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:36.140 INFO:tasks.workunit.client.0.smithi083.stdout:7/214: mknod d0/d4/d9/d43/c45 0 2024-04-01T06:57:36.141 INFO:tasks.workunit.client.0.smithi083.stdout:4/186: dwrite d1/d4/da/f29 [0,4194304] 0 2024-04-01T06:57:36.142 INFO:tasks.workunit.client.0.smithi083.stdout:4/187: readlink d1/d4/db/l26 0 2024-04-01T06:57:36.142 INFO:tasks.workunit.client.0.smithi083.stdout:2/338: creat d3/d26/d59/d2b/f77 x:0 0 0 2024-04-01T06:57:36.142 INFO:tasks.workunit.client.0.smithi083.stdout:2/339: chown d3/f16 27 1 2024-04-01T06:57:36.145 INFO:tasks.workunit.client.0.smithi083.stdout:3/386: mknod d6/d15/d2d/d2f/d42/d46/d55/c86 0 2024-04-01T06:57:36.145 INFO:tasks.workunit.client.0.smithi083.stdout:6/202: getdents d9/dc/d29 0 2024-04-01T06:57:36.147 INFO:tasks.workunit.client.0.smithi083.stdout:7/215: mknod d0/d10/d34/c46 0 2024-04-01T06:57:36.148 INFO:tasks.workunit.client.0.smithi083.stdout:6/203: dread d9/dc/d1b/f1f [0,4194304] 0 2024-04-01T06:57:36.148 INFO:tasks.workunit.client.0.smithi083.stdout:6/204: fdatasync d9/dc/f27 0 2024-04-01T06:57:36.152 INFO:tasks.workunit.client.0.smithi083.stdout:4/188: unlink d1/d4/db/c2c 0 2024-04-01T06:57:36.153 INFO:tasks.workunit.client.0.smithi083.stdout:4/189: dread d1/d4/db/f18 [0,4194304] 0 2024-04-01T06:57:36.153 INFO:tasks.workunit.client.0.smithi083.stdout:4/190: dread - d1/d4/d1f/d2a/f31 zero size 2024-04-01T06:57:36.153 INFO:tasks.workunit.client.0.smithi083.stdout:4/191: chown d1/d4/d1f/f27 0 1 2024-04-01T06:57:36.153 INFO:tasks.workunit.client.0.smithi083.stdout:3/387: creat d6/d1e/f87 x:0 0 0 2024-04-01T06:57:36.154 INFO:tasks.workunit.client.0.smithi083.stdout:3/388: chown d6/d15/d2d/l3b 722943287 1 2024-04-01T06:57:36.155 INFO:tasks.workunit.client.0.smithi083.stdout:7/216: creat d0/d10/f47 x:0 0 0 2024-04-01T06:57:36.156 INFO:tasks.workunit.client.0.smithi083.stdout:6/205: rename d9/dc/d1b/c13 to d9/dc/d29/d3c/c3e 0 2024-04-01T06:57:36.158 INFO:tasks.workunit.client.0.smithi083.stdout:6/206: truncate d9/dc/f14 1392356 0 2024-04-01T06:57:36.161 INFO:tasks.workunit.client.0.smithi083.stdout:6/207: creat d9/dc/d1b/f3f x:0 0 0 2024-04-01T06:57:36.161 INFO:tasks.workunit.client.0.smithi083.stdout:6/208: chown d9/dc/d29 46943 1 2024-04-01T06:57:36.162 INFO:tasks.workunit.client.0.smithi083.stdout:6/209: dread d9/dc/d1b/f37 [0,4194304] 0 2024-04-01T06:57:36.175 INFO:tasks.workunit.client.0.smithi083.stdout:4/192: dwrite d1/f2 [4194304,4194304] 0 2024-04-01T06:57:36.175 INFO:tasks.workunit.client.0.smithi083.stdout:4/193: stat d1/d8/c1d 0 2024-04-01T06:57:36.176 INFO:tasks.workunit.client.0.smithi083.stdout:3/389: dwrite d6/d15/d2d/d2f/d42/d46/f57 [0,4194304] 0 2024-04-01T06:57:36.176 INFO:tasks.workunit.client.0.smithi083.stdout:3/390: readlink d6/d15/d2d/l84 0 2024-04-01T06:57:36.176 INFO:tasks.workunit.client.0.smithi083.stdout:4/194: write d1/d4/da/f29 [2214988,82320] 0 2024-04-01T06:57:36.177 INFO:tasks.workunit.client.0.smithi083.stdout:7/217: dwrite d0/d10/f47 [0,4194304] 0 2024-04-01T06:57:36.177 INFO:tasks.workunit.client.0.smithi083.stdout:3/391: dread d6/d15/d2d/d2f/d42/d5c/f72 [0,4194304] 0 2024-04-01T06:57:36.177 INFO:tasks.workunit.client.0.smithi083.stdout:3/392: fsync d6/d12/f2c 0 2024-04-01T06:57:36.181 INFO:tasks.workunit.client.0.smithi083.stdout:7/218: mkdir d0/d4/d9/d39/d48 0 2024-04-01T06:57:36.181 INFO:tasks.workunit.client.0.smithi083.stdout:7/219: truncate d0/d10/f3c 118877 0 2024-04-01T06:57:36.181 INFO:tasks.workunit.client.0.smithi083.stdout:7/220: chown d0/d4/d9/f3e 828350397 1 2024-04-01T06:57:36.181 INFO:tasks.workunit.client.0.smithi083.stdout:7/221: dread - d0/f37 zero size 2024-04-01T06:57:36.181 INFO:tasks.workunit.client.0.smithi083.stdout:3/393: dread d6/d15/d2d/d2f/d42/d5c/f68 [0,4194304] 0 2024-04-01T06:57:36.182 INFO:tasks.workunit.client.0.smithi083.stdout:3/394: fdatasync d6/d15/d2d/d2f/d42/d46/f5e 0 2024-04-01T06:57:36.182 INFO:tasks.workunit.client.0.smithi083.stdout:7/222: read d0/d4/f16 [2940289,13171] 0 2024-04-01T06:57:36.182 INFO:tasks.workunit.client.0.smithi083.stdout:8/312: sync 2024-04-01T06:57:36.192 INFO:tasks.workunit.client.0.smithi083.stdout:7/223: dread d0/d4/fc [0,4194304] 0 2024-04-01T06:57:36.197 INFO:tasks.workunit.client.0.smithi083.stdout:7/224: dread d0/d4/ff [0,4194304] 0 2024-04-01T06:57:36.197 INFO:tasks.workunit.client.0.smithi083.stdout:7/225: write d0/d4/fc [3602177,4846] 0 2024-04-01T06:57:36.197 INFO:tasks.workunit.client.0.smithi083.stdout:7/226: readlink d0/d4/d9/d39/l44 0 2024-04-01T06:57:36.200 INFO:tasks.workunit.client.0.smithi083.stdout:8/313: dwrite d15/d18/f64 [4194304,4194304] 0 2024-04-01T06:57:36.203 INFO:tasks.workunit.client.0.smithi083.stdout:8/314: unlink d15/d18/d19/d24/c6d 0 2024-04-01T06:57:36.203 INFO:tasks.workunit.client.0.smithi083.stdout:8/315: symlink d15/d18/d19/d1d/l79 0 2024-04-01T06:57:36.204 INFO:tasks.workunit.client.0.smithi083.stdout:8/316: chown d15/d18/f31 359799 1 2024-04-01T06:57:36.204 INFO:tasks.workunit.client.0.smithi083.stdout:8/317: dread - d15/d18/d19/f71 zero size 2024-04-01T06:57:36.205 INFO:tasks.workunit.client.0.smithi083.stdout:7/227: dread d0/d10/f20 [0,4194304] 0 2024-04-01T06:57:36.205 INFO:tasks.workunit.client.0.smithi083.stdout:3/395: dwrite d6/d15/d2d/d2f/d42/f81 [0,4194304] 0 2024-04-01T06:57:36.207 INFO:tasks.workunit.client.0.smithi083.stdout:7/228: creat d0/f49 x:0 0 0 2024-04-01T06:57:36.208 INFO:tasks.workunit.client.0.smithi083.stdout:3/396: mkdir d6/d15/d2d/d2f/d42/d5c/d88 0 2024-04-01T06:57:36.210 INFO:tasks.workunit.client.0.smithi083.stdout:7/229: creat d0/f4a x:0 0 0 2024-04-01T06:57:36.211 INFO:tasks.workunit.client.0.smithi083.stdout:3/397: creat d6/d1e/f89 x:0 0 0 2024-04-01T06:57:36.211 INFO:tasks.workunit.client.0.smithi083.stdout:3/398: write d6/d1e/f87 [324083,124195] 0 2024-04-01T06:57:36.212 INFO:tasks.workunit.client.0.smithi083.stdout:3/399: truncate d6/d1e/f87 1113220 0 2024-04-01T06:57:36.216 INFO:tasks.workunit.client.0.smithi083.stdout:3/400: dread d6/d15/d2d/d2f/d42/f71 [0,4194304] 0 2024-04-01T06:57:36.218 INFO:tasks.workunit.client.0.smithi083.stdout:7/230: rmdir d0 39 2024-04-01T06:57:36.221 INFO:tasks.workunit.client.0.smithi083.stdout:8/318: dwrite d15/d18/d19/d24/f4b [0,4194304] 0 2024-04-01T06:57:36.222 INFO:tasks.workunit.client.0.smithi083.stdout:8/319: chown d15/d18/d19/d24/d38/c4f 4287 1 2024-04-01T06:57:36.222 INFO:tasks.workunit.client.0.smithi083.stdout:8/320: write d15/d18/f37 [462983,109915] 0 2024-04-01T06:57:36.222 INFO:tasks.workunit.client.0.smithi083.stdout:8/321: write d15/d21/f51 [3956992,111209] 0 2024-04-01T06:57:36.225 INFO:tasks.workunit.client.0.smithi083.stdout:7/231: dread d0/d4/d9/f22 [0,4194304] 0 2024-04-01T06:57:36.225 INFO:tasks.workunit.client.0.smithi083.stdout:8/322: mknod d15/d18/d19/d24/d44/d75/c7a 0 2024-04-01T06:57:36.228 INFO:tasks.workunit.client.0.smithi083.stdout:8/323: rename d15/d18/d19/f1a to d15/f7b 0 2024-04-01T06:57:36.228 INFO:tasks.workunit.client.0.smithi083.stdout:8/324: truncate d15/d18/d19/d1d/f54 510529 0 2024-04-01T06:57:36.228 INFO:tasks.workunit.client.0.smithi083.stdout:7/232: rmdir d0/d4/d9 39 2024-04-01T06:57:36.228 INFO:tasks.workunit.client.0.smithi083.stdout:3/401: dwrite d6/d1e/f89 [0,4194304] 0 2024-04-01T06:57:36.230 INFO:tasks.workunit.client.0.smithi083.stdout:3/402: creat d6/d12/f8a x:0 0 0 2024-04-01T06:57:36.231 INFO:tasks.workunit.client.0.smithi083.stdout:3/403: write d6/d15/d2d/d2f/d42/d5c/f72 [704135,74745] 0 2024-04-01T06:57:36.233 INFO:tasks.workunit.client.0.smithi083.stdout:3/404: fdatasync d6/d15/d2d/d2f/d42/d5c/f72 0 2024-04-01T06:57:36.233 INFO:tasks.workunit.client.0.smithi083.stdout:3/405: stat d6/d1e/d6f/l70 0 2024-04-01T06:57:36.236 INFO:tasks.workunit.client.0.smithi083.stdout:7/233: mkdir d0/d4b 0 2024-04-01T06:57:36.236 INFO:tasks.workunit.client.0.smithi083.stdout:8/325: dread d15/d21/f51 [0,4194304] 0 2024-04-01T06:57:36.236 INFO:tasks.workunit.client.0.smithi083.stdout:8/326: chown d15/d18/l32 659 1 2024-04-01T06:57:36.236 INFO:tasks.workunit.client.0.smithi083.stdout:8/327: readlink l6 0 2024-04-01T06:57:36.237 INFO:tasks.workunit.client.0.smithi083.stdout:7/234: write d0/d10/f20 [3197035,102453] 0 2024-04-01T06:57:36.247 INFO:tasks.workunit.client.0.smithi083.stdout:8/328: dwrite d15/f7b [0,4194304] 0 2024-04-01T06:57:36.249 INFO:tasks.workunit.client.0.smithi083.stdout:3/406: dwrite d6/d15/d2d/d2f/d42/f71 [0,4194304] 0 2024-04-01T06:57:36.249 INFO:tasks.workunit.client.0.smithi083.stdout:7/235: dread d0/d4/fc [0,4194304] 0 2024-04-01T06:57:36.253 INFO:tasks.workunit.client.0.smithi083.stdout:8/329: rmdir d15 39 2024-04-01T06:57:36.257 INFO:tasks.workunit.client.0.smithi083.stdout:3/407: symlink d6/d15/d2d/d2f/d42/d5c/d88/l8b 0 2024-04-01T06:57:36.258 INFO:tasks.workunit.client.0.smithi083.stdout:8/330: rename d15/d18/d19/d24/f4b to d15/d1b/d39/d48/f7c 0 2024-04-01T06:57:36.260 INFO:tasks.workunit.client.0.smithi083.stdout:3/408: getdents d6/d15/d2d/d2f 0 2024-04-01T06:57:36.260 INFO:tasks.workunit.client.0.smithi083.stdout:3/409: write d6/d15/f1c [4309180,90827] 0 2024-04-01T06:57:36.261 INFO:tasks.workunit.client.0.smithi083.stdout:8/331: symlink d15/d18/d19/l7d 0 2024-04-01T06:57:36.261 INFO:tasks.workunit.client.0.smithi083.stdout:8/332: fsync d15/d1b/d39/d48/d5e/f73 0 2024-04-01T06:57:36.261 INFO:tasks.workunit.client.0.smithi083.stdout:8/333: fsync d15/f74 0 2024-04-01T06:57:36.262 INFO:tasks.workunit.client.0.smithi083.stdout:3/410: creat d6/d15/d2d/d2f/d3e/f8c x:0 0 0 2024-04-01T06:57:36.264 INFO:tasks.workunit.client.0.smithi083.stdout:3/411: mknod d6/d15/d2d/d2f/d42/d46/c8d 0 2024-04-01T06:57:36.264 INFO:tasks.workunit.client.0.smithi083.stdout:3/412: chown d6/d15/d2d/d2f/d42/d46/d55/d67/l6a 119520560 1 2024-04-01T06:57:36.265 INFO:tasks.workunit.client.0.smithi083.stdout:3/413: truncate d6/d15/d2d/d2f/d42/d46/f57 3096175 0 2024-04-01T06:57:36.265 INFO:tasks.workunit.client.0.smithi083.stdout:3/414: write d6/d1e/f43 [529277,122252] 0 2024-04-01T06:57:36.265 INFO:tasks.workunit.client.0.smithi083.stdout:3/415: creat d6/d15/f8e x:0 0 0 2024-04-01T06:57:36.273 INFO:tasks.workunit.client.0.smithi083.stdout:3/416: rmdir d6/d15/d2d/d2f/d42/d46 39 2024-04-01T06:57:36.274 INFO:tasks.workunit.client.0.smithi083.stdout:8/334: dwrite d15/d18/d19/d1d/f36 [0,4194304] 0 2024-04-01T06:57:36.275 INFO:tasks.workunit.client.0.smithi083.stdout:8/335: creat d15/d18/d19/d24/f7e x:0 0 0 2024-04-01T06:57:36.279 INFO:tasks.workunit.client.0.smithi083.stdout:9/229: sync 2024-04-01T06:57:36.280 INFO:tasks.workunit.client.0.smithi083.stdout:9/230: chown d6/d32/d26/d2d/d34/l3a 62440806 1 2024-04-01T06:57:36.292 INFO:tasks.workunit.client.0.smithi083.stdout:3/417: dwrite d6/d12/f2c [0,4194304] 0 2024-04-01T06:57:36.293 INFO:tasks.workunit.client.0.smithi083.stdout:8/336: dwrite d15/d18/d19/d24/d38/f41 [0,4194304] 0 2024-04-01T06:57:36.293 INFO:tasks.workunit.client.0.smithi083.stdout:8/337: fdatasync d15/d18/f31 0 2024-04-01T06:57:36.295 INFO:tasks.workunit.client.0.smithi083.stdout:8/338: symlink d15/d18/d19/d24/d38/d62/l7f 0 2024-04-01T06:57:36.296 INFO:tasks.workunit.client.0.smithi083.stdout:8/339: dread - d15/d18/d19/d24/f7e zero size 2024-04-01T06:57:36.296 INFO:tasks.workunit.client.0.smithi083.stdout:8/340: mkdir d15/d1b/d39/d80 0 2024-04-01T06:57:36.297 INFO:tasks.workunit.client.0.smithi083.stdout:9/231: dwrite d6/f2f [0,4194304] 0 2024-04-01T06:57:36.297 INFO:tasks.workunit.client.0.smithi083.stdout:8/341: symlink d15/d18/d19/d24/d44/d75/l81 0 2024-04-01T06:57:36.299 INFO:tasks.workunit.client.0.smithi083.stdout:9/232: mkdir d6/d32/d4d 0 2024-04-01T06:57:36.300 INFO:tasks.workunit.client.0.smithi083.stdout:8/342: mkdir d15/d82 0 2024-04-01T06:57:36.313 INFO:tasks.workunit.client.0.smithi083.stdout:8/343: dwrite d15/d1b/d39/d48/d5e/f73 [4194304,4194304] 0 2024-04-01T06:57:36.315 INFO:tasks.workunit.client.0.smithi083.stdout:8/344: link d15/d18/c5f d15/d21/c83 0 2024-04-01T06:57:36.327 INFO:tasks.workunit.client.0.smithi083.stdout:5/179: sync 2024-04-01T06:57:36.327 INFO:tasks.workunit.client.0.smithi083.stdout:0/259: sync 2024-04-01T06:57:36.328 INFO:tasks.workunit.client.0.smithi083.stdout:1/365: sync 2024-04-01T06:57:36.328 INFO:tasks.workunit.client.0.smithi083.stdout:1/366: chown db/d1c/d29/d33/d50/d5d/d6c 16 1 2024-04-01T06:57:36.328 INFO:tasks.workunit.client.0.smithi083.stdout:1/367: chown db/f15 0 1 2024-04-01T06:57:36.328 INFO:tasks.workunit.client.0.smithi083.stdout:1/368: write db/d1c/d29/d33/d50/d5d/d6c/f7c [36194,122627] 0 2024-04-01T06:57:36.329 INFO:tasks.workunit.client.0.smithi083.stdout:5/180: link d4/f1b d4/d9/f3a 0 2024-04-01T06:57:36.329 INFO:tasks.workunit.client.0.smithi083.stdout:1/369: write db/f11 [2952761,74089] 0 2024-04-01T06:57:36.329 INFO:tasks.workunit.client.0.smithi083.stdout:0/260: unlink d16/d3a/c50 0 2024-04-01T06:57:36.330 INFO:tasks.workunit.client.0.smithi083.stdout:5/181: creat d4/d9/f3b x:0 0 0 2024-04-01T06:57:36.331 INFO:tasks.workunit.client.0.smithi083.stdout:5/182: readlink d4/d9/l17 0 2024-04-01T06:57:36.331 INFO:tasks.workunit.client.0.smithi083.stdout:5/183: write d4/fb [4623146,104113] 0 2024-04-01T06:57:36.343 INFO:tasks.workunit.client.0.smithi083.stdout:0/261: dwrite f7 [0,4194304] 0 2024-04-01T06:57:36.345 INFO:tasks.workunit.client.0.smithi083.stdout:0/262: write d16/d3a/f3c [947210,70276] 0 2024-04-01T06:57:36.347 INFO:tasks.workunit.client.0.smithi083.stdout:0/263: unlink d16/f2c 0 2024-04-01T06:57:36.347 INFO:tasks.workunit.client.0.smithi083.stdout:0/264: truncate fe 1073624 0 2024-04-01T06:57:36.348 INFO:tasks.workunit.client.0.smithi083.stdout:0/265: mkdir d16/d55 0 2024-04-01T06:57:36.348 INFO:tasks.workunit.client.0.smithi083.stdout:0/266: getdents d16/d55 0 2024-04-01T06:57:36.349 INFO:tasks.workunit.client.0.smithi083.stdout:0/267: truncate d16/d1d/f37 591548 0 2024-04-01T06:57:36.355 INFO:tasks.workunit.client.0.smithi083.stdout:1/370: dwrite db/f13 [0,4194304] 0 2024-04-01T06:57:36.358 INFO:tasks.workunit.client.0.smithi083.stdout:5/184: dwrite d4/d9/f3a [0,4194304] 0 2024-04-01T06:57:36.358 INFO:tasks.workunit.client.0.smithi083.stdout:1/371: truncate db/d1c/d1d/f4c 2603610 0 2024-04-01T06:57:36.358 INFO:tasks.workunit.client.0.smithi083.stdout:1/372: chown db/d1c/d1d/f45 1 1 2024-04-01T06:57:36.358 INFO:tasks.workunit.client.0.smithi083.stdout:1/373: dread - db/d1c/d2e/d30/f6a zero size 2024-04-01T06:57:36.358 INFO:tasks.workunit.client.0.smithi083.stdout:1/374: dread - db/d1c/d1d/f40 zero size 2024-04-01T06:57:36.359 INFO:tasks.workunit.client.0.smithi083.stdout:5/185: mknod d4/d9/d16/d1f/d2f/c3c 0 2024-04-01T06:57:36.359 INFO:tasks.workunit.client.0.smithi083.stdout:5/186: chown d4/d2b/d21/c26 10145234 1 2024-04-01T06:57:36.361 INFO:tasks.workunit.client.0.smithi083.stdout:1/375: creat db/d1c/d29/d33/d50/d5c/f86 x:0 0 0 2024-04-01T06:57:36.362 INFO:tasks.workunit.client.0.smithi083.stdout:5/187: symlink d4/d23/l3d 0 2024-04-01T06:57:36.363 INFO:tasks.workunit.client.0.smithi083.stdout:1/376: fsync db/d1c/d1d/f4c 0 2024-04-01T06:57:36.363 INFO:tasks.workunit.client.0.smithi083.stdout:1/377: chown db 1999381 1 2024-04-01T06:57:36.363 INFO:tasks.workunit.client.0.smithi083.stdout:0/268: dwrite d16/d1d/f46 [4194304,4194304] 0 2024-04-01T06:57:36.367 INFO:tasks.workunit.client.0.smithi083.stdout:5/188: rename d4/l7 to d4/d2b/d21/l3e 0 2024-04-01T06:57:36.369 INFO:tasks.workunit.client.0.smithi083.stdout:1/378: unlink db/d1c/d29/f2d 0 2024-04-01T06:57:36.370 INFO:tasks.workunit.client.0.smithi083.stdout:1/379: readlink db/l58 0 2024-04-01T06:57:36.372 INFO:tasks.workunit.client.0.smithi083.stdout:5/189: dread d4/d23/f30 [0,4194304] 0 2024-04-01T06:57:36.372 INFO:tasks.workunit.client.0.smithi083.stdout:0/269: mknod d16/d2e/c56 0 2024-04-01T06:57:36.374 INFO:tasks.workunit.client.0.smithi083.stdout:1/380: creat db/d1c/d29/d33/d50/d5d/d6c/f87 x:0 0 0 2024-04-01T06:57:36.375 INFO:tasks.workunit.client.0.smithi083.stdout:0/270: mknod d16/d1d/c57 0 2024-04-01T06:57:36.377 INFO:tasks.workunit.client.0.smithi083.stdout:1/381: creat db/f88 x:0 0 0 2024-04-01T06:57:36.377 INFO:tasks.workunit.client.0.smithi083.stdout:1/382: chown db/d1c/d49/c56 1083687 1 2024-04-01T06:57:36.378 INFO:tasks.workunit.client.0.smithi083.stdout:0/271: symlink d16/d3a/d4b/l58 0 2024-04-01T06:57:36.382 INFO:tasks.workunit.client.0.smithi083.stdout:0/272: rename d16/f2d to d16/d2e/d3d/f59 0 2024-04-01T06:57:36.384 INFO:tasks.workunit.client.0.smithi083.stdout:5/190: dwrite d4/d9/f3b [0,4194304] 0 2024-04-01T06:57:36.387 INFO:tasks.workunit.client.0.smithi083.stdout:0/273: rename d16/d2e/c56 to d16/d3a/c5a 0 2024-04-01T06:57:36.387 INFO:tasks.workunit.client.0.smithi083.stdout:0/274: fsync f12 0 2024-04-01T06:57:36.389 INFO:tasks.workunit.client.0.smithi083.stdout:1/383: rmdir db/d1c/d29 39 2024-04-01T06:57:36.389 INFO:tasks.workunit.client.0.smithi083.stdout:2/340: sync 2024-04-01T06:57:36.389 INFO:tasks.workunit.client.0.smithi083.stdout:6/210: sync 2024-04-01T06:57:36.389 INFO:tasks.workunit.client.0.smithi083.stdout:4/195: sync 2024-04-01T06:57:36.389 INFO:tasks.workunit.client.0.smithi083.stdout:2/341: dread - d3/d26/d59/d2b/f77 zero size 2024-04-01T06:57:36.389 INFO:tasks.workunit.client.0.smithi083.stdout:2/342: truncate d3/d26/d59/d70/f51 22015 0 2024-04-01T06:57:36.389 INFO:tasks.workunit.client.0.smithi083.stdout:2/343: readlink d3/d4d/l5b 0 2024-04-01T06:57:36.389 INFO:tasks.workunit.client.0.smithi083.stdout:4/196: write d1/d4/da/f39 [9167,83382] 0 2024-04-01T06:57:36.389 INFO:tasks.workunit.client.0.smithi083.stdout:2/344: getdents d3/d71 0 2024-04-01T06:57:36.390 INFO:tasks.workunit.client.0.smithi083.stdout:2/345: write d3/d26/d59/d2b/f32 [1597492,89085] 0 2024-04-01T06:57:36.390 INFO:tasks.workunit.client.0.smithi083.stdout:5/191: dread d4/d23/f30 [0,4194304] 0 2024-04-01T06:57:36.391 INFO:tasks.workunit.client.0.smithi083.stdout:5/192: read d4/d2b/f24 [2352442,85725] 0 2024-04-01T06:57:36.392 INFO:tasks.workunit.client.0.smithi083.stdout:0/275: mkdir d16/d2e/d5b 0 2024-04-01T06:57:36.393 INFO:tasks.workunit.client.0.smithi083.stdout:9/233: sync 2024-04-01T06:57:36.393 INFO:tasks.workunit.client.0.smithi083.stdout:3/418: sync 2024-04-01T06:57:36.393 INFO:tasks.workunit.client.0.smithi083.stdout:8/345: sync 2024-04-01T06:57:36.393 INFO:tasks.workunit.client.0.smithi083.stdout:7/236: sync 2024-04-01T06:57:36.393 INFO:tasks.workunit.client.0.smithi083.stdout:7/237: readlink d0/d10/l1d 0 2024-04-01T06:57:36.396 INFO:tasks.workunit.client.0.smithi083.stdout:6/211: rename d9/dc/d1b/f22 to d9/dc/f40 0 2024-04-01T06:57:36.397 INFO:tasks.workunit.client.0.smithi083.stdout:2/346: rename d3/d20 to d3/d20/d78 22 2024-04-01T06:57:36.397 INFO:tasks.workunit.client.0.smithi083.stdout:6/212: fdatasync d9/dc/fe 0 2024-04-01T06:57:36.397 INFO:tasks.workunit.client.0.smithi083.stdout:6/213: write d9/dc/f2e [1042737,86040] 0 2024-04-01T06:57:36.397 INFO:tasks.workunit.client.0.smithi083.stdout:6/214: truncate d9/dc/d29/f34 1047973 0 2024-04-01T06:57:36.400 INFO:tasks.workunit.client.0.smithi083.stdout:5/193: symlink d4/d9/d16/d1f/d2f/l3f 0 2024-04-01T06:57:36.401 INFO:tasks.workunit.client.0.smithi083.stdout:0/276: creat d16/d3a/d4b/f5c x:0 0 0 2024-04-01T06:57:36.402 INFO:tasks.workunit.client.0.smithi083.stdout:9/234: mknod d6/d32/c4e 0 2024-04-01T06:57:36.403 INFO:tasks.workunit.client.0.smithi083.stdout:7/238: symlink d0/d4/d9/l4c 0 2024-04-01T06:57:36.405 INFO:tasks.workunit.client.0.smithi083.stdout:6/215: creat d9/dc/d1b/f41 x:0 0 0 2024-04-01T06:57:36.410 INFO:tasks.workunit.client.0.smithi083.stdout:9/235: creat d6/d32/f4f x:0 0 0 2024-04-01T06:57:36.410 INFO:tasks.workunit.client.0.smithi083.stdout:0/277: read d16/f29 [1867190,117344] 0 2024-04-01T06:57:36.412 INFO:tasks.workunit.client.0.smithi083.stdout:7/239: unlink d0/d4/f2c 0 2024-04-01T06:57:36.412 INFO:tasks.workunit.client.0.smithi083.stdout:7/240: write d0/f3f [75577,1103] 0 2024-04-01T06:57:36.413 INFO:tasks.workunit.client.0.smithi083.stdout:0/278: write d16/f22 [1839820,25877] 0 2024-04-01T06:57:36.413 INFO:tasks.workunit.client.0.smithi083.stdout:0/279: read d16/d1d/f20 [153426,103049] 0 2024-04-01T06:57:36.414 INFO:tasks.workunit.client.0.smithi083.stdout:6/216: creat d9/dc/f42 x:0 0 0 2024-04-01T06:57:36.416 INFO:tasks.workunit.client.0.smithi083.stdout:9/236: rename d6/d32/d26/d2d/f3f to d6/d32/d3c/d4c/f50 0 2024-04-01T06:57:36.416 INFO:tasks.workunit.client.0.smithi083.stdout:9/237: write d6/f2f [4288480,39088] 0 2024-04-01T06:57:36.416 INFO:tasks.workunit.client.0.smithi083.stdout:1/384: dwrite db/d1c/d1d/f40 [0,4194304] 0 2024-04-01T06:57:36.417 INFO:tasks.workunit.client.0.smithi083.stdout:7/241: creat d0/f4d x:0 0 0 2024-04-01T06:57:36.418 INFO:tasks.workunit.client.0.smithi083.stdout:0/280: mkdir d16/d2e/d3d/d5d 0 2024-04-01T06:57:36.418 INFO:tasks.workunit.client.0.smithi083.stdout:6/217: chown l3 274 1 2024-04-01T06:57:36.418 INFO:tasks.workunit.client.0.smithi083.stdout:3/419: dread d6/d15/d2d/d2f/d3e/f54 [0,4194304] 0 2024-04-01T06:57:36.425 INFO:tasks.workunit.client.0.smithi083.stdout:1/385: creat db/d1c/f89 x:0 0 0 2024-04-01T06:57:36.428 INFO:tasks.workunit.client.0.smithi083.stdout:3/420: symlink d6/d15/d2d/d2f/d42/d5c/l8f 0 2024-04-01T06:57:36.428 INFO:tasks.workunit.client.0.smithi083.stdout:2/347: dwrite d3/d26/f4c [0,4194304] 0 2024-04-01T06:57:36.428 INFO:tasks.workunit.client.0.smithi083.stdout:4/197: dwrite d1/d8/f14 [0,4194304] 0 2024-04-01T06:57:36.428 INFO:tasks.workunit.client.0.smithi083.stdout:4/198: dread - d1/d4/d1f/d2a/f2e zero size 2024-04-01T06:57:36.428 INFO:tasks.workunit.client.0.smithi083.stdout:4/199: read - d1/d4/d1f/d2a/f31 zero size 2024-04-01T06:57:36.428 INFO:tasks.workunit.client.0.smithi083.stdout:4/200: dread - d1/d4/d1f/d2a/f2e zero size 2024-04-01T06:57:36.428 INFO:tasks.workunit.client.0.smithi083.stdout:4/201: write d1/d4/db/f18 [307668,75004] 0 2024-04-01T06:57:36.428 INFO:tasks.workunit.client.0.smithi083.stdout:3/421: creat d6/d1e/f90 x:0 0 0 2024-04-01T06:57:36.428 INFO:tasks.workunit.client.0.smithi083.stdout:3/422: read - d6/d15/d2d/d2f/d42/f63 zero size 2024-04-01T06:57:36.428 INFO:tasks.workunit.client.0.smithi083.stdout:5/194: dwrite d4/d9/f3b [0,4194304] 0 2024-04-01T06:57:36.430 INFO:tasks.workunit.client.0.smithi083.stdout:2/348: mkdir d3/d26/d59/d27/d79 0 2024-04-01T06:57:36.430 INFO:tasks.workunit.client.0.smithi083.stdout:2/349: stat d3/d26/d59/c35 0 2024-04-01T06:57:36.431 INFO:tasks.workunit.client.0.smithi083.stdout:1/386: mknod db/d1c/d29/d33/d4b/c8a 0 2024-04-01T06:57:36.431 INFO:tasks.workunit.client.0.smithi083.stdout:1/387: fdatasync db/d1c/d29/d33/d50/f2c 0 2024-04-01T06:57:36.432 INFO:tasks.workunit.client.0.smithi083.stdout:7/242: dread d0/d4/d9/f1c [0,4194304] 0 2024-04-01T06:57:36.432 INFO:tasks.workunit.client.0.smithi083.stdout:7/243: dread - d0/f4d zero size 2024-04-01T06:57:36.432 INFO:tasks.workunit.client.0.smithi083.stdout:0/281: rmdir d16/d2e/d3d 39 2024-04-01T06:57:36.432 INFO:tasks.workunit.client.0.smithi083.stdout:0/282: chown d16/d1d/c1e 163 1 2024-04-01T06:57:36.434 INFO:tasks.workunit.client.0.smithi083.stdout:9/238: dwrite d6/f27 [0,4194304] 0 2024-04-01T06:57:36.436 INFO:tasks.workunit.client.0.smithi083.stdout:4/202: symlink d1/d4/d1f/l3b 0 2024-04-01T06:57:36.436 INFO:tasks.workunit.client.0.smithi083.stdout:4/203: stat d1/d8/c21 0 2024-04-01T06:57:36.437 INFO:tasks.workunit.client.0.smithi083.stdout:5/195: mknod d4/d9/d16/d19/c40 0 2024-04-01T06:57:36.438 INFO:tasks.workunit.client.0.smithi083.stdout:2/350: dread d3/f2f [0,4194304] 0 2024-04-01T06:57:36.438 INFO:tasks.workunit.client.0.smithi083.stdout:2/351: readlink d3/d26/l45 0 2024-04-01T06:57:36.438 INFO:tasks.workunit.client.0.smithi083.stdout:5/196: stat d4/d23/f29 0 2024-04-01T06:57:36.438 INFO:tasks.workunit.client.0.smithi083.stdout:7/244: mkdir d0/d4/d9/d4e 0 2024-04-01T06:57:36.438 INFO:tasks.workunit.client.0.smithi083.stdout:7/245: chown d0/d4/ff 2 1 2024-04-01T06:57:36.440 INFO:tasks.workunit.client.0.smithi083.stdout:9/239: unlink d6/d32/l1d 0 2024-04-01T06:57:36.442 INFO:tasks.workunit.client.0.smithi083.stdout:4/204: rename d1/d4/d1f/l3a to d1/d4/db/l3c 0 2024-04-01T06:57:36.444 INFO:tasks.workunit.client.0.smithi083.stdout:9/240: write d6/f2f [679190,48078] 0 2024-04-01T06:57:36.444 INFO:tasks.workunit.client.0.smithi083.stdout:5/197: symlink d4/d9/d16/d19/l41 0 2024-04-01T06:57:36.445 INFO:tasks.workunit.client.0.smithi083.stdout:6/218: dwrite d9/f19 [4194304,4194304] 0 2024-04-01T06:57:36.445 INFO:tasks.workunit.client.0.smithi083.stdout:2/352: symlink d3/d26/d59/d70/d53/l7a 0 2024-04-01T06:57:36.447 INFO:tasks.workunit.client.0.smithi083.stdout:7/246: unlink d0/l15 0 2024-04-01T06:57:36.447 INFO:tasks.workunit.client.0.smithi083.stdout:7/247: chown d0/d10/f3c 2 1 2024-04-01T06:57:36.448 INFO:tasks.workunit.client.0.smithi083.stdout:7/248: write d0/d10/f27 [4179341,48287] 0 2024-04-01T06:57:36.449 INFO:tasks.workunit.client.0.smithi083.stdout:4/205: getdents d1/d4/da 0 2024-04-01T06:57:36.451 INFO:tasks.workunit.client.0.smithi083.stdout:5/198: unlink d4/d2b/d21/l3e 0 2024-04-01T06:57:36.455 INFO:tasks.workunit.client.0.smithi083.stdout:6/219: creat d9/dc/d1b/f43 x:0 0 0 2024-04-01T06:57:36.456 INFO:tasks.workunit.client.0.smithi083.stdout:1/388: dwrite db/d1c/d29/d33/d50/d5d/d6c/f74 [0,4194304] 0 2024-04-01T06:57:36.456 INFO:tasks.workunit.client.0.smithi083.stdout:1/389: write db/d1c/d2e/f2f [4228115,6203] 0 2024-04-01T06:57:36.457 INFO:tasks.workunit.client.0.smithi083.stdout:2/353: creat d3/d26/d59/d70/d53/d5e/f7b x:0 0 0 2024-04-01T06:57:36.458 INFO:tasks.workunit.client.0.smithi083.stdout:4/206: truncate d1/d4/db/f11 307452 0 2024-04-01T06:57:36.458 INFO:tasks.workunit.client.0.smithi083.stdout:4/207: write d1/d4/da/f39 [674056,72732] 0 2024-04-01T06:57:36.460 INFO:tasks.workunit.client.0.smithi083.stdout:5/199: symlink d4/d9/d16/d19/l42 0 2024-04-01T06:57:36.460 INFO:tasks.workunit.client.0.smithi083.stdout:0/283: dwrite d16/d3a/f3c [0,4194304] 0 2024-04-01T06:57:36.462 INFO:tasks.workunit.client.0.smithi083.stdout:6/220: unlink d9/dc/f32 0 2024-04-01T06:57:36.462 INFO:tasks.workunit.client.0.smithi083.stdout:6/221: write d9/f1a [711667,102828] 0 2024-04-01T06:57:36.463 INFO:tasks.workunit.client.0.smithi083.stdout:3/423: dwrite d6/d1e/f31 [4194304,4194304] 0 2024-04-01T06:57:36.464 INFO:tasks.workunit.client.0.smithi083.stdout:9/241: dwrite d6/d32/d3c/d4c/f50 [4194304,4194304] 0 2024-04-01T06:57:36.464 INFO:tasks.workunit.client.0.smithi083.stdout:9/242: chown d6/d29/c31 6956820 1 2024-04-01T06:57:36.465 INFO:tasks.workunit.client.0.smithi083.stdout:7/249: dwrite d0/f37 [0,4194304] 0 2024-04-01T06:57:36.465 INFO:tasks.workunit.client.0.smithi083.stdout:1/390: rename db/d1c/d29/d33/d50/d5c to db/d1c/d1d/d8b 0 2024-04-01T06:57:36.467 INFO:tasks.workunit.client.0.smithi083.stdout:2/354: rmdir d3/d4d/d57 39 2024-04-01T06:57:36.468 INFO:tasks.workunit.client.0.smithi083.stdout:5/200: symlink d4/d9/l43 0 2024-04-01T06:57:36.470 INFO:tasks.workunit.client.0.smithi083.stdout:0/284: symlink d16/d1d/l5e 0 2024-04-01T06:57:36.470 INFO:tasks.workunit.client.0.smithi083.stdout:6/222: mkdir d9/dc/d29/d44 0 2024-04-01T06:57:36.473 INFO:tasks.workunit.client.0.smithi083.stdout:9/243: rmdir d6/d32/d3c/d3d 39 2024-04-01T06:57:36.478 INFO:tasks.workunit.client.0.smithi083.stdout:3/424: rename d6/d15/d2d/d2f/l4d to d6/d12/l91 0 2024-04-01T06:57:36.481 INFO:tasks.workunit.client.0.smithi083.stdout:1/391: unlink db/f10 0 2024-04-01T06:57:36.481 INFO:tasks.workunit.client.0.smithi083.stdout:4/208: write d1/d4/db/f11 [223052,51401] 0 2024-04-01T06:57:36.482 INFO:tasks.workunit.client.0.smithi083.stdout:2/355: creat d3/d26/d59/d70/d53/d5f/f7c x:0 0 0 2024-04-01T06:57:36.483 INFO:tasks.workunit.client.0.smithi083.stdout:5/201: creat d4/d9/d16/d1f/f44 x:0 0 0 2024-04-01T06:57:36.484 INFO:tasks.workunit.client.0.smithi083.stdout:0/285: dwrite d16/d1d/f23 [0,4194304] 0 2024-04-01T06:57:36.485 INFO:tasks.workunit.client.0.smithi083.stdout:6/223: read f8 [1775010,34055] 0 2024-04-01T06:57:36.487 INFO:tasks.workunit.client.0.smithi083.stdout:9/244: link d6/d32/d26/c28 d6/d32/d26/c51 0 2024-04-01T06:57:36.489 INFO:tasks.workunit.client.0.smithi083.stdout:7/250: rename d0/f3f to d0/d10/d38/f4f 0 2024-04-01T06:57:36.491 INFO:tasks.workunit.client.0.smithi083.stdout:3/425: symlink d6/d15/d2d/d2f/d42/d46/l92 0 2024-04-01T06:57:36.492 INFO:tasks.workunit.client.0.smithi083.stdout:3/426: read - d6/d15/f8e zero size 2024-04-01T06:57:36.493 INFO:tasks.workunit.client.0.smithi083.stdout:1/392: read db/d1c/d29/d33/d47/f55 [496067,129370] 0 2024-04-01T06:57:36.493 INFO:tasks.workunit.client.0.smithi083.stdout:7/251: dread d0/d4/d9/f3e [0,4194304] 0 2024-04-01T06:57:36.496 INFO:tasks.workunit.client.0.smithi083.stdout:5/202: rmdir d4/d23 39 2024-04-01T06:57:36.496 INFO:tasks.workunit.client.0.smithi083.stdout:5/203: stat d4/d2b/d21/c28 0 2024-04-01T06:57:36.499 INFO:tasks.workunit.client.0.smithi083.stdout:0/286: symlink d16/d2e/d3d/d5d/l5f 0 2024-04-01T06:57:36.499 INFO:tasks.workunit.client.0.smithi083.stdout:9/245: dwrite d6/d32/d26/d2d/d34/f40 [0,4194304] 0 2024-04-01T06:57:36.500 INFO:tasks.workunit.client.0.smithi083.stdout:7/252: dread d0/d10/f47 [0,4194304] 0 2024-04-01T06:57:36.504 INFO:tasks.workunit.client.0.smithi083.stdout:6/224: mkdir d9/dc/d29/d3c/d45 0 2024-04-01T06:57:36.505 INFO:tasks.workunit.client.0.smithi083.stdout:5/204: mknod d4/d2b/c45 0 2024-04-01T06:57:36.506 INFO:tasks.workunit.client.0.smithi083.stdout:0/287: mknod d16/d1d/c60 0 2024-04-01T06:57:36.507 INFO:tasks.workunit.client.0.smithi083.stdout:9/246: rmdir d6/d32/d3c 39 2024-04-01T06:57:36.507 INFO:tasks.workunit.client.0.smithi083.stdout:5/205: dread d4/d23/f29 [0,4194304] 0 2024-04-01T06:57:36.508 INFO:tasks.workunit.client.0.smithi083.stdout:7/253: mknod d0/d4/d9/d43/c50 0 2024-04-01T06:57:36.509 INFO:tasks.workunit.client.0.smithi083.stdout:6/225: unlink d9/dc/d1b/f37 0 2024-04-01T06:57:36.515 INFO:tasks.workunit.client.0.smithi083.stdout:2/356: rename d3/c1e to d3/d26/d59/d70/d53/d66/c7d 0 2024-04-01T06:57:36.515 INFO:tasks.workunit.client.0.smithi083.stdout:0/288: creat d16/d3a/f61 x:0 0 0 2024-04-01T06:57:36.515 INFO:tasks.workunit.client.0.smithi083.stdout:9/247: dread d6/f27 [0,4194304] 0 2024-04-01T06:57:36.515 INFO:tasks.workunit.client.0.smithi083.stdout:7/254: symlink d0/d4/d9/l51 0 2024-04-01T06:57:36.515 INFO:tasks.workunit.client.0.smithi083.stdout:7/255: write d0/d4/d9/f22 [4583086,67278] 0 2024-04-01T06:57:36.515 INFO:tasks.workunit.client.0.smithi083.stdout:7/256: truncate d0/f49 192043 0 2024-04-01T06:57:36.516 INFO:tasks.workunit.client.0.smithi083.stdout:0/289: creat d16/f62 x:0 0 0 2024-04-01T06:57:36.516 INFO:tasks.workunit.client.0.smithi083.stdout:0/290: fdatasync d16/d3a/f3c 0 2024-04-01T06:57:36.516 INFO:tasks.workunit.client.0.smithi083.stdout:0/291: fsync d16/d1d/f54 0 2024-04-01T06:57:36.516 INFO:tasks.workunit.client.0.smithi083.stdout:0/292: dread - d16/f62 zero size 2024-04-01T06:57:36.516 INFO:tasks.workunit.client.0.smithi083.stdout:5/206: dwrite d4/d9/d16/d1f/f44 [0,4194304] 0 2024-04-01T06:57:36.516 INFO:tasks.workunit.client.0.smithi083.stdout:9/248: creat d6/d32/d4d/f52 x:0 0 0 2024-04-01T06:57:36.517 INFO:tasks.workunit.client.0.smithi083.stdout:7/257: truncate d0/d4/d9/f25 169639 0 2024-04-01T06:57:36.518 INFO:tasks.workunit.client.0.smithi083.stdout:1/393: rename db/d1c/f25 to db/d1c/d1d/d8b/f8c 0 2024-04-01T06:57:36.518 INFO:tasks.workunit.client.0.smithi083.stdout:6/226: rename d9 to d9/dc/d1b/d39/d46 22 2024-04-01T06:57:36.520 INFO:tasks.workunit.client.0.smithi083.stdout:6/227: write d9/dc/d29/f2a [2532672,112629] 0 2024-04-01T06:57:36.520 INFO:tasks.workunit.client.0.smithi083.stdout:6/228: stat d9/f21 0 2024-04-01T06:57:36.521 INFO:tasks.workunit.client.0.smithi083.stdout:5/207: rmdir d4/d9/d16/d1f/d2f 39 2024-04-01T06:57:36.521 INFO:tasks.workunit.client.0.smithi083.stdout:9/249: dread d6/f27 [0,4194304] 0 2024-04-01T06:57:36.521 INFO:tasks.workunit.client.0.smithi083.stdout:9/250: truncate d6/d32/d26/d2d/f4a 330188 0 2024-04-01T06:57:36.521 INFO:tasks.workunit.client.0.smithi083.stdout:9/251: fdatasync d6/d32/d26/d2d/d34/f40 0 2024-04-01T06:57:36.522 INFO:tasks.workunit.client.0.smithi083.stdout:6/229: write d9/dc/f14 [349976,16035] 0 2024-04-01T06:57:36.522 INFO:tasks.workunit.client.0.smithi083.stdout:5/208: truncate d4/d9/f12 1580178 0 2024-04-01T06:57:36.523 INFO:tasks.workunit.client.0.smithi083.stdout:9/252: rename d6/f19 to d6/f53 0 2024-04-01T06:57:36.524 INFO:tasks.workunit.client.0.smithi083.stdout:6/230: mkdir d9/dc/d1b/d39/d47 0 2024-04-01T06:57:36.525 INFO:tasks.workunit.client.0.smithi083.stdout:1/394: dread db/f14 [0,4194304] 0 2024-04-01T06:57:36.525 INFO:tasks.workunit.client.0.smithi083.stdout:5/209: link d4/d2b/f31 d4/d9/d16/d1f/d2f/f46 0 2024-04-01T06:57:36.527 INFO:tasks.workunit.client.0.smithi083.stdout:9/253: creat d6/d32/d26/d2d/f54 x:0 0 0 2024-04-01T06:57:36.528 INFO:tasks.workunit.client.0.smithi083.stdout:2/357: dwrite d3/d20/f2a [0,4194304] 0 2024-04-01T06:57:36.531 INFO:tasks.workunit.client.0.smithi083.stdout:9/254: creat d6/d32/d3c/d4c/f55 x:0 0 0 2024-04-01T06:57:36.531 INFO:tasks.workunit.client.0.smithi083.stdout:9/255: write d6/d32/d26/d2d/f54 [998702,54499] 0 2024-04-01T06:57:36.531 INFO:tasks.workunit.client.0.smithi083.stdout:7/258: rmdir d0 39 2024-04-01T06:57:36.532 INFO:tasks.workunit.client.0.smithi083.stdout:5/210: write d4/d9/d16/d1f/f22 [74353,59600] 0 2024-04-01T06:57:36.532 INFO:tasks.workunit.client.0.smithi083.stdout:7/259: dread d0/d10/d38/f4f [0,4194304] 0 2024-04-01T06:57:36.534 INFO:tasks.workunit.client.0.smithi083.stdout:2/358: rename d3/ff to d3/d26/d59/d27/f7e 0 2024-04-01T06:57:36.537 INFO:tasks.workunit.client.0.smithi083.stdout:9/256: link d6/cf d6/d29/c56 0 2024-04-01T06:57:36.537 INFO:tasks.workunit.client.0.smithi083.stdout:9/257: fdatasync d6/d32/d26/d2d/f4a 0 2024-04-01T06:57:36.541 INFO:tasks.workunit.client.0.smithi083.stdout:1/395: dwrite db/d1c/d29/d33/d50/d4d/d73/f79 [0,4194304] 0 2024-04-01T06:57:36.542 INFO:tasks.workunit.client.0.smithi083.stdout:2/359: dread d3/d26/d59/d2b/f39 [0,4194304] 0 2024-04-01T06:57:36.542 INFO:tasks.workunit.client.0.smithi083.stdout:7/260: rename d0/cb to d0/d4/c52 0 2024-04-01T06:57:36.546 INFO:tasks.workunit.client.0.smithi083.stdout:6/231: rmdir d9/dc/d1b 39 2024-04-01T06:57:36.546 INFO:tasks.workunit.client.0.smithi083.stdout:6/232: chown d9/dc/d1b/d35/c36 163 1 2024-04-01T06:57:36.546 INFO:tasks.workunit.client.0.smithi083.stdout:6/233: fdatasync d9/dc/f30 0 2024-04-01T06:57:36.548 INFO:tasks.workunit.client.0.smithi083.stdout:6/234: mkdir d9/dc/d1b/d35/d48 0 2024-04-01T06:57:36.552 INFO:tasks.workunit.client.0.smithi083.stdout:6/235: rename d9/dc/f27 to d9/dc/d1b/d39/d47/f49 0 2024-04-01T06:57:36.554 INFO:tasks.workunit.client.0.smithi083.stdout:6/236: symlink d9/dc/d1b/d35/l4a 0 2024-04-01T06:57:36.554 INFO:tasks.workunit.client.0.smithi083.stdout:6/237: write d9/dc/f42 [119845,100672] 0 2024-04-01T06:57:36.555 INFO:tasks.workunit.client.0.smithi083.stdout:6/238: creat d9/dc/d1b/f4b x:0 0 0 2024-04-01T06:57:36.557 INFO:tasks.workunit.client.0.smithi083.stdout:6/239: mkdir d9/dc/d1b/d4c 0 2024-04-01T06:57:36.562 INFO:tasks.workunit.client.0.smithi083.stdout:9/258: dwrite d6/d32/d26/d2d/f4a [0,4194304] 0 2024-04-01T06:57:36.563 INFO:tasks.workunit.client.0.smithi083.stdout:1/396: dwrite db/d1c/d49/f7d [0,4194304] 0 2024-04-01T06:57:36.563 INFO:tasks.workunit.client.0.smithi083.stdout:1/397: write db/fd [1130329,6783] 0 2024-04-01T06:57:36.564 INFO:tasks.workunit.client.0.smithi083.stdout:9/259: write d6/d32/d26/d2d/f4a [1380185,65139] 0 2024-04-01T06:57:36.564 INFO:tasks.workunit.client.0.smithi083.stdout:9/260: write d6/f53 [4194578,8624] 0 2024-04-01T06:57:36.566 INFO:tasks.workunit.client.0.smithi083.stdout:7/261: dwrite d0/d4/f16 [0,4194304] 0 2024-04-01T06:57:36.566 INFO:tasks.workunit.client.0.smithi083.stdout:7/262: dread - d0/d4/f2a zero size 2024-04-01T06:57:36.566 INFO:tasks.workunit.client.0.smithi083.stdout:7/263: fdatasync d0/f49 0 2024-04-01T06:57:36.566 INFO:tasks.workunit.client.0.smithi083.stdout:7/264: dread - d0/d4/f2a zero size 2024-04-01T06:57:36.568 INFO:tasks.workunit.client.0.smithi083.stdout:1/398: mknod db/d61/c8d 0 2024-04-01T06:57:36.568 INFO:tasks.workunit.client.0.smithi083.stdout:1/399: write db/d1c/d1d/f6b [439230,75544] 0 2024-04-01T06:57:36.569 INFO:tasks.workunit.client.0.smithi083.stdout:2/360: dwrite d3/fc [4194304,4194304] 0 2024-04-01T06:57:36.570 INFO:tasks.workunit.client.0.smithi083.stdout:9/261: read d6/d32/d26/d2d/f1f [222470,74520] 0 2024-04-01T06:57:36.572 INFO:tasks.workunit.client.0.smithi083.stdout:7/265: rmdir d0/d10/d34 39 2024-04-01T06:57:36.573 INFO:tasks.workunit.client.0.smithi083.stdout:1/400: stat db/d1c/d29/f46 0 2024-04-01T06:57:36.573 INFO:tasks.workunit.client.0.smithi083.stdout:6/240: dwrite d9/dc/d1b/f41 [0,4194304] 0 2024-04-01T06:57:36.573 INFO:tasks.workunit.client.0.smithi083.stdout:6/241: chown d9/dc/fe 286658 1 2024-04-01T06:57:36.577 INFO:tasks.workunit.client.0.smithi083.stdout:9/262: rename d6/f27 to d6/d32/d3c/f57 0 2024-04-01T06:57:36.578 INFO:tasks.workunit.client.0.smithi083.stdout:9/263: write d6/d32/d26/d2d/f4a [1250899,9804] 0 2024-04-01T06:57:36.579 INFO:tasks.workunit.client.0.smithi083.stdout:6/242: truncate d9/dc/f14 865322 0 2024-04-01T06:57:36.581 INFO:tasks.workunit.client.0.smithi083.stdout:7/266: link d0/f49 d0/d10/f53 0 2024-04-01T06:57:36.583 INFO:tasks.workunit.client.0.smithi083.stdout:9/264: symlink d6/d32/l58 0 2024-04-01T06:57:36.584 INFO:tasks.workunit.client.0.smithi083.stdout:6/243: rename d9/dc/d29/f34 to d9/dc/d1b/f4d 0 2024-04-01T06:57:36.585 INFO:tasks.workunit.client.0.smithi083.stdout:9/265: truncate d6/d32/f1a 6356434 0 2024-04-01T06:57:36.587 INFO:tasks.workunit.client.0.smithi083.stdout:7/267: rename d0/d4/d9/f1c to d0/d4b/f54 0 2024-04-01T06:57:36.589 INFO:tasks.workunit.client.0.smithi083.stdout:1/401: dwrite db/d1c/d29/d33/d50/d5d/d6c/f7c [0,4194304] 0 2024-04-01T06:57:36.590 INFO:tasks.workunit.client.0.smithi083.stdout:1/402: chown db/d1c/d2e/d30/l31 1146054 1 2024-04-01T06:57:36.590 INFO:tasks.workunit.client.0.smithi083.stdout:7/268: creat d0/d4/d9/d39/f55 x:0 0 0 2024-04-01T06:57:36.593 INFO:tasks.workunit.client.0.smithi083.stdout:9/266: rename d6/d32/d26/d2d/c1c to d6/d32/d3c/c59 0 2024-04-01T06:57:36.593 INFO:tasks.workunit.client.0.smithi083.stdout:9/267: truncate d6/d32/d26/d2d/f54 1530818 0 2024-04-01T06:57:36.594 INFO:tasks.workunit.client.0.smithi083.stdout:8/346: sync 2024-04-01T06:57:36.594 INFO:tasks.workunit.client.0.smithi083.stdout:8/347: stat d15/d18/d19/d1d/f54 0 2024-04-01T06:57:36.594 INFO:tasks.workunit.client.0.smithi083.stdout:9/268: write d6/d32/f36 [3034467,85736] 0 2024-04-01T06:57:36.596 INFO:tasks.workunit.client.0.smithi083.stdout:1/403: mkdir db/d1c/d29/d33/d50/d5d/d6c/d8e 0 2024-04-01T06:57:36.597 INFO:tasks.workunit.client.0.smithi083.stdout:6/244: dwrite d9/dc/d1b/f41 [0,4194304] 0 2024-04-01T06:57:36.597 INFO:tasks.workunit.client.0.smithi083.stdout:7/269: symlink d0/d4/l56 0 2024-04-01T06:57:36.598 INFO:tasks.workunit.client.0.smithi083.stdout:8/348: link f9 d15/d1b/f84 0 2024-04-01T06:57:36.599 INFO:tasks.workunit.client.0.smithi083.stdout:9/269: creat d6/d32/d3c/d4c/f5a x:0 0 0 2024-04-01T06:57:36.599 INFO:tasks.workunit.client.0.smithi083.stdout:9/270: read - d6/d32/d3c/d4c/f5a zero size 2024-04-01T06:57:36.599 INFO:tasks.workunit.client.0.smithi083.stdout:9/271: dread - d6/d32/d3c/d4c/f5a zero size 2024-04-01T06:57:36.601 INFO:tasks.workunit.client.0.smithi083.stdout:1/404: rename db/fe to db/d1c/d1d/d8b/f8f 0 2024-04-01T06:57:36.601 INFO:tasks.workunit.client.0.smithi083.stdout:1/405: chown db/d1c/d1d/c66 315046 1 2024-04-01T06:57:36.601 INFO:tasks.workunit.client.0.smithi083.stdout:6/245: rmdir d9/dc/d1b/d39 39 2024-04-01T06:57:36.603 INFO:tasks.workunit.client.0.smithi083.stdout:7/270: creat d0/d10/d34/f57 x:0 0 0 2024-04-01T06:57:36.603 INFO:tasks.workunit.client.0.smithi083.stdout:7/271: read d0/d10/d38/f4f [3831,113011] 0 2024-04-01T06:57:36.604 INFO:tasks.workunit.client.0.smithi083.stdout:8/349: unlink d15/d18/d1e/c3e 0 2024-04-01T06:57:36.605 INFO:tasks.workunit.client.0.smithi083.stdout:8/350: read d15/d18/f31 [512348,14816] 0 2024-04-01T06:57:36.605 INFO:tasks.workunit.client.0.smithi083.stdout:8/351: fsync d15/d1b/d39/d48/f59 0 2024-04-01T06:57:36.605 INFO:tasks.workunit.client.0.smithi083.stdout:9/272: mkdir d6/d32/d3c/d5b 0 2024-04-01T06:57:36.606 INFO:tasks.workunit.client.0.smithi083.stdout:9/273: write d6/d32/d26/d2d/f4a [1482062,7419] 0 2024-04-01T06:57:36.607 INFO:tasks.workunit.client.0.smithi083.stdout:1/406: creat db/d1c/d29/d33/d50/d4d/f90 x:0 0 0 2024-04-01T06:57:36.608 INFO:tasks.workunit.client.0.smithi083.stdout:6/246: truncate d9/dc/f25 1410248 0 2024-04-01T06:57:36.609 INFO:tasks.workunit.client.0.smithi083.stdout:6/247: write d9/dc/f23 [1220163,54888] 0 2024-04-01T06:57:36.609 INFO:tasks.workunit.client.0.smithi083.stdout:7/272: creat d0/d4/f58 x:0 0 0 2024-04-01T06:57:36.610 INFO:tasks.workunit.client.0.smithi083.stdout:8/352: creat d15/d18/d19/d24/d38/d62/f85 x:0 0 0 2024-04-01T06:57:36.611 INFO:tasks.workunit.client.0.smithi083.stdout:1/407: creat db/d1c/d29/d33/d4b/f91 x:0 0 0 2024-04-01T06:57:36.613 INFO:tasks.workunit.client.0.smithi083.stdout:6/248: creat d9/dc/d29/d3c/d45/f4e x:0 0 0 2024-04-01T06:57:36.614 INFO:tasks.workunit.client.0.smithi083.stdout:7/273: unlink d0/d4/d9/l36 0 2024-04-01T06:57:36.617 INFO:tasks.workunit.client.0.smithi083.stdout:8/353: link d15/d18/d19/d24/d38/f41 d15/d1b/d39/d48/d5e/d70/f86 0 2024-04-01T06:57:36.617 INFO:tasks.workunit.client.0.smithi083.stdout:1/408: creat db/d1c/d29/d33/d50/d5d/d81/f92 x:0 0 0 2024-04-01T06:57:36.619 INFO:tasks.workunit.client.0.smithi083.stdout:7/274: creat d0/d4/d9/d43/f59 x:0 0 0 2024-04-01T06:57:36.621 INFO:tasks.workunit.client.0.smithi083.stdout:8/354: link d15/d18/f37 d15/d1b/d39/d80/f87 0 2024-04-01T06:57:36.623 INFO:tasks.workunit.client.0.smithi083.stdout:1/409: mknod db/c93 0 2024-04-01T06:57:36.623 INFO:tasks.workunit.client.0.smithi083.stdout:9/274: dwrite d6/d32/d26/d2d/f54 [0,4194304] 0 2024-04-01T06:57:36.623 INFO:tasks.workunit.client.0.smithi083.stdout:6/249: dread d9/dc/d1b/f41 [0,4194304] 0 2024-04-01T06:57:36.623 INFO:tasks.workunit.client.0.smithi083.stdout:6/250: stat d9/dc/d29/c2b 0 2024-04-01T06:57:36.628 INFO:tasks.workunit.client.0.smithi083.stdout:8/355: unlink d15/d18/d19/d24/d38/d62/l53 0 2024-04-01T06:57:36.631 INFO:tasks.workunit.client.0.smithi083.stdout:9/275: creat d6/d32/d4d/f5c x:0 0 0 2024-04-01T06:57:36.632 INFO:tasks.workunit.client.0.smithi083.stdout:9/276: read - d6/d32/d3c/d4c/f55 zero size 2024-04-01T06:57:36.633 INFO:tasks.workunit.client.0.smithi083.stdout:6/251: symlink d9/dc/d29/d3c/d45/l4f 0 2024-04-01T06:57:36.635 INFO:tasks.workunit.client.0.smithi083.stdout:8/356: creat d15/d18/d19/d24/d44/f88 x:0 0 0 2024-04-01T06:57:36.639 INFO:tasks.workunit.client.0.smithi083.stdout:6/252: creat d9/dc/d1b/d39/d47/f50 x:0 0 0 2024-04-01T06:57:36.639 INFO:tasks.workunit.client.0.smithi083.stdout:1/410: dwrite db/f3b [0,4194304] 0 2024-04-01T06:57:36.640 INFO:tasks.workunit.client.0.smithi083.stdout:1/411: write db/d1c/d1d/d8b/f8f [2771938,119839] 0 2024-04-01T06:57:36.640 INFO:tasks.workunit.client.0.smithi083.stdout:1/412: truncate db/d1c/d1d/f1f 972333 0 2024-04-01T06:57:36.641 INFO:tasks.workunit.client.0.smithi083.stdout:8/357: dread d15/d18/f64 [4194304,4194304] 0 2024-04-01T06:57:36.643 INFO:tasks.workunit.client.0.smithi083.stdout:6/253: rename d9/dc/d1b/f1f to d9/dc/d1b/d35/f51 0 2024-04-01T06:57:36.643 INFO:tasks.workunit.client.0.smithi083.stdout:6/254: truncate d9/dc/f42 1151895 0 2024-04-01T06:57:36.643 INFO:tasks.workunit.client.0.smithi083.stdout:6/255: fsync d9/dc/d1b/f4b 0 2024-04-01T06:57:36.644 INFO:tasks.workunit.client.0.smithi083.stdout:1/413: truncate db/d1c/d29/d33/d50/d5d/d6c/f74 3795845 0 2024-04-01T06:57:36.645 INFO:tasks.workunit.client.0.smithi083.stdout:1/414: mkdir db/d1c/d29/d33/d50/d5d/d81/d94 0 2024-04-01T06:57:36.646 INFO:tasks.workunit.client.0.smithi083.stdout:1/415: creat db/d1c/d2e/d30/d82/f95 x:0 0 0 2024-04-01T06:57:36.648 INFO:tasks.workunit.client.0.smithi083.stdout:1/416: rename db/d1c/d2e/d30/f6a to db/d1c/d1d/d8b/f96 0 2024-04-01T06:57:36.648 INFO:tasks.workunit.client.0.smithi083.stdout:1/417: mknod db/d1c/d29/d33/d47/c97 0 2024-04-01T06:57:36.650 INFO:tasks.workunit.client.0.smithi083.stdout:1/418: creat db/d1c/d29/d33/d47/f98 x:0 0 0 2024-04-01T06:57:36.656 INFO:tasks.workunit.client.0.smithi083.stdout:8/358: dwrite d15/d18/d19/d24/d38/f41 [4194304,4194304] 0 2024-04-01T06:57:36.657 INFO:tasks.workunit.client.0.smithi083.stdout:6/256: dwrite d9/dc/f40 [0,4194304] 0 2024-04-01T06:57:36.659 INFO:tasks.workunit.client.0.smithi083.stdout:8/359: creat d15/d18/d19/d24/f89 x:0 0 0 2024-04-01T06:57:36.661 INFO:tasks.workunit.client.0.smithi083.stdout:1/419: dread db/d1c/d2e/d30/f3a [0,4194304] 0 2024-04-01T06:57:36.661 INFO:tasks.workunit.client.0.smithi083.stdout:1/420: fdatasync db/d1c/d2e/f6e 0 2024-04-01T06:57:36.662 INFO:tasks.workunit.client.0.smithi083.stdout:6/257: rename d9/dc/d29/d44 to d9/dc/d1b/d35/d48/d52 0 2024-04-01T06:57:36.662 INFO:tasks.workunit.client.0.smithi083.stdout:8/360: mknod d15/c8a 0 2024-04-01T06:57:36.663 INFO:tasks.workunit.client.0.smithi083.stdout:8/361: dread - d15/f74 zero size 2024-04-01T06:57:36.665 INFO:tasks.workunit.client.0.smithi083.stdout:1/421: rename db/d1c/f22 to db/d1c/d29/d33/d50/d5d/d6c/f99 0 2024-04-01T06:57:36.666 INFO:tasks.workunit.client.0.smithi083.stdout:6/258: symlink d9/dc/d1b/d35/d48/l53 0 2024-04-01T06:57:36.666 INFO:tasks.workunit.client.0.smithi083.stdout:6/259: write d9/dc/d1b/f43 [722115,58073] 0 2024-04-01T06:57:36.668 INFO:tasks.workunit.client.0.smithi083.stdout:8/362: link d15/d1b/d39/d48/f68 d15/d1b/d39/f8b 0 2024-04-01T06:57:36.668 INFO:tasks.workunit.client.0.smithi083.stdout:1/422: creat db/d1c/d1d/d8b/f9a x:0 0 0 2024-04-01T06:57:36.668 INFO:tasks.workunit.client.0.smithi083.stdout:1/423: readlink db/d1c/d29/d33/l80 0 2024-04-01T06:57:36.677 INFO:tasks.workunit.client.0.smithi083.stdout:6/260: dwrite f6 [0,4194304] 0 2024-04-01T06:57:36.678 INFO:tasks.workunit.client.0.smithi083.stdout:6/261: rename d9/dc/d29/d3c/d45/f4e to d9/dc/d1b/d35/d48/d52/f54 0 2024-04-01T06:57:36.679 INFO:tasks.workunit.client.0.smithi083.stdout:6/262: symlink d9/dc/l55 0 2024-04-01T06:57:36.679 INFO:tasks.workunit.client.0.smithi083.stdout:6/263: dread - d9/f21 zero size 2024-04-01T06:57:36.680 INFO:tasks.workunit.client.0.smithi083.stdout:6/264: symlink d9/dc/d1b/d4c/l56 0 2024-04-01T06:57:36.680 INFO:tasks.workunit.client.0.smithi083.stdout:6/265: fdatasync d9/dc/d1b/d35/f51 0 2024-04-01T06:57:36.690 INFO:tasks.workunit.client.0.smithi083.stdout:8/363: dwrite d15/f27 [0,4194304] 0 2024-04-01T06:57:36.690 INFO:tasks.workunit.client.0.smithi083.stdout:8/364: write d15/d18/f37 [886009,46145] 0 2024-04-01T06:57:36.692 INFO:tasks.workunit.client.0.smithi083.stdout:4/209: sync 2024-04-01T06:57:36.692 INFO:tasks.workunit.client.0.smithi083.stdout:3/427: sync 2024-04-01T06:57:36.693 INFO:tasks.workunit.client.0.smithi083.stdout:5/211: sync 2024-04-01T06:57:36.693 INFO:tasks.workunit.client.0.smithi083.stdout:0/293: sync 2024-04-01T06:57:36.693 INFO:tasks.workunit.client.0.smithi083.stdout:3/428: chown d6/d15/d2d/d2f/d53 5 1 2024-04-01T06:57:36.693 INFO:tasks.workunit.client.0.smithi083.stdout:5/212: readlink d4/l27 0 2024-04-01T06:57:36.694 INFO:tasks.workunit.client.0.smithi083.stdout:4/210: rename d1/d8/ld to d1/d4/db/l3d 0 2024-04-01T06:57:36.695 INFO:tasks.workunit.client.0.smithi083.stdout:5/213: creat d4/d9/d16/d1f/d2f/f47 x:0 0 0 2024-04-01T06:57:36.695 INFO:tasks.workunit.client.0.smithi083.stdout:5/214: stat d4/l2d 0 2024-04-01T06:57:36.697 INFO:tasks.workunit.client.0.smithi083.stdout:1/424: dwrite f1 [4194304,4194304] 0 2024-04-01T06:57:36.697 INFO:tasks.workunit.client.0.smithi083.stdout:4/211: unlink d1/d8/c21 0 2024-04-01T06:57:36.698 INFO:tasks.workunit.client.0.smithi083.stdout:1/425: readlink db/d1c/d29/l84 0 2024-04-01T06:57:36.698 INFO:tasks.workunit.client.0.smithi083.stdout:0/294: write f12 [494710,4979] 0 2024-04-01T06:57:36.699 INFO:tasks.workunit.client.0.smithi083.stdout:0/295: chown d16/f42 69217 1 2024-04-01T06:57:36.700 INFO:tasks.workunit.client.0.smithi083.stdout:4/212: truncate d1/d4/db/f20 3160161 0 2024-04-01T06:57:36.700 INFO:tasks.workunit.client.0.smithi083.stdout:4/213: fsync d1/d4/f25 0 2024-04-01T06:57:36.703 INFO:tasks.workunit.client.0.smithi083.stdout:1/426: unlink db/d61/f6d 0 2024-04-01T06:57:36.703 INFO:tasks.workunit.client.0.smithi083.stdout:1/427: chown db/c93 128188 1 2024-04-01T06:57:36.703 INFO:tasks.workunit.client.0.smithi083.stdout:6/266: dwrite d9/dc/f30 [0,4194304] 0 2024-04-01T06:57:36.703 INFO:tasks.workunit.client.0.smithi083.stdout:4/214: getdents d1/d4 0 2024-04-01T06:57:36.703 INFO:tasks.workunit.client.0.smithi083.stdout:4/215: chown d1/d4/db/l2b 10487703 1 2024-04-01T06:57:36.703 INFO:tasks.workunit.client.0.smithi083.stdout:4/216: chown d1/d4/da/l32 142660901 1 2024-04-01T06:57:36.703 INFO:tasks.workunit.client.0.smithi083.stdout:1/428: mknod db/d1c/d2e/d30/c9b 0 2024-04-01T06:57:36.705 INFO:tasks.workunit.client.0.smithi083.stdout:3/429: dread d6/d1e/f23 [4194304,4194304] 0 2024-04-01T06:57:36.706 INFO:tasks.workunit.client.0.smithi083.stdout:4/217: creat d1/d4/db/f3e x:0 0 0 2024-04-01T06:57:36.707 INFO:tasks.workunit.client.0.smithi083.stdout:8/365: dread d15/d1b/d39/d48/f56 [0,4194304] 0 2024-04-01T06:57:36.707 INFO:tasks.workunit.client.0.smithi083.stdout:1/429: mknod db/d1c/d29/d33/d4b/c9c 0 2024-04-01T06:57:36.709 INFO:tasks.workunit.client.0.smithi083.stdout:3/430: mknod d6/d15/d2d/d2f/d42/d5c/c93 0 2024-04-01T06:57:36.710 INFO:tasks.workunit.client.0.smithi083.stdout:6/267: getdents d9/dc/d1b/d35/d48 0 2024-04-01T06:57:36.711 INFO:tasks.workunit.client.0.smithi083.stdout:4/218: symlink d1/d4/d33/l3f 0 2024-04-01T06:57:36.711 INFO:tasks.workunit.client.0.smithi083.stdout:4/219: chown d1/d4/d1f/l3b 28322787 1 2024-04-01T06:57:36.713 INFO:tasks.workunit.client.0.smithi083.stdout:6/268: read d9/dc/d1b/d35/f51 [920252,47666] 0 2024-04-01T06:57:36.713 INFO:tasks.workunit.client.0.smithi083.stdout:6/269: stat d9/dc/d1b/d39/d47/f49 0 2024-04-01T06:57:36.713 INFO:tasks.workunit.client.0.smithi083.stdout:4/220: dread d1/d4/db/f18 [0,4194304] 0 2024-04-01T06:57:36.717 INFO:tasks.workunit.client.0.smithi083.stdout:5/215: dwrite d4/d23/f30 [0,4194304] 0 2024-04-01T06:57:36.718 INFO:tasks.workunit.client.0.smithi083.stdout:4/221: rename d1/d4/db/c24 to d1/c40 0 2024-04-01T06:57:36.719 INFO:tasks.workunit.client.0.smithi083.stdout:0/296: dwrite d16/d2e/d3d/f4e [0,4194304] 0 2024-04-01T06:57:36.719 INFO:tasks.workunit.client.0.smithi083.stdout:0/297: write d16/f4c [726617,23186] 0 2024-04-01T06:57:36.721 INFO:tasks.workunit.client.0.smithi083.stdout:1/430: dwrite db/f14 [0,4194304] 0 2024-04-01T06:57:36.721 INFO:tasks.workunit.client.0.smithi083.stdout:5/216: truncate d4/d9/f3a 2252174 0 2024-04-01T06:57:36.724 INFO:tasks.workunit.client.0.smithi083.stdout:8/366: dread d15/d18/d19/d1d/f36 [0,4194304] 0 2024-04-01T06:57:36.724 INFO:tasks.workunit.client.0.smithi083.stdout:6/270: dwrite d9/dc/f11 [0,4194304] 0 2024-04-01T06:57:36.724 INFO:tasks.workunit.client.0.smithi083.stdout:6/271: read - d9/dc/d1b/d39/d47/f50 zero size 2024-04-01T06:57:36.728 INFO:tasks.workunit.client.0.smithi083.stdout:0/298: rename d16/d55 to d16/d3a/d63 0 2024-04-01T06:57:36.728 INFO:tasks.workunit.client.0.smithi083.stdout:0/299: fdatasync d16/d2e/f36 0 2024-04-01T06:57:36.728 INFO:tasks.workunit.client.0.smithi083.stdout:0/300: readlink d16/d1d/l5e 0 2024-04-01T06:57:36.730 INFO:tasks.workunit.client.0.smithi083.stdout:1/431: mknod db/d1c/d29/d33/d50/d5d/c9d 0 2024-04-01T06:57:36.733 INFO:tasks.workunit.client.0.smithi083.stdout:1/432: dread db/d1c/d29/d33/d47/f55 [0,4194304] 0 2024-04-01T06:57:36.736 INFO:tasks.workunit.client.0.smithi083.stdout:6/272: mkdir d9/d57 0 2024-04-01T06:57:36.737 INFO:tasks.workunit.client.0.smithi083.stdout:0/301: mknod d16/d3a/d63/c64 0 2024-04-01T06:57:36.737 INFO:tasks.workunit.client.0.smithi083.stdout:0/302: chown d16/d3a/l47 126440 1 2024-04-01T06:57:36.738 INFO:tasks.workunit.client.0.smithi083.stdout:1/433: mknod db/d1c/d29/d33/d47/d76/c9e 0 2024-04-01T06:57:36.739 INFO:tasks.workunit.client.0.smithi083.stdout:6/273: symlink d9/dc/l58 0 2024-04-01T06:57:36.741 INFO:tasks.workunit.client.0.smithi083.stdout:6/274: dread d9/dc/d1b/d39/d47/f49 [0,4194304] 0 2024-04-01T06:57:36.741 INFO:tasks.workunit.client.0.smithi083.stdout:6/275: chown d9/dc/d1b/d39/d47/f49 64929791 1 2024-04-01T06:57:36.741 INFO:tasks.workunit.client.0.smithi083.stdout:6/276: truncate d9/dc/d1b/d39/d47/f50 321033 0 2024-04-01T06:57:36.742 INFO:tasks.workunit.client.0.smithi083.stdout:6/277: mknod d9/dc/d1b/d35/c59 0 2024-04-01T06:57:36.742 INFO:tasks.workunit.client.0.smithi083.stdout:2/361: sync 2024-04-01T06:57:36.746 INFO:tasks.workunit.client.0.smithi083.stdout:6/278: rename d9/dc/d1b/d4c/l56 to d9/dc/d1b/d39/d47/l5a 0 2024-04-01T06:57:36.746 INFO:tasks.workunit.client.0.smithi083.stdout:6/279: write d9/dc/f23 [4003742,14234] 0 2024-04-01T06:57:36.746 INFO:tasks.workunit.client.0.smithi083.stdout:2/362: getdents d3/d26/d59/d2b 0 2024-04-01T06:57:36.747 INFO:tasks.workunit.client.0.smithi083.stdout:4/222: dwrite d1/d4/db/f20 [0,4194304] 0 2024-04-01T06:57:36.747 INFO:tasks.workunit.client.0.smithi083.stdout:4/223: stat d1/d4/d1f/d2a 0 2024-04-01T06:57:36.748 INFO:tasks.workunit.client.0.smithi083.stdout:5/217: dwrite d4/d9/d16/d1f/d2f/f46 [0,4194304] 0 2024-04-01T06:57:36.748 INFO:tasks.workunit.client.0.smithi083.stdout:0/303: dread d16/d3a/f3c [0,4194304] 0 2024-04-01T06:57:36.748 INFO:tasks.workunit.client.0.smithi083.stdout:6/280: mkdir d9/dc/d29/d5b 0 2024-04-01T06:57:36.749 INFO:tasks.workunit.client.0.smithi083.stdout:5/218: write d4/d9/d16/d1f/d2f/f46 [1791482,29485] 0 2024-04-01T06:57:36.753 INFO:tasks.workunit.client.0.smithi083.stdout:8/367: dwrite d15/d1b/d39/d48/d5e/d70/f86 [0,4194304] 0 2024-04-01T06:57:36.753 INFO:tasks.workunit.client.0.smithi083.stdout:8/368: stat d15/d18/d19/d1d/f60 0 2024-04-01T06:57:36.753 INFO:tasks.workunit.client.0.smithi083.stdout:6/281: mkdir d9/dc/d29/d3c/d5c 0 2024-04-01T06:57:36.756 INFO:tasks.workunit.client.0.smithi083.stdout:5/219: rmdir d4 39 2024-04-01T06:57:36.758 INFO:tasks.workunit.client.0.smithi083.stdout:8/369: link d15/d18/l42 d15/d1b/d39/d80/l8c 0 2024-04-01T06:57:36.758 INFO:tasks.workunit.client.0.smithi083.stdout:8/370: getdents d15/d18/d19/d6c 0 2024-04-01T06:57:36.758 INFO:tasks.workunit.client.0.smithi083.stdout:8/371: readlink d15/d18/d19/l26 0 2024-04-01T06:57:36.758 INFO:tasks.workunit.client.0.smithi083.stdout:8/372: chown d15/f27 111 1 2024-04-01T06:57:36.758 INFO:tasks.workunit.client.0.smithi083.stdout:0/304: rmdir d16/d1d 39 2024-04-01T06:57:36.760 INFO:tasks.workunit.client.0.smithi083.stdout:0/305: symlink d16/d2e/l65 0 2024-04-01T06:57:36.760 INFO:tasks.workunit.client.0.smithi083.stdout:2/363: dwrite d3/d4d/f52 [0,4194304] 0 2024-04-01T06:57:36.761 INFO:tasks.workunit.client.0.smithi083.stdout:0/306: dread d16/d1d/f37 [0,4194304] 0 2024-04-01T06:57:36.764 INFO:tasks.workunit.client.0.smithi083.stdout:2/364: getdents d3/d4d/d5d 0 2024-04-01T06:57:36.764 INFO:tasks.workunit.client.0.smithi083.stdout:2/365: chown d3/d4d/d57 94 1 2024-04-01T06:57:36.765 INFO:tasks.workunit.client.0.smithi083.stdout:0/307: rmdir d16/d1d 39 2024-04-01T06:57:36.767 INFO:tasks.workunit.client.0.smithi083.stdout:0/308: creat d16/f66 x:0 0 0 2024-04-01T06:57:36.772 INFO:tasks.workunit.client.0.smithi083.stdout:2/366: dread d3/f1c [0,4194304] 0 2024-04-01T06:57:36.772 INFO:tasks.workunit.client.0.smithi083.stdout:2/367: dread - d3/d20/d42/f6c zero size 2024-04-01T06:57:36.776 INFO:tasks.workunit.client.0.smithi083.stdout:2/368: unlink d3/d26/d59/d70/d53/d5e/f69 0 2024-04-01T06:57:36.777 INFO:tasks.workunit.client.0.smithi083.stdout:6/282: dwrite d9/dc/d1b/d39/d47/f50 [0,4194304] 0 2024-04-01T06:57:36.778 INFO:tasks.workunit.client.0.smithi083.stdout:1/434: dwrite db/f13 [0,4194304] 0 2024-04-01T06:57:36.778 INFO:tasks.workunit.client.0.smithi083.stdout:4/224: dwrite d1/f2 [0,4194304] 0 2024-04-01T06:57:36.778 INFO:tasks.workunit.client.0.smithi083.stdout:4/225: fdatasync d1/f37 0 2024-04-01T06:57:36.780 INFO:tasks.workunit.client.0.smithi083.stdout:6/283: dread d9/dc/f14 [0,4194304] 0 2024-04-01T06:57:36.781 INFO:tasks.workunit.client.0.smithi083.stdout:2/369: rename d3/d26/d59/d2b/f49 to d3/f7f 0 2024-04-01T06:57:36.783 INFO:tasks.workunit.client.0.smithi083.stdout:1/435: unlink db/d1c/d29/d33/d50/d5d/d6c/f71 0 2024-04-01T06:57:36.783 INFO:tasks.workunit.client.0.smithi083.stdout:1/436: chown db/d1c 3 1 2024-04-01T06:57:36.783 INFO:tasks.workunit.client.0.smithi083.stdout:1/437: truncate db/d1c/f24 1667631 0 2024-04-01T06:57:36.783 INFO:tasks.workunit.client.0.smithi083.stdout:0/309: dwrite d16/d1d/f54 [0,4194304] 0 2024-04-01T06:57:36.783 INFO:tasks.workunit.client.0.smithi083.stdout:0/310: write d16/d1d/f20 [924256,108596] 0 2024-04-01T06:57:36.784 INFO:tasks.workunit.client.0.smithi083.stdout:4/226: creat d1/d4/db/f41 x:0 0 0 2024-04-01T06:57:36.785 INFO:tasks.workunit.client.0.smithi083.stdout:6/284: creat d9/dc/d29/f5d x:0 0 0 2024-04-01T06:57:36.785 INFO:tasks.workunit.client.0.smithi083.stdout:2/370: mknod d3/d20/d42/c80 0 2024-04-01T06:57:36.786 INFO:tasks.workunit.client.0.smithi083.stdout:2/371: chown d3/d26/d59/d70/d53/d66/c7d 228509141 1 2024-04-01T06:57:36.786 INFO:tasks.workunit.client.0.smithi083.stdout:2/372: dread - d3/d4d/d5d/f74 zero size 2024-04-01T06:57:36.786 INFO:tasks.workunit.client.0.smithi083.stdout:2/373: chown d3/f72 29 1 2024-04-01T06:57:36.786 INFO:tasks.workunit.client.0.smithi083.stdout:1/438: link db/d1c/d2e/d30/l3f db/d1c/d29/d33/d50/d5d/d6c/d8e/l9f 0 2024-04-01T06:57:36.787 INFO:tasks.workunit.client.0.smithi083.stdout:1/439: read db/f39 [1604946,55806] 0 2024-04-01T06:57:36.788 INFO:tasks.workunit.client.0.smithi083.stdout:0/311: link d16/f4c d16/d2e/d3d/d5d/f67 0 2024-04-01T06:57:36.788 INFO:tasks.workunit.client.0.smithi083.stdout:0/312: chown d16/d3a 13752830 1 2024-04-01T06:57:36.789 INFO:tasks.workunit.client.0.smithi083.stdout:4/227: stat d1/d4/db/l3d 0 2024-04-01T06:57:36.790 INFO:tasks.workunit.client.0.smithi083.stdout:7/275: sync 2024-04-01T06:57:36.790 INFO:tasks.workunit.client.0.smithi083.stdout:9/277: sync 2024-04-01T06:57:36.790 INFO:tasks.workunit.client.0.smithi083.stdout:7/276: read d0/f2b [5525714,28360] 0 2024-04-01T06:57:36.791 INFO:tasks.workunit.client.0.smithi083.stdout:2/374: mkdir d3/d71/d81 0 2024-04-01T06:57:36.792 INFO:tasks.workunit.client.0.smithi083.stdout:1/440: mknod db/d1c/d29/d33/d47/d76/ca0 0 2024-04-01T06:57:36.794 INFO:tasks.workunit.client.0.smithi083.stdout:6/285: rmdir d9/dc/d1b/d35/d48 39 2024-04-01T06:57:36.794 INFO:tasks.workunit.client.0.smithi083.stdout:6/286: chown d9/dc/d1b/f3f 45340197 1 2024-04-01T06:57:36.795 INFO:tasks.workunit.client.0.smithi083.stdout:0/313: mkdir d16/d3a/d4b/d68 0 2024-04-01T06:57:36.796 INFO:tasks.workunit.client.0.smithi083.stdout:4/228: mkdir d1/d8/d42 0 2024-04-01T06:57:36.796 INFO:tasks.workunit.client.0.smithi083.stdout:9/278: stat d6/l20 0 2024-04-01T06:57:36.797 INFO:tasks.workunit.client.0.smithi083.stdout:1/441: mknod db/d1c/d49/ca1 0 2024-04-01T06:57:36.799 INFO:tasks.workunit.client.0.smithi083.stdout:0/314: creat d16/d3a/d63/f69 x:0 0 0 2024-04-01T06:57:36.799 INFO:tasks.workunit.client.0.smithi083.stdout:0/315: dread - d16/d2e/d3d/f59 zero size 2024-04-01T06:57:36.800 INFO:tasks.workunit.client.0.smithi083.stdout:0/316: dread - d16/f66 zero size 2024-04-01T06:57:36.800 INFO:tasks.workunit.client.0.smithi083.stdout:4/229: creat d1/d4/d33/f43 x:0 0 0 2024-04-01T06:57:36.800 INFO:tasks.workunit.client.0.smithi083.stdout:4/230: readlink d1/d4/l22 0 2024-04-01T06:57:36.800 INFO:tasks.workunit.client.0.smithi083.stdout:4/231: fsync d1/d4/da/f29 0 2024-04-01T06:57:36.802 INFO:tasks.workunit.client.0.smithi083.stdout:9/279: creat d6/d32/d3c/d5b/f5d x:0 0 0 2024-04-01T06:57:36.802 INFO:tasks.workunit.client.0.smithi083.stdout:6/287: rmdir d9/dc/d29 39 2024-04-01T06:57:36.804 INFO:tasks.workunit.client.0.smithi083.stdout:1/442: creat db/d1c/d29/d33/d50/fa2 x:0 0 0 2024-04-01T06:57:36.804 INFO:tasks.workunit.client.0.smithi083.stdout:1/443: chown db/d1c/d29/d33/d50/d5d/d6c/f99 4167 1 2024-04-01T06:57:36.805 INFO:tasks.workunit.client.0.smithi083.stdout:0/317: symlink d16/d2e/d3d/d5d/l6a 0 2024-04-01T06:57:36.806 INFO:tasks.workunit.client.0.smithi083.stdout:4/232: dread - d1/d4/d1f/d2a/f2e zero size 2024-04-01T06:57:36.806 INFO:tasks.workunit.client.0.smithi083.stdout:4/233: write d1/d4/db/f18 [807834,118756] 0 2024-04-01T06:57:36.806 INFO:tasks.workunit.client.0.smithi083.stdout:0/318: write f7 [4951840,79120] 0 2024-04-01T06:57:36.806 INFO:tasks.workunit.client.0.smithi083.stdout:0/319: chown f12 5 1 2024-04-01T06:57:36.808 INFO:tasks.workunit.client.0.smithi083.stdout:7/277: dwrite d0/d4/fc [0,4194304] 0 2024-04-01T06:57:36.808 INFO:tasks.workunit.client.0.smithi083.stdout:9/280: rename d6/d32/d26/d2d to d6/d32/d26/d2d/d5e 22 2024-04-01T06:57:36.809 INFO:tasks.workunit.client.0.smithi083.stdout:1/444: mknod db/d1c/d29/d33/d50/d5d/d81/ca3 0 2024-04-01T06:57:36.811 INFO:tasks.workunit.client.0.smithi083.stdout:4/234: truncate d1/d4/d1f/d2a/f36 241509 0 2024-04-01T06:57:36.811 INFO:tasks.workunit.client.0.smithi083.stdout:0/320: mkdir d16/d3a/d6b 0 2024-04-01T06:57:36.812 INFO:tasks.workunit.client.0.smithi083.stdout:9/281: symlink d6/d32/d4d/l5f 0 2024-04-01T06:57:36.812 INFO:tasks.workunit.client.0.smithi083.stdout:4/235: getdents d1/d4/d1f/d2a 0 2024-04-01T06:57:36.812 INFO:tasks.workunit.client.0.smithi083.stdout:4/236: write d1/d4/da/f29 [4770613,16667] 0 2024-04-01T06:57:36.813 INFO:tasks.workunit.client.0.smithi083.stdout:0/321: mkdir d16/d2e/d6c 0 2024-04-01T06:57:36.815 INFO:tasks.workunit.client.0.smithi083.stdout:9/282: mkdir d6/d32/d3c/d5b/d60 0 2024-04-01T06:57:36.815 INFO:tasks.workunit.client.0.smithi083.stdout:7/278: dread d0/d10/f2d [0,4194304] 0 2024-04-01T06:57:36.816 INFO:tasks.workunit.client.0.smithi083.stdout:4/237: mknod d1/d4/db/c44 0 2024-04-01T06:57:36.816 INFO:tasks.workunit.client.0.smithi083.stdout:7/279: write d0/f2b [7325669,3320] 0 2024-04-01T06:57:36.816 INFO:tasks.workunit.client.0.smithi083.stdout:7/280: stat d0 0 2024-04-01T06:57:36.816 INFO:tasks.workunit.client.0.smithi083.stdout:7/281: dread - d0/d4/f58 zero size 2024-04-01T06:57:36.816 INFO:tasks.workunit.client.0.smithi083.stdout:0/322: creat d16/d3a/f6d x:0 0 0 2024-04-01T06:57:36.816 INFO:tasks.workunit.client.0.smithi083.stdout:4/238: dread d1/d4/d1f/d2a/f36 [0,4194304] 0 2024-04-01T06:57:36.817 INFO:tasks.workunit.client.0.smithi083.stdout:9/283: link d6/d32/d26/c28 d6/d32/c61 0 2024-04-01T06:57:36.818 INFO:tasks.workunit.client.0.smithi083.stdout:7/282: unlink d0/d4/d9/d43/f59 0 2024-04-01T06:57:36.819 INFO:tasks.workunit.client.0.smithi083.stdout:7/283: read d0/f37 [2062060,4153] 0 2024-04-01T06:57:36.819 INFO:tasks.workunit.client.0.smithi083.stdout:0/323: mkdir d16/d3a/d4b/d6e 0 2024-04-01T06:57:36.820 INFO:tasks.workunit.client.0.smithi083.stdout:9/284: creat d6/d32/d26/d2d/f62 x:0 0 0 2024-04-01T06:57:36.821 INFO:tasks.workunit.client.0.smithi083.stdout:7/284: unlink d0/le 0 2024-04-01T06:57:36.822 INFO:tasks.workunit.client.0.smithi083.stdout:0/324: rename fe to d16/d2e/d5b/f6f 0 2024-04-01T06:57:36.822 INFO:tasks.workunit.client.0.smithi083.stdout:4/239: dread d1/d4/ff [0,4194304] 0 2024-04-01T06:57:36.822 INFO:tasks.workunit.client.0.smithi083.stdout:4/240: write d1/d4/d33/f43 [93339,90937] 0 2024-04-01T06:57:36.822 INFO:tasks.workunit.client.0.smithi083.stdout:4/241: write d1/f37 [720610,11834] 0 2024-04-01T06:57:36.823 INFO:tasks.workunit.client.0.smithi083.stdout:7/285: symlink d0/d4/d9/d39/l5a 0 2024-04-01T06:57:36.823 INFO:tasks.workunit.client.0.smithi083.stdout:0/325: creat d16/d2e/d6c/f70 x:0 0 0 2024-04-01T06:57:36.823 INFO:tasks.workunit.client.0.smithi083.stdout:0/326: chown d16/d1d 928145 1 2024-04-01T06:57:36.824 INFO:tasks.workunit.client.0.smithi083.stdout:0/327: read f11 [3717046,29656] 0 2024-04-01T06:57:36.825 INFO:tasks.workunit.client.0.smithi083.stdout:4/242: unlink d1/d4/ff 0 2024-04-01T06:57:36.825 INFO:tasks.workunit.client.0.smithi083.stdout:4/243: chown d1/d8/c1d 167755 1 2024-04-01T06:57:36.826 INFO:tasks.workunit.client.0.smithi083.stdout:7/286: creat d0/f5b x:0 0 0 2024-04-01T06:57:36.826 INFO:tasks.workunit.client.0.smithi083.stdout:0/328: mknod d16/d3a/d4b/c71 0 2024-04-01T06:57:36.826 INFO:tasks.workunit.client.0.smithi083.stdout:4/244: symlink d1/d8/l45 0 2024-04-01T06:57:36.828 INFO:tasks.workunit.client.0.smithi083.stdout:7/287: rename d0/d10/d38/c3a to d0/d4/d9/d39/d48/c5c 0 2024-04-01T06:57:36.828 INFO:tasks.workunit.client.0.smithi083.stdout:7/288: truncate d0/d4/d9/f25 1187325 0 2024-04-01T06:57:36.831 INFO:tasks.workunit.client.0.smithi083.stdout:9/285: dread d6/f13 [0,4194304] 0 2024-04-01T06:57:36.831 INFO:tasks.workunit.client.0.smithi083.stdout:9/286: write d6/d32/f1b [109657,68486] 0 2024-04-01T06:57:36.839 INFO:tasks.workunit.client.0.smithi083.stdout:0/329: getdents d16/d2e/d5b 0 2024-04-01T06:57:36.839 INFO:tasks.workunit.client.0.smithi083.stdout:0/330: stat d16/d2e/d5b/f6f 0 2024-04-01T06:57:36.839 INFO:tasks.workunit.client.0.smithi083.stdout:0/331: dread - d16/f62 zero size 2024-04-01T06:57:36.839 INFO:tasks.workunit.client.0.smithi083.stdout:0/332: chown c9 4891643 1 2024-04-01T06:57:36.839 INFO:tasks.workunit.client.0.smithi083.stdout:7/289: dwrite d0/d4/d9/d39/f55 [0,4194304] 0 2024-04-01T06:57:36.839 INFO:tasks.workunit.client.0.smithi083.stdout:7/290: chown d0/d10/l1d 0 1 2024-04-01T06:57:36.841 INFO:tasks.workunit.client.0.smithi083.stdout:0/333: unlink d16/d2e/d3d/d5d/l5f 0 2024-04-01T06:57:36.842 INFO:tasks.workunit.client.0.smithi083.stdout:4/245: dwrite d1/d4/d1f/d2a/f2e [0,4194304] 0 2024-04-01T06:57:36.845 INFO:tasks.workunit.client.0.smithi083.stdout:7/291: mkdir d0/d4b/d5d 0 2024-04-01T06:57:36.845 INFO:tasks.workunit.client.0.smithi083.stdout:7/292: chown d0/d4/d9/d39/l5a 931340 1 2024-04-01T06:57:36.849 INFO:tasks.workunit.client.0.smithi083.stdout:4/246: getdents d1/d8 0 2024-04-01T06:57:36.850 INFO:tasks.workunit.client.0.smithi083.stdout:9/287: dwrite d6/d32/d26/d2d/f54 [0,4194304] 0 2024-04-01T06:57:36.850 INFO:tasks.workunit.client.0.smithi083.stdout:4/247: creat d1/d8/d42/f46 x:0 0 0 2024-04-01T06:57:36.851 INFO:tasks.workunit.client.0.smithi083.stdout:7/293: dread d0/d10/f47 [0,4194304] 0 2024-04-01T06:57:36.852 INFO:tasks.workunit.client.0.smithi083.stdout:7/294: creat d0/d4/d9/f5e x:0 0 0 2024-04-01T06:57:36.854 INFO:tasks.workunit.client.0.smithi083.stdout:7/295: link d0/f4d d0/d4/d9/d43/f5f 0 2024-04-01T06:57:36.854 INFO:tasks.workunit.client.0.smithi083.stdout:7/296: write d0/d10/f2d [4208749,66511] 0 2024-04-01T06:57:36.854 INFO:tasks.workunit.client.0.smithi083.stdout:4/248: truncate d1/f2 6308836 0 2024-04-01T06:57:36.857 INFO:tasks.workunit.client.0.smithi083.stdout:0/334: dwrite d16/d1d/f51 [0,4194304] 0 2024-04-01T06:57:36.857 INFO:tasks.workunit.client.0.smithi083.stdout:0/335: getdents d16/d2e/d5b 0 2024-04-01T06:57:36.858 INFO:tasks.workunit.client.0.smithi083.stdout:9/288: dread d6/d32/d26/d2d/f4a [0,4194304] 0 2024-04-01T06:57:36.861 INFO:tasks.workunit.client.0.smithi083.stdout:9/289: unlink d6/d32/l22 0 2024-04-01T06:57:36.865 INFO:tasks.workunit.client.0.smithi083.stdout:4/249: rename d1/d4/d1f to d1/d47 0 2024-04-01T06:57:36.866 INFO:tasks.workunit.client.0.smithi083.stdout:9/290: creat d6/d32/d3c/d3d/f63 x:0 0 0 2024-04-01T06:57:36.867 INFO:tasks.workunit.client.0.smithi083.stdout:4/250: rmdir d1/d8 39 2024-04-01T06:57:36.868 INFO:tasks.workunit.client.0.smithi083.stdout:9/291: write d6/f53 [224118,91581] 0 2024-04-01T06:57:36.869 INFO:tasks.workunit.client.0.smithi083.stdout:4/251: unlink d1/d4/db/l3c 0 2024-04-01T06:57:36.869 INFO:tasks.workunit.client.0.smithi083.stdout:4/252: readlink d1/d4/da/l32 0 2024-04-01T06:57:36.870 INFO:tasks.workunit.client.0.smithi083.stdout:4/253: write d1/d4/f25 [1087725,65160] 0 2024-04-01T06:57:36.871 INFO:tasks.workunit.client.0.smithi083.stdout:4/254: symlink d1/d8/l48 0 2024-04-01T06:57:36.872 INFO:tasks.workunit.client.0.smithi083.stdout:4/255: write d1/d4/db/f41 [631640,129535] 0 2024-04-01T06:57:36.872 INFO:tasks.workunit.client.0.smithi083.stdout:4/256: fsync d1/d47/d2a/f36 0 2024-04-01T06:57:36.873 INFO:tasks.workunit.client.0.smithi083.stdout:7/297: dwrite d0/f4d [0,4194304] 0 2024-04-01T06:57:36.874 INFO:tasks.workunit.client.0.smithi083.stdout:7/298: write d0/d10/d38/f4f [323803,108268] 0 2024-04-01T06:57:36.874 INFO:tasks.workunit.client.0.smithi083.stdout:4/257: creat d1/d4/d33/f49 x:0 0 0 2024-04-01T06:57:36.874 INFO:tasks.workunit.client.0.smithi083.stdout:7/299: symlink d0/d4/d9/d4e/l60 0 2024-04-01T06:57:36.875 INFO:tasks.workunit.client.0.smithi083.stdout:4/258: symlink d1/d4/d33/l4a 0 2024-04-01T06:57:36.877 INFO:tasks.workunit.client.0.smithi083.stdout:7/300: mknod d0/d4/d9/d4e/c61 0 2024-04-01T06:57:36.880 INFO:tasks.workunit.client.0.smithi083.stdout:4/259: rename d1/d4/da/f28 to d1/d8/d42/f4b 0 2024-04-01T06:57:36.883 INFO:tasks.workunit.client.0.smithi083.stdout:4/260: creat d1/d4/f4c x:0 0 0 2024-04-01T06:57:36.885 INFO:tasks.workunit.client.0.smithi083.stdout:7/301: mkdir d0/d10/d62 0 2024-04-01T06:57:36.885 INFO:tasks.workunit.client.0.smithi083.stdout:7/302: chown d0/d4/d9/f22 41 1 2024-04-01T06:57:36.886 INFO:tasks.workunit.client.0.smithi083.stdout:4/261: rename d1/d4/db/l26 to d1/d4/l4d 0 2024-04-01T06:57:36.887 INFO:tasks.workunit.client.0.smithi083.stdout:7/303: mknod d0/d4/d9/d39/c63 0 2024-04-01T06:57:36.889 INFO:tasks.workunit.client.0.smithi083.stdout:7/304: unlink d0/d4/d9/d39/f55 0 2024-04-01T06:57:36.889 INFO:tasks.workunit.client.0.smithi083.stdout:7/305: fsync d0/d4/fc 0 2024-04-01T06:57:36.892 INFO:tasks.workunit.client.0.smithi083.stdout:7/306: link d0/d10/d34/c46 d0/d4/d9/d39/c64 0 2024-04-01T06:57:36.893 INFO:tasks.workunit.client.0.smithi083.stdout:7/307: creat d0/d4b/d5d/f65 x:0 0 0 2024-04-01T06:57:36.913 INFO:tasks.workunit.client.0.smithi083.stdout:3/431: sync 2024-04-01T06:57:36.913 INFO:tasks.workunit.client.0.smithi083.stdout:3/432: readlink d6/d15/d2d/l3b 0 2024-04-01T06:57:36.914 INFO:tasks.workunit.client.0.smithi083.stdout:3/433: symlink d6/d15/d2d/d2f/d3e/d74/l94 0 2024-04-01T06:57:36.914 INFO:tasks.workunit.client.0.smithi083.stdout:3/434: stat d6/d15/d2d/d2f/d42/d46/f57 0 2024-04-01T06:57:36.915 INFO:tasks.workunit.client.0.smithi083.stdout:3/435: symlink d6/d15/d2d/d2f/d3e/l95 0 2024-04-01T06:57:36.916 INFO:tasks.workunit.client.0.smithi083.stdout:3/436: rename d6/d1e/f20 to d6/d1e/d6f/f96 0 2024-04-01T06:57:36.917 INFO:tasks.workunit.client.0.smithi083.stdout:3/437: mknod d6/d12/c97 0 2024-04-01T06:57:36.918 INFO:tasks.workunit.client.0.smithi083.stdout:3/438: rename d6/d15/d2d/d2f/d3e/l95 to d6/l98 0 2024-04-01T06:57:36.919 INFO:tasks.workunit.client.0.smithi083.stdout:3/439: stat d6/d1e/f23 0 2024-04-01T06:57:36.919 INFO:tasks.workunit.client.0.smithi083.stdout:3/440: symlink d6/d15/d2d/d2f/d53/l99 0 2024-04-01T06:57:36.920 INFO:tasks.workunit.client.0.smithi083.stdout:3/441: write d6/f24 [4028140,103927] 0 2024-04-01T06:57:36.925 INFO:tasks.workunit.client.0.smithi083.stdout:3/442: truncate f2 724925 0 2024-04-01T06:57:36.926 INFO:tasks.workunit.client.0.smithi083.stdout:3/443: truncate d6/d12/f2c 2201043 0 2024-04-01T06:57:36.927 INFO:tasks.workunit.client.0.smithi083.stdout:3/444: rename d6/d15/d2d/d2f/d42/d46/d55/c86 to d6/d15/d2d/d2f/d3e/d74/c9a 0 2024-04-01T06:57:36.928 INFO:tasks.workunit.client.0.smithi083.stdout:3/445: symlink d6/d1e/d4a/l9b 0 2024-04-01T06:57:36.938 INFO:tasks.workunit.client.0.smithi083.stdout:3/446: dwrite d6/d15/f64 [0,4194304] 0 2024-04-01T06:57:36.940 INFO:tasks.workunit.client.0.smithi083.stdout:3/447: unlink d6/d15/d2d/d2f/d42/d46/f57 0 2024-04-01T06:57:36.942 INFO:tasks.workunit.client.0.smithi083.stdout:3/448: link d6/d15/f5f d6/d15/d2d/d2f/d3e/d74/f9c 0 2024-04-01T06:57:36.943 INFO:tasks.workunit.client.0.smithi083.stdout:3/449: truncate d6/d1e/f31 54103 0 2024-04-01T06:57:36.943 INFO:tasks.workunit.client.0.smithi083.stdout:3/450: mknod d6/d15/d2d/d2f/d42/d46/c9d 0 2024-04-01T06:57:36.944 INFO:tasks.workunit.client.0.smithi083.stdout:3/451: write d6/d15/d2d/d2f/d42/f59 [4591973,10105] 0 2024-04-01T06:57:36.946 INFO:tasks.workunit.client.0.smithi083.stdout:3/452: rename d6/d15/f11 to d6/d15/d2d/d2f/f9e 0 2024-04-01T06:57:36.949 INFO:tasks.workunit.client.0.smithi083.stdout:3/453: mkdir d6/d15/d2d/d2f/d42/d9f 0 2024-04-01T06:57:36.949 INFO:tasks.workunit.client.0.smithi083.stdout:3/454: chown d6/d15/d2d 477554 1 2024-04-01T06:57:36.949 INFO:tasks.workunit.client.0.smithi083.stdout:3/455: fdatasync d6/d15/d2d/d2f/d3e/d74/f75 0 2024-04-01T06:57:36.949 INFO:tasks.workunit.client.0.smithi083.stdout:3/456: chown d6/d15/d2d/d2f/d42/d46/f5e 4088087 1 2024-04-01T06:57:37.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:36 smithi145 ceph-mon[47816]: pgmap v55: 97 pgs: 97 active+clean; 593 MiB data, 741 MiB used, 1.0 TiB / 1.0 TiB avail; 34 MiB/s rd, 75 MiB/s wr, 1.56k op/s 2024-04-01T06:57:37.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:36 smithi145 ceph-mon[47816]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-04-01T06:57:37.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:36 smithi083 ceph-mon[43429]: pgmap v55: 97 pgs: 97 active+clean; 593 MiB data, 741 MiB used, 1.0 TiB / 1.0 TiB avail; 34 MiB/s rd, 75 MiB/s wr, 1.56k op/s 2024-04-01T06:57:37.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:36 smithi083 ceph-mon[43429]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-04-01T06:57:37.038 INFO:tasks.workunit.client.0.smithi083.stdout:5/220: sync 2024-04-01T06:57:37.038 INFO:tasks.workunit.client.0.smithi083.stdout:5/221: stat d4/d9/d16/d1f/d2f/f46 0 2024-04-01T06:57:37.038 INFO:tasks.workunit.client.0.smithi083.stdout:5/222: write d4/d23/f29 [2384199,75165] 0 2024-04-01T06:57:37.038 INFO:tasks.workunit.client.0.smithi083.stdout:5/223: read d4/d2b/f24 [840922,16311] 0 2024-04-01T06:57:37.040 INFO:tasks.workunit.client.0.smithi083.stdout:5/224: unlink d4/d9/f3a 0 2024-04-01T06:57:37.042 INFO:tasks.workunit.client.0.smithi083.stdout:5/225: dread d4/fa [4194304,4194304] 0 2024-04-01T06:57:37.043 INFO:tasks.workunit.client.0.smithi083.stdout:5/226: rename d4/d23/f30 to d4/d9/d16/d1f/f48 0 2024-04-01T06:57:37.057 INFO:tasks.workunit.client.0.smithi083.stdout:5/227: dwrite d4/d9/d16/d1f/f48 [0,4194304] 0 2024-04-01T06:57:37.058 INFO:tasks.workunit.client.0.smithi083.stdout:5/228: write d4/d2b/f39 [1314765,56135] 0 2024-04-01T06:57:37.058 INFO:tasks.workunit.client.0.smithi083.stdout:5/229: chown d4/d9/d16/d19 737358 1 2024-04-01T06:57:37.058 INFO:tasks.workunit.client.0.smithi083.stdout:5/230: mkdir d4/d23/d49 0 2024-04-01T06:57:37.060 INFO:tasks.workunit.client.0.smithi083.stdout:5/231: rename d4/d9/d16/d1f/d2f/f47 to d4/f4a 0 2024-04-01T06:57:37.068 INFO:tasks.workunit.client.0.smithi083.stdout:2/375: sync 2024-04-01T06:57:37.069 INFO:tasks.workunit.client.0.smithi083.stdout:8/373: sync 2024-04-01T06:57:37.069 INFO:tasks.workunit.client.0.smithi083.stdout:3/457: sync 2024-04-01T06:57:37.069 INFO:tasks.workunit.client.0.smithi083.stdout:1/445: sync 2024-04-01T06:57:37.069 INFO:tasks.workunit.client.0.smithi083.stdout:4/262: sync 2024-04-01T06:57:37.069 INFO:tasks.workunit.client.0.smithi083.stdout:0/336: sync 2024-04-01T06:57:37.069 INFO:tasks.workunit.client.0.smithi083.stdout:9/292: sync 2024-04-01T06:57:37.069 INFO:tasks.workunit.client.0.smithi083.stdout:4/263: truncate d1/d47/d2a/f2e 5240826 0 2024-04-01T06:57:37.069 INFO:tasks.workunit.client.0.smithi083.stdout:6/288: sync 2024-04-01T06:57:37.069 INFO:tasks.workunit.client.0.smithi083.stdout:7/308: sync 2024-04-01T06:57:37.071 INFO:tasks.workunit.client.0.smithi083.stdout:1/446: read db/f11 [1949421,44027] 0 2024-04-01T06:57:37.071 INFO:tasks.workunit.client.0.smithi083.stdout:3/458: write d6/d15/d2d/d2f/d42/f81 [2520066,94779] 0 2024-04-01T06:57:37.071 INFO:tasks.workunit.client.0.smithi083.stdout:3/459: write d6/d1e/f2b [1151138,110759] 0 2024-04-01T06:57:37.071 INFO:tasks.workunit.client.0.smithi083.stdout:3/460: chown d6/d12/c97 16907 1 2024-04-01T06:57:37.071 INFO:tasks.workunit.client.0.smithi083.stdout:2/376: link d3/d26/d59/d70/d53/d68/f5c d3/d26/d59/d2b/f82 0 2024-04-01T06:57:37.071 INFO:tasks.workunit.client.0.smithi083.stdout:2/377: getdents d3/d4d/d5d 0 2024-04-01T06:57:37.071 INFO:tasks.workunit.client.0.smithi083.stdout:8/374: truncate f7 3209629 0 2024-04-01T06:57:37.072 INFO:tasks.workunit.client.0.smithi083.stdout:8/375: write d15/d18/f37 [823286,107495] 0 2024-04-01T06:57:37.072 INFO:tasks.workunit.client.0.smithi083.stdout:8/376: chown d15/d1b/d39/c76 353 1 2024-04-01T06:57:37.072 INFO:tasks.workunit.client.0.smithi083.stdout:0/337: mknod d16/d2e/d3d/c72 0 2024-04-01T06:57:37.073 INFO:tasks.workunit.client.0.smithi083.stdout:1/447: creat db/d1c/d29/d33/d50/d4d/fa4 x:0 0 0 2024-04-01T06:57:37.074 INFO:tasks.workunit.client.0.smithi083.stdout:5/232: dwrite d4/fb [4194304,4194304] 0 2024-04-01T06:57:37.074 INFO:tasks.workunit.client.0.smithi083.stdout:3/461: mknod d6/d1e/ca0 0 2024-04-01T06:57:37.081 INFO:tasks.workunit.client.0.smithi083.stdout:7/309: rename d0/d10/f47 to d0/f66 0 2024-04-01T06:57:37.081 INFO:tasks.workunit.client.0.smithi083.stdout:7/310: chown d0/l40 2766 1 2024-04-01T06:57:37.081 INFO:tasks.workunit.client.0.smithi083.stdout:8/377: write d15/d18/d19/f23 [1529190,60073] 0 2024-04-01T06:57:37.081 INFO:tasks.workunit.client.0.smithi083.stdout:8/378: chown d15/d21/f50 18 1 2024-04-01T06:57:37.081 INFO:tasks.workunit.client.0.smithi083.stdout:8/379: write d15/d18/f37 [1249503,92524] 0 2024-04-01T06:57:37.081 INFO:tasks.workunit.client.0.smithi083.stdout:1/448: fsync db/d1c/d29/f3e 0 2024-04-01T06:57:37.081 INFO:tasks.workunit.client.0.smithi083.stdout:3/462: getdents d6/d1e/d4a 0 2024-04-01T06:57:37.083 INFO:tasks.workunit.client.0.smithi083.stdout:2/378: mknod d3/c83 0 2024-04-01T06:57:37.084 INFO:tasks.workunit.client.0.smithi083.stdout:7/311: getdents d0/d10/d38 0 2024-04-01T06:57:37.085 INFO:tasks.workunit.client.0.smithi083.stdout:9/293: dwrite d6/d32/d4d/f5c [0,4194304] 0 2024-04-01T06:57:37.085 INFO:tasks.workunit.client.0.smithi083.stdout:9/294: readlink d6/l11 0 2024-04-01T06:57:37.085 INFO:tasks.workunit.client.0.smithi083.stdout:9/295: dread - d6/d32/f4f zero size 2024-04-01T06:57:37.086 INFO:tasks.workunit.client.0.smithi083.stdout:4/264: dwrite d1/d4/d33/f43 [0,4194304] 0 2024-04-01T06:57:37.086 INFO:tasks.workunit.client.0.smithi083.stdout:4/265: chown d1/d47/d2a/f31 611375389 1 2024-04-01T06:57:37.086 INFO:tasks.workunit.client.0.smithi083.stdout:4/266: chown d1/f23 0 1 2024-04-01T06:57:37.086 INFO:tasks.workunit.client.0.smithi083.stdout:4/267: chown d1/d4/d33/l4a 299682 1 2024-04-01T06:57:37.088 INFO:tasks.workunit.client.0.smithi083.stdout:8/380: mknod d15/d18/d1e/c8d 0 2024-04-01T06:57:37.089 INFO:tasks.workunit.client.0.smithi083.stdout:4/268: dread d1/f37 [0,4194304] 0 2024-04-01T06:57:37.089 INFO:tasks.workunit.client.0.smithi083.stdout:4/269: chown d1/d4/db/f41 6 1 2024-04-01T06:57:37.091 INFO:tasks.workunit.client.0.smithi083.stdout:6/289: dwrite d9/dc/fe [0,4194304] 0 2024-04-01T06:57:37.091 INFO:tasks.workunit.client.0.smithi083.stdout:1/449: mknod db/d1c/ca5 0 2024-04-01T06:57:37.092 INFO:tasks.workunit.client.0.smithi083.stdout:3/463: creat d6/d15/d2d/d2f/d42/d5c/fa1 x:0 0 0 2024-04-01T06:57:37.094 INFO:tasks.workunit.client.0.smithi083.stdout:5/233: dread d4/f1c [0,4194304] 0 2024-04-01T06:57:37.097 INFO:tasks.workunit.client.0.smithi083.stdout:2/379: rmdir d3/d4d 39 2024-04-01T06:57:37.097 INFO:tasks.workunit.client.0.smithi083.stdout:4/270: dread d1/d47/f27 [0,4194304] 0 2024-04-01T06:57:37.099 INFO:tasks.workunit.client.0.smithi083.stdout:0/338: dwrite f11 [4194304,4194304] 0 2024-04-01T06:57:37.099 INFO:tasks.workunit.client.0.smithi083.stdout:8/381: creat d15/d1b/d39/d48/d5e/d70/f8e x:0 0 0 2024-04-01T06:57:37.099 INFO:tasks.workunit.client.0.smithi083.stdout:8/382: fdatasync d15/d18/d19/d24/f89 0 2024-04-01T06:57:37.100 INFO:tasks.workunit.client.0.smithi083.stdout:8/383: readlink d15/d1b/d39/d48/l5a 0 2024-04-01T06:57:37.100 INFO:tasks.workunit.client.0.smithi083.stdout:2/380: write d3/d26/f4c [2601385,84211] 0 2024-04-01T06:57:37.100 INFO:tasks.workunit.client.0.smithi083.stdout:2/381: write d3/d26/d59/d2b/f77 [147066,69268] 0 2024-04-01T06:57:37.100 INFO:tasks.workunit.client.0.smithi083.stdout:5/234: dread d4/d9/d16/d1f/d2f/f46 [0,4194304] 0 2024-04-01T06:57:37.101 INFO:tasks.workunit.client.0.smithi083.stdout:6/290: creat d9/d57/f5e x:0 0 0 2024-04-01T06:57:37.102 INFO:tasks.workunit.client.0.smithi083.stdout:6/291: write d9/dc/f25 [4110347,1161] 0 2024-04-01T06:57:37.102 INFO:tasks.workunit.client.0.smithi083.stdout:6/292: read - d9/dc/d1b/f3d zero size 2024-04-01T06:57:37.102 INFO:tasks.workunit.client.0.smithi083.stdout:1/450: creat db/d1c/d2e/d30/fa6 x:0 0 0 2024-04-01T06:57:37.105 INFO:tasks.workunit.client.0.smithi083.stdout:3/464: creat d6/d15/d2d/d2f/d42/d46/d55/d67/fa2 x:0 0 0 2024-04-01T06:57:37.105 INFO:tasks.workunit.client.0.smithi083.stdout:3/465: truncate d6/d1e/f23 331026 0 2024-04-01T06:57:37.105 INFO:tasks.workunit.client.0.smithi083.stdout:4/271: symlink d1/d47/l4e 0 2024-04-01T06:57:37.105 INFO:tasks.workunit.client.0.smithi083.stdout:4/272: fsync d1/d8/d42/f4b 0 2024-04-01T06:57:37.108 INFO:tasks.workunit.client.0.smithi083.stdout:0/339: symlink d16/d2e/d3d/l73 0 2024-04-01T06:57:37.108 INFO:tasks.workunit.client.0.smithi083.stdout:8/384: symlink d15/d18/d19/d24/d38/d62/l8f 0 2024-04-01T06:57:37.109 INFO:tasks.workunit.client.0.smithi083.stdout:2/382: dread d3/d26/d59/d70/d53/d68/f5c [0,4194304] 0 2024-04-01T06:57:37.109 INFO:tasks.workunit.client.0.smithi083.stdout:6/293: mkdir d9/d57/d5f 0 2024-04-01T06:57:37.109 INFO:tasks.workunit.client.0.smithi083.stdout:6/294: write d9/dc/d1b/d39/d47/f49 [835994,47290] 0 2024-04-01T06:57:37.109 INFO:tasks.workunit.client.0.smithi083.stdout:6/295: fdatasync d9/dc/d29/f5d 0 2024-04-01T06:57:37.110 INFO:tasks.workunit.client.0.smithi083.stdout:1/451: truncate f1 2205083 0 2024-04-01T06:57:37.110 INFO:tasks.workunit.client.0.smithi083.stdout:1/452: truncate db/d1c/d29/d33/d50/d5d/d81/f92 657409 0 2024-04-01T06:57:37.111 INFO:tasks.workunit.client.0.smithi083.stdout:4/273: creat d1/d4/f4f x:0 0 0 2024-04-01T06:57:37.111 INFO:tasks.workunit.client.0.smithi083.stdout:5/235: dread d4/d9/d16/d1f/f22 [0,4194304] 0 2024-04-01T06:57:37.113 INFO:tasks.workunit.client.0.smithi083.stdout:7/312: dwrite d0/d10/d34/f57 [0,4194304] 0 2024-04-01T06:57:37.114 INFO:tasks.workunit.client.0.smithi083.stdout:7/313: write d0/d4b/f54 [1665989,99829] 0 2024-04-01T06:57:37.114 INFO:tasks.workunit.client.0.smithi083.stdout:3/466: dread d6/d15/d2d/d2f/d42/d46/f58 [0,4194304] 0 2024-04-01T06:57:37.114 INFO:tasks.workunit.client.0.smithi083.stdout:6/296: creat d9/dc/d1b/d39/f60 x:0 0 0 2024-04-01T06:57:37.114 INFO:tasks.workunit.client.0.smithi083.stdout:3/467: chown d6/l26 7 1 2024-04-01T06:57:37.115 INFO:tasks.workunit.client.0.smithi083.stdout:5/236: creat d4/d9/d16/d19/f4b x:0 0 0 2024-04-01T06:57:37.115 INFO:tasks.workunit.client.0.smithi083.stdout:3/468: write d6/d15/f8e [331579,58272] 0 2024-04-01T06:57:37.115 INFO:tasks.workunit.client.0.smithi083.stdout:0/340: dread f10 [0,4194304] 0 2024-04-01T06:57:37.115 INFO:tasks.workunit.client.0.smithi083.stdout:0/341: fsync d16/d3a/f3c 0 2024-04-01T06:57:37.115 INFO:tasks.workunit.client.0.smithi083.stdout:9/296: dwrite d6/d32/f4f [0,4194304] 0 2024-04-01T06:57:37.115 INFO:tasks.workunit.client.0.smithi083.stdout:4/274: creat d1/d4/d33/f50 x:0 0 0 2024-04-01T06:57:37.118 INFO:tasks.workunit.client.0.smithi083.stdout:6/297: rmdir d9/dc/d29/d5b 0 2024-04-01T06:57:37.118 INFO:tasks.workunit.client.0.smithi083.stdout:6/298: dread - d9/d57/f5e zero size 2024-04-01T06:57:37.120 INFO:tasks.workunit.client.0.smithi083.stdout:5/237: unlink d4/f1c 0 2024-04-01T06:57:37.123 INFO:tasks.workunit.client.0.smithi083.stdout:3/469: creat d6/d15/d2d/d2f/fa3 x:0 0 0 2024-04-01T06:57:37.123 INFO:tasks.workunit.client.0.smithi083.stdout:3/470: write d6/d12/f8a [971455,62442] 0 2024-04-01T06:57:37.123 INFO:tasks.workunit.client.0.smithi083.stdout:1/453: fsync db/f11 0 2024-04-01T06:57:37.129 INFO:tasks.workunit.client.0.smithi083.stdout:0/342: getdents d16/d3a 0 2024-04-01T06:57:37.132 INFO:tasks.workunit.client.0.smithi083.stdout:9/297: rmdir d6/d32/d3c/d5b/d60 0 2024-04-01T06:57:37.133 INFO:tasks.workunit.client.0.smithi083.stdout:6/299: dread f8 [0,4194304] 0 2024-04-01T06:57:37.133 INFO:tasks.workunit.client.0.smithi083.stdout:8/385: dwrite d15/d1b/d39/d80/f87 [0,4194304] 0 2024-04-01T06:57:37.134 INFO:tasks.workunit.client.0.smithi083.stdout:5/238: dread d4/d9/f3b [0,4194304] 0 2024-04-01T06:57:37.134 INFO:tasks.workunit.client.0.smithi083.stdout:4/275: creat d1/d8/d42/f51 x:0 0 0 2024-04-01T06:57:37.136 INFO:tasks.workunit.client.0.smithi083.stdout:3/471: creat d6/d15/d2d/d2f/d3e/fa4 x:0 0 0 2024-04-01T06:57:37.137 INFO:tasks.workunit.client.0.smithi083.stdout:2/383: dwrite d3/d26/d59/f30 [0,4194304] 0 2024-04-01T06:57:37.137 INFO:tasks.workunit.client.0.smithi083.stdout:2/384: fdatasync d3/d26/f3a 0 2024-04-01T06:57:37.139 INFO:tasks.workunit.client.0.smithi083.stdout:9/298: dread d6/f13 [0,4194304] 0 2024-04-01T06:57:37.139 INFO:tasks.workunit.client.0.smithi083.stdout:9/299: chown d6/d32/d26/d2d/d34/f40 854 1 2024-04-01T06:57:37.139 INFO:tasks.workunit.client.0.smithi083.stdout:9/300: dread - d6/d32/d3c/d3d/f63 zero size 2024-04-01T06:57:37.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:36 smithi153 ceph-mon[48187]: pgmap v55: 97 pgs: 97 active+clean; 593 MiB data, 741 MiB used, 1.0 TiB / 1.0 TiB avail; 34 MiB/s rd, 75 MiB/s wr, 1.56k op/s 2024-04-01T06:57:37.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:36 smithi153 ceph-mon[48187]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-04-01T06:57:37.141 INFO:tasks.workunit.client.0.smithi083.stdout:9/301: write d6/d32/d4d/f5c [1146194,9492] 0 2024-04-01T06:57:37.142 INFO:tasks.workunit.client.0.smithi083.stdout:8/386: dread d15/d1b/d39/d48/d5e/f73 [4194304,4194304] 0 2024-04-01T06:57:37.142 INFO:tasks.workunit.client.0.smithi083.stdout:0/343: rename d16/d3a/d6b to d16/d2e/d5b/d74 0 2024-04-01T06:57:37.142 INFO:tasks.workunit.client.0.smithi083.stdout:0/344: stat d16/d3a 0 2024-04-01T06:57:37.144 INFO:tasks.workunit.client.0.smithi083.stdout:7/314: dwrite d0/d4/f58 [0,4194304] 0 2024-04-01T06:57:37.144 INFO:tasks.workunit.client.0.smithi083.stdout:7/315: fsync d0/d10/f42 0 2024-04-01T06:57:37.144 INFO:tasks.workunit.client.0.smithi083.stdout:7/316: write d0/d4b/d5d/f65 [282945,111473] 0 2024-04-01T06:57:37.146 INFO:tasks.workunit.client.0.smithi083.stdout:6/300: truncate d9/dc/f14 636927 0 2024-04-01T06:57:37.151 INFO:tasks.workunit.client.0.smithi083.stdout:2/385: dwrite d3/fc [4194304,4194304] 0 2024-04-01T06:57:37.152 INFO:tasks.workunit.client.0.smithi083.stdout:2/386: write d3/d26/d59/d27/f7e [4546769,129667] 0 2024-04-01T06:57:37.153 INFO:tasks.workunit.client.0.smithi083.stdout:5/239: creat d4/d9/d16/f4c x:0 0 0 2024-04-01T06:57:37.155 INFO:tasks.workunit.client.0.smithi083.stdout:4/276: creat d1/d47/d2a/f52 x:0 0 0 2024-04-01T06:57:37.155 INFO:tasks.workunit.client.0.smithi083.stdout:4/277: readlink d1/d8/l45 0 2024-04-01T06:57:37.155 INFO:tasks.workunit.client.0.smithi083.stdout:4/278: read - d1/d4/f4f zero size 2024-04-01T06:57:37.155 INFO:tasks.workunit.client.0.smithi083.stdout:3/472: truncate d6/d15/d2d/d2f/d42/f59 6964624 0 2024-04-01T06:57:37.158 INFO:tasks.workunit.client.0.smithi083.stdout:7/317: dwrite d0/f37 [0,4194304] 0 2024-04-01T06:57:37.159 INFO:tasks.workunit.client.0.smithi083.stdout:7/318: readlink d0/d4/l2e 0 2024-04-01T06:57:37.159 INFO:tasks.workunit.client.0.smithi083.stdout:9/302: rename d6/d32/d26/d2d/d34/l38 to d6/d32/d26/l64 0 2024-04-01T06:57:37.159 INFO:tasks.workunit.client.0.smithi083.stdout:9/303: truncate d6/d32/d4d/f52 1015878 0 2024-04-01T06:57:37.159 INFO:tasks.workunit.client.0.smithi083.stdout:8/387: rmdir d15/d18/d19/d24/d44/d75 39 2024-04-01T06:57:37.160 INFO:tasks.workunit.client.0.smithi083.stdout:9/304: write d6/d32/f4f [327603,41521] 0 2024-04-01T06:57:37.161 INFO:tasks.workunit.client.0.smithi083.stdout:0/345: getdents d16/d2e/d3d 0 2024-04-01T06:57:37.166 INFO:tasks.workunit.client.0.smithi083.stdout:2/387: creat d3/d20/f84 x:0 0 0 2024-04-01T06:57:37.166 INFO:tasks.workunit.client.0.smithi083.stdout:5/240: mknod d4/d9/c4d 0 2024-04-01T06:57:37.167 INFO:tasks.workunit.client.0.smithi083.stdout:0/346: dread d16/d1d/f25 [0,4194304] 0 2024-04-01T06:57:37.169 INFO:tasks.workunit.client.0.smithi083.stdout:4/279: dwrite d1/d4/db/f41 [0,4194304] 0 2024-04-01T06:57:37.169 INFO:tasks.workunit.client.0.smithi083.stdout:7/319: mkdir d0/d4/d9/d39/d67 0 2024-04-01T06:57:37.171 INFO:tasks.workunit.client.0.smithi083.stdout:8/388: creat d15/d1b/d39/d48/d5e/d6b/d6f/f90 x:0 0 0 2024-04-01T06:57:37.171 INFO:tasks.workunit.client.0.smithi083.stdout:8/389: chown d15/d18/d19/d24/f7e 1475 1 2024-04-01T06:57:37.173 INFO:tasks.workunit.client.0.smithi083.stdout:9/305: rename d6/d32/d26/d2d/f4a to d6/d32/d3c/d5b/f65 0 2024-04-01T06:57:37.175 INFO:tasks.workunit.client.0.smithi083.stdout:6/301: truncate d9/dc/fe 7619953 0 2024-04-01T06:57:37.175 INFO:tasks.workunit.client.0.smithi083.stdout:6/302: fdatasync d9/dc/d1b/d39/d47/f49 0 2024-04-01T06:57:37.176 INFO:tasks.workunit.client.0.smithi083.stdout:0/347: mknod d16/d3a/d63/c75 0 2024-04-01T06:57:37.176 INFO:tasks.workunit.client.0.smithi083.stdout:0/348: chown d16/d3a/d4b/l58 167899 1 2024-04-01T06:57:37.179 INFO:tasks.workunit.client.0.smithi083.stdout:3/473: unlink d6/d15/d2d/d2f/d42/f59 0 2024-04-01T06:57:37.181 INFO:tasks.workunit.client.0.smithi083.stdout:9/306: write d6/d32/d26/d2d/f30 [166425,14633] 0 2024-04-01T06:57:37.181 INFO:tasks.workunit.client.0.smithi083.stdout:9/307: chown d6/d32/d26/d2d/d34/l44 0 1 2024-04-01T06:57:37.182 INFO:tasks.workunit.client.0.smithi083.stdout:2/388: symlink d3/l85 0 2024-04-01T06:57:37.183 INFO:tasks.workunit.client.0.smithi083.stdout:2/389: readlink d3/l38 0 2024-04-01T06:57:37.184 INFO:tasks.workunit.client.0.smithi083.stdout:0/349: unlink d16/d1d/c1e 0 2024-04-01T06:57:37.191 INFO:tasks.workunit.client.0.smithi083.stdout:9/308: unlink d6/d32/d3c/d4c/f5a 0 2024-04-01T06:57:37.191 INFO:tasks.workunit.client.0.smithi083.stdout:2/390: unlink d3/d20/f3f 0 2024-04-01T06:57:37.192 INFO:tasks.workunit.client.0.smithi083.stdout:2/391: truncate f2 242730 0 2024-04-01T06:57:37.198 INFO:tasks.workunit.client.0.smithi083.stdout:3/474: write d6/fb [2895935,60690] 0 2024-04-01T06:57:37.199 INFO:tasks.workunit.client.0.smithi083.stdout:4/280: dwrite d1/d4/db/f20 [0,4194304] 0 2024-04-01T06:57:37.204 INFO:tasks.workunit.client.0.smithi083.stdout:8/390: dwrite f9 [4194304,4194304] 0 2024-04-01T06:57:37.206 INFO:tasks.workunit.client.0.smithi083.stdout:0/350: dwrite d16/d1d/f2b [0,4194304] 0 2024-04-01T06:57:37.206 INFO:tasks.workunit.client.0.smithi083.stdout:0/351: chown d16/d1d/f37 1 1 2024-04-01T06:57:37.206 INFO:tasks.workunit.client.0.smithi083.stdout:0/352: stat d16/d1d/f46 0 2024-04-01T06:57:37.209 INFO:tasks.workunit.client.0.smithi083.stdout:5/241: dread d4/f1b [0,4194304] 0 2024-04-01T06:57:37.209 INFO:tasks.workunit.client.0.smithi083.stdout:2/392: read d3/d26/d59/d70/f64 [310278,125961] 0 2024-04-01T06:57:37.210 INFO:tasks.workunit.client.0.smithi083.stdout:3/475: dwrite d6/d15/f19 [4194304,4194304] 0 2024-04-01T06:57:37.210 INFO:tasks.workunit.client.0.smithi083.stdout:3/476: chown d6/d15/d2d/d2f/d42/d46/l92 136312285 1 2024-04-01T06:57:37.210 INFO:tasks.workunit.client.0.smithi083.stdout:3/477: chown d6/d12/l16 1538 1 2024-04-01T06:57:37.211 INFO:tasks.workunit.client.0.smithi083.stdout:7/320: dwrite d0/f3 [4194304,4194304] 0 2024-04-01T06:57:37.212 INFO:tasks.workunit.client.0.smithi083.stdout:5/242: dread d4/d9/f12 [0,4194304] 0 2024-04-01T06:57:37.213 INFO:tasks.workunit.client.0.smithi083.stdout:0/353: mknod d16/d2e/d3d/c76 0 2024-04-01T06:57:37.213 INFO:tasks.workunit.client.0.smithi083.stdout:8/391: write d15/d18/d19/d1d/f2d [5714957,73942] 0 2024-04-01T06:57:37.215 INFO:tasks.workunit.client.0.smithi083.stdout:2/393: getdents d3 0 2024-04-01T06:57:37.215 INFO:tasks.workunit.client.0.smithi083.stdout:2/394: dread - d3/f72 zero size 2024-04-01T06:57:37.216 INFO:tasks.workunit.client.0.smithi083.stdout:9/309: dwrite d6/d32/d4d/f52 [0,4194304] 0 2024-04-01T06:57:37.216 INFO:tasks.workunit.client.0.smithi083.stdout:3/478: mknod d6/d15/d2d/d2f/d42/d46/d55/ca5 0 2024-04-01T06:57:37.219 INFO:tasks.workunit.client.0.smithi083.stdout:7/321: creat d0/d10/d38/f68 x:0 0 0 2024-04-01T06:57:37.219 INFO:tasks.workunit.client.0.smithi083.stdout:6/303: dwrite d9/f1a [0,4194304] 0 2024-04-01T06:57:37.220 INFO:tasks.workunit.client.0.smithi083.stdout:5/243: mkdir d4/d23/d4e 0 2024-04-01T06:57:37.221 INFO:tasks.workunit.client.0.smithi083.stdout:0/354: stat d16/d1d/l35 0 2024-04-01T06:57:37.221 INFO:tasks.workunit.client.0.smithi083.stdout:0/355: dread - d16/f62 zero size 2024-04-01T06:57:37.221 INFO:tasks.workunit.client.0.smithi083.stdout:0/356: fsync d16/d2e/d3d/d5d/f67 0 2024-04-01T06:57:37.221 INFO:tasks.workunit.client.0.smithi083.stdout:0/357: chown d16/d3a/f6d 132312 1 2024-04-01T06:57:37.221 INFO:tasks.workunit.client.0.smithi083.stdout:0/358: dread - d16/d2e/d3d/f59 zero size 2024-04-01T06:57:37.224 INFO:tasks.workunit.client.0.smithi083.stdout:2/395: creat d3/d4d/f86 x:0 0 0 2024-04-01T06:57:37.224 INFO:tasks.workunit.client.0.smithi083.stdout:8/392: mknod d15/d82/c91 0 2024-04-01T06:57:37.226 INFO:tasks.workunit.client.0.smithi083.stdout:9/310: creat d6/d32/d3c/f66 x:0 0 0 2024-04-01T06:57:37.226 INFO:tasks.workunit.client.0.smithi083.stdout:9/311: dread - d6/d32/d26/d2d/f62 zero size 2024-04-01T06:57:37.226 INFO:tasks.workunit.client.0.smithi083.stdout:9/312: fsync d6/d32/f1a 0 2024-04-01T06:57:37.226 INFO:tasks.workunit.client.0.smithi083.stdout:2/396: dread f2 [0,4194304] 0 2024-04-01T06:57:37.226 INFO:tasks.workunit.client.0.smithi083.stdout:2/397: stat d3/ca 0 2024-04-01T06:57:37.227 INFO:tasks.workunit.client.0.smithi083.stdout:4/281: dwrite d1/d47/f27 [0,4194304] 0 2024-04-01T06:57:37.227 INFO:tasks.workunit.client.0.smithi083.stdout:9/313: dread d6/d32/d26/d2d/d34/f3b [0,4194304] 0 2024-04-01T06:57:37.229 INFO:tasks.workunit.client.0.smithi083.stdout:6/304: getdents d9/dc/d1b/d39/d47 0 2024-04-01T06:57:37.229 INFO:tasks.workunit.client.0.smithi083.stdout:6/305: stat d9/dc/f25 0 2024-04-01T06:57:37.229 INFO:tasks.workunit.client.0.smithi083.stdout:6/306: chown d9/dc/f14 1225 1 2024-04-01T06:57:37.229 INFO:tasks.workunit.client.0.smithi083.stdout:6/307: write d9/dc/d1b/d39/d47/f49 [867053,10592] 0 2024-04-01T06:57:37.231 INFO:tasks.workunit.client.0.smithi083.stdout:5/244: mkdir d4/d9/d4f 0 2024-04-01T06:57:37.232 INFO:tasks.workunit.client.0.smithi083.stdout:7/322: dwrite d0/d4/d9/f3e [0,4194304] 0 2024-04-01T06:57:37.235 INFO:tasks.workunit.client.0.smithi083.stdout:0/359: truncate d16/f29 1125156 0 2024-04-01T06:57:37.235 INFO:tasks.workunit.client.0.smithi083.stdout:8/393: rmdir d15/d82 39 2024-04-01T06:57:37.235 INFO:tasks.workunit.client.0.smithi083.stdout:8/394: chown d15/f5c 11 1 2024-04-01T06:57:37.235 INFO:tasks.workunit.client.0.smithi083.stdout:5/245: dread d4/d2b/f31 [0,4194304] 0 2024-04-01T06:57:37.235 INFO:tasks.workunit.client.0.smithi083.stdout:3/479: dwrite d6/fb [0,4194304] 0 2024-04-01T06:57:37.239 INFO:tasks.workunit.client.0.smithi083.stdout:2/398: dread d3/fc [0,4194304] 0 2024-04-01T06:57:37.241 INFO:tasks.workunit.client.0.smithi083.stdout:0/360: dread d16/d1d/f51 [0,4194304] 0 2024-04-01T06:57:37.241 INFO:tasks.workunit.client.0.smithi083.stdout:0/361: dread - d16/d3a/d4b/f5c zero size 2024-04-01T06:57:37.241 INFO:tasks.workunit.client.0.smithi083.stdout:0/362: write d16/f34 [1604337,40050] 0 2024-04-01T06:57:37.244 INFO:tasks.workunit.client.0.smithi083.stdout:4/282: creat d1/d4/da/f53 x:0 0 0 2024-04-01T06:57:37.245 INFO:tasks.workunit.client.0.smithi083.stdout:6/308: creat d9/dc/d1b/d39/d47/f61 x:0 0 0 2024-04-01T06:57:37.245 INFO:tasks.workunit.client.0.smithi083.stdout:6/309: chown d9/dc/d1b/f3d 85 1 2024-04-01T06:57:37.245 INFO:tasks.workunit.client.0.smithi083.stdout:9/314: dwrite d6/d32/d3c/f66 [0,4194304] 0 2024-04-01T06:57:37.246 INFO:tasks.workunit.client.0.smithi083.stdout:7/323: getdents d0/d10/d34 0 2024-04-01T06:57:37.247 INFO:tasks.workunit.client.0.smithi083.stdout:8/395: symlink d15/d18/d1e/l92 0 2024-04-01T06:57:37.249 INFO:tasks.workunit.client.0.smithi083.stdout:3/480: rename d6/d15/d2d/d2f/d42/d46/f7e to d6/d15/d2d/d2f/d53/fa6 0 2024-04-01T06:57:37.252 INFO:tasks.workunit.client.0.smithi083.stdout:5/246: symlink d4/d23/d4e/l50 0 2024-04-01T06:57:37.252 INFO:tasks.workunit.client.0.smithi083.stdout:9/315: dread d6/f14 [0,4194304] 0 2024-04-01T06:57:37.252 INFO:tasks.workunit.client.0.smithi083.stdout:0/363: link d16/d1d/f23 d16/d3a/f77 0 2024-04-01T06:57:37.252 INFO:tasks.workunit.client.0.smithi083.stdout:4/283: creat d1/d4/db/f54 x:0 0 0 2024-04-01T06:57:37.253 INFO:tasks.workunit.client.0.smithi083.stdout:4/284: fsync d1/d8/f14 0 2024-04-01T06:57:37.254 INFO:tasks.workunit.client.0.smithi083.stdout:6/310: unlink d9/dc/d1b/f28 0 2024-04-01T06:57:37.256 INFO:tasks.workunit.client.0.smithi083.stdout:4/285: dread d1/d4/db/f11 [0,4194304] 0 2024-04-01T06:57:37.256 INFO:tasks.workunit.client.0.smithi083.stdout:4/286: dread - d1/d4/db/f3e zero size 2024-04-01T06:57:37.256 INFO:tasks.workunit.client.0.smithi083.stdout:1/454: sync 2024-04-01T06:57:37.256 INFO:tasks.workunit.client.0.smithi083.stdout:1/455: dread - db/d1c/d2e/f6e zero size 2024-04-01T06:57:37.256 INFO:tasks.workunit.client.0.smithi083.stdout:8/396: mknod d15/d18/d19/d1d/c93 0 2024-04-01T06:57:37.256 INFO:tasks.workunit.client.0.smithi083.stdout:8/397: readlink d15/d18/d19/d24/d38/d62/l7f 0 2024-04-01T06:57:37.258 INFO:tasks.workunit.client.0.smithi083.stdout:2/399: rename d3/d20/d42/f75 to d3/d26/d59/d70/d53/d5e/f87 0 2024-04-01T06:57:37.258 INFO:tasks.workunit.client.0.smithi083.stdout:2/400: write d3/f7f [307934,23648] 0 2024-04-01T06:57:37.258 INFO:tasks.workunit.client.0.smithi083.stdout:2/401: write d3/f16 [4439071,75723] 0 2024-04-01T06:57:37.258 INFO:tasks.workunit.client.0.smithi083.stdout:9/316: write d6/d32/d4d/f52 [2598681,96374] 0 2024-04-01T06:57:37.258 INFO:tasks.workunit.client.0.smithi083.stdout:0/364: dread d16/d2e/d3d/f4d [0,4194304] 0 2024-04-01T06:57:37.258 INFO:tasks.workunit.client.0.smithi083.stdout:3/481: creat d6/d15/d2d/d2f/d42/d46/fa7 x:0 0 0 2024-04-01T06:57:37.259 INFO:tasks.workunit.client.0.smithi083.stdout:3/482: fsync d6/d15/d2d/d2f/d42/f63 0 2024-04-01T06:57:37.262 INFO:tasks.workunit.client.0.smithi083.stdout:5/247: symlink d4/d2b/l51 0 2024-04-01T06:57:37.263 INFO:tasks.workunit.client.0.smithi083.stdout:6/311: creat d9/dc/d1b/d39/f62 x:0 0 0 2024-04-01T06:57:37.264 INFO:tasks.workunit.client.0.smithi083.stdout:6/312: chown d9/dc/l55 67 1 2024-04-01T06:57:37.264 INFO:tasks.workunit.client.0.smithi083.stdout:4/287: symlink d1/d47/d2a/l55 0 2024-04-01T06:57:37.266 INFO:tasks.workunit.client.0.smithi083.stdout:1/456: symlink db/d1c/d29/d33/d50/la7 0 2024-04-01T06:57:37.267 INFO:tasks.workunit.client.0.smithi083.stdout:1/457: write db/d1c/d1d/f4c [2272683,22426] 0 2024-04-01T06:57:37.267 INFO:tasks.workunit.client.0.smithi083.stdout:1/458: chown db/d1c/d29/d33/f59 2198 1 2024-04-01T06:57:37.267 INFO:tasks.workunit.client.0.smithi083.stdout:8/398: creat d15/d18/d19/d24/f94 x:0 0 0 2024-04-01T06:57:37.267 INFO:tasks.workunit.client.0.smithi083.stdout:8/399: dread - d15/d18/d19/d1d/f60 zero size 2024-04-01T06:57:37.268 INFO:tasks.workunit.client.0.smithi083.stdout:7/324: rename d0/d10/f20 to d0/d4/f69 0 2024-04-01T06:57:37.269 INFO:tasks.workunit.client.0.smithi083.stdout:2/402: link d3/d26/d59/d27/f7e d3/d20/d42/f88 0 2024-04-01T06:57:37.270 INFO:tasks.workunit.client.0.smithi083.stdout:2/403: write f1 [2996422,61267] 0 2024-04-01T06:57:37.270 INFO:tasks.workunit.client.0.smithi083.stdout:0/365: getdents d16/d3a 0 2024-04-01T06:57:37.271 INFO:tasks.workunit.client.0.smithi083.stdout:5/248: mknod d4/d23/d49/c52 0 2024-04-01T06:57:37.274 INFO:tasks.workunit.client.0.smithi083.stdout:6/313: creat d9/dc/d29/d3c/d5c/f63 x:0 0 0 2024-04-01T06:57:37.274 INFO:tasks.workunit.client.0.smithi083.stdout:6/314: chown d9/dc/d1b/d39/f62 79151 1 2024-04-01T06:57:37.275 INFO:tasks.workunit.client.0.smithi083.stdout:4/288: creat d1/d4/db/f56 x:0 0 0 2024-04-01T06:57:37.275 INFO:tasks.workunit.client.0.smithi083.stdout:1/459: creat db/d1c/d29/d33/d47/fa8 x:0 0 0 2024-04-01T06:57:37.276 INFO:tasks.workunit.client.0.smithi083.stdout:8/400: creat d15/d18/d19/d6c/f95 x:0 0 0 2024-04-01T06:57:37.277 INFO:tasks.workunit.client.0.smithi083.stdout:9/317: symlink d6/d32/d26/d2d/l67 0 2024-04-01T06:57:37.278 INFO:tasks.workunit.client.0.smithi083.stdout:2/404: link d3/d26/f36 d3/d26/f89 0 2024-04-01T06:57:37.279 INFO:tasks.workunit.client.0.smithi083.stdout:2/405: write d3/d4d/d57/f6a [109575,39345] 0 2024-04-01T06:57:37.279 INFO:tasks.workunit.client.0.smithi083.stdout:0/366: link c9 d16/d3a/d63/c78 0 2024-04-01T06:57:37.280 INFO:tasks.workunit.client.0.smithi083.stdout:5/249: mkdir d4/d9/d16/d1f/d2f/d53 0 2024-04-01T06:57:37.281 INFO:tasks.workunit.client.0.smithi083.stdout:4/289: getdents d1/d8 0 2024-04-01T06:57:37.282 INFO:tasks.workunit.client.0.smithi083.stdout:2/406: dread d3/d26/d59/d2b/f82 [0,4194304] 0 2024-04-01T06:57:37.283 INFO:tasks.workunit.client.0.smithi083.stdout:1/460: symlink db/d1c/d29/d33/d50/la9 0 2024-04-01T06:57:37.287 INFO:tasks.workunit.client.0.smithi083.stdout:7/325: dwrite d0/f5b [0,4194304] 0 2024-04-01T06:57:37.287 INFO:tasks.workunit.client.0.smithi083.stdout:0/367: getdents d16/d2e/d3d/d5d 0 2024-04-01T06:57:37.287 INFO:tasks.workunit.client.0.smithi083.stdout:0/368: fsync d16/d1d/f25 0 2024-04-01T06:57:37.287 INFO:tasks.workunit.client.0.smithi083.stdout:0/369: fdatasync d16/d2e/d3d/f4d 0 2024-04-01T06:57:37.287 INFO:tasks.workunit.client.0.smithi083.stdout:0/370: chown f12 2891591 1 2024-04-01T06:57:37.289 INFO:tasks.workunit.client.0.smithi083.stdout:5/250: creat d4/d2b/f54 x:0 0 0 2024-04-01T06:57:37.290 INFO:tasks.workunit.client.0.smithi083.stdout:2/407: mknod d3/d26/d59/d70/c8a 0 2024-04-01T06:57:37.291 INFO:tasks.workunit.client.0.smithi083.stdout:0/371: dread d16/f4c [0,4194304] 0 2024-04-01T06:57:37.292 INFO:tasks.workunit.client.0.smithi083.stdout:6/315: dwrite d9/dc/d1b/f1e [0,4194304] 0 2024-04-01T06:57:37.293 INFO:tasks.workunit.client.0.smithi083.stdout:6/316: chown d9/dc/d1b/f4d 77 1 2024-04-01T06:57:37.293 INFO:tasks.workunit.client.0.smithi083.stdout:6/317: readlink d9/dc/d1b/d39/d47/l5a 0 2024-04-01T06:57:37.293 INFO:tasks.workunit.client.0.smithi083.stdout:6/318: fsync d9/dc/d1b/f43 0 2024-04-01T06:57:37.293 INFO:tasks.workunit.client.0.smithi083.stdout:2/408: dread d3/d4d/d57/f6a [0,4194304] 0 2024-04-01T06:57:37.293 INFO:tasks.workunit.client.0.smithi083.stdout:2/409: read d3/f7f [199303,23758] 0 2024-04-01T06:57:37.293 INFO:tasks.workunit.client.0.smithi083.stdout:9/318: mknod d6/d32/d26/d2d/c68 0 2024-04-01T06:57:37.299 INFO:tasks.workunit.client.0.smithi083.stdout:7/326: creat d0/d10/d34/f6a x:0 0 0 2024-04-01T06:57:37.300 INFO:tasks.workunit.client.0.smithi083.stdout:1/461: dwrite db/d1c/d29/d33/d47/f98 [0,4194304] 0 2024-04-01T06:57:37.300 INFO:tasks.workunit.client.0.smithi083.stdout:1/462: write db/d1c/d29/d33/d50/d5d/d81/f92 [1330278,127319] 0 2024-04-01T06:57:37.300 INFO:tasks.workunit.client.0.smithi083.stdout:1/463: readlink db/d1c/d2e/l5f 0 2024-04-01T06:57:37.302 INFO:tasks.workunit.client.0.smithi083.stdout:6/319: dread d9/dc/f11 [0,4194304] 0 2024-04-01T06:57:37.302 INFO:tasks.workunit.client.0.smithi083.stdout:6/320: chown d9/f1a 2 1 2024-04-01T06:57:37.302 INFO:tasks.workunit.client.0.smithi083.stdout:6/321: read d9/dc/f42 [850914,27366] 0 2024-04-01T06:57:37.302 INFO:tasks.workunit.client.0.smithi083.stdout:8/401: dwrite d15/d18/d19/d24/f89 [0,4194304] 0 2024-04-01T06:57:37.307 INFO:tasks.workunit.client.0.smithi083.stdout:5/251: dwrite d4/d9/d16/d19/f1e [0,4194304] 0 2024-04-01T06:57:37.308 INFO:tasks.workunit.client.0.smithi083.stdout:9/319: link d6/l46 d6/d29/l69 0 2024-04-01T06:57:37.309 INFO:tasks.workunit.client.0.smithi083.stdout:0/372: dwrite d16/d1d/f51 [4194304,4194304] 0 2024-04-01T06:57:37.311 INFO:tasks.workunit.client.0.smithi083.stdout:1/464: truncate f3 1176484 0 2024-04-01T06:57:37.313 INFO:tasks.workunit.client.0.smithi083.stdout:7/327: dwrite d0/d4/f2a [0,4194304] 0 2024-04-01T06:57:37.317 INFO:tasks.workunit.client.0.smithi083.stdout:9/320: creat d6/d32/d3c/f6a x:0 0 0 2024-04-01T06:57:37.320 INFO:tasks.workunit.client.0.smithi083.stdout:0/373: mknod d16/d3a/c79 0 2024-04-01T06:57:37.321 INFO:tasks.workunit.client.0.smithi083.stdout:1/465: dread db/d1c/d29/d33/d50/d5d/d6c/f74 [0,4194304] 0 2024-04-01T06:57:37.321 INFO:tasks.workunit.client.0.smithi083.stdout:1/466: dread - db/d1c/d2e/f6e zero size 2024-04-01T06:57:37.321 INFO:tasks.workunit.client.0.smithi083.stdout:1/467: write db/d1c/d1d/f1f [1930923,55325] 0 2024-04-01T06:57:37.321 INFO:tasks.workunit.client.0.smithi083.stdout:1/468: read db/fd [81917,3678] 0 2024-04-01T06:57:37.321 INFO:tasks.workunit.client.0.smithi083.stdout:1/469: write db/d1c/d29/d33/d50/d4d/f63 [522115,128043] 0 2024-04-01T06:57:37.323 INFO:tasks.workunit.client.0.smithi083.stdout:8/402: dwrite d15/d18/d19/d24/d44/f88 [0,4194304] 0 2024-04-01T06:57:37.324 INFO:tasks.workunit.client.0.smithi083.stdout:5/252: mkdir d4/d55 0 2024-04-01T06:57:37.324 INFO:tasks.workunit.client.0.smithi083.stdout:8/403: write d15/d21/f51 [3312474,3327] 0 2024-04-01T06:57:37.324 INFO:tasks.workunit.client.0.smithi083.stdout:8/404: dread - d15/d18/d19/d24/f7e zero size 2024-04-01T06:57:37.324 INFO:tasks.workunit.client.0.smithi083.stdout:0/374: link d16/d2e/l65 d16/d2e/d3d/l7a 0 2024-04-01T06:57:37.324 INFO:tasks.workunit.client.0.smithi083.stdout:0/375: write d16/f42 [4010,52299] 0 2024-04-01T06:57:37.327 INFO:tasks.workunit.client.0.smithi083.stdout:2/410: rename d3/d26/d59/d70 to d3/d8b 0 2024-04-01T06:57:37.327 INFO:tasks.workunit.client.0.smithi083.stdout:2/411: read - d3/d26/f3a zero size 2024-04-01T06:57:37.334 INFO:tasks.workunit.client.0.smithi083.stdout:1/470: rmdir db 39 2024-04-01T06:57:37.335 INFO:tasks.workunit.client.0.smithi083.stdout:8/405: rmdir d15/d18/d19/d24/d44 39 2024-04-01T06:57:37.336 INFO:tasks.workunit.client.0.smithi083.stdout:0/376: mkdir d16/d3a/d4b/d6e/d7b 0 2024-04-01T06:57:37.339 INFO:tasks.workunit.client.0.smithi083.stdout:6/322: rename d9/dc/fe to d9/dc/d1b/d35/f64 0 2024-04-01T06:57:37.341 INFO:tasks.workunit.client.0.smithi083.stdout:2/412: creat d3/d8b/d53/d66/f8c x:0 0 0 2024-04-01T06:57:37.341 INFO:tasks.workunit.client.0.smithi083.stdout:2/413: chown d3/d26/d59/c35 1626 1 2024-04-01T06:57:37.342 INFO:tasks.workunit.client.0.smithi083.stdout:5/253: mkdir d4/d56 0 2024-04-01T06:57:37.342 INFO:tasks.workunit.client.0.smithi083.stdout:5/254: fdatasync d4/fa 0 2024-04-01T06:57:37.343 INFO:tasks.workunit.client.0.smithi083.stdout:0/377: dread d16/d1d/f46 [0,4194304] 0 2024-04-01T06:57:37.343 INFO:tasks.workunit.client.0.smithi083.stdout:1/471: creat db/d1c/d29/d33/d50/faa x:0 0 0 2024-04-01T06:57:37.347 INFO:tasks.workunit.client.0.smithi083.stdout:8/406: rename fa to d15/d18/d19/d24/d38/d62/f96 0 2024-04-01T06:57:37.347 INFO:tasks.workunit.client.0.smithi083.stdout:8/407: fdatasync d15/f27 0 2024-04-01T06:57:37.347 INFO:tasks.workunit.client.0.smithi083.stdout:6/323: creat d9/dc/f65 x:0 0 0 2024-04-01T06:57:37.347 INFO:tasks.workunit.client.0.smithi083.stdout:8/408: fdatasync d15/d18/d19/f23 0 2024-04-01T06:57:37.347 INFO:tasks.workunit.client.0.smithi083.stdout:6/324: chown f8 24984 1 2024-04-01T06:57:37.348 INFO:tasks.workunit.client.0.smithi083.stdout:0/378: mkdir d16/d2e/d3d/d7c 0 2024-04-01T06:57:37.349 INFO:tasks.workunit.client.0.smithi083.stdout:1/472: creat db/d1c/d1d/fab x:0 0 0 2024-04-01T06:57:37.351 INFO:tasks.workunit.client.0.smithi083.stdout:8/409: mkdir d15/d18/d19/d24/d44/d97 0 2024-04-01T06:57:37.352 INFO:tasks.workunit.client.0.smithi083.stdout:1/473: mknod db/d1c/d49/cac 0 2024-04-01T06:57:37.354 INFO:tasks.workunit.client.0.smithi083.stdout:6/325: rename c5 to d9/d57/c66 0 2024-04-01T06:57:37.354 INFO:tasks.workunit.client.0.smithi083.stdout:6/326: chown d9/dc/d1b/f3f 22404938 1 2024-04-01T06:57:37.354 INFO:tasks.workunit.client.0.smithi083.stdout:6/327: write d9/dc/d1b/d35/d48/d52/f54 [750157,72426] 0 2024-04-01T06:57:37.354 INFO:tasks.workunit.client.0.smithi083.stdout:1/474: rmdir db/d1c/d1d/d8b 39 2024-04-01T06:57:37.357 INFO:tasks.workunit.client.0.smithi083.stdout:0/379: dread d16/d3a/f3c [0,4194304] 0 2024-04-01T06:57:37.358 INFO:tasks.workunit.client.0.smithi083.stdout:2/414: dwrite d3/d26/d59/d2b/f82 [0,4194304] 0 2024-04-01T06:57:37.364 INFO:tasks.workunit.client.0.smithi083.stdout:8/410: dread d15/d18/d19/f23 [0,4194304] 0 2024-04-01T06:57:37.364 INFO:tasks.workunit.client.0.smithi083.stdout:8/411: chown d15/d21/f2c 54542230 1 2024-04-01T06:57:37.364 INFO:tasks.workunit.client.0.smithi083.stdout:5/255: dwrite d4/d9/d16/f4c [0,4194304] 0 2024-04-01T06:57:37.364 INFO:tasks.workunit.client.0.smithi083.stdout:5/256: fdatasync d4/fb 0 2024-04-01T06:57:37.364 INFO:tasks.workunit.client.0.smithi083.stdout:5/257: truncate d4/d2b/f39 5205348 0 2024-04-01T06:57:37.364 INFO:tasks.workunit.client.0.smithi083.stdout:0/380: creat d16/d3a/d63/f7d x:0 0 0 2024-04-01T06:57:37.364 INFO:tasks.workunit.client.0.smithi083.stdout:2/415: rename d3/d26/d59/c25 to d3/c8d 0 2024-04-01T06:57:37.364 INFO:tasks.workunit.client.0.smithi083.stdout:2/416: write d3/d26/d59/d2b/f40 [1716106,77151] 0 2024-04-01T06:57:37.365 INFO:tasks.workunit.client.0.smithi083.stdout:2/417: readlink d3/d26/d59/d2b/l6e 0 2024-04-01T06:57:37.365 INFO:tasks.workunit.client.0.smithi083.stdout:8/412: creat d15/d1b/d39/d48/d5e/d70/f98 x:0 0 0 2024-04-01T06:57:37.367 INFO:tasks.workunit.client.0.smithi083.stdout:1/475: getdents db/d1c/d29/d33/d50 0 2024-04-01T06:57:37.370 INFO:tasks.workunit.client.0.smithi083.stdout:5/258: rename d4/ff to d4/d23/d4e/f57 0 2024-04-01T06:57:37.370 INFO:tasks.workunit.client.0.smithi083.stdout:8/413: rename d15 to d15/d18/d19/d1d/d99 22 2024-04-01T06:57:37.371 INFO:tasks.workunit.client.0.smithi083.stdout:5/259: write d4/d9/d16/d19/f1e [2045147,108040] 0 2024-04-01T06:57:37.371 INFO:tasks.workunit.client.0.smithi083.stdout:5/260: write d4/d9/d16/d1f/d2f/f46 [3991326,40242] 0 2024-04-01T06:57:37.373 INFO:tasks.workunit.client.0.smithi083.stdout:2/418: link d3/d26/d59/d2b/f82 d3/d8b/f8e 0 2024-04-01T06:57:37.373 INFO:tasks.workunit.client.0.smithi083.stdout:2/419: write d3/f1c [4285683,114632] 0 2024-04-01T06:57:37.375 INFO:tasks.workunit.client.0.smithi083.stdout:1/476: unlink db/d1c/d29/l84 0 2024-04-01T06:57:37.375 INFO:tasks.workunit.client.0.smithi083.stdout:0/381: dwrite d16/d1d/f54 [0,4194304] 0 2024-04-01T06:57:37.375 INFO:tasks.workunit.client.0.smithi083.stdout:0/382: chown d16/d3a/d63/c64 2259266 1 2024-04-01T06:57:37.375 INFO:tasks.workunit.client.0.smithi083.stdout:0/383: stat d16/d1d/l5e 0 2024-04-01T06:57:37.378 INFO:tasks.workunit.client.0.smithi083.stdout:8/414: mkdir d15/d1b/d39/d48/d5e/d6b/d9a 0 2024-04-01T06:57:37.378 INFO:tasks.workunit.client.0.smithi083.stdout:8/415: write d15/d18/d19/f23 [4020232,128693] 0 2024-04-01T06:57:37.378 INFO:tasks.workunit.client.0.smithi083.stdout:5/261: rename d4/d2b/d21/c28 to d4/d2b/d21/c58 0 2024-04-01T06:57:37.380 INFO:tasks.workunit.client.0.smithi083.stdout:1/477: rmdir db/d1c/d1d 39 2024-04-01T06:57:37.382 INFO:tasks.workunit.client.0.smithi083.stdout:1/478: write db/d1c/d29/d33/d47/f98 [3678379,44309] 0 2024-04-01T06:57:37.384 INFO:tasks.workunit.client.0.smithi083.stdout:0/384: rename d16/d3a/d63/f69 to d16/d1d/f7e 0 2024-04-01T06:57:37.384 INFO:tasks.workunit.client.0.smithi083.stdout:2/420: dwrite d3/d26/d59/f30 [4194304,4194304] 0 2024-04-01T06:57:37.386 INFO:tasks.workunit.client.0.smithi083.stdout:5/262: creat d4/d9/d16/d1f/d2f/f59 x:0 0 0 2024-04-01T06:57:37.388 INFO:tasks.workunit.client.0.smithi083.stdout:1/479: mkdir db/d1c/d29/d33/d50/d5d/dad 0 2024-04-01T06:57:37.389 INFO:tasks.workunit.client.0.smithi083.stdout:0/385: symlink d16/d2e/d5b/d74/l7f 0 2024-04-01T06:57:37.391 INFO:tasks.workunit.client.0.smithi083.stdout:8/416: dwrite d15/d18/d19/d24/d38/d62/f85 [0,4194304] 0 2024-04-01T06:57:37.392 INFO:tasks.workunit.client.0.smithi083.stdout:2/421: symlink d3/d8b/l8f 0 2024-04-01T06:57:37.392 INFO:tasks.workunit.client.0.smithi083.stdout:2/422: chown d3/d8b/d53/d5e/f7b 5 1 2024-04-01T06:57:37.392 INFO:tasks.workunit.client.0.smithi083.stdout:2/423: chown d3/d8b/c55 47362 1 2024-04-01T06:57:37.393 INFO:tasks.workunit.client.0.smithi083.stdout:5/263: mknod d4/d23/c5a 0 2024-04-01T06:57:37.394 INFO:tasks.workunit.client.0.smithi083.stdout:5/264: dread - d4/d9/d16/d19/f4b zero size 2024-04-01T06:57:37.399 INFO:tasks.workunit.client.0.smithi083.stdout:1/480: unlink db/d1c/d29/d33/d50/d4d/f4f 0 2024-04-01T06:57:37.399 INFO:tasks.workunit.client.0.smithi083.stdout:1/481: write f7 [5014934,56205] 0 2024-04-01T06:57:37.405 INFO:tasks.workunit.client.0.smithi083.stdout:0/386: symlink d16/d3a/d63/l80 0 2024-04-01T06:57:37.407 INFO:tasks.workunit.client.0.smithi083.stdout:8/417: truncate d15/d18/d19/d24/d38/f41 5304869 0 2024-04-01T06:57:37.408 INFO:tasks.workunit.client.0.smithi083.stdout:8/418: write d15/d1b/d39/d48/d5e/d70/f98 [4117,58327] 0 2024-04-01T06:57:37.408 INFO:tasks.workunit.client.0.smithi083.stdout:8/419: chown d15/d18/d19/d24/d44 0 1 2024-04-01T06:57:37.408 INFO:tasks.workunit.client.0.smithi083.stdout:2/424: mkdir d3/d71/d90 0 2024-04-01T06:57:37.411 INFO:tasks.workunit.client.0.smithi083.stdout:5/265: unlink d4/d9/f3b 0 2024-04-01T06:57:37.411 INFO:tasks.workunit.client.0.smithi083.stdout:1/482: dwrite db/d1c/d1d/fab [0,4194304] 0 2024-04-01T06:57:37.411 INFO:tasks.workunit.client.0.smithi083.stdout:1/483: write db/d1c/d1d/f6b [672668,67018] 0 2024-04-01T06:57:37.412 INFO:tasks.workunit.client.0.smithi083.stdout:0/387: truncate d16/d1d/f49 644456 0 2024-04-01T06:57:37.413 INFO:tasks.workunit.client.0.smithi083.stdout:8/420: rename d15/d21/l6a to d15/d18/d19/l9b 0 2024-04-01T06:57:37.414 INFO:tasks.workunit.client.0.smithi083.stdout:5/266: truncate d4/f1b 313233 0 2024-04-01T06:57:37.419 INFO:tasks.workunit.client.0.smithi083.stdout:0/388: link d16/d3a/d4b/c71 d16/d2e/c81 0 2024-04-01T06:57:37.420 INFO:tasks.workunit.client.0.smithi083.stdout:5/267: mknod d4/d9/c5b 0 2024-04-01T06:57:37.420 INFO:tasks.workunit.client.0.smithi083.stdout:5/268: rename d4 to d4/d23/d5c 22 2024-04-01T06:57:37.421 INFO:tasks.workunit.client.0.smithi083.stdout:5/269: mknod d4/d9/d4f/c5d 0 2024-04-01T06:57:37.423 INFO:tasks.workunit.client.0.smithi083.stdout:0/389: write f11 [6700211,24252] 0 2024-04-01T06:57:37.423 INFO:tasks.workunit.client.0.smithi083.stdout:1/484: dwrite db/d1c/d2e/f38 [0,4194304] 0 2024-04-01T06:57:37.424 INFO:tasks.workunit.client.0.smithi083.stdout:5/270: mkdir d4/d9/d16/d19/d5e 0 2024-04-01T06:57:37.427 INFO:tasks.workunit.client.0.smithi083.stdout:0/390: mkdir d16/d2e/d6c/d82 0 2024-04-01T06:57:37.427 INFO:tasks.workunit.client.0.smithi083.stdout:8/421: dwrite d15/d18/d19/d6c/f95 [0,4194304] 0 2024-04-01T06:57:37.428 INFO:tasks.workunit.client.0.smithi083.stdout:1/485: symlink db/d1c/d29/d33/d4b/lae 0 2024-04-01T06:57:37.431 INFO:tasks.workunit.client.0.smithi083.stdout:0/391: rename d16/d2e/f2f to d16/d3a/f83 0 2024-04-01T06:57:37.431 INFO:tasks.workunit.client.0.smithi083.stdout:0/392: chown d16/d3a 1022 1 2024-04-01T06:57:37.431 INFO:tasks.workunit.client.0.smithi083.stdout:0/393: chown d16/d2e/d3d/c72 30 1 2024-04-01T06:57:37.435 INFO:tasks.workunit.client.0.smithi083.stdout:5/271: dread d4/d2b/f39 [0,4194304] 0 2024-04-01T06:57:37.436 INFO:tasks.workunit.client.0.smithi083.stdout:5/272: read d4/d23/f29 [1281212,113772] 0 2024-04-01T06:57:37.436 INFO:tasks.workunit.client.0.smithi083.stdout:5/273: fsync d4/fa 0 2024-04-01T06:57:37.438 INFO:tasks.workunit.client.0.smithi083.stdout:5/274: link d4/l35 d4/d9/d16/d1f/d2f/d53/l5f 0 2024-04-01T06:57:37.440 INFO:tasks.workunit.client.0.smithi083.stdout:1/486: dwrite db/d1c/d29/d33/d50/f27 [0,4194304] 0 2024-04-01T06:57:37.440 INFO:tasks.workunit.client.0.smithi083.stdout:5/275: rename d4/d9/f12 to d4/d9/d16/d1f/d2f/f60 0 2024-04-01T06:57:37.443 INFO:tasks.workunit.client.0.smithi083.stdout:1/487: dread db/d1c/d2e/f34 [0,4194304] 0 2024-04-01T06:57:37.445 INFO:tasks.workunit.client.0.smithi083.stdout:0/394: dwrite d16/d3a/f6d [0,4194304] 0 2024-04-01T06:57:37.445 INFO:tasks.workunit.client.0.smithi083.stdout:0/395: getdents d16/d2e/d3d/d7c 0 2024-04-01T06:57:37.449 INFO:tasks.workunit.client.0.smithi083.stdout:5/276: dread d4/d9/d16/d1f/f44 [0,4194304] 0 2024-04-01T06:57:37.450 INFO:tasks.workunit.client.0.smithi083.stdout:5/277: mkdir d4/d2b/d61 0 2024-04-01T06:57:37.461 INFO:tasks.workunit.client.0.smithi083.stdout:1/488: dwrite db/d1c/d29/f3e [0,4194304] 0 2024-04-01T06:57:37.463 INFO:tasks.workunit.client.0.smithi083.stdout:1/489: unlink db/d1c/d1d/d8b/f86 0 2024-04-01T06:57:37.463 INFO:tasks.workunit.client.0.smithi083.stdout:1/490: chown db/d1c/d29/d33/d50/f2c 0 1 2024-04-01T06:57:37.463 INFO:tasks.workunit.client.0.smithi083.stdout:0/396: dwrite f7 [4194304,4194304] 0 2024-04-01T06:57:37.463 INFO:tasks.workunit.client.0.smithi083.stdout:0/397: readlink d16/d1d/l21 0 2024-04-01T06:57:37.464 INFO:tasks.workunit.client.0.smithi083.stdout:0/398: mkdir d16/d3a/d4b/d84 0 2024-04-01T06:57:37.467 INFO:tasks.workunit.client.0.smithi083.stdout:5/278: dwrite d4/d2b/f24 [0,4194304] 0 2024-04-01T06:57:37.467 INFO:tasks.workunit.client.0.smithi083.stdout:5/279: dread - d4/d9/d16/d19/f4b zero size 2024-04-01T06:57:37.474 INFO:tasks.workunit.client.0.smithi083.stdout:0/399: creat d16/d2e/d6c/f85 x:0 0 0 2024-04-01T06:57:37.476 INFO:tasks.workunit.client.0.smithi083.stdout:5/280: rename d4/d9/c15 to d4/d23/d4e/c62 0 2024-04-01T06:57:37.476 INFO:tasks.workunit.client.0.smithi083.stdout:5/281: dread - d4/d9/d16/d19/f4b zero size 2024-04-01T06:57:37.476 INFO:tasks.workunit.client.0.smithi083.stdout:5/282: chown d4/d9/d16/d1f/f22 32518 1 2024-04-01T06:57:37.478 INFO:tasks.workunit.client.0.smithi083.stdout:0/400: link f14 d16/d3a/d4b/d68/f86 0 2024-04-01T06:57:37.480 INFO:tasks.workunit.client.0.smithi083.stdout:1/491: dwrite db/d1c/d29/d33/d50/d5d/d81/f92 [0,4194304] 0 2024-04-01T06:57:37.482 INFO:tasks.workunit.client.0.smithi083.stdout:5/283: rename d4/d23/l3d to d4/d9/d16/d1f/l63 0 2024-04-01T06:57:37.483 INFO:tasks.workunit.client.0.smithi083.stdout:5/284: write d4/d9/d16/d1f/d2f/f46 [2161170,100992] 0 2024-04-01T06:57:37.484 INFO:tasks.workunit.client.0.smithi083.stdout:0/401: rmdir d16/d3a/d4b/d6e/d7b 0 2024-04-01T06:57:37.492 INFO:tasks.workunit.client.0.smithi083.stdout:1/492: mknod db/d1c/d29/d33/d47/caf 0 2024-04-01T06:57:37.498 INFO:tasks.workunit.client.0.smithi083.stdout:3/483: sync 2024-04-01T06:57:37.498 INFO:tasks.workunit.client.0.smithi083.stdout:3/484: dread - d6/d15/f35 zero size 2024-04-01T06:57:37.503 INFO:tasks.workunit.client.0.smithi083.stdout:1/493: rename db/f15 to db/d1c/d29/d33/d50/d5d/d81/d94/fb0 0 2024-04-01T06:57:37.509 INFO:tasks.workunit.client.0.smithi083.stdout:1/494: rmdir db/d1c/d29/d33/d50/d5d/d81/d94 39 2024-04-01T06:57:37.512 INFO:tasks.workunit.client.0.smithi083.stdout:1/495: link db/d1c/d1d/c66 db/d1c/d29/d33/d47/cb1 0 2024-04-01T06:57:37.512 INFO:tasks.workunit.client.0.smithi083.stdout:1/496: stat db/f11 0 2024-04-01T06:57:37.512 INFO:tasks.workunit.client.0.smithi083.stdout:1/497: write db/d1c/d29/d33/d4b/f51 [5843876,109426] 0 2024-04-01T06:57:37.514 INFO:tasks.workunit.client.0.smithi083.stdout:5/285: rmdir d4/d56 0 2024-04-01T06:57:37.514 INFO:tasks.workunit.client.0.smithi083.stdout:5/286: write d4/fb [7582662,81958] 0 2024-04-01T06:57:37.515 INFO:tasks.workunit.client.0.smithi083.stdout:5/287: read d4/d2b/f31 [1373115,74610] 0 2024-04-01T06:57:37.516 INFO:tasks.workunit.client.0.smithi083.stdout:5/288: fsync d4/fb 0 2024-04-01T06:57:37.517 INFO:tasks.workunit.client.0.smithi083.stdout:1/498: rename db/d1c/d29/d33/d50/d5d/c62 to db/d1c/cb2 0 2024-04-01T06:57:37.519 INFO:tasks.workunit.client.0.smithi083.stdout:0/402: rmdir d16/d1d 39 2024-04-01T06:57:37.520 INFO:tasks.workunit.client.0.smithi083.stdout:5/289: creat d4/d9/d16/d19/d5e/f64 x:0 0 0 2024-04-01T06:57:37.521 INFO:tasks.workunit.client.0.smithi083.stdout:1/499: mknod db/d1c/d29/d33/d50/d5d/d81/d94/cb3 0 2024-04-01T06:57:37.521 INFO:tasks.workunit.client.0.smithi083.stdout:1/500: chown db/l42 4182729 1 2024-04-01T06:57:37.521 INFO:tasks.workunit.client.0.smithi083.stdout:1/501: fdatasync db/d1c/d29/d33/d50/f2c 0 2024-04-01T06:57:37.521 INFO:tasks.workunit.client.0.smithi083.stdout:1/502: stat db/d1c/d1d/c6f 0 2024-04-01T06:57:37.522 INFO:tasks.workunit.client.0.smithi083.stdout:0/403: creat d16/d2e/d6c/d82/f87 x:0 0 0 2024-04-01T06:57:37.524 INFO:tasks.workunit.client.0.smithi083.stdout:5/290: getdents d4/d2b 0 2024-04-01T06:57:37.532 INFO:tasks.workunit.client.0.smithi083.stdout:1/503: mkdir db/d1c/d1d/db4 0 2024-04-01T06:57:37.532 INFO:tasks.workunit.client.0.smithi083.stdout:1/504: link db/d1c/d1d/f20 db/d1c/d29/d33/d50/d5d/d81/fb5 0 2024-04-01T06:57:37.532 INFO:tasks.workunit.client.0.smithi083.stdout:1/505: write db/fd [816632,21478] 0 2024-04-01T06:57:37.534 INFO:tasks.workunit.client.0.smithi083.stdout:1/506: mkdir db/d1c/d29/d33/d47/d76/db6 0 2024-04-01T06:57:37.544 INFO:tasks.workunit.client.0.smithi083.stdout:0/404: dwrite d16/d1d/f54 [0,4194304] 0 2024-04-01T06:57:37.544 INFO:tasks.workunit.client.0.smithi083.stdout:5/291: dwrite d4/d9/d16/f4c [0,4194304] 0 2024-04-01T06:57:37.552 INFO:tasks.workunit.client.0.smithi083.stdout:4/290: sync 2024-04-01T06:57:37.553 INFO:tasks.workunit.client.0.smithi083.stdout:5/292: dwrite d4/d9/d16/d1f/f44 [0,4194304] 0 2024-04-01T06:57:37.553 INFO:tasks.workunit.client.0.smithi083.stdout:5/293: getdents d4/d2b 0 2024-04-01T06:57:37.554 INFO:tasks.workunit.client.0.smithi083.stdout:4/291: creat d1/d8/d42/f57 x:0 0 0 2024-04-01T06:57:37.554 INFO:tasks.workunit.client.0.smithi083.stdout:0/405: dread d16/f52 [0,4194304] 0 2024-04-01T06:57:37.555 INFO:tasks.workunit.client.0.smithi083.stdout:5/294: creat d4/d23/d4e/f65 x:0 0 0 2024-04-01T06:57:37.555 INFO:tasks.workunit.client.0.smithi083.stdout:4/292: write d1/d47/f27 [2807551,67202] 0 2024-04-01T06:57:37.556 INFO:tasks.workunit.client.0.smithi083.stdout:4/293: chown d1/d4/db/f3e 841 1 2024-04-01T06:57:37.556 INFO:tasks.workunit.client.0.smithi083.stdout:0/406: symlink d16/l88 0 2024-04-01T06:57:37.556 INFO:tasks.workunit.client.0.smithi083.stdout:0/407: write d16/d3a/f6d [1283936,86963] 0 2024-04-01T06:57:37.556 INFO:tasks.workunit.client.0.smithi083.stdout:5/295: unlink d4/d9/c2e 0 2024-04-01T06:57:37.557 INFO:tasks.workunit.client.0.smithi083.stdout:4/294: mknod d1/d8/c58 0 2024-04-01T06:57:37.557 INFO:tasks.workunit.client.0.smithi083.stdout:4/295: stat d1/d4/db 0 2024-04-01T06:57:37.557 INFO:tasks.workunit.client.0.smithi083.stdout:4/296: fsync d1/d8/f14 0 2024-04-01T06:57:37.557 INFO:tasks.workunit.client.0.smithi083.stdout:4/297: chown d1/d4/db/c17 6632340 1 2024-04-01T06:57:37.558 INFO:tasks.workunit.client.0.smithi083.stdout:0/408: creat d16/d2e/d3d/d5d/f89 x:0 0 0 2024-04-01T06:57:37.558 INFO:tasks.workunit.client.0.smithi083.stdout:0/409: write d16/d1d/f2a [1250779,60306] 0 2024-04-01T06:57:37.559 INFO:tasks.workunit.client.0.smithi083.stdout:0/410: fdatasync d16/d3a/f3c 0 2024-04-01T06:57:37.559 INFO:tasks.workunit.client.0.smithi083.stdout:0/411: write d16/d2e/d3d/f40 [1001042,61188] 0 2024-04-01T06:57:37.559 INFO:tasks.workunit.client.0.smithi083.stdout:0/412: truncate d16/d3a/f3e 1198528 0 2024-04-01T06:57:37.559 INFO:tasks.workunit.client.0.smithi083.stdout:0/413: stat f11 0 2024-04-01T06:57:37.559 INFO:tasks.workunit.client.0.smithi083.stdout:0/414: chown d16/d3a/c48 2478649 1 2024-04-01T06:57:37.559 INFO:tasks.workunit.client.0.smithi083.stdout:5/296: rename d4/d9/d16/d1f/f22 to d4/d9/d16/d1f/d2f/d53/f66 0 2024-04-01T06:57:37.559 INFO:tasks.workunit.client.0.smithi083.stdout:0/415: truncate d16/d3a/d4b/d68/f86 565019 0 2024-04-01T06:57:37.560 INFO:tasks.workunit.client.0.smithi083.stdout:5/297: mkdir d4/d23/d67 0 2024-04-01T06:57:37.560 INFO:tasks.workunit.client.0.smithi083.stdout:5/298: read - d4/d9/d16/d1f/d2f/f59 zero size 2024-04-01T06:57:37.562 INFO:tasks.workunit.client.0.smithi083.stdout:0/416: unlink d16/d1d/c43 0 2024-04-01T06:57:37.563 INFO:tasks.workunit.client.0.smithi083.stdout:5/299: mkdir d4/d9/d4f/d68 0 2024-04-01T06:57:37.563 INFO:tasks.workunit.client.0.smithi083.stdout:5/300: chown d4/fb 60140078 1 2024-04-01T06:57:37.567 INFO:tasks.workunit.client.0.smithi083.stdout:4/298: dread d1/d4/db/f20 [0,4194304] 0 2024-04-01T06:57:37.567 INFO:tasks.workunit.client.0.smithi083.stdout:4/299: chown d1/d47/d2a/f2f 52660464 1 2024-04-01T06:57:37.567 INFO:tasks.workunit.client.0.smithi083.stdout:4/300: chown d1/d8 92269 1 2024-04-01T06:57:37.567 INFO:tasks.workunit.client.0.smithi083.stdout:5/301: write d4/fb [1610728,55789] 0 2024-04-01T06:57:37.567 INFO:tasks.workunit.client.0.smithi083.stdout:5/302: chown d4/d23/d4e/l50 3 1 2024-04-01T06:57:37.567 INFO:tasks.workunit.client.0.smithi083.stdout:5/303: dread - d4/d9/d16/d19/f4b zero size 2024-04-01T06:57:37.567 INFO:tasks.workunit.client.0.smithi083.stdout:5/304: readlink d4/d9/d16/d1f/d2f/d53/l5f 0 2024-04-01T06:57:37.567 INFO:tasks.workunit.client.0.smithi083.stdout:5/305: truncate d4/d9/d16/d1f/d2f/f59 385146 0 2024-04-01T06:57:37.567 INFO:tasks.workunit.client.0.smithi083.stdout:4/301: mknod d1/d47/c59 0 2024-04-01T06:57:37.569 INFO:tasks.workunit.client.0.smithi083.stdout:0/417: write d16/d3a/d4b/d68/f86 [214844,59076] 0 2024-04-01T06:57:37.571 INFO:tasks.workunit.client.0.smithi083.stdout:4/302: read d1/d4/d33/f43 [919088,85502] 0 2024-04-01T06:57:37.571 INFO:tasks.workunit.client.0.smithi083.stdout:4/303: dread - d1/d4/d33/f49 zero size 2024-04-01T06:57:37.577 INFO:tasks.workunit.client.0.smithi083.stdout:5/306: dwrite d4/d9/d16/d19/d5e/f64 [0,4194304] 0 2024-04-01T06:57:37.578 INFO:tasks.workunit.client.0.smithi083.stdout:4/304: fsync d1/d47/f27 0 2024-04-01T06:57:37.578 INFO:tasks.workunit.client.0.smithi083.stdout:4/305: truncate d1/d4/db/f54 19916 0 2024-04-01T06:57:37.578 INFO:tasks.workunit.client.0.smithi083.stdout:0/418: dread d16/d2e/f36 [0,4194304] 0 2024-04-01T06:57:37.580 INFO:tasks.workunit.client.0.smithi083.stdout:4/306: mknod d1/d8/d42/c5a 0 2024-04-01T06:57:37.581 INFO:tasks.workunit.client.0.smithi083.stdout:4/307: mkdir d1/d4/db/d5b 0 2024-04-01T06:57:37.582 INFO:tasks.workunit.client.0.smithi083.stdout:4/308: creat d1/d4/f5c x:0 0 0 2024-04-01T06:57:37.582 INFO:tasks.workunit.client.0.smithi083.stdout:4/309: read - d1/d4/f5c zero size 2024-04-01T06:57:37.584 INFO:tasks.workunit.client.0.smithi083.stdout:4/310: write d1/d4/da/f29 [1551833,3397] 0 2024-04-01T06:57:37.584 INFO:tasks.workunit.client.0.smithi083.stdout:5/307: dread d4/d9/d16/d1f/d2f/d53/f66 [0,4194304] 0 2024-04-01T06:57:37.594 INFO:tasks.workunit.client.0.smithi083.stdout:5/308: dread d4/d9/d16/d1f/f48 [0,4194304] 0 2024-04-01T06:57:37.595 INFO:tasks.workunit.client.0.smithi083.stdout:5/309: creat d4/d9/d16/d1f/f69 x:0 0 0 2024-04-01T06:57:37.598 INFO:tasks.workunit.client.0.smithi083.stdout:0/419: dwrite d16/d2e/d5b/f6f [0,4194304] 0 2024-04-01T06:57:37.599 INFO:tasks.workunit.client.0.smithi083.stdout:0/420: mknod d16/d2e/d3d/c8a 0 2024-04-01T06:57:37.600 INFO:tasks.workunit.client.0.smithi083.stdout:0/421: creat d16/d1d/f8b x:0 0 0 2024-04-01T06:57:37.600 INFO:tasks.workunit.client.0.smithi083.stdout:0/422: chown d16/d1d 9 1 2024-04-01T06:57:37.601 INFO:tasks.workunit.client.0.smithi083.stdout:0/423: symlink d16/d2e/d6c/d82/l8c 0 2024-04-01T06:57:37.602 INFO:tasks.workunit.client.0.smithi083.stdout:4/311: dwrite d1/d4/db/f41 [0,4194304] 0 2024-04-01T06:57:37.602 INFO:tasks.workunit.client.0.smithi083.stdout:0/424: truncate d16/d2e/f36 1751697 0 2024-04-01T06:57:37.604 INFO:tasks.workunit.client.0.smithi083.stdout:4/312: unlink d1/d8/d42/f4b 0 2024-04-01T06:57:37.605 INFO:tasks.workunit.client.0.smithi083.stdout:0/425: truncate d16/d3a/f3c 1305797 0 2024-04-01T06:57:37.605 INFO:tasks.workunit.client.0.smithi083.stdout:0/426: dread - d16/d1d/f7e zero size 2024-04-01T06:57:37.606 INFO:tasks.workunit.client.0.smithi083.stdout:4/313: unlink d1/d47/l4e 0 2024-04-01T06:57:37.608 INFO:tasks.workunit.client.0.smithi083.stdout:4/314: rename d1/d4/da/l19 to d1/l5d 0 2024-04-01T06:57:37.608 INFO:tasks.workunit.client.0.smithi083.stdout:4/315: chown d1/d4/db/f54 11 1 2024-04-01T06:57:37.609 INFO:tasks.workunit.client.0.smithi083.stdout:5/310: dwrite d4/d9/d16/d1f/f44 [4194304,4194304] 0 2024-04-01T06:57:37.613 INFO:tasks.workunit.client.0.smithi083.stdout:5/311: dread d4/d2b/f31 [0,4194304] 0 2024-04-01T06:57:37.614 INFO:tasks.workunit.client.0.smithi083.stdout:5/312: mknod d4/d55/c6a 0 2024-04-01T06:57:37.614 INFO:tasks.workunit.client.0.smithi083.stdout:5/313: chown d4/d9/d16/d1f/d2f/f59 18891997 1 2024-04-01T06:57:37.617 INFO:tasks.workunit.client.0.smithi083.stdout:5/314: dread d4/d2b/f39 [0,4194304] 0 2024-04-01T06:57:37.618 INFO:tasks.workunit.client.0.smithi083.stdout:0/427: dwrite d16/d3a/f77 [0,4194304] 0 2024-04-01T06:57:37.619 INFO:tasks.workunit.client.0.smithi083.stdout:5/315: link d4/d9/d4f/c5d d4/d23/d49/c6b 0 2024-04-01T06:57:37.620 INFO:tasks.workunit.client.0.smithi083.stdout:4/316: dread d1/d47/f27 [0,4194304] 0 2024-04-01T06:57:37.620 INFO:tasks.workunit.client.0.smithi083.stdout:4/317: fdatasync d1/d4/f25 0 2024-04-01T06:57:37.622 INFO:tasks.workunit.client.0.smithi083.stdout:5/316: rmdir d4/d2b/d61 0 2024-04-01T06:57:37.622 INFO:tasks.workunit.client.0.smithi083.stdout:0/428: dread d16/f29 [0,4194304] 0 2024-04-01T06:57:37.624 INFO:tasks.workunit.client.0.smithi083.stdout:4/318: rename d1/f37 to d1/d8/f5e 0 2024-04-01T06:57:37.625 INFO:tasks.workunit.client.0.smithi083.stdout:5/317: symlink d4/d23/d4e/l6c 0 2024-04-01T06:57:37.626 INFO:tasks.workunit.client.0.smithi083.stdout:0/429: mkdir d16/d1d/d8d 0 2024-04-01T06:57:37.627 INFO:tasks.workunit.client.0.smithi083.stdout:5/318: truncate d4/d9/d16/f4c 176823 0 2024-04-01T06:57:37.629 INFO:tasks.workunit.client.0.smithi083.stdout:5/319: rmdir d4/d9/d16/d1f 39 2024-04-01T06:57:37.633 INFO:tasks.workunit.client.0.smithi083.stdout:0/430: rmdir d16/d2e/d5b 39 2024-04-01T06:57:37.633 INFO:tasks.workunit.client.0.smithi083.stdout:0/431: fdatasync d16/f22 0 2024-04-01T06:57:37.635 INFO:tasks.workunit.client.0.smithi083.stdout:0/432: mknod d16/d3a/d63/c8e 0 2024-04-01T06:57:37.635 INFO:tasks.workunit.client.0.smithi083.stdout:0/433: write d16/d3a/f3e [1028850,22997] 0 2024-04-01T06:57:37.636 INFO:tasks.workunit.client.0.smithi083.stdout:0/434: creat d16/d2e/d3d/f8f x:0 0 0 2024-04-01T06:57:37.637 INFO:tasks.workunit.client.0.smithi083.stdout:0/435: rename d16/c1c to d16/d3a/c90 0 2024-04-01T06:57:37.638 INFO:tasks.workunit.client.0.smithi083.stdout:0/436: symlink d16/d3a/l91 0 2024-04-01T06:57:37.639 INFO:tasks.workunit.client.0.smithi083.stdout:0/437: truncate d16/d3a/d4b/f5c 577815 0 2024-04-01T06:57:37.639 INFO:tasks.workunit.client.0.smithi083.stdout:0/438: write d16/f34 [2060801,75497] 0 2024-04-01T06:57:37.639 INFO:tasks.workunit.client.0.smithi083.stdout:0/439: rmdir d16/d2e/d5b 39 2024-04-01T06:57:37.644 INFO:tasks.workunit.client.0.smithi083.stdout:5/320: dwrite d4/d2b/f54 [0,4194304] 0 2024-04-01T06:57:37.646 INFO:tasks.workunit.client.0.smithi083.stdout:5/321: unlink d4/d23/d4e/f65 0 2024-04-01T06:57:37.647 INFO:tasks.workunit.client.0.smithi083.stdout:5/322: truncate d4/d9/d16/d1f/d2f/f46 2663214 0 2024-04-01T06:57:37.650 INFO:tasks.workunit.client.0.smithi083.stdout:0/440: dread d16/d2e/d5b/f6f [0,4194304] 0 2024-04-01T06:57:37.650 INFO:tasks.workunit.client.0.smithi083.stdout:0/441: chown d16/d1d/f8b 2014083221 1 2024-04-01T06:57:37.650 INFO:tasks.workunit.client.0.smithi083.stdout:0/442: write d16/d2e/d6c/f70 [947988,19724] 0 2024-04-01T06:57:37.650 INFO:tasks.workunit.client.0.smithi083.stdout:0/443: fdatasync f10 0 2024-04-01T06:57:37.652 INFO:tasks.workunit.client.0.smithi083.stdout:4/319: dwrite d1/d8/d42/f46 [0,4194304] 0 2024-04-01T06:57:37.652 INFO:tasks.workunit.client.0.smithi083.stdout:0/444: rename d16/d1d/l4f to d16/d3a/d63/l92 0 2024-04-01T06:57:37.660 INFO:tasks.workunit.client.0.smithi083.stdout:4/320: getdents d1/d4/db 0 2024-04-01T06:57:37.660 INFO:tasks.workunit.client.0.smithi083.stdout:4/321: stat d1/d4/da 0 2024-04-01T06:57:37.662 INFO:tasks.workunit.client.0.smithi083.stdout:4/322: creat d1/d4/db/d5b/f5f x:0 0 0 2024-04-01T06:57:37.663 INFO:tasks.workunit.client.0.smithi083.stdout:4/323: symlink d1/l60 0 2024-04-01T06:57:37.664 INFO:tasks.workunit.client.0.smithi083.stdout:4/324: fdatasync d1/d4/db/f11 0 2024-04-01T06:57:37.665 INFO:tasks.workunit.client.0.smithi083.stdout:4/325: getdents d1/d47/d2a 0 2024-04-01T06:57:37.665 INFO:tasks.workunit.client.0.smithi083.stdout:5/323: dwrite d4/d9/d16/d19/f4b [0,4194304] 0 2024-04-01T06:57:37.666 INFO:tasks.workunit.client.0.smithi083.stdout:4/326: creat d1/d8/d42/f61 x:0 0 0 2024-04-01T06:57:37.667 INFO:tasks.workunit.client.0.smithi083.stdout:0/445: dwrite d16/d2e/d3d/f40 [0,4194304] 0 2024-04-01T06:57:37.667 INFO:tasks.workunit.client.0.smithi083.stdout:0/446: fsync d16/d2e/d3d/f59 0 2024-04-01T06:57:37.669 INFO:tasks.workunit.client.0.smithi083.stdout:4/327: mkdir d1/d4/db/d5b/d62 0 2024-04-01T06:57:37.669 INFO:tasks.workunit.client.0.smithi083.stdout:4/328: chown d1/l60 93145 1 2024-04-01T06:57:37.671 INFO:tasks.workunit.client.0.smithi083.stdout:0/447: truncate d16/d3a/f3c 1156906 0 2024-04-01T06:57:37.672 INFO:tasks.workunit.client.0.smithi083.stdout:4/329: link d1/d8/d42/f57 d1/d8/f63 0 2024-04-01T06:57:37.672 INFO:tasks.workunit.client.0.smithi083.stdout:4/330: dread - d1/d4/f5c zero size 2024-04-01T06:57:37.672 INFO:tasks.workunit.client.0.smithi083.stdout:0/448: creat d16/d3a/d63/f93 x:0 0 0 2024-04-01T06:57:37.673 INFO:tasks.workunit.client.0.smithi083.stdout:0/449: creat d16/d3a/d4b/f94 x:0 0 0 2024-04-01T06:57:37.674 INFO:tasks.workunit.client.0.smithi083.stdout:0/450: mkdir d16/d3a/d4b/d95 0 2024-04-01T06:57:37.685 INFO:tasks.workunit.client.0.smithi083.stdout:5/324: dwrite d4/f1b [0,4194304] 0 2024-04-01T06:57:37.685 INFO:tasks.workunit.client.0.smithi083.stdout:5/325: read d4/d2b/f54 [1478760,22545] 0 2024-04-01T06:57:37.688 INFO:tasks.workunit.client.0.smithi083.stdout:5/326: rmdir d4/d9/d16 39 2024-04-01T06:57:37.689 INFO:tasks.workunit.client.0.smithi083.stdout:5/327: readlink d4/l27 0 2024-04-01T06:57:37.690 INFO:tasks.workunit.client.0.smithi083.stdout:5/328: dread d4/d9/d16/f4c [0,4194304] 0 2024-04-01T06:57:37.690 INFO:tasks.workunit.client.0.smithi083.stdout:5/329: dread - d4/f4a zero size 2024-04-01T06:57:37.690 INFO:tasks.workunit.client.0.smithi083.stdout:5/330: fsync d4/d9/d16/d1f/d2f/d53/f66 0 2024-04-01T06:57:37.691 INFO:tasks.workunit.client.0.smithi083.stdout:4/331: dwrite d1/d8/f63 [0,4194304] 0 2024-04-01T06:57:37.691 INFO:tasks.workunit.client.0.smithi083.stdout:4/332: chown d1/d4/f25 1977727738 1 2024-04-01T06:57:37.692 INFO:tasks.workunit.client.0.smithi083.stdout:4/333: read d1/d8/f5e [8577,20947] 0 2024-04-01T06:57:37.692 INFO:tasks.workunit.client.0.smithi083.stdout:4/334: chown d1/d4/f4f 6 1 2024-04-01T06:57:37.692 INFO:tasks.workunit.client.0.smithi083.stdout:5/331: rename c3 to d4/d9/d4f/d68/c6d 0 2024-04-01T06:57:37.692 INFO:tasks.workunit.client.0.smithi083.stdout:5/332: write d4/f1b [4520065,32506] 0 2024-04-01T06:57:37.699 INFO:tasks.workunit.client.0.smithi083.stdout:0/451: dwrite d16/d3a/d63/f93 [0,4194304] 0 2024-04-01T06:57:37.699 INFO:tasks.workunit.client.0.smithi083.stdout:0/452: fdatasync d16/d2e/f36 0 2024-04-01T06:57:37.701 INFO:tasks.workunit.client.0.smithi083.stdout:0/453: rmdir d16/d2e/d5b/d74 39 2024-04-01T06:57:37.702 INFO:tasks.workunit.client.0.smithi083.stdout:4/335: dwrite d1/f23 [0,4194304] 0 2024-04-01T06:57:37.702 INFO:tasks.workunit.client.0.smithi083.stdout:0/454: mkdir d16/d3a/d4b/d6e/d96 0 2024-04-01T06:57:37.703 INFO:tasks.workunit.client.0.smithi083.stdout:4/336: symlink d1/d47/l64 0 2024-04-01T06:57:37.706 INFO:tasks.workunit.client.0.smithi083.stdout:4/337: dread d1/d4/da/f39 [0,4194304] 0 2024-04-01T06:57:37.706 INFO:tasks.workunit.client.0.smithi083.stdout:0/455: rename d16/d3a/f77 to d16/d2e/d5b/d74/f97 0 2024-04-01T06:57:37.706 INFO:tasks.workunit.client.0.smithi083.stdout:0/456: write d16/d1d/f8b [76946,115872] 0 2024-04-01T06:57:37.706 INFO:tasks.workunit.client.0.smithi083.stdout:0/457: write d16/d3a/f83 [798820,83546] 0 2024-04-01T06:57:37.706 INFO:tasks.workunit.client.0.smithi083.stdout:0/458: chown d16/d1d/f2a 6039498 1 2024-04-01T06:57:37.707 INFO:tasks.workunit.client.0.smithi083.stdout:7/328: sync 2024-04-01T06:57:37.707 INFO:tasks.workunit.client.0.smithi083.stdout:9/321: sync 2024-04-01T06:57:37.708 INFO:tasks.workunit.client.0.smithi083.stdout:9/322: write d6/d32/d4d/f52 [1121405,120961] 0 2024-04-01T06:57:37.708 INFO:tasks.workunit.client.0.smithi083.stdout:7/329: dread d0/d4/f32 [0,4194304] 0 2024-04-01T06:57:37.709 INFO:tasks.workunit.client.0.smithi083.stdout:7/330: write d0/f37 [1933223,23786] 0 2024-04-01T06:57:37.710 INFO:tasks.workunit.client.0.smithi083.stdout:9/323: rename d6/d32/d3c/d5b to d6/d32/d3c/d4c/d6b 0 2024-04-01T06:57:37.710 INFO:tasks.workunit.client.0.smithi083.stdout:9/324: write d6/f53 [4603429,35748] 0 2024-04-01T06:57:37.713 INFO:tasks.workunit.client.0.smithi083.stdout:7/331: creat d0/d4/d9/d43/f6b x:0 0 0 2024-04-01T06:57:37.716 INFO:tasks.workunit.client.0.smithi083.stdout:7/332: creat d0/d10/d62/f6c x:0 0 0 2024-04-01T06:57:37.718 INFO:tasks.workunit.client.0.smithi083.stdout:4/338: dwrite d1/d4/f5c [0,4194304] 0 2024-04-01T06:57:37.718 INFO:tasks.workunit.client.0.smithi083.stdout:9/325: dread d6/d32/f36 [0,4194304] 0 2024-04-01T06:57:37.719 INFO:tasks.workunit.client.0.smithi083.stdout:4/339: symlink d1/d8/l65 0 2024-04-01T06:57:37.720 INFO:tasks.workunit.client.0.smithi083.stdout:9/326: mkdir d6/d32/d26/d2d/d34/d6c 0 2024-04-01T06:57:37.722 INFO:tasks.workunit.client.0.smithi083.stdout:7/333: rename d0/d4/d9/d43 to d0/d4/d9/d39/d67/d6d 0 2024-04-01T06:57:37.723 INFO:tasks.workunit.client.0.smithi083.stdout:4/340: rename d1 to d1/d66 22 2024-04-01T06:57:37.724 INFO:tasks.workunit.client.0.smithi083.stdout:7/334: symlink d0/d4/d9/d39/d48/l6e 0 2024-04-01T06:57:37.740 INFO:tasks.workunit.client.0.smithi083.stdout:9/327: dwrite d6/d32/d26/d2d/f1f [0,4194304] 0 2024-04-01T06:57:37.742 INFO:tasks.workunit.client.0.smithi083.stdout:9/328: write d6/d32/f17 [63471,86932] 0 2024-04-01T06:57:37.743 INFO:tasks.workunit.client.0.smithi083.stdout:9/329: mkdir d6/d32/d4b/d6d 0 2024-04-01T06:57:37.745 INFO:tasks.workunit.client.0.smithi083.stdout:4/341: dwrite d1/d47/d2a/f2e [0,4194304] 0 2024-04-01T06:57:37.747 INFO:tasks.workunit.client.0.smithi083.stdout:9/330: mkdir d6/d32/d26/d2d/d6e 0 2024-04-01T06:57:37.748 INFO:tasks.workunit.client.0.smithi083.stdout:9/331: write d6/d32/d3c/f57 [111353,97177] 0 2024-04-01T06:57:37.748 INFO:tasks.workunit.client.0.smithi083.stdout:4/342: mknod d1/d47/c67 0 2024-04-01T06:57:37.749 INFO:tasks.workunit.client.0.smithi083.stdout:9/332: unlink d6/d32/d3c/l48 0 2024-04-01T06:57:37.750 INFO:tasks.workunit.client.0.smithi083.stdout:4/343: creat d1/d4/f68 x:0 0 0 2024-04-01T06:57:37.750 INFO:tasks.workunit.client.0.smithi083.stdout:4/344: readlink d1/d4/l22 0 2024-04-01T06:57:37.751 INFO:tasks.workunit.client.0.smithi083.stdout:9/333: rename d6/d32/d26/d2d/f45 to d6/d32/d3c/f6f 0 2024-04-01T06:57:37.751 INFO:tasks.workunit.client.0.smithi083.stdout:7/335: dwrite d0/d4/f58 [0,4194304] 0 2024-04-01T06:57:37.752 INFO:tasks.workunit.client.0.smithi083.stdout:9/334: read d6/d32/f4f [2818102,35873] 0 2024-04-01T06:57:37.753 INFO:tasks.workunit.client.0.smithi083.stdout:4/345: rename d1/f23 to d1/d4/db/d5b/f69 0 2024-04-01T06:57:37.753 INFO:tasks.workunit.client.0.smithi083.stdout:7/336: truncate d0/f37 1416651 0 2024-04-01T06:57:37.754 INFO:tasks.workunit.client.0.smithi083.stdout:9/335: rename d6/d32/d26/d2d/d34/l39 to d6/d32/d4b/d6d/l70 0 2024-04-01T06:57:37.755 INFO:tasks.workunit.client.0.smithi083.stdout:4/346: mkdir d1/d8/d6a 0 2024-04-01T06:57:37.755 INFO:tasks.workunit.client.0.smithi083.stdout:4/347: chown d1/d4/f25 24015236 1 2024-04-01T06:57:37.756 INFO:tasks.workunit.client.0.smithi083.stdout:7/337: creat d0/d10/d62/f6f x:0 0 0 2024-04-01T06:57:37.756 INFO:tasks.workunit.client.0.smithi083.stdout:4/348: mknod d1/d4/db/d5b/c6b 0 2024-04-01T06:57:37.758 INFO:tasks.workunit.client.0.smithi083.stdout:7/338: rename d0/f4d to d0/d4/d9/d39/f70 0 2024-04-01T06:57:37.758 INFO:tasks.workunit.client.0.smithi083.stdout:7/339: fsync d0/f3 0 2024-04-01T06:57:37.759 INFO:tasks.workunit.client.0.smithi083.stdout:4/349: mknod d1/d8/d42/c6c 0 2024-04-01T06:57:37.759 INFO:tasks.workunit.client.0.smithi083.stdout:4/350: write d1/d4/db/f3e [693291,55523] 0 2024-04-01T06:57:37.760 INFO:tasks.workunit.client.0.smithi083.stdout:4/351: unlink d1/d8/d42/f51 0 2024-04-01T06:57:37.761 INFO:tasks.workunit.client.0.smithi083.stdout:4/352: chown d1/d4/f5c 2415 1 2024-04-01T06:57:37.762 INFO:tasks.workunit.client.0.smithi083.stdout:4/353: creat d1/d4/f6d x:0 0 0 2024-04-01T06:57:37.770 INFO:tasks.workunit.client.0.smithi083.stdout:4/354: dread d1/d8/f63 [0,4194304] 0 2024-04-01T06:57:37.770 INFO:tasks.workunit.client.0.smithi083.stdout:4/355: readlink d1/d4/l22 0 2024-04-01T06:57:37.770 INFO:tasks.workunit.client.0.smithi083.stdout:9/336: dwrite d6/d32/d26/d2d/d34/f43 [0,4194304] 0 2024-04-01T06:57:37.770 INFO:tasks.workunit.client.0.smithi083.stdout:7/340: dread d0/f5b [0,4194304] 0 2024-04-01T06:57:37.770 INFO:tasks.workunit.client.0.smithi083.stdout:4/356: mkdir d1/d4/d6e 0 2024-04-01T06:57:37.770 INFO:tasks.workunit.client.0.smithi083.stdout:4/357: read - d1/d4/f6d zero size 2024-04-01T06:57:37.771 INFO:tasks.workunit.client.0.smithi083.stdout:4/358: readlink d1/d8/l48 0 2024-04-01T06:57:37.772 INFO:tasks.workunit.client.0.smithi083.stdout:4/359: fsync d1/d4/db/f3e 0 2024-04-01T06:57:37.773 INFO:tasks.workunit.client.0.smithi083.stdout:9/337: mkdir d6/d32/d26/d71 0 2024-04-01T06:57:37.774 INFO:tasks.workunit.client.0.smithi083.stdout:7/341: truncate d0/f66 936767 0 2024-04-01T06:57:37.774 INFO:tasks.workunit.client.0.smithi083.stdout:7/342: chown d0/d10/d38 1053674482 1 2024-04-01T06:57:37.774 INFO:tasks.workunit.client.0.smithi083.stdout:7/343: write d0/f4a [1031134,77908] 0 2024-04-01T06:57:37.775 INFO:tasks.workunit.client.0.smithi083.stdout:7/344: truncate d0/d4/d9/d39/d67/d6d/f6b 492248 0 2024-04-01T06:57:37.775 INFO:tasks.workunit.client.0.smithi083.stdout:7/345: write d0/d10/d38/f4f [319152,74168] 0 2024-04-01T06:57:37.776 INFO:tasks.workunit.client.0.smithi083.stdout:7/346: mknod d0/d10/d38/c71 0 2024-04-01T06:57:37.776 INFO:tasks.workunit.client.0.smithi083.stdout:7/347: chown d0/d10/d62/f6c 6158 1 2024-04-01T06:57:37.785 INFO:tasks.workunit.client.0.smithi083.stdout:4/360: dread d1/d4/d33/f43 [0,4194304] 0 2024-04-01T06:57:37.786 INFO:tasks.workunit.client.0.smithi083.stdout:4/361: mkdir d1/d4/d6f 0 2024-04-01T06:57:37.789 INFO:tasks.workunit.client.0.smithi083.stdout:4/362: dread d1/d4/db/f18 [0,4194304] 0 2024-04-01T06:57:37.789 INFO:tasks.workunit.client.0.smithi083.stdout:7/348: dread d0/d4/d9/d39/f70 [0,4194304] 0 2024-04-01T06:57:37.790 INFO:tasks.workunit.client.0.smithi083.stdout:4/363: creat d1/d47/f70 x:0 0 0 2024-04-01T06:57:37.792 INFO:tasks.workunit.client.0.smithi083.stdout:9/338: dwrite d6/f7 [4194304,4194304] 0 2024-04-01T06:57:37.792 INFO:tasks.workunit.client.0.smithi083.stdout:7/349: creat d0/d10/f72 x:0 0 0 2024-04-01T06:57:37.793 INFO:tasks.workunit.client.0.smithi083.stdout:4/364: mknod d1/d4/db/d5b/c71 0 2024-04-01T06:57:37.794 INFO:tasks.workunit.client.0.smithi083.stdout:9/339: mknod d6/d32/d4b/c72 0 2024-04-01T06:57:37.795 INFO:tasks.workunit.client.0.smithi083.stdout:7/350: symlink d0/d10/d62/l73 0 2024-04-01T06:57:37.796 INFO:tasks.workunit.client.0.smithi083.stdout:9/340: symlink d6/d32/d26/d2d/d34/l73 0 2024-04-01T06:57:37.797 INFO:tasks.workunit.client.0.smithi083.stdout:7/351: dread d0/d10/f35 [0,4194304] 0 2024-04-01T06:57:37.797 INFO:tasks.workunit.client.0.smithi083.stdout:7/352: fdatasync d0/d4/d9/d39/d67/d6d/f6b 0 2024-04-01T06:57:37.799 INFO:tasks.workunit.client.0.smithi083.stdout:9/341: rename d6/d32/c61 to d6/d32/d26/d71/c74 0 2024-04-01T06:57:37.799 INFO:tasks.workunit.client.0.smithi083.stdout:7/353: stat d0/d10/l1d 0 2024-04-01T06:57:37.800 INFO:tasks.workunit.client.0.smithi083.stdout:7/354: mknod d0/d4/d9/d4e/c74 0 2024-04-01T06:57:37.802 INFO:tasks.workunit.client.0.smithi083.stdout:4/365: dread d1/f2 [0,4194304] 0 2024-04-01T06:57:37.802 INFO:tasks.workunit.client.0.smithi083.stdout:4/366: write d1/d4/db/d5b/f5f [780382,23276] 0 2024-04-01T06:57:37.802 INFO:tasks.workunit.client.0.smithi083.stdout:4/367: getdents d1/d4/db/d5b/d62 0 2024-04-01T06:57:37.802 INFO:tasks.workunit.client.0.smithi083.stdout:4/368: dread - d1/d47/f70 zero size 2024-04-01T06:57:37.802 INFO:tasks.workunit.client.0.smithi083.stdout:4/369: dread - d1/d4/f6d zero size 2024-04-01T06:57:37.812 INFO:tasks.workunit.client.0.smithi083.stdout:9/342: dwrite d6/d32/d3c/d4c/f55 [0,4194304] 0 2024-04-01T06:57:37.813 INFO:tasks.workunit.client.0.smithi083.stdout:4/370: dwrite d1/d4/d33/f43 [0,4194304] 0 2024-04-01T06:57:37.815 INFO:tasks.workunit.client.0.smithi083.stdout:9/343: mknod d6/d32/d26/d2d/d6e/c75 0 2024-04-01T06:57:37.815 INFO:tasks.workunit.client.0.smithi083.stdout:9/344: chown d6/d32/d3c/d4c/d6b/f5d 64573941 1 2024-04-01T06:57:37.815 INFO:tasks.workunit.client.0.smithi083.stdout:9/345: write d6/d32/d3c/d4c/f50 [9092147,24697] 0 2024-04-01T06:57:37.818 INFO:tasks.workunit.client.0.smithi083.stdout:9/346: mkdir d6/d76 0 2024-04-01T06:57:37.822 INFO:tasks.workunit.client.0.smithi083.stdout:4/371: dwrite d1/d4/f4c [0,4194304] 0 2024-04-01T06:57:37.822 INFO:tasks.workunit.client.0.smithi083.stdout:9/347: dread d6/d32/f36 [0,4194304] 0 2024-04-01T06:57:37.824 INFO:tasks.workunit.client.0.smithi083.stdout:9/348: unlink d6/f53 0 2024-04-01T06:57:37.824 INFO:tasks.workunit.client.0.smithi083.stdout:9/349: chown d6/d32/f36 656 1 2024-04-01T06:57:37.826 INFO:tasks.workunit.client.0.smithi083.stdout:4/372: truncate d1/f2 6023192 0 2024-04-01T06:57:37.826 INFO:tasks.workunit.client.0.smithi083.stdout:4/373: stat d1/d47/c67 0 2024-04-01T06:57:37.826 INFO:tasks.workunit.client.0.smithi083.stdout:4/374: readlink d1/d4/l22 0 2024-04-01T06:57:37.826 INFO:tasks.workunit.client.0.smithi083.stdout:4/375: stat d1/d4/db/d5b/f5f 0 2024-04-01T06:57:37.827 INFO:tasks.workunit.client.0.smithi083.stdout:4/376: rename d1/d47/d2a/c35 to d1/d8/d6a/c72 0 2024-04-01T06:57:37.829 INFO:tasks.workunit.client.0.smithi083.stdout:4/377: rmdir d1/d4/d6f 0 2024-04-01T06:57:37.832 INFO:tasks.workunit.client.0.smithi083.stdout:4/378: mknod d1/d8/d42/c73 0 2024-04-01T06:57:37.833 INFO:tasks.workunit.client.0.smithi083.stdout:4/379: dread - d1/d4/d33/f49 zero size 2024-04-01T06:57:37.833 INFO:tasks.workunit.client.0.smithi083.stdout:4/380: chown d1/d4/db/l2b 32245 1 2024-04-01T06:57:37.833 INFO:tasks.workunit.client.0.smithi083.stdout:4/381: fdatasync d1/d4/d33/f50 0 2024-04-01T06:57:37.837 INFO:tasks.workunit.client.0.smithi083.stdout:9/350: dwrite d6/d32/f1a [4194304,4194304] 0 2024-04-01T06:57:37.838 INFO:tasks.workunit.client.0.smithi083.stdout:4/382: getdents d1/d8/d42 0 2024-04-01T06:57:37.838 INFO:tasks.workunit.client.0.smithi083.stdout:4/383: chown d1/d4/db/f20 105465 1 2024-04-01T06:57:37.841 INFO:tasks.workunit.client.0.smithi083.stdout:9/351: rename d6/d32/d26/d71 to d6/d32/d3c/d4c/d6b/d77 0 2024-04-01T06:57:37.842 INFO:tasks.workunit.client.0.smithi083.stdout:4/384: rename d1/d4/db/l3d to d1/d4/d6e/l74 0 2024-04-01T06:57:37.843 INFO:tasks.workunit.client.0.smithi083.stdout:9/352: mknod d6/d32/d4d/c78 0 2024-04-01T06:57:37.843 INFO:tasks.workunit.client.0.smithi083.stdout:4/385: symlink d1/d4/db/d5b/l75 0 2024-04-01T06:57:37.844 INFO:tasks.workunit.client.0.smithi083.stdout:9/353: rmdir d6/d32/d4b/d6d 39 2024-04-01T06:57:37.845 INFO:tasks.workunit.client.0.smithi083.stdout:4/386: creat d1/d8/d6a/f76 x:0 0 0 2024-04-01T06:57:37.845 INFO:tasks.workunit.client.0.smithi083.stdout:4/387: fsync d1/d8/d42/f61 0 2024-04-01T06:57:37.845 INFO:tasks.workunit.client.0.smithi083.stdout:4/388: write d1/d4/da/f53 [412857,56648] 0 2024-04-01T06:57:37.845 INFO:tasks.workunit.client.0.smithi083.stdout:9/354: truncate d6/d32/d3c/f66 3803005 0 2024-04-01T06:57:37.848 INFO:tasks.workunit.client.0.smithi083.stdout:8/422: sync 2024-04-01T06:57:37.848 INFO:tasks.workunit.client.0.smithi083.stdout:2/425: sync 2024-04-01T06:57:37.848 INFO:tasks.workunit.client.0.smithi083.stdout:6/328: sync 2024-04-01T06:57:37.848 INFO:tasks.workunit.client.0.smithi083.stdout:6/329: write d9/dc/d1b/f43 [728173,43002] 0 2024-04-01T06:57:37.848 INFO:tasks.workunit.client.0.smithi083.stdout:6/330: write d9/dc/d1b/d39/f62 [975279,47495] 0 2024-04-01T06:57:37.851 INFO:tasks.workunit.client.0.smithi083.stdout:2/426: getdents d3/d8b/d53 0 2024-04-01T06:57:37.851 INFO:tasks.workunit.client.0.smithi083.stdout:2/427: chown d3/d26/l3d 14 1 2024-04-01T06:57:37.851 INFO:tasks.workunit.client.0.smithi083.stdout:4/389: dread d1/d4/db/d5b/f69 [0,4194304] 0 2024-04-01T06:57:37.852 INFO:tasks.workunit.client.0.smithi083.stdout:8/423: getdents d15/d18 0 2024-04-01T06:57:37.853 INFO:tasks.workunit.client.0.smithi083.stdout:9/355: rmdir d6/d32 39 2024-04-01T06:57:37.855 INFO:tasks.workunit.client.0.smithi083.stdout:6/331: link d9/dc/d1b/f4d d9/dc/d1b/d4c/f67 0 2024-04-01T06:57:37.857 INFO:tasks.workunit.client.0.smithi083.stdout:2/428: mknod d3/d8b/d53/d5e/c91 0 2024-04-01T06:57:37.857 INFO:tasks.workunit.client.0.smithi083.stdout:9/356: symlink d6/d32/d3c/d4c/d6b/l79 0 2024-04-01T06:57:37.859 INFO:tasks.workunit.client.0.smithi083.stdout:6/332: mkdir d9/dc/d1b/d39/d68 0 2024-04-01T06:57:37.860 INFO:tasks.workunit.client.0.smithi083.stdout:2/429: creat d3/d4d/f92 x:0 0 0 2024-04-01T06:57:37.860 INFO:tasks.workunit.client.0.smithi083.stdout:9/357: mknod d6/d32/d3c/d4c/c7a 0 2024-04-01T06:57:37.861 INFO:tasks.workunit.client.0.smithi083.stdout:6/333: creat d9/dc/d1b/d39/d47/f69 x:0 0 0 2024-04-01T06:57:37.862 INFO:tasks.workunit.client.0.smithi083.stdout:4/390: dwrite d1/d4/db/d5b/f5f [0,4194304] 0 2024-04-01T06:57:37.862 INFO:tasks.workunit.client.0.smithi083.stdout:2/430: creat d3/d71/d81/f93 x:0 0 0 2024-04-01T06:57:37.862 INFO:tasks.workunit.client.0.smithi083.stdout:8/424: dread d15/d18/d19/d1d/f2d [4194304,4194304] 0 2024-04-01T06:57:37.863 INFO:tasks.workunit.client.0.smithi083.stdout:6/334: link d9/dc/d1b/d35/l4a d9/dc/d1b/d39/l6a 0 2024-04-01T06:57:37.865 INFO:tasks.workunit.client.0.smithi083.stdout:4/391: mknod d1/d4/db/d5b/c77 0 2024-04-01T06:57:37.865 INFO:tasks.workunit.client.0.smithi083.stdout:4/392: chown d1/d8/d42/c6c 401 1 2024-04-01T06:57:37.865 INFO:tasks.workunit.client.0.smithi083.stdout:4/393: chown d1/d8/d42 303 1 2024-04-01T06:57:37.865 INFO:tasks.workunit.client.0.smithi083.stdout:4/394: chown d1/d47/d2a/f2f 3214870 1 2024-04-01T06:57:37.865 INFO:tasks.workunit.client.0.smithi083.stdout:4/395: truncate d1/d47/d2a/f52 932907 0 2024-04-01T06:57:37.865 INFO:tasks.workunit.client.0.smithi083.stdout:2/431: creat d3/d71/d90/f94 x:0 0 0 2024-04-01T06:57:37.866 INFO:tasks.workunit.client.0.smithi083.stdout:2/432: write d3/f72 [766714,14946] 0 2024-04-01T06:57:37.866 INFO:tasks.workunit.client.0.smithi083.stdout:2/433: write d3/fc [7463352,48215] 0 2024-04-01T06:57:37.867 INFO:tasks.workunit.client.0.smithi083.stdout:8/425: link d15/d21/l52 d15/d18/d19/d6c/l9c 0 2024-04-01T06:57:37.867 INFO:tasks.workunit.client.0.smithi083.stdout:8/426: truncate d15/d18/d19/d24/d38/d62/f2e 152963 0 2024-04-01T06:57:37.867 INFO:tasks.workunit.client.0.smithi083.stdout:8/427: chown d15/d1b/d39/d48/d5e/d6b/d6f 14682 1 2024-04-01T06:57:37.868 INFO:tasks.workunit.client.0.smithi083.stdout:6/335: link d9/f21 d9/dc/d29/f6b 0 2024-04-01T06:57:37.868 INFO:tasks.workunit.client.0.smithi083.stdout:6/336: readlink l3 0 2024-04-01T06:57:37.870 INFO:tasks.workunit.client.0.smithi083.stdout:4/396: creat d1/d4/d6e/f78 x:0 0 0 2024-04-01T06:57:37.870 INFO:tasks.workunit.client.0.smithi083.stdout:4/397: dread - d1/d4/d6e/f78 zero size 2024-04-01T06:57:37.871 INFO:tasks.workunit.client.0.smithi083.stdout:2/434: rename d3/c83 to d3/d20/d42/c95 0 2024-04-01T06:57:37.872 INFO:tasks.workunit.client.0.smithi083.stdout:6/337: mknod d9/d57/c6c 0 2024-04-01T06:57:37.873 INFO:tasks.workunit.client.0.smithi083.stdout:6/338: write f8 [2178984,52383] 0 2024-04-01T06:57:37.874 INFO:tasks.workunit.client.0.smithi083.stdout:9/358: dwrite d6/d32/d26/d2d/f54 [0,4194304] 0 2024-04-01T06:57:37.874 INFO:tasks.workunit.client.0.smithi083.stdout:9/359: truncate d6/d32/d26/d2d/f62 510992 0 2024-04-01T06:57:37.874 INFO:tasks.workunit.client.0.smithi083.stdout:4/398: mkdir d1/d8/d42/d79 0 2024-04-01T06:57:37.875 INFO:tasks.workunit.client.0.smithi083.stdout:2/435: creat d3/d26/d59/d27/f96 x:0 0 0 2024-04-01T06:57:37.875 INFO:tasks.workunit.client.0.smithi083.stdout:2/436: chown d3/d4d/f4f 6197 1 2024-04-01T06:57:37.876 INFO:tasks.workunit.client.0.smithi083.stdout:6/339: mknod d9/dc/d29/d3c/d45/c6d 0 2024-04-01T06:57:37.877 INFO:tasks.workunit.client.0.smithi083.stdout:8/428: dread d15/d1b/f84 [4194304,4194304] 0 2024-04-01T06:57:37.884 INFO:tasks.workunit.client.0.smithi083.stdout:8/429: rename d15/d21/f2c to d15/d18/d1e/f9d 0 2024-04-01T06:57:37.884 INFO:tasks.workunit.client.0.smithi083.stdout:2/437: dread d3/d26/d59/d2b/f54 [0,4194304] 0 2024-04-01T06:57:37.884 INFO:tasks.workunit.client.0.smithi083.stdout:2/438: dread - d3/d26/f3a zero size 2024-04-01T06:57:37.884 INFO:tasks.workunit.client.0.smithi083.stdout:2/439: readlink d3/d26/d59/l22 0 2024-04-01T06:57:37.886 INFO:tasks.workunit.client.0.smithi083.stdout:8/430: mknod d15/d1b/d39/c9e 0 2024-04-01T06:57:37.886 INFO:tasks.workunit.client.0.smithi083.stdout:8/431: stat d15/d18/c5f 0 2024-04-01T06:57:37.886 INFO:tasks.workunit.client.0.smithi083.stdout:8/432: chown d15/d18/d19/d1d/f54 1 1 2024-04-01T06:57:37.886 INFO:tasks.workunit.client.0.smithi083.stdout:9/360: dread d6/f7 [0,4194304] 0 2024-04-01T06:57:37.886 INFO:tasks.workunit.client.0.smithi083.stdout:9/361: write d6/d32/d3c/f6a [649028,10206] 0 2024-04-01T06:57:37.887 INFO:tasks.workunit.client.0.smithi083.stdout:2/440: unlink d3/ca 0 2024-04-01T06:57:37.890 INFO:tasks.workunit.client.0.smithi083.stdout:6/340: dwrite f6 [0,4194304] 0 2024-04-01T06:57:37.891 INFO:tasks.workunit.client.0.smithi083.stdout:9/362: creat d6/d32/d3c/d4c/f7b x:0 0 0 2024-04-01T06:57:37.893 INFO:tasks.workunit.client.0.smithi083.stdout:6/341: rename d9/dc/d1b/d39/f62 to d9/d57/f6e 0 2024-04-01T06:57:37.893 INFO:tasks.workunit.client.0.smithi083.stdout:6/342: chown d9/dc/d1b/f3d 106969 1 2024-04-01T06:57:37.893 INFO:tasks.workunit.client.0.smithi083.stdout:6/343: truncate d9/d57/f5e 192928 0 2024-04-01T06:57:37.893 INFO:tasks.workunit.client.0.smithi083.stdout:9/363: dread d6/f14 [4194304,4194304] 0 2024-04-01T06:57:37.894 INFO:tasks.workunit.client.0.smithi083.stdout:9/364: write d6/d32/d3c/f57 [1237094,118639] 0 2024-04-01T06:57:37.894 INFO:tasks.workunit.client.0.smithi083.stdout:4/399: dwrite d1/f2 [4194304,4194304] 0 2024-04-01T06:57:37.895 INFO:tasks.workunit.client.0.smithi083.stdout:4/400: readlink d1/d4/db/l2b 0 2024-04-01T06:57:37.896 INFO:tasks.workunit.client.0.smithi083.stdout:6/344: creat d9/dc/d1b/d35/d48/d52/f6f x:0 0 0 2024-04-01T06:57:37.900 INFO:tasks.workunit.client.0.smithi083.stdout:9/365: mknod d6/d32/d26/d2d/d6e/c7c 0 2024-04-01T06:57:37.900 INFO:tasks.workunit.client.0.smithi083.stdout:9/366: fsync d6/d32/f1a 0 2024-04-01T06:57:37.900 INFO:tasks.workunit.client.0.smithi083.stdout:9/367: readlink d6/d29/l33 0 2024-04-01T06:57:37.901 INFO:tasks.workunit.client.0.smithi083.stdout:6/345: creat d9/dc/d1b/d39/d47/f70 x:0 0 0 2024-04-01T06:57:37.902 INFO:tasks.workunit.client.0.smithi083.stdout:8/433: dwrite f14 [0,4194304] 0 2024-04-01T06:57:37.902 INFO:tasks.workunit.client.0.smithi083.stdout:8/434: read d15/d1b/d39/d48/d5e/f73 [2846201,34342] 0 2024-04-01T06:57:37.903 INFO:tasks.workunit.client.0.smithi083.stdout:8/435: truncate d15/d21/f51 5012864 0 2024-04-01T06:57:37.903 INFO:tasks.workunit.client.0.smithi083.stdout:6/346: creat d9/d57/d5f/f71 x:0 0 0 2024-04-01T06:57:37.903 INFO:tasks.workunit.client.0.smithi083.stdout:6/347: chown d9/dc/d29 2338 1 2024-04-01T06:57:37.910 INFO:tasks.workunit.client.0.smithi083.stdout:8/436: symlink d15/l9f 0 2024-04-01T06:57:37.910 INFO:tasks.workunit.client.0.smithi083.stdout:2/441: dwrite d3/d26/f3a [0,4194304] 0 2024-04-01T06:57:37.911 INFO:tasks.workunit.client.0.smithi083.stdout:3/485: sync 2024-04-01T06:57:37.911 INFO:tasks.workunit.client.0.smithi083.stdout:5/333: sync 2024-04-01T06:57:37.911 INFO:tasks.workunit.client.0.smithi083.stdout:1/507: sync 2024-04-01T06:57:37.911 INFO:tasks.workunit.client.0.smithi083.stdout:0/459: sync 2024-04-01T06:57:37.911 INFO:tasks.workunit.client.0.smithi083.stdout:0/460: read - d16/d3a/d4b/f94 zero size 2024-04-01T06:57:37.911 INFO:tasks.workunit.client.0.smithi083.stdout:9/368: dread d6/d32/d3c/f6f [0,4194304] 0 2024-04-01T06:57:37.911 INFO:tasks.workunit.client.0.smithi083.stdout:6/348: rename d9/c2c to d9/dc/c72 0 2024-04-01T06:57:37.912 INFO:tasks.workunit.client.0.smithi083.stdout:1/508: dread db/d1c/f35 [0,4194304] 0 2024-04-01T06:57:37.912 INFO:tasks.workunit.client.0.smithi083.stdout:1/509: dread - db/d1c/d29/d33/d50/faa zero size 2024-04-01T06:57:37.912 INFO:tasks.workunit.client.0.smithi083.stdout:1/510: fdatasync db/d1c/d29/d33/d50/d5d/d6c/f7c 0 2024-04-01T06:57:37.912 INFO:tasks.workunit.client.0.smithi083.stdout:1/511: chown db/d1c/cb2 19837 1 2024-04-01T06:57:37.913 INFO:tasks.workunit.client.0.smithi083.stdout:1/512: readlink db/d1c/l57 0 2024-04-01T06:57:37.913 INFO:tasks.workunit.client.0.smithi083.stdout:6/349: dread d9/dc/d1b/f4d [0,4194304] 0 2024-04-01T06:57:37.913 INFO:tasks.workunit.client.0.smithi083.stdout:6/350: chown d9/dc/d1b/d4c 2 1 2024-04-01T06:57:37.915 INFO:tasks.workunit.client.0.smithi083.stdout:8/437: creat d15/d1b/d39/d48/d5e/d6b/d6f/fa0 x:0 0 0 2024-04-01T06:57:37.921 INFO:tasks.workunit.client.0.smithi083.stdout:3/486: unlink d6/d15/d2d/d2f/d42/d46/d55/ca5 0 2024-04-01T06:57:37.923 INFO:tasks.workunit.client.0.smithi083.stdout:9/369: link d6/d32/d26/d2d/d6e/c7c d6/d32/c7d 0 2024-04-01T06:57:37.923 INFO:tasks.workunit.client.0.smithi083.stdout:9/370: fdatasync d6/d32/d26/d2d/f18 0 2024-04-01T06:57:37.924 INFO:tasks.workunit.client.0.smithi083.stdout:5/334: rmdir d4/d9/d16 39 2024-04-01T06:57:37.924 INFO:tasks.workunit.client.0.smithi083.stdout:5/335: fsync d4/f4a 0 2024-04-01T06:57:37.924 INFO:tasks.workunit.client.0.smithi083.stdout:9/371: write d6/d32/d3c/d4c/f50 [3441522,68417] 0 2024-04-01T06:57:37.925 INFO:tasks.workunit.client.0.smithi083.stdout:2/442: rename d3/d26/d59/d2b/f4a to d3/d8b/d53/f97 0 2024-04-01T06:57:37.926 INFO:tasks.workunit.client.0.smithi083.stdout:1/513: unlink db/f39 0 2024-04-01T06:57:37.928 INFO:tasks.workunit.client.0.smithi083.stdout:6/351: unlink d9/dc/d1b/d39/d47/f49 0 2024-04-01T06:57:37.929 INFO:tasks.workunit.client.0.smithi083.stdout:8/438: creat d15/d18/d19/d6c/fa1 x:0 0 0 2024-04-01T06:57:37.930 INFO:tasks.workunit.client.0.smithi083.stdout:7/355: sync 2024-04-01T06:57:37.930 INFO:tasks.workunit.client.0.smithi083.stdout:0/461: dwrite d16/d2e/d3d/f4d [0,4194304] 0 2024-04-01T06:57:37.930 INFO:tasks.workunit.client.0.smithi083.stdout:0/462: readlink lb 0 2024-04-01T06:57:37.931 INFO:tasks.workunit.client.0.smithi083.stdout:2/443: symlink d3/d8b/d53/d68/l98 0 2024-04-01T06:57:37.931 INFO:tasks.workunit.client.0.smithi083.stdout:2/444: getdents d3/d26/d59/d27/d79 0 2024-04-01T06:57:37.932 INFO:tasks.workunit.client.0.smithi083.stdout:1/514: creat db/d1c/d29/d33/d50/d4d/fb7 x:0 0 0 2024-04-01T06:57:37.932 INFO:tasks.workunit.client.0.smithi083.stdout:1/515: fdatasync db/d1c/d29/d33/d50/d5d/d81/f92 0 2024-04-01T06:57:37.932 INFO:tasks.workunit.client.0.smithi083.stdout:6/352: getdents d9/dc/d1b/d35 0 2024-04-01T06:57:37.933 INFO:tasks.workunit.client.0.smithi083.stdout:6/353: dread - d9/dc/d1b/d39/d47/f70 zero size 2024-04-01T06:57:37.933 INFO:tasks.workunit.client.0.smithi083.stdout:6/354: fdatasync d9/dc/f14 0 2024-04-01T06:57:37.935 INFO:tasks.workunit.client.0.smithi083.stdout:6/355: dread d9/dc/f2e [0,4194304] 0 2024-04-01T06:57:37.937 INFO:tasks.workunit.client.0.smithi083.stdout:7/356: mknod d0/d4/c75 0 2024-04-01T06:57:37.937 INFO:tasks.workunit.client.0.smithi083.stdout:8/439: rename d15/d1b/d39/d48/d5e/d6b to d15/d18/d19/d24/da2 0 2024-04-01T06:57:37.937 INFO:tasks.workunit.client.0.smithi083.stdout:8/440: truncate d15/d1b/f29 1706181 0 2024-04-01T06:57:37.937 INFO:tasks.workunit.client.0.smithi083.stdout:2/445: truncate d3/f19 4023047 0 2024-04-01T06:57:37.938 INFO:tasks.workunit.client.0.smithi083.stdout:8/441: write d15/d18/d19/d1d/f2d [3947653,92906] 0 2024-04-01T06:57:37.939 INFO:tasks.workunit.client.0.smithi083.stdout:1/516: creat db/d1c/d2e/d30/fb8 x:0 0 0 2024-04-01T06:57:37.940 INFO:tasks.workunit.client.0.smithi083.stdout:6/356: mkdir d9/dc/d1b/d73 0 2024-04-01T06:57:37.945 INFO:tasks.workunit.client.0.smithi083.stdout:9/372: dwrite d6/f14 [0,4194304] 0 2024-04-01T06:57:37.945 INFO:tasks.workunit.client.0.smithi083.stdout:7/357: symlink d0/d4/d9/d4e/l76 0 2024-04-01T06:57:37.945 INFO:tasks.workunit.client.0.smithi083.stdout:2/446: mknod d3/d20/d42/c99 0 2024-04-01T06:57:37.945 INFO:tasks.workunit.client.0.smithi083.stdout:2/447: chown d3/d4d/f4f 66229 1 2024-04-01T06:57:37.945 INFO:tasks.workunit.client.0.smithi083.stdout:1/517: mkdir db/d1c/d29/d33/d50/d5d/d81/d94/db9 0 2024-04-01T06:57:37.945 INFO:tasks.workunit.client.0.smithi083.stdout:1/518: fsync db/d1c/d29/d33/d50/d4d/f90 0 2024-04-01T06:57:37.946 INFO:tasks.workunit.client.0.smithi083.stdout:6/357: link d9/dc/d1b/d35/f51 d9/dc/d1b/d4c/f74 0 2024-04-01T06:57:37.946 INFO:tasks.workunit.client.0.smithi083.stdout:6/358: fdatasync d9/dc/d1b/d39/d47/f70 0 2024-04-01T06:57:37.947 INFO:tasks.workunit.client.0.smithi083.stdout:9/373: mknod d6/c7e 0 2024-04-01T06:57:37.948 INFO:tasks.workunit.client.0.smithi083.stdout:5/336: dwrite d4/d9/d16/d1f/f48 [0,4194304] 0 2024-04-01T06:57:37.948 INFO:tasks.workunit.client.0.smithi083.stdout:2/448: creat d3/d8b/d53/d5e/f9a x:0 0 0 2024-04-01T06:57:37.948 INFO:tasks.workunit.client.0.smithi083.stdout:5/337: write d4/fa [8365514,85211] 0 2024-04-01T06:57:37.949 INFO:tasks.workunit.client.0.smithi083.stdout:1/519: creat db/d1c/d29/d33/d50/fba x:0 0 0 2024-04-01T06:57:37.949 INFO:tasks.workunit.client.0.smithi083.stdout:1/520: write db/d1c/d29/d33/d50/d5d/d6c/f87 [673869,99351] 0 2024-04-01T06:57:37.951 INFO:tasks.workunit.client.0.smithi083.stdout:6/359: creat d9/dc/d1b/d39/d68/f75 x:0 0 0 2024-04-01T06:57:37.953 INFO:tasks.workunit.client.0.smithi083.stdout:9/374: mkdir d6/d7f 0 2024-04-01T06:57:37.953 INFO:tasks.workunit.client.0.smithi083.stdout:0/463: dwrite f10 [4194304,4194304] 0 2024-04-01T06:57:37.953 INFO:tasks.workunit.client.0.smithi083.stdout:0/464: truncate d16/d2e/f41 168566 0 2024-04-01T06:57:37.955 INFO:tasks.workunit.client.0.smithi083.stdout:8/442: dwrite d15/d18/d1e/f49 [0,4194304] 0 2024-04-01T06:57:37.957 INFO:tasks.workunit.client.0.smithi083.stdout:1/521: mknod db/d1c/d1d/d8b/cbb 0 2024-04-01T06:57:37.957 INFO:tasks.workunit.client.0.smithi083.stdout:6/360: getdents d9 0 2024-04-01T06:57:37.959 INFO:tasks.workunit.client.0.smithi083.stdout:0/465: truncate d16/d1d/f49 3795634 0 2024-04-01T06:57:37.962 INFO:tasks.workunit.client.0.smithi083.stdout:8/443: mknod d15/d18/d19/d24/da2/d9a/ca3 0 2024-04-01T06:57:37.962 INFO:tasks.workunit.client.0.smithi083.stdout:8/444: stat d15/d1b/d39/d48/l5a 0 2024-04-01T06:57:37.962 INFO:tasks.workunit.client.0.smithi083.stdout:8/445: truncate d15/d18/d19/d24/d44/f88 4780872 0 2024-04-01T06:57:37.964 INFO:tasks.workunit.client.0.smithi083.stdout:8/446: write d15/d1b/d39/d48/d5e/f66 [3740075,85669] 0 2024-04-01T06:57:37.966 INFO:tasks.workunit.client.0.smithi083.stdout:1/522: mknod db/d1c/d1d/db4/cbc 0 2024-04-01T06:57:37.966 INFO:tasks.workunit.client.0.smithi083.stdout:1/523: readlink db/d1c/d49/l5b 0 2024-04-01T06:57:37.967 INFO:tasks.workunit.client.0.smithi083.stdout:2/449: dread d3/d4d/f4f [0,4194304] 0 2024-04-01T06:57:37.967 INFO:tasks.workunit.client.0.smithi083.stdout:6/361: creat d9/d57/d5f/f76 x:0 0 0 2024-04-01T06:57:37.967 INFO:tasks.workunit.client.0.smithi083.stdout:6/362: getdents d9/dc/d1b/d35 0 2024-04-01T06:57:37.970 INFO:tasks.workunit.client.0.smithi083.stdout:8/447: rename d15/d1b/d39/d80/f87 to d15/d18/fa4 0 2024-04-01T06:57:37.970 INFO:tasks.workunit.client.0.smithi083.stdout:9/375: dwrite d6/d32/d26/d2d/f54 [4194304,4194304] 0 2024-04-01T06:57:37.971 INFO:tasks.workunit.client.0.smithi083.stdout:7/358: dwrite d0/d4/fc [4194304,4194304] 0 2024-04-01T06:57:37.972 INFO:tasks.workunit.client.0.smithi083.stdout:7/359: stat d0/f2b 0 2024-04-01T06:57:37.973 INFO:tasks.workunit.client.0.smithi083.stdout:5/338: dwrite d4/d9/d16/d1f/d2f/d53/f66 [0,4194304] 0 2024-04-01T06:57:37.974 INFO:tasks.workunit.client.0.smithi083.stdout:2/450: truncate d3/d8b/d53/f60 2657297 0 2024-04-01T06:57:37.975 INFO:tasks.workunit.client.0.smithi083.stdout:2/451: write d3/f7 [8953496,91792] 0 2024-04-01T06:57:37.975 INFO:tasks.workunit.client.0.smithi083.stdout:2/452: truncate d3/d8b/d53/f97 945186 0 2024-04-01T06:57:37.978 INFO:tasks.workunit.client.0.smithi083.stdout:1/524: rename db/f11 to db/d61/fbd 0 2024-04-01T06:57:37.980 INFO:tasks.workunit.client.0.smithi083.stdout:8/448: link d15/d1b/d39/c76 d15/d1b/d39/d48/d5e/d70/ca5 0 2024-04-01T06:57:37.980 INFO:tasks.workunit.client.0.smithi083.stdout:8/449: read - d15/d18/d19/d24/da2/d6f/fa0 zero size 2024-04-01T06:57:37.980 INFO:tasks.workunit.client.0.smithi083.stdout:8/450: write d15/d1b/d39/d48/d5e/d70/f77 [99758,25240] 0 2024-04-01T06:57:37.982 INFO:tasks.workunit.client.0.smithi083.stdout:6/363: dwrite d9/d57/f6e [0,4194304] 0 2024-04-01T06:57:37.982 INFO:tasks.workunit.client.0.smithi083.stdout:9/376: creat d6/d32/d26/d2d/d34/d6c/f80 x:0 0 0 2024-04-01T06:57:37.982 INFO:tasks.workunit.client.0.smithi083.stdout:7/360: symlink d0/d4b/l77 0 2024-04-01T06:57:37.983 INFO:tasks.workunit.client.0.smithi083.stdout:9/377: write d6/d32/d26/d2d/f1f [521493,127704] 0 2024-04-01T06:57:37.985 INFO:tasks.workunit.client.0.smithi083.stdout:7/361: dread d0/d4/ff [0,4194304] 0 2024-04-01T06:57:37.986 INFO:tasks.workunit.client.0.smithi083.stdout:5/339: dwrite d4/d9/d16/d1f/f69 [0,4194304] 0 2024-04-01T06:57:37.986 INFO:tasks.workunit.client.0.smithi083.stdout:5/340: fdatasync d4/d23/d4e/f57 0 2024-04-01T06:57:37.999 INFO:tasks.workunit.client.0.smithi083.stdout:2/453: dwrite d3/f7f [0,4194304] 0 2024-04-01T06:57:38.001 INFO:tasks.workunit.client.0.smithi083.stdout:6/364: link d9/c38 d9/dc/d29/c77 0 2024-04-01T06:57:38.003 INFO:tasks.workunit.client.0.smithi083.stdout:7/362: creat d0/d10/f78 x:0 0 0 2024-04-01T06:57:38.006 INFO:tasks.workunit.client.0.smithi083.stdout:8/451: dwrite d15/d1b/d39/d48/f58 [0,4194304] 0 2024-04-01T06:57:38.006 INFO:tasks.workunit.client.0.smithi083.stdout:5/341: link d4/d23/d4e/f57 d4/d2b/d21/f6e 0 2024-04-01T06:57:38.007 INFO:tasks.workunit.client.0.smithi083.stdout:1/525: mkdir db/d1c/d29/dbe 0 2024-04-01T06:57:38.007 INFO:tasks.workunit.client.0.smithi083.stdout:1/526: write db/d1c/d29/d33/d4b/f91 [661563,59945] 0 2024-04-01T06:57:38.007 INFO:tasks.workunit.client.0.smithi083.stdout:5/342: dread d4/d9/d16/d1f/d2f/f59 [0,4194304] 0 2024-04-01T06:57:38.008 INFO:tasks.workunit.client.0.smithi083.stdout:2/454: unlink d3/cd 0 2024-04-01T06:57:38.010 INFO:tasks.workunit.client.0.smithi083.stdout:6/365: creat d9/dc/d1b/d35/f78 x:0 0 0 2024-04-01T06:57:38.010 INFO:tasks.workunit.client.0.smithi083.stdout:6/366: stat d9/dc/d29/c2b 0 2024-04-01T06:57:38.013 INFO:tasks.workunit.client.0.smithi083.stdout:1/527: dread db/d1c/d1d/f20 [0,4194304] 0 2024-04-01T06:57:38.013 INFO:tasks.workunit.client.0.smithi083.stdout:9/378: dwrite d6/d32/d3c/d4c/f50 [8388608,4194304] 0 2024-04-01T06:57:38.016 INFO:tasks.workunit.client.0.smithi083.stdout:0/466: dwrite f14 [0,4194304] 0 2024-04-01T06:57:38.016 INFO:tasks.workunit.client.0.smithi083.stdout:0/467: readlink d16/d3a/l47 0 2024-04-01T06:57:38.017 INFO:tasks.workunit.client.0.smithi083.stdout:8/452: mkdir d15/d18/d19/d24/da2/da6 0 2024-04-01T06:57:38.017 INFO:tasks.workunit.client.0.smithi083.stdout:5/343: truncate d4/d9/d16/d19/f1e 5137761 0 2024-04-01T06:57:38.019 INFO:tasks.workunit.client.0.smithi083.stdout:8/453: write d15/d18/d1e/f9d [388235,33503] 0 2024-04-01T06:57:38.019 INFO:tasks.workunit.client.0.smithi083.stdout:8/454: write d15/d1b/d39/f61 [609843,20869] 0 2024-04-01T06:57:38.019 INFO:tasks.workunit.client.0.smithi083.stdout:2/455: getdents d3/d26/d59 0 2024-04-01T06:57:38.020 INFO:tasks.workunit.client.0.smithi083.stdout:6/367: symlink d9/dc/d1b/d4c/l79 0 2024-04-01T06:57:38.021 INFO:tasks.workunit.client.0.smithi083.stdout:7/363: symlink d0/d10/l79 0 2024-04-01T06:57:38.024 INFO:tasks.workunit.client.0.smithi083.stdout:1/528: rename db/d1c/d29/d33/d4b to db/d1c/d29/d33/d50/d5d/dad/dbf 0 2024-04-01T06:57:38.028 INFO:tasks.workunit.client.0.smithi083.stdout:9/379: dwrite d6/d32/d26/d2d/f54 [0,4194304] 0 2024-04-01T06:57:38.028 INFO:tasks.workunit.client.0.smithi083.stdout:2/456: rename d3/d8b/c55 to d3/d8b/c9b 0 2024-04-01T06:57:38.030 INFO:tasks.workunit.client.0.smithi083.stdout:6/368: link d9/dc/f23 d9/dc/d3b/f7a 0 2024-04-01T06:57:38.030 INFO:tasks.workunit.client.0.smithi083.stdout:6/369: write d9/d57/d5f/f71 [142596,79315] 0 2024-04-01T06:57:38.031 INFO:tasks.workunit.client.0.smithi083.stdout:4/401: sync 2024-04-01T06:57:38.034 INFO:tasks.workunit.client.0.smithi083.stdout:0/468: dwrite d16/d2e/d3d/f4e [0,4194304] 0 2024-04-01T06:57:38.036 INFO:tasks.workunit.client.0.smithi083.stdout:5/344: rmdir d4 39 2024-04-01T06:57:38.039 INFO:tasks.workunit.client.0.smithi083.stdout:1/529: getdents db/d1c/d29/d33/d50/d5d/dad/dbf 0 2024-04-01T06:57:38.039 INFO:tasks.workunit.client.0.smithi083.stdout:1/530: chown db/d1c/d1d/f4c 14846 1 2024-04-01T06:57:38.039 INFO:tasks.workunit.client.0.smithi083.stdout:1/531: chown db/d1c/d1d/d8b/f96 23 1 2024-04-01T06:57:38.043 INFO:tasks.workunit.client.0.smithi083.stdout:6/370: creat d9/dc/d1b/d35/f7b x:0 0 0 2024-04-01T06:57:38.043 INFO:tasks.workunit.client.0.smithi083.stdout:3/487: sync 2024-04-01T06:57:38.043 INFO:tasks.workunit.client.0.smithi083.stdout:8/455: dwrite d15/d18/d19/d24/d44/f88 [0,4194304] 0 2024-04-01T06:57:38.044 INFO:tasks.workunit.client.0.smithi083.stdout:8/456: read d15/d21/f22 [2529326,34982] 0 2024-04-01T06:57:38.045 INFO:tasks.workunit.client.0.smithi083.stdout:9/380: dwrite d6/d32/d26/d2d/d34/d6c/f80 [0,4194304] 0 2024-04-01T06:57:38.047 INFO:tasks.workunit.client.0.smithi083.stdout:4/402: dwrite d1/d4/da/f29 [0,4194304] 0 2024-04-01T06:57:38.048 INFO:tasks.workunit.client.0.smithi083.stdout:7/364: mkdir d0/d7a 0 2024-04-01T06:57:38.048 INFO:tasks.workunit.client.0.smithi083.stdout:7/365: chown d0/d4/d9 918 1 2024-04-01T06:57:38.049 INFO:tasks.workunit.client.0.smithi083.stdout:2/457: rmdir d3 39 2024-04-01T06:57:38.056 INFO:tasks.workunit.client.0.smithi083.stdout:3/488: truncate d6/d15/d2d/d2f/d42/d46/f69 1051751 0 2024-04-01T06:57:38.056 INFO:tasks.workunit.client.0.smithi083.stdout:5/345: creat d4/d9/d4f/f6f x:0 0 0 2024-04-01T06:57:38.056 INFO:tasks.workunit.client.0.smithi083.stdout:5/346: truncate d4/d9/d16/f4c 482015 0 2024-04-01T06:57:38.056 INFO:tasks.workunit.client.0.smithi083.stdout:8/457: rmdir d15/d18/d19/d24/d38 39 2024-04-01T06:57:38.056 INFO:tasks.workunit.client.0.smithi083.stdout:8/458: readlink d15/d21/l43 0 2024-04-01T06:57:38.056 INFO:tasks.workunit.client.0.smithi083.stdout:8/459: dread - d15/d1b/d39/d48/f68 zero size 2024-04-01T06:57:38.056 INFO:tasks.workunit.client.0.smithi083.stdout:9/381: creat d6/d32/d4b/f81 x:0 0 0 2024-04-01T06:57:38.056 INFO:tasks.workunit.client.0.smithi083.stdout:9/382: dread - d6/d32/d3c/d3d/f63 zero size 2024-04-01T06:57:38.056 INFO:tasks.workunit.client.0.smithi083.stdout:0/469: mknod d16/d3a/d4b/c98 0 2024-04-01T06:57:38.056 INFO:tasks.workunit.client.0.smithi083.stdout:1/532: dwrite db/d1c/d29/d33/d50/faa [0,4194304] 0 2024-04-01T06:57:38.056 INFO:tasks.workunit.client.0.smithi083.stdout:1/533: chown db/d1c/d29/d33/d50/c48 16 1 2024-04-01T06:57:38.057 INFO:tasks.workunit.client.0.smithi083.stdout:7/366: creat d0/d7a/f7b x:0 0 0 2024-04-01T06:57:38.057 INFO:tasks.workunit.client.0.smithi083.stdout:6/371: mknod d9/dc/d29/c7c 0 2024-04-01T06:57:38.057 INFO:tasks.workunit.client.0.smithi083.stdout:6/372: dread - d9/dc/d1b/d39/f60 zero size 2024-04-01T06:57:38.058 INFO:tasks.workunit.client.0.smithi083.stdout:9/383: dread d6/d32/d26/d2d/d34/f3b [0,4194304] 0 2024-04-01T06:57:38.058 INFO:tasks.workunit.client.0.smithi083.stdout:4/403: dwrite d1/d4/db/f3e [0,4194304] 0 2024-04-01T06:57:38.058 INFO:tasks.workunit.client.0.smithi083.stdout:2/458: symlink d3/d4d/d5d/l9c 0 2024-04-01T06:57:38.058 INFO:tasks.workunit.client.0.smithi083.stdout:2/459: readlink d3/d8b/d53/d68/l62 0 2024-04-01T06:57:38.058 INFO:tasks.workunit.client.0.smithi083.stdout:1/534: read db/d1c/d29/d33/d50/faa [3806935,101252] 0 2024-04-01T06:57:38.058 INFO:tasks.workunit.client.0.smithi083.stdout:3/489: rename d6/d1e/f89 to d6/d15/d2d/d2f/d42/d5c/fa8 0 2024-04-01T06:57:38.059 INFO:tasks.workunit.client.0.smithi083.stdout:5/347: creat d4/d9/d16/d1f/d2f/d53/f70 x:0 0 0 2024-04-01T06:57:38.063 INFO:tasks.workunit.client.0.smithi083.stdout:8/460: rmdir d15/d18/d19 39 2024-04-01T06:57:38.064 INFO:tasks.workunit.client.0.smithi083.stdout:3/490: dread d6/d15/f1a [0,4194304] 0 2024-04-01T06:57:38.064 INFO:tasks.workunit.client.0.smithi083.stdout:3/491: truncate d6/d15/d2d/d2f/d42/d46/d55/f79 930175 0 2024-04-01T06:57:38.065 INFO:tasks.workunit.client.0.smithi083.stdout:7/367: stat d0/d4/d9/d39/l44 0 2024-04-01T06:57:38.065 INFO:tasks.workunit.client.0.smithi083.stdout:7/368: stat d0/d4/d9/d39/d67/d6d/f5f 0 2024-04-01T06:57:38.068 INFO:tasks.workunit.client.0.smithi083.stdout:6/373: link d9/d57/d5f/f76 d9/f7d 0 2024-04-01T06:57:38.074 INFO:tasks.workunit.client.0.smithi083.stdout:1/535: dwrite db/d1c/d29/d33/d50/d5d/d6c/f74 [0,4194304] 0 2024-04-01T06:57:38.074 INFO:tasks.workunit.client.0.smithi083.stdout:1/536: dread - db/d1c/d2e/d30/fa6 zero size 2024-04-01T06:57:38.074 INFO:tasks.workunit.client.0.smithi083.stdout:9/384: unlink d6/d29/l69 0 2024-04-01T06:57:38.074 INFO:tasks.workunit.client.0.smithi083.stdout:8/461: dwrite d15/f7b [0,4194304] 0 2024-04-01T06:57:38.077 INFO:tasks.workunit.client.0.smithi083.stdout:4/404: link d1/l60 d1/d8/l7a 0 2024-04-01T06:57:38.077 INFO:tasks.workunit.client.0.smithi083.stdout:4/405: fdatasync d1/d4/db/f54 0 2024-04-01T06:57:38.077 INFO:tasks.workunit.client.0.smithi083.stdout:4/406: chown d1/d8/l48 235601 1 2024-04-01T06:57:38.077 INFO:tasks.workunit.client.0.smithi083.stdout:4/407: fsync d1/d47/d2a/f36 0 2024-04-01T06:57:38.077 INFO:tasks.workunit.client.0.smithi083.stdout:0/470: rename d16/d3a to d16/d99 0 2024-04-01T06:57:38.077 INFO:tasks.workunit.client.0.smithi083.stdout:0/471: write d16/d2e/d6c/f85 [913633,22346] 0 2024-04-01T06:57:38.077 INFO:tasks.workunit.client.0.smithi083.stdout:2/460: mkdir d3/d26/d59/d2b/d9d 0 2024-04-01T06:57:38.079 INFO:tasks.workunit.client.0.smithi083.stdout:3/492: rename d6/d15/d2d/d2f/d42/d46/l92 to d6/d15/la9 0 2024-04-01T06:57:38.080 INFO:tasks.workunit.client.0.smithi083.stdout:6/374: link d9/dc/d1b/f43 d9/dc/f7e 0 2024-04-01T06:57:38.081 INFO:tasks.workunit.client.0.smithi083.stdout:1/537: symlink db/d1c/d29/d33/d50/d5d/dad/lc0 0 2024-04-01T06:57:38.082 INFO:tasks.workunit.client.0.smithi083.stdout:8/462: creat d15/d1b/fa7 x:0 0 0 2024-04-01T06:57:38.082 INFO:tasks.workunit.client.0.smithi083.stdout:8/463: chown d15/d18/d19/d24/d38/d62/l7f 28 1 2024-04-01T06:57:38.083 INFO:tasks.workunit.client.0.smithi083.stdout:8/464: write d15/d18/d19/d24/f94 [1021880,63065] 0 2024-04-01T06:57:38.083 INFO:tasks.workunit.client.0.smithi083.stdout:4/408: creat d1/d4/f7b x:0 0 0 2024-04-01T06:57:38.084 INFO:tasks.workunit.client.0.smithi083.stdout:0/472: link d16/d2e/d5b/d74/l7f d16/d99/d4b/d6e/d96/l9a 0 2024-04-01T06:57:38.085 INFO:tasks.workunit.client.0.smithi083.stdout:5/348: mkdir d4/d71 0 2024-04-01T06:57:38.087 INFO:tasks.workunit.client.0.smithi083.stdout:9/385: rename d6/d32/d4d/f52 to d6/d32/d4b/d6d/f82 0 2024-04-01T06:57:38.087 INFO:tasks.workunit.client.0.smithi083.stdout:3/493: symlink d6/d15/d2d/laa 0 2024-04-01T06:57:38.087 INFO:tasks.workunit.client.0.smithi083.stdout:3/494: dread - d6/d1e/f90 zero size 2024-04-01T06:57:38.088 INFO:tasks.workunit.client.0.smithi083.stdout:7/369: mkdir d0/d7c 0 2024-04-01T06:57:38.088 INFO:tasks.workunit.client.0.smithi083.stdout:7/370: write d0/f4a [1326662,117786] 0 2024-04-01T06:57:38.089 INFO:tasks.workunit.client.0.smithi083.stdout:7/371: chown d0/d10/d34/c46 96538829 1 2024-04-01T06:57:38.089 INFO:tasks.workunit.client.0.smithi083.stdout:7/372: truncate d0/d10/f42 602190 0 2024-04-01T06:57:38.089 INFO:tasks.workunit.client.0.smithi083.stdout:6/375: mknod d9/dc/d1b/d39/d47/c7f 0 2024-04-01T06:57:38.089 INFO:tasks.workunit.client.0.smithi083.stdout:7/373: dread d0/d4/d9/d39/d67/d6d/f6b [0,4194304] 0 2024-04-01T06:57:38.089 INFO:tasks.workunit.client.0.smithi083.stdout:1/538: creat db/d1c/d2e/d30/fc1 x:0 0 0 2024-04-01T06:57:38.090 INFO:tasks.workunit.client.0.smithi083.stdout:2/461: dwrite d3/f72 [0,4194304] 0 2024-04-01T06:57:38.090 INFO:tasks.workunit.client.0.smithi083.stdout:3/495: dread d6/d1e/f43 [0,4194304] 0 2024-04-01T06:57:38.090 INFO:tasks.workunit.client.0.smithi083.stdout:2/462: write d3/d8b/d53/d5e/f7b [82562,93346] 0 2024-04-01T06:57:38.091 INFO:tasks.workunit.client.0.smithi083.stdout:8/465: mkdir d15/d18/d19/d24/da2/da6/da8 0 2024-04-01T06:57:38.091 INFO:tasks.workunit.client.0.smithi083.stdout:4/409: symlink d1/d4/d33/l7c 0 2024-04-01T06:57:38.091 INFO:tasks.workunit.client.0.smithi083.stdout:5/349: mknod d4/d23/c72 0 2024-04-01T06:57:38.092 INFO:tasks.workunit.client.0.smithi083.stdout:5/350: fdatasync d4/d9/d16/d1f/d2f/f46 0 2024-04-01T06:57:38.092 INFO:tasks.workunit.client.0.smithi083.stdout:7/374: write d0/d10/f27 [477088,59467] 0 2024-04-01T06:57:38.092 INFO:tasks.workunit.client.0.smithi083.stdout:0/473: dread d16/d1d/f2b [0,4194304] 0 2024-04-01T06:57:38.093 INFO:tasks.workunit.client.0.smithi083.stdout:9/386: truncate d6/d32/d3c/f57 1097528 0 2024-04-01T06:57:38.093 INFO:tasks.workunit.client.0.smithi083.stdout:9/387: write d6/d32/d26/d2d/f62 [1058815,26915] 0 2024-04-01T06:57:38.093 INFO:tasks.workunit.client.0.smithi083.stdout:1/539: rename db/d1c/d29/d33/d50/d5d/d81/d94/cb3 to db/d1c/d29/d33/d50/d5d/d6c/cc2 0 2024-04-01T06:57:38.093 INFO:tasks.workunit.client.0.smithi083.stdout:1/540: chown db/d1c/d29/d33/d47/c97 1139155 1 2024-04-01T06:57:38.094 INFO:tasks.workunit.client.0.smithi083.stdout:1/541: write db/d1c/d29/d33/d50/d4d/fa4 [431837,4744] 0 2024-04-01T06:57:38.094 INFO:tasks.workunit.client.0.smithi083.stdout:1/542: stat db/d1c/d29/d33/f59 0 2024-04-01T06:57:38.094 INFO:tasks.workunit.client.0.smithi083.stdout:0/474: write f12 [1363925,11711] 0 2024-04-01T06:57:38.095 INFO:tasks.workunit.client.0.smithi083.stdout:0/475: write d16/d1d/f37 [146258,2801] 0 2024-04-01T06:57:38.096 INFO:tasks.workunit.client.0.smithi083.stdout:6/376: dread d9/dc/d1b/d35/f64 [4194304,4194304] 0 2024-04-01T06:57:38.096 INFO:tasks.workunit.client.0.smithi083.stdout:6/377: write d9/dc/d1b/d39/d47/f69 [725891,19796] 0 2024-04-01T06:57:38.096 INFO:tasks.workunit.client.0.smithi083.stdout:6/378: chown d9/dc/d29/d3c/d5c 117207903 1 2024-04-01T06:57:38.096 INFO:tasks.workunit.client.0.smithi083.stdout:3/496: creat d6/d15/d2d/d2f/d53/fab x:0 0 0 2024-04-01T06:57:38.096 INFO:tasks.workunit.client.0.smithi083.stdout:3/497: write d6/d15/d2d/d2f/d42/d46/d55/d67/fa2 [627949,103418] 0 2024-04-01T06:57:38.097 INFO:tasks.workunit.client.0.smithi083.stdout:2/463: unlink d3/d20/d42/f88 0 2024-04-01T06:57:38.098 INFO:tasks.workunit.client.0.smithi083.stdout:8/466: mknod d15/d18/d19/d24/d38/ca9 0 2024-04-01T06:57:38.099 INFO:tasks.workunit.client.0.smithi083.stdout:2/464: dread d3/d20/f21 [0,4194304] 0 2024-04-01T06:57:38.099 INFO:tasks.workunit.client.0.smithi083.stdout:1/543: dread db/d1c/d29/d33/d50/f2c [0,4194304] 0 2024-04-01T06:57:38.099 INFO:tasks.workunit.client.0.smithi083.stdout:3/498: dread d6/d1e/f43 [0,4194304] 0 2024-04-01T06:57:38.101 INFO:tasks.workunit.client.0.smithi083.stdout:5/351: creat d4/d23/d49/f73 x:0 0 0 2024-04-01T06:57:38.102 INFO:tasks.workunit.client.0.smithi083.stdout:7/375: mkdir d0/d4/d9/d39/d67/d6d/d7d 0 2024-04-01T06:57:38.102 INFO:tasks.workunit.client.0.smithi083.stdout:7/376: chown d0/c31 59 1 2024-04-01T06:57:38.108 INFO:tasks.workunit.client.0.smithi083.stdout:4/410: dwrite d1/d4/db/f56 [0,4194304] 0 2024-04-01T06:57:38.109 INFO:tasks.workunit.client.0.smithi083.stdout:9/388: rename d6/d32/d26/d2d/d34/l44 to d6/d32/d3c/d4c/d6b/l83 0 2024-04-01T06:57:38.109 INFO:tasks.workunit.client.0.smithi083.stdout:9/389: stat d6/d32/d3c/d4c/f50 0 2024-04-01T06:57:38.110 INFO:tasks.workunit.client.0.smithi083.stdout:0/476: link c15 d16/d1d/c9b 0 2024-04-01T06:57:38.110 INFO:tasks.workunit.client.0.smithi083.stdout:0/477: stat d16/d1d/d8d 0 2024-04-01T06:57:38.112 INFO:tasks.workunit.client.0.smithi083.stdout:6/379: symlink d9/dc/d1b/d35/l80 0 2024-04-01T06:57:38.113 INFO:tasks.workunit.client.0.smithi083.stdout:8/467: truncate d15/d18/d1e/f49 3875839 0 2024-04-01T06:57:38.114 INFO:tasks.workunit.client.0.smithi083.stdout:2/465: mknod d3/d8b/d53/d66/c9e 0 2024-04-01T06:57:38.115 INFO:tasks.workunit.client.0.smithi083.stdout:8/468: dread d15/d18/d1e/f1f [0,4194304] 0 2024-04-01T06:57:38.115 INFO:tasks.workunit.client.0.smithi083.stdout:9/390: dread d6/d32/d26/d2d/d34/d6c/f80 [0,4194304] 0 2024-04-01T06:57:38.116 INFO:tasks.workunit.client.0.smithi083.stdout:3/499: creat d6/d15/d2d/d2f/d42/d5c/fac x:0 0 0 2024-04-01T06:57:38.116 INFO:tasks.workunit.client.0.smithi083.stdout:8/469: write d15/d1b/d39/d48/f56 [225548,88103] 0 2024-04-01T06:57:38.117 INFO:tasks.workunit.client.0.smithi083.stdout:5/352: mknod d4/d9/d16/d19/d5e/c74 0 2024-04-01T06:57:38.123 INFO:tasks.workunit.client.0.smithi083.stdout:4/411: truncate d1/f2 2214774 0 2024-04-01T06:57:38.125 INFO:tasks.workunit.client.0.smithi083.stdout:1/544: rename db/d1c/d29/d33/d50/d5d/c75 to db/d1c/d29/d33/d50/d5d/dad/cc3 0 2024-04-01T06:57:38.125 INFO:tasks.workunit.client.0.smithi083.stdout:1/545: chown db/d1c/ca5 680 1 2024-04-01T06:57:38.127 INFO:tasks.workunit.client.0.smithi083.stdout:0/478: dwrite f10 [0,4194304] 0 2024-04-01T06:57:38.136 INFO:tasks.workunit.client.0.smithi083.stdout:6/380: mknod d9/dc/d3b/c81 0 2024-04-01T06:57:38.138 INFO:tasks.workunit.client.0.smithi083.stdout:2/466: mkdir d3/d26/d59/d2b/d9f 0 2024-04-01T06:57:38.138 INFO:tasks.workunit.client.0.smithi083.stdout:2/467: fsync d3/d8b/f64 0 2024-04-01T06:57:38.139 INFO:tasks.workunit.client.0.smithi083.stdout:9/391: unlink d6/d32/d26/d2d/d34/d6c/f80 0 2024-04-01T06:57:38.141 INFO:tasks.workunit.client.0.smithi083.stdout:3/500: creat d6/d15/d2d/d2f/d42/d5c/d88/fad x:0 0 0 2024-04-01T06:57:38.141 INFO:tasks.workunit.client.0.smithi083.stdout:3/501: fdatasync d6/d15/d2d/d2f/d53/fab 0 2024-04-01T06:57:38.142 INFO:tasks.workunit.client.0.smithi083.stdout:1/546: dread db/d1c/d29/d33/d50/d4d/d73/f79 [0,4194304] 0 2024-04-01T06:57:38.142 INFO:tasks.workunit.client.0.smithi083.stdout:5/353: creat d4/d23/f75 x:0 0 0 2024-04-01T06:57:38.143 INFO:tasks.workunit.client.0.smithi083.stdout:4/412: mknod d1/c7d 0 2024-04-01T06:57:38.145 INFO:tasks.workunit.client.0.smithi083.stdout:8/470: rename d15/d1b/f29 to d15/faa 0 2024-04-01T06:57:38.146 INFO:tasks.workunit.client.0.smithi083.stdout:0/479: dwrite d16/d1d/f51 [8388608,4194304] 0 2024-04-01T06:57:38.146 INFO:tasks.workunit.client.0.smithi083.stdout:0/480: fsync d16/f29 0 2024-04-01T06:57:38.146 INFO:tasks.workunit.client.0.smithi083.stdout:0/481: truncate d16/d2e/d3d/f4e 4908404 0 2024-04-01T06:57:38.147 INFO:tasks.workunit.client.0.smithi083.stdout:6/381: mknod d9/d57/c82 0 2024-04-01T06:57:38.147 INFO:tasks.workunit.client.0.smithi083.stdout:9/392: mknod d6/d29/c84 0 2024-04-01T06:57:38.148 INFO:tasks.workunit.client.0.smithi083.stdout:3/502: creat d6/d15/d2d/d2f/d42/d9f/fae x:0 0 0 2024-04-01T06:57:38.149 INFO:tasks.workunit.client.0.smithi083.stdout:1/547: getdents db/d1c 0 2024-04-01T06:57:38.151 INFO:tasks.workunit.client.0.smithi083.stdout:4/413: unlink d1/d8/d42/f57 0 2024-04-01T06:57:38.151 INFO:tasks.workunit.client.0.smithi083.stdout:4/414: write d1/d8/d6a/f76 [979044,5022] 0 2024-04-01T06:57:38.152 INFO:tasks.workunit.client.0.smithi083.stdout:2/468: rename d3/d4d/c61 to d3/d26/d59/d2b/ca0 0 2024-04-01T06:57:38.155 INFO:tasks.workunit.client.0.smithi083.stdout:8/471: mkdir d15/d18/d19/d24/d44/d75/dab 0 2024-04-01T06:57:38.156 INFO:tasks.workunit.client.0.smithi083.stdout:6/382: creat d9/dc/f83 x:0 0 0 2024-04-01T06:57:38.156 INFO:tasks.workunit.client.0.smithi083.stdout:6/383: chown d9/dc/f40 3 1 2024-04-01T06:57:38.157 INFO:tasks.workunit.client.0.smithi083.stdout:9/393: getdents d6/d32 0 2024-04-01T06:57:38.159 INFO:tasks.workunit.client.0.smithi083.stdout:3/503: mkdir d6/d1e/d6f/daf 0 2024-04-01T06:57:38.159 INFO:tasks.workunit.client.0.smithi083.stdout:3/504: dread - d6/d15/d2d/f5b zero size 2024-04-01T06:57:38.160 INFO:tasks.workunit.client.0.smithi083.stdout:1/548: creat db/d1c/d29/d33/d50/d5d/d81/d94/fc4 x:0 0 0 2024-04-01T06:57:38.161 INFO:tasks.workunit.client.0.smithi083.stdout:4/415: dread d1/d4/db/d5b/f5f [0,4194304] 0 2024-04-01T06:57:38.161 INFO:tasks.workunit.client.0.smithi083.stdout:4/416: stat d1/d4/db/d5b 0 2024-04-01T06:57:38.161 INFO:tasks.workunit.client.0.smithi083.stdout:4/417: dread - d1/d4/f7b zero size 2024-04-01T06:57:38.161 INFO:tasks.workunit.client.0.smithi083.stdout:0/482: rename d16/l88 to d16/d1d/d8d/l9c 0 2024-04-01T06:57:38.161 INFO:tasks.workunit.client.0.smithi083.stdout:0/483: chown d16/d1d/c57 2463372 1 2024-04-01T06:57:38.162 INFO:tasks.workunit.client.0.smithi083.stdout:2/469: rmdir d3/d71/d90 39 2024-04-01T06:57:38.170 INFO:tasks.workunit.client.0.smithi083.stdout:2/470: dwrite d3/d4d/f52 [0,4194304] 0 2024-04-01T06:57:38.172 INFO:tasks.workunit.client.0.smithi083.stdout:8/472: creat d15/d18/d19/d24/d44/d75/dab/fac x:0 0 0 2024-04-01T06:57:38.173 INFO:tasks.workunit.client.0.smithi083.stdout:6/384: unlink d9/dc/d1b/f3d 0 2024-04-01T06:57:38.178 INFO:tasks.workunit.client.0.smithi083.stdout:9/394: symlink d6/l85 0 2024-04-01T06:57:38.178 INFO:tasks.workunit.client.0.smithi083.stdout:9/395: fsync d6/d32/d26/d2d/f30 0 2024-04-01T06:57:38.178 INFO:tasks.workunit.client.0.smithi083.stdout:3/505: creat d6/d15/d2d/d2f/d42/d83/fb0 x:0 0 0 2024-04-01T06:57:38.178 INFO:tasks.workunit.client.0.smithi083.stdout:3/506: chown d6/d15/f19 8513040 1 2024-04-01T06:57:38.178 INFO:tasks.workunit.client.0.smithi083.stdout:3/507: chown d6/d15/f1a 168741 1 2024-04-01T06:57:38.178 INFO:tasks.workunit.client.0.smithi083.stdout:1/549: mknod db/cc5 0 2024-04-01T06:57:38.179 INFO:tasks.workunit.client.0.smithi083.stdout:4/418: creat d1/d4/f7e x:0 0 0 2024-04-01T06:57:38.179 INFO:tasks.workunit.client.0.smithi083.stdout:0/484: mkdir d16/d99/d4b/d68/d9d 0 2024-04-01T06:57:38.180 INFO:tasks.workunit.client.0.smithi083.stdout:0/485: read d16/d2e/d3d/d5d/f67 [468409,118286] 0 2024-04-01T06:57:38.180 INFO:tasks.workunit.client.0.smithi083.stdout:0/486: readlink d16/d1d/l35 0 2024-04-01T06:57:38.180 INFO:tasks.workunit.client.0.smithi083.stdout:2/471: mknod d3/d8b/d53/d5e/ca1 0 2024-04-01T06:57:38.181 INFO:tasks.workunit.client.0.smithi083.stdout:2/472: write d3/d4d/d57/f6b [578661,110798] 0 2024-04-01T06:57:38.182 INFO:tasks.workunit.client.0.smithi083.stdout:6/385: creat d9/dc/d29/d3c/d5c/f84 x:0 0 0 2024-04-01T06:57:38.182 INFO:tasks.workunit.client.0.smithi083.stdout:6/386: chown d9/dc/d1b/d39/f60 2 1 2024-04-01T06:57:38.182 INFO:tasks.workunit.client.0.smithi083.stdout:6/387: stat d9/d57/c82 0 2024-04-01T06:57:38.183 INFO:tasks.workunit.client.0.smithi083.stdout:6/388: chown d9/dc/d1b/d35/c59 210 1 2024-04-01T06:57:38.183 INFO:tasks.workunit.client.0.smithi083.stdout:6/389: fdatasync d9/dc/d29/f5d 0 2024-04-01T06:57:38.183 INFO:tasks.workunit.client.0.smithi083.stdout:6/390: dread - d9/dc/d1b/f3f zero size 2024-04-01T06:57:38.183 INFO:tasks.workunit.client.0.smithi083.stdout:6/391: read d9/dc/f23 [4261462,22487] 0 2024-04-01T06:57:38.183 INFO:tasks.workunit.client.0.smithi083.stdout:2/473: read d3/d26/d59/d27/f3b [3017334,101258] 0 2024-04-01T06:57:38.183 INFO:tasks.workunit.client.0.smithi083.stdout:2/474: chown d3/d26/d59/d2b/f82 81302 1 2024-04-01T06:57:38.183 INFO:tasks.workunit.client.0.smithi083.stdout:2/475: readlink d3/d8b/l8f 0 2024-04-01T06:57:38.183 INFO:tasks.workunit.client.0.smithi083.stdout:2/476: chown d3/d26/f89 1363 1 2024-04-01T06:57:38.183 INFO:tasks.workunit.client.0.smithi083.stdout:2/477: fdatasync d3/f1c 0 2024-04-01T06:57:38.183 INFO:tasks.workunit.client.0.smithi083.stdout:9/396: link d6/d29/l33 d6/d32/d4b/d6d/l86 0 2024-04-01T06:57:38.184 INFO:tasks.workunit.client.0.smithi083.stdout:9/397: fsync d6/d32/d26/d2d/f18 0 2024-04-01T06:57:38.184 INFO:tasks.workunit.client.0.smithi083.stdout:9/398: write d6/d32/d26/d2d/f18 [865207,56041] 0 2024-04-01T06:57:38.184 INFO:tasks.workunit.client.0.smithi083.stdout:3/508: creat d6/d15/d2d/fb1 x:0 0 0 2024-04-01T06:57:38.186 INFO:tasks.workunit.client.0.smithi083.stdout:3/509: dread d6/d1e/f87 [0,4194304] 0 2024-04-01T06:57:38.186 INFO:tasks.workunit.client.0.smithi083.stdout:3/510: fdatasync d6/d15/d2d/d2f/d42/d5c/d88/fad 0 2024-04-01T06:57:38.186 INFO:tasks.workunit.client.0.smithi083.stdout:3/511: stat d6/d15/d2d/d2f/d42/d46/c4f 0 2024-04-01T06:57:38.187 INFO:tasks.workunit.client.0.smithi083.stdout:3/512: write d6/f21 [2020335,11803] 0 2024-04-01T06:57:38.187 INFO:tasks.workunit.client.0.smithi083.stdout:1/550: creat db/d1c/d29/d33/fc6 x:0 0 0 2024-04-01T06:57:38.188 INFO:tasks.workunit.client.0.smithi083.stdout:4/419: truncate d1/d4/f5c 34710 0 2024-04-01T06:57:38.190 INFO:tasks.workunit.client.0.smithi083.stdout:0/487: symlink d16/l9e 0 2024-04-01T06:57:38.192 INFO:tasks.workunit.client.0.smithi083.stdout:6/392: unlink d9/dc/d1b/d39/d47/f61 0 2024-04-01T06:57:38.192 INFO:tasks.workunit.client.0.smithi083.stdout:6/393: write d9/d57/d5f/f76 [482491,63816] 0 2024-04-01T06:57:38.193 INFO:tasks.workunit.client.0.smithi083.stdout:2/478: creat d3/d8b/d53/d5e/fa2 x:0 0 0 2024-04-01T06:57:38.194 INFO:tasks.workunit.client.0.smithi083.stdout:9/399: creat d6/f87 x:0 0 0 2024-04-01T06:57:38.194 INFO:tasks.workunit.client.0.smithi083.stdout:9/400: dread - d6/f87 zero size 2024-04-01T06:57:38.196 INFO:tasks.workunit.client.0.smithi083.stdout:3/513: getdents d6/d15/d2d/d2f/d42/d5c/d88 0 2024-04-01T06:57:38.196 INFO:tasks.workunit.client.0.smithi083.stdout:3/514: write d6/d15/d2d/d2f/d42/d46/f5e [1249824,74450] 0 2024-04-01T06:57:38.196 INFO:tasks.workunit.client.0.smithi083.stdout:3/515: read d6/fe [552126,129918] 0 2024-04-01T06:57:38.198 INFO:tasks.workunit.client.0.smithi083.stdout:0/488: creat d16/d99/d4b/d6e/f9f x:0 0 0 2024-04-01T06:57:38.201 INFO:tasks.workunit.client.0.smithi083.stdout:6/394: creat d9/dc/d1b/d35/f85 x:0 0 0 2024-04-01T06:57:38.203 INFO:tasks.workunit.client.0.smithi083.stdout:2/479: truncate d3/d20/f2a 448487 0 2024-04-01T06:57:38.204 INFO:tasks.workunit.client.0.smithi083.stdout:2/480: read d3/f7 [8108858,130680] 0 2024-04-01T06:57:38.206 INFO:tasks.workunit.client.0.smithi083.stdout:3/516: unlink d6/d15/d2d/d2f/d42/d5c/f68 0 2024-04-01T06:57:38.206 INFO:tasks.workunit.client.0.smithi083.stdout:3/517: getdents d6/d1e/d4a 0 2024-04-01T06:57:38.207 INFO:tasks.workunit.client.0.smithi083.stdout:0/489: creat d16/d2e/d3d/fa0 x:0 0 0 2024-04-01T06:57:38.209 INFO:tasks.workunit.client.0.smithi083.stdout:2/481: unlink d3/l4 0 2024-04-01T06:57:38.211 INFO:tasks.workunit.client.0.smithi083.stdout:3/518: creat d6/d15/d2d/d2f/d42/d46/d55/fb2 x:0 0 0 2024-04-01T06:57:38.213 INFO:tasks.workunit.client.0.smithi083.stdout:1/551: dwrite db/d1c/d29/d33/d50/d5d/dad/dbf/f51 [0,4194304] 0 2024-04-01T06:57:38.213 INFO:tasks.workunit.client.0.smithi083.stdout:1/552: readlink db/d1c/d1d/l7f 0 2024-04-01T06:57:38.215 INFO:tasks.workunit.client.0.smithi083.stdout:4/420: dwrite d1/d4/d6e/f78 [0,4194304] 0 2024-04-01T06:57:38.216 INFO:tasks.workunit.client.0.smithi083.stdout:6/395: rmdir d9/dc/d1b/d39/d47 39 2024-04-01T06:57:38.216 INFO:tasks.workunit.client.0.smithi083.stdout:0/490: creat d16/d99/d4b/d68/d9d/fa1 x:0 0 0 2024-04-01T06:57:38.216 INFO:tasks.workunit.client.0.smithi083.stdout:2/482: truncate d3/d26/d59/d2b/f32 2313186 0 2024-04-01T06:57:38.217 INFO:tasks.workunit.client.0.smithi083.stdout:2/483: chown d3/d8b/d53/f60 0 1 2024-04-01T06:57:38.218 INFO:tasks.workunit.client.0.smithi083.stdout:3/519: creat d6/d15/d2d/d2f/d42/d46/d55/d67/fb3 x:0 0 0 2024-04-01T06:57:38.218 INFO:tasks.workunit.client.0.smithi083.stdout:3/520: readlink d6/l98 0 2024-04-01T06:57:38.218 INFO:tasks.workunit.client.0.smithi083.stdout:0/491: dread d16/d2e/d6c/f70 [0,4194304] 0 2024-04-01T06:57:38.219 INFO:tasks.workunit.client.0.smithi083.stdout:9/401: dwrite d6/d32/f17 [0,4194304] 0 2024-04-01T06:57:38.220 INFO:tasks.workunit.client.0.smithi083.stdout:1/553: creat db/d1c/d2e/d30/fc7 x:0 0 0 2024-04-01T06:57:38.223 INFO:tasks.workunit.client.0.smithi083.stdout:4/421: readlink d1/d8/l65 0 2024-04-01T06:57:38.225 INFO:tasks.workunit.client.0.smithi083.stdout:6/396: symlink d9/dc/d1b/d39/l86 0 2024-04-01T06:57:38.227 INFO:tasks.workunit.client.0.smithi083.stdout:3/521: unlink d6/d15/d2d/d2f/fa3 0 2024-04-01T06:57:38.232 INFO:tasks.workunit.client.0.smithi083.stdout:9/402: mkdir d6/d32/d3c/d4c/d88 0 2024-04-01T06:57:38.233 INFO:tasks.workunit.client.0.smithi083.stdout:9/403: write d6/d32/d26/d2d/f30 [373511,65529] 0 2024-04-01T06:57:38.233 INFO:tasks.workunit.client.0.smithi083.stdout:9/404: truncate d6/d32/d26/d2d/f1f 4846277 0 2024-04-01T06:57:38.233 INFO:tasks.workunit.client.0.smithi083.stdout:0/492: dwrite d16/d2e/d3d/f4e [0,4194304] 0 2024-04-01T06:57:38.233 INFO:tasks.workunit.client.0.smithi083.stdout:0/493: write d16/d99/d4b/f5c [942766,1191] 0 2024-04-01T06:57:38.234 INFO:tasks.workunit.client.0.smithi083.stdout:1/554: rename db/f14 to db/d1c/d29/d33/d47/d76/fc8 0 2024-04-01T06:57:38.234 INFO:tasks.workunit.client.0.smithi083.stdout:4/422: chown d1/d8/d42/c73 6771 1 2024-04-01T06:57:38.234 INFO:tasks.workunit.client.0.smithi083.stdout:4/423: truncate d1/d4/d33/f49 856330 0 2024-04-01T06:57:38.236 INFO:tasks.workunit.client.0.smithi083.stdout:6/397: mknod d9/dc/d29/c87 0 2024-04-01T06:57:38.236 INFO:tasks.workunit.client.0.smithi083.stdout:6/398: dread - d9/dc/d1b/d39/d68/f75 zero size 2024-04-01T06:57:38.236 INFO:tasks.workunit.client.0.smithi083.stdout:6/399: write d9/f7d [1198404,37921] 0 2024-04-01T06:57:38.236 INFO:tasks.workunit.client.0.smithi083.stdout:6/400: readlink l3 0 2024-04-01T06:57:38.236 INFO:tasks.workunit.client.0.smithi083.stdout:3/522: creat d6/d15/d2d/fb4 x:0 0 0 2024-04-01T06:57:38.237 INFO:tasks.workunit.client.0.smithi083.stdout:9/405: creat d6/d32/d4b/d6d/f89 x:0 0 0 2024-04-01T06:57:38.239 INFO:tasks.workunit.client.0.smithi083.stdout:9/406: write d6/d32/d26/d2d/f18 [5503221,94920] 0 2024-04-01T06:57:38.239 INFO:tasks.workunit.client.0.smithi083.stdout:9/407: write d6/d32/d26/d2d/f62 [2128745,46447] 0 2024-04-01T06:57:38.239 INFO:tasks.workunit.client.0.smithi083.stdout:9/408: stat d6/f14 0 2024-04-01T06:57:38.239 INFO:tasks.workunit.client.0.smithi083.stdout:0/494: creat d16/d99/d4b/fa2 x:0 0 0 2024-04-01T06:57:38.241 INFO:tasks.workunit.client.0.smithi083.stdout:1/555: creat db/d1c/d29/fc9 x:0 0 0 2024-04-01T06:57:38.241 INFO:tasks.workunit.client.0.smithi083.stdout:1/556: stat db/d1c/ca5 0 2024-04-01T06:57:38.241 INFO:tasks.workunit.client.0.smithi083.stdout:1/557: readlink db/d1c/d29/d33/d50/d4d/l54 0 2024-04-01T06:57:38.246 INFO:tasks.workunit.client.0.smithi083.stdout:6/401: symlink d9/dc/d1b/d35/d48/d52/l88 0 2024-04-01T06:57:38.247 INFO:tasks.workunit.client.0.smithi083.stdout:3/523: getdents d6/d15/d2d/d2f/d42 0 2024-04-01T06:57:38.249 INFO:tasks.workunit.client.0.smithi083.stdout:0/495: dwrite d16/d2e/d5b/f6f [4194304,4194304] 0 2024-04-01T06:57:38.249 INFO:tasks.workunit.client.0.smithi083.stdout:9/409: creat d6/d32/d3c/d4c/d88/f8a x:0 0 0 2024-04-01T06:57:38.250 INFO:tasks.workunit.client.0.smithi083.stdout:9/410: write d6/f7 [2227894,29902] 0 2024-04-01T06:57:38.250 INFO:tasks.workunit.client.0.smithi083.stdout:4/424: creat d1/d8/d6a/f7f x:0 0 0 2024-04-01T06:57:38.250 INFO:tasks.workunit.client.0.smithi083.stdout:9/411: write d6/d32/f1a [5363092,13906] 0 2024-04-01T06:57:38.251 INFO:tasks.workunit.client.0.smithi083.stdout:1/558: link db/d1c/d29/d33/f59 db/d1c/d2e/d30/fca 0 2024-04-01T06:57:38.252 INFO:tasks.workunit.client.0.smithi083.stdout:6/402: creat d9/dc/d1b/d35/f89 x:0 0 0 2024-04-01T06:57:38.253 INFO:tasks.workunit.client.0.smithi083.stdout:3/524: mknod d6/d12/cb5 0 2024-04-01T06:57:38.255 INFO:tasks.workunit.client.0.smithi083.stdout:0/496: unlink d16/d1d/l5e 0 2024-04-01T06:57:38.256 INFO:tasks.workunit.client.0.smithi083.stdout:4/425: getdents d1/d4/d33 0 2024-04-01T06:57:38.256 INFO:tasks.workunit.client.0.smithi083.stdout:4/426: chown d1 70 1 2024-04-01T06:57:38.257 INFO:tasks.workunit.client.0.smithi083.stdout:4/427: dread d1/d4/d33/f49 [0,4194304] 0 2024-04-01T06:57:38.260 INFO:tasks.workunit.client.0.smithi083.stdout:0/497: mknod d16/d99/d4b/d95/ca3 0 2024-04-01T06:57:38.261 INFO:tasks.workunit.client.0.smithi083.stdout:1/559: dread db/d1c/d29/d33/d50/d5d/d6c/f7c [0,4194304] 0 2024-04-01T06:57:38.267 INFO:tasks.workunit.client.0.smithi083.stdout:4/428: creat d1/d47/d2a/f80 x:0 0 0 2024-04-01T06:57:38.268 INFO:tasks.workunit.client.0.smithi083.stdout:9/412: rmdir d6 39 2024-04-01T06:57:38.269 INFO:tasks.workunit.client.0.smithi083.stdout:6/403: dwrite d9/dc/d1b/f41 [0,4194304] 0 2024-04-01T06:57:38.269 INFO:tasks.workunit.client.0.smithi083.stdout:0/498: getdents d16/d99/d4b/d68 0 2024-04-01T06:57:38.269 INFO:tasks.workunit.client.0.smithi083.stdout:6/404: chown d9/dc/d1b/f3f 1221565114 1 2024-04-01T06:57:38.271 INFO:tasks.workunit.client.0.smithi083.stdout:4/429: creat d1/d4/d33/f81 x:0 0 0 2024-04-01T06:57:38.271 INFO:tasks.workunit.client.0.smithi083.stdout:3/525: dwrite d6/d15/f5a [0,4194304] 0 2024-04-01T06:57:38.271 INFO:tasks.workunit.client.0.smithi083.stdout:3/526: write d6/d15/d2d/d2f/d42/d46/f69 [1062572,79800] 0 2024-04-01T06:57:38.272 INFO:tasks.workunit.client.0.smithi083.stdout:0/499: link d16/d1d/d8d/l9c d16/la4 0 2024-04-01T06:57:38.272 INFO:tasks.workunit.client.0.smithi083.stdout:0/500: fdatasync f12 0 2024-04-01T06:57:38.273 INFO:tasks.workunit.client.0.smithi083.stdout:6/405: mkdir d9/d8a 0 2024-04-01T06:57:38.273 INFO:tasks.workunit.client.0.smithi083.stdout:6/406: chown d9/dc/d1b/d4c/f74 858801 1 2024-04-01T06:57:38.275 INFO:tasks.workunit.client.0.smithi083.stdout:1/560: dwrite db/d1c/d1d/f45 [0,4194304] 0 2024-04-01T06:57:38.275 INFO:tasks.workunit.client.0.smithi083.stdout:1/561: chown f3 68133 1 2024-04-01T06:57:38.277 INFO:tasks.workunit.client.0.smithi083.stdout:3/527: rename d6/d12/c52 to d6/d15/d2d/d2f/d42/cb6 0 2024-04-01T06:57:38.278 INFO:tasks.workunit.client.0.smithi083.stdout:9/413: dread d6/f7 [0,4194304] 0 2024-04-01T06:57:38.278 INFO:tasks.workunit.client.0.smithi083.stdout:9/414: truncate d6/d32/d26/d2d/f30 956707 0 2024-04-01T06:57:38.278 INFO:tasks.workunit.client.0.smithi083.stdout:9/415: fsync d6/d32/d26/d2d/f1f 0 2024-04-01T06:57:38.278 INFO:tasks.workunit.client.0.smithi083.stdout:9/416: chown d6/f87 541 1 2024-04-01T06:57:38.278 INFO:tasks.workunit.client.0.smithi083.stdout:9/417: write d6/d32/d26/d2d/d34/f3b [553579,34795] 0 2024-04-01T06:57:38.278 INFO:tasks.workunit.client.0.smithi083.stdout:0/501: mknod d16/ca5 0 2024-04-01T06:57:38.279 INFO:tasks.workunit.client.0.smithi083.stdout:3/528: dread f2 [0,4194304] 0 2024-04-01T06:57:38.286 INFO:tasks.workunit.client.0.smithi083.stdout:6/407: mkdir d9/dc/d29/d3c/d5c/d8b 0 2024-04-01T06:57:38.286 INFO:tasks.workunit.client.0.smithi083.stdout:6/408: truncate d9/dc/d1b/d35/f89 221439 0 2024-04-01T06:57:38.287 INFO:tasks.workunit.client.0.smithi083.stdout:1/562: creat db/d1c/d29/d33/d50/d4d/fcb x:0 0 0 2024-04-01T06:57:38.291 INFO:tasks.workunit.client.0.smithi083.stdout:0/502: unlink d16/d2e/d3d/f4d 0 2024-04-01T06:57:38.291 INFO:tasks.workunit.client.0.smithi083.stdout:3/529: mknod d6/d15/d2d/d2f/d3e/cb7 0 2024-04-01T06:57:38.292 INFO:tasks.workunit.client.0.smithi083.stdout:4/430: dwrite d1/d8/f14 [0,4194304] 0 2024-04-01T06:57:38.292 INFO:tasks.workunit.client.0.smithi083.stdout:4/431: write d1/d4/d33/f49 [1532968,126121] 0 2024-04-01T06:57:38.292 INFO:tasks.workunit.client.0.smithi083.stdout:9/418: rmdir d6/d32 39 2024-04-01T06:57:38.294 INFO:tasks.workunit.client.0.smithi083.stdout:1/563: mknod db/d1c/d29/d33/d50/d5d/d81/ccc 0 2024-04-01T06:57:38.296 INFO:tasks.workunit.client.0.smithi083.stdout:0/503: rename d16/c17 to d16/d99/d4b/d68/ca6 0 2024-04-01T06:57:38.296 INFO:tasks.workunit.client.0.smithi083.stdout:0/504: chown f7 393 1 2024-04-01T06:57:38.300 INFO:tasks.workunit.client.0.smithi083.stdout:1/564: link db/d1c/d29/d33/d47/cb1 db/ccd 0 2024-04-01T06:57:38.300 INFO:tasks.workunit.client.0.smithi083.stdout:0/505: truncate d16/d1d/f51 2535880 0 2024-04-01T06:57:38.300 INFO:tasks.workunit.client.0.smithi083.stdout:4/432: dread d1/d4/db/f3e [0,4194304] 0 2024-04-01T06:57:38.300 INFO:tasks.workunit.client.0.smithi083.stdout:4/433: chown d1/d8/l65 13186 1 2024-04-01T06:57:38.300 INFO:tasks.workunit.client.0.smithi083.stdout:9/419: rmdir d6 39 2024-04-01T06:57:38.302 INFO:tasks.workunit.client.0.smithi083.stdout:1/565: link db/d1c/d1d/l7f db/d1c/d29/d33/d50/d5d/d81/d94/lce 0 2024-04-01T06:57:38.302 INFO:tasks.workunit.client.0.smithi083.stdout:1/566: dread - db/d1c/d2e/d30/fb8 zero size 2024-04-01T06:57:38.302 INFO:tasks.workunit.client.0.smithi083.stdout:1/567: chown db/d1c/d1d 972863 1 2024-04-01T06:57:38.303 INFO:tasks.workunit.client.0.smithi083.stdout:0/506: symlink d16/d1d/la7 0 2024-04-01T06:57:38.304 INFO:tasks.workunit.client.0.smithi083.stdout:3/530: dwrite d6/d15/d2d/d2f/d3e/fa4 [0,4194304] 0 2024-04-01T06:57:38.305 INFO:tasks.workunit.client.0.smithi083.stdout:9/420: symlink d6/d29/l8b 0 2024-04-01T06:57:38.306 INFO:tasks.workunit.client.0.smithi083.stdout:6/409: dwrite d9/f1a [0,4194304] 0 2024-04-01T06:57:38.306 INFO:tasks.workunit.client.0.smithi083.stdout:1/568: truncate db/d1c/f35 307622 0 2024-04-01T06:57:38.307 INFO:tasks.workunit.client.0.smithi083.stdout:1/569: write db/d1c/d29/d33/d50/d4d/f63 [239648,91950] 0 2024-04-01T06:57:38.307 INFO:tasks.workunit.client.0.smithi083.stdout:1/570: dread - db/d1c/d29/d33/d50/fba zero size 2024-04-01T06:57:38.310 INFO:tasks.workunit.client.0.smithi083.stdout:3/531: mknod d6/d15/d2d/d2f/d42/d9f/cb8 0 2024-04-01T06:57:38.312 INFO:tasks.workunit.client.0.smithi083.stdout:9/421: symlink d6/d32/d3c/d3d/l8c 0 2024-04-01T06:57:38.314 INFO:tasks.workunit.client.0.smithi083.stdout:6/410: rename d9/dc/d1b/d39/d47/f70 to d9/d57/f8c 0 2024-04-01T06:57:38.315 INFO:tasks.workunit.client.0.smithi083.stdout:0/507: getdents d16 0 2024-04-01T06:57:38.316 INFO:tasks.workunit.client.0.smithi083.stdout:4/434: dwrite d1/d8/f5e [0,4194304] 0 2024-04-01T06:57:38.316 INFO:tasks.workunit.client.0.smithi083.stdout:3/532: mkdir d6/d15/d2d/d2f/d42/d5c/d88/db9 0 2024-04-01T06:57:38.317 INFO:tasks.workunit.client.0.smithi083.stdout:3/533: truncate d6/d1e/f90 635434 0 2024-04-01T06:57:38.318 INFO:tasks.workunit.client.0.smithi083.stdout:6/411: symlink d9/dc/d1b/d39/d47/l8d 0 2024-04-01T06:57:38.318 INFO:tasks.workunit.client.0.smithi083.stdout:6/412: getdents d9/dc/d1b/d35/d48 0 2024-04-01T06:57:38.319 INFO:tasks.workunit.client.0.smithi083.stdout:6/413: write f6 [530927,36469] 0 2024-04-01T06:57:38.321 INFO:tasks.workunit.client.0.smithi083.stdout:1/571: rename db/d1c/d29/d33/d50/d5d/dad/dbf/f51 to db/d1c/d29/d33/d50/fcf 0 2024-04-01T06:57:38.323 INFO:tasks.workunit.client.0.smithi083.stdout:0/508: link d16/d2e/d6c/d82/f87 d16/d99/fa8 0 2024-04-01T06:57:38.330 INFO:tasks.workunit.client.0.smithi083.stdout:4/435: truncate d1/d4/db/f11 211379 0 2024-04-01T06:57:38.332 INFO:tasks.workunit.client.0.smithi083.stdout:9/422: rename d6/d32/d3c/d4c/c7a to d6/d32/d4d/c8d 0 2024-04-01T06:57:38.332 INFO:tasks.workunit.client.0.smithi083.stdout:3/534: dwrite d6/d15/f1c [4194304,4194304] 0 2024-04-01T06:57:38.333 INFO:tasks.workunit.client.0.smithi083.stdout:3/535: fsync d6/d15/d2d/d2f/d3e/fa4 0 2024-04-01T06:57:38.333 INFO:tasks.workunit.client.0.smithi083.stdout:3/536: stat d6/l26 0 2024-04-01T06:57:38.334 INFO:tasks.workunit.client.0.smithi083.stdout:4/436: symlink d1/d4/db/d5b/l82 0 2024-04-01T06:57:38.334 INFO:tasks.workunit.client.0.smithi083.stdout:1/572: dwrite db/d1c/f24 [0,4194304] 0 2024-04-01T06:57:38.334 INFO:tasks.workunit.client.0.smithi083.stdout:9/423: mkdir d6/d32/d26/d8e 0 2024-04-01T06:57:38.334 INFO:tasks.workunit.client.0.smithi083.stdout:9/424: dread - d6/d32/d3c/d3d/f63 zero size 2024-04-01T06:57:38.337 INFO:tasks.workunit.client.0.smithi083.stdout:3/537: rename d6/d15/d2d/d2f/d42/d46/c8d to d6/d15/d2d/d2f/d42/d5c/d88/cba 0 2024-04-01T06:57:38.337 INFO:tasks.workunit.client.0.smithi083.stdout:3/538: readlink d6/d1e/d4a/l9b 0 2024-04-01T06:57:38.337 INFO:tasks.workunit.client.0.smithi083.stdout:3/539: stat d6/d1e/d6f/daf 0 2024-04-01T06:57:38.337 INFO:tasks.workunit.client.0.smithi083.stdout:3/540: fdatasync d6/d15/d2d/fb4 0 2024-04-01T06:57:38.337 INFO:tasks.workunit.client.0.smithi083.stdout:3/541: fsync d6/d1e/d6f/f96 0 2024-04-01T06:57:38.337 INFO:tasks.workunit.client.0.smithi083.stdout:4/437: creat d1/d4/da/f83 x:0 0 0 2024-04-01T06:57:38.337 INFO:tasks.workunit.client.0.smithi083.stdout:4/438: write d1/d4/f6d [38102,111706] 0 2024-04-01T06:57:38.342 INFO:tasks.workunit.client.0.smithi083.stdout:3/542: dread d6/d15/d2d/d2f/d3e/d74/f9c [0,4194304] 0 2024-04-01T06:57:38.343 INFO:tasks.workunit.client.0.smithi083.stdout:0/509: dread fd [4194304,4194304] 0 2024-04-01T06:57:38.343 INFO:tasks.workunit.client.0.smithi083.stdout:0/510: truncate d16/d2e/d6c/f70 1481584 0 2024-04-01T06:57:38.343 INFO:tasks.workunit.client.0.smithi083.stdout:1/573: mknod db/d1c/d2e/d30/cd0 0 2024-04-01T06:57:38.343 INFO:tasks.workunit.client.0.smithi083.stdout:1/574: dread - db/d1c/d29/d33/d50/d4d/fcb zero size 2024-04-01T06:57:38.343 INFO:tasks.workunit.client.0.smithi083.stdout:1/575: readlink db/d1c/l57 0 2024-04-01T06:57:38.343 INFO:tasks.workunit.client.0.smithi083.stdout:1/576: readlink db/d1c/d29/d33/d50/d4d/l54 0 2024-04-01T06:57:38.348 INFO:tasks.workunit.client.0.smithi083.stdout:0/511: mkdir d16/d2e/d3d/da9 0 2024-04-01T06:57:38.348 INFO:tasks.workunit.client.0.smithi083.stdout:5/354: sync 2024-04-01T06:57:38.348 INFO:tasks.workunit.client.0.smithi083.stdout:8/473: sync 2024-04-01T06:57:38.348 INFO:tasks.workunit.client.0.smithi083.stdout:7/377: sync 2024-04-01T06:57:38.348 INFO:tasks.workunit.client.0.smithi083.stdout:7/378: fsync d0/d4/d9/f22 0 2024-04-01T06:57:38.350 INFO:tasks.workunit.client.0.smithi083.stdout:0/512: symlink d16/d2e/d3d/laa 0 2024-04-01T06:57:38.350 INFO:tasks.workunit.client.0.smithi083.stdout:3/543: dread f3 [0,4194304] 0 2024-04-01T06:57:38.351 INFO:tasks.workunit.client.0.smithi083.stdout:7/379: mknod d0/d4/d9/d39/d67/d6d/d7d/c7e 0 2024-04-01T06:57:38.351 INFO:tasks.workunit.client.0.smithi083.stdout:3/544: write d6/d15/d2d/d2f/f9e [7161798,115572] 0 2024-04-01T06:57:38.351 INFO:tasks.workunit.client.0.smithi083.stdout:3/545: stat d6/d15/d2d/d2f/d53/l99 0 2024-04-01T06:57:38.354 INFO:tasks.workunit.client.0.smithi083.stdout:7/380: rename d0/d10/l17 to d0/d4/d9/d39/d67/d6d/l7f 0 2024-04-01T06:57:38.356 INFO:tasks.workunit.client.0.smithi083.stdout:7/381: dread d0/d4/d9/d39/d67/d6d/f6b [0,4194304] 0 2024-04-01T06:57:38.356 INFO:tasks.workunit.client.0.smithi083.stdout:3/546: mkdir d6/d1e/dbb 0 2024-04-01T06:57:38.357 INFO:tasks.workunit.client.0.smithi083.stdout:7/382: truncate d0/d4/d9/f22 748013 0 2024-04-01T06:57:38.357 INFO:tasks.workunit.client.0.smithi083.stdout:7/383: fdatasync d0/d10/f78 0 2024-04-01T06:57:38.359 INFO:tasks.workunit.client.0.smithi083.stdout:7/384: rmdir d0/d4/d9/d39/d67/d6d 39 2024-04-01T06:57:38.360 INFO:tasks.workunit.client.0.smithi083.stdout:3/547: rmdir d6/d1e/d4a 39 2024-04-01T06:57:38.360 INFO:tasks.workunit.client.0.smithi083.stdout:3/548: read d6/d15/f64 [3515132,71292] 0 2024-04-01T06:57:38.361 INFO:tasks.workunit.client.0.smithi083.stdout:5/355: dread d4/d9/d16/d19/d5e/f64 [0,4194304] 0 2024-04-01T06:57:38.361 INFO:tasks.workunit.client.0.smithi083.stdout:7/385: creat d0/d4/f80 x:0 0 0 2024-04-01T06:57:38.363 INFO:tasks.workunit.client.0.smithi083.stdout:5/356: rename d4/d2b/d21/c26 to d4/d23/d49/c76 0 2024-04-01T06:57:38.363 INFO:tasks.workunit.client.0.smithi083.stdout:1/577: dwrite db/d1c/d2e/d30/d82/f95 [0,4194304] 0 2024-04-01T06:57:38.364 INFO:tasks.workunit.client.0.smithi083.stdout:7/386: creat d0/d4/d9/f81 x:0 0 0 2024-04-01T06:57:38.364 INFO:tasks.workunit.client.0.smithi083.stdout:7/387: fdatasync d0/d7a/f7b 0 2024-04-01T06:57:38.364 INFO:tasks.workunit.client.0.smithi083.stdout:5/357: write d4/d2b/f24 [83897,77314] 0 2024-04-01T06:57:38.365 INFO:tasks.workunit.client.0.smithi083.stdout:9/425: dwrite d6/d32/d3c/d4c/d6b/f5d [0,4194304] 0 2024-04-01T06:57:38.365 INFO:tasks.workunit.client.0.smithi083.stdout:9/426: readlink d6/d32/d3c/l47 0 2024-04-01T06:57:38.365 INFO:tasks.workunit.client.0.smithi083.stdout:9/427: write d6/d32/d26/d2d/f30 [1978601,119568] 0 2024-04-01T06:57:38.367 INFO:tasks.workunit.client.0.smithi083.stdout:1/578: mknod db/cd1 0 2024-04-01T06:57:38.367 INFO:tasks.workunit.client.0.smithi083.stdout:1/579: chown db/d1c/d29/d33/d47/f5a 15 1 2024-04-01T06:57:38.369 INFO:tasks.workunit.client.0.smithi083.stdout:7/388: rmdir d0/d4b/d5d 39 2024-04-01T06:57:38.369 INFO:tasks.workunit.client.0.smithi083.stdout:7/389: fsync d0/d4/f58 0 2024-04-01T06:57:38.369 INFO:tasks.workunit.client.0.smithi083.stdout:7/390: chown d0/d10/f27 11 1 2024-04-01T06:57:38.370 INFO:tasks.workunit.client.0.smithi083.stdout:5/358: rename d4/d9/d16/d19/d5e/c74 to d4/d9/d16/d19/c77 0 2024-04-01T06:57:38.370 INFO:tasks.workunit.client.0.smithi083.stdout:8/474: dwrite d15/d1b/d39/d48/f58 [0,4194304] 0 2024-04-01T06:57:38.375 INFO:tasks.workunit.client.0.smithi083.stdout:1/580: mknod db/d1c/cd2 0 2024-04-01T06:57:38.375 INFO:tasks.workunit.client.0.smithi083.stdout:1/581: chown db/d1c/d29/d33/c64 0 1 2024-04-01T06:57:38.378 INFO:tasks.workunit.client.0.smithi083.stdout:7/391: creat d0/d4/d9/d39/d67/f82 x:0 0 0 2024-04-01T06:57:38.378 INFO:tasks.workunit.client.0.smithi083.stdout:5/359: creat d4/d9/d16/d19/f78 x:0 0 0 2024-04-01T06:57:38.378 INFO:tasks.workunit.client.0.smithi083.stdout:9/428: dwrite d6/d32/d3c/f57 [0,4194304] 0 2024-04-01T06:57:38.378 INFO:tasks.workunit.client.0.smithi083.stdout:9/429: write d6/d32/d3c/d3d/f63 [80660,111482] 0 2024-04-01T06:57:38.378 INFO:tasks.workunit.client.0.smithi083.stdout:9/430: chown d6/d32/d3c/d4c/d6b/f5d 807 1 2024-04-01T06:57:38.379 INFO:tasks.workunit.client.0.smithi083.stdout:8/475: creat d15/d18/d19/d24/d44/d97/fad x:0 0 0 2024-04-01T06:57:38.382 INFO:tasks.workunit.client.0.smithi083.stdout:3/549: dwrite d6/d15/d2d/d2f/d3e/f8c [0,4194304] 0 2024-04-01T06:57:38.382 INFO:tasks.workunit.client.0.smithi083.stdout:3/550: write d6/d15/f35 [894434,86912] 0 2024-04-01T06:57:38.382 INFO:tasks.workunit.client.0.smithi083.stdout:1/582: link db/d1c/d29/d33/d50/d5d/dad/dbf/c9c db/d1c/d29/dbe/cd3 0 2024-04-01T06:57:38.383 INFO:tasks.workunit.client.0.smithi083.stdout:5/360: mkdir d4/d23/d4e/d79 0 2024-04-01T06:57:38.384 INFO:tasks.workunit.client.0.smithi083.stdout:5/361: write d4/d9/d16/d1f/d2f/d53/f66 [4113018,38559] 0 2024-04-01T06:57:38.390 INFO:tasks.workunit.client.0.smithi083.stdout:3/551: creat d6/d15/d2d/d2f/d53/fbc x:0 0 0 2024-04-01T06:57:38.392 INFO:tasks.workunit.client.0.smithi083.stdout:1/583: mknod db/d61/cd4 0 2024-04-01T06:57:38.394 INFO:tasks.workunit.client.0.smithi083.stdout:9/431: dread d6/d32/d4b/d6d/f82 [0,4194304] 0 2024-04-01T06:57:38.395 INFO:tasks.workunit.client.0.smithi083.stdout:7/392: rename d0/d10 to d0/d4/d9/d4e/d83 0 2024-04-01T06:57:38.398 INFO:tasks.workunit.client.0.smithi083.stdout:5/362: dwrite d4/d9/d16/d1f/f69 [0,4194304] 0 2024-04-01T06:57:38.398 INFO:tasks.workunit.client.0.smithi083.stdout:9/432: rename d6/d32/d4b to d6/d32/d8f 0 2024-04-01T06:57:38.400 INFO:tasks.workunit.client.0.smithi083.stdout:7/393: link d0/d4/d9/d4e/d83/d34/c46 d0/d4b/d5d/c84 0 2024-04-01T06:57:38.401 INFO:tasks.workunit.client.0.smithi083.stdout:8/476: dwrite d15/f5c [0,4194304] 0 2024-04-01T06:57:38.401 INFO:tasks.workunit.client.0.smithi083.stdout:7/394: dread d0/d4/d9/f25 [0,4194304] 0 2024-04-01T06:57:38.407 INFO:tasks.workunit.client.0.smithi083.stdout:5/363: creat d4/d71/f7a x:0 0 0 2024-04-01T06:57:38.407 INFO:tasks.workunit.client.0.smithi083.stdout:9/433: symlink d6/d32/d3c/d4c/l90 0 2024-04-01T06:57:38.408 INFO:tasks.workunit.client.0.smithi083.stdout:1/584: dwrite db/d1c/d29/f3e [4194304,4194304] 0 2024-04-01T06:57:38.410 INFO:tasks.workunit.client.0.smithi083.stdout:3/552: dwrite d6/d1e/f31 [0,4194304] 0 2024-04-01T06:57:38.410 INFO:tasks.workunit.client.0.smithi083.stdout:3/553: readlink d6/d15/d2d/l84 0 2024-04-01T06:57:38.414 INFO:tasks.workunit.client.0.smithi083.stdout:8/477: symlink d15/d1b/d39/d48/lae 0 2024-04-01T06:57:38.415 INFO:tasks.workunit.client.0.smithi083.stdout:7/395: creat d0/d4/d9/d39/d48/f85 x:0 0 0 2024-04-01T06:57:38.415 INFO:tasks.workunit.client.0.smithi083.stdout:8/478: write d15/d18/d19/f23 [625188,13013] 0 2024-04-01T06:57:38.416 INFO:tasks.workunit.client.0.smithi083.stdout:5/364: dwrite d4/d2b/f31 [0,4194304] 0 2024-04-01T06:57:38.416 INFO:tasks.workunit.client.0.smithi083.stdout:8/479: read d15/d18/f64 [2295641,59906] 0 2024-04-01T06:57:38.416 INFO:tasks.workunit.client.0.smithi083.stdout:8/480: read d15/d1b/d39/d48/d5e/d70/f86 [2907745,102895] 0 2024-04-01T06:57:38.416 INFO:tasks.workunit.client.0.smithi083.stdout:8/481: read - d15/d18/d19/d24/da2/d6f/fa0 zero size 2024-04-01T06:57:38.417 INFO:tasks.workunit.client.0.smithi083.stdout:9/434: link d6/l20 d6/d32/d26/d8e/l91 0 2024-04-01T06:57:38.419 INFO:tasks.workunit.client.0.smithi083.stdout:1/585: creat db/d1c/d29/d33/d50/d5d/d6c/d8e/fd5 x:0 0 0 2024-04-01T06:57:38.419 INFO:tasks.workunit.client.0.smithi083.stdout:1/586: truncate db/d1c/d49/f65 659317 0 2024-04-01T06:57:38.421 INFO:tasks.workunit.client.0.smithi083.stdout:3/554: unlink d6/d15/d2d/d2f/d42/cb6 0 2024-04-01T06:57:38.421 INFO:tasks.workunit.client.0.smithi083.stdout:3/555: write d6/d15/d2d/d2f/d53/fa6 [485435,8401] 0 2024-04-01T06:57:38.426 INFO:tasks.workunit.client.0.smithi083.stdout:7/396: unlink d0/f5b 0 2024-04-01T06:57:38.426 INFO:tasks.workunit.client.0.smithi083.stdout:7/397: dread - d0/d4/d9/d4e/d83/d38/f68 zero size 2024-04-01T06:57:38.426 INFO:tasks.workunit.client.0.smithi083.stdout:5/365: symlink d4/d23/d49/l7b 0 2024-04-01T06:57:38.428 INFO:tasks.workunit.client.0.smithi083.stdout:8/482: unlink d15/d18/d19/d1d/f54 0 2024-04-01T06:57:38.429 INFO:tasks.workunit.client.0.smithi083.stdout:9/435: creat d6/d76/f92 x:0 0 0 2024-04-01T06:57:38.431 INFO:tasks.workunit.client.0.smithi083.stdout:1/587: mknod db/d1c/d29/d33/d47/cd6 0 2024-04-01T06:57:38.431 INFO:tasks.workunit.client.0.smithi083.stdout:1/588: chown db/d1c/d49 318457 1 2024-04-01T06:57:38.432 INFO:tasks.workunit.client.0.smithi083.stdout:7/398: mknod d0/d7c/c86 0 2024-04-01T06:57:38.432 INFO:tasks.workunit.client.0.smithi083.stdout:7/399: truncate d0/d4/d9/d4e/d83/f2d 4881679 0 2024-04-01T06:57:38.433 INFO:tasks.workunit.client.0.smithi083.stdout:7/400: read d0/d4b/f54 [1829317,109138] 0 2024-04-01T06:57:38.434 INFO:tasks.workunit.client.0.smithi083.stdout:5/366: rename d4/d9/d16/d19/f1e to d4/d55/f7c 0 2024-04-01T06:57:38.435 INFO:tasks.workunit.client.0.smithi083.stdout:8/483: creat d15/d18/d1e/faf x:0 0 0 2024-04-01T06:57:38.435 INFO:tasks.workunit.client.0.smithi083.stdout:8/484: chown d15/d18/l32 2730 1 2024-04-01T06:57:38.435 INFO:tasks.workunit.client.0.smithi083.stdout:8/485: read d15/d18/d1e/f1f [706067,100480] 0 2024-04-01T06:57:38.435 INFO:tasks.workunit.client.0.smithi083.stdout:2/484: sync 2024-04-01T06:57:38.436 INFO:tasks.workunit.client.0.smithi083.stdout:9/436: mknod d6/d32/d26/d2d/d34/d6c/c93 0 2024-04-01T06:57:38.436 INFO:tasks.workunit.client.0.smithi083.stdout:9/437: stat d6/d32/f1b 0 2024-04-01T06:57:38.436 INFO:tasks.workunit.client.0.smithi083.stdout:8/486: write d15/d18/d19/f5d [2675672,41133] 0 2024-04-01T06:57:38.438 INFO:tasks.workunit.client.0.smithi083.stdout:1/589: mknod db/d1c/d29/d33/d50/d5d/dad/dbf/cd7 0 2024-04-01T06:57:38.439 INFO:tasks.workunit.client.0.smithi083.stdout:7/401: truncate d0/f2b 2208450 0 2024-04-01T06:57:38.441 INFO:tasks.workunit.client.0.smithi083.stdout:8/487: link d15/d18/d19/d24/d38/d62/f85 d15/d21/fb0 0 2024-04-01T06:57:38.441 INFO:tasks.workunit.client.0.smithi083.stdout:8/488: truncate d15/d21/f22 4577504 0 2024-04-01T06:57:38.442 INFO:tasks.workunit.client.0.smithi083.stdout:1/590: mknod db/d1c/d29/d33/d50/d5d/d6c/cd8 0 2024-04-01T06:57:38.442 INFO:tasks.workunit.client.0.smithi083.stdout:1/591: fdatasync db/d1c/d29/d33/d50/d5d/d81/d94/fc4 0 2024-04-01T06:57:38.444 INFO:tasks.workunit.client.0.smithi083.stdout:8/489: symlink d15/d1b/d39/d80/lb1 0 2024-04-01T06:57:38.444 INFO:tasks.workunit.client.0.smithi083.stdout:8/490: write d15/d18/d19/f30 [114541,123055] 0 2024-04-01T06:57:38.444 INFO:tasks.workunit.client.0.smithi083.stdout:8/491: chown d15/d18/d19/d24/l63 316 1 2024-04-01T06:57:38.445 INFO:tasks.workunit.client.0.smithi083.stdout:8/492: truncate d15/f27 4649355 0 2024-04-01T06:57:38.445 INFO:tasks.workunit.client.0.smithi083.stdout:1/592: creat db/d1c/d29/d33/d50/d5d/dad/dbf/fd9 x:0 0 0 2024-04-01T06:57:38.445 INFO:tasks.workunit.client.0.smithi083.stdout:1/593: chown db/d1c/d29/d33/d50/d5d/d6c/f74 1 1 2024-04-01T06:57:38.447 INFO:tasks.workunit.client.0.smithi083.stdout:1/594: creat db/d1c/d29/d33/d50/d5d/dad/dbf/fda x:0 0 0 2024-04-01T06:57:38.449 INFO:tasks.workunit.client.0.smithi083.stdout:1/595: stat db/d1c/d29/d33/d50/d5d/d6c/cc2 0 2024-04-01T06:57:38.449 INFO:tasks.workunit.client.0.smithi083.stdout:1/596: fdatasync db/d1c/d2e/d30/fc1 0 2024-04-01T06:57:38.451 INFO:tasks.workunit.client.0.smithi083.stdout:1/597: truncate db/d1c/d2e/f2f 172285 0 2024-04-01T06:57:38.452 INFO:tasks.workunit.client.0.smithi083.stdout:5/367: dwrite d4/d2b/f24 [0,4194304] 0 2024-04-01T06:57:38.454 INFO:tasks.workunit.client.0.smithi083.stdout:5/368: mkdir d4/d71/d7d 0 2024-04-01T06:57:38.455 INFO:tasks.workunit.client.0.smithi083.stdout:5/369: getdents d4/d2b 0 2024-04-01T06:57:38.457 INFO:tasks.workunit.client.0.smithi083.stdout:5/370: dread d4/d2b/f39 [4194304,4194304] 0 2024-04-01T06:57:38.457 INFO:tasks.workunit.client.0.smithi083.stdout:5/371: read - d4/f4a zero size 2024-04-01T06:57:38.457 INFO:tasks.workunit.client.0.smithi083.stdout:5/372: dread - d4/d71/f7a zero size 2024-04-01T06:57:38.457 INFO:tasks.workunit.client.0.smithi083.stdout:5/373: write d4/f4a [693100,118800] 0 2024-04-01T06:57:38.457 INFO:tasks.workunit.client.0.smithi083.stdout:5/374: truncate d4/d9/d16/d19/f78 485478 0 2024-04-01T06:57:38.457 INFO:tasks.workunit.client.0.smithi083.stdout:5/375: stat d4/d2b/f24 0 2024-04-01T06:57:38.458 INFO:tasks.workunit.client.0.smithi083.stdout:9/438: dwrite d6/d32/d26/d2d/f54 [4194304,4194304] 0 2024-04-01T06:57:38.459 INFO:tasks.workunit.client.0.smithi083.stdout:9/439: link d6/l11 d6/d32/d26/d2d/d6e/l94 0 2024-04-01T06:57:38.460 INFO:tasks.workunit.client.0.smithi083.stdout:1/598: dread db/d1c/d2e/d30/d82/f95 [0,4194304] 0 2024-04-01T06:57:38.462 INFO:tasks.workunit.client.0.smithi083.stdout:9/440: dread d6/d32/d26/d2d/d34/f3b [0,4194304] 0 2024-04-01T06:57:38.462 INFO:tasks.workunit.client.0.smithi083.stdout:1/599: mkdir db/d1c/d29/d33/d50/d5d/d6c/ddb 0 2024-04-01T06:57:38.462 INFO:tasks.workunit.client.0.smithi083.stdout:1/600: fsync db/d1c/d1d/f4c 0 2024-04-01T06:57:38.462 INFO:tasks.workunit.client.0.smithi083.stdout:1/601: write db/d1c/d29/d33/d47/fa8 [775170,117879] 0 2024-04-01T06:57:38.463 INFO:tasks.workunit.client.0.smithi083.stdout:9/441: link d6/d32/d3c/c59 d6/d32/d3c/c95 0 2024-04-01T06:57:38.464 INFO:tasks.workunit.client.0.smithi083.stdout:1/602: creat db/d1c/d29/d33/d47/d76/fdc x:0 0 0 2024-04-01T06:57:38.464 INFO:tasks.workunit.client.0.smithi083.stdout:1/603: getdents db/d1c/d29/d33/d50/d5d/d81/d94/db9 0 2024-04-01T06:57:38.465 INFO:tasks.workunit.client.0.smithi083.stdout:9/442: creat d6/d32/d26/f96 x:0 0 0 2024-04-01T06:57:38.465 INFO:tasks.workunit.client.0.smithi083.stdout:9/443: write d6/d32/d3c/d3d/f63 [940330,21884] 0 2024-04-01T06:57:38.466 INFO:tasks.workunit.client.0.smithi083.stdout:1/604: getdents db/d1c/d1d 0 2024-04-01T06:57:38.467 INFO:tasks.workunit.client.0.smithi083.stdout:8/493: dwrite d15/d18/d19/d1d/f36 [4194304,4194304] 0 2024-04-01T06:57:38.468 INFO:tasks.workunit.client.0.smithi083.stdout:9/444: creat d6/f97 x:0 0 0 2024-04-01T06:57:38.473 INFO:tasks.workunit.client.0.smithi083.stdout:8/494: symlink d15/d18/d19/d24/da2/lb2 0 2024-04-01T06:57:38.473 INFO:tasks.workunit.client.0.smithi083.stdout:9/445: link d6/d32/f1b d6/d32/d3c/d3d/f98 0 2024-04-01T06:57:38.473 INFO:tasks.workunit.client.0.smithi083.stdout:8/495: dread - d15/f74 zero size 2024-04-01T06:57:38.474 INFO:tasks.workunit.client.0.smithi083.stdout:9/446: rename d6/l16 to d6/d32/d3c/d4c/d6b/l99 0 2024-04-01T06:57:38.474 INFO:tasks.workunit.client.0.smithi083.stdout:1/605: dwrite db/d1c/d29/d33/d50/fa2 [0,4194304] 0 2024-04-01T06:57:38.475 INFO:tasks.workunit.client.0.smithi083.stdout:5/376: dread d4/d9/d16/d1f/d2f/d53/f66 [0,4194304] 0 2024-04-01T06:57:38.475 INFO:tasks.workunit.client.0.smithi083.stdout:5/377: chown d4/d2b/d21/f6e 5 1 2024-04-01T06:57:38.475 INFO:tasks.workunit.client.0.smithi083.stdout:9/447: rmdir d6/d32/d3c/d3d 39 2024-04-01T06:57:38.477 INFO:tasks.workunit.client.0.smithi083.stdout:1/606: getdents db/d1c/d2e/d30 0 2024-04-01T06:57:38.478 INFO:tasks.workunit.client.0.smithi083.stdout:9/448: creat d6/d32/d26/f9a x:0 0 0 2024-04-01T06:57:38.482 INFO:tasks.workunit.client.0.smithi083.stdout:5/378: dread d4/d9/d16/d1f/f69 [0,4194304] 0 2024-04-01T06:57:38.482 INFO:tasks.workunit.client.0.smithi083.stdout:5/379: chown d4/fb 44023698 1 2024-04-01T06:57:38.482 INFO:tasks.workunit.client.0.smithi083.stdout:1/607: symlink db/d1c/d29/d33/d50/d5d/d81/d94/ldd 0 2024-04-01T06:57:38.483 INFO:tasks.workunit.client.0.smithi083.stdout:9/449: creat d6/d32/d3c/f9b x:0 0 0 2024-04-01T06:57:38.490 INFO:tasks.workunit.client.0.smithi083.stdout:9/450: dread d6/d32/d26/d2d/d34/f40 [0,4194304] 0 2024-04-01T06:57:38.490 INFO:tasks.workunit.client.0.smithi083.stdout:9/451: readlink d6/l46 0 2024-04-01T06:57:38.499 INFO:tasks.workunit.client.0.smithi083.stdout:8/496: dwrite d15/d18/d19/d24/d38/f47 [0,4194304] 0 2024-04-01T06:57:38.500 INFO:tasks.workunit.client.0.smithi083.stdout:1/608: dread db/d1c/d29/d33/d50/fcf [0,4194304] 0 2024-04-01T06:57:38.502 INFO:tasks.workunit.client.0.smithi083.stdout:1/609: symlink db/d1c/d1d/lde 0 2024-04-01T06:57:38.502 INFO:tasks.workunit.client.0.smithi083.stdout:1/610: write db/d1c/d29/d33/d47/f5a [997453,125933] 0 2024-04-01T06:57:38.502 INFO:tasks.workunit.client.0.smithi083.stdout:1/611: write db/d1c/d29/d33/d50/d5d/d81/d94/fc4 [120317,25977] 0 2024-04-01T06:57:38.502 INFO:tasks.workunit.client.0.smithi083.stdout:8/497: symlink d15/d82/lb3 0 2024-04-01T06:57:38.503 INFO:tasks.workunit.client.0.smithi083.stdout:8/498: rename d15/d18/d19/d24/d38/c4f to d15/d82/cb4 0 2024-04-01T06:57:38.504 INFO:tasks.workunit.client.0.smithi083.stdout:9/452: dread d6/d32/f25 [0,4194304] 0 2024-04-01T06:57:38.504 INFO:tasks.workunit.client.0.smithi083.stdout:9/453: dread - d6/f97 zero size 2024-04-01T06:57:38.504 INFO:tasks.workunit.client.0.smithi083.stdout:9/454: chown d6/d32/d26/d2d/d34/f40 336 1 2024-04-01T06:57:38.504 INFO:tasks.workunit.client.0.smithi083.stdout:9/455: write d6/d32/d26/d2d/f30 [2574946,22633] 0 2024-04-01T06:57:38.506 INFO:tasks.workunit.client.0.smithi083.stdout:8/499: getdents d15/d1b/d39/d80 0 2024-04-01T06:57:38.506 INFO:tasks.workunit.client.0.smithi083.stdout:5/380: dwrite d4/d2b/f13 [0,4194304] 0 2024-04-01T06:57:38.508 INFO:tasks.workunit.client.0.smithi083.stdout:5/381: mknod d4/d23/d4e/d79/c7e 0 2024-04-01T06:57:38.508 INFO:tasks.workunit.client.0.smithi083.stdout:5/382: dread - d4/d23/f75 zero size 2024-04-01T06:57:38.509 INFO:tasks.workunit.client.0.smithi083.stdout:8/500: write d15/f27 [3529029,100987] 0 2024-04-01T06:57:38.509 INFO:tasks.workunit.client.0.smithi083.stdout:1/612: truncate db/d1c/d29/d33/d47/fa8 637284 0 2024-04-01T06:57:38.510 INFO:tasks.workunit.client.0.smithi083.stdout:5/383: mkdir d4/d23/d49/d7f 0 2024-04-01T06:57:38.510 INFO:tasks.workunit.client.0.smithi083.stdout:5/384: write d4/fb [8401707,10094] 0 2024-04-01T06:57:38.511 INFO:tasks.workunit.client.0.smithi083.stdout:8/501: symlink d15/d18/d19/lb5 0 2024-04-01T06:57:38.512 INFO:tasks.workunit.client.0.smithi083.stdout:8/502: symlink d15/d82/lb6 0 2024-04-01T06:57:38.514 INFO:tasks.workunit.client.0.smithi083.stdout:8/503: rmdir d15/d18/d19/d24/da2/da6/da8 0 2024-04-01T06:57:38.514 INFO:tasks.workunit.client.0.smithi083.stdout:8/504: chown d15/d18/d19/d24/d38/d62/f2e 125451598 1 2024-04-01T06:57:38.516 INFO:tasks.workunit.client.0.smithi083.stdout:8/505: mknod d15/d21/cb7 0 2024-04-01T06:57:38.517 INFO:tasks.workunit.client.0.smithi083.stdout:5/385: dread d4/d2b/f31 [0,4194304] 0 2024-04-01T06:57:38.517 INFO:tasks.workunit.client.0.smithi083.stdout:8/506: symlink d15/d1b/d39/d80/lb8 0 2024-04-01T06:57:38.517 INFO:tasks.workunit.client.0.smithi083.stdout:8/507: fsync d15/d18/d19/f23 0 2024-04-01T06:57:38.518 INFO:tasks.workunit.client.0.smithi083.stdout:5/386: rmdir d4/d55 39 2024-04-01T06:57:38.518 INFO:tasks.workunit.client.0.smithi083.stdout:5/387: write d4/d9/d16/d1f/d2f/d53/f70 [370592,126110] 0 2024-04-01T06:57:38.522 INFO:tasks.workunit.client.0.smithi083.stdout:8/508: creat d15/d1b/fb9 x:0 0 0 2024-04-01T06:57:38.522 INFO:tasks.workunit.client.0.smithi083.stdout:8/509: readlink d15/d18/d19/l20 0 2024-04-01T06:57:38.522 INFO:tasks.workunit.client.0.smithi083.stdout:1/613: dread db/d1c/d49/f7d [0,4194304] 0 2024-04-01T06:57:38.523 INFO:tasks.workunit.client.0.smithi083.stdout:9/456: dwrite d6/d32/d3c/d3d/f98 [0,4194304] 0 2024-04-01T06:57:38.523 INFO:tasks.workunit.client.0.smithi083.stdout:9/457: read - d6/f97 zero size 2024-04-01T06:57:38.523 INFO:tasks.workunit.client.0.smithi083.stdout:9/458: dread - d6/d32/d3c/f9b zero size 2024-04-01T06:57:38.523 INFO:tasks.workunit.client.0.smithi083.stdout:9/459: chown d6/d32/d3c/c49 43975311 1 2024-04-01T06:57:38.523 INFO:tasks.workunit.client.0.smithi083.stdout:8/510: write d15/d18/d19/d1d/f36 [2907551,95534] 0 2024-04-01T06:57:38.523 INFO:tasks.workunit.client.0.smithi083.stdout:8/511: chown d15/d18/d19/d24/da2/d6f/fa0 65447 1 2024-04-01T06:57:38.523 INFO:tasks.workunit.client.0.smithi083.stdout:8/512: chown d15/d18/d19/d24/d44/f88 113004 1 2024-04-01T06:57:38.525 INFO:tasks.workunit.client.0.smithi083.stdout:8/513: dread d15/d1b/d39/f61 [0,4194304] 0 2024-04-01T06:57:38.528 INFO:tasks.workunit.client.0.smithi083.stdout:5/388: dread d4/f1b [0,4194304] 0 2024-04-01T06:57:38.533 INFO:tasks.workunit.client.0.smithi083.stdout:5/389: link d4/d23/c5a d4/d9/d4f/d68/c80 0 2024-04-01T06:57:38.533 INFO:tasks.workunit.client.0.smithi083.stdout:5/390: chown d4/d9/l43 1332 1 2024-04-01T06:57:38.535 INFO:tasks.workunit.client.0.smithi083.stdout:1/614: rmdir db/d1c/d29/d33/d50/d5d/d81/d94/db9 0 2024-04-01T06:57:38.535 INFO:tasks.workunit.client.0.smithi083.stdout:1/615: chown db/d1c/d1d/f1f 16 1 2024-04-01T06:57:38.536 INFO:tasks.workunit.client.0.smithi083.stdout:1/616: write db/d1c/d29/d33/d50/fcf [6639349,83753] 0 2024-04-01T06:57:38.536 INFO:tasks.workunit.client.0.smithi083.stdout:1/617: truncate db/d1c/d29/d33/d50/d4d/fb7 336908 0 2024-04-01T06:57:38.536 INFO:tasks.workunit.client.0.smithi083.stdout:1/618: write db/d1c/d29/d33/d47/fa8 [141426,130936] 0 2024-04-01T06:57:38.538 INFO:tasks.workunit.client.0.smithi083.stdout:5/391: truncate d4/d9/d16/d1f/d2f/f46 4015446 0 2024-04-01T06:57:38.539 INFO:tasks.workunit.client.0.smithi083.stdout:5/392: read - d4/d23/f75 zero size 2024-04-01T06:57:38.541 INFO:tasks.workunit.client.0.smithi083.stdout:1/619: mkdir db/d1c/d1d/db4/ddf 0 2024-04-01T06:57:38.541 INFO:tasks.workunit.client.0.smithi083.stdout:5/393: creat d4/d9/d16/f81 x:0 0 0 2024-04-01T06:57:38.541 INFO:tasks.workunit.client.0.smithi083.stdout:5/394: chown d4/d71/d7d 680649760 1 2024-04-01T06:57:38.541 INFO:tasks.workunit.client.0.smithi083.stdout:5/395: truncate d4/d2b/d21/f6e 2520478 0 2024-04-01T06:57:38.543 INFO:tasks.workunit.client.0.smithi083.stdout:8/514: dwrite d15/d1b/d39/d48/d5e/d70/f98 [0,4194304] 0 2024-04-01T06:57:38.546 INFO:tasks.workunit.client.0.smithi083.stdout:8/515: creat d15/d18/d19/d24/d44/fba x:0 0 0 2024-04-01T06:57:38.548 INFO:tasks.workunit.client.0.smithi083.stdout:8/516: creat d15/d18/d19/d24/fbb x:0 0 0 2024-04-01T06:57:38.548 INFO:tasks.workunit.client.0.smithi083.stdout:8/517: stat d15/d1b/d39/d48/d5e/d70/f8e 0 2024-04-01T06:57:38.549 INFO:tasks.workunit.client.0.smithi083.stdout:8/518: mkdir d15/d21/dbc 0 2024-04-01T06:57:38.551 INFO:tasks.workunit.client.0.smithi083.stdout:8/519: creat d15/fbd x:0 0 0 2024-04-01T06:57:38.551 INFO:tasks.workunit.client.0.smithi083.stdout:8/520: fdatasync d15/d18/d19/d24/f89 0 2024-04-01T06:57:38.551 INFO:tasks.workunit.client.0.smithi083.stdout:8/521: readlink d15/d18/d19/l20 0 2024-04-01T06:57:38.551 INFO:tasks.workunit.client.0.smithi083.stdout:8/522: write d15/d1b/fa7 [315041,95287] 0 2024-04-01T06:57:38.552 INFO:tasks.workunit.client.0.smithi083.stdout:0/513: sync 2024-04-01T06:57:38.552 INFO:tasks.workunit.client.0.smithi083.stdout:4/439: sync 2024-04-01T06:57:38.552 INFO:tasks.workunit.client.0.smithi083.stdout:0/514: chown l0 12 1 2024-04-01T06:57:38.552 INFO:tasks.workunit.client.0.smithi083.stdout:6/414: sync 2024-04-01T06:57:38.552 INFO:tasks.workunit.client.0.smithi083.stdout:6/415: write d9/dc/f2e [964679,117044] 0 2024-04-01T06:57:38.552 INFO:tasks.workunit.client.0.smithi083.stdout:5/396: dwrite d4/d2b/f39 [0,4194304] 0 2024-04-01T06:57:38.552 INFO:tasks.workunit.client.0.smithi083.stdout:5/397: truncate d4/d2b/f39 5425708 0 2024-04-01T06:57:38.553 INFO:tasks.workunit.client.0.smithi083.stdout:8/523: rename d15/d18/d1e/faf to d15/d18/d19/d1d/fbe 0 2024-04-01T06:57:38.557 INFO:tasks.workunit.client.0.smithi083.stdout:6/416: dread d9/dc/d1b/d39/d47/f69 [0,4194304] 0 2024-04-01T06:57:38.557 INFO:tasks.workunit.client.0.smithi083.stdout:1/620: dwrite db/d1c/d2e/f6e [0,4194304] 0 2024-04-01T06:57:38.557 INFO:tasks.workunit.client.0.smithi083.stdout:0/515: unlink f11 0 2024-04-01T06:57:38.557 INFO:tasks.workunit.client.0.smithi083.stdout:0/516: fdatasync d16/d99/d63/f93 0 2024-04-01T06:57:38.560 INFO:tasks.workunit.client.0.smithi083.stdout:5/398: creat d4/d9/d16/d1f/f82 x:0 0 0 2024-04-01T06:57:38.560 INFO:tasks.workunit.client.0.smithi083.stdout:5/399: chown d4/d9/d16/d1f/l38 22696869 1 2024-04-01T06:57:38.560 INFO:tasks.workunit.client.0.smithi083.stdout:5/400: chown d4/d9/d16/d19/c40 1020897685 1 2024-04-01T06:57:38.560 INFO:tasks.workunit.client.0.smithi083.stdout:5/401: fdatasync d4/d2b/f13 0 2024-04-01T06:57:38.562 INFO:tasks.workunit.client.0.smithi083.stdout:8/524: creat d15/d18/fbf x:0 0 0 2024-04-01T06:57:38.562 INFO:tasks.workunit.client.0.smithi083.stdout:8/525: fdatasync d15/d18/d19/d24/da2/d6f/f90 0 2024-04-01T06:57:38.563 INFO:tasks.workunit.client.0.smithi083.stdout:1/621: dread db/d1c/f24 [0,4194304] 0 2024-04-01T06:57:38.564 INFO:tasks.workunit.client.0.smithi083.stdout:6/417: creat d9/dc/d29/d3c/d5c/d8b/f8e x:0 0 0 2024-04-01T06:57:38.566 INFO:tasks.workunit.client.0.smithi083.stdout:0/517: mknod d16/cab 0 2024-04-01T06:57:38.569 INFO:tasks.workunit.client.0.smithi083.stdout:5/402: unlink d4/d9/d16/f81 0 2024-04-01T06:57:38.569 INFO:tasks.workunit.client.0.smithi083.stdout:5/403: stat d4/d9/d16/d19 0 2024-04-01T06:57:38.570 INFO:tasks.workunit.client.0.smithi083.stdout:5/404: write d4/d9/d16/d1f/f48 [182584,53155] 0 2024-04-01T06:57:38.570 INFO:tasks.workunit.client.0.smithi083.stdout:8/526: creat d15/d18/d19/d24/d38/d62/fc0 x:0 0 0 2024-04-01T06:57:38.570 INFO:tasks.workunit.client.0.smithi083.stdout:5/405: write d4/d2b/d21/f6e [335878,23187] 0 2024-04-01T06:57:38.572 INFO:tasks.workunit.client.0.smithi083.stdout:1/622: creat db/d1c/d29/d33/d50/d5d/dad/dbf/fe0 x:0 0 0 2024-04-01T06:57:38.572 INFO:tasks.workunit.client.0.smithi083.stdout:4/440: dwrite d1/d4/f7b [0,4194304] 0 2024-04-01T06:57:38.572 INFO:tasks.workunit.client.0.smithi083.stdout:6/418: dread d9/d57/f6e [0,4194304] 0 2024-04-01T06:57:38.572 INFO:tasks.workunit.client.0.smithi083.stdout:0/518: creat d16/d99/d4b/d6e/fac x:0 0 0 2024-04-01T06:57:38.573 INFO:tasks.workunit.client.0.smithi083.stdout:0/519: dread - d16/d2e/d6c/d82/f87 zero size 2024-04-01T06:57:38.573 INFO:tasks.workunit.client.0.smithi083.stdout:0/520: stat d16/f62 0 2024-04-01T06:57:38.573 INFO:tasks.workunit.client.0.smithi083.stdout:0/521: write d16/d2e/d3d/f4e [4996502,103444] 0 2024-04-01T06:57:38.574 INFO:tasks.workunit.client.0.smithi083.stdout:8/527: creat d15/d18/fc1 x:0 0 0 2024-04-01T06:57:38.581 INFO:tasks.workunit.client.0.smithi083.stdout:5/406: rmdir d4/d9/d16/d19/d5e 39 2024-04-01T06:57:38.583 INFO:tasks.workunit.client.0.smithi083.stdout:1/623: creat db/d1c/d29/d33/d47/d76/db6/fe1 x:0 0 0 2024-04-01T06:57:38.583 INFO:tasks.workunit.client.0.smithi083.stdout:1/624: readlink db/d1c/d2e/d30/l31 0 2024-04-01T06:57:38.587 INFO:tasks.workunit.client.0.smithi083.stdout:4/441: creat d1/d4/da/f84 x:0 0 0 2024-04-01T06:57:38.587 INFO:tasks.workunit.client.0.smithi083.stdout:5/407: dread d4/d9/d16/d1f/d2f/d53/f66 [0,4194304] 0 2024-04-01T06:57:38.587 INFO:tasks.workunit.client.0.smithi083.stdout:6/419: mknod d9/dc/d29/d3c/d5c/d8b/c8f 0 2024-04-01T06:57:38.587 INFO:tasks.workunit.client.0.smithi083.stdout:6/420: dread - d9/dc/d1b/d39/f3a zero size 2024-04-01T06:57:38.588 INFO:tasks.workunit.client.0.smithi083.stdout:6/421: write f8 [2379079,46703] 0 2024-04-01T06:57:38.589 INFO:tasks.workunit.client.0.smithi083.stdout:0/522: rename d16/la4 to d16/d99/d4b/d68/d9d/lad 0 2024-04-01T06:57:38.590 INFO:tasks.workunit.client.0.smithi083.stdout:8/528: creat d15/d18/d19/d24/d44/fc2 x:0 0 0 2024-04-01T06:57:38.591 INFO:tasks.workunit.client.0.smithi083.stdout:8/529: read d15/d1b/d39/d48/d5e/d70/f86 [4029569,65319] 0 2024-04-01T06:57:38.591 INFO:tasks.workunit.client.0.smithi083.stdout:8/530: write d15/d21/f22 [4925014,44624] 0 2024-04-01T06:57:38.597 INFO:tasks.workunit.client.0.smithi083.stdout:5/408: getdents d4/d9/d4f 0 2024-04-01T06:57:38.600 INFO:tasks.workunit.client.0.smithi083.stdout:6/422: rmdir d9/dc/d1b/d4c 39 2024-04-01T06:57:38.602 INFO:tasks.workunit.client.0.smithi083.stdout:4/442: rename d1/c7d to d1/d8/d6a/c85 0 2024-04-01T06:57:38.602 INFO:tasks.workunit.client.0.smithi083.stdout:4/443: chown d1/d4/f68 29099 1 2024-04-01T06:57:38.604 INFO:tasks.workunit.client.0.smithi083.stdout:0/523: unlink d16/d99/f3c 0 2024-04-01T06:57:38.604 INFO:tasks.workunit.client.0.smithi083.stdout:0/524: readlink d16/d2e/d5b/d74/l7f 0 2024-04-01T06:57:38.604 INFO:tasks.workunit.client.0.smithi083.stdout:0/525: chown d16/d99/c48 1 1 2024-04-01T06:57:38.604 INFO:tasks.workunit.client.0.smithi083.stdout:0/526: read - d16/d99/d4b/d6e/f9f zero size 2024-04-01T06:57:38.604 INFO:tasks.workunit.client.0.smithi083.stdout:8/531: creat d15/d21/dbc/fc3 x:0 0 0 2024-04-01T06:57:38.607 INFO:tasks.workunit.client.0.smithi083.stdout:6/423: link d9/dc/d1b/d35/c59 d9/d8a/c90 0 2024-04-01T06:57:38.608 INFO:tasks.workunit.client.0.smithi083.stdout:4/444: creat d1/d4/db/d5b/d62/f86 x:0 0 0 2024-04-01T06:57:38.609 INFO:tasks.workunit.client.0.smithi083.stdout:0/527: rename d16/d99/d63/f93 to d16/d99/d4b/d6e/fae 0 2024-04-01T06:57:38.610 INFO:tasks.workunit.client.0.smithi083.stdout:6/424: creat d9/dc/d29/d3c/d5c/d8b/f91 x:0 0 0 2024-04-01T06:57:38.610 INFO:tasks.workunit.client.0.smithi083.stdout:8/532: dread d15/d18/f64 [4194304,4194304] 0 2024-04-01T06:57:38.611 INFO:tasks.workunit.client.0.smithi083.stdout:0/528: symlink d16/d99/d4b/d84/laf 0 2024-04-01T06:57:38.612 INFO:tasks.workunit.client.0.smithi083.stdout:8/533: mknod d15/d1b/d39/cc4 0 2024-04-01T06:57:38.613 INFO:tasks.workunit.client.0.smithi083.stdout:0/529: symlink d16/d99/d63/lb0 0 2024-04-01T06:57:38.614 INFO:tasks.workunit.client.0.smithi083.stdout:0/530: write d16/d2e/d3d/f40 [3073896,74825] 0 2024-04-01T06:57:38.615 INFO:tasks.workunit.client.0.smithi083.stdout:0/531: dread - d16/d2e/d3d/f59 zero size 2024-04-01T06:57:38.615 INFO:tasks.workunit.client.0.smithi083.stdout:0/532: dread - d16/f62 zero size 2024-04-01T06:57:38.615 INFO:tasks.workunit.client.0.smithi083.stdout:5/409: dwrite d4/d2b/f13 [0,4194304] 0 2024-04-01T06:57:38.615 INFO:tasks.workunit.client.0.smithi083.stdout:0/533: read d16/d2e/d3d/f4e [3178703,84782] 0 2024-04-01T06:57:38.615 INFO:tasks.workunit.client.0.smithi083.stdout:8/534: rename d15/d1b/d39/f8b to d15/d18/d19/d6c/fc5 0 2024-04-01T06:57:38.619 INFO:tasks.workunit.client.0.smithi083.stdout:4/445: dread d1/d4/db/f56 [0,4194304] 0 2024-04-01T06:57:38.625 INFO:tasks.workunit.client.0.smithi083.stdout:8/535: rmdir d15/d18/d19/d6c 39 2024-04-01T06:57:38.625 INFO:tasks.workunit.client.0.smithi083.stdout:8/536: dread - d15/d1b/d39/d48/f6e zero size 2024-04-01T06:57:38.627 INFO:tasks.workunit.client.0.smithi083.stdout:8/537: link d15/d1b/d39/d80/lb8 d15/d1b/d39/d48/d5e/lc6 0 2024-04-01T06:57:38.628 INFO:tasks.workunit.client.0.smithi083.stdout:8/538: dread d15/d18/d19/d24/d38/d62/f2e [0,4194304] 0 2024-04-01T06:57:38.629 INFO:tasks.workunit.client.0.smithi083.stdout:8/539: mknod d15/d18/d19/cc7 0 2024-04-01T06:57:38.630 INFO:tasks.workunit.client.0.smithi083.stdout:8/540: link d15/d18/d19/d24/d38/d62/f96 d15/d18/d19/d24/da2/d6f/fc8 0 2024-04-01T06:57:38.631 INFO:tasks.workunit.client.0.smithi083.stdout:8/541: creat d15/fc9 x:0 0 0 2024-04-01T06:57:38.631 INFO:tasks.workunit.client.0.smithi083.stdout:8/542: truncate d15/faa 2159106 0 2024-04-01T06:57:38.631 INFO:tasks.workunit.client.0.smithi083.stdout:8/543: fdatasync d15/d18/d19/d24/d38/d62/fc0 0 2024-04-01T06:57:38.631 INFO:tasks.workunit.client.0.smithi083.stdout:0/534: dread d16/f4c [0,4194304] 0 2024-04-01T06:57:38.632 INFO:tasks.workunit.client.0.smithi083.stdout:0/535: readlink d16/d99/d4b/d84/laf 0 2024-04-01T06:57:38.632 INFO:tasks.workunit.client.0.smithi083.stdout:8/544: creat d15/d1b/d39/d48/fca x:0 0 0 2024-04-01T06:57:38.633 INFO:tasks.workunit.client.0.smithi083.stdout:0/536: getdents d16 0 2024-04-01T06:57:38.633 INFO:tasks.workunit.client.0.smithi083.stdout:6/425: dwrite d9/dc/d1b/d35/f78 [0,4194304] 0 2024-04-01T06:57:38.634 INFO:tasks.workunit.client.0.smithi083.stdout:8/545: mkdir d15/d1b/dcb 0 2024-04-01T06:57:38.634 INFO:tasks.workunit.client.0.smithi083.stdout:0/537: getdents d16/d1d/d8d 0 2024-04-01T06:57:38.636 INFO:tasks.workunit.client.0.smithi083.stdout:4/446: dwrite d1/d4/db/f18 [0,4194304] 0 2024-04-01T06:57:38.636 INFO:tasks.workunit.client.0.smithi083.stdout:6/426: write d9/dc/d1b/d35/f64 [6563078,63000] 0 2024-04-01T06:57:38.636 INFO:tasks.workunit.client.0.smithi083.stdout:5/410: dwrite d4/f1b [0,4194304] 0 2024-04-01T06:57:38.638 INFO:tasks.workunit.client.0.smithi083.stdout:0/538: symlink d16/d1d/lb1 0 2024-04-01T06:57:38.638 INFO:tasks.workunit.client.0.smithi083.stdout:0/539: dread - d16/d99/d4b/f94 zero size 2024-04-01T06:57:38.638 INFO:tasks.workunit.client.0.smithi083.stdout:0/540: stat d16/d1d/l35 0 2024-04-01T06:57:38.642 INFO:tasks.workunit.client.0.smithi083.stdout:4/447: unlink d1/d4/db/c17 0 2024-04-01T06:57:38.646 INFO:tasks.workunit.client.0.smithi083.stdout:0/541: creat d16/d2e/d3d/d7c/fb2 x:0 0 0 2024-04-01T06:57:38.647 INFO:tasks.workunit.client.0.smithi083.stdout:0/542: write d16/d99/d4b/d6e/fae [2082185,88826] 0 2024-04-01T06:57:38.647 INFO:tasks.workunit.client.0.smithi083.stdout:6/427: rename l7 to d9/dc/d1b/d35/d48/d52/l92 0 2024-04-01T06:57:38.649 INFO:tasks.workunit.client.0.smithi083.stdout:5/411: dwrite d4/d23/d4e/f57 [0,4194304] 0 2024-04-01T06:57:38.649 INFO:tasks.workunit.client.0.smithi083.stdout:5/412: truncate d4/d9/d16/d1f/d2f/f59 1409718 0 2024-04-01T06:57:38.649 INFO:tasks.workunit.client.0.smithi083.stdout:5/413: read - d4/d23/f75 zero size 2024-04-01T06:57:38.650 INFO:tasks.workunit.client.0.smithi083.stdout:0/543: creat d16/d99/fb3 x:0 0 0 2024-04-01T06:57:38.652 INFO:tasks.workunit.client.0.smithi083.stdout:6/428: getdents d9/dc/d1b/d39/d47 0 2024-04-01T06:57:38.652 INFO:tasks.workunit.client.0.smithi083.stdout:6/429: chown d9/dc/d1b/d4c/f74 2243 1 2024-04-01T06:57:38.652 INFO:tasks.workunit.client.0.smithi083.stdout:6/430: chown f6 62847414 1 2024-04-01T06:57:38.652 INFO:tasks.workunit.client.0.smithi083.stdout:8/546: dwrite d15/d18/d19/d24/d38/d62/f2e [0,4194304] 0 2024-04-01T06:57:38.653 INFO:tasks.workunit.client.0.smithi083.stdout:8/547: write d15/d18/d19/d24/da2/d6f/fc8 [4262126,100253] 0 2024-04-01T06:57:38.655 INFO:tasks.workunit.client.0.smithi083.stdout:5/414: truncate d4/d2b/f54 3807249 0 2024-04-01T06:57:38.655 INFO:tasks.workunit.client.0.smithi083.stdout:0/544: rename d16/c31 to d16/d2e/d5b/cb4 0 2024-04-01T06:57:38.656 INFO:tasks.workunit.client.0.smithi083.stdout:4/448: dwrite d1/d47/d2a/f36 [0,4194304] 0 2024-04-01T06:57:38.656 INFO:tasks.workunit.client.0.smithi083.stdout:4/449: chown d1/d4/db/f54 205 1 2024-04-01T06:57:38.656 INFO:tasks.workunit.client.0.smithi083.stdout:4/450: write d1/d4/db/d5b/d62/f86 [768838,8477] 0 2024-04-01T06:57:38.666 INFO:tasks.workunit.client.0.smithi083.stdout:6/431: rename d9/dc/d29/d3c/d45/c6d to d9/c93 0 2024-04-01T06:57:38.668 INFO:tasks.workunit.client.0.smithi083.stdout:5/415: mkdir d4/d23/d4e/d83 0 2024-04-01T06:57:38.669 INFO:tasks.workunit.client.0.smithi083.stdout:0/545: symlink d16/d2e/d3d/d7c/lb5 0 2024-04-01T06:57:38.669 INFO:tasks.workunit.client.0.smithi083.stdout:0/546: readlink d16/d2e/d5b/d74/l7f 0 2024-04-01T06:57:38.669 INFO:tasks.workunit.client.0.smithi083.stdout:0/547: write d16/d1d/f2b [1966994,59921] 0 2024-04-01T06:57:38.670 INFO:tasks.workunit.client.0.smithi083.stdout:4/451: dread d1/d8/f5e [0,4194304] 0 2024-04-01T06:57:38.672 INFO:tasks.workunit.client.0.smithi083.stdout:8/548: dwrite d15/f67 [0,4194304] 0 2024-04-01T06:57:38.673 INFO:tasks.workunit.client.0.smithi083.stdout:6/432: unlink d9/f21 0 2024-04-01T06:57:38.674 INFO:tasks.workunit.client.0.smithi083.stdout:7/402: sync 2024-04-01T06:57:38.674 INFO:tasks.workunit.client.0.smithi083.stdout:2/485: sync 2024-04-01T06:57:38.674 INFO:tasks.workunit.client.0.smithi083.stdout:3/556: sync 2024-04-01T06:57:38.675 INFO:tasks.workunit.client.0.smithi083.stdout:5/416: creat d4/d9/f84 x:0 0 0 2024-04-01T06:57:38.677 INFO:tasks.workunit.client.0.smithi083.stdout:0/548: rename d16/d99/d63/lb0 to d16/d2e/d6c/lb6 0 2024-04-01T06:57:38.677 INFO:tasks.workunit.client.0.smithi083.stdout:0/549: write d16/d2e/d3d/f8f [4792,11915] 0 2024-04-01T06:57:38.678 INFO:tasks.workunit.client.0.smithi083.stdout:0/550: write d16/d2e/d5b/f6f [6448163,12590] 0 2024-04-01T06:57:38.678 INFO:tasks.workunit.client.0.smithi083.stdout:0/551: fdatasync d16/d2e/d6c/f85 0 2024-04-01T06:57:38.679 INFO:tasks.workunit.client.0.smithi083.stdout:4/452: unlink d1/l5d 0 2024-04-01T06:57:38.679 INFO:tasks.workunit.client.0.smithi083.stdout:4/453: fsync d1/d4/da/f84 0 2024-04-01T06:57:38.679 INFO:tasks.workunit.client.0.smithi083.stdout:4/454: fsync d1/d47/d2a/f31 0 2024-04-01T06:57:38.681 INFO:tasks.workunit.client.0.smithi083.stdout:3/557: dread d6/d1e/f39 [0,4194304] 0 2024-04-01T06:57:38.681 INFO:tasks.workunit.client.0.smithi083.stdout:3/558: fsync d6/d15/d2d/d2f/f9e 0 2024-04-01T06:57:38.682 INFO:tasks.workunit.client.0.smithi083.stdout:3/559: dread d6/d15/d2d/d2f/d42/d46/d55/f79 [0,4194304] 0 2024-04-01T06:57:38.682 INFO:tasks.workunit.client.0.smithi083.stdout:3/560: chown d6/d15/d2d/d2f/d42 28023 1 2024-04-01T06:57:38.685 INFO:tasks.workunit.client.0.smithi083.stdout:8/549: unlink d15/d18/d19/d1d/c40 0 2024-04-01T06:57:38.687 INFO:tasks.workunit.client.0.smithi083.stdout:6/433: symlink d9/dc/d29/d3c/d5c/d8b/l94 0 2024-04-01T06:57:38.689 INFO:tasks.workunit.client.0.smithi083.stdout:2/486: mkdir d3/d26/d59/d2b/da3 0 2024-04-01T06:57:38.691 INFO:tasks.workunit.client.0.smithi083.stdout:5/417: link d4/l2d d4/d9/d4f/d68/l85 0 2024-04-01T06:57:38.694 INFO:tasks.workunit.client.0.smithi083.stdout:0/552: symlink d16/d2e/d5b/lb7 0 2024-04-01T06:57:38.695 INFO:tasks.workunit.client.0.smithi083.stdout:4/455: creat d1/f87 x:0 0 0 2024-04-01T06:57:38.696 INFO:tasks.workunit.client.0.smithi083.stdout:1/625: sync 2024-04-01T06:57:38.696 INFO:tasks.workunit.client.0.smithi083.stdout:9/460: sync 2024-04-01T06:57:38.697 INFO:tasks.workunit.client.0.smithi083.stdout:3/561: truncate d6/d15/f5f 933540 0 2024-04-01T06:57:38.698 INFO:tasks.workunit.client.0.smithi083.stdout:1/626: dread db/fd [0,4194304] 0 2024-04-01T06:57:38.699 INFO:tasks.workunit.client.0.smithi083.stdout:8/550: unlink d15/l16 0 2024-04-01T06:57:38.699 INFO:tasks.workunit.client.0.smithi083.stdout:8/551: dread - d15/d18/d19/d24/d38/d62/f4a zero size 2024-04-01T06:57:38.703 INFO:tasks.workunit.client.0.smithi083.stdout:6/434: creat d9/dc/d29/d3c/f95 x:0 0 0 2024-04-01T06:57:38.703 INFO:tasks.workunit.client.0.smithi083.stdout:8/552: dread d15/d18/d19/f30 [0,4194304] 0 2024-04-01T06:57:38.703 INFO:tasks.workunit.client.0.smithi083.stdout:2/487: creat d3/d8b/d53/d66/fa4 x:0 0 0 2024-04-01T06:57:38.706 INFO:tasks.workunit.client.0.smithi083.stdout:5/418: dwrite d4/fa [8388608,4194304] 0 2024-04-01T06:57:38.706 INFO:tasks.workunit.client.0.smithi083.stdout:5/419: getdents d4/d23/d49/d7f 0 2024-04-01T06:57:38.707 INFO:tasks.workunit.client.0.smithi083.stdout:0/553: creat d16/d99/d4b/d84/fb8 x:0 0 0 2024-04-01T06:57:38.708 INFO:tasks.workunit.client.0.smithi083.stdout:4/456: mkdir d1/d4/da/d88 0 2024-04-01T06:57:38.710 INFO:tasks.workunit.client.0.smithi083.stdout:9/461: symlink d6/d29/l9c 0 2024-04-01T06:57:38.711 INFO:tasks.workunit.client.0.smithi083.stdout:7/403: rename d0/d4/d9/d4e to d0/d4/d9/d39/d67/d6d/d87 0 2024-04-01T06:57:38.711 INFO:tasks.workunit.client.0.smithi083.stdout:7/404: readlink d0/d4/d9/l3d 0 2024-04-01T06:57:38.712 INFO:tasks.workunit.client.0.smithi083.stdout:3/562: mknod d6/d15/d2d/d2f/d42/d83/cbd 0 2024-04-01T06:57:38.712 INFO:tasks.workunit.client.0.smithi083.stdout:3/563: chown d6/d15/d2d/d2f/d42/l73 121172 1 2024-04-01T06:57:38.714 INFO:tasks.workunit.client.0.smithi083.stdout:1/627: mknod db/d1c/d1d/d8b/ce2 0 2024-04-01T06:57:38.714 INFO:tasks.workunit.client.0.smithi083.stdout:8/553: dwrite d15/d18/d1e/f5b [4194304,4194304] 0 2024-04-01T06:57:38.715 INFO:tasks.workunit.client.0.smithi083.stdout:0/554: mknod d16/d2e/d3d/da9/cb9 0 2024-04-01T06:57:38.715 INFO:tasks.workunit.client.0.smithi083.stdout:0/555: fsync f14 0 2024-04-01T06:57:38.716 INFO:tasks.workunit.client.0.smithi083.stdout:4/457: mkdir d1/d4/d33/d89 0 2024-04-01T06:57:38.717 INFO:tasks.workunit.client.0.smithi083.stdout:9/462: truncate d6/d32/d3c/d4c/d6b/f5d 1969497 0 2024-04-01T06:57:38.719 INFO:tasks.workunit.client.0.smithi083.stdout:2/488: rename d3/d8b/d53/d68/l62 to d3/d26/d59/d2b/da3/la5 0 2024-04-01T06:57:38.719 INFO:tasks.workunit.client.0.smithi083.stdout:2/489: chown d3/d8b/l8f 1099172 1 2024-04-01T06:57:38.721 INFO:tasks.workunit.client.0.smithi083.stdout:3/564: truncate f3 2243946 0 2024-04-01T06:57:38.721 INFO:tasks.workunit.client.0.smithi083.stdout:3/565: dread - d6/d15/d2d/d2f/d42/f76 zero size 2024-04-01T06:57:38.721 INFO:tasks.workunit.client.0.smithi083.stdout:3/566: chown d6/d12 295 1 2024-04-01T06:57:38.725 INFO:tasks.workunit.client.0.smithi083.stdout:1/628: getdents db/d1c/d29/d33/d50/d5d 0 2024-04-01T06:57:38.725 INFO:tasks.workunit.client.0.smithi083.stdout:1/629: write db/d1c/d1d/f4c [3589878,86540] 0 2024-04-01T06:57:38.725 INFO:tasks.workunit.client.0.smithi083.stdout:1/630: chown db/d1c/d29/d33/d50/d5d/d6c/d8e/l9f 160836438 1 2024-04-01T06:57:38.726 INFO:tasks.workunit.client.0.smithi083.stdout:7/405: dwrite d0/d4/f16 [4194304,4194304] 0 2024-04-01T06:57:38.726 INFO:tasks.workunit.client.0.smithi083.stdout:7/406: write d0/d4/d9/d39/d48/f85 [655574,111761] 0 2024-04-01T06:57:38.729 INFO:tasks.workunit.client.0.smithi083.stdout:6/435: mknod d9/dc/d29/d3c/c96 0 2024-04-01T06:57:38.729 INFO:tasks.workunit.client.0.smithi083.stdout:6/436: stat d9/dc/d1b/d35 0 2024-04-01T06:57:38.729 INFO:tasks.workunit.client.0.smithi083.stdout:6/437: dread - d9/dc/f83 zero size 2024-04-01T06:57:38.729 INFO:tasks.workunit.client.0.smithi083.stdout:6/438: dread - d9/dc/d1b/d39/d68/f75 zero size 2024-04-01T06:57:38.731 INFO:tasks.workunit.client.0.smithi083.stdout:4/458: dwrite d1/d4/da/f83 [0,4194304] 0 2024-04-01T06:57:38.732 INFO:tasks.workunit.client.0.smithi083.stdout:5/420: mknod d4/c86 0 2024-04-01T06:57:38.732 INFO:tasks.workunit.client.0.smithi083.stdout:5/421: chown d4/d23/f75 3617 1 2024-04-01T06:57:38.733 INFO:tasks.workunit.client.0.smithi083.stdout:0/556: mkdir d16/d2e/dba 0 2024-04-01T06:57:38.734 INFO:tasks.workunit.client.0.smithi083.stdout:9/463: mkdir d6/d32/d3c/d3d/d9d 0 2024-04-01T06:57:38.735 INFO:tasks.workunit.client.0.smithi083.stdout:2/490: rename d3/d20/d42/c95 to d3/d20/d42/ca6 0 2024-04-01T06:57:38.737 INFO:tasks.workunit.client.0.smithi083.stdout:3/567: creat d6/d15/d2d/d2f/d42/fbe x:0 0 0 2024-04-01T06:57:38.738 INFO:tasks.workunit.client.0.smithi083.stdout:3/568: write d6/d15/f5f [338950,96959] 0 2024-04-01T06:57:38.738 INFO:tasks.workunit.client.0.smithi083.stdout:3/569: read - d6/d15/d2d/d2f/d3e/d74/f75 zero size 2024-04-01T06:57:38.739 INFO:tasks.workunit.client.0.smithi083.stdout:1/631: mknod db/d1c/d49/ce3 0 2024-04-01T06:57:38.739 INFO:tasks.workunit.client.0.smithi083.stdout:1/632: stat db/d61/c68 0 2024-04-01T06:57:38.739 INFO:tasks.workunit.client.0.smithi083.stdout:3/570: write d6/fb [942135,95784] 0 2024-04-01T06:57:38.740 INFO:tasks.workunit.client.0.smithi083.stdout:8/554: creat d15/d18/d19/d24/da2/fcc x:0 0 0 2024-04-01T06:57:38.742 INFO:tasks.workunit.client.0.smithi083.stdout:7/407: mknod d0/d4/d9/d39/d67/d6d/d87/d83/d34/c88 0 2024-04-01T06:57:38.743 INFO:tasks.workunit.client.0.smithi083.stdout:6/439: symlink d9/dc/d1b/d35/d48/d52/l97 0 2024-04-01T06:57:38.743 INFO:tasks.workunit.client.0.smithi083.stdout:6/440: write d9/dc/f83 [974300,25574] 0 2024-04-01T06:57:38.744 INFO:tasks.workunit.client.0.smithi083.stdout:5/422: dwrite d4/d9/f84 [0,4194304] 0 2024-04-01T06:57:38.749 INFO:tasks.workunit.client.0.smithi083.stdout:4/459: mknod d1/d4/da/c8a 0 2024-04-01T06:57:38.750 INFO:tasks.workunit.client.0.smithi083.stdout:0/557: mkdir d16/d1d/dbb 0 2024-04-01T06:57:38.750 INFO:tasks.workunit.client.0.smithi083.stdout:9/464: link d6/d32/d26/d2d/c68 d6/c9e 0 2024-04-01T06:57:38.750 INFO:tasks.workunit.client.0.smithi083.stdout:2/491: mknod d3/d8b/d53/ca7 0 2024-04-01T06:57:38.751 INFO:tasks.workunit.client.0.smithi083.stdout:1/633: rename db/d1c/d29/d33/d50/d4d/d73 to db/d1c/d29/d33/d47/de4 0 2024-04-01T06:57:38.752 INFO:tasks.workunit.client.0.smithi083.stdout:3/571: truncate f2 588677 0 2024-04-01T06:57:38.754 INFO:tasks.workunit.client.0.smithi083.stdout:6/441: unlink d9/dc/d1b/c1c 0 2024-04-01T06:57:38.757 INFO:tasks.workunit.client.0.smithi083.stdout:5/423: unlink d4/d2b/c45 0 2024-04-01T06:57:38.757 INFO:tasks.workunit.client.0.smithi083.stdout:8/555: dwrite d15/d1b/d39/d48/d5e/d70/f86 [4194304,4194304] 0 2024-04-01T06:57:38.757 INFO:tasks.workunit.client.0.smithi083.stdout:8/556: fsync d15/d1b/d39/d48/d5e/d70/f8e 0 2024-04-01T06:57:38.758 INFO:tasks.workunit.client.0.smithi083.stdout:4/460: getdents d1/d8/d6a 0 2024-04-01T06:57:38.760 INFO:tasks.workunit.client.0.smithi083.stdout:7/408: dwrite d0/f37 [0,4194304] 0 2024-04-01T06:57:38.760 INFO:tasks.workunit.client.0.smithi083.stdout:2/492: link d3/d26/d59/d2b/l48 d3/d26/d59/la8 0 2024-04-01T06:57:38.761 INFO:tasks.workunit.client.0.smithi083.stdout:0/558: dread d16/d1d/f23 [0,4194304] 0 2024-04-01T06:57:38.761 INFO:tasks.workunit.client.0.smithi083.stdout:1/634: mkdir db/d61/de5 0 2024-04-01T06:57:38.762 INFO:tasks.workunit.client.0.smithi083.stdout:0/559: write d16/f34 [42472,34581] 0 2024-04-01T06:57:38.765 INFO:tasks.workunit.client.0.smithi083.stdout:5/424: mknod d4/d23/d49/c87 0 2024-04-01T06:57:38.766 INFO:tasks.workunit.client.0.smithi083.stdout:5/425: dread d4/d9/d16/d1f/f48 [4194304,4194304] 0 2024-04-01T06:57:38.769 INFO:tasks.workunit.client.0.smithi083.stdout:6/442: dwrite d9/dc/f30 [8388608,4194304] 0 2024-04-01T06:57:38.769 INFO:tasks.workunit.client.0.smithi083.stdout:8/557: mkdir d15/d21/dcd 0 2024-04-01T06:57:38.769 INFO:tasks.workunit.client.0.smithi083.stdout:8/558: write d15/d21/f51 [3392390,87961] 0 2024-04-01T06:57:38.777 INFO:tasks.workunit.client.0.smithi083.stdout:9/465: rename d6/d32/d26/d2d/d6e/c7c to d6/d32/d26/d2d/c9f 0 2024-04-01T06:57:38.777 INFO:tasks.workunit.client.0.smithi083.stdout:2/493: dwrite d3/d8b/d53/d66/f8c [0,4194304] 0 2024-04-01T06:57:38.779 INFO:tasks.workunit.client.0.smithi083.stdout:9/466: dread d6/d32/d3c/f6a [0,4194304] 0 2024-04-01T06:57:38.780 INFO:tasks.workunit.client.0.smithi083.stdout:9/467: chown d6/d32/d3c/l41 383228 1 2024-04-01T06:57:38.780 INFO:tasks.workunit.client.0.smithi083.stdout:1/635: symlink db/d1c/d29/d33/d47/d76/le6 0 2024-04-01T06:57:38.784 INFO:tasks.workunit.client.0.smithi083.stdout:4/461: dwrite d1/d8/f63 [0,4194304] 0 2024-04-01T06:57:38.784 INFO:tasks.workunit.client.0.smithi083.stdout:5/426: creat d4/d23/d49/f88 x:0 0 0 2024-04-01T06:57:38.784 INFO:tasks.workunit.client.0.smithi083.stdout:0/560: dwrite d16/d1d/f25 [4194304,4194304] 0 2024-04-01T06:57:38.786 INFO:tasks.workunit.client.0.smithi083.stdout:6/443: link d9/dc/d1b/d4c/l79 d9/d57/l98 0 2024-04-01T06:57:38.790 INFO:tasks.workunit.client.0.smithi083.stdout:6/444: write d9/dc/f25 [3565948,49318] 0 2024-04-01T06:57:38.790 INFO:tasks.workunit.client.0.smithi083.stdout:8/559: link d15/d18/d19/d24/d38/d62/f2e d15/d18/d19/d24/da2/d9a/fce 0 2024-04-01T06:57:38.790 INFO:tasks.workunit.client.0.smithi083.stdout:0/561: dread d16/f34 [0,4194304] 0 2024-04-01T06:57:38.790 INFO:tasks.workunit.client.0.smithi083.stdout:7/409: rename d0/d4b to d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89 0 2024-04-01T06:57:38.790 INFO:tasks.workunit.client.0.smithi083.stdout:1/636: rename db to db/d1c/d1d/db4/ddf/de7 22 2024-04-01T06:57:38.791 INFO:tasks.workunit.client.0.smithi083.stdout:1/637: getdents db/d1c/d2e/d30 0 2024-04-01T06:57:38.792 INFO:tasks.workunit.client.0.smithi083.stdout:2/494: creat d3/d71/d81/fa9 x:0 0 0 2024-04-01T06:57:38.795 INFO:tasks.workunit.client.0.smithi083.stdout:4/462: creat d1/d4/db/d5b/d62/f8b x:0 0 0 2024-04-01T06:57:38.795 INFO:tasks.workunit.client.0.smithi083.stdout:4/463: fdatasync d1/d47/d2a/f2f 0 2024-04-01T06:57:38.796 INFO:tasks.workunit.client.0.smithi083.stdout:6/445: rmdir d9/dc/d29/d3c 39 2024-04-01T06:57:38.798 INFO:tasks.workunit.client.0.smithi083.stdout:0/562: creat d16/d2e/d6c/d82/fbc x:0 0 0 2024-04-01T06:57:38.798 INFO:tasks.workunit.client.0.smithi083.stdout:0/563: fdatasync d16/d99/d4b/d68/f86 0 2024-04-01T06:57:38.798 INFO:tasks.workunit.client.0.smithi083.stdout:5/427: dwrite d4/d2b/f24 [0,4194304] 0 2024-04-01T06:57:38.800 INFO:tasks.workunit.client.0.smithi083.stdout:8/560: rename d15/d18/d19/d24/da2/d6f/fa0 to d15/d1b/fcf 0 2024-04-01T06:57:38.803 INFO:tasks.workunit.client.0.smithi083.stdout:7/410: mkdir d0/d4/d9/d39/d67/d6d/d7d/d8a 0 2024-04-01T06:57:38.803 INFO:tasks.workunit.client.0.smithi083.stdout:7/411: write d0/d4/d9/d39/d67/d6d/d87/d83/f53 [1135885,29308] 0 2024-04-01T06:57:38.804 INFO:tasks.workunit.client.0.smithi083.stdout:1/638: getdents db 0 2024-04-01T06:57:38.805 INFO:tasks.workunit.client.0.smithi083.stdout:6/446: dread d9/dc/d1b/f41 [0,4194304] 0 2024-04-01T06:57:38.805 INFO:tasks.workunit.client.0.smithi083.stdout:2/495: mknod d3/d26/d59/d2b/d9f/caa 0 2024-04-01T06:57:38.806 INFO:tasks.workunit.client.0.smithi083.stdout:4/464: creat d1/d4/db/d5b/f8c x:0 0 0 2024-04-01T06:57:38.807 INFO:tasks.workunit.client.0.smithi083.stdout:4/465: write d1/d47/d2a/f2e [2260727,26268] 0 2024-04-01T06:57:38.807 INFO:tasks.workunit.client.0.smithi083.stdout:4/466: fsync d1/d4/db/d5b/d62/f8b 0 2024-04-01T06:57:38.808 INFO:tasks.workunit.client.0.smithi083.stdout:0/564: symlink d16/d2e/d6c/d82/lbd 0 2024-04-01T06:57:38.808 INFO:tasks.workunit.client.0.smithi083.stdout:0/565: chown d16/cab 738666686 1 2024-04-01T06:57:38.808 INFO:tasks.workunit.client.0.smithi083.stdout:5/428: mknod d4/d23/d67/c89 0 2024-04-01T06:57:38.809 INFO:tasks.workunit.client.0.smithi083.stdout:5/429: chown d4/d9/d16/d1f/d2f/c3c 5415469 1 2024-04-01T06:57:38.810 INFO:tasks.workunit.client.0.smithi083.stdout:8/561: rename c11 to d15/d1b/d39/cd0 0 2024-04-01T06:57:38.811 INFO:tasks.workunit.client.0.smithi083.stdout:1/639: dread db/d1c/d1d/f20 [0,4194304] 0 2024-04-01T06:57:38.812 INFO:tasks.workunit.client.0.smithi083.stdout:6/447: mkdir d9/dc/d1b/d4c/d99 0 2024-04-01T06:57:38.812 INFO:tasks.workunit.client.0.smithi083.stdout:0/566: stat d16/d99/d4b/c53 0 2024-04-01T06:57:38.813 INFO:tasks.workunit.client.0.smithi083.stdout:0/567: fsync d16/d1d/f37 0 2024-04-01T06:57:38.813 INFO:tasks.workunit.client.0.smithi083.stdout:0/568: write f7 [7110992,51137] 0 2024-04-01T06:57:38.814 INFO:tasks.workunit.client.0.smithi083.stdout:5/430: mkdir d4/d9/d16/d8a 0 2024-04-01T06:57:38.815 INFO:tasks.workunit.client.0.smithi083.stdout:2/496: rename d3/d8b/d53/d66/fa4 to d3/d20/d42/fab 0 2024-04-01T06:57:38.816 INFO:tasks.workunit.client.0.smithi083.stdout:7/412: symlink d0/l8b 0 2024-04-01T06:57:38.816 INFO:tasks.workunit.client.0.smithi083.stdout:1/640: symlink db/d1c/d29/d33/d50/d5d/d6c/d8e/le8 0 2024-04-01T06:57:38.817 INFO:tasks.workunit.client.0.smithi083.stdout:6/448: stat d9/dc/d1b/d35/c59 0 2024-04-01T06:57:38.817 INFO:tasks.workunit.client.0.smithi083.stdout:6/449: stat d9/dc/f40 0 2024-04-01T06:57:38.819 INFO:tasks.workunit.client.0.smithi083.stdout:5/431: mknod d4/d9/d16/d1f/d2f/d53/c8b 0 2024-04-01T06:57:38.820 INFO:tasks.workunit.client.0.smithi083.stdout:2/497: unlink d3/d8b/d53/d5e/ca1 0 2024-04-01T06:57:38.820 INFO:tasks.workunit.client.0.smithi083.stdout:2/498: write d3/d8b/d53/d5e/f7b [788600,98042] 0 2024-04-01T06:57:38.821 INFO:tasks.workunit.client.0.smithi083.stdout:4/467: dwrite d1/d47/f70 [0,4194304] 0 2024-04-01T06:57:38.821 INFO:tasks.workunit.client.0.smithi083.stdout:0/569: rename d16/d99/d4b/d95/ca3 to d16/d2e/d3d/da9/cbe 0 2024-04-01T06:57:38.822 INFO:tasks.workunit.client.0.smithi083.stdout:1/641: mkdir db/d1c/d1d/db4/ddf/de9 0 2024-04-01T06:57:38.822 INFO:tasks.workunit.client.0.smithi083.stdout:6/450: symlink d9/dc/d3b/l9a 0 2024-04-01T06:57:38.823 INFO:tasks.workunit.client.0.smithi083.stdout:6/451: readlink d9/l12 0 2024-04-01T06:57:38.823 INFO:tasks.workunit.client.0.smithi083.stdout:6/452: write d9/dc/f7e [796036,127994] 0 2024-04-01T06:57:38.823 INFO:tasks.workunit.client.0.smithi083.stdout:5/432: link d4/d9/d16/d1f/f69 d4/d71/d7d/f8c 0 2024-04-01T06:57:38.824 INFO:tasks.workunit.client.0.smithi083.stdout:4/468: dread d1/d4/db/d5b/f69 [0,4194304] 0 2024-04-01T06:57:38.824 INFO:tasks.workunit.client.0.smithi083.stdout:2/499: symlink d3/d71/d81/lac 0 2024-04-01T06:57:38.825 INFO:tasks.workunit.client.0.smithi083.stdout:4/469: write d1/d47/f70 [3905553,86401] 0 2024-04-01T06:57:38.827 INFO:tasks.workunit.client.0.smithi083.stdout:6/453: creat d9/d8a/f9b x:0 0 0 2024-04-01T06:57:38.829 INFO:tasks.workunit.client.0.smithi083.stdout:1/642: dread f1 [0,4194304] 0 2024-04-01T06:57:38.829 INFO:tasks.workunit.client.0.smithi083.stdout:1/643: fdatasync db/d1c/d2e/f34 0 2024-04-01T06:57:38.829 INFO:tasks.workunit.client.0.smithi083.stdout:1/644: write db/d1c/d29/d33/d50/f27 [4700374,15410] 0 2024-04-01T06:57:38.830 INFO:tasks.workunit.client.0.smithi083.stdout:5/433: mkdir d4/d71/d8d 0 2024-04-01T06:57:38.830 INFO:tasks.workunit.client.0.smithi083.stdout:4/470: mknod d1/d8/d6a/c8d 0 2024-04-01T06:57:38.831 INFO:tasks.workunit.client.0.smithi083.stdout:1/645: mknod db/d1c/d29/d33/d50/d5d/d6c/ddb/cea 0 2024-04-01T06:57:38.833 INFO:tasks.workunit.client.0.smithi083.stdout:5/434: symlink d4/d9/d4f/d68/l8e 0 2024-04-01T06:57:38.833 INFO:tasks.workunit.client.0.smithi083.stdout:5/435: fdatasync d4/f4a 0 2024-04-01T06:57:38.833 INFO:tasks.workunit.client.0.smithi083.stdout:7/413: dwrite d0/d4/d9/d39/d67/d6d/d87/d83/d34/f6a [0,4194304] 0 2024-04-01T06:57:38.835 INFO:tasks.workunit.client.0.smithi083.stdout:4/471: rename d1/d4/db/d5b/l75 to d1/d8/d42/l8e 0 2024-04-01T06:57:38.836 INFO:tasks.workunit.client.0.smithi083.stdout:5/436: dread d4/d2b/f31 [0,4194304] 0 2024-04-01T06:57:38.840 INFO:tasks.workunit.client.0.smithi083.stdout:7/414: unlink d0/d4/d9/d39/d67/f82 0 2024-04-01T06:57:38.842 INFO:tasks.workunit.client.0.smithi083.stdout:4/472: symlink d1/d4/db/d5b/d62/l8f 0 2024-04-01T06:57:38.842 INFO:tasks.workunit.client.0.smithi083.stdout:4/473: stat d1/d4/da/f83 0 2024-04-01T06:57:38.843 INFO:tasks.workunit.client.0.smithi083.stdout:0/570: dwrite d16/d99/fa8 [0,4194304] 0 2024-04-01T06:57:38.847 INFO:tasks.workunit.client.0.smithi083.stdout:7/415: rename d0/d4/d9/d39/d67/d6d/d87/d83/l79 to d0/d7a/l8c 0 2024-04-01T06:57:38.852 INFO:tasks.workunit.client.0.smithi083.stdout:7/416: mknod d0/d4/d9/d39/d67/d6d/d7d/c8d 0 2024-04-01T06:57:38.855 INFO:tasks.workunit.client.0.smithi083.stdout:2/500: dwrite d3/d8b/d53/d5e/fa2 [0,4194304] 0 2024-04-01T06:57:38.855 INFO:tasks.workunit.client.0.smithi083.stdout:1/646: dread f1 [0,4194304] 0 2024-04-01T06:57:38.855 INFO:tasks.workunit.client.0.smithi083.stdout:7/417: link d0/d4/d9/d39/d67/d6d/d87/d83/d62/f6c d0/d4/d9/d39/d67/d6d/d87/d83/d62/f8e 0 2024-04-01T06:57:38.856 INFO:tasks.workunit.client.0.smithi083.stdout:7/418: read d0/d4/d9/d39/d67/d6d/d87/d83/f2d [4167859,12110] 0 2024-04-01T06:57:38.860 INFO:tasks.workunit.client.0.smithi083.stdout:5/437: dwrite d4/d9/d16/d1f/d2f/d53/f70 [0,4194304] 0 2024-04-01T06:57:38.860 INFO:tasks.workunit.client.0.smithi083.stdout:6/454: dwrite d9/dc/d1b/d39/f60 [0,4194304] 0 2024-04-01T06:57:38.861 INFO:tasks.workunit.client.0.smithi083.stdout:2/501: dread d3/d4d/f4f [0,4194304] 0 2024-04-01T06:57:38.861 INFO:tasks.workunit.client.0.smithi083.stdout:2/502: readlink d3/l38 0 2024-04-01T06:57:38.864 INFO:tasks.workunit.client.0.smithi083.stdout:7/419: creat d0/d4/d9/d39/d67/d6d/d87/f8f x:0 0 0 2024-04-01T06:57:38.870 INFO:tasks.workunit.client.0.smithi083.stdout:5/438: symlink d4/d9/d16/l8f 0 2024-04-01T06:57:38.872 INFO:tasks.workunit.client.0.smithi083.stdout:1/647: dwrite db/d1c/d29/d33/d50/fba [0,4194304] 0 2024-04-01T06:57:38.873 INFO:tasks.workunit.client.0.smithi083.stdout:6/455: mkdir d9/dc/d1b/d35/d48/d52/d9c 0 2024-04-01T06:57:38.873 INFO:tasks.workunit.client.0.smithi083.stdout:6/456: stat d9/la 0 2024-04-01T06:57:38.873 INFO:tasks.workunit.client.0.smithi083.stdout:6/457: truncate d9/dc/d29/d3c/d5c/f63 432177 0 2024-04-01T06:57:38.874 INFO:tasks.workunit.client.0.smithi083.stdout:6/458: chown d9/d57/f6e 286994 1 2024-04-01T06:57:38.874 INFO:tasks.workunit.client.0.smithi083.stdout:7/420: creat d0/d4/d9/d39/f90 x:0 0 0 2024-04-01T06:57:38.875 INFO:tasks.workunit.client.0.smithi083.stdout:5/439: mknod d4/d9/d16/d19/d5e/c90 0 2024-04-01T06:57:38.879 INFO:tasks.workunit.client.0.smithi083.stdout:2/503: dwrite d3/d26/d59/d2b/f82 [4194304,4194304] 0 2024-04-01T06:57:38.879 INFO:tasks.workunit.client.0.smithi083.stdout:1/648: creat db/d1c/d1d/db4/ddf/de9/feb x:0 0 0 2024-04-01T06:57:38.880 INFO:tasks.workunit.client.0.smithi083.stdout:6/459: mkdir d9/dc/d9d 0 2024-04-01T06:57:38.880 INFO:tasks.workunit.client.0.smithi083.stdout:6/460: dread - d9/dc/d29/d3c/f95 zero size 2024-04-01T06:57:38.881 INFO:tasks.workunit.client.0.smithi083.stdout:7/421: rmdir d0/d4/d9/d39/d48 39 2024-04-01T06:57:38.884 INFO:tasks.workunit.client.0.smithi083.stdout:2/504: mkdir d3/d26/d59/dad 0 2024-04-01T06:57:38.884 INFO:tasks.workunit.client.0.smithi083.stdout:2/505: fsync d3/d20/d42/fab 0 2024-04-01T06:57:38.885 INFO:tasks.workunit.client.0.smithi083.stdout:1/649: creat db/d1c/d29/fec x:0 0 0 2024-04-01T06:57:38.885 INFO:tasks.workunit.client.0.smithi083.stdout:1/650: write db/d1c/d2e/f34 [5210314,80365] 0 2024-04-01T06:57:38.887 INFO:tasks.workunit.client.0.smithi083.stdout:2/506: mkdir d3/d8b/d53/d68/dae 0 2024-04-01T06:57:38.888 INFO:tasks.workunit.client.0.smithi083.stdout:1/651: mknod db/d1c/d29/d33/d50/d5d/d6c/ddb/ced 0 2024-04-01T06:57:38.889 INFO:tasks.workunit.client.0.smithi083.stdout:1/652: fdatasync db/d1c/d29/f3e 0 2024-04-01T06:57:38.889 INFO:tasks.workunit.client.0.smithi083.stdout:1/653: stat db/d1c/d2e/d30/l69 0 2024-04-01T06:57:38.891 INFO:tasks.workunit.client.0.smithi083.stdout:2/507: unlink d3/d8b/d53/d66/c7d 0 2024-04-01T06:57:38.892 INFO:tasks.workunit.client.0.smithi083.stdout:2/508: dread - d3/d20/d42/f6c zero size 2024-04-01T06:57:38.892 INFO:tasks.workunit.client.0.smithi083.stdout:6/461: dwrite d9/d57/f8c [0,4194304] 0 2024-04-01T06:57:38.893 INFO:tasks.workunit.client.0.smithi083.stdout:2/509: mkdir d3/d26/d59/daf 0 2024-04-01T06:57:38.893 INFO:tasks.workunit.client.0.smithi083.stdout:2/510: write d3/d4d/f86 [41443,72994] 0 2024-04-01T06:57:38.893 INFO:tasks.workunit.client.0.smithi083.stdout:2/511: write d3/d8b/f64 [4986400,4114] 0 2024-04-01T06:57:38.895 INFO:tasks.workunit.client.0.smithi083.stdout:6/462: mknod d9/dc/c9e 0 2024-04-01T06:57:38.897 INFO:tasks.workunit.client.0.smithi083.stdout:2/512: rename d3/d20/d42/f4e to d3/d4d/d5d/fb0 0 2024-04-01T06:57:38.897 INFO:tasks.workunit.client.0.smithi083.stdout:2/513: fsync d3/d20/d42/f50 0 2024-04-01T06:57:38.897 INFO:tasks.workunit.client.0.smithi083.stdout:2/514: fdatasync d3/d20/f84 0 2024-04-01T06:57:38.897 INFO:tasks.workunit.client.0.smithi083.stdout:2/515: readlink d3/d26/l3d 0 2024-04-01T06:57:38.898 INFO:tasks.workunit.client.0.smithi083.stdout:6/463: rmdir d9/dc/d1b/d4c 39 2024-04-01T06:57:38.901 INFO:tasks.workunit.client.0.smithi083.stdout:6/464: dread d9/dc/f25 [0,4194304] 0 2024-04-01T06:57:38.902 INFO:tasks.workunit.client.0.smithi083.stdout:6/465: fdatasync d9/dc/f30 0 2024-04-01T06:57:38.902 INFO:tasks.workunit.client.0.smithi083.stdout:2/516: dread d3/d8b/f64 [4194304,4194304] 0 2024-04-01T06:57:38.902 INFO:tasks.workunit.client.0.smithi083.stdout:2/517: chown d3/d71/d90 438572037 1 2024-04-01T06:57:38.902 INFO:tasks.workunit.client.0.smithi083.stdout:6/466: mkdir d9/dc/d9f 0 2024-04-01T06:57:38.903 INFO:tasks.workunit.client.0.smithi083.stdout:2/518: rename d3/d71/d81/fa9 to d3/d71/d81/fb1 0 2024-04-01T06:57:38.903 INFO:tasks.workunit.client.0.smithi083.stdout:2/519: read - d3/d26/d59/d2b/f73 zero size 2024-04-01T06:57:38.904 INFO:tasks.workunit.client.0.smithi083.stdout:6/467: mknod d9/dc/d29/d3c/d5c/ca0 0 2024-04-01T06:57:38.905 INFO:tasks.workunit.client.0.smithi083.stdout:2/520: unlink d3/d26/f28 0 2024-04-01T06:57:38.907 INFO:tasks.workunit.client.0.smithi083.stdout:2/521: rename d3/d4d/d5d/l9c to d3/d8b/d53/d68/lb2 0 2024-04-01T06:57:38.909 INFO:tasks.workunit.client.0.smithi083.stdout:2/522: write d3/f2f [3876577,64788] 0 2024-04-01T06:57:38.909 INFO:tasks.workunit.client.0.smithi083.stdout:2/523: mknod d3/d26/d59/d27/d79/cb3 0 2024-04-01T06:57:38.914 INFO:tasks.workunit.client.0.smithi083.stdout:1/654: getdents db/d1c/d1d/db4/ddf/de9 0 2024-04-01T06:57:38.915 INFO:tasks.workunit.client.0.smithi083.stdout:1/655: chown db/d1c/d2e/l5f 97536809 1 2024-04-01T06:57:38.915 INFO:tasks.workunit.client.0.smithi083.stdout:1/656: readlink db/d1c/d2e/d30/l31 0 2024-04-01T06:57:38.916 INFO:tasks.workunit.client.0.smithi083.stdout:1/657: rename db/d1c/d29/d33/d50/d5d/d6c/cd8 to db/d1c/d1d/db4/ddf/de9/cee 0 2024-04-01T06:57:38.919 INFO:tasks.workunit.client.0.smithi083.stdout:6/468: dwrite d9/dc/d1b/f1e [0,4194304] 0 2024-04-01T06:57:38.919 INFO:tasks.workunit.client.0.smithi083.stdout:6/469: getdents d9/dc/d1b/d39/d47 0 2024-04-01T06:57:38.919 INFO:tasks.workunit.client.0.smithi083.stdout:6/470: chown d9/dc/d1b/d4c/f74 1 1 2024-04-01T06:57:38.919 INFO:tasks.workunit.client.0.smithi083.stdout:1/658: rename db/d1c/d2e/f6e to db/d1c/d29/d33/d47/d76/db6/fef 0 2024-04-01T06:57:38.919 INFO:tasks.workunit.client.0.smithi083.stdout:1/659: dread - db/d1c/d1d/d8b/f9a zero size 2024-04-01T06:57:38.920 INFO:tasks.workunit.client.0.smithi083.stdout:6/471: dread f6 [4194304,4194304] 0 2024-04-01T06:57:38.920 INFO:tasks.workunit.client.0.smithi083.stdout:6/472: truncate d9/dc/d1b/f3f 845026 0 2024-04-01T06:57:38.920 INFO:tasks.workunit.client.0.smithi083.stdout:6/473: chown d9/f7d 530 1 2024-04-01T06:57:38.920 INFO:tasks.workunit.client.0.smithi083.stdout:6/474: write d9/dc/d1b/f4d [1752259,106925] 0 2024-04-01T06:57:38.923 INFO:tasks.workunit.client.0.smithi083.stdout:6/475: creat d9/dc/d1b/d35/fa1 x:0 0 0 2024-04-01T06:57:38.923 INFO:tasks.workunit.client.0.smithi083.stdout:6/476: truncate d9/dc/d1b/d35/fa1 1047226 0 2024-04-01T06:57:38.924 INFO:tasks.workunit.client.0.smithi083.stdout:1/660: mkdir db/d1c/d29/df0 0 2024-04-01T06:57:38.924 INFO:tasks.workunit.client.0.smithi083.stdout:1/661: chown db/d1c/d2e/d30/fc7 8098837 1 2024-04-01T06:57:38.924 INFO:tasks.workunit.client.0.smithi083.stdout:1/662: chown db/d1c/d2e/d30/fca 10339428 1 2024-04-01T06:57:38.924 INFO:tasks.workunit.client.0.smithi083.stdout:1/663: chown db 128218080 1 2024-04-01T06:57:38.924 INFO:tasks.workunit.client.0.smithi083.stdout:2/524: dwrite d3/d20/d42/f6c [0,4194304] 0 2024-04-01T06:57:38.926 INFO:tasks.workunit.client.0.smithi083.stdout:6/477: creat d9/dc/d9f/fa2 x:0 0 0 2024-04-01T06:57:38.926 INFO:tasks.workunit.client.0.smithi083.stdout:6/478: write d9/d57/f5e [724375,27477] 0 2024-04-01T06:57:38.926 INFO:tasks.workunit.client.0.smithi083.stdout:6/479: truncate d9/dc/d1b/f3f 1557170 0 2024-04-01T06:57:38.930 INFO:tasks.workunit.client.0.smithi083.stdout:2/525: symlink d3/d8b/d53/d66/lb4 0 2024-04-01T06:57:38.930 INFO:tasks.workunit.client.0.smithi083.stdout:2/526: write d3/d71/d81/f93 [989176,100465] 0 2024-04-01T06:57:38.932 INFO:tasks.workunit.client.0.smithi083.stdout:6/480: link d9/dc/d29/d3c/c3e d9/dc/d29/d3c/ca3 0 2024-04-01T06:57:38.932 INFO:tasks.workunit.client.0.smithi083.stdout:6/481: chown d9/dc/d29/d3c/d5c/d8b/c8f 511 1 2024-04-01T06:57:38.932 INFO:tasks.workunit.client.0.smithi083.stdout:6/482: fdatasync d9/dc/d1b/f3f 0 2024-04-01T06:57:38.933 INFO:tasks.workunit.client.0.smithi083.stdout:2/527: link d3/d8b/c9b d3/d4d/d57/cb5 0 2024-04-01T06:57:38.934 INFO:tasks.workunit.client.0.smithi083.stdout:3/572: sync 2024-04-01T06:57:38.934 INFO:tasks.workunit.client.0.smithi083.stdout:3/573: chown d6/d15/d2d/d2f/d42/d5c/d88/l8b 74 1 2024-04-01T06:57:38.936 INFO:tasks.workunit.client.0.smithi083.stdout:2/528: dread d3/d20/f2a [0,4194304] 0 2024-04-01T06:57:38.936 INFO:tasks.workunit.client.0.smithi083.stdout:2/529: stat d3/fc 0 2024-04-01T06:57:38.936 INFO:tasks.workunit.client.0.smithi083.stdout:6/483: unlink d9/dc/d29/d3c/c3e 0 2024-04-01T06:57:38.936 INFO:tasks.workunit.client.0.smithi083.stdout:6/484: write d9/dc/f7e [1891343,246] 0 2024-04-01T06:57:38.936 INFO:tasks.workunit.client.0.smithi083.stdout:6/485: dread - d9/dc/d1b/d35/f85 zero size 2024-04-01T06:57:38.938 INFO:tasks.workunit.client.0.smithi083.stdout:3/574: getdents d6/d15/d2d/d2f/d42/d46/d55/d67 0 2024-04-01T06:57:38.944 INFO:tasks.workunit.client.0.smithi083.stdout:1/664: dwrite db/d1c/d29/d33/d50/fba [4194304,4194304] 0 2024-04-01T06:57:38.945 INFO:tasks.workunit.client.0.smithi083.stdout:1/665: write db/d1c/d1d/f6b [625486,12806] 0 2024-04-01T06:57:38.945 INFO:tasks.workunit.client.0.smithi083.stdout:1/666: truncate db/d1c/f89 255729 0 2024-04-01T06:57:38.946 INFO:tasks.workunit.client.0.smithi083.stdout:6/486: dread f6 [0,4194304] 0 2024-04-01T06:57:38.946 INFO:tasks.workunit.client.0.smithi083.stdout:6/487: stat d9/dc/d29/d3c/f95 0 2024-04-01T06:57:38.946 INFO:tasks.workunit.client.0.smithi083.stdout:6/488: dread - d9/dc/d29/d3c/f95 zero size 2024-04-01T06:57:38.949 INFO:tasks.workunit.client.0.smithi083.stdout:3/575: rename d6/d1e/d6f/l70 to d6/d15/d2d/d2f/d42/d5c/lbf 0 2024-04-01T06:57:38.949 INFO:tasks.workunit.client.0.smithi083.stdout:3/576: chown d6/d15/d2d/d2f/d42/d46/d55/f79 87 1 2024-04-01T06:57:38.954 INFO:tasks.workunit.client.0.smithi083.stdout:1/667: unlink db/d1c/d29/d33/d50/d5d/d6c/c83 0 2024-04-01T06:57:38.954 INFO:tasks.workunit.client.0.smithi083.stdout:1/668: truncate db/d1c/d29/d33/d47/f5a 1862189 0 2024-04-01T06:57:38.955 INFO:tasks.workunit.client.0.smithi083.stdout:6/489: creat d9/dc/d29/d3c/d5c/d8b/fa4 x:0 0 0 2024-04-01T06:57:38.956 INFO:tasks.workunit.client.0.smithi083.stdout:3/577: truncate d6/d15/d2d/d2f/d53/fa6 433159 0 2024-04-01T06:57:38.956 INFO:tasks.workunit.client.0.smithi083.stdout:3/578: write f0 [1390200,94124] 0 2024-04-01T06:57:38.957 INFO:tasks.workunit.client.0.smithi083.stdout:6/490: mknod d9/dc/d1b/d4c/ca5 0 2024-04-01T06:57:38.957 INFO:tasks.workunit.client.0.smithi083.stdout:6/491: dread - d9/dc/d1b/d35/f7b zero size 2024-04-01T06:57:38.958 INFO:tasks.workunit.client.0.smithi083.stdout:3/579: unlink d6/d15/d2d/d2f/d42/d9f/cb8 0 2024-04-01T06:57:38.958 INFO:tasks.workunit.client.0.smithi083.stdout:6/492: symlink d9/dc/d9f/la6 0 2024-04-01T06:57:38.959 INFO:tasks.workunit.client.0.smithi083.stdout:6/493: dread d9/dc/d1b/d35/fa1 [0,4194304] 0 2024-04-01T06:57:38.960 INFO:tasks.workunit.client.0.smithi083.stdout:3/580: write d6/d1e/f56 [1611372,88519] 0 2024-04-01T06:57:38.960 INFO:tasks.workunit.client.0.smithi083.stdout:6/494: symlink d9/dc/d9d/la7 0 2024-04-01T06:57:38.961 INFO:tasks.workunit.client.0.smithi083.stdout:3/581: write d6/d15/f5f [610786,79165] 0 2024-04-01T06:57:38.961 INFO:tasks.workunit.client.0.smithi083.stdout:3/582: chown d6/d15/d2d/d2f/d3e/d74/f75 0 1 2024-04-01T06:57:38.962 INFO:tasks.workunit.client.0.smithi083.stdout:6/495: creat d9/dc/d29/fa8 x:0 0 0 2024-04-01T06:57:38.962 INFO:tasks.workunit.client.0.smithi083.stdout:6/496: truncate d9/dc/f25 4586132 0 2024-04-01T06:57:38.963 INFO:tasks.workunit.client.0.smithi083.stdout:6/497: mkdir d9/dc/d1b/d35/d48/d52/d9c/da9 0 2024-04-01T06:57:38.975 INFO:tasks.workunit.client.0.smithi083.stdout:6/498: dwrite d9/dc/d1b/d35/f89 [0,4194304] 0 2024-04-01T06:57:38.975 INFO:tasks.workunit.client.0.smithi083.stdout:6/499: fsync d9/dc/f11 0 2024-04-01T06:57:38.976 INFO:tasks.workunit.client.0.smithi083.stdout:3/583: rename f2 to d6/d1e/fc0 0 2024-04-01T06:57:38.985 INFO:tasks.workunit.client.0.smithi083.stdout:6/500: getdents d9/dc/d29/d3c/d5c/d8b 0 2024-04-01T06:57:39.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:38 smithi145 ceph-mon[47816]: pgmap v56: 97 pgs: 97 active+clean; 593 MiB data, 741 MiB used, 1.0 TiB / 1.0 TiB avail; 33 MiB/s rd, 69 MiB/s wr, 948 op/s 2024-04-01T06:57:39.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:38 smithi083 ceph-mon[43429]: pgmap v56: 97 pgs: 97 active+clean; 593 MiB data, 741 MiB used, 1.0 TiB / 1.0 TiB avail; 33 MiB/s rd, 69 MiB/s wr, 948 op/s 2024-04-01T06:57:39.017 INFO:tasks.workunit.client.0.smithi083.stdout:3/584: dwrite d6/d15/d2d/d2f/d42/d46/d55/fb2 [0,4194304] 0 2024-04-01T06:57:39.019 INFO:tasks.workunit.client.0.smithi083.stdout:6/501: dwrite d9/dc/d1b/f1e [4194304,4194304] 0 2024-04-01T06:57:39.021 INFO:tasks.workunit.client.0.smithi083.stdout:2/530: dwrite d3/d26/d59/d27/f7e [0,4194304] 0 2024-04-01T06:57:39.022 INFO:tasks.workunit.client.0.smithi083.stdout:1/669: dwrite db/d1c/d2e/d30/fc1 [0,4194304] 0 2024-04-01T06:57:39.022 INFO:tasks.workunit.client.0.smithi083.stdout:6/502: creat d9/d8a/faa x:0 0 0 2024-04-01T06:57:39.022 INFO:tasks.workunit.client.0.smithi083.stdout:6/503: stat d9/dc/f40 0 2024-04-01T06:57:39.031 INFO:tasks.workunit.client.0.smithi083.stdout:2/531: truncate d3/d26/d59/d27/f7e 3436665 0 2024-04-01T06:57:39.033 INFO:tasks.workunit.client.0.smithi083.stdout:2/532: truncate d3/d20/d42/f6c 2366899 0 2024-04-01T06:57:39.033 INFO:tasks.workunit.client.0.smithi083.stdout:2/533: chown d3/d26/f3a 2 1 2024-04-01T06:57:39.034 INFO:tasks.workunit.client.0.smithi083.stdout:2/534: write d3/d26/f89 [3977555,32332] 0 2024-04-01T06:57:39.034 INFO:tasks.workunit.client.0.smithi083.stdout:2/535: readlink d3/d71/d81/lac 0 2024-04-01T06:57:39.039 INFO:tasks.workunit.client.0.smithi083.stdout:3/585: dwrite d6/d15/d2d/f5b [0,4194304] 0 2024-04-01T06:57:39.042 INFO:tasks.workunit.client.0.smithi083.stdout:6/504: dwrite d9/dc/d1b/d35/f7b [0,4194304] 0 2024-04-01T06:57:39.052 INFO:tasks.workunit.client.0.smithi083.stdout:1/670: dwrite db/f88 [0,4194304] 0 2024-04-01T06:57:39.055 INFO:tasks.workunit.client.0.smithi083.stdout:2/536: dwrite d3/d26/f4c [0,4194304] 0 2024-04-01T06:57:39.056 INFO:tasks.workunit.client.0.smithi083.stdout:3/586: dwrite d6/d15/d2d/d2f/d42/f63 [0,4194304] 0 2024-04-01T06:57:39.056 INFO:tasks.workunit.client.0.smithi083.stdout:3/587: chown d6/d15/d2d/d2f/d42/d46/fa7 85788818 1 2024-04-01T06:57:39.056 INFO:tasks.workunit.client.0.smithi083.stdout:3/588: fsync d6/d15/d2d/d2f/d42/f81 0 2024-04-01T06:57:39.057 INFO:tasks.workunit.client.0.smithi083.stdout:1/671: mkdir db/df1 0 2024-04-01T06:57:39.057 INFO:tasks.workunit.client.0.smithi083.stdout:6/505: dwrite d9/dc/f65 [0,4194304] 0 2024-04-01T06:57:39.057 INFO:tasks.workunit.client.0.smithi083.stdout:6/506: chown d9/d57/d5f 1 1 2024-04-01T06:57:39.057 INFO:tasks.workunit.client.0.smithi083.stdout:6/507: write d9/dc/d1b/d35/d48/d52/f6f [226518,105447] 0 2024-04-01T06:57:39.058 INFO:tasks.workunit.client.0.smithi083.stdout:2/537: mkdir d3/d71/d90/db6 0 2024-04-01T06:57:39.058 INFO:tasks.workunit.client.0.smithi083.stdout:2/538: write d3/d8b/d53/d68/f5c [3134592,34047] 0 2024-04-01T06:57:39.060 INFO:tasks.workunit.client.0.smithi083.stdout:3/589: mkdir d6/d1e/d6f/daf/dc1 0 2024-04-01T06:57:39.061 INFO:tasks.workunit.client.0.smithi083.stdout:1/672: mkdir db/d1c/df2 0 2024-04-01T06:57:39.062 INFO:tasks.workunit.client.0.smithi083.stdout:1/673: write db/d1c/d29/d33/d50/d5d/dad/dbf/f91 [515478,64399] 0 2024-04-01T06:57:39.065 INFO:tasks.workunit.client.0.smithi083.stdout:2/539: unlink d3/f72 0 2024-04-01T06:57:39.066 INFO:tasks.workunit.client.0.smithi083.stdout:3/590: mknod d6/d1e/cc2 0 2024-04-01T06:57:39.067 INFO:tasks.workunit.client.0.smithi083.stdout:1/674: mknod db/d1c/d29/d33/d47/de4/cf3 0 2024-04-01T06:57:39.069 INFO:tasks.workunit.client.0.smithi083.stdout:6/508: dwrite d9/dc/d29/d3c/d5c/f84 [0,4194304] 0 2024-04-01T06:57:39.070 INFO:tasks.workunit.client.0.smithi083.stdout:3/591: rename d6/d15/c6d to d6/d1e/dbb/cc3 0 2024-04-01T06:57:39.070 INFO:tasks.workunit.client.0.smithi083.stdout:3/592: chown d6/d1e/f43 143 1 2024-04-01T06:57:39.070 INFO:tasks.workunit.client.0.smithi083.stdout:3/593: chown d6/d15/d2d/d2f/d42/d5c/d88 6714 1 2024-04-01T06:57:39.070 INFO:tasks.workunit.client.0.smithi083.stdout:9/468: sync 2024-04-01T06:57:39.071 INFO:tasks.workunit.client.0.smithi083.stdout:1/675: getdents db/d1c/d29/d33/d50/d5d/d6c/ddb 0 2024-04-01T06:57:39.072 INFO:tasks.workunit.client.0.smithi083.stdout:2/540: link d3/d26/d59/f31 d3/d26/d59/d27/fb7 0 2024-04-01T06:57:39.076 INFO:tasks.workunit.client.0.smithi083.stdout:9/469: creat d6/d32/d26/fa0 x:0 0 0 2024-04-01T06:57:39.076 INFO:tasks.workunit.client.0.smithi083.stdout:1/676: symlink db/df1/lf4 0 2024-04-01T06:57:39.076 INFO:tasks.workunit.client.0.smithi083.stdout:1/677: readlink db/l58 0 2024-04-01T06:57:39.076 INFO:tasks.workunit.client.0.smithi083.stdout:6/509: dread d9/dc/d1b/f1e [4194304,4194304] 0 2024-04-01T06:57:39.077 INFO:tasks.workunit.client.0.smithi083.stdout:2/541: mkdir d3/d71/db8 0 2024-04-01T06:57:39.077 INFO:tasks.workunit.client.0.smithi083.stdout:6/510: fsync f8 0 2024-04-01T06:57:39.077 INFO:tasks.workunit.client.0.smithi083.stdout:2/542: chown d3/d26/d59/d27/d79/cb3 689 1 2024-04-01T06:57:39.077 INFO:tasks.workunit.client.0.smithi083.stdout:2/543: chown d3/d4d/f92 49 1 2024-04-01T06:57:39.077 INFO:tasks.workunit.client.0.smithi083.stdout:6/511: getdents d9/dc/d1b/d35/d48 0 2024-04-01T06:57:39.077 INFO:tasks.workunit.client.0.smithi083.stdout:6/512: chown d9/dc/d29/d3c/d5c/d8b 0 1 2024-04-01T06:57:39.077 INFO:tasks.workunit.client.0.smithi083.stdout:6/513: read d9/d57/d5f/f71 [187592,89564] 0 2024-04-01T06:57:39.077 INFO:tasks.workunit.client.0.smithi083.stdout:6/514: fsync d9/dc/f23 0 2024-04-01T06:57:39.077 INFO:tasks.workunit.client.0.smithi083.stdout:9/470: truncate d6/d32/f1a 5523739 0 2024-04-01T06:57:39.079 INFO:tasks.workunit.client.0.smithi083.stdout:6/515: mkdir d9/dc/d1b/d35/d48/d52/d9c/dab 0 2024-04-01T06:57:39.080 INFO:tasks.workunit.client.0.smithi083.stdout:9/471: getdents d6/d32/d26/d8e 0 2024-04-01T06:57:39.082 INFO:tasks.workunit.client.0.smithi083.stdout:6/516: mknod d9/dc/cac 0 2024-04-01T06:57:39.082 INFO:tasks.workunit.client.0.smithi083.stdout:6/517: getdents d9/dc/d1b/d4c/d99 0 2024-04-01T06:57:39.085 INFO:tasks.workunit.client.0.smithi083.stdout:1/678: rmdir db/d1c/d1d/db4/ddf/de9 39 2024-04-01T06:57:39.085 INFO:tasks.workunit.client.0.smithi083.stdout:1/679: write db/d1c/d2e/d30/fa6 [812362,6284] 0 2024-04-01T06:57:39.085 INFO:tasks.workunit.client.0.smithi083.stdout:3/594: dwrite d6/d1e/f23 [0,4194304] 0 2024-04-01T06:57:39.087 INFO:tasks.workunit.client.0.smithi083.stdout:9/472: creat d6/d32/d8f/fa1 x:0 0 0 2024-04-01T06:57:39.087 INFO:tasks.workunit.client.0.smithi083.stdout:9/473: truncate d6/d32/d3c/f6f 4527115 0 2024-04-01T06:57:39.089 INFO:tasks.workunit.client.0.smithi083.stdout:1/680: creat db/d1c/d29/dbe/ff5 x:0 0 0 2024-04-01T06:57:39.094 INFO:tasks.workunit.client.0.smithi083.stdout:3/595: link d6/d12/f7d d6/d15/d2d/d2f/d42/d5c/d88/fc4 0 2024-04-01T06:57:39.095 INFO:tasks.workunit.client.0.smithi083.stdout:9/474: creat d6/d32/fa2 x:0 0 0 2024-04-01T06:57:39.095 INFO:tasks.workunit.client.0.smithi083.stdout:9/475: truncate d6/d32/f36 5086893 0 2024-04-01T06:57:39.098 INFO:tasks.workunit.client.0.smithi083.stdout:6/518: dwrite d9/d57/f8c [0,4194304] 0 2024-04-01T06:57:39.101 INFO:tasks.workunit.client.0.smithi083.stdout:3/596: symlink d6/d15/d2d/d2f/d42/d5c/lc5 0 2024-04-01T06:57:39.101 INFO:tasks.workunit.client.0.smithi083.stdout:2/544: dwrite d3/d26/d59/d2b/f82 [4194304,4194304] 0 2024-04-01T06:57:39.102 INFO:tasks.workunit.client.0.smithi083.stdout:2/545: write d3/d8b/d53/f97 [245674,118180] 0 2024-04-01T06:57:39.102 INFO:tasks.workunit.client.0.smithi083.stdout:2/546: write d3/d4d/f92 [764964,101979] 0 2024-04-01T06:57:39.102 INFO:tasks.workunit.client.0.smithi083.stdout:2/547: truncate d3/d4d/d5d/f74 793608 0 2024-04-01T06:57:39.102 INFO:tasks.workunit.client.0.smithi083.stdout:9/476: rename d6/d32/d3c/c59 to d6/d32/d26/d2d/d6e/ca3 0 2024-04-01T06:57:39.104 INFO:tasks.workunit.client.0.smithi083.stdout:6/519: creat d9/dc/d1b/d35/d48/d52/d9c/dab/fad x:0 0 0 2024-04-01T06:57:39.106 INFO:tasks.workunit.client.0.smithi083.stdout:2/548: dread d3/d8b/d53/f60 [0,4194304] 0 2024-04-01T06:57:39.109 INFO:tasks.workunit.client.0.smithi083.stdout:9/477: creat d6/d32/fa4 x:0 0 0 2024-04-01T06:57:39.109 INFO:tasks.workunit.client.0.smithi083.stdout:9/478: write d6/d32/d26/fa0 [266330,112308] 0 2024-04-01T06:57:39.109 INFO:tasks.workunit.client.0.smithi083.stdout:9/479: chown d6/d32/d26/d2d/d34/l3a 9 1 2024-04-01T06:57:39.109 INFO:tasks.workunit.client.0.smithi083.stdout:3/597: dread d6/d15/d2d/d2f/d3e/f54 [0,4194304] 0 2024-04-01T06:57:39.109 INFO:tasks.workunit.client.0.smithi083.stdout:2/549: symlink d3/d26/d59/d2b/d9f/lb9 0 2024-04-01T06:57:39.111 INFO:tasks.workunit.client.0.smithi083.stdout:2/550: mkdir d3/d26/d59/d2b/d9f/dba 0 2024-04-01T06:57:39.115 INFO:tasks.workunit.client.0.smithi083.stdout:2/551: unlink d3/f7f 0 2024-04-01T06:57:39.116 INFO:tasks.workunit.client.0.smithi083.stdout:8/562: sync 2024-04-01T06:57:39.117 INFO:tasks.workunit.client.0.smithi083.stdout:4/474: sync 2024-04-01T06:57:39.117 INFO:tasks.workunit.client.0.smithi083.stdout:6/520: dwrite d9/dc/d29/d3c/d5c/d8b/f8e [0,4194304] 0 2024-04-01T06:57:39.118 INFO:tasks.workunit.client.0.smithi083.stdout:2/552: mkdir d3/d26/d59/d2b/da3/dbb 0 2024-04-01T06:57:39.119 INFO:tasks.workunit.client.0.smithi083.stdout:3/598: dwrite d6/d15/d2d/d2f/d42/d5c/fa1 [0,4194304] 0 2024-04-01T06:57:39.120 INFO:tasks.workunit.client.0.smithi083.stdout:3/599: dread - d6/d15/d2d/d2f/d42/d46/fa7 zero size 2024-04-01T06:57:39.120 INFO:tasks.workunit.client.0.smithi083.stdout:8/563: symlink d15/d18/d19/d24/d44/d75/ld1 0 2024-04-01T06:57:39.120 INFO:tasks.workunit.client.0.smithi083.stdout:2/553: mknod d3/d71/d90/cbc 0 2024-04-01T06:57:39.123 INFO:tasks.workunit.client.0.smithi083.stdout:3/600: unlink d6/d15/d2d/d2f/d42/d46/f69 0 2024-04-01T06:57:39.125 INFO:tasks.workunit.client.0.smithi083.stdout:3/601: creat d6/d15/d2d/d2f/d3e/fc6 x:0 0 0 2024-04-01T06:57:39.126 INFO:tasks.workunit.client.0.smithi083.stdout:8/564: rename d15/d1b/d39/c76 to d15/d18/d1e/cd2 0 2024-04-01T06:57:39.128 INFO:tasks.workunit.client.0.smithi083.stdout:2/554: rmdir d3/d26/d59/d2b 39 2024-04-01T06:57:39.128 INFO:tasks.workunit.client.0.smithi083.stdout:6/521: dread d9/f19 [0,4194304] 0 2024-04-01T06:57:39.128 INFO:tasks.workunit.client.0.smithi083.stdout:6/522: dread - d9/dc/d1b/d39/d68/f75 zero size 2024-04-01T06:57:39.128 INFO:tasks.workunit.client.0.smithi083.stdout:3/602: mkdir d6/d15/d2d/d2f/dc7 0 2024-04-01T06:57:39.129 INFO:tasks.workunit.client.0.smithi083.stdout:4/475: dread d1/d47/d2a/f36 [0,4194304] 0 2024-04-01T06:57:39.129 INFO:tasks.workunit.client.0.smithi083.stdout:2/555: write d3/d26/f4c [2030283,31993] 0 2024-04-01T06:57:39.130 INFO:tasks.workunit.client.0.smithi083.stdout:6/523: dread d9/dc/d1b/d35/f51 [0,4194304] 0 2024-04-01T06:57:39.131 INFO:tasks.workunit.client.0.smithi083.stdout:8/565: rename d15/d18/d19/d24/f94 to d15/fd3 0 2024-04-01T06:57:39.136 INFO:tasks.workunit.client.0.smithi083.stdout:3/603: symlink d6/d1e/dbb/lc8 0 2024-04-01T06:57:39.136 INFO:tasks.workunit.client.0.smithi083.stdout:8/566: rename d15/d18/d19/d24/da2/d9a/fce to d15/d18/d19/d24/d38/d62/fd4 0 2024-04-01T06:57:39.136 INFO:tasks.workunit.client.0.smithi083.stdout:3/604: truncate d6/fb 4893988 0 2024-04-01T06:57:39.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:38 smithi153 ceph-mon[48187]: pgmap v56: 97 pgs: 97 active+clean; 593 MiB data, 741 MiB used, 1.0 TiB / 1.0 TiB avail; 33 MiB/s rd, 69 MiB/s wr, 948 op/s 2024-04-01T06:57:39.142 INFO:tasks.workunit.client.0.smithi083.stdout:4/476: dwrite d1/d8/d6a/f7f [0,4194304] 0 2024-04-01T06:57:39.143 INFO:tasks.workunit.client.0.smithi083.stdout:2/556: dwrite d3/d26/d59/d2b/f54 [0,4194304] 0 2024-04-01T06:57:39.146 INFO:tasks.workunit.client.0.smithi083.stdout:8/567: dread d15/d1b/d39/d48/f7c [0,4194304] 0 2024-04-01T06:57:39.146 INFO:tasks.workunit.client.0.smithi083.stdout:8/568: read - d15/d18/d19/d24/d44/fc2 zero size 2024-04-01T06:57:39.146 INFO:tasks.workunit.client.0.smithi083.stdout:8/569: write d15/d18/d19/f71 [440152,86296] 0 2024-04-01T06:57:39.146 INFO:tasks.workunit.client.0.smithi083.stdout:8/570: fdatasync d15/d21/fb0 0 2024-04-01T06:57:39.146 INFO:tasks.workunit.client.0.smithi083.stdout:8/571: truncate d15/d18/d19/d6c/fa1 97007 0 2024-04-01T06:57:39.147 INFO:tasks.workunit.client.0.smithi083.stdout:3/605: rename d6/d15/d2d/d2f/d42/d46/d55/d67 to d6/d15/d2d/d2f/dc9 0 2024-04-01T06:57:39.148 INFO:tasks.workunit.client.0.smithi083.stdout:2/557: creat d3/d71/fbd x:0 0 0 2024-04-01T06:57:39.150 INFO:tasks.workunit.client.0.smithi083.stdout:3/606: creat d6/d15/d2d/d2f/d42/d9f/fca x:0 0 0 2024-04-01T06:57:39.154 INFO:tasks.workunit.client.0.smithi083.stdout:8/572: dread d15/d1b/f84 [4194304,4194304] 0 2024-04-01T06:57:39.159 INFO:tasks.workunit.client.0.smithi083.stdout:3/607: dwrite d6/d15/d2d/d2f/dc9/fb3 [0,4194304] 0 2024-04-01T06:57:39.159 INFO:tasks.workunit.client.0.smithi083.stdout:3/608: write d6/d15/d2d/d2f/d42/d5c/d88/fad [380450,9620] 0 2024-04-01T06:57:39.163 INFO:tasks.workunit.client.0.smithi083.stdout:3/609: link d6/d15/d2d/d2f/d42/d5c/d88/fc4 d6/d15/d2d/d2f/d42/d46/fcb 0 2024-04-01T06:57:39.164 INFO:tasks.workunit.client.0.smithi083.stdout:2/558: dwrite d3/d26/f4c [0,4194304] 0 2024-04-01T06:57:39.169 INFO:tasks.workunit.client.0.smithi083.stdout:8/573: dwrite d15/d18/d19/d1d/f36 [0,4194304] 0 2024-04-01T06:57:39.169 INFO:tasks.workunit.client.0.smithi083.stdout:8/574: write d15/d18/d19/d1d/fbe [997095,35962] 0 2024-04-01T06:57:39.171 INFO:tasks.workunit.client.0.smithi083.stdout:8/575: link d15/d1b/d39/d48/f6e d15/d18/d19/d24/da2/fd5 0 2024-04-01T06:57:39.172 INFO:tasks.workunit.client.0.smithi083.stdout:8/576: symlink d15/d18/d19/d24/ld6 0 2024-04-01T06:57:39.174 INFO:tasks.workunit.client.0.smithi083.stdout:8/577: truncate d15/d18/d1e/f49 2181549 0 2024-04-01T06:57:39.174 INFO:tasks.workunit.client.0.smithi083.stdout:8/578: stat d15/d18/d19/d24/f7e 0 2024-04-01T06:57:39.180 INFO:tasks.workunit.client.0.smithi083.stdout:3/610: dwrite d6/d15/d2d/d2f/d3e/f8c [0,4194304] 0 2024-04-01T06:57:39.181 INFO:tasks.workunit.client.0.smithi083.stdout:3/611: write d6/d15/d2d/d2f/d3e/f54 [3273840,108573] 0 2024-04-01T06:57:39.185 INFO:tasks.workunit.client.0.smithi083.stdout:3/612: rename d6/d15/d2d/d2f/d3e/cb7 to d6/d12/ccc 0 2024-04-01T06:57:39.185 INFO:tasks.workunit.client.0.smithi083.stdout:3/613: chown d6/d12/f2c 115550 1 2024-04-01T06:57:39.185 INFO:tasks.workunit.client.0.smithi083.stdout:3/614: creat d6/d12/fcd x:0 0 0 2024-04-01T06:57:39.186 INFO:tasks.workunit.client.0.smithi083.stdout:3/615: dread - d6/d15/d2d/d2f/d53/fbc zero size 2024-04-01T06:57:39.186 INFO:tasks.workunit.client.0.smithi083.stdout:3/616: readlink d6/d15/d2d/d2f/dc9/l6a 0 2024-04-01T06:57:39.186 INFO:tasks.workunit.client.0.smithi083.stdout:3/617: stat d6/d1e/f2b 0 2024-04-01T06:57:39.194 INFO:tasks.workunit.client.0.smithi083.stdout:3/618: dread d6/d15/d2d/d2f/d42/f71 [0,4194304] 0 2024-04-01T06:57:39.198 INFO:tasks.workunit.client.0.smithi083.stdout:3/619: getdents d6/d15/d2d/d2f/d53 0 2024-04-01T06:57:39.199 INFO:tasks.workunit.client.0.smithi083.stdout:3/620: chown d6/d15/l4c 638911782 1 2024-04-01T06:57:39.212 INFO:tasks.workunit.client.0.smithi083.stdout:3/621: dwrite d6/d15/d2d/d2f/d3e/f8c [0,4194304] 0 2024-04-01T06:57:39.213 INFO:tasks.workunit.client.0.smithi083.stdout:3/622: rename d6/d15/d2d/d2f/d3e/d74/l94 to d6/d15/lce 0 2024-04-01T06:57:39.213 INFO:tasks.workunit.client.0.smithi083.stdout:3/623: fdatasync d6/d15/f3a 0 2024-04-01T06:57:39.217 INFO:tasks.workunit.client.0.smithi083.stdout:3/624: rename d6/d15/d2d/d2f/dc9 to d6/d15/d2d/d2f/dc7/dcf 0 2024-04-01T06:57:39.218 INFO:tasks.workunit.client.0.smithi083.stdout:3/625: truncate d6/d1e/f39 3251705 0 2024-04-01T06:57:39.218 INFO:tasks.workunit.client.0.smithi083.stdout:3/626: chown d6/d12/fcd 582493856 1 2024-04-01T06:57:39.219 INFO:tasks.workunit.client.0.smithi083.stdout:3/627: write d6/d15/d2d/d2f/d3e/fa4 [1576671,31598] 0 2024-04-01T06:57:39.223 INFO:tasks.workunit.client.0.smithi083.stdout:3/628: rmdir d6/d1e/d4a 39 2024-04-01T06:57:39.223 INFO:tasks.workunit.client.0.smithi083.stdout:3/629: stat d6/d15/d2d/d2f/d42/d5c/d88/fad 0 2024-04-01T06:57:39.228 INFO:tasks.workunit.client.0.smithi083.stdout:3/630: rmdir d6/d15/d2d/d2f/d3e/d74 39 2024-04-01T06:57:39.228 INFO:tasks.workunit.client.0.smithi083.stdout:3/631: write d6/d15/d2d/d2f/d3e/d74/f75 [914154,40195] 0 2024-04-01T06:57:39.228 INFO:tasks.workunit.client.0.smithi083.stdout:3/632: readlink d6/d15/d2d/d2f/dc7/dcf/l6a 0 2024-04-01T06:57:39.229 INFO:tasks.workunit.client.0.smithi083.stdout:3/633: mkdir d6/d1e/d4a/dd0 0 2024-04-01T06:57:39.231 INFO:tasks.workunit.client.0.smithi083.stdout:3/634: rename d6/d15/d2d/d2f/c33 to d6/d15/cd1 0 2024-04-01T06:57:39.232 INFO:tasks.workunit.client.0.smithi083.stdout:3/635: mkdir d6/d15/d2d/d2f/d42/d46/dd2 0 2024-04-01T06:57:39.233 INFO:tasks.workunit.client.0.smithi083.stdout:7/422: sync 2024-04-01T06:57:39.233 INFO:tasks.workunit.client.0.smithi083.stdout:0/571: sync 2024-04-01T06:57:39.233 INFO:tasks.workunit.client.0.smithi083.stdout:5/440: sync 2024-04-01T06:57:39.233 INFO:tasks.workunit.client.0.smithi083.stdout:5/441: readlink d4/d9/d16/d1f/d2f/l3f 0 2024-04-01T06:57:39.234 INFO:tasks.workunit.client.0.smithi083.stdout:3/636: dread d6/d15/d2d/d2f/d53/fa6 [0,4194304] 0 2024-04-01T06:57:39.234 INFO:tasks.workunit.client.0.smithi083.stdout:3/637: read d6/d15/d2d/d2f/d42/d46/d55/f79 [529646,1246] 0 2024-04-01T06:57:39.234 INFO:tasks.workunit.client.0.smithi083.stdout:0/572: mkdir d16/d1d/d8d/dbf 0 2024-04-01T06:57:39.235 INFO:tasks.workunit.client.0.smithi083.stdout:5/442: rmdir d4/d71/d7d 39 2024-04-01T06:57:39.235 INFO:tasks.workunit.client.0.smithi083.stdout:5/443: getdents d4/d23/d49/d7f 0 2024-04-01T06:57:39.236 INFO:tasks.workunit.client.0.smithi083.stdout:0/573: rename d16/d1d/l27 to d16/d99/d4b/d6e/lc0 0 2024-04-01T06:57:39.238 INFO:tasks.workunit.client.0.smithi083.stdout:5/444: rename d4/d23/d49/l7b to d4/d9/d4f/d68/l91 0 2024-04-01T06:57:39.240 INFO:tasks.workunit.client.0.smithi083.stdout:0/574: creat d16/d2e/fc1 x:0 0 0 2024-04-01T06:57:39.240 INFO:tasks.workunit.client.0.smithi083.stdout:0/575: write d16/f62 [468346,29643] 0 2024-04-01T06:57:39.242 INFO:tasks.workunit.client.0.smithi083.stdout:5/445: creat d4/f92 x:0 0 0 2024-04-01T06:57:39.242 INFO:tasks.workunit.client.0.smithi083.stdout:5/446: chown d4/d23/d49/f88 955732 1 2024-04-01T06:57:39.245 INFO:tasks.workunit.client.0.smithi083.stdout:5/447: link d4/d2b/d21/f6e d4/f93 0 2024-04-01T06:57:39.247 INFO:tasks.workunit.client.0.smithi083.stdout:5/448: mkdir d4/d71/d94 0 2024-04-01T06:57:39.248 INFO:tasks.workunit.client.0.smithi083.stdout:5/449: creat d4/d9/d16/f95 x:0 0 0 2024-04-01T06:57:39.250 INFO:tasks.workunit.client.0.smithi083.stdout:7/423: dwrite d0/d4/f58 [4194304,4194304] 0 2024-04-01T06:57:39.250 INFO:tasks.workunit.client.0.smithi083.stdout:7/424: fsync d0/d4/d9/d39/d67/d6d/f6b 0 2024-04-01T06:57:39.250 INFO:tasks.workunit.client.0.smithi083.stdout:7/425: stat d0/d4/d9/d39/d48/f85 0 2024-04-01T06:57:39.250 INFO:tasks.workunit.client.0.smithi083.stdout:7/426: truncate d0/d4/f80 78705 0 2024-04-01T06:57:39.252 INFO:tasks.workunit.client.0.smithi083.stdout:7/427: rename d0/d4/f16 to d0/d7c/f91 0 2024-04-01T06:57:39.255 INFO:tasks.workunit.client.0.smithi083.stdout:7/428: mkdir d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/d92 0 2024-04-01T06:57:39.256 INFO:tasks.workunit.client.0.smithi083.stdout:7/429: getdents d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/d5d 0 2024-04-01T06:57:39.256 INFO:tasks.workunit.client.0.smithi083.stdout:7/430: dread - d0/d4/d9/f5e zero size 2024-04-01T06:57:39.256 INFO:tasks.workunit.client.0.smithi083.stdout:7/431: chown d0/d4/d9/d39/d67/d6d/d87/d83/d34 8 1 2024-04-01T06:57:39.257 INFO:tasks.workunit.client.0.smithi083.stdout:0/576: dwrite d16/d2e/d3d/f4e [0,4194304] 0 2024-04-01T06:57:39.259 INFO:tasks.workunit.client.0.smithi083.stdout:3/638: dwrite d6/d15/f5f [0,4194304] 0 2024-04-01T06:57:39.259 INFO:tasks.workunit.client.0.smithi083.stdout:3/639: fdatasync d6/d15/d2d/d2f/d42/d46/d55/fb2 0 2024-04-01T06:57:39.260 INFO:tasks.workunit.client.0.smithi083.stdout:3/640: creat d6/d1e/d6f/daf/fd3 x:0 0 0 2024-04-01T06:57:39.263 INFO:tasks.workunit.client.0.smithi083.stdout:7/432: dread d0/d4/f69 [0,4194304] 0 2024-04-01T06:57:39.265 INFO:tasks.workunit.client.0.smithi083.stdout:7/433: creat d0/d4/d9/d39/d67/d6d/d87/f93 x:0 0 0 2024-04-01T06:57:39.266 INFO:tasks.workunit.client.0.smithi083.stdout:7/434: dread d0/d4/d9/f22 [0,4194304] 0 2024-04-01T06:57:39.273 INFO:tasks.workunit.client.0.smithi083.stdout:7/435: rmdir d0/d4/d9/d39/d67/d6d/d87 39 2024-04-01T06:57:39.276 INFO:tasks.workunit.client.0.smithi083.stdout:7/436: creat d0/d4/d9/d39/d67/d6d/d87/d83/d34/f94 x:0 0 0 2024-04-01T06:57:39.276 INFO:tasks.workunit.client.0.smithi083.stdout:0/577: dwrite fd [0,4194304] 0 2024-04-01T06:57:39.276 INFO:tasks.workunit.client.0.smithi083.stdout:7/437: mkdir d0/d4/d9/d95 0 2024-04-01T06:57:39.276 INFO:tasks.workunit.client.0.smithi083.stdout:0/578: rename d16/d2e/d3d/da9 to d16/d99/dc2 0 2024-04-01T06:57:39.277 INFO:tasks.workunit.client.0.smithi083.stdout:3/641: dwrite d6/d1e/f23 [0,4194304] 0 2024-04-01T06:57:39.277 INFO:tasks.workunit.client.0.smithi083.stdout:7/438: symlink d0/d7c/l96 0 2024-04-01T06:57:39.277 INFO:tasks.workunit.client.0.smithi083.stdout:7/439: chown d0/d4/d9/f25 69965 1 2024-04-01T06:57:39.278 INFO:tasks.workunit.client.0.smithi083.stdout:0/579: mknod d16/d1d/d8d/cc3 0 2024-04-01T06:57:39.280 INFO:tasks.workunit.client.0.smithi083.stdout:0/580: creat d16/d1d/d8d/fc4 x:0 0 0 2024-04-01T06:57:39.285 INFO:tasks.workunit.client.0.smithi083.stdout:0/581: symlink d16/d2e/dba/lc5 0 2024-04-01T06:57:39.285 INFO:tasks.workunit.client.0.smithi083.stdout:0/582: chown d16/d99/d4b/d68/f86 30 1 2024-04-01T06:57:39.285 INFO:tasks.workunit.client.0.smithi083.stdout:7/440: rmdir d0/d4/d9/d39 39 2024-04-01T06:57:39.285 INFO:tasks.workunit.client.0.smithi083.stdout:7/441: truncate d0/d4/d9/d39/d67/d6d/d87/f93 459377 0 2024-04-01T06:57:39.286 INFO:tasks.workunit.client.0.smithi083.stdout:3/642: truncate d6/d1e/f23 4131684 0 2024-04-01T06:57:39.286 INFO:tasks.workunit.client.0.smithi083.stdout:3/643: write d6/d15/d2d/d2f/d53/fbc [750374,72092] 0 2024-04-01T06:57:39.287 INFO:tasks.workunit.client.0.smithi083.stdout:3/644: dread d6/d15/f8e [0,4194304] 0 2024-04-01T06:57:39.287 INFO:tasks.workunit.client.0.smithi083.stdout:3/645: stat d6/f24 0 2024-04-01T06:57:39.292 INFO:tasks.workunit.client.0.smithi083.stdout:0/583: mkdir d16/dc6 0 2024-04-01T06:57:39.293 INFO:tasks.workunit.client.0.smithi083.stdout:7/442: rmdir d0/d4/d9/d39/d67/d6d/d87/d83/d34 39 2024-04-01T06:57:39.293 INFO:tasks.workunit.client.0.smithi083.stdout:0/584: write d16/d1d/f25 [5071483,4768] 0 2024-04-01T06:57:39.294 INFO:tasks.workunit.client.0.smithi083.stdout:7/443: mkdir d0/d4/d9/d39/d97 0 2024-04-01T06:57:39.296 INFO:tasks.workunit.client.0.smithi083.stdout:7/444: creat d0/d4/d9/d39/d67/d6d/d87/d83/d62/f98 x:0 0 0 2024-04-01T06:57:39.296 INFO:tasks.workunit.client.0.smithi083.stdout:7/445: stat d0/d4/d9/d39/d67/d6d/d87/c61 0 2024-04-01T06:57:39.297 INFO:tasks.workunit.client.0.smithi083.stdout:7/446: symlink d0/l99 0 2024-04-01T06:57:39.297 INFO:tasks.workunit.client.0.smithi083.stdout:7/447: chown d0/d4/d9/d39/d67/d6d/d87/d83/d62/f98 0 1 2024-04-01T06:57:39.300 INFO:tasks.workunit.client.0.smithi083.stdout:0/585: dread d16/d2e/d6c/d82/f87 [0,4194304] 0 2024-04-01T06:57:39.301 INFO:tasks.workunit.client.0.smithi083.stdout:0/586: mknod d16/d2e/dba/cc7 0 2024-04-01T06:57:39.301 INFO:tasks.workunit.client.0.smithi083.stdout:3/646: dwrite d6/d15/d2d/f5b [0,4194304] 0 2024-04-01T06:57:39.305 INFO:tasks.workunit.client.0.smithi083.stdout:7/448: dread d0/d4/d9/f3e [0,4194304] 0 2024-04-01T06:57:39.307 INFO:tasks.workunit.client.0.smithi083.stdout:7/449: rmdir d0/d4/d9/d39/d67/d6d/d87 39 2024-04-01T06:57:39.308 INFO:tasks.workunit.client.0.smithi083.stdout:7/450: write d0/d7c/f91 [2369731,75539] 0 2024-04-01T06:57:39.309 INFO:tasks.workunit.client.0.smithi083.stdout:7/451: symlink d0/d4/d9/d39/d67/d6d/d87/d83/d62/l9a 0 2024-04-01T06:57:39.311 INFO:tasks.workunit.client.0.smithi083.stdout:7/452: mknod d0/d4/d9/d39/d67/d6d/d87/d83/c9b 0 2024-04-01T06:57:39.313 INFO:tasks.workunit.client.0.smithi083.stdout:7/453: creat d0/d4/d9/d39/d67/d6d/d87/f9c x:0 0 0 2024-04-01T06:57:39.313 INFO:tasks.workunit.client.0.smithi083.stdout:3/647: dwrite d6/d15/f64 [0,4194304] 0 2024-04-01T06:57:39.313 INFO:tasks.workunit.client.0.smithi083.stdout:3/648: write d6/d15/d2d/d2f/d42/d5c/d88/fad [707775,66740] 0 2024-04-01T06:57:39.314 INFO:tasks.workunit.client.0.smithi083.stdout:7/454: write d0/d4/d9/d39/d67/d6d/f5f [2139953,28753] 0 2024-04-01T06:57:39.314 INFO:tasks.workunit.client.0.smithi083.stdout:3/649: unlink d6/d1e/f31 0 2024-04-01T06:57:39.315 INFO:tasks.workunit.client.0.smithi083.stdout:3/650: chown d6/d12/f2c 54 1 2024-04-01T06:57:39.316 INFO:tasks.workunit.client.0.smithi083.stdout:7/455: mknod d0/d4/c9d 0 2024-04-01T06:57:39.316 INFO:tasks.workunit.client.0.smithi083.stdout:7/456: readlink d0/d7a/l8c 0 2024-04-01T06:57:39.316 INFO:tasks.workunit.client.0.smithi083.stdout:7/457: write d0/d4/d9/d39/d67/d6d/d87/d83/d62/f6f [163894,66338] 0 2024-04-01T06:57:39.316 INFO:tasks.workunit.client.0.smithi083.stdout:7/458: truncate d0/d4/d9/d39/d67/d6d/d87/d83/f72 585443 0 2024-04-01T06:57:39.318 INFO:tasks.workunit.client.0.smithi083.stdout:3/651: link d6/d15/d2d/d2f/d42/d5c/fa8 d6/d15/fd4 0 2024-04-01T06:57:39.319 INFO:tasks.workunit.client.0.smithi083.stdout:0/587: dwrite d16/d2e/d3d/d5d/f89 [0,4194304] 0 2024-04-01T06:57:39.321 INFO:tasks.workunit.client.0.smithi083.stdout:3/652: rename d6/d1e/c49 to d6/d15/d2d/d2f/d42/cd5 0 2024-04-01T06:57:39.323 INFO:tasks.workunit.client.0.smithi083.stdout:0/588: mknod d16/d2e/d6c/d82/cc8 0 2024-04-01T06:57:39.326 INFO:tasks.workunit.client.0.smithi083.stdout:3/653: link d6/d1e/f7b d6/fd6 0 2024-04-01T06:57:39.326 INFO:tasks.workunit.client.0.smithi083.stdout:3/654: truncate d6/d1e/fc0 2480458 0 2024-04-01T06:57:39.326 INFO:tasks.workunit.client.0.smithi083.stdout:3/655: stat d6/d15/d2d/fb1 0 2024-04-01T06:57:39.329 INFO:tasks.workunit.client.0.smithi083.stdout:3/656: write d6/fb [1305287,58675] 0 2024-04-01T06:57:39.332 INFO:tasks.workunit.client.0.smithi083.stdout:0/589: dwrite d16/d99/f3e [0,4194304] 0 2024-04-01T06:57:39.344 INFO:tasks.workunit.client.0.smithi083.stdout:3/657: dwrite d6/d15/d2d/d2f/f9e [4194304,4194304] 0 2024-04-01T06:57:39.346 INFO:tasks.workunit.client.0.smithi083.stdout:3/658: creat d6/d15/d2d/d2f/d42/d46/d55/fd7 x:0 0 0 2024-04-01T06:57:39.346 INFO:tasks.workunit.client.0.smithi083.stdout:3/659: dread - d6/d15/d2d/d2f/d3e/fc6 zero size 2024-04-01T06:57:39.346 INFO:tasks.workunit.client.0.smithi083.stdout:3/660: write d6/d15/d2d/d2f/d53/fab [606677,98291] 0 2024-04-01T06:57:39.346 INFO:tasks.workunit.client.0.smithi083.stdout:0/590: dwrite d16/d1d/f54 [0,4194304] 0 2024-04-01T06:57:39.346 INFO:tasks.workunit.client.0.smithi083.stdout:3/661: mkdir d6/d1e/d4a/dd0/dd8 0 2024-04-01T06:57:39.347 INFO:tasks.workunit.client.0.smithi083.stdout:0/591: write f12 [443673,119574] 0 2024-04-01T06:57:39.349 INFO:tasks.workunit.client.0.smithi083.stdout:3/662: creat d6/d1e/dbb/fd9 x:0 0 0 2024-04-01T06:57:39.350 INFO:tasks.workunit.client.0.smithi083.stdout:0/592: unlink d16/d1d/f20 0 2024-04-01T06:57:39.351 INFO:tasks.workunit.client.0.smithi083.stdout:3/663: dread d6/d15/d2d/d2f/d42/d5c/f72 [0,4194304] 0 2024-04-01T06:57:39.351 INFO:tasks.workunit.client.0.smithi083.stdout:3/664: fdatasync d6/d15/f5a 0 2024-04-01T06:57:39.351 INFO:tasks.workunit.client.0.smithi083.stdout:0/593: mknod d16/d2e/d3d/cc9 0 2024-04-01T06:57:39.353 INFO:tasks.workunit.client.0.smithi083.stdout:0/594: rename d16/d1d/f49 to d16/d99/d4b/d68/fca 0 2024-04-01T06:57:39.353 INFO:tasks.workunit.client.0.smithi083.stdout:0/595: dread - d16/d99/d4b/d6e/fac zero size 2024-04-01T06:57:39.354 INFO:tasks.workunit.client.0.smithi083.stdout:0/596: creat d16/fcb x:0 0 0 2024-04-01T06:57:39.355 INFO:tasks.workunit.client.0.smithi083.stdout:0/597: symlink d16/d2e/d5b/lcc 0 2024-04-01T06:57:39.355 INFO:tasks.workunit.client.0.smithi083.stdout:9/480: sync 2024-04-01T06:57:39.355 INFO:tasks.workunit.client.0.smithi083.stdout:2/559: sync 2024-04-01T06:57:39.356 INFO:tasks.workunit.client.0.smithi083.stdout:1/681: sync 2024-04-01T06:57:39.356 INFO:tasks.workunit.client.0.smithi083.stdout:8/579: sync 2024-04-01T06:57:39.356 INFO:tasks.workunit.client.0.smithi083.stdout:6/524: sync 2024-04-01T06:57:39.356 INFO:tasks.workunit.client.0.smithi083.stdout:4/477: sync 2024-04-01T06:57:39.356 INFO:tasks.workunit.client.0.smithi083.stdout:4/478: chown d1/d4/l22 214 1 2024-04-01T06:57:39.357 INFO:tasks.workunit.client.0.smithi083.stdout:2/560: truncate d3/d26/d59/d27/f7e 3435578 0 2024-04-01T06:57:39.358 INFO:tasks.workunit.client.0.smithi083.stdout:8/580: mknod d15/d21/cd7 0 2024-04-01T06:57:39.358 INFO:tasks.workunit.client.0.smithi083.stdout:8/581: write d15/d18/d19/d24/d44/fba [414678,96195] 0 2024-04-01T06:57:39.358 INFO:tasks.workunit.client.0.smithi083.stdout:6/525: mkdir d9/dc/d29/d3c/d5c/dae 0 2024-04-01T06:57:39.358 INFO:tasks.workunit.client.0.smithi083.stdout:3/665: dread d6/d15/d2d/d2f/d42/d5c/fa1 [0,4194304] 0 2024-04-01T06:57:39.359 INFO:tasks.workunit.client.0.smithi083.stdout:1/682: dread db/d1c/d29/d33/d47/f5a [0,4194304] 0 2024-04-01T06:57:39.361 INFO:tasks.workunit.client.0.smithi083.stdout:8/582: rename d15/d1b/d39/d48/l57 to d15/d18/d19/d24/da2/d6f/ld8 0 2024-04-01T06:57:39.362 INFO:tasks.workunit.client.0.smithi083.stdout:3/666: symlink d6/d1e/d6f/daf/lda 0 2024-04-01T06:57:39.362 INFO:tasks.workunit.client.0.smithi083.stdout:3/667: chown d6/d15/d2d/d2f/d42/d46/fa7 282 1 2024-04-01T06:57:39.362 INFO:tasks.workunit.client.0.smithi083.stdout:3/668: write d6/d15/d2d/d2f/d42/d46/fa7 [541075,77590] 0 2024-04-01T06:57:39.363 INFO:tasks.workunit.client.0.smithi083.stdout:2/561: mknod d3/d26/d59/dad/cbe 0 2024-04-01T06:57:39.365 INFO:tasks.workunit.client.0.smithi083.stdout:8/583: symlink d15/d18/d19/d24/ld9 0 2024-04-01T06:57:39.366 INFO:tasks.workunit.client.0.smithi083.stdout:9/481: dread d6/d32/d3c/d4c/d6b/f5d [0,4194304] 0 2024-04-01T06:57:39.367 INFO:tasks.workunit.client.0.smithi083.stdout:3/669: symlink d6/d1e/d4a/dd0/dd8/ldb 0 2024-04-01T06:57:39.367 INFO:tasks.workunit.client.0.smithi083.stdout:3/670: chown d6/d15/d2d/d2f/d3e/c48 0 1 2024-04-01T06:57:39.369 INFO:tasks.workunit.client.0.smithi083.stdout:6/526: rename d9/dc/d1b/d39/f60 to d9/dc/d29/d3c/faf 0 2024-04-01T06:57:39.369 INFO:tasks.workunit.client.0.smithi083.stdout:2/562: dread f1 [0,4194304] 0 2024-04-01T06:57:39.370 INFO:tasks.workunit.client.0.smithi083.stdout:8/584: mkdir d15/dda 0 2024-04-01T06:57:39.370 INFO:tasks.workunit.client.0.smithi083.stdout:8/585: chown d15/d18/d1e/f49 137295 1 2024-04-01T06:57:39.371 INFO:tasks.workunit.client.0.smithi083.stdout:9/482: rmdir d6/d29 39 2024-04-01T06:57:39.371 INFO:tasks.workunit.client.0.smithi083.stdout:4/479: dwrite d1/d8/d6a/f7f [4194304,4194304] 0 2024-04-01T06:57:39.374 INFO:tasks.workunit.client.0.smithi083.stdout:3/671: rename d6/d15/d2d/d2f/d42/l73 to d6/d15/d2d/d2f/d42/d83/ldc 0 2024-04-01T06:57:39.374 INFO:tasks.workunit.client.0.smithi083.stdout:3/672: readlink d6/d15/lce 0 2024-04-01T06:57:39.374 INFO:tasks.workunit.client.0.smithi083.stdout:0/598: dwrite d16/d1d/f7e [0,4194304] 0 2024-04-01T06:57:39.377 INFO:tasks.workunit.client.0.smithi083.stdout:8/586: creat d15/d18/d19/d24/d44/d97/fdb x:0 0 0 2024-04-01T06:57:39.377 INFO:tasks.workunit.client.0.smithi083.stdout:8/587: fsync d15/d1b/f84 0 2024-04-01T06:57:39.378 INFO:tasks.workunit.client.0.smithi083.stdout:9/483: truncate d6/d32/f1a 613446 0 2024-04-01T06:57:39.381 INFO:tasks.workunit.client.0.smithi083.stdout:4/480: dread d1/f2 [0,4194304] 0 2024-04-01T06:57:39.383 INFO:tasks.workunit.client.0.smithi083.stdout:8/588: write d15/f5c [48985,50506] 0 2024-04-01T06:57:39.386 INFO:tasks.workunit.client.0.smithi083.stdout:6/527: rmdir d9/dc 39 2024-04-01T06:57:39.389 INFO:tasks.workunit.client.0.smithi083.stdout:1/683: dwrite db/d1c/d1d/f20 [0,4194304] 0 2024-04-01T06:57:39.389 INFO:tasks.workunit.client.0.smithi083.stdout:3/673: dwrite d6/d15/d2d/d2f/dc7/dcf/fb3 [4194304,4194304] 0 2024-04-01T06:57:39.391 INFO:tasks.workunit.client.0.smithi083.stdout:2/563: dwrite d3/d20/d42/f6c [0,4194304] 0 2024-04-01T06:57:39.391 INFO:tasks.workunit.client.0.smithi083.stdout:0/599: rename d16/d99/d4b/c98 to d16/d1d/d8d/ccd 0 2024-04-01T06:57:39.391 INFO:tasks.workunit.client.0.smithi083.stdout:0/600: dread - d16/d1d/d8d/fc4 zero size 2024-04-01T06:57:39.393 INFO:tasks.workunit.client.0.smithi083.stdout:9/484: creat d6/d32/d3c/d4c/d88/fa5 x:0 0 0 2024-04-01T06:57:39.394 INFO:tasks.workunit.client.0.smithi083.stdout:4/481: unlink d1/d4/l4d 0 2024-04-01T06:57:39.395 INFO:tasks.workunit.client.0.smithi083.stdout:4/482: dread d1/d4/f6d [0,4194304] 0 2024-04-01T06:57:39.395 INFO:tasks.workunit.client.0.smithi083.stdout:4/483: chown d1/d4/db/f20 13402 1 2024-04-01T06:57:39.396 INFO:tasks.workunit.client.0.smithi083.stdout:8/589: mknod d15/d18/d19/d24/da2/cdc 0 2024-04-01T06:57:39.397 INFO:tasks.workunit.client.0.smithi083.stdout:6/528: mkdir d9/dc/d1b/d35/d48/d52/d9c/db0 0 2024-04-01T06:57:39.397 INFO:tasks.workunit.client.0.smithi083.stdout:6/529: write d9/f7d [2145579,45258] 0 2024-04-01T06:57:39.399 INFO:tasks.workunit.client.0.smithi083.stdout:1/684: mknod db/d1c/df2/cf6 0 2024-04-01T06:57:39.401 INFO:tasks.workunit.client.0.smithi083.stdout:3/674: mknod d6/d15/d2d/d2f/dc7/cdd 0 2024-04-01T06:57:39.401 INFO:tasks.workunit.client.0.smithi083.stdout:3/675: write d6/d15/d2d/d2f/d42/fbe [834707,37946] 0 2024-04-01T06:57:39.401 INFO:tasks.workunit.client.0.smithi083.stdout:3/676: chown d6/d15/d2d/d2f/d3e/d74/c9a 4115 1 2024-04-01T06:57:39.403 INFO:tasks.workunit.client.0.smithi083.stdout:2/564: creat d3/fbf x:0 0 0 2024-04-01T06:57:39.404 INFO:tasks.workunit.client.0.smithi083.stdout:0/601: symlink d16/d99/d63/lce 0 2024-04-01T06:57:39.405 INFO:tasks.workunit.client.0.smithi083.stdout:0/602: chown d16/d2e/d6c/d82/lbd 10706156 1 2024-04-01T06:57:39.405 INFO:tasks.workunit.client.0.smithi083.stdout:8/590: dread d15/d18/d19/d24/d38/f47 [0,4194304] 0 2024-04-01T06:57:39.405 INFO:tasks.workunit.client.0.smithi083.stdout:8/591: write d15/d18/d19/d24/da2/fd5 [603871,74322] 0 2024-04-01T06:57:39.405 INFO:tasks.workunit.client.0.smithi083.stdout:9/485: mknod d6/d32/d3c/d3d/d9d/ca6 0 2024-04-01T06:57:39.406 INFO:tasks.workunit.client.0.smithi083.stdout:8/592: write d15/d1b/d39/d48/d5e/f66 [1550792,4024] 0 2024-04-01T06:57:39.406 INFO:tasks.workunit.client.0.smithi083.stdout:8/593: write d15/d18/d19/d24/fbb [359000,124197] 0 2024-04-01T06:57:39.406 INFO:tasks.workunit.client.0.smithi083.stdout:8/594: readlink d15/d21/l43 0 2024-04-01T06:57:39.407 INFO:tasks.workunit.client.0.smithi083.stdout:4/484: mkdir d1/d47/d90 0 2024-04-01T06:57:39.407 INFO:tasks.workunit.client.0.smithi083.stdout:0/603: dread d16/d2e/f36 [0,4194304] 0 2024-04-01T06:57:39.408 INFO:tasks.workunit.client.0.smithi083.stdout:6/530: creat d9/dc/d29/fb1 x:0 0 0 2024-04-01T06:57:39.408 INFO:tasks.workunit.client.0.smithi083.stdout:9/486: write d6/d32/d3c/d4c/d6b/f65 [3480570,110048] 0 2024-04-01T06:57:39.414 INFO:tasks.workunit.client.0.smithi083.stdout:3/677: symlink d6/d15/d2d/d2f/lde 0 2024-04-01T06:57:39.415 INFO:tasks.workunit.client.0.smithi083.stdout:2/565: truncate d3/d8b/d53/d68/f5c 8005502 0 2024-04-01T06:57:39.415 INFO:tasks.workunit.client.0.smithi083.stdout:2/566: chown d3/d8b/d53/d68/l98 63088186 1 2024-04-01T06:57:39.416 INFO:tasks.workunit.client.0.smithi083.stdout:2/567: read d3/d26/f36 [2433806,310] 0 2024-04-01T06:57:39.416 INFO:tasks.workunit.client.0.smithi083.stdout:0/604: dread d16/d1d/f7e [0,4194304] 0 2024-04-01T06:57:39.417 INFO:tasks.workunit.client.0.smithi083.stdout:4/485: mknod d1/d4/d33/c91 0 2024-04-01T06:57:39.418 INFO:tasks.workunit.client.0.smithi083.stdout:6/531: mknod d9/cb2 0 2024-04-01T06:57:39.418 INFO:tasks.workunit.client.0.smithi083.stdout:6/532: chown d9/d57/c82 3 1 2024-04-01T06:57:39.419 INFO:tasks.workunit.client.0.smithi083.stdout:9/487: creat d6/d32/d26/d2d/d6e/fa7 x:0 0 0 2024-04-01T06:57:39.420 INFO:tasks.workunit.client.0.smithi083.stdout:0/605: mknod d16/d2e/d3d/d5d/ccf 0 2024-04-01T06:57:39.421 INFO:tasks.workunit.client.0.smithi083.stdout:0/606: write d16/d2e/d3d/d5d/f89 [4443589,69196] 0 2024-04-01T06:57:39.421 INFO:tasks.workunit.client.0.smithi083.stdout:4/486: creat d1/d4/d33/f92 x:0 0 0 2024-04-01T06:57:39.422 INFO:tasks.workunit.client.0.smithi083.stdout:3/678: dread d6/d12/f7d [0,4194304] 0 2024-04-01T06:57:39.422 INFO:tasks.workunit.client.0.smithi083.stdout:8/595: dwrite d15/d18/d19/d1d/f60 [0,4194304] 0 2024-04-01T06:57:39.422 INFO:tasks.workunit.client.0.smithi083.stdout:0/607: symlink d16/d2e/d5b/d74/ld0 0 2024-04-01T06:57:39.423 INFO:tasks.workunit.client.0.smithi083.stdout:0/608: write d16/d1d/f37 [449794,86755] 0 2024-04-01T06:57:39.423 INFO:tasks.workunit.client.0.smithi083.stdout:5/450: sync 2024-04-01T06:57:39.423 INFO:tasks.workunit.client.0.smithi083.stdout:2/568: write d3/d26/d59/f30 [5814173,89386] 0 2024-04-01T06:57:39.424 INFO:tasks.workunit.client.0.smithi083.stdout:2/569: write d3/f7 [1224804,118720] 0 2024-04-01T06:57:39.424 INFO:tasks.workunit.client.0.smithi083.stdout:2/570: read d3/d8b/d53/d66/f8c [2914790,112305] 0 2024-04-01T06:57:39.425 INFO:tasks.workunit.client.0.smithi083.stdout:3/679: getdents d6/d15 0 2024-04-01T06:57:39.426 INFO:tasks.workunit.client.0.smithi083.stdout:8/596: mknod d15/d18/d19/d24/cdd 0 2024-04-01T06:57:39.427 INFO:tasks.workunit.client.0.smithi083.stdout:8/597: fdatasync d15/f27 0 2024-04-01T06:57:39.427 INFO:tasks.workunit.client.0.smithi083.stdout:4/487: write d1/d4/d33/f43 [3017568,109629] 0 2024-04-01T06:57:39.428 INFO:tasks.workunit.client.0.smithi083.stdout:8/598: write d15/d18/d19/d24/d38/d62/f85 [3421087,25015] 0 2024-04-01T06:57:39.428 INFO:tasks.workunit.client.0.smithi083.stdout:8/599: fsync d15/fbd 0 2024-04-01T06:57:39.428 INFO:tasks.workunit.client.0.smithi083.stdout:8/600: write d15/d18/d19/d24/d44/d75/dab/fac [848868,3331] 0 2024-04-01T06:57:39.428 INFO:tasks.workunit.client.0.smithi083.stdout:8/601: write d15/d18/d19/d24/d38/d62/f4c [841315,46175] 0 2024-04-01T06:57:39.429 INFO:tasks.workunit.client.0.smithi083.stdout:9/488: dread d6/d32/f17 [0,4194304] 0 2024-04-01T06:57:39.430 INFO:tasks.workunit.client.0.smithi083.stdout:6/533: dwrite d9/dc/d1b/d39/d47/f69 [0,4194304] 0 2024-04-01T06:57:39.430 INFO:tasks.workunit.client.0.smithi083.stdout:9/489: write d6/d32/f4f [2053983,85245] 0 2024-04-01T06:57:39.430 INFO:tasks.workunit.client.0.smithi083.stdout:0/609: creat d16/d99/d4b/d6e/fd1 x:0 0 0 2024-04-01T06:57:39.431 INFO:tasks.workunit.client.0.smithi083.stdout:5/451: mkdir d4/d9/d4f/d96 0 2024-04-01T06:57:39.433 INFO:tasks.workunit.client.0.smithi083.stdout:2/571: rename d3/d4d/d57/cb5 to d3/d71/cc0 0 2024-04-01T06:57:39.435 INFO:tasks.workunit.client.0.smithi083.stdout:4/488: chown d1/d8/c1d 688681 1 2024-04-01T06:57:39.435 INFO:tasks.workunit.client.0.smithi083.stdout:4/489: chown d1/d8/d6a/f7f 0 1 2024-04-01T06:57:39.438 INFO:tasks.workunit.client.0.smithi083.stdout:6/534: mknod d9/d57/cb3 0 2024-04-01T06:57:39.439 INFO:tasks.workunit.client.0.smithi083.stdout:9/490: creat d6/d32/d3c/d4c/d6b/fa8 x:0 0 0 2024-04-01T06:57:39.440 INFO:tasks.workunit.client.0.smithi083.stdout:5/452: rename d4/fb to d4/d71/f97 0 2024-04-01T06:57:39.441 INFO:tasks.workunit.client.0.smithi083.stdout:3/680: dwrite d6/d15/d2d/d2f/d42/f71 [4194304,4194304] 0 2024-04-01T06:57:39.441 INFO:tasks.workunit.client.0.smithi083.stdout:3/681: chown d6/d15/d2d 54257 1 2024-04-01T06:57:39.441 INFO:tasks.workunit.client.0.smithi083.stdout:2/572: mkdir d3/d8b/d53/d66/dc1 0 2024-04-01T06:57:39.441 INFO:tasks.workunit.client.0.smithi083.stdout:2/573: stat d3/l38 0 2024-04-01T06:57:39.441 INFO:tasks.workunit.client.0.smithi083.stdout:2/574: fsync d3/d4d/d5d/fb0 0 2024-04-01T06:57:39.442 INFO:tasks.workunit.client.0.smithi083.stdout:0/610: dread d16/d99/d4b/d6e/fae [0,4194304] 0 2024-04-01T06:57:39.442 INFO:tasks.workunit.client.0.smithi083.stdout:0/611: chown d16/f52 0 1 2024-04-01T06:57:39.442 INFO:tasks.workunit.client.0.smithi083.stdout:0/612: chown d16/d2e/d3d 630238894 1 2024-04-01T06:57:39.444 INFO:tasks.workunit.client.0.smithi083.stdout:6/535: mkdir d9/dc/d29/d3c/d5c/db4 0 2024-04-01T06:57:39.444 INFO:tasks.workunit.client.0.smithi083.stdout:6/536: write d9/dc/f42 [887234,48527] 0 2024-04-01T06:57:39.445 INFO:tasks.workunit.client.0.smithi083.stdout:5/453: link d4/d9/d4f/d68/l8e d4/d9/d16/d19/l98 0 2024-04-01T06:57:39.452 INFO:tasks.workunit.client.0.smithi083.stdout:4/490: rmdir d1/d4 39 2024-04-01T06:57:39.452 INFO:tasks.workunit.client.0.smithi083.stdout:6/537: dread d9/d57/d5f/f76 [0,4194304] 0 2024-04-01T06:57:39.452 INFO:tasks.workunit.client.0.smithi083.stdout:6/538: fsync d9/dc/f40 0 2024-04-01T06:57:39.452 INFO:tasks.workunit.client.0.smithi083.stdout:6/539: truncate d9/d57/f6e 4581821 0 2024-04-01T06:57:39.452 INFO:tasks.workunit.client.0.smithi083.stdout:0/613: dread d16/f22 [0,4194304] 0 2024-04-01T06:57:39.455 INFO:tasks.workunit.client.0.smithi083.stdout:8/602: dwrite d15/d1b/d39/d48/d5e/d70/f98 [0,4194304] 0 2024-04-01T06:57:39.455 INFO:tasks.workunit.client.0.smithi083.stdout:3/682: link d6/d15/d2d/d2f/d42/d46/d55/fb2 d6/d15/d2d/d2f/d53/fdf 0 2024-04-01T06:57:39.455 INFO:tasks.workunit.client.0.smithi083.stdout:2/575: mknod d3/d4d/cc2 0 2024-04-01T06:57:39.457 INFO:tasks.workunit.client.0.smithi083.stdout:8/603: write d15/f7b [2723537,82107] 0 2024-04-01T06:57:39.457 INFO:tasks.workunit.client.0.smithi083.stdout:5/454: link d4/d23/d49/c52 d4/d71/d94/c99 0 2024-04-01T06:57:39.457 INFO:tasks.workunit.client.0.smithi083.stdout:5/455: write d4/d71/f7a [211402,71624] 0 2024-04-01T06:57:39.458 INFO:tasks.workunit.client.0.smithi083.stdout:6/540: creat d9/dc/d1b/d35/fb5 x:0 0 0 2024-04-01T06:57:39.459 INFO:tasks.workunit.client.0.smithi083.stdout:6/541: dread - d9/dc/d29/d3c/d5c/d8b/fa4 zero size 2024-04-01T06:57:39.459 INFO:tasks.workunit.client.0.smithi083.stdout:6/542: write d9/dc/d29/d3c/d5c/d8b/f91 [108554,125003] 0 2024-04-01T06:57:39.460 INFO:tasks.workunit.client.0.smithi083.stdout:9/491: dread d6/d32/d3c/d4c/d6b/f65 [0,4194304] 0 2024-04-01T06:57:39.461 INFO:tasks.workunit.client.0.smithi083.stdout:0/614: unlink d16/d99/d4b/d68/fca 0 2024-04-01T06:57:39.461 INFO:tasks.workunit.client.0.smithi083.stdout:9/492: write d6/d32/d26/d2d/f18 [6165403,7944] 0 2024-04-01T06:57:39.465 INFO:tasks.workunit.client.0.smithi083.stdout:3/683: getdents d6/d15/d2d/d2f/d42/d46 0 2024-04-01T06:57:39.465 INFO:tasks.workunit.client.0.smithi083.stdout:8/604: dread d15/d18/d19/d1d/f36 [0,4194304] 0 2024-04-01T06:57:39.466 INFO:tasks.workunit.client.0.smithi083.stdout:2/576: symlink d3/d71/d90/lc3 0 2024-04-01T06:57:39.467 INFO:tasks.workunit.client.0.smithi083.stdout:2/577: read - d3/d8b/d53/d5e/f9a zero size 2024-04-01T06:57:39.473 INFO:tasks.workunit.client.0.smithi083.stdout:2/578: dread d3/f2f [0,4194304] 0 2024-04-01T06:57:39.475 INFO:tasks.workunit.client.0.smithi083.stdout:5/456: link d4/d9/d16/d1f/d2f/d53/l5f d4/d23/d49/l9a 0 2024-04-01T06:57:39.476 INFO:tasks.workunit.client.0.smithi083.stdout:0/615: mkdir d16/d99/d4b/d6e/d96/dd2 0 2024-04-01T06:57:39.478 INFO:tasks.workunit.client.0.smithi083.stdout:9/493: rename d6/d7f to d6/d32/d26/da9 0 2024-04-01T06:57:39.479 INFO:tasks.workunit.client.0.smithi083.stdout:9/494: read d6/d32/d3c/d3d/f98 [2883722,117444] 0 2024-04-01T06:57:39.479 INFO:tasks.workunit.client.0.smithi083.stdout:3/684: creat d6/d1e/d4a/dd0/dd8/fe0 x:0 0 0 2024-04-01T06:57:39.480 INFO:tasks.workunit.client.0.smithi083.stdout:8/605: mkdir d15/d18/d19/d24/d44/d97/dde 0 2024-04-01T06:57:39.480 INFO:tasks.workunit.client.0.smithi083.stdout:8/606: read - d15/d18/d19/d24/d38/d62/fc0 zero size 2024-04-01T06:57:39.483 INFO:tasks.workunit.client.0.smithi083.stdout:2/579: rmdir d3/d20/d42 39 2024-04-01T06:57:39.484 INFO:tasks.workunit.client.0.smithi083.stdout:5/457: rmdir d4/d71/d94 39 2024-04-01T06:57:39.486 INFO:tasks.workunit.client.0.smithi083.stdout:2/580: dread d3/d26/f36 [0,4194304] 0 2024-04-01T06:57:39.491 INFO:tasks.workunit.client.0.smithi083.stdout:3/685: rename d6/d15/d2d/d2f/d42/d5c/fac to d6/d15/d2d/d2f/d42/d46/d55/fe1 0 2024-04-01T06:57:39.491 INFO:tasks.workunit.client.0.smithi083.stdout:3/686: rename d6/d15/d2d to d6/d15/d2d/d2f/d53/de2 22 2024-04-01T06:57:39.492 INFO:tasks.workunit.client.0.smithi083.stdout:8/607: truncate d15/d1b/d39/d48/f56 618527 0 2024-04-01T06:57:39.493 INFO:tasks.workunit.client.0.smithi083.stdout:5/458: mknod d4/d23/c9b 0 2024-04-01T06:57:39.495 INFO:tasks.workunit.client.0.smithi083.stdout:0/616: mkdir d16/d2e/d5b/d74/dd3 0 2024-04-01T06:57:39.495 INFO:tasks.workunit.client.0.smithi083.stdout:9/495: dwrite d6/f13 [4194304,4194304] 0 2024-04-01T06:57:39.495 INFO:tasks.workunit.client.0.smithi083.stdout:0/617: dread - d16/f66 zero size 2024-04-01T06:57:39.496 INFO:tasks.workunit.client.0.smithi083.stdout:0/618: chown d16/d2e/d3d/d7c/fb2 1 1 2024-04-01T06:57:39.496 INFO:tasks.workunit.client.0.smithi083.stdout:0/619: dread - d16/d2e/d3d/fa0 zero size 2024-04-01T06:57:39.496 INFO:tasks.workunit.client.0.smithi083.stdout:2/581: write f2 [2843224,49413] 0 2024-04-01T06:57:39.496 INFO:tasks.workunit.client.0.smithi083.stdout:8/608: mknod d15/d18/d19/d24/d44/d97/dde/cdf 0 2024-04-01T06:57:39.498 INFO:tasks.workunit.client.0.smithi083.stdout:0/620: creat d16/d99/d4b/d68/d9d/fd4 x:0 0 0 2024-04-01T06:57:39.498 INFO:tasks.workunit.client.0.smithi083.stdout:0/621: write d16/d2e/d3d/f8f [829174,35636] 0 2024-04-01T06:57:39.498 INFO:tasks.workunit.client.0.smithi083.stdout:0/622: write d16/f66 [1034413,83639] 0 2024-04-01T06:57:39.499 INFO:tasks.workunit.client.0.smithi083.stdout:8/609: symlink d15/d1b/d39/d80/le0 0 2024-04-01T06:57:39.499 INFO:tasks.workunit.client.0.smithi083.stdout:7/459: sync 2024-04-01T06:57:39.500 INFO:tasks.workunit.client.0.smithi083.stdout:0/623: symlink d16/d99/d4b/ld5 0 2024-04-01T06:57:39.500 INFO:tasks.workunit.client.0.smithi083.stdout:0/624: stat d16/d99/d63/c64 0 2024-04-01T06:57:39.502 INFO:tasks.workunit.client.0.smithi083.stdout:8/610: mknod d15/d18/d19/d24/da2/ce1 0 2024-04-01T06:57:39.502 INFO:tasks.workunit.client.0.smithi083.stdout:3/687: dread d6/d15/d2d/d2f/d42/f81 [0,4194304] 0 2024-04-01T06:57:39.503 INFO:tasks.workunit.client.0.smithi083.stdout:3/688: fdatasync d6/d15/d2d/d2f/d42/d46/f5e 0 2024-04-01T06:57:39.504 INFO:tasks.workunit.client.0.smithi083.stdout:7/460: dread d0/f4a [0,4194304] 0 2024-04-01T06:57:39.505 INFO:tasks.workunit.client.0.smithi083.stdout:3/689: dread f0 [0,4194304] 0 2024-04-01T06:57:39.507 INFO:tasks.workunit.client.0.smithi083.stdout:3/690: write d6/d15/f5f [353829,116047] 0 2024-04-01T06:57:39.507 INFO:tasks.workunit.client.0.smithi083.stdout:3/691: readlink d6/d12/l16 0 2024-04-01T06:57:39.507 INFO:tasks.workunit.client.0.smithi083.stdout:3/692: fsync d6/d15/d2d/d2f/d53/fdf 0 2024-04-01T06:57:39.507 INFO:tasks.workunit.client.0.smithi083.stdout:3/693: dread - d6/d12/fcd zero size 2024-04-01T06:57:39.507 INFO:tasks.workunit.client.0.smithi083.stdout:3/694: chown d6/d15/d2d/d2f/d42/d83 25029 1 2024-04-01T06:57:39.507 INFO:tasks.workunit.client.0.smithi083.stdout:3/695: fsync d6/d15/f10 0 2024-04-01T06:57:39.508 INFO:tasks.workunit.client.0.smithi083.stdout:3/696: dread - d6/fd6 zero size 2024-04-01T06:57:39.508 INFO:tasks.workunit.client.0.smithi083.stdout:3/697: stat d6/d12 0 2024-04-01T06:57:39.508 INFO:tasks.workunit.client.0.smithi083.stdout:3/698: stat d6/d12/f47 0 2024-04-01T06:57:39.508 INFO:tasks.workunit.client.0.smithi083.stdout:3/699: creat d6/d15/d2d/d2f/d42/d5c/d88/fe3 x:0 0 0 2024-04-01T06:57:39.509 INFO:tasks.workunit.client.0.smithi083.stdout:3/700: truncate d6/d15/d2d/d2f/d42/d46/fcb 734559 0 2024-04-01T06:57:39.511 INFO:tasks.workunit.client.0.smithi083.stdout:3/701: mknod d6/d1e/dbb/ce4 0 2024-04-01T06:57:39.511 INFO:tasks.workunit.client.0.smithi083.stdout:3/702: fsync d6/d15/d2d/d2f/d42/d9f/fae 0 2024-04-01T06:57:39.512 INFO:tasks.workunit.client.0.smithi083.stdout:3/703: unlink d6/d15/f5f 0 2024-04-01T06:57:39.513 INFO:tasks.workunit.client.0.smithi083.stdout:3/704: mkdir d6/d15/d2d/d2f/d53/de5 0 2024-04-01T06:57:39.513 INFO:tasks.workunit.client.0.smithi083.stdout:3/705: stat d6/d1e/d6f/daf/fd3 0 2024-04-01T06:57:39.513 INFO:tasks.workunit.client.0.smithi083.stdout:3/706: fsync d6/d1e/d6f/f96 0 2024-04-01T06:57:39.513 INFO:tasks.workunit.client.0.smithi083.stdout:3/707: readlink d6/d15/la9 0 2024-04-01T06:57:39.513 INFO:tasks.workunit.client.0.smithi083.stdout:9/496: dwrite d6/f7 [4194304,4194304] 0 2024-04-01T06:57:39.514 INFO:tasks.workunit.client.0.smithi083.stdout:3/708: rename d6/d15/d2d/fb1 to d6/d15/d2d/d2f/d42/d46/fe6 0 2024-04-01T06:57:39.514 INFO:tasks.workunit.client.0.smithi083.stdout:3/709: chown d6/d15/d2d/d2f/d3e/d74/f9c 689386112 1 2024-04-01T06:57:39.515 INFO:tasks.workunit.client.0.smithi083.stdout:3/710: readlink d6/d15/d2d/d2f/d53/l61 0 2024-04-01T06:57:39.515 INFO:tasks.workunit.client.0.smithi083.stdout:9/497: creat d6/d32/d8f/faa x:0 0 0 2024-04-01T06:57:39.516 INFO:tasks.workunit.client.0.smithi083.stdout:3/711: creat d6/d15/d2d/d2f/d53/de5/fe7 x:0 0 0 2024-04-01T06:57:39.516 INFO:tasks.workunit.client.0.smithi083.stdout:3/712: getdents d6/d1e/d6f/daf/dc1 0 2024-04-01T06:57:39.517 INFO:tasks.workunit.client.0.smithi083.stdout:3/713: truncate d6/d15/f19 519573 0 2024-04-01T06:57:39.518 INFO:tasks.workunit.client.0.smithi083.stdout:7/461: dwrite d0/d4/d9/d39/d67/d6d/d87/d83/f53 [0,4194304] 0 2024-04-01T06:57:39.518 INFO:tasks.workunit.client.0.smithi083.stdout:7/462: truncate d0/d4/d9/d39/d67/d6d/d87/f8f 867386 0 2024-04-01T06:57:39.519 INFO:tasks.workunit.client.0.smithi083.stdout:7/463: write d0/d4/d9/d39/d67/d6d/d87/d83/f42 [183102,15680] 0 2024-04-01T06:57:39.519 INFO:tasks.workunit.client.0.smithi083.stdout:3/714: symlink d6/d15/d2d/d2f/d53/de5/le8 0 2024-04-01T06:57:39.525 INFO:tasks.workunit.client.0.smithi083.stdout:7/464: mknod d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/d5d/c9e 0 2024-04-01T06:57:39.525 INFO:tasks.workunit.client.0.smithi083.stdout:3/715: creat d6/d15/d2d/fe9 x:0 0 0 2024-04-01T06:57:39.528 INFO:tasks.workunit.client.0.smithi083.stdout:3/716: link d6/d15/d2d/d2f/d42/d46/d55/l41 d6/d15/d2d/d2f/d53/de5/lea 0 2024-04-01T06:57:39.529 INFO:tasks.workunit.client.0.smithi083.stdout:9/498: dwrite d6/d32/d8f/f81 [0,4194304] 0 2024-04-01T06:57:39.529 INFO:tasks.workunit.client.0.smithi083.stdout:9/499: chown d6/d32/d3c/d4c 275054 1 2024-04-01T06:57:39.529 INFO:tasks.workunit.client.0.smithi083.stdout:5/459: dwrite d4/d71/f97 [4194304,4194304] 0 2024-04-01T06:57:39.529 INFO:tasks.workunit.client.0.smithi083.stdout:5/460: fdatasync d4/d2b/f39 0 2024-04-01T06:57:39.529 INFO:tasks.workunit.client.0.smithi083.stdout:5/461: chown d4/d23/d67 42637 1 2024-04-01T06:57:39.529 INFO:tasks.workunit.client.0.smithi083.stdout:5/462: rename d4 to d4/d23/d4e/d83/d9c 22 2024-04-01T06:57:39.529 INFO:tasks.workunit.client.0.smithi083.stdout:7/465: creat d0/d7a/f9f x:0 0 0 2024-04-01T06:57:39.532 INFO:tasks.workunit.client.0.smithi083.stdout:3/717: write d6/d1e/f2b [244618,20963] 0 2024-04-01T06:57:39.532 INFO:tasks.workunit.client.0.smithi083.stdout:3/718: fdatasync d6/fb 0 2024-04-01T06:57:39.534 INFO:tasks.workunit.client.0.smithi083.stdout:9/500: symlink d6/d32/d3c/lab 0 2024-04-01T06:57:39.534 INFO:tasks.workunit.client.0.smithi083.stdout:9/501: stat d6/d32/d26/d8e 0 2024-04-01T06:57:39.535 INFO:tasks.workunit.client.0.smithi083.stdout:0/625: dwrite d16/d2e/d3d/f40 [0,4194304] 0 2024-04-01T06:57:39.535 INFO:tasks.workunit.client.0.smithi083.stdout:0/626: fsync d16/d2e/d6c/d82/fbc 0 2024-04-01T06:57:39.536 INFO:tasks.workunit.client.0.smithi083.stdout:5/463: creat d4/d55/f9d x:0 0 0 2024-04-01T06:57:39.537 INFO:tasks.workunit.client.0.smithi083.stdout:7/466: mknod d0/d4/d9/d39/d67/d6d/d7d/ca0 0 2024-04-01T06:57:39.539 INFO:tasks.workunit.client.0.smithi083.stdout:9/502: creat d6/d76/fac x:0 0 0 2024-04-01T06:57:39.540 INFO:tasks.workunit.client.0.smithi083.stdout:0/627: creat d16/d99/d4b/d68/fd6 x:0 0 0 2024-04-01T06:57:39.544 INFO:tasks.workunit.client.0.smithi083.stdout:7/467: rename d0/d4/d9/d39/d67/d6d/d87/d83/d34/c46 to d0/d4/d9/d95/ca1 0 2024-04-01T06:57:39.544 INFO:tasks.workunit.client.0.smithi083.stdout:7/468: readlink d0/d7c/l96 0 2024-04-01T06:57:39.545 INFO:tasks.workunit.client.0.smithi083.stdout:7/469: chown d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/l77 58 1 2024-04-01T06:57:39.545 INFO:tasks.workunit.client.0.smithi083.stdout:7/470: chown d0/d4/d9/d39/d67/d6d 1321815 1 2024-04-01T06:57:39.545 INFO:tasks.workunit.client.0.smithi083.stdout:9/503: rmdir d6/d32/d4d 39 2024-04-01T06:57:39.545 INFO:tasks.workunit.client.0.smithi083.stdout:5/464: dwrite d4/d2b/f31 [0,4194304] 0 2024-04-01T06:57:39.546 INFO:tasks.workunit.client.0.smithi083.stdout:3/719: dwrite d6/d1e/d6f/daf/fd3 [0,4194304] 0 2024-04-01T06:57:39.546 INFO:tasks.workunit.client.0.smithi083.stdout:3/720: read - d6/d15/d2d/d2f/d42/d83/fb0 zero size 2024-04-01T06:57:39.546 INFO:tasks.workunit.client.0.smithi083.stdout:3/721: dread - d6/d15/d2d/d2f/d3e/fc6 zero size 2024-04-01T06:57:39.546 INFO:tasks.workunit.client.0.smithi083.stdout:0/628: creat d16/d1d/d8d/fd7 x:0 0 0 2024-04-01T06:57:39.546 INFO:tasks.workunit.client.0.smithi083.stdout:0/629: chown d16/d2e/dba 180288873 1 2024-04-01T06:57:39.546 INFO:tasks.workunit.client.0.smithi083.stdout:0/630: read - d16/d2e/d3d/f59 zero size 2024-04-01T06:57:39.547 INFO:tasks.workunit.client.0.smithi083.stdout:7/471: symlink d0/d4/d9/d39/d67/la2 0 2024-04-01T06:57:39.548 INFO:tasks.workunit.client.0.smithi083.stdout:9/504: symlink d6/d32/d26/d8e/lad 0 2024-04-01T06:57:39.548 INFO:tasks.workunit.client.0.smithi083.stdout:7/472: read d0/d4/f32 [589273,67425] 0 2024-04-01T06:57:39.549 INFO:tasks.workunit.client.0.smithi083.stdout:7/473: write d0/d7a/f7b [934107,22193] 0 2024-04-01T06:57:39.549 INFO:tasks.workunit.client.0.smithi083.stdout:3/722: truncate d6/d15/d2d/d2f/d53/fbc 398423 0 2024-04-01T06:57:39.552 INFO:tasks.workunit.client.0.smithi083.stdout:9/505: creat d6/d32/d3c/d4c/fae x:0 0 0 2024-04-01T06:57:39.554 INFO:tasks.workunit.client.0.smithi083.stdout:5/465: dwrite d4/d71/d7d/f8c [0,4194304] 0 2024-04-01T06:57:39.558 INFO:tasks.workunit.client.0.smithi083.stdout:9/506: dread d6/d32/d4d/f5c [0,4194304] 0 2024-04-01T06:57:39.558 INFO:tasks.workunit.client.0.smithi083.stdout:9/507: write d6/d76/fac [686533,56824] 0 2024-04-01T06:57:39.559 INFO:tasks.workunit.client.0.smithi083.stdout:7/474: symlink d0/d4/d9/d39/d67/d6d/d87/d83/d34/la3 0 2024-04-01T06:57:39.561 INFO:tasks.workunit.client.0.smithi083.stdout:3/723: creat d6/d15/d2d/d2f/d42/d5c/d88/db9/feb x:0 0 0 2024-04-01T06:57:39.564 INFO:tasks.workunit.client.0.smithi083.stdout:5/466: link d4/d9/d16/d1f/d2f/d53/f70 d4/d9/d16/f9e 0 2024-04-01T06:57:39.564 INFO:tasks.workunit.client.0.smithi083.stdout:5/467: stat d4/d2b/d21 0 2024-04-01T06:57:39.568 INFO:tasks.workunit.client.0.smithi083.stdout:5/468: mkdir d4/d9/d16/d9f 0 2024-04-01T06:57:39.569 INFO:tasks.workunit.client.0.smithi083.stdout:5/469: mkdir d4/d23/d49/d7f/da0 0 2024-04-01T06:57:39.570 INFO:tasks.workunit.client.0.smithi083.stdout:5/470: stat d4/d23/c72 0 2024-04-01T06:57:39.570 INFO:tasks.workunit.client.0.smithi083.stdout:5/471: creat d4/d23/d49/fa1 x:0 0 0 2024-04-01T06:57:39.572 INFO:tasks.workunit.client.0.smithi083.stdout:1/685: sync 2024-04-01T06:57:39.575 INFO:tasks.workunit.client.0.smithi083.stdout:1/686: rename db/l58 to db/d1c/d1d/lf7 0 2024-04-01T06:57:39.575 INFO:tasks.workunit.client.0.smithi083.stdout:1/687: dread - db/d1c/d29/d33/fc6 zero size 2024-04-01T06:57:39.575 INFO:tasks.workunit.client.0.smithi083.stdout:7/475: dwrite d0/d4/d9/d39/d67/d6d/d87/d83/f72 [0,4194304] 0 2024-04-01T06:57:39.576 INFO:tasks.workunit.client.0.smithi083.stdout:1/688: mknod db/d1c/d1d/db4/cf8 0 2024-04-01T06:57:39.577 INFO:tasks.workunit.client.0.smithi083.stdout:1/689: write db/d1c/d29/d33/d50/d5d/d6c/f74 [2274471,42162] 0 2024-04-01T06:57:39.578 INFO:tasks.workunit.client.0.smithi083.stdout:1/690: write db/d1c/d29/f3e [7165900,80336] 0 2024-04-01T06:57:39.579 INFO:tasks.workunit.client.0.smithi083.stdout:1/691: readlink db/d1c/d1d/l7f 0 2024-04-01T06:57:39.579 INFO:tasks.workunit.client.0.smithi083.stdout:5/472: dread d4/d9/d16/d19/f4b [0,4194304] 0 2024-04-01T06:57:39.579 INFO:tasks.workunit.client.0.smithi083.stdout:5/473: chown d4/d9/d16/d1f/d2f/f59 22 1 2024-04-01T06:57:39.580 INFO:tasks.workunit.client.0.smithi083.stdout:7/476: mkdir d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/da4 0 2024-04-01T06:57:39.584 INFO:tasks.workunit.client.0.smithi083.stdout:5/474: rename d4/d9/l17 to d4/d9/d16/d9f/la2 0 2024-04-01T06:57:39.584 INFO:tasks.workunit.client.0.smithi083.stdout:5/475: write d4/d9/d16/d1f/d2f/f60 [1207581,77547] 0 2024-04-01T06:57:39.584 INFO:tasks.workunit.client.0.smithi083.stdout:7/477: creat d0/d7a/fa5 x:0 0 0 2024-04-01T06:57:39.584 INFO:tasks.workunit.client.0.smithi083.stdout:7/478: stat d0/d4/c75 0 2024-04-01T06:57:39.585 INFO:tasks.workunit.client.0.smithi083.stdout:1/692: mknod db/d1c/d29/cf9 0 2024-04-01T06:57:39.585 INFO:tasks.workunit.client.0.smithi083.stdout:1/693: fdatasync db/d1c/d29/d33/d50/d5d/d81/d94/fc4 0 2024-04-01T06:57:39.585 INFO:tasks.workunit.client.0.smithi083.stdout:5/476: rmdir d4/d23/d67 39 2024-04-01T06:57:39.586 INFO:tasks.workunit.client.0.smithi083.stdout:5/477: write d4/f93 [4234200,26555] 0 2024-04-01T06:57:39.586 INFO:tasks.workunit.client.0.smithi083.stdout:5/478: chown d4/d71 2 1 2024-04-01T06:57:39.586 INFO:tasks.workunit.client.0.smithi083.stdout:7/479: symlink d0/d4/d9/d39/la6 0 2024-04-01T06:57:39.587 INFO:tasks.workunit.client.0.smithi083.stdout:1/694: mknod db/d1c/d29/d33/d50/cfa 0 2024-04-01T06:57:39.587 INFO:tasks.workunit.client.0.smithi083.stdout:5/479: rmdir d4/d9/d16/d19/d5e 39 2024-04-01T06:57:39.589 INFO:tasks.workunit.client.0.smithi083.stdout:7/480: unlink d0/d7c/f91 0 2024-04-01T06:57:39.589 INFO:tasks.workunit.client.0.smithi083.stdout:7/481: stat d0/d4/d9/d39/d67/d6d/d87/d83/f53 0 2024-04-01T06:57:39.589 INFO:tasks.workunit.client.0.smithi083.stdout:1/695: mknod db/d1c/d29/d33/d50/d5d/d6c/ddb/cfb 0 2024-04-01T06:57:39.589 INFO:tasks.workunit.client.0.smithi083.stdout:1/696: readlink db/d1c/d2e/d30/l3f 0 2024-04-01T06:57:39.590 INFO:tasks.workunit.client.0.smithi083.stdout:1/697: write db/d1c/d29/d33/d50/d4d/f90 [638886,9775] 0 2024-04-01T06:57:39.590 INFO:tasks.workunit.client.0.smithi083.stdout:5/480: creat d4/d71/fa3 x:0 0 0 2024-04-01T06:57:39.590 INFO:tasks.workunit.client.0.smithi083.stdout:7/482: symlink d0/d7c/la7 0 2024-04-01T06:57:39.591 INFO:tasks.workunit.client.0.smithi083.stdout:1/698: creat db/d1c/d29/d33/d50/d5d/dad/dbf/ffc x:0 0 0 2024-04-01T06:57:39.591 INFO:tasks.workunit.client.0.smithi083.stdout:1/699: truncate db/d1c/d29/d33/d50/d5d/dad/dbf/fda 465603 0 2024-04-01T06:57:39.592 INFO:tasks.workunit.client.0.smithi083.stdout:5/481: creat d4/d9/d16/d9f/fa4 x:0 0 0 2024-04-01T06:57:39.592 INFO:tasks.workunit.client.0.smithi083.stdout:7/483: getdents d0/d4/d9/d39/d67/d6d 0 2024-04-01T06:57:39.593 INFO:tasks.workunit.client.0.smithi083.stdout:1/700: mkdir db/d1c/d2e/dfd 0 2024-04-01T06:57:39.594 INFO:tasks.workunit.client.0.smithi083.stdout:5/482: mknod d4/d9/d16/ca5 0 2024-04-01T06:57:39.594 INFO:tasks.workunit.client.0.smithi083.stdout:5/483: stat d4/d23/d67/c89 0 2024-04-01T06:57:39.595 INFO:tasks.workunit.client.0.smithi083.stdout:1/701: truncate db/d1c/f2b 2347958 0 2024-04-01T06:57:39.595 INFO:tasks.workunit.client.0.smithi083.stdout:7/484: dread d0/d7a/f7b [0,4194304] 0 2024-04-01T06:57:39.597 INFO:tasks.workunit.client.0.smithi083.stdout:1/702: rename db/d1c/d29/d33/d50/d5d/dad/dbf/fda to db/d1c/d2e/dfd/ffe 0 2024-04-01T06:57:39.597 INFO:tasks.workunit.client.0.smithi083.stdout:1/703: truncate db/d1c/d2e/d30/fc7 872060 0 2024-04-01T06:57:39.597 INFO:tasks.workunit.client.0.smithi083.stdout:1/704: chown db/d1c/d29/d33/d50/d5d/d6c/ddb 14296382 1 2024-04-01T06:57:39.598 INFO:tasks.workunit.client.0.smithi083.stdout:7/485: unlink d0/d4/d9/d39/d67/d6d/d87/f93 0 2024-04-01T06:57:39.598 INFO:tasks.workunit.client.0.smithi083.stdout:7/486: chown d0/l99 3 1 2024-04-01T06:57:39.600 INFO:tasks.workunit.client.0.smithi083.stdout:1/705: rename db/d1c/d29/d33/d50/d5d/d81/ca3 to db/d1c/d29/d33/d47/d76/db6/cff 0 2024-04-01T06:57:39.600 INFO:tasks.workunit.client.0.smithi083.stdout:1/706: readlink db/d1c/d29/d33/d50/d4d/l54 0 2024-04-01T06:57:39.601 INFO:tasks.workunit.client.0.smithi083.stdout:7/487: truncate d0/d4/d9/f25 175201 0 2024-04-01T06:57:39.606 INFO:tasks.workunit.client.0.smithi083.stdout:1/707: rename db/d1c/d29/d33/d50/d4d/f90 to db/d1c/d29/d33/d50/d5d/dad/f100 0 2024-04-01T06:57:39.606 INFO:tasks.workunit.client.0.smithi083.stdout:1/708: truncate db/d1c/d29/d33/fc6 167460 0 2024-04-01T06:57:39.607 INFO:tasks.workunit.client.0.smithi083.stdout:5/484: dwrite d4/d9/d16/d19/d5e/f64 [0,4194304] 0 2024-04-01T06:57:39.607 INFO:tasks.workunit.client.0.smithi083.stdout:1/709: creat db/d1c/d29/d33/f101 x:0 0 0 2024-04-01T06:57:39.608 INFO:tasks.workunit.client.0.smithi083.stdout:5/485: mknod d4/d9/d16/d1f/ca6 0 2024-04-01T06:57:39.608 INFO:tasks.workunit.client.0.smithi083.stdout:5/486: readlink d4/d9/d4f/d68/l91 0 2024-04-01T06:57:39.609 INFO:tasks.workunit.client.0.smithi083.stdout:1/710: creat db/d1c/d2e/d30/d82/f102 x:0 0 0 2024-04-01T06:57:39.612 INFO:tasks.workunit.client.0.smithi083.stdout:7/488: dwrite d0/d4/d9/d39/d67/d6d/d87/f8f [0,4194304] 0 2024-04-01T06:57:39.612 INFO:tasks.workunit.client.0.smithi083.stdout:5/487: rename d4/d9/d4f/d68/c80 to d4/d23/d4e/d83/ca7 0 2024-04-01T06:57:39.620 INFO:tasks.workunit.client.0.smithi083.stdout:7/489: dread d0/f37 [0,4194304] 0 2024-04-01T06:57:39.622 INFO:tasks.workunit.client.0.smithi083.stdout:7/490: write d0/d4/f2a [149055,95717] 0 2024-04-01T06:57:39.623 INFO:tasks.workunit.client.0.smithi083.stdout:7/491: write d0/d4/d9/d39/d67/d6d/d87/f8f [1224830,90582] 0 2024-04-01T06:57:39.623 INFO:tasks.workunit.client.0.smithi083.stdout:7/492: fsync d0/d7a/f7b 0 2024-04-01T06:57:39.623 INFO:tasks.workunit.client.0.smithi083.stdout:7/493: chown d0/d4/d9/d39/f70 360 1 2024-04-01T06:57:39.626 INFO:tasks.workunit.client.0.smithi083.stdout:7/494: fdatasync d0/d4/d9/d39/d67/d6d/d87/f8f 0 2024-04-01T06:57:39.626 INFO:tasks.workunit.client.0.smithi083.stdout:7/495: write d0/d4/ff [1490487,18368] 0 2024-04-01T06:57:39.626 INFO:tasks.workunit.client.0.smithi083.stdout:7/496: chown d0/d4/d9/d39/d67/d6d/d87/d83/f42 34196416 1 2024-04-01T06:57:39.626 INFO:tasks.workunit.client.0.smithi083.stdout:1/711: dwrite db/d1c/d1d/f45 [8388608,4194304] 0 2024-04-01T06:57:39.627 INFO:tasks.workunit.client.0.smithi083.stdout:7/497: mknod d0/d4/d9/d39/d67/d6d/d7d/d8a/ca8 0 2024-04-01T06:57:39.627 INFO:tasks.workunit.client.0.smithi083.stdout:5/488: dwrite d4/d9/d16/d1f/d2f/d53/f70 [0,4194304] 0 2024-04-01T06:57:39.631 INFO:tasks.workunit.client.0.smithi083.stdout:7/498: rename d0/l40 to d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/d92/la9 0 2024-04-01T06:57:39.636 INFO:tasks.workunit.client.0.smithi083.stdout:1/712: rmdir db/d1c/d29/d33/d50 39 2024-04-01T06:57:39.637 INFO:tasks.workunit.client.0.smithi083.stdout:5/489: getdents d4/d23/d49/d7f 0 2024-04-01T06:57:39.637 INFO:tasks.workunit.client.0.smithi083.stdout:5/490: dread - d4/d71/fa3 zero size 2024-04-01T06:57:39.639 INFO:tasks.workunit.client.0.smithi083.stdout:7/499: mkdir d0/d4/d9/d39/d67/d6d/d87/d83/d38/daa 0 2024-04-01T06:57:39.639 INFO:tasks.workunit.client.0.smithi083.stdout:7/500: truncate d0/d4/d9/d39/d67/d6d/f6b 752594 0 2024-04-01T06:57:39.639 INFO:tasks.workunit.client.0.smithi083.stdout:7/501: fsync d0/d4/d9/d39/d67/d6d/d87/d83/d38/f68 0 2024-04-01T06:57:39.641 INFO:tasks.workunit.client.0.smithi083.stdout:1/713: creat db/d1c/d29/d33/d50/d5d/d6c/d8e/f103 x:0 0 0 2024-04-01T06:57:39.641 INFO:tasks.workunit.client.0.smithi083.stdout:1/714: fdatasync db/d1c/d29/f3e 0 2024-04-01T06:57:39.647 INFO:tasks.workunit.client.0.smithi083.stdout:5/491: dwrite d4/d55/f9d [0,4194304] 0 2024-04-01T06:57:39.649 INFO:tasks.workunit.client.0.smithi083.stdout:1/715: dread db/d1c/d29/d33/d50/f27 [0,4194304] 0 2024-04-01T06:57:39.649 INFO:tasks.workunit.client.0.smithi083.stdout:1/716: readlink db/d1c/d29/d33/d50/d5d/dad/dbf/l77 0 2024-04-01T06:57:39.649 INFO:tasks.workunit.client.0.smithi083.stdout:1/717: fdatasync db/d1c/d29/d33/d50/fcf 0 2024-04-01T06:57:39.649 INFO:tasks.workunit.client.0.smithi083.stdout:1/718: stat db/d61/cd4 0 2024-04-01T06:57:39.649 INFO:tasks.workunit.client.0.smithi083.stdout:5/492: mkdir d4/d71/d94/da8 0 2024-04-01T06:57:39.650 INFO:tasks.workunit.client.0.smithi083.stdout:1/719: creat db/d1c/d29/df0/f104 x:0 0 0 2024-04-01T06:57:39.651 INFO:tasks.workunit.client.0.smithi083.stdout:7/502: dwrite d0/d4/d9/d39/d67/d6d/f6b [0,4194304] 0 2024-04-01T06:57:39.651 INFO:tasks.workunit.client.0.smithi083.stdout:1/720: mknod db/d1c/d29/d33/d50/c105 0 2024-04-01T06:57:39.653 INFO:tasks.workunit.client.0.smithi083.stdout:5/493: dread d4/d9/d16/d1f/d2f/f60 [0,4194304] 0 2024-04-01T06:57:39.653 INFO:tasks.workunit.client.0.smithi083.stdout:5/494: readlink d4/d9/d4f/d68/l91 0 2024-04-01T06:57:39.654 INFO:tasks.workunit.client.0.smithi083.stdout:7/503: creat d0/d4/d9/d39/d67/d6d/d7d/d8a/fab x:0 0 0 2024-04-01T06:57:39.658 INFO:tasks.workunit.client.0.smithi083.stdout:1/721: dread db/d1c/d1d/d8b/f8f [0,4194304] 0 2024-04-01T06:57:39.659 INFO:tasks.workunit.client.0.smithi083.stdout:5/495: mkdir d4/d2b/da9 0 2024-04-01T06:57:39.660 INFO:tasks.workunit.client.0.smithi083.stdout:7/504: creat d0/d4/d9/d39/d67/d6d/fac x:0 0 0 2024-04-01T06:57:39.660 INFO:tasks.workunit.client.0.smithi083.stdout:7/505: dread - d0/d4/d9/f5e zero size 2024-04-01T06:57:39.661 INFO:tasks.workunit.client.0.smithi083.stdout:7/506: rmdir d0/d4/d9/d39/d67 39 2024-04-01T06:57:39.662 INFO:tasks.workunit.client.0.smithi083.stdout:6/543: sync 2024-04-01T06:57:39.662 INFO:tasks.workunit.client.0.smithi083.stdout:4/491: sync 2024-04-01T06:57:39.662 INFO:tasks.workunit.client.0.smithi083.stdout:7/507: write d0/d4/d9/d39/d67/d6d/d87/d83/d38/f4f [153138,25855] 0 2024-04-01T06:57:39.664 INFO:tasks.workunit.client.0.smithi083.stdout:4/492: creat d1/d8/f93 x:0 0 0 2024-04-01T06:57:39.664 INFO:tasks.workunit.client.0.smithi083.stdout:4/493: chown d1/d8/d6a/f7f 20014 1 2024-04-01T06:57:39.664 INFO:tasks.workunit.client.0.smithi083.stdout:6/544: rename d9/dc/d1b/d35/fa1 to d9/dc/d1b/d35/d48/d52/d9c/fb6 0 2024-04-01T06:57:39.667 INFO:tasks.workunit.client.0.smithi083.stdout:4/494: mkdir d1/d4/db/d94 0 2024-04-01T06:57:39.667 INFO:tasks.workunit.client.0.smithi083.stdout:6/545: mknod d9/dc/d1b/d4c/d99/cb7 0 2024-04-01T06:57:39.667 INFO:tasks.workunit.client.0.smithi083.stdout:6/546: chown d9/dc/d1b/d35/d48/d52 16258418 1 2024-04-01T06:57:39.667 INFO:tasks.workunit.client.0.smithi083.stdout:5/496: dread d4/d23/d4e/f57 [0,4194304] 0 2024-04-01T06:57:39.667 INFO:tasks.workunit.client.0.smithi083.stdout:5/497: chown d4/d55 4512 1 2024-04-01T06:57:39.667 INFO:tasks.workunit.client.0.smithi083.stdout:6/547: rmdir d9/dc/d1b/d35/d48/d52/d9c/dab 39 2024-04-01T06:57:39.669 INFO:tasks.workunit.client.0.smithi083.stdout:6/548: rmdir d9/dc/d1b/d35/d48/d52/d9c/db0 0 2024-04-01T06:57:39.670 INFO:tasks.workunit.client.0.smithi083.stdout:6/549: creat d9/dc/d1b/d39/d68/fb8 x:0 0 0 2024-04-01T06:57:39.672 INFO:tasks.workunit.client.0.smithi083.stdout:6/550: dread d9/dc/f14 [0,4194304] 0 2024-04-01T06:57:39.674 INFO:tasks.workunit.client.0.smithi083.stdout:6/551: mknod d9/dc/d29/cb9 0 2024-04-01T06:57:39.674 INFO:tasks.workunit.client.0.smithi083.stdout:6/552: write d9/dc/f42 [520975,107370] 0 2024-04-01T06:57:39.675 INFO:tasks.workunit.client.0.smithi083.stdout:6/553: stat d9/dc/d29/d3c/d5c 0 2024-04-01T06:57:39.675 INFO:tasks.workunit.client.0.smithi083.stdout:7/508: dwrite d0/d4/f69 [0,4194304] 0 2024-04-01T06:57:39.677 INFO:tasks.workunit.client.0.smithi083.stdout:7/509: truncate d0/d4/d9/d39/d67/d6d/d87/f8f 39430 0 2024-04-01T06:57:39.677 INFO:tasks.workunit.client.0.smithi083.stdout:7/510: write d0/d4/d9/f25 [769055,745] 0 2024-04-01T06:57:39.686 INFO:tasks.workunit.client.0.smithi083.stdout:4/495: dwrite d1/f2 [0,4194304] 0 2024-04-01T06:57:39.686 INFO:tasks.workunit.client.0.smithi083.stdout:4/496: chown d1/d4/f7e 50 1 2024-04-01T06:57:39.687 INFO:tasks.workunit.client.0.smithi083.stdout:4/497: symlink d1/d4/d33/l95 0 2024-04-01T06:57:39.688 INFO:tasks.workunit.client.0.smithi083.stdout:4/498: rename d1/d4/d33/f81 to d1/d4/d6e/f96 0 2024-04-01T06:57:39.689 INFO:tasks.workunit.client.0.smithi083.stdout:4/499: rmdir d1/d8/d6a 39 2024-04-01T06:57:39.689 INFO:tasks.workunit.client.0.smithi083.stdout:7/511: dwrite d0/d4/d9/d39/d67/d6d/d87/d83/f42 [0,4194304] 0 2024-04-01T06:57:39.689 INFO:tasks.workunit.client.0.smithi083.stdout:7/512: write d0/d4/d9/d39/d67/d6d/d87/f9c [597411,5013] 0 2024-04-01T06:57:39.689 INFO:tasks.workunit.client.0.smithi083.stdout:7/513: read d0/d4/ff [865052,24980] 0 2024-04-01T06:57:39.709 INFO:tasks.workunit.client.0.smithi083.stdout:7/514: dwrite d0/d4/d9/d39/d67/d6d/d87/f9c [0,4194304] 0 2024-04-01T06:57:39.711 INFO:tasks.workunit.client.0.smithi083.stdout:4/500: dwrite d1/d47/f27 [0,4194304] 0 2024-04-01T06:57:39.711 INFO:tasks.workunit.client.0.smithi083.stdout:7/515: write d0/d4/d9/d39/d67/d6d/d87/d83/f27 [4303845,1548] 0 2024-04-01T06:57:39.714 INFO:tasks.workunit.client.0.smithi083.stdout:4/501: rename d1/d8/f14 to d1/d47/d90/f97 0 2024-04-01T06:57:39.715 INFO:tasks.workunit.client.0.smithi083.stdout:7/516: link d0/d7c/la7 d0/d4/d9/d39/d67/d6d/d7d/d8a/lad 0 2024-04-01T06:57:39.719 INFO:tasks.workunit.client.0.smithi083.stdout:4/502: rmdir d1/d47 39 2024-04-01T06:57:39.720 INFO:tasks.workunit.client.0.smithi083.stdout:4/503: rename d1/d4/d6e/l74 to d1/d4/d33/l98 0 2024-04-01T06:57:39.722 INFO:tasks.workunit.client.0.smithi083.stdout:4/504: truncate d1/d4/da/f39 537108 0 2024-04-01T06:57:39.723 INFO:tasks.workunit.client.0.smithi083.stdout:4/505: creat d1/d4/da/d88/f99 x:0 0 0 2024-04-01T06:57:39.723 INFO:tasks.workunit.client.0.smithi083.stdout:7/517: dread d0/d4/f58 [0,4194304] 0 2024-04-01T06:57:39.725 INFO:tasks.workunit.client.0.smithi083.stdout:7/518: creat d0/d4/d9/d39/fae x:0 0 0 2024-04-01T06:57:39.726 INFO:tasks.workunit.client.0.smithi083.stdout:7/519: creat d0/d4/d9/d39/d67/d6d/d87/d83/d38/daa/faf x:0 0 0 2024-04-01T06:57:39.741 INFO:tasks.workunit.client.0.smithi083.stdout:4/506: dwrite d1/d4/db/d5b/d62/f86 [0,4194304] 0 2024-04-01T06:57:39.741 INFO:tasks.workunit.client.0.smithi083.stdout:4/507: chown d1/d4/da/d88 0 1 2024-04-01T06:57:39.741 INFO:tasks.workunit.client.0.smithi083.stdout:4/508: fsync d1/d4/d33/f49 0 2024-04-01T06:57:39.742 INFO:tasks.workunit.client.0.smithi083.stdout:7/520: dwrite d0/d4/f80 [0,4194304] 0 2024-04-01T06:57:39.742 INFO:tasks.workunit.client.0.smithi083.stdout:7/521: truncate d0/d7a/f9f 452165 0 2024-04-01T06:57:39.743 INFO:tasks.workunit.client.0.smithi083.stdout:7/522: write d0/d4/d9/d39/d48/f85 [112819,15690] 0 2024-04-01T06:57:39.745 INFO:tasks.workunit.client.0.smithi083.stdout:7/523: symlink d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/lb0 0 2024-04-01T06:57:39.745 INFO:tasks.workunit.client.0.smithi083.stdout:7/524: truncate d0/d4/f58 4539872 0 2024-04-01T06:57:39.746 INFO:tasks.workunit.client.0.smithi083.stdout:7/525: creat d0/d4/d9/d39/d67/d6d/d87/fb1 x:0 0 0 2024-04-01T06:57:39.748 INFO:tasks.workunit.client.0.smithi083.stdout:7/526: mkdir d0/d4/d9/d39/d67/d6d/d87/d83/d38/daa/db2 0 2024-04-01T06:57:39.748 INFO:tasks.workunit.client.0.smithi083.stdout:7/527: write d0/d4/f2a [4999340,60115] 0 2024-04-01T06:57:39.750 INFO:tasks.workunit.client.0.smithi083.stdout:7/528: mkdir d0/d4/d9/d39/d67/d6d/d87/d83/d38/db3 0 2024-04-01T06:57:39.751 INFO:tasks.workunit.client.0.smithi083.stdout:7/529: creat d0/d4/d9/d39/d97/fb4 x:0 0 0 2024-04-01T06:57:39.751 INFO:tasks.workunit.client.0.smithi083.stdout:7/530: chown d0/d4/d9/d39/d67/d6d/d87/d83/f3c 1500 1 2024-04-01T06:57:39.753 INFO:tasks.workunit.client.0.smithi083.stdout:4/509: dwrite d1/d4/db/d5b/f5f [0,4194304] 0 2024-04-01T06:57:39.753 INFO:tasks.workunit.client.0.smithi083.stdout:4/510: read d1/d4/f7b [3375401,23753] 0 2024-04-01T06:57:39.761 INFO:tasks.workunit.client.0.smithi083.stdout:7/531: dread d0/d4/d9/d39/d67/d6d/d87/f9c [0,4194304] 0 2024-04-01T06:57:39.761 INFO:tasks.workunit.client.0.smithi083.stdout:4/511: truncate d1/d4/d33/f49 52234 0 2024-04-01T06:57:39.761 INFO:tasks.workunit.client.0.smithi083.stdout:4/512: fdatasync d1/d47/d2a/f31 0 2024-04-01T06:57:39.762 INFO:tasks.workunit.client.0.smithi083.stdout:7/532: mknod d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/d5d/cb5 0 2024-04-01T06:57:39.763 INFO:tasks.workunit.client.0.smithi083.stdout:4/513: symlink d1/d4/da/d88/l9a 0 2024-04-01T06:57:39.763 INFO:tasks.workunit.client.0.smithi083.stdout:4/514: dread - d1/d8/f93 zero size 2024-04-01T06:57:39.763 INFO:tasks.workunit.client.0.smithi083.stdout:4/515: write d1/d4/f4f [628592,28601] 0 2024-04-01T06:57:39.764 INFO:tasks.workunit.client.0.smithi083.stdout:7/533: mkdir d0/d4/d9/d39/d67/d6d/d7d/db6 0 2024-04-01T06:57:39.780 INFO:tasks.workunit.client.0.smithi083.stdout:4/516: dwrite d1/d4/db/f54 [0,4194304] 0 2024-04-01T06:57:39.782 INFO:tasks.workunit.client.0.smithi083.stdout:4/517: mknod d1/d4/db/d5b/c9b 0 2024-04-01T06:57:39.782 INFO:tasks.workunit.client.0.smithi083.stdout:4/518: chown d1/d4/db/d5b/d62/f86 3 1 2024-04-01T06:57:39.783 INFO:tasks.workunit.client.0.smithi083.stdout:4/519: rename d1/d4/d6e/f96 to d1/d8/d42/f9c 0 2024-04-01T06:57:39.804 INFO:tasks.workunit.client.0.smithi083.stdout:9/508: sync 2024-04-01T06:57:39.805 INFO:tasks.workunit.client.0.smithi083.stdout:8/611: sync 2024-04-01T06:57:39.805 INFO:tasks.workunit.client.0.smithi083.stdout:2/582: sync 2024-04-01T06:57:39.805 INFO:tasks.workunit.client.0.smithi083.stdout:0/631: sync 2024-04-01T06:57:39.805 INFO:tasks.workunit.client.0.smithi083.stdout:8/612: write d15/d1b/fcf [386926,48049] 0 2024-04-01T06:57:39.806 INFO:tasks.workunit.client.0.smithi083.stdout:0/632: write d16/d99/fa8 [2457929,34790] 0 2024-04-01T06:57:39.806 INFO:tasks.workunit.client.0.smithi083.stdout:0/633: write d16/d99/d4b/d6e/f9f [937569,71645] 0 2024-04-01T06:57:39.806 INFO:tasks.workunit.client.0.smithi083.stdout:2/583: mknod d3/d26/d59/dad/cc4 0 2024-04-01T06:57:39.806 INFO:tasks.workunit.client.0.smithi083.stdout:8/613: mkdir d15/d18/d19/d24/da2/da6/de2 0 2024-04-01T06:57:39.807 INFO:tasks.workunit.client.0.smithi083.stdout:0/634: getdents d16/d99/d4b 0 2024-04-01T06:57:39.807 INFO:tasks.workunit.client.0.smithi083.stdout:0/635: dread - d16/d2e/d3d/f59 zero size 2024-04-01T06:57:39.808 INFO:tasks.workunit.client.0.smithi083.stdout:2/584: creat d3/d4d/d5d/fc5 x:0 0 0 2024-04-01T06:57:39.810 INFO:tasks.workunit.client.0.smithi083.stdout:8/614: mkdir d15/d18/d1e/de3 0 2024-04-01T06:57:39.811 INFO:tasks.workunit.client.0.smithi083.stdout:0/636: link d16/d1d/f51 d16/d2e/d3d/d7c/fd8 0 2024-04-01T06:57:39.812 INFO:tasks.workunit.client.0.smithi083.stdout:2/585: rmdir d3/d26/d59/d2b/d9f 39 2024-04-01T06:57:39.813 INFO:tasks.workunit.client.0.smithi083.stdout:9/509: dwrite d6/d32/d26/d2d/d34/f3b [0,4194304] 0 2024-04-01T06:57:39.813 INFO:tasks.workunit.client.0.smithi083.stdout:2/586: dread d3/d8b/f51 [0,4194304] 0 2024-04-01T06:57:39.814 INFO:tasks.workunit.client.0.smithi083.stdout:0/637: unlink d16/d1d/c26 0 2024-04-01T06:57:39.814 INFO:tasks.workunit.client.0.smithi083.stdout:0/638: fsync d16/d99/d4b/d6e/fac 0 2024-04-01T06:57:39.814 INFO:tasks.workunit.client.0.smithi083.stdout:0/639: truncate d16/d1d/d8d/fc4 169680 0 2024-04-01T06:57:39.814 INFO:tasks.workunit.client.0.smithi083.stdout:9/510: write d6/d32/d4d/f5c [3118736,26733] 0 2024-04-01T06:57:39.816 INFO:tasks.workunit.client.0.smithi083.stdout:2/587: mknod d3/d8b/d53/d66/dc1/cc6 0 2024-04-01T06:57:39.816 INFO:tasks.workunit.client.0.smithi083.stdout:2/588: read d3/f16 [780760,3919] 0 2024-04-01T06:57:39.818 INFO:tasks.workunit.client.0.smithi083.stdout:0/640: read f14 [3540382,84649] 0 2024-04-01T06:57:39.820 INFO:tasks.workunit.client.0.smithi083.stdout:2/589: unlink d3/d26/c47 0 2024-04-01T06:57:39.820 INFO:tasks.workunit.client.0.smithi083.stdout:2/590: getdents d3/d71/d90/db6 0 2024-04-01T06:57:39.824 INFO:tasks.workunit.client.0.smithi083.stdout:0/641: symlink d16/d2e/d5b/d74/ld9 0 2024-04-01T06:57:39.824 INFO:tasks.workunit.client.0.smithi083.stdout:0/642: chown d16/d2e/d6c/d82/lbd 1475819 1 2024-04-01T06:57:39.824 INFO:tasks.workunit.client.0.smithi083.stdout:2/591: readlink d3/d26/d59/l6d 0 2024-04-01T06:57:39.824 INFO:tasks.workunit.client.0.smithi083.stdout:0/643: mkdir d16/d2e/d3d/dda 0 2024-04-01T06:57:39.826 INFO:tasks.workunit.client.0.smithi083.stdout:0/644: creat d16/d2e/d5b/d74/dd3/fdb x:0 0 0 2024-04-01T06:57:39.826 INFO:tasks.workunit.client.0.smithi083.stdout:2/592: creat d3/d26/d59/daf/fc7 x:0 0 0 2024-04-01T06:57:39.827 INFO:tasks.workunit.client.0.smithi083.stdout:0/645: symlink d16/d2e/d3d/dda/ldc 0 2024-04-01T06:57:39.829 INFO:tasks.workunit.client.0.smithi083.stdout:0/646: unlink d16/d99/f61 0 2024-04-01T06:57:39.829 INFO:tasks.workunit.client.0.smithi083.stdout:0/647: fdatasync d16/f22 0 2024-04-01T06:57:39.829 INFO:tasks.workunit.client.0.smithi083.stdout:0/648: dread - d16/d99/d4b/d68/fd6 zero size 2024-04-01T06:57:39.829 INFO:tasks.workunit.client.0.smithi083.stdout:8/615: dwrite d15/d1b/fa7 [0,4194304] 0 2024-04-01T06:57:39.829 INFO:tasks.workunit.client.0.smithi083.stdout:8/616: dread - d15/d1b/d39/d48/f68 zero size 2024-04-01T06:57:39.835 INFO:tasks.workunit.client.0.smithi083.stdout:2/593: dread d3/d26/d59/f30 [4194304,4194304] 0 2024-04-01T06:57:39.836 INFO:tasks.workunit.client.0.smithi083.stdout:8/617: creat d15/d18/d19/d6c/fe4 x:0 0 0 2024-04-01T06:57:39.838 INFO:tasks.workunit.client.0.smithi083.stdout:2/594: mknod d3/d8b/d53/d68/cc8 0 2024-04-01T06:57:39.839 INFO:tasks.workunit.client.0.smithi083.stdout:2/595: chown d3/d26/d59/d2b/f32 1 1 2024-04-01T06:57:39.839 INFO:tasks.workunit.client.0.smithi083.stdout:8/618: truncate d15/d1b/d39/d48/f7c 3675401 0 2024-04-01T06:57:39.839 INFO:tasks.workunit.client.0.smithi083.stdout:8/619: stat d15/d21/cd7 0 2024-04-01T06:57:39.839 INFO:tasks.workunit.client.0.smithi083.stdout:0/649: dwrite d16/d1d/f8b [0,4194304] 0 2024-04-01T06:57:39.839 INFO:tasks.workunit.client.0.smithi083.stdout:2/596: creat d3/d26/fc9 x:0 0 0 2024-04-01T06:57:39.839 INFO:tasks.workunit.client.0.smithi083.stdout:9/511: dwrite d6/f97 [0,4194304] 0 2024-04-01T06:57:39.841 INFO:tasks.workunit.client.0.smithi083.stdout:8/620: rename d15/d18/d19/d24/d44/d75/l81 to d15/d18/d19/le5 0 2024-04-01T06:57:39.842 INFO:tasks.workunit.client.0.smithi083.stdout:8/621: write d15/f7b [4183456,26138] 0 2024-04-01T06:57:39.845 INFO:tasks.workunit.client.0.smithi083.stdout:0/650: link d16/d1d/f8b d16/d99/d4b/d6e/d96/fdd 0 2024-04-01T06:57:39.845 INFO:tasks.workunit.client.0.smithi083.stdout:0/651: readlink d16/d1d/l21 0 2024-04-01T06:57:39.846 INFO:tasks.workunit.client.0.smithi083.stdout:2/597: creat d3/d71/d81/fca x:0 0 0 2024-04-01T06:57:39.846 INFO:tasks.workunit.client.0.smithi083.stdout:2/598: truncate d3/d20/f2a 1478790 0 2024-04-01T06:57:39.850 INFO:tasks.workunit.client.0.smithi083.stdout:2/599: dread d3/f2f [0,4194304] 0 2024-04-01T06:57:39.850 INFO:tasks.workunit.client.0.smithi083.stdout:2/600: chown d3/d8b/c9b 683 1 2024-04-01T06:57:39.851 INFO:tasks.workunit.client.0.smithi083.stdout:8/622: mknod d15/d18/d19/d24/d44/ce6 0 2024-04-01T06:57:39.851 INFO:tasks.workunit.client.0.smithi083.stdout:8/623: stat d15/f7b 0 2024-04-01T06:57:39.852 INFO:tasks.workunit.client.0.smithi083.stdout:0/652: rename d16/d99/d4b/fa2 to d16/d2e/dba/fde 0 2024-04-01T06:57:39.852 INFO:tasks.workunit.client.0.smithi083.stdout:0/653: chown d16/d2e/dba/fde 84951 1 2024-04-01T06:57:39.853 INFO:tasks.workunit.client.0.smithi083.stdout:2/601: creat d3/d8b/d53/fcb x:0 0 0 2024-04-01T06:57:39.855 INFO:tasks.workunit.client.0.smithi083.stdout:2/602: dread d3/d8b/d53/f97 [0,4194304] 0 2024-04-01T06:57:39.855 INFO:tasks.workunit.client.0.smithi083.stdout:8/624: truncate d15/d18/d19/d24/da2/d6f/fc8 5262117 0 2024-04-01T06:57:39.856 INFO:tasks.workunit.client.0.smithi083.stdout:0/654: creat d16/d99/d4b/d95/fdf x:0 0 0 2024-04-01T06:57:39.856 INFO:tasks.workunit.client.0.smithi083.stdout:0/655: stat d16/d2e/d3d/d7c 0 2024-04-01T06:57:39.857 INFO:tasks.workunit.client.0.smithi083.stdout:8/625: truncate d15/d1b/d39/d48/d5e/d70/f86 2585053 0 2024-04-01T06:57:39.858 INFO:tasks.workunit.client.0.smithi083.stdout:8/626: stat d15/faa 0 2024-04-01T06:57:39.858 INFO:tasks.workunit.client.0.smithi083.stdout:0/656: creat d16/d2e/d3d/dda/fe0 x:0 0 0 2024-04-01T06:57:39.860 INFO:tasks.workunit.client.0.smithi083.stdout:8/627: truncate d15/d1b/d39/d48/d5e/f66 3252142 0 2024-04-01T06:57:39.861 INFO:tasks.workunit.client.0.smithi083.stdout:0/657: creat d16/d99/d4b/d95/fe1 x:0 0 0 2024-04-01T06:57:39.861 INFO:tasks.workunit.client.0.smithi083.stdout:8/628: write d15/d18/d19/f5d [1353979,31144] 0 2024-04-01T06:57:39.862 INFO:tasks.workunit.client.0.smithi083.stdout:0/658: creat d16/d2e/dba/fe2 x:0 0 0 2024-04-01T06:57:39.864 INFO:tasks.workunit.client.0.smithi083.stdout:8/629: rename d15/d82 to d15/d18/d19/d24/d38/de7 0 2024-04-01T06:57:39.866 INFO:tasks.workunit.client.0.smithi083.stdout:0/659: rename d16/d2e/d6c/d82/l8c to d16/d99/dc2/le3 0 2024-04-01T06:57:39.866 INFO:tasks.workunit.client.0.smithi083.stdout:8/630: dread d15/d18/d19/d24/fbb [0,4194304] 0 2024-04-01T06:57:39.867 INFO:tasks.workunit.client.0.smithi083.stdout:0/660: symlink d16/d2e/d3d/d7c/le4 0 2024-04-01T06:57:39.880 INFO:tasks.workunit.client.0.smithi083.stdout:3/724: sync 2024-04-01T06:57:39.881 INFO:tasks.workunit.client.0.smithi083.stdout:3/725: mkdir d6/d15/dec 0 2024-04-01T06:57:39.883 INFO:tasks.workunit.client.0.smithi083.stdout:3/726: rmdir d6/d1e/d4a/dd0/dd8 39 2024-04-01T06:57:39.884 INFO:tasks.workunit.client.0.smithi083.stdout:0/661: dwrite d16/d99/d4b/d6e/fac [0,4194304] 0 2024-04-01T06:57:39.886 INFO:tasks.workunit.client.0.smithi083.stdout:3/727: mkdir d6/d15/d2d/d2f/d42/d46/dd2/ded 0 2024-04-01T06:57:39.886 INFO:tasks.workunit.client.0.smithi083.stdout:8/631: dwrite d15/d18/fa4 [0,4194304] 0 2024-04-01T06:57:39.886 INFO:tasks.workunit.client.0.smithi083.stdout:8/632: read d15/d18/d1e/f9d [1933339,73150] 0 2024-04-01T06:57:39.886 INFO:tasks.workunit.client.0.smithi083.stdout:8/633: write d15/d1b/d39/d48/fca [875595,130389] 0 2024-04-01T06:57:39.887 INFO:tasks.workunit.client.0.smithi083.stdout:0/662: mkdir d16/d1d/dbb/de5 0 2024-04-01T06:57:39.888 INFO:tasks.workunit.client.0.smithi083.stdout:0/663: stat d16/d99/d4b/f5c 0 2024-04-01T06:57:39.888 INFO:tasks.workunit.client.0.smithi083.stdout:3/728: creat d6/d15/d2d/d2f/d3e/fee x:0 0 0 2024-04-01T06:57:39.888 INFO:tasks.workunit.client.0.smithi083.stdout:3/729: truncate d6/d15/d2d/d2f/d42/d46/fcb 1154713 0 2024-04-01T06:57:39.889 INFO:tasks.workunit.client.0.smithi083.stdout:0/664: mkdir d16/de6 0 2024-04-01T06:57:39.890 INFO:tasks.workunit.client.0.smithi083.stdout:3/730: symlink d6/d15/dec/lef 0 2024-04-01T06:57:39.890 INFO:tasks.workunit.client.0.smithi083.stdout:3/731: write d6/d1e/fc0 [1303860,44800] 0 2024-04-01T06:57:39.891 INFO:tasks.workunit.client.0.smithi083.stdout:0/665: rename d16/d2e/c81 to d16/d99/ce7 0 2024-04-01T06:57:39.891 INFO:tasks.workunit.client.0.smithi083.stdout:3/732: rename d6/d15/d2d/d2f/d42/d5c/d88/db9 to d6/d15/d2d/d2f/d42/d5c/d88/db9/df0 22 2024-04-01T06:57:39.891 INFO:tasks.workunit.client.0.smithi083.stdout:0/666: chown d16/d2e/d5b 189361 1 2024-04-01T06:57:39.898 INFO:tasks.workunit.client.0.smithi083.stdout:3/733: dread d6/f21 [0,4194304] 0 2024-04-01T06:57:39.899 INFO:tasks.workunit.client.0.smithi083.stdout:3/734: rmdir d6/d15/d2d/d2f/d53 39 2024-04-01T06:57:39.900 INFO:tasks.workunit.client.0.smithi083.stdout:8/634: dwrite d15/d21/f51 [0,4194304] 0 2024-04-01T06:57:39.905 INFO:tasks.workunit.client.0.smithi083.stdout:8/635: link d15/d18/d19/d24/da2/fd5 d15/d18/d1e/fe8 0 2024-04-01T06:57:39.905 INFO:tasks.workunit.client.0.smithi083.stdout:8/636: truncate d15/d21/f51 5853188 0 2024-04-01T06:57:39.906 INFO:tasks.workunit.client.0.smithi083.stdout:8/637: mknod d15/d18/d19/d24/da2/da6/de2/ce9 0 2024-04-01T06:57:39.907 INFO:tasks.workunit.client.0.smithi083.stdout:0/667: dwrite d16/d99/f83 [0,4194304] 0 2024-04-01T06:57:39.908 INFO:tasks.workunit.client.0.smithi083.stdout:0/668: dread - d16/d99/d4b/d68/fd6 zero size 2024-04-01T06:57:39.908 INFO:tasks.workunit.client.0.smithi083.stdout:0/669: truncate d16/d99/d4b/f94 337711 0 2024-04-01T06:57:39.909 INFO:tasks.workunit.client.0.smithi083.stdout:0/670: mknod d16/d1d/d8d/ce8 0 2024-04-01T06:57:39.909 INFO:tasks.workunit.client.0.smithi083.stdout:8/638: dread d15/d1b/d39/d48/fca [0,4194304] 0 2024-04-01T06:57:39.918 INFO:tasks.workunit.client.0.smithi083.stdout:8/639: dread d15/d1b/d39/d48/f59 [0,4194304] 0 2024-04-01T06:57:39.918 INFO:tasks.workunit.client.0.smithi083.stdout:8/640: truncate d15/d18/d19/f30 99702 0 2024-04-01T06:57:39.918 INFO:tasks.workunit.client.0.smithi083.stdout:8/641: chown d15/d21/dbc/fc3 282830 1 2024-04-01T06:57:39.919 INFO:tasks.workunit.client.0.smithi083.stdout:8/642: mknod d15/d18/d19/d24/da2/d6f/cea 0 2024-04-01T06:57:39.922 INFO:tasks.workunit.client.0.smithi083.stdout:0/671: dwrite d16/d1d/f37 [0,4194304] 0 2024-04-01T06:57:39.926 INFO:tasks.workunit.client.0.smithi083.stdout:8/643: rmdir d15/d1b/d39/d80 39 2024-04-01T06:57:39.928 INFO:tasks.workunit.client.0.smithi083.stdout:8/644: dread d15/d18/d19/f30 [0,4194304] 0 2024-04-01T06:57:39.934 INFO:tasks.workunit.client.0.smithi083.stdout:8/645: dread d15/d18/d19/d24/d38/f41 [0,4194304] 0 2024-04-01T06:57:39.934 INFO:tasks.workunit.client.0.smithi083.stdout:0/672: dwrite d16/f66 [0,4194304] 0 2024-04-01T06:57:39.937 INFO:tasks.workunit.client.0.smithi083.stdout:0/673: rename d16/d99/d63 to d16/d1d/dbb/de9 0 2024-04-01T06:57:39.937 INFO:tasks.workunit.client.0.smithi083.stdout:0/674: readlink d16/l3f 0 2024-04-01T06:57:39.938 INFO:tasks.workunit.client.0.smithi083.stdout:8/646: mkdir d15/d18/deb 0 2024-04-01T06:57:39.939 INFO:tasks.workunit.client.0.smithi083.stdout:8/647: creat d15/d21/fec x:0 0 0 2024-04-01T06:57:39.939 INFO:tasks.workunit.client.0.smithi083.stdout:8/648: fsync d15/d18/d19/d24/da2/d6f/fc8 0 2024-04-01T06:57:39.954 INFO:tasks.workunit.client.0.smithi083.stdout:8/649: dwrite d15/d1b/d39/d48/f68 [0,4194304] 0 2024-04-01T06:57:39.954 INFO:tasks.workunit.client.0.smithi083.stdout:8/650: write d15/faa [3117565,68657] 0 2024-04-01T06:57:39.955 INFO:tasks.workunit.client.0.smithi083.stdout:0/675: dwrite d16/f22 [0,4194304] 0 2024-04-01T06:57:39.955 INFO:tasks.workunit.client.0.smithi083.stdout:0/676: write d16/d99/d4b/d95/fe1 [889164,4019] 0 2024-04-01T06:57:39.955 INFO:tasks.workunit.client.0.smithi083.stdout:8/651: write d15/d21/f22 [1506100,72589] 0 2024-04-01T06:57:39.955 INFO:tasks.workunit.client.0.smithi083.stdout:8/652: truncate d15/d1b/fb9 790957 0 2024-04-01T06:57:39.956 INFO:tasks.workunit.client.0.smithi083.stdout:0/677: unlink d16/d1d/l28 0 2024-04-01T06:57:39.958 INFO:tasks.workunit.client.0.smithi083.stdout:8/653: creat d15/d18/deb/fed x:0 0 0 2024-04-01T06:57:39.959 INFO:tasks.workunit.client.0.smithi083.stdout:7/534: sync 2024-04-01T06:57:39.959 INFO:tasks.workunit.client.0.smithi083.stdout:5/498: sync 2024-04-01T06:57:39.959 INFO:tasks.workunit.client.0.smithi083.stdout:6/554: sync 2024-04-01T06:57:39.959 INFO:tasks.workunit.client.0.smithi083.stdout:1/722: sync 2024-04-01T06:57:39.961 INFO:tasks.workunit.client.0.smithi083.stdout:8/654: dread d15/d1b/d39/d48/f56 [0,4194304] 0 2024-04-01T06:57:39.961 INFO:tasks.workunit.client.0.smithi083.stdout:8/655: dread - d15/d21/dbc/fc3 zero size 2024-04-01T06:57:39.962 INFO:tasks.workunit.client.0.smithi083.stdout:0/678: rename d16/d99/fa8 to d16/d2e/d5b/d74/fea 0 2024-04-01T06:57:39.962 INFO:tasks.workunit.client.0.smithi083.stdout:0/679: write d16/d2e/f36 [2721371,92405] 0 2024-04-01T06:57:39.962 INFO:tasks.workunit.client.0.smithi083.stdout:8/656: write d15/d1b/fb9 [423457,108626] 0 2024-04-01T06:57:39.962 INFO:tasks.workunit.client.0.smithi083.stdout:8/657: chown d15/d18/d19/d24/d38/f41 118242 1 2024-04-01T06:57:39.962 INFO:tasks.workunit.client.0.smithi083.stdout:8/658: fsync d15/fc9 0 2024-04-01T06:57:39.968 INFO:tasks.workunit.client.0.smithi083.stdout:6/555: rename d9/dc/f83 to d9/dc/d1b/fba 0 2024-04-01T06:57:39.969 INFO:tasks.workunit.client.0.smithi083.stdout:6/556: write d9/d8a/faa [529120,75226] 0 2024-04-01T06:57:39.969 INFO:tasks.workunit.client.0.smithi083.stdout:8/659: truncate d15/d18/d19/d24/d38/d62/f85 2774445 0 2024-04-01T06:57:39.970 INFO:tasks.workunit.client.0.smithi083.stdout:5/499: dwrite d4/d9/d16/d1f/f44 [0,4194304] 0 2024-04-01T06:57:39.971 INFO:tasks.workunit.client.0.smithi083.stdout:8/660: read d15/d18/fa4 [114336,91974] 0 2024-04-01T06:57:39.971 INFO:tasks.workunit.client.0.smithi083.stdout:7/535: rename d0/d4/d9/d39/d67/d6d/d87/d83/d38/db3 to d0/d4/d9/d39/d67/d6d/d87/d83/d38/daa/db7 0 2024-04-01T06:57:39.976 INFO:tasks.workunit.client.0.smithi083.stdout:5/500: link d4/d71/f7a d4/d9/d16/d19/d5e/faa 0 2024-04-01T06:57:39.977 INFO:tasks.workunit.client.0.smithi083.stdout:8/661: mkdir d15/d18/d19/d24/da2/dee 0 2024-04-01T06:57:39.978 INFO:tasks.workunit.client.0.smithi083.stdout:1/723: dwrite db/d1c/d2e/d30/fb8 [0,4194304] 0 2024-04-01T06:57:39.979 INFO:tasks.workunit.client.0.smithi083.stdout:0/680: dwrite d16/f52 [0,4194304] 0 2024-04-01T06:57:39.979 INFO:tasks.workunit.client.0.smithi083.stdout:0/681: chown d16/d99/d4b/f5c 80675843 1 2024-04-01T06:57:39.979 INFO:tasks.workunit.client.0.smithi083.stdout:7/536: mkdir d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/db8 0 2024-04-01T06:57:39.981 INFO:tasks.workunit.client.0.smithi083.stdout:6/557: link d9/dc/d3b/f7a d9/dc/d29/d3c/fbb 0 2024-04-01T06:57:39.982 INFO:tasks.workunit.client.0.smithi083.stdout:8/662: creat d15/d1b/fef x:0 0 0 2024-04-01T06:57:39.982 INFO:tasks.workunit.client.0.smithi083.stdout:8/663: fdatasync d15/d18/d19/d1d/f2d 0 2024-04-01T06:57:39.982 INFO:tasks.workunit.client.0.smithi083.stdout:8/664: stat d15/f27 0 2024-04-01T06:57:39.983 INFO:tasks.workunit.client.0.smithi083.stdout:8/665: write d15/d1b/f84 [6621200,107939] 0 2024-04-01T06:57:39.984 INFO:tasks.workunit.client.0.smithi083.stdout:1/724: mkdir db/d1c/d29/d33/d50/d5d/dad/d106 0 2024-04-01T06:57:39.989 INFO:tasks.workunit.client.0.smithi083.stdout:0/682: symlink d16/d2e/d6c/leb 0 2024-04-01T06:57:39.990 INFO:tasks.workunit.client.0.smithi083.stdout:1/725: dread db/d1c/f2b [0,4194304] 0 2024-04-01T06:57:39.992 INFO:tasks.workunit.client.0.smithi083.stdout:7/537: link d0/d4/d9/f81 d0/d4/d9/d39/d67/d6d/d87/d83/d38/daa/fb9 0 2024-04-01T06:57:39.993 INFO:tasks.workunit.client.0.smithi083.stdout:6/558: creat d9/dc/d29/d3c/d5c/db4/fbc x:0 0 0 2024-04-01T06:57:39.993 INFO:tasks.workunit.client.0.smithi083.stdout:8/666: creat d15/d18/d19/d24/d38/d62/ff0 x:0 0 0 2024-04-01T06:57:39.994 INFO:tasks.workunit.client.0.smithi083.stdout:0/683: creat d16/d1d/fec x:0 0 0 2024-04-01T06:57:39.994 INFO:tasks.workunit.client.0.smithi083.stdout:7/538: creat d0/d4/d9/d39/d67/d6d/d87/d83/d38/daa/db7/fba x:0 0 0 2024-04-01T06:57:39.996 INFO:tasks.workunit.client.0.smithi083.stdout:6/559: mkdir d9/d57/dbd 0 2024-04-01T06:57:39.996 INFO:tasks.workunit.client.0.smithi083.stdout:6/560: chown f6 188367556 1 2024-04-01T06:57:39.996 INFO:tasks.workunit.client.0.smithi083.stdout:6/561: truncate d9/dc/d1b/d39/d68/fb8 811262 0 2024-04-01T06:57:39.999 INFO:tasks.workunit.client.0.smithi083.stdout:7/539: symlink d0/d4/d9/d39/lbb 0 2024-04-01T06:57:40.000 INFO:tasks.workunit.client.0.smithi083.stdout:6/562: creat d9/dc/d1b/d35/d48/d52/d9c/da9/fbe x:0 0 0 2024-04-01T06:57:40.001 INFO:tasks.workunit.client.0.smithi083.stdout:0/684: rename lb to d16/d2e/dba/led 0 2024-04-01T06:57:40.004 INFO:tasks.workunit.client.0.smithi083.stdout:7/540: truncate d0/d4/d9/f3e 3205443 0 2024-04-01T06:57:40.006 INFO:tasks.workunit.client.0.smithi083.stdout:6/563: mknod d9/dc/d1b/d35/d48/d52/d9c/da9/cbf 0 2024-04-01T06:57:40.006 INFO:tasks.workunit.client.0.smithi083.stdout:6/564: dread - d9/d8a/f9b zero size 2024-04-01T06:57:40.006 INFO:tasks.workunit.client.0.smithi083.stdout:6/565: write d9/dc/d29/fa8 [1004480,123342] 0 2024-04-01T06:57:40.006 INFO:tasks.workunit.client.0.smithi083.stdout:0/685: mknod d16/d99/d4b/d68/cee 0 2024-04-01T06:57:40.007 INFO:tasks.workunit.client.0.smithi083.stdout:8/667: dread d15/d1b/d39/d48/f59 [4194304,4194304] 0 2024-04-01T06:57:40.007 INFO:tasks.workunit.client.0.smithi083.stdout:1/726: dwrite db/d1c/d29/d33/d50/d5d/d81/f92 [0,4194304] 0 2024-04-01T06:57:40.008 INFO:tasks.workunit.client.0.smithi083.stdout:7/541: unlink d0/d4/d9/d39/d67/d6d/d87/d83/d38/daa/db7/fba 0 2024-04-01T06:57:40.010 INFO:tasks.workunit.client.0.smithi083.stdout:8/668: symlink d15/d18/d1e/de3/lf1 0 2024-04-01T06:57:40.014 INFO:tasks.workunit.client.0.smithi083.stdout:1/727: unlink db/d1c/d29/d33/d50/d5d/dad/dbf/c9c 0 2024-04-01T06:57:40.014 INFO:tasks.workunit.client.0.smithi083.stdout:1/728: fdatasync db/d1c/d1d/d8b/f96 0 2024-04-01T06:57:40.015 INFO:tasks.workunit.client.0.smithi083.stdout:8/669: symlink d15/d18/d19/d24/lf2 0 2024-04-01T06:57:40.015 INFO:tasks.workunit.client.0.smithi083.stdout:8/670: chown d15/d18/d1e 47 1 2024-04-01T06:57:40.017 INFO:tasks.workunit.client.0.smithi083.stdout:8/671: link d15/d18/d19/d1d/l79 d15/d1b/d39/d48/d5e/lf3 0 2024-04-01T06:57:40.018 INFO:tasks.workunit.client.0.smithi083.stdout:8/672: readlink lf 0 2024-04-01T06:57:40.020 INFO:tasks.workunit.client.0.smithi083.stdout:8/673: mkdir d15/d18/d19/d24/d38/d62/df4 0 2024-04-01T06:57:40.020 INFO:tasks.workunit.client.0.smithi083.stdout:8/674: chown d15/d1b/fcf 122066 1 2024-04-01T06:57:40.021 INFO:tasks.workunit.client.0.smithi083.stdout:8/675: creat d15/d1b/d39/d48/d5e/ff5 x:0 0 0 2024-04-01T06:57:40.029 INFO:tasks.workunit.client.0.smithi083.stdout:7/542: dwrite d0/d4/f80 [0,4194304] 0 2024-04-01T06:57:40.033 INFO:tasks.workunit.client.0.smithi083.stdout:0/686: dwrite d16/d99/d4b/d6e/f9f [0,4194304] 0 2024-04-01T06:57:40.035 INFO:tasks.workunit.client.0.smithi083.stdout:0/687: mknod d16/d1d/d8d/cef 0 2024-04-01T06:57:40.036 INFO:tasks.workunit.client.0.smithi083.stdout:0/688: creat d16/d1d/dbb/ff0 x:0 0 0 2024-04-01T06:57:40.037 INFO:tasks.workunit.client.0.smithi083.stdout:0/689: read d16/d99/f3e [4037806,39177] 0 2024-04-01T06:57:40.038 INFO:tasks.workunit.client.0.smithi083.stdout:8/676: rmdir d15/d18/d1e 39 2024-04-01T06:57:40.038 INFO:tasks.workunit.client.0.smithi083.stdout:8/677: readlink l6 0 2024-04-01T06:57:40.039 INFO:tasks.workunit.client.0.smithi083.stdout:1/729: dwrite db/d1c/d29/d33/d50/d5d/d6c/f7c [0,4194304] 0 2024-04-01T06:57:40.039 INFO:tasks.workunit.client.0.smithi083.stdout:1/730: truncate db/d1c/d29/d33/d50/d5d/d6c/d8e/f103 281643 0 2024-04-01T06:57:40.039 INFO:tasks.workunit.client.0.smithi083.stdout:0/690: creat d16/dc6/ff1 x:0 0 0 2024-04-01T06:57:40.039 INFO:tasks.workunit.client.0.smithi083.stdout:0/691: readlink d16/d99/d4b/d68/d9d/lad 0 2024-04-01T06:57:40.039 INFO:tasks.workunit.client.0.smithi083.stdout:4/520: sync 2024-04-01T06:57:40.040 INFO:tasks.workunit.client.0.smithi083.stdout:8/678: symlink d15/d18/d19/d24/da2/da6/de2/lf6 0 2024-04-01T06:57:40.041 INFO:tasks.workunit.client.0.smithi083.stdout:1/731: symlink db/d1c/d29/d33/d47/de4/l107 0 2024-04-01T06:57:40.046 INFO:tasks.workunit.client.0.smithi083.stdout:1/732: getdents db/d1c/d29/d33/d47 0 2024-04-01T06:57:40.046 INFO:tasks.workunit.client.0.smithi083.stdout:1/733: chown db/d1c/d29/d33/d50/f7b 7 1 2024-04-01T06:57:40.046 INFO:tasks.workunit.client.0.smithi083.stdout:1/734: dread - db/d1c/d29/d33/d50/d5d/dad/dbf/ffc zero size 2024-04-01T06:57:40.049 INFO:tasks.workunit.client.0.smithi083.stdout:1/735: link db/d1c/d29/d33/d50/d5d/dad/dbf/l77 db/d1c/d29/d33/d50/d5d/dad/l108 0 2024-04-01T06:57:40.063 INFO:tasks.workunit.client.0.smithi083.stdout:0/692: dwrite d16/d1d/f2b [0,4194304] 0 2024-04-01T06:57:40.063 INFO:tasks.workunit.client.0.smithi083.stdout:0/693: truncate d16/d2e/d3d/fa0 261129 0 2024-04-01T06:57:40.063 INFO:tasks.workunit.client.0.smithi083.stdout:8/679: dwrite d15/d18/d19/d24/d44/fba [0,4194304] 0 2024-04-01T06:57:40.063 INFO:tasks.workunit.client.0.smithi083.stdout:0/694: write f14 [2702871,56596] 0 2024-04-01T06:57:40.067 INFO:tasks.workunit.client.0.smithi083.stdout:8/680: truncate d15/d18/d19/d24/d38/d62/fd4 679611 0 2024-04-01T06:57:40.068 INFO:tasks.workunit.client.0.smithi083.stdout:0/695: mknod d16/d99/d4b/d6e/d96/cf2 0 2024-04-01T06:57:40.074 INFO:tasks.workunit.client.0.smithi083.stdout:0/696: unlink f7 0 2024-04-01T06:57:40.074 INFO:tasks.workunit.client.0.smithi083.stdout:0/697: dread - d16/d99/d4b/d95/fdf zero size 2024-04-01T06:57:40.074 INFO:tasks.workunit.client.0.smithi083.stdout:0/698: truncate d16/d2e/d3d/fa0 570995 0 2024-04-01T06:57:40.074 INFO:tasks.workunit.client.0.smithi083.stdout:2/603: sync 2024-04-01T06:57:40.074 INFO:tasks.workunit.client.0.smithi083.stdout:3/735: sync 2024-04-01T06:57:40.074 INFO:tasks.workunit.client.0.smithi083.stdout:9/512: sync 2024-04-01T06:57:40.074 INFO:tasks.workunit.client.0.smithi083.stdout:2/604: write d3/d8b/d53/f60 [482044,11992] 0 2024-04-01T06:57:40.075 INFO:tasks.workunit.client.0.smithi083.stdout:0/699: link d16/d1d/d8d/l9c d16/d2e/lf3 0 2024-04-01T06:57:40.075 INFO:tasks.workunit.client.0.smithi083.stdout:2/605: dread d3/d4d/d5d/f74 [0,4194304] 0 2024-04-01T06:57:40.075 INFO:tasks.workunit.client.0.smithi083.stdout:0/700: read d16/d99/d4b/f5c [330933,107586] 0 2024-04-01T06:57:40.075 INFO:tasks.workunit.client.0.smithi083.stdout:0/701: fsync d16/f22 0 2024-04-01T06:57:40.075 INFO:tasks.workunit.client.0.smithi083.stdout:3/736: symlink d6/d15/d2d/d2f/dc7/lf1 0 2024-04-01T06:57:40.076 INFO:tasks.workunit.client.0.smithi083.stdout:9/513: mkdir d6/d32/d8f/d6d/daf 0 2024-04-01T06:57:40.076 INFO:tasks.workunit.client.0.smithi083.stdout:9/514: readlink d6/l11 0 2024-04-01T06:57:40.079 INFO:tasks.workunit.client.0.smithi083.stdout:2/606: truncate d3/f19 2589257 0 2024-04-01T06:57:40.080 INFO:tasks.workunit.client.0.smithi083.stdout:0/702: creat d16/d99/ff4 x:0 0 0 2024-04-01T06:57:40.080 INFO:tasks.workunit.client.0.smithi083.stdout:0/703: write d16/d1d/f2a [1654360,73217] 0 2024-04-01T06:57:40.081 INFO:tasks.workunit.client.0.smithi083.stdout:9/515: mknod d6/d32/d3c/d3d/d9d/cb0 0 2024-04-01T06:57:40.082 INFO:tasks.workunit.client.0.smithi083.stdout:0/704: fsync d16/d1d/f2a 0 2024-04-01T06:57:40.083 INFO:tasks.workunit.client.0.smithi083.stdout:8/681: rename d15/d18/d19/d24/d38/d62/f2e to d15/d18/d19/d24/da2/d9a/ff7 0 2024-04-01T06:57:40.086 INFO:tasks.workunit.client.0.smithi083.stdout:0/705: symlink d16/d99/d4b/lf5 0 2024-04-01T06:57:40.087 INFO:tasks.workunit.client.0.smithi083.stdout:8/682: mknod d15/d18/d19/d24/d38/d62/cf8 0 2024-04-01T06:57:40.087 INFO:tasks.workunit.client.0.smithi083.stdout:8/683: chown d15/d21/dbc/fc3 180806 1 2024-04-01T06:57:40.087 INFO:tasks.workunit.client.0.smithi083.stdout:0/706: creat d16/d99/d4b/d84/ff6 x:0 0 0 2024-04-01T06:57:40.088 INFO:tasks.workunit.client.0.smithi083.stdout:3/737: dread d6/f40 [0,4194304] 0 2024-04-01T06:57:40.090 INFO:tasks.workunit.client.0.smithi083.stdout:2/607: dwrite d3/d26/d59/d2b/f40 [0,4194304] 0 2024-04-01T06:57:40.090 INFO:tasks.workunit.client.0.smithi083.stdout:3/738: mknod d6/d1e/d6f/daf/cf2 0 2024-04-01T06:57:40.092 INFO:tasks.workunit.client.0.smithi083.stdout:8/684: dread d15/faa [0,4194304] 0 2024-04-01T06:57:40.093 INFO:tasks.workunit.client.0.smithi083.stdout:8/685: chown d15/d18/d19/f71 2463352 1 2024-04-01T06:57:40.093 INFO:tasks.workunit.client.0.smithi083.stdout:2/608: symlink d3/d26/d59/d27/d79/lcc 0 2024-04-01T06:57:40.093 INFO:tasks.workunit.client.0.smithi083.stdout:8/686: write d15/d1b/d39/d48/d5e/d70/f98 [4479159,104433] 0 2024-04-01T06:57:40.093 INFO:tasks.workunit.client.0.smithi083.stdout:2/609: read d3/d8b/d53/d5e/f7b [719489,47385] 0 2024-04-01T06:57:40.094 INFO:tasks.workunit.client.0.smithi083.stdout:3/739: link d6/d15/d2d/d2f/d42/d46/f5e d6/d15/d2d/d2f/d42/d46/ff3 0 2024-04-01T06:57:40.094 INFO:tasks.workunit.client.0.smithi083.stdout:9/516: dread d6/d32/d26/d2d/f18 [0,4194304] 0 2024-04-01T06:57:40.095 INFO:tasks.workunit.client.0.smithi083.stdout:0/707: dread d16/d99/d4b/d6e/fac [0,4194304] 0 2024-04-01T06:57:40.095 INFO:tasks.workunit.client.0.smithi083.stdout:8/687: rename d15/d18/d19/d24/d44/d97/fdb to d15/d18/d19/d24/ff9 0 2024-04-01T06:57:40.096 INFO:tasks.workunit.client.0.smithi083.stdout:8/688: write d15/d18/d1e/f9d [1699136,4652] 0 2024-04-01T06:57:40.097 INFO:tasks.workunit.client.0.smithi083.stdout:2/610: mkdir d3/d71/d90/db6/dcd 0 2024-04-01T06:57:40.098 INFO:tasks.workunit.client.0.smithi083.stdout:8/689: dread d15/d18/d1e/f1f [0,4194304] 0 2024-04-01T06:57:40.099 INFO:tasks.workunit.client.0.smithi083.stdout:3/740: unlink d6/d15/d2d/d2f/d53/de5/le8 0 2024-04-01T06:57:40.099 INFO:tasks.workunit.client.0.smithi083.stdout:3/741: dread - d6/d15/d2d/d2f/d42/d46/d55/fd7 zero size 2024-04-01T06:57:40.100 INFO:tasks.workunit.client.0.smithi083.stdout:9/517: mknod d6/d32/d26/da9/cb1 0 2024-04-01T06:57:40.103 INFO:tasks.workunit.client.0.smithi083.stdout:2/611: mknod d3/d26/d59/d2b/cce 0 2024-04-01T06:57:40.103 INFO:tasks.workunit.client.0.smithi083.stdout:2/612: chown d3/d26/d59/d2b/d9f 720 1 2024-04-01T06:57:40.103 INFO:tasks.workunit.client.0.smithi083.stdout:8/690: creat d15/d18/d19/d24/d38/ffa x:0 0 0 2024-04-01T06:57:40.103 INFO:tasks.workunit.client.0.smithi083.stdout:8/691: readlink d15/d1b/d39/d48/d5e/lc6 0 2024-04-01T06:57:40.104 INFO:tasks.workunit.client.0.smithi083.stdout:3/742: mkdir d6/d15/d2d/d2f/d53/de5/df4 0 2024-04-01T06:57:40.105 INFO:tasks.workunit.client.0.smithi083.stdout:9/518: creat d6/d32/d8f/d6d/daf/fb2 x:0 0 0 2024-04-01T06:57:40.105 INFO:tasks.workunit.client.0.smithi083.stdout:2/613: creat d3/d71/d81/fcf x:0 0 0 2024-04-01T06:57:40.106 INFO:tasks.workunit.client.0.smithi083.stdout:9/519: write d6/d32/d3c/f66 [839588,95] 0 2024-04-01T06:57:40.106 INFO:tasks.workunit.client.0.smithi083.stdout:9/520: read - d6/d76/f92 zero size 2024-04-01T06:57:40.106 INFO:tasks.workunit.client.0.smithi083.stdout:2/614: write d3/d26/f4c [1654821,69926] 0 2024-04-01T06:57:40.107 INFO:tasks.workunit.client.0.smithi083.stdout:8/692: mknod d15/d18/d19/cfb 0 2024-04-01T06:57:40.107 INFO:tasks.workunit.client.0.smithi083.stdout:8/693: stat d15/d18/d19/d24/lf2 0 2024-04-01T06:57:40.108 INFO:tasks.workunit.client.0.smithi083.stdout:8/694: chown d15/d1b/d39/cc4 0 1 2024-04-01T06:57:40.108 INFO:tasks.workunit.client.0.smithi083.stdout:3/743: unlink d6/d15/f64 0 2024-04-01T06:57:40.108 INFO:tasks.workunit.client.0.smithi083.stdout:3/744: write d6/d15/d2d/d2f/d42/d46/f58 [5222866,43914] 0 2024-04-01T06:57:40.108 INFO:tasks.workunit.client.0.smithi083.stdout:3/745: write d6/d12/f47 [543874,32216] 0 2024-04-01T06:57:40.109 INFO:tasks.workunit.client.0.smithi083.stdout:0/708: dwrite d16/d2e/d5b/d74/fea [0,4194304] 0 2024-04-01T06:57:40.109 INFO:tasks.workunit.client.0.smithi083.stdout:2/615: getdents d3/d4d 0 2024-04-01T06:57:40.109 INFO:tasks.workunit.client.0.smithi083.stdout:0/709: stat d16/d2e/d3d/d7c/fd8 0 2024-04-01T06:57:40.109 INFO:tasks.workunit.client.0.smithi083.stdout:2/616: write d3/d71/d81/fb1 [543514,120686] 0 2024-04-01T06:57:40.110 INFO:tasks.workunit.client.0.smithi083.stdout:8/695: creat d15/d1b/ffc x:0 0 0 2024-04-01T06:57:40.113 INFO:tasks.workunit.client.0.smithi083.stdout:3/746: rmdir d6/d1e/d6f 39 2024-04-01T06:57:40.113 INFO:tasks.workunit.client.0.smithi083.stdout:0/710: creat d16/d2e/d3d/ff7 x:0 0 0 2024-04-01T06:57:40.116 INFO:tasks.workunit.client.0.smithi083.stdout:3/747: rmdir d6/d15/d2d/d2f/d42/d5c 39 2024-04-01T06:57:40.124 INFO:tasks.workunit.client.0.smithi083.stdout:9/521: dwrite d6/d32/d3c/d4c/d88/f8a [0,4194304] 0 2024-04-01T06:57:40.124 INFO:tasks.workunit.client.0.smithi083.stdout:9/522: fsync d6/d32/d8f/f81 0 2024-04-01T06:57:40.128 INFO:tasks.workunit.client.0.smithi083.stdout:8/696: dwrite d15/d18/d19/d6c/fc5 [0,4194304] 0 2024-04-01T06:57:40.128 INFO:tasks.workunit.client.0.smithi083.stdout:8/697: dread - d15/d18/d19/d24/da2/d6f/f90 zero size 2024-04-01T06:57:40.128 INFO:tasks.workunit.client.0.smithi083.stdout:8/698: chown d15/d18/d19/d24/da2/da6/de2/lf6 25373814 1 2024-04-01T06:57:40.128 INFO:tasks.workunit.client.0.smithi083.stdout:8/699: readlink d15/d1b/d39/d80/lb1 0 2024-04-01T06:57:40.128 INFO:tasks.workunit.client.0.smithi083.stdout:8/700: creat d15/d18/d19/d24/da2/ffd x:0 0 0 2024-04-01T06:57:40.134 INFO:tasks.workunit.client.0.smithi083.stdout:0/711: dwrite d16/d1d/f25 [4194304,4194304] 0 2024-04-01T06:57:40.135 INFO:tasks.workunit.client.0.smithi083.stdout:0/712: rename d16/d1d/la7 to d16/de6/lf8 0 2024-04-01T06:57:40.136 INFO:tasks.workunit.client.0.smithi083.stdout:0/713: mkdir d16/dc6/df9 0 2024-04-01T06:57:40.137 INFO:tasks.workunit.client.0.smithi083.stdout:0/714: link d16/d2e/d5b/cb4 d16/d99/d4b/d6e/d96/cfa 0 2024-04-01T06:57:40.141 INFO:tasks.workunit.client.0.smithi083.stdout:0/715: rmdir d16/dc6 39 2024-04-01T06:57:40.141 INFO:tasks.workunit.client.0.smithi083.stdout:9/523: dwrite d6/d32/d3c/d4c/fae [0,4194304] 0 2024-04-01T06:57:40.142 INFO:tasks.workunit.client.0.smithi083.stdout:0/716: mknod d16/d99/d4b/d68/d9d/cfb 0 2024-04-01T06:57:40.142 INFO:tasks.workunit.client.0.smithi083.stdout:0/717: read d16/d1d/d8d/fc4 [54109,104675] 0 2024-04-01T06:57:40.142 INFO:tasks.workunit.client.0.smithi083.stdout:0/718: chown d16/d99/d4b/d84/fb8 130556 1 2024-04-01T06:57:40.144 INFO:tasks.workunit.client.0.smithi083.stdout:9/524: mknod d6/d29/cb3 0 2024-04-01T06:57:40.144 INFO:tasks.workunit.client.0.smithi083.stdout:0/719: creat d16/d99/d4b/d84/ffc x:0 0 0 2024-04-01T06:57:40.146 INFO:tasks.workunit.client.0.smithi083.stdout:9/525: rename d6/f97 to d6/d32/d8f/fb4 0 2024-04-01T06:57:40.147 INFO:tasks.workunit.client.0.smithi083.stdout:0/720: creat d16/dc6/ffd x:0 0 0 2024-04-01T06:57:40.148 INFO:tasks.workunit.client.0.smithi083.stdout:0/721: dread - d16/d1d/d8d/fd7 zero size 2024-04-01T06:57:40.149 INFO:tasks.workunit.client.0.smithi083.stdout:9/526: rename l4 to d6/d32/d3c/d4c/lb5 0 2024-04-01T06:57:40.149 INFO:tasks.workunit.client.0.smithi083.stdout:9/527: write d6/d32/d26/fa0 [637319,28411] 0 2024-04-01T06:57:40.149 INFO:tasks.workunit.client.0.smithi083.stdout:0/722: mknod d16/d1d/dbb/de5/cfe 0 2024-04-01T06:57:40.150 INFO:tasks.workunit.client.0.smithi083.stdout:9/528: truncate d6/d32/d3c/d3d/f98 1054780 0 2024-04-01T06:57:40.167 INFO:tasks.workunit.client.0.smithi083.stdout:0/723: dwrite d16/d99/d4b/d95/fdf [0,4194304] 0 2024-04-01T06:57:40.168 INFO:tasks.workunit.client.0.smithi083.stdout:9/529: dwrite d6/d32/d26/d2d/f54 [0,4194304] 0 2024-04-01T06:57:40.168 INFO:tasks.workunit.client.0.smithi083.stdout:9/530: read d6/f2f [1798219,109840] 0 2024-04-01T06:57:40.169 INFO:tasks.workunit.client.0.smithi083.stdout:0/724: symlink d16/d2e/d6c/d82/lff 0 2024-04-01T06:57:40.169 INFO:tasks.workunit.client.0.smithi083.stdout:9/531: symlink d6/d32/d26/d2d/d34/lb6 0 2024-04-01T06:57:40.170 INFO:tasks.workunit.client.0.smithi083.stdout:0/725: write d16/d99/d4b/d6e/d96/fdd [1564448,93962] 0 2024-04-01T06:57:40.170 INFO:tasks.workunit.client.0.smithi083.stdout:0/726: fsync d16/d99/d4b/d68/d9d/fa1 0 2024-04-01T06:57:40.171 INFO:tasks.workunit.client.0.smithi083.stdout:9/532: rename d6/d32/d26/d2d/f62 to d6/d32/d8f/fb7 0 2024-04-01T06:57:40.171 INFO:tasks.workunit.client.0.smithi083.stdout:9/533: chown d6/d32/d26/c28 344 1 2024-04-01T06:57:40.172 INFO:tasks.workunit.client.0.smithi083.stdout:0/727: mknod d16/d2e/d5b/c100 0 2024-04-01T06:57:40.172 INFO:tasks.workunit.client.0.smithi083.stdout:0/728: chown d16/d2e/d3d 95980 1 2024-04-01T06:57:40.173 INFO:tasks.workunit.client.0.smithi083.stdout:0/729: rmdir d16/d99/d4b 39 2024-04-01T06:57:40.188 INFO:tasks.workunit.client.0.smithi083.stdout:9/534: dwrite d6/d32/d8f/faa [0,4194304] 0 2024-04-01T06:57:40.189 INFO:tasks.workunit.client.0.smithi083.stdout:9/535: truncate d6/d32/d3c/f6a 1239558 0 2024-04-01T06:57:40.190 INFO:tasks.workunit.client.0.smithi083.stdout:0/730: dwrite d16/d1d/dbb/ff0 [0,4194304] 0 2024-04-01T06:57:40.190 INFO:tasks.workunit.client.0.smithi083.stdout:9/536: symlink d6/d32/d8f/d6d/lb8 0 2024-04-01T06:57:40.199 INFO:tasks.workunit.client.0.smithi083.stdout:9/537: creat d6/d32/d26/d2d/d34/d6c/fb9 x:0 0 0 2024-04-01T06:57:40.207 INFO:tasks.workunit.client.0.smithi083.stdout:0/731: dwrite d16/f66 [4194304,4194304] 0 2024-04-01T06:57:40.207 INFO:tasks.workunit.client.0.smithi083.stdout:0/732: chown d16/d2e/d3d/d7c 4061 1 2024-04-01T06:57:40.209 INFO:tasks.workunit.client.0.smithi083.stdout:0/733: creat d16/d99/dc2/f101 x:0 0 0 2024-04-01T06:57:40.210 INFO:tasks.workunit.client.0.smithi083.stdout:0/734: symlink d16/d2e/l102 0 2024-04-01T06:57:40.211 INFO:tasks.workunit.client.0.smithi083.stdout:0/735: creat d16/d99/d4b/d6e/d96/f103 x:0 0 0 2024-04-01T06:57:40.211 INFO:tasks.workunit.client.0.smithi083.stdout:0/736: chown d16/l9e 13312 1 2024-04-01T06:57:40.211 INFO:tasks.workunit.client.0.smithi083.stdout:0/737: mkdir d16/d104 0 2024-04-01T06:57:40.212 INFO:tasks.workunit.client.0.smithi083.stdout:0/738: chown d16/f66 25131956 1 2024-04-01T06:57:40.212 INFO:tasks.workunit.client.0.smithi083.stdout:0/739: creat d16/d1d/d8d/f105 x:0 0 0 2024-04-01T06:57:40.212 INFO:tasks.workunit.client.0.smithi083.stdout:9/538: dwrite d6/d32/d8f/faa [0,4194304] 0 2024-04-01T06:57:40.214 INFO:tasks.workunit.client.0.smithi083.stdout:9/539: symlink d6/d32/d3c/lba 0 2024-04-01T06:57:40.214 INFO:tasks.workunit.client.0.smithi083.stdout:9/540: chown d6/d32/d26/d2d/d34/d6c/c93 3 1 2024-04-01T06:57:40.214 INFO:tasks.workunit.client.0.smithi083.stdout:9/541: fdatasync d6/f14 0 2024-04-01T06:57:40.217 INFO:tasks.workunit.client.0.smithi083.stdout:9/542: creat d6/d76/fbb x:0 0 0 2024-04-01T06:57:40.218 INFO:tasks.workunit.client.0.smithi083.stdout:9/543: link d6/d32/d26/d2d/d34/l37 d6/d32/d3c/d4c/d6b/d77/lbc 0 2024-04-01T06:57:40.218 INFO:tasks.workunit.client.0.smithi083.stdout:9/544: symlink d6/d32/d3c/d3d/lbd 0 2024-04-01T06:57:40.218 INFO:tasks.workunit.client.0.smithi083.stdout:9/545: read d6/d32/f1a [67103,39243] 0 2024-04-01T06:57:40.218 INFO:tasks.workunit.client.0.smithi083.stdout:9/546: chown d6/l11 55665976 1 2024-04-01T06:57:40.218 INFO:tasks.workunit.client.0.smithi083.stdout:9/547: getdents d6/d32/d8f 0 2024-04-01T06:57:40.219 INFO:tasks.workunit.client.0.smithi083.stdout:0/740: dread d16/d1d/f8b [0,4194304] 0 2024-04-01T06:57:40.219 INFO:tasks.workunit.client.0.smithi083.stdout:0/741: write d16/d99/d4b/d68/d9d/fa1 [720813,59254] 0 2024-04-01T06:57:40.219 INFO:tasks.workunit.client.0.smithi083.stdout:0/742: chown d16/d99/d4b/d68 227 1 2024-04-01T06:57:40.219 INFO:tasks.workunit.client.0.smithi083.stdout:9/548: write d6/d32/d26/d2d/d34/f43 [1932508,7914] 0 2024-04-01T06:57:40.221 INFO:tasks.workunit.client.0.smithi083.stdout:9/549: chown d6/d32/d26/d2d/c10 656826323 1 2024-04-01T06:57:40.224 INFO:tasks.workunit.client.0.smithi083.stdout:0/743: rmdir d16/d1d 39 2024-04-01T06:57:40.230 INFO:tasks.workunit.client.0.smithi083.stdout:9/550: dread d6/d32/f4f [0,4194304] 0 2024-04-01T06:57:40.232 INFO:tasks.workunit.client.0.smithi083.stdout:9/551: rmdir d6/d32/d8f 39 2024-04-01T06:57:40.235 INFO:tasks.workunit.client.0.smithi083.stdout:5/501: sync 2024-04-01T06:57:40.236 INFO:tasks.workunit.client.0.smithi083.stdout:9/552: rename d6/d32/d3c/d4c/d6b/l83 to d6/d32/d26/lbe 0 2024-04-01T06:57:40.237 INFO:tasks.workunit.client.0.smithi083.stdout:5/502: mkdir d4/d23/d49/d7f/da0/dab 0 2024-04-01T06:57:40.238 INFO:tasks.workunit.client.0.smithi083.stdout:9/553: creat d6/d29/fbf x:0 0 0 2024-04-01T06:57:40.238 INFO:tasks.workunit.client.0.smithi083.stdout:0/744: dwrite d16/d1d/f54 [0,4194304] 0 2024-04-01T06:57:40.239 INFO:tasks.workunit.client.0.smithi083.stdout:5/503: creat d4/d71/d8d/fac x:0 0 0 2024-04-01T06:57:40.239 INFO:tasks.workunit.client.0.smithi083.stdout:5/504: dread - d4/d9/d4f/f6f zero size 2024-04-01T06:57:40.240 INFO:tasks.workunit.client.0.smithi083.stdout:5/505: read d4/d23/d4e/f57 [1969012,117960] 0 2024-04-01T06:57:40.242 INFO:tasks.workunit.client.0.smithi083.stdout:5/506: unlink d4/d23/f29 0 2024-04-01T06:57:40.242 INFO:tasks.workunit.client.0.smithi083.stdout:5/507: fsync d4/d9/d16/d1f/d2f/d53/f66 0 2024-04-01T06:57:40.242 INFO:tasks.workunit.client.0.smithi083.stdout:5/508: chown d4/d9/d16/d9f 903 1 2024-04-01T06:57:40.242 INFO:tasks.workunit.client.0.smithi083.stdout:9/554: mknod d6/d32/d26/d2d/cc0 0 2024-04-01T06:57:40.243 INFO:tasks.workunit.client.0.smithi083.stdout:5/509: creat d4/d23/d4e/d79/fad x:0 0 0 2024-04-01T06:57:40.243 INFO:tasks.workunit.client.0.smithi083.stdout:5/510: dread - d4/d23/d49/f73 zero size 2024-04-01T06:57:40.244 INFO:tasks.workunit.client.0.smithi083.stdout:5/511: creat d4/d71/fae x:0 0 0 2024-04-01T06:57:40.245 INFO:tasks.workunit.client.0.smithi083.stdout:5/512: unlink d4/d23/f75 0 2024-04-01T06:57:40.256 INFO:tasks.workunit.client.0.smithi083.stdout:0/745: dwrite d16/f62 [0,4194304] 0 2024-04-01T06:57:40.258 INFO:tasks.workunit.client.0.smithi083.stdout:0/746: creat d16/dc6/f106 x:0 0 0 2024-04-01T06:57:40.258 INFO:tasks.workunit.client.0.smithi083.stdout:9/555: dwrite d6/d32/d3c/d4c/f55 [0,4194304] 0 2024-04-01T06:57:40.261 INFO:tasks.workunit.client.0.smithi083.stdout:0/747: rename d16/d2e/d5b/d74/f97 to d16/de6/f107 0 2024-04-01T06:57:40.263 INFO:tasks.workunit.client.0.smithi083.stdout:0/748: unlink d16/d1d/l44 0 2024-04-01T06:57:40.269 INFO:tasks.workunit.client.0.smithi083.stdout:0/749: rmdir d16/dc6 39 2024-04-01T06:57:40.270 INFO:tasks.workunit.client.0.smithi083.stdout:1/736: sync 2024-04-01T06:57:40.270 INFO:tasks.workunit.client.0.smithi083.stdout:7/543: sync 2024-04-01T06:57:40.270 INFO:tasks.workunit.client.0.smithi083.stdout:4/521: sync 2024-04-01T06:57:40.270 INFO:tasks.workunit.client.0.smithi083.stdout:6/566: sync 2024-04-01T06:57:40.270 INFO:tasks.workunit.client.0.smithi083.stdout:1/737: truncate db/d1c/d29/f3e 13023216 0 2024-04-01T06:57:40.270 INFO:tasks.workunit.client.0.smithi083.stdout:1/738: read - db/d1c/d29/d33/d50/d5d/dad/dbf/fd9 zero size 2024-04-01T06:57:40.270 INFO:tasks.workunit.client.0.smithi083.stdout:6/567: write d9/dc/d1b/d39/d68/f75 [356008,93861] 0 2024-04-01T06:57:40.270 INFO:tasks.workunit.client.0.smithi083.stdout:6/568: stat d9/dc/d29 0 2024-04-01T06:57:40.271 INFO:tasks.workunit.client.0.smithi083.stdout:0/750: link d16/f29 d16/d99/d4b/d6e/f108 0 2024-04-01T06:57:40.271 INFO:tasks.workunit.client.0.smithi083.stdout:0/751: fdatasync d16/d1d/f2a 0 2024-04-01T06:57:40.275 INFO:tasks.workunit.client.0.smithi083.stdout:4/522: creat d1/d8/d6a/f9d x:0 0 0 2024-04-01T06:57:40.275 INFO:tasks.workunit.client.0.smithi083.stdout:6/569: truncate d9/dc/d29/d3c/f95 453678 0 2024-04-01T06:57:40.276 INFO:tasks.workunit.client.0.smithi083.stdout:4/523: dread d1/d4/db/f11 [0,4194304] 0 2024-04-01T06:57:40.277 INFO:tasks.workunit.client.0.smithi083.stdout:1/739: rename db/d1c/d29/dbe/cd3 to db/d1c/d29/d33/d50/d5d/d81/d94/c109 0 2024-04-01T06:57:40.277 INFO:tasks.workunit.client.0.smithi083.stdout:1/740: readlink db/l1e 0 2024-04-01T06:57:40.277 INFO:tasks.workunit.client.0.smithi083.stdout:1/741: stat f3 0 2024-04-01T06:57:40.278 INFO:tasks.workunit.client.0.smithi083.stdout:6/570: creat d9/dc/d1b/d35/d48/d52/d9c/fc0 x:0 0 0 2024-04-01T06:57:40.278 INFO:tasks.workunit.client.0.smithi083.stdout:0/752: dread d16/d2e/f36 [0,4194304] 0 2024-04-01T06:57:40.279 INFO:tasks.workunit.client.0.smithi083.stdout:1/742: link db/d1c/d49/f7d db/d61/f10a 0 2024-04-01T06:57:40.280 INFO:tasks.workunit.client.0.smithi083.stdout:6/571: mknod d9/dc/d1b/d4c/cc1 0 2024-04-01T06:57:40.280 INFO:tasks.workunit.client.0.smithi083.stdout:7/544: dwrite d0/d4/ff [0,4194304] 0 2024-04-01T06:57:40.280 INFO:tasks.workunit.client.0.smithi083.stdout:6/572: write d9/dc/d1b/f43 [666999,78397] 0 2024-04-01T06:57:40.281 INFO:tasks.workunit.client.0.smithi083.stdout:0/753: symlink d16/d2e/d3d/l109 0 2024-04-01T06:57:40.281 INFO:tasks.workunit.client.0.smithi083.stdout:1/743: creat db/d1c/d29/d33/f10b x:0 0 0 2024-04-01T06:57:40.281 INFO:tasks.workunit.client.0.smithi083.stdout:0/754: dread d16/f42 [0,4194304] 0 2024-04-01T06:57:40.282 INFO:tasks.workunit.client.0.smithi083.stdout:7/545: creat d0/d7c/fbc x:0 0 0 2024-04-01T06:57:40.283 INFO:tasks.workunit.client.0.smithi083.stdout:6/573: symlink d9/dc/d9f/lc2 0 2024-04-01T06:57:40.283 INFO:tasks.workunit.client.0.smithi083.stdout:6/574: chown d9/dc/d1b/f4b 5241 1 2024-04-01T06:57:40.284 INFO:tasks.workunit.client.0.smithi083.stdout:1/744: truncate db/d1c/d2e/d30/f3a 2595096 0 2024-04-01T06:57:40.288 INFO:tasks.workunit.client.0.smithi083.stdout:7/546: rename d0/d4/d9/d39/d67/d6d/d87/d83/d38/daa to d0/d4/dbd 0 2024-04-01T06:57:40.289 INFO:tasks.workunit.client.0.smithi083.stdout:4/524: dwrite d1/d4/da/f29 [0,4194304] 0 2024-04-01T06:57:40.289 INFO:tasks.workunit.client.0.smithi083.stdout:4/525: fsync d1/d47/d2a/f80 0 2024-04-01T06:57:40.289 INFO:tasks.workunit.client.0.smithi083.stdout:4/526: chown d1/d4/db/l2b 488904 1 2024-04-01T06:57:40.290 INFO:tasks.workunit.client.0.smithi083.stdout:0/755: rmdir d16/d2e/d5b 39 2024-04-01T06:57:40.290 INFO:tasks.workunit.client.0.smithi083.stdout:0/756: chown d16/d2e/d3d/laa 13593 1 2024-04-01T06:57:40.290 INFO:tasks.workunit.client.0.smithi083.stdout:4/527: dread d1/d47/d2a/f52 [0,4194304] 0 2024-04-01T06:57:40.292 INFO:tasks.workunit.client.0.smithi083.stdout:6/575: rename l3 to d9/d57/lc3 0 2024-04-01T06:57:40.292 INFO:tasks.workunit.client.0.smithi083.stdout:6/576: readlink d9/l31 0 2024-04-01T06:57:40.292 INFO:tasks.workunit.client.0.smithi083.stdout:6/577: fdatasync d9/d8a/f9b 0 2024-04-01T06:57:40.293 INFO:tasks.workunit.client.0.smithi083.stdout:1/745: dread db/d1c/d29/d33/d50/d5d/d81/f92 [0,4194304] 0 2024-04-01T06:57:40.293 INFO:tasks.workunit.client.0.smithi083.stdout:1/746: chown db/d1c/d29/d33/d50/d4d/fa4 396 1 2024-04-01T06:57:40.294 INFO:tasks.workunit.client.0.smithi083.stdout:7/547: creat d0/d4/d9/d39/d67/d6d/d7d/fbe x:0 0 0 2024-04-01T06:57:40.294 INFO:tasks.workunit.client.0.smithi083.stdout:7/548: chown d0/d4/f32 1027827 1 2024-04-01T06:57:40.294 INFO:tasks.workunit.client.0.smithi083.stdout:6/578: dread d9/d8a/faa [0,4194304] 0 2024-04-01T06:57:40.296 INFO:tasks.workunit.client.0.smithi083.stdout:0/757: symlink d16/d1d/d8d/dbf/l10a 0 2024-04-01T06:57:40.296 INFO:tasks.workunit.client.0.smithi083.stdout:0/758: readlink d16/d2e/d5b/lb7 0 2024-04-01T06:57:40.296 INFO:tasks.workunit.client.0.smithi083.stdout:4/528: symlink d1/d4/d33/d89/l9e 0 2024-04-01T06:57:40.298 INFO:tasks.workunit.client.0.smithi083.stdout:4/529: write d1/d4/db/d5b/d62/f86 [3750888,130408] 0 2024-04-01T06:57:40.298 INFO:tasks.workunit.client.0.smithi083.stdout:7/549: mkdir d0/d4/d9/d39/d67/d6d/d87/d83/d38/dbf 0 2024-04-01T06:57:40.298 INFO:tasks.workunit.client.0.smithi083.stdout:7/550: fdatasync d0/d7a/fa5 0 2024-04-01T06:57:40.298 INFO:tasks.workunit.client.0.smithi083.stdout:7/551: truncate d0/d4/d9/f81 924666 0 2024-04-01T06:57:40.300 INFO:tasks.workunit.client.0.smithi083.stdout:7/552: write d0/d4/d9/d39/d67/d6d/d87/d83/f27 [8178348,67203] 0 2024-04-01T06:57:40.300 INFO:tasks.workunit.client.0.smithi083.stdout:7/553: readlink d0/d4/d9/d39/d67/d6d/l7f 0 2024-04-01T06:57:40.303 INFO:tasks.workunit.client.0.smithi083.stdout:0/759: dread d16/d1d/f37 [0,4194304] 0 2024-04-01T06:57:40.304 INFO:tasks.workunit.client.0.smithi083.stdout:0/760: write d16/d2e/f41 [1141232,54933] 0 2024-04-01T06:57:40.304 INFO:tasks.workunit.client.0.smithi083.stdout:0/761: truncate d16/d99/dc2/f101 1025926 0 2024-04-01T06:57:40.305 INFO:tasks.workunit.client.0.smithi083.stdout:4/530: creat d1/d4/db/f9f x:0 0 0 2024-04-01T06:57:40.307 INFO:tasks.workunit.client.0.smithi083.stdout:6/579: rename d9/dc/d29/d3c/d5c/db4 to d9/dc/d29/d3c/d45/dc4 0 2024-04-01T06:57:40.308 INFO:tasks.workunit.client.0.smithi083.stdout:1/747: dwrite db/d1c/d2e/d30/fa6 [0,4194304] 0 2024-04-01T06:57:40.308 INFO:tasks.workunit.client.0.smithi083.stdout:7/554: unlink d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/d92/la9 0 2024-04-01T06:57:40.310 INFO:tasks.workunit.client.0.smithi083.stdout:4/531: symlink d1/d4/db/d5b/la0 0 2024-04-01T06:57:40.318 INFO:tasks.workunit.client.0.smithi083.stdout:0/762: dwrite d16/d2e/d6c/f70 [0,4194304] 0 2024-04-01T06:57:40.318 INFO:tasks.workunit.client.0.smithi083.stdout:1/748: rename db/fd to db/d1c/d29/d33/d50/d4d/f10c 0 2024-04-01T06:57:40.320 INFO:tasks.workunit.client.0.smithi083.stdout:6/580: mknod d9/dc/d29/d3c/cc5 0 2024-04-01T06:57:40.320 INFO:tasks.workunit.client.0.smithi083.stdout:6/581: fdatasync d9/dc/d1b/d35/f85 0 2024-04-01T06:57:40.322 INFO:tasks.workunit.client.0.smithi083.stdout:7/555: dwrite d0/d4/d9/f25 [0,4194304] 0 2024-04-01T06:57:40.322 INFO:tasks.workunit.client.0.smithi083.stdout:7/556: stat d0/d4/d9/d39/d67/d6d/d87/d83/d34/c41 0 2024-04-01T06:57:40.323 INFO:tasks.workunit.client.0.smithi083.stdout:0/763: truncate d16/d1d/f51 2256651 0 2024-04-01T06:57:40.325 INFO:tasks.workunit.client.0.smithi083.stdout:1/749: mknod db/d1c/d29/d33/d47/de4/c10d 0 2024-04-01T06:57:40.326 INFO:tasks.workunit.client.0.smithi083.stdout:6/582: link d9/dc/d9f/fa2 d9/dc/d1b/d4c/d99/fc6 0 2024-04-01T06:57:40.339 INFO:tasks.workunit.client.0.smithi083.stdout:4/532: rename d1/d8/d42 to d1/d47/da1 0 2024-04-01T06:57:40.339 INFO:tasks.workunit.client.0.smithi083.stdout:4/533: stat d1/d47/d2a/c34 0 2024-04-01T06:57:40.342 INFO:tasks.workunit.client.0.smithi083.stdout:0/764: rename d16/d1d/f46 to d16/d99/d4b/d6e/f10b 0 2024-04-01T06:57:40.343 INFO:tasks.workunit.client.0.smithi083.stdout:6/583: dwrite d9/dc/f25 [4194304,4194304] 0 2024-04-01T06:57:40.344 INFO:tasks.workunit.client.0.smithi083.stdout:4/534: symlink d1/d4/la2 0 2024-04-01T06:57:40.346 INFO:tasks.workunit.client.0.smithi083.stdout:0/765: creat d16/d99/d4b/d84/f10c x:0 0 0 2024-04-01T06:57:40.346 INFO:tasks.workunit.client.0.smithi083.stdout:0/766: dread - d16/d99/d4b/d84/ff6 zero size 2024-04-01T06:57:40.347 INFO:tasks.workunit.client.0.smithi083.stdout:6/584: mknod d9/dc/d1b/d35/d48/d52/d9c/da9/cc7 0 2024-04-01T06:57:40.348 INFO:tasks.workunit.client.0.smithi083.stdout:4/535: symlink d1/d4/db/d5b/d62/la3 0 2024-04-01T06:57:40.348 INFO:tasks.workunit.client.0.smithi083.stdout:7/557: dwrite d0/d4/d9/d39/d67/d6d/f5f [0,4194304] 0 2024-04-01T06:57:40.349 INFO:tasks.workunit.client.0.smithi083.stdout:1/750: dwrite db/d1c/d29/d33/d50/d5d/d6c/f7c [0,4194304] 0 2024-04-01T06:57:40.349 INFO:tasks.workunit.client.0.smithi083.stdout:1/751: chown db/d1c/d2e/d30/d82/f102 290 1 2024-04-01T06:57:40.350 INFO:tasks.workunit.client.0.smithi083.stdout:0/767: getdents d16/d99/d4b 0 2024-04-01T06:57:40.350 INFO:tasks.workunit.client.0.smithi083.stdout:4/536: dread d1/d4/d33/f49 [0,4194304] 0 2024-04-01T06:57:40.350 INFO:tasks.workunit.client.0.smithi083.stdout:4/537: write d1/d4/db/f11 [806264,112597] 0 2024-04-01T06:57:40.351 INFO:tasks.workunit.client.0.smithi083.stdout:6/585: truncate d9/dc/d1b/d39/d47/f50 1683307 0 2024-04-01T06:57:40.351 INFO:tasks.workunit.client.0.smithi083.stdout:6/586: readlink d9/l31 0 2024-04-01T06:57:40.351 INFO:tasks.workunit.client.0.smithi083.stdout:6/587: chown d9/c93 94512187 1 2024-04-01T06:57:40.354 INFO:tasks.workunit.client.0.smithi083.stdout:1/752: mknod db/d1c/d29/d33/d50/d5d/c10e 0 2024-04-01T06:57:40.356 INFO:tasks.workunit.client.0.smithi083.stdout:3/748: sync 2024-04-01T06:57:40.356 INFO:tasks.workunit.client.0.smithi083.stdout:8/701: sync 2024-04-01T06:57:40.356 INFO:tasks.workunit.client.0.smithi083.stdout:2/617: sync 2024-04-01T06:57:40.357 INFO:tasks.workunit.client.0.smithi083.stdout:0/768: mkdir d16/d2e/d5b/d74/dd3/d10d 0 2024-04-01T06:57:40.357 INFO:tasks.workunit.client.0.smithi083.stdout:2/618: dread d3/d4d/d5d/fb0 [0,4194304] 0 2024-04-01T06:57:40.358 INFO:tasks.workunit.client.0.smithi083.stdout:4/538: mknod d1/d4/db/d5b/ca4 0 2024-04-01T06:57:40.360 INFO:tasks.workunit.client.0.smithi083.stdout:6/588: creat d9/dc/d1b/d35/fc8 x:0 0 0 2024-04-01T06:57:40.361 INFO:tasks.workunit.client.0.smithi083.stdout:7/558: dwrite d0/f49 [0,4194304] 0 2024-04-01T06:57:40.362 INFO:tasks.workunit.client.0.smithi083.stdout:7/559: readlink d0/d4/d9/d39/d48/l6e 0 2024-04-01T06:57:40.362 INFO:tasks.workunit.client.0.smithi083.stdout:7/560: fsync d0/d4/d9/d39/d67/d6d/d87/d83/d34/f57 0 2024-04-01T06:57:40.362 INFO:tasks.workunit.client.0.smithi083.stdout:1/753: getdents db/d1c/d29/d33/d50/d5d/dad 0 2024-04-01T06:57:40.362 INFO:tasks.workunit.client.0.smithi083.stdout:1/754: write db/d1c/d2e/d30/fa6 [4812404,94571] 0 2024-04-01T06:57:40.363 INFO:tasks.workunit.client.0.smithi083.stdout:8/702: link d15/d21/l52 d15/d18/d19/d24/d38/d62/df4/lfe 0 2024-04-01T06:57:40.367 INFO:tasks.workunit.client.0.smithi083.stdout:5/513: sync 2024-04-01T06:57:40.368 INFO:tasks.workunit.client.0.smithi083.stdout:9/556: sync 2024-04-01T06:57:40.368 INFO:tasks.workunit.client.0.smithi083.stdout:5/514: truncate d4/f92 745539 0 2024-04-01T06:57:40.368 INFO:tasks.workunit.client.0.smithi083.stdout:9/557: fdatasync d6/d32/d8f/d6d/f89 0 2024-04-01T06:57:40.368 INFO:tasks.workunit.client.0.smithi083.stdout:9/558: stat d6/d32/fa2 0 2024-04-01T06:57:40.368 INFO:tasks.workunit.client.0.smithi083.stdout:4/539: mkdir d1/da5 0 2024-04-01T06:57:40.368 INFO:tasks.workunit.client.0.smithi083.stdout:9/559: write d6/d32/d8f/f81 [4930211,16487] 0 2024-04-01T06:57:40.369 INFO:tasks.workunit.client.0.smithi083.stdout:0/769: creat d16/d2e/d3d/d5d/f10e x:0 0 0 2024-04-01T06:57:40.369 INFO:tasks.workunit.client.0.smithi083.stdout:4/540: dread d1/d47/d2a/f52 [0,4194304] 0 2024-04-01T06:57:40.369 INFO:tasks.workunit.client.0.smithi083.stdout:6/589: link d9/dc/d1b/d35/c59 d9/dc/d1b/d39/d68/cc9 0 2024-04-01T06:57:40.370 INFO:tasks.workunit.client.0.smithi083.stdout:6/590: write d9/dc/f65 [4177746,79390] 0 2024-04-01T06:57:40.370 INFO:tasks.workunit.client.0.smithi083.stdout:6/591: dread - d9/dc/d1b/d39/f3a zero size 2024-04-01T06:57:40.370 INFO:tasks.workunit.client.0.smithi083.stdout:6/592: fsync d9/dc/d1b/f1e 0 2024-04-01T06:57:40.370 INFO:tasks.workunit.client.0.smithi083.stdout:4/541: write d1/f2 [1375078,82234] 0 2024-04-01T06:57:40.372 INFO:tasks.workunit.client.0.smithi083.stdout:7/561: rename d0/d4/d9/d39/d67/d6d/d7d/db6 to d0/d4/d9/d39/d67/dc0 0 2024-04-01T06:57:40.375 INFO:tasks.workunit.client.0.smithi083.stdout:5/515: symlink d4/d71/laf 0 2024-04-01T06:57:40.378 INFO:tasks.workunit.client.0.smithi083.stdout:0/770: unlink d16/d2e/l102 0 2024-04-01T06:57:40.380 INFO:tasks.workunit.client.0.smithi083.stdout:1/755: dwrite db/d1c/d2e/d30/fc7 [0,4194304] 0 2024-04-01T06:57:40.383 INFO:tasks.workunit.client.0.smithi083.stdout:6/593: creat d9/dc/d1b/d39/d68/fca x:0 0 0 2024-04-01T06:57:40.383 INFO:tasks.workunit.client.0.smithi083.stdout:4/542: creat d1/d8/fa6 x:0 0 0 2024-04-01T06:57:40.384 INFO:tasks.workunit.client.0.smithi083.stdout:7/562: link d0/d4/d9/l51 d0/d4/d9/d39/lc1 0 2024-04-01T06:57:40.385 INFO:tasks.workunit.client.0.smithi083.stdout:4/543: write d1/d4/db/f3e [4094860,74199] 0 2024-04-01T06:57:40.385 INFO:tasks.workunit.client.0.smithi083.stdout:4/544: truncate d1/d47/da1/f61 984772 0 2024-04-01T06:57:40.385 INFO:tasks.workunit.client.0.smithi083.stdout:4/545: dread - d1/d4/db/d5b/f8c zero size 2024-04-01T06:57:40.385 INFO:tasks.workunit.client.0.smithi083.stdout:0/771: creat d16/d2e/dba/f10f x:0 0 0 2024-04-01T06:57:40.387 INFO:tasks.workunit.client.0.smithi083.stdout:6/594: mkdir d9/dc/d29/d3c/d45/dc4/dcb 0 2024-04-01T06:57:40.524 INFO:tasks.workunit.client.0.smithi083.stdout:7/563: truncate d0/f2b 723867 0 2024-04-01T06:57:40.524 INFO:tasks.workunit.client.0.smithi083.stdout:8/703: dwrite d15/d1b/ffc [0,4194304] 0 2024-04-01T06:57:40.524 INFO:tasks.workunit.client.0.smithi083.stdout:5/516: dwrite d4/d2b/f31 [0,4194304] 0 2024-04-01T06:57:40.524 INFO:tasks.workunit.client.0.smithi083.stdout:5/517: write d4/d71/fa3 [971342,87126] 0 2024-04-01T06:57:40.524 INFO:tasks.workunit.client.0.smithi083.stdout:4/546: creat d1/d4/db/d94/fa7 x:0 0 0 2024-04-01T06:57:40.524 INFO:tasks.workunit.client.0.smithi083.stdout:4/547: read d1/d4/da/f29 [4341933,108030] 0 2024-04-01T06:57:40.524 INFO:tasks.workunit.client.0.smithi083.stdout:0/772: mknod d16/d2e/d5b/d74/dd3/d10d/c110 0 2024-04-01T06:57:40.525 INFO:tasks.workunit.client.0.smithi083.stdout:6/595: creat d9/d8a/fcc x:0 0 0 2024-04-01T06:57:40.525 INFO:tasks.workunit.client.0.smithi083.stdout:6/596: truncate d9/dc/d1b/d35/fc8 365222 0 2024-04-01T06:57:40.525 INFO:tasks.workunit.client.0.smithi083.stdout:9/560: dwrite d6/d32/d3c/d3d/f63 [0,4194304] 0 2024-04-01T06:57:40.525 INFO:tasks.workunit.client.0.smithi083.stdout:9/561: chown d6/d32/d8f/fb4 75374 1 2024-04-01T06:57:40.525 INFO:tasks.workunit.client.0.smithi083.stdout:7/564: creat d0/d4/d9/d39/d67/d6d/d87/d83/d34/fc2 x:0 0 0 2024-04-01T06:57:40.525 INFO:tasks.workunit.client.0.smithi083.stdout:8/704: symlink d15/d18/d19/d24/da2/d9a/lff 0 2024-04-01T06:57:40.525 INFO:tasks.workunit.client.0.smithi083.stdout:4/548: mkdir d1/d4/da/d88/da8 0 2024-04-01T06:57:40.525 INFO:tasks.workunit.client.0.smithi083.stdout:0/773: unlink d16/d1d/c57 0 2024-04-01T06:57:40.525 INFO:tasks.workunit.client.0.smithi083.stdout:6/597: symlink d9/d57/lcd 0 2024-04-01T06:57:40.525 INFO:tasks.workunit.client.0.smithi083.stdout:9/562: rmdir d6/d32/d3c/d4c 39 2024-04-01T06:57:40.525 INFO:tasks.workunit.client.0.smithi083.stdout:7/565: mknod d0/d4/dbd/db7/cc3 0 2024-04-01T06:57:40.525 INFO:tasks.workunit.client.0.smithi083.stdout:8/705: mknod d15/d1b/d39/d48/d5e/c100 0 2024-04-01T06:57:40.526 INFO:tasks.workunit.client.0.smithi083.stdout:4/549: unlink d1/d4/db/d5b/f8c 0 2024-04-01T06:57:40.526 INFO:tasks.workunit.client.0.smithi083.stdout:4/550: write d1/d4/da/d88/f99 [977435,113707] 0 2024-04-01T06:57:40.526 INFO:tasks.workunit.client.0.smithi083.stdout:0/774: truncate d16/d2e/d6c/d82/f87 1686854 0 2024-04-01T06:57:40.526 INFO:tasks.workunit.client.0.smithi083.stdout:6/598: mkdir d9/dc/d29/d3c/d45/dc4/dcb/dce 0 2024-04-01T06:57:40.526 INFO:tasks.workunit.client.0.smithi083.stdout:7/566: symlink d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/da4/lc4 0 2024-04-01T06:57:40.526 INFO:tasks.workunit.client.0.smithi083.stdout:4/551: symlink d1/d4/db/d5b/la9 0 2024-04-01T06:57:40.526 INFO:tasks.workunit.client.0.smithi083.stdout:4/552: write d1/d4/f4f [1057598,12001] 0 2024-04-01T06:57:40.526 INFO:tasks.workunit.client.0.smithi083.stdout:4/553: write d1/d8/d6a/f76 [1757508,607] 0 2024-04-01T06:57:40.526 INFO:tasks.workunit.client.0.smithi083.stdout:0/775: truncate d16/d1d/f23 560533 0 2024-04-01T06:57:40.526 INFO:tasks.workunit.client.0.smithi083.stdout:9/563: dwrite d6/f87 [0,4194304] 0 2024-04-01T06:57:40.526 INFO:tasks.workunit.client.0.smithi083.stdout:6/599: dread d9/dc/f65 [0,4194304] 0 2024-04-01T06:57:40.526 INFO:tasks.workunit.client.0.smithi083.stdout:6/600: readlink d9/d57/lc3 0 2024-04-01T06:57:40.527 INFO:tasks.workunit.client.0.smithi083.stdout:9/564: write d6/d32/d3c/f66 [1807960,70981] 0 2024-04-01T06:57:40.527 INFO:tasks.workunit.client.0.smithi083.stdout:7/567: creat d0/d4/fc5 x:0 0 0 2024-04-01T06:57:40.527 INFO:tasks.workunit.client.0.smithi083.stdout:0/776: dread d16/d99/d4b/d95/fdf [0,4194304] 0 2024-04-01T06:57:40.527 INFO:tasks.workunit.client.0.smithi083.stdout:6/601: mknod d9/d8a/ccf 0 2024-04-01T06:57:40.527 INFO:tasks.workunit.client.0.smithi083.stdout:6/602: fsync d9/dc/d1b/d39/d47/f50 0 2024-04-01T06:57:40.527 INFO:tasks.workunit.client.0.smithi083.stdout:6/603: fsync d9/d8a/faa 0 2024-04-01T06:57:40.527 INFO:tasks.workunit.client.0.smithi083.stdout:9/565: symlink d6/d32/d3c/d4c/d6b/lc1 0 2024-04-01T06:57:40.527 INFO:tasks.workunit.client.0.smithi083.stdout:9/566: dread - d6/d32/fa4 zero size 2024-04-01T06:57:40.527 INFO:tasks.workunit.client.0.smithi083.stdout:7/568: getdents d0/d4/d9 0 2024-04-01T06:57:40.527 INFO:tasks.workunit.client.0.smithi083.stdout:6/604: symlink d9/dc/d1b/d35/ld0 0 2024-04-01T06:57:40.527 INFO:tasks.workunit.client.0.smithi083.stdout:6/605: readlink d9/dc/d1b/d39/d47/l8d 0 2024-04-01T06:57:40.527 INFO:tasks.workunit.client.0.smithi083.stdout:6/606: write d9/dc/d1b/d35/fb5 [958943,116567] 0 2024-04-01T06:57:40.527 INFO:tasks.workunit.client.0.smithi083.stdout:6/607: symlink d9/dc/d1b/d35/d48/d52/d9c/ld1 0 2024-04-01T06:57:40.528 INFO:tasks.workunit.client.0.smithi083.stdout:9/567: dread d6/d32/d26/d2d/d34/f43 [0,4194304] 0 2024-04-01T06:57:40.528 INFO:tasks.workunit.client.0.smithi083.stdout:6/608: mkdir d9/dc/d29/d3c/d45/dc4/dd2 0 2024-04-01T06:57:40.528 INFO:tasks.workunit.client.0.smithi083.stdout:6/609: fsync d9/dc/f14 0 2024-04-01T06:57:40.528 INFO:tasks.workunit.client.0.smithi083.stdout:6/610: mkdir d9/dc/d29/d3c/d45/dc4/dcb/dd3 0 2024-04-01T06:57:40.528 INFO:tasks.workunit.client.0.smithi083.stdout:0/777: rmdir d16/d99/d4b/d68 39 2024-04-01T06:57:40.528 INFO:tasks.workunit.client.0.smithi083.stdout:9/568: dread d6/d32/d8f/faa [0,4194304] 0 2024-04-01T06:57:40.528 INFO:tasks.workunit.client.0.smithi083.stdout:5/518: rename d4/d23/d49/d7f to d4/d71/d7d/db0 0 2024-04-01T06:57:40.528 INFO:tasks.workunit.client.0.smithi083.stdout:8/706: rename d15/d18/d19/d24/d38/f47 to d15/d21/dbc/f101 0 2024-04-01T06:57:40.528 INFO:tasks.workunit.client.0.smithi083.stdout:5/519: mknod d4/d2b/da9/cb1 0 2024-04-01T06:57:40.528 INFO:tasks.workunit.client.0.smithi083.stdout:8/707: read f14 [3878661,96106] 0 2024-04-01T06:57:40.528 INFO:tasks.workunit.client.0.smithi083.stdout:8/708: truncate d15/d18/d19/d24/da2/d9a/ff7 826893 0 2024-04-01T06:57:40.528 INFO:tasks.workunit.client.0.smithi083.stdout:5/520: mkdir d4/d9/d4f/d96/db2 0 2024-04-01T06:57:40.528 INFO:tasks.workunit.client.0.smithi083.stdout:5/521: fsync d4/d2b/f54 0 2024-04-01T06:57:40.529 INFO:tasks.workunit.client.0.smithi083.stdout:5/522: write d4/d23/d49/fa1 [615370,52651] 0 2024-04-01T06:57:40.529 INFO:tasks.workunit.client.0.smithi083.stdout:8/709: getdents d15/d1b/d39/d48/d5e 0 2024-04-01T06:57:40.529 INFO:tasks.workunit.client.0.smithi083.stdout:5/523: mkdir d4/d2b/da9/db3 0 2024-04-01T06:57:40.529 INFO:tasks.workunit.client.0.smithi083.stdout:6/611: dread d9/dc/d1b/d35/f89 [0,4194304] 0 2024-04-01T06:57:40.529 INFO:tasks.workunit.client.0.smithi083.stdout:4/554: rename d1/f87 to d1/d8/faa 0 2024-04-01T06:57:40.529 INFO:tasks.workunit.client.0.smithi083.stdout:0/778: dwrite f10 [4194304,4194304] 0 2024-04-01T06:57:40.529 INFO:tasks.workunit.client.0.smithi083.stdout:0/779: truncate d16/d2e/d3d/fa0 1610972 0 2024-04-01T06:57:40.529 INFO:tasks.workunit.client.0.smithi083.stdout:0/780: fdatasync d16/d2e/fc1 0 2024-04-01T06:57:40.529 INFO:tasks.workunit.client.0.smithi083.stdout:0/781: chown d16/d1d/f2a 936539 1 2024-04-01T06:57:40.529 INFO:tasks.workunit.client.0.smithi083.stdout:5/524: getdents d4/d2b 0 2024-04-01T06:57:40.529 INFO:tasks.workunit.client.0.smithi083.stdout:5/525: readlink d4/d71/laf 0 2024-04-01T06:57:40.529 INFO:tasks.workunit.client.0.smithi083.stdout:9/569: dwrite d6/d32/d3c/d4c/f55 [0,4194304] 0 2024-04-01T06:57:40.529 INFO:tasks.workunit.client.0.smithi083.stdout:6/612: getdents d9/dc 0 2024-04-01T06:57:40.530 INFO:tasks.workunit.client.0.smithi083.stdout:5/526: mknod d4/d9/cb4 0 2024-04-01T06:57:40.530 INFO:tasks.workunit.client.0.smithi083.stdout:5/527: write d4/d9/d16/d1f/f48 [4159096,25603] 0 2024-04-01T06:57:40.530 INFO:tasks.workunit.client.0.smithi083.stdout:9/570: getdents d6/d32/d3c/d3d 0 2024-04-01T06:57:40.530 INFO:tasks.workunit.client.0.smithi083.stdout:9/571: truncate d6/d32/d3c/d4c/d88/fa5 339699 0 2024-04-01T06:57:40.530 INFO:tasks.workunit.client.0.smithi083.stdout:6/613: rename d9/dc/d1b/d4c/d99/cb7 to d9/d57/cd4 0 2024-04-01T06:57:40.530 INFO:tasks.workunit.client.0.smithi083.stdout:4/555: mkdir d1/d8/dab 0 2024-04-01T06:57:40.530 INFO:tasks.workunit.client.0.smithi083.stdout:9/572: mknod d6/d32/d4d/cc2 0 2024-04-01T06:57:40.530 INFO:tasks.workunit.client.0.smithi083.stdout:6/614: symlink d9/dc/d1b/d35/d48/d52/ld5 0 2024-04-01T06:57:40.530 INFO:tasks.workunit.client.0.smithi083.stdout:6/615: chown d9/dc/d29/d3c/d45 40821 1 2024-04-01T06:57:40.530 INFO:tasks.workunit.client.0.smithi083.stdout:4/556: mkdir d1/d47/dac 0 2024-04-01T06:57:40.530 INFO:tasks.workunit.client.0.smithi083.stdout:8/710: dwrite d15/faa [0,4194304] 0 2024-04-01T06:57:40.530 INFO:tasks.workunit.client.0.smithi083.stdout:9/573: mkdir d6/d32/d26/d2d/d34/dc3 0 2024-04-01T06:57:40.531 INFO:tasks.workunit.client.0.smithi083.stdout:4/557: rename c0 to d1/cad 0 2024-04-01T06:57:40.531 INFO:tasks.workunit.client.0.smithi083.stdout:9/574: dread d6/d32/d3c/f6a [0,4194304] 0 2024-04-01T06:57:40.531 INFO:tasks.workunit.client.0.smithi083.stdout:8/711: truncate d15/d1b/fa7 3903935 0 2024-04-01T06:57:40.531 INFO:tasks.workunit.client.0.smithi083.stdout:4/558: unlink d1/d4/l22 0 2024-04-01T06:57:40.531 INFO:tasks.workunit.client.0.smithi083.stdout:4/559: truncate d1/d8/fa6 543064 0 2024-04-01T06:57:40.531 INFO:tasks.workunit.client.0.smithi083.stdout:4/560: mkdir d1/da5/dae 0 2024-04-01T06:57:40.531 INFO:tasks.workunit.client.0.smithi083.stdout:4/561: readlink d1/d47/l3b 0 2024-04-01T06:57:40.531 INFO:tasks.workunit.client.0.smithi083.stdout:4/562: fsync d1/d8/d6a/f7f 0 2024-04-01T06:57:40.531 INFO:tasks.workunit.client.0.smithi083.stdout:4/563: stat d1/d4/db/d5b/d62/la3 0 2024-04-01T06:57:40.531 INFO:tasks.workunit.client.0.smithi083.stdout:5/528: dwrite d4/d9/d16/d19/d5e/faa [0,4194304] 0 2024-04-01T06:57:40.531 INFO:tasks.workunit.client.0.smithi083.stdout:5/529: write d4/f92 [1495339,71915] 0 2024-04-01T06:57:40.531 INFO:tasks.workunit.client.0.smithi083.stdout:4/564: mkdir d1/d4/db/d94/daf 0 2024-04-01T06:57:40.531 INFO:tasks.workunit.client.0.smithi083.stdout:9/575: dread d6/d32/f1a [0,4194304] 0 2024-04-01T06:57:40.532 INFO:tasks.workunit.client.0.smithi083.stdout:0/782: dwrite d16/d2e/d3d/d5d/f10e [0,4194304] 0 2024-04-01T06:57:40.532 INFO:tasks.workunit.client.0.smithi083.stdout:5/530: write d4/d2b/f39 [685325,29245] 0 2024-04-01T06:57:40.532 INFO:tasks.workunit.client.0.smithi083.stdout:6/616: dread d9/dc/d29/d3c/d5c/f84 [0,4194304] 0 2024-04-01T06:57:40.532 INFO:tasks.workunit.client.0.smithi083.stdout:4/565: mknod d1/d4/d33/d89/cb0 0 2024-04-01T06:57:40.532 INFO:tasks.workunit.client.0.smithi083.stdout:5/531: dread d4/d9/d16/d1f/f69 [0,4194304] 0 2024-04-01T06:57:40.532 INFO:tasks.workunit.client.0.smithi083.stdout:8/712: dwrite d15/d1b/d39/d48/f58 [0,4194304] 0 2024-04-01T06:57:40.532 INFO:tasks.workunit.client.0.smithi083.stdout:9/576: creat d6/d32/d3c/d4c/fc4 x:0 0 0 2024-04-01T06:57:40.532 INFO:tasks.workunit.client.0.smithi083.stdout:0/783: creat d16/d1d/dbb/de9/f111 x:0 0 0 2024-04-01T06:57:40.532 INFO:tasks.workunit.client.0.smithi083.stdout:6/617: write d9/dc/d29/f5d [681524,18166] 0 2024-04-01T06:57:40.532 INFO:tasks.workunit.client.0.smithi083.stdout:6/618: chown d9/dc 1 1 2024-04-01T06:57:40.532 INFO:tasks.workunit.client.0.smithi083.stdout:4/566: link d1/d4/db/f56 d1/da5/dae/fb1 0 2024-04-01T06:57:40.532 INFO:tasks.workunit.client.0.smithi083.stdout:5/532: rmdir d4/d55 39 2024-04-01T06:57:40.532 INFO:tasks.workunit.client.0.smithi083.stdout:8/713: creat d15/d18/d19/d24/d44/d97/dde/f102 x:0 0 0 2024-04-01T06:57:40.532 INFO:tasks.workunit.client.0.smithi083.stdout:0/784: unlink d16/d99/f3e 0 2024-04-01T06:57:40.533 INFO:tasks.workunit.client.0.smithi083.stdout:6/619: unlink d9/dc/d1b/d35/d48/d52/d9c/da9/cc7 0 2024-04-01T06:57:40.533 INFO:tasks.workunit.client.0.smithi083.stdout:6/620: fdatasync d9/dc/d1b/f43 0 2024-04-01T06:57:40.533 INFO:tasks.workunit.client.0.smithi083.stdout:4/567: creat d1/d4/fb2 x:0 0 0 2024-04-01T06:57:40.533 INFO:tasks.workunit.client.0.smithi083.stdout:4/568: write d1/d8/f63 [4984163,65159] 0 2024-04-01T06:57:40.533 INFO:tasks.workunit.client.0.smithi083.stdout:8/714: read d15/d18/f37 [3225056,93385] 0 2024-04-01T06:57:40.533 INFO:tasks.workunit.client.0.smithi083.stdout:3/749: sync 2024-04-01T06:57:40.533 INFO:tasks.workunit.client.0.smithi083.stdout:3/750: fdatasync d6/d15/d2d/d2f/d42/f81 0 2024-04-01T06:57:40.533 INFO:tasks.workunit.client.0.smithi083.stdout:0/785: mkdir d16/d99/d4b/d68/d112 0 2024-04-01T06:57:40.533 INFO:tasks.workunit.client.0.smithi083.stdout:6/621: creat d9/d57/d5f/fd6 x:0 0 0 2024-04-01T06:57:40.533 INFO:tasks.workunit.client.0.smithi083.stdout:9/577: dwrite d6/d32/d8f/faa [0,4194304] 0 2024-04-01T06:57:40.533 INFO:tasks.workunit.client.0.smithi083.stdout:4/569: creat d1/d4/db/fb3 x:0 0 0 2024-04-01T06:57:40.533 INFO:tasks.workunit.client.0.smithi083.stdout:8/715: symlink d15/d18/d19/d24/d44/d97/l103 0 2024-04-01T06:57:40.533 INFO:tasks.workunit.client.0.smithi083.stdout:8/716: chown d15/d1b/d39/d48/d5e/lf3 1 1 2024-04-01T06:57:40.534 INFO:tasks.workunit.client.0.smithi083.stdout:9/578: creat d6/d32/d26/fc5 x:0 0 0 2024-04-01T06:57:40.534 INFO:tasks.workunit.client.0.smithi083.stdout:9/579: dread - d6/d32/d8f/d6d/f89 zero size 2024-04-01T06:57:40.534 INFO:tasks.workunit.client.0.smithi083.stdout:4/570: rmdir d1/d4/db/d94 39 2024-04-01T06:57:40.535 INFO:tasks.workunit.client.0.smithi083.stdout:4/571: write d1/d8/f63 [2964505,61161] 0 2024-04-01T06:57:40.535 INFO:tasks.workunit.client.0.smithi083.stdout:8/717: getdents d15/d18/d19/d24/da2/d9a 0 2024-04-01T06:57:40.535 INFO:tasks.workunit.client.0.smithi083.stdout:6/622: link d9/dc/d29/c87 d9/dc/d29/d3c/d45/dc4/dcb/dce/cd7 0 2024-04-01T06:57:40.536 INFO:tasks.workunit.client.0.smithi083.stdout:4/572: mkdir d1/d47/da1/db4 0 2024-04-01T06:57:40.536 INFO:tasks.workunit.client.0.smithi083.stdout:4/573: stat d1/d4/da/d88/da8 0 2024-04-01T06:57:40.536 INFO:tasks.workunit.client.0.smithi083.stdout:4/574: write d1/d4/db/f20 [3413319,81004] 0 2024-04-01T06:57:40.536 INFO:tasks.workunit.client.0.smithi083.stdout:6/623: creat d9/dc/d1b/d4c/fd8 x:0 0 0 2024-04-01T06:57:40.536 INFO:tasks.workunit.client.0.smithi083.stdout:4/575: mkdir d1/d47/d2a/db5 0 2024-04-01T06:57:40.536 INFO:tasks.workunit.client.0.smithi083.stdout:4/576: mkdir d1/d47/da1/db4/db6 0 2024-04-01T06:57:40.536 INFO:tasks.workunit.client.0.smithi083.stdout:8/718: dread f14 [0,4194304] 0 2024-04-01T06:57:40.536 INFO:tasks.workunit.client.0.smithi083.stdout:4/577: write d1/d4/f25 [4974968,100418] 0 2024-04-01T06:57:40.536 INFO:tasks.workunit.client.0.smithi083.stdout:8/719: truncate f9 2830715 0 2024-04-01T06:57:40.537 INFO:tasks.workunit.client.0.smithi083.stdout:8/720: rename d15/d18/d1e/c8d to d15/d18/d19/d24/d44/d75/c104 0 2024-04-01T06:57:40.537 INFO:tasks.workunit.client.0.smithi083.stdout:0/786: dwrite d16/d1d/f2b [0,4194304] 0 2024-04-01T06:57:40.537 INFO:tasks.workunit.client.0.smithi083.stdout:8/721: chown d15/d18/c5f 7330864 1 2024-04-01T06:57:40.540 INFO:tasks.workunit.client.0.smithi083.stdout:0/787: write fd [3304770,36617] 0 2024-04-01T06:57:40.543 INFO:tasks.workunit.client.0.smithi083.stdout:0/788: getdents d16/d2e/d5b/d74/dd3/d10d 0 2024-04-01T06:57:40.543 INFO:tasks.workunit.client.0.smithi083.stdout:4/578: dread d1/f2 [0,4194304] 0 2024-04-01T06:57:40.543 INFO:tasks.workunit.client.0.smithi083.stdout:4/579: write d1/d4/db/f56 [4649583,122078] 0 2024-04-01T06:57:40.547 INFO:tasks.workunit.client.0.smithi083.stdout:0/789: rename d16/d2e/d3d/d7c/le4 to d16/d2e/d5b/d74/dd3/l113 0 2024-04-01T06:57:40.547 INFO:tasks.workunit.client.0.smithi083.stdout:3/751: dwrite d6/f28 [0,4194304] 0 2024-04-01T06:57:40.548 INFO:tasks.workunit.client.0.smithi083.stdout:3/752: write d6/f28 [3828917,71057] 0 2024-04-01T06:57:40.549 INFO:tasks.workunit.client.0.smithi083.stdout:3/753: write d6/d15/f19 [22871,130175] 0 2024-04-01T06:57:40.550 INFO:tasks.workunit.client.0.smithi083.stdout:6/624: dwrite d9/dc/d1b/d35/f89 [0,4194304] 0 2024-04-01T06:57:40.550 INFO:tasks.workunit.client.0.smithi083.stdout:0/790: getdents d16/d99/d4b/d95 0 2024-04-01T06:57:40.558 INFO:tasks.workunit.client.0.smithi083.stdout:9/580: dwrite d6/d32/d8f/f81 [0,4194304] 0 2024-04-01T06:57:40.560 INFO:tasks.workunit.client.0.smithi083.stdout:9/581: mkdir d6/d32/d26/d2d/d34/dc6 0 2024-04-01T06:57:40.560 INFO:tasks.workunit.client.0.smithi083.stdout:9/582: write d6/d32/f1b [1341065,33417] 0 2024-04-01T06:57:40.560 INFO:tasks.workunit.client.0.smithi083.stdout:4/580: dwrite d1/d8/d6a/f9d [0,4194304] 0 2024-04-01T06:57:40.562 INFO:tasks.workunit.client.0.smithi083.stdout:9/583: creat d6/d32/d26/d2d/d34/dc6/fc7 x:0 0 0 2024-04-01T06:57:40.565 INFO:tasks.workunit.client.0.smithi083.stdout:9/584: rename d6/l85 to d6/d32/d3c/d4c/lc8 0 2024-04-01T06:57:40.569 INFO:tasks.workunit.client.0.smithi083.stdout:9/585: dread d6/d76/fac [0,4194304] 0 2024-04-01T06:57:40.569 INFO:tasks.workunit.client.0.smithi083.stdout:9/586: fdatasync d6/d32/d3c/d4c/f7b 0 2024-04-01T06:57:40.569 INFO:tasks.workunit.client.0.smithi083.stdout:9/587: dread - d6/d32/fa2 zero size 2024-04-01T06:57:40.571 INFO:tasks.workunit.client.0.smithi083.stdout:0/791: dwrite d16/f52 [4194304,4194304] 0 2024-04-01T06:57:40.571 INFO:tasks.workunit.client.0.smithi083.stdout:6/625: dwrite d9/d57/f8c [4194304,4194304] 0 2024-04-01T06:57:40.571 INFO:tasks.workunit.client.0.smithi083.stdout:9/588: mkdir d6/d32/d26/d2d/d34/d6c/dc9 0 2024-04-01T06:57:40.575 INFO:tasks.workunit.client.0.smithi083.stdout:0/792: mknod d16/d1d/d8d/dbf/c114 0 2024-04-01T06:57:40.575 INFO:tasks.workunit.client.0.smithi083.stdout:6/626: symlink d9/dc/d29/d3c/d5c/d8b/ld9 0 2024-04-01T06:57:40.576 INFO:tasks.workunit.client.0.smithi083.stdout:4/581: dwrite d1/d4/f5c [0,4194304] 0 2024-04-01T06:57:40.576 INFO:tasks.workunit.client.0.smithi083.stdout:4/582: truncate d1/d4/da/f83 4385102 0 2024-04-01T06:57:40.577 INFO:tasks.workunit.client.0.smithi083.stdout:6/627: fdatasync d9/dc/d29/f2a 0 2024-04-01T06:57:40.578 INFO:tasks.workunit.client.0.smithi083.stdout:0/793: link d16/d2e/fc1 d16/d2e/d3d/d7c/f115 0 2024-04-01T06:57:40.579 INFO:tasks.workunit.client.0.smithi083.stdout:4/583: creat d1/d47/d2a/db5/fb7 x:0 0 0 2024-04-01T06:57:40.579 INFO:tasks.workunit.client.0.smithi083.stdout:4/584: readlink d1/d47/d2a/l55 0 2024-04-01T06:57:40.579 INFO:tasks.workunit.client.0.smithi083.stdout:6/628: symlink d9/dc/d29/d3c/d45/lda 0 2024-04-01T06:57:40.580 INFO:tasks.workunit.client.0.smithi083.stdout:6/629: truncate d9/dc/d1b/f3f 1973113 0 2024-04-01T06:57:40.580 INFO:tasks.workunit.client.0.smithi083.stdout:3/754: dwrite d6/d15/d2d/d2f/d3e/f8c [0,4194304] 0 2024-04-01T06:57:40.580 INFO:tasks.workunit.client.0.smithi083.stdout:9/589: dread d6/d32/d3c/d4c/d88/f8a [0,4194304] 0 2024-04-01T06:57:40.580 INFO:tasks.workunit.client.0.smithi083.stdout:4/585: dread d1/d47/da1/f61 [0,4194304] 0 2024-04-01T06:57:40.581 INFO:tasks.workunit.client.0.smithi083.stdout:9/590: read d6/f87 [460919,92588] 0 2024-04-01T06:57:40.581 INFO:tasks.workunit.client.0.smithi083.stdout:6/630: rename d9/f1a to d9/dc/fdb 0 2024-04-01T06:57:40.581 INFO:tasks.workunit.client.0.smithi083.stdout:6/631: dread - d9/dc/d1b/d39/f3a zero size 2024-04-01T06:57:40.581 INFO:tasks.workunit.client.0.smithi083.stdout:9/591: write d6/d32/d8f/fb7 [2330489,60808] 0 2024-04-01T06:57:40.581 INFO:tasks.workunit.client.0.smithi083.stdout:4/586: truncate d1/d8/fa6 526074 0 2024-04-01T06:57:40.583 INFO:tasks.workunit.client.0.smithi083.stdout:6/632: unlink d9/dc/d1b/d35/l4a 0 2024-04-01T06:57:40.584 INFO:tasks.workunit.client.0.smithi083.stdout:9/592: mkdir d6/d32/d3c/dca 0 2024-04-01T06:57:40.585 INFO:tasks.workunit.client.0.smithi083.stdout:9/593: write d6/d32/d8f/fb7 [1778968,109479] 0 2024-04-01T06:57:40.585 INFO:tasks.workunit.client.0.smithi083.stdout:9/594: fsync d6/d76/fac 0 2024-04-01T06:57:40.585 INFO:tasks.workunit.client.0.smithi083.stdout:4/587: mkdir d1/d4/db8 0 2024-04-01T06:57:40.585 INFO:tasks.workunit.client.0.smithi083.stdout:4/588: fsync d1/d4/db/d5b/d62/f8b 0 2024-04-01T06:57:40.586 INFO:tasks.workunit.client.0.smithi083.stdout:6/633: symlink d9/d57/dbd/ldc 0 2024-04-01T06:57:40.586 INFO:tasks.workunit.client.0.smithi083.stdout:6/634: stat d9/dc/d1b/d39/f3a 0 2024-04-01T06:57:40.587 INFO:tasks.workunit.client.0.smithi083.stdout:9/595: rmdir d6/d32/d3c/d4c/d88 39 2024-04-01T06:57:40.587 INFO:tasks.workunit.client.0.smithi083.stdout:9/596: stat d6/d32/d26/d2d/d6e 0 2024-04-01T06:57:40.589 INFO:tasks.workunit.client.0.smithi083.stdout:4/589: mknod d1/cb9 0 2024-04-01T06:57:40.591 INFO:tasks.workunit.client.0.smithi083.stdout:9/597: dread d6/d32/f36 [0,4194304] 0 2024-04-01T06:57:40.592 INFO:tasks.workunit.client.0.smithi083.stdout:6/635: creat d9/dc/d29/d3c/d5c/fdd x:0 0 0 2024-04-01T06:57:40.594 INFO:tasks.workunit.client.0.smithi083.stdout:4/590: mkdir d1/d4/db/dba 0 2024-04-01T06:57:40.594 INFO:tasks.workunit.client.0.smithi083.stdout:4/591: write d1/d4/da/d88/f99 [61781,27412] 0 2024-04-01T06:57:40.594 INFO:tasks.workunit.client.0.smithi083.stdout:9/598: symlink d6/d32/d26/lcb 0 2024-04-01T06:57:40.595 INFO:tasks.workunit.client.0.smithi083.stdout:6/636: creat d9/dc/d29/d3c/d5c/d8b/fde x:0 0 0 2024-04-01T06:57:40.597 INFO:tasks.workunit.client.0.smithi083.stdout:4/592: creat d1/d47/da1/d79/fbb x:0 0 0 2024-04-01T06:57:40.603 INFO:tasks.workunit.client.0.smithi083.stdout:6/637: dread d9/dc/f11 [0,4194304] 0 2024-04-01T06:57:40.604 INFO:tasks.workunit.client.0.smithi083.stdout:0/794: dwrite d16/f4c [0,4194304] 0 2024-04-01T06:57:40.607 INFO:tasks.workunit.client.0.smithi083.stdout:3/755: dwrite d6/d15/f10 [0,4194304] 0 2024-04-01T06:57:40.607 INFO:tasks.workunit.client.0.smithi083.stdout:9/599: dwrite d6/d32/d26/d2d/d34/f43 [0,4194304] 0 2024-04-01T06:57:40.607 INFO:tasks.workunit.client.0.smithi083.stdout:3/756: read d6/d15/d2d/d2f/dc7/dcf/fb3 [6429185,15716] 0 2024-04-01T06:57:40.609 INFO:tasks.workunit.client.0.smithi083.stdout:6/638: unlink d9/dc/f11 0 2024-04-01T06:57:40.612 INFO:tasks.workunit.client.0.smithi083.stdout:3/757: mkdir d6/d15/d2d/d2f/d3e/d74/df5 0 2024-04-01T06:57:40.612 INFO:tasks.workunit.client.0.smithi083.stdout:0/795: dread d16/f66 [0,4194304] 0 2024-04-01T06:57:40.612 INFO:tasks.workunit.client.0.smithi083.stdout:0/796: write d16/fcb [620933,56368] 0 2024-04-01T06:57:40.612 INFO:tasks.workunit.client.0.smithi083.stdout:0/797: write d16/d2e/d3d/f59 [590379,115880] 0 2024-04-01T06:57:40.612 INFO:tasks.workunit.client.0.smithi083.stdout:0/798: fdatasync d16/d99/d4b/d68/f86 0 2024-04-01T06:57:40.613 INFO:tasks.workunit.client.0.smithi083.stdout:3/758: creat d6/d1e/d6f/daf/dc1/ff6 x:0 0 0 2024-04-01T06:57:40.621 INFO:tasks.workunit.client.0.smithi083.stdout:6/639: dread d9/dc/d1b/f41 [0,4194304] 0 2024-04-01T06:57:40.625 INFO:tasks.workunit.client.0.smithi083.stdout:3/759: rmdir d6/d15/d2d 39 2024-04-01T06:57:40.626 INFO:tasks.workunit.client.0.smithi083.stdout:3/760: getdents d6/d15/d2d/d2f/dc7/dcf 0 2024-04-01T06:57:40.626 INFO:tasks.workunit.client.0.smithi083.stdout:9/600: dwrite d6/d32/f1a [0,4194304] 0 2024-04-01T06:57:40.628 INFO:tasks.workunit.client.0.smithi083.stdout:9/601: write d6/d32/d26/d2d/d34/f43 [2121273,124938] 0 2024-04-01T06:57:40.632 INFO:tasks.workunit.client.0.smithi083.stdout:3/761: mknod d6/d15/d2d/d2f/d42/cf7 0 2024-04-01T06:57:40.632 INFO:tasks.workunit.client.0.smithi083.stdout:3/762: readlink d6/l98 0 2024-04-01T06:57:40.632 INFO:tasks.workunit.client.0.smithi083.stdout:3/763: fsync d6/f21 0 2024-04-01T06:57:40.632 INFO:tasks.workunit.client.0.smithi083.stdout:3/764: truncate d6/d12/f8a 1419386 0 2024-04-01T06:57:40.632 INFO:tasks.workunit.client.0.smithi083.stdout:3/765: read - d6/d15/d2d/d2f/d42/d46/d55/fe1 zero size 2024-04-01T06:57:40.632 INFO:tasks.workunit.client.0.smithi083.stdout:3/766: write d6/d15/d2d/d2f/d3e/fc6 [209405,14728] 0 2024-04-01T06:57:40.632 INFO:tasks.workunit.client.0.smithi083.stdout:0/799: dwrite d16/d1d/f8b [4194304,4194304] 0 2024-04-01T06:57:40.635 INFO:tasks.workunit.client.0.smithi083.stdout:9/602: mknod d6/d32/d3c/d3d/ccc 0 2024-04-01T06:57:40.635 INFO:tasks.workunit.client.0.smithi083.stdout:9/603: truncate d6/d32/d3c/d4c/d88/fa5 802608 0 2024-04-01T06:57:40.635 INFO:tasks.workunit.client.0.smithi083.stdout:9/604: dread - d6/d32/d26/d2d/d34/d6c/fb9 zero size 2024-04-01T06:57:40.635 INFO:tasks.workunit.client.0.smithi083.stdout:9/605: truncate d6/d32/d26/fc5 764817 0 2024-04-01T06:57:40.635 INFO:tasks.workunit.client.0.smithi083.stdout:9/606: write d6/d32/d26/d2d/d34/d6c/fb9 [183744,13086] 0 2024-04-01T06:57:40.636 INFO:tasks.workunit.client.0.smithi083.stdout:3/767: truncate d6/d15/d2d/d2f/d42/d46/d55/f79 184483 0 2024-04-01T06:57:40.638 INFO:tasks.workunit.client.0.smithi083.stdout:9/607: getdents d6/d32/d8f/d6d/daf 0 2024-04-01T06:57:40.644 INFO:tasks.workunit.client.0.smithi083.stdout:9/608: symlink d6/d32/d3c/lcd 0 2024-04-01T06:57:40.645 INFO:tasks.workunit.client.0.smithi083.stdout:0/800: dwrite d16/d2e/d3d/d5d/f67 [4194304,4194304] 0 2024-04-01T06:57:40.645 INFO:tasks.workunit.client.0.smithi083.stdout:0/801: write d16/d1d/f51 [2675206,87032] 0 2024-04-01T06:57:40.646 INFO:tasks.workunit.client.0.smithi083.stdout:9/609: link d6/d76/f92 d6/d32/fce 0 2024-04-01T06:57:40.650 INFO:tasks.workunit.client.0.smithi083.stdout:9/610: creat d6/d32/d3c/fcf x:0 0 0 2024-04-01T06:57:40.651 INFO:tasks.workunit.client.0.smithi083.stdout:9/611: mkdir d6/d32/d3c/dd0 0 2024-04-01T06:57:40.652 INFO:tasks.workunit.client.0.smithi083.stdout:9/612: chown d6/d32/d26/d2d/f1f 2 1 2024-04-01T06:57:40.652 INFO:tasks.workunit.client.0.smithi083.stdout:9/613: stat d6/d32/d3c/l47 0 2024-04-01T06:57:40.654 INFO:tasks.workunit.client.0.smithi083.stdout:9/614: mkdir d6/d32/d26/d2d/d34/dd1 0 2024-04-01T06:57:40.655 INFO:tasks.workunit.client.0.smithi083.stdout:9/615: mknod d6/d32/d3c/d4c/d6b/d77/cd2 0 2024-04-01T06:57:40.656 INFO:tasks.workunit.client.0.smithi083.stdout:9/616: read d6/d32/d26/fa0 [273551,110574] 0 2024-04-01T06:57:40.657 INFO:tasks.workunit.client.0.smithi083.stdout:9/617: dread d6/d32/d26/fc5 [0,4194304] 0 2024-04-01T06:57:40.659 INFO:tasks.workunit.client.0.smithi083.stdout:0/802: dwrite d16/d99/d4b/d6e/d96/fdd [8388608,4194304] 0 2024-04-01T06:57:40.659 INFO:tasks.workunit.client.0.smithi083.stdout:9/618: mkdir d6/d32/d3c/d4c/d6b/dd3 0 2024-04-01T06:57:40.659 INFO:tasks.workunit.client.0.smithi083.stdout:9/619: chown d6/d32/d26/c28 40401 1 2024-04-01T06:57:40.659 INFO:tasks.workunit.client.0.smithi083.stdout:0/803: chown d16/d1d/d8d/dbf/l10a 2764457 1 2024-04-01T06:57:40.659 INFO:tasks.workunit.client.0.smithi083.stdout:0/804: write d16/dc6/f106 [122912,105889] 0 2024-04-01T06:57:40.660 INFO:tasks.workunit.client.0.smithi083.stdout:9/620: creat d6/d32/d26/d2d/d34/d6c/fd4 x:0 0 0 2024-04-01T06:57:40.660 INFO:tasks.workunit.client.0.smithi083.stdout:0/805: creat d16/d99/dc2/f116 x:0 0 0 2024-04-01T06:57:40.661 INFO:tasks.workunit.client.0.smithi083.stdout:9/621: mkdir d6/d32/d26/d2d/d34/d6c/dc9/dd5 0 2024-04-01T06:57:40.661 INFO:tasks.workunit.client.0.smithi083.stdout:9/622: truncate d6/d32/d26/d2d/d34/d6c/fd4 524939 0 2024-04-01T06:57:40.662 INFO:tasks.workunit.client.0.smithi083.stdout:0/806: write d16/d1d/f25 [7514042,40495] 0 2024-04-01T06:57:40.663 INFO:tasks.workunit.client.0.smithi083.stdout:9/623: mknod d6/d32/d26/d2d/d34/d6c/dc9/cd6 0 2024-04-01T06:57:40.663 INFO:tasks.workunit.client.0.smithi083.stdout:2/619: sync 2024-04-01T06:57:40.664 INFO:tasks.workunit.client.0.smithi083.stdout:0/807: symlink d16/d1d/d8d/l117 0 2024-04-01T06:57:40.665 INFO:tasks.workunit.client.0.smithi083.stdout:2/620: creat d3/d8b/fd0 x:0 0 0 2024-04-01T06:57:40.666 INFO:tasks.workunit.client.0.smithi083.stdout:0/808: rmdir d16/d1d/dbb/de9 39 2024-04-01T06:57:40.671 INFO:tasks.workunit.client.0.smithi083.stdout:9/624: dread d6/d32/d3c/f66 [0,4194304] 0 2024-04-01T06:57:40.674 INFO:tasks.workunit.client.0.smithi083.stdout:0/809: truncate d16/f29 570008 0 2024-04-01T06:57:40.674 INFO:tasks.workunit.client.0.smithi083.stdout:0/810: read - d16/d99/d4b/d68/fd6 zero size 2024-04-01T06:57:40.675 INFO:tasks.workunit.client.0.smithi083.stdout:9/625: creat d6/d32/d26/d2d/d34/dc3/fd7 x:0 0 0 2024-04-01T06:57:40.675 INFO:tasks.workunit.client.0.smithi083.stdout:9/626: fdatasync d6/d32/d8f/f81 0 2024-04-01T06:57:40.677 INFO:tasks.workunit.client.0.smithi083.stdout:0/811: rmdir d16/d2e/d5b/d74 39 2024-04-01T06:57:40.677 INFO:tasks.workunit.client.0.smithi083.stdout:0/812: write d16/d99/d4b/d84/ff6 [979980,93551] 0 2024-04-01T06:57:40.681 INFO:tasks.workunit.client.0.smithi083.stdout:0/813: dread d16/d2e/f36 [0,4194304] 0 2024-04-01T06:57:40.682 INFO:tasks.workunit.client.0.smithi083.stdout:0/814: mkdir d16/d118 0 2024-04-01T06:57:40.682 INFO:tasks.workunit.client.0.smithi083.stdout:0/815: creat d16/d99/d4b/d6e/d96/f119 x:0 0 0 2024-04-01T06:57:40.683 INFO:tasks.workunit.client.0.smithi083.stdout:0/816: mknod d16/c11a 0 2024-04-01T06:57:40.684 INFO:tasks.workunit.client.0.smithi083.stdout:0/817: chown d16/d1d/d8d/fd7 48854 1 2024-04-01T06:57:40.684 INFO:tasks.workunit.client.0.smithi083.stdout:0/818: write d16/d99/d4b/d84/ffc [239659,116154] 0 2024-04-01T06:57:40.688 INFO:tasks.workunit.client.0.smithi083.stdout:0/819: dread d16/d99/d4b/d84/ffc [0,4194304] 0 2024-04-01T06:57:40.692 INFO:tasks.workunit.client.0.smithi083.stdout:9/627: dwrite d6/d32/d4d/f5c [4194304,4194304] 0 2024-04-01T06:57:40.694 INFO:tasks.workunit.client.0.smithi083.stdout:9/628: rename d6/d32/d8f/f81 to d6/d32/d26/d2d/d34/dc6/fd8 0 2024-04-01T06:57:40.696 INFO:tasks.workunit.client.0.smithi083.stdout:9/629: rmdir d6/d32/d26/d2d/d34/dd1 0 2024-04-01T06:57:40.697 INFO:tasks.workunit.client.0.smithi083.stdout:9/630: symlink d6/d32/d8f/d6d/daf/ld9 0 2024-04-01T06:57:40.698 INFO:tasks.workunit.client.0.smithi083.stdout:9/631: mkdir d6/d32/d26/dda 0 2024-04-01T06:57:40.699 INFO:tasks.workunit.client.0.smithi083.stdout:9/632: mknod d6/d32/d3c/d4c/d6b/cdb 0 2024-04-01T06:57:40.702 INFO:tasks.workunit.client.0.smithi083.stdout:0/820: dwrite d16/d1d/f37 [0,4194304] 0 2024-04-01T06:57:40.704 INFO:tasks.workunit.client.0.smithi083.stdout:0/821: mkdir d16/d99/d4b/d11b 0 2024-04-01T06:57:40.706 INFO:tasks.workunit.client.0.smithi083.stdout:0/822: mkdir d16/d99/dc2/d11c 0 2024-04-01T06:57:40.707 INFO:tasks.workunit.client.0.smithi083.stdout:0/823: getdents d16/d2e/d3d 0 2024-04-01T06:57:40.708 INFO:tasks.workunit.client.0.smithi083.stdout:9/633: dread d6/d32/d8f/fb4 [0,4194304] 0 2024-04-01T06:57:40.708 INFO:tasks.workunit.client.0.smithi083.stdout:9/634: write d6/d32/fce [745348,106110] 0 2024-04-01T06:57:40.711 INFO:tasks.workunit.client.0.smithi083.stdout:0/824: rename d16/d2e/dba/fde to d16/d1d/dbb/de5/f11d 0 2024-04-01T06:57:40.714 INFO:tasks.workunit.client.0.smithi083.stdout:9/635: creat d6/d32/d3c/d4c/d6b/dd3/fdc x:0 0 0 2024-04-01T06:57:40.715 INFO:tasks.workunit.client.0.smithi083.stdout:0/825: symlink d16/d99/l11e 0 2024-04-01T06:57:40.730 INFO:tasks.workunit.client.0.smithi083.stdout:9/636: dwrite d6/d32/d26/fc5 [0,4194304] 0 2024-04-01T06:57:40.732 INFO:tasks.workunit.client.0.smithi083.stdout:9/637: creat d6/d32/d8f/d6d/daf/fdd x:0 0 0 2024-04-01T06:57:40.734 INFO:tasks.workunit.client.0.smithi083.stdout:1/756: sync 2024-04-01T06:57:40.734 INFO:tasks.workunit.client.0.smithi083.stdout:7/569: sync 2024-04-01T06:57:40.734 INFO:tasks.workunit.client.0.smithi083.stdout:9/638: creat d6/d32/d26/d2d/d34/d6c/dc9/dd5/fde x:0 0 0 2024-04-01T06:57:40.735 INFO:tasks.workunit.client.0.smithi083.stdout:9/639: read d6/f7 [3297321,22703] 0 2024-04-01T06:57:40.735 INFO:tasks.workunit.client.0.smithi083.stdout:7/570: mkdir d0/d4/d9/d39/d67/d6d/d87/d83/d62/dc6 0 2024-04-01T06:57:40.737 INFO:tasks.workunit.client.0.smithi083.stdout:9/640: creat d6/d32/d26/d2d/d34/fdf x:0 0 0 2024-04-01T06:57:40.737 INFO:tasks.workunit.client.0.smithi083.stdout:9/641: chown d6/d32/d26/lcb 98778694 1 2024-04-01T06:57:40.737 INFO:tasks.workunit.client.0.smithi083.stdout:9/642: write d6/d32/d3c/d4c/f7b [941670,120493] 0 2024-04-01T06:57:40.738 INFO:tasks.workunit.client.0.smithi083.stdout:7/571: dread d0/d4/d9/d39/d48/f85 [0,4194304] 0 2024-04-01T06:57:40.738 INFO:tasks.workunit.client.0.smithi083.stdout:9/643: mknod d6/d32/d26/da9/ce0 0 2024-04-01T06:57:40.739 INFO:tasks.workunit.client.0.smithi083.stdout:9/644: readlink d6/d32/d3c/d3d/lbd 0 2024-04-01T06:57:40.740 INFO:tasks.workunit.client.0.smithi083.stdout:7/572: mkdir d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/dc7 0 2024-04-01T06:57:40.741 INFO:tasks.workunit.client.0.smithi083.stdout:9/645: link d6/f13 d6/d32/d26/d2d/d34/d6c/fe1 0 2024-04-01T06:57:40.743 INFO:tasks.workunit.client.0.smithi083.stdout:7/573: creat d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/fc8 x:0 0 0 2024-04-01T06:57:40.744 INFO:tasks.workunit.client.0.smithi083.stdout:9/646: symlink d6/d32/d26/d2d/d34/dc6/le2 0 2024-04-01T06:57:40.746 INFO:tasks.workunit.client.0.smithi083.stdout:7/574: creat d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/d92/fc9 x:0 0 0 2024-04-01T06:57:40.746 INFO:tasks.workunit.client.0.smithi083.stdout:7/575: truncate d0/f2b 1160744 0 2024-04-01T06:57:40.746 INFO:tasks.workunit.client.0.smithi083.stdout:7/576: getdents d0/d4/dbd/db2 0 2024-04-01T06:57:40.747 INFO:tasks.workunit.client.0.smithi083.stdout:7/577: write d0/d4/d9/f81 [32259,60110] 0 2024-04-01T06:57:40.747 INFO:tasks.workunit.client.0.smithi083.stdout:9/647: creat d6/d32/d26/d2d/d34/d6c/fe3 x:0 0 0 2024-04-01T06:57:40.748 INFO:tasks.workunit.client.0.smithi083.stdout:7/578: creat d0/d4/d9/d39/d67/d6d/d87/d83/fca x:0 0 0 2024-04-01T06:57:40.749 INFO:tasks.workunit.client.0.smithi083.stdout:9/648: creat d6/d32/d3c/fe4 x:0 0 0 2024-04-01T06:57:40.750 INFO:tasks.workunit.client.0.smithi083.stdout:9/649: write d6/f13 [8321929,96103] 0 2024-04-01T06:57:40.750 INFO:tasks.workunit.client.0.smithi083.stdout:9/650: write d6/d32/d26/f96 [36486,6253] 0 2024-04-01T06:57:40.750 INFO:tasks.workunit.client.0.smithi083.stdout:9/651: dread - d6/d32/d26/d2d/d34/fdf zero size 2024-04-01T06:57:40.751 INFO:tasks.workunit.client.0.smithi083.stdout:1/757: dwrite db/d1c/d29/d33/d47/d76/db6/fe1 [0,4194304] 0 2024-04-01T06:57:40.751 INFO:tasks.workunit.client.0.smithi083.stdout:9/652: creat d6/d32/d26/fe5 x:0 0 0 2024-04-01T06:57:40.753 INFO:tasks.workunit.client.0.smithi083.stdout:9/653: dread d6/d76/fac [0,4194304] 0 2024-04-01T06:57:40.753 INFO:tasks.workunit.client.0.smithi083.stdout:1/758: link db/d1c/d29/d33/d50/c105 db/d1c/d29/d33/d50/d4d/c10f 0 2024-04-01T06:57:40.754 INFO:tasks.workunit.client.0.smithi083.stdout:9/654: creat d6/d32/d8f/d6d/fe6 x:0 0 0 2024-04-01T06:57:40.754 INFO:tasks.workunit.client.0.smithi083.stdout:9/655: chown d6/d32/d3c/dd0 28 1 2024-04-01T06:57:40.755 INFO:tasks.workunit.client.0.smithi083.stdout:9/656: stat d6/d32/d26/d2d/cc0 0 2024-04-01T06:57:40.755 INFO:tasks.workunit.client.0.smithi083.stdout:9/657: write d6/d76/fbb [927653,120719] 0 2024-04-01T06:57:40.755 INFO:tasks.workunit.client.0.smithi083.stdout:1/759: creat db/d1c/d29/d33/d50/d5d/d6c/f110 x:0 0 0 2024-04-01T06:57:40.755 INFO:tasks.workunit.client.0.smithi083.stdout:1/760: dread - db/d1c/d29/d33/d50/d5d/dad/dbf/fe0 zero size 2024-04-01T06:57:40.756 INFO:tasks.workunit.client.0.smithi083.stdout:9/658: truncate d6/f7 5014917 0 2024-04-01T06:57:40.757 INFO:tasks.workunit.client.0.smithi083.stdout:1/761: rmdir db/d1c/d1d/d8b 39 2024-04-01T06:57:40.758 INFO:tasks.workunit.client.0.smithi083.stdout:9/659: symlink d6/d32/d26/d2d/d34/dc3/le7 0 2024-04-01T06:57:40.760 INFO:tasks.workunit.client.0.smithi083.stdout:1/762: symlink db/d1c/d1d/db4/ddf/l111 0 2024-04-01T06:57:40.760 INFO:tasks.workunit.client.0.smithi083.stdout:1/763: dread - db/d1c/d1d/d8b/f9a zero size 2024-04-01T06:57:40.760 INFO:tasks.workunit.client.0.smithi083.stdout:7/579: dwrite d0/d4/d9/d39/d67/d6d/d87/d83/f42 [0,4194304] 0 2024-04-01T06:57:40.761 INFO:tasks.workunit.client.0.smithi083.stdout:9/660: getdents d6/d32/d3c/d4c/d6b/d77 0 2024-04-01T06:57:40.762 INFO:tasks.workunit.client.0.smithi083.stdout:7/580: mknod d0/d4/d9/d95/ccb 0 2024-04-01T06:57:40.764 INFO:tasks.workunit.client.0.smithi083.stdout:9/661: creat d6/d32/d8f/d6d/fe8 x:0 0 0 2024-04-01T06:57:40.764 INFO:tasks.workunit.client.0.smithi083.stdout:9/662: chown d6/d32/d3c/d4c/d6b/l99 56871148 1 2024-04-01T06:57:40.766 INFO:tasks.workunit.client.0.smithi083.stdout:1/764: dread db/d1c/d29/d33/d50/fa2 [0,4194304] 0 2024-04-01T06:57:40.766 INFO:tasks.workunit.client.0.smithi083.stdout:7/581: mknod d0/d4/d9/ccc 0 2024-04-01T06:57:40.768 INFO:tasks.workunit.client.0.smithi083.stdout:9/663: creat d6/d32/d26/d8e/fe9 x:0 0 0 2024-04-01T06:57:40.768 INFO:tasks.workunit.client.0.smithi083.stdout:9/664: chown d6/d32/d3c/d4c/d6b/fa8 1121 1 2024-04-01T06:57:40.769 INFO:tasks.workunit.client.0.smithi083.stdout:7/582: creat d0/d4/dbd/db2/fcd x:0 0 0 2024-04-01T06:57:40.770 INFO:tasks.workunit.client.0.smithi083.stdout:9/665: mknod d6/d29/cea 0 2024-04-01T06:57:40.773 INFO:tasks.workunit.client.0.smithi083.stdout:9/666: mkdir d6/d32/d26/d2d/deb 0 2024-04-01T06:57:40.777 INFO:tasks.workunit.client.0.smithi083.stdout:1/765: dread db/d1c/d1d/f40 [0,4194304] 0 2024-04-01T06:57:40.777 INFO:tasks.workunit.client.0.smithi083.stdout:1/766: truncate db/d1c/f24 4271254 0 2024-04-01T06:57:40.777 INFO:tasks.workunit.client.0.smithi083.stdout:1/767: chown db/d1c/d29/d33/d50/fcf 136 1 2024-04-01T06:57:40.778 INFO:tasks.workunit.client.0.smithi083.stdout:1/768: write db/d1c/d1d/db4/ddf/de9/feb [576008,117022] 0 2024-04-01T06:57:40.779 INFO:tasks.workunit.client.0.smithi083.stdout:7/583: dread d0/d4/d9/d39/d67/d6d/d87/d83/f53 [0,4194304] 0 2024-04-01T06:57:40.780 INFO:tasks.workunit.client.0.smithi083.stdout:1/769: creat db/d1c/d29/d33/d50/d5d/dad/d106/f112 x:0 0 0 2024-04-01T06:57:40.782 INFO:tasks.workunit.client.0.smithi083.stdout:7/584: rename d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/da4 to d0/d4/d9/d39/d67/d6d/d7d/d8a/dce 0 2024-04-01T06:57:40.784 INFO:tasks.workunit.client.0.smithi083.stdout:1/770: truncate db/f88 3865985 0 2024-04-01T06:57:40.792 INFO:tasks.workunit.client.0.smithi083.stdout:1/771: truncate fa 1723810 0 2024-04-01T06:57:40.796 INFO:tasks.workunit.client.0.smithi083.stdout:1/772: rename db/d1c/d1d/l7f to db/d1c/d29/d33/d50/d5d/d81/d94/l113 0 2024-04-01T06:57:40.797 INFO:tasks.workunit.client.0.smithi083.stdout:1/773: truncate f7 5218725 0 2024-04-01T06:57:40.797 INFO:tasks.workunit.client.0.smithi083.stdout:1/774: write db/d1c/d2e/d30/d82/f102 [266469,55941] 0 2024-04-01T06:57:40.797 INFO:tasks.workunit.client.0.smithi083.stdout:1/775: truncate db/d1c/d29/f46 308926 0 2024-04-01T06:57:40.800 INFO:tasks.workunit.client.0.smithi083.stdout:5/533: sync 2024-04-01T06:57:40.800 INFO:tasks.workunit.client.0.smithi083.stdout:4/593: sync 2024-04-01T06:57:40.800 INFO:tasks.workunit.client.0.smithi083.stdout:8/722: sync 2024-04-01T06:57:40.800 INFO:tasks.workunit.client.0.smithi083.stdout:6/640: sync 2024-04-01T06:57:40.800 INFO:tasks.workunit.client.0.smithi083.stdout:7/585: dwrite d0/d4/fc [0,4194304] 0 2024-04-01T06:57:40.803 INFO:tasks.workunit.client.0.smithi083.stdout:1/776: dread db/d1c/d2e/d30/fa6 [0,4194304] 0 2024-04-01T06:57:40.803 INFO:tasks.workunit.client.0.smithi083.stdout:1/777: chown db/d1c/d2e/d30/d82/f102 16262 1 2024-04-01T06:57:40.804 INFO:tasks.workunit.client.0.smithi083.stdout:5/534: rename d4/d9/d16/d9f/la2 to d4/d9/d16/d1f/d2f/lb5 0 2024-04-01T06:57:40.806 INFO:tasks.workunit.client.0.smithi083.stdout:4/594: mkdir d1/d47/da1/db4/dbc 0 2024-04-01T06:57:40.807 INFO:tasks.workunit.client.0.smithi083.stdout:1/778: dread db/d1c/d29/d33/d50/f2c [0,4194304] 0 2024-04-01T06:57:40.808 INFO:tasks.workunit.client.0.smithi083.stdout:6/641: mknod d9/dc/d9f/cdf 0 2024-04-01T06:57:40.811 INFO:tasks.workunit.client.0.smithi083.stdout:8/723: rename d15/f5c to d15/d18/d19/d24/d38/d62/df4/f105 0 2024-04-01T06:57:40.812 INFO:tasks.workunit.client.0.smithi083.stdout:4/595: mkdir d1/d4/db/d5b/d62/dbd 0 2024-04-01T06:57:40.813 INFO:tasks.workunit.client.0.smithi083.stdout:1/779: creat db/d1c/d29/d33/d50/f114 x:0 0 0 2024-04-01T06:57:40.813 INFO:tasks.workunit.client.0.smithi083.stdout:1/780: fsync db/d1c/d29/d33/f10b 0 2024-04-01T06:57:40.815 INFO:tasks.workunit.client.0.smithi083.stdout:4/596: link d1/d47/l3b d1/d4/da/d88/da8/lbe 0 2024-04-01T06:57:40.816 INFO:tasks.workunit.client.0.smithi083.stdout:1/781: creat db/d1c/d49/f115 x:0 0 0 2024-04-01T06:57:40.816 INFO:tasks.workunit.client.0.smithi083.stdout:4/597: read d1/f2 [1675050,49613] 0 2024-04-01T06:57:40.817 INFO:tasks.workunit.client.0.smithi083.stdout:8/724: link d15/d18/fc1 d15/d18/d1e/de3/f106 0 2024-04-01T06:57:40.817 INFO:tasks.workunit.client.0.smithi083.stdout:1/782: write f1 [1114353,94082] 0 2024-04-01T06:57:40.817 INFO:tasks.workunit.client.0.smithi083.stdout:1/783: chown db/ccd 465976 1 2024-04-01T06:57:40.817 INFO:tasks.workunit.client.0.smithi083.stdout:1/784: stat db/d1c/d29/d33/d47/d76/fdc 0 2024-04-01T06:57:40.818 INFO:tasks.workunit.client.0.smithi083.stdout:4/598: creat d1/d4/db/d94/fbf x:0 0 0 2024-04-01T06:57:40.818 INFO:tasks.workunit.client.0.smithi083.stdout:8/725: symlink d15/d18/d19/d24/da2/l107 0 2024-04-01T06:57:40.819 INFO:tasks.workunit.client.0.smithi083.stdout:8/726: write d15/d18/d19/d24/d38/d62/f4a [510903,27949] 0 2024-04-01T06:57:40.819 INFO:tasks.workunit.client.0.smithi083.stdout:8/727: fdatasync d15/d18/d19/d24/d44/d75/dab/fac 0 2024-04-01T06:57:40.819 INFO:tasks.workunit.client.0.smithi083.stdout:8/728: fdatasync d15/d18/d19/d24/fbb 0 2024-04-01T06:57:40.819 INFO:tasks.workunit.client.0.smithi083.stdout:8/729: truncate d15/d18/d19/d24/da2/fd5 818989 0 2024-04-01T06:57:40.821 INFO:tasks.workunit.client.0.smithi083.stdout:4/599: unlink d1/d4/db/f41 0 2024-04-01T06:57:40.821 INFO:tasks.workunit.client.0.smithi083.stdout:8/730: dread d15/d1b/d39/d48/d5e/d70/f86 [0,4194304] 0 2024-04-01T06:57:40.821 INFO:tasks.workunit.client.0.smithi083.stdout:5/535: dwrite d4/d9/d16/d1f/d2f/d53/f66 [0,4194304] 0 2024-04-01T06:57:40.825 INFO:tasks.workunit.client.0.smithi083.stdout:4/600: truncate d1/d4/db/d5b/f69 1941473 0 2024-04-01T06:57:40.825 INFO:tasks.workunit.client.0.smithi083.stdout:4/601: stat d1/d4/fb2 0 2024-04-01T06:57:40.826 INFO:tasks.workunit.client.0.smithi083.stdout:8/731: mkdir d15/d18/d19/d24/d44/d108 0 2024-04-01T06:57:40.826 INFO:tasks.workunit.client.0.smithi083.stdout:1/785: dread db/d1c/d29/d33/d50/fba [4194304,4194304] 0 2024-04-01T06:57:40.830 INFO:tasks.workunit.client.0.smithi083.stdout:6/642: dwrite d9/dc/d29/f2a [4194304,4194304] 0 2024-04-01T06:57:40.830 INFO:tasks.workunit.client.0.smithi083.stdout:4/602: getdents d1 0 2024-04-01T06:57:40.830 INFO:tasks.workunit.client.0.smithi083.stdout:4/603: write d1/d4/da/f84 [139136,10552] 0 2024-04-01T06:57:40.830 INFO:tasks.workunit.client.0.smithi083.stdout:8/732: rename d15/d1b/d39/d48/d5e/c100 to d15/d1b/d39/d48/d5e/c109 0 2024-04-01T06:57:40.832 INFO:tasks.workunit.client.0.smithi083.stdout:1/786: unlink db/d1c/d2e/d30/l3f 0 2024-04-01T06:57:40.832 INFO:tasks.workunit.client.0.smithi083.stdout:1/787: chown f1 1 1 2024-04-01T06:57:40.835 INFO:tasks.workunit.client.0.smithi083.stdout:5/536: dwrite d4/d9/d16/f4c [0,4194304] 0 2024-04-01T06:57:40.836 INFO:tasks.workunit.client.0.smithi083.stdout:8/733: mkdir d15/d18/d19/d24/d38/de7/d10a 0 2024-04-01T06:57:40.838 INFO:tasks.workunit.client.0.smithi083.stdout:6/643: mkdir d9/dc/d1b/d35/de0 0 2024-04-01T06:57:40.839 INFO:tasks.workunit.client.0.smithi083.stdout:8/734: readlink d15/d18/l32 0 2024-04-01T06:57:40.840 INFO:tasks.workunit.client.0.smithi083.stdout:1/788: rmdir db/d1c/d29/d33/d50/d5d/d6c/ddb 39 2024-04-01T06:57:40.842 INFO:tasks.workunit.client.0.smithi083.stdout:6/644: rename d9/dc/d1b/d4c/f74 to d9/dc/d29/d3c/d45/dc4/dd2/fe1 0 2024-04-01T06:57:40.843 INFO:tasks.workunit.client.0.smithi083.stdout:8/735: unlink d15/d18/d19/d24/d38/d62/f85 0 2024-04-01T06:57:40.845 INFO:tasks.workunit.client.0.smithi083.stdout:1/789: rename db/d1c/d29/d33/d50/d5d/d81/ccc to db/d1c/d29/d33/d50/d5d/c116 0 2024-04-01T06:57:40.845 INFO:tasks.workunit.client.0.smithi083.stdout:1/790: chown db/d61 208405323 1 2024-04-01T06:57:40.845 INFO:tasks.workunit.client.0.smithi083.stdout:6/645: rmdir d9/dc/d29/d3c/d45 39 2024-04-01T06:57:40.846 INFO:tasks.workunit.client.0.smithi083.stdout:5/537: dwrite d4/d9/d16/d19/d5e/f64 [0,4194304] 0 2024-04-01T06:57:40.846 INFO:tasks.workunit.client.0.smithi083.stdout:1/791: dread db/d1c/f35 [0,4194304] 0 2024-04-01T06:57:40.847 INFO:tasks.workunit.client.0.smithi083.stdout:8/736: truncate d15/d1b/d39/d48/d5e/d70/f98 2303053 0 2024-04-01T06:57:40.848 INFO:tasks.workunit.client.0.smithi083.stdout:6/646: readlink d9/dc/d1b/d39/l86 0 2024-04-01T06:57:40.848 INFO:tasks.workunit.client.0.smithi083.stdout:6/647: stat d9/dc/d1b/d35/d48 0 2024-04-01T06:57:40.848 INFO:tasks.workunit.client.0.smithi083.stdout:6/648: dread - d9/d8a/f9b zero size 2024-04-01T06:57:40.850 INFO:tasks.workunit.client.0.smithi083.stdout:8/737: dread d15/d18/d19/f5d [0,4194304] 0 2024-04-01T06:57:40.853 INFO:tasks.workunit.client.0.smithi083.stdout:4/604: write d1/d4/db/d5b/f69 [1572898,59151] 0 2024-04-01T06:57:40.854 INFO:tasks.workunit.client.0.smithi083.stdout:5/538: getdents d4/d9/d16/d1f 0 2024-04-01T06:57:40.855 INFO:tasks.workunit.client.0.smithi083.stdout:1/792: getdents db/d1c/d29/dbe 0 2024-04-01T06:57:40.856 INFO:tasks.workunit.client.0.smithi083.stdout:6/649: dread d9/dc/d1b/d35/f78 [0,4194304] 0 2024-04-01T06:57:40.862 INFO:tasks.workunit.client.0.smithi083.stdout:8/738: creat d15/d18/d1e/f10b x:0 0 0 2024-04-01T06:57:40.866 INFO:tasks.workunit.client.0.smithi083.stdout:4/605: unlink d1/d4/da/f84 0 2024-04-01T06:57:40.867 INFO:tasks.workunit.client.0.smithi083.stdout:5/539: symlink d4/d9/d16/d19/d5e/lb6 0 2024-04-01T06:57:40.867 INFO:tasks.workunit.client.0.smithi083.stdout:3/768: sync 2024-04-01T06:57:40.867 INFO:tasks.workunit.client.0.smithi083.stdout:2/621: sync 2024-04-01T06:57:40.869 INFO:tasks.workunit.client.0.smithi083.stdout:3/769: write d6/d15/d2d/d2f/d42/d46/d55/fb2 [3936227,119615] 0 2024-04-01T06:57:40.869 INFO:tasks.workunit.client.0.smithi083.stdout:1/793: getdents db/d1c/d49 0 2024-04-01T06:57:40.869 INFO:tasks.workunit.client.0.smithi083.stdout:1/794: readlink db/d1c/d29/d33/d47/de4/l107 0 2024-04-01T06:57:40.871 INFO:tasks.workunit.client.0.smithi083.stdout:3/770: dread d6/d15/d2d/d2f/d42/d5c/d88/fc4 [0,4194304] 0 2024-04-01T06:57:40.871 INFO:tasks.workunit.client.0.smithi083.stdout:3/771: write d6/d15/d2d/d2f/d3e/fee [97080,80236] 0 2024-04-01T06:57:40.872 INFO:tasks.workunit.client.0.smithi083.stdout:3/772: fsync d6/d15/d2d/d2f/d42/d46/d55/fd7 0 2024-04-01T06:57:40.880 INFO:tasks.workunit.client.0.smithi083.stdout:4/606: mkdir d1/d4/db/dc0 0 2024-04-01T06:57:40.882 INFO:tasks.workunit.client.0.smithi083.stdout:2/622: unlink d3/d4d/f52 0 2024-04-01T06:57:40.883 INFO:tasks.workunit.client.0.smithi083.stdout:6/650: dwrite d9/dc/d29/f6b [0,4194304] 0 2024-04-01T06:57:40.885 INFO:tasks.workunit.client.0.smithi083.stdout:1/795: rename db/d1c/d29/df0 to db/d1c/d1d/db4/ddf/d117 0 2024-04-01T06:57:40.885 INFO:tasks.workunit.client.0.smithi083.stdout:1/796: read - db/d1c/d29/d33/f101 zero size 2024-04-01T06:57:40.887 INFO:tasks.workunit.client.0.smithi083.stdout:3/773: creat d6/d1e/d6f/daf/ff8 x:0 0 0 2024-04-01T06:57:40.889 INFO:tasks.workunit.client.0.smithi083.stdout:6/651: mkdir d9/dc/d9f/de2 0 2024-04-01T06:57:40.890 INFO:tasks.workunit.client.0.smithi083.stdout:6/652: write d9/dc/d1b/f43 [313267,8675] 0 2024-04-01T06:57:40.890 INFO:tasks.workunit.client.0.smithi083.stdout:6/653: read d9/d8a/faa [554420,45287] 0 2024-04-01T06:57:40.890 INFO:tasks.workunit.client.0.smithi083.stdout:4/607: rename d1/d4/db/f3e to d1/d4/da/fc1 0 2024-04-01T06:57:40.892 INFO:tasks.workunit.client.0.smithi083.stdout:6/654: getdents d9/dc/d1b/d39 0 2024-04-01T06:57:40.894 INFO:tasks.workunit.client.0.smithi083.stdout:2/623: rename d3/d4d/f4f to d3/d71/d90/fd1 0 2024-04-01T06:57:40.898 INFO:tasks.workunit.client.0.smithi083.stdout:3/774: rename d6/d15/d2d/d2f/f9e to d6/d15/d2d/d2f/dc7/ff9 0 2024-04-01T06:57:40.899 INFO:tasks.workunit.client.0.smithi083.stdout:1/797: dwrite db/d1c/d29/f3e [4194304,4194304] 0 2024-04-01T06:57:40.901 INFO:tasks.workunit.client.0.smithi083.stdout:3/775: rename d6/d15/d2d/d2f/d42/d9f/fae to d6/d15/d2d/d2f/d42/d5c/d88/db9/ffa 0 2024-04-01T06:57:40.903 INFO:tasks.workunit.client.0.smithi083.stdout:1/798: rename db/d1c/d2e/f2f to db/d1c/d29/d33/d50/d5d/d81/f118 0 2024-04-01T06:57:40.905 INFO:tasks.workunit.client.0.smithi083.stdout:3/776: mkdir d6/d15/d2d/d2f/d3e/d74/dfb 0 2024-04-01T06:57:40.905 INFO:tasks.workunit.client.0.smithi083.stdout:3/777: truncate d6/d15/d2d/d2f/d42/d46/fa7 1010048 0 2024-04-01T06:57:40.905 INFO:tasks.workunit.client.0.smithi083.stdout:3/778: readlink d6/d12/l91 0 2024-04-01T06:57:40.905 INFO:tasks.workunit.client.0.smithi083.stdout:3/779: fsync d6/d15/d2d/d2f/d42/d46/d55/fe1 0 2024-04-01T06:57:40.907 INFO:tasks.workunit.client.0.smithi083.stdout:3/780: creat d6/d15/d2d/d2f/d53/de5/ffc x:0 0 0 2024-04-01T06:57:40.907 INFO:tasks.workunit.client.0.smithi083.stdout:3/781: write d6/d15/d2d/d2f/d42/d46/d55/f79 [1020468,73616] 0 2024-04-01T06:57:40.913 INFO:tasks.workunit.client.0.smithi083.stdout:6/655: dread d9/dc/f30 [8388608,4194304] 0 2024-04-01T06:57:40.913 INFO:tasks.workunit.client.0.smithi083.stdout:6/656: fdatasync d9/dc/d1b/d35/d48/d52/d9c/fb6 0 2024-04-01T06:57:40.913 INFO:tasks.workunit.client.0.smithi083.stdout:6/657: dread - d9/dc/d1b/d4c/fd8 zero size 2024-04-01T06:57:40.913 INFO:tasks.workunit.client.0.smithi083.stdout:6/658: chown d9/dc/d29/c7c 162774 1 2024-04-01T06:57:40.915 INFO:tasks.workunit.client.0.smithi083.stdout:6/659: fdatasync d9/dc/f23 0 2024-04-01T06:57:40.915 INFO:tasks.workunit.client.0.smithi083.stdout:6/660: fdatasync d9/dc/d1b/d35/f64 0 2024-04-01T06:57:40.915 INFO:tasks.workunit.client.0.smithi083.stdout:2/624: dwrite d3/d8b/d53/d5e/fa2 [0,4194304] 0 2024-04-01T06:57:40.917 INFO:tasks.workunit.client.0.smithi083.stdout:2/625: write d3/d8b/d53/d68/f5c [2352012,120846] 0 2024-04-01T06:57:40.918 INFO:tasks.workunit.client.0.smithi083.stdout:2/626: write d3/fc [4870612,31456] 0 2024-04-01T06:57:40.921 INFO:tasks.workunit.client.0.smithi083.stdout:1/799: dwrite db/d1c/d29/d33/d47/d76/db6/fef [0,4194304] 0 2024-04-01T06:57:40.921 INFO:tasks.workunit.client.0.smithi083.stdout:1/800: truncate db/d1c/d29/d33/d50/d5d/d6c/f74 4644255 0 2024-04-01T06:57:40.922 INFO:tasks.workunit.client.0.smithi083.stdout:3/782: dwrite d6/d15/f35 [0,4194304] 0 2024-04-01T06:57:40.922 INFO:tasks.workunit.client.0.smithi083.stdout:3/783: write d6/d15/d2d/d2f/d42/d46/f5e [885025,36777] 0 2024-04-01T06:57:40.923 INFO:tasks.workunit.client.0.smithi083.stdout:2/627: symlink d3/d4d/ld2 0 2024-04-01T06:57:40.924 INFO:tasks.workunit.client.0.smithi083.stdout:1/801: creat db/f119 x:0 0 0 2024-04-01T06:57:40.924 INFO:tasks.workunit.client.0.smithi083.stdout:1/802: fdatasync db/f13 0 2024-04-01T06:57:40.925 INFO:tasks.workunit.client.0.smithi083.stdout:1/803: write db/d1c/d29/d33/d50/f2c [1561089,14398] 0 2024-04-01T06:57:40.925 INFO:tasks.workunit.client.0.smithi083.stdout:6/661: dwrite d9/dc/f25 [0,4194304] 0 2024-04-01T06:57:40.925 INFO:tasks.workunit.client.0.smithi083.stdout:6/662: write d9/dc/d1b/d35/f85 [274812,120490] 0 2024-04-01T06:57:40.931 INFO:tasks.workunit.client.0.smithi083.stdout:3/784: unlink d6/d1e/f7b 0 2024-04-01T06:57:40.933 INFO:tasks.workunit.client.0.smithi083.stdout:2/628: unlink d3/f16 0 2024-04-01T06:57:40.933 INFO:tasks.workunit.client.0.smithi083.stdout:2/629: fdatasync f2 0 2024-04-01T06:57:40.933 INFO:tasks.workunit.client.0.smithi083.stdout:2/630: chown d3/d26/d59/daf/fc7 1535 1 2024-04-01T06:57:40.933 INFO:tasks.workunit.client.0.smithi083.stdout:6/663: dread d9/dc/f30 [0,4194304] 0 2024-04-01T06:57:40.935 INFO:tasks.workunit.client.0.smithi083.stdout:1/804: creat db/d1c/d29/f11a x:0 0 0 2024-04-01T06:57:40.935 INFO:tasks.workunit.client.0.smithi083.stdout:1/805: write db/d1c/d2e/d30/fca [952706,126521] 0 2024-04-01T06:57:40.935 INFO:tasks.workunit.client.0.smithi083.stdout:1/806: readlink db/d1c/l28 0 2024-04-01T06:57:40.936 INFO:tasks.workunit.client.0.smithi083.stdout:3/785: unlink d6/d15/d2d/d2f/d42/d5c/l8f 0 2024-04-01T06:57:40.937 INFO:tasks.workunit.client.0.smithi083.stdout:2/631: creat d3/d8b/fd3 x:0 0 0 2024-04-01T06:57:40.937 INFO:tasks.workunit.client.0.smithi083.stdout:2/632: read d3/d4d/d5d/f74 [244600,128072] 0 2024-04-01T06:57:40.938 INFO:tasks.workunit.client.0.smithi083.stdout:6/664: getdents d9/dc/d1b/d4c/d99 0 2024-04-01T06:57:40.940 INFO:tasks.workunit.client.0.smithi083.stdout:1/807: symlink db/d1c/d2e/d30/d82/l11b 0 2024-04-01T06:57:40.941 INFO:tasks.workunit.client.0.smithi083.stdout:3/786: mkdir d6/d1e/d4a/dfd 0 2024-04-01T06:57:40.942 INFO:tasks.workunit.client.0.smithi083.stdout:2/633: creat d3/d26/d59/fd4 x:0 0 0 2024-04-01T06:57:40.943 INFO:tasks.workunit.client.0.smithi083.stdout:2/634: write d3/f43 [4919276,20464] 0 2024-04-01T06:57:40.946 INFO:tasks.workunit.client.0.smithi083.stdout:2/635: mknod d3/d26/cd5 0 2024-04-01T06:57:40.946 INFO:tasks.workunit.client.0.smithi083.stdout:2/636: readlink d3/l13 0 2024-04-01T06:57:40.948 INFO:tasks.workunit.client.0.smithi083.stdout:3/787: symlink d6/lfe 0 2024-04-01T06:57:40.949 INFO:tasks.workunit.client.0.smithi083.stdout:3/788: truncate d6/d15/d2d/d2f/d53/fa6 1401741 0 2024-04-01T06:57:40.954 INFO:tasks.workunit.client.0.smithi083.stdout:6/665: dwrite d9/dc/d1b/d35/f64 [0,4194304] 0 2024-04-01T06:57:40.954 INFO:tasks.workunit.client.0.smithi083.stdout:2/637: dread f1 [0,4194304] 0 2024-04-01T06:57:40.955 INFO:tasks.workunit.client.0.smithi083.stdout:6/666: mknod d9/d8a/ce3 0 2024-04-01T06:57:40.957 INFO:tasks.workunit.client.0.smithi083.stdout:2/638: mkdir d3/d8b/dd6 0 2024-04-01T06:57:40.957 INFO:tasks.workunit.client.0.smithi083.stdout:1/808: dwrite db/d1c/d1d/db4/ddf/de9/feb [0,4194304] 0 2024-04-01T06:57:40.958 INFO:tasks.workunit.client.0.smithi083.stdout:6/667: truncate d9/dc/d29/d3c/d5c/f63 346729 0 2024-04-01T06:57:40.958 INFO:tasks.workunit.client.0.smithi083.stdout:6/668: write d9/dc/d1b/d35/d48/d52/d9c/fc0 [968723,130089] 0 2024-04-01T06:57:40.960 INFO:tasks.workunit.client.0.smithi083.stdout:2/639: chown d3/d26/d59/l22 5544254 1 2024-04-01T06:57:40.962 INFO:tasks.workunit.client.0.smithi083.stdout:6/669: dread d9/d57/d5f/f76 [0,4194304] 0 2024-04-01T06:57:40.965 INFO:tasks.workunit.client.0.smithi083.stdout:1/809: rename db/d1c/d29/d33/d50/d5d/d6c/f99 to db/d1c/d1d/f11c 0 2024-04-01T06:57:40.965 INFO:tasks.workunit.client.0.smithi083.stdout:1/810: fdatasync db/d1c/d29/d33/d50/f27 0 2024-04-01T06:57:40.966 INFO:tasks.workunit.client.0.smithi083.stdout:1/811: mknod db/d61/c11d 0 2024-04-01T06:57:40.970 INFO:tasks.workunit.client.0.smithi083.stdout:3/789: dwrite d6/d15/d2d/fe9 [0,4194304] 0 2024-04-01T06:57:40.971 INFO:tasks.workunit.client.0.smithi083.stdout:1/812: rename db/d1c/d29/d33/d50/d5d/d6c/d8e/l9f to db/d1c/l11e 0 2024-04-01T06:57:40.973 INFO:tasks.workunit.client.0.smithi083.stdout:1/813: dread db/d1c/d29/d33/d50/d5d/d81/d94/fc4 [0,4194304] 0 2024-04-01T06:57:40.973 INFO:tasks.workunit.client.0.smithi083.stdout:1/814: chown db/d1c/d2e/d30/l69 4072 1 2024-04-01T06:57:40.975 INFO:tasks.workunit.client.0.smithi083.stdout:3/790: write d6/f21 [3248047,63435] 0 2024-04-01T06:57:40.975 INFO:tasks.workunit.client.0.smithi083.stdout:9/667: sync 2024-04-01T06:57:40.975 INFO:tasks.workunit.client.0.smithi083.stdout:0/826: sync 2024-04-01T06:57:40.977 INFO:tasks.workunit.client.0.smithi083.stdout:0/827: truncate d16/d1d/f8b 4276816 0 2024-04-01T06:57:40.978 INFO:tasks.workunit.client.0.smithi083.stdout:0/828: write d16/d99/d4b/d6e/fae [2139238,64158] 0 2024-04-01T06:57:40.979 INFO:tasks.workunit.client.0.smithi083.stdout:2/640: dwrite d3/d26/f36 [0,4194304] 0 2024-04-01T06:57:40.979 INFO:tasks.workunit.client.0.smithi083.stdout:9/668: write d6/d32/d3c/d4c/fae [61465,83114] 0 2024-04-01T06:57:40.980 INFO:tasks.workunit.client.0.smithi083.stdout:3/791: rename d6/f24 to d6/d15/d2d/d2f/d53/fff 0 2024-04-01T06:57:40.983 INFO:tasks.workunit.client.0.smithi083.stdout:0/829: write f12 [3966795,101508] 0 2024-04-01T06:57:40.983 INFO:tasks.workunit.client.0.smithi083.stdout:2/641: mknod d3/d71/d81/cd7 0 2024-04-01T06:57:40.986 INFO:tasks.workunit.client.0.smithi083.stdout:6/670: dwrite f8 [4194304,4194304] 0 2024-04-01T06:57:40.987 INFO:tasks.workunit.client.0.smithi083.stdout:9/669: unlink d6/d32/d3c/d4c/lc8 0 2024-04-01T06:57:40.989 INFO:tasks.workunit.client.0.smithi083.stdout:9/670: write d6/d32/d8f/faa [2722473,116029] 0 2024-04-01T06:57:40.989 INFO:tasks.workunit.client.0.smithi083.stdout:9/671: dread - d6/d32/d26/d2d/d34/fdf zero size 2024-04-01T06:57:40.990 INFO:tasks.workunit.client.0.smithi083.stdout:9/672: dread d6/d32/d26/d2d/d34/d6c/fb9 [0,4194304] 0 2024-04-01T06:57:40.992 INFO:tasks.workunit.client.0.smithi083.stdout:0/830: symlink d16/d99/d4b/l11f 0 2024-04-01T06:57:40.995 INFO:tasks.workunit.client.0.smithi083.stdout:1/815: dwrite db/f119 [0,4194304] 0 2024-04-01T06:57:40.996 INFO:tasks.workunit.client.0.smithi083.stdout:1/816: write db/d1c/d1d/f45 [13872300,94270] 0 2024-04-01T06:57:40.996 INFO:tasks.workunit.client.0.smithi083.stdout:1/817: write db/d1c/f2b [3351109,26693] 0 2024-04-01T06:57:40.996 INFO:tasks.workunit.client.0.smithi083.stdout:1/818: fsync db/d1c/d1d/d8b/f8c 0 2024-04-01T06:57:40.997 INFO:tasks.workunit.client.0.smithi083.stdout:3/792: dwrite d6/d15/f1a [0,4194304] 0 2024-04-01T06:57:40.998 INFO:tasks.workunit.client.0.smithi083.stdout:3/793: readlink d6/d15/d2d/d2f/d42/d5c/d88/l8b 0 2024-04-01T06:57:40.999 INFO:tasks.workunit.client.0.smithi083.stdout:9/673: truncate d6/d32/d3c/d4c/d6b/f5d 1266359 0 2024-04-01T06:57:40.999 INFO:tasks.workunit.client.0.smithi083.stdout:9/674: dread - d6/d29/fbf zero size 2024-04-01T06:57:40.999 INFO:tasks.workunit.client.0.smithi083.stdout:9/675: chown d6/d32/d3c/d4c 30744899 1 2024-04-01T06:57:41.000 INFO:tasks.workunit.client.0.smithi083.stdout:9/676: write d6/d32/f1b [999195,42785] 0 2024-04-01T06:57:41.000 INFO:tasks.workunit.client.0.smithi083.stdout:9/677: chown d6/d32/d26/d2d/d6e/c75 4264 1 2024-04-01T06:57:41.002 INFO:tasks.workunit.client.0.smithi083.stdout:6/671: rmdir d9/dc/d1b/d39/d47 39 2024-04-01T06:57:41.002 INFO:tasks.workunit.client.0.smithi083.stdout:6/672: dread - d9/d57/d5f/fd6 zero size 2024-04-01T06:57:41.002 INFO:tasks.workunit.client.0.smithi083.stdout:6/673: dread - d9/d8a/fcc zero size 2024-04-01T06:57:41.002 INFO:tasks.workunit.client.0.smithi083.stdout:6/674: readlink d9/d57/dbd/ldc 0 2024-04-01T06:57:41.002 INFO:tasks.workunit.client.0.smithi083.stdout:6/675: fsync d9/dc/d1b/d4c/d99/fc6 0 2024-04-01T06:57:41.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:40 smithi145 ceph-mon[47816]: pgmap v57: 97 pgs: 97 active+clean; 1.3 GiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 96 MiB/s rd, 188 MiB/s wr, 1.12k op/s 2024-04-01T06:57:41.003 INFO:tasks.workunit.client.0.smithi083.stdout:0/831: dwrite d16/d2e/d3d/d5d/f89 [4194304,4194304] 0 2024-04-01T06:57:41.005 INFO:tasks.workunit.client.0.smithi083.stdout:1/819: rename db/d1c/d2e/d30/d82/l11b to db/d1c/d29/d33/d50/l11f 0 2024-04-01T06:57:41.007 INFO:tasks.workunit.client.0.smithi083.stdout:3/794: unlink d6/d15/d2d/d2f/d42/d46/fcb 0 2024-04-01T06:57:41.007 INFO:tasks.workunit.client.0.smithi083.stdout:3/795: write d6/d15/d2d/d2f/d3e/f54 [4466460,33351] 0 2024-04-01T06:57:41.008 INFO:tasks.workunit.client.0.smithi083.stdout:0/832: mkdir d16/d99/dc2/d120 0 2024-04-01T06:57:41.009 INFO:tasks.workunit.client.0.smithi083.stdout:1/820: dread db/d1c/d2e/d30/f3a [0,4194304] 0 2024-04-01T06:57:41.011 INFO:tasks.workunit.client.0.smithi083.stdout:9/678: rename d6/d32/d26/d2d/d34/fdf to d6/d32/d26/d2d/d34/d6c/dc9/dd5/fec 0 2024-04-01T06:57:41.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:40 smithi083 ceph-mon[43429]: pgmap v57: 97 pgs: 97 active+clean; 1.3 GiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 96 MiB/s rd, 188 MiB/s wr, 1.12k op/s 2024-04-01T06:57:41.013 INFO:tasks.workunit.client.0.smithi083.stdout:3/796: creat d6/d15/d2d/d2f/d53/de5/df4/f100 x:0 0 0 2024-04-01T06:57:41.014 INFO:tasks.workunit.client.0.smithi083.stdout:3/797: stat d6/d15/d2d/d2f/d42/d46/dd2 0 2024-04-01T06:57:41.014 INFO:tasks.workunit.client.0.smithi083.stdout:1/821: creat db/d1c/d1d/db4/ddf/de9/f120 x:0 0 0 2024-04-01T06:57:41.015 INFO:tasks.workunit.client.0.smithi083.stdout:1/822: write db/d1c/d1d/f1f [939617,90443] 0 2024-04-01T06:57:41.016 INFO:tasks.workunit.client.0.smithi083.stdout:0/833: rename d16/d99/d4b/f5c to d16/d99/dc2/d11c/f121 0 2024-04-01T06:57:41.017 INFO:tasks.workunit.client.0.smithi083.stdout:9/679: creat d6/d32/d3c/d4c/d88/fed x:0 0 0 2024-04-01T06:57:41.017 INFO:tasks.workunit.client.0.smithi083.stdout:9/680: write d6/d32/d26/d2d/f18 [8673465,48816] 0 2024-04-01T06:57:41.018 INFO:tasks.workunit.client.0.smithi083.stdout:9/681: chown d6/d32/d3c/l47 11129 1 2024-04-01T06:57:41.020 INFO:tasks.workunit.client.0.smithi083.stdout:0/834: creat d16/d99/d4b/f122 x:0 0 0 2024-04-01T06:57:41.023 INFO:tasks.workunit.client.0.smithi083.stdout:3/798: rmdir d6/d15/d2d/d2f/dc7 39 2024-04-01T06:57:41.025 INFO:tasks.workunit.client.0.smithi083.stdout:9/682: mkdir d6/d32/d26/d2d/d34/d6c/dee 0 2024-04-01T06:57:41.026 INFO:tasks.workunit.client.0.smithi083.stdout:3/799: creat d6/d15/d2d/d2f/d3e/f101 x:0 0 0 2024-04-01T06:57:41.026 INFO:tasks.workunit.client.0.smithi083.stdout:1/823: dwrite db/d1c/f35 [0,4194304] 0 2024-04-01T06:57:41.036 INFO:tasks.workunit.client.0.smithi083.stdout:0/835: dwrite d16/d1d/d8d/fc4 [0,4194304] 0 2024-04-01T06:57:41.036 INFO:tasks.workunit.client.0.smithi083.stdout:0/836: truncate d16/d1d/d8d/fd7 740626 0 2024-04-01T06:57:41.041 INFO:tasks.workunit.client.0.smithi083.stdout:3/800: dwrite d6/d15/d2d/d2f/d42/d46/f58 [0,4194304] 0 2024-04-01T06:57:41.043 INFO:tasks.workunit.client.0.smithi083.stdout:7/586: sync 2024-04-01T06:57:41.043 INFO:tasks.workunit.client.0.smithi083.stdout:8/739: sync 2024-04-01T06:57:41.043 INFO:tasks.workunit.client.0.smithi083.stdout:0/837: dread d16/d1d/f2b [0,4194304] 0 2024-04-01T06:57:41.043 INFO:tasks.workunit.client.0.smithi083.stdout:7/587: fdatasync d0/d4/d9/d39/d67/d6d/d87/d83/d34/f6a 0 2024-04-01T06:57:41.043 INFO:tasks.workunit.client.0.smithi083.stdout:8/740: truncate d15/d18/d1e/de3/f106 978327 0 2024-04-01T06:57:41.043 INFO:tasks.workunit.client.0.smithi083.stdout:0/838: chown d16/d2e/d3d/dda/ldc 347443 1 2024-04-01T06:57:41.043 INFO:tasks.workunit.client.0.smithi083.stdout:0/839: write d16/d2e/d3d/dda/fe0 [222900,106583] 0 2024-04-01T06:57:41.046 INFO:tasks.workunit.client.0.smithi083.stdout:3/801: truncate d6/f28 4689615 0 2024-04-01T06:57:41.046 INFO:tasks.workunit.client.0.smithi083.stdout:8/741: symlink d15/d18/d19/d6c/l10c 0 2024-04-01T06:57:41.047 INFO:tasks.workunit.client.0.smithi083.stdout:8/742: write d15/d18/d19/d1d/f60 [2826338,73848] 0 2024-04-01T06:57:41.047 INFO:tasks.workunit.client.0.smithi083.stdout:0/840: unlink d16/d99/d4b/d6e/d96/f103 0 2024-04-01T06:57:41.047 INFO:tasks.workunit.client.0.smithi083.stdout:3/802: chown d6/d1e/d4a/dfd 224 1 2024-04-01T06:57:41.048 INFO:tasks.workunit.client.0.smithi083.stdout:3/803: truncate d6/d12/f8a 1584669 0 2024-04-01T06:57:41.048 INFO:tasks.workunit.client.0.smithi083.stdout:0/841: dread d16/d99/dc2/f101 [0,4194304] 0 2024-04-01T06:57:41.049 INFO:tasks.workunit.client.0.smithi083.stdout:1/824: dwrite db/d1c/d29/d33/d50/d5d/d6c/d8e/fd5 [0,4194304] 0 2024-04-01T06:57:41.049 INFO:tasks.workunit.client.0.smithi083.stdout:0/842: link f14 d16/d99/d4b/d68/d112/f123 0 2024-04-01T06:57:41.050 INFO:tasks.workunit.client.0.smithi083.stdout:0/843: stat d16/d99/d4b/d84/f10c 0 2024-04-01T06:57:41.053 INFO:tasks.workunit.client.0.smithi083.stdout:3/804: dread d6/d15/d2d/d2f/d42/d5c/fa1 [0,4194304] 0 2024-04-01T06:57:41.053 INFO:tasks.workunit.client.0.smithi083.stdout:1/825: mkdir db/d1c/d29/d33/d50/d121 0 2024-04-01T06:57:41.053 INFO:tasks.workunit.client.0.smithi083.stdout:3/805: getdents d6/d15/d2d/d2f/d3e/d74/df5 0 2024-04-01T06:57:41.053 INFO:tasks.workunit.client.0.smithi083.stdout:0/844: link d16/d99/dc2/f101 d16/d99/d4b/d68/d9d/f124 0 2024-04-01T06:57:41.056 INFO:tasks.workunit.client.0.smithi083.stdout:7/588: dread d0/d4/d9/d39/f70 [0,4194304] 0 2024-04-01T06:57:41.056 INFO:tasks.workunit.client.0.smithi083.stdout:1/826: creat db/d1c/d29/d33/d47/f122 x:0 0 0 2024-04-01T06:57:41.056 INFO:tasks.workunit.client.0.smithi083.stdout:1/827: write db/d1c/d29/d33/d50/d4d/fa4 [810999,85845] 0 2024-04-01T06:57:41.058 INFO:tasks.workunit.client.0.smithi083.stdout:3/806: mknod d6/d1e/d4a/dd0/dd8/c102 0 2024-04-01T06:57:41.058 INFO:tasks.workunit.client.0.smithi083.stdout:3/807: chown d6/d15/d2d/d2f/d42/d5c/c6e 27082357 1 2024-04-01T06:57:41.059 INFO:tasks.workunit.client.0.smithi083.stdout:7/589: getdents d0/d4/d9/d39/d67 0 2024-04-01T06:57:41.060 INFO:tasks.workunit.client.0.smithi083.stdout:1/828: creat db/d1c/d2e/f123 x:0 0 0 2024-04-01T06:57:41.060 INFO:tasks.workunit.client.0.smithi083.stdout:1/829: fsync db/d1c/d2e/d30/d82/f95 0 2024-04-01T06:57:41.061 INFO:tasks.workunit.client.0.smithi083.stdout:8/743: dwrite d15/d18/d19/d24/d38/d62/fc0 [0,4194304] 0 2024-04-01T06:57:41.062 INFO:tasks.workunit.client.0.smithi083.stdout:3/808: rename d6/d15/d2d/d2f/d42/f63 to d6/d15/d2d/d2f/d42/d46/d55/f103 0 2024-04-01T06:57:41.062 INFO:tasks.workunit.client.0.smithi083.stdout:3/809: write d6/d1e/f90 [1340525,8122] 0 2024-04-01T06:57:41.062 INFO:tasks.workunit.client.0.smithi083.stdout:1/830: creat db/d1c/d29/d33/d47/f124 x:0 0 0 2024-04-01T06:57:41.074 INFO:tasks.workunit.client.0.smithi083.stdout:7/590: rmdir d0 39 2024-04-01T06:57:41.077 INFO:tasks.workunit.client.0.smithi083.stdout:8/744: write d15/d21/f50 [645934,90616] 0 2024-04-01T06:57:41.078 INFO:tasks.workunit.client.0.smithi083.stdout:3/810: rename d6/d1e/d4a/dd0/dd8/c102 to d6/d1e/d4a/c104 0 2024-04-01T06:57:41.080 INFO:tasks.workunit.client.0.smithi083.stdout:1/831: mknod db/d1c/d29/d33/d50/d5d/c125 0 2024-04-01T06:57:41.082 INFO:tasks.workunit.client.0.smithi083.stdout:7/591: getdents d0/d4/dbd/db7 0 2024-04-01T06:57:41.083 INFO:tasks.workunit.client.0.smithi083.stdout:8/745: mkdir d15/d18/d19/d24/da2/da6/d10d 0 2024-04-01T06:57:41.085 INFO:tasks.workunit.client.0.smithi083.stdout:1/832: mkdir db/d1c/d29/d33/d50/d126 0 2024-04-01T06:57:41.086 INFO:tasks.workunit.client.0.smithi083.stdout:7/592: mknod d0/d4/ccf 0 2024-04-01T06:57:41.089 INFO:tasks.workunit.client.0.smithi083.stdout:3/811: dread d6/f40 [0,4194304] 0 2024-04-01T06:57:41.090 INFO:tasks.workunit.client.0.smithi083.stdout:1/833: link db/d1c/d2e/d30/fc7 db/d1c/d1d/db4/ddf/f127 0 2024-04-01T06:57:41.091 INFO:tasks.workunit.client.0.smithi083.stdout:7/593: mkdir d0/d4/dbd/dd0 0 2024-04-01T06:57:41.091 INFO:tasks.workunit.client.0.smithi083.stdout:8/746: creat d15/d21/dbc/f10e x:0 0 0 2024-04-01T06:57:41.093 INFO:tasks.workunit.client.0.smithi083.stdout:3/812: unlink d6/d15/d2d/d2f/d42/d46/d55/fd7 0 2024-04-01T06:57:41.094 INFO:tasks.workunit.client.0.smithi083.stdout:7/594: symlink d0/d4/d9/d39/d67/dc0/ld1 0 2024-04-01T06:57:41.094 INFO:tasks.workunit.client.0.smithi083.stdout:3/813: write d6/d1e/d6f/daf/fd3 [2443652,115190] 0 2024-04-01T06:57:41.094 INFO:tasks.workunit.client.0.smithi083.stdout:3/814: chown d6/d15/d2d/d2f/d42/d5c/d88 37330597 1 2024-04-01T06:57:41.095 INFO:tasks.workunit.client.0.smithi083.stdout:8/747: creat d15/d1b/d39/d80/f10f x:0 0 0 2024-04-01T06:57:41.099 INFO:tasks.workunit.client.0.smithi083.stdout:8/748: dread d15/d18/d19/f5d [0,4194304] 0 2024-04-01T06:57:41.099 INFO:tasks.workunit.client.0.smithi083.stdout:7/595: symlink d0/d4/d9/d39/d67/ld2 0 2024-04-01T06:57:41.101 INFO:tasks.workunit.client.0.smithi083.stdout:3/815: truncate d6/d15/d2d/d2f/d42/d46/f58 3663056 0 2024-04-01T06:57:41.102 INFO:tasks.workunit.client.0.smithi083.stdout:8/749: dread f14 [0,4194304] 0 2024-04-01T06:57:41.117 INFO:tasks.workunit.client.0.smithi083.stdout:7/596: dwrite d0/f3 [4194304,4194304] 0 2024-04-01T06:57:41.119 INFO:tasks.workunit.client.0.smithi083.stdout:8/750: dwrite d15/d18/d1e/f5b [4194304,4194304] 0 2024-04-01T06:57:41.121 INFO:tasks.workunit.client.0.smithi083.stdout:8/751: rename d15/d18/d1e/f1f to d15/d18/d19/d24/d44/f110 0 2024-04-01T06:57:41.128 INFO:tasks.workunit.client.0.smithi083.stdout:4/608: sync 2024-04-01T06:57:41.128 INFO:tasks.workunit.client.0.smithi083.stdout:5/540: sync 2024-04-01T06:57:41.128 INFO:tasks.workunit.client.0.smithi083.stdout:4/609: chown d1/d4/da/d88/l9a 33537 1 2024-04-01T06:57:41.128 INFO:tasks.workunit.client.0.smithi083.stdout:4/610: chown d1/d4/db/d5b/c77 131 1 2024-04-01T06:57:41.129 INFO:tasks.workunit.client.0.smithi083.stdout:5/541: write d4/d23/d4e/f57 [1772723,65603] 0 2024-04-01T06:57:41.129 INFO:tasks.workunit.client.0.smithi083.stdout:5/542: chown d4/d2b 196 1 2024-04-01T06:57:41.129 INFO:tasks.workunit.client.0.smithi083.stdout:8/752: dread d15/d1b/d39/d48/f68 [0,4194304] 0 2024-04-01T06:57:41.129 INFO:tasks.workunit.client.0.smithi083.stdout:8/753: chown d15/d18/d19/d24/d44/d97/dde 12881025 1 2024-04-01T06:57:41.129 INFO:tasks.workunit.client.0.smithi083.stdout:8/754: chown d15/d18/d19/d24/da2/da6/de2/lf6 32841 1 2024-04-01T06:57:41.130 INFO:tasks.workunit.client.0.smithi083.stdout:5/543: creat d4/fb7 x:0 0 0 2024-04-01T06:57:41.131 INFO:tasks.workunit.client.0.smithi083.stdout:8/755: link d15/d1b/d39/cd0 d15/d1b/d39/d48/c111 0 2024-04-01T06:57:41.131 INFO:tasks.workunit.client.0.smithi083.stdout:5/544: symlink d4/d9/lb8 0 2024-04-01T06:57:41.132 INFO:tasks.workunit.client.0.smithi083.stdout:5/545: creat d4/d9/fb9 x:0 0 0 2024-04-01T06:57:41.133 INFO:tasks.workunit.client.0.smithi083.stdout:5/546: symlink d4/d55/lba 0 2024-04-01T06:57:41.135 INFO:tasks.workunit.client.0.smithi083.stdout:4/611: dread d1/d4/da/fc1 [0,4194304] 0 2024-04-01T06:57:41.135 INFO:tasks.workunit.client.0.smithi083.stdout:4/612: fsync d1/d4/f4c 0 2024-04-01T06:57:41.135 INFO:tasks.workunit.client.0.smithi083.stdout:4/613: dread - d1/d47/d2a/f80 zero size 2024-04-01T06:57:41.137 INFO:tasks.workunit.client.0.smithi083.stdout:4/614: getdents d1/d4/da 0 2024-04-01T06:57:41.138 INFO:tasks.workunit.client.0.smithi083.stdout:4/615: mkdir d1/d47/da1/db4/dbc/dc2 0 2024-04-01T06:57:41.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:40 smithi153 ceph-mon[48187]: pgmap v57: 97 pgs: 97 active+clean; 1.3 GiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 96 MiB/s rd, 188 MiB/s wr, 1.12k op/s 2024-04-01T06:57:41.146 INFO:tasks.workunit.client.0.smithi083.stdout:8/756: dwrite d15/d1b/d39/d48/d5e/d70/f86 [0,4194304] 0 2024-04-01T06:57:41.146 INFO:tasks.workunit.client.0.smithi083.stdout:8/757: stat d15/f3c 0 2024-04-01T06:57:41.146 INFO:tasks.workunit.client.0.smithi083.stdout:8/758: write d15/fc9 [255130,91290] 0 2024-04-01T06:57:41.151 INFO:tasks.workunit.client.0.smithi083.stdout:4/616: dwrite d1/d4/f25 [4194304,4194304] 0 2024-04-01T06:57:41.151 INFO:tasks.workunit.client.0.smithi083.stdout:4/617: fsync d1/d4/db/d94/fa7 0 2024-04-01T06:57:41.152 INFO:tasks.workunit.client.0.smithi083.stdout:4/618: creat d1/d4/db8/fc3 x:0 0 0 2024-04-01T06:57:41.152 INFO:tasks.workunit.client.0.smithi083.stdout:8/759: dread d15/d18/f64 [4194304,4194304] 0 2024-04-01T06:57:41.152 INFO:tasks.workunit.client.0.smithi083.stdout:4/619: symlink d1/d47/d2a/db5/lc4 0 2024-04-01T06:57:41.153 INFO:tasks.workunit.client.0.smithi083.stdout:8/760: symlink d15/d1b/d39/d80/l112 0 2024-04-01T06:57:41.154 INFO:tasks.workunit.client.0.smithi083.stdout:4/620: rmdir d1/d4/db/dc0 0 2024-04-01T06:57:41.155 INFO:tasks.workunit.client.0.smithi083.stdout:8/761: mknod d15/d1b/d39/d48/d5e/c113 0 2024-04-01T06:57:41.156 INFO:tasks.workunit.client.0.smithi083.stdout:4/621: creat d1/d47/fc5 x:0 0 0 2024-04-01T06:57:41.156 INFO:tasks.workunit.client.0.smithi083.stdout:8/762: mkdir d15/d18/d19/d24/da2/d6f/d114 0 2024-04-01T06:57:41.158 INFO:tasks.workunit.client.0.smithi083.stdout:4/622: rename d1/d47/da1/f61 to d1/d8/d6a/fc6 0 2024-04-01T06:57:41.158 INFO:tasks.workunit.client.0.smithi083.stdout:8/763: symlink d15/d18/d19/d24/da2/d6f/l115 0 2024-04-01T06:57:41.159 INFO:tasks.workunit.client.0.smithi083.stdout:4/623: link d1/d47/d2a/l55 d1/d4/d33/lc7 0 2024-04-01T06:57:41.160 INFO:tasks.workunit.client.0.smithi083.stdout:8/764: mknod d15/d18/d19/d24/d38/d62/df4/c116 0 2024-04-01T06:57:41.161 INFO:tasks.workunit.client.0.smithi083.stdout:4/624: write d1/d4/da/f29 [506841,33521] 0 2024-04-01T06:57:41.162 INFO:tasks.workunit.client.0.smithi083.stdout:8/765: rename d15/d18/d19/d24/d38/de7/lb6 to d15/d18/d19/d24/d38/d62/df4/l117 0 2024-04-01T06:57:41.162 INFO:tasks.workunit.client.0.smithi083.stdout:8/766: chown d15/d18/d19/d24/ld6 4581972 1 2024-04-01T06:57:41.162 INFO:tasks.workunit.client.0.smithi083.stdout:8/767: mkdir d15/d18/d19/d24/da2/da6/d118 0 2024-04-01T06:57:41.164 INFO:tasks.workunit.client.0.smithi083.stdout:8/768: mkdir d15/d18/d19/d119 0 2024-04-01T06:57:41.164 INFO:tasks.workunit.client.0.smithi083.stdout:8/769: fsync d15/d18/d1e/de3/f106 0 2024-04-01T06:57:41.165 INFO:tasks.workunit.client.0.smithi083.stdout:8/770: creat d15/d18/d19/d1d/f11a x:0 0 0 2024-04-01T06:57:41.165 INFO:tasks.workunit.client.0.smithi083.stdout:8/771: symlink d15/d18/d19/d6c/l11b 0 2024-04-01T06:57:41.165 INFO:tasks.workunit.client.0.smithi083.stdout:8/772: truncate d15/fd3 1975436 0 2024-04-01T06:57:41.171 INFO:tasks.workunit.client.0.smithi083.stdout:4/625: dread d1/d47/da1/f46 [0,4194304] 0 2024-04-01T06:57:41.173 INFO:tasks.workunit.client.0.smithi083.stdout:4/626: symlink d1/d8/lc8 0 2024-04-01T06:57:41.174 INFO:tasks.workunit.client.0.smithi083.stdout:4/627: symlink d1/d4/db/d94/lc9 0 2024-04-01T06:57:41.175 INFO:tasks.workunit.client.0.smithi083.stdout:4/628: write d1/d8/d6a/f7f [191452,123695] 0 2024-04-01T06:57:41.176 INFO:tasks.workunit.client.0.smithi083.stdout:4/629: truncate d1/d4/d33/f50 782589 0 2024-04-01T06:57:41.176 INFO:tasks.workunit.client.0.smithi083.stdout:4/630: truncate d1/d47/da1/f9c 169341 0 2024-04-01T06:57:41.176 INFO:tasks.workunit.client.0.smithi083.stdout:4/631: write d1/d4/da/d88/f99 [506047,19839] 0 2024-04-01T06:57:41.176 INFO:tasks.workunit.client.0.smithi083.stdout:4/632: chown d1/d4/db/f56 2 1 2024-04-01T06:57:41.176 INFO:tasks.workunit.client.0.smithi083.stdout:4/633: chown d1/d4/db/d5b/l82 868512 1 2024-04-01T06:57:41.177 INFO:tasks.workunit.client.0.smithi083.stdout:4/634: write d1/d4/db/d5b/f5f [1922139,66307] 0 2024-04-01T06:57:41.178 INFO:tasks.workunit.client.0.smithi083.stdout:4/635: dread d1/d4/da/f39 [0,4194304] 0 2024-04-01T06:57:41.179 INFO:tasks.workunit.client.0.smithi083.stdout:8/773: dwrite d15/d18/d19/d24/d38/d62/fc0 [0,4194304] 0 2024-04-01T06:57:41.179 INFO:tasks.workunit.client.0.smithi083.stdout:8/774: readlink d15/d18/d19/d24/d38/d62/df4/lfe 0 2024-04-01T06:57:41.181 INFO:tasks.workunit.client.0.smithi083.stdout:8/775: truncate d15/d18/d1e/fe8 575301 0 2024-04-01T06:57:41.181 INFO:tasks.workunit.client.0.smithi083.stdout:8/776: truncate d15/d18/d19/d1d/fbe 1053967 0 2024-04-01T06:57:41.198 INFO:tasks.workunit.client.0.smithi083.stdout:8/777: rename d15/d18/d19/d24 to d15/d1b/d39/d48/d5e/d70/d11c 0 2024-04-01T06:57:41.199 INFO:tasks.workunit.client.0.smithi083.stdout:8/778: creat d15/d1b/d39/d48/d5e/d70/d11c/d44/f11d x:0 0 0 2024-04-01T06:57:41.217 INFO:tasks.workunit.client.0.smithi083.stdout:8/779: dwrite d15/d18/d19/d1d/f2d [0,4194304] 0 2024-04-01T06:57:41.219 INFO:tasks.workunit.client.0.smithi083.stdout:8/780: link d15/d1b/d39/d48/d5e/ff5 d15/d1b/d39/d48/d5e/d70/d11c/d44/d97/f11e 0 2024-04-01T06:57:41.220 INFO:tasks.workunit.client.0.smithi083.stdout:8/781: write d15/faa [2532148,111784] 0 2024-04-01T06:57:41.220 INFO:tasks.workunit.client.0.smithi083.stdout:8/782: chown d15/d1b/d39/d48/d5e/d70/d11c/d38/d62/df4 1 1 2024-04-01T06:57:41.222 INFO:tasks.workunit.client.0.smithi083.stdout:8/783: unlink d15/d1b/d39/d48/d5e/d70/d11c/d44/f88 0 2024-04-01T06:57:41.222 INFO:tasks.workunit.client.0.smithi083.stdout:8/784: readlink d15/d1b/d39/d48/d5e/d70/d11c/d38/de7/lb3 0 2024-04-01T06:57:41.222 INFO:tasks.workunit.client.0.smithi083.stdout:8/785: stat d15/f7b 0 2024-04-01T06:57:41.222 INFO:tasks.workunit.client.0.smithi083.stdout:8/786: write d15/f35 [1997904,9871] 0 2024-04-01T06:57:41.224 INFO:tasks.workunit.client.0.smithi083.stdout:8/787: dread d15/fc9 [0,4194304] 0 2024-04-01T06:57:41.224 INFO:tasks.workunit.client.0.smithi083.stdout:8/788: write d15/d1b/d39/d48/d5e/d70/d11c/ff9 [468165,113738] 0 2024-04-01T06:57:41.224 INFO:tasks.workunit.client.0.smithi083.stdout:8/789: write d15/d18/d1e/f9d [816133,303] 0 2024-04-01T06:57:41.225 INFO:tasks.workunit.client.0.smithi083.stdout:8/790: fsync d15/d18/fbf 0 2024-04-01T06:57:41.233 INFO:tasks.workunit.client.0.smithi083.stdout:6/676: sync 2024-04-01T06:57:41.234 INFO:tasks.workunit.client.0.smithi083.stdout:9/683: sync 2024-04-01T06:57:41.234 INFO:tasks.workunit.client.0.smithi083.stdout:2/642: sync 2024-04-01T06:57:41.237 INFO:tasks.workunit.client.0.smithi083.stdout:2/643: chown d3/d26/d59/c35 9 1 2024-04-01T06:57:41.238 INFO:tasks.workunit.client.0.smithi083.stdout:6/677: creat d9/dc/d3b/fe4 x:0 0 0 2024-04-01T06:57:41.238 INFO:tasks.workunit.client.0.smithi083.stdout:2/644: creat d3/d71/d90/db6/dcd/fd8 x:0 0 0 2024-04-01T06:57:41.238 INFO:tasks.workunit.client.0.smithi083.stdout:6/678: creat d9/d57/fe5 x:0 0 0 2024-04-01T06:57:41.238 INFO:tasks.workunit.client.0.smithi083.stdout:6/679: dread - d9/dc/d1b/d35/d48/d52/d9c/da9/fbe zero size 2024-04-01T06:57:41.238 INFO:tasks.workunit.client.0.smithi083.stdout:6/680: link d9/dc/d29/d3c/d5c/d8b/fa4 d9/dc/d1b/d35/d48/d52/d9c/dab/fe6 0 2024-04-01T06:57:41.240 INFO:tasks.workunit.client.0.smithi083.stdout:6/681: rename d9/d57/lcd to d9/dc/d1b/d35/d48/d52/le7 0 2024-04-01T06:57:41.241 INFO:tasks.workunit.client.0.smithi083.stdout:6/682: mkdir d9/dc/d1b/d39/d68/de8 0 2024-04-01T06:57:41.244 INFO:tasks.workunit.client.0.smithi083.stdout:2/645: getdents d3/d71/d90/db6/dcd 0 2024-04-01T06:57:41.245 INFO:tasks.workunit.client.0.smithi083.stdout:9/684: dwrite d6/d29/fbf [0,4194304] 0 2024-04-01T06:57:41.247 INFO:tasks.workunit.client.0.smithi083.stdout:9/685: symlink d6/d32/d26/da9/lef 0 2024-04-01T06:57:41.263 INFO:tasks.workunit.client.0.smithi083.stdout:2/646: dwrite d3/d4d/f86 [0,4194304] 0 2024-04-01T06:57:41.264 INFO:tasks.workunit.client.0.smithi083.stdout:9/686: dwrite d6/d32/d26/d2d/f1f [0,4194304] 0 2024-04-01T06:57:41.266 INFO:tasks.workunit.client.0.smithi083.stdout:9/687: dread d6/d32/fce [0,4194304] 0 2024-04-01T06:57:41.266 INFO:tasks.workunit.client.0.smithi083.stdout:2/647: link d3/d26/d59/d2b/f39 d3/d26/d59/d2b/da3/fd9 0 2024-04-01T06:57:41.267 INFO:tasks.workunit.client.0.smithi083.stdout:2/648: write d3/d26/d59/d2b/f40 [3845715,83745] 0 2024-04-01T06:57:41.269 INFO:tasks.workunit.client.0.smithi083.stdout:9/688: truncate d6/d32/d8f/faa 3692490 0 2024-04-01T06:57:41.270 INFO:tasks.workunit.client.0.smithi083.stdout:9/689: write d6/d32/d3c/f6f [700115,127118] 0 2024-04-01T06:57:41.272 INFO:tasks.workunit.client.0.smithi083.stdout:2/649: creat d3/d4d/d57/fda x:0 0 0 2024-04-01T06:57:41.272 INFO:tasks.workunit.client.0.smithi083.stdout:2/650: readlink d3/d8b/d53/d66/lb4 0 2024-04-01T06:57:41.273 INFO:tasks.workunit.client.0.smithi083.stdout:9/690: mkdir d6/d32/d3c/d4c/d88/df0 0 2024-04-01T06:57:41.273 INFO:tasks.workunit.client.0.smithi083.stdout:9/691: stat d6/d32/d3c/d4c/d6b/f65 0 2024-04-01T06:57:41.274 INFO:tasks.workunit.client.0.smithi083.stdout:9/692: dread - d6/d32/d26/d2d/d34/dc3/fd7 zero size 2024-04-01T06:57:41.274 INFO:tasks.workunit.client.0.smithi083.stdout:9/693: truncate d6/d32/d26/f9a 313215 0 2024-04-01T06:57:41.274 INFO:tasks.workunit.client.0.smithi083.stdout:2/651: mkdir d3/d71/d90/ddb 0 2024-04-01T06:57:41.275 INFO:tasks.workunit.client.0.smithi083.stdout:9/694: truncate d6/d32/d26/d2d/d34/f3b 3294014 0 2024-04-01T06:57:41.277 INFO:tasks.workunit.client.0.smithi083.stdout:2/652: creat d3/d8b/d53/d66/dc1/fdc x:0 0 0 2024-04-01T06:57:41.278 INFO:tasks.workunit.client.0.smithi083.stdout:9/695: symlink d6/d32/d3c/lf1 0 2024-04-01T06:57:41.280 INFO:tasks.workunit.client.0.smithi083.stdout:9/696: rename d6/d32/d8f/d6d/f89 to d6/d32/d3c/d3d/d9d/ff2 0 2024-04-01T06:57:41.281 INFO:tasks.workunit.client.0.smithi083.stdout:9/697: stat d6/d32/c7d 0 2024-04-01T06:57:41.288 INFO:tasks.workunit.client.0.smithi083.stdout:1/834: sync 2024-04-01T06:57:41.288 INFO:tasks.workunit.client.0.smithi083.stdout:0/845: sync 2024-04-01T06:57:41.289 INFO:tasks.workunit.client.0.smithi083.stdout:0/846: truncate d16/d1d/f25 5736838 0 2024-04-01T06:57:41.293 INFO:tasks.workunit.client.0.smithi083.stdout:9/698: dwrite d6/d32/d26/d2d/d34/d6c/dc9/dd5/fde [0,4194304] 0 2024-04-01T06:57:41.294 INFO:tasks.workunit.client.0.smithi083.stdout:2/653: dwrite d3/f7 [4194304,4194304] 0 2024-04-01T06:57:41.295 INFO:tasks.workunit.client.0.smithi083.stdout:2/654: stat d3/d26 0 2024-04-01T06:57:41.295 INFO:tasks.workunit.client.0.smithi083.stdout:2/655: chown d3/d8b 4 1 2024-04-01T06:57:41.295 INFO:tasks.workunit.client.0.smithi083.stdout:2/656: dread - d3/d26/d59/d2b/f73 zero size 2024-04-01T06:57:41.295 INFO:tasks.workunit.client.0.smithi083.stdout:2/657: readlink d3/l38 0 2024-04-01T06:57:41.295 INFO:tasks.workunit.client.0.smithi083.stdout:9/699: write d6/d32/d8f/fb4 [3051937,23232] 0 2024-04-01T06:57:41.295 INFO:tasks.workunit.client.0.smithi083.stdout:9/700: read d6/d32/d3c/f6f [900090,66997] 0 2024-04-01T06:57:41.295 INFO:tasks.workunit.client.0.smithi083.stdout:9/701: read - d6/d32/d26/d2d/d6e/fa7 zero size 2024-04-01T06:57:41.296 INFO:tasks.workunit.client.0.smithi083.stdout:2/658: mkdir d3/d8b/d53/d68/dae/ddd 0 2024-04-01T06:57:41.297 INFO:tasks.workunit.client.0.smithi083.stdout:9/702: mkdir d6/d32/d3c/d4c/d6b/df3 0 2024-04-01T06:57:41.297 INFO:tasks.workunit.client.0.smithi083.stdout:9/703: fsync d6/d32/d8f/d6d/fe8 0 2024-04-01T06:57:41.298 INFO:tasks.workunit.client.0.smithi083.stdout:2/659: unlink d3/d8b/fd0 0 2024-04-01T06:57:41.300 INFO:tasks.workunit.client.0.smithi083.stdout:2/660: dread d3/d20/f2a [0,4194304] 0 2024-04-01T06:57:41.301 INFO:tasks.workunit.client.0.smithi083.stdout:2/661: unlink d3/f19 0 2024-04-01T06:57:41.303 INFO:tasks.workunit.client.0.smithi083.stdout:2/662: unlink d3/d20/d42/fab 0 2024-04-01T06:57:41.304 INFO:tasks.workunit.client.0.smithi083.stdout:2/663: unlink d3/d71/d90/cbc 0 2024-04-01T06:57:41.310 INFO:tasks.workunit.client.0.smithi083.stdout:9/704: dwrite d6/d32/d3c/d4c/d6b/dd3/fdc [0,4194304] 0 2024-04-01T06:57:41.310 INFO:tasks.workunit.client.0.smithi083.stdout:9/705: readlink d6/d32/d26/lbe 0 2024-04-01T06:57:41.315 INFO:tasks.workunit.client.0.smithi083.stdout:2/664: dwrite d3/d8b/d53/d68/f5c [0,4194304] 0 2024-04-01T06:57:41.317 INFO:tasks.workunit.client.0.smithi083.stdout:2/665: link d3/d8b/d53/fcb d3/d8b/d53/d68/dae/ddd/fde 0 2024-04-01T06:57:41.326 INFO:tasks.workunit.client.0.smithi083.stdout:2/666: dread d3/d26/d59/d27/fb7 [0,4194304] 0 2024-04-01T06:57:41.326 INFO:tasks.workunit.client.0.smithi083.stdout:2/667: dread - d3/fbf zero size 2024-04-01T06:57:41.328 INFO:tasks.workunit.client.0.smithi083.stdout:2/668: creat d3/d26/d59/d2b/d9f/dba/fdf x:0 0 0 2024-04-01T06:57:41.328 INFO:tasks.workunit.client.0.smithi083.stdout:2/669: fdatasync d3/d26/d59/f31 0 2024-04-01T06:57:41.328 INFO:tasks.workunit.client.0.smithi083.stdout:2/670: readlink d3/d26/d59/d2b/l67 0 2024-04-01T06:57:41.328 INFO:tasks.workunit.client.0.smithi083.stdout:2/671: creat d3/d26/fe0 x:0 0 0 2024-04-01T06:57:41.331 INFO:tasks.workunit.client.0.smithi083.stdout:9/706: dwrite d6/d32/d3c/d4c/fae [0,4194304] 0 2024-04-01T06:57:41.338 INFO:tasks.workunit.client.0.smithi083.stdout:3/816: sync 2024-04-01T06:57:41.338 INFO:tasks.workunit.client.0.smithi083.stdout:9/707: truncate d6/d32/d26/f9a 272367 0 2024-04-01T06:57:41.339 INFO:tasks.workunit.client.0.smithi083.stdout:7/597: sync 2024-04-01T06:57:41.341 INFO:tasks.workunit.client.0.smithi083.stdout:3/817: dread d6/d15/d2d/d2f/d42/d5c/d88/fc4 [0,4194304] 0 2024-04-01T06:57:41.341 INFO:tasks.workunit.client.0.smithi083.stdout:3/818: fsync d6/d15/d2d/d2f/d3e/d74/f9c 0 2024-04-01T06:57:41.341 INFO:tasks.workunit.client.0.smithi083.stdout:3/819: fdatasync d6/d15/d2d/d2f/d53/fbc 0 2024-04-01T06:57:41.341 INFO:tasks.workunit.client.0.smithi083.stdout:3/820: write d6/d15/d2d/d2f/d42/d5c/d88/fe3 [554223,88603] 0 2024-04-01T06:57:41.341 INFO:tasks.workunit.client.0.smithi083.stdout:7/598: rename d0/d4/d9/d39/c63 to d0/d4/dbd/dd0/cd3 0 2024-04-01T06:57:41.343 INFO:tasks.workunit.client.0.smithi083.stdout:3/821: creat d6/d15/d2d/d2f/d42/d83/f105 x:0 0 0 2024-04-01T06:57:41.344 INFO:tasks.workunit.client.0.smithi083.stdout:3/822: write d6/d15/d2d/d2f/d42/d5c/f72 [194790,10883] 0 2024-04-01T06:57:41.345 INFO:tasks.workunit.client.0.smithi083.stdout:2/672: dwrite d3/d26/f3a [0,4194304] 0 2024-04-01T06:57:41.346 INFO:tasks.workunit.client.0.smithi083.stdout:2/673: truncate d3/d4d/d5d/fb0 1423756 0 2024-04-01T06:57:41.346 INFO:tasks.workunit.client.0.smithi083.stdout:7/599: rename d0/d4/d9/l51 to d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/db8/ld4 0 2024-04-01T06:57:41.346 INFO:tasks.workunit.client.0.smithi083.stdout:7/600: write d0/d4/fc5 [339010,3221] 0 2024-04-01T06:57:41.348 INFO:tasks.workunit.client.0.smithi083.stdout:3/823: creat d6/d15/d2d/d2f/d42/d46/dd2/ded/f106 x:0 0 0 2024-04-01T06:57:41.349 INFO:tasks.workunit.client.0.smithi083.stdout:2/674: mkdir d3/de1 0 2024-04-01T06:57:41.353 INFO:tasks.workunit.client.0.smithi083.stdout:7/601: unlink d0/f4a 0 2024-04-01T06:57:41.356 INFO:tasks.workunit.client.0.smithi083.stdout:7/602: write d0/d4/d9/d39/d67/d6d/d87/d83/f2d [4230782,129030] 0 2024-04-01T06:57:41.356 INFO:tasks.workunit.client.0.smithi083.stdout:7/603: chown d0/d4/d9/f22 74725 1 2024-04-01T06:57:41.357 INFO:tasks.workunit.client.0.smithi083.stdout:3/824: getdents d6/d15/d2d/d2f/d53/de5 0 2024-04-01T06:57:41.359 INFO:tasks.workunit.client.0.smithi083.stdout:9/708: dwrite d6/d32/d8f/fb4 [0,4194304] 0 2024-04-01T06:57:41.359 INFO:tasks.workunit.client.0.smithi083.stdout:2/675: dwrite d3/d26/d59/d27/f7e [0,4194304] 0 2024-04-01T06:57:41.360 INFO:tasks.workunit.client.0.smithi083.stdout:3/825: symlink d6/d15/d2d/d2f/d42/d5c/d88/l107 0 2024-04-01T06:57:41.360 INFO:tasks.workunit.client.0.smithi083.stdout:3/826: fsync d6/d15/d2d/d2f/d42/d46/f5e 0 2024-04-01T06:57:41.360 INFO:tasks.workunit.client.0.smithi083.stdout:3/827: chown d6/d15/d2d/d2f/dc7/lf1 0 1 2024-04-01T06:57:41.360 INFO:tasks.workunit.client.0.smithi083.stdout:3/828: stat d6/d15/d2d/d2f/d42 0 2024-04-01T06:57:41.360 INFO:tasks.workunit.client.0.smithi083.stdout:3/829: write d6/d15/d2d/d2f/d42/d46/d55/fb2 [2986697,3357] 0 2024-04-01T06:57:41.361 INFO:tasks.workunit.client.0.smithi083.stdout:2/676: creat d3/d8b/d53/d68/fe2 x:0 0 0 2024-04-01T06:57:41.363 INFO:tasks.workunit.client.0.smithi083.stdout:2/677: mknod d3/d8b/d53/d68/dae/ddd/ce3 0 2024-04-01T06:57:41.365 INFO:tasks.workunit.client.0.smithi083.stdout:2/678: getdents d3/d26/d59/d2b 0 2024-04-01T06:57:41.365 INFO:tasks.workunit.client.0.smithi083.stdout:2/679: stat d3/d71/d90/db6/dcd/fd8 0 2024-04-01T06:57:41.365 INFO:tasks.workunit.client.0.smithi083.stdout:2/680: dread - d3/d8b/d53/d66/dc1/fdc zero size 2024-04-01T06:57:41.365 INFO:tasks.workunit.client.0.smithi083.stdout:2/681: write d3/d20/f84 [583901,126628] 0 2024-04-01T06:57:41.365 INFO:tasks.workunit.client.0.smithi083.stdout:2/682: dread - d3/d8b/d53/d68/fe2 zero size 2024-04-01T06:57:41.365 INFO:tasks.workunit.client.0.smithi083.stdout:2/683: write d3/d26/f36 [291462,114198] 0 2024-04-01T06:57:41.366 INFO:tasks.workunit.client.0.smithi083.stdout:2/684: dread - d3/d26/d59/d27/f96 zero size 2024-04-01T06:57:41.367 INFO:tasks.workunit.client.0.smithi083.stdout:2/685: truncate d3/d26/d59/d2b/f77 113412 0 2024-04-01T06:57:41.369 INFO:tasks.workunit.client.0.smithi083.stdout:2/686: dread d3/d4d/f92 [0,4194304] 0 2024-04-01T06:57:41.369 INFO:tasks.workunit.client.0.smithi083.stdout:2/687: chown d3/d8b/f64 100043 1 2024-04-01T06:57:41.372 INFO:tasks.workunit.client.0.smithi083.stdout:9/709: dwrite d6/d32/d26/d2d/d34/dc3/fd7 [0,4194304] 0 2024-04-01T06:57:41.375 INFO:tasks.workunit.client.0.smithi083.stdout:9/710: symlink d6/d32/d8f/lf4 0 2024-04-01T06:57:41.376 INFO:tasks.workunit.client.0.smithi083.stdout:9/711: dread d6/d32/d26/f96 [0,4194304] 0 2024-04-01T06:57:41.378 INFO:tasks.workunit.client.0.smithi083.stdout:9/712: truncate d6/f2f 1380172 0 2024-04-01T06:57:41.379 INFO:tasks.workunit.client.0.smithi083.stdout:9/713: read d6/f7 [4356620,42040] 0 2024-04-01T06:57:41.379 INFO:tasks.workunit.client.0.smithi083.stdout:9/714: write d6/d32/d8f/d6d/daf/fb2 [67254,93119] 0 2024-04-01T06:57:41.379 INFO:tasks.workunit.client.0.smithi083.stdout:9/715: fsync d6/d32/d8f/d6d/f82 0 2024-04-01T06:57:41.381 INFO:tasks.workunit.client.0.smithi083.stdout:9/716: rename d6/d32/d26/d2d/c10 to d6/d32/d3c/d3d/d9d/cf5 0 2024-04-01T06:57:41.382 INFO:tasks.workunit.client.0.smithi083.stdout:9/717: mkdir d6/d32/d3c/d4c/d6b/dd3/df6 0 2024-04-01T06:57:41.382 INFO:tasks.workunit.client.0.smithi083.stdout:9/718: write d6/d32/d3c/f6f [4833544,37376] 0 2024-04-01T06:57:41.383 INFO:tasks.workunit.client.0.smithi083.stdout:3/830: dwrite d6/d1e/f2b [0,4194304] 0 2024-04-01T06:57:41.384 INFO:tasks.workunit.client.0.smithi083.stdout:3/831: mknod d6/d15/d2d/d2f/d53/c108 0 2024-04-01T06:57:41.385 INFO:tasks.workunit.client.0.smithi083.stdout:2/688: dwrite d3/d26/d59/d2b/f39 [0,4194304] 0 2024-04-01T06:57:41.387 INFO:tasks.workunit.client.0.smithi083.stdout:2/689: link d3/f43 d3/d4d/d57/fe4 0 2024-04-01T06:57:41.388 INFO:tasks.workunit.client.0.smithi083.stdout:2/690: rename d3/d71/d90/f94 to d3/d8b/d53/d66/dc1/fe5 0 2024-04-01T06:57:41.401 INFO:tasks.workunit.client.0.smithi083.stdout:9/719: dwrite d6/f14 [0,4194304] 0 2024-04-01T06:57:41.402 INFO:tasks.workunit.client.0.smithi083.stdout:9/720: dread - d6/d32/d26/d2d/d34/dc6/fc7 zero size 2024-04-01T06:57:41.402 INFO:tasks.workunit.client.0.smithi083.stdout:9/721: mknod d6/d32/d26/d2d/d34/d6c/dc9/cf7 0 2024-04-01T06:57:41.408 INFO:tasks.workunit.client.0.smithi083.stdout:2/691: dwrite d3/d8b/d53/f97 [0,4194304] 0 2024-04-01T06:57:41.413 INFO:tasks.workunit.client.0.smithi083.stdout:3/832: dwrite d6/d15/d2d/d2f/d3e/f8c [0,4194304] 0 2024-04-01T06:57:41.422 INFO:tasks.workunit.client.0.smithi083.stdout:9/722: dwrite d6/d32/f17 [0,4194304] 0 2024-04-01T06:57:41.423 INFO:tasks.workunit.client.0.smithi083.stdout:9/723: write d6/d32/d26/d2d/d34/d6c/dc9/dd5/fde [3767393,91976] 0 2024-04-01T06:57:41.425 INFO:tasks.workunit.client.0.smithi083.stdout:9/724: rename d6/d32/d26/f9a to d6/d32/d26/ff8 0 2024-04-01T06:57:41.426 INFO:tasks.workunit.client.0.smithi083.stdout:2/692: dwrite d3/d26/d59/f30 [8388608,4194304] 0 2024-04-01T06:57:41.426 INFO:tasks.workunit.client.0.smithi083.stdout:2/693: write d3/d71/d81/fcf [237888,80844] 0 2024-04-01T06:57:41.427 INFO:tasks.workunit.client.0.smithi083.stdout:9/725: symlink d6/d32/d3c/lf9 0 2024-04-01T06:57:41.428 INFO:tasks.workunit.client.0.smithi083.stdout:2/694: rename d3/d26/d59/d2b/da3/la5 to d3/d26/d59/d2b/da3/le6 0 2024-04-01T06:57:41.428 INFO:tasks.workunit.client.0.smithi083.stdout:2/695: stat d3/l5 0 2024-04-01T06:57:41.429 INFO:tasks.workunit.client.0.smithi083.stdout:2/696: stat d3/d26/d59/f31 0 2024-04-01T06:57:41.429 INFO:tasks.workunit.client.0.smithi083.stdout:9/726: creat d6/d32/d8f/d6d/ffa x:0 0 0 2024-04-01T06:57:41.430 INFO:tasks.workunit.client.0.smithi083.stdout:3/833: dwrite d6/d1e/d6f/daf/fd3 [0,4194304] 0 2024-04-01T06:57:41.430 INFO:tasks.workunit.client.0.smithi083.stdout:2/697: creat d3/fe7 x:0 0 0 2024-04-01T06:57:41.442 INFO:tasks.workunit.client.0.smithi083.stdout:3/834: getdents d6/d15/d2d/d2f/d42 0 2024-04-01T06:57:41.442 INFO:tasks.workunit.client.0.smithi083.stdout:2/698: symlink d3/d8b/d53/d5f/le8 0 2024-04-01T06:57:41.444 INFO:tasks.workunit.client.0.smithi083.stdout:2/699: mkdir d3/d26/d59/d27/d79/de9 0 2024-04-01T06:57:41.445 INFO:tasks.workunit.client.0.smithi083.stdout:2/700: mkdir d3/d8b/dea 0 2024-04-01T06:57:41.450 INFO:tasks.workunit.client.0.smithi083.stdout:9/727: dwrite d6/d32/d8f/d6d/daf/fb2 [0,4194304] 0 2024-04-01T06:57:41.450 INFO:tasks.workunit.client.0.smithi083.stdout:9/728: dread - d6/d32/d3c/f9b zero size 2024-04-01T06:57:41.451 INFO:tasks.workunit.client.0.smithi083.stdout:9/729: write d6/d32/d3c/d4c/f50 [5061208,35911] 0 2024-04-01T06:57:41.451 INFO:tasks.workunit.client.0.smithi083.stdout:9/730: getdents d6/d32/d26/d2d/deb 0 2024-04-01T06:57:41.453 INFO:tasks.workunit.client.0.smithi083.stdout:9/731: creat d6/d76/ffb x:0 0 0 2024-04-01T06:57:41.453 INFO:tasks.workunit.client.0.smithi083.stdout:3/835: dread d6/d15/d2d/fe9 [0,4194304] 0 2024-04-01T06:57:41.453 INFO:tasks.workunit.client.0.smithi083.stdout:3/836: chown d6/d15/d2d/d2f/d42/d46/f5e 27 1 2024-04-01T06:57:41.455 INFO:tasks.workunit.client.0.smithi083.stdout:9/732: creat d6/d32/d3c/d4c/d88/df0/ffc x:0 0 0 2024-04-01T06:57:41.463 INFO:tasks.workunit.client.0.smithi083.stdout:2/701: dwrite d3/d8b/d53/d68/dae/ddd/fde [0,4194304] 0 2024-04-01T06:57:41.466 INFO:tasks.workunit.client.0.smithi083.stdout:2/702: link d3/d20/f2a d3/d71/db8/feb 0 2024-04-01T06:57:41.469 INFO:tasks.workunit.client.0.smithi083.stdout:2/703: mkdir d3/d71/db8/dec 0 2024-04-01T06:57:41.469 INFO:tasks.workunit.client.0.smithi083.stdout:2/704: chown d3/d26/d59/d2b/d9d 329372996 1 2024-04-01T06:57:41.472 INFO:tasks.workunit.client.0.smithi083.stdout:2/705: rename d3/d26/d59/d2b/d9f/lb9 to d3/d20/d42/led 0 2024-04-01T06:57:41.472 INFO:tasks.workunit.client.0.smithi083.stdout:2/706: fsync d3/f43 0 2024-04-01T06:57:41.472 INFO:tasks.workunit.client.0.smithi083.stdout:3/837: dwrite d6/d15/d2d/d2f/dc7/ff9 [0,4194304] 0 2024-04-01T06:57:41.473 INFO:tasks.workunit.client.0.smithi083.stdout:3/838: rename d6/d15 to d6/d15/d2d/d2f/d42/d9f/d109 22 2024-04-01T06:57:41.473 INFO:tasks.workunit.client.0.smithi083.stdout:3/839: write d6/d15/d2d/d2f/d42/d5c/d88/db9/feb [546048,71498] 0 2024-04-01T06:57:41.473 INFO:tasks.workunit.client.0.smithi083.stdout:9/733: dwrite d6/d32/d8f/fb7 [0,4194304] 0 2024-04-01T06:57:41.473 INFO:tasks.workunit.client.0.smithi083.stdout:2/707: rmdir d3/d71/d90/ddb 0 2024-04-01T06:57:41.475 INFO:tasks.workunit.client.0.smithi083.stdout:9/734: mkdir d6/dfd 0 2024-04-01T06:57:41.475 INFO:tasks.workunit.client.0.smithi083.stdout:9/735: readlink d6/d32/d3c/lf1 0 2024-04-01T06:57:41.475 INFO:tasks.workunit.client.0.smithi083.stdout:6/683: sync 2024-04-01T06:57:41.475 INFO:tasks.workunit.client.0.smithi083.stdout:8/791: sync 2024-04-01T06:57:41.475 INFO:tasks.workunit.client.0.smithi083.stdout:4/636: sync 2024-04-01T06:57:41.475 INFO:tasks.workunit.client.0.smithi083.stdout:8/792: dread - d15/d1b/d39/d48/d5e/d70/d11c/d44/d97/f11e zero size 2024-04-01T06:57:41.475 INFO:tasks.workunit.client.0.smithi083.stdout:5/547: sync 2024-04-01T06:57:41.476 INFO:tasks.workunit.client.0.smithi083.stdout:9/736: dread d6/d32/d26/d2d/d34/d6c/fd4 [0,4194304] 0 2024-04-01T06:57:41.477 INFO:tasks.workunit.client.0.smithi083.stdout:9/737: dread d6/d32/d26/d2d/d34/d6c/fb9 [0,4194304] 0 2024-04-01T06:57:41.479 INFO:tasks.workunit.client.0.smithi083.stdout:9/738: write d6/d32/d26/d2d/f1f [1926584,2997] 0 2024-04-01T06:57:41.479 INFO:tasks.workunit.client.0.smithi083.stdout:6/684: link d9/dc/d29/d3c/d45/dc4/fbc d9/dc/d1b/d35/fe9 0 2024-04-01T06:57:41.479 INFO:tasks.workunit.client.0.smithi083.stdout:4/637: creat d1/d47/d90/fca x:0 0 0 2024-04-01T06:57:41.479 INFO:tasks.workunit.client.0.smithi083.stdout:8/793: symlink d15/d1b/d39/d48/d5e/d70/d11c/d44/d108/l11f 0 2024-04-01T06:57:41.480 INFO:tasks.workunit.client.0.smithi083.stdout:4/638: dread - d1/d47/d2a/db5/fb7 zero size 2024-04-01T06:57:41.480 INFO:tasks.workunit.client.0.smithi083.stdout:5/548: rename d4/d71/d8d to d4/d9/d16/d1f/d2f/d53/dbb 0 2024-04-01T06:57:41.480 INFO:tasks.workunit.client.0.smithi083.stdout:5/549: truncate d4/d71/fa3 1368967 0 2024-04-01T06:57:41.482 INFO:tasks.workunit.client.0.smithi083.stdout:9/739: dread d6/d32/d3c/d4c/f7b [0,4194304] 0 2024-04-01T06:57:41.483 INFO:tasks.workunit.client.0.smithi083.stdout:9/740: chown d6/d32/d3c/l47 8031 1 2024-04-01T06:57:41.483 INFO:tasks.workunit.client.0.smithi083.stdout:9/741: dread - d6/d32/d3c/fcf zero size 2024-04-01T06:57:41.483 INFO:tasks.workunit.client.0.smithi083.stdout:5/550: write d4/d23/d49/fa1 [133550,72012] 0 2024-04-01T06:57:41.483 INFO:tasks.workunit.client.0.smithi083.stdout:5/551: stat d4/d9/d16/d1f/c25 0 2024-04-01T06:57:41.483 INFO:tasks.workunit.client.0.smithi083.stdout:5/552: fdatasync d4/d9/d16/d19/d5e/faa 0 2024-04-01T06:57:41.483 INFO:tasks.workunit.client.0.smithi083.stdout:6/685: creat d9/dc/d1b/d35/d48/d52/fea x:0 0 0 2024-04-01T06:57:41.483 INFO:tasks.workunit.client.0.smithi083.stdout:5/553: read d4/d55/f7c [2719757,325] 0 2024-04-01T06:57:41.483 INFO:tasks.workunit.client.0.smithi083.stdout:8/794: mkdir d15/d1b/d120 0 2024-04-01T06:57:41.484 INFO:tasks.workunit.client.0.smithi083.stdout:4/639: mknod d1/d47/da1/ccb 0 2024-04-01T06:57:41.484 INFO:tasks.workunit.client.0.smithi083.stdout:9/742: unlink d6/d32/f1b 0 2024-04-01T06:57:41.485 INFO:tasks.workunit.client.0.smithi083.stdout:6/686: dread d9/d57/d5f/f76 [0,4194304] 0 2024-04-01T06:57:41.489 INFO:tasks.workunit.client.0.smithi083.stdout:3/840: dwrite d6/d1e/f56 [0,4194304] 0 2024-04-01T06:57:41.490 INFO:tasks.workunit.client.0.smithi083.stdout:5/554: mknod d4/d9/d4f/d96/cbc 0 2024-04-01T06:57:41.490 INFO:tasks.workunit.client.0.smithi083.stdout:5/555: read - d4/d9/fb9 zero size 2024-04-01T06:57:41.491 INFO:tasks.workunit.client.0.smithi083.stdout:8/795: mknod d15/d1b/d39/d48/d5e/d70/d11c/da2/d6f/c121 0 2024-04-01T06:57:41.491 INFO:tasks.workunit.client.0.smithi083.stdout:3/841: dread d6/d15/d2d/d2f/d42/d5c/f72 [0,4194304] 0 2024-04-01T06:57:41.491 INFO:tasks.workunit.client.0.smithi083.stdout:8/796: chown d15/d18/d19/d6c/fc5 186 1 2024-04-01T06:57:41.492 INFO:tasks.workunit.client.0.smithi083.stdout:2/708: dwrite d3/d20/d42/f50 [0,4194304] 0 2024-04-01T06:57:41.492 INFO:tasks.workunit.client.0.smithi083.stdout:4/640: stat d1/d8/l48 0 2024-04-01T06:57:41.492 INFO:tasks.workunit.client.0.smithi083.stdout:4/641: fsync d1/d47/d2a/f36 0 2024-04-01T06:57:41.492 INFO:tasks.workunit.client.0.smithi083.stdout:4/642: dread - d1/d47/d2a/db5/fb7 zero size 2024-04-01T06:57:41.493 INFO:tasks.workunit.client.0.smithi083.stdout:4/643: write d1/d8/d6a/f7f [7388163,111367] 0 2024-04-01T06:57:41.493 INFO:tasks.workunit.client.0.smithi083.stdout:9/743: mkdir d6/d32/d3c/d4c/d6b/dd3/df6/dfe 0 2024-04-01T06:57:41.495 INFO:tasks.workunit.client.0.smithi083.stdout:6/687: creat d9/dc/d29/d3c/d45/dc4/dd2/feb x:0 0 0 2024-04-01T06:57:41.495 INFO:tasks.workunit.client.0.smithi083.stdout:6/688: write d9/dc/d1b/d35/fe9 [232852,95283] 0 2024-04-01T06:57:41.496 INFO:tasks.workunit.client.0.smithi083.stdout:5/556: truncate d4/fa 3168816 0 2024-04-01T06:57:41.496 INFO:tasks.workunit.client.0.smithi083.stdout:5/557: readlink d4/d9/d16/d1f/d2f/lb5 0 2024-04-01T06:57:41.496 INFO:tasks.workunit.client.0.smithi083.stdout:5/558: fsync d4/d9/d16/d1f/d2f/d53/f66 0 2024-04-01T06:57:41.496 INFO:tasks.workunit.client.0.smithi083.stdout:5/559: fsync d4/f1b 0 2024-04-01T06:57:41.497 INFO:tasks.workunit.client.0.smithi083.stdout:5/560: chown d4/d23/d49/l9a 42849637 1 2024-04-01T06:57:41.497 INFO:tasks.workunit.client.0.smithi083.stdout:5/561: fdatasync d4/d9/d16/d9f/fa4 0 2024-04-01T06:57:41.497 INFO:tasks.workunit.client.0.smithi083.stdout:5/562: fdatasync d4/d9/d16/d1f/d2f/f59 0 2024-04-01T06:57:41.497 INFO:tasks.workunit.client.0.smithi083.stdout:8/797: symlink d15/d1b/d39/d48/d5e/d70/d11c/da2/da6/l122 0 2024-04-01T06:57:41.497 INFO:tasks.workunit.client.0.smithi083.stdout:3/842: dread d6/d15/d2d/f5b [0,4194304] 0 2024-04-01T06:57:41.502 INFO:tasks.workunit.client.0.smithi083.stdout:4/644: dread d1/d4/f5c [0,4194304] 0 2024-04-01T06:57:41.505 INFO:tasks.workunit.client.0.smithi083.stdout:2/709: rename d3/d26/d59/d2b/d9f/dba to d3/d20/d42/dee 0 2024-04-01T06:57:41.508 INFO:tasks.workunit.client.0.smithi083.stdout:9/744: getdents d6/d32/d26/d2d/d34/dc3 0 2024-04-01T06:57:41.513 INFO:tasks.workunit.client.0.smithi083.stdout:6/689: creat d9/dc/d1b/d35/fec x:0 0 0 2024-04-01T06:57:41.515 INFO:tasks.workunit.client.0.smithi083.stdout:8/798: creat d15/d1b/d39/d48/d5e/d70/d11c/d38/de7/f123 x:0 0 0 2024-04-01T06:57:41.516 INFO:tasks.workunit.client.0.smithi083.stdout:3/843: getdents d6/d15/d2d/d2f/d42/d46 0 2024-04-01T06:57:41.516 INFO:tasks.workunit.client.0.smithi083.stdout:3/844: chown d6/d15/d2d/d2f/d42/d5c/fa1 1798082 1 2024-04-01T06:57:41.517 INFO:tasks.workunit.client.0.smithi083.stdout:5/563: rmdir d4/d71/d7d 39 2024-04-01T06:57:41.517 INFO:tasks.workunit.client.0.smithi083.stdout:5/564: stat d4/d71/d7d/db0/da0 0 2024-04-01T06:57:41.518 INFO:tasks.workunit.client.0.smithi083.stdout:4/645: mknod d1/d4/db/d94/daf/ccc 0 2024-04-01T06:57:41.519 INFO:tasks.workunit.client.0.smithi083.stdout:1/835: sync 2024-04-01T06:57:41.521 INFO:tasks.workunit.client.0.smithi083.stdout:2/710: unlink d3/d4d/ld2 0 2024-04-01T06:57:41.522 INFO:tasks.workunit.client.0.smithi083.stdout:9/745: mknod d6/d32/d26/d8e/cff 0 2024-04-01T06:57:41.522 INFO:tasks.workunit.client.0.smithi083.stdout:9/746: stat d6/d32/d8f/fa1 0 2024-04-01T06:57:41.525 INFO:tasks.workunit.client.0.smithi083.stdout:9/747: dread d6/d32/d3c/d4c/d6b/f5d [0,4194304] 0 2024-04-01T06:57:41.525 INFO:tasks.workunit.client.0.smithi083.stdout:6/690: symlink d9/dc/d29/d3c/d45/dc4/dcb/led 0 2024-04-01T06:57:41.526 INFO:tasks.workunit.client.0.smithi083.stdout:6/691: write d9/dc/d1b/f43 [1679629,56389] 0 2024-04-01T06:57:41.526 INFO:tasks.workunit.client.0.smithi083.stdout:8/799: getdents d15/d1b/d39/d48/d5e/d70/d11c/da2/da6/de2 0 2024-04-01T06:57:41.527 INFO:tasks.workunit.client.0.smithi083.stdout:6/692: write d9/dc/d3b/f7a [4461639,123221] 0 2024-04-01T06:57:41.527 INFO:tasks.workunit.client.0.smithi083.stdout:6/693: write d9/d57/fe5 [489236,4573] 0 2024-04-01T06:57:41.527 INFO:tasks.workunit.client.0.smithi083.stdout:0/847: sync 2024-04-01T06:57:41.527 INFO:tasks.workunit.client.0.smithi083.stdout:7/604: sync 2024-04-01T06:57:41.527 INFO:tasks.workunit.client.0.smithi083.stdout:7/605: chown d0/d4/d9/d39/l44 24218 1 2024-04-01T06:57:41.527 INFO:tasks.workunit.client.0.smithi083.stdout:8/800: read d15/d18/fc1 [49514,29908] 0 2024-04-01T06:57:41.529 INFO:tasks.workunit.client.0.smithi083.stdout:3/845: truncate d6/d15/f1c 5829954 0 2024-04-01T06:57:41.529 INFO:tasks.workunit.client.0.smithi083.stdout:1/836: dread db/f13 [0,4194304] 0 2024-04-01T06:57:41.531 INFO:tasks.workunit.client.0.smithi083.stdout:5/565: symlink d4/d9/d16/d19/lbd 0 2024-04-01T06:57:41.531 INFO:tasks.workunit.client.0.smithi083.stdout:5/566: write d4/d2b/f13 [5115888,33734] 0 2024-04-01T06:57:41.531 INFO:tasks.workunit.client.0.smithi083.stdout:5/567: truncate d4/d71/fae 187645 0 2024-04-01T06:57:41.532 INFO:tasks.workunit.client.0.smithi083.stdout:5/568: dread - d4/d23/d49/f88 zero size 2024-04-01T06:57:41.535 INFO:tasks.workunit.client.0.smithi083.stdout:4/646: unlink d1/d4/da/d88/f99 0 2024-04-01T06:57:41.535 INFO:tasks.workunit.client.0.smithi083.stdout:4/647: truncate d1/d4/f6d 734072 0 2024-04-01T06:57:41.535 INFO:tasks.workunit.client.0.smithi083.stdout:2/711: truncate d3/d4d/f86 1779428 0 2024-04-01T06:57:41.538 INFO:tasks.workunit.client.0.smithi083.stdout:7/606: rename d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/d5d/f65 to d0/d4/d9/d39/d67/d6d/d7d/fd5 0 2024-04-01T06:57:41.540 INFO:tasks.workunit.client.0.smithi083.stdout:3/846: symlink d6/d1e/d6f/l10a 0 2024-04-01T06:57:41.540 INFO:tasks.workunit.client.0.smithi083.stdout:2/712: dread d3/d71/d81/f93 [0,4194304] 0 2024-04-01T06:57:41.541 INFO:tasks.workunit.client.0.smithi083.stdout:1/837: mkdir db/d1c/d29/d33/d50/d5d/d6c/d128 0 2024-04-01T06:57:41.544 INFO:tasks.workunit.client.0.smithi083.stdout:5/569: link d4/d9/d4f/d68/l91 d4/d9/d4f/d96/db2/lbe 0 2024-04-01T06:57:41.545 INFO:tasks.workunit.client.0.smithi083.stdout:9/748: mkdir d6/d32/d26/d2d/d100 0 2024-04-01T06:57:41.546 INFO:tasks.workunit.client.0.smithi083.stdout:6/694: dwrite d9/dc/d1b/d39/d47/f69 [0,4194304] 0 2024-04-01T06:57:41.546 INFO:tasks.workunit.client.0.smithi083.stdout:6/695: chown d9/d57/f6e 42573 1 2024-04-01T06:57:41.547 INFO:tasks.workunit.client.0.smithi083.stdout:7/607: creat d0/d4/d9/d39/d67/fd6 x:0 0 0 2024-04-01T06:57:41.549 INFO:tasks.workunit.client.0.smithi083.stdout:1/838: creat db/d1c/d29/d33/d50/d5d/d81/f129 x:0 0 0 2024-04-01T06:57:41.549 INFO:tasks.workunit.client.0.smithi083.stdout:1/839: fdatasync db/d1c/d29/d33/d50/d4d/fb7 0 2024-04-01T06:57:41.549 INFO:tasks.workunit.client.0.smithi083.stdout:1/840: chown db/d1c/d29/d33/d50/d5d/dad/dbf/c8a 201066224 1 2024-04-01T06:57:41.549 INFO:tasks.workunit.client.0.smithi083.stdout:1/841: chown db/d1c/d29/d33/d50/d5d/d81/d94/l113 4187 1 2024-04-01T06:57:41.553 INFO:tasks.workunit.client.0.smithi083.stdout:5/570: unlink d4/d9/d16/d1f/d2f/d53/c8b 0 2024-04-01T06:57:41.554 INFO:tasks.workunit.client.0.smithi083.stdout:8/801: dwrite d15/d1b/d39/d48/d5e/d70/f98 [0,4194304] 0 2024-04-01T06:57:41.554 INFO:tasks.workunit.client.0.smithi083.stdout:8/802: chown d15/d1b 29826529 1 2024-04-01T06:57:41.554 INFO:tasks.workunit.client.0.smithi083.stdout:4/648: dwrite d1/d4/db/f11 [0,4194304] 0 2024-04-01T06:57:41.554 INFO:tasks.workunit.client.0.smithi083.stdout:4/649: fsync d1/d4/db/f20 0 2024-04-01T06:57:41.555 INFO:tasks.workunit.client.0.smithi083.stdout:9/749: symlink d6/d32/d26/dda/l101 0 2024-04-01T06:57:41.555 INFO:tasks.workunit.client.0.smithi083.stdout:8/803: write d15/d18/d1e/de3/f106 [318034,62547] 0 2024-04-01T06:57:41.555 INFO:tasks.workunit.client.0.smithi083.stdout:2/713: dwrite d3/d20/d42/f6c [0,4194304] 0 2024-04-01T06:57:41.556 INFO:tasks.workunit.client.0.smithi083.stdout:3/847: rmdir d6/d15/d2d/d2f/d42/d46/d55 39 2024-04-01T06:57:41.556 INFO:tasks.workunit.client.0.smithi083.stdout:3/848: chown d6/d1e/d6f/daf 388 1 2024-04-01T06:57:41.557 INFO:tasks.workunit.client.0.smithi083.stdout:6/696: creat d9/dc/d9f/fee x:0 0 0 2024-04-01T06:57:41.558 INFO:tasks.workunit.client.0.smithi083.stdout:7/608: mknod d0/d7c/cd7 0 2024-04-01T06:57:41.560 INFO:tasks.workunit.client.0.smithi083.stdout:5/571: creat d4/d55/fbf x:0 0 0 2024-04-01T06:57:41.560 INFO:tasks.workunit.client.0.smithi083.stdout:5/572: readlink d4/d23/d49/l9a 0 2024-04-01T06:57:41.562 INFO:tasks.workunit.client.0.smithi083.stdout:4/650: mkdir d1/d4/db/dba/dcd 0 2024-04-01T06:57:41.562 INFO:tasks.workunit.client.0.smithi083.stdout:1/842: dwrite db/d1c/d1d/db4/ddf/f127 [0,4194304] 0 2024-04-01T06:57:41.563 INFO:tasks.workunit.client.0.smithi083.stdout:9/750: symlink d6/d32/d26/da9/l102 0 2024-04-01T06:57:41.564 INFO:tasks.workunit.client.0.smithi083.stdout:7/609: dread d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/f54 [0,4194304] 0 2024-04-01T06:57:41.564 INFO:tasks.workunit.client.0.smithi083.stdout:7/610: truncate d0/d4/d9/d39/d67/d6d/d7d/fbe 803495 0 2024-04-01T06:57:41.564 INFO:tasks.workunit.client.0.smithi083.stdout:8/804: rename d15/d18/d19/f23 to d15/d1b/d39/d48/d5e/d70/d11c/d44/d75/f124 0 2024-04-01T06:57:41.565 INFO:tasks.workunit.client.0.smithi083.stdout:8/805: chown d15/d18/d19/d119 1561 1 2024-04-01T06:57:41.565 INFO:tasks.workunit.client.0.smithi083.stdout:2/714: creat d3/d4d/d5d/fef x:0 0 0 2024-04-01T06:57:41.566 INFO:tasks.workunit.client.0.smithi083.stdout:3/849: mkdir d6/d1e/d6f/d10b 0 2024-04-01T06:57:41.567 INFO:tasks.workunit.client.0.smithi083.stdout:6/697: creat d9/dc/d29/d3c/d45/dc4/dcb/dd3/fef x:0 0 0 2024-04-01T06:57:41.567 INFO:tasks.workunit.client.0.smithi083.stdout:5/573: creat d4/d23/d4e/fc0 x:0 0 0 2024-04-01T06:57:41.568 INFO:tasks.workunit.client.0.smithi083.stdout:4/651: unlink d1/d4/db/l2b 0 2024-04-01T06:57:41.569 INFO:tasks.workunit.client.0.smithi083.stdout:4/652: dread - d1/d47/d2a/f31 zero size 2024-04-01T06:57:41.573 INFO:tasks.workunit.client.0.smithi083.stdout:1/843: dread db/d1c/d29/d33/d47/d76/db6/fe1 [0,4194304] 0 2024-04-01T06:57:41.574 INFO:tasks.workunit.client.0.smithi083.stdout:9/751: truncate d6/d32/d3c/d4c/d6b/f5d 898381 0 2024-04-01T06:57:41.575 INFO:tasks.workunit.client.0.smithi083.stdout:1/844: write db/d1c/d29/d33/d47/d76/db6/fef [3072863,113638] 0 2024-04-01T06:57:41.575 INFO:tasks.workunit.client.0.smithi083.stdout:5/574: dread d4/d9/d16/f4c [0,4194304] 0 2024-04-01T06:57:41.576 INFO:tasks.workunit.client.0.smithi083.stdout:8/806: mknod d15/d1b/d39/d48/d5e/d70/d11c/d38/c125 0 2024-04-01T06:57:41.576 INFO:tasks.workunit.client.0.smithi083.stdout:8/807: readlink d15/l9f 0 2024-04-01T06:57:41.577 INFO:tasks.workunit.client.0.smithi083.stdout:2/715: creat d3/ff0 x:0 0 0 2024-04-01T06:57:41.577 INFO:tasks.workunit.client.0.smithi083.stdout:2/716: dread - d3/d71/fbd zero size 2024-04-01T06:57:41.578 INFO:tasks.workunit.client.0.smithi083.stdout:6/698: mkdir d9/dc/d3b/df0 0 2024-04-01T06:57:41.578 INFO:tasks.workunit.client.0.smithi083.stdout:6/699: chown d9/dc/d1b/d35/fb5 1 1 2024-04-01T06:57:41.579 INFO:tasks.workunit.client.0.smithi083.stdout:4/653: creat d1/d47/da1/d79/fce x:0 0 0 2024-04-01T06:57:41.579 INFO:tasks.workunit.client.0.smithi083.stdout:7/611: mknod d0/d4/d9/d39/d67/d6d/d87/d83/cd8 0 2024-04-01T06:57:41.581 INFO:tasks.workunit.client.0.smithi083.stdout:5/575: getdents d4/d55 0 2024-04-01T06:57:41.583 INFO:tasks.workunit.client.0.smithi083.stdout:3/850: dwrite d6/d15/d2d/d2f/d42/d5c/d88/db9/ffa [0,4194304] 0 2024-04-01T06:57:41.585 INFO:tasks.workunit.client.0.smithi083.stdout:8/808: creat d15/d21/f126 x:0 0 0 2024-04-01T06:57:41.585 INFO:tasks.workunit.client.0.smithi083.stdout:3/851: dread d6/d15/d2d/d2f/d42/d46/fa7 [0,4194304] 0 2024-04-01T06:57:41.586 INFO:tasks.workunit.client.0.smithi083.stdout:2/717: creat d3/d8b/ff1 x:0 0 0 2024-04-01T06:57:41.586 INFO:tasks.workunit.client.0.smithi083.stdout:2/718: fsync f2 0 2024-04-01T06:57:41.588 INFO:tasks.workunit.client.0.smithi083.stdout:6/700: creat d9/dc/d1b/d4c/d99/ff1 x:0 0 0 2024-04-01T06:57:41.590 INFO:tasks.workunit.client.0.smithi083.stdout:4/654: creat d1/d47/d2a/fcf x:0 0 0 2024-04-01T06:57:41.590 INFO:tasks.workunit.client.0.smithi083.stdout:4/655: read d1/d4/f6d [239593,80401] 0 2024-04-01T06:57:41.591 INFO:tasks.workunit.client.0.smithi083.stdout:9/752: dwrite d6/d32/d3c/f57 [0,4194304] 0 2024-04-01T06:57:41.592 INFO:tasks.workunit.client.0.smithi083.stdout:1/845: symlink db/d1c/d29/l12a 0 2024-04-01T06:57:41.594 INFO:tasks.workunit.client.0.smithi083.stdout:7/612: dwrite d0/d4/d9/d39/d67/d6d/d87/d83/f42 [0,4194304] 0 2024-04-01T06:57:41.598 INFO:tasks.workunit.client.0.smithi083.stdout:8/809: mkdir d15/d1b/d39/d48/d5e/d70/d11c/d44/d97/dde/d127 0 2024-04-01T06:57:41.601 INFO:tasks.workunit.client.0.smithi083.stdout:3/852: link d6/d15/d2d/d2f/d3e/fee d6/d15/d2d/d2f/d3e/d74/df5/f10c 0 2024-04-01T06:57:41.601 INFO:tasks.workunit.client.0.smithi083.stdout:3/853: write d6/d1e/f90 [2235348,105253] 0 2024-04-01T06:57:41.602 INFO:tasks.workunit.client.0.smithi083.stdout:1/846: dread db/d1c/d1d/f40 [0,4194304] 0 2024-04-01T06:57:41.602 INFO:tasks.workunit.client.0.smithi083.stdout:2/719: dwrite d3/d8b/d53/fcb [0,4194304] 0 2024-04-01T06:57:41.602 INFO:tasks.workunit.client.0.smithi083.stdout:1/847: read db/d1c/d1d/db4/ddf/de9/feb [4180616,95500] 0 2024-04-01T06:57:41.602 INFO:tasks.workunit.client.0.smithi083.stdout:6/701: getdents d9/dc 0 2024-04-01T06:57:41.607 INFO:tasks.workunit.client.0.smithi083.stdout:4/656: symlink d1/da5/dae/ld0 0 2024-04-01T06:57:41.610 INFO:tasks.workunit.client.0.smithi083.stdout:9/753: rmdir d6/d29 39 2024-04-01T06:57:41.610 INFO:tasks.workunit.client.0.smithi083.stdout:9/754: getdents d6/d32/d3c/dca 0 2024-04-01T06:57:41.610 INFO:tasks.workunit.client.0.smithi083.stdout:9/755: chown d6/d32/d26/d2d/d34/d6c/dc9/dd5/fec 218 1 2024-04-01T06:57:41.610 INFO:tasks.workunit.client.0.smithi083.stdout:9/756: getdents d6/dfd 0 2024-04-01T06:57:41.612 INFO:tasks.workunit.client.0.smithi083.stdout:7/613: symlink d0/d4/ld9 0 2024-04-01T06:57:41.613 INFO:tasks.workunit.client.0.smithi083.stdout:7/614: chown d0/d4/dbd/db2/fcd 182434295 1 2024-04-01T06:57:41.614 INFO:tasks.workunit.client.0.smithi083.stdout:5/576: rename d4/d71/d7d/db0 to d4/d9/d16/dc1 0 2024-04-01T06:57:41.616 INFO:tasks.workunit.client.0.smithi083.stdout:3/854: symlink d6/d15/d2d/d2f/d42/d5c/d88/db9/l10d 0 2024-04-01T06:57:41.618 INFO:tasks.workunit.client.0.smithi083.stdout:2/720: mkdir d3/d4d/d57/df2 0 2024-04-01T06:57:41.618 INFO:tasks.workunit.client.0.smithi083.stdout:2/721: readlink d3/d8b/d53/l7a 0 2024-04-01T06:57:41.618 INFO:tasks.workunit.client.0.smithi083.stdout:8/810: dwrite d15/d1b/d39/d48/d5e/ff5 [0,4194304] 0 2024-04-01T06:57:41.619 INFO:tasks.workunit.client.0.smithi083.stdout:6/702: creat d9/dc/d1b/d35/d48/ff2 x:0 0 0 2024-04-01T06:57:41.619 INFO:tasks.workunit.client.0.smithi083.stdout:6/703: read - d9/dc/d1b/d39/d68/fca zero size 2024-04-01T06:57:41.619 INFO:tasks.workunit.client.0.smithi083.stdout:1/848: dwrite db/d1c/d1d/d8b/f8f [4194304,4194304] 0 2024-04-01T06:57:41.620 INFO:tasks.workunit.client.0.smithi083.stdout:9/757: mkdir d6/d32/d8f/d6d/d103 0 2024-04-01T06:57:41.620 INFO:tasks.workunit.client.0.smithi083.stdout:7/615: getdents d0/d4/d9/d39/d97 0 2024-04-01T06:57:41.622 INFO:tasks.workunit.client.0.smithi083.stdout:7/616: dread d0/d4/d9/f81 [0,4194304] 0 2024-04-01T06:57:41.622 INFO:tasks.workunit.client.0.smithi083.stdout:3/855: creat d6/d15/d2d/d2f/d42/d46/f10e x:0 0 0 2024-04-01T06:57:41.623 INFO:tasks.workunit.client.0.smithi083.stdout:2/722: creat d3/d20/d42/dee/ff3 x:0 0 0 2024-04-01T06:57:41.626 INFO:tasks.workunit.client.0.smithi083.stdout:8/811: creat d15/d18/d1e/de3/f128 x:0 0 0 2024-04-01T06:57:41.628 INFO:tasks.workunit.client.0.smithi083.stdout:6/704: getdents d9/dc/d9d 0 2024-04-01T06:57:41.629 INFO:tasks.workunit.client.0.smithi083.stdout:1/849: mknod db/d1c/c12b 0 2024-04-01T06:57:41.629 INFO:tasks.workunit.client.0.smithi083.stdout:4/657: dwrite d1/d8/faa [0,4194304] 0 2024-04-01T06:57:41.631 INFO:tasks.workunit.client.0.smithi083.stdout:5/577: dwrite d4/d9/d16/d1f/d2f/d53/f70 [0,4194304] 0 2024-04-01T06:57:41.631 INFO:tasks.workunit.client.0.smithi083.stdout:5/578: chown d4/d9/d16/d1f/f44 18838 1 2024-04-01T06:57:41.634 INFO:tasks.workunit.client.0.smithi083.stdout:9/758: symlink d6/d32/d3c/d4c/d6b/df3/l104 0 2024-04-01T06:57:41.634 INFO:tasks.workunit.client.0.smithi083.stdout:7/617: mkdir d0/d4/d9/d39/d67/d6d/d87/dda 0 2024-04-01T06:57:41.634 INFO:tasks.workunit.client.0.smithi083.stdout:3/856: mknod d6/d15/d2d/d2f/d3e/d74/dfb/c10f 0 2024-04-01T06:57:41.635 INFO:tasks.workunit.client.0.smithi083.stdout:2/723: mkdir d3/d26/d59/d2b/d9d/df4 0 2024-04-01T06:57:41.636 INFO:tasks.workunit.client.0.smithi083.stdout:8/812: mknod d15/d18/d1e/de3/c129 0 2024-04-01T06:57:41.637 INFO:tasks.workunit.client.0.smithi083.stdout:1/850: unlink db/d1c/d29/d33/d47/f55 0 2024-04-01T06:57:41.641 INFO:tasks.workunit.client.0.smithi083.stdout:5/579: unlink d4/d9/d16/d1f/d2f/d53/l5f 0 2024-04-01T06:57:41.645 INFO:tasks.workunit.client.0.smithi083.stdout:6/705: dwrite d9/dc/f2e [0,4194304] 0 2024-04-01T06:57:41.657 INFO:tasks.workunit.client.0.smithi083.stdout:7/618: dwrite d0/d4/d9/d39/d67/d6d/d87/d83/f3c [0,4194304] 0 2024-04-01T06:57:41.660 INFO:tasks.workunit.client.0.smithi083.stdout:5/580: dwrite d4/d23/d4e/fc0 [0,4194304] 0 2024-04-01T06:57:41.660 INFO:tasks.workunit.client.0.smithi083.stdout:6/706: dwrite d9/dc/d1b/d35/f51 [0,4194304] 0 2024-04-01T06:57:41.660 INFO:tasks.workunit.client.0.smithi083.stdout:6/707: write d9/dc/d1b/d35/d48/d52/d9c/da9/fbe [1014734,9295] 0 2024-04-01T06:57:41.661 INFO:tasks.workunit.client.0.smithi083.stdout:6/708: write d9/d57/fe5 [73381,70183] 0 2024-04-01T06:57:41.661 INFO:tasks.workunit.client.0.smithi083.stdout:1/851: rmdir db/d1c/d29/d33/d50/d5d/d6c/ddb 39 2024-04-01T06:57:41.661 INFO:tasks.workunit.client.0.smithi083.stdout:6/709: write d9/dc/f7e [1879474,35714] 0 2024-04-01T06:57:41.662 INFO:tasks.workunit.client.0.smithi083.stdout:6/710: chown d9/dc/d1b/d35/f51 9 1 2024-04-01T06:57:41.662 INFO:tasks.workunit.client.0.smithi083.stdout:6/711: write d9/dc/d1b/d35/fc8 [1376353,7401] 0 2024-04-01T06:57:41.663 INFO:tasks.workunit.client.0.smithi083.stdout:9/759: dwrite d6/d32/d3c/d4c/d6b/fa8 [0,4194304] 0 2024-04-01T06:57:41.663 INFO:tasks.workunit.client.0.smithi083.stdout:9/760: truncate d6/d32/d3c/fe4 1022706 0 2024-04-01T06:57:41.664 INFO:tasks.workunit.client.0.smithi083.stdout:8/813: dwrite d15/d21/dbc/f10e [0,4194304] 0 2024-04-01T06:57:41.665 INFO:tasks.workunit.client.0.smithi083.stdout:4/658: rename d1/d8 to d1/d4/db/d94/daf/dd1 0 2024-04-01T06:57:41.666 INFO:tasks.workunit.client.0.smithi083.stdout:5/581: dread d4/f93 [0,4194304] 0 2024-04-01T06:57:41.667 INFO:tasks.workunit.client.0.smithi083.stdout:7/619: mknod d0/d4/d9/d39/cdb 0 2024-04-01T06:57:41.667 INFO:tasks.workunit.client.0.smithi083.stdout:7/620: write d0/d4/d9/d39/d67/d6d/d87/d83/d38/f68 [9272,124297] 0 2024-04-01T06:57:41.671 INFO:tasks.workunit.client.0.smithi083.stdout:1/852: creat db/d1c/d1d/d8b/f12c x:0 0 0 2024-04-01T06:57:41.672 INFO:tasks.workunit.client.0.smithi083.stdout:1/853: read db/f88 [1152703,130320] 0 2024-04-01T06:57:41.672 INFO:tasks.workunit.client.0.smithi083.stdout:6/712: getdents d9/dc/d29/d3c/d45/dc4/dcb/dd3 0 2024-04-01T06:57:41.672 INFO:tasks.workunit.client.0.smithi083.stdout:6/713: fdatasync d9/dc/d29/d3c/fbb 0 2024-04-01T06:57:41.675 INFO:tasks.workunit.client.0.smithi083.stdout:9/761: creat d6/d32/d26/d2d/d100/f105 x:0 0 0 2024-04-01T06:57:41.682 INFO:tasks.workunit.client.0.smithi083.stdout:7/621: dwrite d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/d92/fc9 [0,4194304] 0 2024-04-01T06:57:41.687 INFO:tasks.workunit.client.0.smithi083.stdout:8/814: link d15/d1b/d39/d48/d5e/d70/d11c/d38/d62/f96 d15/dda/f12a 0 2024-04-01T06:57:41.687 INFO:tasks.workunit.client.0.smithi083.stdout:8/815: truncate d15/d18/d1e/de3/f128 686069 0 2024-04-01T06:57:41.687 INFO:tasks.workunit.client.0.smithi083.stdout:8/816: fsync d15/d1b/d39/d48/f56 0 2024-04-01T06:57:41.688 INFO:tasks.workunit.client.0.smithi083.stdout:3/857: rename d6/d1e/d4a/dd0/dd8 to d6/d15/d2d/d2f/d42/d46/dd2/ded/d110 0 2024-04-01T06:57:41.689 INFO:tasks.workunit.client.0.smithi083.stdout:4/659: mkdir d1/da5/dae/dd2 0 2024-04-01T06:57:41.690 INFO:tasks.workunit.client.0.smithi083.stdout:5/582: getdents d4/d9/d16/d1f/d2f/d53 0 2024-04-01T06:57:41.691 INFO:tasks.workunit.client.0.smithi083.stdout:5/583: read d4/d71/f97 [1889545,76121] 0 2024-04-01T06:57:41.692 INFO:tasks.workunit.client.0.smithi083.stdout:1/854: mkdir db/d1c/df2/d12d 0 2024-04-01T06:57:41.692 INFO:tasks.workunit.client.0.smithi083.stdout:1/855: write db/d1c/d29/fec [200446,9752] 0 2024-04-01T06:57:41.693 INFO:tasks.workunit.client.0.smithi083.stdout:6/714: creat d9/dc/d1b/d39/d68/ff3 x:0 0 0 2024-04-01T06:57:41.694 INFO:tasks.workunit.client.0.smithi083.stdout:0/848: sync 2024-04-01T06:57:41.695 INFO:tasks.workunit.client.0.smithi083.stdout:9/762: mkdir d6/d32/d8f/d106 0 2024-04-01T06:57:41.695 INFO:tasks.workunit.client.0.smithi083.stdout:9/763: dread - d6/d32/d26/fe5 zero size 2024-04-01T06:57:41.698 INFO:tasks.workunit.client.0.smithi083.stdout:7/622: mknod d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/d92/cdc 0 2024-04-01T06:57:41.698 INFO:tasks.workunit.client.0.smithi083.stdout:7/623: dread - d0/d7c/fbc zero size 2024-04-01T06:57:41.699 INFO:tasks.workunit.client.0.smithi083.stdout:8/817: stat d15/d18/d1e/l72 0 2024-04-01T06:57:41.699 INFO:tasks.workunit.client.0.smithi083.stdout:8/818: chown d15/d1b/d39/d48/d5e/d70/d11c/d38/de7/lb3 3 1 2024-04-01T06:57:41.701 INFO:tasks.workunit.client.0.smithi083.stdout:8/819: write d15/f3c [2577713,97851] 0 2024-04-01T06:57:41.701 INFO:tasks.workunit.client.0.smithi083.stdout:8/820: fsync d15/d18/deb/fed 0 2024-04-01T06:57:41.701 INFO:tasks.workunit.client.0.smithi083.stdout:2/724: rename d3/d8b/d53/d68 to d3/de1/df5 0 2024-04-01T06:57:41.703 INFO:tasks.workunit.client.0.smithi083.stdout:0/849: dread d16/d99/d4b/d6e/f10b [0,4194304] 0 2024-04-01T06:57:41.703 INFO:tasks.workunit.client.0.smithi083.stdout:3/858: symlink d6/d1e/d6f/daf/dc1/l111 0 2024-04-01T06:57:41.703 INFO:tasks.workunit.client.0.smithi083.stdout:3/859: chown d6/d15/d2d/d2f/d42/d46/dd2/ded/d110/ldb 4040731 1 2024-04-01T06:57:41.704 INFO:tasks.workunit.client.0.smithi083.stdout:3/860: write d6/d15/fd4 [1419641,79748] 0 2024-04-01T06:57:41.705 INFO:tasks.workunit.client.0.smithi083.stdout:4/660: link d1/d4/d33/l7c d1/ld3 0 2024-04-01T06:57:41.708 INFO:tasks.workunit.client.0.smithi083.stdout:5/584: creat d4/d9/d16/dc1/fc2 x:0 0 0 2024-04-01T06:57:41.708 INFO:tasks.workunit.client.0.smithi083.stdout:4/661: write d1/d47/da1/f46 [1876559,101170] 0 2024-04-01T06:57:41.708 INFO:tasks.workunit.client.0.smithi083.stdout:4/662: write d1/d4/da/fc1 [5143895,47649] 0 2024-04-01T06:57:41.710 INFO:tasks.workunit.client.0.smithi083.stdout:1/856: unlink db/d1c/d29/d33/d47/cb1 0 2024-04-01T06:57:41.711 INFO:tasks.workunit.client.0.smithi083.stdout:1/857: fsync db/d1c/d29/d33/d50/d5d/d6c/f87 0 2024-04-01T06:57:41.711 INFO:tasks.workunit.client.0.smithi083.stdout:6/715: mknod d9/dc/d9f/cf4 0 2024-04-01T06:57:41.712 INFO:tasks.workunit.client.0.smithi083.stdout:9/764: getdents d6/d32/d8f 0 2024-04-01T06:57:41.713 INFO:tasks.workunit.client.0.smithi083.stdout:9/765: fdatasync d6/d32/d26/d2d/f54 0 2024-04-01T06:57:41.713 INFO:tasks.workunit.client.0.smithi083.stdout:9/766: chown d6/d32/d8f/d6d/l86 4624 1 2024-04-01T06:57:41.713 INFO:tasks.workunit.client.0.smithi083.stdout:9/767: truncate d6/d32/d3c/d4c/f55 4442806 0 2024-04-01T06:57:41.715 INFO:tasks.workunit.client.0.smithi083.stdout:8/821: getdents d15/d18/d1e 0 2024-04-01T06:57:41.716 INFO:tasks.workunit.client.0.smithi083.stdout:2/725: symlink d3/d4d/d57/df2/lf6 0 2024-04-01T06:57:41.720 INFO:tasks.workunit.client.0.smithi083.stdout:7/624: dwrite d0/d4/fc [4194304,4194304] 0 2024-04-01T06:57:41.722 INFO:tasks.workunit.client.0.smithi083.stdout:0/850: rename d16/d2e/d3d/l109 to d16/d1d/l125 0 2024-04-01T06:57:41.722 INFO:tasks.workunit.client.0.smithi083.stdout:0/851: truncate d16/dc6/ff1 1020748 0 2024-04-01T06:57:41.722 INFO:tasks.workunit.client.0.smithi083.stdout:0/852: write d16/f62 [4893271,62117] 0 2024-04-01T06:57:41.722 INFO:tasks.workunit.client.0.smithi083.stdout:0/853: chown d16/d1d/fec 1286127 1 2024-04-01T06:57:41.724 INFO:tasks.workunit.client.0.smithi083.stdout:4/663: dwrite d1/d4/db/d5b/f69 [0,4194304] 0 2024-04-01T06:57:41.724 INFO:tasks.workunit.client.0.smithi083.stdout:6/716: dread d9/dc/d1b/d35/f51 [0,4194304] 0 2024-04-01T06:57:41.725 INFO:tasks.workunit.client.0.smithi083.stdout:9/768: symlink d6/d29/l107 0 2024-04-01T06:57:41.726 INFO:tasks.workunit.client.0.smithi083.stdout:8/822: mkdir d15/d21/dbc/d12b 0 2024-04-01T06:57:41.727 INFO:tasks.workunit.client.0.smithi083.stdout:2/726: mknod d3/d71/d90/cf7 0 2024-04-01T06:57:41.727 INFO:tasks.workunit.client.0.smithi083.stdout:9/769: write d6/f2f [1115691,49904] 0 2024-04-01T06:57:41.728 INFO:tasks.workunit.client.0.smithi083.stdout:7/625: mknod d0/d4/dbd/dd0/cdd 0 2024-04-01T06:57:41.731 INFO:tasks.workunit.client.0.smithi083.stdout:5/585: rename d4/fa to d4/d9/d16/d1f/d2f/d53/dbb/fc3 0 2024-04-01T06:57:41.731 INFO:tasks.workunit.client.0.smithi083.stdout:2/727: rename d3/d71 to d3/d71/d90/db6/dcd/df8 22 2024-04-01T06:57:41.731 INFO:tasks.workunit.client.0.smithi083.stdout:2/728: write d3/d8b/d53/f97 [4217265,87694] 0 2024-04-01T06:57:41.732 INFO:tasks.workunit.client.0.smithi083.stdout:1/858: dwrite db/d1c/d29/d33/d50/d5d/d81/fb5 [0,4194304] 0 2024-04-01T06:57:41.732 INFO:tasks.workunit.client.0.smithi083.stdout:1/859: truncate db/d1c/d29/d33/d50/d5d/dad/dbf/fe0 183975 0 2024-04-01T06:57:41.732 INFO:tasks.workunit.client.0.smithi083.stdout:4/664: creat d1/d47/da1/fd4 x:0 0 0 2024-04-01T06:57:41.732 INFO:tasks.workunit.client.0.smithi083.stdout:4/665: chown d1/d47/c59 239 1 2024-04-01T06:57:41.733 INFO:tasks.workunit.client.0.smithi083.stdout:8/823: truncate d15/d1b/fa7 3896884 0 2024-04-01T06:57:41.736 INFO:tasks.workunit.client.0.smithi083.stdout:9/770: creat d6/d32/d26/f108 x:0 0 0 2024-04-01T06:57:41.737 INFO:tasks.workunit.client.0.smithi083.stdout:5/586: mkdir d4/d9/d16/d1f/d2f/dc4 0 2024-04-01T06:57:41.737 INFO:tasks.workunit.client.0.smithi083.stdout:5/587: dread - d4/d23/d4e/d79/fad zero size 2024-04-01T06:57:41.737 INFO:tasks.workunit.client.0.smithi083.stdout:0/854: dwrite d16/d2e/d3d/d5d/f67 [4194304,4194304] 0 2024-04-01T06:57:41.739 INFO:tasks.workunit.client.0.smithi083.stdout:2/729: mkdir d3/d71/df9 0 2024-04-01T06:57:41.745 INFO:tasks.workunit.client.0.smithi083.stdout:1/860: rename db/d1c/d29/d33/d50/la9 to db/d1c/d29/d33/d50/d4d/l12e 0 2024-04-01T06:57:41.745 INFO:tasks.workunit.client.0.smithi083.stdout:8/824: symlink d15/d1b/d39/d48/d5e/d70/d11c/da2/da6/d118/l12c 0 2024-04-01T06:57:41.746 INFO:tasks.workunit.client.0.smithi083.stdout:4/666: dwrite d1/d47/d2a/f31 [0,4194304] 0 2024-04-01T06:57:41.746 INFO:tasks.workunit.client.0.smithi083.stdout:4/667: write d1/da5/dae/fb1 [4860025,53463] 0 2024-04-01T06:57:41.747 INFO:tasks.workunit.client.0.smithi083.stdout:9/771: link d6/l46 d6/d32/d26/dda/l109 0 2024-04-01T06:57:41.747 INFO:tasks.workunit.client.0.smithi083.stdout:8/825: write d15/d1b/fcf [71805,86357] 0 2024-04-01T06:57:41.747 INFO:tasks.workunit.client.0.smithi083.stdout:8/826: chown f9 1 1 2024-04-01T06:57:41.748 INFO:tasks.workunit.client.0.smithi083.stdout:0/855: dread d16/d99/f83 [0,4194304] 0 2024-04-01T06:57:41.749 INFO:tasks.workunit.client.0.smithi083.stdout:8/827: dread d15/d1b/d39/d48/f56 [0,4194304] 0 2024-04-01T06:57:41.753 INFO:tasks.workunit.client.0.smithi083.stdout:2/730: mknod d3/d71/d90/db6/cfa 0 2024-04-01T06:57:41.756 INFO:tasks.workunit.client.0.smithi083.stdout:5/588: rename d4/d9/d16/f4c to d4/d9/d16/d19/d5e/fc5 0 2024-04-01T06:57:41.759 INFO:tasks.workunit.client.0.smithi083.stdout:0/856: getdents d16/de6 0 2024-04-01T06:57:41.761 INFO:tasks.workunit.client.0.smithi083.stdout:1/861: dwrite db/d1c/d29/d33/d50/d5d/dad/dbf/fe0 [0,4194304] 0 2024-04-01T06:57:41.762 INFO:tasks.workunit.client.0.smithi083.stdout:5/589: mknod d4/d2b/da9/db3/cc6 0 2024-04-01T06:57:41.762 INFO:tasks.workunit.client.0.smithi083.stdout:5/590: read d4/d2b/f39 [404398,74136] 0 2024-04-01T06:57:41.763 INFO:tasks.workunit.client.0.smithi083.stdout:9/772: dwrite d6/d32/d26/d2d/d34/dc3/fd7 [0,4194304] 0 2024-04-01T06:57:41.763 INFO:tasks.workunit.client.0.smithi083.stdout:9/773: chown d6/d32/d8f 2682 1 2024-04-01T06:57:41.763 INFO:tasks.workunit.client.0.smithi083.stdout:2/731: dread d3/d8b/d53/fcb [0,4194304] 0 2024-04-01T06:57:41.763 INFO:tasks.workunit.client.0.smithi083.stdout:5/591: read d4/f1b [4707039,73625] 0 2024-04-01T06:57:41.767 INFO:tasks.workunit.client.0.smithi083.stdout:1/862: symlink db/d1c/d29/d33/d50/d5d/d6c/ddb/l12f 0 2024-04-01T06:57:41.768 INFO:tasks.workunit.client.0.smithi083.stdout:1/863: dread db/d1c/f89 [0,4194304] 0 2024-04-01T06:57:41.768 INFO:tasks.workunit.client.0.smithi083.stdout:9/774: truncate d6/f87 3265031 0 2024-04-01T06:57:41.768 INFO:tasks.workunit.client.0.smithi083.stdout:4/668: dwrite d1/d4/db/f11 [0,4194304] 0 2024-04-01T06:57:41.770 INFO:tasks.workunit.client.0.smithi083.stdout:0/857: dread d16/f22 [0,4194304] 0 2024-04-01T06:57:41.771 INFO:tasks.workunit.client.0.smithi083.stdout:2/732: creat d3/d71/d81/ffb x:0 0 0 2024-04-01T06:57:41.774 INFO:tasks.workunit.client.0.smithi083.stdout:8/828: dwrite d15/d1b/d39/d48/d5e/d70/d11c/d44/d75/dab/fac [0,4194304] 0 2024-04-01T06:57:41.774 INFO:tasks.workunit.client.0.smithi083.stdout:8/829: readlink d15/d1b/d39/d48/d5e/d70/d11c/da2/da6/d118/l12c 0 2024-04-01T06:57:41.781 INFO:tasks.workunit.client.0.smithi083.stdout:5/592: rename d4/d9/d4f to d4/d9/d16/d9f/dc7 0 2024-04-01T06:57:41.783 INFO:tasks.workunit.client.0.smithi083.stdout:2/733: read d3/d26/d59/d2b/f32 [1632716,117621] 0 2024-04-01T06:57:41.785 INFO:tasks.workunit.client.0.smithi083.stdout:8/830: dread d15/d1b/d39/d48/f7c [0,4194304] 0 2024-04-01T06:57:41.785 INFO:tasks.workunit.client.0.smithi083.stdout:0/858: rename d16/d2e/lf3 to d16/d2e/d3d/l126 0 2024-04-01T06:57:41.787 INFO:tasks.workunit.client.0.smithi083.stdout:0/859: truncate d16/d99/f6d 174636 0 2024-04-01T06:57:41.788 INFO:tasks.workunit.client.0.smithi083.stdout:0/860: write f14 [1541424,92526] 0 2024-04-01T06:57:41.791 INFO:tasks.workunit.client.0.smithi083.stdout:4/669: dwrite d1/d4/db/d94/daf/dd1/f5e [0,4194304] 0 2024-04-01T06:57:41.791 INFO:tasks.workunit.client.0.smithi083.stdout:1/864: dwrite db/d1c/f35 [0,4194304] 0 2024-04-01T06:57:41.796 INFO:tasks.workunit.client.0.smithi083.stdout:9/775: dwrite d6/d32/d26/d2d/d34/d6c/fb9 [0,4194304] 0 2024-04-01T06:57:41.796 INFO:tasks.workunit.client.0.smithi083.stdout:9/776: stat d6/d32/d3c/d4c/d88/f8a 0 2024-04-01T06:57:41.797 INFO:tasks.workunit.client.0.smithi083.stdout:5/593: dread d4/d9/d16/d1f/d2f/d53/f66 [0,4194304] 0 2024-04-01T06:57:41.802 INFO:tasks.workunit.client.0.smithi083.stdout:9/777: mkdir d6/d29/d10a 0 2024-04-01T06:57:41.803 INFO:tasks.workunit.client.0.smithi083.stdout:9/778: truncate d6/d32/d26/d2d/d100/f105 54993 0 2024-04-01T06:57:41.803 INFO:tasks.workunit.client.0.smithi083.stdout:9/779: readlink d6/d32/d26/dda/l101 0 2024-04-01T06:57:41.806 INFO:tasks.workunit.client.0.smithi083.stdout:5/594: creat d4/fc8 x:0 0 0 2024-04-01T06:57:41.807 INFO:tasks.workunit.client.0.smithi083.stdout:4/670: dwrite d1/d4/db/d94/fbf [0,4194304] 0 2024-04-01T06:57:41.807 INFO:tasks.workunit.client.0.smithi083.stdout:8/831: dwrite d15/d1b/d39/d48/d5e/d70/d11c/ff9 [0,4194304] 0 2024-04-01T06:57:41.807 INFO:tasks.workunit.client.0.smithi083.stdout:9/780: mknod d6/d32/d26/d2d/d34/dc6/c10b 0 2024-04-01T06:57:41.807 INFO:tasks.workunit.client.0.smithi083.stdout:9/781: fsync d6/d32/d3c/d4c/d6b/f5d 0 2024-04-01T06:57:41.808 INFO:tasks.workunit.client.0.smithi083.stdout:9/782: truncate d6/d32/d3c/f6a 1989689 0 2024-04-01T06:57:41.810 INFO:tasks.workunit.client.0.smithi083.stdout:0/861: dwrite d16/d2e/d5b/d74/dd3/fdb [0,4194304] 0 2024-04-01T06:57:41.812 INFO:tasks.workunit.client.0.smithi083.stdout:1/865: rename db/d1c/d29/dbe to db/d1c/d29/d33/d50/d121/d130 0 2024-04-01T06:57:41.815 INFO:tasks.workunit.client.0.smithi083.stdout:0/862: mknod d16/d99/d4b/d11b/c127 0 2024-04-01T06:57:41.816 INFO:tasks.workunit.client.0.smithi083.stdout:0/863: fdatasync d16/dc6/ff1 0 2024-04-01T06:57:41.816 INFO:tasks.workunit.client.0.smithi083.stdout:0/864: chown d16/d99/d4b/d68/ca6 20 1 2024-04-01T06:57:41.818 INFO:tasks.workunit.client.0.smithi083.stdout:4/671: rename d1/d47/da1/db4 to d1/d4/da/dd5 0 2024-04-01T06:57:41.818 INFO:tasks.workunit.client.0.smithi083.stdout:5/595: dwrite d4/d9/d16/d19/f4b [4194304,4194304] 0 2024-04-01T06:57:41.818 INFO:tasks.workunit.client.0.smithi083.stdout:8/832: mkdir d15/d21/d12d 0 2024-04-01T06:57:41.819 INFO:tasks.workunit.client.0.smithi083.stdout:1/866: dread db/d1c/d29/d33/d50/f27 [0,4194304] 0 2024-04-01T06:57:41.819 INFO:tasks.workunit.client.0.smithi083.stdout:0/865: stat d16/d2e/d5b/cb4 0 2024-04-01T06:57:41.821 INFO:tasks.workunit.client.0.smithi083.stdout:4/672: unlink d1/d47/da1/c73 0 2024-04-01T06:57:41.821 INFO:tasks.workunit.client.0.smithi083.stdout:4/673: readlink d1/d4/d33/l95 0 2024-04-01T06:57:41.823 INFO:tasks.workunit.client.0.smithi083.stdout:5/596: mkdir d4/d23/dc9 0 2024-04-01T06:57:41.824 INFO:tasks.workunit.client.0.smithi083.stdout:9/783: dwrite d6/d32/d3c/d4c/f7b [0,4194304] 0 2024-04-01T06:57:41.825 INFO:tasks.workunit.client.0.smithi083.stdout:9/784: dread d6/d32/d26/d2d/d100/f105 [0,4194304] 0 2024-04-01T06:57:41.826 INFO:tasks.workunit.client.0.smithi083.stdout:8/833: symlink d15/d1b/d39/d48/d5e/d70/d11c/d44/l12e 0 2024-04-01T06:57:41.827 INFO:tasks.workunit.client.0.smithi083.stdout:1/867: dread db/f88 [0,4194304] 0 2024-04-01T06:57:41.827 INFO:tasks.workunit.client.0.smithi083.stdout:1/868: read db/d1c/d1d/f6b [696195,89215] 0 2024-04-01T06:57:41.827 INFO:tasks.workunit.client.0.smithi083.stdout:1/869: chown db/d1c/d1d/f4c 248074 1 2024-04-01T06:57:41.828 INFO:tasks.workunit.client.0.smithi083.stdout:0/866: rename d16/d99/d4b/d6e/d96/cf2 to d16/d99/d4b/d6e/d96/dd2/c128 0 2024-04-01T06:57:41.828 INFO:tasks.workunit.client.0.smithi083.stdout:0/867: fdatasync d16/d99/d4b/d84/ffc 0 2024-04-01T06:57:41.829 INFO:tasks.workunit.client.0.smithi083.stdout:4/674: unlink d1/d47/d2a/c34 0 2024-04-01T06:57:41.837 INFO:tasks.workunit.client.0.smithi083.stdout:9/785: rename d6/d32/d3c/f6a to d6/d32/d26/d8e/f10c 0 2024-04-01T06:57:41.839 INFO:tasks.workunit.client.0.smithi083.stdout:0/868: mkdir d16/d2e/dba/d129 0 2024-04-01T06:57:41.839 INFO:tasks.workunit.client.0.smithi083.stdout:0/869: write d16/d2e/d3d/fa0 [1196998,82114] 0 2024-04-01T06:57:41.840 INFO:tasks.workunit.client.0.smithi083.stdout:4/675: creat d1/d47/fd6 x:0 0 0 2024-04-01T06:57:41.840 INFO:tasks.workunit.client.0.smithi083.stdout:4/676: write d1/d47/d90/fca [517576,75142] 0 2024-04-01T06:57:41.840 INFO:tasks.workunit.client.0.smithi083.stdout:0/870: write d16/d1d/d8d/fc4 [3222843,98622] 0 2024-04-01T06:57:41.841 INFO:tasks.workunit.client.0.smithi083.stdout:8/834: mkdir d15/d21/dcd/d12f 0 2024-04-01T06:57:41.844 INFO:tasks.workunit.client.0.smithi083.stdout:1/870: rename db/l43 to db/d1c/d29/d33/d50/d5d/d81/l131 0 2024-04-01T06:57:41.845 INFO:tasks.workunit.client.0.smithi083.stdout:9/786: creat d6/d32/d26/d8e/f10d x:0 0 0 2024-04-01T06:57:41.846 INFO:tasks.workunit.client.0.smithi083.stdout:4/677: symlink d1/d47/d2a/ld7 0 2024-04-01T06:57:41.849 INFO:tasks.workunit.client.0.smithi083.stdout:0/871: getdents d16/d99/d4b 0 2024-04-01T06:57:41.852 INFO:tasks.workunit.client.0.smithi083.stdout:1/871: symlink db/d1c/d49/l132 0 2024-04-01T06:57:41.853 INFO:tasks.workunit.client.0.smithi083.stdout:9/787: rmdir d6/d32/d3c/d4c/d6b/df3 39 2024-04-01T06:57:41.857 INFO:tasks.workunit.client.0.smithi083.stdout:4/678: truncate d1/d4/db/d94/daf/dd1/d6a/fc6 549559 0 2024-04-01T06:57:41.857 INFO:tasks.workunit.client.0.smithi083.stdout:4/679: chown d1/d47/c2d 29706843 1 2024-04-01T06:57:41.857 INFO:tasks.workunit.client.0.smithi083.stdout:4/680: write d1/d47/da1/f9c [1026427,62130] 0 2024-04-01T06:57:41.857 INFO:tasks.workunit.client.0.smithi083.stdout:0/872: symlink d16/d1d/dbb/l12a 0 2024-04-01T06:57:41.858 INFO:tasks.workunit.client.0.smithi083.stdout:8/835: dwrite d15/d1b/d39/d48/f6e [0,4194304] 0 2024-04-01T06:57:41.858 INFO:tasks.workunit.client.0.smithi083.stdout:8/836: truncate d15/d1b/d39/d48/d5e/d70/d11c/d44/f11d 380185 0 2024-04-01T06:57:41.858 INFO:tasks.workunit.client.0.smithi083.stdout:8/837: dread - d15/d21/f126 zero size 2024-04-01T06:57:41.863 INFO:tasks.workunit.client.0.smithi083.stdout:1/872: creat db/d1c/d2e/d30/d82/f133 x:0 0 0 2024-04-01T06:57:41.863 INFO:tasks.workunit.client.0.smithi083.stdout:1/873: dread - db/d1c/d1d/d8b/f9a zero size 2024-04-01T06:57:41.866 INFO:tasks.workunit.client.0.smithi083.stdout:0/873: readlink l0 0 2024-04-01T06:57:41.868 INFO:tasks.workunit.client.0.smithi083.stdout:9/788: dread d6/d32/d3c/d3d/f98 [0,4194304] 0 2024-04-01T06:57:41.868 INFO:tasks.workunit.client.0.smithi083.stdout:9/789: write d6/d32/d4d/f5c [9324273,109091] 0 2024-04-01T06:57:41.868 INFO:tasks.workunit.client.0.smithi083.stdout:9/790: chown d6/d32/d8f/d6d/d103 9612 1 2024-04-01T06:57:41.871 INFO:tasks.workunit.client.0.smithi083.stdout:4/681: link d1/d4/d33/l3f d1/d4/db/d94/daf/dd1/ld8 0 2024-04-01T06:57:41.872 INFO:tasks.workunit.client.0.smithi083.stdout:0/874: rename d16/d1d/dbb/de9/l80 to d16/d2e/d3d/l12b 0 2024-04-01T06:57:41.873 INFO:tasks.workunit.client.0.smithi083.stdout:9/791: write d6/f2f [89184,104490] 0 2024-04-01T06:57:41.875 INFO:tasks.workunit.client.0.smithi083.stdout:8/838: link d15/d21/f51 d15/d1b/d39/f130 0 2024-04-01T06:57:41.875 INFO:tasks.workunit.client.0.smithi083.stdout:1/874: dwrite db/d1c/d29/d33/d50/d4d/fa4 [0,4194304] 0 2024-04-01T06:57:41.876 INFO:tasks.workunit.client.0.smithi083.stdout:4/682: mknod d1/d4/db/dba/cd9 0 2024-04-01T06:57:41.877 INFO:tasks.workunit.client.0.smithi083.stdout:0/875: rename d16/d99/d4b/lf5 to d16/d1d/dbb/l12c 0 2024-04-01T06:57:41.878 INFO:tasks.workunit.client.0.smithi083.stdout:9/792: creat d6/d32/d26/d2d/deb/f10e x:0 0 0 2024-04-01T06:57:41.881 INFO:tasks.workunit.client.0.smithi083.stdout:1/875: link db/d1c/d2e/f38 db/d1c/d29/d33/d50/d4d/f134 0 2024-04-01T06:57:41.881 INFO:tasks.workunit.client.0.smithi083.stdout:4/683: mkdir d1/da5/dae/dda 0 2024-04-01T06:57:41.882 INFO:tasks.workunit.client.0.smithi083.stdout:4/684: fdatasync d1/d4/d6e/f78 0 2024-04-01T06:57:41.883 INFO:tasks.workunit.client.0.smithi083.stdout:0/876: mkdir d16/d2e/dba/d12d 0 2024-04-01T06:57:41.883 INFO:tasks.workunit.client.0.smithi083.stdout:0/877: write d16/d1d/dbb/de5/f11d [854643,59958] 0 2024-04-01T06:57:41.883 INFO:tasks.workunit.client.0.smithi083.stdout:4/685: write d1/d4/db/d5b/f69 [3188070,80536] 0 2024-04-01T06:57:41.883 INFO:tasks.workunit.client.0.smithi083.stdout:4/686: chown d1/cad 2284 1 2024-04-01T06:57:41.884 INFO:tasks.workunit.client.0.smithi083.stdout:4/687: write d1/d47/f27 [3595223,125139] 0 2024-04-01T06:57:41.884 INFO:tasks.workunit.client.0.smithi083.stdout:4/688: chown d1/d4/f7b 88653 1 2024-04-01T06:57:41.885 INFO:tasks.workunit.client.0.smithi083.stdout:9/793: dread d6/d32/d3c/f66 [0,4194304] 0 2024-04-01T06:57:41.885 INFO:tasks.workunit.client.0.smithi083.stdout:8/839: rename d15/d1b/d39/d48/d5e/d70/f98 to d15/d1b/d39/d48/d5e/d70/d11c/da2/da6/d10d/f131 0 2024-04-01T06:57:41.885 INFO:tasks.workunit.client.0.smithi083.stdout:8/840: fsync d15/d1b/d39/d48/d5e/d70/d11c/d38/f41 0 2024-04-01T06:57:41.886 INFO:tasks.workunit.client.0.smithi083.stdout:8/841: dread - d15/d1b/d39/d48/d5e/d70/d11c/da2/d6f/f90 zero size 2024-04-01T06:57:41.886 INFO:tasks.workunit.client.0.smithi083.stdout:9/794: write d6/d32/d3c/d4c/f55 [3346760,6250] 0 2024-04-01T06:57:41.887 INFO:tasks.workunit.client.0.smithi083.stdout:1/876: unlink db/cc 0 2024-04-01T06:57:41.890 INFO:tasks.workunit.client.0.smithi083.stdout:4/689: truncate d1/d4/da/f83 3245760 0 2024-04-01T06:57:41.890 INFO:tasks.workunit.client.0.smithi083.stdout:4/690: chown d1/d47/d2a/f52 719512294 1 2024-04-01T06:57:41.890 INFO:tasks.workunit.client.0.smithi083.stdout:4/691: truncate d1/d4/db8/fc3 417673 0 2024-04-01T06:57:41.890 INFO:tasks.workunit.client.0.smithi083.stdout:4/692: chown d1/d47/da1/d79 13400 1 2024-04-01T06:57:41.891 INFO:tasks.workunit.client.0.smithi083.stdout:0/878: rename d16/d99/dc2/d120 to d16/d1d/d8d/d12e 0 2024-04-01T06:57:41.891 INFO:tasks.workunit.client.0.smithi083.stdout:0/879: write d16/f52 [2772848,128035] 0 2024-04-01T06:57:41.893 INFO:tasks.workunit.client.0.smithi083.stdout:1/877: creat db/d1c/d29/f135 x:0 0 0 2024-04-01T06:57:41.894 INFO:tasks.workunit.client.0.smithi083.stdout:4/693: symlink d1/d47/da1/ldb 0 2024-04-01T06:57:41.894 INFO:tasks.workunit.client.0.smithi083.stdout:4/694: read - d1/d47/d2a/db5/fb7 zero size 2024-04-01T06:57:41.896 INFO:tasks.workunit.client.0.smithi083.stdout:9/795: rmdir d6/d32/d3c/d3d 39 2024-04-01T06:57:41.899 INFO:tasks.workunit.client.0.smithi083.stdout:0/880: mknod d16/d2e/d5b/d74/c12f 0 2024-04-01T06:57:41.899 INFO:tasks.workunit.client.0.smithi083.stdout:8/842: dwrite d15/d18/d19/d1d/f2d [4194304,4194304] 0 2024-04-01T06:57:41.899 INFO:tasks.workunit.client.0.smithi083.stdout:0/881: read d16/f29 [47489,53410] 0 2024-04-01T06:57:41.900 INFO:tasks.workunit.client.0.smithi083.stdout:0/882: read d16/d2e/d3d/d5d/f10e [2110695,2488] 0 2024-04-01T06:57:41.900 INFO:tasks.workunit.client.0.smithi083.stdout:1/878: symlink db/d1c/d1d/db4/ddf/l136 0 2024-04-01T06:57:41.903 INFO:tasks.workunit.client.0.smithi083.stdout:4/695: creat d1/d4/da/dd5/dbc/fdc x:0 0 0 2024-04-01T06:57:41.903 INFO:tasks.workunit.client.0.smithi083.stdout:9/796: creat d6/d32/d26/d2d/d34/f10f x:0 0 0 2024-04-01T06:57:41.904 INFO:tasks.workunit.client.0.smithi083.stdout:8/843: mknod d15/d1b/d39/d48/d5e/d70/d11c/da2/d6f/c132 0 2024-04-01T06:57:41.904 INFO:tasks.workunit.client.0.smithi083.stdout:8/844: chown d15 54 1 2024-04-01T06:57:41.905 INFO:tasks.workunit.client.0.smithi083.stdout:0/883: creat d16/dc6/df9/f130 x:0 0 0 2024-04-01T06:57:41.906 INFO:tasks.workunit.client.0.smithi083.stdout:0/884: write d16/d1d/f2b [148262,130033] 0 2024-04-01T06:57:41.907 INFO:tasks.workunit.client.0.smithi083.stdout:4/696: link d1/d4/da/f53 d1/d4/db8/fdd 0 2024-04-01T06:57:41.916 INFO:tasks.workunit.client.0.smithi083.stdout:8/845: rename d15/d1b/d39/d48/d5e/d70/d11c/f7e to d15/d18/d19/d6c/f133 0 2024-04-01T06:57:41.916 INFO:tasks.workunit.client.0.smithi083.stdout:8/846: dread - d15/d1b/d39/d48/d5e/d70/d11c/da2/fcc zero size 2024-04-01T06:57:41.916 INFO:tasks.workunit.client.0.smithi083.stdout:9/797: dwrite d6/d32/d3c/d4c/d6b/fa8 [0,4194304] 0 2024-04-01T06:57:41.917 INFO:tasks.workunit.client.0.smithi083.stdout:8/847: write d15/d1b/d39/d48/d5e/d70/d11c/d44/d75/f124 [76502,18642] 0 2024-04-01T06:57:41.917 INFO:tasks.workunit.client.0.smithi083.stdout:8/848: chown d15/d1b/d39/d48/d5e/d70/d11c/d38/de7/c91 3483743 1 2024-04-01T06:57:41.917 INFO:tasks.workunit.client.0.smithi083.stdout:9/798: write d6/d32/d4d/f5c [6601553,91192] 0 2024-04-01T06:57:41.917 INFO:tasks.workunit.client.0.smithi083.stdout:9/799: fsync d6/d32/d8f/d6d/ffa 0 2024-04-01T06:57:41.918 INFO:tasks.workunit.client.0.smithi083.stdout:0/885: link d16/d2e/d5b/d74/l7f d16/d99/d4b/d6e/d96/l131 0 2024-04-01T06:57:41.918 INFO:tasks.workunit.client.0.smithi083.stdout:0/886: read d16/d99/dc2/d11c/f121 [751273,60436] 0 2024-04-01T06:57:41.919 INFO:tasks.workunit.client.0.smithi083.stdout:4/697: creat d1/d4/db/d94/daf/dd1/d6a/fde x:0 0 0 2024-04-01T06:57:41.922 INFO:tasks.workunit.client.0.smithi083.stdout:8/849: mkdir d15/d1b/d39/d48/d5e/d70/d11c/da2/d6f/d134 0 2024-04-01T06:57:41.923 INFO:tasks.workunit.client.0.smithi083.stdout:0/887: creat d16/d1d/d8d/f132 x:0 0 0 2024-04-01T06:57:41.924 INFO:tasks.workunit.client.0.smithi083.stdout:4/698: creat d1/d4/d33/d89/fdf x:0 0 0 2024-04-01T06:57:41.926 INFO:tasks.workunit.client.0.smithi083.stdout:8/850: truncate d15/d1b/d39/d48/d5e/d70/d11c/fbb 254846 0 2024-04-01T06:57:41.926 INFO:tasks.workunit.client.0.smithi083.stdout:8/851: write d15/d1b/d39/d48/d5e/d70/d11c/d44/fc2 [39815,47462] 0 2024-04-01T06:57:41.927 INFO:tasks.workunit.client.0.smithi083.stdout:0/888: mknod d16/d2e/d6c/d82/c133 0 2024-04-01T06:57:41.927 INFO:tasks.workunit.client.0.smithi083.stdout:0/889: fsync f10 0 2024-04-01T06:57:41.929 INFO:tasks.workunit.client.0.smithi083.stdout:4/699: mknod d1/d4/da/d88/da8/ce0 0 2024-04-01T06:57:41.930 INFO:tasks.workunit.client.0.smithi083.stdout:0/890: rmdir d16/d2e/d3d/dda 39 2024-04-01T06:57:41.930 INFO:tasks.workunit.client.0.smithi083.stdout:0/891: write d16/d1d/dbb/de9/f111 [345288,14802] 0 2024-04-01T06:57:41.930 INFO:tasks.workunit.client.0.smithi083.stdout:9/800: dwrite d6/d32/d3c/f57 [4194304,4194304] 0 2024-04-01T06:57:41.932 INFO:tasks.workunit.client.0.smithi083.stdout:4/700: getdents d1/d4/d33 0 2024-04-01T06:57:41.934 INFO:tasks.workunit.client.0.smithi083.stdout:0/892: creat d16/d2e/d5b/f134 x:0 0 0 2024-04-01T06:57:41.936 INFO:tasks.workunit.client.0.smithi083.stdout:9/801: mknod d6/d32/d4d/c110 0 2024-04-01T06:57:41.938 INFO:tasks.workunit.client.0.smithi083.stdout:4/701: mknod d1/d4/da/dd5/dbc/dc2/ce1 0 2024-04-01T06:57:41.939 INFO:tasks.workunit.client.0.smithi083.stdout:8/852: dwrite d15/d21/f126 [0,4194304] 0 2024-04-01T06:57:41.939 INFO:tasks.workunit.client.0.smithi083.stdout:4/702: write d1/da5/dae/fb1 [2777460,103582] 0 2024-04-01T06:57:41.939 INFO:tasks.workunit.client.0.smithi083.stdout:9/802: creat d6/d32/f111 x:0 0 0 2024-04-01T06:57:41.939 INFO:tasks.workunit.client.0.smithi083.stdout:9/803: readlink d6/l20 0 2024-04-01T06:57:41.939 INFO:tasks.workunit.client.0.smithi083.stdout:9/804: chown d6/d32/d26/d2d/d34/d6c/dc9/dd5/fde 315 1 2024-04-01T06:57:41.941 INFO:tasks.workunit.client.0.smithi083.stdout:0/893: dread d16/f62 [0,4194304] 0 2024-04-01T06:57:41.943 INFO:tasks.workunit.client.0.smithi083.stdout:4/703: creat d1/d4/db/d94/fe2 x:0 0 0 2024-04-01T06:57:41.944 INFO:tasks.workunit.client.0.smithi083.stdout:8/853: dread d15/d1b/f84 [0,4194304] 0 2024-04-01T06:57:41.944 INFO:tasks.workunit.client.0.smithi083.stdout:8/854: truncate d15/d1b/d39/d80/f10f 17575 0 2024-04-01T06:57:41.944 INFO:tasks.workunit.client.0.smithi083.stdout:9/805: symlink d6/d32/d26/d2d/d34/d6c/dc9/dd5/l112 0 2024-04-01T06:57:41.947 INFO:tasks.workunit.client.0.smithi083.stdout:4/704: truncate d1/d4/db/d94/fbf 2550036 0 2024-04-01T06:57:41.947 INFO:tasks.workunit.client.0.smithi083.stdout:4/705: chown d1/d47/d2a/db5/fb7 2641548 1 2024-04-01T06:57:41.949 INFO:tasks.workunit.client.0.smithi083.stdout:8/855: mknod d15/d1b/d39/d48/c135 0 2024-04-01T06:57:41.950 INFO:tasks.workunit.client.0.smithi083.stdout:9/806: dread d6/d32/d26/d2d/d34/f40 [0,4194304] 0 2024-04-01T06:57:41.952 INFO:tasks.workunit.client.0.smithi083.stdout:8/856: rmdir d15/d1b/d39/d48/d5e/d70/d11c/da2/d6f/d114 0 2024-04-01T06:57:41.952 INFO:tasks.workunit.client.0.smithi083.stdout:8/857: truncate d15/d18/fc1 1481041 0 2024-04-01T06:57:41.962 INFO:tasks.workunit.client.0.smithi083.stdout:8/858: write f9 [412678,29291] 0 2024-04-01T06:57:41.963 INFO:tasks.workunit.client.0.smithi083.stdout:4/706: dwrite d1/d4/db/d5b/d62/f8b [0,4194304] 0 2024-04-01T06:57:41.963 INFO:tasks.workunit.client.0.smithi083.stdout:8/859: rmdir d15/d1b/d39/d48/d5e/d70/d11c/d38/d62/df4 39 2024-04-01T06:57:41.965 INFO:tasks.workunit.client.0.smithi083.stdout:4/707: write d1/d4/f5c [647352,89214] 0 2024-04-01T06:57:41.966 INFO:tasks.workunit.client.0.smithi083.stdout:4/708: dread d1/d4/d33/f49 [0,4194304] 0 2024-04-01T06:57:41.967 INFO:tasks.workunit.client.0.smithi083.stdout:4/709: creat d1/d4/db/fe3 x:0 0 0 2024-04-01T06:57:41.968 INFO:tasks.workunit.client.0.smithi083.stdout:4/710: rmdir d1/da5/dae 39 2024-04-01T06:57:41.971 INFO:tasks.workunit.client.0.smithi083.stdout:8/860: dread d15/d21/f126 [0,4194304] 0 2024-04-01T06:57:41.971 INFO:tasks.workunit.client.0.smithi083.stdout:8/861: write d15/d1b/d39/d48/d5e/d70/f8e [667571,21038] 0 2024-04-01T06:57:41.971 INFO:tasks.workunit.client.0.smithi083.stdout:8/862: readlink d15/d18/d19/l20 0 2024-04-01T06:57:41.971 INFO:tasks.workunit.client.0.smithi083.stdout:8/863: fsync d15/d21/f126 0 2024-04-01T06:57:41.971 INFO:tasks.workunit.client.0.smithi083.stdout:4/711: dread d1/d4/db8/fdd [0,4194304] 0 2024-04-01T06:57:41.972 INFO:tasks.workunit.client.0.smithi083.stdout:4/712: mknod d1/da5/ce4 0 2024-04-01T06:57:41.973 INFO:tasks.workunit.client.0.smithi083.stdout:9/807: dwrite d6/d32/d8f/d6d/fe8 [0,4194304] 0 2024-04-01T06:57:41.973 INFO:tasks.workunit.client.0.smithi083.stdout:4/713: creat d1/da5/fe5 x:0 0 0 2024-04-01T06:57:41.974 INFO:tasks.workunit.client.0.smithi083.stdout:9/808: creat d6/d32/d8f/f113 x:0 0 0 2024-04-01T06:57:41.975 INFO:tasks.workunit.client.0.smithi083.stdout:4/714: creat d1/da5/dae/dd2/fe6 x:0 0 0 2024-04-01T06:57:41.976 INFO:tasks.workunit.client.0.smithi083.stdout:3/861: sync 2024-04-01T06:57:41.976 INFO:tasks.workunit.client.0.smithi083.stdout:6/717: sync 2024-04-01T06:57:41.976 INFO:tasks.workunit.client.0.smithi083.stdout:7/626: sync 2024-04-01T06:57:41.976 INFO:tasks.workunit.client.0.smithi083.stdout:7/627: write d0/d4/d9/d39/d67/d6d/d87/d83/d62/f6f [985236,5213] 0 2024-04-01T06:57:41.977 INFO:tasks.workunit.client.0.smithi083.stdout:9/809: rename d6/d32/d26/d2d/d34/d6c/fe1 to d6/d32/d4d/f114 0 2024-04-01T06:57:41.978 INFO:tasks.workunit.client.0.smithi083.stdout:8/864: dread d15/d1b/d39/f130 [0,4194304] 0 2024-04-01T06:57:41.979 INFO:tasks.workunit.client.0.smithi083.stdout:9/810: write d6/d32/d3c/d4c/d88/f8a [3870734,55007] 0 2024-04-01T06:57:41.979 INFO:tasks.workunit.client.0.smithi083.stdout:3/862: creat d6/d1e/d6f/daf/dc1/f112 x:0 0 0 2024-04-01T06:57:41.979 INFO:tasks.workunit.client.0.smithi083.stdout:3/863: truncate d6/d15/d2d/d2f/d42/d46/f10e 675468 0 2024-04-01T06:57:41.980 INFO:tasks.workunit.client.0.smithi083.stdout:6/718: mkdir d9/dc/d9f/de2/df5 0 2024-04-01T06:57:41.982 INFO:tasks.workunit.client.0.smithi083.stdout:4/715: rename d1/d4/fb2 to d1/d4/da/dd5/dbc/dc2/fe7 0 2024-04-01T06:57:41.983 INFO:tasks.workunit.client.0.smithi083.stdout:9/811: truncate d6/d32/d26/d2d/f1f 779489 0 2024-04-01T06:57:41.985 INFO:tasks.workunit.client.0.smithi083.stdout:3/864: creat d6/d15/d2d/d2f/d3e/d74/f113 x:0 0 0 2024-04-01T06:57:41.990 INFO:tasks.workunit.client.0.smithi083.stdout:9/812: unlink d6/d32/d8f/d6d/ffa 0 2024-04-01T06:57:41.990 INFO:tasks.workunit.client.0.smithi083.stdout:9/813: fsync d6/d32/d26/d2d/deb/f10e 0 2024-04-01T06:57:41.990 INFO:tasks.workunit.client.0.smithi083.stdout:9/814: fsync d6/d32/d3c/f6f 0 2024-04-01T06:57:41.991 INFO:tasks.workunit.client.0.smithi083.stdout:3/865: symlink d6/d15/d2d/d2f/d42/d46/dd2/l114 0 2024-04-01T06:57:41.991 INFO:tasks.workunit.client.0.smithi083.stdout:3/866: fsync d6/d15/d2d/d2f/d3e/d74/f75 0 2024-04-01T06:57:41.991 INFO:tasks.workunit.client.0.smithi083.stdout:3/867: write d6/d15/d2d/d2f/d42/d83/f105 [376426,58683] 0 2024-04-01T06:57:41.992 INFO:tasks.workunit.client.0.smithi083.stdout:9/815: mkdir d6/d32/d26/d2d/d34/d6c/dc9/dd5/d115 0 2024-04-01T06:57:41.995 INFO:tasks.workunit.client.0.smithi083.stdout:3/868: unlink d6/d15/d2d/d2f/d3e/f101 0 2024-04-01T06:57:41.995 INFO:tasks.workunit.client.0.smithi083.stdout:9/816: creat d6/f116 x:0 0 0 2024-04-01T06:57:41.996 INFO:tasks.workunit.client.0.smithi083.stdout:3/869: read d6/fe [3877761,3410] 0 2024-04-01T06:57:41.997 INFO:tasks.workunit.client.0.smithi083.stdout:9/817: creat d6/d32/d8f/f117 x:0 0 0 2024-04-01T06:57:41.999 INFO:tasks.workunit.client.0.smithi083.stdout:3/870: dread d6/d12/f8a [0,4194304] 0 2024-04-01T06:57:41.999 INFO:tasks.workunit.client.0.smithi083.stdout:9/818: symlink d6/d32/d3c/d3d/l118 0 2024-04-01T06:57:42.001 INFO:tasks.workunit.client.0.smithi083.stdout:3/871: rename d6/d15/d2d/d2f/d3e/d74/df5/f10c to d6/d15/d2d/d2f/d42/f115 0 2024-04-01T06:57:42.001 INFO:tasks.workunit.client.0.smithi083.stdout:7/628: dwrite d0/d4/d9/d39/d97/fb4 [0,4194304] 0 2024-04-01T06:57:42.001 INFO:tasks.workunit.client.0.smithi083.stdout:7/629: write d0/d4/d9/d39/d67/d6d/d87/d83/d62/f6c [563277,35835] 0 2024-04-01T06:57:42.002 INFO:tasks.workunit.client.0.smithi083.stdout:9/819: mknod d6/d29/c119 0 2024-04-01T06:57:42.003 INFO:tasks.workunit.client.0.smithi083.stdout:3/872: mkdir d6/d15/d2d/d2f/d3e/d116 0 2024-04-01T06:57:42.004 INFO:tasks.workunit.client.0.smithi083.stdout:9/820: dread d6/d32/d26/fa0 [0,4194304] 0 2024-04-01T06:57:42.006 INFO:tasks.workunit.client.0.smithi083.stdout:4/716: dwrite d1/d4/db/d5b/f5f [0,4194304] 0 2024-04-01T06:57:42.007 INFO:tasks.workunit.client.0.smithi083.stdout:4/717: stat d1/d47/d90/f97 0 2024-04-01T06:57:42.007 INFO:tasks.workunit.client.0.smithi083.stdout:4/718: fdatasync d1/d4/db/d94/daf/dd1/d6a/fde 0 2024-04-01T06:57:42.007 INFO:tasks.workunit.client.0.smithi083.stdout:8/865: dwrite d15/d18/d1e/de3/f106 [0,4194304] 0 2024-04-01T06:57:42.007 INFO:tasks.workunit.client.0.smithi083.stdout:8/866: chown d15/d1b/d39/d48/d5e/d70/d11c/da2/da6/d118/l12c 21592 1 2024-04-01T06:57:42.007 INFO:tasks.workunit.client.0.smithi083.stdout:9/821: getdents d6/d32/d26/dda 0 2024-04-01T06:57:42.013 INFO:tasks.workunit.client.0.smithi083.stdout:9/822: dread d6/d32/d3c/f66 [0,4194304] 0 2024-04-01T06:57:42.014 INFO:tasks.workunit.client.0.smithi083.stdout:8/867: link d15/d1b/f84 d15/d1b/d39/d48/d5e/d70/d11c/d38/f136 0 2024-04-01T06:57:42.017 INFO:tasks.workunit.client.0.smithi083.stdout:3/873: dwrite d6/d15/d2d/d2f/d42/d46/f58 [0,4194304] 0 2024-04-01T06:57:42.018 INFO:tasks.workunit.client.0.smithi083.stdout:3/874: symlink d6/d15/d2d/d2f/d42/d9f/l117 0 2024-04-01T06:57:42.018 INFO:tasks.workunit.client.0.smithi083.stdout:8/868: fsync d15/d1b/f84 0 2024-04-01T06:57:42.019 INFO:tasks.workunit.client.0.smithi083.stdout:3/875: creat d6/d15/d2d/d2f/d42/d46/dd2/ded/d110/f118 x:0 0 0 2024-04-01T06:57:42.020 INFO:tasks.workunit.client.0.smithi083.stdout:8/869: symlink d15/d1b/d39/d48/d5e/d70/d11c/da2/da6/l137 0 2024-04-01T06:57:42.021 INFO:tasks.workunit.client.0.smithi083.stdout:8/870: getdents d15/dda 0 2024-04-01T06:57:42.023 INFO:tasks.workunit.client.0.smithi083.stdout:8/871: rename d15/f3c to d15/d21/dcd/f138 0 2024-04-01T06:57:42.023 INFO:tasks.workunit.client.0.smithi083.stdout:8/872: write d15/f7b [5241493,88443] 0 2024-04-01T06:57:42.031 INFO:tasks.workunit.client.0.smithi083.stdout:9/823: dwrite d6/d32/d3c/d3d/d9d/ff2 [0,4194304] 0 2024-04-01T06:57:42.034 INFO:tasks.workunit.client.0.smithi083.stdout:9/824: link d6/d32/d26/da9/cb1 d6/d32/d26/d8e/c11a 0 2024-04-01T06:57:42.034 INFO:tasks.workunit.client.0.smithi083.stdout:3/876: dwrite d6/d15/d2d/d2f/d53/fab [0,4194304] 0 2024-04-01T06:57:42.035 INFO:tasks.workunit.client.0.smithi083.stdout:9/825: write d6/d32/f4f [3762256,122373] 0 2024-04-01T06:57:42.035 INFO:tasks.workunit.client.0.smithi083.stdout:9/826: write d6/d32/d26/d2d/f1f [454480,5062] 0 2024-04-01T06:57:42.039 INFO:tasks.workunit.client.0.smithi083.stdout:9/827: truncate d6/d32/d26/d2d/d34/d6c/dc9/dd5/fde 3641783 0 2024-04-01T06:57:42.044 INFO:tasks.workunit.client.0.smithi083.stdout:2/734: sync 2024-04-01T06:57:42.054 INFO:tasks.workunit.client.0.smithi083.stdout:8/873: dwrite d15/d18/d19/d1d/f2d [0,4194304] 0 2024-04-01T06:57:42.054 INFO:tasks.workunit.client.0.smithi083.stdout:2/735: dread f2 [0,4194304] 0 2024-04-01T06:57:42.054 INFO:tasks.workunit.client.0.smithi083.stdout:8/874: readlink d15/d1b/d39/d48/d5e/d70/d11c/ld9 0 2024-04-01T06:57:42.054 INFO:tasks.workunit.client.0.smithi083.stdout:3/877: dwrite d6/d15/d2d/d2f/d42/d9f/fca [0,4194304] 0 2024-04-01T06:57:42.054 INFO:tasks.workunit.client.0.smithi083.stdout:3/878: stat d6/d12/cb5 0 2024-04-01T06:57:42.057 INFO:tasks.workunit.client.0.smithi083.stdout:9/828: dwrite d6/d32/d8f/fb4 [0,4194304] 0 2024-04-01T06:57:42.057 INFO:tasks.workunit.client.0.smithi083.stdout:9/829: truncate d6/d32/fce 1625401 0 2024-04-01T06:57:42.058 INFO:tasks.workunit.client.0.smithi083.stdout:9/830: mkdir d6/d32/d26/d2d/d34/dc6/d11b 0 2024-04-01T06:57:42.067 INFO:tasks.workunit.client.0.smithi083.stdout:3/879: dwrite d6/d15/d2d/d2f/d42/d46/f10e [0,4194304] 0 2024-04-01T06:57:42.069 INFO:tasks.workunit.client.0.smithi083.stdout:8/875: dwrite d15/d18/d19/d1d/f36 [4194304,4194304] 0 2024-04-01T06:57:42.070 INFO:tasks.workunit.client.0.smithi083.stdout:8/876: symlink d15/d1b/d39/d48/d5e/d70/d11c/da2/d6f/l139 0 2024-04-01T06:57:42.072 INFO:tasks.workunit.client.0.smithi083.stdout:8/877: rename d15/d1b/d39/d48/d5e/d70/d11c/d44/d75/f124 to d15/d18/deb/f13a 0 2024-04-01T06:57:42.073 INFO:tasks.workunit.client.0.smithi083.stdout:8/878: creat d15/d1b/d39/d48/d5e/d70/d11c/da2/da6/d10d/f13b x:0 0 0 2024-04-01T06:57:42.074 INFO:tasks.workunit.client.0.smithi083.stdout:9/831: dread d6/d32/d3c/d3d/f63 [0,4194304] 0 2024-04-01T06:57:42.075 INFO:tasks.workunit.client.0.smithi083.stdout:8/879: getdents d15 0 2024-04-01T06:57:42.075 INFO:tasks.workunit.client.0.smithi083.stdout:8/880: fdatasync f7 0 2024-04-01T06:57:42.075 INFO:tasks.workunit.client.0.smithi083.stdout:8/881: dread - d15/d1b/fef zero size 2024-04-01T06:57:42.076 INFO:tasks.workunit.client.0.smithi083.stdout:8/882: chown d15/d18/d19/d1d/c93 753 1 2024-04-01T06:57:42.076 INFO:tasks.workunit.client.0.smithi083.stdout:8/883: chown d15/f7b 238517893 1 2024-04-01T06:57:42.076 INFO:tasks.workunit.client.0.smithi083.stdout:3/880: dread d6/d1e/f56 [0,4194304] 0 2024-04-01T06:57:42.076 INFO:tasks.workunit.client.0.smithi083.stdout:3/881: chown d6/d15/d2d/l3b 12 1 2024-04-01T06:57:42.076 INFO:tasks.workunit.client.0.smithi083.stdout:9/832: creat d6/d29/d10a/f11c x:0 0 0 2024-04-01T06:57:42.077 INFO:tasks.workunit.client.0.smithi083.stdout:3/882: dread d6/d1e/f87 [0,4194304] 0 2024-04-01T06:57:42.079 INFO:tasks.workunit.client.0.smithi083.stdout:9/833: truncate d6/d32/d3c/f6f 335698 0 2024-04-01T06:57:42.081 INFO:tasks.workunit.client.0.smithi083.stdout:3/883: truncate d6/d15/d2d/f5b 4072431 0 2024-04-01T06:57:42.083 INFO:tasks.workunit.client.0.smithi083.stdout:3/884: creat d6/d15/d2d/d2f/d42/d83/f119 x:0 0 0 2024-04-01T06:57:42.084 INFO:tasks.workunit.client.0.smithi083.stdout:3/885: creat d6/d15/d2d/d2f/dc7/dcf/f11a x:0 0 0 2024-04-01T06:57:42.084 INFO:tasks.workunit.client.0.smithi083.stdout:3/886: read d6/d15/f8e [47228,6603] 0 2024-04-01T06:57:42.085 INFO:tasks.workunit.client.0.smithi083.stdout:3/887: chown d6/d15/d2d/d2f/d3e/c48 1 1 2024-04-01T06:57:42.086 INFO:tasks.workunit.client.0.smithi083.stdout:3/888: write d6/d1e/d6f/f96 [3847369,88436] 0 2024-04-01T06:57:42.086 INFO:tasks.workunit.client.0.smithi083.stdout:3/889: dread - d6/d15/d2d/d2f/d3e/d74/f113 zero size 2024-04-01T06:57:42.087 INFO:tasks.workunit.client.0.smithi083.stdout:3/890: symlink d6/d15/d2d/d2f/dc7/dcf/l11b 0 2024-04-01T06:57:42.095 INFO:tasks.workunit.client.0.smithi083.stdout:8/884: dwrite d15/d18/d19/d1d/f11a [0,4194304] 0 2024-04-01T06:57:42.097 INFO:tasks.workunit.client.0.smithi083.stdout:9/834: dwrite d6/d32/f4f [0,4194304] 0 2024-04-01T06:57:42.097 INFO:tasks.workunit.client.0.smithi083.stdout:9/835: stat d6/d32/d26/d2d/d34/l73 0 2024-04-01T06:57:42.097 INFO:tasks.workunit.client.0.smithi083.stdout:9/836: write d6/d32/f111 [202735,11253] 0 2024-04-01T06:57:42.097 INFO:tasks.workunit.client.0.smithi083.stdout:9/837: readlink d6/d32/d3c/lf9 0 2024-04-01T06:57:42.097 INFO:tasks.workunit.client.0.smithi083.stdout:9/838: truncate d6/d32/d8f/d6d/daf/fdd 647063 0 2024-04-01T06:57:42.098 INFO:tasks.workunit.client.0.smithi083.stdout:9/839: write d6/d32/d8f/d6d/f82 [2875690,80008] 0 2024-04-01T06:57:42.098 INFO:tasks.workunit.client.0.smithi083.stdout:9/840: truncate d6/d32/d3c/d4c/d6b/dd3/fdc 4225261 0 2024-04-01T06:57:42.098 INFO:tasks.workunit.client.0.smithi083.stdout:9/841: chown d6/d32/d26/l2c 6126 1 2024-04-01T06:57:42.108 INFO:tasks.workunit.client.0.smithi083.stdout:3/891: dwrite d6/d1e/f2b [0,4194304] 0 2024-04-01T06:57:42.110 INFO:tasks.workunit.client.0.smithi083.stdout:3/892: creat d6/d15/d2d/d2f/d42/d46/dd2/f11c x:0 0 0 2024-04-01T06:57:42.111 INFO:tasks.workunit.client.0.smithi083.stdout:3/893: mknod d6/d15/d2d/d2f/d3e/d74/df5/c11d 0 2024-04-01T06:57:42.113 INFO:tasks.workunit.client.0.smithi083.stdout:3/894: dread d6/d15/d2d/d2f/d42/d5c/f72 [0,4194304] 0 2024-04-01T06:57:42.113 INFO:tasks.workunit.client.0.smithi083.stdout:8/885: dwrite d15/d1b/d39/d48/d5e/d70/f86 [0,4194304] 0 2024-04-01T06:57:42.113 INFO:tasks.workunit.client.0.smithi083.stdout:8/886: chown d15/d1b/d39/d48/c135 130639 1 2024-04-01T06:57:42.114 INFO:tasks.workunit.client.0.smithi083.stdout:8/887: chown d15/d1b/d39/cc4 1691987 1 2024-04-01T06:57:42.114 INFO:tasks.workunit.client.0.smithi083.stdout:3/895: mknod d6/d15/d2d/c11e 0 2024-04-01T06:57:42.115 INFO:tasks.workunit.client.0.smithi083.stdout:3/896: getdents d6 0 2024-04-01T06:57:42.115 INFO:tasks.workunit.client.0.smithi083.stdout:3/897: chown d6/d15/d2d/d2f/d42/d46/d55/c6b 13 1 2024-04-01T06:57:42.116 INFO:tasks.workunit.client.0.smithi083.stdout:3/898: rmdir d6/d1e/dbb 39 2024-04-01T06:57:42.122 INFO:tasks.workunit.client.0.smithi083.stdout:9/842: dwrite d6/d32/fa2 [0,4194304] 0 2024-04-01T06:57:42.122 INFO:tasks.workunit.client.0.smithi083.stdout:9/843: chown d6/d32/d26/d2d/cc0 8 1 2024-04-01T06:57:42.125 INFO:tasks.workunit.client.0.smithi083.stdout:3/899: dread d6/d15/d2d/d2f/d42/d9f/fca [0,4194304] 0 2024-04-01T06:57:42.125 INFO:tasks.workunit.client.0.smithi083.stdout:9/844: rename d6/d32/d8f/fb4 to d6/d32/d26/d2d/d34/dc6/d11b/f11d 0 2024-04-01T06:57:42.127 INFO:tasks.workunit.client.0.smithi083.stdout:8/888: dwrite d15/d1b/d39/d48/d5e/d70/d11c/d44/f110 [0,4194304] 0 2024-04-01T06:57:42.127 INFO:tasks.workunit.client.0.smithi083.stdout:8/889: chown d15/d18/d19/f30 10 1 2024-04-01T06:57:42.127 INFO:tasks.workunit.client.0.smithi083.stdout:8/890: write d15/d1b/d39/f61 [744321,50830] 0 2024-04-01T06:57:42.138 INFO:tasks.workunit.client.0.smithi083.stdout:8/891: mkdir d15/d1b/d39/d48/d5e/d70/d11c/da2/dee/d13c 0 2024-04-01T06:57:42.138 INFO:tasks.workunit.client.0.smithi083.stdout:8/892: fdatasync d15/d1b/d39/d48/d5e/d70/d11c/d38/d62/f4c 0 2024-04-01T06:57:42.138 INFO:tasks.workunit.client.0.smithi083.stdout:8/893: chown d15 126357718 1 2024-04-01T06:57:42.141 INFO:tasks.workunit.client.0.smithi083.stdout:9/845: dread d6/d32/d3c/d4c/d6b/fa8 [0,4194304] 0 2024-04-01T06:57:42.142 INFO:tasks.workunit.client.0.smithi083.stdout:9/846: write d6/f13 [7277275,126907] 0 2024-04-01T06:57:42.143 INFO:tasks.workunit.client.0.smithi083.stdout:3/900: dwrite d6/d15/d2d/fe9 [4194304,4194304] 0 2024-04-01T06:57:42.143 INFO:tasks.workunit.client.0.smithi083.stdout:9/847: rmdir d6/d32/d3c/d3d/d9d 39 2024-04-01T06:57:42.145 INFO:tasks.workunit.client.0.smithi083.stdout:3/901: rename d6/f40 to d6/d15/d2d/d2f/d3e/d74/df5/f11f 0 2024-04-01T06:57:42.146 INFO:tasks.workunit.client.0.smithi083.stdout:9/848: truncate d6/d32/d8f/d6d/fe8 3763532 0 2024-04-01T06:57:42.147 INFO:tasks.workunit.client.0.smithi083.stdout:3/902: dread d6/d15/d2d/d2f/d42/d46/d55/f79 [0,4194304] 0 2024-04-01T06:57:42.147 INFO:tasks.workunit.client.0.smithi083.stdout:9/849: mkdir d6/d32/d26/d2d/d6e/d11e 0 2024-04-01T06:57:42.148 INFO:tasks.workunit.client.0.smithi083.stdout:3/903: creat d6/d15/d2d/d2f/d42/d46/f120 x:0 0 0 2024-04-01T06:57:42.148 INFO:tasks.workunit.client.0.smithi083.stdout:3/904: truncate d6/d15/d2d/d2f/d42/d5c/d88/fc4 1677687 0 2024-04-01T06:57:42.149 INFO:tasks.workunit.client.0.smithi083.stdout:3/905: symlink d6/d15/d2d/d2f/d42/d46/d55/l121 0 2024-04-01T06:57:42.151 INFO:tasks.workunit.client.0.smithi083.stdout:3/906: creat d6/d15/d2d/d2f/d53/de5/f122 x:0 0 0 2024-04-01T06:57:42.152 INFO:tasks.workunit.client.0.smithi083.stdout:0/894: sync 2024-04-01T06:57:42.152 INFO:tasks.workunit.client.0.smithi083.stdout:5/597: sync 2024-04-01T06:57:42.152 INFO:tasks.workunit.client.0.smithi083.stdout:1/879: sync 2024-04-01T06:57:42.152 INFO:tasks.workunit.client.0.smithi083.stdout:0/895: read - d16/d1d/dbb/de9/f7d zero size 2024-04-01T06:57:42.152 INFO:tasks.workunit.client.0.smithi083.stdout:3/907: rename d6/d15/d2d/d2f/d3e/c48 to d6/d15/d2d/d2f/d3e/c123 0 2024-04-01T06:57:42.152 INFO:tasks.workunit.client.0.smithi083.stdout:3/908: stat d6/d15/d2d/d2f/dc7/lf1 0 2024-04-01T06:57:42.152 INFO:tasks.workunit.client.0.smithi083.stdout:3/909: chown d6/d15/f5a 8080234 1 2024-04-01T06:57:42.154 INFO:tasks.workunit.client.0.smithi083.stdout:5/598: link d4/d9/d16/d19/l42 d4/d9/d16/lca 0 2024-04-01T06:57:42.155 INFO:tasks.workunit.client.0.smithi083.stdout:1/880: creat db/d1c/d29/d33/d50/d5d/d81/f137 x:0 0 0 2024-04-01T06:57:42.158 INFO:tasks.workunit.client.0.smithi083.stdout:0/896: getdents d16/d2e/d3d 0 2024-04-01T06:57:42.159 INFO:tasks.workunit.client.0.smithi083.stdout:9/850: dwrite d6/d32/d26/d2d/d34/f10f [0,4194304] 0 2024-04-01T06:57:42.160 INFO:tasks.workunit.client.0.smithi083.stdout:1/881: mknod db/d1c/d2e/d30/c138 0 2024-04-01T06:57:42.163 INFO:tasks.workunit.client.0.smithi083.stdout:0/897: unlink d16/d2e/d3d/d5d/f89 0 2024-04-01T06:57:42.164 INFO:tasks.workunit.client.0.smithi083.stdout:3/910: dwrite d6/d15/d2d/d2f/d53/fab [0,4194304] 0 2024-04-01T06:57:42.165 INFO:tasks.workunit.client.0.smithi083.stdout:5/599: rmdir d4/d71 39 2024-04-01T06:57:42.165 INFO:tasks.workunit.client.0.smithi083.stdout:5/600: chown d4/d9/fb9 2 1 2024-04-01T06:57:42.167 INFO:tasks.workunit.client.0.smithi083.stdout:9/851: getdents d6/d29/d10a 0 2024-04-01T06:57:42.167 INFO:tasks.workunit.client.0.smithi083.stdout:9/852: readlink d6/d32/d3c/l41 0 2024-04-01T06:57:42.169 INFO:tasks.workunit.client.0.smithi083.stdout:1/882: creat db/d1c/d49/f139 x:0 0 0 2024-04-01T06:57:42.171 INFO:tasks.workunit.client.0.smithi083.stdout:3/911: creat d6/d15/d2d/d2f/d42/d46/dd2/f124 x:0 0 0 2024-04-01T06:57:42.171 INFO:tasks.workunit.client.0.smithi083.stdout:3/912: chown d6/d15/d2d/d2f/d42/d46/dd2 0 1 2024-04-01T06:57:42.171 INFO:tasks.workunit.client.0.smithi083.stdout:0/898: dread d16/d2e/d3d/d5d/f10e [0,4194304] 0 2024-04-01T06:57:42.174 INFO:tasks.workunit.client.0.smithi083.stdout:5/601: creat d4/d9/d16/d9f/fcb x:0 0 0 2024-04-01T06:57:42.175 INFO:tasks.workunit.client.0.smithi083.stdout:9/853: symlink d6/d32/d3c/dd0/l11f 0 2024-04-01T06:57:42.176 INFO:tasks.workunit.client.0.smithi083.stdout:9/854: read d6/f13 [3660534,22325] 0 2024-04-01T06:57:42.176 INFO:tasks.workunit.client.0.smithi083.stdout:1/883: rename db/df1 to db/d1c/d29/d33/d50/d5d/d81/d13a 0 2024-04-01T06:57:42.177 INFO:tasks.workunit.client.0.smithi083.stdout:9/855: write d6/d32/d26/d2d/d34/f10f [1756851,14707] 0 2024-04-01T06:57:42.178 INFO:tasks.workunit.client.0.smithi083.stdout:3/913: truncate d6/d15/d2d/d2f/d3e/d74/f9c 3790085 0 2024-04-01T06:57:42.178 INFO:tasks.workunit.client.0.smithi083.stdout:9/856: write d6/d32/d26/d2d/d34/dc6/fd8 [1229411,46087] 0 2024-04-01T06:57:42.179 INFO:tasks.workunit.client.0.smithi083.stdout:9/857: chown d6/d29/c56 1725166 1 2024-04-01T06:57:42.179 INFO:tasks.workunit.client.0.smithi083.stdout:0/899: mknod d16/dc6/c135 0 2024-04-01T06:57:42.179 INFO:tasks.workunit.client.0.smithi083.stdout:0/900: read - d16/d2e/d3d/ff7 zero size 2024-04-01T06:57:42.181 INFO:tasks.workunit.client.0.smithi083.stdout:9/858: link d6/d29/c119 d6/d32/d8f/d106/c120 0 2024-04-01T06:57:42.183 INFO:tasks.workunit.client.0.smithi083.stdout:9/859: unlink d6/d32/d26/d8e/f10c 0 2024-04-01T06:57:42.183 INFO:tasks.workunit.client.0.smithi083.stdout:9/860: write d6/d32/f111 [725312,75241] 0 2024-04-01T06:57:42.187 INFO:tasks.workunit.client.0.smithi083.stdout:9/861: dread d6/d32/d26/fa0 [0,4194304] 0 2024-04-01T06:57:42.189 INFO:tasks.workunit.client.0.smithi083.stdout:9/862: creat d6/d32/d3c/d3d/d9d/f121 x:0 0 0 2024-04-01T06:57:42.189 INFO:tasks.workunit.client.0.smithi083.stdout:9/863: creat d6/d32/d3c/d4c/d88/f122 x:0 0 0 2024-04-01T06:57:42.190 INFO:tasks.workunit.client.0.smithi083.stdout:0/901: dread d16/d1d/dbb/ff0 [0,4194304] 0 2024-04-01T06:57:42.190 INFO:tasks.workunit.client.0.smithi083.stdout:0/902: write d16/d2e/dba/fe2 [265406,65497] 0 2024-04-01T06:57:42.192 INFO:tasks.workunit.client.0.smithi083.stdout:0/903: rename d16/d1d/dbb/de9/l92 to d16/d2e/d3d/l136 0 2024-04-01T06:57:42.193 INFO:tasks.workunit.client.0.smithi083.stdout:9/864: dread d6/d76/fbb [0,4194304] 0 2024-04-01T06:57:42.194 INFO:tasks.workunit.client.0.smithi083.stdout:9/865: rmdir d6/d32/d3c/d4c/d6b/df3 39 2024-04-01T06:57:42.194 INFO:tasks.workunit.client.0.smithi083.stdout:9/866: chown d6/d29/cea 292927397 1 2024-04-01T06:57:42.197 INFO:tasks.workunit.client.0.smithi083.stdout:3/914: dread d6/d1e/f2b [0,4194304] 0 2024-04-01T06:57:42.197 INFO:tasks.workunit.client.0.smithi083.stdout:9/867: mkdir d6/d32/d3c/d3d/d123 0 2024-04-01T06:57:42.198 INFO:tasks.workunit.client.0.smithi083.stdout:9/868: creat d6/d32/d8f/d6d/d103/f124 x:0 0 0 2024-04-01T06:57:42.199 INFO:tasks.workunit.client.0.smithi083.stdout:5/602: dwrite d4/d2b/f13 [4194304,4194304] 0 2024-04-01T06:57:42.199 INFO:tasks.workunit.client.0.smithi083.stdout:9/869: dread d6/d32/d3c/d4c/d88/fa5 [0,4194304] 0 2024-04-01T06:57:42.199 INFO:tasks.workunit.client.0.smithi083.stdout:9/870: dread - d6/d32/fa4 zero size 2024-04-01T06:57:42.201 INFO:tasks.workunit.client.0.smithi083.stdout:9/871: mknod d6/d32/d8f/d6d/daf/c125 0 2024-04-01T06:57:42.201 INFO:tasks.workunit.client.0.smithi083.stdout:0/904: dread d16/d99/f83 [0,4194304] 0 2024-04-01T06:57:42.202 INFO:tasks.workunit.client.0.smithi083.stdout:9/872: creat d6/d32/d26/d2d/d34/dc6/d11b/f126 x:0 0 0 2024-04-01T06:57:42.204 INFO:tasks.workunit.client.0.smithi083.stdout:9/873: symlink d6/d32/d3c/d4c/d6b/l127 0 2024-04-01T06:57:42.204 INFO:tasks.workunit.client.0.smithi083.stdout:9/874: write d6/d32/d3c/fcf [979294,109961] 0 2024-04-01T06:57:42.209 INFO:tasks.workunit.client.0.smithi083.stdout:5/603: dwrite d4/d71/d7d/f8c [0,4194304] 0 2024-04-01T06:57:42.210 INFO:tasks.workunit.client.0.smithi083.stdout:0/905: dread d16/d99/f83 [0,4194304] 0 2024-04-01T06:57:42.210 INFO:tasks.workunit.client.0.smithi083.stdout:0/906: read - d16/d99/d4b/d84/f10c zero size 2024-04-01T06:57:42.211 INFO:tasks.workunit.client.0.smithi083.stdout:9/875: write d6/d32/d8f/d6d/fe8 [2392488,91514] 0 2024-04-01T06:57:42.211 INFO:tasks.workunit.client.0.smithi083.stdout:9/876: truncate d6/d32/d8f/fa1 114415 0 2024-04-01T06:57:42.211 INFO:tasks.workunit.client.0.smithi083.stdout:0/907: mknod d16/d99/d4b/d6e/d96/dd2/c137 0 2024-04-01T06:57:42.211 INFO:tasks.workunit.client.0.smithi083.stdout:0/908: write d16/d2e/d3d/f59 [982699,96907] 0 2024-04-01T06:57:42.212 INFO:tasks.workunit.client.0.smithi083.stdout:0/909: truncate d16/d2e/dba/fe2 447189 0 2024-04-01T06:57:42.213 INFO:tasks.workunit.client.0.smithi083.stdout:0/910: mkdir d16/d99/d4b/d6e/d96/dd2/d138 0 2024-04-01T06:57:42.213 INFO:tasks.workunit.client.0.smithi083.stdout:0/911: write d16/d99/d4b/f94 [1115985,35101] 0 2024-04-01T06:57:42.214 INFO:tasks.workunit.client.0.smithi083.stdout:9/877: rename d6/cf to d6/d32/d26/d2d/c128 0 2024-04-01T06:57:42.215 INFO:tasks.workunit.client.0.smithi083.stdout:9/878: read d6/d32/fa2 [3570292,71164] 0 2024-04-01T06:57:42.215 INFO:tasks.workunit.client.0.smithi083.stdout:0/912: truncate d16/f29 311964 0 2024-04-01T06:57:42.216 INFO:tasks.workunit.client.0.smithi083.stdout:0/913: creat d16/d2e/f139 x:0 0 0 2024-04-01T06:57:42.216 INFO:tasks.workunit.client.0.smithi083.stdout:0/914: truncate d16/d1d/d8d/f132 658737 0 2024-04-01T06:57:42.217 INFO:tasks.workunit.client.0.smithi083.stdout:0/915: stat d16/d99/c48 0 2024-04-01T06:57:42.217 INFO:tasks.workunit.client.0.smithi083.stdout:0/916: rename d16/d99/d4b/d11b/c127 to d16/d104/c13a 0 2024-04-01T06:57:42.222 INFO:tasks.workunit.client.0.smithi083.stdout:5/604: dwrite d4/d9/d16/f95 [0,4194304] 0 2024-04-01T06:57:42.229 INFO:tasks.workunit.client.0.smithi083.stdout:5/605: dread d4/d9/d16/d1f/d2f/f46 [0,4194304] 0 2024-04-01T06:57:42.229 INFO:tasks.workunit.client.0.smithi083.stdout:5/606: creat d4/d9/fcc x:0 0 0 2024-04-01T06:57:42.237 INFO:tasks.workunit.client.0.smithi083.stdout:9/879: dwrite d6/d32/fce [0,4194304] 0 2024-04-01T06:57:42.237 INFO:tasks.workunit.client.0.smithi083.stdout:9/880: dread - d6/d32/d26/f108 zero size 2024-04-01T06:57:42.240 INFO:tasks.workunit.client.0.smithi083.stdout:9/881: getdents d6/d32/d8f/d6d 0 2024-04-01T06:57:42.240 INFO:tasks.workunit.client.0.smithi083.stdout:0/917: dwrite f10 [0,4194304] 0 2024-04-01T06:57:42.242 INFO:tasks.workunit.client.0.smithi083.stdout:9/882: getdents d6/d32/d3c/d4c/d6b/dd3 0 2024-04-01T06:57:42.244 INFO:tasks.workunit.client.0.smithi083.stdout:5/607: dwrite d4/d9/d16/d1f/f82 [0,4194304] 0 2024-04-01T06:57:42.244 INFO:tasks.workunit.client.0.smithi083.stdout:0/918: mknod d16/d99/d4b/d6e/d96/dd2/d138/c13b 0 2024-04-01T06:57:42.252 INFO:tasks.workunit.client.0.smithi083.stdout:5/608: creat d4/d9/d16/d9f/dc7/d68/fcd x:0 0 0 2024-04-01T06:57:42.255 INFO:tasks.workunit.client.0.smithi083.stdout:6/719: sync 2024-04-01T06:57:42.258 INFO:tasks.workunit.client.0.smithi083.stdout:6/720: mkdir d9/dc/d1b/df6 0 2024-04-01T06:57:42.258 INFO:tasks.workunit.client.0.smithi083.stdout:6/721: fdatasync d9/dc/d29/f2a 0 2024-04-01T06:57:42.258 INFO:tasks.workunit.client.0.smithi083.stdout:6/722: getdents d9/dc/d1b/d39/d68/de8 0 2024-04-01T06:57:42.259 INFO:tasks.workunit.client.0.smithi083.stdout:0/919: dwrite d16/d1d/f23 [0,4194304] 0 2024-04-01T06:57:42.259 INFO:tasks.workunit.client.0.smithi083.stdout:6/723: mkdir d9/dc/d29/df7 0 2024-04-01T06:57:42.261 INFO:tasks.workunit.client.0.smithi083.stdout:0/920: unlink d16/d1d/d8d/dbf/c114 0 2024-04-01T06:57:42.261 INFO:tasks.workunit.client.0.smithi083.stdout:0/921: dread - d16/d2e/d5b/f134 zero size 2024-04-01T06:57:42.261 INFO:tasks.workunit.client.0.smithi083.stdout:0/922: write d16/d2e/dba/fe2 [696336,127181] 0 2024-04-01T06:57:42.261 INFO:tasks.workunit.client.0.smithi083.stdout:6/724: rmdir d9/dc/d29/d3c/d5c/dae 0 2024-04-01T06:57:42.262 INFO:tasks.workunit.client.0.smithi083.stdout:6/725: write d9/dc/d1b/d35/fb5 [589409,8403] 0 2024-04-01T06:57:42.264 INFO:tasks.workunit.client.0.smithi083.stdout:6/726: creat d9/dc/d9d/ff8 x:0 0 0 2024-04-01T06:57:42.265 INFO:tasks.workunit.client.0.smithi083.stdout:6/727: rename d9/dc/d1b/d39/d68/de8 to d9/d57/d5f/df9 0 2024-04-01T06:57:42.266 INFO:tasks.workunit.client.0.smithi083.stdout:6/728: truncate d9/dc/f23 3436862 0 2024-04-01T06:57:42.270 INFO:tasks.workunit.client.0.smithi083.stdout:5/609: dwrite d4/d9/d16/d1f/d2f/d53/f66 [0,4194304] 0 2024-04-01T06:57:42.272 INFO:tasks.workunit.client.0.smithi083.stdout:5/610: creat d4/d71/fce x:0 0 0 2024-04-01T06:57:42.272 INFO:tasks.workunit.client.0.smithi083.stdout:5/611: write d4/d9/d16/dc1/fc2 [646857,50428] 0 2024-04-01T06:57:42.272 INFO:tasks.workunit.client.0.smithi083.stdout:5/612: dread - d4/d55/fbf zero size 2024-04-01T06:57:42.272 INFO:tasks.workunit.client.0.smithi083.stdout:5/613: readlink d4/d9/d16/d19/l32 0 2024-04-01T06:57:42.276 INFO:tasks.workunit.client.0.smithi083.stdout:6/729: dwrite d9/dc/d1b/d35/f51 [0,4194304] 0 2024-04-01T06:57:42.281 INFO:tasks.workunit.client.0.smithi083.stdout:5/614: dwrite d4/d9/d16/d1f/f69 [0,4194304] 0 2024-04-01T06:57:42.281 INFO:tasks.workunit.client.0.smithi083.stdout:5/615: fsync d4/d55/fbf 0 2024-04-01T06:57:42.282 INFO:tasks.workunit.client.0.smithi083.stdout:5/616: getdents d4/d23/d49 0 2024-04-01T06:57:42.284 INFO:tasks.workunit.client.0.smithi083.stdout:5/617: write d4/d9/d16/f9e [2896305,78591] 0 2024-04-01T06:57:42.284 INFO:tasks.workunit.client.0.smithi083.stdout:5/618: chown d4/d23 1357160 1 2024-04-01T06:57:42.284 INFO:tasks.workunit.client.0.smithi083.stdout:5/619: creat d4/d9/d16/d19/fcf x:0 0 0 2024-04-01T06:57:42.296 INFO:tasks.workunit.client.0.smithi083.stdout:5/620: dwrite d4/d55/f9d [4194304,4194304] 0 2024-04-01T06:57:42.299 INFO:tasks.workunit.client.0.smithi083.stdout:5/621: dread d4/f92 [0,4194304] 0 2024-04-01T06:57:42.305 INFO:tasks.workunit.client.0.smithi083.stdout:5/622: dread d4/d9/d16/d1f/f69 [0,4194304] 0 2024-04-01T06:57:42.306 INFO:tasks.workunit.client.0.smithi083.stdout:5/623: dread d4/d9/d16/d1f/d2f/f60 [0,4194304] 0 2024-04-01T06:57:42.306 INFO:tasks.workunit.client.0.smithi083.stdout:5/624: fdatasync d4/d9/d16/d19/d5e/fc5 0 2024-04-01T06:57:42.307 INFO:tasks.workunit.client.0.smithi083.stdout:5/625: unlink d4/d9/d16/d19/l36 0 2024-04-01T06:57:42.309 INFO:tasks.workunit.client.0.smithi083.stdout:5/626: link d4/l27 d4/d23/d4e/ld0 0 2024-04-01T06:57:42.309 INFO:tasks.workunit.client.0.smithi083.stdout:5/627: chown d4/d9/d16/d1f/d2f/f60 51747 1 2024-04-01T06:57:42.309 INFO:tasks.workunit.client.0.smithi083.stdout:5/628: chown d4/d23/d49 11692741 1 2024-04-01T06:57:42.309 INFO:tasks.workunit.client.0.smithi083.stdout:5/629: symlink d4/d71/d7d/ld1 0 2024-04-01T06:57:42.310 INFO:tasks.workunit.client.0.smithi083.stdout:5/630: symlink d4/d9/d16/d9f/dc7/d96/ld2 0 2024-04-01T06:57:42.310 INFO:tasks.workunit.client.0.smithi083.stdout:5/631: stat d4/d23/d4e/d79/c7e 0 2024-04-01T06:57:42.327 INFO:tasks.workunit.client.0.smithi083.stdout:5/632: dwrite d4/f1b [4194304,4194304] 0 2024-04-01T06:57:42.327 INFO:tasks.workunit.client.0.smithi083.stdout:5/633: dread d4/d71/fae [0,4194304] 0 2024-04-01T06:57:42.329 INFO:tasks.workunit.client.0.smithi083.stdout:5/634: creat d4/d71/d7d/fd3 x:0 0 0 2024-04-01T06:57:42.330 INFO:tasks.workunit.client.0.smithi083.stdout:5/635: rename d4/d9/d16/d9f/dc7/c5d to d4/d2b/da9/cd4 0 2024-04-01T06:57:42.330 INFO:tasks.workunit.client.0.smithi083.stdout:5/636: fdatasync d4/f93 0 2024-04-01T06:57:42.331 INFO:tasks.workunit.client.0.smithi083.stdout:5/637: mkdir d4/d23/d4e/d83/dd5 0 2024-04-01T06:57:42.332 INFO:tasks.workunit.client.0.smithi083.stdout:5/638: link d4/d55/fbf d4/d9/d16/dc1/fd6 0 2024-04-01T06:57:42.332 INFO:tasks.workunit.client.0.smithi083.stdout:5/639: stat d4/d23/d49/l9a 0 2024-04-01T06:57:42.332 INFO:tasks.workunit.client.0.smithi083.stdout:5/640: chown d4/d23/d4e/d79/fad 45003 1 2024-04-01T06:57:42.333 INFO:tasks.workunit.client.0.smithi083.stdout:5/641: creat d4/d23/fd7 x:0 0 0 2024-04-01T06:57:42.343 INFO:tasks.workunit.client.0.smithi083.stdout:5/642: dwrite d4/d2b/f31 [0,4194304] 0 2024-04-01T06:57:42.343 INFO:tasks.workunit.client.0.smithi083.stdout:5/643: dread - d4/d9/d16/d1f/d2f/d53/dbb/fac zero size 2024-04-01T06:57:42.343 INFO:tasks.workunit.client.0.smithi083.stdout:5/644: truncate d4/d55/f9d 7559460 0 2024-04-01T06:57:42.357 INFO:tasks.workunit.client.0.smithi083.stdout:5/645: dwrite d4/d9/d16/d1f/d2f/d53/f70 [0,4194304] 0 2024-04-01T06:57:42.359 INFO:tasks.workunit.client.0.smithi083.stdout:5/646: mknod d4/d9/d16/d1f/d2f/dc4/cd8 0 2024-04-01T06:57:42.360 INFO:tasks.workunit.client.0.smithi083.stdout:5/647: creat d4/d9/d16/d9f/dc7/fd9 x:0 0 0 2024-04-01T06:57:42.362 INFO:tasks.workunit.client.0.smithi083.stdout:5/648: link d4/d9/d16/d1f/d2f/d53/f70 d4/d23/d49/fda 0 2024-04-01T06:57:42.362 INFO:tasks.workunit.client.0.smithi083.stdout:5/649: write d4/d9/d16/d1f/d2f/f59 [1688396,62198] 0 2024-04-01T06:57:42.382 INFO:tasks.workunit.client.0.smithi083.stdout:7/630: sync 2024-04-01T06:57:42.383 INFO:tasks.workunit.client.0.smithi083.stdout:4/719: sync 2024-04-01T06:57:42.383 INFO:tasks.workunit.client.0.smithi083.stdout:2/736: sync 2024-04-01T06:57:42.383 INFO:tasks.workunit.client.0.smithi083.stdout:2/737: truncate d3/d8b/d53/d5e/f9a 210624 0 2024-04-01T06:57:42.383 INFO:tasks.workunit.client.0.smithi083.stdout:7/631: symlink d0/d4/lde 0 2024-04-01T06:57:42.385 INFO:tasks.workunit.client.0.smithi083.stdout:2/738: creat d3/d71/d90/db6/ffc x:0 0 0 2024-04-01T06:57:42.386 INFO:tasks.workunit.client.0.smithi083.stdout:2/739: rmdir d3/d26/d59/daf 39 2024-04-01T06:57:42.386 INFO:tasks.workunit.client.0.smithi083.stdout:2/740: chown d3/d26/fc9 328 1 2024-04-01T06:57:42.388 INFO:tasks.workunit.client.0.smithi083.stdout:2/741: getdents d3/d71/d81 0 2024-04-01T06:57:42.391 INFO:tasks.workunit.client.0.smithi083.stdout:7/632: write d0/d7a/f9f [160185,86989] 0 2024-04-01T06:57:42.394 INFO:tasks.workunit.client.0.smithi083.stdout:7/633: link d0/d7c/fbc d0/d4/dbd/db2/fdf 0 2024-04-01T06:57:42.394 INFO:tasks.workunit.client.0.smithi083.stdout:4/720: dwrite d1/d47/d2a/fcf [0,4194304] 0 2024-04-01T06:57:42.395 INFO:tasks.workunit.client.0.smithi083.stdout:7/634: rename d0/d4/d9/l4c to d0/d4/d9/le0 0 2024-04-01T06:57:42.397 INFO:tasks.workunit.client.0.smithi083.stdout:2/742: rename d3/d8b/d53 to d3/d71/d90/db6/dcd/dfd 0 2024-04-01T06:57:42.398 INFO:tasks.workunit.client.0.smithi083.stdout:2/743: write d3/fbf [809603,24615] 0 2024-04-01T06:57:42.399 INFO:tasks.workunit.client.0.smithi083.stdout:2/744: symlink d3/d20/d42/dee/lfe 0 2024-04-01T06:57:42.400 INFO:tasks.workunit.client.0.smithi083.stdout:2/745: write d3/d26/f3a [146926,97220] 0 2024-04-01T06:57:42.403 INFO:tasks.workunit.client.0.smithi083.stdout:2/746: symlink d3/d71/d90/db6/dcd/lff 0 2024-04-01T06:57:42.403 INFO:tasks.workunit.client.0.smithi083.stdout:2/747: write d3/f2f [4710142,75853] 0 2024-04-01T06:57:42.406 INFO:tasks.workunit.client.0.smithi083.stdout:2/748: truncate d3/d26/d59/d27/f3b 3954466 0 2024-04-01T06:57:42.406 INFO:tasks.workunit.client.0.smithi083.stdout:2/749: getdents d3/d8b/dea 0 2024-04-01T06:57:42.406 INFO:tasks.workunit.client.0.smithi083.stdout:2/750: read d3/fc [3334385,115500] 0 2024-04-01T06:57:42.407 INFO:tasks.workunit.client.0.smithi083.stdout:4/721: rename d1/d4/da to d1/d47/da1/de8 0 2024-04-01T06:57:42.408 INFO:tasks.workunit.client.0.smithi083.stdout:4/722: readlink d1/d47/d2a/db5/lc4 0 2024-04-01T06:57:42.408 INFO:tasks.workunit.client.0.smithi083.stdout:4/723: readlink d1/d4/d33/l7c 0 2024-04-01T06:57:42.408 INFO:tasks.workunit.client.0.smithi083.stdout:2/751: unlink d3/d71/d81/fcf 0 2024-04-01T06:57:42.410 INFO:tasks.workunit.client.0.smithi083.stdout:2/752: write d3/d26/f3a [1370164,34442] 0 2024-04-01T06:57:42.410 INFO:tasks.workunit.client.0.smithi083.stdout:7/635: rename d0/d4/d9/d39/d67/dc0/ld1 to d0/d4/d9/d39/d67/d6d/d7d/le1 0 2024-04-01T06:57:42.411 INFO:tasks.workunit.client.0.smithi083.stdout:2/753: readlink d3/d26/d59/la8 0 2024-04-01T06:57:42.413 INFO:tasks.workunit.client.0.smithi083.stdout:7/636: mkdir d0/d4/d9/d39/d67/d6d/d87/d83/d38/de2 0 2024-04-01T06:57:42.413 INFO:tasks.workunit.client.0.smithi083.stdout:7/637: chown d0/d4/d9/d39/d97/fb4 85535176 1 2024-04-01T06:57:42.413 INFO:tasks.workunit.client.0.smithi083.stdout:7/638: chown d0/l8b 10 1 2024-04-01T06:57:42.414 INFO:tasks.workunit.client.0.smithi083.stdout:2/754: symlink d3/d8b/dea/l100 0 2024-04-01T06:57:42.418 INFO:tasks.workunit.client.0.smithi083.stdout:2/755: dread d3/d26/d59/f30 [4194304,4194304] 0 2024-04-01T06:57:42.419 INFO:tasks.workunit.client.0.smithi083.stdout:2/756: symlink d3/d8b/l101 0 2024-04-01T06:57:42.419 INFO:tasks.workunit.client.0.smithi083.stdout:2/757: readlink d3/d26/d59/l6d 0 2024-04-01T06:57:42.419 INFO:tasks.workunit.client.0.smithi083.stdout:2/758: chown d3/d4d/d57/f6a 97 1 2024-04-01T06:57:42.420 INFO:tasks.workunit.client.0.smithi083.stdout:2/759: read - d3/d26/d59/d2b/f73 zero size 2024-04-01T06:57:42.420 INFO:tasks.workunit.client.0.smithi083.stdout:2/760: read - d3/de1/df5/fe2 zero size 2024-04-01T06:57:42.420 INFO:tasks.workunit.client.0.smithi083.stdout:2/761: rmdir d3/d4d/d57 39 2024-04-01T06:57:42.422 INFO:tasks.workunit.client.0.smithi083.stdout:2/762: truncate d3/f1c 957717 0 2024-04-01T06:57:42.422 INFO:tasks.workunit.client.0.smithi083.stdout:2/763: readlink d3/d20/d42/led 0 2024-04-01T06:57:42.422 INFO:tasks.workunit.client.0.smithi083.stdout:2/764: write d3/d20/f21 [1123464,45283] 0 2024-04-01T06:57:42.423 INFO:tasks.workunit.client.0.smithi083.stdout:4/724: rename d1/d4/d33 to d1/d47/da1/de8/dd5/de9 0 2024-04-01T06:57:42.426 INFO:tasks.workunit.client.0.smithi083.stdout:7/639: rename d0/d4/d9/d95/ca1 to d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/d92/ce3 0 2024-04-01T06:57:42.426 INFO:tasks.workunit.client.0.smithi083.stdout:7/640: chown d0/d4/d9/d39/l44 213875 1 2024-04-01T06:57:42.429 INFO:tasks.workunit.client.0.smithi083.stdout:4/725: link d1/d47/d2a/db5/fb7 d1/d4/db/d5b/fea 0 2024-04-01T06:57:42.429 INFO:tasks.workunit.client.0.smithi083.stdout:4/726: truncate d1/d4/db/fb3 166467 0 2024-04-01T06:57:42.429 INFO:tasks.workunit.client.0.smithi083.stdout:4/727: read d1/d4/db/d94/daf/dd1/d6a/f76 [1185005,10299] 0 2024-04-01T06:57:42.431 INFO:tasks.workunit.client.0.smithi083.stdout:7/641: unlink d0/d4/d9/d39/d67/d6d/d7d/fbe 0 2024-04-01T06:57:42.431 INFO:tasks.workunit.client.0.smithi083.stdout:7/642: chown d0/d4/dbd/dd0 11 1 2024-04-01T06:57:42.432 INFO:tasks.workunit.client.0.smithi083.stdout:7/643: readlink d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/db8/ld4 0 2024-04-01T06:57:42.432 INFO:tasks.workunit.client.0.smithi083.stdout:7/644: write d0/d7a/f9f [935896,5991] 0 2024-04-01T06:57:42.432 INFO:tasks.workunit.client.0.smithi083.stdout:7/645: dread - d0/d4/d9/d39/d67/d6d/d7d/d8a/fab zero size 2024-04-01T06:57:42.432 INFO:tasks.workunit.client.0.smithi083.stdout:7/646: chown d0/d4/d9/d39/d67/d6d/d87/d83/d34/f6a 523870 1 2024-04-01T06:57:42.435 INFO:tasks.workunit.client.0.smithi083.stdout:4/728: rmdir d1 39 2024-04-01T06:57:42.435 INFO:tasks.workunit.client.0.smithi083.stdout:2/765: dwrite d3/d26/d59/d2b/f39 [0,4194304] 0 2024-04-01T06:57:42.436 INFO:tasks.workunit.client.0.smithi083.stdout:4/729: write d1/d47/d2a/f36 [22766,101664] 0 2024-04-01T06:57:42.437 INFO:tasks.workunit.client.0.smithi083.stdout:4/730: truncate d1/d4/db/d94/daf/dd1/d6a/f9d 2156039 0 2024-04-01T06:57:42.439 INFO:tasks.workunit.client.0.smithi083.stdout:4/731: creat d1/d4/db/d5b/feb x:0 0 0 2024-04-01T06:57:42.439 INFO:tasks.workunit.client.0.smithi083.stdout:4/732: truncate d1/d4/f7e 390414 0 2024-04-01T06:57:42.441 INFO:tasks.workunit.client.0.smithi083.stdout:4/733: mkdir d1/d4/db/d94/daf/dec 0 2024-04-01T06:57:42.441 INFO:tasks.workunit.client.0.smithi083.stdout:7/647: dread d0/d4/d9/d39/d67/d6d/d87/d83/f42 [0,4194304] 0 2024-04-01T06:57:42.442 INFO:tasks.workunit.client.0.smithi083.stdout:7/648: write d0/d4/d9/f81 [456902,62181] 0 2024-04-01T06:57:42.445 INFO:tasks.workunit.client.0.smithi083.stdout:7/649: rename d0/d4/c52 to d0/d4/ce4 0 2024-04-01T06:57:42.448 INFO:tasks.workunit.client.0.smithi083.stdout:2/766: dwrite d3/d4d/d57/f6a [0,4194304] 0 2024-04-01T06:57:42.448 INFO:tasks.workunit.client.0.smithi083.stdout:2/767: chown d3/d8b/fd3 0 1 2024-04-01T06:57:42.448 INFO:tasks.workunit.client.0.smithi083.stdout:2/768: write d3/ff0 [387449,28272] 0 2024-04-01T06:57:42.449 INFO:tasks.workunit.client.0.smithi083.stdout:4/734: rename d1/d47/da1 to d1/d4/db8/ded 0 2024-04-01T06:57:42.451 INFO:tasks.workunit.client.0.smithi083.stdout:7/650: dread d0/d4/d9/d39/d67/d6d/d87/d83/f53 [0,4194304] 0 2024-04-01T06:57:42.456 INFO:tasks.workunit.client.0.smithi083.stdout:2/769: rename d3/d20/f2a to d3/d71/f102 0 2024-04-01T06:57:42.457 INFO:tasks.workunit.client.0.smithi083.stdout:4/735: mknod d1/da5/dae/dd2/cee 0 2024-04-01T06:57:42.461 INFO:tasks.workunit.client.0.smithi083.stdout:7/651: mkdir d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/de5 0 2024-04-01T06:57:42.463 INFO:tasks.workunit.client.0.smithi083.stdout:4/736: symlink d1/d4/db/d94/daf/dd1/d6a/lef 0 2024-04-01T06:57:42.465 INFO:tasks.workunit.client.0.smithi083.stdout:7/652: creat d0/d4/dbd/db7/fe6 x:0 0 0 2024-04-01T06:57:42.467 INFO:tasks.workunit.client.0.smithi083.stdout:7/653: dread d0/d4/d9/d39/d67/d6d/d87/d83/d38/f68 [0,4194304] 0 2024-04-01T06:57:42.467 INFO:tasks.workunit.client.0.smithi083.stdout:7/654: chown d0/d4/dbd/db7/cc3 36 1 2024-04-01T06:57:42.469 INFO:tasks.workunit.client.0.smithi083.stdout:2/770: dwrite f1 [0,4194304] 0 2024-04-01T06:57:42.469 INFO:tasks.workunit.client.0.smithi083.stdout:2/771: fdatasync d3/d26/d59/d27/f7e 0 2024-04-01T06:57:42.469 INFO:tasks.workunit.client.0.smithi083.stdout:2/772: dread - d3/d26/d59/d2b/f73 zero size 2024-04-01T06:57:42.469 INFO:tasks.workunit.client.0.smithi083.stdout:2/773: readlink d3/d71/d90/db6/dcd/dfd/d5f/le8 0 2024-04-01T06:57:42.469 INFO:tasks.workunit.client.0.smithi083.stdout:2/774: chown d3/d26/fc9 39521 1 2024-04-01T06:57:42.478 INFO:tasks.workunit.client.0.smithi083.stdout:4/737: getdents d1/d4/db8/ded/d79 0 2024-04-01T06:57:42.482 INFO:tasks.workunit.client.0.smithi083.stdout:7/655: getdents d0/d4 0 2024-04-01T06:57:42.483 INFO:tasks.workunit.client.0.smithi083.stdout:2/775: dwrite d3/d26/f36 [0,4194304] 0 2024-04-01T06:57:42.483 INFO:tasks.workunit.client.0.smithi083.stdout:3/915: sync 2024-04-01T06:57:42.483 INFO:tasks.workunit.client.0.smithi083.stdout:1/884: sync 2024-04-01T06:57:42.483 INFO:tasks.workunit.client.0.smithi083.stdout:8/894: sync 2024-04-01T06:57:42.483 INFO:tasks.workunit.client.0.smithi083.stdout:3/916: fdatasync d6/d15/d2d/d2f/d42/d5c/d88/fad 0 2024-04-01T06:57:42.484 INFO:tasks.workunit.client.0.smithi083.stdout:7/656: dread d0/d4/d9/d39/d67/d6d/d7d/fd5 [0,4194304] 0 2024-04-01T06:57:42.484 INFO:tasks.workunit.client.0.smithi083.stdout:4/738: symlink d1/d4/db/d5b/d62/dbd/lf0 0 2024-04-01T06:57:42.489 INFO:tasks.workunit.client.0.smithi083.stdout:8/895: getdents d15/d1b/d39/d48/d5e/d70/d11c/d44/d97/dde 0 2024-04-01T06:57:42.489 INFO:tasks.workunit.client.0.smithi083.stdout:8/896: fdatasync d15/d1b/d39/d48/d5e/d70/d11c/f89 0 2024-04-01T06:57:42.489 INFO:tasks.workunit.client.0.smithi083.stdout:8/897: readlink l12 0 2024-04-01T06:57:42.490 INFO:tasks.workunit.client.0.smithi083.stdout:8/898: stat d15/d1b/d39/d48/d5e/d70/d11c/da2/da6/d10d/f131 0 2024-04-01T06:57:42.491 INFO:tasks.workunit.client.0.smithi083.stdout:5/650: sync 2024-04-01T06:57:42.491 INFO:tasks.workunit.client.0.smithi083.stdout:6/730: sync 2024-04-01T06:57:42.491 INFO:tasks.workunit.client.0.smithi083.stdout:0/923: sync 2024-04-01T06:57:42.491 INFO:tasks.workunit.client.0.smithi083.stdout:9/883: sync 2024-04-01T06:57:42.491 INFO:tasks.workunit.client.0.smithi083.stdout:6/731: truncate d9/dc/d9f/fee 628985 0 2024-04-01T06:57:42.492 INFO:tasks.workunit.client.0.smithi083.stdout:6/732: readlink d9/l12 0 2024-04-01T06:57:42.492 INFO:tasks.workunit.client.0.smithi083.stdout:0/924: write d16/d99/d4b/d95/fe1 [1446073,95407] 0 2024-04-01T06:57:42.492 INFO:tasks.workunit.client.0.smithi083.stdout:0/925: chown d16/d99/d4b/d6e/d96/dd2/d138 49 1 2024-04-01T06:57:42.492 INFO:tasks.workunit.client.0.smithi083.stdout:0/926: read d16/d1d/f8b [311864,93462] 0 2024-04-01T06:57:42.493 INFO:tasks.workunit.client.0.smithi083.stdout:1/885: mkdir db/d1c/d29/d33/d50/d121/d130/d13b 0 2024-04-01T06:57:42.497 INFO:tasks.workunit.client.0.smithi083.stdout:7/657: mkdir d0/d4/d9/d39/d67/d6d/d87/d83/d38/dbf/de7 0 2024-04-01T06:57:42.500 INFO:tasks.workunit.client.0.smithi083.stdout:4/739: mkdir d1/d4/db/d94/df1 0 2024-04-01T06:57:42.500 INFO:tasks.workunit.client.0.smithi083.stdout:3/917: dwrite d6/d15/d2d/d2f/d3e/fc6 [0,4194304] 0 2024-04-01T06:57:42.500 INFO:tasks.workunit.client.0.smithi083.stdout:3/918: read d6/d15/d2d/d2f/d42/d5c/d88/fc4 [297445,17856] 0 2024-04-01T06:57:42.502 INFO:tasks.workunit.client.0.smithi083.stdout:8/899: truncate d15/d1b/d39/d48/d5e/d70/d11c/d38/d62/f4a 445038 0 2024-04-01T06:57:42.503 INFO:tasks.workunit.client.0.smithi083.stdout:3/919: dread d6/d15/d2d/d2f/d42/d46/f5e [0,4194304] 0 2024-04-01T06:57:42.506 INFO:tasks.workunit.client.0.smithi083.stdout:5/651: symlink d4/d71/ldb 0 2024-04-01T06:57:42.509 INFO:tasks.workunit.client.0.smithi083.stdout:6/733: dwrite d9/dc/d1b/d35/fc8 [0,4194304] 0 2024-04-01T06:57:42.509 INFO:tasks.workunit.client.0.smithi083.stdout:6/734: fdatasync d9/dc/d1b/d35/f89 0 2024-04-01T06:57:42.509 INFO:tasks.workunit.client.0.smithi083.stdout:6/735: truncate d9/dc/d1b/d35/d48/d52/f54 1554397 0 2024-04-01T06:57:42.509 INFO:tasks.workunit.client.0.smithi083.stdout:9/884: mknod d6/d32/d3c/d4c/c129 0 2024-04-01T06:57:42.512 INFO:tasks.workunit.client.0.smithi083.stdout:0/927: truncate f12 3258840 0 2024-04-01T06:57:42.513 INFO:tasks.workunit.client.0.smithi083.stdout:0/928: write d16/d2e/d5b/d74/dd3/fdb [860090,84232] 0 2024-04-01T06:57:42.516 INFO:tasks.workunit.client.0.smithi083.stdout:1/886: mknod db/d1c/d2e/d30/d82/c13c 0 2024-04-01T06:57:42.516 INFO:tasks.workunit.client.0.smithi083.stdout:1/887: fdatasync db/d1c/d2e/d30/d82/f95 0 2024-04-01T06:57:42.516 INFO:tasks.workunit.client.0.smithi083.stdout:1/888: write db/d1c/d1d/f6b [1183206,92347] 0 2024-04-01T06:57:42.516 INFO:tasks.workunit.client.0.smithi083.stdout:1/889: chown db/d1c/d1d/c3c 133247717 1 2024-04-01T06:57:42.518 INFO:tasks.workunit.client.0.smithi083.stdout:1/890: dread db/d1c/d2e/d30/fa6 [0,4194304] 0 2024-04-01T06:57:42.519 INFO:tasks.workunit.client.0.smithi083.stdout:7/658: getdents d0/d4/d9/d39/d67/d6d/d87/d83 0 2024-04-01T06:57:42.522 INFO:tasks.workunit.client.0.smithi083.stdout:4/740: creat d1/d4/db8/ded/de8/d88/ff2 x:0 0 0 2024-04-01T06:57:42.522 INFO:tasks.workunit.client.0.smithi083.stdout:4/741: fdatasync d1/d4/db/d5b/d62/f8b 0 2024-04-01T06:57:42.529 INFO:tasks.workunit.client.0.smithi083.stdout:8/900: mkdir d15/d1b/d39/d48/d5e/d70/d11c/d38/de7/d10a/d13d 0 2024-04-01T06:57:42.530 INFO:tasks.workunit.client.0.smithi083.stdout:9/885: dwrite d6/d32/d26/d2d/d34/dc6/d11b/f126 [0,4194304] 0 2024-04-01T06:57:42.530 INFO:tasks.workunit.client.0.smithi083.stdout:5/652: symlink d4/d9/d16/d9f/dc7/d68/ldc 0 2024-04-01T06:57:42.536 INFO:tasks.workunit.client.0.smithi083.stdout:0/929: dwrite d16/dc6/ff1 [0,4194304] 0 2024-04-01T06:57:42.544 INFO:tasks.workunit.client.0.smithi083.stdout:6/736: rmdir d9/dc/d29/d3c/d45/dc4/dcb/dce 39 2024-04-01T06:57:42.545 INFO:tasks.workunit.client.0.smithi083.stdout:6/737: dread d9/dc/d9f/fee [0,4194304] 0 2024-04-01T06:57:42.545 INFO:tasks.workunit.client.0.smithi083.stdout:6/738: dread - d9/dc/d29/d3c/d5c/d8b/fa4 zero size 2024-04-01T06:57:42.549 INFO:tasks.workunit.client.0.smithi083.stdout:1/891: creat db/d1c/df2/d12d/f13d x:0 0 0 2024-04-01T06:57:42.550 INFO:tasks.workunit.client.0.smithi083.stdout:0/930: dwrite d16/d99/d4b/d6e/f9f [0,4194304] 0 2024-04-01T06:57:42.553 INFO:tasks.workunit.client.0.smithi083.stdout:7/659: creat d0/d4/d9/d39/d67/d6d/d87/d83/d62/dc6/fe8 x:0 0 0 2024-04-01T06:57:42.553 INFO:tasks.workunit.client.0.smithi083.stdout:7/660: chown d0/d4/d9/d39/d67/dc0 3729 1 2024-04-01T06:57:42.558 INFO:tasks.workunit.client.0.smithi083.stdout:4/742: creat d1/d4/db8/ded/de8/dd5/db6/ff3 x:0 0 0 2024-04-01T06:57:42.559 INFO:tasks.workunit.client.0.smithi083.stdout:8/901: truncate d15/f27 3817620 0 2024-04-01T06:57:42.565 INFO:tasks.workunit.client.0.smithi083.stdout:9/886: creat d6/d32/d3c/d3d/d123/f12a x:0 0 0 2024-04-01T06:57:42.565 INFO:tasks.workunit.client.0.smithi083.stdout:1/892: dwrite db/d1c/d29/d33/d50/d5d/d81/f118 [0,4194304] 0 2024-04-01T06:57:42.569 INFO:tasks.workunit.client.0.smithi083.stdout:5/653: rename d4/d9/d16/d19/c40 to d4/d9/cdd 0 2024-04-01T06:57:42.578 INFO:tasks.workunit.client.0.smithi083.stdout:0/931: mkdir d16/d2e/d6c/d13c 0 2024-04-01T06:57:42.582 INFO:tasks.workunit.client.0.smithi083.stdout:7/661: unlink d0/d4/d9/d39/d67/fd6 0 2024-04-01T06:57:42.585 INFO:tasks.workunit.client.0.smithi083.stdout:4/743: creat d1/d4/db8/ded/de8/dd5/ff4 x:0 0 0 2024-04-01T06:57:42.587 INFO:tasks.workunit.client.0.smithi083.stdout:8/902: link d15/d1b/d39/d48/d5e/d70/d11c/ff9 d15/d1b/d39/d48/d5e/d70/f13e 0 2024-04-01T06:57:42.588 INFO:tasks.workunit.client.0.smithi083.stdout:8/903: write d15/d1b/d39/d48/d5e/d70/d11c/d38/d62/fd4 [199099,35539] 0 2024-04-01T06:57:42.592 INFO:tasks.workunit.client.0.smithi083.stdout:9/887: unlink d6/d32/d26/fc5 0 2024-04-01T06:57:42.593 INFO:tasks.workunit.client.0.smithi083.stdout:9/888: read d6/d32/f4f [3836401,62196] 0 2024-04-01T06:57:42.594 INFO:tasks.workunit.client.0.smithi083.stdout:4/744: dread d1/d4/db/d94/daf/dd1/d6a/f7f [0,4194304] 0 2024-04-01T06:57:42.594 INFO:tasks.workunit.client.0.smithi083.stdout:4/745: fsync d1/d4/db8/ded/de8/dd5/de9/f50 0 2024-04-01T06:57:42.594 INFO:tasks.workunit.client.0.smithi083.stdout:1/893: mknod db/d1c/d29/d33/d47/d76/db6/c13e 0 2024-04-01T06:57:42.599 INFO:tasks.workunit.client.0.smithi083.stdout:5/654: truncate d4/d9/d16/f95 3225519 0 2024-04-01T06:57:42.601 INFO:tasks.workunit.client.0.smithi083.stdout:0/932: mknod d16/d2e/d6c/d13c/c13d 0 2024-04-01T06:57:42.603 INFO:tasks.workunit.client.0.smithi083.stdout:7/662: mknod d0/d4/d9/d39/d67/d6d/d87/dda/ce9 0 2024-04-01T06:57:42.605 INFO:tasks.workunit.client.0.smithi083.stdout:0/933: dread d16/d1d/f2a [0,4194304] 0 2024-04-01T06:57:42.609 INFO:tasks.workunit.client.0.smithi083.stdout:9/889: creat d6/dfd/f12b x:0 0 0 2024-04-01T06:57:42.609 INFO:tasks.workunit.client.0.smithi083.stdout:9/890: chown d6/d32/d3c/lf1 7117944 1 2024-04-01T06:57:42.609 INFO:tasks.workunit.client.0.smithi083.stdout:9/891: readlink d6/d32/d8f/d6d/l70 0 2024-04-01T06:57:42.609 INFO:tasks.workunit.client.0.smithi083.stdout:9/892: fdatasync d6/d29/fbf 0 2024-04-01T06:57:42.609 INFO:tasks.workunit.client.0.smithi083.stdout:9/893: chown d6/d32/d26/d2d/f54 204937101 1 2024-04-01T06:57:42.609 INFO:tasks.workunit.client.0.smithi083.stdout:9/894: dread - d6/d32/d3c/d4c/fc4 zero size 2024-04-01T06:57:42.609 INFO:tasks.workunit.client.0.smithi083.stdout:9/895: dread - d6/d32/d3c/d4c/d88/df0/ffc zero size 2024-04-01T06:57:42.610 INFO:tasks.workunit.client.0.smithi083.stdout:9/896: write d6/d32/d8f/d6d/f82 [2096497,84596] 0 2024-04-01T06:57:42.612 INFO:tasks.workunit.client.0.smithi083.stdout:4/746: mkdir d1/da5/dae/df5 0 2024-04-01T06:57:42.614 INFO:tasks.workunit.client.0.smithi083.stdout:1/894: getdents db/d1c/d29/d33/d47 0 2024-04-01T06:57:42.616 INFO:tasks.workunit.client.0.smithi083.stdout:6/739: rename d9/dc/d29/d3c/fbb to d9/dc/d29/d3c/d45/dc4/ffa 0 2024-04-01T06:57:42.616 INFO:tasks.workunit.client.0.smithi083.stdout:8/904: dread d15/d21/f22 [0,4194304] 0 2024-04-01T06:57:42.617 INFO:tasks.workunit.client.0.smithi083.stdout:8/905: readlink d15/d1b/d39/d48/d5e/d70/d11c/d38/de7/lb3 0 2024-04-01T06:57:42.620 INFO:tasks.workunit.client.0.smithi083.stdout:1/895: dread db/d1c/d29/d33/d47/f98 [0,4194304] 0 2024-04-01T06:57:42.622 INFO:tasks.workunit.client.0.smithi083.stdout:1/896: dread f3 [0,4194304] 0 2024-04-01T06:57:42.623 INFO:tasks.workunit.client.0.smithi083.stdout:1/897: write db/d1c/d2e/f123 [25888,50388] 0 2024-04-01T06:57:42.627 INFO:tasks.workunit.client.0.smithi083.stdout:7/663: symlink d0/d4/dbd/lea 0 2024-04-01T06:57:42.627 INFO:tasks.workunit.client.0.smithi083.stdout:7/664: stat d0/d4/d9/d39/d67/d6d/d7d/c8d 0 2024-04-01T06:57:42.629 INFO:tasks.workunit.client.0.smithi083.stdout:0/934: link d16/d2e/d3d/d5d/ccf d16/d2e/c13e 0 2024-04-01T06:57:42.629 INFO:tasks.workunit.client.0.smithi083.stdout:0/935: chown d16/fcb 245611 1 2024-04-01T06:57:42.631 INFO:tasks.workunit.client.0.smithi083.stdout:0/936: write f14 [3788449,37104] 0 2024-04-01T06:57:42.631 INFO:tasks.workunit.client.0.smithi083.stdout:0/937: truncate d16/d99/f6d 458425 0 2024-04-01T06:57:42.632 INFO:tasks.workunit.client.0.smithi083.stdout:9/897: symlink d6/d32/d8f/l12c 0 2024-04-01T06:57:42.633 INFO:tasks.workunit.client.0.smithi083.stdout:4/747: truncate d1/d4/db/d94/daf/dd1/d6a/f7f 2780104 0 2024-04-01T06:57:42.633 INFO:tasks.workunit.client.0.smithi083.stdout:4/748: fsync d1/d47/d2a/f31 0 2024-04-01T06:57:42.636 INFO:tasks.workunit.client.0.smithi083.stdout:6/740: link f6 d9/dc/d9d/ffb 0 2024-04-01T06:57:42.637 INFO:tasks.workunit.client.0.smithi083.stdout:8/906: mkdir d15/d21/d12d/d13f 0 2024-04-01T06:57:42.640 INFO:tasks.workunit.client.0.smithi083.stdout:7/665: mknod d0/d4/ceb 0 2024-04-01T06:57:42.641 INFO:tasks.workunit.client.0.smithi083.stdout:2/776: rmdir d3/d26/d59/d2b 39 2024-04-01T06:57:42.641 INFO:tasks.workunit.client.0.smithi083.stdout:3/920: sync 2024-04-01T06:57:42.642 INFO:tasks.workunit.client.0.smithi083.stdout:3/921: write d6/d15/d2d/d2f/d42/d5c/d88/db9/ffa [1127744,15835] 0 2024-04-01T06:57:42.642 INFO:tasks.workunit.client.0.smithi083.stdout:0/938: symlink d16/d99/l13f 0 2024-04-01T06:57:42.642 INFO:tasks.workunit.client.0.smithi083.stdout:0/939: write d16/d99/d4b/d6e/f9f [4153023,92227] 0 2024-04-01T06:57:42.644 INFO:tasks.workunit.client.0.smithi083.stdout:9/898: creat d6/d32/d3c/d3d/d123/f12d x:0 0 0 2024-04-01T06:57:42.644 INFO:tasks.workunit.client.0.smithi083.stdout:9/899: fsync d6/d32/d3c/d3d/f63 0 2024-04-01T06:57:42.645 INFO:tasks.workunit.client.0.smithi083.stdout:4/749: getdents d1/d4/db8/ded/de8/dd5/dbc/dc2 0 2024-04-01T06:57:42.645 INFO:tasks.workunit.client.0.smithi083.stdout:4/750: chown d1/d4/db/fe3 443 1 2024-04-01T06:57:42.647 INFO:tasks.workunit.client.0.smithi083.stdout:6/741: rename d9/dc/d1b/d35/d48/d52/d9c/ld1 to d9/dc/d29/d3c/d5c/lfc 0 2024-04-01T06:57:42.647 INFO:tasks.workunit.client.0.smithi083.stdout:6/742: dread - d9/dc/d1b/d35/d48/d52/fea zero size 2024-04-01T06:57:42.647 INFO:tasks.workunit.client.0.smithi083.stdout:6/743: stat d9/dc/d29/d3c/d5c 0 2024-04-01T06:57:42.648 INFO:tasks.workunit.client.0.smithi083.stdout:8/907: rmdir d15/d1b/d39/d48/d5e/d70/d11c/d38/de7 39 2024-04-01T06:57:42.649 INFO:tasks.workunit.client.0.smithi083.stdout:7/666: write d0/d4/d9/d39/d67/d6d/d87/d83/d34/f94 [777681,9401] 0 2024-04-01T06:57:42.651 INFO:tasks.workunit.client.0.smithi083.stdout:2/777: creat d3/d8b/dd6/f103 x:0 0 0 2024-04-01T06:57:42.651 INFO:tasks.workunit.client.0.smithi083.stdout:2/778: stat d3/d26/d59/d2b/da3/fd9 0 2024-04-01T06:57:42.651 INFO:tasks.workunit.client.0.smithi083.stdout:8/908: dread d15/d18/d19/d1d/fbe [0,4194304] 0 2024-04-01T06:57:42.652 INFO:tasks.workunit.client.0.smithi083.stdout:3/922: creat d6/d15/d2d/d2f/d42/d83/f125 x:0 0 0 2024-04-01T06:57:42.652 INFO:tasks.workunit.client.0.smithi083.stdout:3/923: readlink d6/d15/d2d/d2f/d42/d46/dd2/l114 0 2024-04-01T06:57:42.652 INFO:tasks.workunit.client.0.smithi083.stdout:3/924: write d6/d15/d2d/d2f/d42/d46/f120 [199543,119203] 0 2024-04-01T06:57:42.652 INFO:tasks.workunit.client.0.smithi083.stdout:9/900: getdents d6/d32/d8f/d106 0 2024-04-01T06:57:42.652 INFO:tasks.workunit.client.0.smithi083.stdout:9/901: chown d6/d32/d3c/d3d/d9d/cb0 0 1 2024-04-01T06:57:42.653 INFO:tasks.workunit.client.0.smithi083.stdout:2/779: dread d3/d4d/f92 [0,4194304] 0 2024-04-01T06:57:42.654 INFO:tasks.workunit.client.0.smithi083.stdout:2/780: chown d3/d26/fe0 4978185 1 2024-04-01T06:57:42.654 INFO:tasks.workunit.client.0.smithi083.stdout:4/751: creat d1/d4/ff6 x:0 0 0 2024-04-01T06:57:42.655 INFO:tasks.workunit.client.0.smithi083.stdout:0/940: dwrite d16/d99/d4b/d6e/d96/f119 [0,4194304] 0 2024-04-01T06:57:42.655 INFO:tasks.workunit.client.0.smithi083.stdout:6/744: chown d9/dc/d29/c2b 34840612 1 2024-04-01T06:57:42.658 INFO:tasks.workunit.client.0.smithi083.stdout:7/667: mkdir d0/d4/d9/d39/d67/d6d/d87/d83/d62/dc6/dec 0 2024-04-01T06:57:42.658 INFO:tasks.workunit.client.0.smithi083.stdout:7/668: stat d0/d4/d9/d39/d67/d6d/d87 0 2024-04-01T06:57:42.659 INFO:tasks.workunit.client.0.smithi083.stdout:8/909: mknod d15/d1b/d39/d48/d5e/c140 0 2024-04-01T06:57:42.660 INFO:tasks.workunit.client.0.smithi083.stdout:2/781: creat d3/d26/d59/d2b/d9d/f104 x:0 0 0 2024-04-01T06:57:42.660 INFO:tasks.workunit.client.0.smithi083.stdout:2/782: chown d3/d71/d90/db6/dcd/dfd/d66 0 1 2024-04-01T06:57:42.660 INFO:tasks.workunit.client.0.smithi083.stdout:2/783: write d3/d26/fe0 [639484,86931] 0 2024-04-01T06:57:42.662 INFO:tasks.workunit.client.0.smithi083.stdout:4/752: mknod d1/d4/db8/ded/de8/d88/cf7 0 2024-04-01T06:57:42.665 INFO:tasks.workunit.client.0.smithi083.stdout:0/941: link d16/d2e/dba/cc7 d16/d1d/dbb/c140 0 2024-04-01T06:57:42.667 INFO:tasks.workunit.client.0.smithi083.stdout:6/745: creat d9/dc/d1b/d35/de0/ffd x:0 0 0 2024-04-01T06:57:42.668 INFO:tasks.workunit.client.0.smithi083.stdout:7/669: creat d0/d4/d9/d39/d67/d6d/d87/dda/fed x:0 0 0 2024-04-01T06:57:42.669 INFO:tasks.workunit.client.0.smithi083.stdout:9/902: dwrite d6/d32/d3c/d4c/d88/f8a [0,4194304] 0 2024-04-01T06:57:42.670 INFO:tasks.workunit.client.0.smithi083.stdout:2/784: mknod d3/d26/d59/d2b/da3/c105 0 2024-04-01T06:57:42.670 INFO:tasks.workunit.client.0.smithi083.stdout:2/785: read - d3/d71/fbd zero size 2024-04-01T06:57:42.670 INFO:tasks.workunit.client.0.smithi083.stdout:2/786: write d3/d26/f3a [5126909,54206] 0 2024-04-01T06:57:42.671 INFO:tasks.workunit.client.0.smithi083.stdout:4/753: mkdir d1/d4/db8/ded/de8/d88/da8/df8 0 2024-04-01T06:57:42.674 INFO:tasks.workunit.client.0.smithi083.stdout:0/942: mknod d16/dc6/df9/c141 0 2024-04-01T06:57:42.677 INFO:tasks.workunit.client.0.smithi083.stdout:6/746: mkdir d9/dc/d1b/df6/dfe 0 2024-04-01T06:57:42.677 INFO:tasks.workunit.client.0.smithi083.stdout:6/747: write d9/dc/d29/fa8 [2145545,36955] 0 2024-04-01T06:57:42.677 INFO:tasks.workunit.client.0.smithi083.stdout:6/748: dread d9/dc/d1b/d35/fb5 [0,4194304] 0 2024-04-01T06:57:42.678 INFO:tasks.workunit.client.0.smithi083.stdout:7/670: write d0/d4/f2a [3727058,32812] 0 2024-04-01T06:57:42.681 INFO:tasks.workunit.client.0.smithi083.stdout:8/910: rename d15/d18 to d15/d1b/d39/d48/d5e/d70/d11c/d44/d141 0 2024-04-01T06:57:42.682 INFO:tasks.workunit.client.0.smithi083.stdout:9/903: rmdir d6/d32/d26/da9 39 2024-04-01T06:57:42.682 INFO:tasks.workunit.client.0.smithi083.stdout:9/904: chown d6/d32/d26/d8e/lad 3700452 1 2024-04-01T06:57:42.684 INFO:tasks.workunit.client.0.smithi083.stdout:0/943: getdents d16/d1d/dbb 0 2024-04-01T06:57:42.685 INFO:tasks.workunit.client.0.smithi083.stdout:6/749: mkdir d9/d57/d5f/dff 0 2024-04-01T06:57:42.685 INFO:tasks.workunit.client.0.smithi083.stdout:6/750: write d9/dc/d1b/d39/d68/ff3 [77720,101237] 0 2024-04-01T06:57:42.685 INFO:tasks.workunit.client.0.smithi083.stdout:4/754: dwrite d1/d4/db/fb3 [0,4194304] 0 2024-04-01T06:57:42.686 INFO:tasks.workunit.client.0.smithi083.stdout:4/755: read d1/d4/f7e [230987,76064] 0 2024-04-01T06:57:42.686 INFO:tasks.workunit.client.0.smithi083.stdout:5/655: sync 2024-04-01T06:57:42.686 INFO:tasks.workunit.client.0.smithi083.stdout:5/656: chown d4/d9/d16/d9f/dc7/d96 0 1 2024-04-01T06:57:42.686 INFO:tasks.workunit.client.0.smithi083.stdout:5/657: chown d4/d23/d49/fda 95 1 2024-04-01T06:57:42.687 INFO:tasks.workunit.client.0.smithi083.stdout:7/671: mknod d0/d4/d9/d39/d67/d6d/d7d/d8a/cee 0 2024-04-01T06:57:42.687 INFO:tasks.workunit.client.0.smithi083.stdout:7/672: readlink d0/d4/d9/d39/d67/d6d/l7f 0 2024-04-01T06:57:42.687 INFO:tasks.workunit.client.0.smithi083.stdout:7/673: fdatasync d0/d4/d9/d39/fae 0 2024-04-01T06:57:42.688 INFO:tasks.workunit.client.0.smithi083.stdout:8/911: creat d15/d1b/d39/d48/d5e/d70/d11c/f142 x:0 0 0 2024-04-01T06:57:42.689 INFO:tasks.workunit.client.0.smithi083.stdout:9/905: link d6/d32/d26/d2d/c128 d6/d32/d8f/d6d/c12e 0 2024-04-01T06:57:42.690 INFO:tasks.workunit.client.0.smithi083.stdout:9/906: dread - d6/d32/d26/d2d/deb/f10e zero size 2024-04-01T06:57:42.691 INFO:tasks.workunit.client.0.smithi083.stdout:0/944: rmdir d16/d99/d4b/d6e/d96/dd2 39 2024-04-01T06:57:42.691 INFO:tasks.workunit.client.0.smithi083.stdout:6/751: symlink d9/dc/d1b/df6/dfe/l100 0 2024-04-01T06:57:42.693 INFO:tasks.workunit.client.0.smithi083.stdout:5/658: mknod d4/d9/d16/d1f/cde 0 2024-04-01T06:57:42.694 INFO:tasks.workunit.client.0.smithi083.stdout:7/674: truncate d0/d4/d9/d39/d67/d6d/d87/d83/f2d 1598401 0 2024-04-01T06:57:42.694 INFO:tasks.workunit.client.0.smithi083.stdout:8/912: mknod d15/d1b/d39/d48/d5e/d70/d11c/d44/d75/dab/c143 0 2024-04-01T06:57:42.695 INFO:tasks.workunit.client.0.smithi083.stdout:6/752: write d9/d57/f6e [2384306,95628] 0 2024-04-01T06:57:42.695 INFO:tasks.workunit.client.0.smithi083.stdout:6/753: readlink d9/dc/d29/d3c/d5c/d8b/l94 0 2024-04-01T06:57:42.697 INFO:tasks.workunit.client.0.smithi083.stdout:4/756: dwrite d1/d4/db8/fc3 [0,4194304] 0 2024-04-01T06:57:42.697 INFO:tasks.workunit.client.0.smithi083.stdout:4/757: fsync d1/d4/f7b 0 2024-04-01T06:57:42.697 INFO:tasks.workunit.client.0.smithi083.stdout:0/945: link d16/d2e/f139 d16/d99/d4b/d6e/f142 0 2024-04-01T06:57:42.697 INFO:tasks.workunit.client.0.smithi083.stdout:0/946: dread - d16/d99/d4b/d6e/f142 zero size 2024-04-01T06:57:42.698 INFO:tasks.workunit.client.0.smithi083.stdout:7/675: creat d0/d4/d9/d39/d67/d6d/d7d/fef x:0 0 0 2024-04-01T06:57:42.704 INFO:tasks.workunit.client.0.smithi083.stdout:7/676: creat d0/d4/dbd/db2/ff0 x:0 0 0 2024-04-01T06:57:42.705 INFO:tasks.workunit.client.0.smithi083.stdout:7/677: read d0/f2b [1090432,12009] 0 2024-04-01T06:57:42.705 INFO:tasks.workunit.client.0.smithi083.stdout:5/659: dread d4/d9/d16/d1f/d2f/f59 [0,4194304] 0 2024-04-01T06:57:42.706 INFO:tasks.workunit.client.0.smithi083.stdout:5/660: write d4/d9/fcc [922413,8925] 0 2024-04-01T06:57:42.706 INFO:tasks.workunit.client.0.smithi083.stdout:9/907: dwrite d6/f14 [0,4194304] 0 2024-04-01T06:57:42.707 INFO:tasks.workunit.client.0.smithi083.stdout:5/661: truncate d4/d9/d16/d1f/d2f/f59 1163002 0 2024-04-01T06:57:42.709 INFO:tasks.workunit.client.0.smithi083.stdout:9/908: creat d6/d32/d26/d2d/d6e/d11e/f12f x:0 0 0 2024-04-01T06:57:42.709 INFO:tasks.workunit.client.0.smithi083.stdout:5/662: write d4/f92 [901432,96836] 0 2024-04-01T06:57:42.712 INFO:tasks.workunit.client.0.smithi083.stdout:9/909: mknod d6/d32/d3c/d4c/d6b/dd3/c130 0 2024-04-01T06:57:42.712 INFO:tasks.workunit.client.0.smithi083.stdout:9/910: write d6/f116 [142827,87804] 0 2024-04-01T06:57:42.715 INFO:tasks.workunit.client.0.smithi083.stdout:6/754: dwrite d9/dc/d1b/d35/fb5 [0,4194304] 0 2024-04-01T06:57:42.715 INFO:tasks.workunit.client.0.smithi083.stdout:6/755: dread - d9/dc/d1b/d35/de0/ffd zero size 2024-04-01T06:57:42.715 INFO:tasks.workunit.client.0.smithi083.stdout:6/756: fdatasync d9/dc/d9f/fa2 0 2024-04-01T06:57:42.719 INFO:tasks.workunit.client.0.smithi083.stdout:6/757: rename d9/dc/d29/d3c/d5c/ca0 to d9/dc/d29/d3c/d5c/d8b/c101 0 2024-04-01T06:57:42.728 INFO:tasks.workunit.client.0.smithi083.stdout:7/678: dwrite d0/d4/dbd/db2/fdf [0,4194304] 0 2024-04-01T06:57:42.728 INFO:tasks.workunit.client.0.smithi083.stdout:5/663: dwrite d4/d2b/f31 [0,4194304] 0 2024-04-01T06:57:42.731 INFO:tasks.workunit.client.0.smithi083.stdout:7/679: creat d0/ff1 x:0 0 0 2024-04-01T06:57:42.731 INFO:tasks.workunit.client.0.smithi083.stdout:7/680: dread - d0/d4/d9/d39/d67/d6d/d87/fb1 zero size 2024-04-01T06:57:42.733 INFO:tasks.workunit.client.0.smithi083.stdout:4/758: dwrite d1/d4/db8/ded/de8/dd5/dbc/fdc [0,4194304] 0 2024-04-01T06:57:42.733 INFO:tasks.workunit.client.0.smithi083.stdout:5/664: creat d4/d23/d4e/d83/fdf x:0 0 0 2024-04-01T06:57:42.733 INFO:tasks.workunit.client.0.smithi083.stdout:5/665: rename d4/d9/d16 to d4/d9/d16/de0 22 2024-04-01T06:57:42.734 INFO:tasks.workunit.client.0.smithi083.stdout:7/681: dread d0/d4/d9/d39/d67/d6d/d87/d83/f35 [0,4194304] 0 2024-04-01T06:57:42.734 INFO:tasks.workunit.client.0.smithi083.stdout:9/911: dwrite d6/d32/d8f/fb7 [0,4194304] 0 2024-04-01T06:57:42.734 INFO:tasks.workunit.client.0.smithi083.stdout:9/912: dread - d6/d32/d26/d8e/fe9 zero size 2024-04-01T06:57:42.734 INFO:tasks.workunit.client.0.smithi083.stdout:9/913: readlink d6/d32/d26/d2d/d34/l3a 0 2024-04-01T06:57:42.734 INFO:tasks.workunit.client.0.smithi083.stdout:5/666: write d4/d71/f7a [2566410,110436] 0 2024-04-01T06:57:42.737 INFO:tasks.workunit.client.0.smithi083.stdout:9/914: unlink d6/d32/d3c/f9b 0 2024-04-01T06:57:42.743 INFO:tasks.workunit.client.0.smithi083.stdout:9/915: mkdir d6/d32/d26/d2d/d34/d6c/dc9/dd5/d115/d131 0 2024-04-01T06:57:42.744 INFO:tasks.workunit.client.0.smithi083.stdout:4/759: rmdir d1/d4/db 39 2024-04-01T06:57:42.745 INFO:tasks.workunit.client.0.smithi083.stdout:4/760: read d1/d4/db/f18 [2587228,67208] 0 2024-04-01T06:57:42.746 INFO:tasks.workunit.client.0.smithi083.stdout:9/916: symlink d6/d32/d26/d2d/deb/l132 0 2024-04-01T06:57:42.746 INFO:tasks.workunit.client.0.smithi083.stdout:9/917: write d6/d32/d8f/d6d/fe6 [777736,65409] 0 2024-04-01T06:57:42.747 INFO:tasks.workunit.client.0.smithi083.stdout:4/761: symlink d1/d4/db8/ded/de8/dd5/dbc/dc2/lf9 0 2024-04-01T06:57:42.747 INFO:tasks.workunit.client.0.smithi083.stdout:4/762: chown d1/d4/d6e/f78 24072 1 2024-04-01T06:57:42.747 INFO:tasks.workunit.client.0.smithi083.stdout:4/763: read - d1/d4/db/d5b/fea zero size 2024-04-01T06:57:42.748 INFO:tasks.workunit.client.0.smithi083.stdout:7/682: dwrite d0/d4/d9/d39/d67/d6d/d87/d83/f53 [4194304,4194304] 0 2024-04-01T06:57:42.750 INFO:tasks.workunit.client.0.smithi083.stdout:7/683: link d0/d4/d9/d39/d67/d6d/f5f d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/dc7/ff2 0 2024-04-01T06:57:42.752 INFO:tasks.workunit.client.0.smithi083.stdout:5/667: dwrite d4/d9/d16/d1f/d2f/f59 [0,4194304] 0 2024-04-01T06:57:42.752 INFO:tasks.workunit.client.0.smithi083.stdout:7/684: mknod d0/d4/d9/d39/d67/d6d/d87/d83/d38/cf3 0 2024-04-01T06:57:42.752 INFO:tasks.workunit.client.0.smithi083.stdout:5/668: readlink d4/d9/d16/d9f/dc7/d68/l8e 0 2024-04-01T06:57:42.753 INFO:tasks.workunit.client.0.smithi083.stdout:9/918: dread d6/d32/d3c/f66 [0,4194304] 0 2024-04-01T06:57:42.755 INFO:tasks.workunit.client.0.smithi083.stdout:7/685: unlink d0/d4/d9/d39/d48/l6e 0 2024-04-01T06:57:42.756 INFO:tasks.workunit.client.0.smithi083.stdout:5/669: creat d4/d23/dc9/fe1 x:0 0 0 2024-04-01T06:57:42.757 INFO:tasks.workunit.client.0.smithi083.stdout:5/670: write d4/d71/d7d/f8c [4002317,128759] 0 2024-04-01T06:57:42.758 INFO:tasks.workunit.client.0.smithi083.stdout:9/919: creat d6/d76/f133 x:0 0 0 2024-04-01T06:57:42.758 INFO:tasks.workunit.client.0.smithi083.stdout:9/920: read d6/d32/f36 [406889,76772] 0 2024-04-01T06:57:42.759 INFO:tasks.workunit.client.0.smithi083.stdout:7/686: mknod d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/d92/cf4 0 2024-04-01T06:57:42.760 INFO:tasks.workunit.client.0.smithi083.stdout:5/671: creat d4/d9/d16/d1f/d2f/fe2 x:0 0 0 2024-04-01T06:57:42.761 INFO:tasks.workunit.client.0.smithi083.stdout:5/672: stat d4/d2b/f31 0 2024-04-01T06:57:42.761 INFO:tasks.workunit.client.0.smithi083.stdout:9/921: creat d6/d32/d26/d2d/d34/dc6/d11b/f134 x:0 0 0 2024-04-01T06:57:42.762 INFO:tasks.workunit.client.0.smithi083.stdout:7/687: rename d0/d4/d9/d39/d67/d6d/d87/c61 to d0/d4/d9/d39/d67/d6d/d87/d83/cf5 0 2024-04-01T06:57:42.763 INFO:tasks.workunit.client.0.smithi083.stdout:5/673: mkdir d4/d23/d67/de3 0 2024-04-01T06:57:42.763 INFO:tasks.workunit.client.0.smithi083.stdout:5/674: chown d4/d9/d16/d1f/f48 1322 1 2024-04-01T06:57:42.763 INFO:tasks.workunit.client.0.smithi083.stdout:7/688: write d0/f66 [531508,128355] 0 2024-04-01T06:57:42.766 INFO:tasks.workunit.client.0.smithi083.stdout:4/764: dwrite d1/d4/db8/ded/de8/f39 [0,4194304] 0 2024-04-01T06:57:42.769 INFO:tasks.workunit.client.0.smithi083.stdout:5/675: dread d4/d2b/f24 [0,4194304] 0 2024-04-01T06:57:42.771 INFO:tasks.workunit.client.0.smithi083.stdout:4/765: unlink d1/d4/db8/ded/de8/f29 0 2024-04-01T06:57:42.774 INFO:tasks.workunit.client.0.smithi083.stdout:1/898: sync 2024-04-01T06:57:42.776 INFO:tasks.workunit.client.0.smithi083.stdout:1/899: link db/d1c/d2e/l5f db/d1c/d29/d33/d50/d5d/dad/l13f 0 2024-04-01T06:57:42.783 INFO:tasks.workunit.client.0.smithi083.stdout:5/676: dwrite d4/d55/fbf [0,4194304] 0 2024-04-01T06:57:42.786 INFO:tasks.workunit.client.0.smithi083.stdout:5/677: creat d4/d9/d16/d1f/d2f/d53/fe4 x:0 0 0 2024-04-01T06:57:42.794 INFO:tasks.workunit.client.0.smithi083.stdout:5/678: dread d4/d9/d16/d19/f4b [4194304,4194304] 0 2024-04-01T06:57:42.795 INFO:tasks.workunit.client.0.smithi083.stdout:1/900: dwrite db/d1c/d29/d33/d50/d5d/d81/f118 [0,4194304] 0 2024-04-01T06:57:42.796 INFO:tasks.workunit.client.0.smithi083.stdout:5/679: unlink d4/d9/d16/d9f/dc7/f6f 0 2024-04-01T06:57:42.796 INFO:tasks.workunit.client.0.smithi083.stdout:5/680: chown d4/d9/d16/dc1/fd6 0 1 2024-04-01T06:57:42.797 INFO:tasks.workunit.client.0.smithi083.stdout:5/681: fsync d4/d71/fae 0 2024-04-01T06:57:42.797 INFO:tasks.workunit.client.0.smithi083.stdout:1/901: chown db/d1c/d29/d33/d50/d5d/d6c/d8e/f103 223 1 2024-04-01T06:57:42.797 INFO:tasks.workunit.client.0.smithi083.stdout:1/902: readlink db/d1c/d1d/l67 0 2024-04-01T06:57:42.798 INFO:tasks.workunit.client.0.smithi083.stdout:5/682: write d4/d71/f7a [3432019,90641] 0 2024-04-01T06:57:42.798 INFO:tasks.workunit.client.0.smithi083.stdout:5/683: stat d4/d9/d16/d19/fcf 0 2024-04-01T06:57:42.798 INFO:tasks.workunit.client.0.smithi083.stdout:5/684: readlink d4/d9/d16/lca 0 2024-04-01T06:57:42.798 INFO:tasks.workunit.client.0.smithi083.stdout:5/685: chown d4/d9/d16/d9f/dc7/d68/c6d 563 1 2024-04-01T06:57:42.798 INFO:tasks.workunit.client.0.smithi083.stdout:5/686: symlink d4/d2b/d21/le5 0 2024-04-01T06:57:42.799 INFO:tasks.workunit.client.0.smithi083.stdout:5/687: write d4/d9/d16/f9e [4131589,45780] 0 2024-04-01T06:57:42.800 INFO:tasks.workunit.client.0.smithi083.stdout:5/688: creat d4/d23/dc9/fe6 x:0 0 0 2024-04-01T06:57:42.802 INFO:tasks.workunit.client.0.smithi083.stdout:5/689: dread d4/d23/d49/fa1 [0,4194304] 0 2024-04-01T06:57:42.802 INFO:tasks.workunit.client.0.smithi083.stdout:5/690: fdatasync d4/d9/d16/d1f/d2f/f46 0 2024-04-01T06:57:42.807 INFO:tasks.workunit.client.0.smithi083.stdout:5/691: truncate d4/d23/d49/fda 913396 0 2024-04-01T06:57:42.807 INFO:tasks.workunit.client.0.smithi083.stdout:5/692: write d4/d9/d16/dc1/fd6 [5011996,88780] 0 2024-04-01T06:57:42.822 INFO:tasks.workunit.client.0.smithi083.stdout:5/693: dwrite d4/d9/d16/d1f/d2f/d53/f70 [0,4194304] 0 2024-04-01T06:57:42.822 INFO:tasks.workunit.client.0.smithi083.stdout:5/694: creat d4/fe7 x:0 0 0 2024-04-01T06:57:42.823 INFO:tasks.workunit.client.0.smithi083.stdout:5/695: write d4/d55/fbf [1586519,38835] 0 2024-04-01T06:57:42.825 INFO:tasks.workunit.client.0.smithi083.stdout:5/696: mknod d4/d23/d4e/d83/dd5/ce8 0 2024-04-01T06:57:42.834 INFO:tasks.workunit.client.0.smithi083.stdout:5/697: dwrite d4/d9/d16/d9f/fa4 [0,4194304] 0 2024-04-01T06:57:42.834 INFO:tasks.workunit.client.0.smithi083.stdout:5/698: chown d4/d23/d4e/d79 169505392 1 2024-04-01T06:57:42.834 INFO:tasks.workunit.client.0.smithi083.stdout:5/699: chown d4/d9 1007728 1 2024-04-01T06:57:42.837 INFO:tasks.workunit.client.0.smithi083.stdout:5/700: symlink d4/d9/d16/d9f/dc7/le9 0 2024-04-01T06:57:42.838 INFO:tasks.workunit.client.0.smithi083.stdout:5/701: write d4/d9/d16/d1f/d2f/d53/f66 [3367128,119377] 0 2024-04-01T06:57:42.839 INFO:tasks.workunit.client.0.smithi083.stdout:5/702: symlink d4/d9/d16/d1f/d2f/d53/dbb/lea 0 2024-04-01T06:57:42.841 INFO:tasks.workunit.client.0.smithi083.stdout:5/703: rename d4/d9/cdd to d4/d71/d94/ceb 0 2024-04-01T06:57:42.842 INFO:tasks.workunit.client.0.smithi083.stdout:5/704: fdatasync d4/d9/d16/d1f/d2f/f46 0 2024-04-01T06:57:42.843 INFO:tasks.workunit.client.0.smithi083.stdout:5/705: creat d4/d9/d16/d9f/dc7/d96/fec x:0 0 0 2024-04-01T06:57:42.843 INFO:tasks.workunit.client.0.smithi083.stdout:5/706: chown d4/d9/d16/d19 355304836 1 2024-04-01T06:57:42.846 INFO:tasks.workunit.client.0.smithi083.stdout:5/707: mknod d4/d9/d16/d9f/dc7/d96/ced 0 2024-04-01T06:57:42.847 INFO:tasks.workunit.client.0.smithi083.stdout:5/708: mkdir d4/d9/d16/d1f/d2f/d53/dbb/dee 0 2024-04-01T06:57:42.848 INFO:tasks.workunit.client.0.smithi083.stdout:5/709: write d4/d2b/f24 [249750,93050] 0 2024-04-01T06:57:42.849 INFO:tasks.workunit.client.0.smithi083.stdout:5/710: mknod d4/d9/d16/d1f/d2f/cef 0 2024-04-01T06:57:42.861 INFO:tasks.workunit.client.0.smithi083.stdout:5/711: dwrite d4/d23/dc9/fe1 [0,4194304] 0 2024-04-01T06:57:42.864 INFO:tasks.workunit.client.0.smithi083.stdout:5/712: unlink d4/d9/d16/d9f/dc7/d96/ld2 0 2024-04-01T06:57:42.865 INFO:tasks.workunit.client.0.smithi083.stdout:5/713: write d4/d55/f9d [7287233,66442] 0 2024-04-01T06:57:42.867 INFO:tasks.workunit.client.0.smithi083.stdout:5/714: creat d4/d2b/da9/ff0 x:0 0 0 2024-04-01T06:57:42.867 INFO:tasks.workunit.client.0.smithi083.stdout:5/715: creat d4/d9/d16/ff1 x:0 0 0 2024-04-01T06:57:42.868 INFO:tasks.workunit.client.0.smithi083.stdout:5/716: fsync d4/f93 0 2024-04-01T06:57:42.869 INFO:tasks.workunit.client.0.smithi083.stdout:5/717: mkdir d4/d9/d16/d9f/dc7/d68/df2 0 2024-04-01T06:57:42.870 INFO:tasks.workunit.client.0.smithi083.stdout:5/718: symlink d4/d71/d94/lf3 0 2024-04-01T06:57:42.871 INFO:tasks.workunit.client.0.smithi083.stdout:5/719: mknod d4/d2b/da9/db3/cf4 0 2024-04-01T06:57:42.871 INFO:tasks.workunit.client.0.smithi083.stdout:5/720: write d4/d55/f7c [272458,77188] 0 2024-04-01T06:57:42.873 INFO:tasks.workunit.client.0.smithi083.stdout:5/721: creat d4/d23/d4e/d83/dd5/ff5 x:0 0 0 2024-04-01T06:57:42.874 INFO:tasks.workunit.client.0.smithi083.stdout:5/722: unlink d4/d9/d16/d9f/dc7/d68/ldc 0 2024-04-01T06:57:42.874 INFO:tasks.workunit.client.0.smithi083.stdout:5/723: stat d4/d55/lba 0 2024-04-01T06:57:42.875 INFO:tasks.workunit.client.0.smithi083.stdout:5/724: creat d4/d9/ff6 x:0 0 0 2024-04-01T06:57:42.876 INFO:tasks.workunit.client.0.smithi083.stdout:5/725: rmdir d4/d23/d67 39 2024-04-01T06:57:42.876 INFO:tasks.workunit.client.0.smithi083.stdout:5/726: stat d4/d23/d49/c87 0 2024-04-01T06:57:42.876 INFO:tasks.workunit.client.0.smithi083.stdout:5/727: readlink d4/d9/d16/d19/l37 0 2024-04-01T06:57:42.876 INFO:tasks.workunit.client.0.smithi083.stdout:5/728: mkdir d4/d9/d16/dc1/da0/df7 0 2024-04-01T06:57:42.877 INFO:tasks.workunit.client.0.smithi083.stdout:5/729: write d4/d2b/f39 [3358514,10938] 0 2024-04-01T06:57:42.877 INFO:tasks.workunit.client.0.smithi083.stdout:5/730: fdatasync d4/d9/d16/d1f/d2f/f60 0 2024-04-01T06:57:42.878 INFO:tasks.workunit.client.0.smithi083.stdout:5/731: mknod d4/d23/d67/de3/cf8 0 2024-04-01T06:57:42.882 INFO:tasks.workunit.client.0.smithi083.stdout:3/925: sync 2024-04-01T06:57:42.884 INFO:tasks.workunit.client.0.smithi083.stdout:3/926: creat d6/d15/d2d/d2f/d3e/f126 x:0 0 0 2024-04-01T06:57:42.884 INFO:tasks.workunit.client.0.smithi083.stdout:3/927: rmdir d6/d1e/d6f 39 2024-04-01T06:57:42.884 INFO:tasks.workunit.client.0.smithi083.stdout:3/928: chown d6/d15/la9 5089 1 2024-04-01T06:57:42.885 INFO:tasks.workunit.client.0.smithi083.stdout:3/929: fdatasync d6/d12/f2c 0 2024-04-01T06:57:42.890 INFO:tasks.workunit.client.0.smithi083.stdout:5/732: dwrite d4/d9/d16/dc1/fc2 [0,4194304] 0 2024-04-01T06:57:42.891 INFO:tasks.workunit.client.0.smithi083.stdout:5/733: stat d4/d2b/da9/db3/cc6 0 2024-04-01T06:57:42.891 INFO:tasks.workunit.client.0.smithi083.stdout:5/734: chown d4/d2b/c2a 2142 1 2024-04-01T06:57:42.891 INFO:tasks.workunit.client.0.smithi083.stdout:5/735: fdatasync d4/d9/fcc 0 2024-04-01T06:57:42.893 INFO:tasks.workunit.client.0.smithi083.stdout:5/736: link d4/d9/d16/dc1/fc2 d4/d9/d16/dc1/ff9 0 2024-04-01T06:57:42.893 INFO:tasks.workunit.client.0.smithi083.stdout:5/737: write d4/d9/d16/f95 [3736512,39708] 0 2024-04-01T06:57:42.899 INFO:tasks.workunit.client.0.smithi083.stdout:5/738: truncate d4/d9/d16/dc1/fc2 1479893 0 2024-04-01T06:57:42.899 INFO:tasks.workunit.client.0.smithi083.stdout:5/739: dread - d4/d23/d4e/d83/dd5/ff5 zero size 2024-04-01T06:57:42.900 INFO:tasks.workunit.client.0.smithi083.stdout:5/740: truncate d4/d23/d49/fda 3687010 0 2024-04-01T06:57:42.901 INFO:tasks.workunit.client.0.smithi083.stdout:5/741: write d4/d9/d16/f95 [2699480,2507] 0 2024-04-01T06:57:42.911 INFO:tasks.workunit.client.0.smithi083.stdout:5/742: dwrite d4/d9/d16/d1f/f69 [0,4194304] 0 2024-04-01T06:57:42.921 INFO:tasks.workunit.client.0.smithi083.stdout:5/743: dwrite d4/d23/d4e/fc0 [0,4194304] 0 2024-04-01T06:57:42.934 INFO:tasks.workunit.client.0.smithi083.stdout:5/744: dwrite d4/d9/d16/d1f/d2f/d53/dbb/fc3 [0,4194304] 0 2024-04-01T06:57:42.934 INFO:tasks.workunit.client.0.smithi083.stdout:5/745: write d4/d71/fce [747677,131030] 0 2024-04-01T06:57:42.935 INFO:tasks.workunit.client.0.smithi083.stdout:5/746: truncate d4/d23/d49/fda 587684 0 2024-04-01T06:57:42.936 INFO:tasks.workunit.client.0.smithi083.stdout:5/747: unlink d4/d9/d16/d1f/f44 0 2024-04-01T06:57:42.937 INFO:tasks.workunit.client.0.smithi083.stdout:5/748: fsync d4/d23/d4e/d83/dd5/ff5 0 2024-04-01T06:57:42.937 INFO:tasks.workunit.client.0.smithi083.stdout:5/749: chown d4/d23/d49/f73 1840 1 2024-04-01T06:57:42.938 INFO:tasks.workunit.client.0.smithi083.stdout:5/750: read d4/d23/d49/fda [158234,78372] 0 2024-04-01T06:57:42.939 INFO:tasks.workunit.client.0.smithi083.stdout:5/751: truncate d4/d71/f97 4398350 0 2024-04-01T06:57:42.939 INFO:tasks.workunit.client.0.smithi083.stdout:5/752: dread - d4/d9/d16/d9f/dc7/fd9 zero size 2024-04-01T06:57:42.940 INFO:tasks.workunit.client.0.smithi083.stdout:5/753: getdents d4/d23 0 2024-04-01T06:57:42.940 INFO:tasks.workunit.client.0.smithi083.stdout:5/754: write d4/d9/ff6 [5067,120475] 0 2024-04-01T06:57:42.942 INFO:tasks.workunit.client.0.smithi083.stdout:5/755: creat d4/d9/d16/d19/ffa x:0 0 0 2024-04-01T06:57:42.942 INFO:tasks.workunit.client.0.smithi083.stdout:5/756: stat d4/d23/d49/fda 0 2024-04-01T06:57:42.942 INFO:tasks.workunit.client.0.smithi083.stdout:5/757: write d4/d23/d49/fa1 [135671,32281] 0 2024-04-01T06:57:42.943 INFO:tasks.workunit.client.0.smithi083.stdout:5/758: mkdir d4/d23/dfb 0 2024-04-01T06:57:42.944 INFO:tasks.workunit.client.0.smithi083.stdout:5/759: creat d4/d9/d16/d9f/dc7/ffc x:0 0 0 2024-04-01T06:57:42.945 INFO:tasks.workunit.client.0.smithi083.stdout:5/760: symlink d4/d9/d16/d1f/d2f/d53/dbb/dee/lfd 0 2024-04-01T06:57:42.951 INFO:tasks.workunit.client.0.smithi083.stdout:5/761: dread d4/d9/d16/dc1/fd6 [0,4194304] 0 2024-04-01T06:57:42.952 INFO:tasks.workunit.client.0.smithi083.stdout:5/762: mknod d4/d9/d16/dc1/da0/dab/cfe 0 2024-04-01T06:57:42.952 INFO:tasks.workunit.client.0.smithi083.stdout:5/763: write d4/d9/d16/d1f/d2f/fe2 [512020,83647] 0 2024-04-01T06:57:42.953 INFO:tasks.workunit.client.0.smithi083.stdout:5/764: symlink d4/d9/d16/d9f/dc7/d68/df2/lff 0 2024-04-01T06:57:42.954 INFO:tasks.workunit.client.0.smithi083.stdout:5/765: mknod d4/d23/d4e/c100 0 2024-04-01T06:57:42.961 INFO:tasks.workunit.client.0.smithi083.stdout:5/766: dread d4/d71/f7a [0,4194304] 0 2024-04-01T06:57:42.962 INFO:tasks.workunit.client.0.smithi083.stdout:5/767: mknod d4/d23/d49/c101 0 2024-04-01T06:57:42.976 INFO:tasks.workunit.client.0.smithi083.stdout:5/768: dwrite d4/d71/d7d/fd3 [0,4194304] 0 2024-04-01T06:57:42.978 INFO:tasks.workunit.client.0.smithi083.stdout:5/769: mkdir d4/d9/d16/dc1/da0/df7/d102 0 2024-04-01T06:57:42.978 INFO:tasks.workunit.client.0.smithi083.stdout:5/770: fdatasync d4/d9/fcc 0 2024-04-01T06:57:42.979 INFO:tasks.workunit.client.0.smithi083.stdout:5/771: creat d4/d9/d16/d9f/dc7/d68/df2/f103 x:0 0 0 2024-04-01T06:57:42.979 INFO:tasks.workunit.client.0.smithi083.stdout:5/772: readlink d4/l2d 0 2024-04-01T06:57:42.980 INFO:tasks.workunit.client.0.smithi083.stdout:5/773: write d4/d9/d16/d1f/f48 [219564,128243] 0 2024-04-01T06:57:42.988 INFO:tasks.workunit.client.0.smithi083.stdout:0/947: sync 2024-04-01T06:57:42.989 INFO:tasks.workunit.client.0.smithi083.stdout:2/787: sync 2024-04-01T06:57:42.989 INFO:tasks.workunit.client.0.smithi083.stdout:8/913: sync 2024-04-01T06:57:42.989 INFO:tasks.workunit.client.0.smithi083.stdout:2/788: readlink d3/d26/d59/la8 0 2024-04-01T06:57:42.989 INFO:tasks.workunit.client.0.smithi083.stdout:0/948: write d16/d1d/f51 [2847149,123109] 0 2024-04-01T06:57:42.989 INFO:tasks.workunit.client.0.smithi083.stdout:0/949: truncate d16/f29 801029 0 2024-04-01T06:57:42.989 INFO:tasks.workunit.client.0.smithi083.stdout:0/950: chown d16/d1d/dbb/de9/f7d 45076 1 2024-04-01T06:57:42.989 INFO:tasks.workunit.client.0.smithi083.stdout:0/951: chown d16/d2e/d3d/d5d/ccf 1000 0 2024-04-01T06:57:42.990 INFO:tasks.workunit.client.0.smithi083.stdout:8/914: creat d15/d21/dcd/f144 x:0 0 0 2024-04-01T06:57:42.990 INFO:tasks.workunit.client.0.smithi083.stdout:8/915: readlink d15/d1b/d39/d48/d5e/d70/d11c/da2/da6/l122 0 2024-04-01T06:57:42.990 INFO:tasks.workunit.client.0.smithi083.stdout:8/916: readlink d15/d1b/d39/d48/d5e/d70/d11c/d44/d141/d1e/l72 0 2024-04-01T06:57:42.992 INFO:tasks.workunit.client.0.smithi083.stdout:2/789: rename d3/d4d/d5d/fb0 to d3/d71/df9/f106 0 2024-04-01T06:57:42.993 INFO:tasks.workunit.client.0.smithi083.stdout:2/790: fdatasync d3/d71/d90/db6/dcd/dfd/d66/dc1/fe5 0 2024-04-01T06:57:42.993 INFO:tasks.workunit.client.0.smithi083.stdout:2/791: chown d3/fe7 32 1 2024-04-01T06:57:42.993 INFO:tasks.workunit.client.0.smithi083.stdout:2/792: truncate d3/d4d/d5d/fc5 268767 0 2024-04-01T06:57:42.993 INFO:tasks.workunit.client.0.smithi083.stdout:2/793: write d3/d71/d90/db6/dcd/fd8 [856442,97991] 0 2024-04-01T06:57:42.993 INFO:tasks.workunit.client.0.smithi083.stdout:0/952: rename d16/d1d/fec to d16/d99/d4b/d68/d9d/f143 0 2024-04-01T06:57:42.995 INFO:tasks.workunit.client.0.smithi083.stdout:5/774: dwrite d4/d9/d16/d1f/d2f/d53/dbb/fc3 [4194304,4194304] 0 2024-04-01T06:57:42.995 INFO:tasks.workunit.client.0.smithi083.stdout:2/794: symlink d3/d71/d90/db6/dcd/dfd/d5f/l107 0 2024-04-01T06:57:42.995 INFO:tasks.workunit.client.0.smithi083.stdout:5/775: write d4/d55/f7c [1917184,100753] 0 2024-04-01T06:57:42.996 INFO:tasks.workunit.client.0.smithi083.stdout:0/953: creat d16/d1d/dbb/f144 x:0 0 0 2024-04-01T06:57:42.997 INFO:tasks.workunit.client.0.smithi083.stdout:2/795: mknod d3/c108 0 2024-04-01T06:57:42.998 INFO:tasks.workunit.client.0.smithi083.stdout:0/954: mknod d16/d99/d4b/d68/c145 0 2024-04-01T06:57:43.000 INFO:tasks.workunit.client.0.smithi083.stdout:2/796: creat d3/d20/d42/dee/f109 x:0 0 0 2024-04-01T06:57:43.000 INFO:tasks.workunit.client.0.smithi083.stdout:0/955: symlink d16/d2e/d5b/l146 0 2024-04-01T06:57:43.003 INFO:tasks.workunit.client.0.smithi083.stdout:0/956: rmdir d16/d2e/dba/d129 0 2024-04-01T06:57:43.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:42 smithi145 ceph-mon[47816]: pgmap v58: 97 pgs: 97 active+clean; 1.3 GiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 95 MiB/s rd, 186 MiB/s wr, 1.09k op/s 2024-04-01T06:57:43.004 INFO:tasks.workunit.client.0.smithi083.stdout:8/917: dwrite d15/d1b/d39/d48/d5e/d70/f8e [0,4194304] 0 2024-04-01T06:57:43.010 INFO:tasks.workunit.client.0.smithi083.stdout:0/957: rmdir d16/d2e/d5b/d74/dd3 39 2024-04-01T06:57:43.010 INFO:tasks.workunit.client.0.smithi083.stdout:5/776: dwrite d4/d9/f84 [0,4194304] 0 2024-04-01T06:57:43.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:42 smithi083 ceph-mon[43429]: pgmap v58: 97 pgs: 97 active+clean; 1.3 GiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 95 MiB/s rd, 186 MiB/s wr, 1.09k op/s 2024-04-01T06:57:43.013 INFO:tasks.workunit.client.0.smithi083.stdout:8/918: creat d15/d1b/d39/d48/d5e/d70/d11c/d44/d141/d19/d119/f145 x:0 0 0 2024-04-01T06:57:43.017 INFO:tasks.workunit.client.0.smithi083.stdout:5/777: dread d4/d71/d7d/fd3 [0,4194304] 0 2024-04-01T06:57:43.017 INFO:tasks.workunit.client.0.smithi083.stdout:5/778: readlink d4/l27 0 2024-04-01T06:57:43.018 INFO:tasks.workunit.client.0.smithi083.stdout:8/919: unlink d15/d21/fec 0 2024-04-01T06:57:43.021 INFO:tasks.workunit.client.0.smithi083.stdout:8/920: symlink d15/d1b/d39/d48/d5e/l146 0 2024-04-01T06:57:43.025 INFO:tasks.workunit.client.0.smithi083.stdout:0/958: dwrite d16/dc6/ffd [0,4194304] 0 2024-04-01T06:57:43.025 INFO:tasks.workunit.client.0.smithi083.stdout:0/959: write d16/d1d/dbb/de9/f7d [214286,39825] 0 2024-04-01T06:57:43.025 INFO:tasks.workunit.client.0.smithi083.stdout:0/960: chown d16/d1d/f7e 0 1 2024-04-01T06:57:43.025 INFO:tasks.workunit.client.0.smithi083.stdout:8/921: mkdir d15/d21/d147 0 2024-04-01T06:57:43.025 INFO:tasks.workunit.client.0.smithi083.stdout:8/922: truncate d15/d1b/d39/d48/d5e/d70/d11c/da2/da6/d10d/f13b 721667 0 2024-04-01T06:57:43.029 INFO:tasks.workunit.client.0.smithi083.stdout:0/961: creat d16/d99/f147 x:0 0 0 2024-04-01T06:57:43.030 INFO:tasks.workunit.client.0.smithi083.stdout:5/779: dwrite d4/d71/d7d/fd3 [0,4194304] 0 2024-04-01T06:57:43.030 INFO:tasks.workunit.client.0.smithi083.stdout:5/780: truncate d4/d23/d4e/fc0 4822474 0 2024-04-01T06:57:43.030 INFO:tasks.workunit.client.0.smithi083.stdout:8/923: mknod d15/d1b/d39/d48/d5e/d70/d11c/da2/da6/d118/c148 0 2024-04-01T06:57:43.033 INFO:tasks.workunit.client.0.smithi083.stdout:5/781: mknod d4/d23/d67/de3/c104 0 2024-04-01T06:57:43.033 INFO:tasks.workunit.client.0.smithi083.stdout:5/782: write d4/d9/d16/d19/f78 [1078288,34409] 0 2024-04-01T06:57:43.035 INFO:tasks.workunit.client.0.smithi083.stdout:8/924: rename d15/d1b/d39/d48/d5e/d70/d11c/d44/fba to d15/d21/d12d/d13f/f149 0 2024-04-01T06:57:43.035 INFO:tasks.workunit.client.0.smithi083.stdout:8/925: dread - d15/d1b/d39/d48/d5e/d70/d11c/d44/d141/d1e/f10b zero size 2024-04-01T06:57:43.037 INFO:tasks.workunit.client.0.smithi083.stdout:5/783: rename d4/d2b/f39 to d4/d9/d16/d1f/d2f/d53/f105 0 2024-04-01T06:57:43.038 INFO:tasks.workunit.client.0.smithi083.stdout:5/784: write d4/f4a [510046,14869] 0 2024-04-01T06:57:43.039 INFO:tasks.workunit.client.0.smithi083.stdout:8/926: unlink d15/d1b/d39/d80/lb8 0 2024-04-01T06:57:43.045 INFO:tasks.workunit.client.0.smithi083.stdout:0/962: dwrite d16/d2e/d3d/dda/fe0 [0,4194304] 0 2024-04-01T06:57:43.046 INFO:tasks.workunit.client.0.smithi083.stdout:5/785: mkdir d4/d71/d7d/d106 0 2024-04-01T06:57:43.046 INFO:tasks.workunit.client.0.smithi083.stdout:5/786: write d4/d9/d16/f9e [1328038,75014] 0 2024-04-01T06:57:43.049 INFO:tasks.workunit.client.0.smithi083.stdout:8/927: rmdir d15/d1b/dcb 0 2024-04-01T06:57:43.049 INFO:tasks.workunit.client.0.smithi083.stdout:8/928: write d15/f74 [137384,106883] 0 2024-04-01T06:57:43.053 INFO:tasks.workunit.client.0.smithi083.stdout:0/963: link d16/d1d/f2b d16/d99/d4b/d95/f148 0 2024-04-01T06:57:43.053 INFO:tasks.workunit.client.0.smithi083.stdout:0/964: write d16/d99/d4b/d84/fb8 [910782,96030] 0 2024-04-01T06:57:43.054 INFO:tasks.workunit.client.0.smithi083.stdout:5/787: unlink d4/d2b/l51 0 2024-04-01T06:57:43.054 INFO:tasks.workunit.client.0.smithi083.stdout:5/788: chown d4/d9/d16/dc1/da0 1646379 1 2024-04-01T06:57:43.056 INFO:tasks.workunit.client.0.smithi083.stdout:8/929: mkdir d15/d1b/d39/d48/d5e/d70/d11c/d38/d62/df4/d14a 0 2024-04-01T06:57:43.056 INFO:tasks.workunit.client.0.smithi083.stdout:8/930: fdatasync d15/d1b/d39/d48/d5e/d70/d11c/d38/d62/f4a 0 2024-04-01T06:57:43.056 INFO:tasks.workunit.client.0.smithi083.stdout:8/931: chown d15/d1b/d39/d48/d5e/d70/d11c/cdd 46202197 1 2024-04-01T06:57:43.057 INFO:tasks.workunit.client.0.smithi083.stdout:0/965: link d16/d2e/d5b/cb4 d16/d2e/d5b/d74/dd3/d10d/c149 0 2024-04-01T06:57:43.058 INFO:tasks.workunit.client.0.smithi083.stdout:8/932: symlink d15/d1b/d39/d48/d5e/d70/d11c/d44/d97/l14b 0 2024-04-01T06:57:43.058 INFO:tasks.workunit.client.0.smithi083.stdout:8/933: read d15/d1b/d39/d48/d5e/d70/d11c/d44/fc2 [80656,41288] 0 2024-04-01T06:57:43.058 INFO:tasks.workunit.client.0.smithi083.stdout:8/934: fdatasync d15/d1b/d39/d48/d5e/d70/f86 0 2024-04-01T06:57:43.060 INFO:tasks.workunit.client.0.smithi083.stdout:8/935: mknod d15/d1b/d39/d48/d5e/d70/d11c/d44/d141/d19/d119/c14c 0 2024-04-01T06:57:43.061 INFO:tasks.workunit.client.0.smithi083.stdout:5/789: dread d4/d55/f7c [0,4194304] 0 2024-04-01T06:57:43.065 INFO:tasks.workunit.client.0.smithi083.stdout:8/936: mkdir d15/d1b/d39/d48/d5e/d70/d11c/d44/d141/d14d 0 2024-04-01T06:57:43.066 INFO:tasks.workunit.client.0.smithi083.stdout:8/937: write d15/dda/f12a [2123908,65527] 0 2024-04-01T06:57:43.071 INFO:tasks.workunit.client.0.smithi083.stdout:8/938: dread d15/f74 [0,4194304] 0 2024-04-01T06:57:43.072 INFO:tasks.workunit.client.0.smithi083.stdout:8/939: truncate d15/d1b/ffc 686807 0 2024-04-01T06:57:43.073 INFO:tasks.workunit.client.0.smithi083.stdout:0/966: dwrite d16/dc6/ffd [0,4194304] 0 2024-04-01T06:57:43.073 INFO:tasks.workunit.client.0.smithi083.stdout:0/967: dread - d16/d1d/d8d/f105 zero size 2024-04-01T06:57:43.078 INFO:tasks.workunit.client.0.smithi083.stdout:5/790: dwrite d4/d9/d16/d9f/dc7/d68/df2/f103 [0,4194304] 0 2024-04-01T06:57:43.078 INFO:tasks.workunit.client.0.smithi083.stdout:0/968: rename d16/d2e/d3d/ff7 to d16/d1d/dbb/de9/f14a 0 2024-04-01T06:57:43.078 INFO:tasks.workunit.client.0.smithi083.stdout:0/969: read d16/f34 [1443559,18633] 0 2024-04-01T06:57:43.079 INFO:tasks.workunit.client.0.smithi083.stdout:8/940: creat d15/d1b/d39/d48/d5e/d70/d11c/d38/de7/d10a/d13d/f14e x:0 0 0 2024-04-01T06:57:43.079 INFO:tasks.workunit.client.0.smithi083.stdout:5/791: dread d4/f4a [0,4194304] 0 2024-04-01T06:57:43.079 INFO:tasks.workunit.client.0.smithi083.stdout:8/941: dread d15/d1b/d39/d48/d5e/d70/d11c/da2/da6/d10d/f13b [0,4194304] 0 2024-04-01T06:57:43.081 INFO:tasks.workunit.client.0.smithi083.stdout:0/970: mkdir d16/d1d/d8d/dbf/d14b 0 2024-04-01T06:57:43.081 INFO:tasks.workunit.client.0.smithi083.stdout:8/942: write d15/d1b/d39/d48/d5e/d70/d11c/d38/d62/df4/f105 [1858414,127347] 0 2024-04-01T06:57:43.083 INFO:tasks.workunit.client.0.smithi083.stdout:5/792: mkdir d4/d9/d16/d9f/dc7/d68/df2/d107 0 2024-04-01T06:57:43.083 INFO:tasks.workunit.client.0.smithi083.stdout:4/766: sync 2024-04-01T06:57:43.083 INFO:tasks.workunit.client.0.smithi083.stdout:1/903: sync 2024-04-01T06:57:43.083 INFO:tasks.workunit.client.0.smithi083.stdout:9/922: sync 2024-04-01T06:57:43.083 INFO:tasks.workunit.client.0.smithi083.stdout:6/758: sync 2024-04-01T06:57:43.083 INFO:tasks.workunit.client.0.smithi083.stdout:7/689: sync 2024-04-01T06:57:43.083 INFO:tasks.workunit.client.0.smithi083.stdout:6/759: stat d9/dc/d1b/d4c/d99 0 2024-04-01T06:57:43.084 INFO:tasks.workunit.client.0.smithi083.stdout:9/923: write d6/d32/d8f/d6d/fe8 [3948727,33714] 0 2024-04-01T06:57:43.085 INFO:tasks.workunit.client.0.smithi083.stdout:4/767: write d1/da5/dae/fb1 [1888653,123297] 0 2024-04-01T06:57:43.085 INFO:tasks.workunit.client.0.smithi083.stdout:0/971: mknod d16/d2e/dba/d12d/c14c 0 2024-04-01T06:57:43.085 INFO:tasks.workunit.client.0.smithi083.stdout:0/972: truncate d16/d2e/d3d/f8f 1552125 0 2024-04-01T06:57:43.086 INFO:tasks.workunit.client.0.smithi083.stdout:0/973: write d16/d99/d4b/d68/d9d/f143 [759986,60261] 0 2024-04-01T06:57:43.086 INFO:tasks.workunit.client.0.smithi083.stdout:5/793: unlink d4/d9/d16/d9f/dc7/fd9 0 2024-04-01T06:57:43.086 INFO:tasks.workunit.client.0.smithi083.stdout:5/794: dread - d4/d23/d4e/d79/fad zero size 2024-04-01T06:57:43.087 INFO:tasks.workunit.client.0.smithi083.stdout:5/795: write d4/d23/d4e/d83/fdf [334837,85379] 0 2024-04-01T06:57:43.088 INFO:tasks.workunit.client.0.smithi083.stdout:1/904: mknod db/d1c/d29/d33/d50/d5d/d6c/d128/c140 0 2024-04-01T06:57:43.089 INFO:tasks.workunit.client.0.smithi083.stdout:6/760: unlink d9/dc/d1b/d39/l86 0 2024-04-01T06:57:43.089 INFO:tasks.workunit.client.0.smithi083.stdout:7/690: rmdir d0/d4 39 2024-04-01T06:57:43.091 INFO:tasks.workunit.client.0.smithi083.stdout:4/768: creat d1/da5/dae/dda/ffa x:0 0 0 2024-04-01T06:57:43.094 INFO:tasks.workunit.client.0.smithi083.stdout:0/974: unlink d16/d1d/d8d/f105 0 2024-04-01T06:57:43.094 INFO:tasks.workunit.client.0.smithi083.stdout:1/905: dread db/d1c/d29/d33/d50/d4d/f134 [0,4194304] 0 2024-04-01T06:57:43.095 INFO:tasks.workunit.client.0.smithi083.stdout:5/796: mknod d4/d71/d94/c108 0 2024-04-01T06:57:43.099 INFO:tasks.workunit.client.0.smithi083.stdout:7/691: creat d0/d4/d9/d39/d67/d6d/d7d/d8a/dce/ff6 x:0 0 0 2024-04-01T06:57:43.099 INFO:tasks.workunit.client.0.smithi083.stdout:7/692: readlink d0/d4/d9/d39/d67/d6d/l7f 0 2024-04-01T06:57:43.101 INFO:tasks.workunit.client.0.smithi083.stdout:8/943: truncate d15/d1b/d39/d48/d5e/f73 4247022 0 2024-04-01T06:57:43.101 INFO:tasks.workunit.client.0.smithi083.stdout:0/975: dread d16/d1d/f37 [0,4194304] 0 2024-04-01T06:57:43.102 INFO:tasks.workunit.client.0.smithi083.stdout:0/976: chown d16/d2e/d3d/l7a 317512 1 2024-04-01T06:57:43.102 INFO:tasks.workunit.client.0.smithi083.stdout:6/761: rmdir d9/dc/d29/d3c/d5c/d8b 39 2024-04-01T06:57:43.103 INFO:tasks.workunit.client.0.smithi083.stdout:4/769: truncate d1/d4/f4f 807490 0 2024-04-01T06:57:43.103 INFO:tasks.workunit.client.0.smithi083.stdout:4/770: dread - d1/d4/db/f9f zero size 2024-04-01T06:57:43.103 INFO:tasks.workunit.client.0.smithi083.stdout:1/906: creat db/d1c/d49/f141 x:0 0 0 2024-04-01T06:57:43.105 INFO:tasks.workunit.client.0.smithi083.stdout:7/693: rmdir d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/dc7 39 2024-04-01T06:57:43.107 INFO:tasks.workunit.client.0.smithi083.stdout:0/977: mknod d16/d2e/d5b/d74/c14d 0 2024-04-01T06:57:43.107 INFO:tasks.workunit.client.0.smithi083.stdout:0/978: chown d16/d2e/d3d/d7c/f115 12 1 2024-04-01T06:57:43.107 INFO:tasks.workunit.client.0.smithi083.stdout:0/979: readlink d16/d2e/d3d/l45 0 2024-04-01T06:57:43.107 INFO:tasks.workunit.client.0.smithi083.stdout:0/980: fsync d16/d99/fb3 0 2024-04-01T06:57:43.108 INFO:tasks.workunit.client.0.smithi083.stdout:6/762: creat d9/d57/d5f/dff/f102 x:0 0 0 2024-04-01T06:57:43.110 INFO:tasks.workunit.client.0.smithi083.stdout:1/907: link db/d1c/d29/fec db/d1c/d29/d33/d50/d5d/dad/dbf/f142 0 2024-04-01T06:57:43.111 INFO:tasks.workunit.client.0.smithi083.stdout:7/694: creat d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/dc7/ff7 x:0 0 0 2024-04-01T06:57:43.113 INFO:tasks.workunit.client.0.smithi083.stdout:5/797: dwrite d4/d9/d16/dc1/fd6 [0,4194304] 0 2024-04-01T06:57:43.113 INFO:tasks.workunit.client.0.smithi083.stdout:5/798: readlink d4/d9/d16/d1f/d2f/d53/dbb/dee/lfd 0 2024-04-01T06:57:43.117 INFO:tasks.workunit.client.0.smithi083.stdout:1/908: rmdir db/d61 39 2024-04-01T06:57:43.117 INFO:tasks.workunit.client.0.smithi083.stdout:1/909: write db/d1c/d29/d33/d50/faa [5120266,73782] 0 2024-04-01T06:57:43.119 INFO:tasks.workunit.client.0.smithi083.stdout:5/799: mknod d4/d9/d16/d9f/dc7/d68/c109 0 2024-04-01T06:57:43.121 INFO:tasks.workunit.client.0.smithi083.stdout:1/910: creat db/d1c/d29/d33/d50/d5d/dad/dbf/f143 x:0 0 0 2024-04-01T06:57:43.122 INFO:tasks.workunit.client.0.smithi083.stdout:5/800: mknod d4/d2b/c10a 0 2024-04-01T06:57:43.123 INFO:tasks.workunit.client.0.smithi083.stdout:5/801: read d4/f4a [429890,65499] 0 2024-04-01T06:57:43.123 INFO:tasks.workunit.client.0.smithi083.stdout:5/802: chown d4/d9/d16/d1f/d2f/d53 285253 1 2024-04-01T06:57:43.123 INFO:tasks.workunit.client.0.smithi083.stdout:4/771: dwrite d1/d4/f25 [4194304,4194304] 0 2024-04-01T06:57:43.123 INFO:tasks.workunit.client.0.smithi083.stdout:5/803: readlink d4/d71/d7d/ld1 0 2024-04-01T06:57:43.124 INFO:tasks.workunit.client.0.smithi083.stdout:1/911: link db/d1c/d2e/d30/l31 db/d1c/d1d/d8b/l144 0 2024-04-01T06:57:43.126 INFO:tasks.workunit.client.0.smithi083.stdout:4/772: symlink d1/d4/db/d94/daf/dd1/d6a/lfb 0 2024-04-01T06:57:43.131 INFO:tasks.workunit.client.0.smithi083.stdout:1/912: rename db/d1c/d29/d33/d50/fa2 to db/d1c/d29/d33/d47/de4/f145 0 2024-04-01T06:57:43.131 INFO:tasks.workunit.client.0.smithi083.stdout:1/913: chown db/d1c/d29/d33/d50/d5d/dad 2065340 1 2024-04-01T06:57:43.131 INFO:tasks.workunit.client.0.smithi083.stdout:5/804: dread d4/d23/d4e/fc0 [0,4194304] 0 2024-04-01T06:57:43.131 INFO:tasks.workunit.client.0.smithi083.stdout:5/805: truncate d4/d71/fce 1058660 0 2024-04-01T06:57:43.132 INFO:tasks.workunit.client.0.smithi083.stdout:8/944: dwrite d15/d1b/d39/d48/d5e/d70/d11c/d38/f136 [0,4194304] 0 2024-04-01T06:57:43.132 INFO:tasks.workunit.client.0.smithi083.stdout:8/945: readlink d15/d1b/d39/d48/d5e/d70/d11c/da2/d6f/l115 0 2024-04-01T06:57:43.132 INFO:tasks.workunit.client.0.smithi083.stdout:7/695: dwrite d0/d4/dbd/faf [0,4194304] 0 2024-04-01T06:57:43.133 INFO:tasks.workunit.client.0.smithi083.stdout:8/946: mkdir d15/d1b/d120/d14f 0 2024-04-01T06:57:43.136 INFO:tasks.workunit.client.0.smithi083.stdout:0/981: dwrite d16/d2e/d5b/f134 [0,4194304] 0 2024-04-01T06:57:43.138 INFO:tasks.workunit.client.0.smithi083.stdout:5/806: rmdir d4/d9/d16/d1f 39 2024-04-01T06:57:43.138 INFO:tasks.workunit.client.0.smithi083.stdout:5/807: write d4/d23/d4e/d83/dd5/ff5 [412711,105898] 0 2024-04-01T06:57:43.140 INFO:tasks.workunit.client.0.smithi083.stdout:5/808: write d4/d23/d4e/d83/dd5/ff5 [163261,50994] 0 2024-04-01T06:57:43.140 INFO:tasks.workunit.client.0.smithi083.stdout:5/809: stat d4/d9/d16 0 2024-04-01T06:57:43.140 INFO:tasks.workunit.client.0.smithi083.stdout:4/773: dwrite d1/d4/f7e [0,4194304] 0 2024-04-01T06:57:43.140 INFO:tasks.workunit.client.0.smithi083.stdout:4/774: write d1/d4/ff6 [744239,89711] 0 2024-04-01T06:57:43.140 INFO:tasks.workunit.client.0.smithi083.stdout:4/775: stat d1/l60 0 2024-04-01T06:57:43.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:42 smithi153 ceph-mon[48187]: pgmap v58: 97 pgs: 97 active+clean; 1.3 GiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 95 MiB/s rd, 186 MiB/s wr, 1.09k op/s 2024-04-01T06:57:43.142 INFO:tasks.workunit.client.0.smithi083.stdout:7/696: creat d0/d4/d9/d39/d67/d6d/d87/d83/d38/ff8 x:0 0 0 2024-04-01T06:57:43.142 INFO:tasks.workunit.client.0.smithi083.stdout:7/697: write d0/d4/d9/f81 [1054986,7890] 0 2024-04-01T06:57:43.142 INFO:tasks.workunit.client.0.smithi083.stdout:8/947: creat d15/d21/dbc/d12b/f150 x:0 0 0 2024-04-01T06:57:43.145 INFO:tasks.workunit.client.0.smithi083.stdout:0/982: creat d16/d1d/d8d/d12e/f14e x:0 0 0 2024-04-01T06:57:43.145 INFO:tasks.workunit.client.0.smithi083.stdout:1/914: dwrite db/d1c/d1d/db4/ddf/d117/f104 [0,4194304] 0 2024-04-01T06:57:43.146 INFO:tasks.workunit.client.0.smithi083.stdout:1/915: chown db/d1c/d29/d33/d50/d5d/dad/d106 51858963 1 2024-04-01T06:57:43.146 INFO:tasks.workunit.client.0.smithi083.stdout:5/810: creat d4/d55/f10b x:0 0 0 2024-04-01T06:57:43.147 INFO:tasks.workunit.client.0.smithi083.stdout:5/811: dread - d4/d23/fd7 zero size 2024-04-01T06:57:43.149 INFO:tasks.workunit.client.0.smithi083.stdout:7/698: unlink d0/d4/d9/d39/d67/d6d/d87/d83/d38/cf3 0 2024-04-01T06:57:43.151 INFO:tasks.workunit.client.0.smithi083.stdout:8/948: creat d15/d1b/d39/d48/d5e/d70/f151 x:0 0 0 2024-04-01T06:57:43.151 INFO:tasks.workunit.client.0.smithi083.stdout:8/949: chown d15/d1b/d39/d48/d5e/d70/d11c/d44/d141/d19/l26 1369849647 1 2024-04-01T06:57:43.152 INFO:tasks.workunit.client.0.smithi083.stdout:3/930: sync 2024-04-01T06:57:43.152 INFO:tasks.workunit.client.0.smithi083.stdout:3/931: write d6/d15/d2d/d2f/dc7/ff9 [9289885,90834] 0 2024-04-01T06:57:43.152 INFO:tasks.workunit.client.0.smithi083.stdout:8/950: read d15/f74 [57708,35292] 0 2024-04-01T06:57:43.152 INFO:tasks.workunit.client.0.smithi083.stdout:8/951: write d15/d1b/d39/d48/d5e/d70/d11c/d38/d62/fc0 [5122283,26564] 0 2024-04-01T06:57:43.153 INFO:tasks.workunit.client.0.smithi083.stdout:4/776: dwrite d1/da5/fe5 [0,4194304] 0 2024-04-01T06:57:43.154 INFO:tasks.workunit.client.0.smithi083.stdout:1/916: symlink db/d1c/d29/d33/d50/d5d/dad/l146 0 2024-04-01T06:57:43.156 INFO:tasks.workunit.client.0.smithi083.stdout:5/812: creat d4/d9/d16/d9f/dc7/d96/db2/f10c x:0 0 0 2024-04-01T06:57:43.157 INFO:tasks.workunit.client.0.smithi083.stdout:5/813: dread d4/d71/fae [0,4194304] 0 2024-04-01T06:57:43.157 INFO:tasks.workunit.client.0.smithi083.stdout:5/814: dread - d4/fe7 zero size 2024-04-01T06:57:43.158 INFO:tasks.workunit.client.0.smithi083.stdout:5/815: dread - d4/d9/d16/ff1 zero size 2024-04-01T06:57:43.158 INFO:tasks.workunit.client.0.smithi083.stdout:7/699: creat d0/d4/d9/d39/d67/d6d/d87/d83/d38/dbf/de7/ff9 x:0 0 0 2024-04-01T06:57:43.158 INFO:tasks.workunit.client.0.smithi083.stdout:7/700: write d0/d4/d9/d39/f90 [743113,124073] 0 2024-04-01T06:57:43.158 INFO:tasks.workunit.client.0.smithi083.stdout:0/983: dwrite d16/d99/d4b/d68/f86 [0,4194304] 0 2024-04-01T06:57:43.159 INFO:tasks.workunit.client.0.smithi083.stdout:3/932: mkdir d6/d1e/d4a/dfd/d127 0 2024-04-01T06:57:43.162 INFO:tasks.workunit.client.0.smithi083.stdout:8/952: dread d15/d1b/d39/d48/d5e/d70/d11c/ff9 [0,4194304] 0 2024-04-01T06:57:43.163 INFO:tasks.workunit.client.0.smithi083.stdout:8/953: truncate d15/d1b/d39/d48/d5e/d70/f77 312498 0 2024-04-01T06:57:43.163 INFO:tasks.workunit.client.0.smithi083.stdout:8/954: read d15/d1b/d39/d48/d5e/d70/d11c/d44/d141/d19/f5d [3640091,105526] 0 2024-04-01T06:57:43.163 INFO:tasks.workunit.client.0.smithi083.stdout:8/955: chown l6 314 1 2024-04-01T06:57:43.164 INFO:tasks.workunit.client.0.smithi083.stdout:4/777: unlink d1/d47/c2d 0 2024-04-01T06:57:43.165 INFO:tasks.workunit.client.0.smithi083.stdout:1/917: dread db/d1c/d1d/f11c [0,4194304] 0 2024-04-01T06:57:43.166 INFO:tasks.workunit.client.0.smithi083.stdout:5/816: symlink d4/d71/d7d/l10d 0 2024-04-01T06:57:43.166 INFO:tasks.workunit.client.0.smithi083.stdout:5/817: truncate d4/f4a 845314 0 2024-04-01T06:57:43.167 INFO:tasks.workunit.client.0.smithi083.stdout:7/701: creat d0/d4/d9/d39/d67/d6d/d87/d83/ffa x:0 0 0 2024-04-01T06:57:43.167 INFO:tasks.workunit.client.0.smithi083.stdout:0/984: rmdir d16/dc6 39 2024-04-01T06:57:43.169 INFO:tasks.workunit.client.0.smithi083.stdout:3/933: mknod d6/c128 0 2024-04-01T06:57:43.170 INFO:tasks.workunit.client.0.smithi083.stdout:8/956: fdatasync d15/d1b/d39/d48/d5e/ff5 0 2024-04-01T06:57:43.171 INFO:tasks.workunit.client.0.smithi083.stdout:1/918: rename db/d1c/d29/d33/d50/d5d/dad/l13f to db/l147 0 2024-04-01T06:57:43.173 INFO:tasks.workunit.client.0.smithi083.stdout:5/818: rmdir d4/d9/d16/dc1/da0/dab 39 2024-04-01T06:57:43.173 INFO:tasks.workunit.client.0.smithi083.stdout:4/778: dread d1/d4/f7e [0,4194304] 0 2024-04-01T06:57:43.173 INFO:tasks.workunit.client.0.smithi083.stdout:5/819: write d4/d9/d16/d1f/d2f/d53/f105 [855743,9931] 0 2024-04-01T06:57:43.173 INFO:tasks.workunit.client.0.smithi083.stdout:0/985: symlink d16/d99/d4b/d11b/l14f 0 2024-04-01T06:57:43.177 INFO:tasks.workunit.client.0.smithi083.stdout:3/934: mkdir d6/d1e/d6f/daf/dc1/d129 0 2024-04-01T06:57:43.177 INFO:tasks.workunit.client.0.smithi083.stdout:8/957: creat d15/d1b/d120/d14f/f152 x:0 0 0 2024-04-01T06:57:43.177 INFO:tasks.workunit.client.0.smithi083.stdout:1/919: mkdir db/d1c/d29/d33/d47/d76/d148 0 2024-04-01T06:57:43.178 INFO:tasks.workunit.client.0.smithi083.stdout:4/779: mkdir d1/da5/dfc 0 2024-04-01T06:57:43.178 INFO:tasks.workunit.client.0.smithi083.stdout:7/702: dread d0/f3 [4194304,4194304] 0 2024-04-01T06:57:43.178 INFO:tasks.workunit.client.0.smithi083.stdout:0/986: mknod d16/d2e/d5b/d74/c150 0 2024-04-01T06:57:43.180 INFO:tasks.workunit.client.0.smithi083.stdout:3/935: creat d6/d15/f12a x:0 0 0 2024-04-01T06:57:43.181 INFO:tasks.workunit.client.0.smithi083.stdout:8/958: symlink d15/d21/dcd/d12f/l153 0 2024-04-01T06:57:43.181 INFO:tasks.workunit.client.0.smithi083.stdout:8/959: readlink d15/d1b/d39/d48/d5e/d70/d11c/da2/l107 0 2024-04-01T06:57:43.182 INFO:tasks.workunit.client.0.smithi083.stdout:1/920: mkdir db/d1c/d29/d33/d50/d121/d149 0 2024-04-01T06:57:43.186 INFO:tasks.workunit.client.0.smithi083.stdout:4/780: link d1/d4/db8/ded/ccb d1/d4/db/d94/daf/dd1/d6a/cfd 0 2024-04-01T06:57:43.187 INFO:tasks.workunit.client.0.smithi083.stdout:7/703: symlink d0/d4/d9/d39/d67/d6d/d87/d83/d38/de2/lfb 0 2024-04-01T06:57:43.188 INFO:tasks.workunit.client.0.smithi083.stdout:1/921: mkdir db/d1c/d14a 0 2024-04-01T06:57:43.188 INFO:tasks.workunit.client.0.smithi083.stdout:1/922: chown db/d1c/d29/d33/d50/l11f 41574 1 2024-04-01T06:57:43.189 INFO:tasks.workunit.client.0.smithi083.stdout:4/781: symlink d1/d4/db/dba/dcd/lfe 0 2024-04-01T06:57:43.189 INFO:tasks.workunit.client.0.smithi083.stdout:4/782: truncate d1/d4/db/f9f 818301 0 2024-04-01T06:57:43.190 INFO:tasks.workunit.client.0.smithi083.stdout:7/704: creat d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/db8/ffc x:0 0 0 2024-04-01T06:57:43.191 INFO:tasks.workunit.client.0.smithi083.stdout:1/923: mkdir db/d1c/d1d/db4/ddf/d14b 0 2024-04-01T06:57:43.196 INFO:tasks.workunit.client.0.smithi083.stdout:4/783: dread d1/d4/db/f18 [0,4194304] 0 2024-04-01T06:57:43.196 INFO:tasks.workunit.client.0.smithi083.stdout:4/784: write d1/d47/d2a/f31 [4459668,95792] 0 2024-04-01T06:57:43.196 INFO:tasks.workunit.client.0.smithi083.stdout:7/705: readlink d0/d4/lde 0 2024-04-01T06:57:43.197 INFO:tasks.workunit.client.0.smithi083.stdout:7/706: chown d0/d7c/c86 10266037 1 2024-04-01T06:57:43.197 INFO:tasks.workunit.client.0.smithi083.stdout:7/707: dread - d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/fc8 zero size 2024-04-01T06:57:43.197 INFO:tasks.workunit.client.0.smithi083.stdout:7/708: dread - d0/d4/dbd/db2/ff0 zero size 2024-04-01T06:57:43.197 INFO:tasks.workunit.client.0.smithi083.stdout:0/987: dwrite d16/d2e/d3d/f4e [4194304,4194304] 0 2024-04-01T06:57:43.197 INFO:tasks.workunit.client.0.smithi083.stdout:1/924: mknod db/d1c/d1d/db4/ddf/c14c 0 2024-04-01T06:57:43.198 INFO:tasks.workunit.client.0.smithi083.stdout:7/709: truncate d0/d4/d9/d39/d67/d6d/d87/d83/f72 596843 0 2024-04-01T06:57:43.200 INFO:tasks.workunit.client.0.smithi083.stdout:1/925: read db/d1c/d29/f3e [2086105,85850] 0 2024-04-01T06:57:43.200 INFO:tasks.workunit.client.0.smithi083.stdout:1/926: chown db/d1c/d2e/l5f 687 1 2024-04-01T06:57:43.200 INFO:tasks.workunit.client.0.smithi083.stdout:7/710: unlink d0/d7a/fa5 0 2024-04-01T06:57:43.200 INFO:tasks.workunit.client.0.smithi083.stdout:3/936: dwrite f0 [0,4194304] 0 2024-04-01T06:57:43.200 INFO:tasks.workunit.client.0.smithi083.stdout:3/937: fsync d6/d15/d2d/d2f/d42/d46/d55/f103 0 2024-04-01T06:57:43.201 INFO:tasks.workunit.client.0.smithi083.stdout:1/927: mknod db/d1c/d29/d33/d47/d76/d148/c14d 0 2024-04-01T06:57:43.201 INFO:tasks.workunit.client.0.smithi083.stdout:1/928: fdatasync db/d1c/d1d/d8b/f9a 0 2024-04-01T06:57:43.202 INFO:tasks.workunit.client.0.smithi083.stdout:7/711: creat d0/d4/d9/d39/d67/d6d/d87/d83/d38/dbf/ffd x:0 0 0 2024-04-01T06:57:43.202 INFO:tasks.workunit.client.0.smithi083.stdout:8/960: dwrite d15/d1b/d39/f130 [0,4194304] 0 2024-04-01T06:57:43.205 INFO:tasks.workunit.client.0.smithi083.stdout:3/938: write d6/d15/d2d/d2f/dc7/ff9 [6909154,114814] 0 2024-04-01T06:57:43.209 INFO:tasks.workunit.client.0.smithi083.stdout:4/785: dwrite d1/d4/db8/ded/de8/dd5/de9/f43 [0,4194304] 0 2024-04-01T06:57:43.209 INFO:tasks.workunit.client.0.smithi083.stdout:0/988: dwrite d16/d99/d4b/d84/ff6 [0,4194304] 0 2024-04-01T06:57:43.210 INFO:tasks.workunit.client.0.smithi083.stdout:8/961: creat d15/d1b/d120/d14f/f154 x:0 0 0 2024-04-01T06:57:43.211 INFO:tasks.workunit.client.0.smithi083.stdout:8/962: chown d15/d1b/d39/d48/d5e/d70/d11c/d38/d62/l7f 16444033 1 2024-04-01T06:57:43.211 INFO:tasks.workunit.client.0.smithi083.stdout:3/939: mkdir d6/d15/d2d/d2f/d53/de5/df4/d12b 0 2024-04-01T06:57:43.211 INFO:tasks.workunit.client.0.smithi083.stdout:3/940: fsync d6/d15/d2d/d2f/d42/d5c/f78 0 2024-04-01T06:57:43.212 INFO:tasks.workunit.client.0.smithi083.stdout:3/941: write d6/d15/d2d/d2f/d53/de5/df4/f100 [428215,34759] 0 2024-04-01T06:57:43.214 INFO:tasks.workunit.client.0.smithi083.stdout:7/712: rename d0/d4/f58 to d0/d7c/ffe 0 2024-04-01T06:57:43.216 INFO:tasks.workunit.client.0.smithi083.stdout:1/929: dwrite db/d1c/d2e/d30/fca [0,4194304] 0 2024-04-01T06:57:43.217 INFO:tasks.workunit.client.0.smithi083.stdout:1/930: read db/d1c/d1d/db4/ddf/f127 [1845821,110410] 0 2024-04-01T06:57:43.218 INFO:tasks.workunit.client.0.smithi083.stdout:7/713: readlink d0/d4/l2e 0 2024-04-01T06:57:43.218 INFO:tasks.workunit.client.0.smithi083.stdout:4/786: dread d1/d4/db/f11 [0,4194304] 0 2024-04-01T06:57:43.222 INFO:tasks.workunit.client.0.smithi083.stdout:1/931: symlink db/d1c/d29/d33/d47/d76/l14e 0 2024-04-01T06:57:43.222 INFO:tasks.workunit.client.0.smithi083.stdout:1/932: chown db/d1c/d2e/d30/d82/f95 3266053 1 2024-04-01T06:57:43.224 INFO:tasks.workunit.client.0.smithi083.stdout:4/787: creat d1/d4/db/d94/daf/dd1/fff x:0 0 0 2024-04-01T06:57:43.225 INFO:tasks.workunit.client.0.smithi083.stdout:0/989: dwrite d16/f52 [4194304,4194304] 0 2024-04-01T06:57:43.227 INFO:tasks.workunit.client.0.smithi083.stdout:4/788: symlink d1/d47/dac/l100 0 2024-04-01T06:57:43.227 INFO:tasks.workunit.client.0.smithi083.stdout:4/789: fsync d1/d47/d2a/f36 0 2024-04-01T06:57:43.229 INFO:tasks.workunit.client.0.smithi083.stdout:0/990: mknod d16/d99/d4b/d95/c151 0 2024-04-01T06:57:43.229 INFO:tasks.workunit.client.0.smithi083.stdout:0/991: readlink d16/d99/d4b/d6e/d96/l131 0 2024-04-01T06:57:43.232 INFO:tasks.workunit.client.0.smithi083.stdout:3/942: dread d6/d15/d2d/d2f/dc7/ff9 [4194304,4194304] 0 2024-04-01T06:57:43.232 INFO:tasks.workunit.client.0.smithi083.stdout:4/790: getdents d1/d4 0 2024-04-01T06:57:43.232 INFO:tasks.workunit.client.0.smithi083.stdout:3/943: read d6/d15/d2d/d2f/d3e/d74/f9c [2094961,25463] 0 2024-04-01T06:57:43.233 INFO:tasks.workunit.client.0.smithi083.stdout:0/992: mkdir d16/d2e/d6c/d152 0 2024-04-01T06:57:43.235 INFO:tasks.workunit.client.0.smithi083.stdout:0/993: write d16/d2e/d5b/f134 [1289295,27034] 0 2024-04-01T06:57:43.236 INFO:tasks.workunit.client.0.smithi083.stdout:7/714: dwrite d0/d4/d9/d39/d67/d6d/d87/d83/f53 [0,4194304] 0 2024-04-01T06:57:43.237 INFO:tasks.workunit.client.0.smithi083.stdout:1/933: dwrite db/d1c/d1d/f11c [4194304,4194304] 0 2024-04-01T06:57:43.237 INFO:tasks.workunit.client.0.smithi083.stdout:1/934: read f7 [4066460,24021] 0 2024-04-01T06:57:43.238 INFO:tasks.workunit.client.0.smithi083.stdout:4/791: link d1/d47/d2a/l30 d1/d47/d90/l101 0 2024-04-01T06:57:43.238 INFO:tasks.workunit.client.0.smithi083.stdout:4/792: write d1/d4/db8/ded/de8/dd5/de9/d89/fdf [1002704,119364] 0 2024-04-01T06:57:43.239 INFO:tasks.workunit.client.0.smithi083.stdout:4/793: read - d1/d4/db8/ded/de8/dd5/db6/ff3 zero size 2024-04-01T06:57:43.239 INFO:tasks.workunit.client.0.smithi083.stdout:4/794: chown d1/c40 67302 1 2024-04-01T06:57:43.239 INFO:tasks.workunit.client.0.smithi083.stdout:3/944: mknod d6/d1e/d6f/d10b/c12c 0 2024-04-01T06:57:43.239 INFO:tasks.workunit.client.0.smithi083.stdout:3/945: fsync d6/d15/fd4 0 2024-04-01T06:57:43.241 INFO:tasks.workunit.client.0.smithi083.stdout:0/994: symlink d16/l153 0 2024-04-01T06:57:43.241 INFO:tasks.workunit.client.0.smithi083.stdout:0/995: chown d16/f42 0 1 2024-04-01T06:57:43.241 INFO:tasks.workunit.client.0.smithi083.stdout:0/996: write d16/d1d/dbb/f144 [229914,130981] 0 2024-04-01T06:57:43.242 INFO:tasks.workunit.client.0.smithi083.stdout:1/935: creat db/d1c/d1d/db4/ddf/de9/f14f x:0 0 0 2024-04-01T06:57:43.244 INFO:tasks.workunit.client.0.smithi083.stdout:4/795: rename d1/d4/db8/ded/fd4 to d1/da5/dfc/f102 0 2024-04-01T06:57:43.245 INFO:tasks.workunit.client.0.smithi083.stdout:3/946: symlink d6/d1e/d4a/dfd/l12d 0 2024-04-01T06:57:43.245 INFO:tasks.workunit.client.0.smithi083.stdout:3/947: fsync d6/d15/d2d/d2f/d42/d46/dd2/ded/d110/fe0 0 2024-04-01T06:57:43.245 INFO:tasks.workunit.client.0.smithi083.stdout:3/948: chown d6/d15/d2d/d2f/dc7/dcf/l7c 2093388 1 2024-04-01T06:57:43.245 INFO:tasks.workunit.client.0.smithi083.stdout:3/949: write d6/d1e/f56 [3411248,9554] 0 2024-04-01T06:57:43.246 INFO:tasks.workunit.client.0.smithi083.stdout:0/997: getdents d16/dc6 0 2024-04-01T06:57:43.246 INFO:tasks.workunit.client.0.smithi083.stdout:0/998: write d16/d99/d4b/d6e/d96/fdd [3306644,94117] 0 2024-04-01T06:57:43.247 INFO:tasks.workunit.client.0.smithi083.stdout:1/936: rename db/d1c/l11e to db/d1c/d2e/d30/l150 0 2024-04-01T06:57:43.250 INFO:tasks.workunit.client.0.smithi083.stdout:7/715: dwrite d0/d4/d9/d39/d67/d6d/d87/d83/ffa [0,4194304] 0 2024-04-01T06:57:43.251 INFO:tasks.workunit.client.0.smithi083.stdout:4/796: unlink d1/d4/db/d5b/d62/dbd/lf0 0 2024-04-01T06:57:43.253 INFO:tasks.workunit.client.0.smithi083.stdout:3/950: mkdir d6/d15/d2d/d2f/d42/d5c/d88/db9/d12e 0 2024-04-01T06:57:43.254 INFO:tasks.workunit.client.0.smithi083.stdout:2/797: sync 2024-04-01T06:57:43.255 INFO:tasks.workunit.client.0.smithi083.stdout:0/999: getdents d16/d99/d4b/d6e 0 2024-04-01T06:57:43.257 INFO:tasks.workunit.client.0.smithi083.stdout:1/937: getdents db/d1c/d29/d33/d50/d4d 0 2024-04-01T06:57:43.263 INFO:tasks.workunit.client.0.smithi083.stdout:7/716: unlink d0/d4/d9/d39/d67/d6d/d87/d83/f35 0 2024-04-01T06:57:43.263 INFO:tasks.workunit.client.0.smithi083.stdout:7/717: write d0/d4/d9/d39/d67/d6d/d87/d83/d38/dbf/ffd [670614,5820] 0 2024-04-01T06:57:43.268 INFO:tasks.workunit.client.0.smithi083.stdout:4/797: mknod d1/d4/db8/ded/de8/dd5/de9/d89/c103 0 2024-04-01T06:57:43.270 INFO:tasks.workunit.client.0.smithi083.stdout:3/951: dwrite d6/d15/d2d/d2f/d53/fab [4194304,4194304] 0 2024-04-01T06:57:43.275 INFO:tasks.workunit.client.0.smithi083.stdout:2/798: creat d3/d71/d90/db6/dcd/f10a x:0 0 0 2024-04-01T06:57:43.276 INFO:tasks.workunit.client.0.smithi083.stdout:1/938: creat db/d1c/d29/d33/d50/d5d/dad/d106/f151 x:0 0 0 2024-04-01T06:57:43.277 INFO:tasks.workunit.client.0.smithi083.stdout:7/718: getdents d0/d4/d9/d39/d67/d6d/d87/dda 0 2024-04-01T06:57:43.277 INFO:tasks.workunit.client.0.smithi083.stdout:7/719: chown d0/d4/d9/d39/d67/d6d/d87/d83/d38/dbf/de7/ff9 191727 1 2024-04-01T06:57:43.277 INFO:tasks.workunit.client.0.smithi083.stdout:7/720: write d0/d4/d9/d39/d67/d6d/d87/d83/d62/f8e [804134,94180] 0 2024-04-01T06:57:43.278 INFO:tasks.workunit.client.0.smithi083.stdout:4/798: creat d1/d4/db8/ded/de8/d88/f104 x:0 0 0 2024-04-01T06:57:43.278 INFO:tasks.workunit.client.0.smithi083.stdout:4/799: fdatasync d1/d4/db/fb3 0 2024-04-01T06:57:43.281 INFO:tasks.workunit.client.0.smithi083.stdout:3/952: mkdir d6/d15/d2d/d2f/d42/d5c/d88/db9/d12f 0 2024-04-01T06:57:43.283 INFO:tasks.workunit.client.0.smithi083.stdout:2/799: unlink d3/d20/f84 0 2024-04-01T06:57:43.283 INFO:tasks.workunit.client.0.smithi083.stdout:1/939: mknod db/d1c/d29/d33/d47/c152 0 2024-04-01T06:57:43.284 INFO:tasks.workunit.client.0.smithi083.stdout:7/721: truncate d0/d4/d9/d39/d67/d6d/d87/d83/d62/f6f 167747 0 2024-04-01T06:57:43.284 INFO:tasks.workunit.client.0.smithi083.stdout:7/722: write d0/d4/d9/d39/d67/d6d/d87/fb1 [379156,78507] 0 2024-04-01T06:57:43.285 INFO:tasks.workunit.client.0.smithi083.stdout:4/800: symlink d1/d4/db/d5b/d62/l105 0 2024-04-01T06:57:43.285 INFO:tasks.workunit.client.0.smithi083.stdout:4/801: truncate d1/d4/db8/ded/de8/dd5/ff4 355568 0 2024-04-01T06:57:43.289 INFO:tasks.workunit.client.0.smithi083.stdout:3/953: rmdir d6/d15/d2d/d2f/d3e/d116 0 2024-04-01T06:57:43.290 INFO:tasks.workunit.client.0.smithi083.stdout:2/800: truncate d3/d26/d59/d2b/da3/fd9 1142436 0 2024-04-01T06:57:43.291 INFO:tasks.workunit.client.0.smithi083.stdout:1/940: creat db/d1c/d29/d33/d50/d5d/d6c/d8e/f153 x:0 0 0 2024-04-01T06:57:43.292 INFO:tasks.workunit.client.0.smithi083.stdout:7/723: truncate d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/f54 3369660 0 2024-04-01T06:57:43.294 INFO:tasks.workunit.client.0.smithi083.stdout:4/802: rename d1/d4/db8/ded/de8/dd5/de9/l95 to d1/da5/dfc/l106 0 2024-04-01T06:57:43.294 INFO:tasks.workunit.client.0.smithi083.stdout:4/803: fdatasync d1/d4/db/f9f 0 2024-04-01T06:57:43.294 INFO:tasks.workunit.client.0.smithi083.stdout:4/804: write d1/f2 [5181897,28465] 0 2024-04-01T06:57:43.295 INFO:tasks.workunit.client.0.smithi083.stdout:2/801: symlink d3/de1/df5/dae/ddd/l10b 0 2024-04-01T06:57:43.296 INFO:tasks.workunit.client.0.smithi083.stdout:3/954: dread d6/d15/d2d/d2f/dc7/dcf/fb3 [0,4194304] 0 2024-04-01T06:57:43.299 INFO:tasks.workunit.client.0.smithi083.stdout:7/724: rename d0/d4/d9/f81 to d0/d4/d9/d39/d67/d6d/d87/d83/fff 0 2024-04-01T06:57:43.300 INFO:tasks.workunit.client.0.smithi083.stdout:2/802: symlink d3/d4d/l10c 0 2024-04-01T06:57:43.301 INFO:tasks.workunit.client.0.smithi083.stdout:2/803: stat d3/de1/df5/lb2 0 2024-04-01T06:57:43.302 INFO:tasks.workunit.client.0.smithi083.stdout:9/924: sync 2024-04-01T06:57:43.302 INFO:tasks.workunit.client.0.smithi083.stdout:7/725: dread d0/d4/d9/d39/d67/d6d/d87/d83/f72 [0,4194304] 0 2024-04-01T06:57:43.302 INFO:tasks.workunit.client.0.smithi083.stdout:7/726: readlink d0/d4/d9/d39/lc1 0 2024-04-01T06:57:43.305 INFO:tasks.workunit.client.0.smithi083.stdout:2/804: creat d3/d71/d81/f10d x:0 0 0 2024-04-01T06:57:43.305 INFO:tasks.workunit.client.0.smithi083.stdout:2/805: chown d3/d71/d90/db6/dcd/dfd/d66/f8c 191 1 2024-04-01T06:57:43.305 INFO:tasks.workunit.client.0.smithi083.stdout:2/806: truncate d3/d26/d59/d27/f96 495829 0 2024-04-01T06:57:43.305 INFO:tasks.workunit.client.0.smithi083.stdout:2/807: chown d3/d8b/dea/l100 1298 1 2024-04-01T06:57:43.307 INFO:tasks.workunit.client.0.smithi083.stdout:9/925: creat d6/d32/d26/d2d/f135 x:0 0 0 2024-04-01T06:57:43.312 INFO:tasks.workunit.client.0.smithi083.stdout:7/727: mknod d0/d4/dbd/db2/c100 0 2024-04-01T06:57:43.312 INFO:tasks.workunit.client.0.smithi083.stdout:2/808: symlink d3/d20/l10e 0 2024-04-01T06:57:43.312 INFO:tasks.workunit.client.0.smithi083.stdout:2/809: readlink d3/d71/d90/db6/dcd/dfd/l7a 0 2024-04-01T06:57:43.312 INFO:tasks.workunit.client.0.smithi083.stdout:2/810: write d3/d26/d59/d27/f3b [4749918,121931] 0 2024-04-01T06:57:43.314 INFO:tasks.workunit.client.0.smithi083.stdout:4/805: dwrite d1/d4/db/d94/fbf [0,4194304] 0 2024-04-01T06:57:43.314 INFO:tasks.workunit.client.0.smithi083.stdout:4/806: fdatasync d1/d4/db/f56 0 2024-04-01T06:57:43.314 INFO:tasks.workunit.client.0.smithi083.stdout:4/807: chown d1/d4/db/d94/df1 1218 1 2024-04-01T06:57:43.315 INFO:tasks.workunit.client.0.smithi083.stdout:7/728: creat d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/de5/f101 x:0 0 0 2024-04-01T06:57:43.315 INFO:tasks.workunit.client.0.smithi083.stdout:7/729: write d0/d4/d9/d39/d67/d6d/d87/d83/d62/dc6/fe8 [66390,89129] 0 2024-04-01T06:57:43.316 INFO:tasks.workunit.client.0.smithi083.stdout:2/811: creat d3/d26/d59/d27/d79/de9/f10f x:0 0 0 2024-04-01T06:57:43.318 INFO:tasks.workunit.client.0.smithi083.stdout:2/812: creat d3/d26/d59/d27/f110 x:0 0 0 2024-04-01T06:57:43.319 INFO:tasks.workunit.client.0.smithi083.stdout:2/813: write d3/d26/d59/d2b/f39 [1599754,59705] 0 2024-04-01T06:57:43.320 INFO:tasks.workunit.client.0.smithi083.stdout:2/814: truncate d3/d26/fe0 28315 0 2024-04-01T06:57:43.320 INFO:tasks.workunit.client.0.smithi083.stdout:3/955: dwrite d6/d15/f10 [0,4194304] 0 2024-04-01T06:57:43.321 INFO:tasks.workunit.client.0.smithi083.stdout:3/956: write f3 [1203408,42836] 0 2024-04-01T06:57:43.321 INFO:tasks.workunit.client.0.smithi083.stdout:3/957: read - d6/d1e/d6f/daf/dc1/f112 zero size 2024-04-01T06:57:43.321 INFO:tasks.workunit.client.0.smithi083.stdout:3/958: getdents d6/d1e/d4a/dfd/d127 0 2024-04-01T06:57:43.321 INFO:tasks.workunit.client.0.smithi083.stdout:3/959: fsync d6/d15/d2d/d2f/d42/f76 0 2024-04-01T06:57:43.322 INFO:tasks.workunit.client.0.smithi083.stdout:2/815: symlink d3/d4d/d57/df2/l111 0 2024-04-01T06:57:43.322 INFO:tasks.workunit.client.0.smithi083.stdout:3/960: fsync d6/d15/d2d/d2f/d3e/fee 0 2024-04-01T06:57:43.322 INFO:tasks.workunit.client.0.smithi083.stdout:2/816: write d3/d26/d59/f31 [1114682,27198] 0 2024-04-01T06:57:43.324 INFO:tasks.workunit.client.0.smithi083.stdout:2/817: creat d3/f112 x:0 0 0 2024-04-01T06:57:43.324 INFO:tasks.workunit.client.0.smithi083.stdout:2/818: fsync d3/d71/df9/f106 0 2024-04-01T06:57:43.337 INFO:tasks.workunit.client.0.smithi083.stdout:2/819: dread d3/d26/f89 [0,4194304] 0 2024-04-01T06:57:43.338 INFO:tasks.workunit.client.0.smithi083.stdout:2/820: mkdir d3/d71/db8/dec/d113 0 2024-04-01T06:57:43.338 INFO:tasks.workunit.client.0.smithi083.stdout:2/821: mknod d3/de1/df5/dae/ddd/c114 0 2024-04-01T06:57:43.339 INFO:tasks.workunit.client.0.smithi083.stdout:3/961: dwrite d6/d1e/dbb/fd9 [0,4194304] 0 2024-04-01T06:57:43.340 INFO:tasks.workunit.client.0.smithi083.stdout:2/822: write d3/d26/d59/d2b/f82 [7778833,23756] 0 2024-04-01T06:57:43.341 INFO:tasks.workunit.client.0.smithi083.stdout:4/808: dwrite d1/d4/d6e/f78 [0,4194304] 0 2024-04-01T06:57:43.341 INFO:tasks.workunit.client.0.smithi083.stdout:4/809: truncate d1/d4/db/d94/fe2 349508 0 2024-04-01T06:57:43.341 INFO:tasks.workunit.client.0.smithi083.stdout:4/810: write d1/d4/f4f [1436790,112989] 0 2024-04-01T06:57:43.341 INFO:tasks.workunit.client.0.smithi083.stdout:3/962: truncate d6/f21 2032678 0 2024-04-01T06:57:43.342 INFO:tasks.workunit.client.0.smithi083.stdout:7/730: dwrite d0/d4/d9/d39/d48/f85 [0,4194304] 0 2024-04-01T06:57:43.342 INFO:tasks.workunit.client.0.smithi083.stdout:7/731: write d0/d4/d9/d39/d67/d6d/d7d/fef [413940,86671] 0 2024-04-01T06:57:43.342 INFO:tasks.workunit.client.0.smithi083.stdout:7/732: fsync d0/d7c/fbc 0 2024-04-01T06:57:43.344 INFO:tasks.workunit.client.0.smithi083.stdout:4/811: mkdir d1/d47/d2a/db5/d107 0 2024-04-01T06:57:43.344 INFO:tasks.workunit.client.0.smithi083.stdout:4/812: chown d1/d4/db/d5b/l82 3 1 2024-04-01T06:57:43.344 INFO:tasks.workunit.client.0.smithi083.stdout:2/823: mkdir d3/d71/d90/d115 0 2024-04-01T06:57:43.348 INFO:tasks.workunit.client.0.smithi083.stdout:2/824: rmdir d3/d71/d90/d115 0 2024-04-01T06:57:43.351 INFO:tasks.workunit.client.0.smithi083.stdout:2/825: creat d3/d8b/f116 x:0 0 0 2024-04-01T06:57:43.351 INFO:tasks.workunit.client.0.smithi083.stdout:2/826: readlink d3/d26/d59/l6d 0 2024-04-01T06:57:43.354 INFO:tasks.workunit.client.0.smithi083.stdout:7/733: dwrite d0/d4/d9/d39/d67/d6d/d87/f8f [0,4194304] 0 2024-04-01T06:57:43.364 INFO:tasks.workunit.client.0.smithi083.stdout:3/963: dwrite d6/d15/d2d/d2f/d3e/d74/f9c [0,4194304] 0 2024-04-01T06:57:43.365 INFO:tasks.workunit.client.0.smithi083.stdout:3/964: creat d6/d15/d2d/d2f/f130 x:0 0 0 2024-04-01T06:57:43.366 INFO:tasks.workunit.client.0.smithi083.stdout:3/965: truncate d6/d15/d2d/d2f/d3e/fee 127129 0 2024-04-01T06:57:43.368 INFO:tasks.workunit.client.0.smithi083.stdout:3/966: rename d6/d1e/f43 to d6/d15/d2d/d2f/f131 0 2024-04-01T06:57:43.368 INFO:tasks.workunit.client.0.smithi083.stdout:3/967: write d6/d15/d2d/d2f/d42/d5c/d88/db9/feb [1201231,31089] 0 2024-04-01T06:57:43.368 INFO:tasks.workunit.client.0.smithi083.stdout:3/968: truncate d6/d15/d2d/d2f/dc7/dcf/f11a 934503 0 2024-04-01T06:57:43.369 INFO:tasks.workunit.client.0.smithi083.stdout:3/969: symlink d6/d15/d2d/d2f/l132 0 2024-04-01T06:57:43.371 INFO:tasks.workunit.client.0.smithi083.stdout:2/827: dwrite d3/d20/d42/dee/f109 [0,4194304] 0 2024-04-01T06:57:43.371 INFO:tasks.workunit.client.0.smithi083.stdout:4/813: truncate d1/d4/f4f 424416 0 2024-04-01T06:57:43.378 INFO:tasks.workunit.client.0.smithi083.stdout:4/814: dwrite d1/d4/db8/ded/de8/dd5/de9/f92 [0,4194304] 0 2024-04-01T06:57:43.380 INFO:tasks.workunit.client.0.smithi083.stdout:4/815: stat d1/d4/db8/ded/ccb 0 2024-04-01T06:57:43.382 INFO:tasks.workunit.client.0.smithi083.stdout:8/963: sync 2024-04-01T06:57:43.382 INFO:tasks.workunit.client.0.smithi083.stdout:6/763: sync 2024-04-01T06:57:43.382 INFO:tasks.workunit.client.0.smithi083.stdout:5/820: sync 2024-04-01T06:57:43.383 INFO:tasks.workunit.client.0.smithi083.stdout:8/964: read d15/d1b/d39/d48/d5e/d70/d11c/d38/d62/f4a [292336,72891] 0 2024-04-01T06:57:43.383 INFO:tasks.workunit.client.0.smithi083.stdout:8/965: chown d15/d1b/d39/d48/d5e/d70/d11c/d44/d108/l11f 171118068 1 2024-04-01T06:57:43.384 INFO:tasks.workunit.client.0.smithi083.stdout:8/966: chown d15/d1b/d39/d48/d5e/d70/d11c/d44/d141/d19/l26 714 1 2024-04-01T06:57:43.384 INFO:tasks.workunit.client.0.smithi083.stdout:6/764: creat d9/dc/d29/d3c/d45/dc4/f103 x:0 0 0 2024-04-01T06:57:43.384 INFO:tasks.workunit.client.0.smithi083.stdout:6/765: chown d9/dc/d1b/d39/f3a 31806450 1 2024-04-01T06:57:43.384 INFO:tasks.workunit.client.0.smithi083.stdout:8/967: creat d15/d1b/d39/d48/d5e/d70/d11c/d38/de7/d10a/d13d/f155 x:0 0 0 2024-04-01T06:57:43.384 INFO:tasks.workunit.client.0.smithi083.stdout:8/968: truncate d15/d1b/d39/d48/d5e/d70/d11c/da2/fcc 230430 0 2024-04-01T06:57:43.385 INFO:tasks.workunit.client.0.smithi083.stdout:8/969: dread - d15/d1b/d39/d48/d5e/d70/d11c/d38/d62/ff0 zero size 2024-04-01T06:57:43.385 INFO:tasks.workunit.client.0.smithi083.stdout:8/970: chown d15/d1b/d39/d48/d5e/d70/d11c/d38/d62/fd4 7875399 1 2024-04-01T06:57:43.385 INFO:tasks.workunit.client.0.smithi083.stdout:8/971: write d15/d1b/d39/d48/d5e/d70/d11c/d44/d141/d1e/de3/f128 [1731639,103729] 0 2024-04-01T06:57:43.435 INFO:tasks.workunit.client.0.smithi083.stdout:5/821: dwrite d4/d9/d16/d1f/d2f/d53/fe4 [0,4194304] 0 2024-04-01T06:57:43.439 INFO:tasks.workunit.client.0.smithi083.stdout:5/822: symlink d4/d9/d16/d1f/d2f/dc4/l10e 0 2024-04-01T06:57:43.439 INFO:tasks.workunit.client.0.smithi083.stdout:4/816: dwrite d1/d47/d2a/f36 [0,4194304] 0 2024-04-01T06:57:43.439 INFO:tasks.workunit.client.0.smithi083.stdout:6/766: dwrite d9/dc/d1b/d35/fe9 [0,4194304] 0 2024-04-01T06:57:43.439 INFO:tasks.workunit.client.0.smithi083.stdout:6/767: stat d9/dc/d29/d3c/d5c/fdd 0 2024-04-01T06:57:43.439 INFO:tasks.workunit.client.0.smithi083.stdout:5/823: write d4/d9/d16/d9f/dc7/d68/df2/f103 [2701195,18376] 0 2024-04-01T06:57:43.440 INFO:tasks.workunit.client.0.smithi083.stdout:5/824: write d4/d9/d16/d1f/d2f/f60 [317991,62689] 0 2024-04-01T06:57:43.442 INFO:tasks.workunit.client.0.smithi083.stdout:6/768: mknod d9/dc/d1b/d73/c104 0 2024-04-01T06:57:43.444 INFO:tasks.workunit.client.0.smithi083.stdout:5/825: symlink d4/d9/d16/d9f/dc7/d96/l10f 0 2024-04-01T06:57:43.446 INFO:tasks.workunit.client.0.smithi083.stdout:6/769: symlink d9/dc/d9d/l105 0 2024-04-01T06:57:43.446 INFO:tasks.workunit.client.0.smithi083.stdout:6/770: write d9/dc/d29/d3c/d45/dc4/dd2/fe1 [17831,7557] 0 2024-04-01T06:57:43.447 INFO:tasks.workunit.client.0.smithi083.stdout:5/826: rmdir d4/d23/d49 39 2024-04-01T06:57:43.448 INFO:tasks.workunit.client.0.smithi083.stdout:5/827: mkdir d4/d9/d16/d19/d5e/d110 0 2024-04-01T06:57:43.449 INFO:tasks.workunit.client.0.smithi083.stdout:5/828: creat d4/d9/d16/d9f/dc7/d68/df2/f111 x:0 0 0 2024-04-01T06:57:43.449 INFO:tasks.workunit.client.0.smithi083.stdout:5/829: chown d4/l2d 59974042 1 2024-04-01T06:57:43.449 INFO:tasks.workunit.client.0.smithi083.stdout:5/830: stat d4/d9/d16/d19/fcf 0 2024-04-01T06:57:43.449 INFO:tasks.workunit.client.0.smithi083.stdout:5/831: fsync d4/d9/d16/d9f/fcb 0 2024-04-01T06:57:43.450 INFO:tasks.workunit.client.0.smithi083.stdout:5/832: creat d4/d9/d16/d9f/dc7/d96/f112 x:0 0 0 2024-04-01T06:57:43.451 INFO:tasks.workunit.client.0.smithi083.stdout:5/833: fsync d4/d55/f10b 0 2024-04-01T06:57:43.451 INFO:tasks.workunit.client.0.smithi083.stdout:5/834: truncate d4/d23/d4e/d79/fad 350580 0 2024-04-01T06:57:43.452 INFO:tasks.workunit.client.0.smithi083.stdout:4/817: dwrite d1/d4/db/f9f [0,4194304] 0 2024-04-01T06:57:43.458 INFO:tasks.workunit.client.0.smithi083.stdout:5/835: rename d4/d2b to d4/d9/d16/d19/d5e/d113 0 2024-04-01T06:57:43.459 INFO:tasks.workunit.client.0.smithi083.stdout:4/818: rename d1/d4/db8/ded/de8/d88/f104 to d1/da5/dae/dd2/f108 0 2024-04-01T06:57:43.461 INFO:tasks.workunit.client.0.smithi083.stdout:4/819: dread d1/d4/db8/ded/de8/dd5/de9/f50 [0,4194304] 0 2024-04-01T06:57:43.471 INFO:tasks.workunit.client.0.smithi083.stdout:5/836: dwrite d4/d9/d16/d19/d5e/d113/f24 [0,4194304] 0 2024-04-01T06:57:43.472 INFO:tasks.workunit.client.0.smithi083.stdout:5/837: mknod d4/d23/d4e/d83/c114 0 2024-04-01T06:57:43.473 INFO:tasks.workunit.client.0.smithi083.stdout:5/838: symlink d4/d23/d67/l115 0 2024-04-01T06:57:43.474 INFO:tasks.workunit.client.0.smithi083.stdout:5/839: unlink d4/d9/d16/dc1/da0/dab/cfe 0 2024-04-01T06:57:43.480 INFO:tasks.workunit.client.0.smithi083.stdout:5/840: dread d4/d9/d16/d1f/f69 [0,4194304] 0 2024-04-01T06:57:43.481 INFO:tasks.workunit.client.0.smithi083.stdout:5/841: dread - d4/fc8 zero size 2024-04-01T06:57:43.493 INFO:tasks.workunit.client.0.smithi083.stdout:5/842: dwrite d4/d9/d16/d19/d5e/d113/f24 [0,4194304] 0 2024-04-01T06:57:43.494 INFO:tasks.workunit.client.0.smithi083.stdout:5/843: rmdir d4/d23/d4e/d79 39 2024-04-01T06:57:43.494 INFO:tasks.workunit.client.0.smithi083.stdout:5/844: chown d4/d23/dc9 689 1 2024-04-01T06:57:43.495 INFO:tasks.workunit.client.0.smithi083.stdout:5/845: rmdir d4/d9/d16/dc1/da0/df7 39 2024-04-01T06:57:43.495 INFO:tasks.workunit.client.0.smithi083.stdout:5/846: write d4/d71/fa3 [2309849,12260] 0 2024-04-01T06:57:43.497 INFO:tasks.workunit.client.0.smithi083.stdout:1/941: sync 2024-04-01T06:57:43.498 INFO:tasks.workunit.client.0.smithi083.stdout:5/847: dread d4/d71/d7d/f8c [0,4194304] 0 2024-04-01T06:57:43.498 INFO:tasks.workunit.client.0.smithi083.stdout:5/848: dread - d4/d23/d49/f88 zero size 2024-04-01T06:57:43.500 INFO:tasks.workunit.client.0.smithi083.stdout:1/942: getdents db/d1c/d29/d33/d50/d5d/d6c/d8e 0 2024-04-01T06:57:43.501 INFO:tasks.workunit.client.0.smithi083.stdout:1/943: write db/d1c/d29/d33/d50/d4d/f63 [999202,31844] 0 2024-04-01T06:57:43.501 INFO:tasks.workunit.client.0.smithi083.stdout:5/849: mknod d4/d9/c116 0 2024-04-01T06:57:43.505 INFO:tasks.workunit.client.0.smithi083.stdout:5/850: link d4/fc8 d4/d71/f117 0 2024-04-01T06:57:43.505 INFO:tasks.workunit.client.0.smithi083.stdout:5/851: fsync d4/d9/d16/d19/fcf 0 2024-04-01T06:57:43.506 INFO:tasks.workunit.client.0.smithi083.stdout:5/852: write d4/d9/d16/dc1/ff9 [1962009,96731] 0 2024-04-01T06:57:43.506 INFO:tasks.workunit.client.0.smithi083.stdout:1/944: rmdir db/d1c/d29/d33/d50/d4d 39 2024-04-01T06:57:43.506 INFO:tasks.workunit.client.0.smithi083.stdout:5/853: read d4/d9/d16/d19/d5e/fc5 [675147,6463] 0 2024-04-01T06:57:43.510 INFO:tasks.workunit.client.0.smithi083.stdout:1/945: dread db/d1c/d29/d33/d47/d76/db6/fe1 [0,4194304] 0 2024-04-01T06:57:43.512 INFO:tasks.workunit.client.0.smithi083.stdout:1/946: mknod db/d1c/d29/d33/d50/d5d/c154 0 2024-04-01T06:57:43.512 INFO:tasks.workunit.client.0.smithi083.stdout:1/947: readlink db/d1c/d29/d33/d50/d5d/d81/d13a/lf4 0 2024-04-01T06:57:43.512 INFO:tasks.workunit.client.0.smithi083.stdout:1/948: write db/d1c/d29/d33/d47/f124 [780504,12624] 0 2024-04-01T06:57:43.513 INFO:tasks.workunit.client.0.smithi083.stdout:1/949: write db/d1c/d29/d33/d50/fba [884926,102927] 0 2024-04-01T06:57:43.515 INFO:tasks.workunit.client.0.smithi083.stdout:1/950: rmdir db/d1c/d29/d33/d50/d5d/d6c 39 2024-04-01T06:57:43.517 INFO:tasks.workunit.client.0.smithi083.stdout:1/951: rename db/d1c/f2b to db/d1c/d2e/d30/d82/f155 0 2024-04-01T06:57:43.518 INFO:tasks.workunit.client.0.smithi083.stdout:1/952: mknod db/d1c/d29/d33/d50/d5d/d6c/c156 0 2024-04-01T06:57:43.519 INFO:tasks.workunit.client.0.smithi083.stdout:1/953: getdents db/d1c/d29/d33/d50/d5d/d81/d94 0 2024-04-01T06:57:43.519 INFO:tasks.workunit.client.0.smithi083.stdout:1/954: stat db/d1c/d49/f115 0 2024-04-01T06:57:43.520 INFO:tasks.workunit.client.0.smithi083.stdout:5/854: dwrite d4/d71/f117 [0,4194304] 0 2024-04-01T06:57:43.520 INFO:tasks.workunit.client.0.smithi083.stdout:5/855: chown d4 7242 1 2024-04-01T06:57:43.521 INFO:tasks.workunit.client.0.smithi083.stdout:1/955: creat db/d61/f157 x:0 0 0 2024-04-01T06:57:43.525 INFO:tasks.workunit.client.0.smithi083.stdout:1/956: symlink db/d1c/d29/d33/d50/d5d/d81/d13a/l158 0 2024-04-01T06:57:43.525 INFO:tasks.workunit.client.0.smithi083.stdout:1/957: dread - db/d1c/d29/d33/d50/d5d/dad/d106/f151 zero size 2024-04-01T06:57:43.525 INFO:tasks.workunit.client.0.smithi083.stdout:1/958: chown db/d1c/d29/d33/d50/d4d/f134 268094 1 2024-04-01T06:57:43.525 INFO:tasks.workunit.client.0.smithi083.stdout:1/959: fdatasync db/d1c/d1d/d8b/f9a 0 2024-04-01T06:57:43.531 INFO:tasks.workunit.client.0.smithi083.stdout:1/960: creat db/d1c/d2e/dfd/f159 x:0 0 0 2024-04-01T06:57:43.532 INFO:tasks.workunit.client.0.smithi083.stdout:5/856: rmdir d4/d9 39 2024-04-01T06:57:43.532 INFO:tasks.workunit.client.0.smithi083.stdout:5/857: chown d4 757 1 2024-04-01T06:57:43.536 INFO:tasks.workunit.client.0.smithi083.stdout:1/961: truncate db/d1c/d1d/f45 8608678 0 2024-04-01T06:57:43.538 INFO:tasks.workunit.client.0.smithi083.stdout:5/858: rename d4/d71/d7d/f8c to d4/d9/d16/d9f/dc7/d68/df2/f118 0 2024-04-01T06:57:43.540 INFO:tasks.workunit.client.0.smithi083.stdout:1/962: rmdir db/d61/de5 0 2024-04-01T06:57:43.540 INFO:tasks.workunit.client.0.smithi083.stdout:1/963: creat db/d1c/d2e/d30/d82/f15a x:0 0 0 2024-04-01T06:57:43.541 INFO:tasks.workunit.client.0.smithi083.stdout:1/964: mkdir db/d15b 0 2024-04-01T06:57:43.541 INFO:tasks.workunit.client.0.smithi083.stdout:1/965: readlink db/d1c/d29/l12a 0 2024-04-01T06:57:43.542 INFO:tasks.workunit.client.0.smithi083.stdout:1/966: mknod db/d1c/d29/d33/d50/d121/d130/d13b/c15c 0 2024-04-01T06:57:43.543 INFO:tasks.workunit.client.0.smithi083.stdout:3/970: sync 2024-04-01T06:57:43.543 INFO:tasks.workunit.client.0.smithi083.stdout:9/926: sync 2024-04-01T06:57:43.543 INFO:tasks.workunit.client.0.smithi083.stdout:7/734: sync 2024-04-01T06:57:43.543 INFO:tasks.workunit.client.0.smithi083.stdout:3/971: chown d6/d15/d2d/d2f/lde 19298 1 2024-04-01T06:57:43.544 INFO:tasks.workunit.client.0.smithi083.stdout:9/927: stat d6/d32/d3c/d4c/c129 0 2024-04-01T06:57:43.544 INFO:tasks.workunit.client.0.smithi083.stdout:3/972: dread - d6/d15/d2d/d2f/f130 zero size 2024-04-01T06:57:43.544 INFO:tasks.workunit.client.0.smithi083.stdout:9/928: truncate d6/d32/fa4 296214 0 2024-04-01T06:57:43.544 INFO:tasks.workunit.client.0.smithi083.stdout:1/967: mknod db/c15d 0 2024-04-01T06:57:43.544 INFO:tasks.workunit.client.0.smithi083.stdout:1/968: write db/d1c/d49/f141 [570702,36243] 0 2024-04-01T06:57:43.544 INFO:tasks.workunit.client.0.smithi083.stdout:1/969: truncate db/d1c/d29/d33/d50/d5d/d81/f118 4381709 0 2024-04-01T06:57:43.545 INFO:tasks.workunit.client.0.smithi083.stdout:3/973: write d6/d15/d2d/d2f/d3e/fa4 [551222,122811] 0 2024-04-01T06:57:43.545 INFO:tasks.workunit.client.0.smithi083.stdout:9/929: symlink d6/d32/d26/d2d/deb/l136 0 2024-04-01T06:57:43.545 INFO:tasks.workunit.client.0.smithi083.stdout:9/930: truncate d6/d32/d26/d2d/d6e/d11e/f12f 612693 0 2024-04-01T06:57:43.546 INFO:tasks.workunit.client.0.smithi083.stdout:7/735: dread d0/d4/d9/d39/d67/d6d/d87/d83/fff [0,4194304] 0 2024-04-01T06:57:43.546 INFO:tasks.workunit.client.0.smithi083.stdout:7/736: stat d0/d4/d9/d39/d67/d6d/d87/d83/d62 0 2024-04-01T06:57:43.546 INFO:tasks.workunit.client.0.smithi083.stdout:7/737: chown d0/d4/d9/d39/d67/d6d/d87/dda/fed 939 1 2024-04-01T06:57:43.546 INFO:tasks.workunit.client.0.smithi083.stdout:7/738: readlink d0/d4/d9/d39/l44 0 2024-04-01T06:57:43.546 INFO:tasks.workunit.client.0.smithi083.stdout:1/970: rmdir db/d1c/d1d/db4/ddf/d14b 0 2024-04-01T06:57:43.548 INFO:tasks.workunit.client.0.smithi083.stdout:3/974: creat d6/d15/d2d/d2f/dc7/f133 x:0 0 0 2024-04-01T06:57:43.548 INFO:tasks.workunit.client.0.smithi083.stdout:5/859: dread d4/fc8 [0,4194304] 0 2024-04-01T06:57:43.548 INFO:tasks.workunit.client.0.smithi083.stdout:5/860: write d4/d9/d16/ff1 [200317,93635] 0 2024-04-01T06:57:43.548 INFO:tasks.workunit.client.0.smithi083.stdout:5/861: chown d4/d71/d7d 256 1 2024-04-01T06:57:43.548 INFO:tasks.workunit.client.0.smithi083.stdout:3/975: write d6/d1e/f39 [2139284,30870] 0 2024-04-01T06:57:43.548 INFO:tasks.workunit.client.0.smithi083.stdout:9/931: symlink d6/d32/d26/d2d/d34/d6c/dee/l137 0 2024-04-01T06:57:43.548 INFO:tasks.workunit.client.0.smithi083.stdout:9/932: write d6/d29/d10a/f11c [347528,125030] 0 2024-04-01T06:57:43.549 INFO:tasks.workunit.client.0.smithi083.stdout:7/739: mknod d0/d4/dbd/db7/c102 0 2024-04-01T06:57:43.551 INFO:tasks.workunit.client.0.smithi083.stdout:1/971: mkdir db/d1c/d2e/d15e 0 2024-04-01T06:57:43.552 INFO:tasks.workunit.client.0.smithi083.stdout:5/862: creat d4/d23/d67/f119 x:0 0 0 2024-04-01T06:57:43.552 INFO:tasks.workunit.client.0.smithi083.stdout:5/863: truncate d4/d9/d16/d9f/dc7/d96/db2/f10c 1017910 0 2024-04-01T06:57:43.552 INFO:tasks.workunit.client.0.smithi083.stdout:5/864: truncate d4/d9/d16/d1f/d2f/d53/dbb/fac 371023 0 2024-04-01T06:57:43.553 INFO:tasks.workunit.client.0.smithi083.stdout:3/976: getdents d6/d15/d2d/d2f/d3e/d74/df5 0 2024-04-01T06:57:43.553 INFO:tasks.workunit.client.0.smithi083.stdout:3/977: chown d6/d15/d2d/d2f/d42/d5c/d88/db9/d12e 126 1 2024-04-01T06:57:43.553 INFO:tasks.workunit.client.0.smithi083.stdout:3/978: readlink d6/l98 0 2024-04-01T06:57:43.554 INFO:tasks.workunit.client.0.smithi083.stdout:7/740: dread d0/d4/d9/d39/d67/d6d/f5f [0,4194304] 0 2024-04-01T06:57:43.555 INFO:tasks.workunit.client.0.smithi083.stdout:9/933: mknod d6/d32/d3c/d4c/d6b/c138 0 2024-04-01T06:57:43.556 INFO:tasks.workunit.client.0.smithi083.stdout:9/934: write d6/f14 [3937621,57167] 0 2024-04-01T06:57:43.556 INFO:tasks.workunit.client.0.smithi083.stdout:9/935: stat d6/d32/d8f/d6d/d103/f124 0 2024-04-01T06:57:43.558 INFO:tasks.workunit.client.0.smithi083.stdout:5/865: mknod d4/d23/d67/de3/c11a 0 2024-04-01T06:57:43.559 INFO:tasks.workunit.client.0.smithi083.stdout:3/979: truncate d6/d15/d2d/d2f/d3e/d74/df5/f11f 2470340 0 2024-04-01T06:57:43.561 INFO:tasks.workunit.client.0.smithi083.stdout:7/741: write d0/d4/fc [3843868,32672] 0 2024-04-01T06:57:43.562 INFO:tasks.workunit.client.0.smithi083.stdout:9/936: rename d6/d32/d3c/d4c/fc4 to d6/d32/d26/d2d/deb/f139 0 2024-04-01T06:57:43.562 INFO:tasks.workunit.client.0.smithi083.stdout:7/742: write d0/d4/d9/d39/d67/d6d/d87/d83/ffa [108458,105632] 0 2024-04-01T06:57:43.563 INFO:tasks.workunit.client.0.smithi083.stdout:1/972: symlink db/d1c/d29/l15f 0 2024-04-01T06:57:43.564 INFO:tasks.workunit.client.0.smithi083.stdout:5/866: creat d4/d9/d16/d19/d5e/d110/f11b x:0 0 0 2024-04-01T06:57:43.566 INFO:tasks.workunit.client.0.smithi083.stdout:9/937: mkdir d6/dfd/d13a 0 2024-04-01T06:57:43.566 INFO:tasks.workunit.client.0.smithi083.stdout:9/938: fsync d6/d32/d3c/d4c/d6b/f5d 0 2024-04-01T06:57:43.566 INFO:tasks.workunit.client.0.smithi083.stdout:9/939: chown d6/d32/d8f/d6d/d103/f124 0 1 2024-04-01T06:57:43.566 INFO:tasks.workunit.client.0.smithi083.stdout:9/940: fdatasync d6/d32/d3c/f6f 0 2024-04-01T06:57:43.569 INFO:tasks.workunit.client.0.smithi083.stdout:7/743: mkdir d0/d4/d9/d39/d103 0 2024-04-01T06:57:43.569 INFO:tasks.workunit.client.0.smithi083.stdout:7/744: read d0/d4/d9/d39/d67/d6d/d87/d83/ffa [3029679,14967] 0 2024-04-01T06:57:43.578 INFO:tasks.workunit.client.0.smithi083.stdout:1/973: link db/d1c/d29/l2a db/d1c/d29/d33/d50/d5d/d6c/d8e/l160 0 2024-04-01T06:57:43.579 INFO:tasks.workunit.client.0.smithi083.stdout:1/974: write db/d1c/d49/f141 [122648,75219] 0 2024-04-01T06:57:43.579 INFO:tasks.workunit.client.0.smithi083.stdout:1/975: truncate db/d1c/d1d/d8b/f12c 824365 0 2024-04-01T06:57:43.579 INFO:tasks.workunit.client.0.smithi083.stdout:7/745: mknod d0/c104 0 2024-04-01T06:57:43.582 INFO:tasks.workunit.client.0.smithi083.stdout:1/976: creat db/d1c/d29/d33/d50/d5d/dad/d106/f161 x:0 0 0 2024-04-01T06:57:43.582 INFO:tasks.workunit.client.0.smithi083.stdout:9/941: dwrite d6/d76/fbb [0,4194304] 0 2024-04-01T06:57:43.584 INFO:tasks.workunit.client.0.smithi083.stdout:3/980: rename d6/d15/d2d/d2f/d53 to d6/d1e/d4a/dd0/d134 0 2024-04-01T06:57:43.584 INFO:tasks.workunit.client.0.smithi083.stdout:3/981: write d6/d15/d2d/d2f/dc7/dcf/fa2 [1466765,112574] 0 2024-04-01T06:57:43.585 INFO:tasks.workunit.client.0.smithi083.stdout:1/977: mkdir db/d1c/d1d/d8b/d162 0 2024-04-01T06:57:43.596 INFO:tasks.workunit.client.0.smithi083.stdout:9/942: mkdir d6/d32/d3c/d4c/d88/df0/d13b 0 2024-04-01T06:57:43.598 INFO:tasks.workunit.client.0.smithi083.stdout:5/867: rename d4/d9/d16/d9f/dc7/d96/db2/f10c to d4/d9/d16/d19/d5e/d110/f11c 0 2024-04-01T06:57:43.598 INFO:tasks.workunit.client.0.smithi083.stdout:5/868: write d4/d71/fae [419045,63395] 0 2024-04-01T06:57:43.599 INFO:tasks.workunit.client.0.smithi083.stdout:3/982: getdents d6/d15/d2d/d2f/d42/d5c 0 2024-04-01T06:57:43.601 INFO:tasks.workunit.client.0.smithi083.stdout:1/978: creat db/d1c/d2e/dfd/f163 x:0 0 0 2024-04-01T06:57:43.601 INFO:tasks.workunit.client.0.smithi083.stdout:1/979: truncate db/d1c/d29/d33/d47/f122 37645 0 2024-04-01T06:57:43.601 INFO:tasks.workunit.client.0.smithi083.stdout:1/980: fsync db/d1c/d29/d33/d50/d5d/d81/f137 0 2024-04-01T06:57:43.601 INFO:tasks.workunit.client.0.smithi083.stdout:1/981: write db/d1c/d29/f135 [47294,91509] 0 2024-04-01T06:57:43.603 INFO:tasks.workunit.client.0.smithi083.stdout:9/943: mkdir d6/d32/d26/d2d/d34/dc6/d11b/d13c 0 2024-04-01T06:57:43.604 INFO:tasks.workunit.client.0.smithi083.stdout:5/869: symlink d4/d9/d16/d1f/d2f/d53/dbb/l11d 0 2024-04-01T06:57:43.605 INFO:tasks.workunit.client.0.smithi083.stdout:3/983: symlink d6/d15/d2d/d2f/d3e/d74/l135 0 2024-04-01T06:57:43.606 INFO:tasks.workunit.client.0.smithi083.stdout:3/984: mknod d6/d15/d2d/d2f/d42/d5c/d88/db9/d12f/c136 0 2024-04-01T06:57:43.609 INFO:tasks.workunit.client.0.smithi083.stdout:2/828: sync 2024-04-01T06:57:43.609 INFO:tasks.workunit.client.0.smithi083.stdout:8/972: sync 2024-04-01T06:57:43.609 INFO:tasks.workunit.client.0.smithi083.stdout:6/771: sync 2024-04-01T06:57:43.609 INFO:tasks.workunit.client.0.smithi083.stdout:4/820: sync 2024-04-01T06:57:43.609 INFO:tasks.workunit.client.0.smithi083.stdout:1/982: dread db/d1c/d2e/d30/fc1 [0,4194304] 0 2024-04-01T06:57:43.609 INFO:tasks.workunit.client.0.smithi083.stdout:4/821: truncate d1/d47/d2a/f80 410289 0 2024-04-01T06:57:43.609 INFO:tasks.workunit.client.0.smithi083.stdout:1/983: rename db/d1c/d29 to db/d1c/d29/d33/d50/d5d/dad/dbf/d164 22 2024-04-01T06:57:43.610 INFO:tasks.workunit.client.0.smithi083.stdout:6/772: creat d9/f106 x:0 0 0 2024-04-01T06:57:43.611 INFO:tasks.workunit.client.0.smithi083.stdout:2/829: mkdir d3/d26/d59/d27/d79/d117 0 2024-04-01T06:57:43.611 INFO:tasks.workunit.client.0.smithi083.stdout:2/830: write d3/d4d/d5d/fef [292329,75753] 0 2024-04-01T06:57:43.611 INFO:tasks.workunit.client.0.smithi083.stdout:8/973: symlink d15/d1b/d39/d48/d5e/d70/d11c/d44/d97/dde/l156 0 2024-04-01T06:57:43.612 INFO:tasks.workunit.client.0.smithi083.stdout:3/985: dread d6/d15/d2d/d2f/d3e/d74/df5/f11f [0,4194304] 0 2024-04-01T06:57:43.612 INFO:tasks.workunit.client.0.smithi083.stdout:3/986: chown d6/d15/dec 16 1 2024-04-01T06:57:43.612 INFO:tasks.workunit.client.0.smithi083.stdout:4/822: creat d1/d4/db8/ded/de8/dd5/de9/d89/f109 x:0 0 0 2024-04-01T06:57:43.612 INFO:tasks.workunit.client.0.smithi083.stdout:4/823: dread - d1/d4/db8/ded/d79/fbb zero size 2024-04-01T06:57:43.612 INFO:tasks.workunit.client.0.smithi083.stdout:4/824: chown d1/d47/f70 13 1 2024-04-01T06:57:43.614 INFO:tasks.workunit.client.0.smithi083.stdout:6/773: dread d9/dc/d1b/d35/f85 [0,4194304] 0 2024-04-01T06:57:43.614 INFO:tasks.workunit.client.0.smithi083.stdout:2/831: mknod d3/d8b/dea/c118 0 2024-04-01T06:57:43.614 INFO:tasks.workunit.client.0.smithi083.stdout:2/832: fsync d3/d8b/f51 0 2024-04-01T06:57:43.614 INFO:tasks.workunit.client.0.smithi083.stdout:3/987: write d6/d15/d2d/d2f/d42/d5c/d88/fe3 [184802,78640] 0 2024-04-01T06:57:43.616 INFO:tasks.workunit.client.0.smithi083.stdout:6/774: creat d9/dc/d9f/de2/df5/f107 x:0 0 0 2024-04-01T06:57:43.617 INFO:tasks.workunit.client.0.smithi083.stdout:6/775: read d9/dc/d29/d3c/d45/dc4/fbc [2999569,8327] 0 2024-04-01T06:57:43.617 INFO:tasks.workunit.client.0.smithi083.stdout:2/833: creat d3/d71/d90/db6/dcd/dfd/d5e/f119 x:0 0 0 2024-04-01T06:57:43.618 INFO:tasks.workunit.client.0.smithi083.stdout:3/988: truncate d6/d1e/f90 1493588 0 2024-04-01T06:57:43.621 INFO:tasks.workunit.client.0.smithi083.stdout:2/834: unlink d3/d71/d90/db6/dcd/fd8 0 2024-04-01T06:57:43.622 INFO:tasks.workunit.client.0.smithi083.stdout:3/989: symlink d6/d1e/d6f/daf/dc1/l137 0 2024-04-01T06:57:43.622 INFO:tasks.workunit.client.0.smithi083.stdout:3/990: write d6/d15/d2d/d2f/d42/d46/dd2/f11c [431357,129854] 0 2024-04-01T06:57:43.624 INFO:tasks.workunit.client.0.smithi083.stdout:2/835: creat d3/d4d/d57/df2/f11a x:0 0 0 2024-04-01T06:57:43.624 INFO:tasks.workunit.client.0.smithi083.stdout:5/870: dwrite d4/f92 [0,4194304] 0 2024-04-01T06:57:43.624 INFO:tasks.workunit.client.0.smithi083.stdout:5/871: chown d4/d9/d16/d19/d5e/d113/da9/cb1 0 1 2024-04-01T06:57:43.624 INFO:tasks.workunit.client.0.smithi083.stdout:2/836: write d3/d20/f21 [2133516,64438] 0 2024-04-01T06:57:43.624 INFO:tasks.workunit.client.0.smithi083.stdout:9/944: dwrite d6/d32/d26/d2d/f18 [0,4194304] 0 2024-04-01T06:57:43.624 INFO:tasks.workunit.client.0.smithi083.stdout:9/945: dread - d6/d32/d26/d8e/fe9 zero size 2024-04-01T06:57:43.624 INFO:tasks.workunit.client.0.smithi083.stdout:9/946: write d6/d32/d26/d2d/d34/dc6/d11b/f134 [378461,84199] 0 2024-04-01T06:57:43.624 INFO:tasks.workunit.client.0.smithi083.stdout:9/947: write d6/d32/d26/ff8 [484028,86399] 0 2024-04-01T06:57:43.625 INFO:tasks.workunit.client.0.smithi083.stdout:3/991: dread d6/d1e/d4a/dd0/d134/fbc [0,4194304] 0 2024-04-01T06:57:43.625 INFO:tasks.workunit.client.0.smithi083.stdout:3/992: stat d6/d15/d2d/d2f/d42/d46/dd2/ded/d110 0 2024-04-01T06:57:43.629 INFO:tasks.workunit.client.0.smithi083.stdout:5/872: mknod d4/d71/d94/da8/c11e 0 2024-04-01T06:57:43.629 INFO:tasks.workunit.client.0.smithi083.stdout:5/873: read - d4/d9/fb9 zero size 2024-04-01T06:57:43.632 INFO:tasks.workunit.client.0.smithi083.stdout:2/837: rename d3/f2f to d3/d71/d90/db6/f11b 0 2024-04-01T06:57:43.632 INFO:tasks.workunit.client.0.smithi083.stdout:1/984: dwrite db/d1c/d2e/d30/d82/f102 [0,4194304] 0 2024-04-01T06:57:43.632 INFO:tasks.workunit.client.0.smithi083.stdout:1/985: readlink db/d1c/d1d/db4/ddf/l111 0 2024-04-01T06:57:43.633 INFO:tasks.workunit.client.0.smithi083.stdout:3/993: link d6/d1e/fc0 d6/d15/d2d/d2f/d42/d83/f138 0 2024-04-01T06:57:43.634 INFO:tasks.workunit.client.0.smithi083.stdout:2/838: symlink d3/d4d/d57/df2/l11c 0 2024-04-01T06:57:43.635 INFO:tasks.workunit.client.0.smithi083.stdout:4/825: dwrite d1/d4/db/d5b/fea [0,4194304] 0 2024-04-01T06:57:43.636 INFO:tasks.workunit.client.0.smithi083.stdout:4/826: read d1/d4/db8/fdd [19336,28011] 0 2024-04-01T06:57:43.637 INFO:tasks.workunit.client.0.smithi083.stdout:1/986: creat db/d1c/d29/d33/d50/d5d/dad/dbf/f165 x:0 0 0 2024-04-01T06:57:43.638 INFO:tasks.workunit.client.0.smithi083.stdout:3/994: mkdir d6/d1e/d139 0 2024-04-01T06:57:43.638 INFO:tasks.workunit.client.0.smithi083.stdout:2/839: mknod d3/d4d/c11d 0 2024-04-01T06:57:43.642 INFO:tasks.workunit.client.0.smithi083.stdout:6/776: dread d9/dc/d29/d3c/faf [0,4194304] 0 2024-04-01T06:57:43.642 INFO:tasks.workunit.client.0.smithi083.stdout:6/777: dread - d9/d57/d5f/dff/f102 zero size 2024-04-01T06:57:43.643 INFO:tasks.workunit.client.0.smithi083.stdout:4/827: link d1/d4/db8/ded/c5a d1/d4/db/d94/daf/dd1/dab/c10a 0 2024-04-01T06:57:43.644 INFO:tasks.workunit.client.0.smithi083.stdout:3/995: symlink d6/d1e/d139/l13a 0 2024-04-01T06:57:43.646 INFO:tasks.workunit.client.0.smithi083.stdout:2/840: mknod d3/d71/df9/c11e 0 2024-04-01T06:57:43.646 INFO:tasks.workunit.client.0.smithi083.stdout:2/841: dread - d3/d26/d59/fd4 zero size 2024-04-01T06:57:43.648 INFO:tasks.workunit.client.0.smithi083.stdout:8/974: dwrite d15/d1b/d39/d48/d5e/d70/d11c/d38/d62/f4c [0,4194304] 0 2024-04-01T06:57:43.648 INFO:tasks.workunit.client.0.smithi083.stdout:5/874: dread d4/d71/fa3 [0,4194304] 0 2024-04-01T06:57:43.648 INFO:tasks.workunit.client.0.smithi083.stdout:8/975: truncate d15/d1b/d39/d48/d5e/d70/d11c/d44/d97/f11e 4365465 0 2024-04-01T06:57:43.648 INFO:tasks.workunit.client.0.smithi083.stdout:5/875: write d4/d9/d16/d1f/d2f/f59 [5016206,19637] 0 2024-04-01T06:57:43.648 INFO:tasks.workunit.client.0.smithi083.stdout:5/876: fdatasync d4/d71/f7a 0 2024-04-01T06:57:43.649 INFO:tasks.workunit.client.0.smithi083.stdout:6/778: rename d9/dc/d3b/df0 to d9/dc/d1b/d39/d68/d108 0 2024-04-01T06:57:43.649 INFO:tasks.workunit.client.0.smithi083.stdout:4/828: getdents d1/d4/db8/ded/de8/dd5/dbc 0 2024-04-01T06:57:43.652 INFO:tasks.workunit.client.0.smithi083.stdout:9/948: dwrite d6/d32/d3c/d4c/d88/f8a [0,4194304] 0 2024-04-01T06:57:43.654 INFO:tasks.workunit.client.0.smithi083.stdout:1/987: dwrite db/d1c/d29/d33/d50/f114 [0,4194304] 0 2024-04-01T06:57:43.655 INFO:tasks.workunit.client.0.smithi083.stdout:8/976: unlink d15/d1b/d39/d48/f68 0 2024-04-01T06:57:43.655 INFO:tasks.workunit.client.0.smithi083.stdout:8/977: fsync d15/d1b/d39/d48/d5e/d70/d11c/d44/d75/dab/fac 0 2024-04-01T06:57:43.658 INFO:tasks.workunit.client.0.smithi083.stdout:5/877: unlink d4/d23/c9b 0 2024-04-01T06:57:43.660 INFO:tasks.workunit.client.0.smithi083.stdout:3/996: dwrite d6/d1e/fc0 [4194304,4194304] 0 2024-04-01T06:57:43.660 INFO:tasks.workunit.client.0.smithi083.stdout:2/842: rename d3/d71/d90/db6/dcd/dfd/d5f/le8 to d3/d71/db8/dec/l11f 0 2024-04-01T06:57:43.661 INFO:tasks.workunit.client.0.smithi083.stdout:4/829: mkdir d1/da5/dfc/d10b 0 2024-04-01T06:57:43.668 INFO:tasks.workunit.client.0.smithi083.stdout:1/988: mkdir db/d1c/d1d/db4/d166 0 2024-04-01T06:57:43.676 INFO:tasks.workunit.client.0.smithi083.stdout:8/978: dwrite d15/fd3 [0,4194304] 0 2024-04-01T06:57:43.676 INFO:tasks.workunit.client.0.smithi083.stdout:9/949: dwrite d6/d32/d26/d2d/d34/dc6/fd8 [4194304,4194304] 0 2024-04-01T06:57:43.676 INFO:tasks.workunit.client.0.smithi083.stdout:9/950: truncate d6/d76/f133 297609 0 2024-04-01T06:57:43.676 INFO:tasks.workunit.client.0.smithi083.stdout:9/951: chown d6/d32/d3c/d4c/fae 43960184 1 2024-04-01T06:57:43.681 INFO:tasks.workunit.client.0.smithi083.stdout:3/997: creat d6/d15/d2d/f13b x:0 0 0 2024-04-01T06:57:43.683 INFO:tasks.workunit.client.0.smithi083.stdout:6/779: rename d9/dc/d1b/d35/f7b to d9/dc/d1b/d4c/d99/f109 0 2024-04-01T06:57:43.684 INFO:tasks.workunit.client.0.smithi083.stdout:2/843: mkdir d3/d71/df9/d120 0 2024-04-01T06:57:43.686 INFO:tasks.workunit.client.0.smithi083.stdout:4/830: creat d1/da5/dae/df5/f10c x:0 0 0 2024-04-01T06:57:43.691 INFO:tasks.workunit.client.0.smithi083.stdout:1/989: symlink db/d1c/d29/d33/d50/d4d/l167 0 2024-04-01T06:57:43.692 INFO:tasks.workunit.client.0.smithi083.stdout:8/979: getdents d15/d1b/d39/d48/d5e/d70/d11c/d44/d108 0 2024-04-01T06:57:43.694 INFO:tasks.workunit.client.0.smithi083.stdout:9/952: truncate d6/d32/fa2 3537287 0 2024-04-01T06:57:43.694 INFO:tasks.workunit.client.0.smithi083.stdout:9/953: dread - d6/d76/ffb zero size 2024-04-01T06:57:43.697 INFO:tasks.workunit.client.0.smithi083.stdout:9/954: write d6/d32/d26/d2d/d34/f43 [1742708,29104] 0 2024-04-01T06:57:43.697 INFO:tasks.workunit.client.0.smithi083.stdout:9/955: fsync d6/d32/d3c/f57 0 2024-04-01T06:57:43.697 INFO:tasks.workunit.client.0.smithi083.stdout:9/956: readlink d6/d32/d26/d2d/d34/lb6 0 2024-04-01T06:57:43.697 INFO:tasks.workunit.client.0.smithi083.stdout:9/957: write d6/d32/d3c/d4c/d88/fed [864583,70741] 0 2024-04-01T06:57:43.697 INFO:tasks.workunit.client.0.smithi083.stdout:3/998: symlink d6/d15/d2d/d2f/d42/d5c/d88/db9/d12e/l13c 0 2024-04-01T06:57:43.698 INFO:tasks.workunit.client.0.smithi083.stdout:7/746: sync 2024-04-01T06:57:43.702 INFO:tasks.workunit.client.0.smithi083.stdout:2/844: dwrite d3/d71/d90/db6/dcd/dfd/d5e/f9a [0,4194304] 0 2024-04-01T06:57:43.703 INFO:tasks.workunit.client.0.smithi083.stdout:5/878: rename d4/d71/f117 to d4/d9/d16/dc1/da0/df7/f11f 0 2024-04-01T06:57:43.706 INFO:tasks.workunit.client.0.smithi083.stdout:6/780: creat d9/d57/d5f/df9/f10a x:0 0 0 2024-04-01T06:57:43.708 INFO:tasks.workunit.client.0.smithi083.stdout:1/990: mknod db/d1c/d2e/d15e/c168 0 2024-04-01T06:57:43.708 INFO:tasks.workunit.client.0.smithi083.stdout:4/831: dwrite d1/da5/dae/dd2/f108 [0,4194304] 0 2024-04-01T06:57:43.708 INFO:tasks.workunit.client.0.smithi083.stdout:4/832: readlink d1/d4/la2 0 2024-04-01T06:57:43.708 INFO:tasks.workunit.client.0.smithi083.stdout:7/747: creat d0/d4/dbd/f105 x:0 0 0 2024-04-01T06:57:43.711 INFO:tasks.workunit.client.0.smithi083.stdout:2/845: creat d3/d26/d59/d27/d79/f121 x:0 0 0 2024-04-01T06:57:43.711 INFO:tasks.workunit.client.0.smithi083.stdout:2/846: truncate d3/d71/fbd 884368 0 2024-04-01T06:57:43.712 INFO:tasks.workunit.client.0.smithi083.stdout:2/847: read d3/d71/d90/db6/dcd/dfd/d5e/f9a [1093715,33338] 0 2024-04-01T06:57:43.713 INFO:tasks.workunit.client.0.smithi083.stdout:3/999: dwrite d6/d1e/d4a/dd0/d134/fbc [0,4194304] 0 2024-04-01T06:57:43.713 INFO:tasks.workunit.client.0.smithi083.stdout:6/781: dread d9/dc/d1b/d4c/d99/f109 [0,4194304] 0 2024-04-01T06:57:43.713 INFO:tasks.workunit.client.0.smithi083.stdout:5/879: unlink d4/d9/l43 0 2024-04-01T06:57:43.715 INFO:tasks.workunit.client.0.smithi083.stdout:1/991: link db/d1c/d29/d33/d50/f114 db/d1c/d29/d33/d47/d76/d148/f169 0 2024-04-01T06:57:43.716 INFO:tasks.workunit.client.0.smithi083.stdout:9/958: symlink d6/d32/d3c/d3d/l13d 0 2024-04-01T06:57:43.719 INFO:tasks.workunit.client.0.smithi083.stdout:4/833: mknod d1/d47/d2a/db5/d107/c10d 0 2024-04-01T06:57:43.724 INFO:tasks.workunit.client.0.smithi083.stdout:7/748: creat d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/f106 x:0 0 0 2024-04-01T06:57:43.725 INFO:tasks.workunit.client.0.smithi083.stdout:2/848: rmdir d3/d71/d90/db6/dcd/dfd/d5f 39 2024-04-01T06:57:43.725 INFO:tasks.workunit.client.0.smithi083.stdout:2/849: dread - d3/d71/d81/ffb zero size 2024-04-01T06:57:43.727 INFO:tasks.workunit.client.0.smithi083.stdout:9/959: dwrite d6/d32/d26/d2d/d34/f3b [0,4194304] 0 2024-04-01T06:57:43.727 INFO:tasks.workunit.client.0.smithi083.stdout:4/834: dread d1/d4/db/d94/daf/dd1/f63 [0,4194304] 0 2024-04-01T06:57:43.727 INFO:tasks.workunit.client.0.smithi083.stdout:4/835: chown d1/d4/db8/ded/de8/dd5/de9/f50 5 1 2024-04-01T06:57:43.731 INFO:tasks.workunit.client.0.smithi083.stdout:6/782: creat d9/dc/d9d/f10b x:0 0 0 2024-04-01T06:57:43.731 INFO:tasks.workunit.client.0.smithi083.stdout:5/880: link d4/d9/d16/d19/d5e/d113/d21/le5 d4/d23/d4e/d83/dd5/l120 0 2024-04-01T06:57:43.731 INFO:tasks.workunit.client.0.smithi083.stdout:6/783: truncate d9/dc/f65 5176641 0 2024-04-01T06:57:43.731 INFO:tasks.workunit.client.0.smithi083.stdout:7/749: getdents d0/d4/d9/d95 0 2024-04-01T06:57:43.732 INFO:tasks.workunit.client.0.smithi083.stdout:6/784: dread - d9/dc/d1b/d4c/fd8 zero size 2024-04-01T06:57:43.732 INFO:tasks.workunit.client.0.smithi083.stdout:6/785: write d9/dc/d1b/d35/fec [644967,45672] 0 2024-04-01T06:57:43.732 INFO:tasks.workunit.client.0.smithi083.stdout:6/786: write d9/dc/d29/d3c/d45/dc4/dd2/fe1 [4271561,4819] 0 2024-04-01T06:57:43.732 INFO:tasks.workunit.client.0.smithi083.stdout:1/992: dwrite db/d1c/d29/d33/d50/d5d/d6c/f74 [0,4194304] 0 2024-04-01T06:57:43.732 INFO:tasks.workunit.client.0.smithi083.stdout:1/993: write db/d1c/d49/f7d [4226514,34115] 0 2024-04-01T06:57:43.732 INFO:tasks.workunit.client.0.smithi083.stdout:1/994: chown db/d1c/d29/d33/d50/d5d/d6c/d8e/fd5 3170553 1 2024-04-01T06:57:43.733 INFO:tasks.workunit.client.0.smithi083.stdout:9/960: creat d6/d32/d26/d2d/d34/dc6/d11b/d13c/f13e x:0 0 0 2024-04-01T06:57:43.733 INFO:tasks.workunit.client.0.smithi083.stdout:4/836: read d1/d4/db/d5b/f5f [3192453,44353] 0 2024-04-01T06:57:43.734 INFO:tasks.workunit.client.0.smithi083.stdout:5/881: getdents d4/d23 0 2024-04-01T06:57:43.735 INFO:tasks.workunit.client.0.smithi083.stdout:5/882: readlink d4/d55/lba 0 2024-04-01T06:57:43.737 INFO:tasks.workunit.client.0.smithi083.stdout:6/787: link d9/dc/d1b/d39/d68/fca d9/dc/d29/d3c/d45/dc4/dcb/f10c 0 2024-04-01T06:57:43.737 INFO:tasks.workunit.client.0.smithi083.stdout:6/788: truncate d9/dc/d3b/fe4 75894 0 2024-04-01T06:57:43.739 INFO:tasks.workunit.client.0.smithi083.stdout:6/789: dread d9/dc/f14 [0,4194304] 0 2024-04-01T06:57:43.739 INFO:tasks.workunit.client.0.smithi083.stdout:6/790: fsync d9/dc/d29/fa8 0 2024-04-01T06:57:43.742 INFO:tasks.workunit.client.0.smithi083.stdout:1/995: mknod db/d1c/d1d/c16a 0 2024-04-01T06:57:43.744 INFO:tasks.workunit.client.0.smithi083.stdout:4/837: rmdir d1/d4/db8/ded/de8/dd5/db6 39 2024-04-01T06:57:43.744 INFO:tasks.workunit.client.0.smithi083.stdout:4/838: chown d1/da5/ce4 0 1 2024-04-01T06:57:43.744 INFO:tasks.workunit.client.0.smithi083.stdout:7/750: dwrite d0/d4/d9/d39/d67/d6d/d87/d83/d34/f57 [4194304,4194304] 0 2024-04-01T06:57:43.744 INFO:tasks.workunit.client.0.smithi083.stdout:2/850: dwrite d3/d26/d59/f31 [0,4194304] 0 2024-04-01T06:57:43.746 INFO:tasks.workunit.client.0.smithi083.stdout:5/883: mkdir d4/d9/d16/dc1/d121 0 2024-04-01T06:57:43.746 INFO:tasks.workunit.client.0.smithi083.stdout:5/884: chown d4/d23/d49/fa1 561179 1 2024-04-01T06:57:43.748 INFO:tasks.workunit.client.0.smithi083.stdout:1/996: truncate db/d1c/d29/d33/d50/d5d/d6c/d8e/fd5 4119956 0 2024-04-01T06:57:43.748 INFO:tasks.workunit.client.0.smithi083.stdout:1/997: truncate db/d1c/d2e/d30/d82/f15a 370653 0 2024-04-01T06:57:43.748 INFO:tasks.workunit.client.0.smithi083.stdout:1/998: readlink db/d1c/d29/d33/d50/d4d/l54 0 2024-04-01T06:57:43.749 INFO:tasks.workunit.client.0.smithi083.stdout:4/839: creat d1/d47/d2a/db5/d107/f10e x:0 0 0 2024-04-01T06:57:43.749 INFO:tasks.workunit.client.0.smithi083.stdout:1/999: dread db/d1c/d29/d33/fc6 [0,4194304] 0 2024-04-01T06:57:43.752 INFO:tasks.workunit.client.0.smithi083.stdout:9/961: rename d6/d32/d3c/f66 to d6/d32/d3c/d3d/f13f 0 2024-04-01T06:57:43.755 INFO:tasks.workunit.client.0.smithi083.stdout:5/885: creat d4/d9/d16/d19/d5e/d110/f122 x:0 0 0 2024-04-01T06:57:43.755 INFO:tasks.workunit.client.0.smithi083.stdout:6/791: mkdir d9/dc/d29/d3c/d10d 0 2024-04-01T06:57:43.757 INFO:tasks.workunit.client.0.smithi083.stdout:4/840: getdents d1/d4/db8/ded/de8/dd5/dbc/dc2 0 2024-04-01T06:57:43.759 INFO:tasks.workunit.client.0.smithi083.stdout:9/962: creat d6/d32/d3c/d4c/d6b/dd3/df6/f140 x:0 0 0 2024-04-01T06:57:43.761 INFO:tasks.workunit.client.0.smithi083.stdout:5/886: link d4/d9/d16/d9f/dc7/d68/df2/f103 d4/d23/d67/de3/f123 0 2024-04-01T06:57:43.761 INFO:tasks.workunit.client.0.smithi083.stdout:2/851: dwrite d3/d26/d59/daf/fc7 [0,4194304] 0 2024-04-01T06:57:43.765 INFO:tasks.workunit.client.0.smithi083.stdout:6/792: unlink d9/dc/d1b/d35/c59 0 2024-04-01T06:57:43.767 INFO:tasks.workunit.client.0.smithi083.stdout:4/841: rename d1/d4/f4f to d1/d4/f10f 0 2024-04-01T06:57:43.767 INFO:tasks.workunit.client.0.smithi083.stdout:4/842: chown d1/d4/db8/ded/de8/d88/da8/df8 1002 1 2024-04-01T06:57:43.768 INFO:tasks.workunit.client.0.smithi083.stdout:9/963: symlink d6/d32/d26/d2d/d34/dc6/d11b/l141 0 2024-04-01T06:57:43.771 INFO:tasks.workunit.client.0.smithi083.stdout:5/887: truncate d4/f92 3934660 0 2024-04-01T06:57:43.772 INFO:tasks.workunit.client.0.smithi083.stdout:5/888: write d4/d71/f97 [9391865,57458] 0 2024-04-01T06:57:43.772 INFO:tasks.workunit.client.0.smithi083.stdout:5/889: read d4/d9/d16/d1f/d2f/d53/dbb/fac [202507,97178] 0 2024-04-01T06:57:43.772 INFO:tasks.workunit.client.0.smithi083.stdout:2/852: creat d3/d8b/dea/f122 x:0 0 0 2024-04-01T06:57:43.773 INFO:tasks.workunit.client.0.smithi083.stdout:2/853: fdatasync d3/d71/d90/db6/ffc 0 2024-04-01T06:57:43.773 INFO:tasks.workunit.client.0.smithi083.stdout:5/890: write d4/fc8 [666116,59357] 0 2024-04-01T06:57:43.773 INFO:tasks.workunit.client.0.smithi083.stdout:6/793: mkdir d9/dc/d29/d3c/d45/dc4/dcb/d10e 0 2024-04-01T06:57:43.775 INFO:tasks.workunit.client.0.smithi083.stdout:6/794: write d9/dc/f40 [2330784,66961] 0 2024-04-01T06:57:43.775 INFO:tasks.workunit.client.0.smithi083.stdout:6/795: write d9/dc/d29/d3c/d45/dc4/dcb/dd3/fef [73581,79478] 0 2024-04-01T06:57:43.775 INFO:tasks.workunit.client.0.smithi083.stdout:4/843: creat d1/d4/f110 x:0 0 0 2024-04-01T06:57:43.777 INFO:tasks.workunit.client.0.smithi083.stdout:2/854: truncate d3/d4d/d57/f6b 1341146 0 2024-04-01T06:57:43.777 INFO:tasks.workunit.client.0.smithi083.stdout:2/855: write d3/d26/f89 [1127902,108734] 0 2024-04-01T06:57:43.778 INFO:tasks.workunit.client.0.smithi083.stdout:2/856: write d3/d26/fc9 [666659,25381] 0 2024-04-01T06:57:43.783 INFO:tasks.workunit.client.0.smithi083.stdout:9/964: dwrite d6/d32/d26/d2d/f18 [4194304,4194304] 0 2024-04-01T06:57:43.783 INFO:tasks.workunit.client.0.smithi083.stdout:6/796: symlink d9/dc/d9d/l10f 0 2024-04-01T06:57:43.786 INFO:tasks.workunit.client.0.smithi083.stdout:6/797: creat d9/dc/d3b/f110 x:0 0 0 2024-04-01T06:57:43.787 INFO:tasks.workunit.client.0.smithi083.stdout:4/844: dread d1/d4/d6e/f78 [0,4194304] 0 2024-04-01T06:57:43.787 INFO:tasks.workunit.client.0.smithi083.stdout:4/845: readlink d1/d4/db/d94/daf/dd1/ld8 0 2024-04-01T06:57:43.787 INFO:tasks.workunit.client.0.smithi083.stdout:4/846: dread - d1/da5/dae/dd2/fe6 zero size 2024-04-01T06:57:43.789 INFO:tasks.workunit.client.0.smithi083.stdout:6/798: creat d9/dc/d29/d3c/d5c/f111 x:0 0 0 2024-04-01T06:57:43.790 INFO:tasks.workunit.client.0.smithi083.stdout:5/891: dwrite d4/d9/d16/ff1 [0,4194304] 0 2024-04-01T06:57:43.793 INFO:tasks.workunit.client.0.smithi083.stdout:6/799: dread d9/d57/f5e [0,4194304] 0 2024-04-01T06:57:43.793 INFO:tasks.workunit.client.0.smithi083.stdout:4/847: mkdir d1/d4/db8/ded/de8/d88/da8/d111 0 2024-04-01T06:57:43.793 INFO:tasks.workunit.client.0.smithi083.stdout:9/965: dread d6/d32/d3c/f57 [4194304,4194304] 0 2024-04-01T06:57:43.794 INFO:tasks.workunit.client.0.smithi083.stdout:9/966: dread d6/d32/fa4 [0,4194304] 0 2024-04-01T06:57:43.794 INFO:tasks.workunit.client.0.smithi083.stdout:9/967: stat d6/d76/fac 0 2024-04-01T06:57:43.794 INFO:tasks.workunit.client.0.smithi083.stdout:9/968: chown d6/d32/d26/d2d/d34/dc3/le7 0 1 2024-04-01T06:57:43.794 INFO:tasks.workunit.client.0.smithi083.stdout:9/969: chown d6/d32/d3c/d4c/d6b/dd3 32 1 2024-04-01T06:57:43.797 INFO:tasks.workunit.client.0.smithi083.stdout:2/857: dwrite d3/d20/f21 [0,4194304] 0 2024-04-01T06:57:43.797 INFO:tasks.workunit.client.0.smithi083.stdout:2/858: chown d3/d20/d42/dee/fdf 97 1 2024-04-01T06:57:43.797 INFO:tasks.workunit.client.0.smithi083.stdout:5/892: truncate d4/d9/d16/d1f/d2f/f59 902566 0 2024-04-01T06:57:43.799 INFO:tasks.workunit.client.0.smithi083.stdout:6/800: getdents d9/dc/d29/d3c/d45/dc4 0 2024-04-01T06:57:43.799 INFO:tasks.workunit.client.0.smithi083.stdout:6/801: dread - d9/dc/d29/d3c/d45/dc4/dd2/feb zero size 2024-04-01T06:57:43.799 INFO:tasks.workunit.client.0.smithi083.stdout:6/802: truncate d9/dc/d1b/d35/d48/d52/d9c/dab/fe6 947627 0 2024-04-01T06:57:43.802 INFO:tasks.workunit.client.0.smithi083.stdout:2/859: rename d3/d71/d90/lc3 to d3/d26/d59/d2b/da3/l123 0 2024-04-01T06:57:43.803 INFO:tasks.workunit.client.0.smithi083.stdout:5/893: mknod d4/d9/d16/dc1/da0/c124 0 2024-04-01T06:57:43.803 INFO:tasks.workunit.client.0.smithi083.stdout:6/803: dread d9/dc/d29/d3c/d5c/f84 [0,4194304] 0 2024-04-01T06:57:43.803 INFO:tasks.workunit.client.0.smithi083.stdout:9/970: dwrite d6/d32/d3c/d4c/d6b/dd3/df6/f140 [0,4194304] 0 2024-04-01T06:57:43.803 INFO:tasks.workunit.client.0.smithi083.stdout:9/971: dread - d6/d32/d26/d8e/fe9 zero size 2024-04-01T06:57:43.804 INFO:tasks.workunit.client.0.smithi083.stdout:4/848: dwrite d1/d4/db/d5b/f5f [0,4194304] 0 2024-04-01T06:57:43.804 INFO:tasks.workunit.client.0.smithi083.stdout:2/860: creat d3/d4d/d57/df2/f124 x:0 0 0 2024-04-01T06:57:43.807 INFO:tasks.workunit.client.0.smithi083.stdout:9/972: mknod d6/dfd/d13a/c142 0 2024-04-01T06:57:43.809 INFO:tasks.workunit.client.0.smithi083.stdout:4/849: symlink d1/d4/db8/ded/de8/dd5/db6/l112 0 2024-04-01T06:57:43.809 INFO:tasks.workunit.client.0.smithi083.stdout:4/850: truncate d1/d4/db8/ded/de8/dd5/dbc/dc2/fe7 992574 0 2024-04-01T06:57:43.811 INFO:tasks.workunit.client.0.smithi083.stdout:2/861: mknod d3/de1/df5/dae/ddd/c125 0 2024-04-01T06:57:43.813 INFO:tasks.workunit.client.0.smithi083.stdout:9/973: rename d6/d32/d3c/d3d/d123/f12d to d6/d32/d3c/d4c/f143 0 2024-04-01T06:57:43.813 INFO:tasks.workunit.client.0.smithi083.stdout:2/862: rename d3 to d3/d71/db8/d126 22 2024-04-01T06:57:43.813 INFO:tasks.workunit.client.0.smithi083.stdout:2/863: fdatasync d3/d71/db8/feb 0 2024-04-01T06:57:43.814 INFO:tasks.workunit.client.0.smithi083.stdout:2/864: write d3/d26/d59/d27/f7e [3082078,119050] 0 2024-04-01T06:57:43.814 INFO:tasks.workunit.client.0.smithi083.stdout:4/851: unlink d1/d4/f25 0 2024-04-01T06:57:43.817 INFO:tasks.workunit.client.0.smithi083.stdout:2/865: getdents d3/d20/d42/dee 0 2024-04-01T06:57:43.819 INFO:tasks.workunit.client.0.smithi083.stdout:4/852: mkdir d1/d47/d90/d113 0 2024-04-01T06:57:43.819 INFO:tasks.workunit.client.0.smithi083.stdout:4/853: chown d1/da5/dae/ld0 574 1 2024-04-01T06:57:43.820 INFO:tasks.workunit.client.0.smithi083.stdout:6/804: dwrite d9/dc/f42 [0,4194304] 0 2024-04-01T06:57:43.820 INFO:tasks.workunit.client.0.smithi083.stdout:6/805: readlink d9/dc/d1b/d35/d48/d52/ld5 0 2024-04-01T06:57:43.823 INFO:tasks.workunit.client.0.smithi083.stdout:2/866: link d3/d26/f3a d3/d71/d90/db6/dcd/dfd/d5e/f127 0 2024-04-01T06:57:43.825 INFO:tasks.workunit.client.0.smithi083.stdout:5/894: dwrite d4/d71/fae [0,4194304] 0 2024-04-01T06:57:43.829 INFO:tasks.workunit.client.0.smithi083.stdout:6/806: rmdir d9/dc/d1b/d39/d47 39 2024-04-01T06:57:43.838 INFO:tasks.workunit.client.0.smithi083.stdout:2/867: mkdir d3/d71/df9/d120/d128 0 2024-04-01T06:57:43.840 INFO:tasks.workunit.client.0.smithi083.stdout:5/895: getdents d4/d9/d16/dc1/da0/df7 0 2024-04-01T06:57:43.841 INFO:tasks.workunit.client.0.smithi083.stdout:6/807: rename d9/dc/d9f/cf4 to d9/d57/d5f/c112 0 2024-04-01T06:57:43.843 INFO:tasks.workunit.client.0.smithi083.stdout:5/896: symlink d4/d9/d16/d9f/l125 0 2024-04-01T06:57:43.845 INFO:tasks.workunit.client.0.smithi083.stdout:2/868: rename d3/d26/d59/d2b/f54 to d3/f129 0 2024-04-01T06:57:43.845 INFO:tasks.workunit.client.0.smithi083.stdout:2/869: fsync d3/d26/d59/d2b/d9d/f104 0 2024-04-01T06:57:43.847 INFO:tasks.workunit.client.0.smithi083.stdout:5/897: creat d4/d23/f126 x:0 0 0 2024-04-01T06:57:43.848 INFO:tasks.workunit.client.0.smithi083.stdout:2/870: mknod d3/de1/df5/dae/c12a 0 2024-04-01T06:57:43.848 INFO:tasks.workunit.client.0.smithi083.stdout:2/871: chown d3/d26/f36 202929051 1 2024-04-01T06:57:43.848 INFO:tasks.workunit.client.0.smithi083.stdout:6/808: symlink d9/dc/d29/l113 0 2024-04-01T06:57:43.849 INFO:tasks.workunit.client.0.smithi083.stdout:5/898: rename d4/d9/d16/lca to d4/d9/d16/d19/l127 0 2024-04-01T06:57:43.850 INFO:tasks.workunit.client.0.smithi083.stdout:2/872: mkdir d3/d4d/d57/d12b 0 2024-04-01T06:57:43.851 INFO:tasks.workunit.client.0.smithi083.stdout:6/809: link d9/dc/d1b/d4c/l79 d9/dc/d29/d3c/d45/dc4/dd2/l114 0 2024-04-01T06:57:43.851 INFO:tasks.workunit.client.0.smithi083.stdout:6/810: write d9/d57/f5e [1676184,65708] 0 2024-04-01T06:57:43.851 INFO:tasks.workunit.client.0.smithi083.stdout:6/811: chown d9/c93 1622 1 2024-04-01T06:57:43.852 INFO:tasks.workunit.client.0.smithi083.stdout:5/899: mknod d4/d9/d16/dc1/da0/dab/c128 0 2024-04-01T06:57:43.853 INFO:tasks.workunit.client.0.smithi083.stdout:6/812: rmdir d9/dc/d1b/d35/de0 39 2024-04-01T06:57:43.853 INFO:tasks.workunit.client.0.smithi083.stdout:6/813: truncate d9/dc/d1b/d35/de0/ffd 823666 0 2024-04-01T06:57:43.854 INFO:tasks.workunit.client.0.smithi083.stdout:5/900: creat d4/d23/d4e/f129 x:0 0 0 2024-04-01T06:57:43.854 INFO:tasks.workunit.client.0.smithi083.stdout:6/814: symlink d9/dc/d1b/df6/l115 0 2024-04-01T06:57:43.855 INFO:tasks.workunit.client.0.smithi083.stdout:6/815: fdatasync d9/dc/d1b/d39/d68/fca 0 2024-04-01T06:57:43.858 INFO:tasks.workunit.client.0.smithi083.stdout:6/816: rmdir d9/dc/d1b/d35/d48/d52/d9c 39 2024-04-01T06:57:43.862 INFO:tasks.workunit.client.0.smithi083.stdout:6/817: link d9/dc/f40 d9/d57/dbd/f116 0 2024-04-01T06:57:43.862 INFO:tasks.workunit.client.0.smithi083.stdout:6/818: write d9/dc/d1b/d35/d48/d52/d9c/fc0 [316061,30741] 0 2024-04-01T06:57:43.863 INFO:tasks.workunit.client.0.smithi083.stdout:6/819: getdents d9/dc/d1b 0 2024-04-01T06:57:43.868 INFO:tasks.workunit.client.0.smithi083.stdout:2/873: dwrite d3/d8b/ff1 [0,4194304] 0 2024-04-01T06:57:43.868 INFO:tasks.workunit.client.0.smithi083.stdout:2/874: chown d3/d26/f3a 282424 1 2024-04-01T06:57:43.868 INFO:tasks.workunit.client.0.smithi083.stdout:2/875: write d3/d26/d59/d27/f96 [1221363,19036] 0 2024-04-01T06:57:43.871 INFO:tasks.workunit.client.0.smithi083.stdout:6/820: dread d9/dc/d29/d3c/faf [0,4194304] 0 2024-04-01T06:57:43.872 INFO:tasks.workunit.client.0.smithi083.stdout:5/901: dwrite d4/d9/d16/d9f/dc7/ffc [0,4194304] 0 2024-04-01T06:57:43.875 INFO:tasks.workunit.client.0.smithi083.stdout:6/821: creat d9/dc/d1b/d39/d68/d108/f117 x:0 0 0 2024-04-01T06:57:43.881 INFO:tasks.workunit.client.0.smithi083.stdout:2/876: dwrite d3/d26/d59/d2b/f82 [4194304,4194304] 0 2024-04-01T06:57:43.881 INFO:tasks.workunit.client.0.smithi083.stdout:2/877: mkdir d3/d71/d90/db6/dcd/dfd/d66/d12c 0 2024-04-01T06:57:43.882 INFO:tasks.workunit.client.0.smithi083.stdout:2/878: link d3/de1/df5/dae/ddd/l10b d3/d26/l12d 0 2024-04-01T06:57:43.882 INFO:tasks.workunit.client.0.smithi083.stdout:2/879: stat d3/d8b 0 2024-04-01T06:57:43.887 INFO:tasks.workunit.client.0.smithi083.stdout:6/822: dwrite d9/dc/d1b/d35/f89 [0,4194304] 0 2024-04-01T06:57:43.906 INFO:tasks.workunit.client.0.smithi083.stdout:2/880: dwrite d3/de1/df5/fe2 [0,4194304] 0 2024-04-01T06:57:43.906 INFO:tasks.workunit.client.0.smithi083.stdout:2/881: dread - d3/d71/d90/db6/dcd/dfd/d5e/f119 zero size 2024-04-01T06:57:43.906 INFO:tasks.workunit.client.0.smithi083.stdout:6/823: dwrite d9/dc/d1b/f4d [0,4194304] 0 2024-04-01T06:57:43.906 INFO:tasks.workunit.client.0.smithi083.stdout:6/824: fdatasync d9/dc/d3b/fe4 0 2024-04-01T06:57:43.907 INFO:tasks.workunit.client.0.smithi083.stdout:6/825: fsync d9/dc/d29/d3c/d5c/d8b/f91 0 2024-04-01T06:57:43.907 INFO:tasks.workunit.client.0.smithi083.stdout:6/826: write d9/d57/dbd/f116 [3144034,61017] 0 2024-04-01T06:57:43.908 INFO:tasks.workunit.client.0.smithi083.stdout:2/882: unlink d3/d71/d90/db6/dcd/dfd/fcb 0 2024-04-01T06:57:43.914 INFO:tasks.workunit.client.0.smithi083.stdout:2/883: symlink d3/de1/df5/l12e 0 2024-04-01T06:57:43.914 INFO:tasks.workunit.client.0.smithi083.stdout:2/884: fdatasync d3/d20/d42/dee/fdf 0 2024-04-01T06:57:43.915 INFO:tasks.workunit.client.0.smithi083.stdout:2/885: read d3/fc [4041986,110957] 0 2024-04-01T06:57:43.916 INFO:tasks.workunit.client.0.smithi083.stdout:2/886: mknod d3/c12f 0 2024-04-01T06:57:43.922 INFO:tasks.workunit.client.0.smithi083.stdout:6/827: dwrite d9/dc/d1b/d35/fb5 [0,4194304] 0 2024-04-01T06:57:43.922 INFO:tasks.workunit.client.0.smithi083.stdout:6/828: fdatasync d9/dc/f25 0 2024-04-01T06:57:43.922 INFO:tasks.workunit.client.0.smithi083.stdout:6/829: dread - d9/dc/d9f/fa2 zero size 2024-04-01T06:57:43.923 INFO:tasks.workunit.client.0.smithi083.stdout:6/830: rmdir d9/d57/dbd 39 2024-04-01T06:57:43.924 INFO:tasks.workunit.client.0.smithi083.stdout:6/831: rmdir d9/dc/d9f 39 2024-04-01T06:57:43.925 INFO:tasks.workunit.client.0.smithi083.stdout:6/832: mkdir d9/dc/d1b/df6/dfe/d118 0 2024-04-01T06:57:43.926 INFO:tasks.workunit.client.0.smithi083.stdout:6/833: mknod d9/d57/d5f/dff/c119 0 2024-04-01T06:57:43.926 INFO:tasks.workunit.client.0.smithi083.stdout:6/834: chown d9/dc/d1b/d35/d48/d52/d9c/fc0 79 1 2024-04-01T06:57:43.938 INFO:tasks.workunit.client.0.smithi083.stdout:8/980: sync 2024-04-01T06:57:43.938 INFO:tasks.workunit.client.0.smithi083.stdout:6/835: dwrite d9/dc/d9d/f10b [0,4194304] 0 2024-04-01T06:57:43.940 INFO:tasks.workunit.client.0.smithi083.stdout:6/836: mkdir d9/dc/d29/d3c/d45/dc4/dd2/d11a 0 2024-04-01T06:57:43.942 INFO:tasks.workunit.client.0.smithi083.stdout:6/837: symlink d9/dc/d1b/d39/d68/l11b 0 2024-04-01T06:57:44.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:43 smithi083 ceph-mon[43429]: scrub summary: idle 2024-04-01T06:57:44.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:43 smithi083 ceph-mon[43429]: scrub summary: idle 2024-04-01T06:57:44.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:43 smithi083 ceph-mon[43429]: scrub summary: idle 2024-04-01T06:57:44.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:43 smithi153 ceph-mon[48187]: scrub summary: idle 2024-04-01T06:57:44.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:43 smithi153 ceph-mon[48187]: scrub summary: idle 2024-04-01T06:57:44.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:43 smithi153 ceph-mon[48187]: scrub summary: idle 2024-04-01T06:57:44.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:43 smithi145 ceph-mon[47816]: scrub summary: idle 2024-04-01T06:57:44.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:43 smithi145 ceph-mon[47816]: scrub summary: idle 2024-04-01T06:57:44.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:43 smithi145 ceph-mon[47816]: scrub summary: idle 2024-04-01T06:57:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.983+0000 7ff992ea6700 1 -- 172.21.15.83:0/4099043504 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff98c105c70 msgr2=0x7ff98c106050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.983+0000 7ff992ea6700 1 --2- 172.21.15.83:0/4099043504 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff98c105c70 0x7ff98c106050 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7ff980009990 tx=0x7ff980009ca0 comp rx=0 tx=0).stop 2024-04-01T06:57:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.983+0000 7ff992ea6700 1 -- 172.21.15.83:0/4099043504 shutdown_connections 2024-04-01T06:57:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.983+0000 7ff992ea6700 1 --2- 172.21.15.83:0/4099043504 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff98c105c70 0x7ff98c106050 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.983+0000 7ff992ea6700 1 --2- 172.21.15.83:0/4099043504 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff98c100570 0x7ff98c10ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.983+0000 7ff992ea6700 1 --2- 172.21.15.83:0/4099043504 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff98c0ffbb0 0x7ff98c100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.983+0000 7ff992ea6700 1 -- 172.21.15.83:0/4099043504 >> 172.21.15.83:0/4099043504 conn(0x7ff98c076db0 msgr2=0x7ff98c0771c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.983+0000 7ff992ea6700 1 -- 172.21.15.83:0/4099043504 shutdown_connections 2024-04-01T06:57:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.983+0000 7ff992ea6700 1 -- 172.21.15.83:0/4099043504 wait complete. 2024-04-01T06:57:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.983+0000 7ff992ea6700 1 Processor -- start 2024-04-01T06:57:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.984+0000 7ff992ea6700 1 -- start start 2024-04-01T06:57:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.984+0000 7ff992ea6700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff98c0ffbb0 0x7ff98c101860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.984+0000 7ff992ea6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff98c100570 0x7ff98c101da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.984+0000 7ff992ea6700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff98c105c70 0x7ff98c1022e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.984+0000 7ff992ea6700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff98c1a5460 con 0x7ff98c105c70 2024-04-01T06:57:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.984+0000 7ff992ea6700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff98c1a55d0 con 0x7ff98c0ffbb0 2024-04-01T06:57:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.984+0000 7ff992ea6700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff98c1a5790 con 0x7ff98c100570 2024-04-01T06:57:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.984+0000 7ff991443700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff98c105c70 0x7ff98c1022e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.984+0000 7ff991443700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff98c105c70 0x7ff98c1022e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:40200/0 (socket says 172.21.15.83:40200) 2024-04-01T06:57:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.984+0000 7ff991443700 1 -- 172.21.15.83:0/996677465 learned_addr learned my addr 172.21.15.83:0/996677465 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.984+0000 7ff990c42700 1 --2- 172.21.15.83:0/996677465 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff98c0ffbb0 0x7ff98c101860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:44.986 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.984+0000 7ff98bfff700 1 --2- 172.21.15.83:0/996677465 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff98c100570 0x7ff98c101da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:44.987 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.984+0000 7ff991443700 1 -- 172.21.15.83:0/996677465 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff98c100570 msgr2=0x7ff98c101da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:44.987 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.984+0000 7ff991443700 1 --2- 172.21.15.83:0/996677465 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff98c100570 0x7ff98c101da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:44.987 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.984+0000 7ff991443700 1 -- 172.21.15.83:0/996677465 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff98c0ffbb0 msgr2=0x7ff98c101860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:44.987 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.984+0000 7ff991443700 1 --2- 172.21.15.83:0/996677465 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff98c0ffbb0 0x7ff98c101860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:44.987 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.984+0000 7ff991443700 1 -- 172.21.15.83:0/996677465 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9800095f0 con 0x7ff98c105c70 2024-04-01T06:57:44.987 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.984+0000 7ff991443700 1 --2- 172.21.15.83:0/996677465 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff98c105c70 0x7ff98c1022e0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7ff98400efc0 tx=0x7ff98400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:44.987 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.984+0000 7ff989ffb700 1 -- 172.21.15.83:0/996677465 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff984018070 con 0x7ff98c105c70 2024-04-01T06:57:44.987 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.985+0000 7ff989ffb700 1 -- 172.21.15.83:0/996677465 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff98400f040 con 0x7ff98c105c70 2024-04-01T06:57:44.987 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.985+0000 7ff992ea6700 1 -- 172.21.15.83:0/996677465 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff98c1a5a10 con 0x7ff98c105c70 2024-04-01T06:57:44.987 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.985+0000 7ff989ffb700 1 -- 172.21.15.83:0/996677465 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98400cc10 con 0x7ff98c105c70 2024-04-01T06:57:44.987 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.985+0000 7ff992ea6700 1 -- 172.21.15.83:0/996677465 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff98c1a5ed0 con 0x7ff98c105c70 2024-04-01T06:57:44.994 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.987+0000 7ff989ffb700 1 -- 172.21.15.83:0/996677465 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 25) v1 ==== 135996+0+0 (secure 0 0 0) 0x7ff984003a00 con 0x7ff98c105c70 2024-04-01T06:57:44.994 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.988+0000 7ff989ffb700 1 --2- 172.21.15.83:0/996677465 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7ff97c0a1290 0x7ff97c0a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:44.994 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.988+0000 7ff990c42700 1 --2- 172.21.15.83:0/996677465 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7ff97c0a1290 0x7ff97c0a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:44.994 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.988+0000 7ff989ffb700 1 -- 172.21.15.83:0/996677465 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7ff9840cc720 con 0x7ff98c105c70 2024-04-01T06:57:44.994 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.988+0000 7ff990c42700 1 --2- 172.21.15.83:0/996677465 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7ff97c0a1290 0x7ff97c0a3750 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff98000b2e0 tx=0x7ff980005960 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:44.994 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.988+0000 7ff99f03cb80 1 Processor -- start 2024-04-01T06:57:44.994 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.989+0000 7ff99f03cb80 1 -- start start 2024-04-01T06:57:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.989+0000 7ff99f03cb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d300246100 0x55d3002464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.989+0000 7ff99f03cb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d300246a20 0x55d300251390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.989+0000 7ff99f03cb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d3002518d0 0x55d300253cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.989+0000 7ff99f03cb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d30019f930 con 0x55d300246100 2024-04-01T06:57:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.989+0000 7ff99f03cb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d30019d2f0 con 0x55d3002518d0 2024-04-01T06:57:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.989+0000 7ff99f03cb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d300198be0 con 0x55d300246a20 2024-04-01T06:57:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.989+0000 7ff990c42700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d300246100 0x55d3002464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.989+0000 7ff990c42700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d300246100 0x55d3002464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:40208/0 (socket says 172.21.15.83:40208) 2024-04-01T06:57:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.989+0000 7ff990c42700 1 -- 172.21.15.83:0/641058016 learned_addr learned my addr 172.21.15.83:0/641058016 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.989+0000 7ff991443700 1 --2- 172.21.15.83:0/641058016 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d3002518d0 0x55d300253cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.989+0000 7ff98bfff700 1 --2- 172.21.15.83:0/641058016 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d300246a20 0x55d300251390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.989+0000 7ff990c42700 1 -- 172.21.15.83:0/641058016 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d300246a20 msgr2=0x55d300251390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.989+0000 7ff990c42700 1 --2- 172.21.15.83:0/641058016 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d300246a20 0x55d300251390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.989+0000 7ff990c42700 1 -- 172.21.15.83:0/641058016 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d3002518d0 msgr2=0x55d300253cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.989+0000 7ff990c42700 1 --2- 172.21.15.83:0/641058016 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d3002518d0 0x55d300253cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.989+0000 7ff990c42700 1 -- 172.21.15.83:0/641058016 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d30001a350 con 0x55d300246100 2024-04-01T06:57:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.989+0000 7ff98bfff700 1 --2- 172.21.15.83:0/641058016 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d300246a20 0x55d300251390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:57:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.989+0000 7ff990c42700 1 --2- 172.21.15.83:0/641058016 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d300246100 0x55d3002464e0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7ff980009990 tx=0x7ff980020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f851e833b1a8baf server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.989+0000 7ff976ffd700 1 -- 172.21.15.83:0/641058016 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff980004700 con 0x55d300246100 2024-04-01T06:57:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.990+0000 7ff976ffd700 1 -- 172.21.15.83:0/641058016 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff98001e040 con 0x55d300246100 2024-04-01T06:57:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.990+0000 7ff976ffd700 1 -- 172.21.15.83:0/641058016 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98000fa60 con 0x55d300246100 2024-04-01T06:57:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.990+0000 7ff99f03cb80 1 -- 172.21.15.83:0/641058016 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d300246100 msgr2=0x55d3002464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.990+0000 7ff99f03cb80 1 --2- 172.21.15.83:0/641058016 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d300246100 0x55d3002464e0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7ff980009990 tx=0x7ff980020000 comp rx=0 tx=0).stop 2024-04-01T06:57:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.990+0000 7ff99f03cb80 1 -- 172.21.15.83:0/641058016 shutdown_connections 2024-04-01T06:57:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.990+0000 7ff99f03cb80 1 --2- 172.21.15.83:0/641058016 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d300246100 0x55d3002464e0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.990+0000 7ff99f03cb80 1 --2- 172.21.15.83:0/641058016 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d3002518d0 0x55d300253cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.990+0000 7ff99f03cb80 1 --2- 172.21.15.83:0/641058016 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d300246a20 0x55d300251390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:44.997 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.990+0000 7ff99f03cb80 1 -- 172.21.15.83:0/641058016 >> 172.21.15.83:0/641058016 conn(0x55d3001a6640 msgr2=0x55d300242520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:44.997 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.990+0000 7ff99f03cb80 1 -- 172.21.15.83:0/641058016 shutdown_connections 2024-04-01T06:57:44.997 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.990+0000 7ff99f03cb80 1 -- 172.21.15.83:0/641058016 wait complete. 2024-04-01T06:57:44.997 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.991+0000 7ff99f03cb80 1 -- start start 2024-04-01T06:57:44.997 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.991+0000 7ff99f03cb80 1 Processor -- start 2024-04-01T06:57:44.997 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.991+0000 7ff99f03cb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d300246100 0x55d300251230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:44.997 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.991+0000 7ff99f03cb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d300246a20 0x55d30024e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:44.997 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.991+0000 7ff99f03cb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d3002518d0 0x55d30024ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:44.997 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.991+0000 7ff99f03cb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d300134d20 con 0x55d3002518d0 2024-04-01T06:57:44.997 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.991+0000 7ff99f03cb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3001349c0 con 0x55d300246a20 2024-04-01T06:57:44.997 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.991+0000 7ff99f03cb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d30001c640 con 0x55d300246100 2024-04-01T06:57:44.997 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.991+0000 7ff99f03cb80 10 client.0 _ll_register_callbacks cb 0x55d30013e410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:57:44.997 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.991+0000 7ff991443700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d3002518d0 0x55d30024ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:44.997 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.991+0000 7ff98bfff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d300246a20 0x55d30024e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.991+0000 7ff98bfff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d300246a20 0x55d30024e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.83:44260/0 (socket says 172.21.15.83:44260) 2024-04-01T06:57:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.991+0000 7ff991443700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d3002518d0 0x55d30024ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:40218/0 (socket says 172.21.15.83:40218) 2024-04-01T06:57:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.991+0000 7ff98bfff700 1 -- 172.21.15.83:0/2034444738 learned_addr learned my addr 172.21.15.83:0/2034444738 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.991+0000 7ff990c42700 1 --2- 172.21.15.83:0/2034444738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d300246100 0x55d300251230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.992+0000 7ff991443700 1 -- 172.21.15.83:0/2034444738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d300246100 msgr2=0x55d300251230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.992+0000 7ff991443700 1 --2- 172.21.15.83:0/2034444738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d300246100 0x55d300251230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.992+0000 7ff991443700 1 -- 172.21.15.83:0/2034444738 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d300246a20 msgr2=0x55d30024e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.992+0000 7ff991443700 1 --2- 172.21.15.83:0/2034444738 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d300246a20 0x55d30024e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.992+0000 7ff991443700 1 -- 172.21.15.83:0/2034444738 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff98c10d300 con 0x55d3002518d0 2024-04-01T06:57:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.992+0000 7ff98bfff700 1 --2- 172.21.15.83:0/2034444738 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d300246a20 0x55d30024e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T06:57:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.992+0000 7ff991443700 1 --2- 172.21.15.83:0/2034444738 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d3002518d0 0x55d30024ebc0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7ff9840c9e70 tx=0x7ff984099200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af3480d5831d3f1f server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.992+0000 7ff96bfff700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:57:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.992+0000 7ff96bfff700 1 -- 172.21.15.83:0/2034444738 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98409d650 con 0x55d3002518d0 2024-04-01T06:57:44.999 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.992+0000 7ff99f03cb80 1 -- 172.21.15.83:0/2034444738 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d300159320 con 0x55d3002518d0 2024-04-01T06:57:44.999 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.992+0000 7ff96bfff700 1 -- 172.21.15.83:0/2034444738 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7ff9840a1c10 con 0x55d3002518d0 2024-04-01T06:57:44.999 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.992+0000 7ff96bfff700 1 -- 172.21.15.83:0/2034444738 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff9840b90c0 con 0x55d3002518d0 2024-04-01T06:57:44.999 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.992+0000 7ff99f03cb80 10 client.15963 fetch_fsmap learned FSMap version 28 2024-04-01T06:57:44.999 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.992+0000 7ff99f03cb80 1 -- 172.21.15.83:0/2034444738 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55d2fffc6b00 con 0x55d3002518d0 2024-04-01T06:57:44.999 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.992+0000 7ff96bfff700 1 -- 172.21.15.83:0/2034444738 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d300159320 con 0x55d3002518d0 2024-04-01T06:57:44.999 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.992+0000 7ff96bfff700 1 -- 172.21.15.83:0/2034444738 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 28) v1 ==== 7474+0+0 (secure 0 0 0) 0x7ff984099a80 con 0x55d3002518d0 2024-04-01T06:57:44.999 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.992+0000 7ff99f03cb80 10 client.15963 fetch_fsmap finished waiting for FSMap version 28 2024-04-01T06:57:44.999 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.992+0000 7ff99f03cb80 10 client.15963 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-01T06:57:44.999 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.992+0000 7ff99f03cb80 20 client.15963 populate_metadata read hostname 'smithi083' 2024-04-01T06:57:44.999 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.992+0000 7ff99f03cb80 1 --2- 172.21.15.83:0/2034444738 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55d300261530 0x55d300263950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:44.999 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.992+0000 7ff99f03cb80 4 client.15963 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-01T06:57:44.999 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.992+0000 7ff99f03cb80 1 -- 172.21.15.83:0/2034444738 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d3001916a0 con 0x55d300261530 2024-04-01T06:57:44.999 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.993+0000 7ff990c42700 1 --2- 172.21.15.83:0/2034444738 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55d300261530 0x55d300263950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:44.999 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.993+0000 7ff96bfff700 10 client.15963 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:57:45.000 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.993+0000 7ff990c42700 1 --2- 172.21.15.83:0/2034444738 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55d300261530 0x55d300263950 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f41a74e19978fa35 server_cookie=550ef75b3ee8b0cc in_seq=0 out_seq=0 2024-04-01T06:57:45.000 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.994+0000 7ff96bfff700 1 -- 172.21.15.83:0/2034444738 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d3001916a0 con 0x55d300261530 2024-04-01T06:57:45.000 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.994+0000 7ff96bfff700 10 client.15963 handle_command_reply: tid=0 2024-04-01T06:57:45.000 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.994+0000 7ff99f03cb80 1 client.15963 shutdown 2024-04-01T06:57:45.000 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.994+0000 7ff99f03cb80 1 -- 172.21.15.83:0/2034444738 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d3002518d0 msgr2=0x55d30024ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:45.000 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.994+0000 7ff99f03cb80 1 --2- 172.21.15.83:0/2034444738 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d3002518d0 0x55d30024ebc0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7ff9840c9e70 tx=0x7ff984099200 comp rx=0 tx=0).stop 2024-04-01T06:57:45.000 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.994+0000 7ff99f03cb80 1 -- 172.21.15.83:0/2034444738 shutdown_connections 2024-04-01T06:57:45.000 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.994+0000 7ff99f03cb80 1 --2- 172.21.15.83:0/2034444738 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55d300261530 0x55d300263950 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:45.000 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.994+0000 7ff99f03cb80 1 --2- 172.21.15.83:0/2034444738 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d3002518d0 0x55d30024ebc0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:45.000 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.994+0000 7ff96bfff700 0 client.15963 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:57:45.000 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.994+0000 7ff99f03cb80 1 --2- 172.21.15.83:0/2034444738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d300246100 0x55d300251230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:45.000 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.994+0000 7ff99f03cb80 1 --2- 172.21.15.83:0/2034444738 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d300246a20 0x55d30024e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:45.000 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.994+0000 7ff99f03cb80 1 -- 172.21.15.83:0/2034444738 >> 172.21.15.83:0/2034444738 conn(0x55d3001a6640 msgr2=0x55d3002480a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:45.000 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.994+0000 7ff99f03cb80 1 -- 172.21.15.83:0/2034444738 shutdown_connections 2024-04-01T06:57:45.001 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.994+0000 7ff99f03cb80 1 -- 172.21.15.83:0/2034444738 wait complete. 2024-04-01T06:57:45.001 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:44.994+0000 7ff99f03cb80 20 client.15963 trim_cache size 0 max 16384 2024-04-01T06:57:45.012 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.009+0000 7ff99f03cb80 1 Processor -- start 2024-04-01T06:57:45.013 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.009+0000 7ff99f03cb80 1 -- start start 2024-04-01T06:57:45.013 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.009+0000 7ff99f03cb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d300246100 0x55d30023c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:45.013 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.009+0000 7ff99f03cb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d300246a20 0x55d300258540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:45.013 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.009+0000 7ff99f03cb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d3002518d0 0x55d300248040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:45.013 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.009+0000 7ff99f03cb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3002473b0 con 0x55d3002518d0 2024-04-01T06:57:45.013 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.009+0000 7ff99f03cb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d300258a80 con 0x55d300246a20 2024-04-01T06:57:45.013 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.009+0000 7ff99f03cb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d300246e00 con 0x55d300246100 2024-04-01T06:57:45.013 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.009+0000 7ff991443700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d3002518d0 0x55d300248040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:45.013 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.009+0000 7ff991443700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d3002518d0 0x55d300248040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:40230/0 (socket says 172.21.15.83:40230) 2024-04-01T06:57:45.013 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.009+0000 7ff990c42700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d300246100 0x55d30023c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:45.013 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.009+0000 7ff991443700 1 -- 172.21.15.83:0/3796014365 learned_addr learned my addr 172.21.15.83:0/3796014365 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:45.013 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.009+0000 7ff98bfff700 1 --2- 172.21.15.83:0/3796014365 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d300246a20 0x55d300258540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.009+0000 7ff991443700 1 -- 172.21.15.83:0/3796014365 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d300246100 msgr2=0x55d30023c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.009+0000 7ff991443700 1 --2- 172.21.15.83:0/3796014365 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d300246100 0x55d30023c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.009+0000 7ff991443700 1 -- 172.21.15.83:0/3796014365 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d300246a20 msgr2=0x55d300258540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.009+0000 7ff991443700 1 --2- 172.21.15.83:0/3796014365 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d300246a20 0x55d300258540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.009+0000 7ff991443700 1 -- 172.21.15.83:0/3796014365 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d30015ee40 con 0x55d3002518d0 2024-04-01T06:57:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.010+0000 7ff991443700 1 --2- 172.21.15.83:0/3796014365 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d3002518d0 0x55d300248040 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ff9840090a0 tx=0x7ff984097dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=791fc578453d82d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.010+0000 7ff9777fe700 1 -- 172.21.15.83:0/3796014365 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff984098f70 con 0x55d3002518d0 2024-04-01T06:57:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.010+0000 7ff9777fe700 1 -- 172.21.15.83:0/3796014365 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff9840a1c10 con 0x55d3002518d0 2024-04-01T06:57:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.010+0000 7ff9777fe700 1 -- 172.21.15.83:0/3796014365 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98401b320 con 0x55d3002518d0 2024-04-01T06:57:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.010+0000 7ff99f03cb80 1 -- 172.21.15.83:0/3796014365 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d3002518d0 msgr2=0x55d300248040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.010+0000 7ff99f03cb80 1 --2- 172.21.15.83:0/3796014365 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d3002518d0 0x55d300248040 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ff9840090a0 tx=0x7ff984097dd0 comp rx=0 tx=0).stop 2024-04-01T06:57:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.010+0000 7ff99f03cb80 1 -- 172.21.15.83:0/3796014365 shutdown_connections 2024-04-01T06:57:45.014 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.010+0000 7ff99f03cb80 1 --2- 172.21.15.83:0/3796014365 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d3002518d0 0x55d300248040 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.010+0000 7ff99f03cb80 1 --2- 172.21.15.83:0/3796014365 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d300246100 0x55d30023c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.010+0000 7ff99f03cb80 1 --2- 172.21.15.83:0/3796014365 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d300246a20 0x55d300258540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.010+0000 7ff99f03cb80 1 -- 172.21.15.83:0/3796014365 >> 172.21.15.83:0/3796014365 conn(0x55d3001a6640 msgr2=0x55d30024ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.010+0000 7ff99f03cb80 1 -- 172.21.15.83:0/3796014365 shutdown_connections 2024-04-01T06:57:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.010+0000 7ff99f03cb80 1 -- 172.21.15.83:0/3796014365 wait complete. 2024-04-01T06:57:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.011+0000 7ff99f03cb80 1 -- start start 2024-04-01T06:57:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.011+0000 7ff99f03cb80 1 Processor -- start 2024-04-01T06:57:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.011+0000 7ff99f03cb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d300246100 0x55d30024c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.011+0000 7ff99f03cb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d300246a20 0x55d300256520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.011+0000 7ff99f03cb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d3002518d0 0x55d300256a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.011+0000 7ff99f03cb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d300257170 con 0x55d300246a20 2024-04-01T06:57:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.011+0000 7ff99f03cb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3002572e0 con 0x55d3002518d0 2024-04-01T06:57:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.011+0000 7ff99f03cb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3002b4360 con 0x55d300246100 2024-04-01T06:57:45.015 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.011+0000 7ff99f03cb80 10 client.0 _ll_register_callbacks cb 0x55d30013e410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:57:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.011+0000 7ff990c42700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d300246100 0x55d30024c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.011+0000 7ff98bfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d300246a20 0x55d300256520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.011+0000 7ff990c42700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d300246100 0x55d30024c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.83:37618/0 (socket says 172.21.15.83:37618) 2024-04-01T06:57:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.011+0000 7ff990c42700 1 -- 172.21.15.83:0/2663807464 learned_addr learned my addr 172.21.15.83:0/2663807464 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.011+0000 7ff991443700 1 --2- 172.21.15.83:0/2663807464 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d3002518d0 0x55d300256a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.012+0000 7ff990c42700 1 -- 172.21.15.83:0/2663807464 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d3002518d0 msgr2=0x55d300256a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.012+0000 7ff990c42700 1 --2- 172.21.15.83:0/2663807464 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d3002518d0 0x55d300256a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.012+0000 7ff990c42700 1 -- 172.21.15.83:0/2663807464 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d300246a20 msgr2=0x55d300256520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.012+0000 7ff990c42700 1 --2- 172.21.15.83:0/2663807464 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d300246a20 0x55d300256520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.012+0000 7ff990c42700 1 -- 172.21.15.83:0/2663807464 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d2fffc6b00 con 0x55d300246100 2024-04-01T06:57:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.012+0000 7ff990c42700 1 --2- 172.21.15.83:0/2663807464 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d300246100 0x55d30024c0d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff980006010 tx=0x7ff98000f5c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5798c55a7f61f25 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.012+0000 7ff96bfff700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-04-01T06:57:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.012+0000 7ff96bfff700 1 -- 172.21.15.83:0/2663807464 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff980042070 con 0x55d300246100 2024-04-01T06:57:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.012+0000 7ff99f03cb80 1 -- 172.21.15.83:0/2663807464 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff98001e040 con 0x55d300246100 2024-04-01T06:57:45.017 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.012+0000 7ff96bfff700 1 -- 172.21.15.83:0/2663807464 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7ff98003cd90 con 0x55d300246100 2024-04-01T06:57:45.017 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.012+0000 7ff96bfff700 1 -- 172.21.15.83:0/2663807464 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff98003c0e0 con 0x55d300246100 2024-04-01T06:57:45.017 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.012+0000 7ff99f03cb80 10 client.25399 fetch_fsmap learned FSMap version 28 2024-04-01T06:57:45.017 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.012+0000 7ff99f03cb80 1 -- 172.21.15.83:0/2663807464 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55d30001ec70 con 0x55d300246100 2024-04-01T06:57:45.017 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:44 smithi083 ceph-mon[43429]: pgmap v59: 97 pgs: 97 active+clean; 1.3 GiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 95 MiB/s rd, 186 MiB/s wr, 1.09k op/s 2024-04-01T06:57:45.018 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.012+0000 7ff96bfff700 1 -- 172.21.15.83:0/2663807464 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff98001e040 con 0x55d300246100 2024-04-01T06:57:45.018 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.013+0000 7ff96bfff700 1 -- 172.21.15.83:0/2663807464 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 28) v1 ==== 7474+0+0 (secure 0 0 0) 0x7ff980045030 con 0x55d300246100 2024-04-01T06:57:45.018 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.013+0000 7ff99f03cb80 10 client.25399 fetch_fsmap finished waiting for FSMap version 28 2024-04-01T06:57:45.018 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.013+0000 7ff99f03cb80 10 client.25399 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-01T06:57:45.018 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.013+0000 7ff99f03cb80 20 client.25399 populate_metadata read hostname 'smithi083' 2024-04-01T06:57:45.018 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.013+0000 7ff99f03cb80 1 --2- 172.21.15.83:0/2663807464 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55d3002b55a0 0x55d3002b79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:45.018 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.013+0000 7ff99f03cb80 4 client.25399 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-01T06:57:45.018 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.013+0000 7ff99f03cb80 1 -- 172.21.15.83:0/2663807464 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d2fffe7c90 con 0x55d3002b55a0 2024-04-01T06:57:45.019 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.013+0000 7ff98bfff700 1 --2- 172.21.15.83:0/2663807464 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55d3002b55a0 0x55d3002b79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:45.019 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.013+0000 7ff96bfff700 10 client.25399 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:57:45.019 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.013+0000 7ff98bfff700 1 --2- 172.21.15.83:0/2663807464 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55d3002b55a0 0x55d3002b79c0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1afd7438ffbd20d0 server_cookie=8bfe4805965dfd3b in_seq=0 out_seq=0 2024-04-01T06:57:45.021 INFO:tasks.workunit.client.0.smithi083.stdout:4/854: sync 2024-04-01T06:57:45.021 INFO:tasks.workunit.client.0.smithi083.stdout:6/838: sync 2024-04-01T06:57:45.021 INFO:tasks.workunit.client.0.smithi083.stdout:2/887: sync 2024-04-01T06:57:45.021 INFO:tasks.workunit.client.0.smithi083.stdout:5/902: sync 2024-04-01T06:57:45.021 INFO:tasks.workunit.client.0.smithi083.stdout:7/751: sync 2024-04-01T06:57:45.021 INFO:tasks.workunit.client.0.smithi083.stdout:8/981: sync 2024-04-01T06:57:45.021 INFO:tasks.workunit.client.0.smithi083.stdout:5/903: fsync d4/d23/d67/f119 0 2024-04-01T06:57:45.021 INFO:tasks.workunit.client.0.smithi083.stdout:7/752: readlink d0/d4/d9/d39/d67/d6d/d7d/d8a/lad 0 2024-04-01T06:57:45.021 INFO:tasks.workunit.client.0.smithi083.stdout:5/904: readlink d4/d9/d16/d1f/d2f/d53/dbb/lea 0 2024-04-01T06:57:45.021 INFO:tasks.workunit.client.0.smithi083.stdout:5/905: fsync d4/d71/fae 0 2024-04-01T06:57:45.021 INFO:tasks.workunit.client.0.smithi083.stdout:9/974: sync 2024-04-01T06:57:45.024 INFO:tasks.workunit.client.0.smithi083.stdout:6/839: symlink d9/dc/d9f/l11c 0 2024-04-01T06:57:45.029 INFO:tasks.workunit.client.0.smithi083.stdout:8/982: symlink d15/d1b/d39/d48/d5e/d70/d11c/d44/d97/dde/d127/l157 0 2024-04-01T06:57:45.033 INFO:tasks.workunit.client.0.smithi083.stdout:6/840: unlink d9/dc/d29/d3c/d45/dc4/fbc 0 2024-04-01T06:57:45.035 INFO:tasks.workunit.client.0.smithi083.stdout:4/855: dread d1/d47/d90/f97 [0,4194304] 0 2024-04-01T06:57:45.038 INFO:tasks.workunit.client.0.smithi083.stdout:8/983: link d15/d1b/d39/d48/d5e/d70/d11c/da2/d6f/ld8 d15/d1b/d39/l158 0 2024-04-01T06:57:45.038 INFO:tasks.workunit.client.0.smithi083.stdout:2/888: dwrite d3/d71/d81/f93 [0,4194304] 0 2024-04-01T06:57:45.039 INFO:tasks.workunit.client.0.smithi083.stdout:6/841: symlink d9/dc/d29/d3c/d45/l11d 0 2024-04-01T06:57:45.040 INFO:tasks.workunit.client.0.smithi083.stdout:2/889: dread d3/d71/f102 [0,4194304] 0 2024-04-01T06:57:45.042 INFO:tasks.workunit.client.0.smithi083.stdout:6/842: symlink d9/dc/d29/d3c/d45/dc4/dd2/l11e 0 2024-04-01T06:57:45.044 INFO:tasks.workunit.client.0.smithi083.stdout:2/890: mknod d3/d71/d90/c130 0 2024-04-01T06:57:45.045 INFO:tasks.workunit.client.0.smithi083.stdout:9/975: rename d6/d32/d26/d2d/d34 to d6/d32/d8f/d6d/d103/d144 0 2024-04-01T06:57:45.048 INFO:tasks.workunit.client.0.smithi083.stdout:2/891: unlink d3/d26/d59/d2b/f73 0 2024-04-01T06:57:45.049 INFO:tasks.workunit.client.0.smithi083.stdout:4/856: rename d1/d47/d2a/f36 to d1/da5/dfc/f114 0 2024-04-01T06:57:45.050 INFO:tasks.workunit.client.0.smithi083.stdout:9/976: mkdir d6/d32/d3c/dca/d145 0 2024-04-01T06:57:45.052 INFO:tasks.workunit.client.0.smithi083.stdout:2/892: mkdir d3/d71/d90/db6/dcd/dfd/d66/dc1/d131 0 2024-04-01T06:57:45.052 INFO:tasks.workunit.client.0.smithi083.stdout:2/893: chown d3/d8b/l101 265353 1 2024-04-01T06:57:45.053 INFO:tasks.workunit.client.0.smithi083.stdout:8/984: rename d15/faa to d15/d1b/d39/d48/d5e/d70/d11c/d44/d141/d19/f159 0 2024-04-01T06:57:45.054 INFO:tasks.workunit.client.0.smithi083.stdout:4/857: getdents d1/d4/db8/ded/de8/dd5/db6 0 2024-04-01T06:57:45.058 INFO:tasks.workunit.client.0.smithi083.stdout:4/858: creat d1/d4/d6e/f115 x:0 0 0 2024-04-01T06:57:45.058 INFO:tasks.workunit.client.0.smithi083.stdout:6/843: dwrite d9/dc/d1b/d39/d47/f69 [0,4194304] 0 2024-04-01T06:57:45.058 INFO:tasks.workunit.client.0.smithi083.stdout:6/844: read d9/dc/d9d/ffb [226374,31524] 0 2024-04-01T06:57:45.059 INFO:tasks.workunit.client.0.smithi083.stdout:9/977: mknod d6/d32/d3c/d3d/c146 0 2024-04-01T06:57:45.060 INFO:tasks.workunit.client.0.smithi083.stdout:4/859: mkdir d1/da5/dfc/d116 0 2024-04-01T06:57:45.062 INFO:tasks.workunit.client.0.smithi083.stdout:6/845: getdents d9/dc/d29/d3c/d5c/d8b 0 2024-04-01T06:57:45.062 INFO:tasks.workunit.client.0.smithi083.stdout:6/846: write d9/dc/d9f/de2/df5/f107 [313180,81144] 0 2024-04-01T06:57:45.062 INFO:tasks.workunit.client.0.smithi083.stdout:6/847: chown d9/dc/d1b/df6/l115 46808 1 2024-04-01T06:57:45.062 INFO:tasks.workunit.client.0.smithi083.stdout:8/985: dread d15/d1b/d39/d48/d5e/d70/d11c/d44/d141/d1e/f5b [0,4194304] 0 2024-04-01T06:57:45.062 INFO:tasks.workunit.client.0.smithi083.stdout:8/986: stat d15/d1b/d39/d48/d5e/d70/d11c/d44/d141/d1e/f9d 0 2024-04-01T06:57:45.062 INFO:tasks.workunit.client.0.smithi083.stdout:8/987: readlink d15/d1b/d39/d48/d5e/d70/d11c/da2/da6/de2/lf6 0 2024-04-01T06:57:45.063 INFO:tasks.workunit.client.0.smithi083.stdout:2/894: dwrite d3/f43 [0,4194304] 0 2024-04-01T06:57:45.063 INFO:tasks.workunit.client.0.smithi083.stdout:9/978: mkdir d6/d32/d8f/d6d/d103/d144/d147 0 2024-04-01T06:57:45.064 INFO:tasks.workunit.client.0.smithi083.stdout:4/860: truncate d1/d4/db/f56 3838036 0 2024-04-01T06:57:45.064 INFO:tasks.workunit.client.0.smithi083.stdout:4/861: chown d1/d4/db/dba/dcd 100897762 1 2024-04-01T06:57:45.064 INFO:tasks.workunit.client.0.smithi083.stdout:4/862: chown d1/d4/db8/fdd 0 1 2024-04-01T06:57:45.065 INFO:tasks.workunit.client.0.smithi083.stdout:6/848: mknod d9/dc/d29/d3c/d10d/c11f 0 2024-04-01T06:57:45.067 INFO:tasks.workunit.client.0.smithi083.stdout:8/988: symlink d15/l15a 0 2024-04-01T06:57:45.067 INFO:tasks.workunit.client.0.smithi083.stdout:4/863: dread d1/d4/ff6 [0,4194304] 0 2024-04-01T06:57:45.067 INFO:tasks.workunit.client.0.smithi083.stdout:8/989: truncate d15/d21/dcd/f138 5133816 0 2024-04-01T06:57:45.067 INFO:tasks.workunit.client.0.smithi083.stdout:4/864: fsync d1/d4/db/d94/fe2 0 2024-04-01T06:57:45.067 INFO:tasks.workunit.client.0.smithi083.stdout:8/990: fdatasync d15/d1b/d39/d48/d5e/d70/d11c/d44/d141/d19/d1d/f36 0 2024-04-01T06:57:45.067 INFO:tasks.workunit.client.0.smithi083.stdout:8/991: stat d15/d1b/d39/d48/d5e/d70/d11c/d44/d97/dde/f102 0 2024-04-01T06:57:45.069 INFO:tasks.workunit.client.0.smithi083.stdout:6/849: creat d9/d57/d5f/f120 x:0 0 0 2024-04-01T06:57:45.069 INFO:tasks.workunit.client.0.smithi083.stdout:6/850: chown d9/dc/d1b/d35/d48/d52/d9c/dab/fad 6 1 2024-04-01T06:57:45.069 INFO:tasks.workunit.client.0.smithi083.stdout:4/865: creat d1/da5/dae/f117 x:0 0 0 2024-04-01T06:57:45.070 INFO:tasks.workunit.client.0.smithi083.stdout:6/851: mknod d9/dc/d29/d3c/d10d/c121 0 2024-04-01T06:57:45.070 INFO:tasks.workunit.client.0.smithi083.stdout:6/852: truncate d9/dc/d9f/fa2 749516 0 2024-04-01T06:57:45.072 INFO:tasks.workunit.client.0.smithi083.stdout:6/853: rmdir d9/dc/d29/df7 0 2024-04-01T06:57:45.072 INFO:tasks.workunit.client.0.smithi083.stdout:6/854: readlink d9/dc/d1b/d35/d48/d52/l88 0 2024-04-01T06:57:45.078 INFO:tasks.workunit.client.0.smithi083.stdout:4/866: dread d1/d4/db8/ded/de8/dd5/de9/f49 [0,4194304] 0 2024-04-01T06:57:45.078 INFO:tasks.workunit.client.0.smithi083.stdout:4/867: chown d1/da5/dae 872 1 2024-04-01T06:57:45.078 INFO:tasks.workunit.client.0.smithi083.stdout:4/868: chown d1/d4/db8/ded/de8/dd5/de9/f50 2081 1 2024-04-01T06:57:45.078 INFO:tasks.workunit.client.0.smithi083.stdout:4/869: fdatasync d1/d4/db/d94/daf/dd1/fa6 0 2024-04-01T06:57:45.081 INFO:tasks.workunit.client.0.smithi083.stdout:4/870: link d1/d4/l10 d1/d4/db8/ded/de8/dd5/db6/l118 0 2024-04-01T06:57:45.083 INFO:tasks.workunit.client.0.smithi083.stdout:2/895: dwrite d3/d20/f21 [0,4194304] 0 2024-04-01T06:57:45.089 INFO:tasks.workunit.client.0.smithi083.stdout:4/871: dread d1/d4/db8/ded/de8/dd5/de9/f92 [0,4194304] 0 2024-04-01T06:57:45.090 INFO:tasks.workunit.client.0.smithi083.stdout:8/992: dwrite d15/d1b/fef [0,4194304] 0 2024-04-01T06:57:45.092 INFO:tasks.workunit.client.0.smithi083.stdout:9/979: dwrite d6/d32/d3c/d4c/d6b/f5d [0,4194304] 0 2024-04-01T06:57:45.092 INFO:tasks.workunit.client.0.smithi083.stdout:9/980: chown d6/d76 218999479 1 2024-04-01T06:57:45.092 INFO:tasks.workunit.client.0.smithi083.stdout:9/981: chown d6/d32/d8f/d6d/d103/d144/l37 0 1 2024-04-01T06:57:45.092 INFO:tasks.workunit.client.0.smithi083.stdout:6/855: dwrite f6 [0,4194304] 0 2024-04-01T06:57:45.093 INFO:tasks.workunit.client.0.smithi083.stdout:6/856: dread - d9/dc/d29/d3c/d5c/fdd zero size 2024-04-01T06:57:45.093 INFO:tasks.workunit.client.0.smithi083.stdout:4/872: mknod d1/d4/db8/ded/de8/dd5/dbc/c119 0 2024-04-01T06:57:45.093 INFO:tasks.workunit.client.0.smithi083.stdout:4/873: readlink d1/d4/db/d5b/d62/la3 0 2024-04-01T06:57:45.097 INFO:tasks.workunit.client.0.smithi083.stdout:8/993: link d15/d1b/d39/d48/d5e/d70/d11c/d44/d141/l32 d15/d1b/d39/d48/d5e/d70/d11c/d44/d75/dab/l15b 0 2024-04-01T06:57:45.097 INFO:tasks.workunit.client.0.smithi083.stdout:8/994: truncate d15/d21/dcd/f144 691550 0 2024-04-01T06:57:45.098 INFO:tasks.workunit.client.0.smithi083.stdout:2/896: dwrite d3/d71/db8/feb [0,4194304] 0 2024-04-01T06:57:45.099 INFO:tasks.workunit.client.0.smithi083.stdout:9/982: unlink d6/d32/d26/d2d/d100/f105 0 2024-04-01T06:57:45.100 INFO:tasks.workunit.client.0.smithi083.stdout:6/857: rename d9/d57/cd4 to d9/dc/d29/d3c/d45/dc4/dd2/d11a/c122 0 2024-04-01T06:57:45.102 INFO:tasks.workunit.client.0.smithi083.stdout:4/874: mknod d1/d4/db/d94/daf/dd1/dab/c11a 0 2024-04-01T06:57:45.105 INFO:tasks.workunit.client.0.smithi083.stdout:9/983: mknod d6/dfd/c148 0 2024-04-01T06:57:45.105 INFO:tasks.workunit.client.0.smithi083.stdout:9/984: chown d6/d32/d26/c51 33630960 1 2024-04-01T06:57:45.108 INFO:tasks.workunit.client.0.smithi083.stdout:6/858: write d9/dc/d1b/d35/f51 [1729769,53670] 0 2024-04-01T06:57:45.111 INFO:tasks.workunit.client.0.smithi083.stdout:9/985: creat d6/d32/d8f/d6d/d103/d144/d6c/dc9/dd5/f149 x:0 0 0 2024-04-01T06:57:45.114 INFO:tasks.workunit.client.0.smithi083.stdout:9/986: symlink d6/d32/d3c/d4c/d6b/l14a 0 2024-04-01T06:57:45.118 INFO:tasks.workunit.client.0.smithi083.stdout:9/987: read d6/d32/d26/d2d/f54 [3948592,34424] 0 2024-04-01T06:57:45.118 INFO:tasks.workunit.client.0.smithi083.stdout:9/988: chown d6/d32/d8f/d6d/fe8 186 1 2024-04-01T06:57:45.120 INFO:tasks.workunit.client.0.smithi083.stdout:2/897: dwrite d3/d71/d90/db6/dcd/dfd/f60 [0,4194304] 0 2024-04-01T06:57:45.124 INFO:tasks.workunit.client.0.smithi083.stdout:4/875: dwrite d1/d47/d90/fca [0,4194304] 0 2024-04-01T06:57:45.124 INFO:tasks.workunit.client.0.smithi083.stdout:6/859: dwrite d9/dc/d1b/d35/d48/d52/d9c/da9/fbe [0,4194304] 0 2024-04-01T06:57:45.125 INFO:tasks.workunit.client.0.smithi083.stdout:6/860: chown d9/dc/d1b/d35/d48 679 1 2024-04-01T06:57:45.125 INFO:tasks.workunit.client.0.smithi083.stdout:6/861: read f8 [7194395,4514] 0 2024-04-01T06:57:45.125 INFO:tasks.workunit.client.0.smithi083.stdout:8/995: dwrite d15/d1b/d39/d48/d5e/d70/d11c/d44/d141/d19/d6c/f95 [0,4194304] 0 2024-04-01T06:57:45.127 INFO:tasks.workunit.client.0.smithi083.stdout:8/996: dread d15/d21/f50 [0,4194304] 0 2024-04-01T06:57:45.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:44 smithi153 ceph-mon[48187]: pgmap v59: 97 pgs: 97 active+clean; 1.3 GiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 95 MiB/s rd, 186 MiB/s wr, 1.09k op/s 2024-04-01T06:57:45.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:44 smithi145 ceph-mon[47816]: pgmap v59: 97 pgs: 97 active+clean; 1.3 GiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 95 MiB/s rd, 186 MiB/s wr, 1.09k op/s 2024-04-01T06:57:45.296 INFO:tasks.workunit.client.0.smithi083.stdout:9/989: mknod d6/d32/d8f/d6d/d103/d144/d6c/dc9/dd5/d115/c14b 0 2024-04-01T06:57:45.314 INFO:tasks.workunit.client.0.smithi083.stdout:9/990: dwrite d6/d32/d3c/d4c/d88/f122 [0,4194304] 0 2024-04-01T06:57:45.314 INFO:tasks.workunit.client.0.smithi083.stdout:9/991: fdatasync d6/f7 0 2024-04-01T06:57:45.329 INFO:tasks.workunit.client.0.smithi083.stdout:4/876: truncate d1/d4/db/f18 1757352 0 2024-04-01T06:57:45.333 INFO:tasks.workunit.client.0.smithi083.stdout:6/862: symlink d9/dc/d9f/de2/l123 0 2024-04-01T06:57:45.333 INFO:tasks.workunit.client.0.smithi083.stdout:6/863: write d9/dc/d29/d3c/d5c/fdd [55463,44427] 0 2024-04-01T06:57:45.580 INFO:tasks.workunit.client.0.smithi083.stdout:9/992: symlink d6/d32/d8f/d6d/d103/d144/dc6/d11b/l14c 0 2024-04-01T06:57:45.580 INFO:tasks.workunit.client.0.smithi083.stdout:2/898: link d3/l2c d3/d4d/d57/l132 0 2024-04-01T06:57:45.581 INFO:tasks.workunit.client.0.smithi083.stdout:9/993: write d6/d32/d3c/d3d/f98 [1291997,69525] 0 2024-04-01T06:57:45.581 INFO:tasks.workunit.client.0.smithi083.stdout:9/994: chown d6/d32/d3c/d3d/l118 318511 1 2024-04-01T06:57:45.585 INFO:tasks.workunit.client.0.smithi083.stdout:9/995: creat d6/d32/d8f/d6d/daf/f14d x:0 0 0 2024-04-01T06:57:45.585 INFO:tasks.workunit.client.0.smithi083.stdout:9/996: getdents d6/d32/d26/dda 0 2024-04-01T06:57:45.595 INFO:tasks.workunit.client.0.smithi083.stdout:9/997: symlink d6/d32/d3c/dca/l14e 0 2024-04-01T06:57:45.607 INFO:tasks.workunit.client.0.smithi083.stdout:9/998: creat d6/d32/d3c/d4c/f14f x:0 0 0 2024-04-01T06:57:45.615 INFO:tasks.workunit.client.0.smithi083.stdout:2/899: dwrite d3/f112 [0,4194304] 0 2024-04-01T06:57:45.623 INFO:tasks.workunit.client.0.smithi083.stdout:4/877: dwrite d1/d47/d2a/f52 [0,4194304] 0 2024-04-01T06:57:45.626 INFO:tasks.workunit.client.0.smithi083.stdout:2/900: creat d3/d4d/d57/df2/f133 x:0 0 0 2024-04-01T06:57:45.635 INFO:tasks.workunit.client.0.smithi083.stdout:2/901: rename d3/l5 to d3/d26/d59/d2b/da3/dbb/l134 0 2024-04-01T06:57:45.650 INFO:tasks.workunit.client.0.smithi083.stdout:2/902: dwrite d3/d26/d59/d2b/f32 [0,4194304] 0 2024-04-01T06:57:45.668 INFO:tasks.workunit.client.0.smithi083.stdout:2/903: dwrite d3/de1/df5/fe2 [0,4194304] 0 2024-04-01T06:57:45.685 INFO:tasks.workunit.client.0.smithi083.stdout:2/904: dwrite d3/d26/d59/d27/fb7 [0,4194304] 0 2024-04-01T06:57:45.686 INFO:tasks.workunit.client.0.smithi083.stdout:2/905: write d3/fc [7480559,56928] 0 2024-04-01T06:57:45.695 INFO:tasks.workunit.client.0.smithi083.stdout:2/906: dwrite d3/d71/d90/db6/dcd/dfd/d5e/f7b [0,4194304] 0 2024-04-01T06:57:45.701 INFO:tasks.workunit.client.0.smithi083.stdout:2/907: mknod d3/d71/db8/c135 0 2024-04-01T06:57:45.702 INFO:tasks.workunit.client.0.smithi083.stdout:2/908: write d3/d71/d90/db6/dcd/dfd/d5e/f7b [3827355,73682] 0 2024-04-01T06:57:45.704 INFO:tasks.workunit.client.0.smithi083.stdout:2/909: mkdir d3/d26/d59/d27/d79/d117/d136 0 2024-04-01T06:57:45.705 INFO:tasks.workunit.client.0.smithi083.stdout:8/997: rmdir d15/d1b/d39/d48/d5e/d70/d11c/d44/d141/d1e/de3 39 2024-04-01T06:57:45.705 INFO:tasks.workunit.client.0.smithi083.stdout:8/998: write d15/d1b/d39/d48/d5e/d70/d11c/d44/d141/deb/fed [210996,78964] 0 2024-04-01T06:57:45.707 INFO:tasks.workunit.client.0.smithi083.stdout:9/999: creat d6/d29/f150 x:0 0 0 2024-04-01T06:57:45.715 INFO:tasks.workunit.client.0.smithi083.stdout:2/910: dwrite d3/fbf [0,4194304] 0 2024-04-01T06:57:45.715 INFO:tasks.workunit.client.0.smithi083.stdout:2/911: fsync d3/d26/d59/d27/fb7 0 2024-04-01T06:57:45.720 INFO:tasks.workunit.client.0.smithi083.stdout:8/999: mkdir d15/d1b/d39/d15c 0 2024-04-01T06:57:45.721 INFO:tasks.workunit.client.0.smithi083.stdout:2/912: dread d3/d71/d90/db6/dcd/dfd/f60 [0,4194304] 0 2024-04-01T06:57:45.722 INFO:tasks.workunit.client.0.smithi083.stdout:2/913: getdents d3/d71/d90/db6/dcd/dfd/d5f 0 2024-04-01T06:57:45.722 INFO:tasks.workunit.client.0.smithi083.stdout:2/914: write d3/d71/d81/f93 [4870383,11861] 0 2024-04-01T06:57:45.736 INFO:tasks.workunit.client.0.smithi083.stdout:2/915: dwrite d3/d20/d42/dee/f109 [0,4194304] 0 2024-04-01T06:57:45.736 INFO:tasks.workunit.client.0.smithi083.stdout:2/916: readlink d3/d4d/d57/l132 0 2024-04-01T06:57:45.761 INFO:tasks.workunit.client.0.smithi083.stdout:6/864: link d9/dc/d1b/d35/d48/ff2 d9/dc/d1b/d39/d68/f124 0 2024-04-01T06:57:45.762 INFO:tasks.workunit.client.0.smithi083.stdout:6/865: creat d9/dc/d1b/d39/d68/f125 x:0 0 0 2024-04-01T06:57:45.762 INFO:tasks.workunit.client.0.smithi083.stdout:6/866: write d9/dc/f7e [2502568,12394] 0 2024-04-01T06:57:45.762 INFO:tasks.workunit.client.0.smithi083.stdout:6/867: readlink d9/dc/d1b/d39/d68/l11b 0 2024-04-01T06:57:45.763 INFO:tasks.workunit.client.0.smithi083.stdout:6/868: readlink d9/dc/d1b/df6/l115 0 2024-04-01T06:57:45.763 INFO:tasks.workunit.client.0.smithi083.stdout:6/869: truncate d9/dc/d9d/ff8 1013493 0 2024-04-01T06:57:45.763 INFO:tasks.workunit.client.0.smithi083.stdout:6/870: symlink d9/l126 0 2024-04-01T06:57:45.779 INFO:tasks.workunit.client.0.smithi083.stdout:2/917: write d3/d4d/d57/f6b [946947,127041] 0 2024-04-01T06:57:45.781 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.781+0000 7ff96bfff700 1 -- 172.21.15.83:0/2663807464 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d2fffe7c90 con 0x55d3002b55a0 2024-04-01T06:57:45.781 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.781+0000 7ff96bfff700 10 client.25399 handle_command_reply: tid=0 2024-04-01T06:57:45.781 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.781+0000 7ff99f03cb80 1 client.25399 shutdown 2024-04-01T06:57:45.781 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.781+0000 7ff99f03cb80 1 -- 172.21.15.83:0/2663807464 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d300246100 msgr2=0x55d30024c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:45.782 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.781+0000 7ff99f03cb80 1 --2- 172.21.15.83:0/2663807464 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d300246100 0x55d30024c0d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff980006010 tx=0x7ff98000f5c0 comp rx=0 tx=0).stop 2024-04-01T06:57:45.782 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.781+0000 7ff99f03cb80 1 -- 172.21.15.83:0/2663807464 shutdown_connections 2024-04-01T06:57:45.782 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.781+0000 7ff99f03cb80 1 --2- 172.21.15.83:0/2663807464 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55d3002b55a0 0x55d3002b79c0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:45.782 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.782+0000 7ff99f03cb80 1 --2- 172.21.15.83:0/2663807464 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d3002518d0 0x55d300256a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:45.782 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.782+0000 7ff99f03cb80 1 --2- 172.21.15.83:0/2663807464 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d300246100 0x55d30024c0d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:45.782 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.782+0000 7ff99f03cb80 1 --2- 172.21.15.83:0/2663807464 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d300246a20 0x55d300256520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:45.782 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.782+0000 7ff99f03cb80 1 -- 172.21.15.83:0/2663807464 >> 172.21.15.83:0/2663807464 conn(0x55d3001a6640 msgr2=0x55d300248040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:45.784 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.784+0000 7ff96bfff700 0 client.25399 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:57:45.785 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.785+0000 7ff99f03cb80 1 -- 172.21.15.83:0/2663807464 shutdown_connections 2024-04-01T06:57:45.785 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.785+0000 7ff99f03cb80 1 -- 172.21.15.83:0/2663807464 wait complete. 2024-04-01T06:57:45.785 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.785+0000 7ff99f03cb80 20 client.25399 trim_cache size 0 max 16384 2024-04-01T06:57:45.785 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout:{ 2024-04-01T06:57:45.785 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout: "message": "", 2024-04-01T06:57:45.785 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout: "return_code": 0 2024-04-01T06:57:45.785 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout:} 2024-04-01T06:57:45.786 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.786+0000 7ff992ea6700 1 -- 172.21.15.83:0/996677465 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7ff97c0a1290 msgr2=0x7ff97c0a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:45.786 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.786+0000 7ff992ea6700 1 --2- 172.21.15.83:0/996677465 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7ff97c0a1290 0x7ff97c0a3750 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff98000b2e0 tx=0x7ff980005960 comp rx=0 tx=0).stop 2024-04-01T06:57:45.786 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.786+0000 7ff992ea6700 1 -- 172.21.15.83:0/996677465 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff98c105c70 msgr2=0x7ff98c1022e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:45.786 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.786+0000 7ff992ea6700 1 --2- 172.21.15.83:0/996677465 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff98c105c70 0x7ff98c1022e0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7ff98400efc0 tx=0x7ff98400c3a0 comp rx=0 tx=0).stop 2024-04-01T06:57:45.786 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.787+0000 7ff992ea6700 1 -- 172.21.15.83:0/996677465 shutdown_connections 2024-04-01T06:57:45.786 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.787+0000 7ff992ea6700 1 --2- 172.21.15.83:0/996677465 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7ff97c0a1290 0x7ff97c0a3750 secure :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff98000b2e0 tx=0x7ff980005960 comp rx=0 tx=0).stop 2024-04-01T06:57:45.786 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.787+0000 7ff992ea6700 1 --2- 172.21.15.83:0/996677465 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff98c105c70 0x7ff98c1022e0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:45.786 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.787+0000 7ff992ea6700 1 --2- 172.21.15.83:0/996677465 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff98c0ffbb0 0x7ff98c101860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:45.786 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.787+0000 7ff992ea6700 1 --2- 172.21.15.83:0/996677465 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff98c100570 0x7ff98c101da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:45.787 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.787+0000 7ff992ea6700 1 -- 172.21.15.83:0/996677465 >> 172.21.15.83:0/996677465 conn(0x7ff98c076db0 msgr2=0x7ff98c0696d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:45.787 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.787+0000 7ff992ea6700 1 -- 172.21.15.83:0/996677465 shutdown_connections 2024-04-01T06:57:45.787 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:45.787+0000 7ff992ea6700 1 -- 172.21.15.83:0/996677465 wait complete. 2024-04-01T06:57:45.788 INFO:tasks.workunit.client.0.smithi083.stdout:7/753: sync 2024-04-01T06:57:45.788 INFO:tasks.workunit.client.0.smithi083.stdout:5/906: sync 2024-04-01T06:57:45.788 INFO:tasks.workunit.client.0.smithi083.stdout:2/918: dread d3/d20/d42/f6c [0,4194304] 0 2024-04-01T06:57:45.788 INFO:tasks.workunit.client.0.smithi083.stdout:2/919: rename d3/d71 to d3/d71/d90/db6/dcd/dfd/d66/d137 22 2024-04-01T06:57:45.788 INFO:tasks.workunit.client.0.smithi083.stdout:2/920: fdatasync d3/ff0 0 2024-04-01T06:57:45.789 INFO:tasks.workunit.client.0.smithi083.stdout:7/754: creat d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/db8/f107 x:0 0 0 2024-04-01T06:57:45.790 INFO:tasks.workunit.client.0.smithi083.stdout:5/907: creat d4/d9/d16/d19/d5e/d113/da9/db3/f12a x:0 0 0 2024-04-01T06:57:45.790 INFO:tasks.workunit.client.0.smithi083.stdout:2/921: mknod d3/d26/d59/d27/c138 0 2024-04-01T06:57:45.791 INFO:tasks.workunit.client.0.smithi083.stdout:7/755: symlink d0/d4/d9/d39/d67/d6d/d87/d83/d62/l108 0 2024-04-01T06:57:45.792 INFO:tasks.workunit.client.0.smithi083.stdout:5/908: symlink d4/d23/dfb/l12b 0 2024-04-01T06:57:45.792 INFO:tasks.workunit.client.0.smithi083.stdout:5/909: write d4/d9/ff6 [335196,76693] 0 2024-04-01T06:57:45.792 INFO:tasks.workunit.client.0.smithi083.stdout:2/922: mknod d3/d8b/c139 0 2024-04-01T06:57:45.794 INFO:tasks.workunit.client.0.smithi083.stdout:7/756: creat d0/d4/dbd/dd0/f109 x:0 0 0 2024-04-01T06:57:45.794 INFO:tasks.workunit.client.0.smithi083.stdout:7/757: chown d0/d4/d9/d39/d97/fb4 101 1 2024-04-01T06:57:45.798 INFO:tasks.workunit.client.0.smithi083.stdout:7/758: link d0/d4/d9/f3e d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/de5/f10a 0 2024-04-01T06:57:45.798 INFO:tasks.workunit.client.0.smithi083.stdout:7/759: rename d0 to d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/d5d/d10b 22 2024-04-01T06:57:45.806 INFO:tasks.workunit.client.0.smithi083.stdout:5/910: dwrite d4/d23/d4e/d83/dd5/ff5 [0,4194304] 0 2024-04-01T06:57:45.807 INFO:tasks.workunit.client.0.smithi083.stdout:5/911: write d4/d9/d16/d19/d5e/d110/f11c [126168,119780] 0 2024-04-01T06:57:45.818 INFO:tasks.workunit.client.0.smithi083.stdout:2/923: dwrite d3/d71/d81/f10d [0,4194304] 0 2024-04-01T06:57:45.818 INFO:tasks.workunit.client.0.smithi083.stdout:7/760: dwrite d0/d4/d9/d39/f90 [0,4194304] 0 2024-04-01T06:57:45.818 INFO:tasks.workunit.client.0.smithi083.stdout:5/912: dwrite d4/fb7 [0,4194304] 0 2024-04-01T06:57:45.818 INFO:tasks.workunit.client.0.smithi083.stdout:5/913: fsync d4/d9/d16/d19/d5e/d113/da9/db3/f12a 0 2024-04-01T06:57:45.823 INFO:tasks.workunit.client.0.smithi083.stdout:7/761: getdents d0 0 2024-04-01T06:57:45.824 INFO:tasks.workunit.client.0.smithi083.stdout:2/924: mkdir d3/d26/d13a 0 2024-04-01T06:57:45.825 INFO:tasks.workunit.client.0.smithi083.stdout:2/925: write d3/d26/d59/d27/f7e [2870200,43259] 0 2024-04-01T06:57:45.827 INFO:tasks.workunit.client.0.smithi083.stdout:2/926: write d3/f112 [1450764,106111] 0 2024-04-01T06:57:45.828 INFO:tasks.workunit.client.0.smithi083.stdout:7/762: link d0/d7c/la7 d0/d4/d9/d39/d67/d6d/d7d/d8a/dce/l10c 0 2024-04-01T06:57:45.830 INFO:tasks.workunit.client.0.smithi083.stdout:2/927: creat d3/de1/df5/dae/ddd/f13b x:0 0 0 2024-04-01T06:57:45.830 INFO:tasks.workunit.client.0.smithi083.stdout:2/928: fsync d3/d8b/f64 0 2024-04-01T06:57:45.831 INFO:tasks.workunit.client.0.smithi083.stdout:7/763: creat d0/d4/d9/d39/d67/d6d/d87/d83/d38/de2/f10d x:0 0 0 2024-04-01T06:57:45.831 INFO:tasks.workunit.client.0.smithi083.stdout:5/914: dwrite d4/d9/fcc [0,4194304] 0 2024-04-01T06:57:45.832 INFO:tasks.workunit.client.0.smithi083.stdout:2/929: mkdir d3/d71/d13c 0 2024-04-01T06:57:45.832 INFO:tasks.workunit.client.0.smithi083.stdout:7/764: readlink d0/d4/l56 0 2024-04-01T06:57:45.834 INFO:tasks.workunit.client.0.smithi083.stdout:5/915: rename d4/d9/d16/dc1/fd6 to d4/d71/f12c 0 2024-04-01T06:57:45.835 INFO:tasks.workunit.client.0.smithi083.stdout:7/765: truncate d0/f2b 1043316 0 2024-04-01T06:57:45.835 INFO:tasks.workunit.client.0.smithi083.stdout:7/766: chown d0/d4/d9/d39/d48/f85 4147 1 2024-04-01T06:57:45.835 INFO:tasks.workunit.client.0.smithi083.stdout:7/767: fsync d0/d4/d9/d39/d67/d6d/d87/d83/f2d 0 2024-04-01T06:57:45.838 INFO:tasks.workunit.client.0.smithi083.stdout:5/916: creat d4/d9/d16/d19/d5e/d113/f12d x:0 0 0 2024-04-01T06:57:45.839 INFO:tasks.workunit.client.0.smithi083.stdout:5/917: rename d4/d9/lb8 to d4/d9/d16/d9f/l12e 0 2024-04-01T06:57:45.839 INFO:tasks.workunit.client.0.smithi083.stdout:5/918: dread - d4/d23/fd7 zero size 2024-04-01T06:57:45.840 INFO:tasks.workunit.client.0.smithi083.stdout:5/919: stat d4/d9/d16/d9f/dc7/d68/l91 0 2024-04-01T06:57:45.844 INFO:tasks.workunit.client.0.smithi083.stdout:5/920: rename d4/d9/d16/d19/d5e/d113/da9/db3/f12a to d4/d23/d4e/d83/f12f 0 2024-04-01T06:57:45.844 INFO:tasks.workunit.client.0.smithi083.stdout:5/921: chown d4/d71/d7d/fd3 571 1 2024-04-01T06:57:45.845 INFO:tasks.workunit.client.0.smithi083.stdout:5/922: mknod d4/d9/d16/d9f/dc7/d68/df2/d107/c130 0 2024-04-01T06:57:45.845 INFO:tasks.workunit.client.0.smithi083.stdout:5/923: chown d4/d9/d16/d9f/dc7/d96/db2 588438 1 2024-04-01T06:57:45.847 INFO:tasks.workunit.client.0.smithi083.stdout:5/924: creat d4/d23/d4e/d83/f131 x:0 0 0 2024-04-01T06:57:45.848 INFO:tasks.workunit.client.0.smithi083.stdout:2/930: dwrite d3/d4d/d5d/fef [0,4194304] 0 2024-04-01T06:57:45.848 INFO:tasks.workunit.client.0.smithi083.stdout:5/925: mkdir d4/d9/d16/dc1/da0/df7/d102/d132 0 2024-04-01T06:57:45.851 INFO:tasks.workunit.client.0.smithi083.stdout:2/931: read f1 [2030847,44047] 0 2024-04-01T06:57:45.859 INFO:tasks.workunit.client.0.smithi083.stdout:7/768: dwrite d0/d4/d9/d39/d67/d6d/d7d/d8a/dce/ff6 [0,4194304] 0 2024-04-01T06:57:45.860 INFO:tasks.workunit.client.0.smithi083.stdout:2/932: dread d3/d26/d59/d2b/f32 [0,4194304] 0 2024-04-01T06:57:45.861 INFO:tasks.workunit.client.0.smithi083.stdout:7/769: unlink d0/d4/d9/d39/d67/d6d/d7d/d8a/lad 0 2024-04-01T06:57:45.861 INFO:tasks.workunit.client.0.smithi083.stdout:7/770: readlink d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/l77 0 2024-04-01T06:57:45.862 INFO:tasks.workunit.client.0.smithi083.stdout:7/771: mkdir d0/d4/d9/d95/d10e 0 2024-04-01T06:57:45.873 INFO:tasks.workunit.client.0.smithi083.stdout:2/933: dwrite d3/d26/d59/f30 [4194304,4194304] 0 2024-04-01T06:57:45.873 INFO:tasks.workunit.client.0.smithi083.stdout:2/934: write d3/d71/d90/db6/dcd/dfd/d66/dc1/fe5 [759339,124724] 0 2024-04-01T06:57:45.878 INFO:tasks.workunit.client.0.smithi083.stdout:7/772: dwrite d0/d4/d9/d39/d67/d6d/fac [0,4194304] 0 2024-04-01T06:57:45.880 INFO:tasks.workunit.client.0.smithi083.stdout:7/773: truncate d0/d4/d9/d39/d67/d6d/d7d/fd5 359993 0 2024-04-01T06:57:45.882 INFO:tasks.workunit.client.0.smithi083.stdout:7/774: getdents d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/d5d 0 2024-04-01T06:57:45.882 INFO:tasks.workunit.client.0.smithi083.stdout:7/775: chown d0/d4/d9/d39/l44 0 1 2024-04-01T06:57:45.883 INFO:tasks.workunit.client.0.smithi083.stdout:7/776: write d0/d4/f32 [890616,56759] 0 2024-04-01T06:57:45.885 INFO:tasks.workunit.client.0.smithi083.stdout:2/935: dwrite d3/d26/d59/fd4 [0,4194304] 0 2024-04-01T06:57:45.886 INFO:tasks.workunit.client.0.smithi083.stdout:7/777: rename d0/c104 to d0/d4/d9/d39/d67/d6d/d7d/c10f 0 2024-04-01T06:57:45.886 INFO:tasks.workunit.client.0.smithi083.stdout:7/778: chown d0/d4/d9/d39/d67/d6d/l7f 134294839 1 2024-04-01T06:57:45.891 INFO:tasks.workunit.client.0.smithi083.stdout:7/779: creat d0/d7a/f110 x:0 0 0 2024-04-01T06:57:45.891 INFO:tasks.workunit.client.0.smithi083.stdout:7/780: chown d0/d4/d9/d39/d67/d6d/d87/d83/d38/de2/f10d 1556 1 2024-04-01T06:57:45.891 INFO:tasks.workunit.client.0.smithi083.stdout:7/781: write d0/d4/d9/d39/d67/d6d/d87/dda/fed [263662,46219] 0 2024-04-01T06:57:45.891 INFO:tasks.workunit.client.0.smithi083.stdout:7/782: write d0/d4/d9/d39/d67/d6d/d7d/d8a/fab [854782,82558] 0 2024-04-01T06:57:45.892 INFO:tasks.workunit.client.0.smithi083.stdout:7/783: link d0/d4/d9/d39/d67/ld2 d0/d7c/l111 0 2024-04-01T06:57:45.894 INFO:tasks.workunit.client.0.smithi083.stdout:7/784: getdents d0/d4/d9/d39/d67/d6d/d87/d83 0 2024-04-01T06:57:45.894 INFO:tasks.workunit.client.0.smithi083.stdout:7/785: fsync d0/d4/dbd/db2/ff0 0 2024-04-01T06:57:45.897 INFO:tasks.workunit.client.0.smithi083.stdout:7/786: creat d0/d4/d9/d39/d67/d6d/d87/d83/d62/dc6/dec/f112 x:0 0 0 2024-04-01T06:57:45.898 INFO:tasks.workunit.client.0.smithi083.stdout:2/936: dwrite d3/d71/d90/db6/dcd/dfd/d5e/f87 [0,4194304] 0 2024-04-01T06:57:45.899 INFO:tasks.workunit.client.0.smithi083.stdout:2/937: read - d3/d4d/d57/df2/f124 zero size 2024-04-01T06:57:45.902 INFO:tasks.workunit.client.0.smithi083.stdout:2/938: link d3/d26/d59/c56 d3/d26/d59/d27/d79/de9/c13d 0 2024-04-01T06:57:45.902 INFO:tasks.workunit.client.0.smithi083.stdout:2/939: read - d3/d71/d90/db6/dcd/dfd/d5f/f7c zero size 2024-04-01T06:57:45.902 INFO:tasks.workunit.client.0.smithi083.stdout:2/940: chown d3/de1/df5/dae/ddd 409 1 2024-04-01T06:57:45.904 INFO:tasks.workunit.client.0.smithi083.stdout:7/787: dread d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/f54 [0,4194304] 0 2024-04-01T06:57:45.904 INFO:tasks.workunit.client.0.smithi083.stdout:7/788: truncate d0/d4/d9/d39/d67/d6d/d87/d83/d34/fc2 243650 0 2024-04-01T06:57:45.905 INFO:tasks.workunit.client.0.smithi083.stdout:7/789: getdents d0/d4/d9/d39/d67 0 2024-04-01T06:57:45.906 INFO:tasks.workunit.client.0.smithi083.stdout:7/790: read - d0/d4/dbd/dd0/f109 zero size 2024-04-01T06:57:45.908 INFO:tasks.workunit.client.0.smithi083.stdout:7/791: dread d0/f66 [0,4194304] 0 2024-04-01T06:57:45.910 INFO:tasks.workunit.client.0.smithi083.stdout:2/941: dread d3/d26/d59/d2b/f82 [4194304,4194304] 0 2024-04-01T06:57:45.910 INFO:tasks.workunit.client.0.smithi083.stdout:2/942: chown d3/d4d/d57/df2/l11c 61274613 1 2024-04-01T06:57:45.910 INFO:tasks.workunit.client.0.smithi083.stdout:2/943: creat d3/d4d/d57/df2/f13e x:0 0 0 2024-04-01T06:57:45.911 INFO:tasks.workunit.client.0.smithi083.stdout:2/944: truncate d3/d8b/f51 1008228 0 2024-04-01T06:57:45.925 INFO:tasks.workunit.client.0.smithi083.stdout:7/792: dwrite d0/d4/d9/d39/d67/d6d/f5f [0,4194304] 0 2024-04-01T06:57:45.927 INFO:tasks.workunit.client.0.smithi083.stdout:7/793: creat d0/d4/d9/d39/d67/d6d/d87/d83/d34/f113 x:0 0 0 2024-04-01T06:57:45.940 INFO:tasks.workunit.client.0.smithi083.stdout:7/794: dwrite d0/d4/d9/f5e [0,4194304] 0 2024-04-01T06:57:45.940 INFO:tasks.workunit.client.0.smithi083.stdout:7/795: chown d0/d4/d9/d39/f70 669482721 1 2024-04-01T06:57:45.945 INFO:tasks.workunit.client.0.smithi083.stdout:7/796: dread d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/f54 [0,4194304] 0 2024-04-01T06:57:45.955 INFO:tasks.workunit.client.0.smithi083.stdout:7/797: dwrite d0/d4/d9/d39/d67/d6d/d87/d83/f42 [0,4194304] 0 2024-04-01T06:57:45.971 INFO:tasks.workunit.client.0.smithi083.stdout:7/798: dwrite d0/d4/d9/d39/d67/d6d/d7d/fef [0,4194304] 0 2024-04-01T06:57:45.973 INFO:tasks.workunit.client.0.smithi083.stdout:7/799: mkdir d0/d4/d9/d39/d67/dc0/d114 0 2024-04-01T06:57:45.975 INFO:tasks.workunit.client.0.smithi083.stdout:7/800: dread d0/f2b [0,4194304] 0 2024-04-01T06:57:45.975 INFO:tasks.workunit.client.0.smithi083.stdout:7/801: stat d0/d4/dbd/dd0/f109 0 2024-04-01T06:57:45.975 INFO:tasks.workunit.client.0.smithi083.stdout:7/802: fsync d0/d7a/f7b 0 2024-04-01T06:57:45.976 INFO:tasks.workunit.client.0.smithi083.stdout:7/803: creat d0/d4/d9/d39/f115 x:0 0 0 2024-04-01T06:57:45.977 INFO:tasks.workunit.client.0.smithi083.stdout:7/804: fsync d0/d4/d9/d39/d67/d6d/f5f 0 2024-04-01T06:57:45.977 INFO:tasks.workunit.client.0.smithi083.stdout:7/805: write d0/d4/d9/d39/d67/d6d/d87/d83/d38/dbf/de7/ff9 [833517,41929] 0 2024-04-01T06:57:45.977 INFO:tasks.workunit.client.0.smithi083.stdout:7/806: creat d0/d7a/f116 x:0 0 0 2024-04-01T06:57:45.978 INFO:tasks.workunit.client.0.smithi083.stdout:7/807: rename d0/d7a/l8c to d0/d4/dbd/l117 0 2024-04-01T06:57:45.991 INFO:tasks.workunit.client.0.smithi083.stdout:7/808: dwrite d0/d4/d9/d39/d67/d6d/d87/d83/f3c [0,4194304] 0 2024-04-01T06:57:45.992 INFO:tasks.workunit.client.0.smithi083.stdout:7/809: dread d0/d4/d9/d39/d67/d6d/d87/d83/d62/f6f [0,4194304] 0 2024-04-01T06:57:45.992 INFO:tasks.workunit.client.0.smithi083.stdout:7/810: fsync d0/d4/d9/f3e 0 2024-04-01T06:57:46.009 INFO:tasks.workunit.client.0.smithi083.stdout:7/811: dwrite d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/f106 [0,4194304] 0 2024-04-01T06:57:46.026 INFO:tasks.workunit.client.0.smithi083.stdout:7/812: dwrite d0/d4/fc [0,4194304] 0 2024-04-01T06:57:46.028 INFO:tasks.workunit.client.0.smithi083.stdout:7/813: mknod d0/d4/d9/d39/d67/d6d/d7d/d8a/dce/c118 0 2024-04-01T06:57:46.028 INFO:tasks.workunit.client.0.smithi083.stdout:7/814: write d0/d4/d9/d39/d67/d6d/d87/d83/d62/dc6/dec/f112 [555517,114941] 0 2024-04-01T06:57:46.028 INFO:tasks.workunit.client.0.smithi083.stdout:7/815: write d0/d4/d9/d39/d67/d6d/d87/d83/d62/dc6/dec/f112 [1118075,107772] 0 2024-04-01T06:57:46.030 INFO:tasks.workunit.client.0.smithi083.stdout:7/816: link d0/d4/d9/d39/fae d0/d4/d9/d39/d67/d6d/d87/d83/f119 0 2024-04-01T06:57:46.030 INFO:tasks.workunit.client.0.smithi083.stdout:7/817: fsync d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/f54 0 2024-04-01T06:57:46.030 INFO:tasks.workunit.client.0.smithi083.stdout:7/818: fdatasync d0/d4/d9/d39/d67/d6d/d87/d83/f2d 0 2024-04-01T06:57:46.031 INFO:tasks.workunit.client.0.smithi083.stdout:7/819: creat d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/de5/f11a x:0 0 0 2024-04-01T06:57:46.032 INFO:tasks.workunit.client.0.smithi083.stdout:7/820: mknod d0/d4/d9/d39/d67/dc0/d114/c11b 0 2024-04-01T06:57:46.033 INFO:tasks.workunit.client.0.smithi083.stdout:7/821: stat d0/d4/fc5 0 2024-04-01T06:57:46.035 INFO:tasks.workunit.client.0.smithi083.stdout:7/822: mkdir d0/d4/dbd/dd0/d11c 0 2024-04-01T06:57:46.037 INFO:tasks.workunit.client.0.smithi083.stdout:7/823: unlink d0/d4/d9/d39/d67/d6d/d87/d83/d34/fc2 0 2024-04-01T06:57:46.039 INFO:tasks.workunit.client.0.smithi083.stdout:7/824: write d0/d4/d9/d39/d67/d6d/d87/d83/f27 [4994880,79627] 0 2024-04-01T06:57:46.040 INFO:tasks.workunit.client.0.smithi083.stdout:7/825: creat d0/d4/dbd/db7/f11d x:0 0 0 2024-04-01T06:57:46.040 INFO:tasks.workunit.client.0.smithi083.stdout:7/826: truncate d0/d4/d9/d39/d97/fb4 4520847 0 2024-04-01T06:57:46.042 INFO:tasks.workunit.client.0.smithi083.stdout:7/827: mknod d0/d4/d9/d39/d67/c11e 0 2024-04-01T06:57:46.055 INFO:tasks.workunit.client.0.smithi083.stdout:7/828: dwrite d0/d7c/ffe [4194304,4194304] 0 2024-04-01T06:57:46.062 INFO:tasks.workunit.client.0.smithi083.stdout:7/829: truncate d0/d4/d9/d39/d67/d6d/d87/d83/f42 3446578 0 2024-04-01T06:57:46.062 INFO:tasks.workunit.client.0.smithi083.stdout:7/830: write d0/f66 [1922005,16114] 0 2024-04-01T06:57:46.063 INFO:tasks.workunit.client.0.smithi083.stdout:7/831: dread - d0/d4/d9/d39/d67/d6d/d87/d83/d38/de2/f10d zero size 2024-04-01T06:57:46.063 INFO:tasks.workunit.client.0.smithi083.stdout:7/832: read d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/f106 [717644,127387] 0 2024-04-01T06:57:46.064 INFO:tasks.workunit.client.0.smithi083.stdout:7/833: write d0/d4/d9/d39/f90 [454177,121694] 0 2024-04-01T06:57:46.078 INFO:tasks.workunit.client.0.smithi083.stdout:7/834: dwrite d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/fc8 [0,4194304] 0 2024-04-01T06:57:46.080 INFO:tasks.workunit.client.0.smithi083.stdout:7/835: symlink d0/d4/d9/d39/d67/d6d/d87/d83/d38/l11f 0 2024-04-01T06:57:46.081 INFO:tasks.workunit.client.0.smithi083.stdout:7/836: symlink d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/dc7/l120 0 2024-04-01T06:57:46.082 INFO:tasks.workunit.client.0.smithi083.stdout:7/837: dread - d0/d7a/f110 zero size 2024-04-01T06:57:46.083 INFO:tasks.workunit.client.0.smithi083.stdout:7/838: fsync d0/d4/d9/d39/d67/d6d/d87/d83/d62/dc6/dec/f112 0 2024-04-01T06:57:46.086 INFO:tasks.workunit.client.0.smithi083.stdout:7/839: creat d0/d4/d9/f121 x:0 0 0 2024-04-01T06:57:46.087 INFO:tasks.workunit.client.0.smithi083.stdout:7/840: mknod d0/d4/dbd/dd0/c122 0 2024-04-01T06:57:46.096 INFO:tasks.workunit.client.0.smithi083.stdout:7/841: dwrite d0/d4/d9/d39/d67/d6d/d87/d83/ffa [4194304,4194304] 0 2024-04-01T06:57:46.097 INFO:tasks.workunit.client.0.smithi083.stdout:7/842: write d0/d4/d9/d39/f90 [4220387,112363] 0 2024-04-01T06:57:46.288 INFO:tasks.workunit.client.0.smithi083.stdout:5/926: sync 2024-04-01T06:57:46.289 INFO:tasks.workunit.client.0.smithi083.stdout:2/945: sync 2024-04-01T06:57:46.289 INFO:tasks.workunit.client.0.smithi083.stdout:5/927: fsync d4/d9/d16/d9f/dc7/d68/df2/f111 0 2024-04-01T06:57:46.289 INFO:tasks.workunit.client.0.smithi083.stdout:6/871: sync 2024-04-01T06:57:46.289 INFO:tasks.workunit.client.0.smithi083.stdout:7/843: sync 2024-04-01T06:57:46.289 INFO:tasks.workunit.client.0.smithi083.stdout:4/878: sync 2024-04-01T06:57:46.289 INFO:tasks.workunit.client.0.smithi083.stdout:7/844: fdatasync d0/d4/d9/d39/d67/d6d/d87/d83/fff 0 2024-04-01T06:57:46.289 INFO:tasks.workunit.client.0.smithi083.stdout:4/879: fsync d1/d47/d2a/f2e 0 2024-04-01T06:57:46.289 INFO:tasks.workunit.client.0.smithi083.stdout:7/845: chown d0/d7c/cd7 63 1 2024-04-01T06:57:46.289 INFO:tasks.workunit.client.0.smithi083.stdout:4/880: fsync d1/d4/db/d94/fe2 0 2024-04-01T06:57:46.289 INFO:tasks.workunit.client.0.smithi083.stdout:7/846: write d0/d4/f32 [1048002,115293] 0 2024-04-01T06:57:46.290 INFO:tasks.workunit.client.0.smithi083.stdout:5/928: creat d4/d9/d16/dc1/da0/dab/f133 x:0 0 0 2024-04-01T06:57:46.290 INFO:tasks.workunit.client.0.smithi083.stdout:5/929: fdatasync d4/d9/d16/d19/d5e/d113/f24 0 2024-04-01T06:57:46.290 INFO:tasks.workunit.client.0.smithi083.stdout:2/946: creat d3/d71/df9/f13f x:0 0 0 2024-04-01T06:57:46.291 INFO:tasks.workunit.client.0.smithi083.stdout:4/881: creat d1/d4/db8/ded/de8/dd5/de9/f11b x:0 0 0 2024-04-01T06:57:46.293 INFO:tasks.workunit.client.0.smithi083.stdout:7/847: getdents d0/d4/d9/d39/d67/d6d/d7d/d8a/dce 0 2024-04-01T06:57:46.293 INFO:tasks.workunit.client.0.smithi083.stdout:7/848: write d0/d4/d9/d39/d67/d6d/d87/d83/d62/dc6/dec/f112 [1536817,11914] 0 2024-04-01T06:57:46.295 INFO:tasks.workunit.client.0.smithi083.stdout:5/930: symlink d4/d71/d94/l134 0 2024-04-01T06:57:46.297 INFO:tasks.workunit.client.0.smithi083.stdout:4/882: creat d1/d47/f11c x:0 0 0 2024-04-01T06:57:46.297 INFO:tasks.workunit.client.0.smithi083.stdout:4/883: write d1/d4/db/d94/daf/dd1/fff [789618,123291] 0 2024-04-01T06:57:46.299 INFO:tasks.workunit.client.0.smithi083.stdout:4/884: getdents d1/d47/d90 0 2024-04-01T06:57:46.301 INFO:tasks.workunit.client.0.smithi083.stdout:4/885: rename d1/d4/db8/ded/de8/dd5/de9/lc7 to d1/d4/db/d5b/d62/dbd/l11d 0 2024-04-01T06:57:46.301 INFO:tasks.workunit.client.0.smithi083.stdout:4/886: fdatasync d1/da5/dfc/f114 0 2024-04-01T06:57:46.301 INFO:tasks.workunit.client.0.smithi083.stdout:4/887: fsync d1/d4/db8/ded/de8/f39 0 2024-04-01T06:57:46.304 INFO:tasks.workunit.client.0.smithi083.stdout:4/888: symlink d1/d4/db/d5b/d62/l11e 0 2024-04-01T06:57:46.307 INFO:tasks.workunit.client.0.smithi083.stdout:4/889: creat d1/d4/db8/ded/de8/d88/f11f x:0 0 0 2024-04-01T06:57:46.309 INFO:tasks.workunit.client.0.smithi083.stdout:4/890: mknod d1/d4/d6e/c120 0 2024-04-01T06:57:46.309 INFO:tasks.workunit.client.0.smithi083.stdout:4/891: chown d1/d4/db/fb3 4 1 2024-04-01T06:57:46.309 INFO:tasks.workunit.client.0.smithi083.stdout:4/892: truncate d1/da5/dae/dda/ffa 164699 0 2024-04-01T06:57:46.310 INFO:tasks.workunit.client.0.smithi083.stdout:4/893: truncate d1/d4/db/d5b/f5f 2938636 0 2024-04-01T06:57:46.312 INFO:tasks.workunit.client.0.smithi083.stdout:2/947: dwrite d3/f129 [4194304,4194304] 0 2024-04-01T06:57:46.312 INFO:tasks.workunit.client.0.smithi083.stdout:4/894: truncate d1/d47/d2a/fcf 2443239 0 2024-04-01T06:57:46.313 INFO:tasks.workunit.client.0.smithi083.stdout:2/948: write d3/de1/df5/fe2 [2509861,49099] 0 2024-04-01T06:57:46.314 INFO:tasks.workunit.client.0.smithi083.stdout:6/872: dwrite d9/dc/d1b/d35/f64 [0,4194304] 0 2024-04-01T06:57:46.315 INFO:tasks.workunit.client.0.smithi083.stdout:5/931: dwrite d4/d23/d4e/d83/f12f [0,4194304] 0 2024-04-01T06:57:46.315 INFO:tasks.workunit.client.0.smithi083.stdout:5/932: fdatasync d4/d9/d16/dc1/ff9 0 2024-04-01T06:57:46.316 INFO:tasks.workunit.client.0.smithi083.stdout:6/873: write d9/f19 [6164667,20515] 0 2024-04-01T06:57:46.317 INFO:tasks.workunit.client.0.smithi083.stdout:2/949: rename d3/d71/d90/cf7 to d3/de1/df5/dae/c140 0 2024-04-01T06:57:46.317 INFO:tasks.workunit.client.0.smithi083.stdout:2/950: fsync d3/d71/d90/db6/dcd/dfd/d5f/f7c 0 2024-04-01T06:57:46.318 INFO:tasks.workunit.client.0.smithi083.stdout:2/951: read d3/ff0 [159341,34043] 0 2024-04-01T06:57:46.318 INFO:tasks.workunit.client.0.smithi083.stdout:4/895: dread d1/d4/f7e [0,4194304] 0 2024-04-01T06:57:46.318 INFO:tasks.workunit.client.0.smithi083.stdout:4/896: chown d1/d4/db/fb3 343204747 1 2024-04-01T06:57:46.318 INFO:tasks.workunit.client.0.smithi083.stdout:4/897: truncate d1/d4/db/d94/daf/dd1/fa6 1077262 0 2024-04-01T06:57:46.318 INFO:tasks.workunit.client.0.smithi083.stdout:2/952: write d3/d26/d59/f31 [2330572,39896] 0 2024-04-01T06:57:46.321 INFO:tasks.workunit.client.0.smithi083.stdout:2/953: dread d3/d26/f36 [0,4194304] 0 2024-04-01T06:57:46.321 INFO:tasks.workunit.client.0.smithi083.stdout:5/933: link d4/d23/d49/f73 d4/d9/d16/d9f/dc7/f135 0 2024-04-01T06:57:46.321 INFO:tasks.workunit.client.0.smithi083.stdout:5/934: chown d4/d9/d16/d1f/d2f/d53/dbb/fac 129207 1 2024-04-01T06:57:46.321 INFO:tasks.workunit.client.0.smithi083.stdout:5/935: write d4/d9/d16/d19/d5e/d110/f122 [729145,47243] 0 2024-04-01T06:57:46.323 INFO:tasks.workunit.client.0.smithi083.stdout:4/898: link d1/d4/db8/fc3 d1/d4/db8/ded/de8/dd5/de9/d89/f121 0 2024-04-01T06:57:46.323 INFO:tasks.workunit.client.0.smithi083.stdout:4/899: write d1/da5/dae/f117 [224764,28155] 0 2024-04-01T06:57:46.323 INFO:tasks.workunit.client.0.smithi083.stdout:4/900: write d1/d4/db8/ded/de8/dd5/de9/f50 [1454841,13832] 0 2024-04-01T06:57:46.323 INFO:tasks.workunit.client.0.smithi083.stdout:4/901: chown d1/d4/db/d94/daf/dd1/d6a/fde 1 1 2024-04-01T06:57:46.325 INFO:tasks.workunit.client.0.smithi083.stdout:2/954: mkdir d3/d71/db8/dec/d141 0 2024-04-01T06:57:46.327 INFO:tasks.workunit.client.0.smithi083.stdout:4/902: getdents d1/d4/d6e 0 2024-04-01T06:57:46.327 INFO:tasks.workunit.client.0.smithi083.stdout:4/903: write d1/d4/db/fe3 [381358,49003] 0 2024-04-01T06:57:46.329 INFO:tasks.workunit.client.0.smithi083.stdout:2/955: getdents d3/de1/df5 0 2024-04-01T06:57:46.329 INFO:tasks.workunit.client.0.smithi083.stdout:2/956: truncate d3/d26/fe0 261589 0 2024-04-01T06:57:46.329 INFO:tasks.workunit.client.0.smithi083.stdout:6/874: dwrite d9/dc/d1b/fba [0,4194304] 0 2024-04-01T06:57:46.332 INFO:tasks.workunit.client.0.smithi083.stdout:2/957: creat d3/d4d/d5d/f142 x:0 0 0 2024-04-01T06:57:46.334 INFO:tasks.workunit.client.0.smithi083.stdout:5/936: dwrite d4/f93 [0,4194304] 0 2024-04-01T06:57:46.335 INFO:tasks.workunit.client.0.smithi083.stdout:6/875: creat d9/dc/d3b/f127 x:0 0 0 2024-04-01T06:57:46.337 INFO:tasks.workunit.client.0.smithi083.stdout:4/904: dread d1/d47/f70 [0,4194304] 0 2024-04-01T06:57:46.337 INFO:tasks.workunit.client.0.smithi083.stdout:4/905: fdatasync d1/d4/db/f56 0 2024-04-01T06:57:46.338 INFO:tasks.workunit.client.0.smithi083.stdout:2/958: truncate d3/d26/d59/d2b/f40 915120 0 2024-04-01T06:57:46.338 INFO:tasks.workunit.client.0.smithi083.stdout:2/959: write d3/d26/d59/d27/f3b [3064666,75672] 0 2024-04-01T06:57:46.339 INFO:tasks.workunit.client.0.smithi083.stdout:5/937: mkdir d4/d9/d16/d19/d5e/d113/da9/db3/d136 0 2024-04-01T06:57:46.345 INFO:tasks.workunit.client.0.smithi083.stdout:5/938: getdents d4/d9 0 2024-04-01T06:57:46.346 INFO:tasks.workunit.client.0.smithi083.stdout:6/876: rmdir d9/dc/d1b/d4c 39 2024-04-01T06:57:46.347 INFO:tasks.workunit.client.0.smithi083.stdout:2/960: dwrite d3/d26/d59/d27/f7e [0,4194304] 0 2024-04-01T06:57:46.348 INFO:tasks.workunit.client.0.smithi083.stdout:2/961: chown d3/d71/d90/db6/dcd/dfd/d5e/f7b 0 1 2024-04-01T06:57:46.348 INFO:tasks.workunit.client.0.smithi083.stdout:2/962: chown d3/d26/d59/f31 1023219237 1 2024-04-01T06:57:46.348 INFO:tasks.workunit.client.0.smithi083.stdout:2/963: fsync d3/d26/d59/d27/f96 0 2024-04-01T06:57:46.349 INFO:tasks.workunit.client.0.smithi083.stdout:5/939: link d4/d9/d16/d1f/d2f/d53/dbb/lea d4/d9/d16/d8a/l137 0 2024-04-01T06:57:46.349 INFO:tasks.workunit.client.0.smithi083.stdout:6/877: write d9/dc/d1b/d35/d48/d52/d9c/da9/fbe [4085011,53569] 0 2024-04-01T06:57:46.351 INFO:tasks.workunit.client.0.smithi083.stdout:5/940: symlink d4/d9/d16/dc1/d121/l138 0 2024-04-01T06:57:46.353 INFO:tasks.workunit.client.0.smithi083.stdout:6/878: creat d9/dc/d1b/d35/f128 x:0 0 0 2024-04-01T06:57:46.357 INFO:tasks.workunit.client.0.smithi083.stdout:4/906: dwrite d1/d4/db8/ded/d79/fbb [0,4194304] 0 2024-04-01T06:57:46.357 INFO:tasks.workunit.client.0.smithi083.stdout:4/907: stat d1/d4/db/f11 0 2024-04-01T06:57:46.358 INFO:tasks.workunit.client.0.smithi083.stdout:4/908: dread - d1/d47/fd6 zero size 2024-04-01T06:57:46.358 INFO:tasks.workunit.client.0.smithi083.stdout:5/941: link d4/d71/f7a d4/d71/d94/f139 0 2024-04-01T06:57:46.359 INFO:tasks.workunit.client.0.smithi083.stdout:4/909: mkdir d1/d47/d2a/d122 0 2024-04-01T06:57:46.359 INFO:tasks.workunit.client.0.smithi083.stdout:4/910: chown d1/d4/db8/ded/de8/d88/l9a 1 1 2024-04-01T06:57:46.359 INFO:tasks.workunit.client.0.smithi083.stdout:6/879: write d9/dc/f25 [3806249,126629] 0 2024-04-01T06:57:46.362 INFO:tasks.workunit.client.0.smithi083.stdout:2/964: dwrite d3/d26/f89 [0,4194304] 0 2024-04-01T06:57:46.363 INFO:tasks.workunit.client.0.smithi083.stdout:5/942: dread d4/f1b [0,4194304] 0 2024-04-01T06:57:46.365 INFO:tasks.workunit.client.0.smithi083.stdout:6/880: link d9/dc/d1b/d35/d48/d52/l92 d9/dc/d29/l129 0 2024-04-01T06:57:46.368 INFO:tasks.workunit.client.0.smithi083.stdout:5/943: rename d4/d23/d4e/f57 to d4/d23/d67/de3/f13a 0 2024-04-01T06:57:46.369 INFO:tasks.workunit.client.0.smithi083.stdout:6/881: link d9/dc/d29/f2a d9/d57/d5f/df9/f12a 0 2024-04-01T06:57:46.370 INFO:tasks.workunit.client.0.smithi083.stdout:5/944: rename d4/d9/d16/d19/d5e/d113/c10a to d4/d23/dc9/c13b 0 2024-04-01T06:57:46.370 INFO:tasks.workunit.client.0.smithi083.stdout:6/882: creat d9/dc/d1b/d35/d48/f12b x:0 0 0 2024-04-01T06:57:46.373 INFO:tasks.workunit.client.0.smithi083.stdout:6/883: mkdir d9/dc/d1b/d39/d68/d12c 0 2024-04-01T06:57:46.373 INFO:tasks.workunit.client.0.smithi083.stdout:5/945: dread d4/d9/d16/d19/f78 [0,4194304] 0 2024-04-01T06:57:46.374 INFO:tasks.workunit.client.0.smithi083.stdout:6/884: creat d9/d57/dbd/f12d x:0 0 0 2024-04-01T06:57:46.374 INFO:tasks.workunit.client.0.smithi083.stdout:6/885: fdatasync d9/dc/d1b/d35/d48/d52/fea 0 2024-04-01T06:57:46.374 INFO:tasks.workunit.client.0.smithi083.stdout:6/886: readlink d9/dc/d29/d3c/d5c/d8b/l94 0 2024-04-01T06:57:46.374 INFO:tasks.workunit.client.0.smithi083.stdout:5/946: truncate d4/d71/d7d/fd3 2133253 0 2024-04-01T06:57:46.375 INFO:tasks.workunit.client.0.smithi083.stdout:6/887: mknod d9/dc/d9d/c12e 0 2024-04-01T06:57:46.376 INFO:tasks.workunit.client.0.smithi083.stdout:2/965: dwrite d3/d71/d90/db6/dcd/dfd/d5e/f9a [0,4194304] 0 2024-04-01T06:57:46.377 INFO:tasks.workunit.client.0.smithi083.stdout:5/947: mkdir d4/d9/d16/dc1/da0/df7/d13c 0 2024-04-01T06:57:46.377 INFO:tasks.workunit.client.0.smithi083.stdout:5/948: stat d4/d9/d16/dc1/da0/dab/c128 0 2024-04-01T06:57:46.378 INFO:tasks.workunit.client.0.smithi083.stdout:2/966: mkdir d3/d20/d42/d143 0 2024-04-01T06:57:46.379 INFO:tasks.workunit.client.0.smithi083.stdout:5/949: mkdir d4/d9/d16/dc1/d121/d13d 0 2024-04-01T06:57:46.379 INFO:tasks.workunit.client.0.smithi083.stdout:5/950: dread - d4/d9/d16/dc1/da0/dab/f133 zero size 2024-04-01T06:57:46.380 INFO:tasks.workunit.client.0.smithi083.stdout:5/951: write d4/d55/fbf [1726920,92917] 0 2024-04-01T06:57:46.382 INFO:tasks.workunit.client.0.smithi083.stdout:5/952: write d4/d9/d16/d9f/dc7/ffc [727218,92261] 0 2024-04-01T06:57:46.385 INFO:tasks.workunit.client.0.smithi083.stdout:2/967: dread d3/fbf [0,4194304] 0 2024-04-01T06:57:46.385 INFO:tasks.workunit.client.0.smithi083.stdout:6/888: dwrite d9/dc/d1b/d39/d68/d108/f117 [0,4194304] 0 2024-04-01T06:57:46.387 INFO:tasks.workunit.client.0.smithi083.stdout:6/889: write d9/dc/d1b/d39/d68/d108/f117 [2331776,69405] 0 2024-04-01T06:57:46.387 INFO:tasks.workunit.client.0.smithi083.stdout:5/953: rmdir d4/d9/d16/d19/d5e/d113 39 2024-04-01T06:57:46.387 INFO:tasks.workunit.client.0.smithi083.stdout:5/954: write d4/d71/fce [596252,8668] 0 2024-04-01T06:57:46.389 INFO:tasks.workunit.client.0.smithi083.stdout:2/968: unlink d3/d26/d59/d27/f3b 0 2024-04-01T06:57:46.389 INFO:tasks.workunit.client.0.smithi083.stdout:2/969: write d3/d26/d59/d2b/d9d/f104 [459568,22638] 0 2024-04-01T06:57:46.390 INFO:tasks.workunit.client.0.smithi083.stdout:6/890: creat d9/dc/d29/d3c/d45/dc4/dcb/f12f x:0 0 0 2024-04-01T06:57:46.391 INFO:tasks.workunit.client.0.smithi083.stdout:5/955: creat d4/d9/d16/d1f/d2f/dc4/f13e x:0 0 0 2024-04-01T06:57:46.392 INFO:tasks.workunit.client.0.smithi083.stdout:6/891: symlink d9/dc/d1b/d39/d68/d108/l130 0 2024-04-01T06:57:46.394 INFO:tasks.workunit.client.0.smithi083.stdout:5/956: link d4/d9/d16/d9f/dc7/d68/df2/f111 d4/d23/dfb/f13f 0 2024-04-01T06:57:46.394 INFO:tasks.workunit.client.0.smithi083.stdout:5/957: stat d4/d23/d49/c6b 0 2024-04-01T06:57:46.394 INFO:tasks.workunit.client.0.smithi083.stdout:5/958: readlink d4/d9/d16/d9f/dc7/d68/l91 0 2024-04-01T06:57:46.397 INFO:tasks.workunit.client.0.smithi083.stdout:5/959: truncate d4/d71/f97 380523 0 2024-04-01T06:57:46.397 INFO:tasks.workunit.client.0.smithi083.stdout:5/960: fsync d4/d71/f7a 0 2024-04-01T06:57:46.397 INFO:tasks.workunit.client.0.smithi083.stdout:2/970: dread d3/d26/d59/daf/fc7 [0,4194304] 0 2024-04-01T06:57:46.400 INFO:tasks.workunit.client.0.smithi083.stdout:2/971: mkdir d3/d71/d90/db6/dcd/dfd/d66/dc1/d131/d144 0 2024-04-01T06:57:46.408 INFO:tasks.workunit.client.0.smithi083.stdout:6/892: dwrite d9/dc/d29/f6b [0,4194304] 0 2024-04-01T06:57:46.410 INFO:tasks.workunit.client.0.smithi083.stdout:2/972: dwrite d3/fe7 [0,4194304] 0 2024-04-01T06:57:46.413 INFO:tasks.workunit.client.0.smithi083.stdout:2/973: getdents d3/d71/d90/db6/dcd/dfd/d66/dc1 0 2024-04-01T06:57:46.413 INFO:tasks.workunit.client.0.smithi083.stdout:2/974: fdatasync d3/d71/d90/db6/dcd/dfd/d5e/f119 0 2024-04-01T06:57:46.413 INFO:tasks.workunit.client.0.smithi083.stdout:2/975: chown d3/l85 42999 1 2024-04-01T06:57:46.413 INFO:tasks.workunit.client.0.smithi083.stdout:2/976: chown d3/d26/d59/c35 0 1 2024-04-01T06:57:46.413 INFO:tasks.workunit.client.0.smithi083.stdout:2/977: fsync d3/d26/f89 0 2024-04-01T06:57:46.413 INFO:tasks.workunit.client.0.smithi083.stdout:5/961: dwrite d4/fb7 [4194304,4194304] 0 2024-04-01T06:57:46.413 INFO:tasks.workunit.client.0.smithi083.stdout:5/962: stat d4/d9/d16/dc1/da0/dab/c128 0 2024-04-01T06:57:46.415 INFO:tasks.workunit.client.0.smithi083.stdout:6/893: write d9/dc/d1b/d35/d48/d52/f54 [399203,61510] 0 2024-04-01T06:57:46.415 INFO:tasks.workunit.client.0.smithi083.stdout:6/894: readlink d9/dc/d1b/d39/l6a 0 2024-04-01T06:57:46.416 INFO:tasks.workunit.client.0.smithi083.stdout:2/978: link d3/d4d/d5d/f142 d3/d20/d42/dee/f145 0 2024-04-01T06:57:46.416 INFO:tasks.workunit.client.0.smithi083.stdout:2/979: stat d3/d71/d90/db6/dcd/dfd/d66/dc1/d131 0 2024-04-01T06:57:46.416 INFO:tasks.workunit.client.0.smithi083.stdout:2/980: dread - d3/d71/d81/ffb zero size 2024-04-01T06:57:46.416 INFO:tasks.workunit.client.0.smithi083.stdout:2/981: chown d3/de1 7975480 1 2024-04-01T06:57:46.417 INFO:tasks.workunit.client.0.smithi083.stdout:6/895: symlink d9/d57/d5f/l131 0 2024-04-01T06:57:46.418 INFO:tasks.workunit.client.0.smithi083.stdout:2/982: link d3/d4d/d57/f6a d3/d71/d90/db6/dcd/dfd/d66/d12c/f146 0 2024-04-01T06:57:46.420 INFO:tasks.workunit.client.0.smithi083.stdout:6/896: mkdir d9/dc/d1b/d39/d47/d132 0 2024-04-01T06:57:46.420 INFO:tasks.workunit.client.0.smithi083.stdout:6/897: chown d9/d57/d5f/fd6 471 1 2024-04-01T06:57:46.420 INFO:tasks.workunit.client.0.smithi083.stdout:6/898: write d9/d57/d5f/df9/f10a [81135,34786] 0 2024-04-01T06:57:46.420 INFO:tasks.workunit.client.0.smithi083.stdout:6/899: truncate d9/dc/d9f/fee 1241812 0 2024-04-01T06:57:46.421 INFO:tasks.workunit.client.0.smithi083.stdout:2/983: mknod d3/d8b/dd6/c147 0 2024-04-01T06:57:46.431 INFO:tasks.workunit.client.0.smithi083.stdout:5/963: dwrite d4/f1b [0,4194304] 0 2024-04-01T06:57:46.431 INFO:tasks.workunit.client.0.smithi083.stdout:5/964: chown d4/d71/d7d/l10d 708294745 1 2024-04-01T06:57:46.437 INFO:tasks.workunit.client.0.smithi083.stdout:5/965: dread d4/d55/f7c [0,4194304] 0 2024-04-01T06:57:46.437 INFO:tasks.workunit.client.0.smithi083.stdout:6/900: dwrite d9/dc/d9d/f10b [0,4194304] 0 2024-04-01T06:57:46.444 INFO:tasks.workunit.client.0.smithi083.stdout:2/984: dwrite d3/d26/fe0 [0,4194304] 0 2024-04-01T06:57:46.444 INFO:tasks.workunit.client.0.smithi083.stdout:2/985: read - d3/d4d/d57/df2/f11a zero size 2024-04-01T06:57:46.444 INFO:tasks.workunit.client.0.smithi083.stdout:2/986: readlink d3/d71/d90/db6/dcd/dfd/d66/lb4 0 2024-04-01T06:57:46.447 INFO:tasks.workunit.client.0.smithi083.stdout:5/966: creat d4/d23/d67/de3/f140 x:0 0 0 2024-04-01T06:57:46.447 INFO:tasks.workunit.client.0.smithi083.stdout:5/967: chown d4/d23/d4e/d83/f131 102534 1 2024-04-01T06:57:46.447 INFO:tasks.workunit.client.0.smithi083.stdout:5/968: write d4/d9/d16/d19/d5e/d110/f122 [1132480,41393] 0 2024-04-01T06:57:46.447 INFO:tasks.workunit.client.0.smithi083.stdout:5/969: write d4/d9/d16/d19/fcf [245690,122765] 0 2024-04-01T06:57:46.448 INFO:tasks.workunit.client.0.smithi083.stdout:6/901: stat d9/dc/d29/d3c/d5c/lfc 0 2024-04-01T06:57:46.451 INFO:tasks.workunit.client.0.smithi083.stdout:5/970: getdents d4/d9/d16/d9f 0 2024-04-01T06:57:46.451 INFO:tasks.workunit.client.0.smithi083.stdout:5/971: write d4/d9/d16/dc1/da0/df7/f11f [687448,79554] 0 2024-04-01T06:57:46.456 INFO:tasks.workunit.client.0.smithi083.stdout:5/972: creat d4/d9/d16/d1f/d2f/d53/dbb/dee/f141 x:0 0 0 2024-04-01T06:57:46.456 INFO:tasks.workunit.client.0.smithi083.stdout:5/973: read - d4/d23/f126 zero size 2024-04-01T06:57:46.456 INFO:tasks.workunit.client.0.smithi083.stdout:5/974: dread - d4/d9/d16/d1f/d2f/dc4/f13e zero size 2024-04-01T06:57:46.457 INFO:tasks.workunit.client.0.smithi083.stdout:5/975: fdatasync d4/d71/d7d/fd3 0 2024-04-01T06:57:46.458 INFO:tasks.workunit.client.0.smithi083.stdout:5/976: mknod d4/d23/dc9/c142 0 2024-04-01T06:57:46.458 INFO:tasks.workunit.client.0.smithi083.stdout:5/977: fdatasync d4/d9/d16/d19/f78 0 2024-04-01T06:57:46.459 INFO:tasks.workunit.client.0.smithi083.stdout:2/987: truncate d3/d26/d59/d2b/d9d/f104 324349 0 2024-04-01T06:57:46.459 INFO:tasks.workunit.client.0.smithi083.stdout:6/902: dread d9/dc/d1b/d35/fb5 [0,4194304] 0 2024-04-01T06:57:46.459 INFO:tasks.workunit.client.0.smithi083.stdout:2/988: chown d3/de1/df5/dae 1 1 2024-04-01T06:57:46.460 INFO:tasks.workunit.client.0.smithi083.stdout:5/978: creat d4/d9/d16/dc1/da0/df7/f143 x:0 0 0 2024-04-01T06:57:46.460 INFO:tasks.workunit.client.0.smithi083.stdout:2/989: creat d3/d26/d59/d2b/d9f/f148 x:0 0 0 2024-04-01T06:57:46.461 INFO:tasks.workunit.client.0.smithi083.stdout:6/903: creat d9/dc/d1b/d39/f133 x:0 0 0 2024-04-01T06:57:46.462 INFO:tasks.workunit.client.0.smithi083.stdout:5/979: mkdir d4/d23/d4e/d144 0 2024-04-01T06:57:46.462 INFO:tasks.workunit.client.0.smithi083.stdout:5/980: chown d4/d9/d16/l8f 2218 1 2024-04-01T06:57:46.463 INFO:tasks.workunit.client.0.smithi083.stdout:2/990: creat d3/d71/d90/db6/dcd/dfd/d66/dc1/d131/d144/f149 x:0 0 0 2024-04-01T06:57:46.464 INFO:tasks.workunit.client.0.smithi083.stdout:6/904: mkdir d9/dc/d1b/d35/d48/d52/d9c/dab/d134 0 2024-04-01T06:57:46.466 INFO:tasks.workunit.client.0.smithi083.stdout:6/905: creat d9/d57/f135 x:0 0 0 2024-04-01T06:57:46.466 INFO:tasks.workunit.client.0.smithi083.stdout:6/906: fdatasync d9/dc/d29/d3c/d5c/f84 0 2024-04-01T06:57:46.475 INFO:tasks.workunit.client.0.smithi083.stdout:2/991: dwrite d3/d71/d90/db6/dcd/dfd/d66/dc1/fdc [0,4194304] 0 2024-04-01T06:57:46.477 INFO:tasks.workunit.client.0.smithi083.stdout:2/992: symlink d3/d26/d59/d27/d79/de9/l14a 0 2024-04-01T06:57:46.477 INFO:tasks.workunit.client.0.smithi083.stdout:2/993: chown d3/fc 124563003 1 2024-04-01T06:57:46.478 INFO:tasks.workunit.client.0.smithi083.stdout:2/994: write d3/d26/d59/d2b/d9d/f104 [39132,77576] 0 2024-04-01T06:57:46.479 INFO:tasks.workunit.client.0.smithi083.stdout:5/981: dwrite d4/d23/d4e/d83/f131 [0,4194304] 0 2024-04-01T06:57:46.479 INFO:tasks.workunit.client.0.smithi083.stdout:5/982: chown d4/d9/d16/d1f/d2f 959782916 1 2024-04-01T06:57:46.479 INFO:tasks.workunit.client.0.smithi083.stdout:2/995: mkdir d3/d8b/dea/d14b 0 2024-04-01T06:57:46.482 INFO:tasks.workunit.client.0.smithi083.stdout:6/907: dwrite d9/dc/d1b/d35/d48/d52/d9c/dab/fad [0,4194304] 0 2024-04-01T06:57:46.486 INFO:tasks.workunit.client.0.smithi083.stdout:6/908: rmdir d9/dc/d29/d3c/d45/dc4/dcb/dce 39 2024-04-01T06:57:46.486 INFO:tasks.workunit.client.0.smithi083.stdout:6/909: fsync d9/dc/f65 0 2024-04-01T06:57:46.499 INFO:tasks.workunit.client.0.smithi083.stdout:7/849: sync 2024-04-01T06:57:46.500 INFO:tasks.workunit.client.0.smithi083.stdout:5/983: dwrite d4/d71/fae [0,4194304] 0 2024-04-01T06:57:46.500 INFO:tasks.workunit.client.0.smithi083.stdout:7/850: rename d0/d4/d9/f22 to d0/d4/d9/d39/d67/dc0/f123 0 2024-04-01T06:57:46.501 INFO:tasks.workunit.client.0.smithi083.stdout:5/984: read d4/d9/d16/d1f/f82 [1738097,79790] 0 2024-04-01T06:57:46.501 INFO:tasks.workunit.client.0.smithi083.stdout:7/851: write d0/d4/d9/d39/d67/d6d/d87/d83/f3c [2534239,79706] 0 2024-04-01T06:57:46.503 INFO:tasks.workunit.client.0.smithi083.stdout:6/910: dwrite d9/dc/d1b/fba [0,4194304] 0 2024-04-01T06:57:46.503 INFO:tasks.workunit.client.0.smithi083.stdout:7/852: dread d0/d4/d9/d39/d67/d6d/d87/d83/d38/dbf/de7/ff9 [0,4194304] 0 2024-04-01T06:57:46.504 INFO:tasks.workunit.client.0.smithi083.stdout:7/853: fdatasync d0/ff1 0 2024-04-01T06:57:46.505 INFO:tasks.workunit.client.0.smithi083.stdout:6/911: creat d9/dc/d29/d3c/d45/dc4/dd2/d11a/f136 x:0 0 0 2024-04-01T06:57:46.505 INFO:tasks.workunit.client.0.smithi083.stdout:7/854: dread d0/d4/d9/d39/d67/d6d/d87/d83/d38/f4f [0,4194304] 0 2024-04-01T06:57:46.506 INFO:tasks.workunit.client.0.smithi083.stdout:6/912: unlink d9/dc/d1b/d35/d48/l53 0 2024-04-01T06:57:46.508 INFO:tasks.workunit.client.0.smithi083.stdout:5/985: rename d4/d9/d16/d9f/dc7 to d4/d9/d16/dc1/d121/d145 0 2024-04-01T06:57:46.515 INFO:tasks.workunit.client.0.smithi083.stdout:7/855: dwrite d0/d4/dbd/db2/ff0 [0,4194304] 0 2024-04-01T06:57:46.515 INFO:tasks.workunit.client.0.smithi083.stdout:7/856: read - d0/d4/d9/d39/fae zero size 2024-04-01T06:57:46.517 INFO:tasks.workunit.client.0.smithi083.stdout:5/986: dread d4/d9/d16/d1f/f82 [0,4194304] 0 2024-04-01T06:57:46.519 INFO:tasks.workunit.client.0.smithi083.stdout:6/913: dwrite d9/dc/d29/d3c/d45/dc4/ffa [0,4194304] 0 2024-04-01T06:57:46.519 INFO:tasks.workunit.client.0.smithi083.stdout:5/987: mkdir d4/d9/d16/d1f/d2f/dc4/d146 0 2024-04-01T06:57:46.519 INFO:tasks.workunit.client.0.smithi083.stdout:6/914: read d9/dc/f25 [99426,112335] 0 2024-04-01T06:57:46.521 INFO:tasks.workunit.client.0.smithi083.stdout:5/988: rename d4/d9/d16/d19/d5e/d110/f11c to d4/d9/d16/d1f/d2f/dc4/f147 0 2024-04-01T06:57:46.521 INFO:tasks.workunit.client.0.smithi083.stdout:5/989: read d4/d71/f97 [226179,65761] 0 2024-04-01T06:57:46.522 INFO:tasks.workunit.client.0.smithi083.stdout:6/915: unlink d9/dc/d3b/l9a 0 2024-04-01T06:57:46.524 INFO:tasks.workunit.client.0.smithi083.stdout:5/990: dread d4/d71/d94/f139 [0,4194304] 0 2024-04-01T06:57:46.526 INFO:tasks.workunit.client.0.smithi083.stdout:5/991: link d4/d23/d4e/c100 d4/d71/c148 0 2024-04-01T06:57:46.526 INFO:tasks.workunit.client.0.smithi083.stdout:5/992: chown d4/d9/d16/dc1/d121/d145/d96/db2 0 1 2024-04-01T06:57:46.526 INFO:tasks.workunit.client.0.smithi083.stdout:5/993: write d4/d9/d16/dc1/ff9 [2319618,62656] 0 2024-04-01T06:57:46.526 INFO:tasks.workunit.client.0.smithi083.stdout:5/994: readlink d4/d9/d16/d19/d5e/d113/d21/le5 0 2024-04-01T06:57:46.527 INFO:tasks.workunit.client.0.smithi083.stdout:5/995: symlink d4/d9/d16/dc1/d121/d145/d96/db2/l149 0 2024-04-01T06:57:46.530 INFO:tasks.workunit.client.0.smithi083.stdout:6/916: rmdir d9/dc/d3b 39 2024-04-01T06:57:46.530 INFO:tasks.workunit.client.0.smithi083.stdout:6/917: mkdir d9/dc/d9d/d137 0 2024-04-01T06:57:46.532 INFO:tasks.workunit.client.0.smithi083.stdout:5/996: getdents d4/d9/d16/dc1/d121/d145/d96/db2 0 2024-04-01T06:57:46.532 INFO:tasks.workunit.client.0.smithi083.stdout:5/997: write d4/d9/d16/dc1/d121/d145/d68/df2/f111 [377356,1417] 0 2024-04-01T06:57:46.534 INFO:tasks.workunit.client.0.smithi083.stdout:5/998: creat d4/d9/d16/d1f/d2f/d53/dbb/dee/f14a x:0 0 0 2024-04-01T06:57:46.536 INFO:tasks.workunit.client.0.smithi083.stdout:5/999: link d4/d55/lba d4/d23/d67/de3/l14b 0 2024-04-01T06:57:46.539 INFO:tasks.workunit.client.0.smithi083.stdout:6/918: dwrite d9/dc/d29/d3c/d45/dc4/dd2/feb [0,4194304] 0 2024-04-01T06:57:46.549 INFO:tasks.workunit.client.0.smithi083.stdout:6/919: dwrite d9/dc/d1b/d35/d48/d52/d9c/fc0 [0,4194304] 0 2024-04-01T06:57:46.549 INFO:tasks.workunit.client.0.smithi083.stdout:6/920: write d9/dc/d29/d3c/d5c/fdd [162673,127503] 0 2024-04-01T06:57:46.551 INFO:tasks.workunit.client.0.smithi083.stdout:6/921: creat d9/dc/d1b/df6/dfe/f138 x:0 0 0 2024-04-01T06:57:46.553 INFO:tasks.workunit.client.0.smithi083.stdout:6/922: creat d9/dc/d9f/de2/df5/f139 x:0 0 0 2024-04-01T06:57:46.556 INFO:tasks.workunit.client.0.smithi083.stdout:6/923: truncate d9/dc/f23 2503458 0 2024-04-01T06:57:46.556 INFO:tasks.workunit.client.0.smithi083.stdout:6/924: readlink d9/dc/l55 0 2024-04-01T06:57:46.557 INFO:tasks.workunit.client.0.smithi083.stdout:6/925: mkdir d9/dc/d29/d3c/d5c/d8b/d13a 0 2024-04-01T06:57:46.557 INFO:tasks.workunit.client.0.smithi083.stdout:6/926: fdatasync d9/d8a/faa 0 2024-04-01T06:57:46.558 INFO:tasks.workunit.client.0.smithi083.stdout:6/927: creat d9/dc/d9f/de2/df5/f13b x:0 0 0 2024-04-01T06:57:46.560 INFO:tasks.workunit.client.0.smithi083.stdout:6/928: mknod d9/dc/d9f/de2/c13c 0 2024-04-01T06:57:46.560 INFO:tasks.workunit.client.0.smithi083.stdout:6/929: fdatasync d9/dc/d1b/d35/f64 0 2024-04-01T06:57:46.561 INFO:tasks.workunit.client.0.smithi083.stdout:6/930: link d9/f106 d9/dc/d29/d3c/d45/dc4/dd2/f13d 0 2024-04-01T06:57:46.565 INFO:tasks.workunit.client.0.smithi083.stdout:6/931: dread d9/d57/f5e [0,4194304] 0 2024-04-01T06:57:46.579 INFO:tasks.workunit.client.0.smithi083.stdout:6/932: dwrite d9/d57/d5f/f120 [0,4194304] 0 2024-04-01T06:57:46.585 INFO:tasks.workunit.client.0.smithi083.stdout:6/933: symlink d9/dc/d1b/d39/d47/d132/l13e 0 2024-04-01T06:57:46.586 INFO:tasks.workunit.client.0.smithi083.stdout:6/934: creat d9/dc/d1b/d39/d68/f13f x:0 0 0 2024-04-01T06:57:46.587 INFO:tasks.workunit.client.0.smithi083.stdout:6/935: write d9/dc/f30 [10025615,52015] 0 2024-04-01T06:57:46.588 INFO:tasks.workunit.client.0.smithi083.stdout:6/936: creat d9/dc/d9f/de2/df5/f140 x:0 0 0 2024-04-01T06:57:46.588 INFO:tasks.workunit.client.0.smithi083.stdout:6/937: write d9/d8a/fcc [284363,22828] 0 2024-04-01T06:57:46.589 INFO:tasks.workunit.client.0.smithi083.stdout:6/938: mkdir d9/dc/d1b/df6/dfe/d141 0 2024-04-01T06:57:46.590 INFO:tasks.workunit.client.0.smithi083.stdout:6/939: write d9/dc/d1b/d39/d47/f69 [396995,109424] 0 2024-04-01T06:57:46.593 INFO:tasks.workunit.client.0.smithi083.stdout:6/940: symlink d9/d57/l142 0 2024-04-01T06:57:46.593 INFO:tasks.workunit.client.0.smithi083.stdout:6/941: fsync d9/dc/d29/d3c/faf 0 2024-04-01T06:57:46.593 INFO:tasks.workunit.client.0.smithi083.stdout:6/942: chown d9/dc/d9f/de2/df5/f107 1398 1 2024-04-01T06:57:46.608 INFO:tasks.workunit.client.0.smithi083.stdout:6/943: dwrite d9/d57/d5f/f76 [0,4194304] 0 2024-04-01T06:57:46.610 INFO:tasks.workunit.client.0.smithi083.stdout:6/944: getdents d9/d8a 0 2024-04-01T06:57:46.614 INFO:tasks.workunit.client.0.smithi083.stdout:6/945: getdents d9/dc/d1b/d35/de0 0 2024-04-01T06:57:46.616 INFO:tasks.workunit.client.0.smithi083.stdout:6/946: creat d9/dc/d29/d3c/d10d/f143 x:0 0 0 2024-04-01T06:57:46.629 INFO:tasks.workunit.client.0.smithi083.stdout:4/911: sync 2024-04-01T06:57:46.629 INFO:tasks.workunit.client.0.smithi083.stdout:4/912: write d1/d4/db/f20 [4277347,16169] 0 2024-04-01T06:57:46.629 INFO:tasks.workunit.client.0.smithi083.stdout:4/913: fsync d1/d4/f7e 0 2024-04-01T06:57:46.630 INFO:tasks.workunit.client.0.smithi083.stdout:4/914: symlink d1/d47/d90/d113/l123 0 2024-04-01T06:57:46.631 INFO:tasks.workunit.client.0.smithi083.stdout:4/915: write d1/d47/d90/f97 [470524,57084] 0 2024-04-01T06:57:46.631 INFO:tasks.workunit.client.0.smithi083.stdout:4/916: rename d1 to d1/d4/db8/ded/de8/d88/da8/d111/d124 22 2024-04-01T06:57:46.633 INFO:tasks.workunit.client.0.smithi083.stdout:6/947: dwrite d9/dc/d29/d3c/d5c/f111 [0,4194304] 0 2024-04-01T06:57:46.633 INFO:tasks.workunit.client.0.smithi083.stdout:4/917: mknod d1/d4/db8/c125 0 2024-04-01T06:57:46.636 INFO:tasks.workunit.client.0.smithi083.stdout:4/918: unlink d1/d4/db8/ded/de8/dd5/de9/d89/f121 0 2024-04-01T06:57:46.636 INFO:tasks.workunit.client.0.smithi083.stdout:4/919: chown d1/d4/db8/ded/de8/d88/da8/df8 2750 1 2024-04-01T06:57:46.637 INFO:tasks.workunit.client.0.smithi083.stdout:6/948: symlink d9/dc/d1b/d35/l144 0 2024-04-01T06:57:46.637 INFO:tasks.workunit.client.0.smithi083.stdout:6/949: fdatasync d9/dc/d1b/d39/d68/fca 0 2024-04-01T06:57:46.638 INFO:tasks.workunit.client.0.smithi083.stdout:6/950: creat d9/dc/d1b/d35/d48/d52/d9c/dab/d134/f145 x:0 0 0 2024-04-01T06:57:46.641 INFO:tasks.workunit.client.0.smithi083.stdout:4/920: dread d1/d47/d2a/fcf [0,4194304] 0 2024-04-01T06:57:46.643 INFO:tasks.workunit.client.0.smithi083.stdout:6/951: unlink d9/dc/d29/d3c/d5c/fdd 0 2024-04-01T06:57:46.643 INFO:tasks.workunit.client.0.smithi083.stdout:6/952: chown d9/dc/d29/f6b 6299 1 2024-04-01T06:57:46.644 INFO:tasks.workunit.client.0.smithi083.stdout:6/953: mknod d9/dc/d1b/d35/d48/d52/d9c/dab/d134/c146 0 2024-04-01T06:57:46.645 INFO:tasks.workunit.client.0.smithi083.stdout:6/954: creat d9/dc/d29/d3c/d45/dc4/dd2/f147 x:0 0 0 2024-04-01T06:57:46.646 INFO:tasks.workunit.client.0.smithi083.stdout:6/955: rmdir d9/dc/d1b/df6/dfe/d118 0 2024-04-01T06:57:46.648 INFO:tasks.workunit.client.0.smithi083.stdout:6/956: getdents d9/dc/d1b/d39/d68/d108 0 2024-04-01T06:57:46.650 INFO:tasks.workunit.client.0.smithi083.stdout:6/957: rename d9/dc/d1b/d35/d48/f12b to d9/dc/d1b/d73/f148 0 2024-04-01T06:57:46.650 INFO:tasks.workunit.client.0.smithi083.stdout:6/958: truncate d9/d57/f135 746641 0 2024-04-01T06:57:46.652 INFO:tasks.workunit.client.0.smithi083.stdout:6/959: creat d9/dc/d1b/f149 x:0 0 0 2024-04-01T06:57:46.657 INFO:tasks.workunit.client.0.smithi083.stdout:4/921: dwrite d1/d4/db8/ded/de8/dd5/de9/f92 [4194304,4194304] 0 2024-04-01T06:57:46.657 INFO:tasks.workunit.client.0.smithi083.stdout:4/922: chown d1/d4/db/d5b/d62/dbd/l11d 186644373 1 2024-04-01T06:57:46.665 INFO:tasks.workunit.client.0.smithi083.stdout:6/960: dwrite d9/dc/d9f/de2/df5/f107 [0,4194304] 0 2024-04-01T06:57:46.666 INFO:tasks.workunit.client.0.smithi083.stdout:2/996: sync 2024-04-01T06:57:46.666 INFO:tasks.workunit.client.0.smithi083.stdout:7/857: sync 2024-04-01T06:57:46.666 INFO:tasks.workunit.client.0.smithi083.stdout:2/997: chown d3/d26/d59/c35 2075081244 1 2024-04-01T06:57:46.666 INFO:tasks.workunit.client.0.smithi083.stdout:4/923: dread d1/d4/db/f20 [0,4194304] 0 2024-04-01T06:57:46.666 INFO:tasks.workunit.client.0.smithi083.stdout:4/924: write d1/d4/db/d94/daf/dd1/d6a/fc6 [710070,38455] 0 2024-04-01T06:57:46.666 INFO:tasks.workunit.client.0.smithi083.stdout:4/925: stat d1/d4/db8/ded/de8/dd5/de9/d89/f109 0 2024-04-01T06:57:46.667 INFO:tasks.workunit.client.0.smithi083.stdout:6/961: rename d9/dc/d9f/de2/df5/f139 to d9/dc/d29/d3c/d5c/d8b/d13a/f14a 0 2024-04-01T06:57:46.669 INFO:tasks.workunit.client.0.smithi083.stdout:2/998: rmdir d3/d71/df9 39 2024-04-01T06:57:46.669 INFO:tasks.workunit.client.0.smithi083.stdout:7/858: dread d0/d4/ff [0,4194304] 0 2024-04-01T06:57:46.670 INFO:tasks.workunit.client.0.smithi083.stdout:4/926: rmdir d1/da5/dae/dd2 39 2024-04-01T06:57:46.671 INFO:tasks.workunit.client.0.smithi083.stdout:6/962: mkdir d9/dc/d1b/d35/d48/d52/d14b 0 2024-04-01T06:57:46.671 INFO:tasks.workunit.client.0.smithi083.stdout:6/963: readlink d9/d57/lc3 0 2024-04-01T06:57:46.672 INFO:tasks.workunit.client.0.smithi083.stdout:6/964: write d9/dc/d29/fa8 [93652,65197] 0 2024-04-01T06:57:46.672 INFO:tasks.workunit.client.0.smithi083.stdout:2/999: creat d3/d26/d59/d27/f14c x:0 0 0 2024-04-01T06:57:46.673 INFO:tasks.workunit.client.0.smithi083.stdout:7/859: mkdir d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/de5/d124 0 2024-04-01T06:57:46.674 INFO:tasks.workunit.client.0.smithi083.stdout:4/927: creat d1/d4/db8/ded/d79/f126 x:0 0 0 2024-04-01T06:57:46.675 INFO:tasks.workunit.client.0.smithi083.stdout:6/965: symlink d9/dc/d1b/d35/d48/d52/d9c/l14c 0 2024-04-01T06:57:46.676 INFO:tasks.workunit.client.0.smithi083.stdout:4/928: write d1/d4/db/d94/daf/dd1/f5e [3556425,22007] 0 2024-04-01T06:57:46.677 INFO:tasks.workunit.client.0.smithi083.stdout:6/966: dread d9/dc/d1b/d39/d68/fb8 [0,4194304] 0 2024-04-01T06:57:46.677 INFO:tasks.workunit.client.0.smithi083.stdout:6/967: fdatasync d9/dc/d9f/de2/df5/f107 0 2024-04-01T06:57:46.677 INFO:tasks.workunit.client.0.smithi083.stdout:4/929: mkdir d1/d4/db8/ded/de8/d88/da8/d127 0 2024-04-01T06:57:46.679 INFO:tasks.workunit.client.0.smithi083.stdout:4/930: dread d1/d47/d2a/f2f [0,4194304] 0 2024-04-01T06:57:46.690 INFO:tasks.workunit.client.0.smithi083.stdout:6/968: dwrite d9/dc/f7e [0,4194304] 0 2024-04-01T06:57:46.691 INFO:tasks.workunit.client.0.smithi083.stdout:6/969: stat d9/dc/d1b/d39/d68/f75 0 2024-04-01T06:57:46.693 INFO:tasks.workunit.client.0.smithi083.stdout:4/931: dwrite d1/d4/d6e/f115 [0,4194304] 0 2024-04-01T06:57:46.700 INFO:tasks.workunit.client.0.smithi083.stdout:4/932: dread d1/d47/d2a/db5/fb7 [0,4194304] 0 2024-04-01T06:57:46.702 INFO:tasks.workunit.client.0.smithi083.stdout:4/933: write d1/d4/db/f54 [3907701,17687] 0 2024-04-01T06:57:46.702 INFO:tasks.workunit.client.0.smithi083.stdout:6/970: dread d9/dc/d1b/fba [0,4194304] 0 2024-04-01T06:57:46.702 INFO:tasks.workunit.client.0.smithi083.stdout:6/971: chown d9/dc/d1b/d35/d48/d52/d9c/da9 470 1 2024-04-01T06:57:46.702 INFO:tasks.workunit.client.0.smithi083.stdout:6/972: read - d9/dc/d1b/d73/f148 zero size 2024-04-01T06:57:46.703 INFO:tasks.workunit.client.0.smithi083.stdout:4/934: mkdir d1/d47/d2a/d122/d128 0 2024-04-01T06:57:46.703 INFO:tasks.workunit.client.0.smithi083.stdout:4/935: write d1/d4/db8/ded/de8/dd5/de9/d89/f109 [956696,93829] 0 2024-04-01T06:57:46.703 INFO:tasks.workunit.client.0.smithi083.stdout:4/936: chown d1/d47 1 1 2024-04-01T06:57:46.703 INFO:tasks.workunit.client.0.smithi083.stdout:4/937: dread - d1/d4/db8/ded/de8/dd5/de9/f11b zero size 2024-04-01T06:57:46.704 INFO:tasks.workunit.client.0.smithi083.stdout:4/938: write d1/d4/db/d5b/f69 [3121092,97915] 0 2024-04-01T06:57:46.704 INFO:tasks.workunit.client.0.smithi083.stdout:6/973: getdents d9 0 2024-04-01T06:57:46.705 INFO:tasks.workunit.client.0.smithi083.stdout:4/939: rename d1/d4/db/c44 to d1/da5/dfc/d10b/c129 0 2024-04-01T06:57:46.707 INFO:tasks.workunit.client.0.smithi083.stdout:6/974: mkdir d9/dc/d29/d3c/d5c/d8b/d14d 0 2024-04-01T06:57:46.708 INFO:tasks.workunit.client.0.smithi083.stdout:4/940: mknod d1/d4/db/d5b/d62/c12a 0 2024-04-01T06:57:46.709 INFO:tasks.workunit.client.0.smithi083.stdout:6/975: mkdir d9/d57/dbd/d14e 0 2024-04-01T06:57:46.709 INFO:tasks.workunit.client.0.smithi083.stdout:4/941: read d1/d47/d2a/f52 [880666,1381] 0 2024-04-01T06:57:46.709 INFO:tasks.workunit.client.0.smithi083.stdout:6/976: creat d9/dc/d1b/d39/f14f x:0 0 0 2024-04-01T06:57:46.711 INFO:tasks.workunit.client.0.smithi083.stdout:4/942: dread d1/d4/db8/fdd [0,4194304] 0 2024-04-01T06:57:46.711 INFO:tasks.workunit.client.0.smithi083.stdout:6/977: dread d9/dc/d1b/d35/d48/d52/d9c/fb6 [0,4194304] 0 2024-04-01T06:57:46.712 INFO:tasks.workunit.client.0.smithi083.stdout:6/978: mknod d9/dc/d29/d3c/d45/dc4/dcb/c150 0 2024-04-01T06:57:46.712 INFO:tasks.workunit.client.0.smithi083.stdout:6/979: stat d9/dc/d1b/d4c/d99/f109 0 2024-04-01T06:57:46.712 INFO:tasks.workunit.client.0.smithi083.stdout:6/980: truncate d9/dc/d9f/fee 1373556 0 2024-04-01T06:57:46.712 INFO:tasks.workunit.client.0.smithi083.stdout:6/981: write d9/dc/d1b/d4c/d99/fc6 [1383226,86423] 0 2024-04-01T06:57:46.713 INFO:tasks.workunit.client.0.smithi083.stdout:6/982: creat d9/dc/d1b/d39/d68/d108/f151 x:0 0 0 2024-04-01T06:57:46.714 INFO:tasks.workunit.client.0.smithi083.stdout:6/983: mknod d9/dc/d29/d3c/d45/dc4/dcb/c152 0 2024-04-01T06:57:46.715 INFO:tasks.workunit.client.0.smithi083.stdout:6/984: mknod d9/dc/c153 0 2024-04-01T06:57:46.717 INFO:tasks.workunit.client.0.smithi083.stdout:4/943: dread d1/d47/d2a/f2e [0,4194304] 0 2024-04-01T06:57:46.718 INFO:tasks.workunit.client.0.smithi083.stdout:4/944: read d1/d4/d6e/f78 [3337126,109208] 0 2024-04-01T06:57:46.719 INFO:tasks.workunit.client.0.smithi083.stdout:4/945: mkdir d1/d4/db/d94/df1/d12b 0 2024-04-01T06:57:46.719 INFO:tasks.workunit.client.0.smithi083.stdout:4/946: mkdir d1/da5/dae/dda/d12c 0 2024-04-01T06:57:46.720 INFO:tasks.workunit.client.0.smithi083.stdout:4/947: write d1/d4/db8/ded/de8/dd5/de9/d89/fdf [1170025,80116] 0 2024-04-01T06:57:46.725 INFO:tasks.workunit.client.0.smithi083.stdout:4/948: rename d1/d4/db8/ded/de8/dd5 to d1/d4/db/d5b/d12d 0 2024-04-01T06:57:46.726 INFO:tasks.workunit.client.0.smithi083.stdout:4/949: creat d1/d4/db/dba/f12e x:0 0 0 2024-04-01T06:57:46.726 INFO:tasks.workunit.client.0.smithi083.stdout:4/950: chown d1/d4/ff6 470373855 1 2024-04-01T06:57:46.727 INFO:tasks.workunit.client.0.smithi083.stdout:4/951: read d1/d4/db/d94/daf/dd1/f5e [1085257,95072] 0 2024-04-01T06:57:46.727 INFO:tasks.workunit.client.0.smithi083.stdout:4/952: write d1/d4/db/d5b/d12d/dbc/dc2/fe7 [1288101,51284] 0 2024-04-01T06:57:46.728 INFO:tasks.workunit.client.0.smithi083.stdout:4/953: creat d1/da5/dae/dda/f12f x:0 0 0 2024-04-01T06:57:46.728 INFO:tasks.workunit.client.0.smithi083.stdout:4/954: stat d1/d4/db/d5b/d12d/de9/l7c 0 2024-04-01T06:57:46.729 INFO:tasks.workunit.client.0.smithi083.stdout:4/955: unlink d1/da5/dae/dd2/cee 0 2024-04-01T06:57:46.730 INFO:tasks.workunit.client.0.smithi083.stdout:4/956: fdatasync d1/d4/db/d94/daf/dd1/fa6 0 2024-04-01T06:57:46.730 INFO:tasks.workunit.client.0.smithi083.stdout:4/957: write d1/d47/d2a/f52 [1907960,26029] 0 2024-04-01T06:57:46.732 INFO:tasks.workunit.client.0.smithi083.stdout:4/958: mkdir d1/d4/db/d130 0 2024-04-01T06:57:46.745 INFO:tasks.workunit.client.0.smithi083.stdout:4/959: dwrite d1/da5/fe5 [0,4194304] 0 2024-04-01T06:57:46.758 INFO:tasks.workunit.client.0.smithi083.stdout:4/960: dwrite d1/d4/db/d5b/d12d/dbc/dc2/fe7 [0,4194304] 0 2024-04-01T06:57:46.759 INFO:tasks.workunit.client.0.smithi083.stdout:4/961: dread d1/d4/db/d5b/d12d/de9/f49 [0,4194304] 0 2024-04-01T06:57:46.759 INFO:tasks.workunit.client.0.smithi083.stdout:4/962: write d1/d4/db8/ded/d79/f126 [152648,35666] 0 2024-04-01T06:57:46.760 INFO:tasks.workunit.client.0.smithi083.stdout:4/963: creat d1/d4/db8/ded/de8/f131 x:0 0 0 2024-04-01T06:57:46.770 INFO:tasks.workunit.client.0.smithi083.stdout:4/964: dwrite d1/d4/db8/ded/f9c [0,4194304] 0 2024-04-01T06:57:46.776 INFO:tasks.workunit.client.0.smithi083.stdout:4/965: dread d1/d4/db/d5b/f5f [0,4194304] 0 2024-04-01T06:57:46.780 INFO:tasks.workunit.client.0.smithi083.stdout:7/860: sync 2024-04-01T06:57:46.782 INFO:tasks.workunit.client.0.smithi083.stdout:7/861: link d0/d4/d9/d39/d67/d6d/c45 d0/d4/d9/d39/d67/d6d/d87/d83/d62/dc6/dec/c125 0 2024-04-01T06:57:46.782 INFO:tasks.workunit.client.0.smithi083.stdout:7/862: truncate d0/ff1 1040669 0 2024-04-01T06:57:46.787 INFO:tasks.workunit.client.0.smithi083.stdout:4/966: dwrite d1/d4/db8/ded/de8/d88/f11f [0,4194304] 0 2024-04-01T06:57:46.800 INFO:tasks.workunit.client.0.smithi083.stdout:4/967: dwrite d1/d4/db/d5b/d12d/de9/f11b [0,4194304] 0 2024-04-01T06:57:46.801 INFO:tasks.workunit.client.0.smithi083.stdout:4/968: write d1/d4/db/d5b/f69 [236992,102555] 0 2024-04-01T06:57:46.802 INFO:tasks.workunit.client.0.smithi083.stdout:4/969: truncate d1/d4/db/f56 121663 0 2024-04-01T06:57:46.803 INFO:tasks.workunit.client.0.smithi083.stdout:4/970: truncate d1/d4/db/d94/daf/dd1/f5e 3553717 0 2024-04-01T06:57:46.815 INFO:tasks.workunit.client.0.smithi083.stdout:6/985: sync 2024-04-01T06:57:46.816 INFO:tasks.workunit.client.0.smithi083.stdout:6/986: write d9/dc/d29/d3c/d45/dc4/dd2/f147 [292641,17937] 0 2024-04-01T06:57:46.816 INFO:tasks.workunit.client.0.smithi083.stdout:6/987: creat d9/dc/d1b/d39/d68/d12c/f154 x:0 0 0 2024-04-01T06:57:46.817 INFO:tasks.workunit.client.0.smithi083.stdout:6/988: truncate d9/dc/d29/f6b 2870007 0 2024-04-01T06:57:46.818 INFO:tasks.workunit.client.0.smithi083.stdout:6/989: dread d9/dc/d3b/fe4 [0,4194304] 0 2024-04-01T06:57:46.818 INFO:tasks.workunit.client.0.smithi083.stdout:6/990: chown d9/dc/d1b/f41 226 1 2024-04-01T06:57:46.818 INFO:tasks.workunit.client.0.smithi083.stdout:6/991: getdents d9/dc/d29/d3c/d5c/d8b/d13a 0 2024-04-01T06:57:46.827 INFO:tasks.workunit.client.0.smithi083.stdout:6/992: dwrite d9/dc/d1b/d35/f51 [0,4194304] 0 2024-04-01T06:57:46.840 INFO:tasks.workunit.client.0.smithi083.stdout:6/993: dwrite d9/dc/d1b/d35/f128 [0,4194304] 0 2024-04-01T06:57:46.840 INFO:tasks.workunit.client.0.smithi083.stdout:6/994: write d9/d8a/faa [333012,27309] 0 2024-04-01T06:57:46.840 INFO:tasks.workunit.client.0.smithi083.stdout:6/995: write d9/d57/dbd/f12d [394130,58186] 0 2024-04-01T06:57:46.841 INFO:tasks.workunit.client.0.smithi083.stdout:6/996: mkdir d9/dc/d3b/d155 0 2024-04-01T06:57:46.842 INFO:tasks.workunit.client.0.smithi083.stdout:6/997: unlink d9/f106 0 2024-04-01T06:57:46.844 INFO:tasks.workunit.client.0.smithi083.stdout:6/998: mkdir d9/dc/d29/d3c/d156 0 2024-04-01T06:57:46.845 INFO:tasks.workunit.client.0.smithi083.stdout:6/999: mkdir d9/dc/d9d/d137/d157 0 2024-04-01T06:57:46.929 INFO:tasks.workunit.client.0.smithi083.stdout:7/863: sync 2024-04-01T06:57:46.929 INFO:tasks.workunit.client.0.smithi083.stdout:4/971: sync 2024-04-01T06:57:46.930 INFO:tasks.workunit.client.0.smithi083.stdout:4/972: write d1/d4/db/f9f [4798343,92057] 0 2024-04-01T06:57:46.930 INFO:tasks.workunit.client.0.smithi083.stdout:7/864: creat d0/d4/d9/d39/d67/dc0/d114/f126 x:0 0 0 2024-04-01T06:57:46.931 INFO:tasks.workunit.client.0.smithi083.stdout:7/865: stat d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/de5/f101 0 2024-04-01T06:57:46.932 INFO:tasks.workunit.client.0.smithi083.stdout:7/866: rmdir d0/d4/d9/d39/d103 0 2024-04-01T06:57:46.933 INFO:tasks.workunit.client.0.smithi083.stdout:7/867: mknod d0/d4/d9/d39/d67/d6d/c127 0 2024-04-01T06:57:46.934 INFO:tasks.workunit.client.0.smithi083.stdout:7/868: write d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/dc7/ff2 [3018825,127395] 0 2024-04-01T06:57:46.935 INFO:tasks.workunit.client.0.smithi083.stdout:7/869: getdents d0/d4/d9/d39/d67/d6d/d87/d83/d62/dc6 0 2024-04-01T06:57:46.936 INFO:tasks.workunit.client.0.smithi083.stdout:7/870: write d0/d4/d9/d39/d67/dc0/d114/f126 [69498,126998] 0 2024-04-01T06:57:46.936 INFO:tasks.workunit.client.0.smithi083.stdout:7/871: fsync d0/d4/d9/d39/d67/d6d/d87/d83/d62/f8e 0 2024-04-01T06:57:46.937 INFO:tasks.workunit.client.0.smithi083.stdout:7/872: mkdir d0/d4/dbd/d128 0 2024-04-01T06:57:46.942 INFO:tasks.workunit.client.0.smithi083.stdout:4/973: dwrite d1/d47/fd6 [0,4194304] 0 2024-04-01T06:57:46.944 INFO:tasks.workunit.client.0.smithi083.stdout:4/974: write d1/d4/db/d5b/f5f [2126170,40098] 0 2024-04-01T06:57:46.945 INFO:tasks.workunit.client.0.smithi083.stdout:4/975: rmdir d1/d4/db/d94 39 2024-04-01T06:57:46.947 INFO:tasks.workunit.client.0.smithi083.stdout:4/976: unlink d1/d4/db/d5b/d12d/dbc/c119 0 2024-04-01T06:57:46.947 INFO:tasks.workunit.client.0.smithi083.stdout:4/977: fdatasync d1/d4/db/d5b/d12d/de9/f92 0 2024-04-01T06:57:46.949 INFO:tasks.workunit.client.0.smithi083.stdout:4/978: link d1/d4/db/d94/daf/dd1/d6a/cfd d1/da5/dfc/d116/c132 0 2024-04-01T06:57:46.950 INFO:tasks.workunit.client.0.smithi083.stdout:7/873: dwrite d0/d7a/f116 [0,4194304] 0 2024-04-01T06:57:46.950 INFO:tasks.workunit.client.0.smithi083.stdout:4/979: mknod d1/d4/db8/ded/d79/c133 0 2024-04-01T06:57:46.952 INFO:tasks.workunit.client.0.smithi083.stdout:7/874: truncate d0/d4/d9/d39/d67/d6d/d87/d83/d62/f6c 6305 0 2024-04-01T06:57:46.952 INFO:tasks.workunit.client.0.smithi083.stdout:7/875: dread - d0/d4/d9/d39/f115 zero size 2024-04-01T06:57:46.952 INFO:tasks.workunit.client.0.smithi083.stdout:4/980: truncate d1/d4/db/d5b/d12d/de9/f43 438442 0 2024-04-01T06:57:46.953 INFO:tasks.workunit.client.0.smithi083.stdout:4/981: mknod d1/d4/d6e/c134 0 2024-04-01T06:57:46.954 INFO:tasks.workunit.client.0.smithi083.stdout:4/982: read d1/d4/db8/ded/de8/f39 [3548078,83367] 0 2024-04-01T06:57:46.954 INFO:tasks.workunit.client.0.smithi083.stdout:4/983: readlink d1/d4/db8/ded/de8/d88/da8/lbe 0 2024-04-01T06:57:46.956 INFO:tasks.workunit.client.0.smithi083.stdout:4/984: mknod d1/d47/d2a/c135 0 2024-04-01T06:57:46.956 INFO:tasks.workunit.client.0.smithi083.stdout:4/985: write d1/d47/d90/fca [4300326,15801] 0 2024-04-01T06:57:46.956 INFO:tasks.workunit.client.0.smithi083.stdout:4/986: stat d1/d4/db/f9f 0 2024-04-01T06:57:46.958 INFO:tasks.workunit.client.0.smithi083.stdout:4/987: creat d1/d4/db/d94/f136 x:0 0 0 2024-04-01T06:57:46.960 INFO:tasks.workunit.client.0.smithi083.stdout:4/988: link d1/d47/f11c d1/d4/db8/ded/de8/d88/da8/df8/f137 0 2024-04-01T06:57:46.969 INFO:tasks.workunit.client.0.smithi083.stdout:7/876: dwrite d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/d92/fc9 [0,4194304] 0 2024-04-01T06:57:46.973 INFO:tasks.workunit.client.0.smithi083.stdout:4/989: dwrite d1/d4/db/d5b/f69 [4194304,4194304] 0 2024-04-01T06:57:46.975 INFO:tasks.workunit.client.0.smithi083.stdout:4/990: mknod d1/d4/db/d5b/d62/c138 0 2024-04-01T06:57:46.978 INFO:tasks.workunit.client.0.smithi083.stdout:4/991: creat d1/d4/db8/ded/d79/f139 x:0 0 0 2024-04-01T06:57:46.982 INFO:tasks.workunit.client.0.smithi083.stdout:7/877: dwrite d0/d4/f80 [0,4194304] 0 2024-04-01T06:57:46.982 INFO:tasks.workunit.client.0.smithi083.stdout:4/992: dread d1/d4/db/d5b/d12d/de9/f11b [0,4194304] 0 2024-04-01T06:57:46.982 INFO:tasks.workunit.client.0.smithi083.stdout:4/993: chown d1/d4/db8/ded/l8e 6917763 1 2024-04-01T06:57:46.982 INFO:tasks.workunit.client.0.smithi083.stdout:4/994: chown d1/d4/ff6 59919 1 2024-04-01T06:57:46.983 INFO:tasks.workunit.client.0.smithi083.stdout:7/878: mkdir d0/d4/d9/d39/d67/d6d/d87/d83/d38/dbf/de7/d129 0 2024-04-01T06:57:46.983 INFO:tasks.workunit.client.0.smithi083.stdout:4/995: mkdir d1/d4/db/d13a 0 2024-04-01T06:57:46.984 INFO:tasks.workunit.client.0.smithi083.stdout:7/879: unlink d0/d4/d9/d95/ccb 0 2024-04-01T06:57:46.986 INFO:tasks.workunit.client.0.smithi083.stdout:4/996: mknod d1/d4/db/d5b/d12d/c13b 0 2024-04-01T06:57:46.986 INFO:tasks.workunit.client.0.smithi083.stdout:7/880: mknod d0/d4/dbd/dd0/c12a 0 2024-04-01T06:57:46.986 INFO:tasks.workunit.client.0.smithi083.stdout:4/997: rmdir d1/da5/dae/dd2 39 2024-04-01T06:57:46.987 INFO:tasks.workunit.client.0.smithi083.stdout:7/881: mkdir d0/d4/d9/d12b 0 2024-04-01T06:57:46.988 INFO:tasks.workunit.client.0.smithi083.stdout:4/998: symlink d1/d47/d90/l13c 0 2024-04-01T06:57:46.988 INFO:tasks.workunit.client.0.smithi083.stdout:7/882: creat d0/d4/d9/d39/d67/d6d/d87/d83/d38/de2/f12c x:0 0 0 2024-04-01T06:57:46.989 INFO:tasks.workunit.client.0.smithi083.stdout:4/999: creat d1/d4/db/d94/f13d x:0 0 0 2024-04-01T06:57:46.991 INFO:tasks.workunit.client.0.smithi083.stdout:7/883: unlink d0/d4/d9/d39/d67/d6d/d7d/d8a/dce/ff6 0 2024-04-01T06:57:46.991 INFO:tasks.workunit.client.0.smithi083.stdout:7/884: fsync d0/f2b 0 2024-04-01T06:57:46.999 INFO:tasks.workunit.client.0.smithi083.stdout:7/885: dread d0/d4/d9/d39/d67/d6d/fac [0,4194304] 0 2024-04-01T06:57:47.000 INFO:tasks.workunit.client.0.smithi083.stdout:7/886: creat d0/d4/d9/d95/d10e/f12d x:0 0 0 2024-04-01T06:57:47.001 INFO:tasks.workunit.client.0.smithi083.stdout:7/887: write d0/d4/d9/d39/f115 [705706,77523] 0 2024-04-01T06:57:47.002 INFO:tasks.workunit.client.0.smithi083.stdout:7/888: rename d0/d4/d9/d39/d67/d6d/d87/d83/f119 to d0/d4/d9/d39/d67/d6d/d87/dda/f12e 0 2024-04-01T06:57:47.003 INFO:tasks.workunit.client.0.smithi083.stdout:7/889: symlink d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/d5d/l12f 0 2024-04-01T06:57:47.003 INFO:tasks.workunit.client.0.smithi083.stdout:7/890: truncate d0/d4/d9/d39/d67/d6d/d87/d83/d34/f94 1524074 0 2024-04-01T06:57:47.005 INFO:tasks.workunit.client.0.smithi083.stdout:7/891: link d0/d4/d9/d39/d67/d6d/d87/d83/fff d0/d4/d9/d39/d67/d6d/d87/d83/d62/dc6/dec/f130 0 2024-04-01T06:57:47.014 INFO:tasks.workunit.client.0.smithi083.stdout:7/892: dwrite d0/d4/dbd/db7/fe6 [0,4194304] 0 2024-04-01T06:57:47.014 INFO:tasks.workunit.client.0.smithi083.stdout:7/893: chown d0/d4/f2a 22166858 1 2024-04-01T06:57:47.016 INFO:tasks.workunit.client.0.smithi083.stdout:7/894: mkdir d0/d4/d9/d39/d67/d6d/d87/d83/d38/dbf/de7/d129/d131 0 2024-04-01T06:57:47.016 INFO:tasks.workunit.client.0.smithi083.stdout:7/895: write d0/ff1 [2045948,60717] 0 2024-04-01T06:57:47.017 INFO:tasks.workunit.client.0.smithi083.stdout:7/896: link d0/d7a/f116 d0/d4/dbd/dd0/f132 0 2024-04-01T06:57:47.018 INFO:tasks.workunit.client.0.smithi083.stdout:7/897: link d0/d4/dbd/lea d0/l133 0 2024-04-01T06:57:47.018 INFO:tasks.workunit.client.0.smithi083.stdout:7/898: stat d0/d4/d9/d39/d67/d6d/d7d/d8a/dce 0 2024-04-01T06:57:47.029 INFO:tasks.workunit.client.0.smithi083.stdout:7/899: dwrite d0/d7a/f7b [0,4194304] 0 2024-04-01T06:57:47.031 INFO:tasks.workunit.client.0.smithi083.stdout:7/900: mknod d0/d4/dbd/db7/c134 0 2024-04-01T06:57:47.044 INFO:tasks.workunit.client.0.smithi083.stdout:7/901: dwrite d0/d4/d9/d39/d67/d6d/d87/d83/f78 [0,4194304] 0 2024-04-01T06:57:47.046 INFO:tasks.workunit.client.0.smithi083.stdout:7/902: creat d0/d4/d9/d39/d67/d6d/d87/d83/d62/dc6/dec/f135 x:0 0 0 2024-04-01T06:57:47.058 INFO:tasks.workunit.client.0.smithi083.stdout:7/903: dwrite d0/d7a/f9f [0,4194304] 0 2024-04-01T06:57:47.058 INFO:tasks.workunit.client.0.smithi083.stdout:7/904: write d0/d4/d9/d39/d67/d6d/d87/d83/fca [542331,116079] 0 2024-04-01T06:57:47.059 INFO:tasks.workunit.client.0.smithi083.stdout:7/905: truncate d0/d4/f69 4829989 0 2024-04-01T06:57:47.061 INFO:tasks.workunit.client.0.smithi083.stdout:7/906: dread d0/d4/d9/d39/d67/d6d/d7d/fd5 [0,4194304] 0 2024-04-01T06:57:47.063 INFO:tasks.workunit.client.0.smithi083.stdout:7/907: mkdir d0/d4/d136 0 2024-04-01T06:57:47.064 INFO:tasks.workunit.client.0.smithi083.stdout:7/908: symlink d0/d4/d9/d39/d48/l137 0 2024-04-01T06:57:47.065 INFO:tasks.workunit.client.0.smithi083.stdout:7/909: creat d0/d4/d9/d39/d67/d6d/d87/dda/f138 x:0 0 0 2024-04-01T06:57:47.078 INFO:tasks.workunit.client.0.smithi083.stdout:7/910: dwrite d0/d4/d9/d39/d67/d6d/d87/d83/d62/f98 [0,4194304] 0 2024-04-01T06:57:47.079 INFO:tasks.workunit.client.0.smithi083.stdout:7/911: mknod d0/d4/d9/d39/d67/d6d/d7d/d8a/c139 0 2024-04-01T06:57:47.095 INFO:tasks.workunit.client.0.smithi083.stdout:7/912: dwrite d0/d4/d9/d39/d67/d6d/d87/d83/f72 [0,4194304] 0 2024-04-01T06:57:47.095 INFO:tasks.workunit.client.0.smithi083.stdout:7/913: chown d0/d4/d9/d39/d67/d6d/d7d/d8a/dce/c118 168271998 1 2024-04-01T06:57:47.095 INFO:tasks.workunit.client.0.smithi083.stdout:7/914: read d0/d4/d9/d39/d67/d6d/d87/d83/f53 [3737242,57532] 0 2024-04-01T06:57:47.097 INFO:tasks.workunit.client.0.smithi083.stdout:7/915: rename d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/dc7/ff7 to d0/d4/d9/d39/d67/d6d/d87/d83/d62/dc6/dec/f13a 0 2024-04-01T06:57:47.106 INFO:tasks.workunit.client.0.smithi083.stdout:7/916: dread d0/f49 [0,4194304] 0 2024-04-01T06:57:47.107 INFO:tasks.workunit.client.0.smithi083.stdout:7/917: mknod d0/d4/d9/d39/d67/d6d/d7d/d8a/dce/c13b 0 2024-04-01T06:57:47.112 INFO:tasks.workunit.client.0.smithi083.stdout:7/918: truncate d0/d4/f69 4754163 0 2024-04-01T06:57:47.112 INFO:tasks.workunit.client.0.smithi083.stdout:7/919: truncate d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/de5/f10a 3499101 0 2024-04-01T06:57:47.116 INFO:tasks.workunit.client.0.smithi083.stdout:7/920: rename d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/d5d to d0/d4/d9/d12b/d13c 0 2024-04-01T06:57:47.117 INFO:tasks.workunit.client.0.smithi083.stdout:7/921: rename d0/ff1 to d0/d7c/f13d 0 2024-04-01T06:57:47.118 INFO:tasks.workunit.client.0.smithi083.stdout:7/922: creat d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/de5/d124/f13e x:0 0 0 2024-04-01T06:57:47.130 INFO:tasks.workunit.client.0.smithi083.stdout:7/923: dwrite d0/d4/dbd/dd0/f132 [4194304,4194304] 0 2024-04-01T06:57:47.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:46 smithi153 ceph-mon[48187]: pgmap v60: 97 pgs: 97 active+clean; 2.0 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 146 MiB/s rd, 303 MiB/s wr, 1.27k op/s 2024-04-01T06:57:47.142 INFO:tasks.workunit.client.0.smithi083.stdout:7/924: dwrite d0/d4/d9/d39/d67/d6d/f5f [4194304,4194304] 0 2024-04-01T06:57:47.143 INFO:tasks.workunit.client.0.smithi083.stdout:7/925: creat d0/d4/d9/d39/d67/d6d/f13f x:0 0 0 2024-04-01T06:57:47.143 INFO:tasks.workunit.client.0.smithi083.stdout:7/926: chown d0/d4/d9/d39/d67/d6d/d87/d83/fca 29208 1 2024-04-01T06:57:47.160 INFO:tasks.workunit.client.0.smithi083.stdout:7/927: dwrite d0/d4/dbd/dd0/f109 [0,4194304] 0 2024-04-01T06:57:47.162 INFO:tasks.workunit.client.0.smithi083.stdout:7/928: rmdir d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/de5 39 2024-04-01T06:57:47.162 INFO:tasks.workunit.client.0.smithi083.stdout:7/929: chown d0/d4/d9/d39/d67/d6d/d87/d83/d38/f68 77581221 1 2024-04-01T06:57:47.164 INFO:tasks.workunit.client.0.smithi083.stdout:7/930: creat d0/f140 x:0 0 0 2024-04-01T06:57:47.164 INFO:tasks.workunit.client.0.smithi083.stdout:7/931: stat d0/d4/dbd/db7/cc3 0 2024-04-01T06:57:47.165 INFO:tasks.workunit.client.0.smithi083.stdout:7/932: mknod d0/d4/d9/d39/d67/d6d/d87/d83/d38/dbf/de7/d129/d131/c141 0 2024-04-01T06:57:47.179 INFO:tasks.workunit.client.0.smithi083.stdout:7/933: dwrite d0/d4/d9/d39/d67/d6d/d87/d83/d62/f98 [0,4194304] 0 2024-04-01T06:57:47.181 INFO:tasks.workunit.client.0.smithi083.stdout:7/934: dread d0/d4/d9/d39/d67/d6d/d87/d83/d62/f8e [0,4194304] 0 2024-04-01T06:57:47.192 INFO:tasks.workunit.client.0.smithi083.stdout:7/935: dwrite d0/d4/d9/d39/d67/d6d/d87/d83/f42 [0,4194304] 0 2024-04-01T06:57:47.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:46 smithi145 ceph-mon[47816]: pgmap v60: 97 pgs: 97 active+clean; 2.0 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 146 MiB/s rd, 303 MiB/s wr, 1.27k op/s 2024-04-01T06:57:47.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:46 smithi083 ceph-mon[43429]: pgmap v60: 97 pgs: 97 active+clean; 2.0 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 146 MiB/s rd, 303 MiB/s wr, 1.27k op/s 2024-04-01T06:57:47.331 INFO:tasks.workunit.client.0.smithi083.stdout:7/936: sync 2024-04-01T06:57:47.341 INFO:tasks.workunit.client.0.smithi083.stdout:7/937: dwrite d0/d4/dbd/fb9 [0,4194304] 0 2024-04-01T06:57:47.343 INFO:tasks.workunit.client.0.smithi083.stdout:7/938: creat d0/d4/dbd/dd0/f142 x:0 0 0 2024-04-01T06:57:47.346 INFO:tasks.workunit.client.0.smithi083.stdout:7/939: mkdir d0/d143 0 2024-04-01T06:57:47.347 INFO:tasks.workunit.client.0.smithi083.stdout:7/940: creat d0/d4/d9/d39/d67/d6d/d87/d83/d38/dbf/de7/d129/d131/f144 x:0 0 0 2024-04-01T06:57:47.360 INFO:tasks.workunit.client.0.smithi083.stdout:7/941: dwrite d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/de5/f101 [0,4194304] 0 2024-04-01T06:57:47.362 INFO:tasks.workunit.client.0.smithi083.stdout:7/942: creat d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/db8/f145 x:0 0 0 2024-04-01T06:57:47.375 INFO:tasks.workunit.client.0.smithi083.stdout:7/943: dwrite d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/db8/f107 [0,4194304] 0 2024-04-01T06:57:47.378 INFO:tasks.workunit.client.0.smithi083.stdout:7/944: creat d0/d4/d9/d39/f146 x:0 0 0 2024-04-01T06:57:47.378 INFO:tasks.workunit.client.0.smithi083.stdout:7/945: chown d0/d4/d9/d39/d67/d6d/d87/d83/f72 14 1 2024-04-01T06:57:47.379 INFO:tasks.workunit.client.0.smithi083.stdout:7/946: write d0/d4/f80 [3264653,21103] 0 2024-04-01T06:57:47.380 INFO:tasks.workunit.client.0.smithi083.stdout:7/947: creat d0/d7a/f147 x:0 0 0 2024-04-01T06:57:47.382 INFO:tasks.workunit.client.0.smithi083.stdout:7/948: truncate d0/d4/d9/d39/d67/d6d/d87/d83/d38/dbf/de7/ff9 403607 0 2024-04-01T06:57:47.383 INFO:tasks.workunit.client.0.smithi083.stdout:7/949: mknod d0/d4/d9/d39/d67/d6d/d87/d83/c148 0 2024-04-01T06:57:47.385 INFO:tasks.workunit.client.0.smithi083.stdout:7/950: creat d0/d4/d9/d39/d67/d6d/d87/d83/f149 x:0 0 0 2024-04-01T06:57:47.385 INFO:tasks.workunit.client.0.smithi083.stdout:7/951: chown d0/d4/d9/l3d 75 1 2024-04-01T06:57:47.386 INFO:tasks.workunit.client.0.smithi083.stdout:7/952: write d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/d92/fc9 [42054,62921] 0 2024-04-01T06:57:47.388 INFO:tasks.workunit.client.0.smithi083.stdout:7/953: unlink d0/d7a/f147 0 2024-04-01T06:57:47.389 INFO:tasks.workunit.client.0.smithi083.stdout:7/954: dread d0/d4/d9/d39/d67/d6d/d87/d83/d62/f6f [0,4194304] 0 2024-04-01T06:57:47.391 INFO:tasks.workunit.client.0.smithi083.stdout:7/955: creat d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/de5/f14a x:0 0 0 2024-04-01T06:57:47.404 INFO:tasks.workunit.client.0.smithi083.stdout:7/956: dwrite d0/d4/d9/d39/d67/d6d/d87/d83/d62/dc6/dec/f13a [0,4194304] 0 2024-04-01T06:57:47.407 INFO:tasks.workunit.client.0.smithi083.stdout:7/957: creat d0/d4/d9/d39/d67/d6d/d87/d83/d38/dbf/de7/f14b x:0 0 0 2024-04-01T06:57:47.407 INFO:tasks.workunit.client.0.smithi083.stdout:7/958: symlink d0/d4/d9/d39/d67/d6d/d7d/l14c 0 2024-04-01T06:57:47.415 INFO:tasks.workunit.client.0.smithi083.stdout:7/959: dread d0/d4/f69 [0,4194304] 0 2024-04-01T06:57:47.418 INFO:tasks.workunit.client.0.smithi083.stdout:7/960: rename d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/fc8 to d0/d4/d9/d39/d67/d6d/d87/d83/d62/f14d 0 2024-04-01T06:57:47.418 INFO:tasks.workunit.client.0.smithi083.stdout:7/961: fsync d0/d7a/f9f 0 2024-04-01T06:57:47.420 INFO:tasks.workunit.client.0.smithi083.stdout:7/962: link d0/f49 d0/d4/d9/d39/d67/d6d/d87/dda/f14e 0 2024-04-01T06:57:47.422 INFO:tasks.workunit.client.0.smithi083.stdout:7/963: unlink d0/d4/d9/d39/d67/d6d/d7d/fd5 0 2024-04-01T06:57:47.435 INFO:tasks.workunit.client.0.smithi083.stdout:7/964: dwrite d0/d4/d9/d39/d67/d6d/d87/d83/d34/f94 [0,4194304] 0 2024-04-01T06:57:47.442 INFO:tasks.workunit.client.0.smithi083.stdout:7/965: dread d0/d4/d9/d39/d67/d6d/d87/d83/d34/f6a [0,4194304] 0 2024-04-01T06:57:47.442 INFO:tasks.workunit.client.0.smithi083.stdout:7/966: truncate d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/de5/f11a 90036 0 2024-04-01T06:57:47.490 INFO:tasks.workunit.client.0.smithi083.stdout:7/967: sync 2024-04-01T06:57:47.493 INFO:tasks.workunit.client.0.smithi083.stdout:7/968: dread d0/d4/d9/d39/d67/dc0/f123 [0,4194304] 0 2024-04-01T06:57:47.495 INFO:tasks.workunit.client.0.smithi083.stdout:7/969: rmdir d0/d4/dbd 39 2024-04-01T06:57:47.497 INFO:tasks.workunit.client.0.smithi083.stdout:7/970: symlink d0/d4/d9/d12b/d13c/l14f 0 2024-04-01T06:57:47.497 INFO:tasks.workunit.client.0.smithi083.stdout:7/971: dread - d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/de5/d124/f13e zero size 2024-04-01T06:57:47.498 INFO:tasks.workunit.client.0.smithi083.stdout:7/972: rmdir d0/d7a 39 2024-04-01T06:57:47.503 INFO:tasks.workunit.client.0.smithi083.stdout:7/973: dread d0/f3 [0,4194304] 0 2024-04-01T06:57:47.503 INFO:tasks.workunit.client.0.smithi083.stdout:7/974: write d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/de5/f11a [995514,22845] 0 2024-04-01T06:57:47.513 INFO:tasks.workunit.client.0.smithi083.stdout:7/975: dwrite d0/d4/dbd/db2/fdf [0,4194304] 0 2024-04-01T06:57:47.514 INFO:tasks.workunit.client.0.smithi083.stdout:7/976: chown d0/f66 4 1 2024-04-01T06:57:47.514 INFO:tasks.workunit.client.0.smithi083.stdout:7/977: write d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/de5/f10a [3254893,22603] 0 2024-04-01T06:57:47.521 INFO:tasks.workunit.client.0.smithi083.stdout:7/978: dread d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/de5/f101 [0,4194304] 0 2024-04-01T06:57:47.532 INFO:tasks.workunit.client.0.smithi083.stdout:7/979: dwrite d0/d4/f80 [0,4194304] 0 2024-04-01T06:57:47.545 INFO:tasks.workunit.client.0.smithi083.stdout:7/980: dwrite d0/d4/d9/d39/f115 [0,4194304] 0 2024-04-01T06:57:47.546 INFO:tasks.workunit.client.0.smithi083.stdout:7/981: creat d0/f150 x:0 0 0 2024-04-01T06:57:47.547 INFO:tasks.workunit.client.0.smithi083.stdout:7/982: creat d0/d4/d9/d39/d67/d6d/d87/d83/d38/dbf/de7/f151 x:0 0 0 2024-04-01T06:57:47.548 INFO:tasks.workunit.client.0.smithi083.stdout:7/983: creat d0/d4/d9/d12b/d13c/f152 x:0 0 0 2024-04-01T06:57:47.564 INFO:tasks.workunit.client.0.smithi083.stdout:7/984: dwrite d0/d4/d9/d39/d67/d6d/d87/d83/d38/dbf/ffd [0,4194304] 0 2024-04-01T06:57:47.564 INFO:tasks.workunit.client.0.smithi083.stdout:7/985: write d0/d4/d9/d39/fae [237779,71991] 0 2024-04-01T06:57:47.576 INFO:tasks.workunit.client.0.smithi083.stdout:7/986: dwrite d0/d4/d9/d39/d67/d6d/d87/d83/d38/dbf/de7/f151 [0,4194304] 0 2024-04-01T06:57:47.576 INFO:tasks.workunit.client.0.smithi083.stdout:7/987: write d0/d4/fc [9425850,39025] 0 2024-04-01T06:57:47.578 INFO:tasks.workunit.client.0.smithi083.stdout:7/988: symlink d0/d4/d9/d39/d67/d6d/d87/d83/d38/dbf/de7/d129/l153 0 2024-04-01T06:57:47.578 INFO:tasks.workunit.client.0.smithi083.stdout:7/989: readlink d0/d4/d9/d39/d67/d6d/d87/d83/l1d 0 2024-04-01T06:57:47.578 INFO:tasks.workunit.client.0.smithi083.stdout:7/990: dread - d0/d4/d9/f121 zero size 2024-04-01T06:57:47.580 INFO:tasks.workunit.client.0.smithi083.stdout:7/991: creat d0/d4/d9/d39/d67/dc0/f154 x:0 0 0 2024-04-01T06:57:47.580 INFO:tasks.workunit.client.0.smithi083.stdout:7/992: fdatasync d0/d4/d9/d39/d67/d6d/d87/d83/d38/f68 0 2024-04-01T06:57:47.581 INFO:tasks.workunit.client.0.smithi083.stdout:7/993: symlink d0/d4/d9/d39/d97/l155 0 2024-04-01T06:57:47.583 INFO:tasks.workunit.client.0.smithi083.stdout:7/994: mknod d0/d4/d9/d39/d67/d6d/d87/d83/d38/dbf/de7/d129/d131/c156 0 2024-04-01T06:57:47.584 INFO:tasks.workunit.client.0.smithi083.stdout:7/995: symlink d0/d4/d9/d39/d67/dc0/l157 0 2024-04-01T06:57:47.584 INFO:tasks.workunit.client.0.smithi083.stdout:7/996: chown d0/d4/d9/d39/d67/d6d/d87/dda/ce9 1247 1 2024-04-01T06:57:47.584 INFO:tasks.workunit.client.0.smithi083.stdout:7/997: chown d0/d4/d9/d39/d67/d6d/d7d/d8a 32 1 2024-04-01T06:57:47.586 INFO:tasks.workunit.client.0.smithi083.stdout:7/998: mkdir d0/d4/d9/d39/d67/d6d/d87/d83/d34/d89/de5/d124/d158 0 2024-04-01T06:57:47.586 INFO:tasks.workunit.client.0.smithi083.stdout:7/999: chown d0/d4/d9/d39/d67/d6d/d7d/d8a/ca8 0 1 2024-04-01T06:57:47.589 INFO:tasks.workunit.client.0.smithi083.stderr:+ rm -rf -- ./tmp.byu7WIgLhr 2024-04-01T06:57:49.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:48 smithi153 ceph-mon[48187]: pgmap v61: 97 pgs: 97 active+clean; 2.0 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 114 MiB/s rd, 236 MiB/s wr, 355 op/s 2024-04-01T06:57:49.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:48 smithi145 ceph-mon[47816]: pgmap v61: 97 pgs: 97 active+clean; 2.0 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 114 MiB/s rd, 236 MiB/s wr, 355 op/s 2024-04-01T06:57:49.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:48 smithi083 ceph-mon[43429]: pgmap v61: 97 pgs: 97 active+clean; 2.0 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 114 MiB/s rd, 236 MiB/s wr, 355 op/s 2024-04-01T06:57:51.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:50 smithi153 ceph-mon[48187]: pgmap v62: 97 pgs: 97 active+clean; 1.9 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 126 MiB/s rd, 273 MiB/s wr, 956 op/s 2024-04-01T06:57:51.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:50 smithi145 ceph-mon[47816]: pgmap v62: 97 pgs: 97 active+clean; 1.9 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 126 MiB/s rd, 273 MiB/s wr, 956 op/s 2024-04-01T06:57:51.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:50 smithi083 ceph-mon[43429]: pgmap v62: 97 pgs: 97 active+clean; 1.9 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 126 MiB/s rd, 273 MiB/s wr, 956 op/s 2024-04-01T06:57:53.088 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:52 smithi145 ceph-mon[47816]: pgmap v63: 97 pgs: 97 active+clean; 1.9 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 63 MiB/s rd, 154 MiB/s wr, 781 op/s 2024-04-01T06:57:53.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:52 smithi153 ceph-mon[48187]: pgmap v63: 97 pgs: 97 active+clean; 1.9 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 63 MiB/s rd, 154 MiB/s wr, 781 op/s 2024-04-01T06:57:53.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:52 smithi083 ceph-mon[43429]: pgmap v63: 97 pgs: 97 active+clean; 1.9 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 63 MiB/s rd, 154 MiB/s wr, 781 op/s 2024-04-01T06:57:53.750 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-01T06:57:53.751 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-01T06:57:53.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.883+0000 7fd4b2e22700 1 -- 172.21.15.83:0/3275003229 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd4ac104f60 msgr2=0x7fd4ac10cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:53.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.883+0000 7fd4b2e22700 1 --2- 172.21.15.83:0/3275003229 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd4ac104f60 0x7fd4ac10cae0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fd4a400b0a0 tx=0x7fd4a400b3b0 comp rx=0 tx=0).stop 2024-04-01T06:57:53.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.883+0000 7fd4b2e22700 1 -- 172.21.15.83:0/3275003229 shutdown_connections 2024-04-01T06:57:53.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.883+0000 7fd4b2e22700 1 --2- 172.21.15.83:0/3275003229 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd4ac104f60 0x7fd4ac10cae0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:53.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.883+0000 7fd4b2e22700 1 --2- 172.21.15.83:0/3275003229 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd4ac0ffe50 0x7fd4ac100230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:53.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.883+0000 7fd4b2e22700 1 --2- 172.21.15.83:0/3275003229 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4ac100800 0x7fd4ac104830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:53.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.883+0000 7fd4b2e22700 1 -- 172.21.15.83:0/3275003229 >> 172.21.15.83:0/3275003229 conn(0x7fd4ac076d40 msgr2=0x7fd4ac077150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:53.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.883+0000 7fd4b2e22700 1 -- 172.21.15.83:0/3275003229 shutdown_connections 2024-04-01T06:57:53.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.883+0000 7fd4b2e22700 1 -- 172.21.15.83:0/3275003229 wait complete. 2024-04-01T06:57:53.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.884+0000 7fd4b2e22700 1 Processor -- start 2024-04-01T06:57:53.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.884+0000 7fd4b2e22700 1 -- start start 2024-04-01T06:57:53.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.884+0000 7fd4b2e22700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4ac0ffe50 0x7fd4ac1980c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:53.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.884+0000 7fd4b2e22700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd4ac104f60 0x7fd4ac198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:53.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.884+0000 7fd4b2e22700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd4ac198b90 0x7fd4ac1a3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:53.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.884+0000 7fd4b2e22700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ac1a3850 con 0x7fd4ac104f60 2024-04-01T06:57:53.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.884+0000 7fd4b2e22700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ac1a39c0 con 0x7fd4ac198b90 2024-04-01T06:57:53.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.884+0000 7fd4b2e22700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ac1a3b80 con 0x7fd4ac0ffe50 2024-04-01T06:57:53.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.885+0000 7fd4abfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd4ac104f60 0x7fd4ac198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:53.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.885+0000 7fd4abfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd4ac104f60 0x7fd4ac198600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:60728/0 (socket says 172.21.15.83:60728) 2024-04-01T06:57:53.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.885+0000 7fd4abfff700 1 -- 172.21.15.83:0/1083807638 learned_addr learned my addr 172.21.15.83:0/1083807638 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:53.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.885+0000 7fd4b13bf700 1 --2- 172.21.15.83:0/1083807638 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd4ac198b90 0x7fd4ac1a3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:53.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.885+0000 7fd4b0bbe700 1 --2- 172.21.15.83:0/1083807638 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4ac0ffe50 0x7fd4ac1980c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:53.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.885+0000 7fd4abfff700 1 -- 172.21.15.83:0/1083807638 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4ac0ffe50 msgr2=0x7fd4ac1980c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:53.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.885+0000 7fd4abfff700 1 --2- 172.21.15.83:0/1083807638 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4ac0ffe50 0x7fd4ac1980c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:53.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.885+0000 7fd4abfff700 1 -- 172.21.15.83:0/1083807638 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd4ac198b90 msgr2=0x7fd4ac1a3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:53.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.885+0000 7fd4abfff700 1 --2- 172.21.15.83:0/1083807638 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd4ac198b90 0x7fd4ac1a3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:53.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.885+0000 7fd4abfff700 1 -- 172.21.15.83:0/1083807638 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a4009d00 con 0x7fd4ac104f60 2024-04-01T06:57:53.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.885+0000 7fd4abfff700 1 --2- 172.21.15.83:0/1083807638 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd4ac104f60 0x7fd4ac198600 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fd49800d950 tx=0x7fd49800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:53.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.885+0000 7fd4a9ffb700 1 -- 172.21.15.83:0/1083807638 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd498004220 con 0x7fd4ac104f60 2024-04-01T06:57:53.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.885+0000 7fd4a9ffb700 1 -- 172.21.15.83:0/1083807638 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd498007620 con 0x7fd4ac104f60 2024-04-01T06:57:53.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.885+0000 7fd4b2e22700 1 -- 172.21.15.83:0/1083807638 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4ac1a3e60 con 0x7fd4ac104f60 2024-04-01T06:57:53.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.885+0000 7fd4a9ffb700 1 -- 172.21.15.83:0/1083807638 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd498005690 con 0x7fd4ac104f60 2024-04-01T06:57:53.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.885+0000 7fd4b2e22700 1 -- 172.21.15.83:0/1083807638 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4ac1a42e0 con 0x7fd4ac104f60 2024-04-01T06:57:53.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.887+0000 7fd4a9ffb700 1 -- 172.21.15.83:0/1083807638 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 25) v1 ==== 135996+0+0 (secure 0 0 0) 0x7fd498004750 con 0x7fd4ac104f60 2024-04-01T06:57:53.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.888+0000 7fd4a9ffb700 1 --2- 172.21.15.83:0/1083807638 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fd49c0a1290 0x7fd49c0a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:53.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.888+0000 7fd4b0bbe700 1 --2- 172.21.15.83:0/1083807638 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fd49c0a1290 0x7fd49c0a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:53.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.888+0000 7fd4a9ffb700 1 -- 172.21.15.83:0/1083807638 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7fd4980cca30 con 0x7fd4ac104f60 2024-04-01T06:57:53.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.888+0000 7fd4b0bbe700 1 --2- 172.21.15.83:0/1083807638 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fd49c0a1290 0x7fd49c0a3750 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd4a0009bf0 tx=0x7fd4a0009260 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:53.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.889+0000 7fd4befb8b80 1 Processor -- start 2024-04-01T06:57:53.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.889+0000 7fd4befb8b80 1 -- start start 2024-04-01T06:57:53.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.889+0000 7fd4befb8b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559c354465d0 0x559c354469b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:53.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.889+0000 7fd4befb8b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559c35446ef0 0x559c35455cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:53.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.889+0000 7fd4befb8b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559c35456200 0x559c354585f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:53.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.889+0000 7fd4befb8b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c3539f990 con 0x559c35456200 2024-04-01T06:57:53.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.889+0000 7fd4befb8b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c3539d350 con 0x559c354465d0 2024-04-01T06:57:53.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.889+0000 7fd4befb8b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c35398c40 con 0x559c35446ef0 2024-04-01T06:57:53.897 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.890+0000 7fd4b13bf700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559c35456200 0x559c354585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:53.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.890+0000 7fd4b13bf700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559c35456200 0x559c354585f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:60744/0 (socket says 172.21.15.83:60744) 2024-04-01T06:57:53.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.890+0000 7fd4b0bbe700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559c354465d0 0x559c354469b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:53.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.890+0000 7fd4b13bf700 1 -- 172.21.15.83:0/4201529788 learned_addr learned my addr 172.21.15.83:0/4201529788 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:53.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.890+0000 7fd4abfff700 1 --2- 172.21.15.83:0/4201529788 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559c35446ef0 0x559c35455cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:53.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.890+0000 7fd4b13bf700 1 -- 172.21.15.83:0/4201529788 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559c35446ef0 msgr2=0x559c35455cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:53.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.890+0000 7fd4b13bf700 1 --2- 172.21.15.83:0/4201529788 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559c35446ef0 0x559c35455cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:53.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.890+0000 7fd4b13bf700 1 -- 172.21.15.83:0/4201529788 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559c354465d0 msgr2=0x559c354469b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:53.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.890+0000 7fd4b13bf700 1 --2- 172.21.15.83:0/4201529788 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559c354465d0 0x559c354469b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:53.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.890+0000 7fd4b13bf700 1 -- 172.21.15.83:0/4201529788 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559c3521a3b0 con 0x559c35456200 2024-04-01T06:57:53.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.890+0000 7fd4b0bbe700 1 --2- 172.21.15.83:0/4201529788 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559c354465d0 0x559c354469b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T06:57:53.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.890+0000 7fd4abfff700 1 --2- 172.21.15.83:0/4201529788 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559c35446ef0 0x559c35455cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:57:53.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.890+0000 7fd4b13bf700 1 --2- 172.21.15.83:0/4201529788 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559c35456200 0x559c354585f0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fd4a400b0a0 tx=0x7fd4a40093f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c707c1f70082d30b server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:53.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.890+0000 7fd496ffd700 1 -- 172.21.15.83:0/4201529788 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a400e040 con 0x559c35456200 2024-04-01T06:57:53.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.890+0000 7fd496ffd700 1 -- 172.21.15.83:0/4201529788 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd4a4009b80 con 0x559c35456200 2024-04-01T06:57:53.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.890+0000 7fd496ffd700 1 -- 172.21.15.83:0/4201529788 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a4003c40 con 0x559c35456200 2024-04-01T06:57:53.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.891+0000 7fd4befb8b80 1 -- 172.21.15.83:0/4201529788 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559c35456200 msgr2=0x559c354585f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:53.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.891+0000 7fd4befb8b80 1 --2- 172.21.15.83:0/4201529788 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559c35456200 0x559c354585f0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fd4a400b0a0 tx=0x7fd4a40093f0 comp rx=0 tx=0).stop 2024-04-01T06:57:53.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.891+0000 7fd4befb8b80 1 -- 172.21.15.83:0/4201529788 shutdown_connections 2024-04-01T06:57:53.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.891+0000 7fd4befb8b80 1 --2- 172.21.15.83:0/4201529788 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559c35456200 0x559c354585f0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:53.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.891+0000 7fd4befb8b80 1 --2- 172.21.15.83:0/4201529788 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559c354465d0 0x559c354469b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:53.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.891+0000 7fd4befb8b80 1 --2- 172.21.15.83:0/4201529788 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559c35446ef0 0x559c35455cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:53.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.891+0000 7fd4befb8b80 1 -- 172.21.15.83:0/4201529788 >> 172.21.15.83:0/4201529788 conn(0x559c353a66a0 msgr2=0x559c35442a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:53.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.891+0000 7fd4befb8b80 1 -- 172.21.15.83:0/4201529788 shutdown_connections 2024-04-01T06:57:53.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.891+0000 7fd4befb8b80 1 -- 172.21.15.83:0/4201529788 wait complete. 2024-04-01T06:57:53.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.891+0000 7fd4befb8b80 1 -- start start 2024-04-01T06:57:53.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.891+0000 7fd4befb8b80 1 Processor -- start 2024-04-01T06:57:53.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.892+0000 7fd4befb8b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559c354465d0 0x559c35455ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:53.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.892+0000 7fd4befb8b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559c35446ef0 0x559c35452e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:53.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.892+0000 7fd4befb8b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559c35456200 0x559c35453370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:53.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.892+0000 7fd4befb8b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c35334d80 con 0x559c35456200 2024-04-01T06:57:53.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.892+0000 7fd4befb8b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c35334a20 con 0x559c354465d0 2024-04-01T06:57:53.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.892+0000 7fd4befb8b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c3521c6a0 con 0x559c35446ef0 2024-04-01T06:57:53.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.892+0000 7fd4befb8b80 10 client.0 _ll_register_callbacks cb 0x559c3533e470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:57:53.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.892+0000 7fd4b13bf700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559c35456200 0x559c35453370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:53.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.892+0000 7fd4b13bf700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559c35456200 0x559c35453370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:60746/0 (socket says 172.21.15.83:60746) 2024-04-01T06:57:53.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.892+0000 7fd4b13bf700 1 -- 172.21.15.83:0/2682330365 learned_addr learned my addr 172.21.15.83:0/2682330365 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:53.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.892+0000 7fd4b0bbe700 1 --2- 172.21.15.83:0/2682330365 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559c354465d0 0x559c35455ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:53.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.892+0000 7fd4abfff700 1 --2- 172.21.15.83:0/2682330365 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559c35446ef0 0x559c35452e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:53.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.892+0000 7fd4b13bf700 1 -- 172.21.15.83:0/2682330365 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559c35446ef0 msgr2=0x559c35452e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:53.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.892+0000 7fd4b13bf700 1 --2- 172.21.15.83:0/2682330365 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559c35446ef0 0x559c35452e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:53.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.892+0000 7fd4b13bf700 1 -- 172.21.15.83:0/2682330365 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559c354465d0 msgr2=0x559c35455ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:53.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.892+0000 7fd4b13bf700 1 --2- 172.21.15.83:0/2682330365 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559c354465d0 0x559c35455ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:53.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.892+0000 7fd4b13bf700 1 -- 172.21.15.83:0/2682330365 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4a0011a60 con 0x559c35456200 2024-04-01T06:57:53.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.892+0000 7fd4abfff700 1 --2- 172.21.15.83:0/2682330365 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559c35446ef0 0x559c35452e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:57:53.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.892+0000 7fd4b13bf700 1 --2- 172.21.15.83:0/2682330365 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559c35456200 0x559c35453370 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fd4a40075d0 tx=0x7fd4a400bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60bc7fd9ebeaecd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:53.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.892+0000 7fd48bfff700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:57:53.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.892+0000 7fd48bfff700 1 -- 172.21.15.83:0/2682330365 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a400e040 con 0x559c35456200 2024-04-01T06:57:53.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.892+0000 7fd48bfff700 1 -- 172.21.15.83:0/2682330365 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7fd4a4003e10 con 0x559c35456200 2024-04-01T06:57:53.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.893+0000 7fd4befb8b80 1 -- 172.21.15.83:0/2682330365 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559c35391700 con 0x559c35456200 2024-04-01T06:57:53.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.893+0000 7fd48bfff700 1 -- 172.21.15.83:0/2682330365 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd4a40078f0 con 0x559c35456200 2024-04-01T06:57:53.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.893+0000 7fd4befb8b80 10 client.15981 fetch_fsmap learned FSMap version 28 2024-04-01T06:57:53.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.893+0000 7fd4befb8b80 1 -- 172.21.15.83:0/2682330365 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x7fd4ac10d350 con 0x559c35456200 2024-04-01T06:57:53.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.893+0000 7fd48bfff700 1 -- 172.21.15.83:0/2682330365 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559c35391700 con 0x559c35456200 2024-04-01T06:57:53.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.893+0000 7fd48bfff700 1 -- 172.21.15.83:0/2682330365 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 28) v1 ==== 7474+0+0 (secure 0 0 0) 0x7fd4a4019070 con 0x559c35456200 2024-04-01T06:57:53.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.893+0000 7fd4befb8b80 10 client.15981 fetch_fsmap finished waiting for FSMap version 28 2024-04-01T06:57:53.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.893+0000 7fd4befb8b80 10 client.15981 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-01T06:57:53.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.893+0000 7fd4befb8b80 20 client.15981 populate_metadata read hostname 'smithi083' 2024-04-01T06:57:53.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.893+0000 7fd4befb8b80 1 --2- 172.21.15.83:0/2682330365 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x559c354658b0 0x559c35467cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:53.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.893+0000 7fd4befb8b80 4 client.15981 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-01T06:57:53.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.893+0000 7fd4befb8b80 1 -- 172.21.15.83:0/2682330365 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559c351e7cf0 con 0x559c354658b0 2024-04-01T06:57:53.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.893+0000 7fd4b0bbe700 1 --2- 172.21.15.83:0/2682330365 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x559c354658b0 0x559c35467cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:53.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.894+0000 7fd48bfff700 10 client.15981 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:57:53.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.894+0000 7fd4b0bbe700 1 --2- 172.21.15.83:0/2682330365 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x559c354658b0 0x559c35467cd0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89d7dd1e4e8e9d9b server_cookie=b27b43e0ab62104 in_seq=0 out_seq=0 2024-04-01T06:57:53.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.894+0000 7fd48bfff700 1 -- 172.21.15.83:0/2682330365 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559c351e7cf0 con 0x559c354658b0 2024-04-01T06:57:53.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.894+0000 7fd48bfff700 10 client.15981 handle_command_reply: tid=0 2024-04-01T06:57:53.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.894+0000 7fd4befb8b80 1 client.15981 shutdown 2024-04-01T06:57:53.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.894+0000 7fd4befb8b80 1 -- 172.21.15.83:0/2682330365 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559c35456200 msgr2=0x559c35453370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:53.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.894+0000 7fd4befb8b80 1 --2- 172.21.15.83:0/2682330365 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559c35456200 0x559c35453370 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fd4a40075d0 tx=0x7fd4a400bd30 comp rx=0 tx=0).stop 2024-04-01T06:57:53.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.894+0000 7fd4befb8b80 1 -- 172.21.15.83:0/2682330365 shutdown_connections 2024-04-01T06:57:53.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.894+0000 7fd4befb8b80 1 --2- 172.21.15.83:0/2682330365 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x559c354658b0 0x559c35467cd0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:53.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.894+0000 7fd4befb8b80 1 --2- 172.21.15.83:0/2682330365 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559c35456200 0x559c35453370 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:53.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.894+0000 7fd48bfff700 0 client.15981 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:57:53.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.894+0000 7fd4befb8b80 1 --2- 172.21.15.83:0/2682330365 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559c354465d0 0x559c35455ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:53.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.894+0000 7fd4befb8b80 1 --2- 172.21.15.83:0/2682330365 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559c35446ef0 0x559c35452e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:53.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.894+0000 7fd4befb8b80 1 -- 172.21.15.83:0/2682330365 >> 172.21.15.83:0/2682330365 conn(0x559c353a66a0 msgr2=0x559c354486c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:53.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.895+0000 7fd4befb8b80 1 -- 172.21.15.83:0/2682330365 shutdown_connections 2024-04-01T06:57:53.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.895+0000 7fd4befb8b80 1 -- 172.21.15.83:0/2682330365 wait complete. 2024-04-01T06:57:53.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.895+0000 7fd4befb8b80 20 client.15981 trim_cache size 0 max 16384 2024-04-01T06:57:53.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.914+0000 7fd4befb8b80 1 Processor -- start 2024-04-01T06:57:53.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.914+0000 7fd4befb8b80 1 -- start start 2024-04-01T06:57:53.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.914+0000 7fd4befb8b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559c354465d0 0x559c3545ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:53.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.914+0000 7fd4befb8b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559c35446ef0 0x559c35461570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:53.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.914+0000 7fd4befb8b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559c35456200 0x559c35461ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:53.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.914+0000 7fd4befb8b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c35391730 con 0x559c35456200 2024-04-01T06:57:53.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.914+0000 7fd4befb8b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c35447f90 con 0x559c35446ef0 2024-04-01T06:57:53.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.914+0000 7fd4befb8b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c35455e80 con 0x559c354465d0 2024-04-01T06:57:53.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.914+0000 7fd4b13bf700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559c35456200 0x559c35461ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:53.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.914+0000 7fd4b13bf700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559c35456200 0x559c35461ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:60752/0 (socket says 172.21.15.83:60752) 2024-04-01T06:57:53.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.914+0000 7fd4b13bf700 1 -- 172.21.15.83:0/2412253052 learned_addr learned my addr 172.21.15.83:0/2412253052 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:53.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.914+0000 7fd4b0bbe700 1 --2- 172.21.15.83:0/2412253052 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559c354465d0 0x559c3545ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:53.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.914+0000 7fd4abfff700 1 --2- 172.21.15.83:0/2412253052 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559c35446ef0 0x559c35461570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:53.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.914+0000 7fd4b13bf700 1 -- 172.21.15.83:0/2412253052 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559c354465d0 msgr2=0x559c3545ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:53.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.914+0000 7fd4b13bf700 1 --2- 172.21.15.83:0/2412253052 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559c354465d0 0x559c3545ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:53.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.914+0000 7fd4b13bf700 1 -- 172.21.15.83:0/2412253052 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559c35446ef0 msgr2=0x559c35461570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:53.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.914+0000 7fd4b13bf700 1 --2- 172.21.15.83:0/2412253052 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559c35446ef0 0x559c35461570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:53.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.914+0000 7fd4b13bf700 1 -- 172.21.15.83:0/2412253052 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559c351c6b60 con 0x559c35456200 2024-04-01T06:57:53.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.914+0000 7fd4abfff700 1 --2- 172.21.15.83:0/2412253052 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559c35446ef0 0x559c35461570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:57:53.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.915+0000 7fd4b13bf700 1 --2- 172.21.15.83:0/2412253052 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559c35456200 0x559c35461ab0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fd4a400b780 tx=0x7fd4a4006160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4fd56f554bd383f server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:53.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.915+0000 7fd4977fe700 1 -- 172.21.15.83:0/2412253052 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a400e040 con 0x559c35456200 2024-04-01T06:57:53.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.915+0000 7fd4977fe700 1 -- 172.21.15.83:0/2412253052 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd4a4007600 con 0x559c35456200 2024-04-01T06:57:53.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.915+0000 7fd4977fe700 1 -- 172.21.15.83:0/2412253052 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a40057f0 con 0x559c35456200 2024-04-01T06:57:53.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.915+0000 7fd4befb8b80 1 -- 172.21.15.83:0/2412253052 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559c35456200 msgr2=0x559c35461ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:53.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.915+0000 7fd4befb8b80 1 --2- 172.21.15.83:0/2412253052 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559c35456200 0x559c35461ab0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fd4a400b780 tx=0x7fd4a4006160 comp rx=0 tx=0).stop 2024-04-01T06:57:53.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.915+0000 7fd4befb8b80 1 -- 172.21.15.83:0/2412253052 shutdown_connections 2024-04-01T06:57:53.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.915+0000 7fd4befb8b80 1 --2- 172.21.15.83:0/2412253052 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559c35456200 0x559c35461ab0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:53.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.915+0000 7fd4befb8b80 1 --2- 172.21.15.83:0/2412253052 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559c354465d0 0x559c3545ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:53.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.915+0000 7fd4befb8b80 1 --2- 172.21.15.83:0/2412253052 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559c35446ef0 0x559c35461570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:53.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.915+0000 7fd4befb8b80 1 -- 172.21.15.83:0/2412253052 >> 172.21.15.83:0/2412253052 conn(0x559c353a66a0 msgr2=0x559c35455770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:53.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.915+0000 7fd4befb8b80 1 -- 172.21.15.83:0/2412253052 shutdown_connections 2024-04-01T06:57:53.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.916+0000 7fd4befb8b80 1 -- 172.21.15.83:0/2412253052 wait complete. 2024-04-01T06:57:53.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.916+0000 7fd4befb8b80 1 -- start start 2024-04-01T06:57:53.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.916+0000 7fd4befb8b80 1 Processor -- start 2024-04-01T06:57:53.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.916+0000 7fd4befb8b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559c354465d0 0x559c354ad860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:53.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.916+0000 7fd4befb8b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559c35446ef0 0x559c354adda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:53.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.916+0000 7fd4befb8b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559c35456200 0x559c354b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:53.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.916+0000 7fd4befb8b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c354b1ef0 con 0x559c35456200 2024-04-01T06:57:53.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.916+0000 7fd4befb8b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c354b2060 con 0x559c35446ef0 2024-04-01T06:57:53.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.916+0000 7fd4befb8b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c354b2220 con 0x559c354465d0 2024-04-01T06:57:53.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.916+0000 7fd4befb8b80 10 client.0 _ll_register_callbacks cb 0x559c3533e470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:57:53.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.917+0000 7fd4b0bbe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559c354465d0 0x559c354ad860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:53.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.917+0000 7fd4b0bbe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559c354465d0 0x559c354ad860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.83:37596/0 (socket says 172.21.15.83:37596) 2024-04-01T06:57:53.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.917+0000 7fd4b0bbe700 1 -- 172.21.15.83:0/4281948686 learned_addr learned my addr 172.21.15.83:0/4281948686 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:53.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.917+0000 7fd4b13bf700 1 --2- 172.21.15.83:0/4281948686 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559c35456200 0x559c354b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:53.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.917+0000 7fd4abfff700 1 --2- 172.21.15.83:0/4281948686 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559c35446ef0 0x559c354adda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:53.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.917+0000 7fd4b13bf700 1 -- 172.21.15.83:0/4281948686 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559c354465d0 msgr2=0x559c354ad860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:53.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.917+0000 7fd4b13bf700 1 --2- 172.21.15.83:0/4281948686 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559c354465d0 0x559c354ad860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:53.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.917+0000 7fd4b13bf700 1 -- 172.21.15.83:0/4281948686 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559c35446ef0 msgr2=0x559c354adda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:53.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.917+0000 7fd4b13bf700 1 --2- 172.21.15.83:0/4281948686 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559c35446ef0 0x559c354adda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:53.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.917+0000 7fd4b13bf700 1 -- 172.21.15.83:0/4281948686 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4ac10d350 con 0x559c35456200 2024-04-01T06:57:53.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.917+0000 7fd4b13bf700 1 --2- 172.21.15.83:0/4281948686 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559c35456200 0x559c354b1940 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4000f80 tx=0x7fd4a400bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf23d6f69761ea3 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:53.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.917+0000 7fd48bfff700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:57:53.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.918+0000 7fd48bfff700 1 -- 172.21.15.83:0/4281948686 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a400e070 con 0x559c35456200 2024-04-01T06:57:53.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.919+0000 7fd48bfff700 1 -- 172.21.15.83:0/4281948686 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7fd4a4005230 con 0x559c35456200 2024-04-01T06:57:53.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.919+0000 7fd4befb8b80 1 -- 172.21.15.83:0/4281948686 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559c35359380 con 0x559c35456200 2024-04-01T06:57:53.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.919+0000 7fd48bfff700 1 -- 172.21.15.83:0/4281948686 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd4a40053f0 con 0x559c35456200 2024-04-01T06:57:53.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.919+0000 7fd4befb8b80 10 client.15987 fetch_fsmap learned FSMap version 28 2024-04-01T06:57:53.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.919+0000 7fd4befb8b80 1 -- 172.21.15.83:0/4281948686 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x559c3535eea0 con 0x559c35456200 2024-04-01T06:57:53.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.920+0000 7fd48bfff700 1 -- 172.21.15.83:0/4281948686 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559c35359380 con 0x559c35456200 2024-04-01T06:57:53.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.920+0000 7fd48bfff700 1 -- 172.21.15.83:0/4281948686 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 28) v1 ==== 7474+0+0 (secure 0 0 0) 0x7fd4a400b0d0 con 0x559c35456200 2024-04-01T06:57:53.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.920+0000 7fd4befb8b80 10 client.15987 fetch_fsmap finished waiting for FSMap version 28 2024-04-01T06:57:53.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.920+0000 7fd4befb8b80 10 client.15987 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-01T06:57:53.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.920+0000 7fd4befb8b80 20 client.15987 populate_metadata read hostname 'smithi083' 2024-04-01T06:57:53.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.920+0000 7fd4befb8b80 1 --2- 172.21.15.83:0/4281948686 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x559c35449990 0x559c3544bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:53.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.920+0000 7fd4befb8b80 4 client.15987 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-01T06:57:53.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.920+0000 7fd4befb8b80 1 -- 172.21.15.83:0/4281948686 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x559c3521cce0 con 0x559c35449990 2024-04-01T06:57:53.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.920+0000 7fd4b0bbe700 1 --2- 172.21.15.83:0/4281948686 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x559c35449990 0x559c3544bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:53.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.924+0000 7fd48bfff700 10 client.15987 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:57:53.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.924+0000 7fd4b0bbe700 1 --2- 172.21.15.83:0/4281948686 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x559c35449990 0x559c3544bdb0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a8771893a40ed95 server_cookie=72dd0ff9d3154a55 in_seq=0 out_seq=0 2024-04-01T06:57:53.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.925+0000 7fd48bfff700 1 -- 172.21.15.83:0/4281948686 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x559c3521cce0 con 0x559c35449990 2024-04-01T06:57:53.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.925+0000 7fd48bfff700 10 client.15987 handle_command_reply: tid=0 2024-04-01T06:57:53.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.925+0000 7fd4befb8b80 1 client.15987 shutdown 2024-04-01T06:57:53.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.925+0000 7fd4befb8b80 1 -- 172.21.15.83:0/4281948686 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559c35456200 msgr2=0x559c354b1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:53.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.925+0000 7fd4befb8b80 1 --2- 172.21.15.83:0/4281948686 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559c35456200 0x559c354b1940 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4000f80 tx=0x7fd4a400bd30 comp rx=0 tx=0).stop 2024-04-01T06:57:53.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.925+0000 7fd4befb8b80 1 -- 172.21.15.83:0/4281948686 shutdown_connections 2024-04-01T06:57:53.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.925+0000 7fd4befb8b80 1 --2- 172.21.15.83:0/4281948686 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x559c35449990 0x559c3544bdb0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:53.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.925+0000 7fd4befb8b80 1 --2- 172.21.15.83:0/4281948686 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559c35456200 0x559c354b1940 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:53.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.925+0000 7fd4befb8b80 1 --2- 172.21.15.83:0/4281948686 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559c354465d0 0x559c354ad860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:53.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.925+0000 7fd48bfff700 0 client.15987 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:57:53.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.925+0000 7fd4befb8b80 1 --2- 172.21.15.83:0/4281948686 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559c35446ef0 0x559c354adda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:53.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.925+0000 7fd4befb8b80 1 -- 172.21.15.83:0/4281948686 >> 172.21.15.83:0/4281948686 conn(0x559c353a66a0 msgr2=0x559c35461e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:53.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.925+0000 7fd4befb8b80 1 -- 172.21.15.83:0/4281948686 shutdown_connections 2024-04-01T06:57:53.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.925+0000 7fd4befb8b80 1 -- 172.21.15.83:0/4281948686 wait complete. 2024-04-01T06:57:53.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.925+0000 7fd4befb8b80 20 client.15987 trim_cache size 0 max 16384 2024-04-01T06:57:53.927 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-04-01T06:57:53.927 INFO:teuthology.orchestra.run.smithi083.stdout: "status": "no active scrubs running", 2024-04-01T06:57:53.927 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubs": {} 2024-04-01T06:57:53.927 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-04-01T06:57:53.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.926+0000 7fd4b2e22700 1 -- 172.21.15.83:0/1083807638 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fd49c0a1290 msgr2=0x7fd49c0a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:53.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.926+0000 7fd4b2e22700 1 --2- 172.21.15.83:0/1083807638 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fd49c0a1290 0x7fd49c0a3750 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd4a0009bf0 tx=0x7fd4a0009260 comp rx=0 tx=0).stop 2024-04-01T06:57:53.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.926+0000 7fd4b2e22700 1 -- 172.21.15.83:0/1083807638 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd4ac104f60 msgr2=0x7fd4ac198600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:53.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.926+0000 7fd4b2e22700 1 --2- 172.21.15.83:0/1083807638 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd4ac104f60 0x7fd4ac198600 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fd49800d950 tx=0x7fd49800dc60 comp rx=0 tx=0).stop 2024-04-01T06:57:53.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.926+0000 7fd4b2e22700 1 -- 172.21.15.83:0/1083807638 shutdown_connections 2024-04-01T06:57:53.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.926+0000 7fd4b2e22700 1 --2- 172.21.15.83:0/1083807638 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fd49c0a1290 0x7fd49c0a3750 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:53.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.926+0000 7fd4b2e22700 1 --2- 172.21.15.83:0/1083807638 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd4ac198b90 0x7fd4ac1a3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:53.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.926+0000 7fd4b2e22700 1 --2- 172.21.15.83:0/1083807638 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4ac0ffe50 0x7fd4ac1980c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:53.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.926+0000 7fd4b2e22700 1 --2- 172.21.15.83:0/1083807638 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd4ac104f60 0x7fd4ac198600 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:53.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.926+0000 7fd4b2e22700 1 -- 172.21.15.83:0/1083807638 >> 172.21.15.83:0/1083807638 conn(0x7fd4ac076d40 msgr2=0x7fd4ac0fdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:53.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.926+0000 7fd4b2e22700 1 -- 172.21.15.83:0/1083807638 shutdown_connections 2024-04-01T06:57:53.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:53.926+0000 7fd4b2e22700 1 -- 172.21.15.83:0/1083807638 wait complete. 2024-04-01T06:57:53.941 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-01T06:57:53.941 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T06:57:54.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.079+0000 7f574324f700 1 -- 172.21.15.83:0/215502838 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f573c1026f0 msgr2=0x7f573c10abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:54.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.079+0000 7f574324f700 1 --2- 172.21.15.83:0/215502838 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f573c1026f0 0x7f573c10abd0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f5728009990 tx=0x7f5728009ca0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.079+0000 7f574324f700 1 -- 172.21.15.83:0/215502838 shutdown_connections 2024-04-01T06:57:54.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.079+0000 7f574324f700 1 --2- 172.21.15.83:0/215502838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f573c10b1f0 0x7f573c10d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.079+0000 7f574324f700 1 --2- 172.21.15.83:0/215502838 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f573c101dd0 0x7f573c1021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.079+0000 7f574324f700 1 --2- 172.21.15.83:0/215502838 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f573c1026f0 0x7f573c10abd0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.079+0000 7f574324f700 1 -- 172.21.15.83:0/215502838 >> 172.21.15.83:0/215502838 conn(0x7f573c0fb5f0 msgr2=0x7f573c0fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:54.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.079+0000 7f574324f700 1 -- 172.21.15.83:0/215502838 shutdown_connections 2024-04-01T06:57:54.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.079+0000 7f574324f700 1 -- 172.21.15.83:0/215502838 wait complete. 2024-04-01T06:57:54.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.080+0000 7f574324f700 1 Processor -- start 2024-04-01T06:57:54.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.080+0000 7f574324f700 1 -- start start 2024-04-01T06:57:54.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.080+0000 7f574324f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f573c101dd0 0x7f573c197120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.080+0000 7f574324f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f573c1026f0 0x7f573c197660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.080+0000 7f574324f700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f573c10b1f0 0x7f573c19ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.080+0000 7f574324f700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573c19c040 con 0x7f573c1026f0 2024-04-01T06:57:54.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.080+0000 7f574324f700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573c19c1b0 con 0x7f573c10b1f0 2024-04-01T06:57:54.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.080+0000 7f574324f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573c19c370 con 0x7f573c101dd0 2024-04-01T06:57:54.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.080+0000 7f5740feb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f573c101dd0 0x7f573c197120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.080+0000 7f573bfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f573c1026f0 0x7f573c197660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.080+0000 7f5740feb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f573c101dd0 0x7f573c197120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.83:37612/0 (socket says 172.21.15.83:37612) 2024-04-01T06:57:54.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.080+0000 7f5740feb700 1 -- 172.21.15.83:0/3929301099 learned_addr learned my addr 172.21.15.83:0/3929301099 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:54.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.080+0000 7f57417ec700 1 --2- 172.21.15.83:0/3929301099 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f573c10b1f0 0x7f573c19ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.080+0000 7f573bfff700 1 -- 172.21.15.83:0/3929301099 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f573c101dd0 msgr2=0x7f573c197120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:54.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.080+0000 7f573bfff700 1 --2- 172.21.15.83:0/3929301099 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f573c101dd0 0x7f573c197120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.080+0000 7f573bfff700 1 -- 172.21.15.83:0/3929301099 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f573c10b1f0 msgr2=0x7f573c19ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:54.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.081+0000 7f573bfff700 1 --2- 172.21.15.83:0/3929301099 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f573c10b1f0 0x7f573c19ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.081+0000 7f573bfff700 1 -- 172.21.15.83:0/3929301099 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57280095f0 con 0x7f573c1026f0 2024-04-01T06:57:54.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.081+0000 7f57417ec700 1 --2- 172.21.15.83:0/3929301099 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f573c10b1f0 0x7f573c19ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:57:54.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.081+0000 7f573bfff700 1 --2- 172.21.15.83:0/3929301099 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f573c1026f0 0x7f573c197660 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f5728000c00 tx=0x7f5728004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:54.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.081+0000 7f5739ffb700 1 -- 172.21.15.83:0/3929301099 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572801d070 con 0x7f573c1026f0 2024-04-01T06:57:54.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.081+0000 7f5739ffb700 1 -- 172.21.15.83:0/3929301099 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5728021410 con 0x7f573c1026f0 2024-04-01T06:57:54.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.081+0000 7f574324f700 1 -- 172.21.15.83:0/3929301099 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f573c19c5f0 con 0x7f573c1026f0 2024-04-01T06:57:54.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.081+0000 7f5739ffb700 1 -- 172.21.15.83:0/3929301099 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5728021ea0 con 0x7f573c1026f0 2024-04-01T06:57:54.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.081+0000 7f574324f700 1 -- 172.21.15.83:0/3929301099 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f573c1a3e90 con 0x7f573c1026f0 2024-04-01T06:57:54.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.082+0000 7f574324f700 1 -- 172.21.15.83:0/3929301099 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f573c1062c0 con 0x7f573c1026f0 2024-04-01T06:57:54.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.083+0000 7f5739ffb700 1 -- 172.21.15.83:0/3929301099 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 25) v1 ==== 135996+0+0 (secure 0 0 0) 0x7f5728021580 con 0x7f573c1026f0 2024-04-01T06:57:54.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.084+0000 7f5739ffb700 1 --2- 172.21.15.83:0/3929301099 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f572c0a1310 0x7f572c0a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.084+0000 7f5739ffb700 1 -- 172.21.15.83:0/3929301099 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f57280cdc10 con 0x7f573c1026f0 2024-04-01T06:57:54.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.084+0000 7f5740feb700 1 --2- 172.21.15.83:0/3929301099 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f572c0a1310 0x7f572c0a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.084+0000 7f5740feb700 1 --2- 172.21.15.83:0/3929301099 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f572c0a1310 0x7f572c0a37d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5730009d00 tx=0x7f5730009260 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:54.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.088+0000 7f5739ffb700 1 -- 172.21.15.83:0/3929301099 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f5728097150 con 0x7f573c1026f0 2024-04-01T06:57:54.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.350+0000 7f574324f700 1 -- 172.21.15.83:0/3929301099 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f573c0698b0 con 0x7f573c1026f0 2024-04-01T06:57:54.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.351+0000 7f5739ffb700 1 -- 172.21.15.83:0/3929301099 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+10880 (secure 0 0 0) 0x7f572809a770 con 0x7f573c1026f0 2024-04-01T06:57:54.350 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:57:54.351 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1271130478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1271130478},{"type":"v1","addr":"172.21.15.83:6835","nonce":1271130478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2412682983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2412682983},{"type":"v1","addr":"172.21.15.83:6837","nonce":2412682983}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6839/3348145990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":3348145990},{"type":"v1","addr":"172.21.15.83:6839","nonce":3348145990}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6841/1191267445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6840","nonce":1191267445},{"type":"v1","addr":"172.21.15.83:6841","nonce":1191267445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2467459028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2467459028},{"type":"v1","addr":"172.21.15.153:6833","nonce":2467459028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24448,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4092629042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":4092629042},{"type":"v1","addr":"172.21.15.153:6835","nonce":4092629042}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-01T06:54:28.397062+0000","modified":"2024-04-01T06:57:35.739239+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24524,"mds_1":24494,"mds_2":24473},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6833/647005844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":647005844},{"type":"v1","addr":"172.21.15.145:6833","nonce":647005844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24454":{"gid":24454,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6837/1993816527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1993816527},{"type":"v1","addr":"172.21.15.153:6837","nonce":1993816527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24473":{"gid":24473,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.145:6835/3104241497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":3104241497},{"type":"v1","addr":"172.21.15.145:6835","nonce":3104241497}]},"join_fscid":-1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24494":{"gid":24494,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.145:6837/2687798317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2687798317},{"type":"v1","addr":"172.21.15.145:6837","nonce":2687798317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6839/3886435411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3886435411},{"type":"v1","addr":"172.21.15.145:6839","nonce":3886435411}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_25273":{"gid":25273,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6839/2570595837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":2570595837},{"type":"v1","addr":"172.21.15.153:6839","nonce":2570595837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-01T06:57:54.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.353+0000 7f574324f700 1 -- 172.21.15.83:0/3929301099 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f572c0a1310 msgr2=0x7f572c0a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:54.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.353+0000 7f574324f700 1 --2- 172.21.15.83:0/3929301099 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f572c0a1310 0x7f572c0a37d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5730009d00 tx=0x7f5730009260 comp rx=0 tx=0).stop 2024-04-01T06:57:54.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.353+0000 7f574324f700 1 -- 172.21.15.83:0/3929301099 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f573c1026f0 msgr2=0x7f573c197660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:54.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.353+0000 7f574324f700 1 --2- 172.21.15.83:0/3929301099 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f573c1026f0 0x7f573c197660 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f5728000c00 tx=0x7f5728004730 comp rx=0 tx=0).stop 2024-04-01T06:57:54.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.353+0000 7f574324f700 1 -- 172.21.15.83:0/3929301099 shutdown_connections 2024-04-01T06:57:54.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.353+0000 7f574324f700 1 --2- 172.21.15.83:0/3929301099 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f572c0a1310 0x7f572c0a37d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.353+0000 7f574324f700 1 --2- 172.21.15.83:0/3929301099 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f573c10b1f0 0x7f573c19ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.353+0000 7f574324f700 1 --2- 172.21.15.83:0/3929301099 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f573c101dd0 0x7f573c197120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.353+0000 7f574324f700 1 --2- 172.21.15.83:0/3929301099 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f573c1026f0 0x7f573c197660 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.353+0000 7f574324f700 1 -- 172.21.15.83:0/3929301099 >> 172.21.15.83:0/3929301099 conn(0x7f573c0fb5f0 msgr2=0x7f573c0fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:54.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.353+0000 7f574324f700 1 -- 172.21.15.83:0/3929301099 shutdown_connections 2024-04-01T06:57:54.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.353+0000 7f574324f700 1 -- 172.21.15.83:0/3929301099 wait complete. 2024-04-01T06:57:54.354 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 28 2024-04-01T06:57:54.366 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-01T06:57:54.366 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-01T06:57:54.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.493+0000 7f6026301700 1 -- 172.21.15.83:0/147016262 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60200ffe40 msgr2=0x7f6020105970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:54.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.493+0000 7f6026301700 1 --2- 172.21.15.83:0/147016262 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60200ffe40 0x7f6020105970 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f6014009990 tx=0x7f6014009ca0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.493+0000 7f6026301700 1 -- 172.21.15.83:0/147016262 shutdown_connections 2024-04-01T06:57:54.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.493+0000 7f6026301700 1 --2- 172.21.15.83:0/147016262 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6020106050 0x7f602010dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.493+0000 7f6026301700 1 --2- 172.21.15.83:0/147016262 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f60200ff490 0x7f60200ff870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.493+0000 7f6026301700 1 --2- 172.21.15.83:0/147016262 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60200ffe40 0x7f6020105970 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.493+0000 7f6026301700 1 -- 172.21.15.83:0/147016262 >> 172.21.15.83:0/147016262 conn(0x7f60200761e0 msgr2=0x7f60200fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:54.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.493+0000 7f6026301700 1 -- 172.21.15.83:0/147016262 shutdown_connections 2024-04-01T06:57:54.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.493+0000 7f6026301700 1 -- 172.21.15.83:0/147016262 wait complete. 2024-04-01T06:57:54.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.494+0000 7f6026301700 1 Processor -- start 2024-04-01T06:57:54.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.494+0000 7f6026301700 1 -- start start 2024-04-01T06:57:54.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.494+0000 7f6026301700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60200ff490 0x7f6020100400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.494+0000 7f6026301700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6020106050 0x7f6020100940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.494+0000 7f6026301700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6020100e80 0x7f60201a5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.494+0000 7f6026301700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60201a5a00 con 0x7f60200ff490 2024-04-01T06:57:54.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.494+0000 7f6026301700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60201a5b40 con 0x7f6020100e80 2024-04-01T06:57:54.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.494+0000 7f6026301700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60201a5d00 con 0x7f6020106050 2024-04-01T06:57:54.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.494+0000 7f601ffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60200ff490 0x7f6020100400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.494+0000 7f601ffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60200ff490 0x7f6020100400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:60788/0 (socket says 172.21.15.83:60788) 2024-04-01T06:57:54.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.494+0000 7f601ffff700 1 -- 172.21.15.83:0/3136112533 learned_addr learned my addr 172.21.15.83:0/3136112533 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:54.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.494+0000 7f601f7fe700 1 --2- 172.21.15.83:0/3136112533 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6020106050 0x7f6020100940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.494+0000 7f602489e700 1 --2- 172.21.15.83:0/3136112533 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6020100e80 0x7f60201a5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.494+0000 7f601ffff700 1 -- 172.21.15.83:0/3136112533 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6020106050 msgr2=0x7f6020100940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:54.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.494+0000 7f601ffff700 1 --2- 172.21.15.83:0/3136112533 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6020106050 0x7f6020100940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.494+0000 7f601ffff700 1 -- 172.21.15.83:0/3136112533 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6020100e80 msgr2=0x7f60201a5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:54.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.494+0000 7f601ffff700 1 --2- 172.21.15.83:0/3136112533 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6020100e80 0x7f60201a5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.494+0000 7f601ffff700 1 -- 172.21.15.83:0/3136112533 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60140095f0 con 0x7f60200ff490 2024-04-01T06:57:54.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.495+0000 7f601ffff700 1 --2- 172.21.15.83:0/3136112533 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60200ff490 0x7f6020100400 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f601000e9a0 tx=0x7f601000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:54.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.495+0000 7f601d7fa700 1 -- 172.21.15.83:0/3136112533 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6010009790 con 0x7f60200ff490 2024-04-01T06:57:54.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.495+0000 7f6026301700 1 -- 172.21.15.83:0/3136112533 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60201a5fe0 con 0x7f60200ff490 2024-04-01T06:57:54.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.495+0000 7f601d7fa700 1 -- 172.21.15.83:0/3136112533 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6010010430 con 0x7f60200ff490 2024-04-01T06:57:54.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.495+0000 7f601d7fa700 1 -- 172.21.15.83:0/3136112533 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6010018680 con 0x7f60200ff490 2024-04-01T06:57:54.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.495+0000 7f6026301700 1 -- 172.21.15.83:0/3136112533 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60201a6410 con 0x7f60200ff490 2024-04-01T06:57:54.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.497+0000 7f601d7fa700 1 -- 172.21.15.83:0/3136112533 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 25) v1 ==== 135996+0+0 (secure 0 0 0) 0x7f60100105a0 con 0x7f60200ff490 2024-04-01T06:57:54.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.497+0000 7f601d7fa700 1 --2- 172.21.15.83:0/3136112533 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f60080a1290 0x7f60080a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.498+0000 7f601f7fe700 1 --2- 172.21.15.83:0/3136112533 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f60080a1290 0x7f60080a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.498+0000 7f601d7fa700 1 -- 172.21.15.83:0/3136112533 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f6010014070 con 0x7f60200ff490 2024-04-01T06:57:54.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.498+0000 7f601f7fe700 1 --2- 172.21.15.83:0/3136112533 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f60080a1290 0x7f60080a3750 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f60140059d0 tx=0x7f6014005960 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:54.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.499+0000 7f6032497b80 1 Processor -- start 2024-04-01T06:57:54.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.499+0000 7f6032497b80 1 -- start start 2024-04-01T06:57:54.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.499+0000 7f6032497b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a37d54f5d0 0x55a37d54f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.499+0000 7f6032497b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a37d54fef0 0x55a37d55a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.499+0000 7f6032497b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a37d55adf0 0x55a37d55d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.499+0000 7f6032497b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a37d4a8990 con 0x55a37d54fef0 2024-04-01T06:57:54.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.499+0000 7f6032497b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a37d4a6350 con 0x55a37d54f5d0 2024-04-01T06:57:54.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.499+0000 7f6032497b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a37d4a1c40 con 0x55a37d55adf0 2024-04-01T06:57:54.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.499+0000 7f601f7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a37d54fef0 0x55a37d55a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.499+0000 7f601f7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a37d54fef0 0x55a37d55a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:60798/0 (socket says 172.21.15.83:60798) 2024-04-01T06:57:54.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.499+0000 7f601f7fe700 1 -- 172.21.15.83:0/3106529415 learned_addr learned my addr 172.21.15.83:0/3106529415 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:54.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.499+0000 7f601ffff700 1 --2- 172.21.15.83:0/3106529415 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a37d54f5d0 0x55a37d54f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.499+0000 7f602489e700 1 --2- 172.21.15.83:0/3106529415 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a37d55adf0 0x55a37d55d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.499+0000 7f601f7fe700 1 -- 172.21.15.83:0/3106529415 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a37d55adf0 msgr2=0x55a37d55d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:54.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.499+0000 7f601f7fe700 1 --2- 172.21.15.83:0/3106529415 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a37d55adf0 0x55a37d55d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.499+0000 7f601f7fe700 1 -- 172.21.15.83:0/3106529415 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a37d54f5d0 msgr2=0x55a37d54f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:54.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.499+0000 7f601f7fe700 1 --2- 172.21.15.83:0/3106529415 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a37d54f5d0 0x55a37d54f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.499+0000 7f601f7fe700 1 -- 172.21.15.83:0/3106529415 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a37d3233b0 con 0x55a37d54fef0 2024-04-01T06:57:54.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.499+0000 7f601ffff700 1 --2- 172.21.15.83:0/3106529415 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a37d54f5d0 0x55a37d54f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T06:57:54.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.499+0000 7f601f7fe700 1 --2- 172.21.15.83:0/3106529415 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a37d54fef0 0x55a37d55a8b0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f6014005090 tx=0x7f6014020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b92f2028a5396ef server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:54.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.499+0000 7f60067fc700 1 -- 172.21.15.83:0/3106529415 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6014004700 con 0x55a37d54fef0 2024-04-01T06:57:54.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.500+0000 7f60067fc700 1 -- 172.21.15.83:0/3106529415 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f601401e040 con 0x55a37d54fef0 2024-04-01T06:57:54.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.500+0000 7f60067fc700 1 -- 172.21.15.83:0/3106529415 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601400f930 con 0x55a37d54fef0 2024-04-01T06:57:54.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.500+0000 7f6032497b80 1 -- 172.21.15.83:0/3106529415 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a37d54fef0 msgr2=0x55a37d55a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:54.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.500+0000 7f6032497b80 1 --2- 172.21.15.83:0/3106529415 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a37d54fef0 0x55a37d55a8b0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f6014005090 tx=0x7f6014020000 comp rx=0 tx=0).stop 2024-04-01T06:57:54.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.500+0000 7f6032497b80 1 -- 172.21.15.83:0/3106529415 shutdown_connections 2024-04-01T06:57:54.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.500+0000 7f6032497b80 1 --2- 172.21.15.83:0/3106529415 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a37d55adf0 0x55a37d55d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.500+0000 7f6032497b80 1 --2- 172.21.15.83:0/3106529415 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a37d54f5d0 0x55a37d54f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.500+0000 7f6032497b80 1 --2- 172.21.15.83:0/3106529415 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a37d54fef0 0x55a37d55a8b0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.500+0000 7f6032497b80 1 -- 172.21.15.83:0/3106529415 >> 172.21.15.83:0/3106529415 conn(0x55a37d4af6a0 msgr2=0x55a37d54ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:54.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.500+0000 7f6032497b80 1 -- 172.21.15.83:0/3106529415 shutdown_connections 2024-04-01T06:57:54.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.500+0000 7f6032497b80 1 -- 172.21.15.83:0/3106529415 wait complete. 2024-04-01T06:57:54.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.501+0000 7f6032497b80 1 -- start start 2024-04-01T06:57:54.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.501+0000 7f6032497b80 1 Processor -- start 2024-04-01T06:57:54.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.501+0000 7f6032497b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a37d54f5d0 0x55a37d55a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.501+0000 7f6032497b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a37d54fef0 0x55a37d557b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.501+0000 7f6032497b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a37d55adf0 0x55a37d558250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.501+0000 7f6032497b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a37d43dd80 con 0x55a37d54fef0 2024-04-01T06:57:54.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.501+0000 7f6032497b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a37d43da20 con 0x55a37d55adf0 2024-04-01T06:57:54.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.501+0000 7f6032497b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a37d3256a0 con 0x55a37d54f5d0 2024-04-01T06:57:54.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.501+0000 7f6032497b80 10 client.0 _ll_register_callbacks cb 0x55a37d447470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:57:54.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.501+0000 7f601f7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a37d54fef0 0x55a37d557b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.501+0000 7f601f7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a37d54fef0 0x55a37d557b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:60800/0 (socket says 172.21.15.83:60800) 2024-04-01T06:57:54.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.501+0000 7f601f7fe700 1 -- 172.21.15.83:0/1088778073 learned_addr learned my addr 172.21.15.83:0/1088778073 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:54.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.501+0000 7f602489e700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a37d55adf0 0x55a37d558250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.501+0000 7f601ffff700 1 --2- 172.21.15.83:0/1088778073 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a37d54f5d0 0x55a37d55a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.502+0000 7f601f7fe700 1 -- 172.21.15.83:0/1088778073 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a37d54f5d0 msgr2=0x55a37d55a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:54.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.502+0000 7f601f7fe700 1 --2- 172.21.15.83:0/1088778073 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a37d54f5d0 0x55a37d55a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.502+0000 7f601f7fe700 1 -- 172.21.15.83:0/1088778073 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a37d55adf0 msgr2=0x55a37d558250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:54.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.502+0000 7f601f7fe700 1 --2- 172.21.15.83:0/1088778073 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a37d55adf0 0x55a37d558250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.502+0000 7f601f7fe700 1 -- 172.21.15.83:0/1088778073 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60201a6410 con 0x55a37d54fef0 2024-04-01T06:57:54.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.502+0000 7f602489e700 1 --2- 172.21.15.83:0/1088778073 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a37d55adf0 0x55a37d558250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T06:57:54.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.502+0000 7f601f7fe700 1 --2- 172.21.15.83:0/1088778073 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a37d54fef0 0x55a37d557b60 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f6014009350 tx=0x7f601400fcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c86cd2549f196800 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:54.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.502+0000 7f5fff7fe700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:57:54.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.502+0000 7f5fff7fe700 1 -- 172.21.15.83:0/1088778073 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60140055b0 con 0x55a37d54fef0 2024-04-01T06:57:54.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.502+0000 7f5fff7fe700 1 -- 172.21.15.83:0/1088778073 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f6014004910 con 0x55a37d54fef0 2024-04-01T06:57:54.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.502+0000 7f6032497b80 1 -- 172.21.15.83:0/1088778073 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a37d462380 con 0x55a37d54fef0 2024-04-01T06:57:54.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.502+0000 7f5fff7fe700 1 -- 172.21.15.83:0/1088778073 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6014004ad0 con 0x55a37d54fef0 2024-04-01T06:57:54.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.502+0000 7f6032497b80 10 client.16005 fetch_fsmap learned FSMap version 28 2024-04-01T06:57:54.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.502+0000 7f6032497b80 1 -- 172.21.15.83:0/1088778073 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x7f602010e460 con 0x55a37d54fef0 2024-04-01T06:57:54.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.502+0000 7f5fff7fe700 1 -- 172.21.15.83:0/1088778073 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a37d462380 con 0x55a37d54fef0 2024-04-01T06:57:54.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.502+0000 7f5fff7fe700 1 -- 172.21.15.83:0/1088778073 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 28) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f6014024bd0 con 0x55a37d54fef0 2024-04-01T06:57:54.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.502+0000 7f6032497b80 10 client.16005 fetch_fsmap finished waiting for FSMap version 28 2024-04-01T06:57:54.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.502+0000 7f6032497b80 10 client.16005 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.e 2024-04-01T06:57:54.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.503+0000 7f6032497b80 20 client.16005 populate_metadata read hostname 'smithi083' 2024-04-01T06:57:54.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.503+0000 7f6032497b80 1 --2- 172.21.15.83:0/1088778073 >> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] conn(0x55a37d56a540 0x55a37d56c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.503+0000 7f6032497b80 4 client.16005 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-01T06:57:54.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.503+0000 7f6032497b80 1 -- 172.21.15.83:0/1088778073 --> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a37d49a700 con 0x55a37d56a540 2024-04-01T06:57:54.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.503+0000 7f601ffff700 1 --2- 172.21.15.83:0/1088778073 >> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] conn(0x55a37d56a540 0x55a37d56c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.503+0000 7f601ffff700 1 --2- 172.21.15.83:0/1088778073 >> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] conn(0x55a37d56a540 0x55a37d56c930 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f10948236c9cce24 server_cookie=134fb9d6e125129c in_seq=0 out_seq=0 2024-04-01T06:57:54.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.503+0000 7f5fff7fe700 10 client.16005 ms_handle_connect on v2:172.21.15.145:6834/3104241497 2024-04-01T06:57:54.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.504+0000 7f5fff7fe700 1 -- 172.21.15.83:0/1088778073 <== mds.2 v2:172.21.15.145:6834/3104241497 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a37d49a700 con 0x55a37d56a540 2024-04-01T06:57:54.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.504+0000 7f5fff7fe700 10 client.16005 handle_command_reply: tid=0 2024-04-01T06:57:54.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.504+0000 7f6032497b80 1 client.16005 shutdown 2024-04-01T06:57:54.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.504+0000 7f6032497b80 1 -- 172.21.15.83:0/1088778073 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a37d54fef0 msgr2=0x55a37d557b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:54.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.504+0000 7f6032497b80 1 --2- 172.21.15.83:0/1088778073 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a37d54fef0 0x55a37d557b60 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f6014009350 tx=0x7f601400fcd0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.504+0000 7f6032497b80 1 -- 172.21.15.83:0/1088778073 shutdown_connections 2024-04-01T06:57:54.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.504+0000 7f6032497b80 1 --2- 172.21.15.83:0/1088778073 >> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] conn(0x55a37d56a540 0x55a37d56c930 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.504+0000 7f6032497b80 1 --2- 172.21.15.83:0/1088778073 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a37d55adf0 0x55a37d558250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.504+0000 7f6032497b80 1 --2- 172.21.15.83:0/1088778073 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a37d54f5d0 0x55a37d55a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.504+0000 7f5fff7fe700 0 client.16005 ms_handle_reset on v2:172.21.15.145:6834/3104241497 2024-04-01T06:57:54.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.504+0000 7f6032497b80 1 --2- 172.21.15.83:0/1088778073 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a37d54fef0 0x55a37d557b60 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.504+0000 7f6032497b80 1 -- 172.21.15.83:0/1088778073 >> 172.21.15.83:0/1088778073 conn(0x55a37d4af6a0 msgr2=0x55a37d551690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:54.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.504+0000 7f6032497b80 1 -- 172.21.15.83:0/1088778073 shutdown_connections 2024-04-01T06:57:54.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.504+0000 7f6032497b80 1 -- 172.21.15.83:0/1088778073 wait complete. 2024-04-01T06:57:54.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.505+0000 7f6032497b80 20 client.16005 trim_cache size 0 max 16384 2024-04-01T06:57:54.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.517+0000 7f6032497b80 1 Processor -- start 2024-04-01T06:57:54.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.517+0000 7f6032497b80 1 -- start start 2024-04-01T06:57:54.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.517+0000 7f6032497b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a37d54f5d0 0x55a37d5525e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.517+0000 7f6032497b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a37d54fef0 0x55a37d561a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.517+0000 7f6032497b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a37d55adf0 0x55a37d5445a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.517+0000 7f6032497b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a37d5560f0 con 0x55a37d54fef0 2024-04-01T06:57:54.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.517+0000 7f6032497b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a37d544ae0 con 0x55a37d55adf0 2024-04-01T06:57:54.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.517+0000 7f6032497b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a37d558850 con 0x55a37d54f5d0 2024-04-01T06:57:54.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.518+0000 7f601f7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a37d54fef0 0x55a37d561a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.518+0000 7f601f7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a37d54fef0 0x55a37d561a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:60812/0 (socket says 172.21.15.83:60812) 2024-04-01T06:57:54.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.518+0000 7f601f7fe700 1 -- 172.21.15.83:0/293865454 learned_addr learned my addr 172.21.15.83:0/293865454 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:54.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.518+0000 7f602489e700 1 --2- 172.21.15.83:0/293865454 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a37d55adf0 0x55a37d5445a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.518+0000 7f601ffff700 1 --2- 172.21.15.83:0/293865454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a37d54f5d0 0x55a37d5525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.518+0000 7f601f7fe700 1 -- 172.21.15.83:0/293865454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a37d54f5d0 msgr2=0x55a37d5525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:54.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.518+0000 7f601f7fe700 1 --2- 172.21.15.83:0/293865454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a37d54f5d0 0x55a37d5525e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.518+0000 7f601f7fe700 1 -- 172.21.15.83:0/293865454 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a37d55adf0 msgr2=0x55a37d5445a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:54.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.518+0000 7f601f7fe700 1 --2- 172.21.15.83:0/293865454 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a37d55adf0 0x55a37d5445a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.518+0000 7f601f7fe700 1 -- 172.21.15.83:0/293865454 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a37d2cfb60 con 0x55a37d54fef0 2024-04-01T06:57:54.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.518+0000 7f601f7fe700 1 --2- 172.21.15.83:0/293865454 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a37d54fef0 0x55a37d561a40 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f6014005f50 tx=0x7f601400f4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2420169b5cd88228 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:54.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.518+0000 7f6006ffd700 1 -- 172.21.15.83:0/293865454 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6014018450 con 0x55a37d54fef0 2024-04-01T06:57:54.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.518+0000 7f6006ffd700 1 -- 172.21.15.83:0/293865454 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6014004bd0 con 0x55a37d54fef0 2024-04-01T06:57:54.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.518+0000 7f6006ffd700 1 -- 172.21.15.83:0/293865454 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6014018d60 con 0x55a37d54fef0 2024-04-01T06:57:54.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.519+0000 7f6032497b80 1 -- 172.21.15.83:0/293865454 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a37d54fef0 msgr2=0x55a37d561a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:54.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.519+0000 7f6032497b80 1 --2- 172.21.15.83:0/293865454 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a37d54fef0 0x55a37d561a40 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f6014005f50 tx=0x7f601400f4b0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.519+0000 7f6032497b80 1 -- 172.21.15.83:0/293865454 shutdown_connections 2024-04-01T06:57:54.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.519+0000 7f6032497b80 1 --2- 172.21.15.83:0/293865454 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a37d55adf0 0x55a37d5445a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.519+0000 7f6032497b80 1 --2- 172.21.15.83:0/293865454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a37d54f5d0 0x55a37d5525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.519+0000 7f6032497b80 1 --2- 172.21.15.83:0/293865454 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a37d54fef0 0x55a37d561a40 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.519+0000 7f6032497b80 1 -- 172.21.15.83:0/293865454 >> 172.21.15.83:0/293865454 conn(0x55a37d4af6a0 msgr2=0x55a37d571220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:54.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.519+0000 7f6032497b80 1 -- 172.21.15.83:0/293865454 shutdown_connections 2024-04-01T06:57:54.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.519+0000 7f6032497b80 1 -- 172.21.15.83:0/293865454 wait complete. 2024-04-01T06:57:54.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.519+0000 7f6032497b80 1 -- start start 2024-04-01T06:57:54.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.519+0000 7f6032497b80 1 Processor -- start 2024-04-01T06:57:54.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.520+0000 7f6032497b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a37d54f5d0 0x55a37d55fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.520+0000 7f6032497b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a37d54fef0 0x55a37d55ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.520+0000 7f6032497b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a37d55adf0 0x55a37d5604a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.520+0000 7f6032497b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a37d561dd0 con 0x55a37d54fef0 2024-04-01T06:57:54.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.520+0000 7f6032497b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a37d5bd2d0 con 0x55a37d54f5d0 2024-04-01T06:57:54.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.520+0000 7f6032497b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a37d5bd460 con 0x55a37d55adf0 2024-04-01T06:57:54.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.520+0000 7f6032497b80 10 client.0 _ll_register_callbacks cb 0x55a37d447470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:57:54.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.520+0000 7f601f7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a37d54fef0 0x55a37d55ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.520+0000 7f601f7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a37d54fef0 0x55a37d55ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:60820/0 (socket says 172.21.15.83:60820) 2024-04-01T06:57:54.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.520+0000 7f601f7fe700 1 -- 172.21.15.83:0/1112456203 learned_addr learned my addr 172.21.15.83:0/1112456203 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:54.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.520+0000 7f601ffff700 1 --2- 172.21.15.83:0/1112456203 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a37d54f5d0 0x55a37d55fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.520+0000 7f602489e700 1 --2- 172.21.15.83:0/1112456203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a37d55adf0 0x55a37d5604a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.520+0000 7f601f7fe700 1 -- 172.21.15.83:0/1112456203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a37d55adf0 msgr2=0x55a37d5604a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:54.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.520+0000 7f601f7fe700 1 --2- 172.21.15.83:0/1112456203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a37d55adf0 0x55a37d5604a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.520+0000 7f601f7fe700 1 -- 172.21.15.83:0/1112456203 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a37d54f5d0 msgr2=0x55a37d55fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:54.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.520+0000 7f601f7fe700 1 --2- 172.21.15.83:0/1112456203 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a37d54f5d0 0x55a37d55fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.520+0000 7f601f7fe700 1 -- 172.21.15.83:0/1112456203 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f602010e460 con 0x55a37d54fef0 2024-04-01T06:57:54.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.520+0000 7f601f7fe700 1 --2- 172.21.15.83:0/1112456203 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a37d54fef0 0x55a37d55ff60 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f6014031000 tx=0x7f601400f900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abe3760d152b8443 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:54.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.520+0000 7f5fff7fe700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:57:54.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.520+0000 7f5fff7fe700 1 -- 172.21.15.83:0/1112456203 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601400e7f0 con 0x55a37d54fef0 2024-04-01T06:57:54.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.520+0000 7f5fff7fe700 1 -- 172.21.15.83:0/1112456203 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f601400e950 con 0x55a37d54fef0 2024-04-01T06:57:54.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.520+0000 7f6032497b80 1 -- 172.21.15.83:0/1112456203 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f601401e040 con 0x55a37d54fef0 2024-04-01T06:57:54.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.520+0000 7f5fff7fe700 1 -- 172.21.15.83:0/1112456203 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f601400eb10 con 0x55a37d54fef0 2024-04-01T06:57:54.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.520+0000 7f6032497b80 10 client.16011 fetch_fsmap learned FSMap version 28 2024-04-01T06:57:54.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.521+0000 7f6032497b80 1 -- 172.21.15.83:0/1112456203 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55a37d467ea0 con 0x55a37d54fef0 2024-04-01T06:57:54.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.521+0000 7f5fff7fe700 1 -- 172.21.15.83:0/1112456203 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f601401e040 con 0x55a37d54fef0 2024-04-01T06:57:54.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.521+0000 7f5fff7fe700 1 -- 172.21.15.83:0/1112456203 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 28) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f6014044450 con 0x55a37d54fef0 2024-04-01T06:57:54.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.521+0000 7f6032497b80 10 client.16011 fetch_fsmap finished waiting for FSMap version 28 2024-04-01T06:57:54.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.521+0000 7f6032497b80 10 client.16011 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.e 2024-04-01T06:57:54.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.521+0000 7f6032497b80 20 client.16011 populate_metadata read hostname 'smithi083' 2024-04-01T06:57:54.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.521+0000 7f6032497b80 1 --2- 172.21.15.83:0/1112456203 >> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] conn(0x55a37d5be7d0 0x55a37d5c0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.521+0000 7f6032497b80 4 client.16011 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-01T06:57:54.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.521+0000 7f6032497b80 1 -- 172.21.15.83:0/1112456203 --> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55a37d2f0cf0 con 0x55a37d5be7d0 2024-04-01T06:57:54.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.521+0000 7f601ffff700 1 --2- 172.21.15.83:0/1112456203 >> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] conn(0x55a37d5be7d0 0x55a37d5c0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.521+0000 7f5fff7fe700 10 client.16011 ms_handle_connect on v2:172.21.15.145:6834/3104241497 2024-04-01T06:57:54.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.521+0000 7f601ffff700 1 --2- 172.21.15.83:0/1112456203 >> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] conn(0x55a37d5be7d0 0x55a37d5c0bf0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f10d938fa072df60 server_cookie=67155319b5b1c3da in_seq=0 out_seq=0 2024-04-01T06:57:54.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.522+0000 7f5fff7fe700 1 -- 172.21.15.83:0/1112456203 <== mds.2 v2:172.21.15.145:6834/3104241497 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55a37d2f0cf0 con 0x55a37d5be7d0 2024-04-01T06:57:54.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.522+0000 7f5fff7fe700 10 client.16011 handle_command_reply: tid=0 2024-04-01T06:57:54.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.522+0000 7f6032497b80 1 client.16011 shutdown 2024-04-01T06:57:54.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.522+0000 7f6032497b80 1 -- 172.21.15.83:0/1112456203 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a37d54fef0 msgr2=0x55a37d55ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:54.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.522+0000 7f6032497b80 1 --2- 172.21.15.83:0/1112456203 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a37d54fef0 0x55a37d55ff60 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f6014031000 tx=0x7f601400f900 comp rx=0 tx=0).stop 2024-04-01T06:57:54.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.522+0000 7f6032497b80 1 -- 172.21.15.83:0/1112456203 shutdown_connections 2024-04-01T06:57:54.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.522+0000 7f6032497b80 1 --2- 172.21.15.83:0/1112456203 >> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] conn(0x55a37d5be7d0 0x55a37d5c0bf0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.522+0000 7f6032497b80 1 --2- 172.21.15.83:0/1112456203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a37d55adf0 0x55a37d5604a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.522+0000 7f5fff7fe700 0 client.16011 ms_handle_reset on v2:172.21.15.145:6834/3104241497 2024-04-01T06:57:54.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.522+0000 7f6032497b80 1 --2- 172.21.15.83:0/1112456203 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a37d54f5d0 0x55a37d55fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.522+0000 7f6032497b80 1 --2- 172.21.15.83:0/1112456203 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a37d54fef0 0x55a37d55ff60 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.522+0000 7f6032497b80 1 -- 172.21.15.83:0/1112456203 >> 172.21.15.83:0/1112456203 conn(0x55a37d4af6a0 msgr2=0x55a37d5573f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:54.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.522+0000 7f6032497b80 1 -- 172.21.15.83:0/1112456203 shutdown_connections 2024-04-01T06:57:54.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.522+0000 7f6032497b80 1 -- 172.21.15.83:0/1112456203 wait complete. 2024-04-01T06:57:54.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.522+0000 7f6032497b80 20 client.16011 trim_cache size 0 max 16384 2024-04-01T06:57:54.528 INFO:teuthology.orchestra.run.smithi083.stdout:[] 2024-04-01T06:57:54.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.522+0000 7f6026301700 1 -- 172.21.15.83:0/3136112533 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f60080a1290 msgr2=0x7f60080a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:54.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.522+0000 7f6026301700 1 --2- 172.21.15.83:0/3136112533 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f60080a1290 0x7f60080a3750 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f60140059d0 tx=0x7f6014005960 comp rx=0 tx=0).stop 2024-04-01T06:57:54.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.522+0000 7f6026301700 1 -- 172.21.15.83:0/3136112533 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60200ff490 msgr2=0x7f6020100400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:54.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.522+0000 7f6026301700 1 --2- 172.21.15.83:0/3136112533 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60200ff490 0x7f6020100400 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f601000e9a0 tx=0x7f601000ecb0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.523+0000 7f6026301700 1 -- 172.21.15.83:0/3136112533 shutdown_connections 2024-04-01T06:57:54.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.523+0000 7f6026301700 1 --2- 172.21.15.83:0/3136112533 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f60080a1290 0x7f60080a3750 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.523+0000 7f6026301700 1 --2- 172.21.15.83:0/3136112533 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60200ff490 0x7f6020100400 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.523+0000 7f6026301700 1 --2- 172.21.15.83:0/3136112533 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6020100e80 0x7f60201a5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.523+0000 7f6026301700 1 --2- 172.21.15.83:0/3136112533 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6020106050 0x7f6020100940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.523+0000 7f6026301700 1 -- 172.21.15.83:0/3136112533 >> 172.21.15.83:0/3136112533 conn(0x7f60200761e0 msgr2=0x7f6020104580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:54.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.523+0000 7f6026301700 1 -- 172.21.15.83:0/3136112533 shutdown_connections 2024-04-01T06:57:54.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.523+0000 7f6026301700 1 -- 172.21.15.83:0/3136112533 wait complete. 2024-04-01T06:57:54.534 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-01T06:57:54.534 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-01T06:57:54.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.663+0000 7f3b57668700 1 -- 172.21.15.83:0/1741702167 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b50104f60 msgr2=0x7f3b5010cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:54.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.663+0000 7f3b57668700 1 --2- 172.21.15.83:0/1741702167 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b50104f60 0x7f3b5010cae0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f3b4800b0a0 tx=0x7f3b4800b3b0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.663+0000 7f3b57668700 1 -- 172.21.15.83:0/1741702167 shutdown_connections 2024-04-01T06:57:54.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.663+0000 7f3b57668700 1 --2- 172.21.15.83:0/1741702167 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b50104f60 0x7f3b5010cae0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.663+0000 7f3b57668700 1 --2- 172.21.15.83:0/1741702167 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b500ffe50 0x7f3b50100230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.663+0000 7f3b57668700 1 --2- 172.21.15.83:0/1741702167 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b50100800 0x7f3b50104830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.663+0000 7f3b57668700 1 -- 172.21.15.83:0/1741702167 >> 172.21.15.83:0/1741702167 conn(0x7f3b50076d40 msgr2=0x7f3b50077150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:54.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.663+0000 7f3b57668700 1 -- 172.21.15.83:0/1741702167 shutdown_connections 2024-04-01T06:57:54.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.663+0000 7f3b57668700 1 -- 172.21.15.83:0/1741702167 wait complete. 2024-04-01T06:57:54.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.663+0000 7f3b57668700 1 Processor -- start 2024-04-01T06:57:54.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.663+0000 7f3b57668700 1 -- start start 2024-04-01T06:57:54.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.664+0000 7f3b57668700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b500ffe50 0x7f3b50195f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.664+0000 7f3b57668700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b50104f60 0x7f3b501964a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.664+0000 7f3b57668700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b501969e0 0x7f3b501a55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.664+0000 7f3b57668700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b501a5b20 con 0x7f3b501969e0 2024-04-01T06:57:54.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.664+0000 7f3b57668700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b501a5c60 con 0x7f3b500ffe50 2024-04-01T06:57:54.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.664+0000 7f3b57668700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b501a5da0 con 0x7f3b50104f60 2024-04-01T06:57:54.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.664+0000 7f3b55c05700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b501969e0 0x7f3b501a55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.664+0000 7f3b55c05700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b501969e0 0x7f3b501a55e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:60844/0 (socket says 172.21.15.83:60844) 2024-04-01T06:57:54.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.664+0000 7f3b55c05700 1 -- 172.21.15.83:0/2664927094 learned_addr learned my addr 172.21.15.83:0/2664927094 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:54.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.664+0000 7f3b55404700 1 --2- 172.21.15.83:0/2664927094 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b500ffe50 0x7f3b50195f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.664+0000 7f3b54c03700 1 --2- 172.21.15.83:0/2664927094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b50104f60 0x7f3b501964a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.664+0000 7f3b55c05700 1 -- 172.21.15.83:0/2664927094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b50104f60 msgr2=0x7f3b501964a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:54.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.664+0000 7f3b55c05700 1 --2- 172.21.15.83:0/2664927094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b50104f60 0x7f3b501964a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.664+0000 7f3b55c05700 1 -- 172.21.15.83:0/2664927094 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b500ffe50 msgr2=0x7f3b50195f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:54.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.664+0000 7f3b55c05700 1 --2- 172.21.15.83:0/2664927094 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b500ffe50 0x7f3b50195f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.664+0000 7f3b55c05700 1 -- 172.21.15.83:0/2664927094 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b48009d00 con 0x7f3b501969e0 2024-04-01T06:57:54.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.664+0000 7f3b55c05700 1 --2- 172.21.15.83:0/2664927094 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b501969e0 0x7f3b501a55e0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f3b48006130 tx=0x7f3b48009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:54.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.664+0000 7f3b467fc700 1 -- 172.21.15.83:0/2664927094 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4800e040 con 0x7f3b501969e0 2024-04-01T06:57:54.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.664+0000 7f3b467fc700 1 -- 172.21.15.83:0/2664927094 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3b48004e40 con 0x7f3b501969e0 2024-04-01T06:57:54.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.664+0000 7f3b57668700 1 -- 172.21.15.83:0/2664927094 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b501a6020 con 0x7f3b501969e0 2024-04-01T06:57:54.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.664+0000 7f3b467fc700 1 -- 172.21.15.83:0/2664927094 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4801b6b0 con 0x7f3b501969e0 2024-04-01T06:57:54.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.664+0000 7f3b57668700 1 -- 172.21.15.83:0/2664927094 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b501a64a0 con 0x7f3b501969e0 2024-04-01T06:57:54.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.666+0000 7f3b467fc700 1 -- 172.21.15.83:0/2664927094 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 25) v1 ==== 135996+0+0 (secure 0 0 0) 0x7f3b4801d480 con 0x7f3b501969e0 2024-04-01T06:57:54.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.667+0000 7f3b467fc700 1 --2- 172.21.15.83:0/2664927094 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f3b3c0a1290 0x7f3b3c0a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.667+0000 7f3b55404700 1 --2- 172.21.15.83:0/2664927094 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f3b3c0a1290 0x7f3b3c0a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.667+0000 7f3b467fc700 1 -- 172.21.15.83:0/2664927094 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f3b480ce530 con 0x7f3b501969e0 2024-04-01T06:57:54.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.667+0000 7f3b55404700 1 --2- 172.21.15.83:0/2664927094 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f3b3c0a1290 0x7f3b3c0a3750 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c005950 tx=0x7f3b4c00b410 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:54.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.668+0000 7f3b637feb80 1 Processor -- start 2024-04-01T06:57:54.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.668+0000 7f3b637feb80 1 -- start start 2024-04-01T06:57:54.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.669+0000 7f3b637feb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563bd26845d0 0x563bd26849b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.669+0000 7f3b637feb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563bd2684ef0 0x563bd268f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.669+0000 7f3b637feb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563bd268fdf0 0x563bd26921e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.669+0000 7f3b637feb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x563bd25dd990 con 0x563bd268fdf0 2024-04-01T06:57:54.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.669+0000 7f3b637feb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x563bd25db350 con 0x563bd2684ef0 2024-04-01T06:57:54.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.669+0000 7f3b637feb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x563bd25d6c40 con 0x563bd26845d0 2024-04-01T06:57:54.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.669+0000 7f3b55c05700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563bd268fdf0 0x563bd26921e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.669+0000 7f3b55c05700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563bd268fdf0 0x563bd26921e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:60850/0 (socket says 172.21.15.83:60850) 2024-04-01T06:57:54.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.669+0000 7f3b55c05700 1 -- 172.21.15.83:0/1859534476 learned_addr learned my addr 172.21.15.83:0/1859534476 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:54.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.669+0000 7f3b54c03700 1 --2- 172.21.15.83:0/1859534476 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563bd2684ef0 0x563bd268f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.669+0000 7f3b55404700 1 --2- 172.21.15.83:0/1859534476 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563bd26845d0 0x563bd26849b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.669+0000 7f3b55c05700 1 -- 172.21.15.83:0/1859534476 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563bd26845d0 msgr2=0x563bd26849b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:54.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.669+0000 7f3b55c05700 1 --2- 172.21.15.83:0/1859534476 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563bd26845d0 0x563bd26849b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.669+0000 7f3b55c05700 1 -- 172.21.15.83:0/1859534476 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563bd2684ef0 msgr2=0x563bd268f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:54.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.669+0000 7f3b55c05700 1 --2- 172.21.15.83:0/1859534476 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563bd2684ef0 0x563bd268f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.669+0000 7f3b55c05700 1 -- 172.21.15.83:0/1859534476 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563bd24583b0 con 0x563bd268fdf0 2024-04-01T06:57:54.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.669+0000 7f3b55c05700 1 --2- 172.21.15.83:0/1859534476 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563bd268fdf0 0x563bd26921e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f3b48097c30 tx=0x7f3b4800b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ec1d28b12c5a69f server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:54.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.669+0000 7f3b3b7fe700 1 -- 172.21.15.83:0/1859534476 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4809b090 con 0x563bd268fdf0 2024-04-01T06:57:54.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.669+0000 7f3b3b7fe700 1 -- 172.21.15.83:0/1859534476 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3b4809be30 con 0x563bd268fdf0 2024-04-01T06:57:54.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.669+0000 7f3b3b7fe700 1 -- 172.21.15.83:0/1859534476 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b48097e40 con 0x563bd268fdf0 2024-04-01T06:57:54.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.670+0000 7f3b637feb80 1 -- 172.21.15.83:0/1859534476 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563bd268fdf0 msgr2=0x563bd26921e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:54.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.670+0000 7f3b637feb80 1 --2- 172.21.15.83:0/1859534476 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563bd268fdf0 0x563bd26921e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f3b48097c30 tx=0x7f3b4800b3b0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.670+0000 7f3b637feb80 1 -- 172.21.15.83:0/1859534476 shutdown_connections 2024-04-01T06:57:54.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.670+0000 7f3b637feb80 1 --2- 172.21.15.83:0/1859534476 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563bd268fdf0 0x563bd26921e0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.670+0000 7f3b637feb80 1 --2- 172.21.15.83:0/1859534476 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563bd26845d0 0x563bd26849b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.670+0000 7f3b637feb80 1 --2- 172.21.15.83:0/1859534476 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563bd2684ef0 0x563bd268f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.670+0000 7f3b637feb80 1 -- 172.21.15.83:0/1859534476 >> 172.21.15.83:0/1859534476 conn(0x563bd25e46a0 msgr2=0x563bd2680a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:54.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.670+0000 7f3b637feb80 1 -- 172.21.15.83:0/1859534476 shutdown_connections 2024-04-01T06:57:54.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.670+0000 7f3b637feb80 1 -- 172.21.15.83:0/1859534476 wait complete. 2024-04-01T06:57:54.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.670+0000 7f3b637feb80 1 -- start start 2024-04-01T06:57:54.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.670+0000 7f3b637feb80 1 Processor -- start 2024-04-01T06:57:54.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.671+0000 7f3b637feb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563bd26845d0 0x563bd268f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.671+0000 7f3b637feb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563bd2684ef0 0x563bd268cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.671+0000 7f3b637feb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563bd268fdf0 0x563bd268d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.671+0000 7f3b637feb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x563bd2572d80 con 0x563bd2684ef0 2024-04-01T06:57:54.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.671+0000 7f3b637feb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x563bd2572a20 con 0x563bd26845d0 2024-04-01T06:57:54.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.671+0000 7f3b637feb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x563bd245a6a0 con 0x563bd268fdf0 2024-04-01T06:57:54.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.671+0000 7f3b637feb80 10 client.0 _ll_register_callbacks cb 0x563bd257c470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:57:54.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.671+0000 7f3b54c03700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563bd2684ef0 0x563bd268cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.671+0000 7f3b54c03700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563bd2684ef0 0x563bd268cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:60852/0 (socket says 172.21.15.83:60852) 2024-04-01T06:57:54.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.671+0000 7f3b54c03700 1 -- 172.21.15.83:0/3123734588 learned_addr learned my addr 172.21.15.83:0/3123734588 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:54.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.671+0000 7f3b55404700 1 --2- 172.21.15.83:0/3123734588 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563bd26845d0 0x563bd268f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.678 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.671+0000 7f3b55c05700 1 --2- 172.21.15.83:0/3123734588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563bd268fdf0 0x563bd268d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.671+0000 7f3b54c03700 1 -- 172.21.15.83:0/3123734588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563bd268fdf0 msgr2=0x563bd268d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:54.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.671+0000 7f3b54c03700 1 --2- 172.21.15.83:0/3123734588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563bd268fdf0 0x563bd268d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.671+0000 7f3b54c03700 1 -- 172.21.15.83:0/3123734588 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563bd26845d0 msgr2=0x563bd268f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:54.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.671+0000 7f3b54c03700 1 --2- 172.21.15.83:0/3123734588 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563bd26845d0 0x563bd268f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.671+0000 7f3b54c03700 1 -- 172.21.15.83:0/3123734588 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b501a64a0 con 0x563bd2684ef0 2024-04-01T06:57:54.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.671+0000 7f3b54c03700 1 --2- 172.21.15.83:0/3123734588 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563bd2684ef0 0x563bd268cb40 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f3b4000bf50 tx=0x7f3b40011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be01622f21a78052 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:54.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.671+0000 7f3b38ff9700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:57:54.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.672+0000 7f3b38ff9700 1 -- 172.21.15.83:0/3123734588 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b40016070 con 0x563bd2684ef0 2024-04-01T06:57:54.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.672+0000 7f3b38ff9700 1 -- 172.21.15.83:0/3123734588 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f3b40004830 con 0x563bd2684ef0 2024-04-01T06:57:54.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.672+0000 7f3b637feb80 1 -- 172.21.15.83:0/3123734588 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563bd2597380 con 0x563bd2684ef0 2024-04-01T06:57:54.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.672+0000 7f3b38ff9700 1 -- 172.21.15.83:0/3123734588 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b400049f0 con 0x563bd2684ef0 2024-04-01T06:57:54.679 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.672+0000 7f3b637feb80 10 client.16023 fetch_fsmap learned FSMap version 28 2024-04-01T06:57:54.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.672+0000 7f3b637feb80 1 -- 172.21.15.83:0/3123734588 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x563bd2404b60 con 0x563bd2684ef0 2024-04-01T06:57:54.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.672+0000 7f3b38ff9700 1 -- 172.21.15.83:0/3123734588 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x563bd2597380 con 0x563bd2684ef0 2024-04-01T06:57:54.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.672+0000 7f3b38ff9700 1 -- 172.21.15.83:0/3123734588 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 28) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f3b40021020 con 0x563bd2684ef0 2024-04-01T06:57:54.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.672+0000 7f3b637feb80 10 client.16023 fetch_fsmap finished waiting for FSMap version 28 2024-04-01T06:57:54.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.672+0000 7f3b637feb80 10 client.16023 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-04-01T06:57:54.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.672+0000 7f3b637feb80 20 client.16023 populate_metadata read hostname 'smithi083' 2024-04-01T06:57:54.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.672+0000 7f3b637feb80 1 --2- 172.21.15.83:0/3123734588 >> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] conn(0x563bd269f7f0 0x563bd26a1c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.672+0000 7f3b637feb80 4 client.16023 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-01T06:57:54.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.672+0000 7f3b637feb80 1 -- 172.21.15.83:0/3123734588 --> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563bd25cf700 con 0x563bd269f7f0 2024-04-01T06:57:54.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.672+0000 7f3b55404700 1 --2- 172.21.15.83:0/3123734588 >> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] conn(0x563bd269f7f0 0x563bd26a1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.673+0000 7f3b38ff9700 10 client.16023 ms_handle_connect on v2:172.21.15.145:6836/2687798317 2024-04-01T06:57:54.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.673+0000 7f3b55404700 1 --2- 172.21.15.83:0/3123734588 >> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] conn(0x563bd269f7f0 0x563bd26a1c10 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1d9e614d1b9328f0 server_cookie=8d8de165055c32f0 in_seq=0 out_seq=0 2024-04-01T06:57:54.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.674+0000 7f3b38ff9700 1 -- 172.21.15.83:0/3123734588 <== mds.1 v2:172.21.15.145:6836/2687798317 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563bd25cf700 con 0x563bd269f7f0 2024-04-01T06:57:54.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.674+0000 7f3b38ff9700 10 client.16023 handle_command_reply: tid=0 2024-04-01T06:57:54.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.674+0000 7f3b637feb80 1 client.16023 shutdown 2024-04-01T06:57:54.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.674+0000 7f3b637feb80 1 -- 172.21.15.83:0/3123734588 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563bd2684ef0 msgr2=0x563bd268cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:54.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.674+0000 7f3b637feb80 1 --2- 172.21.15.83:0/3123734588 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563bd2684ef0 0x563bd268cb40 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f3b4000bf50 tx=0x7f3b40011720 comp rx=0 tx=0).stop 2024-04-01T06:57:54.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.674+0000 7f3b637feb80 1 -- 172.21.15.83:0/3123734588 shutdown_connections 2024-04-01T06:57:54.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.674+0000 7f3b637feb80 1 --2- 172.21.15.83:0/3123734588 >> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] conn(0x563bd269f7f0 0x563bd26a1c10 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.674+0000 7f3b637feb80 1 --2- 172.21.15.83:0/3123734588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563bd268fdf0 0x563bd268d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.674+0000 7f3b637feb80 1 --2- 172.21.15.83:0/3123734588 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563bd26845d0 0x563bd268f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.674+0000 7f3b637feb80 1 --2- 172.21.15.83:0/3123734588 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563bd2684ef0 0x563bd268cb40 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.674+0000 7f3b38ff9700 0 client.16023 ms_handle_reset on v2:172.21.15.145:6836/2687798317 2024-04-01T06:57:54.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.674+0000 7f3b637feb80 1 -- 172.21.15.83:0/3123734588 >> 172.21.15.83:0/3123734588 conn(0x563bd25e46a0 msgr2=0x563bd26866c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:54.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.674+0000 7f3b637feb80 1 -- 172.21.15.83:0/3123734588 shutdown_connections 2024-04-01T06:57:54.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.674+0000 7f3b637feb80 1 -- 172.21.15.83:0/3123734588 wait complete. 2024-04-01T06:57:54.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.674+0000 7f3b637feb80 20 client.16023 trim_cache size 0 max 16384 2024-04-01T06:57:54.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.688+0000 7f3b637feb80 1 Processor -- start 2024-04-01T06:57:54.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.688+0000 7f3b637feb80 1 -- start start 2024-04-01T06:57:54.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.688+0000 7f3b637feb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563bd26845d0 0x563bd2696880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.688+0000 7f3b637feb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563bd2684ef0 0x563bd268c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.688+0000 7f3b637feb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563bd268fdf0 0x563bd268c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.688+0000 7f3b637feb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x563bd268d680 con 0x563bd268fdf0 2024-04-01T06:57:54.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.688+0000 7f3b637feb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x563bd2685640 con 0x563bd2684ef0 2024-04-01T06:57:54.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.688+0000 7f3b637feb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x563bd268e170 con 0x563bd26845d0 2024-04-01T06:57:54.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.688+0000 7f3b55c05700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563bd268fdf0 0x563bd268c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.688+0000 7f3b55c05700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563bd268fdf0 0x563bd268c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:60864/0 (socket says 172.21.15.83:60864) 2024-04-01T06:57:54.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.688+0000 7f3b55c05700 1 -- 172.21.15.83:0/1038157043 learned_addr learned my addr 172.21.15.83:0/1038157043 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:54.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.688+0000 7f3b54c03700 1 --2- 172.21.15.83:0/1038157043 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563bd2684ef0 0x563bd268c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.688+0000 7f3b55404700 1 --2- 172.21.15.83:0/1038157043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563bd26845d0 0x563bd2696880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.688+0000 7f3b55c05700 1 -- 172.21.15.83:0/1038157043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563bd26845d0 msgr2=0x563bd2696880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:54.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.688+0000 7f3b55c05700 1 --2- 172.21.15.83:0/1038157043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563bd26845d0 0x563bd2696880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.688+0000 7f3b55c05700 1 -- 172.21.15.83:0/1038157043 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563bd2684ef0 msgr2=0x563bd268c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:54.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.688+0000 7f3b55c05700 1 --2- 172.21.15.83:0/1038157043 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563bd2684ef0 0x563bd268c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.688+0000 7f3b55c05700 1 -- 172.21.15.83:0/1038157043 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563bd259cea0 con 0x563bd268fdf0 2024-04-01T06:57:54.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.688+0000 7f3b54c03700 1 --2- 172.21.15.83:0/1038157043 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563bd2684ef0 0x563bd268c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:57:54.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.688+0000 7f3b55404700 1 --2- 172.21.15.83:0/1038157043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563bd26845d0 0x563bd2696880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:57:54.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.688+0000 7f3b55c05700 1 --2- 172.21.15.83:0/1038157043 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563bd268fdf0 0x563bd268c930 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f3b480cbd90 tx=0x7f3b480bb040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a18f4e3f0882463 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:54.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.689+0000 7f3b3bfff700 1 -- 172.21.15.83:0/1038157043 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b480a3b20 con 0x563bd268fdf0 2024-04-01T06:57:54.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.689+0000 7f3b3bfff700 1 -- 172.21.15.83:0/1038157043 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3b4809b090 con 0x563bd268fdf0 2024-04-01T06:57:54.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.689+0000 7f3b3bfff700 1 -- 172.21.15.83:0/1038157043 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b48097e40 con 0x563bd268fdf0 2024-04-01T06:57:54.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.689+0000 7f3b637feb80 1 -- 172.21.15.83:0/1038157043 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563bd268fdf0 msgr2=0x563bd268c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:54.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.689+0000 7f3b637feb80 1 --2- 172.21.15.83:0/1038157043 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563bd268fdf0 0x563bd268c930 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f3b480cbd90 tx=0x7f3b480bb040 comp rx=0 tx=0).stop 2024-04-01T06:57:54.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.689+0000 7f3b637feb80 1 -- 172.21.15.83:0/1038157043 shutdown_connections 2024-04-01T06:57:54.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.689+0000 7f3b637feb80 1 --2- 172.21.15.83:0/1038157043 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563bd268fdf0 0x563bd268c930 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.689+0000 7f3b637feb80 1 --2- 172.21.15.83:0/1038157043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563bd26845d0 0x563bd2696880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.689+0000 7f3b637feb80 1 --2- 172.21.15.83:0/1038157043 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563bd2684ef0 0x563bd268c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.689+0000 7f3b637feb80 1 -- 172.21.15.83:0/1038157043 >> 172.21.15.83:0/1038157043 conn(0x563bd25e46a0 msgr2=0x563bd2687e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:54.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.689+0000 7f3b637feb80 1 -- 172.21.15.83:0/1038157043 shutdown_connections 2024-04-01T06:57:54.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.689+0000 7f3b637feb80 1 -- 172.21.15.83:0/1038157043 wait complete. 2024-04-01T06:57:54.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.690+0000 7f3b637feb80 1 -- start start 2024-04-01T06:57:54.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.690+0000 7f3b637feb80 1 Processor -- start 2024-04-01T06:57:54.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.690+0000 7f3b637feb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563bd26845d0 0x563bd2694a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.690+0000 7f3b637feb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563bd2684ef0 0x563bd2694f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.690+0000 7f3b637feb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563bd268fdf0 0x563bd26f2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.690+0000 7f3b637feb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x563bd26956e0 con 0x563bd26845d0 2024-04-01T06:57:54.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.690+0000 7f3b637feb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x563bd26f2b40 con 0x563bd268fdf0 2024-04-01T06:57:54.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.690+0000 7f3b637feb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x563bd26f2d00 con 0x563bd2684ef0 2024-04-01T06:57:54.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.690+0000 7f3b637feb80 10 client.0 _ll_register_callbacks cb 0x563bd257c470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:57:54.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.690+0000 7f3b55404700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563bd26845d0 0x563bd2694a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.690+0000 7f3b54c03700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563bd2684ef0 0x563bd2694f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.690+0000 7f3b55404700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563bd26845d0 0x563bd2694a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:60874/0 (socket says 172.21.15.83:60874) 2024-04-01T06:57:54.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.690+0000 7f3b55404700 1 -- 172.21.15.83:0/3025814654 learned_addr learned my addr 172.21.15.83:0/3025814654 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:54.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.690+0000 7f3b55c05700 1 --2- 172.21.15.83:0/3025814654 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563bd268fdf0 0x563bd26f2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.690+0000 7f3b55404700 1 -- 172.21.15.83:0/3025814654 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563bd2684ef0 msgr2=0x563bd2694f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:54.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.690+0000 7f3b55404700 1 --2- 172.21.15.83:0/3025814654 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563bd2684ef0 0x563bd2694f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.690+0000 7f3b55404700 1 -- 172.21.15.83:0/3025814654 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563bd268fdf0 msgr2=0x563bd26f2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:54.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.690+0000 7f3b55404700 1 --2- 172.21.15.83:0/3025814654 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563bd268fdf0 0x563bd26f2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.690+0000 7f3b55404700 1 -- 172.21.15.83:0/3025814654 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563bd24583b0 con 0x563bd26845d0 2024-04-01T06:57:54.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.691+0000 7f3b55404700 1 --2- 172.21.15.83:0/3025814654 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563bd26845d0 0x563bd2694a50 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x563bd26a2500 tx=0x7f3b4c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4771b26c552c2719 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:54.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.691+0000 7f3b38ff9700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:57:54.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.691+0000 7f3b38ff9700 1 -- 172.21.15.83:0/3025814654 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c024040 con 0x563bd26845d0 2024-04-01T06:57:54.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.691+0000 7f3b38ff9700 1 -- 172.21.15.83:0/3025814654 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f3b4c017070 con 0x563bd26845d0 2024-04-01T06:57:54.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.691+0000 7f3b637feb80 1 -- 172.21.15.83:0/3025814654 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3b4809be30 con 0x563bd26845d0 2024-04-01T06:57:54.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.691+0000 7f3b38ff9700 1 -- 172.21.15.83:0/3025814654 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b4c029dd0 con 0x563bd26845d0 2024-04-01T06:57:54.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.691+0000 7f3b637feb80 10 client.16029 fetch_fsmap learned FSMap version 28 2024-04-01T06:57:54.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.691+0000 7f3b637feb80 1 -- 172.21.15.83:0/3025814654 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x563bd245ccd0 con 0x563bd26845d0 2024-04-01T06:57:54.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.691+0000 7f3b38ff9700 1 -- 172.21.15.83:0/3025814654 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3b4809be30 con 0x563bd26845d0 2024-04-01T06:57:54.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.691+0000 7f3b38ff9700 1 -- 172.21.15.83:0/3025814654 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 28) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f3b4c038020 con 0x563bd26845d0 2024-04-01T06:57:54.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.691+0000 7f3b637feb80 10 client.16029 fetch_fsmap finished waiting for FSMap version 28 2024-04-01T06:57:54.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.691+0000 7f3b637feb80 10 client.16029 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-04-01T06:57:54.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.691+0000 7f3b637feb80 20 client.16029 populate_metadata read hostname 'smithi083' 2024-04-01T06:57:54.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.691+0000 7f3b637feb80 1 --2- 172.21.15.83:0/3025814654 >> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] conn(0x563bd26f44c0 0x563bd26f68e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.691+0000 7f3b637feb80 4 client.16029 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-01T06:57:54.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.691+0000 7f3b637feb80 1 -- 172.21.15.83:0/3025814654 --> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x563bd2425cf0 con 0x563bd26f44c0 2024-04-01T06:57:54.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.691+0000 7f3b54c03700 1 --2- 172.21.15.83:0/3025814654 >> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] conn(0x563bd26f44c0 0x563bd26f68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.692+0000 7f3b38ff9700 10 client.16029 ms_handle_connect on v2:172.21.15.145:6836/2687798317 2024-04-01T06:57:54.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.692+0000 7f3b54c03700 1 --2- 172.21.15.83:0/3025814654 >> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] conn(0x563bd26f44c0 0x563bd26f68e0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=77840d881f1a4426 server_cookie=cd5f509c23d0843e in_seq=0 out_seq=0 2024-04-01T06:57:54.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.692+0000 7f3b38ff9700 1 -- 172.21.15.83:0/3025814654 <== mds.1 v2:172.21.15.145:6836/2687798317 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x563bd2425cf0 con 0x563bd26f44c0 2024-04-01T06:57:54.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.692+0000 7f3b38ff9700 10 client.16029 handle_command_reply: tid=0 2024-04-01T06:57:54.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.692+0000 7f3b637feb80 1 client.16029 shutdown 2024-04-01T06:57:54.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.692+0000 7f3b637feb80 1 -- 172.21.15.83:0/3025814654 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563bd26845d0 msgr2=0x563bd2694a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:54.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.692+0000 7f3b637feb80 1 --2- 172.21.15.83:0/3025814654 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563bd26845d0 0x563bd2694a50 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x563bd26a2500 tx=0x7f3b4c0047c0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.692+0000 7f3b637feb80 1 -- 172.21.15.83:0/3025814654 shutdown_connections 2024-04-01T06:57:54.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.692+0000 7f3b637feb80 1 --2- 172.21.15.83:0/3025814654 >> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] conn(0x563bd26f44c0 0x563bd26f68e0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.692+0000 7f3b637feb80 1 --2- 172.21.15.83:0/3025814654 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x563bd26845d0 0x563bd2694a50 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.692+0000 7f3b637feb80 1 --2- 172.21.15.83:0/3025814654 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563bd268fdf0 0x563bd26f2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.692+0000 7f3b637feb80 1 --2- 172.21.15.83:0/3025814654 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563bd2684ef0 0x563bd2694f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.692+0000 7f3b38ff9700 0 client.16029 ms_handle_reset on v2:172.21.15.145:6836/2687798317 2024-04-01T06:57:54.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.692+0000 7f3b637feb80 1 -- 172.21.15.83:0/3025814654 >> 172.21.15.83:0/3025814654 conn(0x563bd25e46a0 msgr2=0x563bd26866c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:54.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.693+0000 7f3b637feb80 1 -- 172.21.15.83:0/3025814654 shutdown_connections 2024-04-01T06:57:54.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.693+0000 7f3b637feb80 1 -- 172.21.15.83:0/3025814654 wait complete. 2024-04-01T06:57:54.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.693+0000 7f3b637feb80 20 client.16029 trim_cache size 0 max 16384 2024-04-01T06:57:54.701 INFO:teuthology.orchestra.run.smithi083.stdout:[] 2024-04-01T06:57:54.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.693+0000 7f3b57668700 1 -- 172.21.15.83:0/2664927094 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f3b3c0a1290 msgr2=0x7f3b3c0a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:54.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.693+0000 7f3b57668700 1 --2- 172.21.15.83:0/2664927094 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f3b3c0a1290 0x7f3b3c0a3750 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c005950 tx=0x7f3b4c00b410 comp rx=0 tx=0).stop 2024-04-01T06:57:54.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.693+0000 7f3b57668700 1 -- 172.21.15.83:0/2664927094 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b501969e0 msgr2=0x7f3b501a55e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:54.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.693+0000 7f3b57668700 1 --2- 172.21.15.83:0/2664927094 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b501969e0 0x7f3b501a55e0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f3b48006130 tx=0x7f3b48009300 comp rx=0 tx=0).stop 2024-04-01T06:57:54.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.693+0000 7f3b57668700 1 -- 172.21.15.83:0/2664927094 shutdown_connections 2024-04-01T06:57:54.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.693+0000 7f3b57668700 1 --2- 172.21.15.83:0/2664927094 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f3b3c0a1290 0x7f3b3c0a3750 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.693+0000 7f3b57668700 1 --2- 172.21.15.83:0/2664927094 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b501969e0 0x7f3b501a55e0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.693+0000 7f3b57668700 1 --2- 172.21.15.83:0/2664927094 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3b500ffe50 0x7f3b50195f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.693+0000 7f3b57668700 1 --2- 172.21.15.83:0/2664927094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b50104f60 0x7f3b501964a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.693+0000 7f3b57668700 1 -- 172.21.15.83:0/2664927094 >> 172.21.15.83:0/2664927094 conn(0x7f3b50076d40 msgr2=0x7f3b500fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:54.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.693+0000 7f3b57668700 1 -- 172.21.15.83:0/2664927094 shutdown_connections 2024-04-01T06:57:54.703 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.693+0000 7f3b57668700 1 -- 172.21.15.83:0/2664927094 wait complete. 2024-04-01T06:57:54.705 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-01T06:57:54.705 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-01T06:57:54.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.834+0000 7f82b6ea6700 1 -- 172.21.15.83:0/2497864791 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82b0105ce0 msgr2=0x7f82b01060c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:54.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.834+0000 7f82b6ea6700 1 --2- 172.21.15.83:0/2497864791 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82b0105ce0 0x7f82b01060c0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f82a4009990 tx=0x7f82a4009ca0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.834+0000 7f82b6ea6700 1 -- 172.21.15.83:0/2497864791 shutdown_connections 2024-04-01T06:57:54.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.834+0000 7f82b6ea6700 1 --2- 172.21.15.83:0/2497864791 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82b0105ce0 0x7f82b01060c0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.834+0000 7f82b6ea6700 1 --2- 172.21.15.83:0/2497864791 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82b00687f0 0x7f82b010db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.834+0000 7f82b6ea6700 1 --2- 172.21.15.83:0/2497864791 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f82b0067e30 0x7f82b00682b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.834+0000 7f82b6ea6700 1 -- 172.21.15.83:0/2497864791 >> 172.21.15.83:0/2497864791 conn(0x7f82b0076d40 msgr2=0x7f82b0077150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:54.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.834+0000 7f82b6ea6700 1 -- 172.21.15.83:0/2497864791 shutdown_connections 2024-04-01T06:57:54.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.834+0000 7f82b6ea6700 1 -- 172.21.15.83:0/2497864791 wait complete. 2024-04-01T06:57:54.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.835+0000 7f82b6ea6700 1 Processor -- start 2024-04-01T06:57:54.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.835+0000 7f82b6ea6700 1 -- start start 2024-04-01T06:57:54.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.835+0000 7f82b6ea6700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82b0067e30 0x7f82b01971d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.835+0000 7f82b6ea6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82b00687f0 0x7f82b0197710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.835+0000 7f82b6ea6700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f82b0105ce0 0x7f82b019ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.835+0000 7f82b6ea6700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b019c0a0 con 0x7f82b0067e30 2024-04-01T06:57:54.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.835+0000 7f82b6ea6700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b019c210 con 0x7f82b0105ce0 2024-04-01T06:57:54.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.835+0000 7f82b6ea6700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b019c3d0 con 0x7f82b00687f0 2024-04-01T06:57:54.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.835+0000 7f82b4c42700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82b0067e30 0x7f82b01971d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.835+0000 7f82b4c42700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82b0067e30 0x7f82b01971d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:60896/0 (socket says 172.21.15.83:60896) 2024-04-01T06:57:54.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.835+0000 7f82b4c42700 1 -- 172.21.15.83:0/1962686415 learned_addr learned my addr 172.21.15.83:0/1962686415 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:54.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.835+0000 7f82b5443700 1 --2- 172.21.15.83:0/1962686415 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f82b0105ce0 0x7f82b019ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.835+0000 7f82affff700 1 --2- 172.21.15.83:0/1962686415 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82b00687f0 0x7f82b0197710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.835+0000 7f82b4c42700 1 -- 172.21.15.83:0/1962686415 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82b00687f0 msgr2=0x7f82b0197710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:54.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.835+0000 7f82b4c42700 1 --2- 172.21.15.83:0/1962686415 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82b00687f0 0x7f82b0197710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.835+0000 7f82b4c42700 1 -- 172.21.15.83:0/1962686415 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f82b0105ce0 msgr2=0x7f82b019ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:54.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.835+0000 7f82b4c42700 1 --2- 172.21.15.83:0/1962686415 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f82b0105ce0 0x7f82b019ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.835+0000 7f82b4c42700 1 -- 172.21.15.83:0/1962686415 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a40095f0 con 0x7f82b0067e30 2024-04-01T06:57:54.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.835+0000 7f82b5443700 1 --2- 172.21.15.83:0/1962686415 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f82b0105ce0 0x7f82b019ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:57:54.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.835+0000 7f82b4c42700 1 --2- 172.21.15.83:0/1962686415 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82b0067e30 0x7f82b01971d0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f82a4003a90 tx=0x7f82a4003b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:54.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.835+0000 7f82adffb700 1 -- 172.21.15.83:0/1962686415 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a401d070 con 0x7f82b0067e30 2024-04-01T06:57:54.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.836+0000 7f82adffb700 1 -- 172.21.15.83:0/1962686415 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f82a4003e80 con 0x7f82b0067e30 2024-04-01T06:57:54.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.836+0000 7f82b6ea6700 1 -- 172.21.15.83:0/1962686415 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82b019c650 con 0x7f82b0067e30 2024-04-01T06:57:54.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.836+0000 7f82adffb700 1 -- 172.21.15.83:0/1962686415 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a400fdf0 con 0x7f82b0067e30 2024-04-01T06:57:54.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.836+0000 7f82b6ea6700 1 -- 172.21.15.83:0/1962686415 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82b01a3ef0 con 0x7f82b0067e30 2024-04-01T06:57:54.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.838+0000 7f82adffb700 1 -- 172.21.15.83:0/1962686415 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 25) v1 ==== 135996+0+0 (secure 0 0 0) 0x7f82a400f4f0 con 0x7f82b0067e30 2024-04-01T06:57:54.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.838+0000 7f82adffb700 1 --2- 172.21.15.83:0/1962686415 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f82a00a1310 0x7f82a00a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.839+0000 7f82affff700 1 --2- 172.21.15.83:0/1962686415 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f82a00a1310 0x7f82a00a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.839+0000 7f82adffb700 1 -- 172.21.15.83:0/1962686415 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f82a40cdfe0 con 0x7f82b0067e30 2024-04-01T06:57:54.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.839+0000 7f82affff700 1 --2- 172.21.15.83:0/1962686415 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f82a00a1310 0x7f82a00a37d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f82b01986d0 tx=0x7f829c00b5b0 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:54.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.839+0000 7f82c303cb80 1 Processor -- start 2024-04-01T06:57:54.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.839+0000 7f82c303cb80 1 -- start start 2024-04-01T06:57:54.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.839+0000 7f82c303cb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d1f8de65d0 0x55d1f8de69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.839+0000 7f82c303cb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1f8de6ef0 0x55d1f8df18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.840+0000 7f82c303cb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d1f8df1df0 0x55d1f8df41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.840+0000 7f82c303cb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1f8d3f990 con 0x55d1f8de65d0 2024-04-01T06:57:54.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.840+0000 7f82c303cb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1f8d3d350 con 0x55d1f8df1df0 2024-04-01T06:57:54.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.840+0000 7f82c303cb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1f8d38c40 con 0x55d1f8de6ef0 2024-04-01T06:57:54.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.840+0000 7f82b4c42700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d1f8de65d0 0x55d1f8de69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.840+0000 7f82b4c42700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d1f8de65d0 0x55d1f8de69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:60902/0 (socket says 172.21.15.83:60902) 2024-04-01T06:57:54.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.840+0000 7f82b4c42700 1 -- 172.21.15.83:0/178022908 learned_addr learned my addr 172.21.15.83:0/178022908 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:54.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.840+0000 7f82b5443700 1 --2- 172.21.15.83:0/178022908 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d1f8df1df0 0x55d1f8df41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.840+0000 7f82affff700 1 --2- 172.21.15.83:0/178022908 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1f8de6ef0 0x55d1f8df18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.840+0000 7f82b4c42700 1 -- 172.21.15.83:0/178022908 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1f8de6ef0 msgr2=0x55d1f8df18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:54.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.840+0000 7f82b4c42700 1 --2- 172.21.15.83:0/178022908 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1f8de6ef0 0x55d1f8df18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.840+0000 7f82b4c42700 1 -- 172.21.15.83:0/178022908 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d1f8df1df0 msgr2=0x55d1f8df41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:54.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.840+0000 7f82b4c42700 1 --2- 172.21.15.83:0/178022908 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d1f8df1df0 0x55d1f8df41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.840+0000 7f82b4c42700 1 -- 172.21.15.83:0/178022908 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d1f8bba3b0 con 0x55d1f8de65d0 2024-04-01T06:57:54.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.840+0000 7f82b4c42700 1 --2- 172.21.15.83:0/178022908 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d1f8de65d0 0x55d1f8de69b0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f82a4097bf0 tx=0x7f82a4005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=219fbc18756d4cb9 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:54.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.840+0000 7f829affd700 1 -- 172.21.15.83:0/178022908 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a409b880 con 0x55d1f8de65d0 2024-04-01T06:57:54.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.840+0000 7f829affd700 1 -- 172.21.15.83:0/178022908 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f82a409b180 con 0x55d1f8de65d0 2024-04-01T06:57:54.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.840+0000 7f829affd700 1 -- 172.21.15.83:0/178022908 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a40a12d0 con 0x55d1f8de65d0 2024-04-01T06:57:54.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.841+0000 7f82c303cb80 1 -- 172.21.15.83:0/178022908 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d1f8de65d0 msgr2=0x55d1f8de69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:54.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.841+0000 7f82c303cb80 1 --2- 172.21.15.83:0/178022908 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d1f8de65d0 0x55d1f8de69b0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f82a4097bf0 tx=0x7f82a4005fd0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.841+0000 7f82c303cb80 1 -- 172.21.15.83:0/178022908 shutdown_connections 2024-04-01T06:57:54.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.841+0000 7f82c303cb80 1 --2- 172.21.15.83:0/178022908 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d1f8de65d0 0x55d1f8de69b0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.841+0000 7f82c303cb80 1 --2- 172.21.15.83:0/178022908 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d1f8df1df0 0x55d1f8df41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.841+0000 7f82c303cb80 1 --2- 172.21.15.83:0/178022908 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1f8de6ef0 0x55d1f8df18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.841+0000 7f82c303cb80 1 -- 172.21.15.83:0/178022908 >> 172.21.15.83:0/178022908 conn(0x55d1f8d466a0 msgr2=0x55d1f8de2a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:54.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.841+0000 7f82c303cb80 1 -- 172.21.15.83:0/178022908 shutdown_connections 2024-04-01T06:57:54.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.841+0000 7f82c303cb80 1 -- 172.21.15.83:0/178022908 wait complete. 2024-04-01T06:57:54.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.841+0000 7f82c303cb80 1 -- start start 2024-04-01T06:57:54.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.841+0000 7f82c303cb80 1 Processor -- start 2024-04-01T06:57:54.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.842+0000 7f82c303cb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d1f8de65d0 0x55d1f8df1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.842+0000 7f82c303cb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d1f8de6ef0 0x55d1f8deea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.842+0000 7f82c303cb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1f8df1df0 0x55d1f8def030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.842+0000 7f82c303cb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1f8cd4d80 con 0x55d1f8de6ef0 2024-04-01T06:57:54.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.842+0000 7f82c303cb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1f8cd4a20 con 0x55d1f8de65d0 2024-04-01T06:57:54.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.842+0000 7f82c303cb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1f8bbc6a0 con 0x55d1f8df1df0 2024-04-01T06:57:54.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.842+0000 7f82c303cb80 10 client.0 _ll_register_callbacks cb 0x55d1f8cde470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:57:54.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.842+0000 7f82affff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d1f8de6ef0 0x55d1f8deea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.842+0000 7f82affff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d1f8de6ef0 0x55d1f8deea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:60914/0 (socket says 172.21.15.83:60914) 2024-04-01T06:57:54.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.842+0000 7f82affff700 1 -- 172.21.15.83:0/2006968587 learned_addr learned my addr 172.21.15.83:0/2006968587 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:54.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.842+0000 7f82b4c42700 1 --2- 172.21.15.83:0/2006968587 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d1f8de65d0 0x55d1f8df1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.842+0000 7f82b5443700 1 --2- 172.21.15.83:0/2006968587 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1f8df1df0 0x55d1f8def030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.842+0000 7f82affff700 1 -- 172.21.15.83:0/2006968587 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1f8df1df0 msgr2=0x55d1f8def030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:54.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.842+0000 7f82affff700 1 --2- 172.21.15.83:0/2006968587 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1f8df1df0 0x55d1f8def030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.842+0000 7f82affff700 1 -- 172.21.15.83:0/2006968587 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d1f8de65d0 msgr2=0x55d1f8df1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:54.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.842+0000 7f82affff700 1 --2- 172.21.15.83:0/2006968587 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d1f8de65d0 0x55d1f8df1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.842+0000 7f82affff700 1 -- 172.21.15.83:0/2006968587 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82b01a3ef0 con 0x55d1f8de6ef0 2024-04-01T06:57:54.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.842+0000 7f82affff700 1 --2- 172.21.15.83:0/2006968587 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d1f8de6ef0 0x55d1f8deea90 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f829c00b9b0 tx=0x7f829c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc80a331f0b524b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:54.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.842+0000 7f828ffff700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:57:54.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.843+0000 7f828ffff700 1 -- 172.21.15.83:0/2006968587 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829c01f430 con 0x55d1f8de6ef0 2024-04-01T06:57:54.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.843+0000 7f82c303cb80 1 -- 172.21.15.83:0/2006968587 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d1f8cf9380 con 0x55d1f8de6ef0 2024-04-01T06:57:54.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.843+0000 7f828ffff700 1 -- 172.21.15.83:0/2006968587 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f829c01f590 con 0x55d1f8de6ef0 2024-04-01T06:57:54.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.843+0000 7f828ffff700 1 -- 172.21.15.83:0/2006968587 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f829c01f750 con 0x55d1f8de6ef0 2024-04-01T06:57:54.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.843+0000 7f82c303cb80 10 client.16041 fetch_fsmap learned FSMap version 28 2024-04-01T06:57:54.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.843+0000 7f82c303cb80 1 -- 172.21.15.83:0/2006968587 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55d1f8b66b60 con 0x55d1f8de6ef0 2024-04-01T06:57:54.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.843+0000 7f828ffff700 1 -- 172.21.15.83:0/2006968587 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d1f8cf9380 con 0x55d1f8de6ef0 2024-04-01T06:57:54.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.843+0000 7f828ffff700 1 -- 172.21.15.83:0/2006968587 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 28) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f829c025020 con 0x55d1f8de6ef0 2024-04-01T06:57:54.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.843+0000 7f82c303cb80 10 client.16041 fetch_fsmap finished waiting for FSMap version 28 2024-04-01T06:57:54.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.843+0000 7f82c303cb80 10 client.16041 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-01T06:57:54.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.843+0000 7f82c303cb80 20 client.16041 populate_metadata read hostname 'smithi083' 2024-04-01T06:57:54.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.843+0000 7f82c303cb80 1 --2- 172.21.15.83:0/2006968587 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55d1f8e01690 0x55d1f8e03ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.843+0000 7f82c303cb80 4 client.16041 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-01T06:57:54.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.843+0000 7f82c303cb80 1 -- 172.21.15.83:0/2006968587 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d1f8d31700 con 0x55d1f8e01690 2024-04-01T06:57:54.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.843+0000 7f82b4c42700 1 --2- 172.21.15.83:0/2006968587 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55d1f8e01690 0x55d1f8e03ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.844+0000 7f828ffff700 10 client.16041 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:57:54.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.844+0000 7f82b4c42700 1 --2- 172.21.15.83:0/2006968587 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55d1f8e01690 0x55d1f8e03ab0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da6d8e27b36d001b server_cookie=d86a522876c9e7af in_seq=0 out_seq=0 2024-04-01T06:57:54.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.845+0000 7f828ffff700 1 -- 172.21.15.83:0/2006968587 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d1f8d31700 con 0x55d1f8e01690 2024-04-01T06:57:54.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.845+0000 7f828ffff700 10 client.16041 handle_command_reply: tid=0 2024-04-01T06:57:54.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.845+0000 7f82c303cb80 1 client.16041 shutdown 2024-04-01T06:57:54.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.845+0000 7f82c303cb80 1 -- 172.21.15.83:0/2006968587 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d1f8de6ef0 msgr2=0x55d1f8deea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:54.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.845+0000 7f82c303cb80 1 --2- 172.21.15.83:0/2006968587 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d1f8de6ef0 0x55d1f8deea90 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f829c00b9b0 tx=0x7f829c004750 comp rx=0 tx=0).stop 2024-04-01T06:57:54.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.845+0000 7f82c303cb80 1 -- 172.21.15.83:0/2006968587 shutdown_connections 2024-04-01T06:57:54.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.845+0000 7f82c303cb80 1 --2- 172.21.15.83:0/2006968587 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55d1f8e01690 0x55d1f8e03ab0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.845+0000 7f82c303cb80 1 --2- 172.21.15.83:0/2006968587 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1f8df1df0 0x55d1f8def030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.845+0000 7f82c303cb80 1 --2- 172.21.15.83:0/2006968587 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d1f8de65d0 0x55d1f8df1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.845+0000 7f82c303cb80 1 --2- 172.21.15.83:0/2006968587 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d1f8de6ef0 0x55d1f8deea90 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.845+0000 7f828ffff700 0 client.16041 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:57:54.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.846+0000 7f82c303cb80 1 -- 172.21.15.83:0/2006968587 >> 172.21.15.83:0/2006968587 conn(0x55d1f8d466a0 msgr2=0x55d1f8de8670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:54.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.846+0000 7f82c303cb80 1 -- 172.21.15.83:0/2006968587 shutdown_connections 2024-04-01T06:57:54.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.846+0000 7f82c303cb80 1 -- 172.21.15.83:0/2006968587 wait complete. 2024-04-01T06:57:54.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.846+0000 7f82c303cb80 20 client.16041 trim_cache size 0 max 16384 2024-04-01T06:57:54.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.859+0000 7f82c303cb80 1 Processor -- start 2024-04-01T06:57:54.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.859+0000 7f82c303cb80 1 -- start start 2024-04-01T06:57:54.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.859+0000 7f82c303cb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d1f8de65d0 0x55d1f8de69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.859+0000 7f82c303cb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1f8de6ef0 0x55d1f8def030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.859+0000 7f82c303cb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d1f8df1df0 0x55d1f8e03a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.859+0000 7f82c303cb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1f8de9560 con 0x55d1f8de65d0 2024-04-01T06:57:54.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.859+0000 7f82c303cb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1f8ddca10 con 0x55d1f8df1df0 2024-04-01T06:57:54.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.859+0000 7f82c303cb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1f8ddcbd0 con 0x55d1f8de6ef0 2024-04-01T06:57:54.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.859+0000 7f82b4c42700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d1f8de65d0 0x55d1f8de69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.859+0000 7f82b4c42700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d1f8de65d0 0x55d1f8de69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:60916/0 (socket says 172.21.15.83:60916) 2024-04-01T06:57:54.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.859+0000 7f82b4c42700 1 -- 172.21.15.83:0/2730138663 learned_addr learned my addr 172.21.15.83:0/2730138663 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:54.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.859+0000 7f82affff700 1 --2- 172.21.15.83:0/2730138663 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1f8de6ef0 0x55d1f8def030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.859+0000 7f82b5443700 1 --2- 172.21.15.83:0/2730138663 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d1f8df1df0 0x55d1f8e03a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.859+0000 7f82b4c42700 1 -- 172.21.15.83:0/2730138663 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1f8de6ef0 msgr2=0x55d1f8def030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:54.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.859+0000 7f82b4c42700 1 --2- 172.21.15.83:0/2730138663 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1f8de6ef0 0x55d1f8def030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.859+0000 7f82b4c42700 1 -- 172.21.15.83:0/2730138663 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d1f8df1df0 msgr2=0x55d1f8e03a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:54.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.859+0000 7f82b4c42700 1 --2- 172.21.15.83:0/2730138663 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d1f8df1df0 0x55d1f8e03a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.859+0000 7f82b4c42700 1 -- 172.21.15.83:0/2730138663 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d1f8cfeea0 con 0x55d1f8de65d0 2024-04-01T06:57:54.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.860+0000 7f82b4c42700 1 --2- 172.21.15.83:0/2730138663 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d1f8de65d0 0x55d1f8de69b0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f82a4009fd0 tx=0x7f82a400f890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f33c1a3390cbb905 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:54.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.860+0000 7f829b7fe700 1 -- 172.21.15.83:0/2730138663 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a409f030 con 0x55d1f8de65d0 2024-04-01T06:57:54.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.860+0000 7f829b7fe700 1 -- 172.21.15.83:0/2730138663 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f82a40a3570 con 0x55d1f8de65d0 2024-04-01T06:57:54.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.860+0000 7f829b7fe700 1 -- 172.21.15.83:0/2730138663 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a409b640 con 0x55d1f8de65d0 2024-04-01T06:57:54.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.860+0000 7f82c303cb80 1 -- 172.21.15.83:0/2730138663 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d1f8de65d0 msgr2=0x55d1f8de69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:54.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.860+0000 7f82c303cb80 1 --2- 172.21.15.83:0/2730138663 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d1f8de65d0 0x55d1f8de69b0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f82a4009fd0 tx=0x7f82a400f890 comp rx=0 tx=0).stop 2024-04-01T06:57:54.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.860+0000 7f82c303cb80 1 -- 172.21.15.83:0/2730138663 shutdown_connections 2024-04-01T06:57:54.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.860+0000 7f82c303cb80 1 --2- 172.21.15.83:0/2730138663 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d1f8de65d0 0x55d1f8de69b0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.860+0000 7f82c303cb80 1 --2- 172.21.15.83:0/2730138663 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d1f8df1df0 0x55d1f8e03a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.860+0000 7f82c303cb80 1 --2- 172.21.15.83:0/2730138663 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1f8de6ef0 0x55d1f8def030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.860+0000 7f82c303cb80 1 -- 172.21.15.83:0/2730138663 >> 172.21.15.83:0/2730138663 conn(0x55d1f8d466a0 msgr2=0x55d1f8ddbf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:54.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.860+0000 7f82c303cb80 1 -- 172.21.15.83:0/2730138663 shutdown_connections 2024-04-01T06:57:54.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.860+0000 7f82c303cb80 1 -- 172.21.15.83:0/2730138663 wait complete. 2024-04-01T06:57:54.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.861+0000 7f82c303cb80 1 -- start start 2024-04-01T06:57:54.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.861+0000 7f82c303cb80 1 Processor -- start 2024-04-01T06:57:54.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.861+0000 7f82c303cb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1f8de65d0 0x55d1f8df67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.861+0000 7f82c303cb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d1f8de6ef0 0x55d1f8df6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.861+0000 7f82c303cb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d1f8df1df0 0x55d1f8df7240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.861+0000 7f82c303cb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1f8e545f0 con 0x55d1f8de6ef0 2024-04-01T06:57:54.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.861+0000 7f82c303cb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1f8e54760 con 0x55d1f8df1df0 2024-04-01T06:57:54.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.861+0000 7f82c303cb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1f8e54920 con 0x55d1f8de65d0 2024-04-01T06:57:54.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.861+0000 7f82c303cb80 10 client.0 _ll_register_callbacks cb 0x55d1f8cde470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:57:54.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.861+0000 7f82affff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d1f8de6ef0 0x55d1f8df6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.861+0000 7f82affff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d1f8de6ef0 0x55d1f8df6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:60930/0 (socket says 172.21.15.83:60930) 2024-04-01T06:57:54.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.861+0000 7f82affff700 1 -- 172.21.15.83:0/710597134 learned_addr learned my addr 172.21.15.83:0/710597134 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:54.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.861+0000 7f82b5443700 1 --2- 172.21.15.83:0/710597134 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d1f8df1df0 0x55d1f8df7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.861+0000 7f82b4c42700 1 --2- 172.21.15.83:0/710597134 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1f8de65d0 0x55d1f8df67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.862+0000 7f82affff700 1 -- 172.21.15.83:0/710597134 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1f8de65d0 msgr2=0x55d1f8df67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:54.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.862+0000 7f82affff700 1 --2- 172.21.15.83:0/710597134 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1f8de65d0 0x55d1f8df67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.862+0000 7f82affff700 1 -- 172.21.15.83:0/710597134 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d1f8df1df0 msgr2=0x55d1f8df7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:54.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.862+0000 7f82affff700 1 --2- 172.21.15.83:0/710597134 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d1f8df1df0 0x55d1f8df7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.862+0000 7f82affff700 1 -- 172.21.15.83:0/710597134 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d1f8bba3b0 con 0x55d1f8de6ef0 2024-04-01T06:57:54.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.862+0000 7f82affff700 1 --2- 172.21.15.83:0/710597134 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d1f8de6ef0 0x55d1f8df6d00 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f829c031a70 tx=0x7f829c031900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5c1c5c0723816e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:54.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.862+0000 7f828ffff700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:57:54.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.862+0000 7f828ffff700 1 -- 172.21.15.83:0/710597134 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829c005450 con 0x55d1f8de6ef0 2024-04-01T06:57:54.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.862+0000 7f828ffff700 1 -- 172.21.15.83:0/710597134 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f829c031ce0 con 0x55d1f8de6ef0 2024-04-01T06:57:54.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.862+0000 7f82c303cb80 1 -- 172.21.15.83:0/710597134 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f82a409b180 con 0x55d1f8de6ef0 2024-04-01T06:57:54.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.862+0000 7f828ffff700 1 -- 172.21.15.83:0/710597134 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f829c011a00 con 0x55d1f8de6ef0 2024-04-01T06:57:54.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.862+0000 7f82c303cb80 10 client.16047 fetch_fsmap learned FSMap version 28 2024-04-01T06:57:54.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.862+0000 7f82c303cb80 1 -- 172.21.15.83:0/710597134 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x55d1f8bbecd0 con 0x55d1f8de6ef0 2024-04-01T06:57:54.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.862+0000 7f828ffff700 1 -- 172.21.15.83:0/710597134 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f82a409b180 con 0x55d1f8de6ef0 2024-04-01T06:57:54.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.862+0000 7f828ffff700 1 -- 172.21.15.83:0/710597134 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 28) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f829c011440 con 0x55d1f8de6ef0 2024-04-01T06:57:54.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.862+0000 7f82c303cb80 10 client.16047 fetch_fsmap finished waiting for FSMap version 28 2024-04-01T06:57:54.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.862+0000 7f82c303cb80 10 client.16047 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-01T06:57:54.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.862+0000 7f82c303cb80 20 client.16047 populate_metadata read hostname 'smithi083' 2024-04-01T06:57:54.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.862+0000 7f82c303cb80 1 --2- 172.21.15.83:0/710597134 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55d1f8e55ea0 0x55d1f8e582c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:54.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.862+0000 7f82c303cb80 4 client.16047 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-01T06:57:54.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.862+0000 7f82c303cb80 1 -- 172.21.15.83:0/710597134 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55d1f8b87cf0 con 0x55d1f8e55ea0 2024-04-01T06:57:54.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.863+0000 7f82b4c42700 1 --2- 172.21.15.83:0/710597134 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55d1f8e55ea0 0x55d1f8e582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:54.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.863+0000 7f828ffff700 10 client.16047 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:57:54.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.863+0000 7f82b4c42700 1 --2- 172.21.15.83:0/710597134 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55d1f8e55ea0 0x55d1f8e582c0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5c37794f0b4874b server_cookie=2abe4c3a3c0465e8 in_seq=0 out_seq=0 2024-04-01T06:57:54.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.864+0000 7f828ffff700 1 -- 172.21.15.83:0/710597134 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55d1f8b87cf0 con 0x55d1f8e55ea0 2024-04-01T06:57:54.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.864+0000 7f828ffff700 10 client.16047 handle_command_reply: tid=0 2024-04-01T06:57:54.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.864+0000 7f82c303cb80 1 client.16047 shutdown 2024-04-01T06:57:54.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.864+0000 7f82c303cb80 1 -- 172.21.15.83:0/710597134 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d1f8de6ef0 msgr2=0x55d1f8df6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:54.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.864+0000 7f82c303cb80 1 --2- 172.21.15.83:0/710597134 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d1f8de6ef0 0x55d1f8df6d00 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f829c031a70 tx=0x7f829c031900 comp rx=0 tx=0).stop 2024-04-01T06:57:54.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.864+0000 7f82c303cb80 1 -- 172.21.15.83:0/710597134 shutdown_connections 2024-04-01T06:57:54.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.864+0000 7f82c303cb80 1 --2- 172.21.15.83:0/710597134 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55d1f8e55ea0 0x55d1f8e582c0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.864+0000 7f82c303cb80 1 --2- 172.21.15.83:0/710597134 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d1f8df1df0 0x55d1f8df7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.864+0000 7f828ffff700 0 client.16047 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:57:54.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.864+0000 7f82c303cb80 1 --2- 172.21.15.83:0/710597134 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d1f8de65d0 0x55d1f8df67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.864+0000 7f82c303cb80 1 --2- 172.21.15.83:0/710597134 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55d1f8de6ef0 0x55d1f8df6d00 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.870 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.864+0000 7f82c303cb80 1 -- 172.21.15.83:0/710597134 >> 172.21.15.83:0/710597134 conn(0x55d1f8d466a0 msgr2=0x55d1f8ddb5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:54.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.864+0000 7f82c303cb80 1 -- 172.21.15.83:0/710597134 shutdown_connections 2024-04-01T06:57:54.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.864+0000 7f82c303cb80 1 -- 172.21.15.83:0/710597134 wait complete. 2024-04-01T06:57:54.871 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.864+0000 7f82c303cb80 20 client.16047 trim_cache size 0 max 16384 2024-04-01T06:57:54.871 INFO:teuthology.orchestra.run.smithi083.stdout:[] 2024-04-01T06:57:54.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.865+0000 7f82b6ea6700 1 -- 172.21.15.83:0/1962686415 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f82a00a1310 msgr2=0x7f82a00a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:54.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.865+0000 7f82b6ea6700 1 --2- 172.21.15.83:0/1962686415 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f82a00a1310 0x7f82a00a37d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f82b01986d0 tx=0x7f829c00b5b0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.865+0000 7f82b6ea6700 1 -- 172.21.15.83:0/1962686415 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82b0067e30 msgr2=0x7f82b01971d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:54.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.865+0000 7f82b6ea6700 1 --2- 172.21.15.83:0/1962686415 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82b0067e30 0x7f82b01971d0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f82a4003a90 tx=0x7f82a4003b70 comp rx=0 tx=0).stop 2024-04-01T06:57:54.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.865+0000 7f82b6ea6700 1 -- 172.21.15.83:0/1962686415 shutdown_connections 2024-04-01T06:57:54.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.865+0000 7f82b6ea6700 1 --2- 172.21.15.83:0/1962686415 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f82a00a1310 0x7f82a00a37d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.872 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.865+0000 7f82b6ea6700 1 --2- 172.21.15.83:0/1962686415 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f82b0067e30 0x7f82b01971d0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.865+0000 7f82b6ea6700 1 --2- 172.21.15.83:0/1962686415 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f82b0105ce0 0x7f82b019ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.865+0000 7f82b6ea6700 1 --2- 172.21.15.83:0/1962686415 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82b00687f0 0x7f82b0197710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:54.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.865+0000 7f82b6ea6700 1 -- 172.21.15.83:0/1962686415 >> 172.21.15.83:0/1962686415 conn(0x7f82b0076d40 msgr2=0x7f82b00fd8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:54.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.865+0000 7f82b6ea6700 1 -- 172.21.15.83:0/1962686415 shutdown_connections 2024-04-01T06:57:54.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:54.865+0000 7f82b6ea6700 1 -- 172.21.15.83:0/1962686415 wait complete. 2024-04-01T06:57:55.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:54 smithi083 ceph-mon[43429]: pgmap v64: 97 pgs: 97 active+clean; 1.9 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 63 MiB/s rd, 154 MiB/s wr, 781 op/s 2024-04-01T06:57:55.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:54 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/3929301099' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:57:55.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:54 smithi153 ceph-mon[48187]: pgmap v64: 97 pgs: 97 active+clean; 1.9 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 63 MiB/s rd, 154 MiB/s wr, 781 op/s 2024-04-01T06:57:55.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:54 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/3929301099' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:57:55.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:54 smithi145 ceph-mon[47816]: pgmap v64: 97 pgs: 97 active+clean; 1.9 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 63 MiB/s rd, 154 MiB/s wr, 781 op/s 2024-04-01T06:57:55.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:54 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/3929301099' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:57:55.877 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-01T06:57:55.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T06:57:55.877 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-01T06:57:56.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.025+0000 7ff7b9e8d700 1 -- 172.21.15.83:0/1648858337 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7b4107db0 msgr2=0x7ff7b4108190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:56.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.025+0000 7ff7b9e8d700 1 --2- 172.21.15.83:0/1648858337 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7b4107db0 0x7ff7b4108190 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7ff7a40099c0 tx=0x7ff7a4009cd0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.025+0000 7ff7b9e8d700 1 -- 172.21.15.83:0/1648858337 shutdown_connections 2024-04-01T06:57:56.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.025+0000 7ff7b9e8d700 1 --2- 172.21.15.83:0/1648858337 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7b4107db0 0x7ff7b4108190 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.025+0000 7ff7b9e8d700 1 --2- 172.21.15.83:0/1648858337 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff7b4113f00 0x7ff7b41162f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.025+0000 7ff7b9e8d700 1 --2- 172.21.15.83:0/1648858337 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7b41086d0 0x7ff7b41139c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.025+0000 7ff7b9e8d700 1 -- 172.21.15.83:0/1648858337 >> 172.21.15.83:0/1648858337 conn(0x7ff7b406bdf0 msgr2=0x7ff7b406c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:56.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.025+0000 7ff7b9e8d700 1 -- 172.21.15.83:0/1648858337 shutdown_connections 2024-04-01T06:57:56.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.025+0000 7ff7b9e8d700 1 -- 172.21.15.83:0/1648858337 wait complete. 2024-04-01T06:57:56.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.026+0000 7ff7b9e8d700 1 Processor -- start 2024-04-01T06:57:56.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.026+0000 7ff7b9e8d700 1 -- start start 2024-04-01T06:57:56.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.026+0000 7ff7b9e8d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7b4107db0 0x7ff7b419fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:56.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.026+0000 7ff7b9e8d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7b41086d0 0x7ff7b419ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:56.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.026+0000 7ff7b9e8d700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff7b4113f00 0x7ff7b41a4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:56.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.026+0000 7ff7b9e8d700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b41a4950 con 0x7ff7b41086d0 2024-04-01T06:57:56.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.027+0000 7ff7b9e8d700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b41a4ac0 con 0x7ff7b4113f00 2024-04-01T06:57:56.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.027+0000 7ff7b9e8d700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b41a4c80 con 0x7ff7b4107db0 2024-04-01T06:57:56.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.027+0000 7ff7b2ffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7b41086d0 0x7ff7b419ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:56.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.027+0000 7ff7b2ffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7b41086d0 0x7ff7b419ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:60942/0 (socket says 172.21.15.83:60942) 2024-04-01T06:57:56.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.027+0000 7ff7b2ffd700 1 -- 172.21.15.83:0/916542711 learned_addr learned my addr 172.21.15.83:0/916542711 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:56.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.027+0000 7ff7b37fe700 1 --2- 172.21.15.83:0/916542711 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7b4107db0 0x7ff7b419fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:56.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.027+0000 7ff7b2ffd700 1 -- 172.21.15.83:0/916542711 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7b4107db0 msgr2=0x7ff7b419fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:56.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.027+0000 7ff7b2ffd700 1 --2- 172.21.15.83:0/916542711 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7b4107db0 0x7ff7b419fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.027+0000 7ff7b2ffd700 1 -- 172.21.15.83:0/916542711 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff7b4113f00 msgr2=0x7ff7b41a4380 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-01T06:57:56.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.027+0000 7ff7b2ffd700 1 --2- 172.21.15.83:0/916542711 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff7b4113f00 0x7ff7b41a4380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.027+0000 7ff7b2ffd700 1 -- 172.21.15.83:0/916542711 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a40095f0 con 0x7ff7b41086d0 2024-04-01T06:57:56.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.027+0000 7ff7b37fe700 1 --2- 172.21.15.83:0/916542711 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7b4107db0 0x7ff7b419fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:57:56.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.027+0000 7ff7b2ffd700 1 --2- 172.21.15.83:0/916542711 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7b41086d0 0x7ff7b419ffb0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7ff7a800b550 tx=0x7ff7a800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:56.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.028+0000 7ff7b0ff9700 1 -- 172.21.15.83:0/916542711 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a8011830 con 0x7ff7b41086d0 2024-04-01T06:57:56.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.028+0000 7ff7b9e8d700 1 -- 172.21.15.83:0/916542711 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7b41a4f60 con 0x7ff7b41086d0 2024-04-01T06:57:56.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.028+0000 7ff7b0ff9700 1 -- 172.21.15.83:0/916542711 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff7a8011e50 con 0x7ff7b41086d0 2024-04-01T06:57:56.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.028+0000 7ff7b0ff9700 1 -- 172.21.15.83:0/916542711 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a800f2e0 con 0x7ff7b41086d0 2024-04-01T06:57:56.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.028+0000 7ff7b9e8d700 1 -- 172.21.15.83:0/916542711 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7b41ac810 con 0x7ff7b41086d0 2024-04-01T06:57:56.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.031+0000 7ff7b0ff9700 1 -- 172.21.15.83:0/916542711 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 25) v1 ==== 135996+0+0 (secure 0 0 0) 0x7ff7a8011990 con 0x7ff7b41086d0 2024-04-01T06:57:56.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.031+0000 7ff7b0ff9700 1 --2- 172.21.15.83:0/916542711 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7ff79c0a1350 0x7ff79c0a3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:56.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.032+0000 7ff7b0ff9700 1 -- 172.21.15.83:0/916542711 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7ff7a80cc5c0 con 0x7ff7b41086d0 2024-04-01T06:57:56.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.032+0000 7ff7b37fe700 1 --2- 172.21.15.83:0/916542711 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7ff79c0a1350 0x7ff79c0a3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:56.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.033+0000 7ff7b37fe700 1 --2- 172.21.15.83:0/916542711 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7ff79c0a1350 0x7ff79c0a3810 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4009fd0 tx=0x7ff7a4005050 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:56.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.034+0000 7ff7c6023b80 1 Processor -- start 2024-04-01T06:57:56.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.034+0000 7ff7c6023b80 1 -- start start 2024-04-01T06:57:56.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.034+0000 7ff7c6023b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5597c4952650 0x5597c4952a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:56.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.034+0000 7ff7c6023b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5597c4952f70 0x5597c495d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:56.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.034+0000 7ff7c6023b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5597c495de70 0x5597c4960260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:56.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.034+0000 7ff7c6023b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597c48aba10 con 0x5597c495de70 2024-04-01T06:57:56.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.034+0000 7ff7c6023b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597c48a93d0 con 0x5597c4952650 2024-04-01T06:57:56.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.034+0000 7ff7c6023b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597c48a4cc0 con 0x5597c4952f70 2024-04-01T06:57:56.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.034+0000 7ff7b2ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5597c4952f70 0x5597c495d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:56.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.034+0000 7ff7b3fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5597c495de70 0x5597c4960260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:56.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.034+0000 7ff7b2ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5597c4952f70 0x5597c495d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.83:37804/0 (socket says 172.21.15.83:37804) 2024-04-01T06:57:56.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.034+0000 7ff7b2ffd700 1 -- 172.21.15.83:0/2980739644 learned_addr learned my addr 172.21.15.83:0/2980739644 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:56.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.035+0000 7ff7b37fe700 1 --2- 172.21.15.83:0/2980739644 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5597c4952650 0x5597c4952a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:56.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.035+0000 7ff7b2ffd700 1 -- 172.21.15.83:0/2980739644 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5597c4952650 msgr2=0x5597c4952a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:56.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.035+0000 7ff7b2ffd700 1 --2- 172.21.15.83:0/2980739644 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5597c4952650 0x5597c4952a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.035+0000 7ff7b2ffd700 1 -- 172.21.15.83:0/2980739644 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5597c495de70 msgr2=0x5597c4960260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:56.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.035+0000 7ff7b2ffd700 1 --2- 172.21.15.83:0/2980739644 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5597c495de70 0x5597c4960260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.035+0000 7ff7b2ffd700 1 -- 172.21.15.83:0/2980739644 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5597c4726430 con 0x5597c4952f70 2024-04-01T06:57:56.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.035+0000 7ff7b3fff700 1 --2- 172.21.15.83:0/2980739644 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5597c495de70 0x5597c4960260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T06:57:56.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.035+0000 7ff7b2ffd700 1 --2- 172.21.15.83:0/2980739644 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5597c4952f70 0x5597c495d930 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8095d40 tx=0x7ff7a8099380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6e6a82ae6bd663b server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:56.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.035+0000 7ff799ffb700 1 -- 172.21.15.83:0/2980739644 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a8099f40 con 0x5597c4952f70 2024-04-01T06:57:56.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.036+0000 7ff799ffb700 1 -- 172.21.15.83:0/2980739644 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff7a8099840 con 0x5597c4952f70 2024-04-01T06:57:56.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.036+0000 7ff799ffb700 1 -- 172.21.15.83:0/2980739644 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a8017520 con 0x5597c4952f70 2024-04-01T06:57:56.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.037+0000 7ff7c6023b80 1 -- 172.21.15.83:0/2980739644 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5597c4952f70 msgr2=0x5597c495d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:56.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.037+0000 7ff7c6023b80 1 --2- 172.21.15.83:0/2980739644 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5597c4952f70 0x5597c495d930 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8095d40 tx=0x7ff7a8099380 comp rx=0 tx=0).stop 2024-04-01T06:57:56.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.038+0000 7ff7c6023b80 1 -- 172.21.15.83:0/2980739644 shutdown_connections 2024-04-01T06:57:56.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.038+0000 7ff7c6023b80 1 --2- 172.21.15.83:0/2980739644 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5597c495de70 0x5597c4960260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.038+0000 7ff7c6023b80 1 --2- 172.21.15.83:0/2980739644 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5597c4952650 0x5597c4952a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.038+0000 7ff7c6023b80 1 --2- 172.21.15.83:0/2980739644 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5597c4952f70 0x5597c495d930 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.038+0000 7ff7c6023b80 1 -- 172.21.15.83:0/2980739644 >> 172.21.15.83:0/2980739644 conn(0x5597c48b2720 msgr2=0x5597c494eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:56.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.038+0000 7ff7c6023b80 1 -- 172.21.15.83:0/2980739644 shutdown_connections 2024-04-01T06:57:56.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.038+0000 7ff7c6023b80 1 -- 172.21.15.83:0/2980739644 wait complete. 2024-04-01T06:57:56.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.039+0000 7ff7c6023b80 1 -- start start 2024-04-01T06:57:56.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.039+0000 7ff7c6023b80 1 Processor -- start 2024-04-01T06:57:56.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.040+0000 7ff7c6023b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5597c4952650 0x5597c495d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:56.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.040+0000 7ff7c6023b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5597c4952f70 0x5597c495ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:56.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.040+0000 7ff7c6023b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5597c495de70 0x5597c495b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:56.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.040+0000 7ff7c6023b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597c4840e00 con 0x5597c4952f70 2024-04-01T06:57:56.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.040+0000 7ff7c6023b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597c4840aa0 con 0x5597c495de70 2024-04-01T06:57:56.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.040+0000 7ff7c6023b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597c4728720 con 0x5597c4952650 2024-04-01T06:57:56.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.040+0000 7ff7c6023b80 10 client.0 _ll_register_callbacks cb 0x5597c484a4f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:57:56.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.040+0000 7ff7b37fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5597c4952650 0x5597c495d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:56.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.040+0000 7ff7b37fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5597c4952650 0x5597c495d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.83:37806/0 (socket says 172.21.15.83:37806) 2024-04-01T06:57:56.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.040+0000 7ff7b37fe700 1 -- 172.21.15.83:0/1085883976 learned_addr learned my addr 172.21.15.83:0/1085883976 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:56.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.040+0000 7ff7b2ffd700 1 --2- 172.21.15.83:0/1085883976 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5597c4952f70 0x5597c495ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:56.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.040+0000 7ff7b3fff700 1 --2- 172.21.15.83:0/1085883976 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5597c495de70 0x5597c495b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:56.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.040+0000 7ff7b37fe700 1 -- 172.21.15.83:0/1085883976 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5597c495de70 msgr2=0x5597c495b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:56.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.040+0000 7ff7b37fe700 1 --2- 172.21.15.83:0/1085883976 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5597c495de70 0x5597c495b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.040+0000 7ff7b37fe700 1 -- 172.21.15.83:0/1085883976 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5597c4952f70 msgr2=0x5597c495ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:56.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.040+0000 7ff7b37fe700 1 --2- 172.21.15.83:0/1085883976 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5597c4952f70 0x5597c495ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.041 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.040+0000 7ff7b37fe700 1 -- 172.21.15.83:0/1085883976 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7ac00e140 con 0x5597c4952650 2024-04-01T06:57:56.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.041+0000 7ff7b2ffd700 1 --2- 172.21.15.83:0/1085883976 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5597c4952f70 0x5597c495ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:57:56.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.041+0000 7ff7b37fe700 1 --2- 172.21.15.83:0/1085883976 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5597c4952650 0x5597c495d8f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff7a40099c0 tx=0x7ff7a401a050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46ac5b2a207a273b server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:56.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.041+0000 7ff792ffd700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-04-01T06:57:56.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.041+0000 7ff792ffd700 1 -- 172.21.15.83:0/1085883976 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a402b040 con 0x5597c4952650 2024-04-01T06:57:56.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.041+0000 7ff792ffd700 1 -- 172.21.15.83:0/1085883976 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7ff7a4024420 con 0x5597c4952650 2024-04-01T06:57:56.042 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.041+0000 7ff7c6023b80 1 -- 172.21.15.83:0/1085883976 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5597c4865400 con 0x5597c4952650 2024-04-01T06:57:56.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.041+0000 7ff792ffd700 1 -- 172.21.15.83:0/1085883976 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff7a40245e0 con 0x5597c4952650 2024-04-01T06:57:56.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.041+0000 7ff7c6023b80 10 client.25477 fetch_fsmap learned FSMap version 28 2024-04-01T06:57:56.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.041+0000 7ff7c6023b80 1 -- 172.21.15.83:0/1085883976 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x7ff7b41ac810 con 0x5597c4952650 2024-04-01T06:57:56.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.042+0000 7ff792ffd700 1 -- 172.21.15.83:0/1085883976 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff7a403d020 con 0x5597c4952650 2024-04-01T06:57:56.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.042+0000 7ff792ffd700 1 -- 172.21.15.83:0/1085883976 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 28) v1 ==== 7474+0+0 (secure 0 0 0) 0x7ff7a4039730 con 0x5597c4952650 2024-04-01T06:57:56.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.042+0000 7ff7c6023b80 10 client.25477 fetch_fsmap finished waiting for FSMap version 28 2024-04-01T06:57:56.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.042+0000 7ff7c6023b80 10 client.25477 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-01T06:57:56.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.042+0000 7ff7c6023b80 20 client.25477 populate_metadata read hostname 'smithi083' 2024-04-01T06:57:56.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.042+0000 7ff7c6023b80 1 --2- 172.21.15.83:0/1085883976 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5597c496db00 0x5597c496ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:56.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.042+0000 7ff7c6023b80 4 client.25477 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-01T06:57:56.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.042+0000 7ff7c6023b80 1 -- 172.21.15.83:0/1085883976 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5597c489d780 con 0x5597c496db00 2024-04-01T06:57:56.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.042+0000 7ff7b2ffd700 1 --2- 172.21.15.83:0/1085883976 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5597c496db00 0x5597c496ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:56.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.043+0000 7ff792ffd700 10 client.25477 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:57:56.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.043+0000 7ff7b2ffd700 1 --2- 172.21.15.83:0/1085883976 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5597c496db00 0x5597c496ff20 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=665096b8d06dac06 server_cookie=14ff50f7b83ca6e1 in_seq=0 out_seq=0 2024-04-01T06:57:56.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.045+0000 7ff792ffd700 1 -- 172.21.15.83:0/1085883976 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5597c489d780 con 0x5597c496db00 2024-04-01T06:57:56.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.045+0000 7ff792ffd700 10 client.25477 handle_command_reply: tid=0 2024-04-01T06:57:56.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.045+0000 7ff7c6023b80 1 client.25477 shutdown 2024-04-01T06:57:56.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.046+0000 7ff7c6023b80 1 -- 172.21.15.83:0/1085883976 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5597c4952650 msgr2=0x5597c495d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:56.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.046+0000 7ff7c6023b80 1 --2- 172.21.15.83:0/1085883976 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5597c4952650 0x5597c495d8f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff7a40099c0 tx=0x7ff7a401a050 comp rx=0 tx=0).stop 2024-04-01T06:57:56.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.046+0000 7ff7c6023b80 1 -- 172.21.15.83:0/1085883976 shutdown_connections 2024-04-01T06:57:56.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.046+0000 7ff7c6023b80 1 --2- 172.21.15.83:0/1085883976 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5597c496db00 0x5597c496ff20 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.046+0000 7ff7c6023b80 1 --2- 172.21.15.83:0/1085883976 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5597c495de70 0x5597c495b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.046+0000 7ff7c6023b80 1 --2- 172.21.15.83:0/1085883976 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5597c4952650 0x5597c495d8f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.046+0000 7ff792ffd700 0 client.25477 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:57:56.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.046+0000 7ff7c6023b80 1 --2- 172.21.15.83:0/1085883976 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5597c4952f70 0x5597c495ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.046+0000 7ff7c6023b80 1 -- 172.21.15.83:0/1085883976 >> 172.21.15.83:0/1085883976 conn(0x5597c48b2720 msgr2=0x5597c4954740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:56.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.046+0000 7ff7c6023b80 1 -- 172.21.15.83:0/1085883976 shutdown_connections 2024-04-01T06:57:56.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.046+0000 7ff7c6023b80 1 -- 172.21.15.83:0/1085883976 wait complete. 2024-04-01T06:57:56.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.046+0000 7ff7c6023b80 20 client.25477 trim_cache size 0 max 16384 2024-04-01T06:57:56.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.067+0000 7ff7c6023b80 1 Processor -- start 2024-04-01T06:57:56.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.067+0000 7ff7c6023b80 1 -- start start 2024-04-01T06:57:56.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.068+0000 7ff7c6023b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5597c4952650 0x5597c4964af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:56.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.068+0000 7ff7c6023b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5597c4952f70 0x5597c4959520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:56.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.068+0000 7ff7c6023b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5597c495de70 0x5597c4959a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:56.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.068+0000 7ff7c6023b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597c4959fa0 con 0x5597c4952650 2024-04-01T06:57:56.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.068+0000 7ff7c6023b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597c49501e0 con 0x5597c495de70 2024-04-01T06:57:56.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.068+0000 7ff7c6023b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597c4948bd0 con 0x5597c4952f70 2024-04-01T06:57:56.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.068+0000 7ff7b37fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5597c4952650 0x5597c4964af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:56.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.068+0000 7ff7b37fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5597c4952650 0x5597c4964af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:60966/0 (socket says 172.21.15.83:60966) 2024-04-01T06:57:56.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.068+0000 7ff7b37fe700 1 -- 172.21.15.83:0/2234871394 learned_addr learned my addr 172.21.15.83:0/2234871394 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:56.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.068+0000 7ff7b3fff700 1 --2- 172.21.15.83:0/2234871394 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5597c495de70 0x5597c4959a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:56.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.068+0000 7ff7b2ffd700 1 --2- 172.21.15.83:0/2234871394 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5597c4952f70 0x5597c4959520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:56.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.068+0000 7ff7b37fe700 1 -- 172.21.15.83:0/2234871394 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5597c4952f70 msgr2=0x5597c4959520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:56.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.068+0000 7ff7b37fe700 1 --2- 172.21.15.83:0/2234871394 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5597c4952f70 0x5597c4959520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.068+0000 7ff7b37fe700 1 -- 172.21.15.83:0/2234871394 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5597c495de70 msgr2=0x5597c4959a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:56.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.068+0000 7ff7b37fe700 1 --2- 172.21.15.83:0/2234871394 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5597c495de70 0x5597c4959a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.068+0000 7ff7b37fe700 1 -- 172.21.15.83:0/2234871394 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5597c4974b30 con 0x5597c4952650 2024-04-01T06:57:56.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.068+0000 7ff7b37fe700 1 --2- 172.21.15.83:0/2234871394 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5597c4952650 0x5597c4964af0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7ff7a40036c0 tx=0x7ff7a4003a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=becc2f2c232c3944 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:56.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.068+0000 7ff79a7fc700 1 -- 172.21.15.83:0/2234871394 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a402b030 con 0x5597c4952650 2024-04-01T06:57:56.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.068+0000 7ff79a7fc700 1 -- 172.21.15.83:0/2234871394 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff7a403d040 con 0x5597c4952650 2024-04-01T06:57:56.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.068+0000 7ff79a7fc700 1 -- 172.21.15.83:0/2234871394 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a402fc10 con 0x5597c4952650 2024-04-01T06:57:56.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.069+0000 7ff7c6023b80 1 -- 172.21.15.83:0/2234871394 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5597c4952650 msgr2=0x5597c4964af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:56.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.069+0000 7ff7c6023b80 1 --2- 172.21.15.83:0/2234871394 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5597c4952650 0x5597c4964af0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7ff7a40036c0 tx=0x7ff7a4003a00 comp rx=0 tx=0).stop 2024-04-01T06:57:56.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.069+0000 7ff7c6023b80 1 -- 172.21.15.83:0/2234871394 shutdown_connections 2024-04-01T06:57:56.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.069+0000 7ff7c6023b80 1 --2- 172.21.15.83:0/2234871394 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5597c4952650 0x5597c4964af0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.069+0000 7ff7c6023b80 1 --2- 172.21.15.83:0/2234871394 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5597c495de70 0x5597c4959a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.069+0000 7ff7c6023b80 1 --2- 172.21.15.83:0/2234871394 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5597c4952f70 0x5597c4959520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.069+0000 7ff7c6023b80 1 -- 172.21.15.83:0/2234871394 >> 172.21.15.83:0/2234871394 conn(0x5597c48b2720 msgr2=0x5597c4947ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:56.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.069+0000 7ff7c6023b80 1 -- 172.21.15.83:0/2234871394 shutdown_connections 2024-04-01T06:57:56.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.069+0000 7ff7c6023b80 1 -- 172.21.15.83:0/2234871394 wait complete. 2024-04-01T06:57:56.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.069+0000 7ff7c6023b80 1 -- start start 2024-04-01T06:57:56.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.070+0000 7ff7c6023b80 1 Processor -- start 2024-04-01T06:57:56.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.070+0000 7ff7c6023b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5597c4952650 0x5597c49bac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:56.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.070+0000 7ff7c6023b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5597c4952f70 0x5597c49bb160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:56.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.070+0000 7ff7c6023b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5597c495de70 0x5597c4963b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:56.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.070+0000 7ff7c6023b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597c4964210 con 0x5597c4952f70 2024-04-01T06:57:56.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.070+0000 7ff7c6023b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597c4964380 con 0x5597c495de70 2024-04-01T06:57:56.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.070+0000 7ff7c6023b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597c4964540 con 0x5597c4952650 2024-04-01T06:57:56.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.070+0000 7ff7c6023b80 10 client.0 _ll_register_callbacks cb 0x7ff7a400baa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:57:56.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.070+0000 7ff7b2ffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5597c4952f70 0x5597c49bb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:56.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.070+0000 7ff7b2ffd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5597c4952f70 0x5597c49bb160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:60970/0 (socket says 172.21.15.83:60970) 2024-04-01T06:57:56.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.070+0000 7ff7b2ffd700 1 -- 172.21.15.83:0/2993062245 learned_addr learned my addr 172.21.15.83:0/2993062245 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:56.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.070+0000 7ff7b37fe700 1 --2- 172.21.15.83:0/2993062245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5597c4952650 0x5597c49bac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:56.075 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.070+0000 7ff7b3fff700 1 --2- 172.21.15.83:0/2993062245 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5597c495de70 0x5597c4963b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:56.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.070+0000 7ff7b2ffd700 1 -- 172.21.15.83:0/2993062245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5597c4952650 msgr2=0x5597c49bac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:56.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.070+0000 7ff7b2ffd700 1 --2- 172.21.15.83:0/2993062245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5597c4952650 0x5597c49bac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.070+0000 7ff7b2ffd700 1 -- 172.21.15.83:0/2993062245 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5597c495de70 msgr2=0x5597c4963b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:56.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.070+0000 7ff7b2ffd700 1 --2- 172.21.15.83:0/2993062245 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5597c495de70 0x5597c4963b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.070+0000 7ff7b2ffd700 1 -- 172.21.15.83:0/2993062245 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7b41ac810 con 0x5597c4952f70 2024-04-01T06:57:56.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.071+0000 7ff7b2ffd700 1 --2- 172.21.15.83:0/2993062245 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5597c4952f70 0x5597c49bb160 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7ff7a80c9f30 tx=0x7ff7a80108c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=621a1bb637bbd17b server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:56.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.071+0000 7ff792ffd700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:57:56.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.071+0000 7ff792ffd700 1 -- 172.21.15.83:0/2993062245 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a8099f40 con 0x5597c4952f70 2024-04-01T06:57:56.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.071+0000 7ff792ffd700 1 -- 172.21.15.83:0/2993062245 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7ff7a80a1cc0 con 0x5597c4952f70 2024-04-01T06:57:56.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.071+0000 7ff7c6023b80 1 -- 172.21.15.83:0/2993062245 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff7a8099840 con 0x5597c4952f70 2024-04-01T06:57:56.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.071+0000 7ff792ffd700 1 -- 172.21.15.83:0/2993062245 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff7a8097be0 con 0x5597c4952f70 2024-04-01T06:57:56.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.071+0000 7ff7c6023b80 10 client.16065 fetch_fsmap learned FSMap version 28 2024-04-01T06:57:56.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.071+0000 7ff7c6023b80 1 -- 172.21.15.83:0/2993062245 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x5597c46d2be0 con 0x5597c4952f70 2024-04-01T06:57:56.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.071+0000 7ff792ffd700 1 -- 172.21.15.83:0/2993062245 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff7a8099840 con 0x5597c4952f70 2024-04-01T06:57:56.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.071+0000 7ff792ffd700 1 -- 172.21.15.83:0/2993062245 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 28) v1 ==== 7474+0+0 (secure 0 0 0) 0x7ff7a8099aa0 con 0x5597c4952f70 2024-04-01T06:57:56.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.071+0000 7ff7c6023b80 10 client.16065 fetch_fsmap finished waiting for FSMap version 28 2024-04-01T06:57:56.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.071+0000 7ff7c6023b80 10 client.16065 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-01T06:57:56.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.071+0000 7ff7c6023b80 20 client.16065 populate_metadata read hostname 'smithi083' 2024-04-01T06:57:56.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.071+0000 7ff7c6023b80 1 --2- 172.21.15.83:0/2993062245 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5597c49c3900 0x5597c49c5d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:56.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.071+0000 7ff7c6023b80 4 client.16065 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-01T06:57:56.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.071+0000 7ff7c6023b80 1 -- 172.21.15.83:0/2993062245 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5597c46f3d70 con 0x5597c49c3900 2024-04-01T06:57:56.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.114+0000 7ff7b37fe700 1 --2- 172.21.15.83:0/2993062245 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5597c49c3900 0x5597c49c5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:56.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.116+0000 7ff7b37fe700 1 --2- 172.21.15.83:0/2993062245 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5597c49c3900 0x5597c49c5d20 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f289e820adc63e7 server_cookie=7853b6bb9eb6ca04 in_seq=0 out_seq=0 2024-04-01T06:57:56.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.116+0000 7ff792ffd700 10 client.16065 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:57:56.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.117+0000 7ff792ffd700 1 -- 172.21.15.83:0/2993062245 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5597c46f3d70 con 0x5597c49c3900 2024-04-01T06:57:56.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.117+0000 7ff792ffd700 10 client.16065 handle_command_reply: tid=0 2024-04-01T06:57:56.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.117+0000 7ff7c6023b80 1 client.16065 shutdown 2024-04-01T06:57:56.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.117+0000 7ff7c6023b80 1 -- 172.21.15.83:0/2993062245 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5597c4952f70 msgr2=0x5597c49bb160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:56.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.117+0000 7ff7c6023b80 1 --2- 172.21.15.83:0/2993062245 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5597c4952f70 0x5597c49bb160 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7ff7a80c9f30 tx=0x7ff7a80108c0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.118+0000 7ff7c6023b80 1 -- 172.21.15.83:0/2993062245 shutdown_connections 2024-04-01T06:57:56.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.118+0000 7ff7c6023b80 1 --2- 172.21.15.83:0/2993062245 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5597c49c3900 0x5597c49c5d20 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.118+0000 7ff7c6023b80 1 --2- 172.21.15.83:0/2993062245 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5597c495de70 0x5597c4963b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.118+0000 7ff7c6023b80 1 --2- 172.21.15.83:0/2993062245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5597c4952650 0x5597c49bac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.118+0000 7ff7c6023b80 1 --2- 172.21.15.83:0/2993062245 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5597c4952f70 0x5597c49bb160 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.118+0000 7ff7c6023b80 1 -- 172.21.15.83:0/2993062245 >> 172.21.15.83:0/2993062245 conn(0x5597c48b2720 msgr2=0x5597c49594c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:56.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.118+0000 7ff792ffd700 0 client.16065 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:57:56.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.118+0000 7ff7c6023b80 1 -- 172.21.15.83:0/2993062245 shutdown_connections 2024-04-01T06:57:56.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.118+0000 7ff7c6023b80 1 -- 172.21.15.83:0/2993062245 wait complete. 2024-04-01T06:57:56.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.118+0000 7ff7c6023b80 20 client.16065 trim_cache size 0 max 16384 2024-04-01T06:57:56.119 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-04-01T06:57:56.119 INFO:teuthology.orchestra.run.smithi083.stdout: "return_code": 0, 2024-04-01T06:57:56.119 INFO:teuthology.orchestra.run.smithi083.stdout: "scrub_tag": "854c92fb-c32d-492d-9f69-2ce2c7fc7e2f", 2024-04-01T06:57:56.119 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": "asynchronous" 2024-04-01T06:57:56.119 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-04-01T06:57:56.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.118+0000 7ff7b9e8d700 1 -- 172.21.15.83:0/916542711 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7ff79c0a1350 msgr2=0x7ff79c0a3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:56.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.118+0000 7ff7b9e8d700 1 --2- 172.21.15.83:0/916542711 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7ff79c0a1350 0x7ff79c0a3810 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4009fd0 tx=0x7ff7a4005050 comp rx=0 tx=0).stop 2024-04-01T06:57:56.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.118+0000 7ff7b9e8d700 1 -- 172.21.15.83:0/916542711 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7b41086d0 msgr2=0x7ff7b419ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:56.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.118+0000 7ff7b9e8d700 1 --2- 172.21.15.83:0/916542711 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7b41086d0 0x7ff7b419ffb0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7ff7a800b550 tx=0x7ff7a800b910 comp rx=0 tx=0).stop 2024-04-01T06:57:56.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.118+0000 7ff7b9e8d700 1 -- 172.21.15.83:0/916542711 shutdown_connections 2024-04-01T06:57:56.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.118+0000 7ff7b9e8d700 1 --2- 172.21.15.83:0/916542711 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7ff79c0a1350 0x7ff79c0a3810 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.118+0000 7ff7b9e8d700 1 --2- 172.21.15.83:0/916542711 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff7b4113f00 0x7ff7b41a4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.118+0000 7ff7b9e8d700 1 --2- 172.21.15.83:0/916542711 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7b4107db0 0x7ff7b419fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.118+0000 7ff7b9e8d700 1 --2- 172.21.15.83:0/916542711 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff7b41086d0 0x7ff7b419ffb0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.119+0000 7ff7b9e8d700 1 -- 172.21.15.83:0/916542711 >> 172.21.15.83:0/916542711 conn(0x7ff7b406bdf0 msgr2=0x7ff7b406f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:56.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.119+0000 7ff7b9e8d700 1 -- 172.21.15.83:0/916542711 shutdown_connections 2024-04-01T06:57:56.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.121+0000 7ff7b9e8d700 1 -- 172.21.15.83:0/916542711 wait complete. 2024-04-01T06:57:56.138 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-01T06:57:56.138 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-01T06:57:56.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.276+0000 7f77a8447700 1 -- 172.21.15.83:0/1331133976 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77a01060f0 msgr2=0x7f77a010dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:56.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.276+0000 7f77a8447700 1 --2- 172.21.15.83:0/1331133976 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77a01060f0 0x7f77a010dc90 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f779800b0a0 tx=0x7f779800b3b0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.276+0000 7f77a8447700 1 -- 172.21.15.83:0/1331133976 shutdown_connections 2024-04-01T06:57:56.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.276+0000 7f77a8447700 1 --2- 172.21.15.83:0/1331133976 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77a01060f0 0x7f77a010dc90 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.276+0000 7f77a8447700 1 --2- 172.21.15.83:0/1331133976 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f77a00ff8e0 0x7f77a00ffcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.276+0000 7f77a8447700 1 --2- 172.21.15.83:0/1331133976 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f77a0100290 0x7f77a01059c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.276+0000 7f77a8447700 1 -- 172.21.15.83:0/1331133976 >> 172.21.15.83:0/1331133976 conn(0x7f77a0074f60 msgr2=0x7f77a0075370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:56.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.276+0000 7f77a8447700 1 -- 172.21.15.83:0/1331133976 shutdown_connections 2024-04-01T06:57:56.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.277+0000 7f77a8447700 1 -- 172.21.15.83:0/1331133976 wait complete. 2024-04-01T06:57:56.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.277+0000 7f77a8447700 1 Processor -- start 2024-04-01T06:57:56.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.277+0000 7f77a8447700 1 -- start start 2024-04-01T06:57:56.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.277+0000 7f77a8447700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f77a00ff8e0 0x7f77a01973f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:56.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.277+0000 7f77a8447700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77a01060f0 0x7f77a0197930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:56.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.277+0000 7f77a8447700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f77a019bcd0 0x7f77a019c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:56.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.277+0000 7f77a8447700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a019c750 con 0x7f77a01060f0 2024-04-01T06:57:56.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.277+0000 7f77a8447700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a019c8c0 con 0x7f77a00ff8e0 2024-04-01T06:57:56.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.277+0000 7f77a8447700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a019ca80 con 0x7f77a019bcd0 2024-04-01T06:57:56.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.277+0000 7f77a59e2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77a01060f0 0x7f77a0197930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:56.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.277+0000 7f77a59e2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77a01060f0 0x7f77a0197930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:60980/0 (socket says 172.21.15.83:60980) 2024-04-01T06:57:56.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.277+0000 7f77a59e2700 1 -- 172.21.15.83:0/1092160971 learned_addr learned my addr 172.21.15.83:0/1092160971 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:56.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.277+0000 7f77a69e4700 1 --2- 172.21.15.83:0/1092160971 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f77a019bcd0 0x7f77a019c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:56.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.278+0000 7f77a61e3700 1 --2- 172.21.15.83:0/1092160971 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f77a00ff8e0 0x7f77a01973f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:56.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.278+0000 7f77a59e2700 1 -- 172.21.15.83:0/1092160971 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f77a019bcd0 msgr2=0x7f77a019c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:56.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.278+0000 7f77a59e2700 1 --2- 172.21.15.83:0/1092160971 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f77a019bcd0 0x7f77a019c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.278+0000 7f77a59e2700 1 -- 172.21.15.83:0/1092160971 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f77a00ff8e0 msgr2=0x7f77a01973f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:56.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.278+0000 7f77a59e2700 1 --2- 172.21.15.83:0/1092160971 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f77a00ff8e0 0x7f77a01973f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.278+0000 7f77a59e2700 1 -- 172.21.15.83:0/1092160971 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7798009d00 con 0x7f77a01060f0 2024-04-01T06:57:56.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.278+0000 7f77a59e2700 1 --2- 172.21.15.83:0/1092160971 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77a01060f0 0x7f77a0197930 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f779c00d980 tx=0x7f779c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:56.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.278+0000 7f77977fe700 1 -- 172.21.15.83:0/1092160971 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779c009930 con 0x7f77a01060f0 2024-04-01T06:57:56.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.278+0000 7f77a8447700 1 -- 172.21.15.83:0/1092160971 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77a01a3fe0 con 0x7f77a01060f0 2024-04-01T06:57:56.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.278+0000 7f77977fe700 1 -- 172.21.15.83:0/1092160971 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f779c010460 con 0x7f77a01060f0 2024-04-01T06:57:56.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.278+0000 7f77977fe700 1 -- 172.21.15.83:0/1092160971 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779c00f620 con 0x7f77a01060f0 2024-04-01T06:57:56.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.278+0000 7f77a8447700 1 -- 172.21.15.83:0/1092160971 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77a01a44b0 con 0x7f77a01060f0 2024-04-01T06:57:56.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.280+0000 7f77977fe700 1 -- 172.21.15.83:0/1092160971 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 25) v1 ==== 135996+0+0 (secure 0 0 0) 0x7f779c0108d0 con 0x7f77a01060f0 2024-04-01T06:57:56.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.281+0000 7f77977fe700 1 --2- 172.21.15.83:0/1092160971 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f778c0a1290 0x7f778c0a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:56.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.281+0000 7f77a61e3700 1 --2- 172.21.15.83:0/1092160971 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f778c0a1290 0x7f778c0a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:56.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.281+0000 7f77977fe700 1 -- 172.21.15.83:0/1092160971 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f779c0cca10 con 0x7f77a01060f0 2024-04-01T06:57:56.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.281+0000 7f77a61e3700 1 --2- 172.21.15.83:0/1092160971 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f778c0a1290 0x7f778c0a3750 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7790009bf0 tx=0x7f7790009260 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:56.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.282+0000 7f77b45ddb80 1 Processor -- start 2024-04-01T06:57:56.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.282+0000 7f77b45ddb80 1 -- start start 2024-04-01T06:57:56.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.282+0000 7f77b45ddb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5610c09885d0 0x5610c09889b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:56.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.282+0000 7f77b45ddb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5610c0988ef0 0x5610c09938b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:56.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.282+0000 7f77b45ddb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5610c0993df0 0x5610c09961e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:56.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.282+0000 7f77b45ddb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610c08e1990 con 0x5610c0993df0 2024-04-01T06:57:56.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.282+0000 7f77b45ddb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610c08df350 con 0x5610c0988ef0 2024-04-01T06:57:56.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.282+0000 7f77b45ddb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610c08dac40 con 0x5610c09885d0 2024-04-01T06:57:56.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.282+0000 7f77a61e3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5610c09885d0 0x5610c09889b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:56.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.282+0000 7f77a69e4700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5610c0993df0 0x5610c09961e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:56.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.282+0000 7f77a61e3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5610c09885d0 0x5610c09889b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.83:37840/0 (socket says 172.21.15.83:37840) 2024-04-01T06:57:56.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.282+0000 7f77a69e4700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5610c0993df0 0x5610c09961e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:60994/0 (socket says 172.21.15.83:60994) 2024-04-01T06:57:56.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.282+0000 7f77a61e3700 1 -- 172.21.15.83:0/750120098 learned_addr learned my addr 172.21.15.83:0/750120098 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:56.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.282+0000 7f77a59e2700 1 --2- 172.21.15.83:0/750120098 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5610c0988ef0 0x5610c09938b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:56.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.283+0000 7f77a61e3700 1 -- 172.21.15.83:0/750120098 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5610c0988ef0 msgr2=0x5610c09938b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:56.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.283+0000 7f77a61e3700 1 --2- 172.21.15.83:0/750120098 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5610c0988ef0 0x5610c09938b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.283+0000 7f77a61e3700 1 -- 172.21.15.83:0/750120098 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5610c0993df0 msgr2=0x5610c09961e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:56.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.283+0000 7f77a61e3700 1 --2- 172.21.15.83:0/750120098 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5610c0993df0 0x5610c09961e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.283+0000 7f77a61e3700 1 -- 172.21.15.83:0/750120098 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610c075c3b0 con 0x5610c09885d0 2024-04-01T06:57:56.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.283+0000 7f77a69e4700 1 --2- 172.21.15.83:0/750120098 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5610c0993df0 0x5610c09961e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T06:57:56.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.283+0000 7f77a61e3700 1 --2- 172.21.15.83:0/750120098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5610c09885d0 0x5610c09889b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7790011e40 tx=0x7f7790014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=957a8252e61c89dd server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:56.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.283+0000 7f7794da8700 1 -- 172.21.15.83:0/750120098 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7790012dc0 con 0x5610c09885d0 2024-04-01T06:57:56.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.283+0000 7f7794da8700 1 -- 172.21.15.83:0/750120098 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7790016070 con 0x5610c09885d0 2024-04-01T06:57:56.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.283+0000 7f7794da8700 1 -- 172.21.15.83:0/750120098 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7790003d20 con 0x5610c09885d0 2024-04-01T06:57:56.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.284+0000 7f77b45ddb80 1 -- 172.21.15.83:0/750120098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5610c09885d0 msgr2=0x5610c09889b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:56.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.284+0000 7f77b45ddb80 1 --2- 172.21.15.83:0/750120098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5610c09885d0 0x5610c09889b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7790011e40 tx=0x7f7790014000 comp rx=0 tx=0).stop 2024-04-01T06:57:56.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.284+0000 7f77b45ddb80 1 -- 172.21.15.83:0/750120098 shutdown_connections 2024-04-01T06:57:56.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.284+0000 7f77b45ddb80 1 --2- 172.21.15.83:0/750120098 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5610c0993df0 0x5610c09961e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.284+0000 7f77b45ddb80 1 --2- 172.21.15.83:0/750120098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5610c09885d0 0x5610c09889b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.284+0000 7f77b45ddb80 1 --2- 172.21.15.83:0/750120098 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5610c0988ef0 0x5610c09938b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.284+0000 7f77b45ddb80 1 -- 172.21.15.83:0/750120098 >> 172.21.15.83:0/750120098 conn(0x5610c08e86a0 msgr2=0x5610c0984a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:56.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.284+0000 7f77b45ddb80 1 -- 172.21.15.83:0/750120098 shutdown_connections 2024-04-01T06:57:56.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.284+0000 7f77b45ddb80 1 -- 172.21.15.83:0/750120098 wait complete. 2024-04-01T06:57:56.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.284+0000 7f77b45ddb80 1 -- start start 2024-04-01T06:57:56.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.285+0000 7f77b45ddb80 1 Processor -- start 2024-04-01T06:57:56.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.285+0000 7f77b45ddb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5610c09885d0 0x5610c09937b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:56.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.285+0000 7f77b45ddb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5610c0988ef0 0x5610c0990a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:56.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.285+0000 7f77b45ddb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5610c0993df0 0x5610c0991040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:56.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.285+0000 7f77b45ddb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610c0876d80 con 0x5610c0988ef0 2024-04-01T06:57:56.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.285+0000 7f77b45ddb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610c0876a20 con 0x5610c0993df0 2024-04-01T06:57:56.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.285+0000 7f77b45ddb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610c075e6a0 con 0x5610c09885d0 2024-04-01T06:57:56.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.285+0000 7f77b45ddb80 10 client.0 _ll_register_callbacks cb 0x5610c0880470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:57:56.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.285+0000 7f77a59e2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5610c0988ef0 0x5610c0990a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:56.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.285+0000 7f77a61e3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5610c09885d0 0x5610c09937b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:56.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.285+0000 7f77a61e3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5610c09885d0 0x5610c09937b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.83:37854/0 (socket says 172.21.15.83:37854) 2024-04-01T06:57:56.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.285+0000 7f77a61e3700 1 -- 172.21.15.83:0/1242651249 learned_addr learned my addr 172.21.15.83:0/1242651249 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:56.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.285+0000 7f77a59e2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5610c0988ef0 0x5610c0990a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:32776/0 (socket says 172.21.15.83:32776) 2024-04-01T06:57:56.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.285+0000 7f77a69e4700 1 --2- 172.21.15.83:0/1242651249 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5610c0993df0 0x5610c0991040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:56.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.285+0000 7f77a59e2700 1 -- 172.21.15.83:0/1242651249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5610c09885d0 msgr2=0x5610c09937b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:56.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.285+0000 7f77a59e2700 1 --2- 172.21.15.83:0/1242651249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5610c09885d0 0x5610c09937b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.285+0000 7f77a59e2700 1 -- 172.21.15.83:0/1242651249 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5610c0993df0 msgr2=0x5610c0991040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:56.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.285+0000 7f77a59e2700 1 --2- 172.21.15.83:0/1242651249 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5610c0993df0 0x5610c0991040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.285+0000 7f77a59e2700 1 -- 172.21.15.83:0/1242651249 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77a010e500 con 0x5610c0988ef0 2024-04-01T06:57:56.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.285+0000 7f77a59e2700 1 --2- 172.21.15.83:0/1242651249 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5610c0988ef0 0x5610c0990a30 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f779c0ca1c0 tx=0x7f779c099b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=763f906fb54ad1ea server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:56.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.285+0000 7f7789ffb700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:57:56.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.286+0000 7f7789ffb700 1 -- 172.21.15.83:0/1242651249 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779c0a2000 con 0x5610c0988ef0 2024-04-01T06:57:56.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.286+0000 7f7789ffb700 1 -- 172.21.15.83:0/1242651249 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f779c099de0 con 0x5610c0988ef0 2024-04-01T06:57:56.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.286+0000 7f77b45ddb80 1 -- 172.21.15.83:0/1242651249 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5610c089b380 con 0x5610c0988ef0 2024-04-01T06:57:56.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.286+0000 7f7789ffb700 1 -- 172.21.15.83:0/1242651249 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f779c099fa0 con 0x5610c0988ef0 2024-04-01T06:57:56.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.286+0000 7f77b45ddb80 10 client.16077 fetch_fsmap learned FSMap version 28 2024-04-01T06:57:56.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.286+0000 7f77b45ddb80 1 -- 172.21.15.83:0/1242651249 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x7f7790011b20 con 0x5610c0988ef0 2024-04-01T06:57:56.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.286+0000 7f7789ffb700 1 -- 172.21.15.83:0/1242651249 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f779c0b6080 con 0x5610c0988ef0 2024-04-01T06:57:56.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.286+0000 7f7789ffb700 1 -- 172.21.15.83:0/1242651249 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 28) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f779c0a1b70 con 0x5610c0988ef0 2024-04-01T06:57:56.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.286+0000 7f77b45ddb80 10 client.16077 fetch_fsmap finished waiting for FSMap version 28 2024-04-01T06:57:56.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.286+0000 7f77b45ddb80 10 client.16077 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-01T06:57:56.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.286+0000 7f77b45ddb80 20 client.16077 populate_metadata read hostname 'smithi083' 2024-04-01T06:57:56.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.286+0000 7f77b45ddb80 1 --2- 172.21.15.83:0/1242651249 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5610c09a39e0 0x5610c09a5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:56.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.286+0000 7f77b45ddb80 4 client.16077 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-01T06:57:56.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.286+0000 7f77b45ddb80 1 -- 172.21.15.83:0/1242651249 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5610c08d3700 con 0x5610c09a39e0 2024-04-01T06:57:56.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.286+0000 7f77a61e3700 1 --2- 172.21.15.83:0/1242651249 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5610c09a39e0 0x5610c09a5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:56.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.287+0000 7f7789ffb700 10 client.16077 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:57:56.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.287+0000 7f77a61e3700 1 --2- 172.21.15.83:0/1242651249 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5610c09a39e0 0x5610c09a5e00 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9fca4b6eb55040c server_cookie=46181d9a9a21b84 in_seq=0 out_seq=0 2024-04-01T06:57:56.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.290+0000 7f7789ffb700 1 -- 172.21.15.83:0/1242651249 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5610c08d3700 con 0x5610c09a39e0 2024-04-01T06:57:56.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.290+0000 7f7789ffb700 10 client.16077 handle_command_reply: tid=0 2024-04-01T06:57:56.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.290+0000 7f77b45ddb80 1 client.16077 shutdown 2024-04-01T06:57:56.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.290+0000 7f77b45ddb80 1 -- 172.21.15.83:0/1242651249 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5610c0988ef0 msgr2=0x5610c0990a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:56.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.290+0000 7f77b45ddb80 1 --2- 172.21.15.83:0/1242651249 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5610c0988ef0 0x5610c0990a30 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f779c0ca1c0 tx=0x7f779c099b80 comp rx=0 tx=0).stop 2024-04-01T06:57:56.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.290+0000 7f77b45ddb80 1 -- 172.21.15.83:0/1242651249 shutdown_connections 2024-04-01T06:57:56.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.290+0000 7f77b45ddb80 1 --2- 172.21.15.83:0/1242651249 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5610c09a39e0 0x5610c09a5e00 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.290+0000 7f77b45ddb80 1 --2- 172.21.15.83:0/1242651249 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5610c0993df0 0x5610c0991040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.290+0000 7f7789ffb700 0 client.16077 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:57:56.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.290+0000 7f77b45ddb80 1 --2- 172.21.15.83:0/1242651249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5610c09885d0 0x5610c09937b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.290+0000 7f77b45ddb80 1 --2- 172.21.15.83:0/1242651249 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5610c0988ef0 0x5610c0990a30 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.290+0000 7f77b45ddb80 1 -- 172.21.15.83:0/1242651249 >> 172.21.15.83:0/1242651249 conn(0x5610c08e86a0 msgr2=0x5610c098a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:56.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.290+0000 7f77b45ddb80 1 -- 172.21.15.83:0/1242651249 shutdown_connections 2024-04-01T06:57:56.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.290+0000 7f77b45ddb80 1 -- 172.21.15.83:0/1242651249 wait complete. 2024-04-01T06:57:56.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.290+0000 7f77b45ddb80 20 client.16077 trim_cache size 0 max 16384 2024-04-01T06:57:56.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.309+0000 7f77b45ddb80 1 Processor -- start 2024-04-01T06:57:56.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.309+0000 7f77b45ddb80 1 -- start start 2024-04-01T06:57:56.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.309+0000 7f77b45ddb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5610c09885d0 0x5610c099aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:56.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.309+0000 7f77b45ddb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5610c0988ef0 0x5610c097df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:56.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.309+0000 7f77b45ddb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5610c0993df0 0x5610c098f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:56.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.309+0000 7f77b45ddb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610c09a6190 con 0x5610c0988ef0 2024-04-01T06:57:56.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.309+0000 7f77b45ddb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610c099afb0 con 0x5610c0993df0 2024-04-01T06:57:56.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.310+0000 7f77b45ddb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610c098b850 con 0x5610c09885d0 2024-04-01T06:57:56.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.310+0000 7f77a59e2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5610c0988ef0 0x5610c097df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:56.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.310+0000 7f77a59e2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5610c0988ef0 0x5610c097df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:32782/0 (socket says 172.21.15.83:32782) 2024-04-01T06:57:56.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.310+0000 7f77a59e2700 1 -- 172.21.15.83:0/573680826 learned_addr learned my addr 172.21.15.83:0/573680826 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:56.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.310+0000 7f77a61e3700 1 --2- 172.21.15.83:0/573680826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5610c09885d0 0x5610c099aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:56.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.310+0000 7f77a69e4700 1 --2- 172.21.15.83:0/573680826 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5610c0993df0 0x5610c098f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:56.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.310+0000 7f77a59e2700 1 -- 172.21.15.83:0/573680826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5610c09885d0 msgr2=0x5610c099aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:56.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.310+0000 7f77a59e2700 1 --2- 172.21.15.83:0/573680826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5610c09885d0 0x5610c099aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.310+0000 7f77a59e2700 1 -- 172.21.15.83:0/573680826 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5610c0993df0 msgr2=0x5610c098f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:56.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.310+0000 7f77a59e2700 1 --2- 172.21.15.83:0/573680826 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5610c0993df0 0x5610c098f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.310+0000 7f77a59e2700 1 -- 172.21.15.83:0/573680826 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610c0708b60 con 0x5610c0988ef0 2024-04-01T06:57:56.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.310+0000 7f77a59e2700 1 --2- 172.21.15.83:0/573680826 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5610c0988ef0 0x5610c097df70 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f779c0ca7c0 tx=0x7f779c0996c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53d97248825a514 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:56.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.310+0000 7f77955a9700 1 -- 172.21.15.83:0/573680826 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779c099bf0 con 0x5610c0988ef0 2024-04-01T06:57:56.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.310+0000 7f77955a9700 1 -- 172.21.15.83:0/573680826 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5610c089b380 con 0x5610c0988ef0 2024-04-01T06:57:56.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.310+0000 7f77955a9700 1 -- 172.21.15.83:0/573680826 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779c099de0 con 0x5610c0988ef0 2024-04-01T06:57:56.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.311+0000 7f77b45ddb80 1 -- 172.21.15.83:0/573680826 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5610c0988ef0 msgr2=0x5610c097df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:56.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.311+0000 7f77b45ddb80 1 --2- 172.21.15.83:0/573680826 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5610c0988ef0 0x5610c097df70 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f779c0ca7c0 tx=0x7f779c0996c0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.311+0000 7f77b45ddb80 1 -- 172.21.15.83:0/573680826 shutdown_connections 2024-04-01T06:57:56.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.311+0000 7f77b45ddb80 1 --2- 172.21.15.83:0/573680826 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5610c0993df0 0x5610c098f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.311+0000 7f77b45ddb80 1 --2- 172.21.15.83:0/573680826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5610c09885d0 0x5610c099aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.311+0000 7f77b45ddb80 1 --2- 172.21.15.83:0/573680826 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5610c0988ef0 0x5610c097df70 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.311+0000 7f77b45ddb80 1 -- 172.21.15.83:0/573680826 >> 172.21.15.83:0/573680826 conn(0x5610c08e86a0 msgr2=0x5610c097d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:56.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.311+0000 7f77b45ddb80 1 -- 172.21.15.83:0/573680826 shutdown_connections 2024-04-01T06:57:56.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.311+0000 7f77b45ddb80 1 -- 172.21.15.83:0/573680826 wait complete. 2024-04-01T06:57:56.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.312+0000 7f77b45ddb80 1 -- start start 2024-04-01T06:57:56.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.312+0000 7f77b45ddb80 1 Processor -- start 2024-04-01T06:57:56.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.312+0000 7f77b45ddb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5610c09885d0 0x5610c099a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:56.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.312+0000 7f77b45ddb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5610c0988ef0 0x5610c0998a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:56.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.312+0000 7f77b45ddb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5610c0993df0 0x5610c0998fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:56.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.312+0000 7f77b45ddb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610c0999510 con 0x5610c0993df0 2024-04-01T06:57:56.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.312+0000 7f77b45ddb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610c0999680 con 0x5610c0988ef0 2024-04-01T06:57:56.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.312+0000 7f77b45ddb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610c0999840 con 0x5610c09885d0 2024-04-01T06:57:56.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.312+0000 7f77b45ddb80 10 client.0 _ll_register_callbacks cb 0x5610c0880470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:57:56.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.312+0000 7f77a69e4700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5610c0993df0 0x5610c0998fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:56.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.312+0000 7f77a61e3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5610c09885d0 0x5610c099a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:56.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.312+0000 7f77a61e3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5610c09885d0 0x5610c099a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.83:37866/0 (socket says 172.21.15.83:37866) 2024-04-01T06:57:56.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.312+0000 7f77a69e4700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5610c0993df0 0x5610c0998fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:32798/0 (socket says 172.21.15.83:32798) 2024-04-01T06:57:56.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.312+0000 7f77a61e3700 1 -- 172.21.15.83:0/1858384788 learned_addr learned my addr 172.21.15.83:0/1858384788 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:56.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.312+0000 7f77a59e2700 1 --2- 172.21.15.83:0/1858384788 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5610c0988ef0 0x5610c0998a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:56.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.312+0000 7f77a69e4700 1 -- 172.21.15.83:0/1858384788 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5610c09885d0 msgr2=0x5610c099a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:56.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.312+0000 7f77a69e4700 1 --2- 172.21.15.83:0/1858384788 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5610c09885d0 0x5610c099a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.312+0000 7f77a69e4700 1 -- 172.21.15.83:0/1858384788 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5610c0988ef0 msgr2=0x5610c0998a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:56.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.312+0000 7f77a69e4700 1 --2- 172.21.15.83:0/1858384788 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5610c0988ef0 0x5610c0998a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.312+0000 7f77a69e4700 1 -- 172.21.15.83:0/1858384788 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7790011b20 con 0x5610c0993df0 2024-04-01T06:57:56.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.313+0000 7f77a61e3700 1 --2- 172.21.15.83:0/1858384788 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5610c09885d0 0x5610c099a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:57:56.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.313+0000 7f77a69e4700 1 --2- 172.21.15.83:0/1858384788 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5610c0993df0 0x5610c0998fd0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f779800b780 tx=0x7f779800bc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d93ad25164a3ef5f server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:56.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.313+0000 7f7789ffb700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:57:56.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.313+0000 7f7789ffb700 1 -- 172.21.15.83:0/1858384788 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7798022070 con 0x5610c0993df0 2024-04-01T06:57:56.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.313+0000 7f77b45ddb80 1 -- 172.21.15.83:0/1858384788 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7790016070 con 0x5610c0993df0 2024-04-01T06:57:56.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.313+0000 7f7789ffb700 1 -- 172.21.15.83:0/1858384788 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f77980076f0 con 0x5610c0993df0 2024-04-01T06:57:56.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.313+0000 7f7789ffb700 1 -- 172.21.15.83:0/1858384788 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f779800e040 con 0x5610c0993df0 2024-04-01T06:57:56.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.313+0000 7f77b45ddb80 10 client.16083 fetch_fsmap learned FSMap version 28 2024-04-01T06:57:56.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.313+0000 7f77b45ddb80 1 -- 172.21.15.83:0/1858384788 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x5610c08a0ea0 con 0x5610c0993df0 2024-04-01T06:57:56.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.313+0000 7f7789ffb700 1 -- 172.21.15.83:0/1858384788 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7790016070 con 0x5610c0993df0 2024-04-01T06:57:56.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.313+0000 7f7789ffb700 1 -- 172.21.15.83:0/1858384788 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 28) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f779800b0d0 con 0x5610c0993df0 2024-04-01T06:57:56.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.313+0000 7f77b45ddb80 10 client.16083 fetch_fsmap finished waiting for FSMap version 28 2024-04-01T06:57:56.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.313+0000 7f77b45ddb80 10 client.16083 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-01T06:57:56.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.313+0000 7f77b45ddb80 20 client.16083 populate_metadata read hostname 'smithi083' 2024-04-01T06:57:56.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.313+0000 7f77b45ddb80 1 --2- 172.21.15.83:0/1858384788 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5610c09f8e20 0x5610c09fb240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:56.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.313+0000 7f77b45ddb80 4 client.16083 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-01T06:57:56.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.313+0000 7f77b45ddb80 1 -- 172.21.15.83:0/1858384788 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5610c0729cf0 con 0x5610c09f8e20 2024-04-01T06:57:56.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.314+0000 7f77a61e3700 1 --2- 172.21.15.83:0/1858384788 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5610c09f8e20 0x5610c09fb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:56.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.314+0000 7f77a61e3700 1 --2- 172.21.15.83:0/1858384788 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5610c09f8e20 0x5610c09fb240 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f5004147f380d32 server_cookie=900af47b3e47fbd9 in_seq=0 out_seq=0 2024-04-01T06:57:56.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.314+0000 7f7789ffb700 10 client.16083 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:57:56.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.322+0000 7f7789ffb700 1 -- 172.21.15.83:0/1858384788 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x5610c0729cf0 con 0x5610c09f8e20 2024-04-01T06:57:56.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.322+0000 7f7789ffb700 10 client.16083 handle_command_reply: tid=0 2024-04-01T06:57:56.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.322+0000 7f77b45ddb80 1 client.16083 shutdown 2024-04-01T06:57:56.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.322+0000 7f77b45ddb80 1 -- 172.21.15.83:0/1858384788 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5610c0993df0 msgr2=0x5610c0998fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:56.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.322+0000 7f77b45ddb80 1 --2- 172.21.15.83:0/1858384788 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5610c0993df0 0x5610c0998fd0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f779800b780 tx=0x7f779800bc60 comp rx=0 tx=0).stop 2024-04-01T06:57:56.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.322+0000 7f77b45ddb80 1 -- 172.21.15.83:0/1858384788 shutdown_connections 2024-04-01T06:57:56.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.322+0000 7f77b45ddb80 1 --2- 172.21.15.83:0/1858384788 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5610c09f8e20 0x5610c09fb240 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.322+0000 7f77b45ddb80 1 --2- 172.21.15.83:0/1858384788 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5610c0993df0 0x5610c0998fd0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.322+0000 7f77b45ddb80 1 --2- 172.21.15.83:0/1858384788 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5610c09885d0 0x5610c099a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.322+0000 7f77b45ddb80 1 --2- 172.21.15.83:0/1858384788 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5610c0988ef0 0x5610c0998a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.322+0000 7f77b45ddb80 1 -- 172.21.15.83:0/1858384788 >> 172.21.15.83:0/1858384788 conn(0x5610c08e86a0 msgr2=0x5610c0990940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:56.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.322+0000 7f7789ffb700 0 client.16083 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:57:56.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.322+0000 7f77b45ddb80 1 -- 172.21.15.83:0/1858384788 shutdown_connections 2024-04-01T06:57:56.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.322+0000 7f77b45ddb80 1 -- 172.21.15.83:0/1858384788 wait complete. 2024-04-01T06:57:56.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.322+0000 7f77b45ddb80 20 client.16083 trim_cache size 0 max 16384 2024-04-01T06:57:56.324 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-04-01T06:57:56.324 INFO:teuthology.orchestra.run.smithi083.stdout: "status": "scrub active (169 inodes in the stack)", 2024-04-01T06:57:56.324 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubs": { 2024-04-01T06:57:56.324 INFO:teuthology.orchestra.run.smithi083.stdout: "854c92fb-c32d-492d-9f69-2ce2c7fc7e2f": { 2024-04-01T06:57:56.324 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/", 2024-04-01T06:57:56.324 INFO:teuthology.orchestra.run.smithi083.stdout: "tag": "854c92fb-c32d-492d-9f69-2ce2c7fc7e2f", 2024-04-01T06:57:56.324 INFO:teuthology.orchestra.run.smithi083.stdout: "options": "recursive,force" 2024-04-01T06:57:56.324 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T06:57:56.324 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T06:57:56.324 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-04-01T06:57:56.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.323+0000 7f77a8447700 1 -- 172.21.15.83:0/1092160971 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f778c0a1290 msgr2=0x7f778c0a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:56.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.323+0000 7f77a8447700 1 --2- 172.21.15.83:0/1092160971 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f778c0a1290 0x7f778c0a3750 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7790009bf0 tx=0x7f7790009260 comp rx=0 tx=0).stop 2024-04-01T06:57:56.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.323+0000 7f77a8447700 1 -- 172.21.15.83:0/1092160971 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77a01060f0 msgr2=0x7f77a0197930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:56.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.323+0000 7f77a8447700 1 --2- 172.21.15.83:0/1092160971 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77a01060f0 0x7f77a0197930 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f779c00d980 tx=0x7f779c00dc90 comp rx=0 tx=0).stop 2024-04-01T06:57:56.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.323+0000 7f77a8447700 1 -- 172.21.15.83:0/1092160971 shutdown_connections 2024-04-01T06:57:56.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.323+0000 7f77a8447700 1 --2- 172.21.15.83:0/1092160971 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f778c0a1290 0x7f778c0a3750 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.323+0000 7f77a8447700 1 --2- 172.21.15.83:0/1092160971 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f77a019bcd0 0x7f77a019c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.323+0000 7f77a8447700 1 --2- 172.21.15.83:0/1092160971 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f77a00ff8e0 0x7f77a01973f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.323+0000 7f77a8447700 1 --2- 172.21.15.83:0/1092160971 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f77a01060f0 0x7f77a0197930 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:56.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.323+0000 7f77a8447700 1 -- 172.21.15.83:0/1092160971 >> 172.21.15.83:0/1092160971 conn(0x7f77a0074f60 msgr2=0x7f77a00fdab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:56.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.323+0000 7f77a8447700 1 -- 172.21.15.83:0/1092160971 shutdown_connections 2024-04-01T06:57:56.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:57:56.323+0000 7f77a8447700 1 -- 172.21.15.83:0/1092160971 wait complete. 2024-04-01T06:57:56.335 INFO:tasks.cephfs.filesystem:scrub status for tag:854c92fb-c32d-492d-9f69-2ce2c7fc7e2f - {'path': '/', 'tag': '854c92fb-c32d-492d-9f69-2ce2c7fc7e2f', 'options': 'recursive,force'} 2024-04-01T06:57:56.504 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:56 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:56.338+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e3d [...4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/ auth v194 ap=1 f(v0 m2024-04-01T06:57:16.911544+0000 7=5+2) n(v1 rc2024-04-01T06:57:16.911544+0000 b22433 14=11+3) (inest lock) (ifile excl) (iversion lock) caps={15249=pAsLsXsFsx/pAsLsXsFsx@1},l=15249 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907c0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001e3d:[<0x10000001e29/timers v194>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(2)0x10000001e3d:[<0x10000001e29/timers v194>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-04-01T06:57:16.911544+0000 7=5+2)","ondisk_value.rstat":"n(v0 rc2024-04-01T06:57:16.911544+0000 b22433 14=11+3)","memory_value.dirstat":"f(v0 m2024-04-01T06:57:16.911544+0000 7=5+2)","memory_value.rstat":"n(v1 rc2024-04-01T06:57:16.911544+0000 b22433 14=11+3)","error_str":""},"return_code":0} 2024-04-01T06:57:56.505 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:56 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:56.339+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e4b [...4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/ auth v212 ap=1 f(v0 m2024-04-01T06:57:16.939543+0000 10=4+6) n(v1 rc2024-04-01T06:57:16.940543+0000 b123102 38=31+7) (inest lock) (ifile excl) (iversion lock) caps={15249=pAsLsXsFsx/pAsLsXsFsx@1},l=15249 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907c0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001e4b:[<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(2)0x10000001e4b:[<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-04-01T06:57:16.939543+0000 10=4+6)","ondisk_value.rstat":"n(v0 rc2024-04-01T06:57:16.940543+0000 b123102 38=31+7)","memory_value.dirstat":"f(v0 m2024-04-01T06:57:16.939543+0000 10=4+6)","memory_value.rstat":"n(v1 rc2024-04-01T06:57:16.940543+0000 b123102 38=31+7)","error_str":""},"return_code":0} 2024-04-01T06:57:56.505 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:56 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:56.340+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e32 [...4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/ auth v214 ap=1 f(v0 m2024-04-01T06:57:16.900544+0000 10=10+0) n(v0 rc2024-04-01T06:57:16.901544+0000 b18832 11=10+1) (inest lock) (ifile excl) (iversion lock) caps={15249=pAsLsXsFsx/pAsLsXsFsx@1},l=15249 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907c1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001e32:[<0x10000001e29/semaphores v214>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(2)0x10000001e32:[<0x10000001e29/semaphores v214>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-04-01T06:57:16.900544+0000 10=10+0)","ondisk_value.rstat":"n(v0 rc2024-04-01T06:57:16.901544+0000 b18832 11=10+1)","memory_value.dirstat":"f(v0 m2024-04-01T06:57:16.900544+0000 10=10+0)","memory_value.rstat":"n(v0 rc2024-04-01T06:57:16.901544+0000 b18832 11=10+1)","error_str":""},"return_code":0} 2024-04-01T06:57:56.505 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:56 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:56.345+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e2a [...4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/mqueues/ auth v210 ap=1 f(v0 m2024-04-01T06:57:16.892545+0000 7=7+0) n(v0 rc2024-04-01T06:57:16.893545+0000 b7998 8=7+1) (inest lock) (ifile excl) (iversion lock) caps={15249=pAsLsXsFsx/pAsLsXsFsx@1},l=15249 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907c1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001e2a:[<0x10000001e29/mqueues v210>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(2)0x10000001e2a:[<0x10000001e29/mqueues v210>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-04-01T06:57:16.892545+0000 7=7+0)","ondisk_value.rstat":"n(v0 rc2024-04-01T06:57:16.893545+0000 b7998 8=7+1)","memory_value.dirstat":"f(v0 m2024-04-01T06:57:16.892545+0000 7=7+0)","memory_value.rstat":"n(v0 rc2024-04-01T06:57:16.893545+0000 b7998 8=7+1)","error_str":""},"return_code":0} 2024-04-01T06:57:57.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:56 smithi145 ceph-mon[47816]: pgmap v65: 97 pgs: 97 active+clean; 1.2 GiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 63 MiB/s rd, 155 MiB/s wr, 882 op/s 2024-04-01T06:57:57.004 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:56 smithi145 ceph-mon[47816]: scrub queued for path: / 2024-04-01T06:57:57.005 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:56 smithi145 ceph-mon[47816]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:57.005 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:56 smithi145 ceph-mon[47816]: scrub summary: active paths [/] 2024-04-01T06:57:57.005 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:56 smithi145 ceph-mon[47816]: scrub summary: active paths [/] 2024-04-01T06:57:57.005 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:56 smithi145 ceph-mon[47816]: scrub summary: active paths [/] 2024-04-01T06:57:57.005 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:56 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:56.571+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e45 [...4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/timers/ auth v73 ap=1 f(v0 m2024-04-01T06:57:16.909544+0000 3=3+0) n(v0 rc2024-04-01T06:57:16.910544+0000 b6246 4=3+1) (inest lock) (ifile excl) (iversion lock) caps={15249=pAsLsXsFsx/pAsLsXsFsx@1},l=15249 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907c6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001e45:[<0x10000001e3d/timers v73>,<0x10000001e29/timers v194>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(2)0x10000001e45:[<0x10000001e3d/timers v73>,<0x10000001e29/timers v194>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-04-01T06:57:16.909544+0000 3=3+0)","ondisk_value.rstat":"n(v0 rc2024-04-01T06:57:16.910544+0000 b6246 4=3+1)","memory_value.dirstat":"f(v0 m2024-04-01T06:57:16.909544+0000 3=3+0)","memory_value.rstat":"n(v0 rc2024-04-01T06:57:16.910544+0000 b6246 4=3+1)","error_str":""},"return_code":0} 2024-04-01T06:57:57.005 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:56 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:56.571+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e3e [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/coverage.txt auth v67 ap=1 s=172 n(v0 rc2024-04-01T06:57:16.903544+0000 b172 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907c7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e3e:[<0x10000001e3d/coverage.txt v67>,<0x10000001e29/timers v194>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e3e:[<0x10000001e3d/coverage.txt v67>,<0x10000001e29/timers v194>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.006 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:56 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:56.572+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e4a [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/plan.txt auth v57 ap=1 s=4787 n(v0 rc2005-06-03T16:36:37.000000+0000 b4787 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907c6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e4a:[<0x10000001e3d/plan.txt v57>,<0x10000001e29/timers v194>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e4a:[<0x10000001e3d/plan.txt v57>,<0x10000001e29/timers v194>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.006 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:56 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:56.572+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e49 [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/run.sh auth v59 ap=1 s=1209 n(v0 rc2024-04-01T06:57:16.911544+0000 b1209 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907c6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e49:[<0x10000001e3d/run.sh v59>,<0x10000001e29/timers v194>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e49:[<0x10000001e3d/run.sh v59>,<0x10000001e29/timers v194>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.007 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:56 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:56.572+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e40 [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/assertions.xml auth v55 ap=1 s=3672 n(v0 rc2024-04-01T06:57:16.904544+0000 b3672 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907c7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e40:[<0x10000001e3d/assertions.xml v55>,<0x10000001e29/timers v194>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e40:[<0x10000001e3d/assertions.xml v55>,<0x10000001e29/timers v194>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.007 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:56 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:56.572+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e41 [...4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/clocks/ auth v75 ap=1 f(v0 m2024-04-01T06:57:16.906544+0000 3=3+0) n(v0 rc2024-04-01T06:57:16.907544+0000 b5981 4=3+1) (inest lock) (ifile excl) (iversion lock) caps={15249=pAsLsXsFsx/pAsLsXsFsx@1},l=15249 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907c8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001e41:[<0x10000001e3d/clocks v75>,<0x10000001e29/timers v194>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(2)0x10000001e41:[<0x10000001e3d/clocks v75>,<0x10000001e29/timers v194>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-04-01T06:57:16.906544+0000 3=3+0)","ondisk_value.rstat":"n(v0 rc2024-04-01T06:57:16.907544+0000 b5981 4=3+1)","memory_value.dirstat":"f(v0 m2024-04-01T06:57:16.906544+0000 3=3+0)","memory_value.rstat":"n(v0 rc2024-04-01T06:57:16.907544+0000 b5981 4=3+1)","error_str":""},"return_code":0} 2024-04-01T06:57:57.007 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:56 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:56.573+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e6c [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/run.sh auth v173 ap=1 s=229 n(v0 rc2024-04-01T06:57:16.937544+0000 b229 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907d5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e6c:[<0x10000001e4b/run.sh v173>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e6c:[<0x10000001e4b/run.sh v173>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.007 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:56 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:56.573+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e50 [...4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/robust_test/ auth v195 ap=1 f(v0 m2024-04-01T06:57:16.921544+0000 8=8+0) n(v0 rc2024-04-01T06:57:16.922544+0000 b24797 9=8+1) (inest lock) (ifile excl) (iversion lock) caps={15249=pAsLsXsFsx/pAsLsXsFsx@1},l=15249 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907d5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001e50:[<0x10000001e4b/robust_test v195>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(2)0x10000001e50:[<0x10000001e4b/robust_test v195>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-04-01T06:57:16.921544+0000 8=8+0)","ondisk_value.rstat":"n(v0 rc2024-04-01T06:57:16.922544+0000 b24797 9=8+1)","memory_value.dirstat":"f(v0 m2024-04-01T06:57:16.921544+0000 8=8+0)","memory_value.rstat":"n(v0 rc2024-04-01T06:57:16.922544+0000 b24797 9=8+1)","error_str":""},"return_code":0} 2024-04-01T06:57:57.007 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:56 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:56.574+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e3f [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/Makefile auth v63 ap=1 s=366 n(v0 rc2005-06-03T16:36:37.000000+0000 b366 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907c7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e3f:[<0x10000001e3d/Makefile v63>,<0x10000001e29/timers v194>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e3f:[<0x10000001e3d/Makefile v63>,<0x10000001e29/timers v194>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.007 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:56 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:56.575+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e70 [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/Makefile.inc auth v167 ap=1 s=244 n(v0 rc2024-04-01T06:57:16.940543+0000 b244 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907d4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e70:[<0x10000001e4b/Makefile.inc v167>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e70:[<0x10000001e4b/Makefile.inc v167>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.007 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:56 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:56.575+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e4c [...4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/condvar/ auth v193 ap=1 f(v0 m2024-04-01T06:57:16.915544+0000 3=3+0) n(v0 rc2024-04-01T06:57:16.915544+0000 b12671 4=3+1) (inest lock) (ifile excl) (iversion lock) caps={15249=pAsLsXsFsx/pAsLsXsFsx@1},l=15249 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907d5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001e4c:[<0x10000001e4b/condvar v193>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(2)0x10000001e4c:[<0x10000001e4b/condvar v193>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-04-01T06:57:16.915544+0000 3=3+0)","ondisk_value.rstat":"n(v0 rc2024-04-01T06:57:16.915544+0000 b12671 4=3+1)","memory_value.dirstat":"f(v0 m2024-04-01T06:57:16.915544+0000 3=3+0)","memory_value.rstat":"n(v0 rc2024-04-01T06:57:16.915544+0000 b12671 4=3+1)","error_str":""},"return_code":0} 2024-04-01T06:57:57.007 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:56 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:56.576+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e6d [...4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/include/ auth v211 ap=1 f(v0 m2024-04-01T06:57:16.939543+0000 2=2+0) n(v0 rc2024-04-01T06:57:16.939543+0000 b2714 3=2+1) (inest lock) (ifile excl) (iversion lock) caps={15249=pAsLsXsFsx/pAsLsXsFsx@1},l=15249 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907d6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001e6d:[<0x10000001e4b/include v211>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(2)0x10000001e6d:[<0x10000001e4b/include v211>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-04-01T06:57:16.939543+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2024-04-01T06:57:16.939543+0000 b2714 3=2+1)","memory_value.dirstat":"f(v0 m2024-04-01T06:57:16.939543+0000 2=2+0)","memory_value.rstat":"n(v0 rc2024-04-01T06:57:16.939543+0000 b2714 3=2+1)","error_str":""},"return_code":0} 2024-04-01T06:57:57.007 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:56 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:56.576+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e61 [...4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/ auth v209 ap=1 f(v0 m2024-04-01T06:57:16.936544+0000 10=10+0) n(v0 rc2024-04-01T06:57:16.936544+0000 b67315 11=10+1) (inest lock) (ifile excl) (iversion lock) caps={15249=pAsLsXsFsx/pAsLsXsFsx@1},l=15249 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907d6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001e61:[<0x10000001e4b/pi_test v209>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(2)0x10000001e61:[<0x10000001e4b/pi_test v209>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-04-01T06:57:16.936544+0000 10=10+0)","ondisk_value.rstat":"n(v0 rc2024-04-01T06:57:16.936544+0000 b67315 11=10+1)","memory_value.dirstat":"f(v0 m2024-04-01T06:57:16.936544+0000 10=10+0)","memory_value.rstat":"n(v0 rc2024-04-01T06:57:16.936544+0000 b67315 11=10+1)","error_str":""},"return_code":0} 2024-04-01T06:57:57.007 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:56 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:56.576+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e59 [...4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/schedule/ auth v191 ap=1 f(v0 m2024-04-01T06:57:16.924544+0000 3=3+0) n(v0 rc2024-04-01T06:57:16.925544+0000 b13913 4=3+1) (inest lock) (ifile excl) (iversion lock) caps={15249=pAsLsXsFsx/pAsLsXsFsx@1},l=15249 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907d7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001e59:[<0x10000001e4b/schedule v191>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(2)0x10000001e59:[<0x10000001e4b/schedule v191>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-04-01T06:57:16.924544+0000 3=3+0)","ondisk_value.rstat":"n(v0 rc2024-04-01T06:57:16.925544+0000 b13913 4=3+1)","memory_value.dirstat":"f(v0 m2024-04-01T06:57:16.924544+0000 3=3+0)","memory_value.rstat":"n(v0 rc2024-04-01T06:57:16.925544+0000 b13913 4=3+1)","error_str":""},"return_code":0} 2024-04-01T06:57:57.008 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:56 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:56.577+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e5d [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/Makefile auth v201 ap=1 s=257 n(v0 rc2024-04-01T06:57:16.926544+0000 b257 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907d6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e5d:[<0x10000001e4b/Makefile v201>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e5d:[<0x10000001e4b/Makefile v201>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.008 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:56 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:56.577+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e60 [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/README auth v175 ap=1 s=608 n(v0 rc2005-06-03T16:36:32.000000+0000 b608 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907d7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e60:[<0x10000001e4b/README v175>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e60:[<0x10000001e4b/README v175>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.008 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:56 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:56.577+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e5e [...4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/tools/ auth v157 ap=1 f(v0 m2024-04-01T06:57:16.927544+0000 1=1+0) n(v0 rc2024-04-01T06:57:16.928544+0000 b354 2=1+1) (inest lock) (ifile excl) (iversion lock) caps={15249=pAsLsXsFsx/pAsLsXsFsx@1},l=15249 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907de000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001e5e:[<0x10000001e4b/tools v157>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(2)0x10000001e5e:[<0x10000001e4b/tools v157>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-04-01T06:57:16.927544+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2024-04-01T06:57:16.928544+0000 b354 2=1+1)","memory_value.dirstat":"f(v0 m2024-04-01T06:57:16.927544+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-04-01T06:57:16.928544+0000 b354 2=1+1)","error_str":""},"return_code":0} 2024-04-01T06:57:57.008 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:56 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:56.577+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e37 [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/sem_sleepingbarber.c auth v44 ap=1 s=4354 n(v0 rc2024-04-01T06:57:16.897545+0000 b4354 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907f6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e37:[<0x10000001e32/sem_sleepingbarber.c v44>,<0x10000001e29/semaphores v214>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e37:[<0x10000001e32/sem_sleepingbarber.c v44>,<0x10000001e29/semaphores v214>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.008 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:56 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:56.578+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e35 [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/coverage.txt auth v46 ap=1 s=130 n(v0 rc2024-04-01T06:57:16.896545+0000 b130 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907f7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e35:[<0x10000001e32/coverage.txt v46>,<0x10000001e29/semaphores v214>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e35:[<0x10000001e32/coverage.txt v46>,<0x10000001e29/semaphores v214>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.008 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:56 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:56.578+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e3a [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/sem_philosopher.c auth v42 ap=1 s=3335 n(v0 rc2024-04-01T06:57:16.899544+0000 b3335 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562890802580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e3a:[<0x10000001e32/sem_philosopher.c v42>,<0x10000001e29/semaphores v214>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e3a:[<0x10000001e32/sem_philosopher.c v42>,<0x10000001e29/semaphores v214>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.008 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:56 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:56.579+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e3c [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/plan.txt auth v60 ap=1 s=77 n(v0 rc2024-04-01T06:57:16.901544+0000 b77 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907f6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e3c:[<0x10000001e32/plan.txt v60>,<0x10000001e29/semaphores v214>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e3c:[<0x10000001e32/plan.txt v60>,<0x10000001e29/semaphores v214>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.008 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:56 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:56.579+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e33 [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/sem_conpro.c auth v54 ap=1 s=3238 n(v0 rc2005-06-03T16:36:31.000000+0000 b3238 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907f7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e33:[<0x10000001e32/sem_conpro.c v54>,<0x10000001e29/semaphores v214>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e33:[<0x10000001e32/sem_conpro.c v54>,<0x10000001e29/semaphores v214>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.008 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:56 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:56.579+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e3b [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/run.sh auth v50 ap=1 s=1119 n(v0 rc2024-04-01T06:57:16.900544+0000 b1119 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907f6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e3b:[<0x10000001e32/run.sh v50>,<0x10000001e29/semaphores v214>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e3b:[<0x10000001e32/run.sh v50>,<0x10000001e29/semaphores v214>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.009 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:56 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:56.579+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e34 [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/sem_lock.c auth v56 ap=1 s=1899 n(v0 rc2024-04-01T06:57:16.895545+0000 b1899 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562890803080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e34:[<0x10000001e32/sem_lock.c v56>,<0x10000001e29/semaphores v214>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e34:[<0x10000001e32/sem_lock.c v56>,<0x10000001e29/semaphores v214>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.009 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:56 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:56.580+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e39 [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/sem_readerwriter.c auth v52 ap=1 s=3873 n(v0 rc2005-06-03T16:36:32.000000+0000 b3873 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562890802b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e39:[<0x10000001e32/sem_readerwriter.c v52>,<0x10000001e29/semaphores v214>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e39:[<0x10000001e32/sem_readerwriter.c v52>,<0x10000001e29/semaphores v214>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.009 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:56 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:56.580+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e31 [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/mqueues/plan.txt auth v32 ap=1 s=79 n(v0 rc2024-04-01T06:57:16.893545+0000 b79 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562890803b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e31:[<0x10000001e2a/plan.txt v32>,<0x10000001e29/mqueues v210>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e31:[<0x10000001e2a/plan.txt v32>,<0x10000001e29/mqueues v210>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.009 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:56 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:56.580+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e36 [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/Makefile auth v48 ap=1 s=271 n(v0 rc2007-07-26T12:02:16.000000+0000 b271 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562890802000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e36:[<0x10000001e32/Makefile v48>,<0x10000001e29/semaphores v214>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e36:[<0x10000001e32/Makefile v48>,<0x10000001e29/semaphores v214>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.009 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:56 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:56.580+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e2c [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/mqueues/coverage.txt auth v42 ap=1 s=110 n(v0 rc2005-06-03T16:36:31.000000+0000 b110 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562890804680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e2c:[<0x10000001e2a/coverage.txt v42>,<0x10000001e29/mqueues v210>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e2c:[<0x10000001e2a/coverage.txt v42>,<0x10000001e29/mqueues v210>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.009 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:56 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:56.580+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e2d [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/mqueues/Makefile auth v34 ap=1 s=188 n(v0 rc2024-04-01T06:57:16.890545+0000 b188 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562890804c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e2d:[<0x10000001e2a/Makefile v34>,<0x10000001e29/mqueues v210>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e2d:[<0x10000001e2a/Makefile v34>,<0x10000001e29/mqueues v210>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.009 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:56 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:56.581+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e2b [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/mqueues/send_rev_2.c auth v30 ap=1 s=3558 n(v0 rc2024-04-01T06:57:16.889545+0000 b3558 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562890805180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e2b:[<0x10000001e2a/send_rev_2.c v30>,<0x10000001e29/mqueues v210>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e2b:[<0x10000001e2a/send_rev_2.c v30>,<0x10000001e29/mqueues v210>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.010 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:56 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:56.581+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e30 [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/mqueues/run.sh auth v36 ap=1 s=1075 n(v0 rc2024-04-01T06:57:16.892545+0000 b1075 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562890804100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e30:[<0x10000001e2a/run.sh v36>,<0x10000001e29/mqueues v210>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e30:[<0x10000001e2a/run.sh v36>,<0x10000001e29/mqueues v210>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.010 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:56 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:56.582+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e2e [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/mqueues/send_rev_1.c auth v38 ap=1 s=2354 n(v0 rc2024-04-01T06:57:16.891545+0000 b2354 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562890805700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e2e:[<0x10000001e2a/send_rev_1.c v38>,<0x10000001e29/mqueues v210>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e2e:[<0x10000001e2a/send_rev_1.c v38>,<0x10000001e29/mqueues v210>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.010 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:56 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:56.584+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e2f [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/mqueues/assertions.xml auth v40 ap=1 s=634 n(v0 rc2005-06-03T16:36:31.000000+0000 b634 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56289080c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e2f:[<0x10000001e2a/assertions.xml v40>,<0x10000001e29/mqueues v210>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e2f:[<0x10000001e2a/assertions.xml v40>,<0x10000001e29/mqueues v210>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.010 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:56 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:56.586+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e38 [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/assertions.xml auth v58 ap=1 s=536 n(v0 rc2024-04-01T06:57:16.898545+0000 b536 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562890803600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e38:[<0x10000001e32/assertions.xml v58>,<0x10000001e29/semaphores v214>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e38:[<0x10000001e32/assertions.xml v58>,<0x10000001e29/semaphores v214>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:56 smithi153 ceph-mon[48187]: pgmap v65: 97 pgs: 97 active+clean; 1.2 GiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 63 MiB/s rd, 155 MiB/s wr, 882 op/s 2024-04-01T06:57:57.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:56 smithi153 ceph-mon[48187]: scrub queued for path: / 2024-04-01T06:57:57.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:56 smithi153 ceph-mon[48187]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:57.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:56 smithi153 ceph-mon[48187]: scrub summary: active paths [/] 2024-04-01T06:57:57.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:56 smithi153 ceph-mon[48187]: scrub summary: active paths [/] 2024-04-01T06:57:57.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:56 smithi153 ceph-mon[48187]: scrub summary: active paths [/] 2024-04-01T06:57:57.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:56 smithi083 ceph-mon[43429]: pgmap v65: 97 pgs: 97 active+clean; 1.2 GiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 63 MiB/s rd, 155 MiB/s wr, 882 op/s 2024-04-01T06:57:57.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:56 smithi083 ceph-mon[43429]: scrub queued for path: / 2024-04-01T06:57:57.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:56 smithi083 ceph-mon[43429]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:57.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:56 smithi083 ceph-mon[43429]: scrub summary: active paths [/] 2024-04-01T06:57:57.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:56 smithi083 ceph-mon[43429]: scrub summary: active paths [/] 2024-04-01T06:57:57.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:56 smithi083 ceph-mon[43429]: scrub summary: active paths [/] 2024-04-01T06:57:57.505 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:57.047+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e48 [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/timers/twoptimers.c auth v14 ap=1 s=3141 n(v0 rc2024-04-01T06:57:16.910544+0000 b3141 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907c8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e48:[<0x10000001e45/twoptimers.c v14>,<0x10000001e3d/timers v73>,<0x10000001e29/timers v194>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e48:[<0x10000001e45/twoptimers.c v14>,<0x10000001e3d/timers v73>,<0x10000001e29/timers v194>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.505 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:57.047+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e42 [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/clocks/Makefile auth v14 ap=1 s=527 n(v0 rc2024-04-01T06:57:16.906544+0000 b527 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907d4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e42:[<0x10000001e41/Makefile v14>,<0x10000001e3d/clocks v75>,<0x10000001e29/timers v194>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e42:[<0x10000001e41/Makefile v14>,<0x10000001e3d/clocks v75>,<0x10000001e29/timers v194>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.506 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:57.051+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e46 [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/timers/Makefile auth v18 ap=1 s=485 n(v0 rc2024-04-01T06:57:16.909544+0000 b485 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907c8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e46:[<0x10000001e45/Makefile v18>,<0x10000001e3d/timers v73>,<0x10000001e29/timers v194>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e46:[<0x10000001e45/Makefile v18>,<0x10000001e3d/timers v73>,<0x10000001e29/timers v194>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.506 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:57.051+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e43 [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/clocks/twopsetclock.c auth v18 ap=1 s=2575 n(v0 rc2005-06-03T16:36:57.000000+0000 b2575 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907d4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e43:[<0x10000001e41/twopsetclock.c v18>,<0x10000001e3d/clocks v75>,<0x10000001e29/timers v194>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e43:[<0x10000001e41/twopsetclock.c v18>,<0x10000001e3d/clocks v75>,<0x10000001e29/timers v194>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.506 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:57.051+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e47 [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/timers/twoevtimers.c auth v16 ap=1 s=2620 n(v0 rc2005-06-03T16:36:58.000000+0000 b2620 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907c9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e47:[<0x10000001e45/twoevtimers.c v16>,<0x10000001e3d/timers v73>,<0x10000001e29/timers v194>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e47:[<0x10000001e45/twoevtimers.c v16>,<0x10000001e3d/timers v73>,<0x10000001e29/timers v194>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.506 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:57.052+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e44 [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/clocks/invaliddates.c auth v16 ap=1 s=2879 n(v0 rc2024-04-01T06:57:16.907544+0000 b2879 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907c9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e44:[<0x10000001e41/invaliddates.c v16>,<0x10000001e3d/clocks v75>,<0x10000001e29/timers v194>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e44:[<0x10000001e41/invaliddates.c v16>,<0x10000001e3d/clocks v75>,<0x10000001e29/timers v194>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.506 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:57.053+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e58 [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/robust_test/robust2-mode2.c auth v44 ap=1 s=4183 n(v0 rc2024-04-01T06:57:16.922544+0000 b4183 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907dfb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e58:[<0x10000001e50/robust2-mode2.c v44>,<0x10000001e4b/robust_test v195>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e58:[<0x10000001e50/robust2-mode2.c v44>,<0x10000001e4b/robust_test v195>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.506 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:57.053+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e57 [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/robust_test/run.sh auth v48 ap=1 s=674 n(v0 rc2024-04-01T06:57:16.921544+0000 b674 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907df600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e57:[<0x10000001e50/run.sh v48>,<0x10000001e4b/robust_test v195>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e57:[<0x10000001e50/run.sh v48>,<0x10000001e4b/robust_test v195>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.506 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:57.054+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e53 [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/robust_test/robust3-mode2.c auth v46 ap=1 s=4099 n(v0 rc2024-04-01T06:57:16.918544+0000 b4099 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907e0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e53:[<0x10000001e50/robust3-mode2.c v46>,<0x10000001e4b/robust_test v195>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e53:[<0x10000001e50/robust3-mode2.c v46>,<0x10000001e4b/robust_test v195>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.506 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:57.054+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e4d [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/condvar/pthread_cond_wait_2.c auth v18 ap=1 s=6124 n(v0 rc2024-04-01T06:57:16.914544+0000 b6124 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907deb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e4d:[<0x10000001e4c/pthread_cond_wait_2.c v18>,<0x10000001e4b/condvar v193>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e4d:[<0x10000001e4c/pthread_cond_wait_2.c v18>,<0x10000001e4b/condvar v193>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.506 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:57.054+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e4f [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/condvar/pthread_cond_wait_1.c auth v14 ap=1 s=6110 n(v0 rc2005-06-03T16:36:33.000000+0000 b6110 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907df080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e4f:[<0x10000001e4c/pthread_cond_wait_1.c v14>,<0x10000001e4b/condvar v193>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e4f:[<0x10000001e4c/pthread_cond_wait_1.c v14>,<0x10000001e4b/condvar v193>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.506 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:57.054+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e4e [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/condvar/Makefile auth v16 ap=1 s=437 n(v0 rc2024-04-01T06:57:16.915544+0000 b437 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907de580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e4e:[<0x10000001e4c/Makefile v16>,<0x10000001e4b/condvar v193>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e4e:[<0x10000001e4c/Makefile v16>,<0x10000001e4b/condvar v193>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.507 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:57.054+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e56 [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/robust_test/robust1-mode2.c auth v34 ap=1 s=3155 n(v0 rc2024-04-01T06:57:16.920544+0000 b3155 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907e0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e56:[<0x10000001e50/robust1-mode2.c v34>,<0x10000001e4b/robust_test v195>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e56:[<0x10000001e50/robust1-mode2.c v34>,<0x10000001e4b/robust_test v195>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.507 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:57.055+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e55 [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/robust_test/robust1-sun.c auth v36 ap=1 s=3196 n(v0 rc2005-06-03T16:36:35.000000+0000 b3196 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907e1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e55:[<0x10000001e50/robust1-sun.c v36>,<0x10000001e4b/robust_test v195>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e55:[<0x10000001e50/robust1-sun.c v36>,<0x10000001e4b/robust_test v195>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.507 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:57.055+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e6f [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/include/pitest.h auth v12 ap=1 s=2070 n(v0 rc2005-06-03T16:36:34.000000+0000 b2070 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907e8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e6f:[<0x10000001e6d/pitest.h v12>,<0x10000001e4b/include v211>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e6f:[<0x10000001e6d/pitest.h v12>,<0x10000001e4b/include v211>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.507 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:57.056+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e54 [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/robust_test/README auth v42 ap=1 s=5168 n(v0 rc2024-04-01T06:57:16.919544+0000 b5168 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907e1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e54:[<0x10000001e50/README v42>,<0x10000001e4b/robust_test v195>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e54:[<0x10000001e50/README v42>,<0x10000001e4b/robust_test v195>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.507 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:57.056+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e52 [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/robust_test/Makefile auth v40 ap=1 s=153 n(v0 rc2005-06-03T16:36:35.000000+0000 b153 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907e0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e52:[<0x10000001e50/Makefile v40>,<0x10000001e4b/robust_test v195>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e52:[<0x10000001e50/Makefile v40>,<0x10000001e4b/robust_test v195>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.507 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:57.056+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e51 [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/robust_test/robust2-sun.c auth v38 ap=1 s=4169 n(v0 rc2024-04-01T06:57:16.917544+0000 b4169 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907e8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e51:[<0x10000001e50/robust2-sun.c v38>,<0x10000001e4b/robust_test v195>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e51:[<0x10000001e50/robust2-sun.c v38>,<0x10000001e4b/robust_test v195>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.507 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:57.056+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e6a [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/pitest-3.c auth v44 ap=1 s=10724 n(v0 rc2024-04-01T06:57:16.936544+0000 b10724 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907e9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e6a:[<0x10000001e61/pitest-3.c v44>,<0x10000001e4b/pi_test v209>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e6a:[<0x10000001e61/pitest-3.c v44>,<0x10000001e4b/pi_test v209>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.507 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:57.056+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e6e [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/include/test.h auth v10 ap=1 s=644 n(v0 rc2024-04-01T06:57:16.939543+0000 b644 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907e8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e6e:[<0x10000001e6d/test.h v10>,<0x10000001e4b/include v211>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e6e:[<0x10000001e6d/test.h v10>,<0x10000001e4b/include v211>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.507 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:57.056+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e6b [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/run.sh auth v46 ap=1 s=1055 n(v0 rc2005-06-03T16:36:34.000000+0000 b1055 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907ea100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e6b:[<0x10000001e61/run.sh v46>,<0x10000001e4b/pi_test v209>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e6b:[<0x10000001e61/run.sh v46>,<0x10000001e4b/pi_test v209>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.507 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:57.057+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e63 [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/pitest-5.c auth v48 ap=1 s=9495 n(v0 rc2024-04-01T06:57:16.931544+0000 b9495 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907ea680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e63:[<0x10000001e61/pitest-5.c v48>,<0x10000001e4b/pi_test v209>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e63:[<0x10000001e61/pitest-5.c v48>,<0x10000001e4b/pi_test v209>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.507 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:57.057+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e66 [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/pitest-4.c auth v56 ap=1 s=9935 n(v0 rc2024-04-01T06:57:16.933544+0000 b9935 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907e9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e66:[<0x10000001e61/pitest-4.c v56>,<0x10000001e4b/pi_test v209>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e66:[<0x10000001e61/pitest-4.c v56>,<0x10000001e4b/pi_test v209>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.507 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:57.058+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e64 [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/Makefile auth v60 ap=1 s=167 n(v0 rc2005-06-03T16:36:34.000000+0000 b167 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907eac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e64:[<0x10000001e61/Makefile v60>,<0x10000001e4b/pi_test v209>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e64:[<0x10000001e61/Makefile v60>,<0x10000001e4b/pi_test v209>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.508 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:57.058+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e69 [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/do-plot auth v58 ap=1 s=1546 n(v0 rc2024-04-01T06:57:16.935544+0000 b1546 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907e9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e69:[<0x10000001e61/do-plot v58>,<0x10000001e4b/pi_test v209>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e69:[<0x10000001e61/do-plot v58>,<0x10000001e4b/pi_test v209>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.508 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:57.058+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e65 [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/pitest-2.c auth v52 ap=1 s=10520 n(v0 rc2024-04-01T06:57:16.932544+0000 b10520 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907eb700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e65:[<0x10000001e61/pitest-2.c v52>,<0x10000001e4b/pi_test v209>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e65:[<0x10000001e61/pitest-2.c v52>,<0x10000001e4b/pi_test v209>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.508 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:57.058+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e67 [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/README auth v42 ap=1 s=5168 n(v0 rc2005-06-03T16:36:34.000000+0000 b5168 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907f4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e67:[<0x10000001e61/README v42>,<0x10000001e4b/pi_test v209>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e67:[<0x10000001e61/README v42>,<0x10000001e4b/pi_test v209>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.508 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:57.058+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e62 [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/pitest-6.c auth v50 ap=1 s=9496 n(v0 rc2024-04-01T06:57:16.930544+0000 b9496 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907f4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e62:[<0x10000001e61/pitest-6.c v50>,<0x10000001e4b/pi_test v209>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e62:[<0x10000001e61/pitest-6.c v50>,<0x10000001e4b/pi_test v209>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.508 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:57.059+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e68 [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/pitest-1.c auth v54 ap=1 s=9209 n(v0 rc2024-04-01T06:57:16.934544+0000 b9209 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907eb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e68:[<0x10000001e61/pitest-1.c v54>,<0x10000001e4b/pi_test v209>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e68:[<0x10000001e61/pitest-1.c v54>,<0x10000001e4b/pi_test v209>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.508 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:57.059+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e5c [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/schedule/1-1.c auth v18 ap=1 s=6022 n(v0 rc2024-04-01T06:57:16.925544+0000 b6022 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907f5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e5c:[<0x10000001e59/1-1.c v18>,<0x10000001e4b/schedule v191>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e5c:[<0x10000001e59/1-1.c v18>,<0x10000001e4b/schedule v191>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.508 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:57.059+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e5a [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/schedule/Makefile auth v16 ap=1 s=374 n(v0 rc2024-04-01T06:57:16.923544+0000 b374 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907f5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e5a:[<0x10000001e59/Makefile v16>,<0x10000001e4b/schedule v191>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e5a:[<0x10000001e59/Makefile v16>,<0x10000001e4b/schedule v191>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.508 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:57.060+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e5b [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/schedule/1-2.c auth v14 ap=1 s=7517 n(v0 rc2024-04-01T06:57:16.924544+0000 b7517 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907f4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e5b:[<0x10000001e59/1-2.c v14>,<0x10000001e4b/schedule v191>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e5b:[<0x10000001e59/1-2.c v14>,<0x10000001e4b/schedule v191>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:57.508 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T06:57:57.061+0000 7ff6f0b9a700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e5f [4,head] /volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/tools/watchdogtimer.sh auth v6 ap=1 s=354 n(v0 rc2024-04-01T06:57:16.928544+0000 b354 1=1+0) (iversion lock) caps={15249=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5628907f5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e5f:[<0x10000001e5e/watchdogtimer.sh v6>,<0x10000001e4b/tools v157>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1224>,<0x10000000202/testcases v1365>,<0x10000000007/ltp-full-20091231 v229>,<0x10000000006/fsstress v139>,<0x10000000005/tmp v87>,<0x100000001fb/client.0 v84>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v95>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v98>,<0x1/volumes v91>]//[]","memoryvalue":"(3)0x10000001e5f:[<0x10000001e5e/watchdogtimer.sh v6>,<0x10000001e4b/tools v157>,<0x10000001e29/threads v212>,<0x100000012ea/functional v285>,<0x10000000204/open_posix_testsuite v1252>,<0x10000000202/testcases v1380>,<0x10000000007/ltp-full-20091231 v239>,<0x10000000006/fsstress v202>,<0x10000000005/tmp v101>,<0x100000001fb/client.0 v96>,<0x100000001fa/7747a261-d796-4d30-94d6-a3bb0531c579 v81>,<0x10000000001/sv_1 v117>,<0x10000000000/qa v114>,<0x1/volumes v105>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-01T06:57:58.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e3d (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e4b (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e32 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e2a (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/mqueues) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e45 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/timers) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e3e (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/coverage.txt) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e4a (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/plan.txt) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e49 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/run.sh) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e40 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/assertions.xml) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e41 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/clocks) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e6c (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/run.sh) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e50 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/robust_test) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e3f (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/Makefile) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e70 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/Makefile.inc) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e4c (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/condvar) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e6d (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/include) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e61 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e59 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/schedule) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e5d (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/Makefile) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.143 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e60 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/README) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.143 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e5e (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/tools) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.143 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e37 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/sem_sleepingbarber.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.143 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e35 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/coverage.txt) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.143 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e3a (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/sem_philosopher.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.143 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e3c (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/plan.txt) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.143 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e33 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/sem_conpro.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.143 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e3b (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/run.sh) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.143 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e34 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/sem_lock.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.143 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e39 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/sem_readerwriter.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.143 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e31 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/mqueues/plan.txt) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.143 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e36 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/Makefile) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.143 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e2c (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/mqueues/coverage.txt) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.143 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e2d (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/mqueues/Makefile) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.144 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e2b (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/mqueues/send_rev_2.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.144 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e30 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/mqueues/run.sh) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.144 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e2e (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/mqueues/send_rev_1.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.144 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e2f (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/mqueues/assertions.xml) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.144 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e38 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/assertions.xml) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.144 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:58.144 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:58.144 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e48 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/timers/twoptimers.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.144 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e42 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/clocks/Makefile) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.144 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e46 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/timers/Makefile) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.144 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e43 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/clocks/twopsetclock.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.144 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e47 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/timers/twoevtimers.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.144 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e44 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/clocks/invaliddates.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.144 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e58 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/robust_test/robust2-mode2.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.145 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e57 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/robust_test/run.sh) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.145 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e53 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/robust_test/robust3-mode2.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.145 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e4d (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/condvar/pthread_cond_wait_2.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.145 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e4f (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/condvar/pthread_cond_wait_1.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.145 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e4e (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/condvar/Makefile) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.145 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e56 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/robust_test/robust1-mode2.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.145 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e55 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/robust_test/robust1-sun.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.145 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e6f (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/include/pitest.h) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.145 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e54 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/robust_test/README) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.145 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e52 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/robust_test/Makefile) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.145 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e51 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/robust_test/robust2-sun.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.145 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e6a (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/pitest-3.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.145 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e6e (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/include/test.h) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.145 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e6b (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/run.sh) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.145 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e63 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/pitest-5.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.146 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e66 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/pitest-4.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.146 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e64 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/Makefile) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.146 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e69 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/do-plot) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.146 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e65 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/pitest-2.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.146 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e67 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/README) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.146 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e62 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/pitest-6.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.146 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e68 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/pitest-1.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.146 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e5c (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/schedule/1-1.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.146 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e5a (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/schedule/Makefile) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.146 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e5b (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/schedule/1-2.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.146 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:57 smithi153 ceph-mon[48187]: Scrub error on inode 0x10000001e5f (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/tools/watchdogtimer.sh) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e3d (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e4b (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e32 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e2a (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/mqueues) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e45 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/timers) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e3e (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/coverage.txt) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.255 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e4a (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/plan.txt) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.255 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e49 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/run.sh) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.255 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e40 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/assertions.xml) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.255 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e41 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/clocks) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.255 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e6c (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/run.sh) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.255 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e50 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/robust_test) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.255 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e3f (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/Makefile) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.255 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e70 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/Makefile.inc) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.255 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e4c (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/condvar) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.255 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e6d (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/include) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.255 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e61 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.255 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e59 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/schedule) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.255 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e5d (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/Makefile) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.255 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e60 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/README) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.256 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e5e (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/tools) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.256 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e37 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/sem_sleepingbarber.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.256 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e35 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/coverage.txt) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.256 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e3a (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/sem_philosopher.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.256 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e3c (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/plan.txt) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.256 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e33 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/sem_conpro.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.256 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e3b (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/run.sh) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.256 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e34 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/sem_lock.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.256 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e39 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/sem_readerwriter.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.256 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e31 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/mqueues/plan.txt) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.256 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e36 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/Makefile) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.256 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e2c (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/mqueues/coverage.txt) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.256 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e2d (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/mqueues/Makefile) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.256 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e2b (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/mqueues/send_rev_2.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.256 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e30 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/mqueues/run.sh) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.257 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e2e (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/mqueues/send_rev_1.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.257 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e2f (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/mqueues/assertions.xml) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.257 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e38 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/assertions.xml) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.257 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:58.257 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:58.257 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e48 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/timers/twoptimers.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.257 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e42 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/clocks/Makefile) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.257 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e46 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/timers/Makefile) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.257 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e43 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/clocks/twopsetclock.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.257 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e47 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/timers/twoevtimers.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.257 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e44 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/clocks/invaliddates.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.257 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e58 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/robust_test/robust2-mode2.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.257 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e57 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/robust_test/run.sh) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.257 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e53 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/robust_test/robust3-mode2.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.258 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e4d (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/condvar/pthread_cond_wait_2.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.258 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e4f (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/condvar/pthread_cond_wait_1.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.258 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e4e (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/condvar/Makefile) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.258 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e56 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/robust_test/robust1-mode2.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.258 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e55 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/robust_test/robust1-sun.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.258 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e6f (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/include/pitest.h) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.258 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e54 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/robust_test/README) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.258 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e52 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/robust_test/Makefile) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.258 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e51 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/robust_test/robust2-sun.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.258 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e6a (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/pitest-3.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.258 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e6e (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/include/test.h) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.258 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e6b (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/run.sh) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.258 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e63 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/pitest-5.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.258 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e66 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/pitest-4.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.259 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e64 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/Makefile) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.259 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e69 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/do-plot) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.259 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e65 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/pitest-2.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.259 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e67 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/README) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.259 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e62 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/pitest-6.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.259 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e68 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/pitest-1.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.259 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e5c (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/schedule/1-1.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.259 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e5a (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/schedule/Makefile) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.259 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e5b (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/schedule/1-2.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.259 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:57 smithi145 ceph-mon[47816]: Scrub error on inode 0x10000001e5f (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/tools/watchdogtimer.sh) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e3d (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e4b (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e32 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e2a (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/mqueues) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e45 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/timers) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e3e (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/coverage.txt) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e4a (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/plan.txt) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e49 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/run.sh) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e40 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/assertions.xml) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e41 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/clocks) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.264 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e6c (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/run.sh) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.264 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e50 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/robust_test) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.264 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e3f (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/Makefile) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.264 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e70 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/Makefile.inc) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.264 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e4c (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/condvar) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.264 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e6d (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/include) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.264 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e61 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.264 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e59 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/schedule) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.264 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e5d (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/Makefile) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.264 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e60 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/README) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.264 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e5e (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/tools) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.264 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e37 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/sem_sleepingbarber.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.264 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e35 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/coverage.txt) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.264 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e3a (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/sem_philosopher.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.265 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e3c (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/plan.txt) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.265 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e33 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/sem_conpro.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.265 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e3b (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/run.sh) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.265 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e34 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/sem_lock.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.265 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e39 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/sem_readerwriter.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.265 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e31 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/mqueues/plan.txt) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.265 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e36 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/Makefile) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.265 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e2c (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/mqueues/coverage.txt) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.265 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e2d (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/mqueues/Makefile) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.265 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e2b (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/mqueues/send_rev_2.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.265 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e30 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/mqueues/run.sh) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.265 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e2e (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/mqueues/send_rev_1.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.265 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e2f (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/mqueues/assertions.xml) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.265 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e38 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/assertions.xml) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.266 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:58.266 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:58.266 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e48 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/timers/twoptimers.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.266 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e42 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/clocks/Makefile) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.266 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e46 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/timers/Makefile) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.266 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e43 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/clocks/twopsetclock.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.266 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e47 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/timers/twoevtimers.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.266 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e44 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/clocks/invaliddates.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.266 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e58 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/robust_test/robust2-mode2.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.266 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e57 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/robust_test/run.sh) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.266 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e53 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/robust_test/robust3-mode2.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.266 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e4d (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/condvar/pthread_cond_wait_2.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.266 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e4f (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/condvar/pthread_cond_wait_1.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.267 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e4e (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/condvar/Makefile) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.267 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e56 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/robust_test/robust1-mode2.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.267 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e55 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/robust_test/robust1-sun.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.267 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e6f (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/include/pitest.h) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.267 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e54 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/robust_test/README) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.267 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e52 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/robust_test/Makefile) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.267 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e51 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/robust_test/robust2-sun.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.267 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e6a (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/pitest-3.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.267 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e6e (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/include/test.h) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.267 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e6b (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/run.sh) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.267 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e63 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/pitest-5.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.267 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e66 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/pitest-4.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.267 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e64 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/Makefile) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.267 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e69 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/do-plot) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.267 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e65 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/pitest-2.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.268 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e67 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/README) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.268 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e62 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/pitest-6.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.268 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e68 (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/pitest-1.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.268 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e5c (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/schedule/1-1.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.268 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e5a (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/schedule/Makefile) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.268 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e5b (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/schedule/1-2.c) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.268 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:57 smithi083 ceph-mon[43429]: Scrub error on inode 0x10000001e5f (/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/tools/watchdogtimer.sh) see mds.e log and `damage ls` output for details 2024-04-01T06:57:58.905 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.903+0000 7faa605f6700 1 -- 172.21.15.83:0/3809101094 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa58105e40 msgr2=0x7faa58106220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:58.905 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.903+0000 7faa605f6700 1 --2- 172.21.15.83:0/3809101094 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa58105e40 0x7faa58106220 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7faa54009990 tx=0x7faa54009ca0 comp rx=0 tx=0).stop 2024-04-01T06:57:58.905 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.903+0000 7faa605f6700 1 -- 172.21.15.83:0/3809101094 shutdown_connections 2024-04-01T06:57:58.906 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.903+0000 7faa605f6700 1 --2- 172.21.15.83:0/3809101094 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa58105e40 0x7faa58106220 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:58.906 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.903+0000 7faa605f6700 1 --2- 172.21.15.83:0/3809101094 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faa580fffa0 0x7faa5810dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:58.906 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.903+0000 7faa605f6700 1 --2- 172.21.15.83:0/3809101094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa580ff5e0 0x7faa580ffa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:58.906 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.903+0000 7faa605f6700 1 -- 172.21.15.83:0/3809101094 >> 172.21.15.83:0/3809101094 conn(0x7faa58074f30 msgr2=0x7faa58075340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:58.906 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.903+0000 7faa605f6700 1 -- 172.21.15.83:0/3809101094 shutdown_connections 2024-04-01T06:57:58.906 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.903+0000 7faa605f6700 1 -- 172.21.15.83:0/3809101094 wait complete. 2024-04-01T06:57:58.906 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.904+0000 7faa605f6700 1 Processor -- start 2024-04-01T06:57:58.906 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.904+0000 7faa605f6700 1 -- start start 2024-04-01T06:57:58.906 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.904+0000 7faa605f6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa580ff5e0 0x7faa581007c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:58.906 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.904+0000 7faa605f6700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa580fffa0 0x7faa58100d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:58.906 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.904+0000 7faa605f6700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faa58105e40 0x7faa58101240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:58.906 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.904+0000 7faa605f6700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa581a53e0 con 0x7faa580fffa0 2024-04-01T06:57:58.906 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.904+0000 7faa605f6700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa581a5550 con 0x7faa58105e40 2024-04-01T06:57:58.906 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.904+0000 7faa605f6700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa581a5710 con 0x7faa580ff5e0 2024-04-01T06:57:58.907 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.904+0000 7faa5db91700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa580fffa0 0x7faa58100d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:58.907 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.904+0000 7faa5db91700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa580fffa0 0x7faa58100d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:32820/0 (socket says 172.21.15.83:32820) 2024-04-01T06:57:58.907 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.904+0000 7faa5db91700 1 -- 172.21.15.83:0/201144071 learned_addr learned my addr 172.21.15.83:0/201144071 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:58.907 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.904+0000 7faa5eb93700 1 --2- 172.21.15.83:0/201144071 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faa58105e40 0x7faa58101240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:58.907 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.904+0000 7faa5e392700 1 --2- 172.21.15.83:0/201144071 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa580ff5e0 0x7faa581007c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:58.907 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.904+0000 7faa5db91700 1 -- 172.21.15.83:0/201144071 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa580ff5e0 msgr2=0x7faa581007c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:58.907 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.904+0000 7faa5db91700 1 --2- 172.21.15.83:0/201144071 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa580ff5e0 0x7faa581007c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:58.907 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.904+0000 7faa5db91700 1 -- 172.21.15.83:0/201144071 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faa58105e40 msgr2=0x7faa58101240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:58.907 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.904+0000 7faa5db91700 1 --2- 172.21.15.83:0/201144071 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faa58105e40 0x7faa58101240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:58.907 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.904+0000 7faa5db91700 1 -- 172.21.15.83:0/201144071 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa540095f0 con 0x7faa580fffa0 2024-04-01T06:57:58.907 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.904+0000 7faa5db91700 1 --2- 172.21.15.83:0/201144071 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa580fffa0 0x7faa58100d00 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7faa4800c9b0 tx=0x7faa4800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:58.907 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.905+0000 7faa4f7fe700 1 -- 172.21.15.83:0/201144071 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa48007b00 con 0x7faa580fffa0 2024-04-01T06:57:58.907 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.905+0000 7faa4f7fe700 1 -- 172.21.15.83:0/201144071 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa4800ce50 con 0x7faa580fffa0 2024-04-01T06:57:58.907 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.905+0000 7faa4f7fe700 1 -- 172.21.15.83:0/201144071 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa48018660 con 0x7faa580fffa0 2024-04-01T06:57:58.907 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.905+0000 7faa605f6700 1 -- 172.21.15.83:0/201144071 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa581a59f0 con 0x7faa580fffa0 2024-04-01T06:57:58.908 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.905+0000 7faa605f6700 1 -- 172.21.15.83:0/201144071 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa581a5eb0 con 0x7faa580fffa0 2024-04-01T06:57:58.914 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.907+0000 7faa4f7fe700 1 -- 172.21.15.83:0/201144071 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 25) v1 ==== 135996+0+0 (secure 0 0 0) 0x7faa4800f450 con 0x7faa580fffa0 2024-04-01T06:57:58.914 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.907+0000 7faa4f7fe700 1 --2- 172.21.15.83:0/201144071 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7faa440a1310 0x7faa440a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:58.914 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.908+0000 7faa4f7fe700 1 -- 172.21.15.83:0/201144071 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7faa480ccbc0 con 0x7faa580fffa0 2024-04-01T06:57:58.914 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.908+0000 7faa5e392700 1 --2- 172.21.15.83:0/201144071 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7faa440a1310 0x7faa440a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:58.914 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.908+0000 7faa5e392700 1 --2- 172.21.15.83:0/201144071 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7faa440a1310 0x7faa440a37d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7faa5400b2e0 tx=0x7faa54005960 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:58.914 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.908+0000 7faa6c78cb80 1 Processor -- start 2024-04-01T06:57:58.914 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.909+0000 7faa6c78cb80 1 -- start start 2024-04-01T06:57:58.914 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.909+0000 7faa6c78cb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5612a25e3100 0x5612a25e34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:58.914 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.909+0000 7faa6c78cb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5612a25e3a20 0x5612a25ee390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:58.914 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.909+0000 7faa6c78cb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5612a25ee8d0 0x5612a25f0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:58.914 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.909+0000 7faa6c78cb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612a253c930 con 0x5612a25ee8d0 2024-04-01T06:57:58.914 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.909+0000 7faa6c78cb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612a253a2f0 con 0x5612a25e3100 2024-04-01T06:57:58.915 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.909+0000 7faa6c78cb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612a2535be0 con 0x5612a25e3a20 2024-04-01T06:57:58.915 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.909+0000 7faa5eb93700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5612a25ee8d0 0x5612a25f0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:58.915 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.909+0000 7faa5e392700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5612a25e3100 0x5612a25e34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:58.915 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.909+0000 7faa5eb93700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5612a25ee8d0 0x5612a25f0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:32834/0 (socket says 172.21.15.83:32834) 2024-04-01T06:57:58.915 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.909+0000 7faa5eb93700 1 -- 172.21.15.83:0/3833222610 learned_addr learned my addr 172.21.15.83:0/3833222610 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:58.915 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.909+0000 7faa5db91700 1 --2- 172.21.15.83:0/3833222610 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5612a25e3a20 0x5612a25ee390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:58.915 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.909+0000 7faa5eb93700 1 -- 172.21.15.83:0/3833222610 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5612a25e3a20 msgr2=0x5612a25ee390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:58.915 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.909+0000 7faa5eb93700 1 --2- 172.21.15.83:0/3833222610 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5612a25e3a20 0x5612a25ee390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:58.915 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.909+0000 7faa5eb93700 1 -- 172.21.15.83:0/3833222610 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5612a25e3100 msgr2=0x5612a25e34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:58.915 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.909+0000 7faa5eb93700 1 --2- 172.21.15.83:0/3833222610 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5612a25e3100 0x5612a25e34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:58.915 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.909+0000 7faa5eb93700 1 -- 172.21.15.83:0/3833222610 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5612a23b7350 con 0x5612a25ee8d0 2024-04-01T06:57:58.915 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.909+0000 7faa5e392700 1 --2- 172.21.15.83:0/3833222610 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5612a25e3100 0x5612a25e34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T06:57:58.915 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.909+0000 7faa5eb93700 1 --2- 172.21.15.83:0/3833222610 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5612a25ee8d0 0x5612a25f0cc0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7faa50011680 tx=0x7faa50009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d3c4d7a6f15cd34 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:58.915 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.910+0000 7faa4cff9700 1 -- 172.21.15.83:0/3833222610 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5000e040 con 0x5612a25ee8d0 2024-04-01T06:57:58.916 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.910+0000 7faa4cff9700 1 -- 172.21.15.83:0/3833222610 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa5000f040 con 0x5612a25ee8d0 2024-04-01T06:57:58.916 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.910+0000 7faa4cff9700 1 -- 172.21.15.83:0/3833222610 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa50004860 con 0x5612a25ee8d0 2024-04-01T06:57:58.916 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.910+0000 7faa6c78cb80 1 -- 172.21.15.83:0/3833222610 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5612a25ee8d0 msgr2=0x5612a25f0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:58.916 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.910+0000 7faa6c78cb80 1 --2- 172.21.15.83:0/3833222610 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5612a25ee8d0 0x5612a25f0cc0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7faa50011680 tx=0x7faa50009920 comp rx=0 tx=0).stop 2024-04-01T06:57:58.916 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.910+0000 7faa6c78cb80 1 -- 172.21.15.83:0/3833222610 shutdown_connections 2024-04-01T06:57:58.916 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.910+0000 7faa6c78cb80 1 --2- 172.21.15.83:0/3833222610 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5612a25ee8d0 0x5612a25f0cc0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:58.916 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.910+0000 7faa6c78cb80 1 --2- 172.21.15.83:0/3833222610 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5612a25e3100 0x5612a25e34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:58.916 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.910+0000 7faa6c78cb80 1 --2- 172.21.15.83:0/3833222610 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5612a25e3a20 0x5612a25ee390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:58.916 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.910+0000 7faa6c78cb80 1 -- 172.21.15.83:0/3833222610 >> 172.21.15.83:0/3833222610 conn(0x5612a2543640 msgr2=0x5612a25df520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:58.916 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.911+0000 7faa6c78cb80 1 -- 172.21.15.83:0/3833222610 shutdown_connections 2024-04-01T06:57:58.916 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.911+0000 7faa6c78cb80 1 -- 172.21.15.83:0/3833222610 wait complete. 2024-04-01T06:57:58.916 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.911+0000 7faa6c78cb80 1 -- start start 2024-04-01T06:57:58.916 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.911+0000 7faa6c78cb80 1 Processor -- start 2024-04-01T06:57:58.916 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.911+0000 7faa6c78cb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5612a25e3100 0x5612a25ee2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:58.917 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.911+0000 7faa6c78cb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5612a25e3a20 0x5612a25eb620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:58.917 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.911+0000 7faa6c78cb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5612a25ee8d0 0x5612a25ebc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:58.917 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.911+0000 7faa6c78cb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612a24d1d20 con 0x5612a25e3a20 2024-04-01T06:57:58.917 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.911+0000 7faa6c78cb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612a24d19c0 con 0x5612a25ee8d0 2024-04-01T06:57:58.917 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.911+0000 7faa6c78cb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612a23b9640 con 0x5612a25e3100 2024-04-01T06:57:58.917 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.911+0000 7faa6c78cb80 10 client.0 _ll_register_callbacks cb 0x5612a24db410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:57:58.917 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.911+0000 7faa5db91700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5612a25e3a20 0x5612a25eb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:58.917 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.911+0000 7faa5db91700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5612a25e3a20 0x5612a25eb620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:32842/0 (socket says 172.21.15.83:32842) 2024-04-01T06:57:58.917 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.911+0000 7faa5db91700 1 -- 172.21.15.83:0/4268966805 learned_addr learned my addr 172.21.15.83:0/4268966805 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:58.917 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.911+0000 7faa5eb93700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5612a25ee8d0 0x5612a25ebc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:58.917 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.911+0000 7faa5e392700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5612a25e3100 0x5612a25ee2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:58.917 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.912+0000 7faa5db91700 1 -- 172.21.15.83:0/4268966805 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5612a25e3100 msgr2=0x5612a25ee2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:58.917 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.912+0000 7faa5db91700 1 --2- 172.21.15.83:0/4268966805 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5612a25e3100 0x5612a25ee2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:58.917 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.912+0000 7faa5db91700 1 -- 172.21.15.83:0/4268966805 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5612a25ee8d0 msgr2=0x5612a25ebc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:58.918 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.912+0000 7faa5db91700 1 --2- 172.21.15.83:0/4268966805 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5612a25ee8d0 0x5612a25ebc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:58.918 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.912+0000 7faa5db91700 1 -- 172.21.15.83:0/4268966805 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa5810e470 con 0x5612a25e3a20 2024-04-01T06:57:58.918 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.912+0000 7faa5db91700 1 --2- 172.21.15.83:0/4268966805 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5612a25e3a20 0x5612a25eb620 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7faa48099c60 tx=0x7faa4800c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee95b2f491dc9f0a server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:58.918 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.912+0000 7faa41ffb700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:57:58.918 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.912+0000 7faa41ffb700 1 -- 172.21.15.83:0/4268966805 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4809a130 con 0x5612a25e3a20 2024-04-01T06:57:58.918 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.912+0000 7faa41ffb700 1 -- 172.21.15.83:0/4268966805 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7faa48099cd0 con 0x5612a25e3a20 2024-04-01T06:57:58.918 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.912+0000 7faa6c78cb80 1 -- 172.21.15.83:0/4268966805 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5612a24f6320 con 0x5612a25e3a20 2024-04-01T06:57:58.918 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.912+0000 7faa41ffb700 1 -- 172.21.15.83:0/4268966805 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa480ca7a0 con 0x5612a25e3a20 2024-04-01T06:57:58.918 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.912+0000 7faa6c78cb80 10 client.16095 fetch_fsmap learned FSMap version 28 2024-04-01T06:57:58.918 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.912+0000 7faa6c78cb80 1 -- 172.21.15.83:0/4268966805 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x7faa50011330 con 0x5612a25e3a20 2024-04-01T06:57:58.918 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.912+0000 7faa41ffb700 1 -- 172.21.15.83:0/4268966805 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa48063020 con 0x5612a25e3a20 2024-04-01T06:57:58.918 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.912+0000 7faa41ffb700 1 -- 172.21.15.83:0/4268966805 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 28) v1 ==== 7474+0+0 (secure 0 0 0) 0x7faa480a1cc0 con 0x5612a25e3a20 2024-04-01T06:57:58.918 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.912+0000 7faa6c78cb80 10 client.16095 fetch_fsmap finished waiting for FSMap version 28 2024-04-01T06:57:58.919 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.912+0000 7faa6c78cb80 10 client.16095 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-01T06:57:58.919 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.912+0000 7faa6c78cb80 20 client.16095 populate_metadata read hostname 'smithi083' 2024-04-01T06:57:58.919 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.912+0000 7faa6c78cb80 1 --2- 172.21.15.83:0/4268966805 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5612a25fe4d0 0x5612a26008f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:58.919 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.912+0000 7faa6c78cb80 4 client.16095 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-01T06:57:58.919 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.912+0000 7faa6c78cb80 1 -- 172.21.15.83:0/4268966805 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5612a252e6a0 con 0x5612a25fe4d0 2024-04-01T06:57:58.919 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.912+0000 7faa5e392700 1 --2- 172.21.15.83:0/4268966805 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5612a25fe4d0 0x5612a26008f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:58.919 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.913+0000 7faa5e392700 1 --2- 172.21.15.83:0/4268966805 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5612a25fe4d0 0x5612a26008f0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41ea18f0d86f913a server_cookie=d8d2a6bff83be265 in_seq=0 out_seq=0 2024-04-01T06:57:58.919 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.913+0000 7faa41ffb700 10 client.16095 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:57:58.920 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.917+0000 7faa41ffb700 1 -- 172.21.15.83:0/4268966805 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5612a252e6a0 con 0x5612a25fe4d0 2024-04-01T06:57:58.920 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.917+0000 7faa41ffb700 10 client.16095 handle_command_reply: tid=0 2024-04-01T06:57:58.920 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.917+0000 7faa6c78cb80 1 client.16095 shutdown 2024-04-01T06:57:58.920 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.918+0000 7faa6c78cb80 1 -- 172.21.15.83:0/4268966805 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5612a25e3a20 msgr2=0x5612a25eb620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:58.921 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.918+0000 7faa6c78cb80 1 --2- 172.21.15.83:0/4268966805 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5612a25e3a20 0x5612a25eb620 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7faa48099c60 tx=0x7faa4800c930 comp rx=0 tx=0).stop 2024-04-01T06:57:58.921 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.918+0000 7faa6c78cb80 1 -- 172.21.15.83:0/4268966805 shutdown_connections 2024-04-01T06:57:58.921 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.918+0000 7faa6c78cb80 1 --2- 172.21.15.83:0/4268966805 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5612a25fe4d0 0x5612a26008f0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:58.921 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.918+0000 7faa6c78cb80 1 --2- 172.21.15.83:0/4268966805 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5612a25ee8d0 0x5612a25ebc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:58.921 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.918+0000 7faa6c78cb80 1 --2- 172.21.15.83:0/4268966805 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5612a25e3100 0x5612a25ee2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:58.921 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.918+0000 7faa6c78cb80 1 --2- 172.21.15.83:0/4268966805 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5612a25e3a20 0x5612a25eb620 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:58.921 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.918+0000 7faa41ffb700 0 client.16095 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:57:58.921 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.918+0000 7faa6c78cb80 1 -- 172.21.15.83:0/4268966805 >> 172.21.15.83:0/4268966805 conn(0x5612a2543640 msgr2=0x5612a25e50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:58.921 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.918+0000 7faa6c78cb80 1 -- 172.21.15.83:0/4268966805 shutdown_connections 2024-04-01T06:57:58.921 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.918+0000 7faa6c78cb80 1 -- 172.21.15.83:0/4268966805 wait complete. 2024-04-01T06:57:58.921 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.918+0000 7faa6c78cb80 20 client.16095 trim_cache size 0 max 16384 2024-04-01T06:57:58.939 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.933+0000 7faa6c78cb80 1 Processor -- start 2024-04-01T06:57:58.939 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.933+0000 7faa6c78cb80 1 -- start start 2024-04-01T06:57:58.939 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.933+0000 7faa6c78cb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5612a25e3100 0x5612a25ebbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:58.939 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.933+0000 7faa6c78cb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5612a25e3a20 0x5612a25d9500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:58.939 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.933+0000 7faa6c78cb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5612a25ee8d0 0x5612a25f5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:58.939 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.933+0000 7faa6c78cb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612a25db1b0 con 0x5612a25ee8d0 2024-04-01T06:57:58.939 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.933+0000 7faa6c78cb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612a25e43b0 con 0x5612a25e3a20 2024-04-01T06:57:58.939 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.933+0000 7faa6c78cb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612a25db430 con 0x5612a25e3100 2024-04-01T06:57:58.940 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.933+0000 7faa5eb93700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5612a25ee8d0 0x5612a25f5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:58.940 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.933+0000 7faa5eb93700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5612a25ee8d0 0x5612a25f5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:32846/0 (socket says 172.21.15.83:32846) 2024-04-01T06:57:58.940 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.933+0000 7faa5eb93700 1 -- 172.21.15.83:0/90712784 learned_addr learned my addr 172.21.15.83:0/90712784 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:58.940 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.933+0000 7faa5e392700 1 --2- 172.21.15.83:0/90712784 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5612a25e3100 0x5612a25ebbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:58.940 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.933+0000 7faa5db91700 1 --2- 172.21.15.83:0/90712784 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5612a25e3a20 0x5612a25d9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:58.940 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.933+0000 7faa5eb93700 1 -- 172.21.15.83:0/90712784 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5612a25e3100 msgr2=0x5612a25ebbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:58.940 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.933+0000 7faa5eb93700 1 --2- 172.21.15.83:0/90712784 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5612a25e3100 0x5612a25ebbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:58.940 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.933+0000 7faa5eb93700 1 -- 172.21.15.83:0/90712784 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5612a25e3a20 msgr2=0x5612a25d9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:58.940 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.933+0000 7faa5eb93700 1 --2- 172.21.15.83:0/90712784 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5612a25e3a20 0x5612a25d9500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:58.940 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.933+0000 7faa5eb93700 1 -- 172.21.15.83:0/90712784 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5612a2363b00 con 0x5612a25ee8d0 2024-04-01T06:57:58.940 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.933+0000 7faa5db91700 1 --2- 172.21.15.83:0/90712784 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5612a25e3a20 0x5612a25d9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:57:58.940 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.934+0000 7faa5eb93700 1 --2- 172.21.15.83:0/90712784 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5612a25ee8d0 0x5612a25f5610 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7faa50011620 tx=0x7faa50009e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7edd4794679978cd server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:58.940 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.934+0000 7faa4d7fa700 1 -- 172.21.15.83:0/90712784 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5000e050 con 0x5612a25ee8d0 2024-04-01T06:57:58.940 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.934+0000 7faa4d7fa700 1 -- 172.21.15.83:0/90712784 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa50009360 con 0x5612a25ee8d0 2024-04-01T06:57:58.941 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.934+0000 7faa4d7fa700 1 -- 172.21.15.83:0/90712784 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa50004920 con 0x5612a25ee8d0 2024-04-01T06:57:58.941 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.934+0000 7faa6c78cb80 1 -- 172.21.15.83:0/90712784 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5612a25ee8d0 msgr2=0x5612a25f5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:58.941 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.934+0000 7faa6c78cb80 1 --2- 172.21.15.83:0/90712784 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5612a25ee8d0 0x5612a25f5610 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7faa50011620 tx=0x7faa50009e10 comp rx=0 tx=0).stop 2024-04-01T06:57:58.941 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.934+0000 7faa6c78cb80 1 -- 172.21.15.83:0/90712784 shutdown_connections 2024-04-01T06:57:58.941 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.934+0000 7faa6c78cb80 1 --2- 172.21.15.83:0/90712784 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5612a25ee8d0 0x5612a25f5610 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:58.941 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.934+0000 7faa6c78cb80 1 --2- 172.21.15.83:0/90712784 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5612a25e3100 0x5612a25ebbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:58.941 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.934+0000 7faa6c78cb80 1 --2- 172.21.15.83:0/90712784 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5612a25e3a20 0x5612a25d9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:58.941 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.934+0000 7faa6c78cb80 1 -- 172.21.15.83:0/90712784 >> 172.21.15.83:0/90712784 conn(0x5612a2543640 msgr2=0x5612a25eaeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:58.941 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.934+0000 7faa6c78cb80 1 -- 172.21.15.83:0/90712784 shutdown_connections 2024-04-01T06:57:58.941 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.934+0000 7faa6c78cb80 1 -- 172.21.15.83:0/90712784 wait complete. 2024-04-01T06:57:58.941 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.935+0000 7faa6c78cb80 1 -- start start 2024-04-01T06:57:58.941 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.935+0000 7faa6c78cb80 1 Processor -- start 2024-04-01T06:57:58.941 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.935+0000 7faa6c78cb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5612a25e3100 0x5612a25f4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:58.941 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.935+0000 7faa6c78cb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5612a25e3a20 0x5612a25f54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:58.942 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.935+0000 7faa6c78cb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5612a25ee8d0 0x5612a25f35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:58.942 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.935+0000 7faa6c78cb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612a25f3bc0 con 0x5612a25e3a20 2024-04-01T06:57:58.942 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.935+0000 7faa6c78cb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612a25f3d30 con 0x5612a25e3100 2024-04-01T06:57:58.942 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.935+0000 7faa6c78cb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612a25f3ef0 con 0x5612a25ee8d0 2024-04-01T06:57:58.942 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.935+0000 7faa6c78cb80 10 client.0 _ll_register_callbacks cb 0x5612a24db410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:57:58.942 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.935+0000 7faa5db91700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5612a25e3a20 0x5612a25f54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:58.942 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.935+0000 7faa5db91700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5612a25e3a20 0x5612a25f54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:32862/0 (socket says 172.21.15.83:32862) 2024-04-01T06:57:58.942 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.935+0000 7faa5db91700 1 -- 172.21.15.83:0/3395344641 learned_addr learned my addr 172.21.15.83:0/3395344641 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:57:58.942 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.935+0000 7faa5e392700 1 --2- 172.21.15.83:0/3395344641 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5612a25e3100 0x5612a25f4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:58.942 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.935+0000 7faa5eb93700 1 --2- 172.21.15.83:0/3395344641 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5612a25ee8d0 0x5612a25f35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:58.942 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.935+0000 7faa5db91700 1 -- 172.21.15.83:0/3395344641 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5612a25ee8d0 msgr2=0x5612a25f35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:58.942 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.935+0000 7faa5db91700 1 --2- 172.21.15.83:0/3395344641 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5612a25ee8d0 0x5612a25f35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:58.942 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.935+0000 7faa5db91700 1 -- 172.21.15.83:0/3395344641 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5612a25e3100 msgr2=0x5612a25f4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:57:58.942 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.935+0000 7faa5db91700 1 --2- 172.21.15.83:0/3395344641 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5612a25e3100 0x5612a25f4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:58.943 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.935+0000 7faa5db91700 1 -- 172.21.15.83:0/3395344641 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5612a23b7350 con 0x5612a25e3a20 2024-04-01T06:57:58.943 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.935+0000 7faa5db91700 1 --2- 172.21.15.83:0/3395344641 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5612a25e3a20 0x5612a25f54b0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7faa48096740 tx=0x7faa480a1ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d763d44858929c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:57:58.943 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.935+0000 7faa41ffb700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:57:58.943 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.936+0000 7faa41ffb700 1 -- 172.21.15.83:0/3395344641 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa480ca7a0 con 0x5612a25e3a20 2024-04-01T06:57:58.943 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.936+0000 7faa41ffb700 1 -- 172.21.15.83:0/3395344641 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7faa48064080 con 0x5612a25e3a20 2024-04-01T06:57:58.943 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.936+0000 7faa6c78cb80 1 -- 172.21.15.83:0/3395344641 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faa5000f040 con 0x5612a25e3a20 2024-04-01T06:57:58.943 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.936+0000 7faa41ffb700 1 -- 172.21.15.83:0/3395344641 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa48099cd0 con 0x5612a25e3a20 2024-04-01T06:57:58.943 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.936+0000 7faa6c78cb80 10 client.16101 fetch_fsmap learned FSMap version 28 2024-04-01T06:57:58.943 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.936+0000 7faa6c78cb80 1 -- 172.21.15.83:0/3395344641 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x5612a24fbe40 con 0x5612a25e3a20 2024-04-01T06:57:58.943 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.936+0000 7faa41ffb700 1 -- 172.21.15.83:0/3395344641 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa5000f040 con 0x5612a25e3a20 2024-04-01T06:57:58.943 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.936+0000 7faa41ffb700 1 -- 172.21.15.83:0/3395344641 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 28) v1 ==== 7474+0+0 (secure 0 0 0) 0x7faa48098c30 con 0x5612a25e3a20 2024-04-01T06:57:58.943 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.936+0000 7faa6c78cb80 10 client.16101 fetch_fsmap finished waiting for FSMap version 28 2024-04-01T06:57:58.943 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.936+0000 7faa6c78cb80 10 client.16101 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-01T06:57:58.943 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.936+0000 7faa6c78cb80 20 client.16101 populate_metadata read hostname 'smithi083' 2024-04-01T06:57:58.944 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.936+0000 7faa6c78cb80 1 --2- 172.21.15.83:0/3395344641 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5612a2652f30 0x5612a2655320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:57:58.944 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.936+0000 7faa6c78cb80 4 client.16101 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-01T06:57:58.944 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.936+0000 7faa6c78cb80 1 -- 172.21.15.83:0/3395344641 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5612a2384c90 con 0x5612a2652f30 2024-04-01T06:57:58.944 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.936+0000 7faa5e392700 1 --2- 172.21.15.83:0/3395344641 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5612a2652f30 0x5612a2655320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:57:58.944 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.937+0000 7faa41ffb700 10 client.16101 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:57:58.944 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:58.937+0000 7faa5e392700 1 --2- 172.21.15.83:0/3395344641 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5612a2652f30 0x5612a2655320 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ccf107a294a86a6 server_cookie=cd43d8008d2814af in_seq=0 out_seq=0 2024-04-01T06:57:59.136 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:59.135+0000 7faa41ffb700 1 -- 172.21.15.83:0/3395344641 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5612a2384c90 con 0x5612a2652f30 2024-04-01T06:57:59.136 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:59.135+0000 7faa41ffb700 10 client.16101 handle_command_reply: tid=0 2024-04-01T06:57:59.136 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:59.135+0000 7faa6c78cb80 1 client.16101 shutdown 2024-04-01T06:57:59.136 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:59.135+0000 7faa6c78cb80 1 -- 172.21.15.83:0/3395344641 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5612a25e3a20 msgr2=0x5612a25f54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:59.136 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:59.135+0000 7faa6c78cb80 1 --2- 172.21.15.83:0/3395344641 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5612a25e3a20 0x5612a25f54b0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7faa48096740 tx=0x7faa480a1ef0 comp rx=0 tx=0).stop 2024-04-01T06:57:59.136 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:59.135+0000 7faa6c78cb80 1 -- 172.21.15.83:0/3395344641 shutdown_connections 2024-04-01T06:57:59.136 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:59.135+0000 7faa6c78cb80 1 --2- 172.21.15.83:0/3395344641 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5612a2652f30 0x5612a2655320 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:59.137 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:59.135+0000 7faa6c78cb80 1 --2- 172.21.15.83:0/3395344641 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5612a25ee8d0 0x5612a25f35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:59.137 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:59.135+0000 7faa41ffb700 0 client.16101 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:57:59.137 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:59.135+0000 7faa6c78cb80 1 --2- 172.21.15.83:0/3395344641 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5612a25e3100 0x5612a25f4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:59.137 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:59.135+0000 7faa6c78cb80 1 --2- 172.21.15.83:0/3395344641 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5612a25e3a20 0x5612a25f54b0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:59.137 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:59.135+0000 7faa6c78cb80 1 -- 172.21.15.83:0/3395344641 >> 172.21.15.83:0/3395344641 conn(0x5612a2543640 msgr2=0x5612a25d83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:59.137 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:59.136+0000 7faa6c78cb80 1 -- 172.21.15.83:0/3395344641 shutdown_connections 2024-04-01T06:57:59.137 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:59.136+0000 7faa6c78cb80 1 -- 172.21.15.83:0/3395344641 wait complete. 2024-04-01T06:57:59.137 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:59.136+0000 7faa6c78cb80 20 client.16101 trim_cache size 0 max 16384 2024-04-01T06:57:59.137 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout:{ 2024-04-01T06:57:59.137 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout: "message": "", 2024-04-01T06:57:59.138 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout: "return_code": 0 2024-04-01T06:57:59.138 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout:} 2024-04-01T06:57:59.138 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:59.137+0000 7faa605f6700 1 -- 172.21.15.83:0/201144071 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7faa440a1310 msgr2=0x7faa440a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:59.138 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:59.137+0000 7faa605f6700 1 --2- 172.21.15.83:0/201144071 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7faa440a1310 0x7faa440a37d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7faa5400b2e0 tx=0x7faa54005960 comp rx=0 tx=0).stop 2024-04-01T06:57:59.138 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:59.137+0000 7faa605f6700 1 -- 172.21.15.83:0/201144071 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa580fffa0 msgr2=0x7faa58100d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:57:59.138 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:59.137+0000 7faa605f6700 1 --2- 172.21.15.83:0/201144071 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa580fffa0 0x7faa58100d00 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7faa4800c9b0 tx=0x7faa4800ccc0 comp rx=0 tx=0).stop 2024-04-01T06:57:59.138 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:59.137+0000 7faa605f6700 1 -- 172.21.15.83:0/201144071 shutdown_connections 2024-04-01T06:57:59.138 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:59.137+0000 7faa605f6700 1 --2- 172.21.15.83:0/201144071 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7faa440a1310 0x7faa440a37d0 secure :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7faa5400b2e0 tx=0x7faa54005960 comp rx=0 tx=0).stop 2024-04-01T06:57:59.138 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:59.137+0000 7faa605f6700 1 --2- 172.21.15.83:0/201144071 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faa58105e40 0x7faa58101240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:59.139 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:59.137+0000 7faa605f6700 1 --2- 172.21.15.83:0/201144071 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa580ff5e0 0x7faa581007c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:59.139 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:59.137+0000 7faa605f6700 1 --2- 172.21.15.83:0/201144071 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa580fffa0 0x7faa58100d00 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:57:59.139 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:59.137+0000 7faa605f6700 1 -- 172.21.15.83:0/201144071 >> 172.21.15.83:0/201144071 conn(0x7faa58074f30 msgr2=0x7faa580fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:57:59.139 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:59.140+0000 7faa605f6700 1 -- 172.21.15.83:0/201144071 shutdown_connections 2024-04-01T06:57:59.139 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:57:59.140+0000 7faa605f6700 1 -- 172.21.15.83:0/201144071 wait complete. 2024-04-01T06:57:59.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:58 smithi153 ceph-mon[48187]: pgmap v66: 97 pgs: 97 active+clean; 1.2 GiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 37 MiB/s wr, 702 op/s 2024-04-01T06:57:59.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:58 smithi153 ceph-mon[48187]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:59.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:58 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:57:59.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:58 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:57:59.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:58 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:57:59.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:58 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:57:59.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:58 smithi145 ceph-mon[47816]: pgmap v66: 97 pgs: 97 active+clean; 1.2 GiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 37 MiB/s wr, 702 op/s 2024-04-01T06:57:59.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:58 smithi145 ceph-mon[47816]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:59.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:58 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:57:59.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:58 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:57:59.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:58 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:57:59.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:58 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:57:59.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:58 smithi083 ceph-mon[43429]: pgmap v66: 97 pgs: 97 active+clean; 1.2 GiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 37 MiB/s wr, 702 op/s 2024-04-01T06:57:59.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:58 smithi083 ceph-mon[43429]: scrub summary: idle+waiting paths [/] 2024-04-01T06:57:59.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:58 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:57:59.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:58 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:57:59.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:58 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:57:59.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:58 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:58:00.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:57:59 smithi153 ceph-mon[48187]: pgmap v67: 97 pgs: 97 active+clean; 426 MiB data, 841 MiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 38 MiB/s wr, 1.60k op/s 2024-04-01T06:58:00.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:57:59 smithi145 ceph-mon[47816]: pgmap v67: 97 pgs: 97 active+clean; 426 MiB data, 841 MiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 38 MiB/s wr, 1.60k op/s 2024-04-01T06:58:00.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:57:59 smithi083 ceph-mon[43429]: pgmap v67: 97 pgs: 97 active+clean; 426 MiB data, 841 MiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 38 MiB/s wr, 1.60k op/s 2024-04-01T06:58:01.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:58:00 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mon-a[43406]: 2024-04-01T06:58:00.800+0000 7fc4c282f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-01T06:58:02.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:58:01 smithi145 ceph-mon[47816]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-01T06:58:02.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:58:01 smithi145 ceph-mon[47816]: mds.? [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] up:active 2024-04-01T06:58:02.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:58:01 smithi145 ceph-mon[47816]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-04-01T06:58:02.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:58:01 smithi083 ceph-mon[43429]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-01T06:58:02.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:58:01 smithi083 ceph-mon[43429]: mds.? [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] up:active 2024-04-01T06:58:02.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:58:01 smithi083 ceph-mon[43429]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-04-01T06:58:02.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:58:01 smithi153 ceph-mon[48187]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-01T06:58:02.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:58:01 smithi153 ceph-mon[48187]: mds.? [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] up:active 2024-04-01T06:58:02.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:58:01 smithi153 ceph-mon[48187]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-04-01T06:58:03.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:58:02 smithi145 ceph-mon[47816]: pgmap v68: 97 pgs: 97 active+clean; 426 MiB data, 841 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.1 MiB/s wr, 995 op/s 2024-04-01T06:58:03.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:58:02 smithi083 ceph-mon[43429]: pgmap v68: 97 pgs: 97 active+clean; 426 MiB data, 841 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.1 MiB/s wr, 995 op/s 2024-04-01T06:58:03.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:58:02 smithi153 ceph-mon[48187]: pgmap v68: 97 pgs: 97 active+clean; 426 MiB data, 841 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.1 MiB/s wr, 995 op/s 2024-04-01T06:58:04.158 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-01T06:58:04.158 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-01T06:58:05.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:58:04 smithi145 ceph-mon[47816]: pgmap v69: 97 pgs: 97 active+clean; 426 MiB data, 841 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.1 MiB/s wr, 995 op/s 2024-04-01T06:58:05.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:58:04 smithi083 ceph-mon[43429]: pgmap v69: 97 pgs: 97 active+clean; 426 MiB data, 841 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.1 MiB/s wr, 995 op/s 2024-04-01T06:58:05.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:58:04 smithi153 ceph-mon[48187]: pgmap v69: 97 pgs: 97 active+clean; 426 MiB data, 841 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.1 MiB/s wr, 995 op/s 2024-04-01T06:58:07.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:58:06 smithi145 ceph-mon[47816]: pgmap v70: 97 pgs: 97 active+clean; 164 MiB data, 805 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.3 MiB/s wr, 1.06k op/s 2024-04-01T06:58:07.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:58:06 smithi083 ceph-mon[43429]: pgmap v70: 97 pgs: 97 active+clean; 164 MiB data, 805 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.3 MiB/s wr, 1.06k op/s 2024-04-01T06:58:07.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:58:06 smithi153 ceph-mon[48187]: pgmap v70: 97 pgs: 97 active+clean; 164 MiB data, 805 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.3 MiB/s wr, 1.06k op/s 2024-04-01T06:58:09.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:58:08 smithi145 ceph-mon[47816]: scrub summary: idle 2024-04-01T06:58:09.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:58:08 smithi145 ceph-mon[47816]: scrub summary: idle 2024-04-01T06:58:09.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:58:08 smithi145 ceph-mon[47816]: scrub summary: idle 2024-04-01T06:58:09.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:58:08 smithi145 ceph-mon[47816]: pgmap v71: 97 pgs: 97 active+clean; 164 MiB data, 805 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 632 KiB/s wr, 963 op/s 2024-04-01T06:58:09.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:58:08 smithi083 ceph-mon[43429]: scrub summary: idle 2024-04-01T06:58:09.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:58:08 smithi083 ceph-mon[43429]: scrub summary: idle 2024-04-01T06:58:09.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:58:08 smithi083 ceph-mon[43429]: scrub summary: idle 2024-04-01T06:58:09.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:58:08 smithi083 ceph-mon[43429]: pgmap v71: 97 pgs: 97 active+clean; 164 MiB data, 805 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 632 KiB/s wr, 963 op/s 2024-04-01T06:58:09.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:58:08 smithi153 ceph-mon[48187]: scrub summary: idle 2024-04-01T06:58:09.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:58:08 smithi153 ceph-mon[48187]: scrub summary: idle 2024-04-01T06:58:09.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:58:08 smithi153 ceph-mon[48187]: scrub summary: idle 2024-04-01T06:58:09.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:58:08 smithi153 ceph-mon[48187]: pgmap v71: 97 pgs: 97 active+clean; 164 MiB data, 805 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 632 KiB/s wr, 963 op/s 2024-04-01T06:58:11.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:58:10 smithi145 ceph-mon[47816]: pgmap v72: 97 pgs: 97 active+clean; 166 MiB data, 813 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 829 KiB/s wr, 993 op/s 2024-04-01T06:58:11.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:58:10 smithi083 ceph-mon[43429]: pgmap v72: 97 pgs: 97 active+clean; 166 MiB data, 813 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 829 KiB/s wr, 993 op/s 2024-04-01T06:58:11.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:58:10 smithi153 ceph-mon[48187]: pgmap v72: 97 pgs: 97 active+clean; 166 MiB data, 813 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 829 KiB/s wr, 993 op/s 2024-04-01T06:58:12.272 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.271+0000 7f6909243700 1 -- 172.21.15.83:0/336072686 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69041000b0 msgr2=0x7f6904100530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:12.272 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.271+0000 7f6909243700 1 --2- 172.21.15.83:0/336072686 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69041000b0 0x7f6904100530 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f68f8009990 tx=0x7f68f8009ca0 comp rx=0 tx=0).stop 2024-04-01T06:58:12.273 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.272+0000 7f6909243700 1 -- 172.21.15.83:0/336072686 shutdown_connections 2024-04-01T06:58:12.273 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.272+0000 7f6909243700 1 --2- 172.21.15.83:0/336072686 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6904100a70 0x7f6904068f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:12.273 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.272+0000 7f6909243700 1 --2- 172.21.15.83:0/336072686 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6904105d50 0x7f6904106130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:12.273 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.272+0000 7f6909243700 1 --2- 172.21.15.83:0/336072686 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f69041000b0 0x7f6904100530 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:12.273 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.272+0000 7f6909243700 1 -- 172.21.15.83:0/336072686 >> 172.21.15.83:0/336072686 conn(0x7f6904076a20 msgr2=0x7f6904076e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:58:12.277 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.273+0000 7f6909243700 1 -- 172.21.15.83:0/336072686 shutdown_connections 2024-04-01T06:58:12.277 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.273+0000 7f6909243700 1 -- 172.21.15.83:0/336072686 wait complete. 2024-04-01T06:58:12.277 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.274+0000 7f6909243700 1 Processor -- start 2024-04-01T06:58:12.277 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.275+0000 7f6909243700 1 -- start start 2024-04-01T06:58:12.277 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.275+0000 7f6909243700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69041000b0 0x7f6904199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:12.278 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.275+0000 7f6909243700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6904100a70 0x7f69041997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:12.278 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.275+0000 7f6909243700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6904105d50 0x7f690419db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:12.278 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.275+0000 7f6909243700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f690419e160 con 0x7f6904105d50 2024-04-01T06:58:12.278 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.275+0000 7f6909243700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f690419e2d0 con 0x7f6904100a70 2024-04-01T06:58:12.278 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.275+0000 7f6909243700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f690419e490 con 0x7f69041000b0 2024-04-01T06:58:12.278 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.275+0000 7f690359e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6904105d50 0x7f690419db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.275+0000 7f690359e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6904105d50 0x7f690419db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:35532/0 (socket says 172.21.15.83:35532) 2024-04-01T06:58:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.275+0000 7f690359e700 1 -- 172.21.15.83:0/924223097 learned_addr learned my addr 172.21.15.83:0/924223097 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:58:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.276+0000 7f690259c700 1 --2- 172.21.15.83:0/924223097 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6904100a70 0x7f69041997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.276+0000 7f690359e700 1 -- 172.21.15.83:0/924223097 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69041000b0 msgr2=0x7f6904199290 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-01T06:58:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.276+0000 7f690359e700 1 --2- 172.21.15.83:0/924223097 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69041000b0 0x7f6904199290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.276+0000 7f690359e700 1 -- 172.21.15.83:0/924223097 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6904100a70 msgr2=0x7f69041997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:12.280 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.276+0000 7f690359e700 1 --2- 172.21.15.83:0/924223097 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6904100a70 0x7f69041997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:12.280 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.276+0000 7f690359e700 1 -- 172.21.15.83:0/924223097 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f80095f0 con 0x7f6904105d50 2024-04-01T06:58:12.280 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.276+0000 7f690359e700 1 --2- 172.21.15.83:0/924223097 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6904105d50 0x7f690419db20 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f68fc00ef30 tx=0x7f68fc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:58:12.280 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.276+0000 7f68ebfff700 1 -- 172.21.15.83:0/924223097 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68fc018070 con 0x7f6904105d50 2024-04-01T06:58:12.280 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.277+0000 7f68ebfff700 1 -- 172.21.15.83:0/924223097 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f68fc00f040 con 0x7f6904105d50 2024-04-01T06:58:12.280 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.277+0000 7f68ebfff700 1 -- 172.21.15.83:0/924223097 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68fc00cdb0 con 0x7f6904105d50 2024-04-01T06:58:12.280 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.277+0000 7f6909243700 1 -- 172.21.15.83:0/924223097 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f690419e710 con 0x7f6904105d50 2024-04-01T06:58:12.281 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.277+0000 7f6909243700 1 -- 172.21.15.83:0/924223097 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f690410ede0 con 0x7f6904105d50 2024-04-01T06:58:12.282 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.282+0000 7f69153d9b80 1 Processor -- start 2024-04-01T06:58:12.282 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.282+0000 7f68ebfff700 1 -- 172.21.15.83:0/924223097 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 25) v1 ==== 135996+0+0 (secure 0 0 0) 0x7f68fc003a00 con 0x7f6904105d50 2024-04-01T06:58:12.284 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.283+0000 7f68ebfff700 1 --2- 172.21.15.83:0/924223097 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f68ec0a1390 0x7f68ec0a3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:12.284 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.283+0000 7f69153d9b80 1 -- start start 2024-04-01T06:58:12.284 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.283+0000 7f68ebfff700 1 -- 172.21.15.83:0/924223097 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f68fc0cc880 con 0x7f6904105d50 2024-04-01T06:58:12.284 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.283+0000 7f69153d9b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5641cd471100 0x5641cd4714e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:12.284 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.283+0000 7f69153d9b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5641cd471a20 0x5641cd47c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:12.284 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.283+0000 7f69153d9b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5641cd47c8d0 0x5641cd47ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:12.284 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.283+0000 7f69153d9b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641cd3ca930 con 0x5641cd47c8d0 2024-04-01T06:58:12.284 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.283+0000 7f69153d9b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641cd3c82f0 con 0x5641cd471100 2024-04-01T06:58:12.284 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.283+0000 7f69153d9b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641cd3c3be0 con 0x5641cd471a20 2024-04-01T06:58:12.284 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.283+0000 7f690259c700 1 --2- 172.21.15.83:0/924223097 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f68ec0a1390 0x7f68ec0a3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:12.284 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.283+0000 7f690259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5641cd471a20 0x5641cd47c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:12.285 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.283+0000 7f690259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5641cd471a20 0x5641cd47c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.83:38538/0 (socket says 172.21.15.83:38538) 2024-04-01T06:58:12.285 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.283+0000 7f690259c700 1 -- 172.21.15.83:0/3392535341 learned_addr learned my addr 172.21.15.83:0/3392535341 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:58:12.285 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.283+0000 7f6902d9d700 1 --2- 172.21.15.83:0/3392535341 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5641cd471100 0x5641cd4714e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:12.285 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.283+0000 7f690259c700 1 --2- 172.21.15.83:0/924223097 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f68ec0a1390 0x7f68ec0a3850 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f68f8005cd0 tx=0x7f68f80053d0 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:58:12.285 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.283+0000 7f690259c700 1 -- 172.21.15.83:0/3392535341 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5641cd471100 msgr2=0x5641cd4714e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:12.285 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.283+0000 7f690259c700 1 --2- 172.21.15.83:0/3392535341 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5641cd471100 0x5641cd4714e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:12.285 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.283+0000 7f690259c700 1 -- 172.21.15.83:0/3392535341 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5641cd47c8d0 msgr2=0x5641cd47ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:12.285 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.283+0000 7f690259c700 1 --2- 172.21.15.83:0/3392535341 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5641cd47c8d0 0x5641cd47ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:12.285 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.283+0000 7f690259c700 1 -- 172.21.15.83:0/3392535341 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5641cd245350 con 0x5641cd471a20 2024-04-01T06:58:12.285 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.284+0000 7f690259c700 1 --2- 172.21.15.83:0/3392535341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5641cd471a20 0x5641cd47c390 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f68f800b6f0 tx=0x7f68f802b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c3809ec55474276 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:58:12.285 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.284+0000 7f68e97fa700 1 -- 172.21.15.83:0/3392535341 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f8004500 con 0x5641cd471a20 2024-04-01T06:58:12.285 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.284+0000 7f68e97fa700 1 -- 172.21.15.83:0/3392535341 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f68f8004b20 con 0x5641cd471a20 2024-04-01T06:58:12.285 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.284+0000 7f68e97fa700 1 -- 172.21.15.83:0/3392535341 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f800fc00 con 0x5641cd471a20 2024-04-01T06:58:12.289 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.285+0000 7f69153d9b80 1 -- 172.21.15.83:0/3392535341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5641cd471a20 msgr2=0x5641cd47c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:12.289 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.285+0000 7f69153d9b80 1 --2- 172.21.15.83:0/3392535341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5641cd471a20 0x5641cd47c390 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f68f800b6f0 tx=0x7f68f802b000 comp rx=0 tx=0).stop 2024-04-01T06:58:12.289 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.285+0000 7f69153d9b80 1 -- 172.21.15.83:0/3392535341 shutdown_connections 2024-04-01T06:58:12.289 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.285+0000 7f69153d9b80 1 --2- 172.21.15.83:0/3392535341 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5641cd47c8d0 0x5641cd47ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:12.289 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.285+0000 7f69153d9b80 1 --2- 172.21.15.83:0/3392535341 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5641cd471100 0x5641cd4714e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:12.289 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.285+0000 7f69153d9b80 1 --2- 172.21.15.83:0/3392535341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5641cd471a20 0x5641cd47c390 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:12.289 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.285+0000 7f69153d9b80 1 -- 172.21.15.83:0/3392535341 >> 172.21.15.83:0/3392535341 conn(0x5641cd3d1640 msgr2=0x5641cd46d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:58:12.290 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.285+0000 7f69153d9b80 1 -- 172.21.15.83:0/3392535341 shutdown_connections 2024-04-01T06:58:12.290 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.285+0000 7f69153d9b80 1 -- 172.21.15.83:0/3392535341 wait complete. 2024-04-01T06:58:12.290 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.285+0000 7f69153d9b80 1 -- start start 2024-04-01T06:58:12.290 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.285+0000 7f69153d9b80 1 Processor -- start 2024-04-01T06:58:12.290 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.285+0000 7f69153d9b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5641cd471100 0x5641cd47c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:12.290 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.286+0000 7f69153d9b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5641cd471a20 0x5641cd4795e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:12.290 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.286+0000 7f69153d9b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5641cd47c8d0 0x5641cd479c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:12.291 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.286+0000 7f69153d9b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641cd35fd20 con 0x5641cd471100 2024-04-01T06:58:12.291 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.286+0000 7f69153d9b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641cd35f9c0 con 0x5641cd47c8d0 2024-04-01T06:58:12.291 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.286+0000 7f69153d9b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641cd247640 con 0x5641cd471a20 2024-04-01T06:58:12.291 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.286+0000 7f69153d9b80 10 client.0 _ll_register_callbacks cb 0x5641cd369410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:58:12.291 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.286+0000 7f6902d9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5641cd471100 0x5641cd47c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:12.291 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.286+0000 7f6902d9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5641cd471100 0x5641cd47c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:35556/0 (socket says 172.21.15.83:35556) 2024-04-01T06:58:12.291 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.286+0000 7f6902d9d700 1 -- 172.21.15.83:0/2946177122 learned_addr learned my addr 172.21.15.83:0/2946177122 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:58:12.291 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.286+0000 7f690259c700 1 --2- 172.21.15.83:0/2946177122 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5641cd471a20 0x5641cd4795e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:12.291 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.286+0000 7f690359e700 1 --2- 172.21.15.83:0/2946177122 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5641cd47c8d0 0x5641cd479c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:12.291 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.286+0000 7f6902d9d700 1 -- 172.21.15.83:0/2946177122 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5641cd471a20 msgr2=0x5641cd4795e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:12.291 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.286+0000 7f6902d9d700 1 --2- 172.21.15.83:0/2946177122 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5641cd471a20 0x5641cd4795e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:12.291 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.286+0000 7f6902d9d700 1 -- 172.21.15.83:0/2946177122 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5641cd47c8d0 msgr2=0x5641cd479c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:12.291 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.286+0000 7f6902d9d700 1 --2- 172.21.15.83:0/2946177122 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5641cd47c8d0 0x5641cd479c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:12.292 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.286+0000 7f6902d9d700 1 -- 172.21.15.83:0/2946177122 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68f8020040 con 0x5641cd471100 2024-04-01T06:58:12.292 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.286+0000 7f6902d9d700 1 --2- 172.21.15.83:0/2946177122 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5641cd471100 0x5641cd47c2f0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f68f40116f0 tx=0x7f68f4011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f69ebdf08525174 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:58:12.292 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.286+0000 7f68e6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:58:12.292 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.287+0000 7f68e6ff5700 1 -- 172.21.15.83:0/2946177122 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f4004020 con 0x5641cd471100 2024-04-01T06:58:12.292 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.287+0000 7f68e6ff5700 1 -- 172.21.15.83:0/2946177122 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f68f4004180 con 0x5641cd471100 2024-04-01T06:58:12.292 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.287+0000 7f69153d9b80 1 -- 172.21.15.83:0/2946177122 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5641cd384320 con 0x5641cd471100 2024-04-01T06:58:12.292 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.287+0000 7f68e6ff5700 1 -- 172.21.15.83:0/2946177122 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68f4004380 con 0x5641cd471100 2024-04-01T06:58:12.292 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.287+0000 7f69153d9b80 10 client.16110 fetch_fsmap learned FSMap version 29 2024-04-01T06:58:12.292 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.287+0000 7f69153d9b80 1 -- 172.21.15.83:0/2946177122 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5641cd1f1b00 con 0x5641cd471100 2024-04-01T06:58:12.292 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.287+0000 7f68e6ff5700 1 -- 172.21.15.83:0/2946177122 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5641cd384320 con 0x5641cd471100 2024-04-01T06:58:12.292 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.287+0000 7f68e6ff5700 1 -- 172.21.15.83:0/2946177122 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 29) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f68f4020020 con 0x5641cd471100 2024-04-01T06:58:12.292 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.287+0000 7f69153d9b80 10 client.16110 fetch_fsmap finished waiting for FSMap version 29 2024-04-01T06:58:12.292 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.287+0000 7f69153d9b80 10 client.16110 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-01T06:58:12.292 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.287+0000 7f69153d9b80 20 client.16110 populate_metadata read hostname 'smithi083' 2024-04-01T06:58:12.293 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.287+0000 7f69153d9b80 1 --2- 172.21.15.83:0/2946177122 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5641cd48c4b0 0x5641cd48e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:12.293 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.287+0000 7f69153d9b80 4 client.16110 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-01T06:58:12.293 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.287+0000 7f69153d9b80 1 -- 172.21.15.83:0/2946177122 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5641cd3bc6a0 con 0x5641cd48c4b0 2024-04-01T06:58:12.293 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.288+0000 7f690259c700 1 --2- 172.21.15.83:0/2946177122 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5641cd48c4b0 0x5641cd48e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:12.293 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.288+0000 7f68e6ff5700 10 client.16110 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:58:12.293 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.288+0000 7f690259c700 1 --2- 172.21.15.83:0/2946177122 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5641cd48c4b0 0x5641cd48e8d0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71f7582c839fff82 server_cookie=aaadbcd7bddd990e in_seq=0 out_seq=0 2024-04-01T06:58:12.293 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.288+0000 7f68e6ff5700 1 -- 172.21.15.83:0/2946177122 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5641cd3bc6a0 con 0x5641cd48c4b0 2024-04-01T06:58:12.293 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.288+0000 7f68e6ff5700 10 client.16110 handle_command_reply: tid=0 2024-04-01T06:58:12.293 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.288+0000 7f69153d9b80 1 client.16110 shutdown 2024-04-01T06:58:12.293 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.289+0000 7f69153d9b80 1 -- 172.21.15.83:0/2946177122 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5641cd471100 msgr2=0x5641cd47c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:12.293 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.289+0000 7f69153d9b80 1 --2- 172.21.15.83:0/2946177122 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5641cd471100 0x5641cd47c2f0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f68f40116f0 tx=0x7f68f4011a00 comp rx=0 tx=0).stop 2024-04-01T06:58:12.293 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.289+0000 7f69153d9b80 1 -- 172.21.15.83:0/2946177122 shutdown_connections 2024-04-01T06:58:12.294 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.289+0000 7f69153d9b80 1 --2- 172.21.15.83:0/2946177122 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5641cd48c4b0 0x5641cd48e8d0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:12.294 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.289+0000 7f69153d9b80 1 --2- 172.21.15.83:0/2946177122 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5641cd471100 0x5641cd47c2f0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:12.294 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.289+0000 7f68e6ff5700 0 client.16110 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:58:12.294 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.289+0000 7f69153d9b80 1 --2- 172.21.15.83:0/2946177122 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5641cd47c8d0 0x5641cd479c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:12.294 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.289+0000 7f69153d9b80 1 --2- 172.21.15.83:0/2946177122 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5641cd471a20 0x5641cd4795e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:12.294 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.289+0000 7f69153d9b80 1 -- 172.21.15.83:0/2946177122 >> 172.21.15.83:0/2946177122 conn(0x5641cd3d1640 msgr2=0x5641cd4730a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:58:12.294 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.289+0000 7f69153d9b80 1 -- 172.21.15.83:0/2946177122 shutdown_connections 2024-04-01T06:58:12.294 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.289+0000 7f69153d9b80 1 -- 172.21.15.83:0/2946177122 wait complete. 2024-04-01T06:58:12.294 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.289+0000 7f69153d9b80 20 client.16110 trim_cache size 0 max 16384 2024-04-01T06:58:12.308 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.303+0000 7f69153d9b80 1 Processor -- start 2024-04-01T06:58:12.308 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.303+0000 7f69153d9b80 1 -- start start 2024-04-01T06:58:12.308 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.303+0000 7f69153d9b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5641cd471100 0x5641cd4795a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:12.308 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.303+0000 7f69153d9b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5641cd471a20 0x5641cd4883a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:12.308 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.303+0000 7f69153d9b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5641cd47c8d0 0x5641cd467500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:12.308 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.304+0000 7f69153d9b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641cd475440 con 0x5641cd471100 2024-04-01T06:58:12.308 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.304+0000 7f69153d9b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641cd47a4f0 con 0x5641cd47c8d0 2024-04-01T06:58:12.309 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.304+0000 7f69153d9b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641cd47a210 con 0x5641cd471a20 2024-04-01T06:58:12.309 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.304+0000 7f6902d9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5641cd471100 0x5641cd4795a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:12.309 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.304+0000 7f6902d9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5641cd471100 0x5641cd4795a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:35570/0 (socket says 172.21.15.83:35570) 2024-04-01T06:58:12.309 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.304+0000 7f6902d9d700 1 -- 172.21.15.83:0/2101986598 learned_addr learned my addr 172.21.15.83:0/2101986598 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:58:12.309 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.304+0000 7f690359e700 1 --2- 172.21.15.83:0/2101986598 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5641cd47c8d0 0x5641cd467500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:12.309 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.304+0000 7f690259c700 1 --2- 172.21.15.83:0/2101986598 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5641cd471a20 0x5641cd4883a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:12.309 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.304+0000 7f6902d9d700 1 -- 172.21.15.83:0/2101986598 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5641cd471a20 msgr2=0x5641cd4883a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:12.309 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.304+0000 7f6902d9d700 1 --2- 172.21.15.83:0/2101986598 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5641cd471a20 0x5641cd4883a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:12.309 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.304+0000 7f6902d9d700 1 -- 172.21.15.83:0/2101986598 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5641cd47c8d0 msgr2=0x5641cd467500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:12.309 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.304+0000 7f6902d9d700 1 --2- 172.21.15.83:0/2101986598 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5641cd47c8d0 0x5641cd467500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:12.309 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.304+0000 7f6902d9d700 1 -- 172.21.15.83:0/2101986598 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5641cd389e40 con 0x5641cd471100 2024-04-01T06:58:12.309 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.304+0000 7f690359e700 1 --2- 172.21.15.83:0/2101986598 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5641cd47c8d0 0x5641cd467500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:58:12.310 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.304+0000 7f6902d9d700 1 --2- 172.21.15.83:0/2101986598 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5641cd471100 0x5641cd4795a0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f68f40116c0 tx=0x7f68f4009350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60c30554c41b736c server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:58:12.310 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.304+0000 7f68e9ffb700 1 -- 172.21.15.83:0/2101986598 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f400ea60 con 0x5641cd471100 2024-04-01T06:58:12.310 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.304+0000 7f68e9ffb700 1 -- 172.21.15.83:0/2101986598 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f68f400ebc0 con 0x5641cd471100 2024-04-01T06:58:12.310 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.304+0000 7f68e9ffb700 1 -- 172.21.15.83:0/2101986598 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f40055f0 con 0x5641cd471100 2024-04-01T06:58:12.311 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.305+0000 7f69153d9b80 1 -- 172.21.15.83:0/2101986598 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5641cd471100 msgr2=0x5641cd4795a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:12.311 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.305+0000 7f69153d9b80 1 --2- 172.21.15.83:0/2101986598 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5641cd471100 0x5641cd4795a0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f68f40116c0 tx=0x7f68f4009350 comp rx=0 tx=0).stop 2024-04-01T06:58:12.311 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.305+0000 7f69153d9b80 1 -- 172.21.15.83:0/2101986598 shutdown_connections 2024-04-01T06:58:12.311 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.305+0000 7f69153d9b80 1 --2- 172.21.15.83:0/2101986598 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5641cd471100 0x5641cd4795a0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:12.311 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.305+0000 7f69153d9b80 1 --2- 172.21.15.83:0/2101986598 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5641cd47c8d0 0x5641cd467500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:12.311 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.305+0000 7f69153d9b80 1 --2- 172.21.15.83:0/2101986598 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5641cd471a20 0x5641cd4883a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:12.311 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.305+0000 7f69153d9b80 1 -- 172.21.15.83:0/2101986598 >> 172.21.15.83:0/2101986598 conn(0x5641cd3d1640 msgr2=0x5641cd478e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:58:12.311 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.305+0000 7f69153d9b80 1 -- 172.21.15.83:0/2101986598 shutdown_connections 2024-04-01T06:58:12.311 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.305+0000 7f69153d9b80 1 -- 172.21.15.83:0/2101986598 wait complete. 2024-04-01T06:58:12.311 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.305+0000 7f69153d9b80 1 -- start start 2024-04-01T06:58:12.311 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.305+0000 7f69153d9b80 1 Processor -- start 2024-04-01T06:58:12.311 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.306+0000 7f69153d9b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5641cd471100 0x5641cd4828f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:12.311 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.306+0000 7f69153d9b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5641cd471a20 0x5641cd482e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:12.311 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.306+0000 7f69153d9b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5641cd47c8d0 0x5641cd4df2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:12.312 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.306+0000 7f69153d9b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641cd4df7e0 con 0x5641cd47c8d0 2024-04-01T06:58:12.312 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.306+0000 7f69153d9b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641cd4df920 con 0x5641cd471a20 2024-04-01T06:58:12.312 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.306+0000 7f69153d9b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641cd4dfa60 con 0x5641cd471100 2024-04-01T06:58:12.312 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.306+0000 7f69153d9b80 10 client.0 _ll_register_callbacks cb 0x5641cd369410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:58:12.312 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.306+0000 7f690359e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5641cd47c8d0 0x5641cd4df2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:12.312 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.306+0000 7f690359e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5641cd47c8d0 0x5641cd4df2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:35574/0 (socket says 172.21.15.83:35574) 2024-04-01T06:58:12.312 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.306+0000 7f690359e700 1 -- 172.21.15.83:0/2357507238 learned_addr learned my addr 172.21.15.83:0/2357507238 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:58:12.312 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.306+0000 7f690259c700 1 --2- 172.21.15.83:0/2357507238 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5641cd471a20 0x5641cd482e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:12.312 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.306+0000 7f6902d9d700 1 --2- 172.21.15.83:0/2357507238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5641cd471100 0x5641cd4828f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:12.312 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.306+0000 7f690359e700 1 -- 172.21.15.83:0/2357507238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5641cd471100 msgr2=0x5641cd4828f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:12.312 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.306+0000 7f690359e700 1 --2- 172.21.15.83:0/2357507238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5641cd471100 0x5641cd4828f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:12.312 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.306+0000 7f690359e700 1 -- 172.21.15.83:0/2357507238 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5641cd471a20 msgr2=0x5641cd482e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:12.312 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.306+0000 7f690359e700 1 --2- 172.21.15.83:0/2357507238 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5641cd471a20 0x5641cd482e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:12.313 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.306+0000 7f690359e700 1 -- 172.21.15.83:0/2357507238 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5641cd1f1b00 con 0x5641cd47c8d0 2024-04-01T06:58:12.313 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.306+0000 7f6902d9d700 1 --2- 172.21.15.83:0/2357507238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5641cd471100 0x5641cd4828f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:58:12.313 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.306+0000 7f690359e700 1 --2- 172.21.15.83:0/2357507238 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5641cd47c8d0 0x5641cd4df2a0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f68fc0090a0 tx=0x7f68fc099470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e27e8f803c29d0c server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:58:12.313 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.306+0000 7f68e6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:58:12.313 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.306+0000 7f68e6ff5700 1 -- 172.21.15.83:0/2357507238 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68fc09a120 con 0x5641cd47c8d0 2024-04-01T06:58:12.313 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.306+0000 7f68e6ff5700 1 -- 172.21.15.83:0/2357507238 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f68fc099a20 con 0x5641cd47c8d0 2024-04-01T06:58:12.313 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.306+0000 7f69153d9b80 1 -- 172.21.15.83:0/2357507238 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f68f8004b20 con 0x5641cd47c8d0 2024-04-01T06:58:12.313 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.307+0000 7f68e6ff5700 1 -- 172.21.15.83:0/2357507238 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68fc09d850 con 0x5641cd47c8d0 2024-04-01T06:58:12.313 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.307+0000 7f69153d9b80 10 client.16116 fetch_fsmap learned FSMap version 29 2024-04-01T06:58:12.313 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.307+0000 7f69153d9b80 1 -- 172.21.15.83:0/2357507238 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5641cd249c70 con 0x5641cd47c8d0 2024-04-01T06:58:12.313 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.307+0000 7f68e6ff5700 1 -- 172.21.15.83:0/2357507238 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f68fc0b6070 con 0x5641cd47c8d0 2024-04-01T06:58:12.313 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.307+0000 7f68e6ff5700 1 -- 172.21.15.83:0/2357507238 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 29) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f68fc0a1980 con 0x5641cd47c8d0 2024-04-01T06:58:12.313 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.307+0000 7f69153d9b80 10 client.16116 fetch_fsmap finished waiting for FSMap version 29 2024-04-01T06:58:12.314 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.307+0000 7f69153d9b80 10 client.16116 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-01T06:58:12.314 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.307+0000 7f69153d9b80 20 client.16116 populate_metadata read hostname 'smithi083' 2024-04-01T06:58:12.314 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.307+0000 7f69153d9b80 1 --2- 172.21.15.83:0/2357507238 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5641cd4e1200 0x5641cd4e3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:12.314 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.307+0000 7f69153d9b80 4 client.16116 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-01T06:58:12.314 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.307+0000 7f69153d9b80 1 -- 172.21.15.83:0/2357507238 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5641cd212c90 con 0x5641cd4e1200 2024-04-01T06:58:12.314 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.307+0000 7f6902d9d700 1 --2- 172.21.15.83:0/2357507238 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5641cd4e1200 0x5641cd4e3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:12.314 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.308+0000 7f68e6ff5700 10 client.16116 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:58:12.314 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.308+0000 7f6902d9d700 1 --2- 172.21.15.83:0/2357507238 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5641cd4e1200 0x5641cd4e3620 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e10e175ec40bd5cd server_cookie=beaa284aafd0d772 in_seq=0 out_seq=0 2024-04-01T06:58:12.347 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.345+0000 7f68e6ff5700 1 -- 172.21.15.83:0/2357507238 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5641cd212c90 con 0x5641cd4e1200 2024-04-01T06:58:12.347 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.345+0000 7f68e6ff5700 10 client.16116 handle_command_reply: tid=0 2024-04-01T06:58:12.347 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.345+0000 7f69153d9b80 1 client.16116 shutdown 2024-04-01T06:58:12.348 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.346+0000 7f69153d9b80 1 -- 172.21.15.83:0/2357507238 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5641cd47c8d0 msgr2=0x5641cd4df2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:12.348 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.346+0000 7f69153d9b80 1 --2- 172.21.15.83:0/2357507238 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5641cd47c8d0 0x5641cd4df2a0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f68fc0090a0 tx=0x7f68fc099470 comp rx=0 tx=0).stop 2024-04-01T06:58:12.348 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.346+0000 7f69153d9b80 1 -- 172.21.15.83:0/2357507238 shutdown_connections 2024-04-01T06:58:12.348 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.346+0000 7f69153d9b80 1 --2- 172.21.15.83:0/2357507238 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5641cd4e1200 0x5641cd4e3620 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:12.348 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.346+0000 7f69153d9b80 1 --2- 172.21.15.83:0/2357507238 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5641cd47c8d0 0x5641cd4df2a0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:12.348 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.346+0000 7f69153d9b80 1 --2- 172.21.15.83:0/2357507238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5641cd471100 0x5641cd4828f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:12.349 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.346+0000 7f69153d9b80 1 --2- 172.21.15.83:0/2357507238 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5641cd471a20 0x5641cd482e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:12.349 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.346+0000 7f68e6ff5700 0 client.16116 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:58:12.349 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.346+0000 7f69153d9b80 1 -- 172.21.15.83:0/2357507238 >> 172.21.15.83:0/2357507238 conn(0x5641cd3d1640 msgr2=0x5641cd46cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:58:12.349 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.346+0000 7f69153d9b80 1 -- 172.21.15.83:0/2357507238 shutdown_connections 2024-04-01T06:58:12.349 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.346+0000 7f69153d9b80 1 -- 172.21.15.83:0/2357507238 wait complete. 2024-04-01T06:58:12.349 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.346+0000 7f69153d9b80 20 client.16116 trim_cache size 0 max 16384 2024-04-01T06:58:12.350 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout:{ 2024-04-01T06:58:12.350 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout: "message": "", 2024-04-01T06:58:12.350 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout: "return_code": 0 2024-04-01T06:58:12.350 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout:} 2024-04-01T06:58:12.351 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.346+0000 7f6909243700 1 -- 172.21.15.83:0/924223097 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f68ec0a1390 msgr2=0x7f68ec0a3850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:12.351 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.346+0000 7f6909243700 1 --2- 172.21.15.83:0/924223097 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f68ec0a1390 0x7f68ec0a3850 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f68f8005cd0 tx=0x7f68f80053d0 comp rx=0 tx=0).stop 2024-04-01T06:58:12.351 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.346+0000 7f6909243700 1 -- 172.21.15.83:0/924223097 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6904105d50 msgr2=0x7f690419db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:12.351 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.346+0000 7f6909243700 1 --2- 172.21.15.83:0/924223097 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6904105d50 0x7f690419db20 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f68fc00ef30 tx=0x7f68fc00c3a0 comp rx=0 tx=0).stop 2024-04-01T06:58:12.352 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.347+0000 7f6909243700 1 -- 172.21.15.83:0/924223097 shutdown_connections 2024-04-01T06:58:12.352 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.347+0000 7f6909243700 1 --2- 172.21.15.83:0/924223097 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f68ec0a1390 0x7f68ec0a3850 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:12.352 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.347+0000 7f6909243700 1 --2- 172.21.15.83:0/924223097 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6904105d50 0x7f690419db20 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:12.352 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.347+0000 7f6909243700 1 --2- 172.21.15.83:0/924223097 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69041000b0 0x7f6904199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:12.352 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.347+0000 7f6909243700 1 --2- 172.21.15.83:0/924223097 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6904100a70 0x7f69041997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:12.352 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.347+0000 7f6909243700 1 -- 172.21.15.83:0/924223097 >> 172.21.15.83:0/924223097 conn(0x7f6904076a20 msgr2=0x7f6904103770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:58:12.352 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.347+0000 7f6909243700 1 -- 172.21.15.83:0/924223097 shutdown_connections 2024-04-01T06:58:12.353 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:12.347+0000 7f6909243700 1 -- 172.21.15.83:0/924223097 wait complete. 2024-04-01T06:58:13.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:58:12 smithi145 ceph-mon[47816]: pgmap v73: 97 pgs: 97 active+clean; 166 MiB data, 813 MiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 371 KiB/s wr, 98 op/s 2024-04-01T06:58:13.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:58:12 smithi083 ceph-mon[43429]: pgmap v73: 97 pgs: 97 active+clean; 166 MiB data, 813 MiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 371 KiB/s wr, 98 op/s 2024-04-01T06:58:13.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:58:12 smithi153 ceph-mon[48187]: pgmap v73: 97 pgs: 97 active+clean; 166 MiB data, 813 MiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 371 KiB/s wr, 98 op/s 2024-04-01T06:58:15.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:58:14 smithi145 ceph-mon[47816]: pgmap v74: 97 pgs: 97 active+clean; 166 MiB data, 813 MiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 371 KiB/s wr, 98 op/s 2024-04-01T06:58:15.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:58:14 smithi083 ceph-mon[43429]: pgmap v74: 97 pgs: 97 active+clean; 166 MiB data, 813 MiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 371 KiB/s wr, 98 op/s 2024-04-01T06:58:15.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:58:14 smithi153 ceph-mon[48187]: pgmap v74: 97 pgs: 97 active+clean; 166 MiB data, 813 MiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 371 KiB/s wr, 98 op/s 2024-04-01T06:58:17.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:58:16 smithi145 ceph-mon[47816]: pgmap v75: 97 pgs: 97 active+clean; 168 MiB data, 828 MiB used, 1.0 TiB / 1.0 TiB avail; 731 KiB/s rd, 737 KiB/s wr, 183 op/s 2024-04-01T06:58:17.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:58:16 smithi083 ceph-mon[43429]: pgmap v75: 97 pgs: 97 active+clean; 168 MiB data, 828 MiB used, 1.0 TiB / 1.0 TiB avail; 731 KiB/s rd, 737 KiB/s wr, 183 op/s 2024-04-01T06:58:17.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:58:16 smithi153 ceph-mon[48187]: pgmap v75: 97 pgs: 97 active+clean; 168 MiB data, 828 MiB used, 1.0 TiB / 1.0 TiB avail; 731 KiB/s rd, 737 KiB/s wr, 183 op/s 2024-04-01T06:58:19.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:58:18 smithi083 ceph-mon[43429]: pgmap v76: 97 pgs: 97 active+clean; 168 MiB data, 828 MiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 563 KiB/s wr, 114 op/s 2024-04-01T06:58:19.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:58:18 smithi153 ceph-mon[48187]: pgmap v76: 97 pgs: 97 active+clean; 168 MiB data, 828 MiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 563 KiB/s wr, 114 op/s 2024-04-01T06:58:19.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:58:18 smithi145 ceph-mon[47816]: pgmap v76: 97 pgs: 97 active+clean; 168 MiB data, 828 MiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 563 KiB/s wr, 114 op/s 2024-04-01T06:58:21.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:58:20 smithi083 ceph-mon[43429]: pgmap v77: 97 pgs: 97 active+clean; 158 MiB data, 836 MiB used, 1.0 TiB / 1.0 TiB avail; 850 KiB/s rd, 877 KiB/s wr, 172 op/s 2024-04-01T06:58:21.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:58:20 smithi153 ceph-mon[48187]: pgmap v77: 97 pgs: 97 active+clean; 158 MiB data, 836 MiB used, 1.0 TiB / 1.0 TiB avail; 850 KiB/s rd, 877 KiB/s wr, 172 op/s 2024-04-01T06:58:21.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:58:20 smithi145 ceph-mon[47816]: pgmap v77: 97 pgs: 97 active+clean; 158 MiB data, 836 MiB used, 1.0 TiB / 1.0 TiB avail; 850 KiB/s rd, 877 KiB/s wr, 172 op/s 2024-04-01T06:58:23.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:58:22 smithi153 ceph-mon[48187]: pgmap v78: 97 pgs: 97 active+clean; 158 MiB data, 836 MiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 680 KiB/s wr, 142 op/s 2024-04-01T06:58:23.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:58:22 smithi145 ceph-mon[47816]: pgmap v78: 97 pgs: 97 active+clean; 158 MiB data, 836 MiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 680 KiB/s wr, 142 op/s 2024-04-01T06:58:23.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:58:22 smithi083 ceph-mon[43429]: pgmap v78: 97 pgs: 97 active+clean; 158 MiB data, 836 MiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 680 KiB/s wr, 142 op/s 2024-04-01T06:58:25.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:58:24 smithi153 ceph-mon[48187]: pgmap v79: 97 pgs: 97 active+clean; 158 MiB data, 836 MiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 680 KiB/s wr, 142 op/s 2024-04-01T06:58:25.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:58:24 smithi145 ceph-mon[47816]: pgmap v79: 97 pgs: 97 active+clean; 158 MiB data, 836 MiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 680 KiB/s wr, 142 op/s 2024-04-01T06:58:25.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:58:24 smithi083 ceph-mon[43429]: pgmap v79: 97 pgs: 97 active+clean; 158 MiB data, 836 MiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 680 KiB/s wr, 142 op/s 2024-04-01T06:58:25.480 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.475+0000 7f9b5aabd700 1 -- 172.21.15.83:0/2013154819 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9b54106e30 msgr2=0x7f9b54107210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:25.480 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.475+0000 7f9b5aabd700 1 --2- 172.21.15.83:0/2013154819 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9b54106e30 0x7f9b54107210 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f9b480099c0 tx=0x7f9b48009cd0 comp rx=0 tx=0).stop 2024-04-01T06:58:25.481 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.476+0000 7f9b5aabd700 1 -- 172.21.15.83:0/2013154819 shutdown_connections 2024-04-01T06:58:25.481 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.476+0000 7f9b5aabd700 1 --2- 172.21.15.83:0/2013154819 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9b54106e30 0x7f9b54107210 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:25.481 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.476+0000 7f9b5aabd700 1 --2- 172.21.15.83:0/2013154819 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9b540ffbe0 0x7f9b5410dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:25.481 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.476+0000 7f9b5aabd700 1 --2- 172.21.15.83:0/2013154819 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b540ff220 0x7f9b540ff6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:25.481 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.476+0000 7f9b5aabd700 1 -- 172.21.15.83:0/2013154819 >> 172.21.15.83:0/2013154819 conn(0x7f9b540761b0 msgr2=0x7f9b540fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:58:25.481 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.476+0000 7f9b5aabd700 1 -- 172.21.15.83:0/2013154819 shutdown_connections 2024-04-01T06:58:25.481 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.476+0000 7f9b5aabd700 1 -- 172.21.15.83:0/2013154819 wait complete. 2024-04-01T06:58:25.481 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.476+0000 7f9b5aabd700 1 Processor -- start 2024-04-01T06:58:25.481 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.476+0000 7f9b5aabd700 1 -- start start 2024-04-01T06:58:25.481 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.476+0000 7f9b5aabd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b540ff220 0x7f9b541971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:25.481 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.476+0000 7f9b5aabd700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9b540ffbe0 0x7f9b54197720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:25.481 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.476+0000 7f9b5aabd700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9b54106e30 0x7f9b5419ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:25.481 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.476+0000 7f9b5aabd700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5419c090 con 0x7f9b540ffbe0 2024-04-01T06:58:25.482 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.476+0000 7f9b5aabd700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5419c200 con 0x7f9b54106e30 2024-04-01T06:58:25.482 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.476+0000 7f9b5aabd700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5419c3c0 con 0x7f9b540ff220 2024-04-01T06:58:25.482 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.477+0000 7f9b53fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9b540ffbe0 0x7f9b54197720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:25.482 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.477+0000 7f9b53fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9b540ffbe0 0x7f9b54197720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:50270/0 (socket says 172.21.15.83:50270) 2024-04-01T06:58:25.482 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.477+0000 7f9b53fff700 1 -- 172.21.15.83:0/274380025 learned_addr learned my addr 172.21.15.83:0/274380025 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:58:25.482 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.477+0000 7f9b5905a700 1 --2- 172.21.15.83:0/274380025 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9b54106e30 0x7f9b5419ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:25.482 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.477+0000 7f9b58859700 1 --2- 172.21.15.83:0/274380025 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b540ff220 0x7f9b541971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:25.482 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.477+0000 7f9b53fff700 1 -- 172.21.15.83:0/274380025 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b540ff220 msgr2=0x7f9b541971e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:25.482 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.477+0000 7f9b53fff700 1 --2- 172.21.15.83:0/274380025 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b540ff220 0x7f9b541971e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:25.482 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.477+0000 7f9b53fff700 1 -- 172.21.15.83:0/274380025 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9b54106e30 msgr2=0x7f9b5419ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:25.482 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.477+0000 7f9b53fff700 1 --2- 172.21.15.83:0/274380025 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9b54106e30 0x7f9b5419ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:25.482 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.477+0000 7f9b53fff700 1 -- 172.21.15.83:0/274380025 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b480095f0 con 0x7f9b540ffbe0 2024-04-01T06:58:25.482 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.477+0000 7f9b53fff700 1 --2- 172.21.15.83:0/274380025 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9b540ffbe0 0x7f9b54197720 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f9b4000c9b0 tx=0x7f9b4000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:58:25.482 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.477+0000 7f9b51ffb700 1 -- 172.21.15.83:0/274380025 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b40007b00 con 0x7f9b540ffbe0 2024-04-01T06:58:25.483 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.477+0000 7f9b51ffb700 1 -- 172.21.15.83:0/274380025 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9b4000ce50 con 0x7f9b540ffbe0 2024-04-01T06:58:25.483 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.477+0000 7f9b5aabd700 1 -- 172.21.15.83:0/274380025 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b5419c6a0 con 0x7f9b540ffbe0 2024-04-01T06:58:25.483 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.477+0000 7f9b51ffb700 1 -- 172.21.15.83:0/274380025 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b40018660 con 0x7f9b540ffbe0 2024-04-01T06:58:25.483 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.477+0000 7f9b5aabd700 1 -- 172.21.15.83:0/274380025 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b541a3ee0 con 0x7f9b540ffbe0 2024-04-01T06:58:25.483 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.479+0000 7f9b51ffb700 1 -- 172.21.15.83:0/274380025 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 25) v1 ==== 135996+0+0 (secure 0 0 0) 0x7f9b4000f450 con 0x7f9b540ffbe0 2024-04-01T06:58:25.483 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.480+0000 7f9b51ffb700 1 --2- 172.21.15.83:0/274380025 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f9b440a1290 0x7f9b440a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:25.483 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.480+0000 7f9b51ffb700 1 -- 172.21.15.83:0/274380025 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f9b400ccbe0 con 0x7f9b540ffbe0 2024-04-01T06:58:25.483 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.480+0000 7f9b58859700 1 --2- 172.21.15.83:0/274380025 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f9b440a1290 0x7f9b440a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:25.490 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.481+0000 7f9b58859700 1 --2- 172.21.15.83:0/274380025 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f9b440a1290 0x7f9b440a3750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9b48009990 tx=0x7f9b48019040 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:58:25.490 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.481+0000 7f9b66c53b80 1 Processor -- start 2024-04-01T06:58:25.490 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.481+0000 7f9b66c53b80 1 -- start start 2024-04-01T06:58:25.490 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.482+0000 7f9b66c53b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5640b9a61100 0x5640b9a614e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:25.490 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.482+0000 7f9b66c53b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5640b9a61a20 0x5640b9a6c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:25.490 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.482+0000 7f9b66c53b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640b9a6c8d0 0x5640b9a6ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:25.490 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.482+0000 7f9b66c53b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640b99ba930 con 0x5640b9a61100 2024-04-01T06:58:25.491 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.482+0000 7f9b66c53b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640b99b82f0 con 0x5640b9a61a20 2024-04-01T06:58:25.491 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.482+0000 7f9b66c53b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640b99b3be0 con 0x5640b9a6c8d0 2024-04-01T06:58:25.491 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.482+0000 7f9b58859700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5640b9a61100 0x5640b9a614e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:25.491 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.482+0000 7f9b58859700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5640b9a61100 0x5640b9a614e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:50276/0 (socket says 172.21.15.83:50276) 2024-04-01T06:58:25.491 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.482+0000 7f9b58859700 1 -- 172.21.15.83:0/956453354 learned_addr learned my addr 172.21.15.83:0/956453354 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:58:25.491 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.482+0000 7f9b53fff700 1 --2- 172.21.15.83:0/956453354 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5640b9a61a20 0x5640b9a6c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:25.491 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.482+0000 7f9b5905a700 1 --2- 172.21.15.83:0/956453354 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640b9a6c8d0 0x5640b9a6ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:25.491 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.482+0000 7f9b58859700 1 -- 172.21.15.83:0/956453354 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640b9a6c8d0 msgr2=0x5640b9a6ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:25.491 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.482+0000 7f9b58859700 1 --2- 172.21.15.83:0/956453354 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640b9a6c8d0 0x5640b9a6ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:25.491 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.482+0000 7f9b58859700 1 -- 172.21.15.83:0/956453354 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5640b9a61a20 msgr2=0x5640b9a6c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:25.491 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.482+0000 7f9b58859700 1 --2- 172.21.15.83:0/956453354 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5640b9a61a20 0x5640b9a6c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:25.491 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.482+0000 7f9b58859700 1 -- 172.21.15.83:0/956453354 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5640b9835350 con 0x5640b9a61100 2024-04-01T06:58:25.491 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.482+0000 7f9b58859700 1 --2- 172.21.15.83:0/956453354 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5640b9a61100 0x5640b9a614e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f9b480099c0 tx=0x7f9b4801f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a75efdc87d55ae54 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:58:25.491 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.482+0000 7f9b3effd700 1 -- 172.21.15.83:0/956453354 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4800fac0 con 0x5640b9a61100 2024-04-01T06:58:25.492 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.482+0000 7f9b3effd700 1 -- 172.21.15.83:0/956453354 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9b4801d040 con 0x5640b9a61100 2024-04-01T06:58:25.492 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.482+0000 7f9b3effd700 1 -- 172.21.15.83:0/956453354 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4802d3f0 con 0x5640b9a61100 2024-04-01T06:58:25.492 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.483+0000 7f9b66c53b80 1 -- 172.21.15.83:0/956453354 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5640b9a61100 msgr2=0x5640b9a614e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:25.492 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.483+0000 7f9b66c53b80 1 --2- 172.21.15.83:0/956453354 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5640b9a61100 0x5640b9a614e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f9b480099c0 tx=0x7f9b4801f000 comp rx=0 tx=0).stop 2024-04-01T06:58:25.492 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.483+0000 7f9b66c53b80 1 -- 172.21.15.83:0/956453354 shutdown_connections 2024-04-01T06:58:25.492 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.483+0000 7f9b66c53b80 1 --2- 172.21.15.83:0/956453354 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5640b9a61100 0x5640b9a614e0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:25.492 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.483+0000 7f9b66c53b80 1 --2- 172.21.15.83:0/956453354 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640b9a6c8d0 0x5640b9a6ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:25.492 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.483+0000 7f9b66c53b80 1 --2- 172.21.15.83:0/956453354 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5640b9a61a20 0x5640b9a6c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:25.492 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.483+0000 7f9b66c53b80 1 -- 172.21.15.83:0/956453354 >> 172.21.15.83:0/956453354 conn(0x5640b99c1640 msgr2=0x5640b9a5d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:58:25.492 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.483+0000 7f9b66c53b80 1 -- 172.21.15.83:0/956453354 shutdown_connections 2024-04-01T06:58:25.492 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.483+0000 7f9b66c53b80 1 -- 172.21.15.83:0/956453354 wait complete. 2024-04-01T06:58:25.492 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.483+0000 7f9b66c53b80 1 -- start start 2024-04-01T06:58:25.492 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.484+0000 7f9b66c53b80 1 Processor -- start 2024-04-01T06:58:25.492 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.484+0000 7f9b66c53b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5640b9a61100 0x5640b9a6c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:25.492 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.484+0000 7f9b66c53b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5640b9a61a20 0x5640b9a695d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:25.493 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.484+0000 7f9b66c53b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640b9a6c8d0 0x5640b9a69c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:25.493 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.484+0000 7f9b66c53b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640b994fd20 con 0x5640b9a61100 2024-04-01T06:58:25.493 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.484+0000 7f9b66c53b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640b994f9c0 con 0x5640b9a61a20 2024-04-01T06:58:25.493 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.484+0000 7f9b66c53b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640b9837640 con 0x5640b9a6c8d0 2024-04-01T06:58:25.493 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.484+0000 7f9b66c53b80 10 client.0 _ll_register_callbacks cb 0x5640b9959410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:58:25.493 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.484+0000 7f9b58859700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5640b9a61100 0x5640b9a6c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:25.493 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.484+0000 7f9b58859700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5640b9a61100 0x5640b9a6c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:50292/0 (socket says 172.21.15.83:50292) 2024-04-01T06:58:25.493 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.484+0000 7f9b58859700 1 -- 172.21.15.83:0/338522783 learned_addr learned my addr 172.21.15.83:0/338522783 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:58:25.493 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.484+0000 7f9b53fff700 1 --2- 172.21.15.83:0/338522783 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5640b9a61a20 0x5640b9a695d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:25.493 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.484+0000 7f9b5905a700 1 --2- 172.21.15.83:0/338522783 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640b9a6c8d0 0x5640b9a69c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:25.493 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.484+0000 7f9b58859700 1 -- 172.21.15.83:0/338522783 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640b9a6c8d0 msgr2=0x5640b9a69c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:25.493 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.484+0000 7f9b58859700 1 --2- 172.21.15.83:0/338522783 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640b9a6c8d0 0x5640b9a69c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:25.494 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.484+0000 7f9b58859700 1 -- 172.21.15.83:0/338522783 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5640b9a61a20 msgr2=0x5640b9a695d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:25.494 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.484+0000 7f9b58859700 1 --2- 172.21.15.83:0/338522783 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5640b9a61a20 0x5640b9a695d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:25.494 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.484+0000 7f9b58859700 1 -- 172.21.15.83:0/338522783 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b5410e4f0 con 0x5640b9a61100 2024-04-01T06:58:25.494 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.484+0000 7f9b5905a700 1 --2- 172.21.15.83:0/338522783 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640b9a6c8d0 0x5640b9a69c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:58:25.494 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.485+0000 7f9b58859700 1 --2- 172.21.15.83:0/338522783 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5640b9a61100 0x5640b9a6c290 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f9b48023a90 tx=0x7f9b4800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bc72acb727aeca8 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:58:25.494 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.485+0000 7f9b33fff700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:58:25.494 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.485+0000 7f9b33fff700 1 -- 172.21.15.83:0/338522783 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b480236f0 con 0x5640b9a61100 2024-04-01T06:58:25.494 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.485+0000 7f9b33fff700 1 -- 172.21.15.83:0/338522783 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f9b48023850 con 0x5640b9a61100 2024-04-01T06:58:25.494 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.485+0000 7f9b66c53b80 1 -- 172.21.15.83:0/338522783 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5640b9974320 con 0x5640b9a61100 2024-04-01T06:58:25.494 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.485+0000 7f9b33fff700 1 -- 172.21.15.83:0/338522783 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b4800f8c0 con 0x5640b9a61100 2024-04-01T06:58:25.494 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.485+0000 7f9b66c53b80 10 client.16128 fetch_fsmap learned FSMap version 29 2024-04-01T06:58:25.494 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.485+0000 7f9b66c53b80 1 -- 172.21.15.83:0/338522783 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5640b97e1b00 con 0x5640b9a61100 2024-04-01T06:58:25.494 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.485+0000 7f9b33fff700 1 -- 172.21.15.83:0/338522783 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5640b9974320 con 0x5640b9a61100 2024-04-01T06:58:25.494 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.485+0000 7f9b33fff700 1 -- 172.21.15.83:0/338522783 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 29) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f9b48047020 con 0x5640b9a61100 2024-04-01T06:58:25.495 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.485+0000 7f9b66c53b80 10 client.16128 fetch_fsmap finished waiting for FSMap version 29 2024-04-01T06:58:25.495 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.485+0000 7f9b66c53b80 10 client.16128 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-01T06:58:25.495 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.485+0000 7f9b66c53b80 20 client.16128 populate_metadata read hostname 'smithi083' 2024-04-01T06:58:25.495 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.485+0000 7f9b66c53b80 1 --2- 172.21.15.83:0/338522783 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5640b9a7bff0 0x5640b9a7e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:25.495 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.485+0000 7f9b66c53b80 4 client.16128 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-01T06:58:25.495 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.485+0000 7f9b66c53b80 1 -- 172.21.15.83:0/338522783 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5640b99ac6a0 con 0x5640b9a7bff0 2024-04-01T06:58:25.495 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.485+0000 7f9b53fff700 1 --2- 172.21.15.83:0/338522783 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5640b9a7bff0 0x5640b9a7e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:25.495 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.486+0000 7f9b33fff700 10 client.16128 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:58:25.495 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.486+0000 7f9b53fff700 1 --2- 172.21.15.83:0/338522783 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5640b9a7bff0 0x5640b9a7e3e0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96b05b50cdb73e87 server_cookie=31db75efb6ca5c2b in_seq=0 out_seq=0 2024-04-01T06:58:25.495 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.486+0000 7f9b33fff700 1 -- 172.21.15.83:0/338522783 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5640b99ac6a0 con 0x5640b9a7bff0 2024-04-01T06:58:25.495 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.486+0000 7f9b33fff700 10 client.16128 handle_command_reply: tid=0 2024-04-01T06:58:25.495 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.486+0000 7f9b66c53b80 1 client.16128 shutdown 2024-04-01T06:58:25.495 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.486+0000 7f9b66c53b80 1 -- 172.21.15.83:0/338522783 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5640b9a61100 msgr2=0x5640b9a6c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:25.495 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.486+0000 7f9b66c53b80 1 --2- 172.21.15.83:0/338522783 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5640b9a61100 0x5640b9a6c290 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f9b48023a90 tx=0x7f9b4800be60 comp rx=0 tx=0).stop 2024-04-01T06:58:25.496 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.486+0000 7f9b66c53b80 1 -- 172.21.15.83:0/338522783 shutdown_connections 2024-04-01T06:58:25.496 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.486+0000 7f9b66c53b80 1 --2- 172.21.15.83:0/338522783 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5640b9a7bff0 0x5640b9a7e3e0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:25.496 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.486+0000 7f9b66c53b80 1 --2- 172.21.15.83:0/338522783 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5640b9a61100 0x5640b9a6c290 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:25.496 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.486+0000 7f9b33fff700 0 client.16128 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:58:25.496 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.486+0000 7f9b66c53b80 1 --2- 172.21.15.83:0/338522783 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640b9a6c8d0 0x5640b9a69c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:25.496 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.486+0000 7f9b66c53b80 1 --2- 172.21.15.83:0/338522783 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5640b9a61a20 0x5640b9a695d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:25.496 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.486+0000 7f9b66c53b80 1 -- 172.21.15.83:0/338522783 >> 172.21.15.83:0/338522783 conn(0x5640b99c1640 msgr2=0x5640b9a63080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:58:25.496 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.487+0000 7f9b66c53b80 1 -- 172.21.15.83:0/338522783 shutdown_connections 2024-04-01T06:58:25.496 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.487+0000 7f9b66c53b80 1 -- 172.21.15.83:0/338522783 wait complete. 2024-04-01T06:58:25.496 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.487+0000 7f9b66c53b80 20 client.16128 trim_cache size 0 max 16384 2024-04-01T06:58:25.506 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.501+0000 7f9b66c53b80 1 Processor -- start 2024-04-01T06:58:25.506 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.502+0000 7f9b66c53b80 1 -- start start 2024-04-01T06:58:25.506 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.502+0000 7f9b66c53b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5640b9a61100 0x5640b9a69c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:25.506 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.502+0000 7f9b66c53b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5640b9a61a20 0x5640b9a64050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:25.506 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.502+0000 7f9b66c53b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640b9a6c8d0 0x5640b9a73540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:25.506 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.502+0000 7f9b66c53b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640b9a6a520 con 0x5640b9a61a20 2024-04-01T06:58:25.506 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.502+0000 7f9b66c53b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640b9a59400 con 0x5640b9a61100 2024-04-01T06:58:25.506 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.502+0000 7f9b66c53b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640b9a73a80 con 0x5640b9a6c8d0 2024-04-01T06:58:25.506 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.502+0000 7f9b53fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5640b9a61a20 0x5640b9a64050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:25.506 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.502+0000 7f9b53fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5640b9a61a20 0x5640b9a64050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:50306/0 (socket says 172.21.15.83:50306) 2024-04-01T06:58:25.507 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.502+0000 7f9b53fff700 1 -- 172.21.15.83:0/4215555712 learned_addr learned my addr 172.21.15.83:0/4215555712 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:58:25.507 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.502+0000 7f9b58859700 1 --2- 172.21.15.83:0/4215555712 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5640b9a61100 0x5640b9a69c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:25.507 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.502+0000 7f9b5905a700 1 --2- 172.21.15.83:0/4215555712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640b9a6c8d0 0x5640b9a73540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:25.507 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.502+0000 7f9b53fff700 1 -- 172.21.15.83:0/4215555712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640b9a6c8d0 msgr2=0x5640b9a73540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:25.507 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.502+0000 7f9b53fff700 1 --2- 172.21.15.83:0/4215555712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640b9a6c8d0 0x5640b9a73540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:25.507 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.502+0000 7f9b53fff700 1 -- 172.21.15.83:0/4215555712 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5640b9a61100 msgr2=0x5640b9a69c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:25.507 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.502+0000 7f9b53fff700 1 --2- 172.21.15.83:0/4215555712 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5640b9a61100 0x5640b9a69c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:25.507 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.502+0000 7f9b53fff700 1 -- 172.21.15.83:0/4215555712 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5640b9979e40 con 0x5640b9a61a20 2024-04-01T06:58:25.507 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.502+0000 7f9b53fff700 1 --2- 172.21.15.83:0/4215555712 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5640b9a61a20 0x5640b9a64050 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f9b400074a0 tx=0x7f9b4009c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a86f4cf5a4aa7ff server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:58:25.507 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.502+0000 7f9b3f7fe700 1 -- 172.21.15.83:0/4215555712 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b40007c60 con 0x5640b9a61a20 2024-04-01T06:58:25.507 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.502+0000 7f9b3f7fe700 1 -- 172.21.15.83:0/4215555712 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9b400b6070 con 0x5640b9a61a20 2024-04-01T06:58:25.507 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.502+0000 7f9b3f7fe700 1 -- 172.21.15.83:0/4215555712 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4000f700 con 0x5640b9a61a20 2024-04-01T06:58:25.507 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.503+0000 7f9b66c53b80 1 -- 172.21.15.83:0/4215555712 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5640b9a61a20 msgr2=0x5640b9a64050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:25.507 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.503+0000 7f9b66c53b80 1 --2- 172.21.15.83:0/4215555712 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5640b9a61a20 0x5640b9a64050 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f9b400074a0 tx=0x7f9b4009c040 comp rx=0 tx=0).stop 2024-04-01T06:58:25.508 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.503+0000 7f9b66c53b80 1 -- 172.21.15.83:0/4215555712 shutdown_connections 2024-04-01T06:58:25.508 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.503+0000 7f9b66c53b80 1 --2- 172.21.15.83:0/4215555712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640b9a6c8d0 0x5640b9a73540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:25.508 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.503+0000 7f9b66c53b80 1 --2- 172.21.15.83:0/4215555712 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5640b9a61100 0x5640b9a69c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:25.508 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.503+0000 7f9b66c53b80 1 --2- 172.21.15.83:0/4215555712 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5640b9a61a20 0x5640b9a64050 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:25.508 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.503+0000 7f9b66c53b80 1 -- 172.21.15.83:0/4215555712 >> 172.21.15.83:0/4215555712 conn(0x5640b99c1640 msgr2=0x5640b9a67ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:58:25.508 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.503+0000 7f9b66c53b80 1 -- 172.21.15.83:0/4215555712 shutdown_connections 2024-04-01T06:58:25.508 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.503+0000 7f9b66c53b80 1 -- 172.21.15.83:0/4215555712 wait complete. 2024-04-01T06:58:25.508 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.503+0000 7f9b66c53b80 1 -- start start 2024-04-01T06:58:25.508 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.503+0000 7f9b66c53b80 1 Processor -- start 2024-04-01T06:58:25.508 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.504+0000 7f9b66c53b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640b9a61100 0x5640b9a71710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:25.508 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.504+0000 7f9b66c53b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5640b9a61a20 0x5640b9a71c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:25.508 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.504+0000 7f9b66c53b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5640b9a6c8d0 0x5640b9aced80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:25.508 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.504+0000 7f9b66c53b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640b9a723e0 con 0x5640b9a6c8d0 2024-04-01T06:58:25.508 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.504+0000 7f9b66c53b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640b9acf2f0 con 0x5640b9a61a20 2024-04-01T06:58:25.509 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.504+0000 7f9b66c53b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640b9acf4b0 con 0x5640b9a61100 2024-04-01T06:58:25.509 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.504+0000 7f9b66c53b80 10 client.0 _ll_register_callbacks cb 0x5640b9959410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:58:25.509 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.504+0000 7f9b5905a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5640b9a6c8d0 0x5640b9aced80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:25.509 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.504+0000 7f9b5905a700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5640b9a6c8d0 0x5640b9aced80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:50316/0 (socket says 172.21.15.83:50316) 2024-04-01T06:58:25.509 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.504+0000 7f9b5905a700 1 -- 172.21.15.83:0/4143803417 learned_addr learned my addr 172.21.15.83:0/4143803417 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:58:25.509 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.504+0000 7f9b53fff700 1 --2- 172.21.15.83:0/4143803417 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5640b9a61a20 0x5640b9a71c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:25.509 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.504+0000 7f9b58859700 1 --2- 172.21.15.83:0/4143803417 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640b9a61100 0x5640b9a71710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:25.509 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.504+0000 7f9b5905a700 1 -- 172.21.15.83:0/4143803417 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640b9a61100 msgr2=0x5640b9a71710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:25.509 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.504+0000 7f9b5905a700 1 --2- 172.21.15.83:0/4143803417 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640b9a61100 0x5640b9a71710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:25.509 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.504+0000 7f9b5905a700 1 -- 172.21.15.83:0/4143803417 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5640b9a61a20 msgr2=0x5640b9a71c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:25.509 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.504+0000 7f9b5905a700 1 --2- 172.21.15.83:0/4143803417 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5640b9a61a20 0x5640b9a71c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:25.509 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.504+0000 7f9b5905a700 1 -- 172.21.15.83:0/4143803417 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b541a3ee0 con 0x5640b9a6c8d0 2024-04-01T06:58:25.509 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.504+0000 7f9b5905a700 1 --2- 172.21.15.83:0/4143803417 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5640b9a6c8d0 0x5640b9aced80 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c007b30 tx=0x7f9b4c007e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c01afbc156c7c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:58:25.509 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.504+0000 7f9b33fff700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:58:25.510 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.505+0000 7f9b33fff700 1 -- 172.21.15.83:0/4143803417 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c00e040 con 0x5640b9a6c8d0 2024-04-01T06:58:25.510 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.505+0000 7f9b33fff700 1 -- 172.21.15.83:0/4143803417 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f9b4c014cc0 con 0x5640b9a6c8d0 2024-04-01T06:58:25.510 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.505+0000 7f9b66c53b80 1 -- 172.21.15.83:0/4143803417 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9b4801d040 con 0x5640b9a6c8d0 2024-04-01T06:58:25.510 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.505+0000 7f9b33fff700 1 -- 172.21.15.83:0/4143803417 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b4c014ea0 con 0x5640b9a6c8d0 2024-04-01T06:58:25.510 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.505+0000 7f9b66c53b80 10 client.16134 fetch_fsmap learned FSMap version 29 2024-04-01T06:58:25.510 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.505+0000 7f9b66c53b80 1 -- 172.21.15.83:0/4143803417 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5640b9839c70 con 0x5640b9a6c8d0 2024-04-01T06:58:25.510 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.505+0000 7f9b33fff700 1 -- 172.21.15.83:0/4143803417 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9b4801d040 con 0x5640b9a6c8d0 2024-04-01T06:58:25.510 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.505+0000 7f9b33fff700 1 -- 172.21.15.83:0/4143803417 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 29) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f9b4c0164c0 con 0x5640b9a6c8d0 2024-04-01T06:58:25.510 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.505+0000 7f9b66c53b80 10 client.16134 fetch_fsmap finished waiting for FSMap version 29 2024-04-01T06:58:25.510 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.505+0000 7f9b66c53b80 10 client.16134 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-01T06:58:25.511 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.505+0000 7f9b66c53b80 20 client.16134 populate_metadata read hostname 'smithi083' 2024-04-01T06:58:25.511 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.505+0000 7f9b66c53b80 1 --2- 172.21.15.83:0/4143803417 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5640b9ad0d40 0x5640b9ad3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:25.511 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.505+0000 7f9b66c53b80 4 client.16134 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-01T06:58:25.511 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.505+0000 7f9b66c53b80 1 -- 172.21.15.83:0/4143803417 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5640b9802c90 con 0x5640b9ad0d40 2024-04-01T06:58:25.511 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.505+0000 7f9b58859700 1 --2- 172.21.15.83:0/4143803417 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5640b9ad0d40 0x5640b9ad3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:25.511 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.506+0000 7f9b58859700 1 --2- 172.21.15.83:0/4143803417 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5640b9ad0d40 0x5640b9ad3160 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f094f9d1c70b8a5 server_cookie=5adc326471716259 in_seq=0 out_seq=0 2024-04-01T06:58:25.511 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.506+0000 7f9b33fff700 10 client.16134 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:58:25.590 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.590+0000 7f9b33fff700 1 -- 172.21.15.83:0/4143803417 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5640b9802c90 con 0x5640b9ad0d40 2024-04-01T06:58:25.591 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.590+0000 7f9b33fff700 10 client.16134 handle_command_reply: tid=0 2024-04-01T06:58:25.591 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.590+0000 7f9b66c53b80 1 client.16134 shutdown 2024-04-01T06:58:25.591 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.590+0000 7f9b66c53b80 1 -- 172.21.15.83:0/4143803417 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5640b9a6c8d0 msgr2=0x5640b9aced80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:25.591 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.590+0000 7f9b66c53b80 1 --2- 172.21.15.83:0/4143803417 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5640b9a6c8d0 0x5640b9aced80 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c007b30 tx=0x7f9b4c007e40 comp rx=0 tx=0).stop 2024-04-01T06:58:25.591 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.590+0000 7f9b66c53b80 1 -- 172.21.15.83:0/4143803417 shutdown_connections 2024-04-01T06:58:25.591 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.590+0000 7f9b66c53b80 1 --2- 172.21.15.83:0/4143803417 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5640b9ad0d40 0x5640b9ad3160 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:25.591 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.590+0000 7f9b66c53b80 1 --2- 172.21.15.83:0/4143803417 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5640b9a6c8d0 0x5640b9aced80 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:25.591 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.590+0000 7f9b33fff700 0 client.16134 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:58:25.591 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.590+0000 7f9b66c53b80 1 --2- 172.21.15.83:0/4143803417 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5640b9a61100 0x5640b9a71710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:25.591 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.590+0000 7f9b66c53b80 1 --2- 172.21.15.83:0/4143803417 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5640b9a61a20 0x5640b9a71c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:25.591 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.590+0000 7f9b66c53b80 1 -- 172.21.15.83:0/4143803417 >> 172.21.15.83:0/4143803417 conn(0x5640b99c1640 msgr2=0x5640b9a563e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:58:25.591 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.590+0000 7f9b66c53b80 1 -- 172.21.15.83:0/4143803417 shutdown_connections 2024-04-01T06:58:25.591 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.590+0000 7f9b66c53b80 1 -- 172.21.15.83:0/4143803417 wait complete. 2024-04-01T06:58:25.591 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.590+0000 7f9b66c53b80 20 client.16134 trim_cache size 0 max 16384 2024-04-01T06:58:25.592 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout:{ 2024-04-01T06:58:25.592 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout: "message": "", 2024-04-01T06:58:25.592 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout: "return_code": 0 2024-04-01T06:58:25.592 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout:} 2024-04-01T06:58:25.593 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.591+0000 7f9b5aabd700 1 -- 172.21.15.83:0/274380025 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f9b440a1290 msgr2=0x7f9b440a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:25.593 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.591+0000 7f9b5aabd700 1 --2- 172.21.15.83:0/274380025 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f9b440a1290 0x7f9b440a3750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9b48009990 tx=0x7f9b48019040 comp rx=0 tx=0).stop 2024-04-01T06:58:25.593 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.591+0000 7f9b5aabd700 1 -- 172.21.15.83:0/274380025 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9b540ffbe0 msgr2=0x7f9b54197720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:25.593 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.591+0000 7f9b5aabd700 1 --2- 172.21.15.83:0/274380025 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9b540ffbe0 0x7f9b54197720 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f9b4000c9b0 tx=0x7f9b4000ccc0 comp rx=0 tx=0).stop 2024-04-01T06:58:25.593 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.591+0000 7f9b5aabd700 1 -- 172.21.15.83:0/274380025 shutdown_connections 2024-04-01T06:58:25.593 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.591+0000 7f9b5aabd700 1 --2- 172.21.15.83:0/274380025 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f9b440a1290 0x7f9b440a3750 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:25.593 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.591+0000 7f9b5aabd700 1 --2- 172.21.15.83:0/274380025 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9b54106e30 0x7f9b5419ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:25.593 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.591+0000 7f9b5aabd700 1 --2- 172.21.15.83:0/274380025 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b540ff220 0x7f9b541971e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:25.594 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.591+0000 7f9b5aabd700 1 --2- 172.21.15.83:0/274380025 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9b540ffbe0 0x7f9b54197720 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:25.594 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.591+0000 7f9b5aabd700 1 -- 172.21.15.83:0/274380025 >> 172.21.15.83:0/274380025 conn(0x7f9b540761b0 msgr2=0x7f9b54103c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:58:25.594 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.591+0000 7f9b5aabd700 1 -- 172.21.15.83:0/274380025 shutdown_connections 2024-04-01T06:58:25.594 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:25.591+0000 7f9b5aabd700 1 -- 172.21.15.83:0/274380025 wait complete. 2024-04-01T06:58:26.336 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-01T06:58:26.336 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-01T06:58:26.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.485+0000 7f66f9669700 1 -- 172.21.15.83:0/3899181809 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66f4106090 msgr2=0x7f66f410dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:26.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.485+0000 7f66f9669700 1 --2- 172.21.15.83:0/3899181809 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66f4106090 0x7f66f410dc10 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f66ec00b0a0 tx=0x7f66ec00b3b0 comp rx=0 tx=0).stop 2024-04-01T06:58:26.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.485+0000 7f66f9669700 1 -- 172.21.15.83:0/3899181809 shutdown_connections 2024-04-01T06:58:26.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.485+0000 7f66f9669700 1 --2- 172.21.15.83:0/3899181809 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66f4106090 0x7f66f410dc10 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:26.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.485+0000 7f66f9669700 1 --2- 172.21.15.83:0/3899181809 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f66f4100f70 0x7f66f4101350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:26.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.485+0000 7f66f9669700 1 --2- 172.21.15.83:0/3899181809 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66f4101920 0x7f66f4105960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:26.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.485+0000 7f66f9669700 1 -- 172.21.15.83:0/3899181809 >> 172.21.15.83:0/3899181809 conn(0x7f66f40fc7f0 msgr2=0x7f66f40fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:58:26.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.485+0000 7f66f9669700 1 -- 172.21.15.83:0/3899181809 shutdown_connections 2024-04-01T06:58:26.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.485+0000 7f66f9669700 1 -- 172.21.15.83:0/3899181809 wait complete. 2024-04-01T06:58:26.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.486+0000 7f66f9669700 1 Processor -- start 2024-04-01T06:58:26.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.486+0000 7f66f9669700 1 -- start start 2024-04-01T06:58:26.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.486+0000 7f66f9669700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66f4100f70 0x7f66f40730b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:26.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.486+0000 7f66f9669700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66f4106090 0x7f66f40735f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:26.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.486+0000 7f66f9669700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f66f4073b30 0x7f66f41a54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:26.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.486+0000 7f66f9669700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f41a5aa0 con 0x7f66f4106090 2024-04-01T06:58:26.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.486+0000 7f66f9669700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f41a5c10 con 0x7f66f4073b30 2024-04-01T06:58:26.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.486+0000 7f66f9669700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f41a5dd0 con 0x7f66f4100f70 2024-04-01T06:58:26.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.486+0000 7f66f27fc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66f4106090 0x7f66f40735f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:26.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.486+0000 7f66f27fc700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66f4106090 0x7f66f40735f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:50334/0 (socket says 172.21.15.83:50334) 2024-04-01T06:58:26.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.486+0000 7f66f27fc700 1 -- 172.21.15.83:0/3811351758 learned_addr learned my addr 172.21.15.83:0/3811351758 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:58:26.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.486+0000 7f66f37fe700 1 --2- 172.21.15.83:0/3811351758 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f66f4073b30 0x7f66f41a54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:26.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.486+0000 7f66f2ffd700 1 --2- 172.21.15.83:0/3811351758 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66f4100f70 0x7f66f40730b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:26.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.486+0000 7f66f27fc700 1 -- 172.21.15.83:0/3811351758 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66f4100f70 msgr2=0x7f66f40730b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:26.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.486+0000 7f66f27fc700 1 --2- 172.21.15.83:0/3811351758 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66f4100f70 0x7f66f40730b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:26.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.487+0000 7f66f27fc700 1 -- 172.21.15.83:0/3811351758 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f66f4073b30 msgr2=0x7f66f41a54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:26.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.487+0000 7f66f27fc700 1 --2- 172.21.15.83:0/3811351758 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f66f4073b30 0x7f66f41a54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:26.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.487+0000 7f66f27fc700 1 -- 172.21.15.83:0/3811351758 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66ec009d00 con 0x7f66f4106090 2024-04-01T06:58:26.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.487+0000 7f66f2ffd700 1 --2- 172.21.15.83:0/3811351758 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66f4100f70 0x7f66f40730b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:58:26.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.487+0000 7f66f27fc700 1 --2- 172.21.15.83:0/3811351758 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66f4106090 0x7f66f40735f0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f66e800c8f0 tx=0x7f66e800cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:58:26.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.487+0000 7f66dbfff700 1 -- 172.21.15.83:0/3811351758 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e8007940 con 0x7f66f4106090 2024-04-01T06:58:26.490 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.487+0000 7f66dbfff700 1 -- 172.21.15.83:0/3811351758 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f66e800f450 con 0x7f66f4106090 2024-04-01T06:58:26.490 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.487+0000 7f66f9669700 1 -- 172.21.15.83:0/3811351758 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66f41a60b0 con 0x7f66f4106090 2024-04-01T06:58:26.490 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.487+0000 7f66dbfff700 1 -- 172.21.15.83:0/3811351758 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e8018660 con 0x7f66f4106090 2024-04-01T06:58:26.490 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.487+0000 7f66f9669700 1 -- 172.21.15.83:0/3811351758 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66f41a65c0 con 0x7f66f4106090 2024-04-01T06:58:26.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.489+0000 7f66dbfff700 1 -- 172.21.15.83:0/3811351758 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 25) v1 ==== 135996+0+0 (secure 0 0 0) 0x7f66e800f5c0 con 0x7f66f4106090 2024-04-01T06:58:26.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.490+0000 7f66dbfff700 1 --2- 172.21.15.83:0/3811351758 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f66dc0a1290 0x7f66dc0a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:26.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.490+0000 7f66f2ffd700 1 --2- 172.21.15.83:0/3811351758 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f66dc0a1290 0x7f66dc0a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:26.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.490+0000 7f66dbfff700 1 -- 172.21.15.83:0/3811351758 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f66e80ccb30 con 0x7f66f4106090 2024-04-01T06:58:26.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.490+0000 7f66f2ffd700 1 --2- 172.21.15.83:0/3811351758 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f66dc0a1290 0x7f66dc0a3750 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f66e4009be0 tx=0x7f66e4009260 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:58:26.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.491+0000 7f67057ffb80 1 Processor -- start 2024-04-01T06:58:26.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.491+0000 7f67057ffb80 1 -- start start 2024-04-01T06:58:26.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.491+0000 7f67057ffb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556af40f55d0 0x556af40f59b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:26.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.491+0000 7f67057ffb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556af40f5ef0 0x556af41008b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:26.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.491+0000 7f67057ffb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556af4100df0 0x556af41031e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:26.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.491+0000 7f67057ffb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x556af404e990 con 0x556af4100df0 2024-04-01T06:58:26.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.491+0000 7f67057ffb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x556af404c350 con 0x556af40f5ef0 2024-04-01T06:58:26.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.491+0000 7f67057ffb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x556af4047c40 con 0x556af40f55d0 2024-04-01T06:58:26.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.491+0000 7f66f37fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556af4100df0 0x556af41031e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:26.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.491+0000 7f66f37fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556af4100df0 0x556af41031e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:50340/0 (socket says 172.21.15.83:50340) 2024-04-01T06:58:26.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.491+0000 7f66f27fc700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556af40f5ef0 0x556af41008b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:26.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.491+0000 7f66f37fe700 1 -- 172.21.15.83:0/501112005 learned_addr learned my addr 172.21.15.83:0/501112005 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:58:26.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.491+0000 7f66f2ffd700 1 --2- 172.21.15.83:0/501112005 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556af40f55d0 0x556af40f59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:26.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.491+0000 7f66f37fe700 1 -- 172.21.15.83:0/501112005 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556af40f55d0 msgr2=0x556af40f59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:26.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.491+0000 7f66f37fe700 1 --2- 172.21.15.83:0/501112005 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556af40f55d0 0x556af40f59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:26.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.491+0000 7f66f37fe700 1 -- 172.21.15.83:0/501112005 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556af40f5ef0 msgr2=0x556af41008b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:26.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.491+0000 7f66f37fe700 1 --2- 172.21.15.83:0/501112005 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556af40f5ef0 0x556af41008b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:26.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.491+0000 7f66f37fe700 1 -- 172.21.15.83:0/501112005 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556af3ec93b0 con 0x556af4100df0 2024-04-01T06:58:26.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.491+0000 7f66f27fc700 1 --2- 172.21.15.83:0/501112005 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556af40f5ef0 0x556af41008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T06:58:26.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.492+0000 7f66f37fe700 1 --2- 172.21.15.83:0/501112005 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556af4100df0 0x556af41031e0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f66ec00b0a0 tx=0x7f66ec009430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=585ce3a79359e627 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:58:26.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.492+0000 7f66d97fa700 1 -- 172.21.15.83:0/501112005 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ec00e040 con 0x556af4100df0 2024-04-01T06:58:26.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.492+0000 7f66d97fa700 1 -- 172.21.15.83:0/501112005 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f66ec007cc0 con 0x556af4100df0 2024-04-01T06:58:26.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.492+0000 7f66d97fa700 1 -- 172.21.15.83:0/501112005 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ec003c40 con 0x556af4100df0 2024-04-01T06:58:26.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.492+0000 7f67057ffb80 1 -- 172.21.15.83:0/501112005 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556af4100df0 msgr2=0x556af41031e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:26.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.492+0000 7f67057ffb80 1 --2- 172.21.15.83:0/501112005 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556af4100df0 0x556af41031e0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f66ec00b0a0 tx=0x7f66ec009430 comp rx=0 tx=0).stop 2024-04-01T06:58:26.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.492+0000 7f67057ffb80 1 -- 172.21.15.83:0/501112005 shutdown_connections 2024-04-01T06:58:26.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.492+0000 7f67057ffb80 1 --2- 172.21.15.83:0/501112005 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556af4100df0 0x556af41031e0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:26.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.492+0000 7f67057ffb80 1 --2- 172.21.15.83:0/501112005 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556af40f55d0 0x556af40f59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:26.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.492+0000 7f67057ffb80 1 --2- 172.21.15.83:0/501112005 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556af40f5ef0 0x556af41008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:26.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.492+0000 7f67057ffb80 1 -- 172.21.15.83:0/501112005 >> 172.21.15.83:0/501112005 conn(0x556af40556a0 msgr2=0x556af40f1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:58:26.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.492+0000 7f67057ffb80 1 -- 172.21.15.83:0/501112005 shutdown_connections 2024-04-01T06:58:26.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.492+0000 7f67057ffb80 1 -- 172.21.15.83:0/501112005 wait complete. 2024-04-01T06:58:26.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.493+0000 7f67057ffb80 1 -- start start 2024-04-01T06:58:26.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.493+0000 7f67057ffb80 1 Processor -- start 2024-04-01T06:58:26.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.493+0000 7f67057ffb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556af40f55d0 0x556af4100780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:26.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.493+0000 7f67057ffb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556af40f5ef0 0x556af40fdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:26.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.493+0000 7f67057ffb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556af4100df0 0x556af40fe140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:26.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.493+0000 7f67057ffb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x556af3fe3d80 con 0x556af4100df0 2024-04-01T06:58:26.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.493+0000 7f67057ffb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x556af3fe3a20 con 0x556af40f5ef0 2024-04-01T06:58:26.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.493+0000 7f67057ffb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x556af3ecb6a0 con 0x556af40f55d0 2024-04-01T06:58:26.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.493+0000 7f67057ffb80 10 client.0 _ll_register_callbacks cb 0x556af3fed470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:58:26.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.493+0000 7f66f37fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556af4100df0 0x556af40fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:26.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.493+0000 7f66f37fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556af4100df0 0x556af40fe140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:50344/0 (socket says 172.21.15.83:50344) 2024-04-01T06:58:26.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.493+0000 7f66f37fe700 1 -- 172.21.15.83:0/3743102652 learned_addr learned my addr 172.21.15.83:0/3743102652 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:58:26.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.493+0000 7f66f27fc700 1 --2- 172.21.15.83:0/3743102652 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556af40f5ef0 0x556af40fdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:26.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.493+0000 7f66f2ffd700 1 --2- 172.21.15.83:0/3743102652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556af40f55d0 0x556af4100780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:26.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.493+0000 7f66f37fe700 1 -- 172.21.15.83:0/3743102652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556af40f55d0 msgr2=0x556af4100780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:26.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.493+0000 7f66f37fe700 1 --2- 172.21.15.83:0/3743102652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556af40f55d0 0x556af4100780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:26.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.493+0000 7f66f37fe700 1 -- 172.21.15.83:0/3743102652 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556af40f5ef0 msgr2=0x556af40fdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:26.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.493+0000 7f66f37fe700 1 --2- 172.21.15.83:0/3743102652 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556af40f5ef0 0x556af40fdbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:26.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.493+0000 7f66f37fe700 1 -- 172.21.15.83:0/3743102652 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66f41a65c0 con 0x556af4100df0 2024-04-01T06:58:26.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.494+0000 7f66f37fe700 1 --2- 172.21.15.83:0/3743102652 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556af4100df0 0x556af40fe140 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f66ec00d010 tx=0x7f66ec003c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55c2409931369770 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:58:26.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.494+0000 7f66d6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:58:26.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.494+0000 7f66d6ff5700 1 -- 172.21.15.83:0/3743102652 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ec00e040 con 0x556af4100df0 2024-04-01T06:58:26.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.494+0000 7f67057ffb80 1 -- 172.21.15.83:0/3743102652 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556af4008380 con 0x556af4100df0 2024-04-01T06:58:26.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.494+0000 7f66d6ff5700 1 -- 172.21.15.83:0/3743102652 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f66ec0052d0 con 0x556af4100df0 2024-04-01T06:58:26.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.494+0000 7f66d6ff5700 1 -- 172.21.15.83:0/3743102652 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f66ec005490 con 0x556af4100df0 2024-04-01T06:58:26.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.494+0000 7f67057ffb80 10 client.16146 fetch_fsmap learned FSMap version 30 2024-04-01T06:58:26.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.494+0000 7f67057ffb80 1 -- 172.21.15.83:0/3743102652 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x7f66f410e480 con 0x556af4100df0 2024-04-01T06:58:26.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.494+0000 7f66d6ff5700 1 -- 172.21.15.83:0/3743102652 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556af4008380 con 0x556af4100df0 2024-04-01T06:58:26.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.494+0000 7f66d6ff5700 1 -- 172.21.15.83:0/3743102652 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 30) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f66ec019070 con 0x556af4100df0 2024-04-01T06:58:26.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.494+0000 7f67057ffb80 10 client.16146 fetch_fsmap finished waiting for FSMap version 30 2024-04-01T06:58:26.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.494+0000 7f67057ffb80 10 client.16146 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-01T06:58:26.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.494+0000 7f67057ffb80 20 client.16146 populate_metadata read hostname 'smithi083' 2024-04-01T06:58:26.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.494+0000 7f67057ffb80 1 --2- 172.21.15.83:0/3743102652 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x556af41105b0 0x556af41129d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:26.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.494+0000 7f67057ffb80 4 client.16146 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-01T06:58:26.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.494+0000 7f67057ffb80 1 -- 172.21.15.83:0/3743102652 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556af4040700 con 0x556af41105b0 2024-04-01T06:58:26.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.495+0000 7f66f2ffd700 1 --2- 172.21.15.83:0/3743102652 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x556af41105b0 0x556af41129d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:26.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.495+0000 7f66d6ff5700 10 client.16146 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:58:26.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.495+0000 7f66f2ffd700 1 --2- 172.21.15.83:0/3743102652 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x556af41105b0 0x556af41129d0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32501e830ac691c6 server_cookie=32709e30b581428e in_seq=0 out_seq=0 2024-04-01T06:58:26.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.495+0000 7f66d6ff5700 1 -- 172.21.15.83:0/3743102652 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556af4040700 con 0x556af41105b0 2024-04-01T06:58:26.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.495+0000 7f66d6ff5700 10 client.16146 handle_command_reply: tid=0 2024-04-01T06:58:26.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.495+0000 7f67057ffb80 1 client.16146 shutdown 2024-04-01T06:58:26.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.496+0000 7f67057ffb80 1 -- 172.21.15.83:0/3743102652 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556af4100df0 msgr2=0x556af40fe140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:26.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.496+0000 7f67057ffb80 1 --2- 172.21.15.83:0/3743102652 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556af4100df0 0x556af40fe140 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f66ec00d010 tx=0x7f66ec003c30 comp rx=0 tx=0).stop 2024-04-01T06:58:26.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.496+0000 7f67057ffb80 1 -- 172.21.15.83:0/3743102652 shutdown_connections 2024-04-01T06:58:26.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.496+0000 7f67057ffb80 1 --2- 172.21.15.83:0/3743102652 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x556af41105b0 0x556af41129d0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:26.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.496+0000 7f67057ffb80 1 --2- 172.21.15.83:0/3743102652 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556af4100df0 0x556af40fe140 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:26.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.496+0000 7f67057ffb80 1 --2- 172.21.15.83:0/3743102652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556af40f55d0 0x556af4100780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:26.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.496+0000 7f66d6ff5700 0 client.16146 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:58:26.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.496+0000 7f67057ffb80 1 --2- 172.21.15.83:0/3743102652 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556af40f5ef0 0x556af40fdbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:26.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.496+0000 7f67057ffb80 1 -- 172.21.15.83:0/3743102652 >> 172.21.15.83:0/3743102652 conn(0x556af40556a0 msgr2=0x556af40f76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:58:26.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.496+0000 7f67057ffb80 1 -- 172.21.15.83:0/3743102652 shutdown_connections 2024-04-01T06:58:26.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.496+0000 7f67057ffb80 1 -- 172.21.15.83:0/3743102652 wait complete. 2024-04-01T06:58:26.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.496+0000 7f67057ffb80 20 client.16146 trim_cache size 0 max 16384 2024-04-01T06:58:26.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.513+0000 7f67057ffb80 1 Processor -- start 2024-04-01T06:58:26.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.513+0000 7f67057ffb80 1 -- start start 2024-04-01T06:58:26.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.513+0000 7f67057ffb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556af40f55d0 0x556af40fd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:26.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.513+0000 7f67057ffb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556af40f5ef0 0x556af4107a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:26.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.513+0000 7f67057ffb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556af4100df0 0x556af40ea5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:26.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.513+0000 7f67057ffb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x556af410d3e0 con 0x556af4100df0 2024-04-01T06:58:26.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.513+0000 7f67057ffb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x556af40f6850 con 0x556af40f55d0 2024-04-01T06:58:26.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.513+0000 7f67057ffb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x556af40f7130 con 0x556af40f5ef0 2024-04-01T06:58:26.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.513+0000 7f66f37fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556af4100df0 0x556af40ea5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:26.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.513+0000 7f66f37fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556af4100df0 0x556af40ea5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:50346/0 (socket says 172.21.15.83:50346) 2024-04-01T06:58:26.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.513+0000 7f66f37fe700 1 -- 172.21.15.83:0/1571804336 learned_addr learned my addr 172.21.15.83:0/1571804336 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:58:26.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.513+0000 7f66f2ffd700 1 --2- 172.21.15.83:0/1571804336 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556af40f55d0 0x556af40fd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:26.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.513+0000 7f66f27fc700 1 --2- 172.21.15.83:0/1571804336 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556af40f5ef0 0x556af4107a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:26.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.513+0000 7f66f37fe700 1 -- 172.21.15.83:0/1571804336 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556af40f5ef0 msgr2=0x556af4107a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:26.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.513+0000 7f66f37fe700 1 --2- 172.21.15.83:0/1571804336 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556af40f5ef0 0x556af4107a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:26.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.513+0000 7f66f37fe700 1 -- 172.21.15.83:0/1571804336 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556af40f55d0 msgr2=0x556af40fd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:26.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.513+0000 7f66f37fe700 1 --2- 172.21.15.83:0/1571804336 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556af40f55d0 0x556af40fd480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:26.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.513+0000 7f66f37fe700 1 -- 172.21.15.83:0/1571804336 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556af3e75b60 con 0x556af4100df0 2024-04-01T06:58:26.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.513+0000 7f66f37fe700 1 --2- 172.21.15.83:0/1571804336 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556af4100df0 0x556af40ea5a0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f66ec002230 tx=0x7f66ec00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=332fa4d82d247d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:58:26.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.513+0000 7f66d9ffb700 1 -- 172.21.15.83:0/1571804336 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ec00e030 con 0x556af4100df0 2024-04-01T06:58:26.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.514+0000 7f66d9ffb700 1 -- 172.21.15.83:0/1571804336 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f66ec006160 con 0x556af4100df0 2024-04-01T06:58:26.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.514+0000 7f66d9ffb700 1 -- 172.21.15.83:0/1571804336 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ec005980 con 0x556af4100df0 2024-04-01T06:58:26.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.514+0000 7f67057ffb80 1 -- 172.21.15.83:0/1571804336 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556af4100df0 msgr2=0x556af40ea5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:26.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.514+0000 7f67057ffb80 1 --2- 172.21.15.83:0/1571804336 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556af4100df0 0x556af40ea5a0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f66ec002230 tx=0x7f66ec00b8b0 comp rx=0 tx=0).stop 2024-04-01T06:58:26.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.514+0000 7f67057ffb80 1 -- 172.21.15.83:0/1571804336 shutdown_connections 2024-04-01T06:58:26.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.514+0000 7f67057ffb80 1 --2- 172.21.15.83:0/1571804336 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556af4100df0 0x556af40ea5a0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:26.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.514+0000 7f67057ffb80 1 --2- 172.21.15.83:0/1571804336 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556af40f55d0 0x556af40fd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:26.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.514+0000 7f67057ffb80 1 --2- 172.21.15.83:0/1571804336 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556af40f5ef0 0x556af4107a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:26.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.514+0000 7f67057ffb80 1 -- 172.21.15.83:0/1571804336 >> 172.21.15.83:0/1571804336 conn(0x556af40556a0 msgr2=0x556af40eaf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:58:26.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.514+0000 7f67057ffb80 1 -- 172.21.15.83:0/1571804336 shutdown_connections 2024-04-01T06:58:26.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.514+0000 7f67057ffb80 1 -- 172.21.15.83:0/1571804336 wait complete. 2024-04-01T06:58:26.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.514+0000 7f67057ffb80 1 -- start start 2024-04-01T06:58:26.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.514+0000 7f67057ffb80 1 Processor -- start 2024-04-01T06:58:26.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.515+0000 7f67057ffb80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556af40f55d0 0x556af41073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:26.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.515+0000 7f67057ffb80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556af40f5ef0 0x556af41078e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:26.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.515+0000 7f67057ffb80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556af4100df0 0x556af41059f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:26.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.515+0000 7f67057ffb80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x556af4105ff0 con 0x556af4100df0 2024-04-01T06:58:26.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.515+0000 7f67057ffb80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x556af4106160 con 0x556af40f5ef0 2024-04-01T06:58:26.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.515+0000 7f67057ffb80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x556af4106320 con 0x556af40f55d0 2024-04-01T06:58:26.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.515+0000 7f67057ffb80 10 client.0 _ll_register_callbacks cb 0x556af3fed470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:58:26.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.515+0000 7f66f37fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556af4100df0 0x556af41059f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:26.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.515+0000 7f66f37fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556af4100df0 0x556af41059f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:50352/0 (socket says 172.21.15.83:50352) 2024-04-01T06:58:26.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.515+0000 7f66f37fe700 1 -- 172.21.15.83:0/423480192 learned_addr learned my addr 172.21.15.83:0/423480192 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:58:26.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.515+0000 7f66f27fc700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556af40f5ef0 0x556af41078e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:26.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.515+0000 7f66f2ffd700 1 --2- 172.21.15.83:0/423480192 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556af40f55d0 0x556af41073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:26.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.515+0000 7f66f37fe700 1 -- 172.21.15.83:0/423480192 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556af40f55d0 msgr2=0x556af41073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:26.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.515+0000 7f66f37fe700 1 --2- 172.21.15.83:0/423480192 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556af40f55d0 0x556af41073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:26.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.515+0000 7f66f37fe700 1 -- 172.21.15.83:0/423480192 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556af40f5ef0 msgr2=0x556af41078e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:26.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.515+0000 7f66f37fe700 1 --2- 172.21.15.83:0/423480192 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556af40f5ef0 0x556af41078e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:26.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.515+0000 7f66f37fe700 1 -- 172.21.15.83:0/423480192 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66f410e480 con 0x556af4100df0 2024-04-01T06:58:26.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.515+0000 7f66f37fe700 1 --2- 172.21.15.83:0/423480192 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556af4100df0 0x556af41059f0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f66ec00b3f0 tx=0x7f66ec0059a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d55310fd2bb80d16 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:58:26.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.515+0000 7f66d6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:58:26.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.515+0000 7f66d6ff5700 1 -- 172.21.15.83:0/423480192 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ec00e040 con 0x556af4100df0 2024-04-01T06:58:26.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.516+0000 7f66d6ff5700 1 -- 172.21.15.83:0/423480192 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f66ec007600 con 0x556af4100df0 2024-04-01T06:58:26.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.516+0000 7f67057ffb80 1 -- 172.21.15.83:0/423480192 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f66ec007cc0 con 0x556af4100df0 2024-04-01T06:58:26.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.516+0000 7f66d6ff5700 1 -- 172.21.15.83:0/423480192 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f66ec025610 con 0x556af4100df0 2024-04-01T06:58:26.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.516+0000 7f67057ffb80 10 client.16152 fetch_fsmap learned FSMap version 30 2024-04-01T06:58:26.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.516+0000 7f67057ffb80 1 -- 172.21.15.83:0/423480192 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x556af400dea0 con 0x556af4100df0 2024-04-01T06:58:26.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.516+0000 7f66d6ff5700 1 -- 172.21.15.83:0/423480192 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f66ec007cc0 con 0x556af4100df0 2024-04-01T06:58:26.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.516+0000 7f66d6ff5700 1 -- 172.21.15.83:0/423480192 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 30) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f66ec00b0d0 con 0x556af4100df0 2024-04-01T06:58:26.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.516+0000 7f67057ffb80 10 client.16152 fetch_fsmap finished waiting for FSMap version 30 2024-04-01T06:58:26.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.516+0000 7f67057ffb80 10 client.16152 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-01T06:58:26.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.516+0000 7f67057ffb80 20 client.16152 populate_metadata read hostname 'smithi083' 2024-04-01T06:58:26.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.516+0000 7f67057ffb80 1 --2- 172.21.15.83:0/423480192 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x556af4165240 0x556af4167660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:26.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.516+0000 7f67057ffb80 4 client.16152 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-01T06:58:26.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.516+0000 7f67057ffb80 1 -- 172.21.15.83:0/423480192 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x556af3e96cf0 con 0x556af4165240 2024-04-01T06:58:26.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.516+0000 7f66f2ffd700 1 --2- 172.21.15.83:0/423480192 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x556af4165240 0x556af4167660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:26.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.517+0000 7f66f2ffd700 1 --2- 172.21.15.83:0/423480192 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x556af4165240 0x556af4167660 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=120ba3ba2c25d5ed server_cookie=b73eb1b48d1184d4 in_seq=0 out_seq=0 2024-04-01T06:58:26.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.517+0000 7f66d6ff5700 10 client.16152 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:58:26.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.547+0000 7f66d6ff5700 1 -- 172.21.15.83:0/423480192 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x556af3e96cf0 con 0x556af4165240 2024-04-01T06:58:26.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.547+0000 7f66d6ff5700 10 client.16152 handle_command_reply: tid=0 2024-04-01T06:58:26.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.547+0000 7f67057ffb80 1 client.16152 shutdown 2024-04-01T06:58:26.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.547+0000 7f67057ffb80 1 -- 172.21.15.83:0/423480192 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556af4100df0 msgr2=0x556af41059f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:26.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.547+0000 7f67057ffb80 1 --2- 172.21.15.83:0/423480192 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556af4100df0 0x556af41059f0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f66ec00b3f0 tx=0x7f66ec0059a0 comp rx=0 tx=0).stop 2024-04-01T06:58:26.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.547+0000 7f67057ffb80 1 -- 172.21.15.83:0/423480192 shutdown_connections 2024-04-01T06:58:26.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.547+0000 7f67057ffb80 1 --2- 172.21.15.83:0/423480192 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x556af4165240 0x556af4167660 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:26.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.547+0000 7f67057ffb80 1 --2- 172.21.15.83:0/423480192 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x556af4100df0 0x556af41059f0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:26.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.547+0000 7f67057ffb80 1 --2- 172.21.15.83:0/423480192 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556af40f55d0 0x556af41073a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:26.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.547+0000 7f67057ffb80 1 --2- 172.21.15.83:0/423480192 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556af40f5ef0 0x556af41078e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:26.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.547+0000 7f66d6ff5700 0 client.16152 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:58:26.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.547+0000 7f67057ffb80 1 -- 172.21.15.83:0/423480192 >> 172.21.15.83:0/423480192 conn(0x556af40556a0 msgr2=0x556af40ea5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:58:26.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.547+0000 7f67057ffb80 1 -- 172.21.15.83:0/423480192 shutdown_connections 2024-04-01T06:58:26.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.547+0000 7f67057ffb80 1 -- 172.21.15.83:0/423480192 wait complete. 2024-04-01T06:58:26.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.547+0000 7f67057ffb80 20 client.16152 trim_cache size 0 max 16384 2024-04-01T06:58:26.549 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-04-01T06:58:26.549 INFO:teuthology.orchestra.run.smithi083.stdout: "status": "no active scrubs running", 2024-04-01T06:58:26.549 INFO:teuthology.orchestra.run.smithi083.stdout: "scrubs": {} 2024-04-01T06:58:26.549 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-04-01T06:58:26.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.548+0000 7f66f9669700 1 -- 172.21.15.83:0/3811351758 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f66dc0a1290 msgr2=0x7f66dc0a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:26.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.548+0000 7f66f9669700 1 --2- 172.21.15.83:0/3811351758 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f66dc0a1290 0x7f66dc0a3750 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f66e4009be0 tx=0x7f66e4009260 comp rx=0 tx=0).stop 2024-04-01T06:58:26.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.548+0000 7f66f9669700 1 -- 172.21.15.83:0/3811351758 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66f4106090 msgr2=0x7f66f40735f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:26.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.548+0000 7f66f9669700 1 --2- 172.21.15.83:0/3811351758 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66f4106090 0x7f66f40735f0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f66e800c8f0 tx=0x7f66e800cc00 comp rx=0 tx=0).stop 2024-04-01T06:58:26.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.548+0000 7f66f9669700 1 -- 172.21.15.83:0/3811351758 shutdown_connections 2024-04-01T06:58:26.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.548+0000 7f66f9669700 1 --2- 172.21.15.83:0/3811351758 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f66dc0a1290 0x7f66dc0a3750 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:26.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.548+0000 7f66f9669700 1 --2- 172.21.15.83:0/3811351758 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f66f4073b30 0x7f66f41a54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:26.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.548+0000 7f66f9669700 1 --2- 172.21.15.83:0/3811351758 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66f4100f70 0x7f66f40730b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:26.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.548+0000 7f66f9669700 1 --2- 172.21.15.83:0/3811351758 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f66f4106090 0x7f66f40735f0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:26.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.548+0000 7f66f9669700 1 -- 172.21.15.83:0/3811351758 >> 172.21.15.83:0/3811351758 conn(0x7f66f40fc7f0 msgr2=0x7f66f40fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:58:26.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.548+0000 7f66f9669700 1 -- 172.21.15.83:0/3811351758 shutdown_connections 2024-04-01T06:58:26.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.548+0000 7f66f9669700 1 -- 172.21.15.83:0/3811351758 wait complete. 2024-04-01T06:58:26.560 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-01T06:58:26.560 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T06:58:26.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.684+0000 7fe50a497700 1 -- 172.21.15.83:0/1461582428 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe504101820 msgr2=0x7fe504105860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:26.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.684+0000 7fe50a497700 1 --2- 172.21.15.83:0/1461582428 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe504101820 0x7fe504105860 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8009990 tx=0x7fe4f8009ca0 comp rx=0 tx=0).stop 2024-04-01T06:58:26.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.684+0000 7fe50a497700 1 -- 172.21.15.83:0/1461582428 shutdown_connections 2024-04-01T06:58:26.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.684+0000 7fe50a497700 1 --2- 172.21.15.83:0/1461582428 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe504105f90 0x7fe50410db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:26.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.684+0000 7fe50a497700 1 --2- 172.21.15.83:0/1461582428 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe504100e70 0x7fe504101250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:26.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.684+0000 7fe50a497700 1 --2- 172.21.15.83:0/1461582428 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe504101820 0x7fe504105860 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:26.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.684+0000 7fe50a497700 1 -- 172.21.15.83:0/1461582428 >> 172.21.15.83:0/1461582428 conn(0x7fe5040fc730 msgr2=0x7fe5040feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:58:26.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.684+0000 7fe50a497700 1 -- 172.21.15.83:0/1461582428 shutdown_connections 2024-04-01T06:58:26.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.684+0000 7fe50a497700 1 -- 172.21.15.83:0/1461582428 wait complete. 2024-04-01T06:58:26.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.684+0000 7fe50a497700 1 Processor -- start 2024-04-01T06:58:26.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.684+0000 7fe50a497700 1 -- start start 2024-04-01T06:58:26.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.685+0000 7fe50a497700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe504100e70 0x7fe5040730b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:26.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.685+0000 7fe50a497700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe504105f90 0x7fe5040735f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:26.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.685+0000 7fe50a497700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe504073b30 0x7fe5041a52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:26.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.685+0000 7fe50a497700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5041a58f0 con 0x7fe504073b30 2024-04-01T06:58:26.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.685+0000 7fe50a497700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5041a5a60 con 0x7fe504100e70 2024-04-01T06:58:26.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.685+0000 7fe50a497700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5041a5c20 con 0x7fe504105f90 2024-04-01T06:58:26.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.685+0000 7fe508a34700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe504073b30 0x7fe5041a52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:26.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.685+0000 7fe503fff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe504100e70 0x7fe5040730b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:26.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.685+0000 7fe508a34700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe504073b30 0x7fe5041a52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:50370/0 (socket says 172.21.15.83:50370) 2024-04-01T06:58:26.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.685+0000 7fe508a34700 1 -- 172.21.15.83:0/336560054 learned_addr learned my addr 172.21.15.83:0/336560054 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:58:26.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.685+0000 7fe5037fe700 1 --2- 172.21.15.83:0/336560054 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe504105f90 0x7fe5040735f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:26.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.685+0000 7fe508a34700 1 -- 172.21.15.83:0/336560054 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe504105f90 msgr2=0x7fe5040735f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:26.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.685+0000 7fe508a34700 1 --2- 172.21.15.83:0/336560054 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe504105f90 0x7fe5040735f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:26.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.685+0000 7fe508a34700 1 -- 172.21.15.83:0/336560054 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe504100e70 msgr2=0x7fe5040730b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:26.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.685+0000 7fe508a34700 1 --2- 172.21.15.83:0/336560054 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe504100e70 0x7fe5040730b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:26.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.685+0000 7fe508a34700 1 -- 172.21.15.83:0/336560054 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f80095f0 con 0x7fe504073b30 2024-04-01T06:58:26.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.685+0000 7fe508a34700 1 --2- 172.21.15.83:0/336560054 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe504073b30 0x7fe5041a52b0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc00ef30 tx=0x7fe4fc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:58:26.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.685+0000 7fe5017fa700 1 -- 172.21.15.83:0/336560054 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4fc018070 con 0x7fe504073b30 2024-04-01T06:58:26.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.686+0000 7fe5017fa700 1 -- 172.21.15.83:0/336560054 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe4fc00f040 con 0x7fe504073b30 2024-04-01T06:58:26.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.686+0000 7fe50a497700 1 -- 172.21.15.83:0/336560054 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5041a5ea0 con 0x7fe504073b30 2024-04-01T06:58:26.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.686+0000 7fe5017fa700 1 -- 172.21.15.83:0/336560054 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4fc00cd00 con 0x7fe504073b30 2024-04-01T06:58:26.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.686+0000 7fe50a497700 1 -- 172.21.15.83:0/336560054 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5041a62d0 con 0x7fe504073b30 2024-04-01T06:58:26.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.686+0000 7fe50a497700 1 -- 172.21.15.83:0/336560054 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe504109260 con 0x7fe504073b30 2024-04-01T06:58:26.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.688+0000 7fe5017fa700 1 -- 172.21.15.83:0/336560054 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 25) v1 ==== 135996+0+0 (secure 0 0 0) 0x7fe4fc003a00 con 0x7fe504073b30 2024-04-01T06:58:26.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.689+0000 7fe5017fa700 1 --2- 172.21.15.83:0/336560054 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fe4ec0a1310 0x7fe4ec0a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:26.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.689+0000 7fe503fff700 1 --2- 172.21.15.83:0/336560054 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fe4ec0a1310 0x7fe4ec0a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:26.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.689+0000 7fe5017fa700 1 -- 172.21.15.83:0/336560054 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7fe4fc0ccf90 con 0x7fe504073b30 2024-04-01T06:58:26.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.689+0000 7fe503fff700 1 --2- 172.21.15.83:0/336560054 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fe4ec0a1310 0x7fe4ec0a37d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe4f4009c60 tx=0x7fe4f4009260 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:58:26.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.692+0000 7fe5017fa700 1 -- 172.21.15.83:0/336560054 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7fe4fc0964d0 con 0x7fe504073b30 2024-04-01T06:58:26.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.942+0000 7fe50a497700 1 -- 172.21.15.83:0/336560054 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe504102340 con 0x7fe504073b30 2024-04-01T06:58:26.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.942+0000 7fe5017fa700 1 -- 172.21.15.83:0/336560054 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+10883 (secure 0 0 0) 0x7fe4fc099af0 con 0x7fe504073b30 2024-04-01T06:58:26.942 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T06:58:26.943 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1271130478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1271130478},{"type":"v1","addr":"172.21.15.83:6835","nonce":1271130478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2412682983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2412682983},{"type":"v1","addr":"172.21.15.83:6837","nonce":2412682983}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6839/3348145990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":3348145990},{"type":"v1","addr":"172.21.15.83:6839","nonce":3348145990}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6841/1191267445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6840","nonce":1191267445},{"type":"v1","addr":"172.21.15.83:6841","nonce":1191267445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2467459028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2467459028},{"type":"v1","addr":"172.21.15.153:6833","nonce":2467459028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24448,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4092629042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":4092629042},{"type":"v1","addr":"172.21.15.153:6835","nonce":4092629042}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-01T06:54:28.397062+0000","modified":"2024-04-01T06:58:25.768790+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24524,"mds_1":24494,"mds_2":24473},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6833/647005844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":647005844},{"type":"v1","addr":"172.21.15.145:6833","nonce":647005844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24454":{"gid":24454,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6837/1993816527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1993816527},{"type":"v1","addr":"172.21.15.153:6837","nonce":1993816527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24473":{"gid":24473,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":59,"addr":"172.21.15.145:6835/3104241497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":3104241497},{"type":"v1","addr":"172.21.15.145:6835","nonce":3104241497}]},"join_fscid":-1,"export_targets":[0,1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24494":{"gid":24494,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.145:6837/2687798317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2687798317},{"type":"v1","addr":"172.21.15.145:6837","nonce":2687798317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6839/3886435411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3886435411},{"type":"v1","addr":"172.21.15.145:6839","nonce":3886435411}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_25273":{"gid":25273,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6839/2570595837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":2570595837},{"type":"v1","addr":"172.21.15.153:6839","nonce":2570595837}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-01T06:58:26.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.945+0000 7fe50a497700 1 -- 172.21.15.83:0/336560054 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fe4ec0a1310 msgr2=0x7fe4ec0a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:26.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.945+0000 7fe50a497700 1 --2- 172.21.15.83:0/336560054 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fe4ec0a1310 0x7fe4ec0a37d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe4f4009c60 tx=0x7fe4f4009260 comp rx=0 tx=0).stop 2024-04-01T06:58:26.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.945+0000 7fe50a497700 1 -- 172.21.15.83:0/336560054 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe504073b30 msgr2=0x7fe5041a52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:26.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.945+0000 7fe50a497700 1 --2- 172.21.15.83:0/336560054 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe504073b30 0x7fe5041a52b0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc00ef30 tx=0x7fe4fc00c3a0 comp rx=0 tx=0).stop 2024-04-01T06:58:26.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.945+0000 7fe50a497700 1 -- 172.21.15.83:0/336560054 shutdown_connections 2024-04-01T06:58:26.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.945+0000 7fe50a497700 1 --2- 172.21.15.83:0/336560054 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fe4ec0a1310 0x7fe4ec0a37d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:26.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.945+0000 7fe50a497700 1 --2- 172.21.15.83:0/336560054 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe504073b30 0x7fe5041a52b0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:26.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.945+0000 7fe50a497700 1 --2- 172.21.15.83:0/336560054 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe504100e70 0x7fe5040730b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:26.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.945+0000 7fe50a497700 1 --2- 172.21.15.83:0/336560054 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe504105f90 0x7fe5040735f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:26.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.945+0000 7fe50a497700 1 -- 172.21.15.83:0/336560054 >> 172.21.15.83:0/336560054 conn(0x7fe5040fc730 msgr2=0x7fe5040feab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:58:26.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.945+0000 7fe50a497700 1 -- 172.21.15.83:0/336560054 shutdown_connections 2024-04-01T06:58:26.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:26.945+0000 7fe50a497700 1 -- 172.21.15.83:0/336560054 wait complete. 2024-04-01T06:58:26.946 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 30 2024-04-01T06:58:26.957 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-01T06:58:26.957 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-01T06:58:27.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.083+0000 7faa2905f700 1 -- 172.21.15.83:0/2781885584 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa24106050 msgr2=0x7faa2410dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:27.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.083+0000 7faa2905f700 1 --2- 172.21.15.83:0/2781885584 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa24106050 0x7faa2410dc20 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7faa1c00b0a0 tx=0x7faa1c00b3b0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.083+0000 7faa2905f700 1 -- 172.21.15.83:0/2781885584 shutdown_connections 2024-04-01T06:58:27.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.083+0000 7faa2905f700 1 --2- 172.21.15.83:0/2781885584 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa24106050 0x7faa2410dc20 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.083+0000 7faa2905f700 1 --2- 172.21.15.83:0/2781885584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa240ff490 0x7faa240ff870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.083+0000 7faa2905f700 1 --2- 172.21.15.83:0/2781885584 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faa240ffe40 0x7faa24105970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.083+0000 7faa2905f700 1 -- 172.21.15.83:0/2781885584 >> 172.21.15.83:0/2781885584 conn(0x7faa240761e0 msgr2=0x7faa240fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:58:27.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.083+0000 7faa2905f700 1 -- 172.21.15.83:0/2781885584 shutdown_connections 2024-04-01T06:58:27.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.083+0000 7faa2905f700 1 -- 172.21.15.83:0/2781885584 wait complete. 2024-04-01T06:58:27.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.084+0000 7faa2905f700 1 Processor -- start 2024-04-01T06:58:27.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.084+0000 7faa2905f700 1 -- start start 2024-04-01T06:58:27.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.084+0000 7faa2905f700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faa240ff490 0x7faa24100400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:27.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.084+0000 7faa2905f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa24106050 0x7faa24100940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:27.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.084+0000 7faa2905f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa24100e80 0x7faa241a54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:27.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.084+0000 7faa2905f700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa241a5aa0 con 0x7faa24106050 2024-04-01T06:58:27.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.084+0000 7faa2905f700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa241a5c10 con 0x7faa240ff490 2024-04-01T06:58:27.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.084+0000 7faa2905f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa241a5dd0 con 0x7faa24100e80 2024-04-01T06:58:27.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.084+0000 7faa2259c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa24106050 0x7faa24100940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:27.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.085+0000 7faa2259c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa24106050 0x7faa24100940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:50394/0 (socket says 172.21.15.83:50394) 2024-04-01T06:58:27.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.085+0000 7faa2259c700 1 -- 172.21.15.83:0/2068446796 learned_addr learned my addr 172.21.15.83:0/2068446796 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:58:27.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.085+0000 7faa22d9d700 1 --2- 172.21.15.83:0/2068446796 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faa240ff490 0x7faa24100400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:27.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.085+0000 7faa2359e700 1 --2- 172.21.15.83:0/2068446796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa24100e80 0x7faa241a54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:27.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.085+0000 7faa2259c700 1 -- 172.21.15.83:0/2068446796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa24100e80 msgr2=0x7faa241a54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:27.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.085+0000 7faa2259c700 1 --2- 172.21.15.83:0/2068446796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa24100e80 0x7faa241a54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.085+0000 7faa2259c700 1 -- 172.21.15.83:0/2068446796 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faa240ff490 msgr2=0x7faa24100400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:27.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.085+0000 7faa2259c700 1 --2- 172.21.15.83:0/2068446796 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faa240ff490 0x7faa24100400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.085+0000 7faa2259c700 1 -- 172.21.15.83:0/2068446796 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa14009520 con 0x7faa24106050 2024-04-01T06:58:27.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.085+0000 7faa2259c700 1 --2- 172.21.15.83:0/2068446796 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa24106050 0x7faa24100940 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7faa14009fd0 tx=0x7faa1400ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:58:27.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.085+0000 7faa0bfff700 1 -- 172.21.15.83:0/2068446796 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1400cbd0 con 0x7faa24106050 2024-04-01T06:58:27.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.085+0000 7faa2905f700 1 -- 172.21.15.83:0/2068446796 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa1c009d00 con 0x7faa24106050 2024-04-01T06:58:27.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.085+0000 7faa0bfff700 1 -- 172.21.15.83:0/2068446796 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa1400eea0 con 0x7faa24106050 2024-04-01T06:58:27.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.085+0000 7faa0bfff700 1 -- 172.21.15.83:0/2068446796 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa14003cf0 con 0x7faa24106050 2024-04-01T06:58:27.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.085+0000 7faa2905f700 1 -- 172.21.15.83:0/2068446796 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa241a6480 con 0x7faa24106050 2024-04-01T06:58:27.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.088+0000 7faa0bfff700 1 -- 172.21.15.83:0/2068446796 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 25) v1 ==== 135996+0+0 (secure 0 0 0) 0x7faa14003eb0 con 0x7faa24106050 2024-04-01T06:58:27.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.088+0000 7faa351f5b80 1 Processor -- start 2024-04-01T06:58:27.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.088+0000 7faa351f5b80 1 -- start start 2024-04-01T06:58:27.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.089+0000 7faa0bfff700 1 --2- 172.21.15.83:0/2068446796 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7faa0c0a1290 0x7faa0c0a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:27.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.089+0000 7faa351f5b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da8d7fa5d0 0x55da8d7fa9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:27.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.089+0000 7faa351f5b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55da8d7faef0 0x55da8d8058b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:27.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.089+0000 7faa351f5b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55da8d805df0 0x55da8d8081e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:27.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.089+0000 7faa2359e700 1 --2- 172.21.15.83:0/2068446796 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7faa0c0a1290 0x7faa0c0a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:27.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.089+0000 7faa351f5b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da8d753990 con 0x55da8d7faef0 2024-04-01T06:58:27.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.089+0000 7faa351f5b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da8d751350 con 0x55da8d7fa5d0 2024-04-01T06:58:27.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.089+0000 7faa351f5b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da8d74cc40 con 0x55da8d805df0 2024-04-01T06:58:27.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.089+0000 7faa0bfff700 1 -- 172.21.15.83:0/2068446796 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7faa14014070 con 0x7faa24106050 2024-04-01T06:58:27.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.089+0000 7faa22d9d700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da8d7fa5d0 0x55da8d7fa9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:27.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.089+0000 7faa2259c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55da8d7faef0 0x55da8d8058b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:27.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.089+0000 7faa22d9d700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da8d7fa5d0 0x55da8d7fa9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.83:60236/0 (socket says 172.21.15.83:60236) 2024-04-01T06:58:27.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.089+0000 7faa22d9d700 1 -- 172.21.15.83:0/109952194 learned_addr learned my addr 172.21.15.83:0/109952194 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:58:27.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.089+0000 7faa2259c700 1 -- 172.21.15.83:0/109952194 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55da8d805df0 msgr2=0x55da8d8081e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:27.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.089+0000 7faa2259c700 1 --2- 172.21.15.83:0/109952194 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55da8d805df0 0x55da8d8081e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.089+0000 7faa2259c700 1 -- 172.21.15.83:0/109952194 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da8d7fa5d0 msgr2=0x55da8d7fa9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:27.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.089+0000 7faa2259c700 1 --2- 172.21.15.83:0/109952194 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da8d7fa5d0 0x55da8d7fa9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.089+0000 7faa2259c700 1 -- 172.21.15.83:0/109952194 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da8d5ce3b0 con 0x55da8d7faef0 2024-04-01T06:58:27.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.089+0000 7faa2359e700 1 --2- 172.21.15.83:0/2068446796 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7faa0c0a1290 0x7faa0c0a3750 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7faa1c009fd0 tx=0x7faa1c0094c0 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:58:27.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.089+0000 7faa2259c700 1 --2- 172.21.15.83:0/109952194 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55da8d7faef0 0x55da8d8058b0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7faa140ca6a0 tx=0x7faa140098e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b4399b3f933f4d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:58:27.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.089+0000 7faa097fa700 1 -- 172.21.15.83:0/109952194 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1409a060 con 0x55da8d7faef0 2024-04-01T06:58:27.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.089+0000 7faa097fa700 1 -- 172.21.15.83:0/109952194 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa1409de90 con 0x55da8d7faef0 2024-04-01T06:58:27.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.089+0000 7faa097fa700 1 -- 172.21.15.83:0/109952194 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1409a2c0 con 0x55da8d7faef0 2024-04-01T06:58:27.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.090+0000 7faa351f5b80 1 -- 172.21.15.83:0/109952194 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55da8d7faef0 msgr2=0x55da8d8058b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:27.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.090+0000 7faa351f5b80 1 --2- 172.21.15.83:0/109952194 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55da8d7faef0 0x55da8d8058b0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7faa140ca6a0 tx=0x7faa140098e0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.090+0000 7faa351f5b80 1 -- 172.21.15.83:0/109952194 shutdown_connections 2024-04-01T06:58:27.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.090+0000 7faa351f5b80 1 --2- 172.21.15.83:0/109952194 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55da8d805df0 0x55da8d8081e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.090+0000 7faa351f5b80 1 --2- 172.21.15.83:0/109952194 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da8d7fa5d0 0x55da8d7fa9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.090+0000 7faa351f5b80 1 --2- 172.21.15.83:0/109952194 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55da8d7faef0 0x55da8d8058b0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.090+0000 7faa351f5b80 1 -- 172.21.15.83:0/109952194 >> 172.21.15.83:0/109952194 conn(0x55da8d75a6a0 msgr2=0x55da8d7f6a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:58:27.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.090+0000 7faa351f5b80 1 -- 172.21.15.83:0/109952194 shutdown_connections 2024-04-01T06:58:27.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.090+0000 7faa351f5b80 1 -- 172.21.15.83:0/109952194 wait complete. 2024-04-01T06:58:27.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.090+0000 7faa351f5b80 1 -- start start 2024-04-01T06:58:27.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.091+0000 7faa351f5b80 1 Processor -- start 2024-04-01T06:58:27.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.091+0000 7faa351f5b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55da8d7fa5d0 0x55da8d802bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:27.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.091+0000 7faa351f5b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55da8d7faef0 0x55da8d803110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:27.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.091+0000 7faa351f5b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da8d805df0 0x55da8d803650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:27.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.091+0000 7faa351f5b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da8d6e8d80 con 0x55da8d7fa5d0 2024-04-01T06:58:27.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.091+0000 7faa351f5b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da8d6e8a20 con 0x55da8d805df0 2024-04-01T06:58:27.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.091+0000 7faa351f5b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da8d5d06a0 con 0x55da8d7faef0 2024-04-01T06:58:27.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.091+0000 7faa351f5b80 10 client.0 _ll_register_callbacks cb 0x55da8d6f2470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:58:27.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.091+0000 7faa22d9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55da8d7fa5d0 0x55da8d802bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:27.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.091+0000 7faa22d9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55da8d7fa5d0 0x55da8d802bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:50424/0 (socket says 172.21.15.83:50424) 2024-04-01T06:58:27.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.091+0000 7faa22d9d700 1 -- 172.21.15.83:0/371456475 learned_addr learned my addr 172.21.15.83:0/371456475 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:58:27.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.091+0000 7faa2359e700 1 --2- 172.21.15.83:0/371456475 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da8d805df0 0x55da8d803650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:27.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.091+0000 7faa2259c700 1 --2- 172.21.15.83:0/371456475 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55da8d7faef0 0x55da8d803110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:27.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.091+0000 7faa22d9d700 1 -- 172.21.15.83:0/371456475 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55da8d7faef0 msgr2=0x55da8d803110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:27.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.091+0000 7faa22d9d700 1 --2- 172.21.15.83:0/371456475 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55da8d7faef0 0x55da8d803110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.091+0000 7faa22d9d700 1 -- 172.21.15.83:0/371456475 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da8d805df0 msgr2=0x55da8d803650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:27.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.091+0000 7faa22d9d700 1 --2- 172.21.15.83:0/371456475 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da8d805df0 0x55da8d803650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.091+0000 7faa22d9d700 1 -- 172.21.15.83:0/371456475 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa241a6480 con 0x55da8d7fa5d0 2024-04-01T06:58:27.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.091+0000 7faa2259c700 1 --2- 172.21.15.83:0/371456475 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55da8d7faef0 0x55da8d803110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:58:27.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.091+0000 7faa22d9d700 1 --2- 172.21.15.83:0/371456475 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55da8d7fa5d0 0x55da8d802bd0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7faa1800b960 tx=0x7faa1800bd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d13123309d5b7fe server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:58:27.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.091+0000 7faa06ff5700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:58:27.097 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.091+0000 7faa06ff5700 1 -- 172.21.15.83:0/371456475 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa18016070 con 0x55da8d7fa5d0 2024-04-01T06:58:27.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.092+0000 7faa06ff5700 1 -- 172.21.15.83:0/371456475 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7faa18003d00 con 0x55da8d7fa5d0 2024-04-01T06:58:27.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.092+0000 7faa351f5b80 1 -- 172.21.15.83:0/371456475 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55da8d70d380 con 0x55da8d7fa5d0 2024-04-01T06:58:27.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.092+0000 7faa06ff5700 1 -- 172.21.15.83:0/371456475 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa1800bea0 con 0x55da8d7fa5d0 2024-04-01T06:58:27.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.092+0000 7faa351f5b80 10 client.16170 fetch_fsmap learned FSMap version 30 2024-04-01T06:58:27.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.092+0000 7faa351f5b80 1 -- 172.21.15.83:0/371456475 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55da8d57ab60 con 0x55da8d7fa5d0 2024-04-01T06:58:27.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.092+0000 7faa06ff5700 1 -- 172.21.15.83:0/371456475 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55da8d70d380 con 0x55da8d7fa5d0 2024-04-01T06:58:27.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.092+0000 7faa06ff5700 1 -- 172.21.15.83:0/371456475 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 30) v1 ==== 7478+0+0 (secure 0 0 0) 0x7faa1801b590 con 0x55da8d7fa5d0 2024-04-01T06:58:27.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.092+0000 7faa351f5b80 10 client.16170 fetch_fsmap finished waiting for FSMap version 30 2024-04-01T06:58:27.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.092+0000 7faa351f5b80 10 client.16170 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.e 2024-04-01T06:58:27.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.092+0000 7faa351f5b80 20 client.16170 populate_metadata read hostname 'smithi083' 2024-04-01T06:58:27.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.092+0000 7faa351f5b80 1 --2- 172.21.15.83:0/371456475 >> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] conn(0x55da8d815ab0 0x55da8d817ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:27.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.092+0000 7faa351f5b80 4 client.16170 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-01T06:58:27.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.092+0000 7faa351f5b80 1 -- 172.21.15.83:0/371456475 --> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55da8d745700 con 0x55da8d815ab0 2024-04-01T06:58:27.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.092+0000 7faa2259c700 1 --2- 172.21.15.83:0/371456475 >> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] conn(0x55da8d815ab0 0x55da8d817ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:27.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.093+0000 7faa2259c700 1 --2- 172.21.15.83:0/371456475 >> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] conn(0x55da8d815ab0 0x55da8d817ed0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2f1296249e34c7a2 server_cookie=ebd22cbab7a82170 in_seq=0 out_seq=0 2024-04-01T06:58:27.099 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.093+0000 7faa06ff5700 10 client.16170 ms_handle_connect on v2:172.21.15.145:6834/3104241497 2024-04-01T06:58:27.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.095+0000 7faa06ff5700 1 -- 172.21.15.83:0/371456475 <== mds.2 v2:172.21.15.145:6834/3104241497 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x7faa1407e730 con 0x55da8d815ab0 2024-04-01T06:58:27.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.095+0000 7faa06ff5700 10 client.16170 handle_command_reply: tid=0 2024-04-01T06:58:27.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.095+0000 7faa351f5b80 1 client.16170 shutdown 2024-04-01T06:58:27.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.095+0000 7faa351f5b80 1 -- 172.21.15.83:0/371456475 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55da8d7fa5d0 msgr2=0x55da8d802bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:27.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.095+0000 7faa351f5b80 1 --2- 172.21.15.83:0/371456475 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55da8d7fa5d0 0x55da8d802bd0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7faa1800b960 tx=0x7faa1800bd20 comp rx=0 tx=0).stop 2024-04-01T06:58:27.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.095+0000 7faa351f5b80 1 -- 172.21.15.83:0/371456475 shutdown_connections 2024-04-01T06:58:27.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.095+0000 7faa351f5b80 1 --2- 172.21.15.83:0/371456475 >> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] conn(0x55da8d815ab0 0x55da8d817ed0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.095+0000 7faa351f5b80 1 --2- 172.21.15.83:0/371456475 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55da8d7fa5d0 0x55da8d802bd0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.095+0000 7faa06ff5700 0 client.16170 ms_handle_reset on v2:172.21.15.145:6834/3104241497 2024-04-01T06:58:27.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.095+0000 7faa351f5b80 1 --2- 172.21.15.83:0/371456475 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da8d805df0 0x55da8d803650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.095+0000 7faa351f5b80 1 --2- 172.21.15.83:0/371456475 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55da8d7faef0 0x55da8d803110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.095+0000 7faa351f5b80 1 -- 172.21.15.83:0/371456475 >> 172.21.15.83:0/371456475 conn(0x55da8d75a6a0 msgr2=0x55da8d7fc690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:58:27.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.095+0000 7faa351f5b80 1 -- 172.21.15.83:0/371456475 shutdown_connections 2024-04-01T06:58:27.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.095+0000 7faa351f5b80 1 -- 172.21.15.83:0/371456475 wait complete. 2024-04-01T06:58:27.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.095+0000 7faa351f5b80 20 client.16170 trim_cache size 0 max 16384 2024-04-01T06:58:27.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.108+0000 7faa351f5b80 1 Processor -- start 2024-04-01T06:58:27.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.108+0000 7faa351f5b80 1 -- start start 2024-04-01T06:58:27.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.109+0000 7faa351f5b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55da8d7fa5d0 0x55da8d817ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:27.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.109+0000 7faa351f5b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55da8d7faef0 0x55da8d7ef5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:27.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.109+0000 7faa351f5b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da8d805df0 0x55da8d803470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:27.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.109+0000 7faa351f5b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da8d7fb850 con 0x55da8d7fa5d0 2024-04-01T06:58:27.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.109+0000 7faa351f5b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da8d7f7660 con 0x55da8d805df0 2024-04-01T06:58:27.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.109+0000 7faa351f5b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da8d7f27b0 con 0x55da8d7faef0 2024-04-01T06:58:27.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.109+0000 7faa22d9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55da8d7fa5d0 0x55da8d817ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:27.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.109+0000 7faa22d9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55da8d7fa5d0 0x55da8d817ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:50430/0 (socket says 172.21.15.83:50430) 2024-04-01T06:58:27.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.109+0000 7faa22d9d700 1 -- 172.21.15.83:0/4214642099 learned_addr learned my addr 172.21.15.83:0/4214642099 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:58:27.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.109+0000 7faa2359e700 1 --2- 172.21.15.83:0/4214642099 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da8d805df0 0x55da8d803470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:27.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.109+0000 7faa2259c700 1 --2- 172.21.15.83:0/4214642099 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55da8d7faef0 0x55da8d7ef5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:27.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.109+0000 7faa22d9d700 1 -- 172.21.15.83:0/4214642099 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55da8d7faef0 msgr2=0x55da8d7ef5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:27.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.109+0000 7faa22d9d700 1 --2- 172.21.15.83:0/4214642099 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55da8d7faef0 0x55da8d7ef5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.109+0000 7faa22d9d700 1 -- 172.21.15.83:0/4214642099 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da8d805df0 msgr2=0x55da8d803470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:27.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.109+0000 7faa22d9d700 1 --2- 172.21.15.83:0/4214642099 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da8d805df0 0x55da8d803470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.109+0000 7faa22d9d700 1 -- 172.21.15.83:0/4214642099 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da8d712ea0 con 0x55da8d7fa5d0 2024-04-01T06:58:27.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.109+0000 7faa2359e700 1 --2- 172.21.15.83:0/4214642099 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da8d805df0 0x55da8d803470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:58:27.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.109+0000 7faa22d9d700 1 --2- 172.21.15.83:0/4214642099 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55da8d7fa5d0 0x55da8d817ea0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7faa180040f0 tx=0x7faa18004120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36935d942f7cc5b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:58:27.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.109+0000 7faa09ffb700 1 -- 172.21.15.83:0/4214642099 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa18016040 con 0x55da8d7fa5d0 2024-04-01T06:58:27.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.109+0000 7faa09ffb700 1 -- 172.21.15.83:0/4214642099 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa1801bc10 con 0x55da8d7fa5d0 2024-04-01T06:58:27.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.109+0000 7faa09ffb700 1 -- 172.21.15.83:0/4214642099 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa18025b90 con 0x55da8d7fa5d0 2024-04-01T06:58:27.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.110+0000 7faa351f5b80 1 -- 172.21.15.83:0/4214642099 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55da8d7fa5d0 msgr2=0x55da8d817ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:27.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.110+0000 7faa351f5b80 1 --2- 172.21.15.83:0/4214642099 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55da8d7fa5d0 0x55da8d817ea0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7faa180040f0 tx=0x7faa18004120 comp rx=0 tx=0).stop 2024-04-01T06:58:27.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.110+0000 7faa351f5b80 1 -- 172.21.15.83:0/4214642099 shutdown_connections 2024-04-01T06:58:27.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.110+0000 7faa351f5b80 1 --2- 172.21.15.83:0/4214642099 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55da8d7fa5d0 0x55da8d817ea0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.110+0000 7faa351f5b80 1 --2- 172.21.15.83:0/4214642099 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da8d805df0 0x55da8d803470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.110+0000 7faa351f5b80 1 --2- 172.21.15.83:0/4214642099 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55da8d7faef0 0x55da8d7ef5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.110+0000 7faa351f5b80 1 -- 172.21.15.83:0/4214642099 >> 172.21.15.83:0/4214642099 conn(0x55da8d75a6a0 msgr2=0x55da8d81c830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:58:27.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.110+0000 7faa351f5b80 1 -- 172.21.15.83:0/4214642099 shutdown_connections 2024-04-01T06:58:27.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.110+0000 7faa351f5b80 1 -- 172.21.15.83:0/4214642099 wait complete. 2024-04-01T06:58:27.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.110+0000 7faa351f5b80 1 -- start start 2024-04-01T06:58:27.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.110+0000 7faa351f5b80 1 Processor -- start 2024-04-01T06:58:27.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.110+0000 7faa351f5b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da8d7fa5d0 0x55da8d80ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:27.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.110+0000 7faa351f5b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55da8d7faef0 0x55da8d80b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:27.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.110+0000 7faa351f5b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55da8d805df0 0x55da8d8618a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:27.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.111+0000 7faa351f5b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da8d861de0 con 0x55da8d7faef0 2024-04-01T06:58:27.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.111+0000 7faa351f5b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da8d861f50 con 0x55da8d7fa5d0 2024-04-01T06:58:27.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.111+0000 7faa351f5b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da8d862110 con 0x55da8d805df0 2024-04-01T06:58:27.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.111+0000 7faa351f5b80 10 client.0 _ll_register_callbacks cb 0x55da8d6f2470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:58:27.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.111+0000 7faa2259c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55da8d7faef0 0x55da8d80b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:27.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.111+0000 7faa2259c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55da8d7faef0 0x55da8d80b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:50432/0 (socket says 172.21.15.83:50432) 2024-04-01T06:58:27.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.111+0000 7faa2259c700 1 -- 172.21.15.83:0/997153641 learned_addr learned my addr 172.21.15.83:0/997153641 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:58:27.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.111+0000 7faa22d9d700 1 --2- 172.21.15.83:0/997153641 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da8d7fa5d0 0x55da8d80ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:27.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.111+0000 7faa2359e700 1 --2- 172.21.15.83:0/997153641 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55da8d805df0 0x55da8d8618a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:27.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.111+0000 7faa2259c700 1 -- 172.21.15.83:0/997153641 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55da8d805df0 msgr2=0x55da8d8618a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:27.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.111+0000 7faa2259c700 1 --2- 172.21.15.83:0/997153641 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55da8d805df0 0x55da8d8618a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.111+0000 7faa2259c700 1 -- 172.21.15.83:0/997153641 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da8d7fa5d0 msgr2=0x55da8d80ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:27.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.111+0000 7faa2259c700 1 --2- 172.21.15.83:0/997153641 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da8d7fa5d0 0x55da8d80ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.111+0000 7faa2259c700 1 -- 172.21.15.83:0/997153641 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55da8d57ab60 con 0x55da8d7faef0 2024-04-01T06:58:27.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.111+0000 7faa22d9d700 1 --2- 172.21.15.83:0/997153641 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da8d7fa5d0 0x55da8d80ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T06:58:27.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.111+0000 7faa2259c700 1 --2- 172.21.15.83:0/997153641 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55da8d7faef0 0x55da8d80b180 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7faa14005950 tx=0x7faa140045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64388280e31f29b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:58:27.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.111+0000 7faa06ff5700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:58:27.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.111+0000 7faa06ff5700 1 -- 172.21.15.83:0/997153641 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa14098400 con 0x55da8d7faef0 2024-04-01T06:58:27.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.111+0000 7faa06ff5700 1 -- 172.21.15.83:0/997153641 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7faa1401fde0 con 0x55da8d7faef0 2024-04-01T06:58:27.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.111+0000 7faa351f5b80 1 -- 172.21.15.83:0/997153641 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faa1409de90 con 0x55da8d7faef0 2024-04-01T06:58:27.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.111+0000 7faa06ff5700 1 -- 172.21.15.83:0/997153641 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa1400cd30 con 0x55da8d7faef0 2024-04-01T06:58:27.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.111+0000 7faa351f5b80 10 client.16176 fetch_fsmap learned FSMap version 30 2024-04-01T06:58:27.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.111+0000 7faa351f5b80 1 -- 172.21.15.83:0/997153641 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55da8d5d2cd0 con 0x55da8d7faef0 2024-04-01T06:58:27.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.112+0000 7faa06ff5700 1 -- 172.21.15.83:0/997153641 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa140a6020 con 0x55da8d7faef0 2024-04-01T06:58:27.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.112+0000 7faa06ff5700 1 -- 172.21.15.83:0/997153641 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 30) v1 ==== 7478+0+0 (secure 0 0 0) 0x7faa14099550 con 0x55da8d7faef0 2024-04-01T06:58:27.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.112+0000 7faa351f5b80 10 client.16176 fetch_fsmap finished waiting for FSMap version 30 2024-04-01T06:58:27.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.112+0000 7faa351f5b80 10 client.16176 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.e 2024-04-01T06:58:27.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.112+0000 7faa351f5b80 20 client.16176 populate_metadata read hostname 'smithi083' 2024-04-01T06:58:27.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.112+0000 7faa351f5b80 1 --2- 172.21.15.83:0/997153641 >> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] conn(0x55da8d86a910 0x55da8d86cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:27.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.112+0000 7faa351f5b80 4 client.16176 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-01T06:58:27.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.112+0000 7faa351f5b80 1 -- 172.21.15.83:0/997153641 --> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55da8d59bcf0 con 0x55da8d86a910 2024-04-01T06:58:27.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.112+0000 7faa22d9d700 1 --2- 172.21.15.83:0/997153641 >> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] conn(0x55da8d86a910 0x55da8d86cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:27.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.112+0000 7faa06ff5700 10 client.16176 ms_handle_connect on v2:172.21.15.145:6834/3104241497 2024-04-01T06:58:27.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.112+0000 7faa22d9d700 1 --2- 172.21.15.83:0/997153641 >> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] conn(0x55da8d86a910 0x55da8d86cd30 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=38469473e25f028e server_cookie=caa8f5390a566dd8 in_seq=0 out_seq=0 2024-04-01T06:58:27.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.113+0000 7faa06ff5700 1 -- 172.21.15.83:0/997153641 <== mds.2 v2:172.21.15.145:6834/3104241497 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19999 (crc 0 0 0) 0x55da8d59bcf0 con 0x55da8d86a910 2024-04-01T06:58:27.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.113+0000 7faa06ff5700 10 client.16176 handle_command_reply: tid=0 2024-04-01T06:58:27.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.113+0000 7faa351f5b80 1 client.16176 shutdown 2024-04-01T06:58:27.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.113+0000 7faa351f5b80 1 -- 172.21.15.83:0/997153641 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55da8d7faef0 msgr2=0x55da8d80b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:27.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.113+0000 7faa351f5b80 1 --2- 172.21.15.83:0/997153641 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55da8d7faef0 0x55da8d80b180 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7faa14005950 tx=0x7faa140045e0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.113+0000 7faa351f5b80 1 -- 172.21.15.83:0/997153641 shutdown_connections 2024-04-01T06:58:27.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.113+0000 7faa351f5b80 1 --2- 172.21.15.83:0/997153641 >> [v2:172.21.15.145:6834/3104241497,v1:172.21.15.145:6835/3104241497] conn(0x55da8d86a910 0x55da8d86cd30 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.113+0000 7faa351f5b80 1 --2- 172.21.15.83:0/997153641 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55da8d805df0 0x55da8d8618a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.113+0000 7faa351f5b80 1 --2- 172.21.15.83:0/997153641 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55da8d7fa5d0 0x55da8d80ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.113+0000 7faa351f5b80 1 --2- 172.21.15.83:0/997153641 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55da8d7faef0 0x55da8d80b180 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.113+0000 7faa06ff5700 0 client.16176 ms_handle_reset on v2:172.21.15.145:6834/3104241497 2024-04-01T06:58:27.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.113+0000 7faa351f5b80 1 -- 172.21.15.83:0/997153641 >> 172.21.15.83:0/997153641 conn(0x55da8d75a6a0 msgr2=0x55da8d7ef5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:58:27.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.113+0000 7faa351f5b80 1 -- 172.21.15.83:0/997153641 shutdown_connections 2024-04-01T06:58:27.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.113+0000 7faa351f5b80 1 -- 172.21.15.83:0/997153641 wait complete. 2024-04-01T06:58:27.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.113+0000 7faa351f5b80 20 client.16176 trim_cache size 0 max 16384 2024-04-01T06:58:27.123 INFO:teuthology.orchestra.run.smithi083.stdout:[ 2024-04-01T06:58:27.123 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.123 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.123 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 60276766, 2024-04-01T06:58:27.124 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635534, 2024-04-01T06:58:27.124 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/condvar/Makefile" 2024-04-01T06:58:27.124 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.124 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.124 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.124 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 65896724, 2024-04-01T06:58:27.124 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635560, 2024-04-01T06:58:27.124 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/pitest-1.c" 2024-04-01T06:58:27.124 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.124 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.124 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.124 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 120150707, 2024-04-01T06:58:27.124 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635536, 2024-04-01T06:58:27.125 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/robust_test" 2024-04-01T06:58:27.125 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.125 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.125 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.125 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 180236150, 2024-04-01T06:58:27.125 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635555, 2024-04-01T06:58:27.125 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/pitest-5.c" 2024-04-01T06:58:27.125 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.125 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.125 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.125 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 224242609, 2024-04-01T06:58:27.125 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635511, 2024-04-01T06:58:27.125 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/sem_sleepingbarber.c" 2024-04-01T06:58:27.125 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.126 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.126 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.126 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 237757934, 2024-04-01T06:58:27.126 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635539, 2024-04-01T06:58:27.126 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/robust_test/robust3-mode2.c" 2024-04-01T06:58:27.126 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.126 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.126 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.126 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 450672560, 2024-04-01T06:58:27.126 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635532, 2024-04-01T06:58:27.126 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/condvar" 2024-04-01T06:58:27.126 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.126 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.126 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.127 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 544595153, 2024-04-01T06:58:27.127 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635533, 2024-04-01T06:58:27.127 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/condvar/pthread_cond_wait_2.c" 2024-04-01T06:58:27.127 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.127 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.127 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.127 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 551810232, 2024-04-01T06:58:27.127 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635545, 2024-04-01T06:58:27.127 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/schedule" 2024-04-01T06:58:27.127 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.127 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.127 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.127 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 617800828, 2024-04-01T06:58:27.127 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635546, 2024-04-01T06:58:27.127 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/schedule/Makefile" 2024-04-01T06:58:27.128 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.128 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.128 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.128 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 639706239, 2024-04-01T06:58:27.128 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635515, 2024-04-01T06:58:27.128 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/run.sh" 2024-04-01T06:58:27.128 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.128 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.128 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.128 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 784819917, 2024-04-01T06:58:27.128 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635550, 2024-04-01T06:58:27.128 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/tools" 2024-04-01T06:58:27.128 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.128 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.129 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.129 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 794638181, 2024-04-01T06:58:27.129 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635501, 2024-04-01T06:58:27.129 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/mqueues/Makefile" 2024-04-01T06:58:27.129 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.129 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.129 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.129 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 936701667, 2024-04-01T06:58:27.129 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635502, 2024-04-01T06:58:27.129 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/mqueues/send_rev_1.c" 2024-04-01T06:58:27.129 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.129 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.129 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.129 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 962055227, 2024-04-01T06:58:27.129 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635498, 2024-04-01T06:58:27.130 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/mqueues" 2024-04-01T06:58:27.130 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.130 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.130 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.130 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 1147249311, 2024-04-01T06:58:27.130 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635507, 2024-04-01T06:58:27.130 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/sem_conpro.c" 2024-04-01T06:58:27.130 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.130 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.130 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.130 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 1201891782, 2024-04-01T06:58:27.130 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635547, 2024-04-01T06:58:27.130 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/schedule/1-2.c" 2024-04-01T06:58:27.130 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.131 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.131 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.131 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 1319099771, 2024-04-01T06:58:27.131 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635506, 2024-04-01T06:58:27.131 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores" 2024-04-01T06:58:27.131 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.131 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.131 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.131 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 1319786022, 2024-04-01T06:58:27.131 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635548, 2024-04-01T06:58:27.131 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/schedule/1-1.c" 2024-04-01T06:58:27.131 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.131 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.131 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.131 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 1667675555, 2024-04-01T06:58:27.132 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635562, 2024-04-01T06:58:27.132 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/pitest-3.c" 2024-04-01T06:58:27.132 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.132 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.132 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.132 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 1716702900, 2024-04-01T06:58:27.132 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635505, 2024-04-01T06:58:27.132 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/mqueues/plan.txt" 2024-04-01T06:58:27.132 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.132 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.132 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.132 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 1791831961, 2024-04-01T06:58:27.132 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635499, 2024-04-01T06:58:27.132 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/mqueues/send_rev_2.c" 2024-04-01T06:58:27.132 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.133 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.133 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.133 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 1826984951, 2024-04-01T06:58:27.133 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635565, 2024-04-01T06:58:27.133 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/include" 2024-04-01T06:58:27.133 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.133 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.133 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.133 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 1943860347, 2024-04-01T06:58:27.133 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635567, 2024-04-01T06:58:27.133 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/include/pitest.h" 2024-04-01T06:58:27.133 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.133 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.133 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.134 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 1987636652, 2024-04-01T06:58:27.134 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635530, 2024-04-01T06:58:27.134 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/plan.txt" 2024-04-01T06:58:27.134 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.134 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.134 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.134 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 1990396617, 2024-04-01T06:58:27.134 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635509, 2024-04-01T06:58:27.134 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/coverage.txt" 2024-04-01T06:58:27.134 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.134 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.135 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.135 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 1991511585, 2024-04-01T06:58:27.135 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635563, 2024-04-01T06:58:27.135 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/run.sh" 2024-04-01T06:58:27.135 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.135 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.135 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.135 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 2082773151, 2024-04-01T06:58:27.135 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635556, 2024-04-01T06:58:27.135 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/Makefile" 2024-04-01T06:58:27.135 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.135 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.135 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.135 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 2127398218, 2024-04-01T06:58:27.135 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635535, 2024-04-01T06:58:27.136 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/condvar/pthread_cond_wait_1.c" 2024-04-01T06:58:27.136 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.136 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.136 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.136 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 2159745572, 2024-04-01T06:58:27.136 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635504, 2024-04-01T06:58:27.136 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/mqueues/run.sh" 2024-04-01T06:58:27.136 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.136 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.136 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.136 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 2184029739, 2024-04-01T06:58:27.136 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635500, 2024-04-01T06:58:27.136 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/mqueues/coverage.txt" 2024-04-01T06:58:27.136 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.137 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.137 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.137 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 2256923794, 2024-04-01T06:58:27.137 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635538, 2024-04-01T06:58:27.137 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/robust_test/Makefile" 2024-04-01T06:58:27.137 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.137 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.137 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.137 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 2308321223, 2024-04-01T06:58:27.137 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635568, 2024-04-01T06:58:27.137 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/Makefile.inc" 2024-04-01T06:58:27.137 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.137 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.137 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.138 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 2367733111, 2024-04-01T06:58:27.138 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635522, 2024-04-01T06:58:27.138 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/clocks/Makefile" 2024-04-01T06:58:27.138 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.138 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.138 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.138 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 2393012308, 2024-04-01T06:58:27.138 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635529, 2024-04-01T06:58:27.138 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/run.sh" 2024-04-01T06:58:27.138 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.138 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.138 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.138 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 2404555188, 2024-04-01T06:58:27.139 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635543, 2024-04-01T06:58:27.139 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/robust_test/run.sh" 2024-04-01T06:58:27.139 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.139 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.139 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.139 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 2433992819, 2024-04-01T06:58:27.139 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635554, 2024-04-01T06:58:27.139 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/pitest-6.c" 2024-04-01T06:58:27.139 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.139 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.139 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.139 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 2434212541, 2024-04-01T06:58:27.139 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635537, 2024-04-01T06:58:27.139 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/robust_test/robust2-sun.c" 2024-04-01T06:58:27.139 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.140 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.140 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.140 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 2474236995, 2024-04-01T06:58:27.140 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635566, 2024-04-01T06:58:27.140 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/include/test.h" 2024-04-01T06:58:27.140 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.140 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.140 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.140 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 2587633722, 2024-04-01T06:58:27.140 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635527, 2024-04-01T06:58:27.140 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/timers/twoevtimers.c" 2024-04-01T06:58:27.140 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.141 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.141 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.141 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 2662544890, 2024-04-01T06:58:27.141 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635518, 2024-04-01T06:58:27.141 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/coverage.txt" 2024-04-01T06:58:27.141 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.141 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.141 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.141 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 2698890573, 2024-04-01T06:58:27.141 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635520, 2024-04-01T06:58:27.141 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/assertions.xml" 2024-04-01T06:58:27.141 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.141 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.141 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.141 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 2728815849, 2024-04-01T06:58:27.142 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635564, 2024-04-01T06:58:27.142 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/run.sh" 2024-04-01T06:58:27.142 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.142 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.142 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.142 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 2765794001, 2024-04-01T06:58:27.142 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635531, 2024-04-01T06:58:27.142 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads" 2024-04-01T06:58:27.142 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.142 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.142 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.142 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 2927433881, 2024-04-01T06:58:27.142 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635541, 2024-04-01T06:58:27.143 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/robust_test/robust1-sun.c" 2024-04-01T06:58:27.143 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.143 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.143 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.143 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 2938302468, 2024-04-01T06:58:27.143 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635513, 2024-04-01T06:58:27.143 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/sem_readerwriter.c" 2024-04-01T06:58:27.143 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.143 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.143 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.143 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 2950976311, 2024-04-01T06:58:27.143 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635519, 2024-04-01T06:58:27.143 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/Makefile" 2024-04-01T06:58:27.143 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.144 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.144 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.144 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 2955986416, 2024-04-01T06:58:27.144 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635523, 2024-04-01T06:58:27.144 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/clocks/twopsetclock.c" 2024-04-01T06:58:27.144 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.144 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.144 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.144 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 3011145272, 2024-04-01T06:58:27.144 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635544, 2024-04-01T06:58:27.144 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/robust_test/robust2-mode2.c" 2024-04-01T06:58:27.144 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.144 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.145 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.145 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 3191110378, 2024-04-01T06:58:27.145 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635517, 2024-04-01T06:58:27.145 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers" 2024-04-01T06:58:27.145 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.145 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.145 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.145 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 3213702600, 2024-04-01T06:58:27.145 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635510, 2024-04-01T06:58:27.145 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/Makefile" 2024-04-01T06:58:27.145 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.145 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.145 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.145 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 3343479020, 2024-04-01T06:58:27.145 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635553, 2024-04-01T06:58:27.146 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test" 2024-04-01T06:58:27.146 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.146 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.146 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.146 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 3415757660, 2024-04-01T06:58:27.146 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635552, 2024-04-01T06:58:27.146 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/README" 2024-04-01T06:58:27.146 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.146 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.146 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.146 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 3438368268, 2024-04-01T06:58:27.146 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635503, 2024-04-01T06:58:27.146 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/mqueues/assertions.xml" 2024-04-01T06:58:27.146 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.147 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.147 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.147 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 3474737162, 2024-04-01T06:58:27.147 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635561, 2024-04-01T06:58:27.147 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/do-plot" 2024-04-01T06:58:27.147 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.147 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.147 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.147 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 3490077428, 2024-04-01T06:58:27.147 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635549, 2024-04-01T06:58:27.147 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/Makefile" 2024-04-01T06:58:27.147 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.147 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.147 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.148 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 3511405067, 2024-04-01T06:58:27.148 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635540, 2024-04-01T06:58:27.148 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/robust_test/README" 2024-04-01T06:58:27.148 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.148 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.148 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.148 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 3515220485, 2024-04-01T06:58:27.148 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635512, 2024-04-01T06:58:27.148 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/assertions.xml" 2024-04-01T06:58:27.148 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.148 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.148 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.148 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 3534710236, 2024-04-01T06:58:27.148 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635558, 2024-04-01T06:58:27.148 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/pitest-4.c" 2024-04-01T06:58:27.149 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.149 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.149 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.149 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 3563445431, 2024-04-01T06:58:27.149 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635514, 2024-04-01T06:58:27.149 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/sem_philosopher.c" 2024-04-01T06:58:27.149 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.149 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.149 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.149 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 3581813831, 2024-04-01T06:58:27.149 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635559, 2024-04-01T06:58:27.149 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/README" 2024-04-01T06:58:27.149 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.149 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.149 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.150 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 3599049708, 2024-04-01T06:58:27.150 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635521, 2024-04-01T06:58:27.150 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/clocks" 2024-04-01T06:58:27.150 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.150 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.150 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.150 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 3641109339, 2024-04-01T06:58:27.150 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635528, 2024-04-01T06:58:27.150 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/timers/twoptimers.c" 2024-04-01T06:58:27.150 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.150 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.150 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.150 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 3698323995, 2024-04-01T06:58:27.150 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635524, 2024-04-01T06:58:27.151 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/clocks/invaliddates.c" 2024-04-01T06:58:27.151 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.151 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.151 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.151 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 3700686270, 2024-04-01T06:58:27.151 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635551, 2024-04-01T06:58:27.151 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/tools/watchdogtimer.sh" 2024-04-01T06:58:27.151 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.151 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.151 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.151 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 3785346865, 2024-04-01T06:58:27.151 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635525, 2024-04-01T06:58:27.151 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/timers" 2024-04-01T06:58:27.151 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.152 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.152 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.152 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 3987464572, 2024-04-01T06:58:27.152 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635542, 2024-04-01T06:58:27.152 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/robust_test/robust1-mode2.c" 2024-04-01T06:58:27.152 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.152 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.152 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.152 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 4004104376, 2024-04-01T06:58:27.152 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635526, 2024-04-01T06:58:27.152 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/timers/Makefile" 2024-04-01T06:58:27.152 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.152 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.152 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.152 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 4017902084, 2024-04-01T06:58:27.153 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635508, 2024-04-01T06:58:27.153 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/sem_lock.c" 2024-04-01T06:58:27.153 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.153 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.153 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.153 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 4147689201, 2024-04-01T06:58:27.153 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635557, 2024-04-01T06:58:27.153 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/pitest-2.c" 2024-04-01T06:58:27.153 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T06:58:27.153 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T06:58:27.153 INFO:teuthology.orchestra.run.smithi083.stdout: "damage_type": "backtrace", 2024-04-01T06:58:27.153 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 4182144660, 2024-04-01T06:58:27.153 INFO:teuthology.orchestra.run.smithi083.stdout: "ino": 1099511635516, 2024-04-01T06:58:27.153 INFO:teuthology.orchestra.run.smithi083.stdout: "path": "/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/plan.txt" 2024-04-01T06:58:27.153 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T06:58:27.154 INFO:teuthology.orchestra.run.smithi083.stdout:] 2024-04-01T06:58:27.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.114+0000 7faa2905f700 1 -- 172.21.15.83:0/2068446796 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7faa0c0a1290 msgr2=0x7faa0c0a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:27.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.114+0000 7faa2905f700 1 --2- 172.21.15.83:0/2068446796 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7faa0c0a1290 0x7faa0c0a3750 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7faa1c009fd0 tx=0x7faa1c0094c0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.114+0000 7faa2905f700 1 -- 172.21.15.83:0/2068446796 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa24106050 msgr2=0x7faa24100940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:27.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.114+0000 7faa2905f700 1 --2- 172.21.15.83:0/2068446796 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa24106050 0x7faa24100940 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7faa14009fd0 tx=0x7faa1400ed10 comp rx=0 tx=0).stop 2024-04-01T06:58:27.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.114+0000 7faa2905f700 1 -- 172.21.15.83:0/2068446796 shutdown_connections 2024-04-01T06:58:27.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.114+0000 7faa2905f700 1 --2- 172.21.15.83:0/2068446796 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7faa0c0a1290 0x7faa0c0a3750 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.114+0000 7faa2905f700 1 --2- 172.21.15.83:0/2068446796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa24100e80 0x7faa241a54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.114+0000 7faa2905f700 1 --2- 172.21.15.83:0/2068446796 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faa240ff490 0x7faa24100400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.114+0000 7faa2905f700 1 --2- 172.21.15.83:0/2068446796 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa24106050 0x7faa24100940 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.114+0000 7faa2905f700 1 -- 172.21.15.83:0/2068446796 >> 172.21.15.83:0/2068446796 conn(0x7faa240761e0 msgr2=0x7faa24104370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:58:27.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.114+0000 7faa2905f700 1 -- 172.21.15.83:0/2068446796 shutdown_connections 2024-04-01T06:58:27.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.114+0000 7faa2905f700 1 -- 172.21.15.83:0/2068446796 wait complete. 2024-04-01T06:58:27.156 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:58:26 smithi083 ceph-mon[43429]: pgmap v80: 97 pgs: 97 active+clean; 165 MiB data, 830 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 181 op/s 2024-04-01T06:58:27.156 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:58:26 smithi083 ceph-mon[43429]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-04-01T06:58:27.157 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-01T06:58:27.157 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-01T06:58:27.158 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:58:26 smithi153 ceph-mon[48187]: pgmap v80: 97 pgs: 97 active+clean; 165 MiB data, 830 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 181 op/s 2024-04-01T06:58:27.158 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:58:26 smithi153 ceph-mon[48187]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-04-01T06:58:27.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:58:26 smithi145 ceph-mon[47816]: pgmap v80: 97 pgs: 97 active+clean; 165 MiB data, 830 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 181 op/s 2024-04-01T06:58:27.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:58:26 smithi145 ceph-mon[47816]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-04-01T06:58:27.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.283+0000 7f2e1f883700 1 -- 172.21.15.83:0/508178700 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e180ffe50 msgr2=0x7f2e18100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:27.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.283+0000 7f2e1f883700 1 --2- 172.21.15.83:0/508178700 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e180ffe50 0x7f2e18100230 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f2e08009990 tx=0x7f2e08009ca0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.283+0000 7f2e1f883700 1 -- 172.21.15.83:0/508178700 shutdown_connections 2024-04-01T06:58:27.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.283+0000 7f2e1f883700 1 --2- 172.21.15.83:0/508178700 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e180ffe50 0x7f2e18100230 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.283+0000 7f2e1f883700 1 --2- 172.21.15.83:0/508178700 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2e18104f60 0x7f2e1810cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.283+0000 7f2e1f883700 1 --2- 172.21.15.83:0/508178700 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e18100800 0x7f2e18104830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.283+0000 7f2e1f883700 1 -- 172.21.15.83:0/508178700 >> 172.21.15.83:0/508178700 conn(0x7f2e18076d40 msgr2=0x7f2e18077150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:58:27.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.283+0000 7f2e1f883700 1 -- 172.21.15.83:0/508178700 shutdown_connections 2024-04-01T06:58:27.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.283+0000 7f2e1f883700 1 -- 172.21.15.83:0/508178700 wait complete. 2024-04-01T06:58:27.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.283+0000 7f2e1f883700 1 Processor -- start 2024-04-01T06:58:27.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.284+0000 7f2e1f883700 1 -- start start 2024-04-01T06:58:27.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.284+0000 7f2e1f883700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e180ffe50 0x7f2e181018d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:27.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.284+0000 7f2e1f883700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e18104f60 0x7f2e18101e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:27.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.284+0000 7f2e1f883700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2e18102350 0x7f2e181a53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:27.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.284+0000 7f2e1f883700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e181a59c0 con 0x7f2e18104f60 2024-04-01T06:58:27.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.284+0000 7f2e1f883700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e181a5b30 con 0x7f2e18102350 2024-04-01T06:58:27.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.284+0000 7f2e1f883700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e181a5cf0 con 0x7f2e180ffe50 2024-04-01T06:58:27.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.284+0000 7f2e1ce1e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e18104f60 0x7f2e18101e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:27.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.284+0000 7f2e1ce1e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e18104f60 0x7f2e18101e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:50440/0 (socket says 172.21.15.83:50440) 2024-04-01T06:58:27.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.284+0000 7f2e1ce1e700 1 -- 172.21.15.83:0/1751889790 learned_addr learned my addr 172.21.15.83:0/1751889790 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:58:27.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.284+0000 7f2e1de20700 1 --2- 172.21.15.83:0/1751889790 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2e18102350 0x7f2e181a53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:27.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.284+0000 7f2e1ce1e700 1 -- 172.21.15.83:0/1751889790 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e180ffe50 msgr2=0x7f2e181018d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:27.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.284+0000 7f2e1d61f700 1 --2- 172.21.15.83:0/1751889790 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e180ffe50 0x7f2e181018d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:27.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.284+0000 7f2e1ce1e700 1 --2- 172.21.15.83:0/1751889790 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e180ffe50 0x7f2e181018d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.284+0000 7f2e1ce1e700 1 -- 172.21.15.83:0/1751889790 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2e18102350 msgr2=0x7f2e181a53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:27.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.284+0000 7f2e1ce1e700 1 --2- 172.21.15.83:0/1751889790 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2e18102350 0x7f2e181a53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.284+0000 7f2e1ce1e700 1 -- 172.21.15.83:0/1751889790 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e080095f0 con 0x7f2e18104f60 2024-04-01T06:58:27.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.284+0000 7f2e1ce1e700 1 --2- 172.21.15.83:0/1751889790 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e18104f60 0x7f2e18101e10 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f2e1400c8f0 tx=0x7f2e1400cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:58:27.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.284+0000 7f2e0e7fc700 1 -- 172.21.15.83:0/1751889790 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e14007940 con 0x7f2e18104f60 2024-04-01T06:58:27.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.284+0000 7f2e0e7fc700 1 -- 172.21.15.83:0/1751889790 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e1400f450 con 0x7f2e18104f60 2024-04-01T06:58:27.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.284+0000 7f2e1f883700 1 -- 172.21.15.83:0/1751889790 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e181a5fd0 con 0x7f2e18104f60 2024-04-01T06:58:27.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.284+0000 7f2e0e7fc700 1 -- 172.21.15.83:0/1751889790 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e14018660 con 0x7f2e18104f60 2024-04-01T06:58:27.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.285+0000 7f2e1f883700 1 -- 172.21.15.83:0/1751889790 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e181a64a0 con 0x7f2e18104f60 2024-04-01T06:58:27.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.287+0000 7f2e0e7fc700 1 -- 172.21.15.83:0/1751889790 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 25) v1 ==== 135996+0+0 (secure 0 0 0) 0x7f2e1400f5c0 con 0x7f2e18104f60 2024-04-01T06:58:27.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.287+0000 7f2e0e7fc700 1 --2- 172.21.15.83:0/1751889790 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f2e040a1310 0x7f2e040a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:27.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.287+0000 7f2e1d61f700 1 --2- 172.21.15.83:0/1751889790 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f2e040a1310 0x7f2e040a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:27.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.287+0000 7f2e0e7fc700 1 -- 172.21.15.83:0/1751889790 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f2e140ccb30 con 0x7f2e18104f60 2024-04-01T06:58:27.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.288+0000 7f2e1d61f700 1 --2- 172.21.15.83:0/1751889790 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f2e040a1310 0x7f2e040a37d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2e0800b2e0 tx=0x7f2e08000bc0 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:58:27.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.288+0000 7f2e2ba19b80 1 Processor -- start 2024-04-01T06:58:27.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.288+0000 7f2e2ba19b80 1 -- start start 2024-04-01T06:58:27.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.288+0000 7f2e2ba19b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b9f9f6d5d0 0x55b9f9f6d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:27.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.288+0000 7f2e2ba19b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9f9f6def0 0x55b9f9f788b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:27.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.288+0000 7f2e2ba19b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9f9f78df0 0x55b9f9f7b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:27.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.288+0000 7f2e2ba19b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9f9ec6990 con 0x55b9f9f6def0 2024-04-01T06:58:27.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.288+0000 7f2e2ba19b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9f9ec4350 con 0x55b9f9f6d5d0 2024-04-01T06:58:27.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.288+0000 7f2e2ba19b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9f9ebfc40 con 0x55b9f9f78df0 2024-04-01T06:58:27.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.289+0000 7f2e1ce1e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9f9f6def0 0x55b9f9f788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:27.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.289+0000 7f2e1d61f700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b9f9f6d5d0 0x55b9f9f6d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:27.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.289+0000 7f2e1ce1e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9f9f6def0 0x55b9f9f788b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:50448/0 (socket says 172.21.15.83:50448) 2024-04-01T06:58:27.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.289+0000 7f2e1ce1e700 1 -- 172.21.15.83:0/572214836 learned_addr learned my addr 172.21.15.83:0/572214836 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:58:27.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.289+0000 7f2e1ce1e700 1 -- 172.21.15.83:0/572214836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9f9f78df0 msgr2=0x55b9f9f7b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:27.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.289+0000 7f2e1ce1e700 1 --2- 172.21.15.83:0/572214836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9f9f78df0 0x55b9f9f7b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.289+0000 7f2e1ce1e700 1 -- 172.21.15.83:0/572214836 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b9f9f6d5d0 msgr2=0x55b9f9f6d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:27.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.289+0000 7f2e1ce1e700 1 --2- 172.21.15.83:0/572214836 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b9f9f6d5d0 0x55b9f9f6d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.289+0000 7f2e1ce1e700 1 -- 172.21.15.83:0/572214836 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b9f9d413b0 con 0x55b9f9f6def0 2024-04-01T06:58:27.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.289+0000 7f2e1ce1e700 1 --2- 172.21.15.83:0/572214836 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9f9f6def0 0x55b9f9f788b0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f2e140a1bf0 tx=0x7f2e14099720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ab23c972c88d065 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:58:27.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.289+0000 7f2e037fe700 1 -- 172.21.15.83:0/572214836 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e140b1070 con 0x55b9f9f6def0 2024-04-01T06:58:27.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.289+0000 7f2e037fe700 1 -- 172.21.15.83:0/572214836 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e140a2120 con 0x55b9f9f6def0 2024-04-01T06:58:27.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.289+0000 7f2e037fe700 1 -- 172.21.15.83:0/572214836 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e14099f00 con 0x55b9f9f6def0 2024-04-01T06:58:27.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.290+0000 7f2e2ba19b80 1 -- 172.21.15.83:0/572214836 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9f9f6def0 msgr2=0x55b9f9f788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:27.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.290+0000 7f2e2ba19b80 1 --2- 172.21.15.83:0/572214836 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9f9f6def0 0x55b9f9f788b0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f2e140a1bf0 tx=0x7f2e14099720 comp rx=0 tx=0).stop 2024-04-01T06:58:27.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.290+0000 7f2e2ba19b80 1 -- 172.21.15.83:0/572214836 shutdown_connections 2024-04-01T06:58:27.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.290+0000 7f2e2ba19b80 1 --2- 172.21.15.83:0/572214836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9f9f78df0 0x55b9f9f7b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.290+0000 7f2e2ba19b80 1 --2- 172.21.15.83:0/572214836 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b9f9f6d5d0 0x55b9f9f6d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.290+0000 7f2e2ba19b80 1 --2- 172.21.15.83:0/572214836 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9f9f6def0 0x55b9f9f788b0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.290+0000 7f2e2ba19b80 1 -- 172.21.15.83:0/572214836 >> 172.21.15.83:0/572214836 conn(0x55b9f9ecd6a0 msgr2=0x55b9f9f69a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:58:27.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.290+0000 7f2e2ba19b80 1 -- 172.21.15.83:0/572214836 shutdown_connections 2024-04-01T06:58:27.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.290+0000 7f2e2ba19b80 1 -- 172.21.15.83:0/572214836 wait complete. 2024-04-01T06:58:27.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.290+0000 7f2e2ba19b80 1 -- start start 2024-04-01T06:58:27.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.290+0000 7f2e2ba19b80 1 Processor -- start 2024-04-01T06:58:27.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.291+0000 7f2e2ba19b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b9f9f6d5d0 0x55b9f9f787b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:27.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.291+0000 7f2e2ba19b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9f9f6def0 0x55b9f9f75aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:27.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.291+0000 7f2e2ba19b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9f9f78df0 0x55b9f9f76120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:27.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.291+0000 7f2e2ba19b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9f9e5bd80 con 0x55b9f9f6def0 2024-04-01T06:58:27.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.291+0000 7f2e2ba19b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9f9e5ba20 con 0x55b9f9f6d5d0 2024-04-01T06:58:27.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.291+0000 7f2e2ba19b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9f9d436a0 con 0x55b9f9f78df0 2024-04-01T06:58:27.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.291+0000 7f2e2ba19b80 10 client.0 _ll_register_callbacks cb 0x55b9f9e65470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:58:27.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.291+0000 7f2e1ce1e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9f9f6def0 0x55b9f9f75aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:27.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.291+0000 7f2e1ce1e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9f9f6def0 0x55b9f9f75aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:50464/0 (socket says 172.21.15.83:50464) 2024-04-01T06:58:27.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.291+0000 7f2e1ce1e700 1 -- 172.21.15.83:0/3645759174 learned_addr learned my addr 172.21.15.83:0/3645759174 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:58:27.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.291+0000 7f2e1d61f700 1 --2- 172.21.15.83:0/3645759174 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b9f9f6d5d0 0x55b9f9f787b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:27.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.291+0000 7f2e1ce1e700 1 -- 172.21.15.83:0/3645759174 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9f9f78df0 msgr2=0x55b9f9f76120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:27.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.291+0000 7f2e1ce1e700 1 --2- 172.21.15.83:0/3645759174 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9f9f78df0 0x55b9f9f76120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.291+0000 7f2e1ce1e700 1 -- 172.21.15.83:0/3645759174 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b9f9f6d5d0 msgr2=0x55b9f9f787b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:27.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.291+0000 7f2e1ce1e700 1 --2- 172.21.15.83:0/3645759174 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b9f9f6d5d0 0x55b9f9f787b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.291+0000 7f2e1ce1e700 1 -- 172.21.15.83:0/3645759174 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e181a64a0 con 0x55b9f9f6def0 2024-04-01T06:58:27.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.291+0000 7f2e1ce1e700 1 --2- 172.21.15.83:0/3645759174 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9f9f6def0 0x55b9f9f75aa0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f2e1400c8c0 tx=0x7f2e140ca300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbe58f20689c6288 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:58:27.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.291+0000 7f2e00ff9700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:58:27.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.291+0000 7f2e00ff9700 1 -- 172.21.15.83:0/3645759174 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e140b1030 con 0x55b9f9f6def0 2024-04-01T06:58:27.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.291+0000 7f2e00ff9700 1 -- 172.21.15.83:0/3645759174 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f2e140b2070 con 0x55b9f9f6def0 2024-04-01T06:58:27.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.291+0000 7f2e2ba19b80 1 -- 172.21.15.83:0/3645759174 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b9f9e80380 con 0x55b9f9f6def0 2024-04-01T06:58:27.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.291+0000 7f2e00ff9700 1 -- 172.21.15.83:0/3645759174 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e140993a0 con 0x55b9f9f6def0 2024-04-01T06:58:27.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.291+0000 7f2e2ba19b80 10 client.16188 fetch_fsmap learned FSMap version 30 2024-04-01T06:58:27.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.291+0000 7f2e2ba19b80 1 -- 172.21.15.83:0/3645759174 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55b9f9cedb60 con 0x55b9f9f6def0 2024-04-01T06:58:27.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.292+0000 7f2e00ff9700 1 -- 172.21.15.83:0/3645759174 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b9f9e80380 con 0x55b9f9f6def0 2024-04-01T06:58:27.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.292+0000 7f2e00ff9700 1 -- 172.21.15.83:0/3645759174 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 30) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f2e1407f020 con 0x55b9f9f6def0 2024-04-01T06:58:27.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.292+0000 7f2e2ba19b80 10 client.16188 fetch_fsmap finished waiting for FSMap version 30 2024-04-01T06:58:27.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.292+0000 7f2e2ba19b80 10 client.16188 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-04-01T06:58:27.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.292+0000 7f2e2ba19b80 20 client.16188 populate_metadata read hostname 'smithi083' 2024-04-01T06:58:27.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.292+0000 7f2e2ba19b80 1 --2- 172.21.15.83:0/3645759174 >> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] conn(0x55b9f9f88480 0x55b9f9f8a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:27.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.292+0000 7f2e2ba19b80 4 client.16188 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-01T06:58:27.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.292+0000 7f2e2ba19b80 1 -- 172.21.15.83:0/3645759174 --> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b9f9eb8700 con 0x55b9f9f88480 2024-04-01T06:58:27.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.292+0000 7f2e1d61f700 1 --2- 172.21.15.83:0/3645759174 >> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] conn(0x55b9f9f88480 0x55b9f9f8a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:27.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.292+0000 7f2e00ff9700 10 client.16188 ms_handle_connect on v2:172.21.15.145:6836/2687798317 2024-04-01T06:58:27.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.292+0000 7f2e1d61f700 1 --2- 172.21.15.83:0/3645759174 >> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] conn(0x55b9f9f88480 0x55b9f9f8a870 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=21a7a663049b6770 server_cookie=3e3cb48a8df01452 in_seq=0 out_seq=0 2024-04-01T06:58:27.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.293+0000 7f2e00ff9700 1 -- 172.21.15.83:0/3645759174 <== mds.1 v2:172.21.15.145:6836/2687798317 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b9f9eb8700 con 0x55b9f9f88480 2024-04-01T06:58:27.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.293+0000 7f2e00ff9700 10 client.16188 handle_command_reply: tid=0 2024-04-01T06:58:27.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.293+0000 7f2e2ba19b80 1 client.16188 shutdown 2024-04-01T06:58:27.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.293+0000 7f2e2ba19b80 1 -- 172.21.15.83:0/3645759174 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9f9f6def0 msgr2=0x55b9f9f75aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:27.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.293+0000 7f2e2ba19b80 1 --2- 172.21.15.83:0/3645759174 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9f9f6def0 0x55b9f9f75aa0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f2e1400c8c0 tx=0x7f2e140ca300 comp rx=0 tx=0).stop 2024-04-01T06:58:27.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.293+0000 7f2e2ba19b80 1 -- 172.21.15.83:0/3645759174 shutdown_connections 2024-04-01T06:58:27.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.293+0000 7f2e2ba19b80 1 --2- 172.21.15.83:0/3645759174 >> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] conn(0x55b9f9f88480 0x55b9f9f8a870 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.293+0000 7f2e2ba19b80 1 --2- 172.21.15.83:0/3645759174 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9f9f78df0 0x55b9f9f76120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.293+0000 7f2e2ba19b80 1 --2- 172.21.15.83:0/3645759174 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b9f9f6d5d0 0x55b9f9f787b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.293+0000 7f2e00ff9700 0 client.16188 ms_handle_reset on v2:172.21.15.145:6836/2687798317 2024-04-01T06:58:27.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.293+0000 7f2e2ba19b80 1 --2- 172.21.15.83:0/3645759174 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9f9f6def0 0x55b9f9f75aa0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.293+0000 7f2e2ba19b80 1 -- 172.21.15.83:0/3645759174 >> 172.21.15.83:0/3645759174 conn(0x55b9f9ecd6a0 msgr2=0x55b9f9f6f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:58:27.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.293+0000 7f2e2ba19b80 1 -- 172.21.15.83:0/3645759174 shutdown_connections 2024-04-01T06:58:27.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.293+0000 7f2e2ba19b80 1 -- 172.21.15.83:0/3645759174 wait complete. 2024-04-01T06:58:27.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.293+0000 7f2e2ba19b80 20 client.16188 trim_cache size 0 max 16384 2024-04-01T06:58:27.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.307+0000 7f2e2ba19b80 1 Processor -- start 2024-04-01T06:58:27.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.307+0000 7f2e2ba19b80 1 -- start start 2024-04-01T06:58:27.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.307+0000 7f2e2ba19b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9f9f6d5d0 0x55b9f9f743d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:27.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.307+0000 7f2e2ba19b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b9f9f6def0 0x55b9f9f74910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:27.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.307+0000 7f2e2ba19b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9f9f78df0 0x55b9f9f84160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:27.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.307+0000 7f2e2ba19b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9f9f854b0 con 0x55b9f9f78df0 2024-04-01T06:58:27.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.307+0000 7f2e2ba19b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9f9f657e0 con 0x55b9f9f6def0 2024-04-01T06:58:27.312 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.307+0000 7f2e2ba19b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9f9f769f0 con 0x55b9f9f6d5d0 2024-04-01T06:58:27.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.307+0000 7f2e1de20700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9f9f78df0 0x55b9f9f84160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:27.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.307+0000 7f2e1ce1e700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b9f9f6def0 0x55b9f9f74910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:27.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.307+0000 7f2e1de20700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9f9f78df0 0x55b9f9f84160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:50470/0 (socket says 172.21.15.83:50470) 2024-04-01T06:58:27.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.307+0000 7f2e1de20700 1 -- 172.21.15.83:0/105124141 learned_addr learned my addr 172.21.15.83:0/105124141 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:58:27.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.307+0000 7f2e1d61f700 1 --2- 172.21.15.83:0/105124141 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9f9f6d5d0 0x55b9f9f743d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:27.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.307+0000 7f2e1de20700 1 -- 172.21.15.83:0/105124141 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9f9f6d5d0 msgr2=0x55b9f9f743d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:27.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.307+0000 7f2e1de20700 1 --2- 172.21.15.83:0/105124141 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9f9f6d5d0 0x55b9f9f743d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.307+0000 7f2e1de20700 1 -- 172.21.15.83:0/105124141 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b9f9f6def0 msgr2=0x55b9f9f74910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:27.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.307+0000 7f2e1de20700 1 --2- 172.21.15.83:0/105124141 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b9f9f6def0 0x55b9f9f74910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.307+0000 7f2e1de20700 1 -- 172.21.15.83:0/105124141 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b9f9e85ea0 con 0x55b9f9f78df0 2024-04-01T06:58:27.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.307+0000 7f2e1de20700 1 --2- 172.21.15.83:0/105124141 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9f9f78df0 0x55b9f9f84160 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f2e100115b0 tx=0x7f2e100118c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b0513c4a89645c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:58:27.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.308+0000 7f2e03fff700 1 -- 172.21.15.83:0/105124141 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1000e040 con 0x55b9f9f78df0 2024-04-01T06:58:27.313 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.308+0000 7f2e03fff700 1 -- 172.21.15.83:0/105124141 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e1000f040 con 0x55b9f9f78df0 2024-04-01T06:58:27.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.308+0000 7f2e03fff700 1 -- 172.21.15.83:0/105124141 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e100046e0 con 0x55b9f9f78df0 2024-04-01T06:58:27.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.308+0000 7f2e2ba19b80 1 -- 172.21.15.83:0/105124141 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9f9f78df0 msgr2=0x55b9f9f84160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:27.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.308+0000 7f2e2ba19b80 1 --2- 172.21.15.83:0/105124141 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9f9f78df0 0x55b9f9f84160 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f2e100115b0 tx=0x7f2e100118c0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.308+0000 7f2e2ba19b80 1 -- 172.21.15.83:0/105124141 shutdown_connections 2024-04-01T06:58:27.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.308+0000 7f2e2ba19b80 1 --2- 172.21.15.83:0/105124141 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9f9f78df0 0x55b9f9f84160 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.308+0000 7f2e2ba19b80 1 --2- 172.21.15.83:0/105124141 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9f9f6d5d0 0x55b9f9f743d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.308+0000 7f2e2ba19b80 1 --2- 172.21.15.83:0/105124141 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b9f9f6def0 0x55b9f9f74910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.308+0000 7f2e2ba19b80 1 -- 172.21.15.83:0/105124141 >> 172.21.15.83:0/105124141 conn(0x55b9f9ecd6a0 msgr2=0x55b9f9f70e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:58:27.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.308+0000 7f2e2ba19b80 1 -- 172.21.15.83:0/105124141 shutdown_connections 2024-04-01T06:58:27.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.308+0000 7f2e2ba19b80 1 -- 172.21.15.83:0/105124141 wait complete. 2024-04-01T06:58:27.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.309+0000 7f2e2ba19b80 1 -- start start 2024-04-01T06:58:27.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.309+0000 7f2e2ba19b80 1 Processor -- start 2024-04-01T06:58:27.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.309+0000 7f2e2ba19b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9f9f6d5d0 0x55b9f9f7f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:27.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.309+0000 7f2e2ba19b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b9f9f6def0 0x55b9f9f7e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:27.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.309+0000 7f2e2ba19b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9f9f78df0 0x55b9f9f7e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:27.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.309+0000 7f2e2ba19b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9f9f7ec90 con 0x55b9f9f78df0 2024-04-01T06:58:27.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.309+0000 7f2e2ba19b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9f9f7ee00 con 0x55b9f9f6def0 2024-04-01T06:58:27.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.309+0000 7f2e2ba19b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9f9fdc1e0 con 0x55b9f9f6d5d0 2024-04-01T06:58:27.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.309+0000 7f2e2ba19b80 10 client.0 _ll_register_callbacks cb 0x55b9f9e65470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:58:27.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.309+0000 7f2e1de20700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9f9f78df0 0x55b9f9f7e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:27.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.309+0000 7f2e1ce1e700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b9f9f6def0 0x55b9f9f7e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:27.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.309+0000 7f2e1ce1e700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b9f9f6def0 0x55b9f9f7e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.83:60312/0 (socket says 172.21.15.83:60312) 2024-04-01T06:58:27.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.309+0000 7f2e1d61f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9f9f6d5d0 0x55b9f9f7f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:27.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.309+0000 7f2e1de20700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9f9f78df0 0x55b9f9f7e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:50478/0 (socket says 172.21.15.83:50478) 2024-04-01T06:58:27.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.309+0000 7f2e1ce1e700 1 -- 172.21.15.83:0/1353630258 learned_addr learned my addr 172.21.15.83:0/1353630258 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:58:27.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.310+0000 7f2e1de20700 1 -- 172.21.15.83:0/1353630258 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9f9f6d5d0 msgr2=0x55b9f9f7f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:27.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.310+0000 7f2e1de20700 1 --2- 172.21.15.83:0/1353630258 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9f9f6d5d0 0x55b9f9f7f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.310+0000 7f2e1de20700 1 -- 172.21.15.83:0/1353630258 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b9f9f6def0 msgr2=0x55b9f9f7e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:27.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.310+0000 7f2e1de20700 1 --2- 172.21.15.83:0/1353630258 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b9f9f6def0 0x55b9f9f7e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.310+0000 7f2e1de20700 1 -- 172.21.15.83:0/1353630258 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e10011230 con 0x55b9f9f78df0 2024-04-01T06:58:27.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.310+0000 7f2e1ce1e700 1 --2- 172.21.15.83:0/1353630258 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b9f9f6def0 0x55b9f9f7e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T06:58:27.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.310+0000 7f2e1de20700 1 --2- 172.21.15.83:0/1353630258 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9f9f78df0 0x55b9f9f7e550 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f2e10009960 tx=0x7f2e10003c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a5e541c64514fa0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:58:27.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.310+0000 7f2e00ff9700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:58:27.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.310+0000 7f2e00ff9700 1 -- 172.21.15.83:0/1353630258 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1000e070 con 0x55b9f9f78df0 2024-04-01T06:58:27.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.310+0000 7f2e00ff9700 1 -- 172.21.15.83:0/1353630258 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f2e10003e20 con 0x55b9f9f78df0 2024-04-01T06:58:27.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.310+0000 7f2e2ba19b80 1 -- 172.21.15.83:0/1353630258 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2e140a2120 con 0x55b9f9f78df0 2024-04-01T06:58:27.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.310+0000 7f2e00ff9700 1 -- 172.21.15.83:0/1353630258 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e10011ed0 con 0x55b9f9f78df0 2024-04-01T06:58:27.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.310+0000 7f2e2ba19b80 10 client.16194 fetch_fsmap learned FSMap version 30 2024-04-01T06:58:27.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.310+0000 7f2e2ba19b80 1 -- 172.21.15.83:0/1353630258 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55b9f9d45cd0 con 0x55b9f9f78df0 2024-04-01T06:58:27.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.310+0000 7f2e00ff9700 1 -- 172.21.15.83:0/1353630258 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e140a2120 con 0x55b9f9f78df0 2024-04-01T06:58:27.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.310+0000 7f2e00ff9700 1 -- 172.21.15.83:0/1353630258 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 30) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f2e1002d020 con 0x55b9f9f78df0 2024-04-01T06:58:27.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.310+0000 7f2e2ba19b80 10 client.16194 fetch_fsmap finished waiting for FSMap version 30 2024-04-01T06:58:27.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.310+0000 7f2e2ba19b80 10 client.16194 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-04-01T06:58:27.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.310+0000 7f2e2ba19b80 20 client.16194 populate_metadata read hostname 'smithi083' 2024-04-01T06:58:27.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.310+0000 7f2e2ba19b80 1 --2- 172.21.15.83:0/1353630258 >> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] conn(0x55b9f9fdd830 0x55b9f9fdfc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:27.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.310+0000 7f2e2ba19b80 4 client.16194 mds_command: new command op to 24494 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-01T06:58:27.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.310+0000 7f2e2ba19b80 1 -- 172.21.15.83:0/1353630258 --> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55b9f9d0ecf0 con 0x55b9f9fdd830 2024-04-01T06:58:27.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.311+0000 7f2e1d61f700 1 --2- 172.21.15.83:0/1353630258 >> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] conn(0x55b9f9fdd830 0x55b9f9fdfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:27.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.311+0000 7f2e00ff9700 10 client.16194 ms_handle_connect on v2:172.21.15.145:6836/2687798317 2024-04-01T06:58:27.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.311+0000 7f2e1d61f700 1 --2- 172.21.15.83:0/1353630258 >> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] conn(0x55b9f9fdd830 0x55b9f9fdfc20 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=76357ca70a413ec5 server_cookie=49ddf0e7ec6fad6e in_seq=0 out_seq=0 2024-04-01T06:58:27.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.311+0000 7f2e00ff9700 1 -- 172.21.15.83:0/1353630258 <== mds.1 v2:172.21.15.145:6836/2687798317 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55b9f9d0ecf0 con 0x55b9f9fdd830 2024-04-01T06:58:27.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.311+0000 7f2e00ff9700 10 client.16194 handle_command_reply: tid=0 2024-04-01T06:58:27.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.311+0000 7f2e2ba19b80 1 client.16194 shutdown 2024-04-01T06:58:27.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.311+0000 7f2e2ba19b80 1 -- 172.21.15.83:0/1353630258 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9f9f78df0 msgr2=0x55b9f9f7e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:27.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.311+0000 7f2e2ba19b80 1 --2- 172.21.15.83:0/1353630258 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9f9f78df0 0x55b9f9f7e550 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f2e10009960 tx=0x7f2e10003c30 comp rx=0 tx=0).stop 2024-04-01T06:58:27.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.311+0000 7f2e2ba19b80 1 -- 172.21.15.83:0/1353630258 shutdown_connections 2024-04-01T06:58:27.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.311+0000 7f2e2ba19b80 1 --2- 172.21.15.83:0/1353630258 >> [v2:172.21.15.145:6836/2687798317,v1:172.21.15.145:6837/2687798317] conn(0x55b9f9fdd830 0x55b9f9fdfc20 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.311+0000 7f2e2ba19b80 1 --2- 172.21.15.83:0/1353630258 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55b9f9f78df0 0x55b9f9f7e550 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.311+0000 7f2e2ba19b80 1 --2- 172.21.15.83:0/1353630258 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b9f9f6d5d0 0x55b9f9f7f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.311+0000 7f2e2ba19b80 1 --2- 172.21.15.83:0/1353630258 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b9f9f6def0 0x55b9f9f7e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.311+0000 7f2e00ff9700 0 client.16194 ms_handle_reset on v2:172.21.15.145:6836/2687798317 2024-04-01T06:58:27.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.311+0000 7f2e2ba19b80 1 -- 172.21.15.83:0/1353630258 >> 172.21.15.83:0/1353630258 conn(0x55b9f9ecd6a0 msgr2=0x55b9f9f74390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:58:27.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.311+0000 7f2e2ba19b80 1 -- 172.21.15.83:0/1353630258 shutdown_connections 2024-04-01T06:58:27.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.311+0000 7f2e2ba19b80 1 -- 172.21.15.83:0/1353630258 wait complete. 2024-04-01T06:58:27.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.312+0000 7f2e2ba19b80 20 client.16194 trim_cache size 0 max 16384 2024-04-01T06:58:27.321 INFO:teuthology.orchestra.run.smithi083.stdout:[] 2024-04-01T06:58:27.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.312+0000 7f2e1f883700 1 -- 172.21.15.83:0/1751889790 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f2e040a1310 msgr2=0x7f2e040a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:27.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.312+0000 7f2e1f883700 1 --2- 172.21.15.83:0/1751889790 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f2e040a1310 0x7f2e040a37d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2e0800b2e0 tx=0x7f2e08000bc0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.312+0000 7f2e1f883700 1 -- 172.21.15.83:0/1751889790 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e18104f60 msgr2=0x7f2e18101e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:27.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.312+0000 7f2e1f883700 1 --2- 172.21.15.83:0/1751889790 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e18104f60 0x7f2e18101e10 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f2e1400c8f0 tx=0x7f2e1400cc00 comp rx=0 tx=0).stop 2024-04-01T06:58:27.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.312+0000 7f2e1f883700 1 -- 172.21.15.83:0/1751889790 shutdown_connections 2024-04-01T06:58:27.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.312+0000 7f2e1f883700 1 --2- 172.21.15.83:0/1751889790 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f2e040a1310 0x7f2e040a37d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.312+0000 7f2e1f883700 1 --2- 172.21.15.83:0/1751889790 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2e18102350 0x7f2e181a53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.312+0000 7f2e1f883700 1 --2- 172.21.15.83:0/1751889790 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e180ffe50 0x7f2e181018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.312+0000 7f2e1f883700 1 --2- 172.21.15.83:0/1751889790 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e18104f60 0x7f2e18101e10 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.312+0000 7f2e1f883700 1 -- 172.21.15.83:0/1751889790 >> 172.21.15.83:0/1751889790 conn(0x7f2e18076d40 msgr2=0x7f2e18068230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:58:27.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.312+0000 7f2e1f883700 1 -- 172.21.15.83:0/1751889790 shutdown_connections 2024-04-01T06:58:27.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.312+0000 7f2e1f883700 1 -- 172.21.15.83:0/1751889790 wait complete. 2024-04-01T06:58:27.324 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-01T06:58:27.324 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-01T06:58:27.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.450+0000 7f8e6a333700 1 -- 172.21.15.83:0/1761256016 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e64100f70 msgr2=0x7f8e64101350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:27.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.450+0000 7f8e6a333700 1 --2- 172.21.15.83:0/1761256016 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e64100f70 0x7f8e64101350 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f8e54009990 tx=0x7f8e54009ca0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.450+0000 7f8e6a333700 1 -- 172.21.15.83:0/1761256016 shutdown_connections 2024-04-01T06:58:27.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.450+0000 7f8e6a333700 1 --2- 172.21.15.83:0/1761256016 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e64100f70 0x7f8e64101350 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.450+0000 7f8e6a333700 1 --2- 172.21.15.83:0/1761256016 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e64106090 0x7f8e6410dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.450+0000 7f8e6a333700 1 --2- 172.21.15.83:0/1761256016 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e64101920 0x7f8e64105960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.450+0000 7f8e6a333700 1 -- 172.21.15.83:0/1761256016 >> 172.21.15.83:0/1761256016 conn(0x7f8e640fc7f0 msgr2=0x7f8e640fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:58:27.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.450+0000 7f8e6a333700 1 -- 172.21.15.83:0/1761256016 shutdown_connections 2024-04-01T06:58:27.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.450+0000 7f8e6a333700 1 -- 172.21.15.83:0/1761256016 wait complete. 2024-04-01T06:58:27.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.451+0000 7f8e6a333700 1 Processor -- start 2024-04-01T06:58:27.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.451+0000 7f8e6a333700 1 -- start start 2024-04-01T06:58:27.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.451+0000 7f8e6a333700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e64100f70 0x7f8e64197220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:27.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.451+0000 7f8e6a333700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e64106090 0x7f8e64197760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:27.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.451+0000 7f8e6a333700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e6419bb00 0x7f8e6419bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:27.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.451+0000 7f8e6a333700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6419c580 con 0x7f8e6419bb00 2024-04-01T06:58:27.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.451+0000 7f8e6a333700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6419c6f0 con 0x7f8e64100f70 2024-04-01T06:58:27.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.451+0000 7f8e6a333700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6419c8b0 con 0x7f8e64106090 2024-04-01T06:58:27.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.451+0000 7f8e688d0700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e6419bb00 0x7f8e6419bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:27.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.451+0000 7f8e63fff700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e64100f70 0x7f8e64197220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:27.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.451+0000 7f8e688d0700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e6419bb00 0x7f8e6419bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:50502/0 (socket says 172.21.15.83:50502) 2024-04-01T06:58:27.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.451+0000 7f8e688d0700 1 -- 172.21.15.83:0/2771354815 learned_addr learned my addr 172.21.15.83:0/2771354815 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:58:27.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.452+0000 7f8e637fe700 1 --2- 172.21.15.83:0/2771354815 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e64106090 0x7f8e64197760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:27.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.452+0000 7f8e688d0700 1 -- 172.21.15.83:0/2771354815 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e64106090 msgr2=0x7f8e64197760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:27.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.452+0000 7f8e688d0700 1 --2- 172.21.15.83:0/2771354815 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e64106090 0x7f8e64197760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.452+0000 7f8e688d0700 1 -- 172.21.15.83:0/2771354815 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e64100f70 msgr2=0x7f8e64197220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:27.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.452+0000 7f8e688d0700 1 --2- 172.21.15.83:0/2771354815 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e64100f70 0x7f8e64197220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.452+0000 7f8e688d0700 1 -- 172.21.15.83:0/2771354815 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e540095f0 con 0x7f8e6419bb00 2024-04-01T06:58:27.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.452+0000 7f8e63fff700 1 --2- 172.21.15.83:0/2771354815 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e64100f70 0x7f8e64197220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T06:58:27.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.452+0000 7f8e688d0700 1 --2- 172.21.15.83:0/2771354815 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e6419bb00 0x7f8e6419bf80 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c007ee0 tx=0x7f8e5c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:58:27.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.452+0000 7f8e617fa700 1 -- 172.21.15.83:0/2771354815 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e5c017070 con 0x7f8e6419bb00 2024-04-01T06:58:27.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.452+0000 7f8e617fa700 1 -- 172.21.15.83:0/2771354815 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8e5c00f040 con 0x7f8e6419bb00 2024-04-01T06:58:27.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.452+0000 7f8e6a333700 1 -- 172.21.15.83:0/2771354815 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e641a3e10 con 0x7f8e6419bb00 2024-04-01T06:58:27.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.452+0000 7f8e617fa700 1 -- 172.21.15.83:0/2771354815 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e5c005580 con 0x7f8e6419bb00 2024-04-01T06:58:27.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.452+0000 7f8e6a333700 1 -- 172.21.15.83:0/2771354815 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e641a42a0 con 0x7f8e6419bb00 2024-04-01T06:58:27.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.454+0000 7f8e617fa700 1 -- 172.21.15.83:0/2771354815 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 25) v1 ==== 135996+0+0 (secure 0 0 0) 0x7f8e5c00db20 con 0x7f8e6419bb00 2024-04-01T06:58:27.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.455+0000 7f8e617fa700 1 --2- 172.21.15.83:0/2771354815 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f8e4c0a1290 0x7f8e4c0a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:27.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.455+0000 7f8e63fff700 1 --2- 172.21.15.83:0/2771354815 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f8e4c0a1290 0x7f8e4c0a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:27.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.456+0000 7f8e617fa700 1 -- 172.21.15.83:0/2771354815 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f8e5c0cc350 con 0x7f8e6419bb00 2024-04-01T06:58:27.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.456+0000 7f8e63fff700 1 --2- 172.21.15.83:0/2771354815 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f8e4c0a1290 0x7f8e4c0a3750 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8e5400b2e0 tx=0x7f8e54005fd0 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:58:27.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.456+0000 7f8e764c9b80 1 Processor -- start 2024-04-01T06:58:27.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.456+0000 7f8e764c9b80 1 -- start start 2024-04-01T06:58:27.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.456+0000 7f8e764c9b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fedffbb5d0 0x55fedffbb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:27.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.456+0000 7f8e764c9b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fedffbbef0 0x55fedffcacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:27.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.456+0000 7f8e764c9b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fedffcb200 0x55fedffcd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:27.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.456+0000 7f8e764c9b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fedff14990 con 0x55fedffbbef0 2024-04-01T06:58:27.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.456+0000 7f8e764c9b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fedff12350 con 0x55fedffbb5d0 2024-04-01T06:58:27.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.456+0000 7f8e764c9b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fedff0dc40 con 0x55fedffcb200 2024-04-01T06:58:27.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.456+0000 7f8e637fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fedffbbef0 0x55fedffcacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:27.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.456+0000 7f8e637fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fedffbbef0 0x55fedffcacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:50506/0 (socket says 172.21.15.83:50506) 2024-04-01T06:58:27.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.456+0000 7f8e637fe700 1 -- 172.21.15.83:0/3650869445 learned_addr learned my addr 172.21.15.83:0/3650869445 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:58:27.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.456+0000 7f8e63fff700 1 --2- 172.21.15.83:0/3650869445 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fedffbb5d0 0x55fedffbb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:27.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.457+0000 7f8e637fe700 1 -- 172.21.15.83:0/3650869445 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fedffcb200 msgr2=0x55fedffcd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:27.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.457+0000 7f8e637fe700 1 --2- 172.21.15.83:0/3650869445 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fedffcb200 0x55fedffcd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.457+0000 7f8e637fe700 1 -- 172.21.15.83:0/3650869445 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fedffbb5d0 msgr2=0x55fedffbb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:27.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.457+0000 7f8e637fe700 1 --2- 172.21.15.83:0/3650869445 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fedffbb5d0 0x55fedffbb9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.457+0000 7f8e637fe700 1 -- 172.21.15.83:0/3650869445 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fedfd8f3b0 con 0x55fedffbbef0 2024-04-01T06:58:27.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.457+0000 7f8e637fe700 1 --2- 172.21.15.83:0/3650869445 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fedffbbef0 0x55fedffcacc0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f8e58009cf0 tx=0x7f8e58011440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a797b5099380ea58 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:58:27.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.457+0000 7f8e4a7fc700 1 -- 172.21.15.83:0/3650869445 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e58011d80 con 0x55fedffbbef0 2024-04-01T06:58:27.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.457+0000 7f8e4a7fc700 1 -- 172.21.15.83:0/3650869445 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8e58004510 con 0x55fedffbbef0 2024-04-01T06:58:27.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.457+0000 7f8e4a7fc700 1 -- 172.21.15.83:0/3650869445 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e58005240 con 0x55fedffbbef0 2024-04-01T06:58:27.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.458+0000 7f8e764c9b80 1 -- 172.21.15.83:0/3650869445 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fedffbbef0 msgr2=0x55fedffcacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:27.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.458+0000 7f8e764c9b80 1 --2- 172.21.15.83:0/3650869445 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fedffbbef0 0x55fedffcacc0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f8e58009cf0 tx=0x7f8e58011440 comp rx=0 tx=0).stop 2024-04-01T06:58:27.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.458+0000 7f8e764c9b80 1 -- 172.21.15.83:0/3650869445 shutdown_connections 2024-04-01T06:58:27.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.458+0000 7f8e764c9b80 1 --2- 172.21.15.83:0/3650869445 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fedffcb200 0x55fedffcd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.458+0000 7f8e764c9b80 1 --2- 172.21.15.83:0/3650869445 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fedffbb5d0 0x55fedffbb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.458+0000 7f8e764c9b80 1 --2- 172.21.15.83:0/3650869445 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fedffbbef0 0x55fedffcacc0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.458+0000 7f8e764c9b80 1 -- 172.21.15.83:0/3650869445 >> 172.21.15.83:0/3650869445 conn(0x55fedff1b6a0 msgr2=0x55fedffb7a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:58:27.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.458+0000 7f8e764c9b80 1 -- 172.21.15.83:0/3650869445 shutdown_connections 2024-04-01T06:58:27.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.458+0000 7f8e764c9b80 1 -- 172.21.15.83:0/3650869445 wait complete. 2024-04-01T06:58:27.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.458+0000 7f8e764c9b80 1 -- start start 2024-04-01T06:58:27.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.458+0000 7f8e764c9b80 1 Processor -- start 2024-04-01T06:58:27.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.458+0000 7f8e764c9b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fedffbb5d0 0x55fedffcab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:27.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.458+0000 7f8e764c9b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fedffbbef0 0x55fedffc7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:27.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.458+0000 7f8e764c9b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fedffcb200 0x55fedffc84e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:27.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.459+0000 7f8e764c9b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fedfea9d80 con 0x55fedffbb5d0 2024-04-01T06:58:27.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.459+0000 7f8e764c9b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fedfea9a20 con 0x55fedffbbef0 2024-04-01T06:58:27.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.459+0000 7f8e764c9b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fedfd916a0 con 0x55fedffcb200 2024-04-01T06:58:27.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.459+0000 7f8e764c9b80 10 client.0 _ll_register_callbacks cb 0x55fedfeb3470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:58:27.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.459+0000 7f8e63fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fedffbb5d0 0x55fedffcab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:27.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.459+0000 7f8e63fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fedffbb5d0 0x55fedffcab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:50510/0 (socket says 172.21.15.83:50510) 2024-04-01T06:58:27.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.459+0000 7f8e63fff700 1 -- 172.21.15.83:0/30947773 learned_addr learned my addr 172.21.15.83:0/30947773 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:58:27.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.459+0000 7f8e637fe700 1 --2- 172.21.15.83:0/30947773 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fedffbbef0 0x55fedffc7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:27.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.459+0000 7f8e63fff700 1 -- 172.21.15.83:0/30947773 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fedffcb200 msgr2=0x55fedffc84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:27.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.459+0000 7f8e688d0700 1 --2- 172.21.15.83:0/30947773 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fedffcb200 0x55fedffc84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:27.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.459+0000 7f8e63fff700 1 --2- 172.21.15.83:0/30947773 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fedffcb200 0x55fedffc84e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.459+0000 7f8e63fff700 1 -- 172.21.15.83:0/30947773 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fedffbbef0 msgr2=0x55fedffc7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:27.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.459+0000 7f8e63fff700 1 --2- 172.21.15.83:0/30947773 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fedffbbef0 0x55fedffc7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.459+0000 7f8e63fff700 1 -- 172.21.15.83:0/30947773 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e58009920 con 0x55fedffbb5d0 2024-04-01T06:58:27.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.459+0000 7f8e637fe700 1 --2- 172.21.15.83:0/30947773 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fedffbbef0 0x55fedffc7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T06:58:27.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.459+0000 7f8e63fff700 1 --2- 172.21.15.83:0/30947773 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fedffbb5d0 0x55fedffcab70 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f8e54009990 tx=0x7f8e5401a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff8c55402e347e69 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:58:27.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.459+0000 7f8e437fe700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:58:27.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.459+0000 7f8e437fe700 1 -- 172.21.15.83:0/30947773 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e5402b050 con 0x55fedffbb5d0 2024-04-01T06:58:27.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.459+0000 7f8e437fe700 1 -- 172.21.15.83:0/30947773 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f8e540056c0 con 0x55fedffbb5d0 2024-04-01T06:58:27.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.459+0000 7f8e764c9b80 1 -- 172.21.15.83:0/30947773 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fedfece380 con 0x55fedffbb5d0 2024-04-01T06:58:27.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.459+0000 7f8e437fe700 1 -- 172.21.15.83:0/30947773 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e54026a10 con 0x55fedffbb5d0 2024-04-01T06:58:27.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.459+0000 7f8e764c9b80 10 client.16206 fetch_fsmap learned FSMap version 30 2024-04-01T06:58:27.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.459+0000 7f8e764c9b80 1 -- 172.21.15.83:0/30947773 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55fedfd3bb60 con 0x55fedffbb5d0 2024-04-01T06:58:27.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.460+0000 7f8e437fe700 1 -- 172.21.15.83:0/30947773 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55fedfece380 con 0x55fedffbb5d0 2024-04-01T06:58:27.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.460+0000 7f8e437fe700 1 -- 172.21.15.83:0/30947773 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 30) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f8e54024bd0 con 0x55fedffbb5d0 2024-04-01T06:58:27.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.460+0000 7f8e764c9b80 10 client.16206 fetch_fsmap finished waiting for FSMap version 30 2024-04-01T06:58:27.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.460+0000 7f8e764c9b80 10 client.16206 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-01T06:58:27.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.460+0000 7f8e764c9b80 20 client.16206 populate_metadata read hostname 'smithi083' 2024-04-01T06:58:27.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.460+0000 7f8e764c9b80 1 --2- 172.21.15.83:0/30947773 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55fedffdae80 0x55fedffdd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:27.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.460+0000 7f8e764c9b80 4 client.16206 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-01T06:58:27.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.460+0000 7f8e764c9b80 1 -- 172.21.15.83:0/30947773 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fedff06700 con 0x55fedffdae80 2024-04-01T06:58:27.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.460+0000 7f8e637fe700 1 --2- 172.21.15.83:0/30947773 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55fedffdae80 0x55fedffdd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:27.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.460+0000 7f8e437fe700 10 client.16206 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:58:27.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.460+0000 7f8e637fe700 1 --2- 172.21.15.83:0/30947773 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55fedffdae80 0x55fedffdd2a0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbb61ab2724fdcd5 server_cookie=f8e613bd2e9f7eb9 in_seq=0 out_seq=0 2024-04-01T06:58:27.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.475+0000 7f8e437fe700 1 -- 172.21.15.83:0/30947773 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fedff06700 con 0x55fedffdae80 2024-04-01T06:58:27.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.475+0000 7f8e437fe700 10 client.16206 handle_command_reply: tid=0 2024-04-01T06:58:27.475 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.475+0000 7f8e764c9b80 1 client.16206 shutdown 2024-04-01T06:58:27.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.475+0000 7f8e764c9b80 1 -- 172.21.15.83:0/30947773 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fedffbb5d0 msgr2=0x55fedffcab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:27.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.475+0000 7f8e764c9b80 1 --2- 172.21.15.83:0/30947773 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fedffbb5d0 0x55fedffcab70 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f8e54009990 tx=0x7f8e5401a050 comp rx=0 tx=0).stop 2024-04-01T06:58:27.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.475+0000 7f8e764c9b80 1 -- 172.21.15.83:0/30947773 shutdown_connections 2024-04-01T06:58:27.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.475+0000 7f8e764c9b80 1 --2- 172.21.15.83:0/30947773 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55fedffdae80 0x55fedffdd2a0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.475+0000 7f8e764c9b80 1 --2- 172.21.15.83:0/30947773 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fedffbb5d0 0x55fedffcab70 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.475+0000 7f8e437fe700 0 client.16206 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:58:27.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.475+0000 7f8e764c9b80 1 --2- 172.21.15.83:0/30947773 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fedffcb200 0x55fedffc84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.475+0000 7f8e764c9b80 1 --2- 172.21.15.83:0/30947773 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fedffbbef0 0x55fedffc7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.475+0000 7f8e764c9b80 1 -- 172.21.15.83:0/30947773 >> 172.21.15.83:0/30947773 conn(0x55fedff1b6a0 msgr2=0x55fedffbd6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:58:27.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.475+0000 7f8e764c9b80 1 -- 172.21.15.83:0/30947773 shutdown_connections 2024-04-01T06:58:27.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.475+0000 7f8e764c9b80 1 -- 172.21.15.83:0/30947773 wait complete. 2024-04-01T06:58:27.476 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.475+0000 7f8e764c9b80 20 client.16206 trim_cache size 0 max 16384 2024-04-01T06:58:27.490 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.488+0000 7f8e764c9b80 1 Processor -- start 2024-04-01T06:58:27.490 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.488+0000 7f8e764c9b80 1 -- start start 2024-04-01T06:58:27.490 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.489+0000 7f8e764c9b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fedffbb5d0 0x55fedffdd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:27.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.489+0000 7f8e764c9b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fedffbbef0 0x55fedffd1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:27.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.489+0000 7f8e764c9b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fedffcb200 0x55fedffb0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:27.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.489+0000 7f8e764c9b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fedffd23f0 con 0x55fedffcb200 2024-04-01T06:58:27.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.489+0000 7f8e764c9b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fedffc6400 con 0x55fedffbbef0 2024-04-01T06:58:27.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.489+0000 7f8e764c9b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fedffb9320 con 0x55fedffbb5d0 2024-04-01T06:58:27.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.489+0000 7f8e688d0700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fedffcb200 0x55fedffb0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:27.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.489+0000 7f8e688d0700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fedffcb200 0x55fedffb0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:50526/0 (socket says 172.21.15.83:50526) 2024-04-01T06:58:27.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.489+0000 7f8e688d0700 1 -- 172.21.15.83:0/2290350575 learned_addr learned my addr 172.21.15.83:0/2290350575 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:58:27.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.489+0000 7f8e637fe700 1 --2- 172.21.15.83:0/2290350575 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fedffbbef0 0x55fedffd1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:27.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.489+0000 7f8e63fff700 1 --2- 172.21.15.83:0/2290350575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fedffbb5d0 0x55fedffdd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:27.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.489+0000 7f8e688d0700 1 -- 172.21.15.83:0/2290350575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fedffbb5d0 msgr2=0x55fedffdd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:27.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.489+0000 7f8e688d0700 1 --2- 172.21.15.83:0/2290350575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fedffbb5d0 0x55fedffdd270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.489+0000 7f8e688d0700 1 -- 172.21.15.83:0/2290350575 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fedffbbef0 msgr2=0x55fedffd1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:27.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.489+0000 7f8e688d0700 1 --2- 172.21.15.83:0/2290350575 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fedffbbef0 0x55fedffd1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.489+0000 7f8e688d0700 1 -- 172.21.15.83:0/2290350575 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fedfed3ea0 con 0x55fedffcb200 2024-04-01T06:58:27.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.489+0000 7f8e688d0700 1 --2- 172.21.15.83:0/2290350575 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fedffcb200 0x55fedffb0f70 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c0a1410 tx=0x7f8e5c0951c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=116147dacde429c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:58:27.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.489+0000 7f8e4affd700 1 -- 172.21.15.83:0/2290350575 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e5c09d120 con 0x55fedffcb200 2024-04-01T06:58:27.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.489+0000 7f8e4affd700 1 -- 172.21.15.83:0/2290350575 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8e5c0994c0 con 0x55fedffcb200 2024-04-01T06:58:27.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.489+0000 7f8e4affd700 1 -- 172.21.15.83:0/2290350575 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e5c0978f0 con 0x55fedffcb200 2024-04-01T06:58:27.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.490+0000 7f8e764c9b80 1 -- 172.21.15.83:0/2290350575 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fedffcb200 msgr2=0x55fedffb0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:27.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.490+0000 7f8e764c9b80 1 --2- 172.21.15.83:0/2290350575 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fedffcb200 0x55fedffb0f70 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c0a1410 tx=0x7f8e5c0951c0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.490+0000 7f8e764c9b80 1 -- 172.21.15.83:0/2290350575 shutdown_connections 2024-04-01T06:58:27.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.490+0000 7f8e764c9b80 1 --2- 172.21.15.83:0/2290350575 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fedffcb200 0x55fedffb0f70 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.490+0000 7f8e764c9b80 1 --2- 172.21.15.83:0/2290350575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fedffbb5d0 0x55fedffdd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.490+0000 7f8e764c9b80 1 --2- 172.21.15.83:0/2290350575 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fedffbbef0 0x55fedffd1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.490+0000 7f8e764c9b80 1 -- 172.21.15.83:0/2290350575 >> 172.21.15.83:0/2290350575 conn(0x55fedff1b6a0 msgr2=0x55fedffb05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:58:27.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.490+0000 7f8e764c9b80 1 -- 172.21.15.83:0/2290350575 shutdown_connections 2024-04-01T06:58:27.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.490+0000 7f8e764c9b80 1 -- 172.21.15.83:0/2290350575 wait complete. 2024-04-01T06:58:27.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.490+0000 7f8e764c9b80 1 -- start start 2024-04-01T06:58:27.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.491+0000 7f8e764c9b80 1 Processor -- start 2024-04-01T06:58:27.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.491+0000 7f8e764c9b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fedffbb5d0 0x55fedffd1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:27.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.491+0000 7f8e764c9b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fedffbbef0 0x55fedffd1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:27.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.491+0000 7f8e764c9b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fedffcb200 0x55fedffcfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:27.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.491+0000 7f8e764c9b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fedffd03a0 con 0x55fedffbbef0 2024-04-01T06:58:27.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.491+0000 7f8e764c9b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fedffd0510 con 0x55fedffcb200 2024-04-01T06:58:27.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.491+0000 7f8e764c9b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fedffd06d0 con 0x55fedffbb5d0 2024-04-01T06:58:27.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.491+0000 7f8e764c9b80 10 client.0 _ll_register_callbacks cb 0x55fedfeb3470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:58:27.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.491+0000 7f8e637fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fedffbbef0 0x55fedffd1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:27.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.491+0000 7f8e637fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fedffbbef0 0x55fedffd1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:50528/0 (socket says 172.21.15.83:50528) 2024-04-01T06:58:27.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.491+0000 7f8e637fe700 1 -- 172.21.15.83:0/3546019438 learned_addr learned my addr 172.21.15.83:0/3546019438 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:58:27.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.491+0000 7f8e63fff700 1 --2- 172.21.15.83:0/3546019438 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fedffbb5d0 0x55fedffd1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:27.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.491+0000 7f8e688d0700 1 --2- 172.21.15.83:0/3546019438 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fedffcb200 0x55fedffcfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:27.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.491+0000 7f8e637fe700 1 -- 172.21.15.83:0/3546019438 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fedffbb5d0 msgr2=0x55fedffd1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:27.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.491+0000 7f8e637fe700 1 --2- 172.21.15.83:0/3546019438 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fedffbb5d0 0x55fedffd1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.491+0000 7f8e637fe700 1 -- 172.21.15.83:0/3546019438 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fedffcb200 msgr2=0x55fedffcfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:27.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.491+0000 7f8e637fe700 1 --2- 172.21.15.83:0/3546019438 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fedffcb200 0x55fedffcfcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.491+0000 7f8e637fe700 1 -- 172.21.15.83:0/3546019438 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e641a42a0 con 0x55fedffbbef0 2024-04-01T06:58:27.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.491+0000 7f8e688d0700 1 --2- 172.21.15.83:0/3546019438 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fedffcb200 0x55fedffcfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:58:27.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.492+0000 7f8e637fe700 1 --2- 172.21.15.83:0/3546019438 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fedffbbef0 0x55fedffd1c40 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f8e58011790 tx=0x7f8e58009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ec25ca4b9995307 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:58:27.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.492+0000 7f8e437fe700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:58:27.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.492+0000 7f8e437fe700 1 -- 172.21.15.83:0/3546019438 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e58029040 con 0x55fedffbbef0 2024-04-01T06:58:27.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.492+0000 7f8e437fe700 1 -- 172.21.15.83:0/3546019438 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f8e58004b30 con 0x55fedffbbef0 2024-04-01T06:58:27.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.492+0000 7f8e764c9b80 1 -- 172.21.15.83:0/3546019438 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8e58004510 con 0x55fedffbbef0 2024-04-01T06:58:27.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.492+0000 7f8e437fe700 1 -- 172.21.15.83:0/3546019438 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e58004d40 con 0x55fedffbbef0 2024-04-01T06:58:27.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.492+0000 7f8e764c9b80 10 client.16212 fetch_fsmap learned FSMap version 30 2024-04-01T06:58:27.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.492+0000 7f8e764c9b80 1 -- 172.21.15.83:0/3546019438 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55fedfd93cd0 con 0x55fedffbbef0 2024-04-01T06:58:27.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.492+0000 7f8e437fe700 1 -- 172.21.15.83:0/3546019438 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8e58004510 con 0x55fedffbbef0 2024-04-01T06:58:27.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.492+0000 7f8e437fe700 1 -- 172.21.15.83:0/3546019438 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 30) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f8e5803b6d0 con 0x55fedffbbef0 2024-04-01T06:58:27.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.492+0000 7f8e764c9b80 10 client.16212 fetch_fsmap finished waiting for FSMap version 30 2024-04-01T06:58:27.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.492+0000 7f8e764c9b80 10 client.16212 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-04-01T06:58:27.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.492+0000 7f8e764c9b80 20 client.16212 populate_metadata read hostname 'smithi083' 2024-04-01T06:58:27.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.492+0000 7f8e764c9b80 1 --2- 172.21.15.83:0/3546019438 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55fee002fe90 0x55fee00322b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:27.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.492+0000 7f8e764c9b80 4 client.16212 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-01T06:58:27.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.492+0000 7f8e764c9b80 1 -- 172.21.15.83:0/3546019438 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55fedfd5ccf0 con 0x55fee002fe90 2024-04-01T06:58:27.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.492+0000 7f8e63fff700 1 --2- 172.21.15.83:0/3546019438 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55fee002fe90 0x55fee00322b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:27.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.493+0000 7f8e63fff700 1 --2- 172.21.15.83:0/3546019438 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55fee002fe90 0x55fee00322b0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9f906f3108e1d60 server_cookie=cc47c29bc556f3e in_seq=0 out_seq=0 2024-04-01T06:58:27.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.493+0000 7f8e437fe700 10 client.16212 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:58:27.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.493+0000 7f8e437fe700 1 -- 172.21.15.83:0/3546019438 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55fedfd5ccf0 con 0x55fee002fe90 2024-04-01T06:58:27.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.493+0000 7f8e437fe700 10 client.16212 handle_command_reply: tid=0 2024-04-01T06:58:27.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.493+0000 7f8e764c9b80 1 client.16212 shutdown 2024-04-01T06:58:27.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.493+0000 7f8e764c9b80 1 -- 172.21.15.83:0/3546019438 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fedffbbef0 msgr2=0x55fedffd1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:27.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.493+0000 7f8e764c9b80 1 --2- 172.21.15.83:0/3546019438 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fedffbbef0 0x55fedffd1c40 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f8e58011790 tx=0x7f8e58009780 comp rx=0 tx=0).stop 2024-04-01T06:58:27.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.493+0000 7f8e764c9b80 1 -- 172.21.15.83:0/3546019438 shutdown_connections 2024-04-01T06:58:27.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.493+0000 7f8e764c9b80 1 --2- 172.21.15.83:0/3546019438 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55fee002fe90 0x55fee00322b0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.493+0000 7f8e764c9b80 1 --2- 172.21.15.83:0/3546019438 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fedffcb200 0x55fedffcfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.493+0000 7f8e437fe700 0 client.16212 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:58:27.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.493+0000 7f8e764c9b80 1 --2- 172.21.15.83:0/3546019438 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fedffbb5d0 0x55fedffd1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.493+0000 7f8e764c9b80 1 --2- 172.21.15.83:0/3546019438 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55fedffbbef0 0x55fedffd1c40 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.493+0000 7f8e764c9b80 1 -- 172.21.15.83:0/3546019438 >> 172.21.15.83:0/3546019438 conn(0x55fedff1b6a0 msgr2=0x55fedffc31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:58:27.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.493+0000 7f8e764c9b80 1 -- 172.21.15.83:0/3546019438 shutdown_connections 2024-04-01T06:58:27.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.493+0000 7f8e764c9b80 1 -- 172.21.15.83:0/3546019438 wait complete. 2024-04-01T06:58:27.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.493+0000 7f8e764c9b80 20 client.16212 trim_cache size 0 max 16384 2024-04-01T06:58:27.500 INFO:teuthology.orchestra.run.smithi083.stdout:[] 2024-04-01T06:58:27.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.494+0000 7f8e6a333700 1 -- 172.21.15.83:0/2771354815 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f8e4c0a1290 msgr2=0x7f8e4c0a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:27.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.494+0000 7f8e6a333700 1 --2- 172.21.15.83:0/2771354815 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f8e4c0a1290 0x7f8e4c0a3750 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8e5400b2e0 tx=0x7f8e54005fd0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.494+0000 7f8e6a333700 1 -- 172.21.15.83:0/2771354815 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e6419bb00 msgr2=0x7f8e6419bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:27.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.494+0000 7f8e6a333700 1 --2- 172.21.15.83:0/2771354815 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e6419bb00 0x7f8e6419bf80 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c007ee0 tx=0x7f8e5c00d3b0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.494+0000 7f8e6a333700 1 -- 172.21.15.83:0/2771354815 shutdown_connections 2024-04-01T06:58:27.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.494+0000 7f8e6a333700 1 --2- 172.21.15.83:0/2771354815 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f8e4c0a1290 0x7f8e4c0a3750 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.494+0000 7f8e6a333700 1 --2- 172.21.15.83:0/2771354815 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e6419bb00 0x7f8e6419bf80 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.494+0000 7f8e6a333700 1 --2- 172.21.15.83:0/2771354815 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e64100f70 0x7f8e64197220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.494+0000 7f8e6a333700 1 --2- 172.21.15.83:0/2771354815 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e64106090 0x7f8e64197760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:27.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.494+0000 7f8e6a333700 1 -- 172.21.15.83:0/2771354815 >> 172.21.15.83:0/2771354815 conn(0x7f8e640fc7f0 msgr2=0x7f8e640fdb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:58:27.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.494+0000 7f8e6a333700 1 -- 172.21.15.83:0/2771354815 shutdown_connections 2024-04-01T06:58:27.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T06:58:27.494+0000 7f8e6a333700 1 -- 172.21.15.83:0/2771354815 wait complete. 2024-04-01T06:58:27.506 ERROR:tasks.fwd_scrub:rank 2 damaged: [{'damage_type': 'backtrace', 'id': 60276766, 'ino': 1099511635534, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/condvar/Makefile'}, {'damage_type': 'backtrace', 'id': 65896724, 'ino': 1099511635560, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/pitest-1.c'}, {'damage_type': 'backtrace', 'id': 120150707, 'ino': 1099511635536, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/robust_test'}, {'damage_type': 'backtrace', 'id': 180236150, 'ino': 1099511635555, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/pitest-5.c'}, {'damage_type': 'backtrace', 'id': 224242609, 'ino': 1099511635511, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/sem_sleepingbarber.c'}, {'damage_type': 'backtrace', 'id': 237757934, 'ino': 1099511635539, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/robust_test/robust3-mode2.c'}, {'damage_type': 'backtrace', 'id': 450672560, 'ino': 1099511635532, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/condvar'}, {'damage_type': 'backtrace', 'id': 544595153, 'ino': 1099511635533, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/condvar/pthread_cond_wait_2.c'}, {'damage_type': 'backtrace', 'id': 551810232, 'ino': 1099511635545, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/schedule'}, {'damage_type': 'backtrace', 'id': 617800828, 'ino': 1099511635546, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/schedule/Makefile'}, {'damage_type': 'backtrace', 'id': 639706239, 'ino': 1099511635515, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/run.sh'}, {'damage_type': 'backtrace', 'id': 784819917, 'ino': 1099511635550, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/tools'}, {'damage_type': 'backtrace', 'id': 794638181, 'ino': 1099511635501, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/mqueues/Makefile'}, {'damage_type': 'backtrace', 'id': 936701667, 'ino': 1099511635502, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/mqueues/send_rev_1.c'}, {'damage_type': 'backtrace', 'id': 962055227, 'ino': 1099511635498, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/mqueues'}, {'damage_type': 'backtrace', 'id': 1147249311, 'ino': 1099511635507, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/sem_conpro.c'}, {'damage_type': 'backtrace', 'id': 1201891782, 'ino': 1099511635547, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/schedule/1-2.c'}, {'damage_type': 'backtrace', 'id': 1319099771, 'ino': 1099511635506, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores'}, {'damage_type': 'backtrace', 'id': 1319786022, 'ino': 1099511635548, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/schedule/1-1.c'}, {'damage_type': 'backtrace', 'id': 1667675555, 'ino': 1099511635562, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/pitest-3.c'}, {'damage_type': 'backtrace', 'id': 1716702900, 'ino': 1099511635505, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/mqueues/plan.txt'}, {'damage_type': 'backtrace', 'id': 1791831961, 'ino': 1099511635499, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/mqueues/send_rev_2.c'}, {'damage_type': 'backtrace', 'id': 1826984951, 'ino': 1099511635565, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/include'}, {'damage_type': 'backtrace', 'id': 1943860347, 'ino': 1099511635567, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/include/pitest.h'}, {'damage_type': 'backtrace', 'id': 1987636652, 'ino': 1099511635530, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/plan.txt'}, {'damage_type': 'backtrace', 'id': 1990396617, 'ino': 1099511635509, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/coverage.txt'}, {'damage_type': 'backtrace', 'id': 1991511585, 'ino': 1099511635563, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/run.sh'}, {'damage_type': 'backtrace', 'id': 2082773151, 'ino': 1099511635556, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/Makefile'}, {'damage_type': 'backtrace', 'id': 2127398218, 'ino': 1099511635535, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/condvar/pthread_cond_wait_1.c'}, {'damage_type': 'backtrace', 'id': 2159745572, 'ino': 1099511635504, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/mqueues/run.sh'}, {'damage_type': 'backtrace', 'id': 2184029739, 'ino': 1099511635500, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/mqueues/coverage.txt'}, {'damage_type': 'backtrace', 'id': 2256923794, 'ino': 1099511635538, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/robust_test/Makefile'}, {'damage_type': 'backtrace', 'id': 2308321223, 'ino': 1099511635568, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/Makefile.inc'}, {'damage_type': 'backtrace', 'id': 2367733111, 'ino': 1099511635522, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/clocks/Makefile'}, {'damage_type': 'backtrace', 'id': 2393012308, 'ino': 1099511635529, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/run.sh'}, {'damage_type': 'backtrace', 'id': 2404555188, 'ino': 1099511635543, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/robust_test/run.sh'}, {'damage_type': 'backtrace', 'id': 2433992819, 'ino': 1099511635554, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/pitest-6.c'}, {'damage_type': 'backtrace', 'id': 2434212541, 'ino': 1099511635537, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/robust_test/robust2-sun.c'}, {'damage_type': 'backtrace', 'id': 2474236995, 'ino': 1099511635566, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/include/test.h'}, {'damage_type': 'backtrace', 'id': 2587633722, 'ino': 1099511635527, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/timers/twoevtimers.c'}, {'damage_type': 'backtrace', 'id': 2662544890, 'ino': 1099511635518, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/coverage.txt'}, {'damage_type': 'backtrace', 'id': 2698890573, 'ino': 1099511635520, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/assertions.xml'}, {'damage_type': 'backtrace', 'id': 2728815849, 'ino': 1099511635564, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/run.sh'}, {'damage_type': 'backtrace', 'id': 2765794001, 'ino': 1099511635531, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads'}, {'damage_type': 'backtrace', 'id': 2927433881, 'ino': 1099511635541, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/robust_test/robust1-sun.c'}, {'damage_type': 'backtrace', 'id': 2938302468, 'ino': 1099511635513, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/sem_readerwriter.c'}, {'damage_type': 'backtrace', 'id': 2950976311, 'ino': 1099511635519, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/Makefile'}, {'damage_type': 'backtrace', 'id': 2955986416, 'ino': 1099511635523, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/clocks/twopsetclock.c'}, {'damage_type': 'backtrace', 'id': 3011145272, 'ino': 1099511635544, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/robust_test/robust2-mode2.c'}, {'damage_type': 'backtrace', 'id': 3191110378, 'ino': 1099511635517, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers'}, {'damage_type': 'backtrace', 'id': 3213702600, 'ino': 1099511635510, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/Makefile'}, {'damage_type': 'backtrace', 'id': 3343479020, 'ino': 1099511635553, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test'}, {'damage_type': 'backtrace', 'id': 3415757660, 'ino': 1099511635552, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/README'}, {'damage_type': 'backtrace', 'id': 3438368268, 'ino': 1099511635503, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/mqueues/assertions.xml'}, {'damage_type': 'backtrace', 'id': 3474737162, 'ino': 1099511635561, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/do-plot'}, {'damage_type': 'backtrace', 'id': 3490077428, 'ino': 1099511635549, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/Makefile'}, {'damage_type': 'backtrace', 'id': 3511405067, 'ino': 1099511635540, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/robust_test/README'}, {'damage_type': 'backtrace', 'id': 3515220485, 'ino': 1099511635512, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/assertions.xml'}, {'damage_type': 'backtrace', 'id': 3534710236, 'ino': 1099511635558, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/pitest-4.c'}, {'damage_type': 'backtrace', 'id': 3563445431, 'ino': 1099511635514, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/sem_philosopher.c'}, {'damage_type': 'backtrace', 'id': 3581813831, 'ino': 1099511635559, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/README'}, {'damage_type': 'backtrace', 'id': 3599049708, 'ino': 1099511635521, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/clocks'}, {'damage_type': 'backtrace', 'id': 3641109339, 'ino': 1099511635528, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/timers/twoptimers.c'}, {'damage_type': 'backtrace', 'id': 3698323995, 'ino': 1099511635524, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/clocks/invaliddates.c'}, {'damage_type': 'backtrace', 'id': 3700686270, 'ino': 1099511635551, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/tools/watchdogtimer.sh'}, {'damage_type': 'backtrace', 'id': 3785346865, 'ino': 1099511635525, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/timers'}, {'damage_type': 'backtrace', 'id': 3987464572, 'ino': 1099511635542, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/robust_test/robust1-mode2.c'}, {'damage_type': 'backtrace', 'id': 4004104376, 'ino': 1099511635526, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/timers/timers/Makefile'}, {'damage_type': 'backtrace', 'id': 4017902084, 'ino': 1099511635508, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/sem_lock.c'}, {'damage_type': 'backtrace', 'id': 4147689201, 'ino': 1099511635557, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/threads/pi_test/pitest-2.c'}, {'damage_type': 'backtrace', 'id': 4182144660, 'ino': 1099511635516, 'path': '/volumes/qa/sv_1/7747a261-d796-4d30-94d6-a3bb0531c579/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/functional/semaphores/plan.txt'}] 2024-04-01T06:58:27.506 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_5df3435b30085cc9abc1eb282ab0f20651c8a39a/qa/tasks/fwd_scrub.py", line 38, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph_5df3435b30085cc9abc1eb282ab0f20651c8a39a/qa/tasks/fwd_scrub.py", line 55, in do_scrub self._scrub() File "/home/teuthworker/src/git.ceph.com_ceph_5df3435b30085cc9abc1eb282ab0f20651c8a39a/qa/tasks/fwd_scrub.py", line 79, in _scrub self._check_damage() File "/home/teuthworker/src/git.ceph.com_ceph_5df3435b30085cc9abc1eb282ab0f20651c8a39a/qa/tasks/fwd_scrub.py", line 90, in _check_damage raise RuntimeError(f"rank damage found: {types}") RuntimeError: rank damage found: {'backtrace'} 2024-04-01T06:58:28.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:58:27 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/336560054' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:58:28.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:58:27 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/336560054' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:58:28.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:58:27 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/336560054' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T06:58:29.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:58:28 smithi153 ceph-mon[48187]: pgmap v81: 97 pgs: 97 active+clean; 165 MiB data, 830 MiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 897 KiB/s wr, 96 op/s 2024-04-01T06:58:29.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:58:28 smithi145 ceph-mon[47816]: pgmap v81: 97 pgs: 97 active+clean; 165 MiB data, 830 MiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 897 KiB/s wr, 96 op/s 2024-04-01T06:58:29.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:58:28 smithi083 ceph-mon[43429]: pgmap v81: 97 pgs: 97 active+clean; 165 MiB data, 830 MiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 897 KiB/s wr, 96 op/s 2024-04-01T06:58:31.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:58:30 smithi153 ceph-mon[48187]: pgmap v82: 97 pgs: 97 active+clean; 165 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 172 op/s 2024-04-01T06:58:31.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:58:30 smithi145 ceph-mon[47816]: pgmap v82: 97 pgs: 97 active+clean; 165 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 172 op/s 2024-04-01T06:58:31.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:58:30 smithi083 ceph-mon[43429]: pgmap v82: 97 pgs: 97 active+clean; 165 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 172 op/s 2024-04-01T06:58:32.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:58:31 smithi153 ceph-mon[48187]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-04-01T06:58:32.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:58:31 smithi145 ceph-mon[47816]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-04-01T06:58:32.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:58:31 smithi083 ceph-mon[43429]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-04-01T06:58:33.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:58:32 smithi153 ceph-mon[48187]: pgmap v83: 97 pgs: 97 active+clean; 165 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 913 KiB/s rd, 1.0 MiB/s wr, 114 op/s 2024-04-01T06:58:33.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:58:32 smithi145 ceph-mon[47816]: pgmap v83: 97 pgs: 97 active+clean; 165 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 913 KiB/s rd, 1.0 MiB/s wr, 114 op/s 2024-04-01T06:58:33.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:58:32 smithi083 ceph-mon[43429]: pgmap v83: 97 pgs: 97 active+clean; 165 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 913 KiB/s rd, 1.0 MiB/s wr, 114 op/s 2024-04-01T06:58:35.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:58:34 smithi153 ceph-mon[48187]: pgmap v84: 97 pgs: 97 active+clean; 165 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 913 KiB/s rd, 1.0 MiB/s wr, 114 op/s 2024-04-01T06:58:35.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:58:34 smithi145 ceph-mon[47816]: pgmap v84: 97 pgs: 97 active+clean; 165 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 913 KiB/s rd, 1.0 MiB/s wr, 114 op/s 2024-04-01T06:58:35.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:58:34 smithi083 ceph-mon[43429]: pgmap v84: 97 pgs: 97 active+clean; 165 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 913 KiB/s rd, 1.0 MiB/s wr, 114 op/s 2024-04-01T06:58:37.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:58:36 smithi145 ceph-mon[47816]: pgmap v85: 97 pgs: 97 active+clean; 174 MiB data, 866 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 215 op/s 2024-04-01T06:58:37.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:58:36 smithi145 ceph-mon[47816]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-04-01T06:58:37.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:58:36 smithi083 ceph-mon[43429]: pgmap v85: 97 pgs: 97 active+clean; 174 MiB data, 866 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 215 op/s 2024-04-01T06:58:37.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:58:36 smithi083 ceph-mon[43429]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-04-01T06:58:37.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:58:36 smithi153 ceph-mon[48187]: pgmap v85: 97 pgs: 97 active+clean; 174 MiB data, 866 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 215 op/s 2024-04-01T06:58:37.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:58:36 smithi153 ceph-mon[48187]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-04-01T06:58:38.707 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.704+0000 7f5320a81700 1 -- 172.21.15.83:0/4165082224 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f531c106030 msgr2=0x7f531c10dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:38.707 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.704+0000 7f5320a81700 1 --2- 172.21.15.83:0/4165082224 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f531c106030 0x7f531c10dbb0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f531400b0a0 tx=0x7f531400b3b0 comp rx=0 tx=0).stop 2024-04-01T06:58:38.707 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.705+0000 7f5320a81700 1 -- 172.21.15.83:0/4165082224 shutdown_connections 2024-04-01T06:58:38.707 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.705+0000 7f5320a81700 1 --2- 172.21.15.83:0/4165082224 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f531c106030 0x7f531c10dbb0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:38.707 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.705+0000 7f5320a81700 1 --2- 172.21.15.83:0/4165082224 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f531c100f10 0x7f531c1012f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:38.707 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.705+0000 7f5320a81700 1 --2- 172.21.15.83:0/4165082224 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f531c1018c0 0x7f531c105900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:38.707 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.705+0000 7f5320a81700 1 -- 172.21.15.83:0/4165082224 >> 172.21.15.83:0/4165082224 conn(0x7f531c0fc770 msgr2=0x7f531c0feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:58:38.708 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.705+0000 7f5320a81700 1 -- 172.21.15.83:0/4165082224 shutdown_connections 2024-04-01T06:58:38.708 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.705+0000 7f5320a81700 1 -- 172.21.15.83:0/4165082224 wait complete. 2024-04-01T06:58:38.708 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.705+0000 7f5320a81700 1 Processor -- start 2024-04-01T06:58:38.708 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.705+0000 7f5320a81700 1 -- start start 2024-04-01T06:58:38.708 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.706+0000 7f5320a81700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f531c100f10 0x7f531c1972e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:38.708 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.706+0000 7f5320a81700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f531c106030 0x7f531c197820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:38.708 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.706+0000 7f5320a81700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f531c19bb70 0x7f531c19bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:38.708 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.706+0000 7f5320a81700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f531c19c5f0 con 0x7f531c19bb70 2024-04-01T06:58:38.708 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.706+0000 7f5320a81700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f531c19c760 con 0x7f531c106030 2024-04-01T06:58:38.708 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.706+0000 7f5320a81700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f531c19c920 con 0x7f531c100f10 2024-04-01T06:58:38.708 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.706+0000 7f531ad9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f531c19bb70 0x7f531c19bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:38.708 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.706+0000 7f531ad9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f531c19bb70 0x7f531c19bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43176/0 (socket says 172.21.15.83:43176) 2024-04-01T06:58:38.708 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.706+0000 7f531ad9d700 1 -- 172.21.15.83:0/1599103094 learned_addr learned my addr 172.21.15.83:0/1599103094 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:58:38.709 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.706+0000 7f5319d9b700 1 --2- 172.21.15.83:0/1599103094 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f531c106030 0x7f531c197820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:38.709 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.706+0000 7f531a59c700 1 --2- 172.21.15.83:0/1599103094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f531c100f10 0x7f531c1972e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:38.709 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.706+0000 7f531ad9d700 1 -- 172.21.15.83:0/1599103094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f531c100f10 msgr2=0x7f531c1972e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:38.709 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.706+0000 7f531ad9d700 1 --2- 172.21.15.83:0/1599103094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f531c100f10 0x7f531c1972e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:38.709 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.706+0000 7f531ad9d700 1 -- 172.21.15.83:0/1599103094 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f531c106030 msgr2=0x7f531c197820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:38.709 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.706+0000 7f531ad9d700 1 --2- 172.21.15.83:0/1599103094 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f531c106030 0x7f531c197820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:38.709 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.706+0000 7f531ad9d700 1 -- 172.21.15.83:0/1599103094 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5314009d00 con 0x7f531c19bb70 2024-04-01T06:58:38.709 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.706+0000 7f531ad9d700 1 --2- 172.21.15.83:0/1599103094 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f531c19bb70 0x7f531c19bff0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f5314006130 tx=0x7f531400bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:58:38.709 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.706+0000 7f53137fe700 1 -- 172.21.15.83:0/1599103094 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531400e040 con 0x7f531c19bb70 2024-04-01T06:58:38.709 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.706+0000 7f5320a81700 1 -- 172.21.15.83:0/1599103094 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f531c1a3e20 con 0x7f531c19bb70 2024-04-01T06:58:38.709 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.706+0000 7f53137fe700 1 -- 172.21.15.83:0/1599103094 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5314007e50 con 0x7f531c19bb70 2024-04-01T06:58:38.709 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.706+0000 7f53137fe700 1 -- 172.21.15.83:0/1599103094 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531401b6b0 con 0x7f531c19bb70 2024-04-01T06:58:38.709 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.706+0000 7f5320a81700 1 -- 172.21.15.83:0/1599103094 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f531c1a42a0 con 0x7f531c19bb70 2024-04-01T06:58:38.715 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.708+0000 7f53137fe700 1 -- 172.21.15.83:0/1599103094 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 25) v1 ==== 135996+0+0 (secure 0 0 0) 0x7f531401d480 con 0x7f531c19bb70 2024-04-01T06:58:38.716 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.709+0000 7f53137fe700 1 --2- 172.21.15.83:0/1599103094 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f53080a1290 0x7f53080a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:38.716 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.709+0000 7f53137fe700 1 -- 172.21.15.83:0/1599103094 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f53140ce440 con 0x7f531c19bb70 2024-04-01T06:58:38.716 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.709+0000 7f531a59c700 1 --2- 172.21.15.83:0/1599103094 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f53080a1290 0x7f53080a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:38.716 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.709+0000 7f531a59c700 1 --2- 172.21.15.83:0/1599103094 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f53080a1290 0x7f53080a3750 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5304009bf0 tx=0x7f5304009260 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:58:38.716 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.710+0000 7f532cc17b80 1 Processor -- start 2024-04-01T06:58:38.716 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.710+0000 7f532cc17b80 1 -- start start 2024-04-01T06:58:38.716 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.710+0000 7f532cc17b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55719cdd4100 0x55719cdd44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:38.716 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.710+0000 7f532cc17b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55719cdd4a20 0x55719cddf390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:38.716 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.710+0000 7f532cc17b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55719cddf8d0 0x55719cde1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:38.716 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.710+0000 7f532cc17b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55719cd2d930 con 0x55719cdd4100 2024-04-01T06:58:38.716 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.710+0000 7f532cc17b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55719cd2b2f0 con 0x55719cddf8d0 2024-04-01T06:58:38.717 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.710+0000 7f532cc17b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55719cd26be0 con 0x55719cdd4a20 2024-04-01T06:58:38.717 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.710+0000 7f531a59c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55719cdd4100 0x55719cdd44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:38.717 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.710+0000 7f531a59c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55719cdd4100 0x55719cdd44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43184/0 (socket says 172.21.15.83:43184) 2024-04-01T06:58:38.717 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.710+0000 7f531a59c700 1 -- 172.21.15.83:0/1457293212 learned_addr learned my addr 172.21.15.83:0/1457293212 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:58:38.717 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.710+0000 7f531ad9d700 1 --2- 172.21.15.83:0/1457293212 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55719cddf8d0 0x55719cde1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:38.717 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.710+0000 7f5319d9b700 1 --2- 172.21.15.83:0/1457293212 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55719cdd4a20 0x55719cddf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:38.717 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.710+0000 7f531a59c700 1 -- 172.21.15.83:0/1457293212 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55719cdd4a20 msgr2=0x55719cddf390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:38.717 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.710+0000 7f531a59c700 1 --2- 172.21.15.83:0/1457293212 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55719cdd4a20 0x55719cddf390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:38.717 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.710+0000 7f531a59c700 1 -- 172.21.15.83:0/1457293212 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55719cddf8d0 msgr2=0x55719cde1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:38.717 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.710+0000 7f531a59c700 1 --2- 172.21.15.83:0/1457293212 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55719cddf8d0 0x55719cde1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:38.717 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.710+0000 7f531a59c700 1 -- 172.21.15.83:0/1457293212 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55719cba8350 con 0x55719cdd4100 2024-04-01T06:58:38.717 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.711+0000 7f531a59c700 1 --2- 172.21.15.83:0/1457293212 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55719cdd4100 0x55719cdd44e0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f5304011e40 tx=0x7f5304014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1f30c3f0f892f0e server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:58:38.717 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.711+0000 7f5310ff9700 1 -- 172.21.15.83:0/1457293212 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5304012dc0 con 0x55719cdd4100 2024-04-01T06:58:38.717 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.711+0000 7f5310ff9700 1 -- 172.21.15.83:0/1457293212 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5304016070 con 0x55719cdd4100 2024-04-01T06:58:38.718 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.711+0000 7f5310ff9700 1 -- 172.21.15.83:0/1457293212 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5304003d70 con 0x55719cdd4100 2024-04-01T06:58:38.718 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.711+0000 7f532cc17b80 1 -- 172.21.15.83:0/1457293212 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55719cdd4100 msgr2=0x55719cdd44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:38.718 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.711+0000 7f532cc17b80 1 --2- 172.21.15.83:0/1457293212 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55719cdd4100 0x55719cdd44e0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f5304011e40 tx=0x7f5304014000 comp rx=0 tx=0).stop 2024-04-01T06:58:38.718 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.711+0000 7f532cc17b80 1 -- 172.21.15.83:0/1457293212 shutdown_connections 2024-04-01T06:58:38.718 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.711+0000 7f532cc17b80 1 --2- 172.21.15.83:0/1457293212 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55719cdd4100 0x55719cdd44e0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:38.718 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.711+0000 7f532cc17b80 1 --2- 172.21.15.83:0/1457293212 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55719cddf8d0 0x55719cde1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:38.718 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.711+0000 7f532cc17b80 1 --2- 172.21.15.83:0/1457293212 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55719cdd4a20 0x55719cddf390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:38.718 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.711+0000 7f532cc17b80 1 -- 172.21.15.83:0/1457293212 >> 172.21.15.83:0/1457293212 conn(0x55719cd34640 msgr2=0x55719cdd0520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:58:38.718 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.712+0000 7f532cc17b80 1 -- 172.21.15.83:0/1457293212 shutdown_connections 2024-04-01T06:58:38.718 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.712+0000 7f532cc17b80 1 -- 172.21.15.83:0/1457293212 wait complete. 2024-04-01T06:58:38.718 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.712+0000 7f532cc17b80 1 -- start start 2024-04-01T06:58:38.718 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.712+0000 7f532cc17b80 1 Processor -- start 2024-04-01T06:58:38.718 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.712+0000 7f532cc17b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55719cdd4100 0x55719cddf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:38.719 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.712+0000 7f532cc17b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55719cdd4a20 0x55719cddc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:38.719 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.712+0000 7f532cc17b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55719cddf8d0 0x55719cddccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:38.719 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.712+0000 7f532cc17b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55719ccc2d20 con 0x55719cddf8d0 2024-04-01T06:58:38.719 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.712+0000 7f532cc17b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55719ccc29c0 con 0x55719cdd4a20 2024-04-01T06:58:38.719 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.712+0000 7f532cc17b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55719cbaa640 con 0x55719cdd4100 2024-04-01T06:58:38.719 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.712+0000 7f532cc17b80 10 client.0 _ll_register_callbacks cb 0x55719cccc410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:58:38.719 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.713+0000 7f531ad9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55719cddf8d0 0x55719cddccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:38.719 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.713+0000 7f5319d9b700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55719cdd4a20 0x55719cddc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:38.719 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.713+0000 7f531ad9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55719cddf8d0 0x55719cddccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43190/0 (socket says 172.21.15.83:43190) 2024-04-01T06:58:38.719 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.713+0000 7f531ad9d700 1 -- 172.21.15.83:0/3643544477 learned_addr learned my addr 172.21.15.83:0/3643544477 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:58:38.719 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.713+0000 7f531a59c700 1 --2- 172.21.15.83:0/3643544477 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55719cdd4100 0x55719cddf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:38.719 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.713+0000 7f531ad9d700 1 -- 172.21.15.83:0/3643544477 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55719cdd4100 msgr2=0x55719cddf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:38.719 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.713+0000 7f531ad9d700 1 --2- 172.21.15.83:0/3643544477 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55719cdd4100 0x55719cddf330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:38.720 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.713+0000 7f531ad9d700 1 -- 172.21.15.83:0/3643544477 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55719cdd4a20 msgr2=0x55719cddc5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:38.720 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.713+0000 7f531ad9d700 1 --2- 172.21.15.83:0/3643544477 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55719cdd4a20 0x55719cddc5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:38.720 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.713+0000 7f531ad9d700 1 -- 172.21.15.83:0/3643544477 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5304011b20 con 0x55719cddf8d0 2024-04-01T06:58:38.720 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.713+0000 7f531ad9d700 1 --2- 172.21.15.83:0/3643544477 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55719cddf8d0 0x55719cddccf0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f531409b5d0 tx=0x7f531409b180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31a88fb59c442133 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:58:38.720 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.713+0000 7f5301ffb700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:58:38.720 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.713+0000 7f5301ffb700 1 -- 172.21.15.83:0/3643544477 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531401d940 con 0x55719cddf8d0 2024-04-01T06:58:38.720 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.713+0000 7f5301ffb700 1 -- 172.21.15.83:0/3643544477 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f5314084e40 con 0x55719cddf8d0 2024-04-01T06:58:38.720 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.713+0000 7f532cc17b80 1 -- 172.21.15.83:0/3643544477 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55719cce7320 con 0x55719cddf8d0 2024-04-01T06:58:38.720 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.713+0000 7f5301ffb700 1 -- 172.21.15.83:0/3643544477 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f531409bd40 con 0x55719cddf8d0 2024-04-01T06:58:38.720 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.713+0000 7f532cc17b80 10 client.16224 fetch_fsmap learned FSMap version 32 2024-04-01T06:58:38.720 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.713+0000 7f532cc17b80 1 -- 172.21.15.83:0/3643544477 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55719cb54b00 con 0x55719cddf8d0 2024-04-01T06:58:38.720 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.713+0000 7f5301ffb700 1 -- 172.21.15.83:0/3643544477 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55719cce7320 con 0x55719cddf8d0 2024-04-01T06:58:38.720 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.713+0000 7f5301ffb700 1 -- 172.21.15.83:0/3643544477 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 32) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f53140860b0 con 0x55719cddf8d0 2024-04-01T06:58:38.720 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.714+0000 7f532cc17b80 10 client.16224 fetch_fsmap finished waiting for FSMap version 32 2024-04-01T06:58:38.720 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.714+0000 7f532cc17b80 10 client.16224 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-01T06:58:38.721 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.714+0000 7f532cc17b80 20 client.16224 populate_metadata read hostname 'smithi083' 2024-04-01T06:58:38.721 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.714+0000 7f532cc17b80 1 --2- 172.21.15.83:0/3643544477 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55719cdef400 0x55719cdf1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:38.721 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.714+0000 7f532cc17b80 4 client.16224 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-01T06:58:38.721 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.714+0000 7f532cc17b80 1 -- 172.21.15.83:0/3643544477 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55719cd1f6a0 con 0x55719cdef400 2024-04-01T06:58:38.721 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.714+0000 7f531a59c700 1 --2- 172.21.15.83:0/3643544477 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55719cdef400 0x55719cdf1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:38.721 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.714+0000 7f5301ffb700 10 client.16224 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:58:38.721 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.714+0000 7f531a59c700 1 --2- 172.21.15.83:0/3643544477 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55719cdef400 0x55719cdf1820 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79ef88ead24f9a40 server_cookie=a3606aca908732cf in_seq=0 out_seq=0 2024-04-01T06:58:38.722 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.716+0000 7f5301ffb700 1 -- 172.21.15.83:0/3643544477 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55719cd1f6a0 con 0x55719cdef400 2024-04-01T06:58:38.722 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.716+0000 7f5301ffb700 10 client.16224 handle_command_reply: tid=0 2024-04-01T06:58:38.723 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.716+0000 7f532cc17b80 1 client.16224 shutdown 2024-04-01T06:58:38.723 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.716+0000 7f532cc17b80 1 -- 172.21.15.83:0/3643544477 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55719cddf8d0 msgr2=0x55719cddccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:38.723 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.716+0000 7f532cc17b80 1 --2- 172.21.15.83:0/3643544477 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55719cddf8d0 0x55719cddccf0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f531409b5d0 tx=0x7f531409b180 comp rx=0 tx=0).stop 2024-04-01T06:58:38.723 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.717+0000 7f532cc17b80 1 -- 172.21.15.83:0/3643544477 shutdown_connections 2024-04-01T06:58:38.723 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.717+0000 7f532cc17b80 1 --2- 172.21.15.83:0/3643544477 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55719cdef400 0x55719cdf1820 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:38.723 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.717+0000 7f532cc17b80 1 --2- 172.21.15.83:0/3643544477 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55719cddf8d0 0x55719cddccf0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:38.723 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.717+0000 7f5301ffb700 0 client.16224 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:58:38.723 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.717+0000 7f532cc17b80 1 --2- 172.21.15.83:0/3643544477 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55719cdd4100 0x55719cddf330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:38.723 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.717+0000 7f532cc17b80 1 --2- 172.21.15.83:0/3643544477 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55719cdd4a20 0x55719cddc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:38.723 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.717+0000 7f532cc17b80 1 -- 172.21.15.83:0/3643544477 >> 172.21.15.83:0/3643544477 conn(0x55719cd34640 msgr2=0x55719cdd60a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:58:38.723 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.717+0000 7f532cc17b80 1 -- 172.21.15.83:0/3643544477 shutdown_connections 2024-04-01T06:58:38.723 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.717+0000 7f532cc17b80 1 -- 172.21.15.83:0/3643544477 wait complete. 2024-04-01T06:58:38.723 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.717+0000 7f532cc17b80 20 client.16224 trim_cache size 0 max 16384 2024-04-01T06:58:38.736 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.731+0000 7f532cc17b80 1 Processor -- start 2024-04-01T06:58:38.736 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.731+0000 7f532cc17b80 1 -- start start 2024-04-01T06:58:38.736 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.731+0000 7f532cc17b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55719cdd4100 0x55719cde65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:38.736 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.731+0000 7f532cc17b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55719cdd4a20 0x55719cddee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:38.736 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.731+0000 7f532cc17b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55719cddf8d0 0x55719cdd6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:38.736 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.731+0000 7f532cc17b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55719cdd4e00 con 0x55719cdd4a20 2024-04-01T06:58:38.736 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.731+0000 7f532cc17b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55719cdd1ae0 con 0x55719cddf8d0 2024-04-01T06:58:38.736 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.731+0000 7f532cc17b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55719cdddc20 con 0x55719cdd4100 2024-04-01T06:58:38.737 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.732+0000 7f5319d9b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55719cdd4a20 0x55719cddee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:38.737 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.732+0000 7f5319d9b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55719cdd4a20 0x55719cddee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43198/0 (socket says 172.21.15.83:43198) 2024-04-01T06:58:38.737 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.732+0000 7f5319d9b700 1 -- 172.21.15.83:0/13851467 learned_addr learned my addr 172.21.15.83:0/13851467 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:58:38.737 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.732+0000 7f531ad9d700 1 --2- 172.21.15.83:0/13851467 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55719cddf8d0 0x55719cdd6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:38.737 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.732+0000 7f5319d9b700 1 -- 172.21.15.83:0/13851467 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55719cdd4100 msgr2=0x55719cde65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:38.737 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.732+0000 7f5319d9b700 1 --2- 172.21.15.83:0/13851467 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55719cdd4100 0x55719cde65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:38.737 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.732+0000 7f5319d9b700 1 -- 172.21.15.83:0/13851467 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55719cddf8d0 msgr2=0x55719cdd6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:38.737 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.732+0000 7f5319d9b700 1 --2- 172.21.15.83:0/13851467 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55719cddf8d0 0x55719cdd6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:38.737 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.732+0000 7f5319d9b700 1 -- 172.21.15.83:0/13851467 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55719ccece40 con 0x55719cdd4a20 2024-04-01T06:58:38.737 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.732+0000 7f5319d9b700 1 --2- 172.21.15.83:0/13851467 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55719cdd4a20 0x55719cddee60 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f530c009e60 tx=0x7f530c010710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f03ee3f3a0e20cb server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:58:38.737 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.732+0000 7f53117fa700 1 -- 172.21.15.83:0/13851467 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530c020070 con 0x55719cdd4a20 2024-04-01T06:58:38.737 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.732+0000 7f53117fa700 1 -- 172.21.15.83:0/13851467 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f530c017040 con 0x55719cdd4a20 2024-04-01T06:58:38.737 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.732+0000 7f53117fa700 1 -- 172.21.15.83:0/13851467 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530c016050 con 0x55719cdd4a20 2024-04-01T06:58:38.737 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.733+0000 7f532cc17b80 1 -- 172.21.15.83:0/13851467 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55719cdd4a20 msgr2=0x55719cddee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:38.738 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.733+0000 7f532cc17b80 1 --2- 172.21.15.83:0/13851467 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55719cdd4a20 0x55719cddee60 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f530c009e60 tx=0x7f530c010710 comp rx=0 tx=0).stop 2024-04-01T06:58:38.738 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.733+0000 7f532cc17b80 1 -- 172.21.15.83:0/13851467 shutdown_connections 2024-04-01T06:58:38.738 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.733+0000 7f532cc17b80 1 --2- 172.21.15.83:0/13851467 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55719cddf8d0 0x55719cdd6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:38.738 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.733+0000 7f532cc17b80 1 --2- 172.21.15.83:0/13851467 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55719cdd4100 0x55719cde65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:38.738 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.733+0000 7f532cc17b80 1 --2- 172.21.15.83:0/13851467 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55719cdd4a20 0x55719cddee60 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:38.738 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.733+0000 7f532cc17b80 1 -- 172.21.15.83:0/13851467 >> 172.21.15.83:0/13851467 conn(0x55719cd34640 msgr2=0x55719cdd6df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:58:38.738 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.733+0000 7f532cc17b80 1 -- 172.21.15.83:0/13851467 shutdown_connections 2024-04-01T06:58:38.738 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.733+0000 7f532cc17b80 1 -- 172.21.15.83:0/13851467 wait complete. 2024-04-01T06:58:38.738 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.733+0000 7f532cc17b80 1 -- start start 2024-04-01T06:58:38.738 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.733+0000 7f532cc17b80 1 Processor -- start 2024-04-01T06:58:38.738 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.733+0000 7f532cc17b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55719cdd4100 0x55719cde63c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:38.738 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.733+0000 7f532cc17b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55719cdd4a20 0x55719cde49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:38.738 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.733+0000 7f532cc17b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55719cddf8d0 0x55719cde4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:38.738 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.733+0000 7f532cc17b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55719cde5430 con 0x55719cddf8d0 2024-04-01T06:58:38.739 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.733+0000 7f532cc17b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55719cde5570 con 0x55719cdd4a20 2024-04-01T06:58:38.739 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.733+0000 7f532cc17b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55719cde5730 con 0x55719cdd4100 2024-04-01T06:58:38.739 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.733+0000 7f532cc17b80 10 client.0 _ll_register_callbacks cb 0x55719cccc410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:58:38.740 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.733+0000 7f531ad9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55719cddf8d0 0x55719cde4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:38.740 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.733+0000 7f531ad9d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55719cddf8d0 0x55719cde4ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43200/0 (socket says 172.21.15.83:43200) 2024-04-01T06:58:38.740 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.733+0000 7f531ad9d700 1 -- 172.21.15.83:0/3499014617 learned_addr learned my addr 172.21.15.83:0/3499014617 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:58:38.740 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.733+0000 7f5319d9b700 1 --2- 172.21.15.83:0/3499014617 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55719cdd4a20 0x55719cde49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:38.740 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.734+0000 7f531a59c700 1 --2- 172.21.15.83:0/3499014617 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55719cdd4100 0x55719cde63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:38.740 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.734+0000 7f531ad9d700 1 -- 172.21.15.83:0/3499014617 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55719cdd4100 msgr2=0x55719cde63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:38.740 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.734+0000 7f531ad9d700 1 --2- 172.21.15.83:0/3499014617 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55719cdd4100 0x55719cde63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:38.740 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.734+0000 7f531ad9d700 1 -- 172.21.15.83:0/3499014617 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55719cdd4a20 msgr2=0x55719cde49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:38.740 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.734+0000 7f531ad9d700 1 --2- 172.21.15.83:0/3499014617 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55719cdd4a20 0x55719cde49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:38.740 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.734+0000 7f531ad9d700 1 -- 172.21.15.83:0/3499014617 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f530c009b10 con 0x55719cddf8d0 2024-04-01T06:58:38.740 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.734+0000 7f531a59c700 1 --2- 172.21.15.83:0/3499014617 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55719cdd4100 0x55719cde63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:58:38.740 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.734+0000 7f531ad9d700 1 --2- 172.21.15.83:0/3499014617 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55719cddf8d0 0x55719cde4ef0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f53140ce720 tx=0x7f531409b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=353837ca26cd3847 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:58:38.741 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.734+0000 7f5301ffb700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:58:38.741 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.734+0000 7f5301ffb700 1 -- 172.21.15.83:0/3499014617 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531401d940 con 0x55719cddf8d0 2024-04-01T06:58:38.741 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.734+0000 7f5301ffb700 1 -- 172.21.15.83:0/3499014617 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f5314084e40 con 0x55719cddf8d0 2024-04-01T06:58:38.741 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.734+0000 7f532cc17b80 1 -- 172.21.15.83:0/3499014617 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5304016070 con 0x55719cddf8d0 2024-04-01T06:58:38.741 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.734+0000 7f5301ffb700 1 -- 172.21.15.83:0/3499014617 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5314004c30 con 0x55719cddf8d0 2024-04-01T06:58:38.741 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.734+0000 7f532cc17b80 10 client.16230 fetch_fsmap learned FSMap version 32 2024-04-01T06:58:38.741 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.734+0000 7f532cc17b80 1 -- 172.21.15.83:0/3499014617 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55719cbacc70 con 0x55719cddf8d0 2024-04-01T06:58:38.741 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.734+0000 7f5301ffb700 1 -- 172.21.15.83:0/3499014617 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5304016070 con 0x55719cddf8d0 2024-04-01T06:58:38.741 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.734+0000 7f5301ffb700 1 -- 172.21.15.83:0/3499014617 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 32) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f53140a35a0 con 0x55719cddf8d0 2024-04-01T06:58:38.741 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.734+0000 7f532cc17b80 10 client.16230 fetch_fsmap finished waiting for FSMap version 32 2024-04-01T06:58:38.741 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.734+0000 7f532cc17b80 10 client.16230 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-01T06:58:38.741 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.734+0000 7f532cc17b80 20 client.16230 populate_metadata read hostname 'smithi083' 2024-04-01T06:58:38.741 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.734+0000 7f532cc17b80 1 --2- 172.21.15.83:0/3499014617 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55719ce442b0 0x55719ce466a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:38.742 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.734+0000 7f532cc17b80 4 client.16230 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-01T06:58:38.742 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.734+0000 7f532cc17b80 1 -- 172.21.15.83:0/3499014617 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55719cb75c90 con 0x55719ce442b0 2024-04-01T06:58:38.742 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.735+0000 7f531a59c700 1 --2- 172.21.15.83:0/3499014617 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55719ce442b0 0x55719ce466a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:38.742 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.735+0000 7f531a59c700 1 --2- 172.21.15.83:0/3499014617 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55719ce442b0 0x55719ce466a0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9f3c31bbd512a26 server_cookie=c98d87972f4ed5e1 in_seq=0 out_seq=0 2024-04-01T06:58:38.742 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.735+0000 7f5301ffb700 10 client.16230 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:58:38.885 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.885+0000 7f5301ffb700 1 -- 172.21.15.83:0/3499014617 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55719cb75c90 con 0x55719ce442b0 2024-04-01T06:58:38.886 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.885+0000 7f5301ffb700 10 client.16230 handle_command_reply: tid=0 2024-04-01T06:58:38.886 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.885+0000 7f532cc17b80 1 client.16230 shutdown 2024-04-01T06:58:38.886 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.885+0000 7f532cc17b80 1 -- 172.21.15.83:0/3499014617 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55719cddf8d0 msgr2=0x55719cde4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:38.886 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.885+0000 7f532cc17b80 1 --2- 172.21.15.83:0/3499014617 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55719cddf8d0 0x55719cde4ef0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f53140ce720 tx=0x7f531409b940 comp rx=0 tx=0).stop 2024-04-01T06:58:38.886 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.885+0000 7f532cc17b80 1 -- 172.21.15.83:0/3499014617 shutdown_connections 2024-04-01T06:58:38.886 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.885+0000 7f532cc17b80 1 --2- 172.21.15.83:0/3499014617 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55719ce442b0 0x55719ce466a0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:38.886 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.885+0000 7f532cc17b80 1 --2- 172.21.15.83:0/3499014617 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55719cddf8d0 0x55719cde4ef0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:38.886 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.885+0000 7f532cc17b80 1 --2- 172.21.15.83:0/3499014617 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55719cdd4100 0x55719cde63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:38.886 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.885+0000 7f532cc17b80 1 --2- 172.21.15.83:0/3499014617 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55719cdd4a20 0x55719cde49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:38.886 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.885+0000 7f5301ffb700 0 client.16230 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:58:38.886 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.885+0000 7f532cc17b80 1 -- 172.21.15.83:0/3499014617 >> 172.21.15.83:0/3499014617 conn(0x55719cd34640 msgr2=0x55719cdc93e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:58:38.886 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.885+0000 7f532cc17b80 1 -- 172.21.15.83:0/3499014617 shutdown_connections 2024-04-01T06:58:38.886 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.885+0000 7f532cc17b80 1 -- 172.21.15.83:0/3499014617 wait complete. 2024-04-01T06:58:38.886 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.885+0000 7f532cc17b80 20 client.16230 trim_cache size 0 max 16384 2024-04-01T06:58:38.887 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout:{ 2024-04-01T06:58:38.887 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout: "message": "", 2024-04-01T06:58:38.887 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout: "return_code": 0 2024-04-01T06:58:38.887 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout:} 2024-04-01T06:58:38.888 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.886+0000 7f5320a81700 1 -- 172.21.15.83:0/1599103094 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f53080a1290 msgr2=0x7f53080a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:38.888 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.886+0000 7f5320a81700 1 --2- 172.21.15.83:0/1599103094 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f53080a1290 0x7f53080a3750 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5304009bf0 tx=0x7f5304009260 comp rx=0 tx=0).stop 2024-04-01T06:58:38.888 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.886+0000 7f5320a81700 1 -- 172.21.15.83:0/1599103094 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f531c19bb70 msgr2=0x7f531c19bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:38.888 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.886+0000 7f5320a81700 1 --2- 172.21.15.83:0/1599103094 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f531c19bb70 0x7f531c19bff0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f5314006130 tx=0x7f531400bdc0 comp rx=0 tx=0).stop 2024-04-01T06:58:38.888 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.886+0000 7f5320a81700 1 -- 172.21.15.83:0/1599103094 shutdown_connections 2024-04-01T06:58:38.888 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.886+0000 7f5320a81700 1 --2- 172.21.15.83:0/1599103094 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f53080a1290 0x7f53080a3750 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:38.888 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.886+0000 7f5320a81700 1 --2- 172.21.15.83:0/1599103094 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f531c19bb70 0x7f531c19bff0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:38.888 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.886+0000 7f5320a81700 1 --2- 172.21.15.83:0/1599103094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f531c100f10 0x7f531c1972e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:38.888 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.886+0000 7f5320a81700 1 --2- 172.21.15.83:0/1599103094 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f531c106030 0x7f531c197820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:38.888 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.886+0000 7f5320a81700 1 -- 172.21.15.83:0/1599103094 >> 172.21.15.83:0/1599103094 conn(0x7f531c0fc770 msgr2=0x7f531c0fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:58:38.888 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.886+0000 7f5320a81700 1 -- 172.21.15.83:0/1599103094 shutdown_connections 2024-04-01T06:58:38.889 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:38.886+0000 7f5320a81700 1 -- 172.21.15.83:0/1599103094 wait complete. 2024-04-01T06:58:39.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:58:38 smithi145 ceph-mon[47816]: pgmap v86: 97 pgs: 97 active+clean; 174 MiB data, 866 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 176 op/s 2024-04-01T06:58:39.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:58:38 smithi083 ceph-mon[43429]: pgmap v86: 97 pgs: 97 active+clean; 174 MiB data, 866 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 176 op/s 2024-04-01T06:58:39.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:58:38 smithi153 ceph-mon[48187]: pgmap v86: 97 pgs: 97 active+clean; 174 MiB data, 866 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 176 op/s 2024-04-01T06:58:39.640 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:58:39 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[88867]: ignoring --setuser ceph since I am not root 2024-04-01T06:58:39.641 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:58:39 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[88867]: ignoring --setgroup ceph since I am not root 2024-04-01T06:58:39.641 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:58:39 smithi153 ceph-mds[88898]: -- 172.21.15.153:0/1160417202 <== mon.1 v2:172.21.15.153:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558e1afe61a0 con 0x558e1afbd000 2024-04-01T06:58:39.641 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 06:58:39 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[88867]: starting mds.i at 2024-04-01T06:58:40.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:58:39 smithi145 ceph-mon[47816]: daemon mds.i restarted 2024-04-01T06:58:40.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:58:39 smithi145 ceph-mon[47816]: osdmap e84: 12 total, 12 up, 12 in 2024-04-01T06:58:40.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:58:39 smithi083 ceph-mon[43429]: daemon mds.i restarted 2024-04-01T06:58:40.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:58:39 smithi083 ceph-mon[43429]: osdmap e84: 12 total, 12 up, 12 in 2024-04-01T06:58:40.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:58:39 smithi153 ceph-mon[48187]: daemon mds.i restarted 2024-04-01T06:58:40.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:58:39 smithi153 ceph-mon[48187]: osdmap e84: 12 total, 12 up, 12 in 2024-04-01T06:58:41.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:58:40 smithi145 ceph-mon[47816]: pgmap v88: 97 pgs: 97 active+clean; 177 MiB data, 864 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 292 op/s 2024-04-01T06:58:41.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:58:40 smithi145 ceph-mon[47816]: mds.? [v2:172.21.15.153:6838/2714928335,v1:172.21.15.153:6839/2714928335] up:boot 2024-04-01T06:58:41.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:58:40 smithi145 ceph-mon[47816]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-04-01T06:58:41.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:58:40 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-01T06:58:41.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:58:40 smithi145 ceph-mon[47816]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-04-01T06:58:41.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:58:40 smithi083 ceph-mon[43429]: pgmap v88: 97 pgs: 97 active+clean; 177 MiB data, 864 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 292 op/s 2024-04-01T06:58:41.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:58:40 smithi083 ceph-mon[43429]: mds.? [v2:172.21.15.153:6838/2714928335,v1:172.21.15.153:6839/2714928335] up:boot 2024-04-01T06:58:41.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:58:40 smithi083 ceph-mon[43429]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-04-01T06:58:41.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:58:40 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-01T06:58:41.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:58:40 smithi083 ceph-mon[43429]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-04-01T06:58:41.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:58:40 smithi153 ceph-mon[48187]: pgmap v88: 97 pgs: 97 active+clean; 177 MiB data, 864 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 292 op/s 2024-04-01T06:58:41.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:58:40 smithi153 ceph-mon[48187]: mds.? [v2:172.21.15.153:6838/2714928335,v1:172.21.15.153:6839/2714928335] up:boot 2024-04-01T06:58:41.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:58:40 smithi153 ceph-mon[48187]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 2 up:standby-replay 7 up:standby 2024-04-01T06:58:41.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:58:40 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-01T06:58:41.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:58:40 smithi153 ceph-mon[48187]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-04-01T06:58:43.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:58:42 smithi083 ceph-mon[43429]: pgmap v89: 97 pgs: 97 active+clean; 177 MiB data, 864 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 292 op/s 2024-04-01T06:58:43.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:58:42 smithi153 ceph-mon[48187]: pgmap v89: 97 pgs: 97 active+clean; 177 MiB data, 864 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 292 op/s 2024-04-01T06:58:43.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:58:42 smithi145 ceph-mon[47816]: pgmap v89: 97 pgs: 97 active+clean; 177 MiB data, 864 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 292 op/s 2024-04-01T06:58:45.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:58:44 smithi083 ceph-mon[43429]: pgmap v90: 97 pgs: 97 active+clean; 177 MiB data, 864 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 292 op/s 2024-04-01T06:58:45.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:58:44 smithi153 ceph-mon[48187]: pgmap v90: 97 pgs: 97 active+clean; 177 MiB data, 864 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 292 op/s 2024-04-01T06:58:45.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:58:44 smithi145 ceph-mon[47816]: pgmap v90: 97 pgs: 97 active+clean; 177 MiB data, 864 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 292 op/s 2024-04-01T06:58:47.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:58:46 smithi083 ceph-mon[43429]: pgmap v91: 97 pgs: 97 active+clean; 184 MiB data, 877 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 290 op/s 2024-04-01T06:58:47.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:58:46 smithi153 ceph-mon[48187]: pgmap v91: 97 pgs: 97 active+clean; 184 MiB data, 877 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 290 op/s 2024-04-01T06:58:47.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:58:46 smithi145 ceph-mon[47816]: pgmap v91: 97 pgs: 97 active+clean; 184 MiB data, 877 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 290 op/s 2024-04-01T06:58:49.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:58:48 smithi083 ceph-mon[43429]: pgmap v92: 97 pgs: 97 active+clean; 184 MiB data, 877 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 290 op/s 2024-04-01T06:58:49.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:58:48 smithi153 ceph-mon[48187]: pgmap v92: 97 pgs: 97 active+clean; 184 MiB data, 877 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 290 op/s 2024-04-01T06:58:49.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:58:48 smithi145 ceph-mon[47816]: pgmap v92: 97 pgs: 97 active+clean; 184 MiB data, 877 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 290 op/s 2024-04-01T06:58:51.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:58:50 smithi153 ceph-mon[48187]: pgmap v93: 97 pgs: 97 active+clean; 192 MiB data, 913 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 448 op/s 2024-04-01T06:58:51.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:58:50 smithi145 ceph-mon[47816]: pgmap v93: 97 pgs: 97 active+clean; 192 MiB data, 913 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 448 op/s 2024-04-01T06:58:51.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:58:50 smithi083 ceph-mon[43429]: pgmap v93: 97 pgs: 97 active+clean; 192 MiB data, 913 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 448 op/s 2024-04-01T06:58:52.011 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:51.997+0000 7f06705d2700 1 -- 172.21.15.83:0/2732236790 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0668100cf0 msgr2=0x7f066810ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:52.012 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:51.997+0000 7f06705d2700 1 --2- 172.21.15.83:0/2732236790 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0668100cf0 0x7f066810ca00 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f066000b0a0 tx=0x7f066000b3b0 comp rx=0 tx=0).stop 2024-04-01T06:58:52.012 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:51.997+0000 7f06705d2700 1 -- 172.21.15.83:0/2732236790 shutdown_connections 2024-04-01T06:58:52.012 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:51.997+0000 7f06705d2700 1 --2- 172.21.15.83:0/2732236790 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0668100cf0 0x7f066810ca00 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:52.012 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:51.997+0000 7f06705d2700 1 --2- 172.21.15.83:0/2732236790 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0668104b90 0x7f0668104f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:52.012 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:51.997+0000 7f06705d2700 1 --2- 172.21.15.83:0/2732236790 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0668100330 0x7f06681007b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:52.013 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:51.997+0000 7f06705d2700 1 -- 172.21.15.83:0/2732236790 >> 172.21.15.83:0/2732236790 conn(0x7f06680761b0 msgr2=0x7f06680fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:58:52.013 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:51.997+0000 7f06705d2700 1 -- 172.21.15.83:0/2732236790 shutdown_connections 2024-04-01T06:58:52.013 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:51.997+0000 7f06705d2700 1 -- 172.21.15.83:0/2732236790 wait complete. 2024-04-01T06:58:52.013 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:51.998+0000 7f06705d2700 1 Processor -- start 2024-04-01T06:58:52.013 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:51.998+0000 7f06705d2700 1 -- start start 2024-04-01T06:58:52.013 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:51.998+0000 7f06705d2700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0668100330 0x7f0668197270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:52.013 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:51.998+0000 7f06705d2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0668100cf0 0x7f06681977b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:52.013 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:51.998+0000 7f06705d2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0668104b90 0x7f066819bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:52.013 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:51.998+0000 7f06705d2700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066819c190 con 0x7f0668100cf0 2024-04-01T06:58:52.013 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:51.998+0000 7f06705d2700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066819c300 con 0x7f0668100330 2024-04-01T06:58:52.013 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:51.998+0000 7f06705d2700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066819c4c0 con 0x7f0668104b90 2024-04-01T06:58:52.014 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:51.998+0000 7f066db6d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0668100cf0 0x7f06681977b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:52.014 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:51.998+0000 7f066db6d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0668100cf0 0x7f06681977b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:56068/0 (socket says 172.21.15.83:56068) 2024-04-01T06:58:52.014 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:51.998+0000 7f066db6d700 1 -- 172.21.15.83:0/3194256101 learned_addr learned my addr 172.21.15.83:0/3194256101 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:58:52.014 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:51.998+0000 7f066e36e700 1 --2- 172.21.15.83:0/3194256101 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0668100330 0x7f0668197270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:52.014 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:51.998+0000 7f066eb6f700 1 --2- 172.21.15.83:0/3194256101 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0668104b90 0x7f066819bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:52.014 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:51.998+0000 7f066db6d700 1 -- 172.21.15.83:0/3194256101 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0668104b90 msgr2=0x7f066819bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:52.014 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:51.998+0000 7f066db6d700 1 --2- 172.21.15.83:0/3194256101 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0668104b90 0x7f066819bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:52.014 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:51.998+0000 7f066db6d700 1 -- 172.21.15.83:0/3194256101 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0668100330 msgr2=0x7f0668197270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:52.014 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:51.998+0000 7f066db6d700 1 --2- 172.21.15.83:0/3194256101 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0668100330 0x7f0668197270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:52.014 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:51.998+0000 7f066db6d700 1 -- 172.21.15.83:0/3194256101 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0660009d00 con 0x7f0668100cf0 2024-04-01T06:58:52.014 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:51.999+0000 7f066db6d700 1 --2- 172.21.15.83:0/3194256101 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0668100cf0 0x7f06681977b0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f065800d950 tx=0x7f065800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:58:52.014 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:51.999+0000 7f065f7fe700 1 -- 172.21.15.83:0/3194256101 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065800f890 con 0x7f0668100cf0 2024-04-01T06:58:52.015 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:51.999+0000 7f06705d2700 1 -- 172.21.15.83:0/3194256101 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f066819c7a0 con 0x7f0668100cf0 2024-04-01T06:58:52.015 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:51.999+0000 7f065f7fe700 1 -- 172.21.15.83:0/3194256101 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0658010460 con 0x7f0668100cf0 2024-04-01T06:58:52.015 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:51.999+0000 7f065f7fe700 1 -- 172.21.15.83:0/3194256101 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065800e610 con 0x7f0668100cf0 2024-04-01T06:58:52.015 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:51.999+0000 7f06705d2700 1 -- 172.21.15.83:0/3194256101 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06681a3fe0 con 0x7f0668100cf0 2024-04-01T06:58:52.015 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.002+0000 7f065f7fe700 1 -- 172.21.15.83:0/3194256101 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 25) v1 ==== 135996+0+0 (secure 0 0 0) 0x7f06580108d0 con 0x7f0668100cf0 2024-04-01T06:58:52.015 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.002+0000 7f065f7fe700 1 --2- 172.21.15.83:0/3194256101 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f06540a1290 0x7f06540a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:52.015 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.002+0000 7f065f7fe700 1 -- 172.21.15.83:0/3194256101 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f06580ccda0 con 0x7f0668100cf0 2024-04-01T06:58:52.015 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.002+0000 7f066e36e700 1 --2- 172.21.15.83:0/3194256101 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f06540a1290 0x7f06540a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:52.015 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.003+0000 7f066e36e700 1 --2- 172.21.15.83:0/3194256101 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f06540a1290 0x7f06540a3750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0664009c60 tx=0x7f0664009260 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:58:52.015 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.003+0000 7f067c768b80 1 Processor -- start 2024-04-01T06:58:52.015 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.003+0000 7f067c768b80 1 -- start start 2024-04-01T06:58:52.015 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.003+0000 7f067c768b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594bc151100 0x5594bc1514e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:52.015 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.003+0000 7f067c768b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5594bc151a20 0x5594bc15c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:52.015 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.003+0000 7f067c768b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5594bc15c8d0 0x5594bc15ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:52.016 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.003+0000 7f067c768b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594bc0aa930 con 0x5594bc15c8d0 2024-04-01T06:58:52.016 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.003+0000 7f067c768b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594bc0a82f0 con 0x5594bc151100 2024-04-01T06:58:52.016 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.003+0000 7f067c768b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594bc0a3be0 con 0x5594bc151a20 2024-04-01T06:58:52.016 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.004+0000 7f066eb6f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5594bc15c8d0 0x5594bc15ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:52.016 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.004+0000 7f066eb6f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5594bc15c8d0 0x5594bc15ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:56074/0 (socket says 172.21.15.83:56074) 2024-04-01T06:58:52.016 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.004+0000 7f066eb6f700 1 -- 172.21.15.83:0/3271645317 learned_addr learned my addr 172.21.15.83:0/3271645317 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:58:52.016 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.004+0000 7f066e36e700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594bc151100 0x5594bc1514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:52.016 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.004+0000 7f066db6d700 1 --2- 172.21.15.83:0/3271645317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5594bc151a20 0x5594bc15c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:52.016 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.004+0000 7f066eb6f700 1 -- 172.21.15.83:0/3271645317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5594bc151a20 msgr2=0x5594bc15c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:52.016 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.004+0000 7f066eb6f700 1 --2- 172.21.15.83:0/3271645317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5594bc151a20 0x5594bc15c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:52.016 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.004+0000 7f066eb6f700 1 -- 172.21.15.83:0/3271645317 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594bc151100 msgr2=0x5594bc1514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:52.016 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.004+0000 7f066eb6f700 1 --2- 172.21.15.83:0/3271645317 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594bc151100 0x5594bc1514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:52.016 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.004+0000 7f066eb6f700 1 -- 172.21.15.83:0/3271645317 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5594bbf25350 con 0x5594bc15c8d0 2024-04-01T06:58:52.017 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.004+0000 7f066e36e700 1 --2- 172.21.15.83:0/3271645317 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594bc151100 0x5594bc1514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T06:58:52.017 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.004+0000 7f066eb6f700 1 --2- 172.21.15.83:0/3271645317 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5594bc15c8d0 0x5594bc15ecc0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f0660009c90 tx=0x7f0660009380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d23ecd82e954d904 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:58:52.017 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.004+0000 7f065cff9700 1 -- 172.21.15.83:0/3271645317 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066000e040 con 0x5594bc15c8d0 2024-04-01T06:58:52.017 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.004+0000 7f065cff9700 1 -- 172.21.15.83:0/3271645317 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0660007d60 con 0x5594bc15c8d0 2024-04-01T06:58:52.017 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.004+0000 7f065cff9700 1 -- 172.21.15.83:0/3271645317 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06600077d0 con 0x5594bc15c8d0 2024-04-01T06:58:52.017 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.005+0000 7f067c768b80 1 -- 172.21.15.83:0/3271645317 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5594bc15c8d0 msgr2=0x5594bc15ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:52.017 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.005+0000 7f067c768b80 1 --2- 172.21.15.83:0/3271645317 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5594bc15c8d0 0x5594bc15ecc0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f0660009c90 tx=0x7f0660009380 comp rx=0 tx=0).stop 2024-04-01T06:58:52.017 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.005+0000 7f067c768b80 1 -- 172.21.15.83:0/3271645317 shutdown_connections 2024-04-01T06:58:52.017 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.005+0000 7f067c768b80 1 --2- 172.21.15.83:0/3271645317 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5594bc15c8d0 0x5594bc15ecc0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:52.017 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.005+0000 7f067c768b80 1 --2- 172.21.15.83:0/3271645317 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594bc151100 0x5594bc1514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:52.017 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.005+0000 7f067c768b80 1 --2- 172.21.15.83:0/3271645317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5594bc151a20 0x5594bc15c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:52.017 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.005+0000 7f067c768b80 1 -- 172.21.15.83:0/3271645317 >> 172.21.15.83:0/3271645317 conn(0x5594bc0b1640 msgr2=0x5594bc14d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:58:52.017 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.005+0000 7f067c768b80 1 -- 172.21.15.83:0/3271645317 shutdown_connections 2024-04-01T06:58:52.017 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.005+0000 7f067c768b80 1 -- 172.21.15.83:0/3271645317 wait complete. 2024-04-01T06:58:52.017 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.005+0000 7f067c768b80 1 -- start start 2024-04-01T06:58:52.018 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.005+0000 7f067c768b80 1 Processor -- start 2024-04-01T06:58:52.018 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.006+0000 7f067c768b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5594bc151100 0x5594bc15c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:52.018 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.006+0000 7f067c768b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594bc151a20 0x5594bc159600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:52.018 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.006+0000 7f067c768b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5594bc15c8d0 0x5594bc159bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:52.018 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.006+0000 7f067c768b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594bc03fd20 con 0x5594bc151100 2024-04-01T06:58:52.018 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.006+0000 7f067c768b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594bc03f9c0 con 0x5594bc151a20 2024-04-01T06:58:52.018 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.006+0000 7f067c768b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594bbf27640 con 0x5594bc15c8d0 2024-04-01T06:58:52.018 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.006+0000 7f067c768b80 10 client.0 _ll_register_callbacks cb 0x5594bc049410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:58:52.018 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.006+0000 7f066e36e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5594bc151100 0x5594bc15c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:52.018 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.006+0000 7f066e36e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5594bc151100 0x5594bc15c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:56090/0 (socket says 172.21.15.83:56090) 2024-04-01T06:58:52.018 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.006+0000 7f066e36e700 1 -- 172.21.15.83:0/3276151206 learned_addr learned my addr 172.21.15.83:0/3276151206 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:58:52.018 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.006+0000 7f066eb6f700 1 --2- 172.21.15.83:0/3276151206 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5594bc15c8d0 0x5594bc159bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:52.018 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.006+0000 7f066db6d700 1 --2- 172.21.15.83:0/3276151206 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594bc151a20 0x5594bc159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:52.019 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.006+0000 7f066e36e700 1 -- 172.21.15.83:0/3276151206 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5594bc15c8d0 msgr2=0x5594bc159bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:52.019 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.006+0000 7f066e36e700 1 --2- 172.21.15.83:0/3276151206 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5594bc15c8d0 0x5594bc159bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:52.019 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.006+0000 7f066e36e700 1 -- 172.21.15.83:0/3276151206 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594bc151a20 msgr2=0x5594bc159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:52.019 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.006+0000 7f066e36e700 1 --2- 172.21.15.83:0/3276151206 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594bc151a20 0x5594bc159600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:52.019 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.006+0000 7f066e36e700 1 -- 172.21.15.83:0/3276151206 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0664017070 con 0x5594bc151100 2024-04-01T06:58:52.019 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.006+0000 7f066db6d700 1 --2- 172.21.15.83:0/3276151206 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594bc151a20 0x5594bc159600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:58:52.019 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.006+0000 7f066e36e700 1 --2- 172.21.15.83:0/3276151206 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5594bc151100 0x5594bc15c270 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f0664009b20 tx=0x7f06640047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c70aefa621d22bc server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:58:52.019 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.006+0000 7f0651ffb700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:58:52.019 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.006+0000 7f0651ffb700 1 -- 172.21.15.83:0/3276151206 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0664022070 con 0x5594bc151100 2024-04-01T06:58:52.019 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.006+0000 7f0651ffb700 1 -- 172.21.15.83:0/3276151206 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f066401d720 con 0x5594bc151100 2024-04-01T06:58:52.019 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.006+0000 7f067c768b80 1 -- 172.21.15.83:0/3276151206 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5594bc064320 con 0x5594bc151100 2024-04-01T06:58:52.019 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.007+0000 7f0651ffb700 1 -- 172.21.15.83:0/3276151206 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f066401d8e0 con 0x5594bc151100 2024-04-01T06:58:52.019 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.007+0000 7f067c768b80 10 client.16248 fetch_fsmap learned FSMap version 34 2024-04-01T06:58:52.019 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.007+0000 7f067c768b80 1 -- 172.21.15.83:0/3276151206 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x7f066810d400 con 0x5594bc151100 2024-04-01T06:58:52.020 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.007+0000 7f0651ffb700 1 -- 172.21.15.83:0/3276151206 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5594bc064320 con 0x5594bc151100 2024-04-01T06:58:52.020 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.007+0000 7f0651ffb700 1 -- 172.21.15.83:0/3276151206 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f066402e070 con 0x5594bc151100 2024-04-01T06:58:52.020 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.007+0000 7f067c768b80 10 client.16248 fetch_fsmap finished waiting for FSMap version 34 2024-04-01T06:58:52.020 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.007+0000 7f067c768b80 10 client.16248 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-01T06:58:52.020 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.007+0000 7f067c768b80 20 client.16248 populate_metadata read hostname 'smithi083' 2024-04-01T06:58:52.020 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.007+0000 7f067c768b80 1 --2- 172.21.15.83:0/3276151206 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5594bc16c5c0 0x5594bc16e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:52.020 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.007+0000 7f067c768b80 4 client.16248 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-01T06:58:52.020 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.007+0000 7f067c768b80 1 -- 172.21.15.83:0/3276151206 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5594bc09c6a0 con 0x5594bc16c5c0 2024-04-01T06:58:52.020 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.007+0000 7f066db6d700 1 --2- 172.21.15.83:0/3276151206 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5594bc16c5c0 0x5594bc16e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:52.020 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.008+0000 7f0651ffb700 10 client.16248 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:58:52.020 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.008+0000 7f066db6d700 1 --2- 172.21.15.83:0/3276151206 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5594bc16c5c0 0x5594bc16e9e0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62bbc99ba27486f8 server_cookie=38e421742f1106d5 in_seq=0 out_seq=0 2024-04-01T06:58:52.020 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.008+0000 7f0651ffb700 1 -- 172.21.15.83:0/3276151206 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5594bc09c6a0 con 0x5594bc16c5c0 2024-04-01T06:58:52.020 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.008+0000 7f0651ffb700 10 client.16248 handle_command_reply: tid=0 2024-04-01T06:58:52.020 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.008+0000 7f067c768b80 1 client.16248 shutdown 2024-04-01T06:58:52.021 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.008+0000 7f067c768b80 1 -- 172.21.15.83:0/3276151206 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5594bc151100 msgr2=0x5594bc15c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:52.021 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.008+0000 7f067c768b80 1 --2- 172.21.15.83:0/3276151206 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5594bc151100 0x5594bc15c270 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f0664009b20 tx=0x7f06640047c0 comp rx=0 tx=0).stop 2024-04-01T06:58:52.021 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.008+0000 7f067c768b80 1 -- 172.21.15.83:0/3276151206 shutdown_connections 2024-04-01T06:58:52.021 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.008+0000 7f067c768b80 1 --2- 172.21.15.83:0/3276151206 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5594bc16c5c0 0x5594bc16e9e0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:52.021 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.009+0000 7f067c768b80 1 --2- 172.21.15.83:0/3276151206 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5594bc151100 0x5594bc15c270 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:52.021 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.009+0000 7f067c768b80 1 --2- 172.21.15.83:0/3276151206 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5594bc15c8d0 0x5594bc159bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:52.021 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.009+0000 7f067c768b80 1 --2- 172.21.15.83:0/3276151206 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594bc151a20 0x5594bc159600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:52.021 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.009+0000 7f067c768b80 1 -- 172.21.15.83:0/3276151206 >> 172.21.15.83:0/3276151206 conn(0x5594bc0b1640 msgr2=0x5594bc1530a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:58:52.021 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.009+0000 7f0651ffb700 0 client.16248 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:58:52.021 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.009+0000 7f067c768b80 1 -- 172.21.15.83:0/3276151206 shutdown_connections 2024-04-01T06:58:52.021 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.009+0000 7f067c768b80 1 -- 172.21.15.83:0/3276151206 wait complete. 2024-04-01T06:58:52.021 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.009+0000 7f067c768b80 20 client.16248 trim_cache size 0 max 16384 2024-04-01T06:58:52.033 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.024+0000 7f067c768b80 1 Processor -- start 2024-04-01T06:58:52.033 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.024+0000 7f067c768b80 1 -- start start 2024-04-01T06:58:52.034 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.024+0000 7f067c768b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594bc151100 0x5594bc154050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:52.034 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.024+0000 7f067c768b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5594bc151a20 0x5594bc1595a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.024+0000 7f067c768b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5594bc15c8d0 0x5594bc147500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.024+0000 7f067c768b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594bc169b20 con 0x5594bc15c8d0 2024-04-01T06:58:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.024+0000 7f067c768b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594bc14e1f0 con 0x5594bc151100 2024-04-01T06:58:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.024+0000 7f067c768b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594bc149400 con 0x5594bc151a20 2024-04-01T06:58:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.024+0000 7f066eb6f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5594bc15c8d0 0x5594bc147500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.024+0000 7f066eb6f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5594bc15c8d0 0x5594bc147500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:56104/0 (socket says 172.21.15.83:56104) 2024-04-01T06:58:52.035 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.024+0000 7f066e36e700 1 --2- 172.21.15.83:0/601380087 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594bc151100 0x5594bc154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:52.036 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.024+0000 7f066eb6f700 1 -- 172.21.15.83:0/601380087 learned_addr learned my addr 172.21.15.83:0/601380087 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:58:52.036 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.025+0000 7f066db6d700 1 --2- 172.21.15.83:0/601380087 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5594bc151a20 0x5594bc1595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:52.036 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.025+0000 7f066eb6f700 1 -- 172.21.15.83:0/601380087 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5594bc151a20 msgr2=0x5594bc1595a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:52.036 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.025+0000 7f066eb6f700 1 --2- 172.21.15.83:0/601380087 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5594bc151a20 0x5594bc1595a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:52.036 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.025+0000 7f066eb6f700 1 -- 172.21.15.83:0/601380087 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594bc151100 msgr2=0x5594bc154050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:52.036 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.025+0000 7f066eb6f700 1 --2- 172.21.15.83:0/601380087 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594bc151100 0x5594bc154050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:52.036 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.025+0000 7f066eb6f700 1 -- 172.21.15.83:0/601380087 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5594bbed1b00 con 0x5594bc15c8d0 2024-04-01T06:58:52.036 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.025+0000 7f066db6d700 1 --2- 172.21.15.83:0/601380087 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5594bc151a20 0x5594bc1595a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:58:52.036 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.025+0000 7f066e36e700 1 --2- 172.21.15.83:0/601380087 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594bc151100 0x5594bc154050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T06:58:52.036 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.025+0000 7f066eb6f700 1 --2- 172.21.15.83:0/601380087 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5594bc15c8d0 0x5594bc147500 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f0660009c90 tx=0x7f0660003ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5156584ab25e2eb server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:58:52.036 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.025+0000 7f065d7fa700 1 -- 172.21.15.83:0/601380087 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066000e040 con 0x5594bc15c8d0 2024-04-01T06:58:52.036 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.025+0000 7f065d7fa700 1 -- 172.21.15.83:0/601380087 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0660003c00 con 0x5594bc15c8d0 2024-04-01T06:58:52.036 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.025+0000 7f065d7fa700 1 -- 172.21.15.83:0/601380087 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06600052d0 con 0x5594bc15c8d0 2024-04-01T06:58:52.037 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.026+0000 7f067c768b80 1 -- 172.21.15.83:0/601380087 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5594bc15c8d0 msgr2=0x5594bc147500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:52.037 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.026+0000 7f067c768b80 1 --2- 172.21.15.83:0/601380087 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5594bc15c8d0 0x5594bc147500 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f0660009c90 tx=0x7f0660003ea0 comp rx=0 tx=0).stop 2024-04-01T06:58:52.037 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.026+0000 7f067c768b80 1 -- 172.21.15.83:0/601380087 shutdown_connections 2024-04-01T06:58:52.037 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.026+0000 7f067c768b80 1 --2- 172.21.15.83:0/601380087 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5594bc15c8d0 0x5594bc147500 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:52.037 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.026+0000 7f067c768b80 1 --2- 172.21.15.83:0/601380087 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594bc151100 0x5594bc154050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:52.037 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.026+0000 7f067c768b80 1 --2- 172.21.15.83:0/601380087 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5594bc151a20 0x5594bc1595a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:52.037 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.026+0000 7f067c768b80 1 -- 172.21.15.83:0/601380087 >> 172.21.15.83:0/601380087 conn(0x5594bc0b1640 msgr2=0x5594bc158e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:58:52.037 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.026+0000 7f067c768b80 1 -- 172.21.15.83:0/601380087 shutdown_connections 2024-04-01T06:58:52.037 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.026+0000 7f067c768b80 1 -- 172.21.15.83:0/601380087 wait complete. 2024-04-01T06:58:52.037 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.026+0000 7f067c768b80 1 -- start start 2024-04-01T06:58:52.037 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.026+0000 7f067c768b80 1 Processor -- start 2024-04-01T06:58:52.037 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.026+0000 7f067c768b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594bc151100 0x5594bc163450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:52.037 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.026+0000 7f067c768b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5594bc151a20 0x5594bc160930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:52.037 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.026+0000 7f067c768b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5594bc15c8d0 0x5594bc160e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:52.037 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.026+0000 7f067c768b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594bc1613f0 con 0x5594bc15c8d0 2024-04-01T06:58:52.038 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.026+0000 7f067c768b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594bc161560 con 0x5594bc151100 2024-04-01T06:58:52.038 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.026+0000 7f067c768b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594bc161720 con 0x5594bc151a20 2024-04-01T06:58:52.038 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.026+0000 7f067c768b80 10 client.0 _ll_register_callbacks cb 0x5594bc049410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:58:52.038 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.027+0000 7f066eb6f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5594bc15c8d0 0x5594bc160e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:52.038 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.027+0000 7f066e36e700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594bc151100 0x5594bc163450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:52.038 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.027+0000 7f066e36e700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594bc151100 0x5594bc163450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.83:46162/0 (socket says 172.21.15.83:46162) 2024-04-01T06:58:52.038 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.027+0000 7f066e36e700 1 -- 172.21.15.83:0/1762735338 learned_addr learned my addr 172.21.15.83:0/1762735338 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:58:52.038 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.027+0000 7f066db6d700 1 --2- 172.21.15.83:0/1762735338 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5594bc151a20 0x5594bc160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:52.038 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.027+0000 7f066db6d700 1 -- 172.21.15.83:0/1762735338 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594bc151100 msgr2=0x5594bc163450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:52.038 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.027+0000 7f066db6d700 1 --2- 172.21.15.83:0/1762735338 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594bc151100 0x5594bc163450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:52.038 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.027+0000 7f066db6d700 1 -- 172.21.15.83:0/1762735338 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5594bc15c8d0 msgr2=0x5594bc160e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:58:52.038 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.027+0000 7f066db6d700 1 --2- 172.21.15.83:0/1762735338 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5594bc15c8d0 0x5594bc160e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:52.038 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.027+0000 7f066db6d700 1 -- 172.21.15.83:0/1762735338 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f066810d400 con 0x5594bc151a20 2024-04-01T06:58:52.039 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.027+0000 7f066e36e700 1 --2- 172.21.15.83:0/1762735338 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594bc151100 0x5594bc163450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T06:58:52.039 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.027+0000 7f066eb6f700 1 --2- 172.21.15.83:0/1762735338 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5594bc15c8d0 0x5594bc160e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-01T06:58:52.039 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.027+0000 7f066db6d700 1 --2- 172.21.15.83:0/1762735338 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5594bc151a20 0x5594bc160930 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f06580ca550 tx=0x7f0658000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81c56fe20b554dfc server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:58:52.039 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.027+0000 7f0651ffb700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-04-01T06:58:52.039 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.027+0000 7f0651ffb700 1 -- 172.21.15.83:0/1762735338 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06580b82a0 con 0x5594bc151a20 2024-04-01T06:58:52.039 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.027+0000 7f067c768b80 1 -- 172.21.15.83:0/1762735338 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0660007d60 con 0x5594bc151a20 2024-04-01T06:58:52.039 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.027+0000 7f0651ffb700 1 -- 172.21.15.83:0/1762735338 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f06580a2390 con 0x5594bc151a20 2024-04-01T06:58:52.039 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.027+0000 7f0651ffb700 1 -- 172.21.15.83:0/1762735338 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f06580ca7d0 con 0x5594bc151a20 2024-04-01T06:58:52.039 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.027+0000 7f067c768b80 10 client.25618 fetch_fsmap learned FSMap version 34 2024-04-01T06:58:52.039 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.027+0000 7f067c768b80 1 -- 172.21.15.83:0/1762735338 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5594bbf25350 con 0x5594bc151a20 2024-04-01T06:58:52.039 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.028+0000 7f0651ffb700 1 -- 172.21.15.83:0/1762735338 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0660007d60 con 0x5594bc151a20 2024-04-01T06:58:52.039 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.028+0000 7f0651ffb700 1 -- 172.21.15.83:0/1762735338 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 34) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f0658099400 con 0x5594bc151a20 2024-04-01T06:58:52.039 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.028+0000 7f067c768b80 10 client.25618 fetch_fsmap finished waiting for FSMap version 34 2024-04-01T06:58:52.039 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.028+0000 7f067c768b80 10 client.25618 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-01T06:58:52.040 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.028+0000 7f067c768b80 20 client.25618 populate_metadata read hostname 'smithi083' 2024-04-01T06:58:52.040 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.028+0000 7f067c768b80 1 --2- 172.21.15.83:0/1762735338 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5594bc1c08a0 0x5594bc1c2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:58:52.040 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.028+0000 7f067c768b80 4 client.25618 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-01T06:58:52.040 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.028+0000 7f067c768b80 1 -- 172.21.15.83:0/1762735338 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5594bbef2c90 con 0x5594bc1c08a0 2024-04-01T06:58:52.040 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.028+0000 7f066e36e700 1 --2- 172.21.15.83:0/1762735338 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5594bc1c08a0 0x5594bc1c2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:58:52.040 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.028+0000 7f0651ffb700 10 client.25618 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:58:52.040 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.028+0000 7f066e36e700 1 --2- 172.21.15.83:0/1762735338 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5594bc1c08a0 0x5594bc1c2cc0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea4715429870ef2b server_cookie=65d68aa9b8fa8233 in_seq=0 out_seq=0 2024-04-01T06:58:52.271 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.270+0000 7f0651ffb700 1 -- 172.21.15.83:0/1762735338 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5594bbef2c90 con 0x5594bc1c08a0 2024-04-01T06:58:52.271 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.270+0000 7f0651ffb700 10 client.25618 handle_command_reply: tid=0 2024-04-01T06:58:52.271 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.270+0000 7f067c768b80 1 client.25618 shutdown 2024-04-01T06:58:52.271 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.270+0000 7f067c768b80 1 -- 172.21.15.83:0/1762735338 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5594bc151a20 msgr2=0x5594bc160930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:52.271 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.271+0000 7f067c768b80 1 --2- 172.21.15.83:0/1762735338 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5594bc151a20 0x5594bc160930 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f06580ca550 tx=0x7f0658000bc0 comp rx=0 tx=0).stop 2024-04-01T06:58:52.271 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.271+0000 7f067c768b80 1 -- 172.21.15.83:0/1762735338 shutdown_connections 2024-04-01T06:58:52.271 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.271+0000 7f067c768b80 1 --2- 172.21.15.83:0/1762735338 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x5594bc1c08a0 0x5594bc1c2cc0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:52.271 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.271+0000 7f067c768b80 1 --2- 172.21.15.83:0/1762735338 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5594bc15c8d0 0x5594bc160e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:52.271 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.271+0000 7f0651ffb700 0 client.25618 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:58:52.272 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.271+0000 7f067c768b80 1 --2- 172.21.15.83:0/1762735338 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594bc151100 0x5594bc163450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:52.272 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.271+0000 7f067c768b80 1 --2- 172.21.15.83:0/1762735338 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5594bc151a20 0x5594bc160930 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:52.272 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.271+0000 7f067c768b80 1 -- 172.21.15.83:0/1762735338 >> 172.21.15.83:0/1762735338 conn(0x5594bc0b1640 msgr2=0x5594bc1463e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:58:52.272 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.271+0000 7f067c768b80 1 -- 172.21.15.83:0/1762735338 shutdown_connections 2024-04-01T06:58:52.272 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.271+0000 7f067c768b80 1 -- 172.21.15.83:0/1762735338 wait complete. 2024-04-01T06:58:52.272 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.271+0000 7f067c768b80 20 client.25618 trim_cache size 0 max 16384 2024-04-01T06:58:52.272 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout:{ 2024-04-01T06:58:52.272 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout: "message": "", 2024-04-01T06:58:52.272 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout: "return_code": 0 2024-04-01T06:58:52.272 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout:} 2024-04-01T06:58:52.273 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.271+0000 7f06705d2700 1 -- 172.21.15.83:0/3194256101 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f06540a1290 msgr2=0x7f06540a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:52.273 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.271+0000 7f06705d2700 1 --2- 172.21.15.83:0/3194256101 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f06540a1290 0x7f06540a3750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0664009c60 tx=0x7f0664009260 comp rx=0 tx=0).stop 2024-04-01T06:58:52.273 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.271+0000 7f06705d2700 1 -- 172.21.15.83:0/3194256101 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0668100cf0 msgr2=0x7f06681977b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:58:52.273 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.271+0000 7f06705d2700 1 --2- 172.21.15.83:0/3194256101 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0668100cf0 0x7f06681977b0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f065800d950 tx=0x7f065800dc60 comp rx=0 tx=0).stop 2024-04-01T06:58:52.274 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.271+0000 7f06705d2700 1 -- 172.21.15.83:0/3194256101 shutdown_connections 2024-04-01T06:58:52.274 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.271+0000 7f06705d2700 1 --2- 172.21.15.83:0/3194256101 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f06540a1290 0x7f06540a3750 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:52.274 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.271+0000 7f06705d2700 1 --2- 172.21.15.83:0/3194256101 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0668104b90 0x7f066819bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:52.274 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.271+0000 7f06705d2700 1 --2- 172.21.15.83:0/3194256101 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0668100330 0x7f0668197270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:52.274 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.271+0000 7f06705d2700 1 --2- 172.21.15.83:0/3194256101 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0668100cf0 0x7f06681977b0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:58:52.274 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.271+0000 7f06705d2700 1 -- 172.21.15.83:0/3194256101 >> 172.21.15.83:0/3194256101 conn(0x7f06680761b0 msgr2=0x7f06680fda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:58:52.274 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.271+0000 7f06705d2700 1 -- 172.21.15.83:0/3194256101 shutdown_connections 2024-04-01T06:58:52.274 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:58:52.271+0000 7f06705d2700 1 -- 172.21.15.83:0/3194256101 wait complete. 2024-04-01T06:58:53.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:58:52 smithi153 ceph-mon[48187]: pgmap v94: 97 pgs: 97 active+clean; 192 MiB data, 913 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 237 op/s 2024-04-01T06:58:53.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:58:52 smithi145 ceph-mon[47816]: pgmap v94: 97 pgs: 97 active+clean; 192 MiB data, 913 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 237 op/s 2024-04-01T06:58:53.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:58:52 smithi083 ceph-mon[43429]: pgmap v94: 97 pgs: 97 active+clean; 192 MiB data, 913 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 237 op/s 2024-04-01T06:58:55.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:58:54 smithi153 ceph-mon[48187]: pgmap v95: 97 pgs: 97 active+clean; 192 MiB data, 913 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 237 op/s 2024-04-01T06:58:55.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:58:54 smithi145 ceph-mon[47816]: pgmap v95: 97 pgs: 97 active+clean; 192 MiB data, 913 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 237 op/s 2024-04-01T06:58:55.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:58:54 smithi083 ceph-mon[43429]: pgmap v95: 97 pgs: 97 active+clean; 192 MiB data, 913 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 237 op/s 2024-04-01T06:58:57.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:58:56 smithi153 ceph-mon[48187]: pgmap v96: 97 pgs: 97 active+clean; 180 MiB data, 928 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 435 op/s 2024-04-01T06:58:57.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:58:56 smithi145 ceph-mon[47816]: pgmap v96: 97 pgs: 97 active+clean; 180 MiB data, 928 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 435 op/s 2024-04-01T06:58:57.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:58:56 smithi083 ceph-mon[43429]: pgmap v96: 97 pgs: 97 active+clean; 180 MiB data, 928 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 435 op/s 2024-04-01T06:58:59.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:58:58 smithi153 ceph-mon[48187]: pgmap v97: 97 pgs: 97 active+clean; 180 MiB data, 928 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 335 op/s 2024-04-01T06:58:59.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:58:58 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:58:59.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:58:58 smithi145 ceph-mon[47816]: pgmap v97: 97 pgs: 97 active+clean; 180 MiB data, 928 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 335 op/s 2024-04-01T06:58:59.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:58:58 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:58:59.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:58:58 smithi083 ceph-mon[43429]: pgmap v97: 97 pgs: 97 active+clean; 180 MiB data, 928 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 335 op/s 2024-04-01T06:58:59.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:58:58 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T06:59:00.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:58:59 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:59:00.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:58:59 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:59:00.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:58:59 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:59:00.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:58:59 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:59:00.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:58:59 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:59:00.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:58:59 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:59:00.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:58:59 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T06:59:00.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:58:59 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T06:59:00.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:58:59 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T06:59:01.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:59:00 smithi153 ceph-mon[48187]: pgmap v98: 97 pgs: 97 active+clean; 184 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 410 op/s 2024-04-01T06:59:01.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:59:00 smithi145 ceph-mon[47816]: pgmap v98: 97 pgs: 97 active+clean; 184 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 410 op/s 2024-04-01T06:59:01.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:59:00 smithi083 ceph-mon[43429]: pgmap v98: 97 pgs: 97 active+clean; 184 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 410 op/s 2024-04-01T06:59:03.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:59:02 smithi153 ceph-mon[48187]: pgmap v99: 97 pgs: 97 active+clean; 184 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 670 KiB/s rd, 919 KiB/s wr, 272 op/s 2024-04-01T06:59:03.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:59:02 smithi145 ceph-mon[47816]: pgmap v99: 97 pgs: 97 active+clean; 184 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 670 KiB/s rd, 919 KiB/s wr, 272 op/s 2024-04-01T06:59:03.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:59:02 smithi083 ceph-mon[43429]: pgmap v99: 97 pgs: 97 active+clean; 184 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 670 KiB/s rd, 919 KiB/s wr, 272 op/s 2024-04-01T06:59:05.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:59:04 smithi153 ceph-mon[48187]: pgmap v100: 97 pgs: 97 active+clean; 184 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 919 KiB/s wr, 272 op/s 2024-04-01T06:59:05.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:59:04 smithi145 ceph-mon[47816]: pgmap v100: 97 pgs: 97 active+clean; 184 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 919 KiB/s wr, 272 op/s 2024-04-01T06:59:05.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:59:04 smithi083 ceph-mon[43429]: pgmap v100: 97 pgs: 97 active+clean; 184 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 919 KiB/s wr, 272 op/s 2024-04-01T06:59:05.383 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.381+0000 7f1f58fb4700 1 -- 172.21.15.83:0/4201504318 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1f54105c60 msgr2=0x7f1f54106040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:59:05.383 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.381+0000 7f1f58fb4700 1 --2- 172.21.15.83:0/4201504318 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1f54105c60 0x7f1f54106040 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f1f44009990 tx=0x7f1f44009ca0 comp rx=0 tx=0).stop 2024-04-01T06:59:05.383 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.381+0000 7f1f58fb4700 1 -- 172.21.15.83:0/4201504318 shutdown_connections 2024-04-01T06:59:05.384 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.381+0000 7f1f58fb4700 1 --2- 172.21.15.83:0/4201504318 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1f54105c60 0x7f1f54106040 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:05.384 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.381+0000 7f1f58fb4700 1 --2- 172.21.15.83:0/4201504318 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1f54100570 0x7f1f5410ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:05.384 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.381+0000 7f1f58fb4700 1 --2- 172.21.15.83:0/4201504318 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f540ffbb0 0x7f1f54100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:05.384 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.381+0000 7f1f58fb4700 1 -- 172.21.15.83:0/4201504318 >> 172.21.15.83:0/4201504318 conn(0x7f1f54076d50 msgr2=0x7f1f54077160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:59:05.384 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.381+0000 7f1f58fb4700 1 -- 172.21.15.83:0/4201504318 shutdown_connections 2024-04-01T06:59:05.384 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.381+0000 7f1f58fb4700 1 -- 172.21.15.83:0/4201504318 wait complete. 2024-04-01T06:59:05.384 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.382+0000 7f1f58fb4700 1 Processor -- start 2024-04-01T06:59:05.384 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.382+0000 7f1f58fb4700 1 -- start start 2024-04-01T06:59:05.384 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.382+0000 7f1f58fb4700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1f540ffbb0 0x7f1f54101850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:59:05.384 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.382+0000 7f1f58fb4700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f54100570 0x7f1f54101d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:59:05.384 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.382+0000 7f1f58fb4700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1f54105c60 0x7f1f541022d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:59:05.384 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.382+0000 7f1f58fb4700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f541a5450 con 0x7f1f540ffbb0 2024-04-01T06:59:05.385 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.382+0000 7f1f58fb4700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f541a55c0 con 0x7f1f54105c60 2024-04-01T06:59:05.385 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.382+0000 7f1f58fb4700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f541a5780 con 0x7f1f54100570 2024-04-01T06:59:05.385 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.382+0000 7f1f5259c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1f540ffbb0 0x7f1f54101850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:59:05.385 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.382+0000 7f1f5259c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1f540ffbb0 0x7f1f54101850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55358/0 (socket says 172.21.15.83:55358) 2024-04-01T06:59:05.385 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.382+0000 7f1f5259c700 1 -- 172.21.15.83:0/3997263290 learned_addr learned my addr 172.21.15.83:0/3997263290 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:59:05.385 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.382+0000 7f1f51d9b700 1 --2- 172.21.15.83:0/3997263290 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f54100570 0x7f1f54101d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:59:05.385 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.382+0000 7f1f52d9d700 1 --2- 172.21.15.83:0/3997263290 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1f54105c60 0x7f1f541022d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:59:05.385 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.382+0000 7f1f5259c700 1 -- 172.21.15.83:0/3997263290 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f54100570 msgr2=0x7f1f54101d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:59:05.385 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.382+0000 7f1f5259c700 1 --2- 172.21.15.83:0/3997263290 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f54100570 0x7f1f54101d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:05.385 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.382+0000 7f1f5259c700 1 -- 172.21.15.83:0/3997263290 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1f54105c60 msgr2=0x7f1f541022d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:59:05.385 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.382+0000 7f1f5259c700 1 --2- 172.21.15.83:0/3997263290 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1f54105c60 0x7f1f541022d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:05.385 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.382+0000 7f1f5259c700 1 -- 172.21.15.83:0/3997263290 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f4c009c40 con 0x7f1f540ffbb0 2024-04-01T06:59:05.385 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.382+0000 7f1f5259c700 1 --2- 172.21.15.83:0/3997263290 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1f540ffbb0 0x7f1f54101850 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f1f44005770 tx=0x7f1f440057a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:59:05.385 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.383+0000 7f1f437fe700 1 -- 172.21.15.83:0/3997263290 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4401d070 con 0x7f1f540ffbb0 2024-04-01T06:59:05.386 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.383+0000 7f1f437fe700 1 -- 172.21.15.83:0/3997263290 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1f44021410 con 0x7f1f540ffbb0 2024-04-01T06:59:05.386 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.383+0000 7f1f58fb4700 1 -- 172.21.15.83:0/3997263290 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f440095f0 con 0x7f1f540ffbb0 2024-04-01T06:59:05.386 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.383+0000 7f1f437fe700 1 -- 172.21.15.83:0/3997263290 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f44017650 con 0x7f1f540ffbb0 2024-04-01T06:59:05.386 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.383+0000 7f1f58fb4700 1 -- 172.21.15.83:0/3997263290 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f541a5d20 con 0x7f1f540ffbb0 2024-04-01T06:59:05.392 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.385+0000 7f1f437fe700 1 -- 172.21.15.83:0/3997263290 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 25) v1 ==== 135996+0+0 (secure 0 0 0) 0x7f1f440217f0 con 0x7f1f540ffbb0 2024-04-01T06:59:05.392 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.385+0000 7f1f437fe700 1 --2- 172.21.15.83:0/3997263290 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f1f3c0a1290 0x7f1f3c0a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:59:05.392 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.385+0000 7f1f51d9b700 1 --2- 172.21.15.83:0/3997263290 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f1f3c0a1290 0x7f1f3c0a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:59:05.392 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.386+0000 7f1f437fe700 1 -- 172.21.15.83:0/3997263290 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f1f440cdf90 con 0x7f1f540ffbb0 2024-04-01T06:59:05.392 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.386+0000 7f1f51d9b700 1 --2- 172.21.15.83:0/3997263290 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f1f3c0a1290 0x7f1f3c0a3750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1f54102f30 tx=0x7f1f480073d0 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:59:05.392 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.386+0000 7f1f6514ab80 1 Processor -- start 2024-04-01T06:59:05.392 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.387+0000 7f1f6514ab80 1 -- start start 2024-04-01T06:59:05.392 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.387+0000 7f1f6514ab80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc62e68100 0x55cc62e684e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:59:05.392 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.387+0000 7f1f6514ab80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cc62e68a20 0x55cc62e73390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:59:05.392 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.387+0000 7f1f6514ab80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc62e738d0 0x55cc62e75cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:59:05.393 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.387+0000 7f1f6514ab80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc62dc1930 con 0x55cc62e68a20 2024-04-01T06:59:05.393 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.387+0000 7f1f6514ab80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc62dbf2f0 con 0x55cc62e68100 2024-04-01T06:59:05.393 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.387+0000 7f1f6514ab80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc62dbabe0 con 0x55cc62e738d0 2024-04-01T06:59:05.393 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.387+0000 7f1f51d9b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cc62e68a20 0x55cc62e73390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:59:05.393 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.387+0000 7f1f51d9b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cc62e68a20 0x55cc62e73390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55362/0 (socket says 172.21.15.83:55362) 2024-04-01T06:59:05.393 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.387+0000 7f1f5259c700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc62e68100 0x55cc62e684e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:59:05.393 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.387+0000 7f1f51d9b700 1 -- 172.21.15.83:0/2270596827 learned_addr learned my addr 172.21.15.83:0/2270596827 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:59:05.393 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.387+0000 7f1f52d9d700 1 --2- 172.21.15.83:0/2270596827 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc62e738d0 0x55cc62e75cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:59:05.393 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.387+0000 7f1f51d9b700 1 -- 172.21.15.83:0/2270596827 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc62e738d0 msgr2=0x55cc62e75cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:59:05.393 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.387+0000 7f1f51d9b700 1 --2- 172.21.15.83:0/2270596827 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc62e738d0 0x55cc62e75cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:05.393 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.387+0000 7f1f51d9b700 1 -- 172.21.15.83:0/2270596827 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc62e68100 msgr2=0x55cc62e684e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:59:05.393 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.387+0000 7f1f51d9b700 1 --2- 172.21.15.83:0/2270596827 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc62e68100 0x55cc62e684e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:05.393 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.387+0000 7f1f51d9b700 1 -- 172.21.15.83:0/2270596827 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc62c3c350 con 0x55cc62e68a20 2024-04-01T06:59:05.394 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.387+0000 7f1f51d9b700 1 --2- 172.21.15.83:0/2270596827 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cc62e68a20 0x55cc62e73390 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f1f48010e60 tx=0x7f1f48013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd8743b3c0c221c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:59:05.394 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.387+0000 7f1f40ff9700 1 -- 172.21.15.83:0/2270596827 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f48011db0 con 0x55cc62e68a20 2024-04-01T06:59:05.394 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.388+0000 7f1f40ff9700 1 -- 172.21.15.83:0/2270596827 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1f48015070 con 0x55cc62e68a20 2024-04-01T06:59:05.394 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.388+0000 7f1f40ff9700 1 -- 172.21.15.83:0/2270596827 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f48003e00 con 0x55cc62e68a20 2024-04-01T06:59:05.394 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.388+0000 7f1f6514ab80 1 -- 172.21.15.83:0/2270596827 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cc62e68a20 msgr2=0x55cc62e73390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:59:05.394 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.388+0000 7f1f6514ab80 1 --2- 172.21.15.83:0/2270596827 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cc62e68a20 0x55cc62e73390 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f1f48010e60 tx=0x7f1f48013000 comp rx=0 tx=0).stop 2024-04-01T06:59:05.394 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.388+0000 7f1f6514ab80 1 -- 172.21.15.83:0/2270596827 shutdown_connections 2024-04-01T06:59:05.394 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.388+0000 7f1f6514ab80 1 --2- 172.21.15.83:0/2270596827 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc62e738d0 0x55cc62e75cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:05.394 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.388+0000 7f1f6514ab80 1 --2- 172.21.15.83:0/2270596827 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc62e68100 0x55cc62e684e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:05.394 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.388+0000 7f1f6514ab80 1 --2- 172.21.15.83:0/2270596827 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cc62e68a20 0x55cc62e73390 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:05.394 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.388+0000 7f1f6514ab80 1 -- 172.21.15.83:0/2270596827 >> 172.21.15.83:0/2270596827 conn(0x55cc62dc8640 msgr2=0x55cc62e64520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:59:05.394 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.388+0000 7f1f6514ab80 1 -- 172.21.15.83:0/2270596827 shutdown_connections 2024-04-01T06:59:05.394 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.388+0000 7f1f6514ab80 1 -- 172.21.15.83:0/2270596827 wait complete. 2024-04-01T06:59:05.395 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.389+0000 7f1f6514ab80 1 -- start start 2024-04-01T06:59:05.395 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.389+0000 7f1f6514ab80 1 Processor -- start 2024-04-01T06:59:05.395 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.389+0000 7f1f6514ab80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc62e68100 0x55cc62e73200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:59:05.395 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.389+0000 7f1f6514ab80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cc62e68a20 0x55cc62e70540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:59:05.395 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.389+0000 7f1f6514ab80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc62e738d0 0x55cc62e70b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:59:05.395 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.389+0000 7f1f6514ab80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc62d56d20 con 0x55cc62e68a20 2024-04-01T06:59:05.395 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.389+0000 7f1f6514ab80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc62d569c0 con 0x55cc62e68100 2024-04-01T06:59:05.395 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.389+0000 7f1f6514ab80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc62c3e640 con 0x55cc62e738d0 2024-04-01T06:59:05.395 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.389+0000 7f1f6514ab80 10 client.0 _ll_register_callbacks cb 0x55cc62d60410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:59:05.395 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.389+0000 7f1f51d9b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cc62e68a20 0x55cc62e70540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:59:05.395 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.389+0000 7f1f51d9b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cc62e68a20 0x55cc62e70540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55364/0 (socket says 172.21.15.83:55364) 2024-04-01T06:59:05.395 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.389+0000 7f1f51d9b700 1 -- 172.21.15.83:0/1088179764 learned_addr learned my addr 172.21.15.83:0/1088179764 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:59:05.395 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.389+0000 7f1f5259c700 1 --2- 172.21.15.83:0/1088179764 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc62e68100 0x55cc62e73200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:59:05.396 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.389+0000 7f1f52d9d700 1 --2- 172.21.15.83:0/1088179764 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc62e738d0 0x55cc62e70b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:59:05.396 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.389+0000 7f1f51d9b700 1 -- 172.21.15.83:0/1088179764 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc62e738d0 msgr2=0x55cc62e70b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:59:05.396 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.389+0000 7f1f51d9b700 1 --2- 172.21.15.83:0/1088179764 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc62e738d0 0x55cc62e70b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:05.396 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.389+0000 7f1f51d9b700 1 -- 172.21.15.83:0/1088179764 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc62e68100 msgr2=0x55cc62e73200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:59:05.396 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.389+0000 7f1f51d9b700 1 --2- 172.21.15.83:0/1088179764 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc62e68100 0x55cc62e73200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:05.396 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.389+0000 7f1f51d9b700 1 -- 172.21.15.83:0/1088179764 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f48010b40 con 0x55cc62e68a20 2024-04-01T06:59:05.396 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.389+0000 7f1f51d9b700 1 --2- 172.21.15.83:0/1088179764 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cc62e68a20 0x55cc62e70540 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f1f48005fa0 tx=0x7f1f48011de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e76f954affcffa9 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:59:05.396 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.389+0000 7f1f39ffb700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:59:05.396 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.390+0000 7f1f39ffb700 1 -- 172.21.15.83:0/1088179764 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f48026850 con 0x55cc62e68a20 2024-04-01T06:59:05.396 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.390+0000 7f1f39ffb700 1 -- 172.21.15.83:0/1088179764 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f1f48017070 con 0x55cc62e68a20 2024-04-01T06:59:05.396 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.390+0000 7f1f6514ab80 1 -- 172.21.15.83:0/1088179764 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cc62d7b320 con 0x55cc62e68a20 2024-04-01T06:59:05.396 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.390+0000 7f1f39ffb700 1 -- 172.21.15.83:0/1088179764 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1f48003730 con 0x55cc62e68a20 2024-04-01T06:59:05.396 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.390+0000 7f1f6514ab80 10 client.16266 fetch_fsmap learned FSMap version 34 2024-04-01T06:59:05.397 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.390+0000 7f1f6514ab80 1 -- 172.21.15.83:0/1088179764 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55cc62be8b00 con 0x55cc62e68a20 2024-04-01T06:59:05.397 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.390+0000 7f1f39ffb700 1 -- 172.21.15.83:0/1088179764 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55cc62d7b320 con 0x55cc62e68a20 2024-04-01T06:59:05.397 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.390+0000 7f1f39ffb700 1 -- 172.21.15.83:0/1088179764 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f1f48024070 con 0x55cc62e68a20 2024-04-01T06:59:05.397 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.390+0000 7f1f6514ab80 10 client.16266 fetch_fsmap finished waiting for FSMap version 34 2024-04-01T06:59:05.397 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.390+0000 7f1f6514ab80 10 client.16266 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-01T06:59:05.397 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.390+0000 7f1f6514ab80 20 client.16266 populate_metadata read hostname 'smithi083' 2024-04-01T06:59:05.397 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.390+0000 7f1f6514ab80 1 --2- 172.21.15.83:0/1088179764 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55cc62e83480 0x55cc62e858a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:59:05.397 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.390+0000 7f1f6514ab80 4 client.16266 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-01T06:59:05.397 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.390+0000 7f1f6514ab80 1 -- 172.21.15.83:0/1088179764 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cc62db36a0 con 0x55cc62e83480 2024-04-01T06:59:05.397 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.390+0000 7f1f5259c700 1 --2- 172.21.15.83:0/1088179764 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55cc62e83480 0x55cc62e858a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:59:05.397 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.391+0000 7f1f5259c700 1 --2- 172.21.15.83:0/1088179764 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55cc62e83480 0x55cc62e858a0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3672420834d22b1b server_cookie=f016e3a01d1c74a8 in_seq=0 out_seq=0 2024-04-01T06:59:05.397 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.391+0000 7f1f39ffb700 10 client.16266 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:59:05.397 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.391+0000 7f1f39ffb700 1 -- 172.21.15.83:0/1088179764 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55cc62db36a0 con 0x55cc62e83480 2024-04-01T06:59:05.398 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.391+0000 7f1f39ffb700 10 client.16266 handle_command_reply: tid=0 2024-04-01T06:59:05.398 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.391+0000 7f1f6514ab80 1 client.16266 shutdown 2024-04-01T06:59:05.398 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.392+0000 7f1f6514ab80 1 -- 172.21.15.83:0/1088179764 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cc62e68a20 msgr2=0x55cc62e70540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:59:05.398 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.392+0000 7f1f6514ab80 1 --2- 172.21.15.83:0/1088179764 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cc62e68a20 0x55cc62e70540 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f1f48005fa0 tx=0x7f1f48011de0 comp rx=0 tx=0).stop 2024-04-01T06:59:05.398 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.392+0000 7f1f6514ab80 1 -- 172.21.15.83:0/1088179764 shutdown_connections 2024-04-01T06:59:05.398 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.392+0000 7f1f6514ab80 1 --2- 172.21.15.83:0/1088179764 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55cc62e83480 0x55cc62e858a0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:05.398 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.392+0000 7f1f6514ab80 1 --2- 172.21.15.83:0/1088179764 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc62e738d0 0x55cc62e70b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:05.398 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.392+0000 7f1f39ffb700 0 client.16266 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:59:05.398 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.392+0000 7f1f6514ab80 1 --2- 172.21.15.83:0/1088179764 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc62e68100 0x55cc62e73200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:05.398 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.392+0000 7f1f6514ab80 1 --2- 172.21.15.83:0/1088179764 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cc62e68a20 0x55cc62e70540 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:05.398 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.392+0000 7f1f6514ab80 1 -- 172.21.15.83:0/1088179764 >> 172.21.15.83:0/1088179764 conn(0x55cc62dc8640 msgr2=0x55cc62e6a080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:59:05.398 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.392+0000 7f1f6514ab80 1 -- 172.21.15.83:0/1088179764 shutdown_connections 2024-04-01T06:59:05.398 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.392+0000 7f1f6514ab80 1 -- 172.21.15.83:0/1088179764 wait complete. 2024-04-01T06:59:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.392+0000 7f1f6514ab80 20 client.16266 trim_cache size 0 max 16384 2024-04-01T06:59:05.411 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.406+0000 7f1f6514ab80 1 Processor -- start 2024-04-01T06:59:05.411 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.406+0000 7f1f6514ab80 1 -- start start 2024-04-01T06:59:05.411 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.407+0000 7f1f6514ab80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc62e68100 0x55cc62e5e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:59:05.411 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.407+0000 7f1f6514ab80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cc62e68a20 0x55cc62e5daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:59:05.411 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.407+0000 7f1f6514ab80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc62e738d0 0x55cc62e7a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:59:05.411 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.407+0000 7f1f6514ab80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc62e80000 con 0x55cc62e68a20 2024-04-01T06:59:05.411 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.407+0000 7f1f6514ab80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc62e658b0 con 0x55cc62e738d0 2024-04-01T06:59:05.411 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.407+0000 7f1f6514ab80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc62e76290 con 0x55cc62e68100 2024-04-01T06:59:05.411 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.407+0000 7f1f51d9b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cc62e68a20 0x55cc62e5daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:59:05.412 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.407+0000 7f1f51d9b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cc62e68a20 0x55cc62e5daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55376/0 (socket says 172.21.15.83:55376) 2024-04-01T06:59:05.412 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.407+0000 7f1f51d9b700 1 -- 172.21.15.83:0/3017877271 learned_addr learned my addr 172.21.15.83:0/3017877271 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:59:05.412 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.407+0000 7f1f52d9d700 1 --2- 172.21.15.83:0/3017877271 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc62e738d0 0x55cc62e7a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:59:05.412 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.407+0000 7f1f51d9b700 1 -- 172.21.15.83:0/3017877271 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc62e68100 msgr2=0x55cc62e5e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:59:05.412 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.407+0000 7f1f5259c700 1 --2- 172.21.15.83:0/3017877271 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc62e68100 0x55cc62e5e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:59:05.412 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.407+0000 7f1f51d9b700 1 --2- 172.21.15.83:0/3017877271 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc62e68100 0x55cc62e5e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:05.412 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.407+0000 7f1f51d9b700 1 -- 172.21.15.83:0/3017877271 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc62e738d0 msgr2=0x55cc62e7a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:59:05.412 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.407+0000 7f1f51d9b700 1 --2- 172.21.15.83:0/3017877271 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc62e738d0 0x55cc62e7a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:05.412 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.407+0000 7f1f51d9b700 1 -- 172.21.15.83:0/3017877271 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc62d80e40 con 0x55cc62e68a20 2024-04-01T06:59:05.412 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.407+0000 7f1f51d9b700 1 --2- 172.21.15.83:0/3017877271 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cc62e68a20 0x55cc62e5daf0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f1f4801ea70 tx=0x7f1f48011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=460dad1b3f8a2942 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:59:05.412 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.407+0000 7f1f417fa700 1 -- 172.21.15.83:0/3017877271 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4801e620 con 0x55cc62e68a20 2024-04-01T06:59:05.412 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.407+0000 7f1f417fa700 1 -- 172.21.15.83:0/3017877271 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1f48005530 con 0x55cc62e68a20 2024-04-01T06:59:05.412 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.407+0000 7f1f417fa700 1 -- 172.21.15.83:0/3017877271 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f48003b40 con 0x55cc62e68a20 2024-04-01T06:59:05.413 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.408+0000 7f1f6514ab80 1 -- 172.21.15.83:0/3017877271 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cc62e68a20 msgr2=0x55cc62e5daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:59:05.413 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.408+0000 7f1f6514ab80 1 --2- 172.21.15.83:0/3017877271 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cc62e68a20 0x55cc62e5daf0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f1f4801ea70 tx=0x7f1f48011a80 comp rx=0 tx=0).stop 2024-04-01T06:59:05.413 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.408+0000 7f1f6514ab80 1 -- 172.21.15.83:0/3017877271 shutdown_connections 2024-04-01T06:59:05.413 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.408+0000 7f1f6514ab80 1 --2- 172.21.15.83:0/3017877271 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc62e738d0 0x55cc62e7a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:05.413 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.408+0000 7f1f6514ab80 1 --2- 172.21.15.83:0/3017877271 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc62e68100 0x55cc62e5e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:05.413 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.408+0000 7f1f6514ab80 1 --2- 172.21.15.83:0/3017877271 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cc62e68a20 0x55cc62e5daf0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:05.413 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.408+0000 7f1f6514ab80 1 -- 172.21.15.83:0/3017877271 >> 172.21.15.83:0/3017877271 conn(0x55cc62dc8640 msgr2=0x55cc62e5d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:59:05.413 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.408+0000 7f1f6514ab80 1 -- 172.21.15.83:0/3017877271 shutdown_connections 2024-04-01T06:59:05.413 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.408+0000 7f1f6514ab80 1 -- 172.21.15.83:0/3017877271 wait complete. 2024-04-01T06:59:05.413 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.408+0000 7f1f6514ab80 1 -- start start 2024-04-01T06:59:05.413 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.408+0000 7f1f6514ab80 1 Processor -- start 2024-04-01T06:59:05.413 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.408+0000 7f1f6514ab80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc62e68100 0x55cc62e78580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:59:05.413 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.408+0000 7f1f6514ab80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cc62e68a20 0x55cc62e78ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:59:05.413 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.409+0000 7f1f6514ab80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc62e738d0 0x55cc62e79000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:59:05.414 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.409+0000 7f1f6514ab80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc62ed6270 con 0x55cc62e68a20 2024-04-01T06:59:05.414 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.409+0000 7f1f6514ab80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc62ed63b0 con 0x55cc62e68100 2024-04-01T06:59:05.414 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.409+0000 7f1f6514ab80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc62ed64f0 con 0x55cc62e738d0 2024-04-01T06:59:05.414 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.409+0000 7f1f6514ab80 10 client.0 _ll_register_callbacks cb 0x55cc62d60410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:59:05.414 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.409+0000 7f1f51d9b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cc62e68a20 0x55cc62e78ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:59:05.414 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.409+0000 7f1f51d9b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cc62e68a20 0x55cc62e78ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55390/0 (socket says 172.21.15.83:55390) 2024-04-01T06:59:05.414 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.409+0000 7f1f51d9b700 1 -- 172.21.15.83:0/3456025865 learned_addr learned my addr 172.21.15.83:0/3456025865 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:59:05.414 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.409+0000 7f1f5259c700 1 --2- 172.21.15.83:0/3456025865 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc62e68100 0x55cc62e78580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:59:05.414 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.409+0000 7f1f51d9b700 1 -- 172.21.15.83:0/3456025865 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc62e738d0 msgr2=0x55cc62e79000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:59:05.414 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.409+0000 7f1f51d9b700 1 --2- 172.21.15.83:0/3456025865 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc62e738d0 0x55cc62e79000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:05.414 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.409+0000 7f1f51d9b700 1 -- 172.21.15.83:0/3456025865 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc62e68100 msgr2=0x55cc62e78580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:59:05.414 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.409+0000 7f1f51d9b700 1 --2- 172.21.15.83:0/3456025865 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc62e68100 0x55cc62e78580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:05.414 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.409+0000 7f1f51d9b700 1 -- 172.21.15.83:0/3456025865 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cc62be8b00 con 0x55cc62e68a20 2024-04-01T06:59:05.415 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.409+0000 7f1f51d9b700 1 --2- 172.21.15.83:0/3456025865 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cc62e68a20 0x55cc62e78ac0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f1f48010760 tx=0x7f1f480071c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a1eaee3e05eef01 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:59:05.415 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.409+0000 7f1f39ffb700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:59:05.415 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.409+0000 7f1f39ffb700 1 -- 172.21.15.83:0/3456025865 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f480037c0 con 0x55cc62e68a20 2024-04-01T06:59:05.415 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.409+0000 7f1f39ffb700 1 -- 172.21.15.83:0/3456025865 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f1f48017040 con 0x55cc62e68a20 2024-04-01T06:59:05.415 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.409+0000 7f1f6514ab80 1 -- 172.21.15.83:0/3456025865 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1f48015070 con 0x55cc62e68a20 2024-04-01T06:59:05.415 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.409+0000 7f1f39ffb700 1 -- 172.21.15.83:0/3456025865 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1f48003920 con 0x55cc62e68a20 2024-04-01T06:59:05.415 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.409+0000 7f1f6514ab80 10 client.16272 fetch_fsmap learned FSMap version 34 2024-04-01T06:59:05.415 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.409+0000 7f1f6514ab80 1 -- 172.21.15.83:0/3456025865 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55cc62c40c70 con 0x55cc62e68a20 2024-04-01T06:59:05.415 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.409+0000 7f1f39ffb700 1 -- 172.21.15.83:0/3456025865 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1f48049080 con 0x55cc62e68a20 2024-04-01T06:59:05.415 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.410+0000 7f1f39ffb700 1 -- 172.21.15.83:0/3456025865 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f1f48024070 con 0x55cc62e68a20 2024-04-01T06:59:05.415 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.410+0000 7f1f6514ab80 10 client.16272 fetch_fsmap finished waiting for FSMap version 34 2024-04-01T06:59:05.415 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.410+0000 7f1f6514ab80 10 client.16272 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-01T06:59:05.415 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.410+0000 7f1f6514ab80 20 client.16272 populate_metadata read hostname 'smithi083' 2024-04-01T06:59:05.415 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.410+0000 7f1f6514ab80 1 --2- 172.21.15.83:0/3456025865 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55cc62ed7830 0x55cc62ed9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:59:05.416 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.410+0000 7f1f6514ab80 4 client.16272 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-01T06:59:05.416 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.410+0000 7f1f6514ab80 1 -- 172.21.15.83:0/3456025865 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55cc62c09c90 con 0x55cc62ed7830 2024-04-01T06:59:05.416 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.410+0000 7f1f5259c700 1 --2- 172.21.15.83:0/3456025865 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55cc62ed7830 0x55cc62ed9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:59:05.416 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.410+0000 7f1f39ffb700 10 client.16272 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:59:05.416 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.410+0000 7f1f5259c700 1 --2- 172.21.15.83:0/3456025865 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55cc62ed7830 0x55cc62ed9c50 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3404cdbf7ee34c6 server_cookie=50f1d2712498014a in_seq=0 out_seq=0 2024-04-01T06:59:05.522 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.521+0000 7f1f39ffb700 1 -- 172.21.15.83:0/3456025865 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55cc62c09c90 con 0x55cc62ed7830 2024-04-01T06:59:05.522 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.521+0000 7f1f39ffb700 10 client.16272 handle_command_reply: tid=0 2024-04-01T06:59:05.523 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.522+0000 7f1f6514ab80 1 client.16272 shutdown 2024-04-01T06:59:05.523 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.522+0000 7f1f6514ab80 1 -- 172.21.15.83:0/3456025865 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cc62e68a20 msgr2=0x55cc62e78ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:59:05.523 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.522+0000 7f1f6514ab80 1 --2- 172.21.15.83:0/3456025865 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cc62e68a20 0x55cc62e78ac0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f1f48010760 tx=0x7f1f480071c0 comp rx=0 tx=0).stop 2024-04-01T06:59:05.523 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.522+0000 7f1f6514ab80 1 -- 172.21.15.83:0/3456025865 shutdown_connections 2024-04-01T06:59:05.523 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.522+0000 7f1f6514ab80 1 --2- 172.21.15.83:0/3456025865 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55cc62ed7830 0x55cc62ed9c50 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:05.523 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.522+0000 7f1f6514ab80 1 --2- 172.21.15.83:0/3456025865 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cc62e738d0 0x55cc62e79000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:05.523 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.522+0000 7f1f39ffb700 0 client.16272 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:59:05.523 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.522+0000 7f1f6514ab80 1 --2- 172.21.15.83:0/3456025865 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc62e68100 0x55cc62e78580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:05.523 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.522+0000 7f1f6514ab80 1 --2- 172.21.15.83:0/3456025865 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cc62e68a20 0x55cc62e78ac0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:05.523 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.522+0000 7f1f6514ab80 1 -- 172.21.15.83:0/3456025865 >> 172.21.15.83:0/3456025865 conn(0x55cc62dc8640 msgr2=0x55cc62e63d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:59:05.523 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.522+0000 7f1f6514ab80 1 -- 172.21.15.83:0/3456025865 shutdown_connections 2024-04-01T06:59:05.524 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.522+0000 7f1f6514ab80 1 -- 172.21.15.83:0/3456025865 wait complete. 2024-04-01T06:59:05.524 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.522+0000 7f1f6514ab80 20 client.16272 trim_cache size 0 max 16384 2024-04-01T06:59:05.524 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout:{ 2024-04-01T06:59:05.524 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout: "message": "", 2024-04-01T06:59:05.524 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout: "return_code": 0 2024-04-01T06:59:05.524 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout:} 2024-04-01T06:59:05.525 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.522+0000 7f1f58fb4700 1 -- 172.21.15.83:0/3997263290 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f1f3c0a1290 msgr2=0x7f1f3c0a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:59:05.525 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.522+0000 7f1f58fb4700 1 --2- 172.21.15.83:0/3997263290 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f1f3c0a1290 0x7f1f3c0a3750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1f54102f30 tx=0x7f1f480073d0 comp rx=0 tx=0).stop 2024-04-01T06:59:05.525 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.522+0000 7f1f58fb4700 1 -- 172.21.15.83:0/3997263290 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1f540ffbb0 msgr2=0x7f1f54101850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:59:05.525 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.522+0000 7f1f58fb4700 1 --2- 172.21.15.83:0/3997263290 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1f540ffbb0 0x7f1f54101850 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f1f44005770 tx=0x7f1f440057a0 comp rx=0 tx=0).stop 2024-04-01T06:59:05.525 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.523+0000 7f1f58fb4700 1 -- 172.21.15.83:0/3997263290 shutdown_connections 2024-04-01T06:59:05.525 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.523+0000 7f1f58fb4700 1 --2- 172.21.15.83:0/3997263290 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f1f3c0a1290 0x7f1f3c0a3750 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:05.525 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.523+0000 7f1f58fb4700 1 --2- 172.21.15.83:0/3997263290 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1f540ffbb0 0x7f1f54101850 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:05.526 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.523+0000 7f1f58fb4700 1 --2- 172.21.15.83:0/3997263290 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1f54105c60 0x7f1f541022d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:05.526 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.523+0000 7f1f58fb4700 1 --2- 172.21.15.83:0/3997263290 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f54100570 0x7f1f54101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:05.526 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.523+0000 7f1f58fb4700 1 -- 172.21.15.83:0/3997263290 >> 172.21.15.83:0/3997263290 conn(0x7f1f54076d50 msgr2=0x7f1f54068290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:59:05.526 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.523+0000 7f1f58fb4700 1 -- 172.21.15.83:0/3997263290 shutdown_connections 2024-04-01T06:59:05.526 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:05.523+0000 7f1f58fb4700 1 -- 172.21.15.83:0/3997263290 wait complete. 2024-04-01T06:59:07.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:59:06 smithi153 ceph-mon[48187]: pgmap v101: 97 pgs: 97 active+clean; 191 MiB data, 933 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 360 op/s 2024-04-01T06:59:07.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:59:06 smithi145 ceph-mon[47816]: pgmap v101: 97 pgs: 97 active+clean; 191 MiB data, 933 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 360 op/s 2024-04-01T06:59:07.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:59:06 smithi083 ceph-mon[43429]: pgmap v101: 97 pgs: 97 active+clean; 191 MiB data, 933 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 360 op/s 2024-04-01T06:59:09.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:59:08 smithi153 ceph-mon[48187]: pgmap v102: 97 pgs: 97 active+clean; 191 MiB data, 933 MiB used, 1.0 TiB / 1.0 TiB avail; 926 KiB/s rd, 976 KiB/s wr, 163 op/s 2024-04-01T06:59:09.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:59:08 smithi145 ceph-mon[47816]: pgmap v102: 97 pgs: 97 active+clean; 191 MiB data, 933 MiB used, 1.0 TiB / 1.0 TiB avail; 926 KiB/s rd, 976 KiB/s wr, 163 op/s 2024-04-01T06:59:09.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:59:08 smithi083 ceph-mon[43429]: pgmap v102: 97 pgs: 97 active+clean; 191 MiB data, 933 MiB used, 1.0 TiB / 1.0 TiB avail; 926 KiB/s rd, 976 KiB/s wr, 163 op/s 2024-04-01T06:59:11.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:59:10 smithi153 ceph-mon[48187]: pgmap v103: 97 pgs: 97 active+clean; 194 MiB data, 964 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 356 op/s 2024-04-01T06:59:11.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:59:10 smithi145 ceph-mon[47816]: pgmap v103: 97 pgs: 97 active+clean; 194 MiB data, 964 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 356 op/s 2024-04-01T06:59:11.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:59:10 smithi083 ceph-mon[43429]: pgmap v103: 97 pgs: 97 active+clean; 194 MiB data, 964 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 356 op/s 2024-04-01T06:59:13.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:59:12 smithi153 ceph-mon[48187]: pgmap v104: 97 pgs: 97 active+clean; 194 MiB data, 964 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 281 op/s 2024-04-01T06:59:13.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:59:12 smithi145 ceph-mon[47816]: pgmap v104: 97 pgs: 97 active+clean; 194 MiB data, 964 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 281 op/s 2024-04-01T06:59:13.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:59:12 smithi083 ceph-mon[43429]: pgmap v104: 97 pgs: 97 active+clean; 194 MiB data, 964 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 281 op/s 2024-04-01T06:59:15.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:59:14 smithi153 ceph-mon[48187]: pgmap v105: 97 pgs: 97 active+clean; 194 MiB data, 964 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 281 op/s 2024-04-01T06:59:15.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:59:14 smithi145 ceph-mon[47816]: pgmap v105: 97 pgs: 97 active+clean; 194 MiB data, 964 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 281 op/s 2024-04-01T06:59:15.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:59:14 smithi083 ceph-mon[43429]: pgmap v105: 97 pgs: 97 active+clean; 194 MiB data, 964 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 281 op/s 2024-04-01T06:59:17.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:59:16 smithi145 ceph-mon[47816]: pgmap v106: 97 pgs: 97 active+clean; 200 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 374 op/s 2024-04-01T06:59:17.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:59:16 smithi083 ceph-mon[43429]: pgmap v106: 97 pgs: 97 active+clean; 200 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 374 op/s 2024-04-01T06:59:17.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:59:16 smithi153 ceph-mon[48187]: pgmap v106: 97 pgs: 97 active+clean; 200 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 374 op/s 2024-04-01T06:59:18.639 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.638+0000 7f6893af2700 1 -- 172.21.15.83:0/2248780472 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f688c100570 msgr2=0x7f688c10ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:59:18.639 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.638+0000 7f6893af2700 1 --2- 172.21.15.83:0/2248780472 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f688c100570 0x7f688c10ca00 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f688400b0a0 tx=0x7f688400b3b0 comp rx=0 tx=0).stop 2024-04-01T06:59:18.639 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.638+0000 7f6893af2700 1 -- 172.21.15.83:0/2248780472 shutdown_connections 2024-04-01T06:59:18.639 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.638+0000 7f6893af2700 1 --2- 172.21.15.83:0/2248780472 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f688c100570 0x7f688c10ca00 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:18.639 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.638+0000 7f6893af2700 1 --2- 172.21.15.83:0/2248780472 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f688c105c60 0x7f688c106040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:18.639 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.638+0000 7f6893af2700 1 --2- 172.21.15.83:0/2248780472 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f688c0ffbb0 0x7f688c100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:18.639 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.638+0000 7f6893af2700 1 -- 172.21.15.83:0/2248780472 >> 172.21.15.83:0/2248780472 conn(0x7f688c076d50 msgr2=0x7f688c077160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:59:18.640 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.639+0000 7f6893af2700 1 -- 172.21.15.83:0/2248780472 shutdown_connections 2024-04-01T06:59:18.640 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.639+0000 7f6893af2700 1 -- 172.21.15.83:0/2248780472 wait complete. 2024-04-01T06:59:18.640 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.639+0000 7f6893af2700 1 Processor -- start 2024-04-01T06:59:18.640 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.639+0000 7f6893af2700 1 -- start start 2024-04-01T06:59:18.642 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.640+0000 7f6893af2700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f688c0ffbb0 0x7f688c196110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:59:18.642 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.640+0000 7f6893af2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f688c100570 0x7f688c196650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:59:18.642 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.640+0000 7f6893af2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f688c105c60 0x7f688c19a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:59:18.642 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.640+0000 7f6893af2700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688c19b030 con 0x7f688c105c60 2024-04-01T06:59:18.642 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.640+0000 7f6893af2700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688c19b1a0 con 0x7f688c0ffbb0 2024-04-01T06:59:18.642 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.640+0000 7f6893af2700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688c19b360 con 0x7f688c100570 2024-04-01T06:59:18.642 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.640+0000 7f689208f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f688c105c60 0x7f688c19a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:59:18.642 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.640+0000 7f689188e700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f688c0ffbb0 0x7f688c196110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:59:18.642 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.640+0000 7f689188e700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f688c0ffbb0 0x7f688c196110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.83:58746/0 (socket says 172.21.15.83:58746) 2024-04-01T06:59:18.642 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.640+0000 7f689188e700 1 -- 172.21.15.83:0/1101625590 learned_addr learned my addr 172.21.15.83:0/1101625590 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:59:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.640+0000 7f689108d700 1 --2- 172.21.15.83:0/1101625590 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f688c100570 0x7f688c196650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:59:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.640+0000 7f689208f700 1 -- 172.21.15.83:0/1101625590 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f688c100570 msgr2=0x7f688c196650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:59:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.640+0000 7f689208f700 1 --2- 172.21.15.83:0/1101625590 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f688c100570 0x7f688c196650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.640+0000 7f689208f700 1 -- 172.21.15.83:0/1101625590 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f688c0ffbb0 msgr2=0x7f688c196110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:59:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.640+0000 7f689208f700 1 --2- 172.21.15.83:0/1101625590 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f688c0ffbb0 0x7f688c196110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.640+0000 7f689208f700 1 -- 172.21.15.83:0/1101625590 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6884009d00 con 0x7f688c105c60 2024-04-01T06:59:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.640+0000 7f689108d700 1 --2- 172.21.15.83:0/1101625590 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f688c100570 0x7f688c196650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T06:59:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.640+0000 7f689208f700 1 --2- 172.21.15.83:0/1101625590 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f688c105c60 0x7f688c19a9f0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f688400b0a0 tx=0x7f6884007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:59:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.640+0000 7f6882ffd700 1 -- 172.21.15.83:0/1101625590 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688400e040 con 0x7f688c105c60 2024-04-01T06:59:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.641+0000 7f6882ffd700 1 -- 172.21.15.83:0/1101625590 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f688400cec0 con 0x7f688c105c60 2024-04-01T06:59:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.641+0000 7f6893af2700 1 -- 172.21.15.83:0/1101625590 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f688c19b5e0 con 0x7f688c105c60 2024-04-01T06:59:18.644 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.641+0000 7f6882ffd700 1 -- 172.21.15.83:0/1101625590 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688401b450 con 0x7f688c105c60 2024-04-01T06:59:18.644 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.641+0000 7f6893af2700 1 -- 172.21.15.83:0/1101625590 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f688c1a2e80 con 0x7f688c105c60 2024-04-01T06:59:18.652 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.643+0000 7f6882ffd700 1 -- 172.21.15.83:0/1101625590 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 25) v1 ==== 135996+0+0 (secure 0 0 0) 0x7f688401d480 con 0x7f688c105c60 2024-04-01T06:59:18.652 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.643+0000 7f6882ffd700 1 --2- 172.21.15.83:0/1101625590 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f68780a1290 0x7f68780a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:59:18.652 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.643+0000 7f6882ffd700 1 -- 172.21.15.83:0/1101625590 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f68840ce4d0 con 0x7f688c105c60 2024-04-01T06:59:18.652 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.643+0000 7f689188e700 1 --2- 172.21.15.83:0/1101625590 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f68780a1290 0x7f68780a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:59:18.652 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.644+0000 7f689188e700 1 --2- 172.21.15.83:0/1101625590 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f68780a1290 0x7f68780a3750 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f687c005950 tx=0x7f687c00b500 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:59:18.652 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.644+0000 7f689fc88b80 1 Processor -- start 2024-04-01T06:59:18.652 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.644+0000 7f689fc88b80 1 -- start start 2024-04-01T06:59:18.652 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.645+0000 7f689fc88b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a1ff760100 0x55a1ff7604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:59:18.652 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.645+0000 7f689fc88b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a1ff760a20 0x55a1ff76f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:59:18.652 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.645+0000 7f689fc88b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a1ff76fed0 0x55a1ff7722c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:59:18.652 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.645+0000 7f689fc88b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1ff6b9930 con 0x55a1ff760a20 2024-04-01T06:59:18.652 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.645+0000 7f689fc88b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1ff6b72f0 con 0x55a1ff76fed0 2024-04-01T06:59:18.653 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.645+0000 7f689fc88b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1ff6b2be0 con 0x55a1ff760100 2024-04-01T06:59:18.653 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.645+0000 7f689108d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a1ff760a20 0x55a1ff76f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:59:18.653 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.645+0000 7f689108d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a1ff760a20 0x55a1ff76f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:40328/0 (socket says 172.21.15.83:40328) 2024-04-01T06:59:18.653 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.645+0000 7f689108d700 1 -- 172.21.15.83:0/3089718142 learned_addr learned my addr 172.21.15.83:0/3089718142 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:59:18.653 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.645+0000 7f689188e700 1 --2- 172.21.15.83:0/3089718142 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a1ff760100 0x55a1ff7604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:59:18.653 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.645+0000 7f689208f700 1 --2- 172.21.15.83:0/3089718142 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a1ff76fed0 0x55a1ff7722c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:59:18.653 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.645+0000 7f689108d700 1 -- 172.21.15.83:0/3089718142 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a1ff760100 msgr2=0x55a1ff7604e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:59:18.653 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.645+0000 7f689108d700 1 --2- 172.21.15.83:0/3089718142 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a1ff760100 0x55a1ff7604e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:18.653 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.645+0000 7f689108d700 1 -- 172.21.15.83:0/3089718142 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a1ff76fed0 msgr2=0x55a1ff7722c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:59:18.653 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.645+0000 7f689108d700 1 --2- 172.21.15.83:0/3089718142 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a1ff76fed0 0x55a1ff7722c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:18.653 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.645+0000 7f689108d700 1 -- 172.21.15.83:0/3089718142 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a1ff534350 con 0x55a1ff760a20 2024-04-01T06:59:18.653 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.645+0000 7f689208f700 1 --2- 172.21.15.83:0/3089718142 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a1ff76fed0 0x55a1ff7722c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:59:18.653 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.645+0000 7f689108d700 1 --2- 172.21.15.83:0/3089718142 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a1ff760a20 0x55a1ff76f990 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f688800bd60 tx=0x7f688800f640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=836157a0c9fed57 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:59:18.653 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.645+0000 7f6877fff700 1 -- 172.21.15.83:0/3089718142 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688800fdf0 con 0x55a1ff760a20 2024-04-01T06:59:18.654 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.645+0000 7f6877fff700 1 -- 172.21.15.83:0/3089718142 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6888011900 con 0x55a1ff760a20 2024-04-01T06:59:18.654 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.645+0000 7f6877fff700 1 -- 172.21.15.83:0/3089718142 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6888010710 con 0x55a1ff760a20 2024-04-01T06:59:18.654 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.646+0000 7f689fc88b80 1 -- 172.21.15.83:0/3089718142 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a1ff760a20 msgr2=0x55a1ff76f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:59:18.654 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.646+0000 7f689fc88b80 1 --2- 172.21.15.83:0/3089718142 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a1ff760a20 0x55a1ff76f990 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f688800bd60 tx=0x7f688800f640 comp rx=0 tx=0).stop 2024-04-01T06:59:18.654 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.646+0000 7f689fc88b80 1 -- 172.21.15.83:0/3089718142 shutdown_connections 2024-04-01T06:59:18.654 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.646+0000 7f689fc88b80 1 --2- 172.21.15.83:0/3089718142 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a1ff76fed0 0x55a1ff7722c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:18.654 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.646+0000 7f689fc88b80 1 --2- 172.21.15.83:0/3089718142 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a1ff760100 0x55a1ff7604e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:18.654 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.646+0000 7f689fc88b80 1 --2- 172.21.15.83:0/3089718142 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a1ff760a20 0x55a1ff76f990 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:18.654 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.646+0000 7f689fc88b80 1 -- 172.21.15.83:0/3089718142 >> 172.21.15.83:0/3089718142 conn(0x55a1ff6c0640 msgr2=0x55a1ff75c520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:59:18.654 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.646+0000 7f689fc88b80 1 -- 172.21.15.83:0/3089718142 shutdown_connections 2024-04-01T06:59:18.654 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.646+0000 7f689fc88b80 1 -- 172.21.15.83:0/3089718142 wait complete. 2024-04-01T06:59:18.654 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.646+0000 7f689fc88b80 1 -- start start 2024-04-01T06:59:18.654 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.647+0000 7f689fc88b80 1 Processor -- start 2024-04-01T06:59:18.654 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.647+0000 7f689fc88b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a1ff760100 0x55a1ff76f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:59:18.655 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.647+0000 7f689fc88b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a1ff760a20 0x55a1ff76cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:59:18.655 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.647+0000 7f689fc88b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a1ff76fed0 0x55a1ff76d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:59:18.655 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.647+0000 7f689fc88b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1ff64ed20 con 0x55a1ff760a20 2024-04-01T06:59:18.655 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.647+0000 7f689fc88b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1ff64e9c0 con 0x55a1ff760100 2024-04-01T06:59:18.655 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.647+0000 7f689fc88b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1ff536640 con 0x55a1ff76fed0 2024-04-01T06:59:18.655 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.647+0000 7f689fc88b80 10 client.0 _ll_register_callbacks cb 0x55a1ff658410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:59:18.655 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.647+0000 7f689108d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a1ff760a20 0x55a1ff76cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:59:18.655 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.647+0000 7f689108d700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a1ff760a20 0x55a1ff76cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:40340/0 (socket says 172.21.15.83:40340) 2024-04-01T06:59:18.655 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.647+0000 7f689108d700 1 -- 172.21.15.83:0/1286933082 learned_addr learned my addr 172.21.15.83:0/1286933082 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:59:18.655 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.647+0000 7f689188e700 1 --2- 172.21.15.83:0/1286933082 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a1ff760100 0x55a1ff76f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:59:18.655 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.647+0000 7f689208f700 1 --2- 172.21.15.83:0/1286933082 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a1ff76fed0 0x55a1ff76d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:59:18.655 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.647+0000 7f689108d700 1 -- 172.21.15.83:0/1286933082 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a1ff76fed0 msgr2=0x55a1ff76d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:59:18.655 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.647+0000 7f689108d700 1 --2- 172.21.15.83:0/1286933082 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a1ff76fed0 0x55a1ff76d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:18.655 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.647+0000 7f689108d700 1 -- 172.21.15.83:0/1286933082 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a1ff760100 msgr2=0x55a1ff76f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:59:18.655 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.647+0000 7f689108d700 1 --2- 172.21.15.83:0/1286933082 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a1ff760100 0x55a1ff76f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:18.656 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.647+0000 7f689108d700 1 -- 172.21.15.83:0/1286933082 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f688800b9c0 con 0x55a1ff760a20 2024-04-01T06:59:18.656 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.648+0000 7f689108d700 1 --2- 172.21.15.83:0/1286933082 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a1ff760a20 0x55a1ff76cc60 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f688800b390 tx=0x7f688800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c412d5de5109295 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:59:18.656 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.648+0000 7f68757fa700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:59:18.656 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.648+0000 7f68757fa700 1 -- 172.21.15.83:0/1286933082 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6888020070 con 0x55a1ff760a20 2024-04-01T06:59:18.656 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.648+0000 7f68757fa700 1 -- 172.21.15.83:0/1286933082 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f6888011b30 con 0x55a1ff760a20 2024-04-01T06:59:18.656 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.648+0000 7f689fc88b80 1 -- 172.21.15.83:0/1286933082 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a1ff673320 con 0x55a1ff760a20 2024-04-01T06:59:18.656 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.648+0000 7f68757fa700 1 -- 172.21.15.83:0/1286933082 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6888011cf0 con 0x55a1ff760a20 2024-04-01T06:59:18.656 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.648+0000 7f689fc88b80 10 client.16284 fetch_fsmap learned FSMap version 34 2024-04-01T06:59:18.656 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.648+0000 7f689fc88b80 1 -- 172.21.15.83:0/1286933082 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55a1ff4e0b00 con 0x55a1ff760a20 2024-04-01T06:59:18.656 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.648+0000 7f68757fa700 1 -- 172.21.15.83:0/1286933082 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a1ff673320 con 0x55a1ff760a20 2024-04-01T06:59:18.656 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.648+0000 7f68757fa700 1 -- 172.21.15.83:0/1286933082 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f688802d020 con 0x55a1ff760a20 2024-04-01T06:59:18.656 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.648+0000 7f689fc88b80 10 client.16284 fetch_fsmap finished waiting for FSMap version 34 2024-04-01T06:59:18.656 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.648+0000 7f689fc88b80 10 client.16284 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-01T06:59:18.656 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.648+0000 7f689fc88b80 20 client.16284 populate_metadata read hostname 'smithi083' 2024-04-01T06:59:18.657 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.648+0000 7f689fc88b80 1 --2- 172.21.15.83:0/1286933082 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55a1ff77f8e0 0x55a1ff781d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:59:18.657 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.648+0000 7f689fc88b80 4 client.16284 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-01T06:59:18.657 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.648+0000 7f689fc88b80 1 -- 172.21.15.83:0/1286933082 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a1ff6ab6a0 con 0x55a1ff77f8e0 2024-04-01T06:59:18.657 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.649+0000 7f689188e700 1 --2- 172.21.15.83:0/1286933082 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55a1ff77f8e0 0x55a1ff781d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:59:18.657 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.649+0000 7f689188e700 1 --2- 172.21.15.83:0/1286933082 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55a1ff77f8e0 0x55a1ff781d00 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12103c09876a8b6d server_cookie=a3bf2c55a8f5465e in_seq=0 out_seq=0 2024-04-01T06:59:18.657 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.649+0000 7f68757fa700 10 client.16284 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:59:18.657 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.650+0000 7f68757fa700 1 -- 172.21.15.83:0/1286933082 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a1ff6ab6a0 con 0x55a1ff77f8e0 2024-04-01T06:59:18.657 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.650+0000 7f68757fa700 10 client.16284 handle_command_reply: tid=0 2024-04-01T06:59:18.657 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.650+0000 7f689fc88b80 1 client.16284 shutdown 2024-04-01T06:59:18.657 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.650+0000 7f689fc88b80 1 -- 172.21.15.83:0/1286933082 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a1ff760a20 msgr2=0x55a1ff76cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:59:18.657 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.650+0000 7f689fc88b80 1 --2- 172.21.15.83:0/1286933082 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a1ff760a20 0x55a1ff76cc60 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f688800b390 tx=0x7f688800b910 comp rx=0 tx=0).stop 2024-04-01T06:59:18.657 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.650+0000 7f689fc88b80 1 -- 172.21.15.83:0/1286933082 shutdown_connections 2024-04-01T06:59:18.657 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.650+0000 7f689fc88b80 1 --2- 172.21.15.83:0/1286933082 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55a1ff77f8e0 0x55a1ff781d00 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:18.657 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.650+0000 7f689fc88b80 1 --2- 172.21.15.83:0/1286933082 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a1ff76fed0 0x55a1ff76d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:18.657 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.650+0000 7f689fc88b80 1 --2- 172.21.15.83:0/1286933082 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a1ff760100 0x55a1ff76f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:18.658 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.650+0000 7f68757fa700 0 client.16284 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:59:18.658 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.650+0000 7f689fc88b80 1 --2- 172.21.15.83:0/1286933082 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a1ff760a20 0x55a1ff76cc60 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:18.658 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.650+0000 7f689fc88b80 1 -- 172.21.15.83:0/1286933082 >> 172.21.15.83:0/1286933082 conn(0x55a1ff6c0640 msgr2=0x55a1ff762150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:59:18.658 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.650+0000 7f689fc88b80 1 -- 172.21.15.83:0/1286933082 shutdown_connections 2024-04-01T06:59:18.658 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.650+0000 7f689fc88b80 1 -- 172.21.15.83:0/1286933082 wait complete. 2024-04-01T06:59:18.658 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.650+0000 7f689fc88b80 20 client.16284 trim_cache size 0 max 16384 2024-04-01T06:59:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.665+0000 7f689fc88b80 1 Processor -- start 2024-04-01T06:59:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.665+0000 7f689fc88b80 1 -- start start 2024-04-01T06:59:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.665+0000 7f689fc88b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a1ff760100 0x55a1ff7627a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:59:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.665+0000 7f689fc88b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a1ff760a20 0x55a1ff776a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:59:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.665+0000 7f689fc88b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a1ff76fed0 0x55a1ff763f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:59:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.665+0000 7f689fc88b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1ff762d60 con 0x55a1ff76fed0 2024-04-01T06:59:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.665+0000 7f689fc88b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1ff758430 con 0x55a1ff760100 2024-04-01T06:59:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.665+0000 7f689fc88b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1ff776f70 con 0x55a1ff760a20 2024-04-01T06:59:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.665+0000 7f689208f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a1ff76fed0 0x55a1ff763f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:59:18.670 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.665+0000 7f689208f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a1ff76fed0 0x55a1ff763f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:40356/0 (socket says 172.21.15.83:40356) 2024-04-01T06:59:18.670 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.665+0000 7f689208f700 1 -- 172.21.15.83:0/622835777 learned_addr learned my addr 172.21.15.83:0/622835777 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:59:18.670 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.665+0000 7f689188e700 1 --2- 172.21.15.83:0/622835777 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a1ff760100 0x55a1ff7627a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:59:18.670 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.665+0000 7f689108d700 1 --2- 172.21.15.83:0/622835777 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a1ff760a20 0x55a1ff776a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:59:18.670 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.665+0000 7f689208f700 1 -- 172.21.15.83:0/622835777 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a1ff760a20 msgr2=0x55a1ff776a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:59:18.670 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.665+0000 7f689208f700 1 --2- 172.21.15.83:0/622835777 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a1ff760a20 0x55a1ff776a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:18.670 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.665+0000 7f689208f700 1 -- 172.21.15.83:0/622835777 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a1ff760100 msgr2=0x55a1ff7627a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:59:18.670 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.665+0000 7f689208f700 1 --2- 172.21.15.83:0/622835777 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a1ff760100 0x55a1ff7627a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:18.670 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.665+0000 7f689208f700 1 -- 172.21.15.83:0/622835777 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a1ff678e40 con 0x55a1ff76fed0 2024-04-01T06:59:18.670 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.666+0000 7f689208f700 1 --2- 172.21.15.83:0/622835777 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a1ff76fed0 0x55a1ff763f10 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f6884029030 tx=0x7f688400b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1154149108ffcef server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:59:18.670 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.666+0000 7f6880da8700 1 -- 172.21.15.83:0/622835777 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688409b030 con 0x55a1ff76fed0 2024-04-01T06:59:18.670 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.666+0000 7f6880da8700 1 -- 172.21.15.83:0/622835777 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f688409bdd0 con 0x55a1ff76fed0 2024-04-01T06:59:18.670 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.666+0000 7f6880da8700 1 -- 172.21.15.83:0/622835777 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68840a3ac0 con 0x55a1ff76fed0 2024-04-01T06:59:18.670 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.666+0000 7f689fc88b80 1 -- 172.21.15.83:0/622835777 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a1ff76fed0 msgr2=0x55a1ff763f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:59:18.671 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.666+0000 7f689fc88b80 1 --2- 172.21.15.83:0/622835777 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a1ff76fed0 0x55a1ff763f10 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f6884029030 tx=0x7f688400b3b0 comp rx=0 tx=0).stop 2024-04-01T06:59:18.671 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.666+0000 7f689fc88b80 1 -- 172.21.15.83:0/622835777 shutdown_connections 2024-04-01T06:59:18.671 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.666+0000 7f689fc88b80 1 --2- 172.21.15.83:0/622835777 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a1ff76fed0 0x55a1ff763f10 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:18.671 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.666+0000 7f689fc88b80 1 --2- 172.21.15.83:0/622835777 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a1ff760100 0x55a1ff7627a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:18.671 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.666+0000 7f689fc88b80 1 --2- 172.21.15.83:0/622835777 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a1ff760a20 0x55a1ff776a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:18.671 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.666+0000 7f689fc88b80 1 -- 172.21.15.83:0/622835777 >> 172.21.15.83:0/622835777 conn(0x55a1ff6c0640 msgr2=0x55a1ff762090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:59:18.671 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.666+0000 7f689fc88b80 1 -- 172.21.15.83:0/622835777 shutdown_connections 2024-04-01T06:59:18.671 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.666+0000 7f689fc88b80 1 -- 172.21.15.83:0/622835777 wait complete. 2024-04-01T06:59:18.671 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.667+0000 7f689fc88b80 1 -- start start 2024-04-01T06:59:18.671 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.667+0000 7f689fc88b80 1 Processor -- start 2024-04-01T06:59:18.672 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.667+0000 7f689fc88b80 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a1ff760100 0x55a1ff76b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:59:18.672 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.667+0000 7f689fc88b80 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a1ff760a20 0x55a1ff76ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:59:18.672 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.667+0000 7f689fc88b80 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a1ff76fed0 0x55a1ff76c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:59:18.672 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.667+0000 7f689fc88b80 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1ff76c870 con 0x55a1ff760100 2024-04-01T06:59:18.672 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.667+0000 7f689fc88b80 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1ff76c9e0 con 0x55a1ff76fed0 2024-04-01T06:59:18.672 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.667+0000 7f689fc88b80 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1ff76cba0 con 0x55a1ff760a20 2024-04-01T06:59:18.672 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.667+0000 7f689fc88b80 10 client.0 _ll_register_callbacks cb 0x55a1ff658410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-01T06:59:18.672 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.667+0000 7f689188e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a1ff760100 0x55a1ff76b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:59:18.672 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.667+0000 7f689188e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a1ff760100 0x55a1ff76b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:40364/0 (socket says 172.21.15.83:40364) 2024-04-01T06:59:18.672 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.667+0000 7f689188e700 1 -- 172.21.15.83:0/2031690291 learned_addr learned my addr 172.21.15.83:0/2031690291 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T06:59:18.672 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.667+0000 7f689108d700 1 --2- 172.21.15.83:0/2031690291 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a1ff760a20 0x55a1ff76ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:59:18.672 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.667+0000 7f689188e700 1 -- 172.21.15.83:0/2031690291 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a1ff760a20 msgr2=0x55a1ff76ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:59:18.672 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.667+0000 7f689188e700 1 --2- 172.21.15.83:0/2031690291 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a1ff760a20 0x55a1ff76ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:18.672 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.667+0000 7f689208f700 1 --2- 172.21.15.83:0/2031690291 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a1ff76fed0 0x55a1ff76c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:59:18.673 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.667+0000 7f689188e700 1 -- 172.21.15.83:0/2031690291 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a1ff76fed0 msgr2=0x55a1ff76c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-01T06:59:18.673 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.667+0000 7f689188e700 1 --2- 172.21.15.83:0/2031690291 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a1ff76fed0 0x55a1ff76c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:18.673 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.667+0000 7f689188e700 1 -- 172.21.15.83:0/2031690291 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f688c1a2e80 con 0x55a1ff760100 2024-04-01T06:59:18.673 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.667+0000 7f689208f700 1 --2- 172.21.15.83:0/2031690291 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a1ff76fed0 0x55a1ff76c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T06:59:18.673 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.668+0000 7f689188e700 1 --2- 172.21.15.83:0/2031690291 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a1ff760100 0x55a1ff76b530 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x55a1ff782610 tx=0x7f687c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db6d26b0485cf216 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T06:59:18.673 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.668+0000 7f68757fa700 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-04-01T06:59:18.673 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.668+0000 7f68757fa700 1 -- 172.21.15.83:0/2031690291 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687c0045b0 con 0x55a1ff760100 2024-04-01T06:59:18.673 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.668+0000 7f68757fa700 1 -- 172.21.15.83:0/2031690291 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8425+0+0 (secure 0 0 0) 0x7f687c017070 con 0x55a1ff760100 2024-04-01T06:59:18.673 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.668+0000 7f689fc88b80 1 -- 172.21.15.83:0/2031690291 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6888011900 con 0x55a1ff760100 2024-04-01T06:59:18.673 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.668+0000 7f68757fa700 1 -- 172.21.15.83:0/2031690291 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f687c0039e0 con 0x55a1ff760100 2024-04-01T06:59:18.673 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.668+0000 7f689fc88b80 10 client.16290 fetch_fsmap learned FSMap version 34 2024-04-01T06:59:18.673 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.668+0000 7f689fc88b80 1 -- 172.21.15.83:0/2031690291 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55a1ff538c70 con 0x55a1ff760100 2024-04-01T06:59:18.673 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.668+0000 7f68757fa700 1 -- 172.21.15.83:0/2031690291 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6888011900 con 0x55a1ff760100 2024-04-01T06:59:18.673 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.668+0000 7f68757fa700 1 -- 172.21.15.83:0/2031690291 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 34) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f687c020660 con 0x55a1ff760100 2024-04-01T06:59:18.674 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.668+0000 7f689fc88b80 10 client.16290 fetch_fsmap finished waiting for FSMap version 34 2024-04-01T06:59:18.674 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.668+0000 7f689fc88b80 10 client.16290 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-04-01T06:59:18.674 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.668+0000 7f689fc88b80 20 client.16290 populate_metadata read hostname 'smithi083' 2024-04-01T06:59:18.674 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.668+0000 7f689fc88b80 1 --2- 172.21.15.83:0/2031690291 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55a1ff7d48b0 0x55a1ff7d6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T06:59:18.674 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.668+0000 7f689fc88b80 4 client.16290 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-01T06:59:18.674 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.668+0000 7f689fc88b80 1 -- 172.21.15.83:0/2031690291 --> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a1ff501c90 con 0x55a1ff7d48b0 2024-04-01T06:59:18.674 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.669+0000 7f689108d700 1 --2- 172.21.15.83:0/2031690291 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55a1ff7d48b0 0x55a1ff7d6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T06:59:18.674 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.669+0000 7f689108d700 1 --2- 172.21.15.83:0/2031690291 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55a1ff7d48b0 0x55a1ff7d6cd0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8699e3d1a84631b server_cookie=2a272972b9884122 in_seq=0 out_seq=0 2024-04-01T06:59:18.674 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.669+0000 7f68757fa700 10 client.16290 ms_handle_connect on v2:172.21.15.145:6838/3886435411 2024-04-01T06:59:18.680 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.680+0000 7f68757fa700 1 -- 172.21.15.83:0/2031690291 <== mds.0 v2:172.21.15.145:6838/3886435411 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a1ff501c90 con 0x55a1ff7d48b0 2024-04-01T06:59:18.680 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.680+0000 7f68757fa700 10 client.16290 handle_command_reply: tid=0 2024-04-01T06:59:18.680 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.680+0000 7f689fc88b80 1 client.16290 shutdown 2024-04-01T06:59:18.680 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.680+0000 7f689fc88b80 1 -- 172.21.15.83:0/2031690291 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a1ff760100 msgr2=0x55a1ff76b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:59:18.680 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.680+0000 7f689fc88b80 1 --2- 172.21.15.83:0/2031690291 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a1ff760100 0x55a1ff76b530 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x55a1ff782610 tx=0x7f687c0047c0 comp rx=0 tx=0).stop 2024-04-01T06:59:18.680 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.680+0000 7f689fc88b80 1 -- 172.21.15.83:0/2031690291 shutdown_connections 2024-04-01T06:59:18.681 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.680+0000 7f689fc88b80 1 --2- 172.21.15.83:0/2031690291 >> [v2:172.21.15.145:6838/3886435411,v1:172.21.15.145:6839/3886435411] conn(0x55a1ff7d48b0 0x55a1ff7d6cd0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:18.681 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.680+0000 7f689fc88b80 1 --2- 172.21.15.83:0/2031690291 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a1ff760100 0x55a1ff76b530 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:18.681 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.680+0000 7f689fc88b80 1 --2- 172.21.15.83:0/2031690291 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a1ff76fed0 0x55a1ff76c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:18.681 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.680+0000 7f689fc88b80 1 --2- 172.21.15.83:0/2031690291 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a1ff760a20 0x55a1ff76ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:18.681 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.680+0000 7f68757fa700 0 client.16290 ms_handle_reset on v2:172.21.15.145:6838/3886435411 2024-04-01T06:59:18.681 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.680+0000 7f689fc88b80 1 -- 172.21.15.83:0/2031690291 >> 172.21.15.83:0/2031690291 conn(0x55a1ff6c0640 msgr2=0x55a1ff7553e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:59:18.681 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.680+0000 7f689fc88b80 1 -- 172.21.15.83:0/2031690291 shutdown_connections 2024-04-01T06:59:18.681 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.680+0000 7f689fc88b80 1 -- 172.21.15.83:0/2031690291 wait complete. 2024-04-01T06:59:18.681 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.680+0000 7f689fc88b80 20 client.16290 trim_cache size 0 max 16384 2024-04-01T06:59:18.681 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout:{ 2024-04-01T06:59:18.681 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout: "message": "", 2024-04-01T06:59:18.682 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout: "return_code": 0 2024-04-01T06:59:18.682 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stdout:} 2024-04-01T06:59:18.682 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.681+0000 7f6893af2700 1 -- 172.21.15.83:0/1101625590 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f68780a1290 msgr2=0x7f68780a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:59:18.682 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.681+0000 7f6893af2700 1 --2- 172.21.15.83:0/1101625590 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f68780a1290 0x7f68780a3750 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f687c005950 tx=0x7f687c00b500 comp rx=0 tx=0).stop 2024-04-01T06:59:18.682 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.681+0000 7f6893af2700 1 -- 172.21.15.83:0/1101625590 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f688c105c60 msgr2=0x7f688c19a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T06:59:18.683 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.681+0000 7f6893af2700 1 --2- 172.21.15.83:0/1101625590 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f688c105c60 0x7f688c19a9f0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f688400b0a0 tx=0x7f6884007870 comp rx=0 tx=0).stop 2024-04-01T06:59:18.683 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.681+0000 7f6893af2700 1 -- 172.21.15.83:0/1101625590 shutdown_connections 2024-04-01T06:59:18.683 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.681+0000 7f6893af2700 1 --2- 172.21.15.83:0/1101625590 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f68780a1290 0x7f68780a3750 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:18.683 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.681+0000 7f6893af2700 1 --2- 172.21.15.83:0/1101625590 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f688c105c60 0x7f688c19a9f0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:18.683 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.681+0000 7f6893af2700 1 --2- 172.21.15.83:0/1101625590 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f688c0ffbb0 0x7f688c196110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:18.683 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.681+0000 7f6893af2700 1 --2- 172.21.15.83:0/1101625590 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f688c100570 0x7f688c196650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T06:59:18.683 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.681+0000 7f6893af2700 1 -- 172.21.15.83:0/1101625590 >> 172.21.15.83:0/1101625590 conn(0x7f688c076d50 msgr2=0x7f688c0fea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T06:59:18.683 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.681+0000 7f6893af2700 1 -- 172.21.15.83:0/1101625590 shutdown_connections 2024-04-01T06:59:18.683 INFO:teuthology.task.background_exec.ubuntu@smithi083.front.sepia.ceph.com.smithi083.stderr:2024-04-01T06:59:18.681+0000 7f6893af2700 1 -- 172.21.15.83:0/1101625590 wait complete. 2024-04-01T06:59:19.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:59:18 smithi083 ceph-mon[43429]: pgmap v107: 97 pgs: 97 active+clean; 200 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 286 op/s 2024-04-01T06:59:19.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:59:18 smithi153 ceph-mon[48187]: pgmap v107: 97 pgs: 97 active+clean; 200 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 286 op/s 2024-04-01T06:59:19.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:59:18 smithi145 ceph-mon[47816]: pgmap v107: 97 pgs: 97 active+clean; 200 MiB data, 1022 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 286 op/s 2024-04-01T06:59:21.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:59:20 smithi083 ceph-mon[43429]: pgmap v108: 97 pgs: 97 active+clean; 202 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 325 op/s 2024-04-01T06:59:21.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:59:20 smithi153 ceph-mon[48187]: pgmap v108: 97 pgs: 97 active+clean; 202 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 325 op/s 2024-04-01T06:59:21.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:59:20 smithi145 ceph-mon[47816]: pgmap v108: 97 pgs: 97 active+clean; 202 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 325 op/s 2024-04-01T06:59:23.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:59:22 smithi083 ceph-mon[43429]: pgmap v109: 97 pgs: 97 active+clean; 202 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 749 KiB/s wr, 132 op/s 2024-04-01T06:59:23.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:59:22 smithi153 ceph-mon[48187]: pgmap v109: 97 pgs: 97 active+clean; 202 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 749 KiB/s wr, 132 op/s 2024-04-01T06:59:23.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:59:22 smithi145 ceph-mon[47816]: pgmap v109: 97 pgs: 97 active+clean; 202 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 749 KiB/s wr, 132 op/s 2024-04-01T06:59:23.773 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-04-01T06:59:23.774 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-01T06:59:24.118 DEBUG:teuthology.parallel:result is None 2024-04-01T06:59:24.119 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-01T06:59:24.155 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-01T06:59:24.155 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-04-01T06:59:24.169 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi083.front.sepia.ceph.com 2024-04-01T06:59:24.203 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-04-01T06:59:24.213 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-04-01T06:59:24.213 INFO:teuthology.task.exec:Executing custom commands... 2024-04-01T06:59:24.213 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi083.front.sepia.ceph.com 2024-04-01T06:59:24.213 DEBUG:teuthology.orchestra.run.smithi083:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-04-01T06:59:24.273 DEBUG:teuthology.orchestra.run.smithi083:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-04-01T06:59:25.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:59:24 smithi083 ceph-mon[43429]: pgmap v110: 97 pgs: 97 active+clean; 202 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 749 KiB/s wr, 132 op/s 2024-04-01T06:59:25.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:59:24 smithi153 ceph-mon[48187]: pgmap v110: 97 pgs: 97 active+clean; 202 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 749 KiB/s wr, 132 op/s 2024-04-01T06:59:25.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:59:24 smithi145 ceph-mon[47816]: pgmap v110: 97 pgs: 97 active+clean; 202 MiB data, 1013 MiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 749 KiB/s wr, 132 op/s 2024-04-01T06:59:27.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:59:26 smithi153 ceph-mon[48187]: pgmap v111: 97 pgs: 97 active+clean; 208 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 212 op/s 2024-04-01T06:59:27.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:59:26 smithi145 ceph-mon[47816]: pgmap v111: 97 pgs: 97 active+clean; 208 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 212 op/s 2024-04-01T06:59:27.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:59:26 smithi083 ceph-mon[43429]: pgmap v111: 97 pgs: 97 active+clean; 208 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 212 op/s 2024-04-01T06:59:29.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:59:28 smithi153 ceph-mon[48187]: pgmap v112: 97 pgs: 97 active+clean; 208 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 728 KiB/s rd, 706 KiB/s wr, 118 op/s 2024-04-01T06:59:29.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:59:28 smithi145 ceph-mon[47816]: pgmap v112: 97 pgs: 97 active+clean; 208 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 728 KiB/s rd, 706 KiB/s wr, 118 op/s 2024-04-01T06:59:29.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:59:28 smithi083 ceph-mon[43429]: pgmap v112: 97 pgs: 97 active+clean; 208 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 728 KiB/s rd, 706 KiB/s wr, 118 op/s 2024-04-01T06:59:31.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:59:30 smithi153 ceph-mon[48187]: pgmap v113: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 715 KiB/s wr, 129 op/s 2024-04-01T06:59:31.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:59:30 smithi145 ceph-mon[47816]: pgmap v113: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 715 KiB/s wr, 129 op/s 2024-04-01T06:59:31.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:59:30 smithi083 ceph-mon[43429]: pgmap v113: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 715 KiB/s wr, 129 op/s 2024-04-01T06:59:33.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:59:32 smithi153 ceph-mon[48187]: pgmap v114: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 563 KiB/s wr, 90 op/s 2024-04-01T06:59:33.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:59:32 smithi145 ceph-mon[47816]: pgmap v114: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 563 KiB/s wr, 90 op/s 2024-04-01T06:59:33.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:59:32 smithi083 ceph-mon[43429]: pgmap v114: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 563 KiB/s wr, 90 op/s 2024-04-01T06:59:35.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:59:34 smithi153 ceph-mon[48187]: pgmap v115: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 563 KiB/s wr, 90 op/s 2024-04-01T06:59:35.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:59:34 smithi145 ceph-mon[47816]: pgmap v115: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 563 KiB/s wr, 90 op/s 2024-04-01T06:59:35.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:59:34 smithi083 ceph-mon[43429]: pgmap v115: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 563 KiB/s wr, 90 op/s 2024-04-01T06:59:37.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:59:36 smithi153 ceph-mon[48187]: pgmap v116: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 572 KiB/s wr, 96 op/s 2024-04-01T06:59:37.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:59:36 smithi145 ceph-mon[47816]: pgmap v116: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 572 KiB/s wr, 96 op/s 2024-04-01T06:59:37.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:59:36 smithi083 ceph-mon[43429]: pgmap v116: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 572 KiB/s wr, 96 op/s 2024-04-01T06:59:39.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:59:38 smithi153 ceph-mon[48187]: pgmap v117: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 KiB/s wr, 15 op/s 2024-04-01T06:59:39.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:59:38 smithi145 ceph-mon[47816]: pgmap v117: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 KiB/s wr, 15 op/s 2024-04-01T06:59:39.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:59:38 smithi083 ceph-mon[43429]: pgmap v117: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 KiB/s wr, 15 op/s 2024-04-01T06:59:41.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:59:40 smithi153 ceph-mon[48187]: pgmap v118: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 17 KiB/s wr, 19 op/s 2024-04-01T06:59:41.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:59:40 smithi145 ceph-mon[47816]: pgmap v118: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 17 KiB/s wr, 19 op/s 2024-04-01T06:59:41.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:59:40 smithi083 ceph-mon[43429]: pgmap v118: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 17 KiB/s wr, 19 op/s 2024-04-01T06:59:43.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:59:42 smithi153 ceph-mon[48187]: pgmap v119: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.7 KiB/s wr, 8 op/s 2024-04-01T06:59:43.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:59:42 smithi145 ceph-mon[47816]: pgmap v119: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.7 KiB/s wr, 8 op/s 2024-04-01T06:59:43.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:59:42 smithi083 ceph-mon[43429]: pgmap v119: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.7 KiB/s wr, 8 op/s 2024-04-01T06:59:45.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:59:44 smithi153 ceph-mon[48187]: pgmap v120: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.7 KiB/s wr, 8 op/s 2024-04-01T06:59:45.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:59:44 smithi145 ceph-mon[47816]: pgmap v120: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.7 KiB/s wr, 8 op/s 2024-04-01T06:59:45.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:59:44 smithi083 ceph-mon[43429]: pgmap v120: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.7 KiB/s wr, 8 op/s 2024-04-01T06:59:47.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:59:46 smithi153 ceph-mon[48187]: pgmap v121: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.3 KiB/s wr, 11 op/s 2024-04-01T06:59:47.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:59:46 smithi145 ceph-mon[47816]: pgmap v121: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.3 KiB/s wr, 11 op/s 2024-04-01T06:59:47.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:59:46 smithi083 ceph-mon[43429]: pgmap v121: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.3 KiB/s wr, 11 op/s 2024-04-01T06:59:49.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:59:48 smithi153 ceph-mon[48187]: pgmap v122: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 597 B/s wr, 6 op/s 2024-04-01T06:59:49.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:59:48 smithi145 ceph-mon[47816]: pgmap v122: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 597 B/s wr, 6 op/s 2024-04-01T06:59:49.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:59:48 smithi083 ceph-mon[43429]: pgmap v122: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 597 B/s wr, 6 op/s 2024-04-01T06:59:51.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:59:50 smithi153 ceph-mon[48187]: pgmap v123: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 8 op/s 2024-04-01T06:59:51.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:59:50 smithi145 ceph-mon[47816]: pgmap v123: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 8 op/s 2024-04-01T06:59:51.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:59:50 smithi083 ceph-mon[43429]: pgmap v123: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 8 op/s 2024-04-01T06:59:52.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:59:51 smithi153 ceph-mon[48187]: pgmap v124: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 597 B/s wr, 5 op/s 2024-04-01T06:59:52.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:59:51 smithi145 ceph-mon[47816]: pgmap v124: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 597 B/s wr, 5 op/s 2024-04-01T06:59:52.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:59:51 smithi083 ceph-mon[43429]: pgmap v124: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 597 B/s wr, 5 op/s 2024-04-01T06:59:55.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:59:54 smithi145 ceph-mon[47816]: pgmap v125: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 597 B/s wr, 5 op/s 2024-04-01T06:59:55.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:59:54 smithi083 ceph-mon[43429]: pgmap v125: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 597 B/s wr, 5 op/s 2024-04-01T06:59:55.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:59:54 smithi153 ceph-mon[48187]: pgmap v125: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 597 B/s wr, 5 op/s 2024-04-01T06:59:57.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:59:56 smithi153 ceph-mon[48187]: pgmap v126: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 8 op/s 2024-04-01T06:59:57.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:59:56 smithi145 ceph-mon[47816]: pgmap v126: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 8 op/s 2024-04-01T06:59:57.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:59:56 smithi083 ceph-mon[43429]: pgmap v126: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 8 op/s 2024-04-01T06:59:59.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:59:58 smithi153 ceph-mon[48187]: pgmap v127: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T06:59:59.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:59:58 smithi145 ceph-mon[47816]: pgmap v127: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T06:59:59.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:59:58 smithi083 ceph-mon[43429]: pgmap v127: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:00:00.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:59:59 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T07:00:00.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:59:59 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T07:00:00.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:59:59 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T07:00:00.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:59:59 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T07:00:00.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:59:59 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T07:00:00.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:59:59 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T07:00:00.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 06:59:59 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T07:00:00.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:59:59 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T07:00:00.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:59:59 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T07:00:00.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:59:59 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T07:00:00.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:59:59 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T07:00:00.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:59:59 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T07:00:00.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:59:59 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T07:00:00.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 06:59:59 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T07:00:00.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:59:59 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T07:00:00.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:59:59 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T07:00:00.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:59:59 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T07:00:00.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:59:59 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T07:00:00.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:59:59 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T07:00:00.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:59:59 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T07:00:00.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 06:59:59 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T07:00:00.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:00:00 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mon-a[43406]: 2024-04-01T06:59:59.999+0000 7fc4c282f700 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2024-04-01T07:00:00.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:00:00 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mon-a[43406]: 2024-04-01T06:59:59.999+0000 7fc4c282f700 -1 log_channel(cluster) log [ERR] : [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2024-04-01T07:00:00.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:00:00 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mon-a[43406]: 2024-04-01T06:59:59.999+0000 7fc4c282f700 -1 log_channel(cluster) log [ERR] : mds.e(mds.2): Metadata damage detected 2024-04-01T07:00:01.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:00:00 smithi153 ceph-mon[48187]: pgmap v128: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:00:01.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:00:00 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T07:00:01.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:00:00 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T07:00:01.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:00:00 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T07:00:01.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:00:00 smithi153 ceph-mon[48187]: Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2024-04-01T07:00:01.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:00:00 smithi153 ceph-mon[48187]: [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2024-04-01T07:00:01.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:00:00 smithi153 ceph-mon[48187]: mds.e(mds.2): Metadata damage detected 2024-04-01T07:00:01.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:00:00 smithi145 ceph-mon[47816]: pgmap v128: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:00:01.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:00:00 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T07:00:01.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:00:00 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T07:00:01.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:00:00 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T07:00:01.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:00:00 smithi145 ceph-mon[47816]: Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2024-04-01T07:00:01.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:00:00 smithi145 ceph-mon[47816]: [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2024-04-01T07:00:01.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:00:00 smithi145 ceph-mon[47816]: mds.e(mds.2): Metadata damage detected 2024-04-01T07:00:01.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:00:00 smithi083 ceph-mon[43429]: pgmap v128: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:00:01.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:00:00 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T07:00:01.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:00:00 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T07:00:01.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:00:00 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T07:00:01.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:00:00 smithi083 ceph-mon[43429]: Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2024-04-01T07:00:01.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:00:00 smithi083 ceph-mon[43429]: [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2024-04-01T07:00:01.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:00:00 smithi083 ceph-mon[43429]: mds.e(mds.2): Metadata damage detected 2024-04-01T07:00:03.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:00:02 smithi153 ceph-mon[48187]: pgmap v129: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:00:03.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:00:02 smithi145 ceph-mon[47816]: pgmap v129: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:00:03.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:00:02 smithi083 ceph-mon[43429]: pgmap v129: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:00:05.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:00:04 smithi153 ceph-mon[48187]: pgmap v130: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:00:05.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:00:04 smithi145 ceph-mon[47816]: pgmap v130: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:00:05.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:00:04 smithi083 ceph-mon[43429]: pgmap v130: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:00:07.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:00:06 smithi153 ceph-mon[48187]: pgmap v131: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-01T07:00:07.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:00:06 smithi145 ceph-mon[47816]: pgmap v131: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-01T07:00:07.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:00:06 smithi083 ceph-mon[43429]: pgmap v131: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-01T07:00:09.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:00:08 smithi153 ceph-mon[48187]: pgmap v132: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-01T07:00:09.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:00:08 smithi145 ceph-mon[47816]: pgmap v132: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-01T07:00:09.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:00:08 smithi083 ceph-mon[43429]: pgmap v132: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-01T07:00:11.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:00:10 smithi153 ceph-mon[48187]: pgmap v133: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-01T07:00:11.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:00:10 smithi145 ceph-mon[47816]: pgmap v133: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-01T07:00:11.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:00:10 smithi083 ceph-mon[43429]: pgmap v133: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-01T07:00:13.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:00:12 smithi153 ceph-mon[48187]: pgmap v134: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-01T07:00:13.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:00:12 smithi145 ceph-mon[47816]: pgmap v134: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-01T07:00:13.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:00:12 smithi083 ceph-mon[43429]: pgmap v134: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-01T07:00:15.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:00:14 smithi153 ceph-mon[48187]: pgmap v135: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-01T07:00:15.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:00:14 smithi145 ceph-mon[47816]: pgmap v135: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-01T07:00:15.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:00:14 smithi083 ceph-mon[43429]: pgmap v135: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-01T07:00:17.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:00:16 smithi153 ceph-mon[48187]: pgmap v136: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-01T07:00:17.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:00:16 smithi145 ceph-mon[47816]: pgmap v136: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-01T07:00:17.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:00:16 smithi083 ceph-mon[43429]: pgmap v136: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-01T07:00:19.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:00:18 smithi153 ceph-mon[48187]: pgmap v137: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-01T07:00:19.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:00:18 smithi145 ceph-mon[47816]: pgmap v137: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-01T07:00:19.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:00:18 smithi083 ceph-mon[43429]: pgmap v137: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-01T07:00:21.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:00:20 smithi153 ceph-mon[48187]: pgmap v138: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-01T07:00:21.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:00:20 smithi145 ceph-mon[47816]: pgmap v138: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-01T07:00:21.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:00:20 smithi083 ceph-mon[43429]: pgmap v138: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-01T07:00:23.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:00:22 smithi153 ceph-mon[48187]: pgmap v139: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:00:23.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:00:22 smithi145 ceph-mon[47816]: pgmap v139: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:00:23.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:00:22 smithi083 ceph-mon[43429]: pgmap v139: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:00:25.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:00:24 smithi153 ceph-mon[48187]: pgmap v140: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:00:25.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:00:24 smithi145 ceph-mon[47816]: pgmap v140: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:00:25.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:00:24 smithi083 ceph-mon[43429]: pgmap v140: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:00:27.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:00:26 smithi153 ceph-mon[48187]: pgmap v141: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:00:27.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:00:26 smithi145 ceph-mon[47816]: pgmap v141: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:00:27.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:00:26 smithi083 ceph-mon[43429]: pgmap v141: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:00:28.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:00:27 smithi153 ceph-mon[48187]: pgmap v142: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:00:28.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:00:27 smithi145 ceph-mon[47816]: pgmap v142: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:00:28.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:00:27 smithi083 ceph-mon[43429]: pgmap v142: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:00:31.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:00:30 smithi145 ceph-mon[47816]: pgmap v143: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:00:31.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:00:30 smithi083 ceph-mon[43429]: pgmap v143: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:00:31.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:00:30 smithi153 ceph-mon[48187]: pgmap v143: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:00:33.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:00:32 smithi153 ceph-mon[48187]: pgmap v144: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:00:33.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:00:32 smithi145 ceph-mon[47816]: pgmap v144: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:00:33.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:00:32 smithi083 ceph-mon[43429]: pgmap v144: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:00:35.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:00:34 smithi153 ceph-mon[48187]: pgmap v145: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:00:35.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:00:34 smithi145 ceph-mon[47816]: pgmap v145: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:00:35.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:00:34 smithi083 ceph-mon[43429]: pgmap v145: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:00:37.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:00:36 smithi153 ceph-mon[48187]: pgmap v146: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-04-01T07:00:37.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:00:36 smithi145 ceph-mon[47816]: pgmap v146: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-04-01T07:00:37.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:00:36 smithi083 ceph-mon[43429]: pgmap v146: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-04-01T07:00:39.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:00:38 smithi153 ceph-mon[48187]: pgmap v147: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-01T07:00:39.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:00:38 smithi145 ceph-mon[47816]: pgmap v147: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-01T07:00:39.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:00:38 smithi083 ceph-mon[43429]: pgmap v147: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-01T07:00:41.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:00:40 smithi153 ceph-mon[48187]: pgmap v148: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-04-01T07:00:41.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:00:40 smithi145 ceph-mon[47816]: pgmap v148: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-04-01T07:00:41.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:00:40 smithi083 ceph-mon[43429]: pgmap v148: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-04-01T07:00:43.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:00:42 smithi153 ceph-mon[48187]: pgmap v149: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-01T07:00:43.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:00:42 smithi145 ceph-mon[47816]: pgmap v149: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-01T07:00:43.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:00:42 smithi083 ceph-mon[43429]: pgmap v149: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-01T07:00:45.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:00:44 smithi153 ceph-mon[48187]: pgmap v150: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-01T07:00:45.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:00:44 smithi145 ceph-mon[47816]: pgmap v150: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-01T07:00:45.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:00:44 smithi083 ceph-mon[43429]: pgmap v150: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-04-01T07:00:47.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:00:46 smithi153 ceph-mon[48187]: pgmap v151: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-04-01T07:00:47.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:00:46 smithi145 ceph-mon[47816]: pgmap v151: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-04-01T07:00:47.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:00:46 smithi083 ceph-mon[43429]: pgmap v151: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-04-01T07:00:49.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:00:48 smithi153 ceph-mon[48187]: pgmap v152: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:00:49.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:00:48 smithi145 ceph-mon[47816]: pgmap v152: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:00:49.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:00:48 smithi083 ceph-mon[43429]: pgmap v152: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:00:51.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:00:50 smithi153 ceph-mon[48187]: pgmap v153: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:00:51.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:00:50 smithi145 ceph-mon[47816]: pgmap v153: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:00:51.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:00:50 smithi083 ceph-mon[43429]: pgmap v153: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:00:53.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:00:52 smithi153 ceph-mon[48187]: pgmap v154: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:00:53.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:00:52 smithi145 ceph-mon[47816]: pgmap v154: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:00:53.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:00:52 smithi083 ceph-mon[43429]: pgmap v154: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:00:55.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:00:54 smithi153 ceph-mon[48187]: pgmap v155: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:00:55.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:00:54 smithi145 ceph-mon[47816]: pgmap v155: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:00:55.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:00:54 smithi083 ceph-mon[43429]: pgmap v155: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:00:57.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:00:56 smithi153 ceph-mon[48187]: pgmap v156: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:00:57.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:00:56 smithi145 ceph-mon[47816]: pgmap v156: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:00:57.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:00:56 smithi083 ceph-mon[43429]: pgmap v156: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:00:59.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:00:58 smithi153 ceph-mon[48187]: pgmap v157: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:00:59.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:00:58 smithi145 ceph-mon[47816]: pgmap v157: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:00:59.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:00:58 smithi083 ceph-mon[43429]: pgmap v157: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:01:01.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:01:00 smithi153 ceph-mon[48187]: pgmap v158: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:01:01.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:01:00 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T07:01:01.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:01:00 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T07:01:01.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:01:00 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T07:01:01.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:01:00 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T07:01:01.248 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:01:00 smithi145 ceph-mon[47816]: pgmap v158: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:01:01.249 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:01:00 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T07:01:01.249 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:01:00 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T07:01:01.249 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:01:00 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T07:01:01.249 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:01:00 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T07:01:01.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:01:00 smithi083 ceph-mon[43429]: pgmap v158: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:01:01.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:01:00 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T07:01:01.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:01:00 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T07:01:01.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:01:00 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T07:01:01.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:01:00 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T07:01:03.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:01:02 smithi153 ceph-mon[48187]: pgmap v159: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:01:03.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:01:02 smithi145 ceph-mon[47816]: pgmap v159: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:01:03.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:01:02 smithi083 ceph-mon[43429]: pgmap v159: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:01:04.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:01:03 smithi153 ceph-mon[48187]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-04-01T07:01:04.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:01:03 smithi153 ceph-mon[48187]: pgmap v160: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:01:04.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:01:03 smithi145 ceph-mon[47816]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-04-01T07:01:04.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:01:03 smithi145 ceph-mon[47816]: pgmap v160: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:01:04.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:01:03 smithi083 ceph-mon[43429]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-04-01T07:01:04.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:01:03 smithi083 ceph-mon[43429]: pgmap v160: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:01:07.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:01:06 smithi153 ceph-mon[48187]: pgmap v161: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-01T07:01:07.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:01:06 smithi145 ceph-mon[47816]: pgmap v161: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-01T07:01:07.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:01:06 smithi083 ceph-mon[43429]: pgmap v161: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-01T07:01:09.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:01:08 smithi153 ceph-mon[48187]: pgmap v162: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-01T07:01:09.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:01:08 smithi145 ceph-mon[47816]: pgmap v162: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-01T07:01:09.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:01:08 smithi083 ceph-mon[43429]: pgmap v162: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-01T07:01:11.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:01:10 smithi153 ceph-mon[48187]: pgmap v163: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-01T07:01:11.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:01:10 smithi145 ceph-mon[47816]: pgmap v163: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-01T07:01:11.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:01:10 smithi083 ceph-mon[43429]: pgmap v163: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-01T07:01:13.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:01:12 smithi153 ceph-mon[48187]: pgmap v164: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-01T07:01:13.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:01:12 smithi145 ceph-mon[47816]: pgmap v164: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-01T07:01:13.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:01:12 smithi083 ceph-mon[43429]: pgmap v164: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-01T07:01:15.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:01:14 smithi153 ceph-mon[48187]: pgmap v165: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-01T07:01:15.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:01:14 smithi145 ceph-mon[47816]: pgmap v165: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-01T07:01:15.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:01:14 smithi083 ceph-mon[43429]: pgmap v165: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-01T07:01:17.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:01:16 smithi153 ceph-mon[48187]: pgmap v166: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-01T07:01:17.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:01:16 smithi145 ceph-mon[47816]: pgmap v166: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-01T07:01:17.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:01:16 smithi083 ceph-mon[43429]: pgmap v166: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-01T07:01:19.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:01:18 smithi153 ceph-mon[48187]: pgmap v167: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 4 op/s 2024-04-01T07:01:19.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:01:18 smithi145 ceph-mon[47816]: pgmap v167: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 4 op/s 2024-04-01T07:01:19.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:01:18 smithi083 ceph-mon[43429]: pgmap v167: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 4 op/s 2024-04-01T07:01:21.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:01:20 smithi153 ceph-mon[48187]: pgmap v168: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-01T07:01:21.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:01:20 smithi145 ceph-mon[47816]: pgmap v168: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-01T07:01:21.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:01:20 smithi083 ceph-mon[43429]: pgmap v168: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-01T07:01:22.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:01:21 smithi153 ceph-mon[48187]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-04-01T07:01:22.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:01:21 smithi145 ceph-mon[47816]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-04-01T07:01:22.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:01:21 smithi083 ceph-mon[43429]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-04-01T07:01:23.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:01:22 smithi153 ceph-mon[48187]: pgmap v169: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:01:23.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:01:22 smithi145 ceph-mon[47816]: pgmap v169: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:01:23.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:01:22 smithi083 ceph-mon[43429]: pgmap v169: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:01:25.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:01:24 smithi153 ceph-mon[48187]: pgmap v170: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:01:25.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:01:24 smithi145 ceph-mon[47816]: pgmap v170: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:01:25.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:01:24 smithi083 ceph-mon[43429]: pgmap v170: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:01:27.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:01:26 smithi153 ceph-mon[48187]: pgmap v171: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:01:27.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:01:26 smithi145 ceph-mon[47816]: pgmap v171: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:01:27.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:01:26 smithi083 ceph-mon[43429]: pgmap v171: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:01:28.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:01:27 smithi153 ceph-mon[48187]: pgmap v172: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:01:28.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:01:27 smithi145 ceph-mon[47816]: pgmap v172: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:01:28.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:01:27 smithi083 ceph-mon[43429]: pgmap v172: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:01:31.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:01:30 smithi145 ceph-mon[47816]: pgmap v173: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:01:31.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:01:30 smithi083 ceph-mon[43429]: pgmap v173: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:01:31.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:01:30 smithi153 ceph-mon[48187]: pgmap v173: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:01:33.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:01:32 smithi153 ceph-mon[48187]: pgmap v174: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:01:33.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:01:32 smithi145 ceph-mon[47816]: pgmap v174: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:01:33.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:01:32 smithi083 ceph-mon[43429]: pgmap v174: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:01:35.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:01:34 smithi153 ceph-mon[48187]: pgmap v175: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:01:35.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:01:34 smithi145 ceph-mon[47816]: pgmap v175: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:01:35.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:01:34 smithi083 ceph-mon[43429]: pgmap v175: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:01:37.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:01:36 smithi153 ceph-mon[48187]: pgmap v176: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:01:37.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:01:36 smithi145 ceph-mon[47816]: pgmap v176: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:01:37.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:01:36 smithi083 ceph-mon[43429]: pgmap v176: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:01:39.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:01:38 smithi153 ceph-mon[48187]: pgmap v177: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:01:39.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:01:38 smithi145 ceph-mon[47816]: pgmap v177: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:01:39.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:01:38 smithi083 ceph-mon[43429]: pgmap v177: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:01:41.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:01:40 smithi153 ceph-mon[48187]: pgmap v178: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:01:41.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:01:40 smithi145 ceph-mon[47816]: pgmap v178: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:01:41.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:01:40 smithi083 ceph-mon[43429]: pgmap v178: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:01:42.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:01:41 smithi153 ceph-mon[48187]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-04-01T07:01:42.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:01:41 smithi145 ceph-mon[47816]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-04-01T07:01:42.266 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:01:41 smithi083 ceph-mon[43429]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-04-01T07:01:43.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:01:42 smithi153 ceph-mon[48187]: pgmap v179: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:01:43.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:01:42 smithi145 ceph-mon[47816]: pgmap v179: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:01:43.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:01:42 smithi083 ceph-mon[43429]: pgmap v179: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:01:45.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:01:44 smithi153 ceph-mon[48187]: pgmap v180: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:01:45.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:01:44 smithi145 ceph-mon[47816]: pgmap v180: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:01:45.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:01:44 smithi083 ceph-mon[43429]: pgmap v180: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:01:47.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:01:46 smithi153 ceph-mon[48187]: pgmap v181: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:01:47.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:01:46 smithi153 ceph-mon[48187]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-04-01T07:01:47.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:01:46 smithi145 ceph-mon[47816]: pgmap v181: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:01:47.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:01:46 smithi145 ceph-mon[47816]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-04-01T07:01:47.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:01:46 smithi083 ceph-mon[43429]: pgmap v181: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:01:47.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:01:46 smithi083 ceph-mon[43429]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-04-01T07:01:49.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:01:48 smithi153 ceph-mon[48187]: pgmap v182: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:01:49.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:01:48 smithi145 ceph-mon[47816]: pgmap v182: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:01:49.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:01:48 smithi083 ceph-mon[43429]: pgmap v182: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:01:50.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:01:49 smithi153 ceph-mon[48187]: pgmap v183: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:01:50.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:01:49 smithi145 ceph-mon[47816]: pgmap v183: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:01:50.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:01:49 smithi083 ceph-mon[43429]: pgmap v183: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:01:53.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:01:52 smithi153 ceph-mon[48187]: pgmap v184: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:01:53.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:01:52 smithi145 ceph-mon[47816]: pgmap v184: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:01:53.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:01:52 smithi083 ceph-mon[43429]: pgmap v184: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:01:55.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:01:54 smithi153 ceph-mon[48187]: pgmap v185: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:01:55.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:01:54 smithi145 ceph-mon[47816]: pgmap v185: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:01:55.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:01:54 smithi083 ceph-mon[43429]: pgmap v185: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:01:57.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:01:56 smithi153 ceph-mon[48187]: pgmap v186: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:01:57.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:01:56 smithi153 ceph-mon[48187]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-04-01T07:01:57.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:01:56 smithi145 ceph-mon[47816]: pgmap v186: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:01:57.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:01:56 smithi145 ceph-mon[47816]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-04-01T07:01:57.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:01:56 smithi083 ceph-mon[43429]: pgmap v186: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:01:57.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:01:56 smithi083 ceph-mon[43429]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-04-01T07:01:59.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:01:58 smithi153 ceph-mon[48187]: pgmap v187: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:01:59.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:01:58 smithi145 ceph-mon[47816]: pgmap v187: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:01:59.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:01:58 smithi083 ceph-mon[43429]: pgmap v187: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:02:01.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:02:00 smithi153 ceph-mon[48187]: pgmap v188: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:02:01.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:02:00 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T07:02:01.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:02:00 smithi145 ceph-mon[47816]: pgmap v188: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:02:01.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:02:00 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T07:02:01.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:02:00 smithi083 ceph-mon[43429]: pgmap v188: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:02:01.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:02:00 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T07:02:02.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:02:01 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T07:02:02.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:02:01 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T07:02:02.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:02:01 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T07:02:02.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:02:01 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T07:02:02.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:02:01 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T07:02:02.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:02:01 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T07:02:02.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:02:01 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T07:02:02.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:02:01 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T07:02:02.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:02:01 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T07:02:03.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:02:02 smithi153 ceph-mon[48187]: pgmap v189: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:02:03.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:02:02 smithi145 ceph-mon[47816]: pgmap v189: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:02:03.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:02:02 smithi083 ceph-mon[43429]: pgmap v189: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:02:05.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:02:04 smithi153 ceph-mon[48187]: pgmap v190: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:02:05.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:02:04 smithi145 ceph-mon[47816]: pgmap v190: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:02:05.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:02:04 smithi083 ceph-mon[43429]: pgmap v190: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:02:07.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:02:06 smithi153 ceph-mon[48187]: pgmap v191: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-04-01T07:02:07.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:02:06 smithi145 ceph-mon[47816]: pgmap v191: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-04-01T07:02:07.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:02:06 smithi083 ceph-mon[43429]: pgmap v191: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-04-01T07:02:09.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:02:08 smithi153 ceph-mon[48187]: pgmap v192: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-04-01T07:02:09.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:02:08 smithi153 ceph-mon[48187]: osdmap e85: 12 total, 12 up, 12 in 2024-04-01T07:02:09.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:02:08 smithi153 ceph-mon[48187]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-04-01T07:02:09.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:02:08 smithi145 ceph-mon[47816]: pgmap v192: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-04-01T07:02:09.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:02:08 smithi145 ceph-mon[47816]: osdmap e85: 12 total, 12 up, 12 in 2024-04-01T07:02:09.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:02:08 smithi145 ceph-mon[47816]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-04-01T07:02:09.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:02:08 smithi083 ceph-mon[43429]: pgmap v192: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-04-01T07:02:09.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:02:08 smithi083 ceph-mon[43429]: osdmap e85: 12 total, 12 up, 12 in 2024-04-01T07:02:09.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:02:08 smithi083 ceph-mon[43429]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-04-01T07:02:10.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:02:09 smithi153 ceph-mon[48187]: pgmap v194: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-04-01T07:02:10.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:02:09 smithi145 ceph-mon[47816]: pgmap v194: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-04-01T07:02:10.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:02:09 smithi083 ceph-mon[43429]: pgmap v194: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-04-01T07:02:12.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:02:11 smithi153 ceph-mon[48187]: osdmap e86: 12 total, 12 up, 12 in 2024-04-01T07:02:12.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:02:11 smithi145 ceph-mon[47816]: osdmap e86: 12 total, 12 up, 12 in 2024-04-01T07:02:12.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:02:11 smithi083 ceph-mon[43429]: osdmap e86: 12 total, 12 up, 12 in 2024-04-01T07:02:13.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:02:12 smithi153 ceph-mon[48187]: pgmap v196: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-01T07:02:13.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:02:12 smithi145 ceph-mon[47816]: pgmap v196: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-01T07:02:13.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:02:12 smithi083 ceph-mon[43429]: pgmap v196: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-01T07:02:15.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:02:14 smithi153 ceph-mon[48187]: pgmap v197: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-04-01T07:02:15.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:02:14 smithi145 ceph-mon[47816]: pgmap v197: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-04-01T07:02:15.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:02:14 smithi083 ceph-mon[43429]: pgmap v197: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-04-01T07:02:17.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:02:16 smithi153 ceph-mon[48187]: pgmap v198: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-04-01T07:02:17.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:02:16 smithi145 ceph-mon[47816]: pgmap v198: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-04-01T07:02:17.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:02:16 smithi083 ceph-mon[43429]: pgmap v198: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-04-01T07:02:19.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:02:18 smithi153 ceph-mon[48187]: pgmap v199: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 208 B/s wr, 6 op/s 2024-04-01T07:02:19.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:02:18 smithi145 ceph-mon[47816]: pgmap v199: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 208 B/s wr, 6 op/s 2024-04-01T07:02:19.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:02:18 smithi083 ceph-mon[43429]: pgmap v199: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 208 B/s wr, 6 op/s 2024-04-01T07:02:21.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:02:20 smithi153 ceph-mon[48187]: pgmap v200: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-01T07:02:21.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:02:20 smithi145 ceph-mon[47816]: pgmap v200: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-01T07:02:21.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:02:20 smithi083 ceph-mon[43429]: pgmap v200: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-01T07:02:23.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:02:22 smithi153 ceph-mon[48187]: pgmap v201: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-01T07:02:23.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:02:22 smithi145 ceph-mon[47816]: pgmap v201: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-01T07:02:23.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:02:22 smithi083 ceph-mon[43429]: pgmap v201: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-01T07:02:25.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:02:24 smithi153 ceph-mon[48187]: pgmap v202: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-01T07:02:25.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:02:24 smithi145 ceph-mon[47816]: pgmap v202: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-01T07:02:25.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:02:24 smithi083 ceph-mon[43429]: pgmap v202: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-01T07:02:27.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:02:26 smithi153 ceph-mon[48187]: pgmap v203: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-01T07:02:27.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:02:26 smithi145 ceph-mon[47816]: pgmap v203: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-01T07:02:27.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:02:26 smithi083 ceph-mon[43429]: pgmap v203: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-01T07:02:29.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:02:28 smithi153 ceph-mon[48187]: pgmap v204: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:02:29.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:02:28 smithi145 ceph-mon[47816]: pgmap v204: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:02:29.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:02:28 smithi083 ceph-mon[43429]: pgmap v204: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:02:31.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:02:30 smithi153 ceph-mon[48187]: pgmap v205: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:02:31.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:02:30 smithi145 ceph-mon[47816]: pgmap v205: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:02:31.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:02:30 smithi083 ceph-mon[43429]: pgmap v205: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:02:32.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:02:31 smithi153 ceph-mon[48187]: pgmap v206: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:02:32.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:02:31 smithi145 ceph-mon[47816]: pgmap v206: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:02:32.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:02:31 smithi083 ceph-mon[43429]: pgmap v206: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:02:35.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:02:34 smithi145 ceph-mon[47816]: pgmap v207: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:02:35.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:02:34 smithi083 ceph-mon[43429]: pgmap v207: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:02:35.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:02:34 smithi153 ceph-mon[48187]: pgmap v207: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:02:37.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:02:36 smithi153 ceph-mon[48187]: pgmap v208: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:02:37.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:02:36 smithi145 ceph-mon[47816]: pgmap v208: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:02:37.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:02:36 smithi083 ceph-mon[43429]: pgmap v208: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:02:39.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:02:38 smithi153 ceph-mon[48187]: pgmap v209: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:02:39.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:02:38 smithi145 ceph-mon[47816]: pgmap v209: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:02:39.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:02:38 smithi083 ceph-mon[43429]: pgmap v209: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:02:41.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:02:40 smithi153 ceph-mon[48187]: pgmap v210: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:02:41.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:02:40 smithi145 ceph-mon[47816]: pgmap v210: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:02:41.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:02:40 smithi083 ceph-mon[43429]: pgmap v210: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:02:43.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:02:42 smithi153 ceph-mon[48187]: pgmap v211: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:02:43.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:02:42 smithi145 ceph-mon[47816]: pgmap v211: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:02:43.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:02:42 smithi083 ceph-mon[43429]: pgmap v211: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:02:45.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:02:44 smithi153 ceph-mon[48187]: pgmap v212: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:02:45.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:02:44 smithi145 ceph-mon[47816]: pgmap v212: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:02:45.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:02:44 smithi083 ceph-mon[43429]: pgmap v212: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:02:47.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:02:46 smithi153 ceph-mon[48187]: pgmap v213: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:02:47.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:02:46 smithi145 ceph-mon[47816]: pgmap v213: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:02:47.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:02:46 smithi083 ceph-mon[43429]: pgmap v213: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:02:49.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:02:48 smithi153 ceph-mon[48187]: pgmap v214: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:02:49.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:02:48 smithi145 ceph-mon[47816]: pgmap v214: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:02:49.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:02:48 smithi083 ceph-mon[43429]: pgmap v214: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:02:51.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:02:50 smithi153 ceph-mon[48187]: pgmap v215: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:02:51.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:02:50 smithi145 ceph-mon[47816]: pgmap v215: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:02:51.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:02:50 smithi083 ceph-mon[43429]: pgmap v215: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:02:53.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:02:52 smithi153 ceph-mon[48187]: pgmap v216: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:02:53.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:02:52 smithi145 ceph-mon[47816]: pgmap v216: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:02:53.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:02:52 smithi083 ceph-mon[43429]: pgmap v216: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:02:55.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:02:54 smithi153 ceph-mon[48187]: pgmap v217: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:02:55.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:02:54 smithi145 ceph-mon[47816]: pgmap v217: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:02:55.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:02:54 smithi083 ceph-mon[43429]: pgmap v217: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:02:57.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:02:56 smithi153 ceph-mon[48187]: pgmap v218: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:02:57.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:02:56 smithi145 ceph-mon[47816]: pgmap v218: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:02:57.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:02:56 smithi083 ceph-mon[43429]: pgmap v218: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:02:59.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:02:58 smithi153 ceph-mon[48187]: pgmap v219: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:02:59.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:02:58 smithi145 ceph-mon[47816]: pgmap v219: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:02:59.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:02:58 smithi083 ceph-mon[43429]: pgmap v219: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:03:00.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:02:59 smithi145 ceph-mon[47816]: pgmap v220: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:03:00.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:02:59 smithi083 ceph-mon[43429]: pgmap v220: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:03:00.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:02:59 smithi153 ceph-mon[48187]: pgmap v220: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:03:02.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:03:01 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T07:03:02.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:03:01 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T07:03:02.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:03:01 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T07:03:02.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:03:01 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T07:03:02.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:03:01 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T07:03:02.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:03:01 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T07:03:02.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:03:01 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T07:03:02.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:03:01 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T07:03:02.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:03:01 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T07:03:02.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:03:01 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T07:03:02.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:03:01 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T07:03:02.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:03:01 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T07:03:03.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:03:02 smithi153 ceph-mon[48187]: pgmap v221: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:03:03.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:03:02 smithi145 ceph-mon[47816]: pgmap v221: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:03:03.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:03:02 smithi083 ceph-mon[43429]: pgmap v221: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:03:05.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:03:04 smithi153 ceph-mon[48187]: pgmap v222: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:03:05.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:03:04 smithi145 ceph-mon[47816]: pgmap v222: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:03:05.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:03:04 smithi083 ceph-mon[43429]: pgmap v222: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:03:07.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:03:06 smithi153 ceph-mon[48187]: pgmap v223: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-01T07:03:07.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:03:06 smithi145 ceph-mon[47816]: pgmap v223: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-01T07:03:07.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:03:06 smithi083 ceph-mon[43429]: pgmap v223: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-01T07:03:09.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:03:08 smithi153 ceph-mon[48187]: pgmap v224: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-04-01T07:03:09.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:03:08 smithi153 ceph-mon[48187]: osdmap e87: 12 total, 12 up, 12 in 2024-04-01T07:03:09.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:03:08 smithi145 ceph-mon[47816]: pgmap v224: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-04-01T07:03:09.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:03:08 smithi145 ceph-mon[47816]: osdmap e87: 12 total, 12 up, 12 in 2024-04-01T07:03:09.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:03:08 smithi083 ceph-mon[43429]: pgmap v224: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-04-01T07:03:09.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:03:08 smithi083 ceph-mon[43429]: osdmap e87: 12 total, 12 up, 12 in 2024-04-01T07:03:11.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:03:10 smithi153 ceph-mon[48187]: pgmap v226: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-01T07:03:11.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:03:10 smithi153 ceph-mon[48187]: osdmap e88: 12 total, 12 up, 12 in 2024-04-01T07:03:11.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:03:10 smithi145 ceph-mon[47816]: pgmap v226: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-01T07:03:11.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:03:10 smithi145 ceph-mon[47816]: osdmap e88: 12 total, 12 up, 12 in 2024-04-01T07:03:11.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:03:10 smithi083 ceph-mon[43429]: pgmap v226: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-01T07:03:11.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:03:10 smithi083 ceph-mon[43429]: osdmap e88: 12 total, 12 up, 12 in 2024-04-01T07:03:13.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:03:12 smithi153 ceph-mon[48187]: pgmap v228: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-01T07:03:13.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:03:12 smithi145 ceph-mon[47816]: pgmap v228: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-01T07:03:13.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:03:12 smithi083 ceph-mon[43429]: pgmap v228: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-01T07:03:14.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:03:13 smithi145 ceph-mon[47816]: pgmap v229: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-04-01T07:03:14.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:03:13 smithi083 ceph-mon[43429]: pgmap v229: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-04-01T07:03:14.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:03:13 smithi153 ceph-mon[48187]: pgmap v229: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-04-01T07:03:17.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:03:16 smithi153 ceph-mon[48187]: pgmap v230: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-04-01T07:03:17.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:03:16 smithi145 ceph-mon[47816]: pgmap v230: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-04-01T07:03:17.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:03:16 smithi083 ceph-mon[43429]: pgmap v230: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-04-01T07:03:19.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:03:18 smithi153 ceph-mon[48187]: pgmap v231: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 208 B/s wr, 6 op/s 2024-04-01T07:03:19.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:03:18 smithi145 ceph-mon[47816]: pgmap v231: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 208 B/s wr, 6 op/s 2024-04-01T07:03:19.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:03:18 smithi083 ceph-mon[43429]: pgmap v231: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 208 B/s wr, 6 op/s 2024-04-01T07:03:21.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:03:20 smithi153 ceph-mon[48187]: pgmap v232: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-01T07:03:21.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:03:20 smithi145 ceph-mon[47816]: pgmap v232: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-01T07:03:21.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:03:20 smithi083 ceph-mon[43429]: pgmap v232: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-01T07:03:23.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:03:22 smithi153 ceph-mon[48187]: pgmap v233: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-01T07:03:23.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:03:22 smithi145 ceph-mon[47816]: pgmap v233: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-01T07:03:23.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:03:22 smithi083 ceph-mon[43429]: pgmap v233: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-01T07:03:25.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:03:24 smithi153 ceph-mon[48187]: pgmap v234: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-01T07:03:25.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:03:24 smithi145 ceph-mon[47816]: pgmap v234: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-01T07:03:25.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:03:24 smithi083 ceph-mon[43429]: pgmap v234: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-01T07:03:27.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:03:26 smithi153 ceph-mon[48187]: pgmap v235: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-01T07:03:27.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:03:26 smithi145 ceph-mon[47816]: pgmap v235: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-01T07:03:27.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:03:26 smithi083 ceph-mon[43429]: pgmap v235: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-01T07:03:29.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:03:28 smithi153 ceph-mon[48187]: pgmap v236: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:03:29.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:03:28 smithi145 ceph-mon[47816]: pgmap v236: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:03:29.265 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:03:28 smithi083 ceph-mon[43429]: pgmap v236: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:03:31.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:03:30 smithi153 ceph-mon[48187]: pgmap v237: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:03:31.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:03:30 smithi145 ceph-mon[47816]: pgmap v237: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:03:31.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:03:30 smithi083 ceph-mon[43429]: pgmap v237: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:03:33.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:03:32 smithi153 ceph-mon[48187]: pgmap v238: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:03:33.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:03:32 smithi145 ceph-mon[47816]: pgmap v238: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:03:33.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:03:32 smithi083 ceph-mon[43429]: pgmap v238: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:03:35.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:03:34 smithi153 ceph-mon[48187]: pgmap v239: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:03:35.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:03:34 smithi145 ceph-mon[47816]: pgmap v239: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:03:35.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:03:34 smithi083 ceph-mon[43429]: pgmap v239: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:03:37.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:03:36 smithi153 ceph-mon[48187]: pgmap v240: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:03:37.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:03:36 smithi145 ceph-mon[47816]: pgmap v240: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:03:37.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:03:36 smithi083 ceph-mon[43429]: pgmap v240: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:03:39.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:03:38 smithi153 ceph-mon[48187]: pgmap v241: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:03:39.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:03:38 smithi145 ceph-mon[47816]: pgmap v241: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:03:39.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:03:38 smithi083 ceph-mon[43429]: pgmap v241: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:03:41.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:03:40 smithi153 ceph-mon[48187]: pgmap v242: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:03:41.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:03:40 smithi145 ceph-mon[47816]: pgmap v242: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:03:41.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:03:40 smithi083 ceph-mon[43429]: pgmap v242: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:03:43.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:03:42 smithi153 ceph-mon[48187]: pgmap v243: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:03:43.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:03:42 smithi145 ceph-mon[47816]: pgmap v243: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:03:43.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:03:42 smithi083 ceph-mon[43429]: pgmap v243: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:03:45.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:03:44 smithi153 ceph-mon[48187]: pgmap v244: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:03:45.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:03:44 smithi145 ceph-mon[47816]: pgmap v244: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:03:45.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:03:44 smithi083 ceph-mon[43429]: pgmap v244: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:03:47.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:03:46 smithi153 ceph-mon[48187]: pgmap v245: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:03:47.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:03:46 smithi145 ceph-mon[47816]: pgmap v245: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:03:47.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:03:46 smithi083 ceph-mon[43429]: pgmap v245: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:03:49.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:03:48 smithi153 ceph-mon[48187]: pgmap v246: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:03:49.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:03:48 smithi145 ceph-mon[47816]: pgmap v246: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:03:49.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:03:48 smithi083 ceph-mon[43429]: pgmap v246: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:03:51.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:03:50 smithi153 ceph-mon[48187]: pgmap v247: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:03:51.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:03:50 smithi145 ceph-mon[47816]: pgmap v247: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:03:51.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:03:50 smithi083 ceph-mon[43429]: pgmap v247: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:03:53.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:03:52 smithi153 ceph-mon[48187]: pgmap v248: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:03:53.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:03:52 smithi145 ceph-mon[47816]: pgmap v248: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:03:53.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:03:52 smithi083 ceph-mon[43429]: pgmap v248: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:03:54.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:03:53 smithi145 ceph-mon[47816]: pgmap v249: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:03:54.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:03:53 smithi083 ceph-mon[43429]: pgmap v249: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:03:54.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:03:53 smithi153 ceph-mon[48187]: pgmap v249: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:03:57.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:03:56 smithi153 ceph-mon[48187]: pgmap v250: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:03:57.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:03:56 smithi145 ceph-mon[47816]: pgmap v250: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:03:57.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:03:56 smithi083 ceph-mon[43429]: pgmap v250: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:03:59.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:03:58 smithi153 ceph-mon[48187]: pgmap v251: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:03:59.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:03:58 smithi145 ceph-mon[47816]: pgmap v251: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:03:59.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:03:58 smithi083 ceph-mon[43429]: pgmap v251: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:04:01.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:04:00 smithi153 ceph-mon[48187]: pgmap v252: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:04:01.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:04:00 smithi145 ceph-mon[47816]: pgmap v252: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:04:01.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:04:00 smithi083 ceph-mon[43429]: pgmap v252: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:04:02.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:04:01 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T07:04:02.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:04:01 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T07:04:02.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:04:01 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T07:04:03.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:04:02 smithi153 ceph-mon[48187]: pgmap v253: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:04:03.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:04:02 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T07:04:03.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:04:02 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T07:04:03.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:04:02 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T07:04:03.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:04:02 smithi145 ceph-mon[47816]: pgmap v253: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:04:03.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:04:02 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T07:04:03.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:04:02 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T07:04:03.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:04:02 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T07:04:03.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:04:02 smithi083 ceph-mon[43429]: pgmap v253: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:04:03.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:04:02 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T07:04:03.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:04:02 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T07:04:03.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:04:02 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T07:04:05.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:04:04 smithi153 ceph-mon[48187]: pgmap v254: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:04:05.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:04:04 smithi145 ceph-mon[47816]: pgmap v254: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:04:05.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:04:04 smithi083 ceph-mon[43429]: pgmap v254: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:04:07.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:04:06 smithi153 ceph-mon[48187]: pgmap v255: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-01T07:04:07.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:04:06 smithi145 ceph-mon[47816]: pgmap v255: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-01T07:04:07.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:04:06 smithi083 ceph-mon[43429]: pgmap v255: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-04-01T07:04:09.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:04:08 smithi153 ceph-mon[48187]: pgmap v256: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-04-01T07:04:09.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:04:08 smithi153 ceph-mon[48187]: osdmap e89: 12 total, 12 up, 12 in 2024-04-01T07:04:09.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:04:08 smithi145 ceph-mon[47816]: pgmap v256: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-04-01T07:04:09.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:04:08 smithi145 ceph-mon[47816]: osdmap e89: 12 total, 12 up, 12 in 2024-04-01T07:04:09.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:04:08 smithi083 ceph-mon[43429]: pgmap v256: 97 pgs: 97 active+clean; 209 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-04-01T07:04:09.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:04:08 smithi083 ceph-mon[43429]: osdmap e89: 12 total, 12 up, 12 in 2024-04-01T07:04:10.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:04:09 smithi153 ceph-mon[48187]: pgmap v258: 97 pgs: 35 active+clean+snaptrim_wait, 44 active+clean, 18 active+clean+snaptrim; 127 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-01T07:04:10.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:04:09 smithi145 ceph-mon[47816]: pgmap v258: 97 pgs: 35 active+clean+snaptrim_wait, 44 active+clean, 18 active+clean+snaptrim; 127 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-01T07:04:10.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:04:09 smithi083 ceph-mon[43429]: pgmap v258: 97 pgs: 35 active+clean+snaptrim_wait, 44 active+clean, 18 active+clean+snaptrim; 127 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-01T07:04:13.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:04:12 smithi153 ceph-mon[48187]: pgmap v259: 97 pgs: 35 active+clean+snaptrim_wait, 44 active+clean, 18 active+clean+snaptrim; 127 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-01T07:04:13.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:04:12 smithi145 ceph-mon[47816]: pgmap v259: 97 pgs: 35 active+clean+snaptrim_wait, 44 active+clean, 18 active+clean+snaptrim; 127 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-01T07:04:13.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:04:12 smithi083 ceph-mon[43429]: pgmap v259: 97 pgs: 35 active+clean+snaptrim_wait, 44 active+clean, 18 active+clean+snaptrim; 127 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-01T07:04:15.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:04:14 smithi153 ceph-mon[48187]: pgmap v260: 97 pgs: 35 active+clean+snaptrim_wait, 44 active+clean, 18 active+clean+snaptrim; 127 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-01T07:04:15.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:04:14 smithi145 ceph-mon[47816]: pgmap v260: 97 pgs: 35 active+clean+snaptrim_wait, 44 active+clean, 18 active+clean+snaptrim; 127 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-01T07:04:15.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:04:14 smithi083 ceph-mon[43429]: pgmap v260: 97 pgs: 35 active+clean+snaptrim_wait, 44 active+clean, 18 active+clean+snaptrim; 127 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-01T07:04:17.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:04:16 smithi153 ceph-mon[48187]: pgmap v261: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-01T07:04:17.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:04:16 smithi145 ceph-mon[47816]: pgmap v261: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-01T07:04:17.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:04:16 smithi083 ceph-mon[43429]: pgmap v261: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-01T07:04:19.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:04:18 smithi153 ceph-mon[48187]: pgmap v262: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-01T07:04:19.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:04:18 smithi145 ceph-mon[47816]: pgmap v262: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-01T07:04:19.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:04:18 smithi083 ceph-mon[43429]: pgmap v262: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-01T07:04:21.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:04:20 smithi153 ceph-mon[48187]: pgmap v263: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 173 B/s wr, 7 op/s 2024-04-01T07:04:21.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:04:20 smithi153 ceph-mon[48187]: osdmap e90: 12 total, 12 up, 12 in 2024-04-01T07:04:21.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:04:20 smithi145 ceph-mon[47816]: pgmap v263: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 173 B/s wr, 7 op/s 2024-04-01T07:04:21.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:04:20 smithi145 ceph-mon[47816]: osdmap e90: 12 total, 12 up, 12 in 2024-04-01T07:04:21.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:04:20 smithi083 ceph-mon[43429]: pgmap v263: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 173 B/s wr, 7 op/s 2024-04-01T07:04:21.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:04:20 smithi083 ceph-mon[43429]: osdmap e90: 12 total, 12 up, 12 in 2024-04-01T07:04:23.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:04:22 smithi153 ceph-mon[48187]: pgmap v265: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-01T07:04:23.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:04:22 smithi145 ceph-mon[47816]: pgmap v265: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-01T07:04:23.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:04:22 smithi083 ceph-mon[43429]: pgmap v265: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-01T07:04:25.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:04:24 smithi153 ceph-mon[48187]: pgmap v266: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-01T07:04:25.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:04:24 smithi145 ceph-mon[47816]: pgmap v266: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-01T07:04:25.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:04:24 smithi083 ceph-mon[43429]: pgmap v266: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-01T07:04:27.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:04:26 smithi153 ceph-mon[48187]: pgmap v267: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-01T07:04:27.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:04:26 smithi145 ceph-mon[47816]: pgmap v267: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-01T07:04:27.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:04:26 smithi083 ceph-mon[43429]: pgmap v267: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-01T07:04:28.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:04:27 smithi145 ceph-mon[47816]: pgmap v268: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-01T07:04:28.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:04:27 smithi083 ceph-mon[43429]: pgmap v268: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-01T07:04:28.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:04:27 smithi153 ceph-mon[48187]: pgmap v268: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-01T07:04:31.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:04:30 smithi145 ceph-mon[47816]: pgmap v269: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-01T07:04:31.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:04:30 smithi083 ceph-mon[43429]: pgmap v269: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-01T07:04:31.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:04:30 smithi153 ceph-mon[48187]: pgmap v269: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-04-01T07:04:33.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:04:32 smithi153 ceph-mon[48187]: pgmap v270: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-01T07:04:33.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:04:32 smithi145 ceph-mon[47816]: pgmap v270: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-01T07:04:33.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:04:32 smithi083 ceph-mon[43429]: pgmap v270: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-04-01T07:04:35.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:04:34 smithi153 ceph-mon[48187]: pgmap v271: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:04:35.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:04:34 smithi145 ceph-mon[47816]: pgmap v271: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:04:35.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:04:34 smithi083 ceph-mon[43429]: pgmap v271: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:04:37.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:04:36 smithi153 ceph-mon[48187]: pgmap v272: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:04:37.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:04:36 smithi145 ceph-mon[47816]: pgmap v272: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:04:37.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:04:36 smithi083 ceph-mon[43429]: pgmap v272: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:04:39.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:04:38 smithi153 ceph-mon[48187]: pgmap v273: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:04:39.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:04:38 smithi145 ceph-mon[47816]: pgmap v273: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:04:39.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:04:38 smithi083 ceph-mon[43429]: pgmap v273: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:04:41.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:04:40 smithi153 ceph-mon[48187]: pgmap v274: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:04:41.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:04:40 smithi145 ceph-mon[47816]: pgmap v274: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:04:41.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:04:40 smithi083 ceph-mon[43429]: pgmap v274: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:04:43.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:04:42 smithi153 ceph-mon[48187]: pgmap v275: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:04:43.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:04:42 smithi145 ceph-mon[47816]: pgmap v275: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:04:43.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:04:42 smithi083 ceph-mon[43429]: pgmap v275: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:04:44.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:04:43 smithi153 ceph-mon[48187]: pgmap v276: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:04:44.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:04:43 smithi145 ceph-mon[47816]: pgmap v276: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:04:44.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:04:43 smithi083 ceph-mon[43429]: pgmap v276: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:04:47.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:04:46 smithi153 ceph-mon[48187]: pgmap v277: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:04:47.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:04:46 smithi145 ceph-mon[47816]: pgmap v277: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:04:47.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:04:46 smithi083 ceph-mon[43429]: pgmap v277: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:04:49.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:04:48 smithi153 ceph-mon[48187]: pgmap v278: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:04:49.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:04:48 smithi145 ceph-mon[47816]: pgmap v278: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:04:49.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:04:48 smithi083 ceph-mon[43429]: pgmap v278: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:04:51.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:04:50 smithi153 ceph-mon[48187]: pgmap v279: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:04:51.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:04:50 smithi145 ceph-mon[47816]: pgmap v279: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:04:51.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:04:50 smithi083 ceph-mon[43429]: pgmap v279: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:04:53.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:04:52 smithi153 ceph-mon[48187]: pgmap v280: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:04:53.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:04:52 smithi145 ceph-mon[47816]: pgmap v280: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:04:53.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:04:52 smithi083 ceph-mon[43429]: pgmap v280: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:04:55.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:04:54 smithi153 ceph-mon[48187]: pgmap v281: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:04:55.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:04:54 smithi145 ceph-mon[47816]: pgmap v281: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:04:55.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:04:54 smithi083 ceph-mon[43429]: pgmap v281: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:04:57.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:04:56 smithi153 ceph-mon[48187]: pgmap v282: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:04:57.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:04:56 smithi145 ceph-mon[47816]: pgmap v282: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:04:57.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:04:56 smithi083 ceph-mon[43429]: pgmap v282: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:04:58.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:04:57 smithi145 ceph-mon[47816]: pgmap v283: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:04:58.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:04:57 smithi083 ceph-mon[43429]: pgmap v283: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:04:58.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:04:57 smithi153 ceph-mon[48187]: pgmap v283: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:05:01.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:05:00 smithi145 ceph-mon[47816]: pgmap v284: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:05:01.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:05:00 smithi083 ceph-mon[43429]: pgmap v284: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:05:01.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:05:00 smithi153 ceph-mon[48187]: pgmap v284: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:05:03.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:05:02 smithi153 ceph-mon[48187]: pgmap v285: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:05:03.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:05:02 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T07:05:03.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:05:02 smithi145 ceph-mon[47816]: pgmap v285: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:05:03.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:05:02 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T07:05:03.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:05:02 smithi083 ceph-mon[43429]: pgmap v285: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:05:03.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:05:02 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T07:05:04.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:05:03 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T07:05:04.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:05:03 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T07:05:04.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:05:03 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T07:05:04.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:05:03 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T07:05:04.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:05:03 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T07:05:04.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:05:03 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T07:05:04.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:05:03 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T07:05:04.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:05:03 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T07:05:04.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:05:03 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T07:05:05.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:05:04 smithi153 ceph-mon[48187]: pgmap v286: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:05:05.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:05:04 smithi145 ceph-mon[47816]: pgmap v286: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:05:05.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:05:04 smithi083 ceph-mon[43429]: pgmap v286: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:05:07.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:05:06 smithi153 ceph-mon[48187]: pgmap v287: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-01T07:05:07.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:05:06 smithi145 ceph-mon[47816]: pgmap v287: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-01T07:05:07.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:05:06 smithi083 ceph-mon[43429]: pgmap v287: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-01T07:05:09.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:05:08 smithi153 ceph-mon[48187]: pgmap v288: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-01T07:05:09.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:05:08 smithi145 ceph-mon[47816]: pgmap v288: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-01T07:05:09.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:05:08 smithi083 ceph-mon[43429]: pgmap v288: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-01T07:05:11.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:05:10 smithi153 ceph-mon[48187]: pgmap v289: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-01T07:05:11.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:05:10 smithi145 ceph-mon[47816]: pgmap v289: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-01T07:05:11.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:05:10 smithi083 ceph-mon[43429]: pgmap v289: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-01T07:05:12.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:05:11 smithi145 ceph-mon[47816]: pgmap v290: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-01T07:05:12.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:05:11 smithi083 ceph-mon[43429]: pgmap v290: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-01T07:05:12.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:05:11 smithi153 ceph-mon[48187]: pgmap v290: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-01T07:05:15.003 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:05:14 smithi145 ceph-mon[47816]: pgmap v291: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-01T07:05:15.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:05:14 smithi083 ceph-mon[43429]: pgmap v291: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-01T07:05:15.143 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:05:14 smithi153 ceph-mon[48187]: pgmap v291: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-04-01T07:05:17.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:05:16 smithi153 ceph-mon[48187]: pgmap v292: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-01T07:05:17.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:05:16 smithi145 ceph-mon[47816]: pgmap v292: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-01T07:05:17.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:05:16 smithi083 ceph-mon[43429]: pgmap v292: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-04-01T07:05:19.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:05:18 smithi153 ceph-mon[48187]: pgmap v293: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-01T07:05:19.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:05:18 smithi145 ceph-mon[47816]: pgmap v293: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-01T07:05:19.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:05:18 smithi083 ceph-mon[43429]: pgmap v293: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-04-01T07:05:21.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:05:20 smithi153 ceph-mon[48187]: pgmap v294: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-01T07:05:21.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:05:20 smithi145 ceph-mon[47816]: pgmap v294: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-01T07:05:21.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:05:20 smithi083 ceph-mon[43429]: pgmap v294: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-04-01T07:05:23.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:05:22 smithi153 ceph-mon[48187]: pgmap v295: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:05:23.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:05:22 smithi145 ceph-mon[47816]: pgmap v295: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:05:23.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:05:22 smithi083 ceph-mon[43429]: pgmap v295: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:05:25.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:05:24 smithi153 ceph-mon[48187]: pgmap v296: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:05:25.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:05:24 smithi145 ceph-mon[47816]: pgmap v296: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:05:25.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:05:24 smithi083 ceph-mon[43429]: pgmap v296: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:05:27.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:05:26 smithi153 ceph-mon[48187]: pgmap v297: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:05:27.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:05:26 smithi145 ceph-mon[47816]: pgmap v297: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:05:27.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:05:26 smithi083 ceph-mon[43429]: pgmap v297: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:05:29.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:05:28 smithi153 ceph-mon[48187]: pgmap v298: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:05:29.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:05:28 smithi145 ceph-mon[47816]: pgmap v298: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:05:29.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:05:28 smithi083 ceph-mon[43429]: pgmap v298: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:05:31.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:05:30 smithi153 ceph-mon[48187]: pgmap v299: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:05:31.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:05:30 smithi145 ceph-mon[47816]: pgmap v299: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:05:31.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:05:30 smithi083 ceph-mon[43429]: pgmap v299: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:05:33.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:05:32 smithi153 ceph-mon[48187]: pgmap v300: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:05:33.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:05:32 smithi145 ceph-mon[47816]: pgmap v300: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:05:33.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:05:32 smithi083 ceph-mon[43429]: pgmap v300: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:05:34.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:05:33 smithi145 ceph-mon[47816]: pgmap v301: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:05:34.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:05:33 smithi083 ceph-mon[43429]: pgmap v301: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:05:34.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:05:33 smithi153 ceph-mon[48187]: pgmap v301: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:05:37.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:05:36 smithi153 ceph-mon[48187]: pgmap v302: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:05:37.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:05:36 smithi145 ceph-mon[47816]: pgmap v302: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:05:37.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:05:36 smithi083 ceph-mon[43429]: pgmap v302: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:05:39.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:05:38 smithi153 ceph-mon[48187]: pgmap v303: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:05:39.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:05:38 smithi145 ceph-mon[47816]: pgmap v303: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:05:39.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:05:38 smithi083 ceph-mon[43429]: pgmap v303: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-04-01T07:05:41.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:05:40 smithi153 ceph-mon[48187]: pgmap v304: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:05:41.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:05:40 smithi145 ceph-mon[47816]: pgmap v304: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:05:41.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:05:40 smithi083 ceph-mon[43429]: pgmap v304: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:05:43.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:05:42 smithi153 ceph-mon[48187]: pgmap v305: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-01T07:05:43.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:05:42 smithi145 ceph-mon[47816]: pgmap v305: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-01T07:05:43.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:05:42 smithi083 ceph-mon[43429]: pgmap v305: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-01T07:05:45.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:05:44 smithi153 ceph-mon[48187]: pgmap v306: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-01T07:05:45.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:05:44 smithi145 ceph-mon[47816]: pgmap v306: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-01T07:05:45.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:05:44 smithi083 ceph-mon[43429]: pgmap v306: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-01T07:05:47.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:05:46 smithi153 ceph-mon[48187]: pgmap v307: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:05:47.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:05:46 smithi145 ceph-mon[47816]: pgmap v307: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:05:47.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:05:46 smithi083 ceph-mon[43429]: pgmap v307: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:05:49.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:05:48 smithi153 ceph-mon[48187]: pgmap v308: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-01T07:05:49.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:05:48 smithi145 ceph-mon[47816]: pgmap v308: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-01T07:05:49.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:05:48 smithi083 ceph-mon[43429]: pgmap v308: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-01T07:05:51.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:05:50 smithi153 ceph-mon[48187]: pgmap v309: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-01T07:05:51.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:05:50 smithi145 ceph-mon[47816]: pgmap v309: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-01T07:05:51.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:05:50 smithi083 ceph-mon[43429]: pgmap v309: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-04-01T07:05:53.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:05:52 smithi153 ceph-mon[48187]: pgmap v310: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-01T07:05:53.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:05:52 smithi145 ceph-mon[47816]: pgmap v310: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-01T07:05:53.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:05:52 smithi083 ceph-mon[43429]: pgmap v310: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-01T07:05:55.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:05:54 smithi153 ceph-mon[48187]: pgmap v311: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-01T07:05:55.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:05:54 smithi145 ceph-mon[47816]: pgmap v311: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-01T07:05:55.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:05:54 smithi083 ceph-mon[43429]: pgmap v311: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-01T07:05:55.344 DEBUG:teuthology.orchestra.run.smithi083:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-04-01T07:05:55.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.495+0000 7f22e4fd8700 1 -- 172.21.15.83:0/1261194650 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22e0100ab0 msgr2=0x7f22e0104860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:05:55.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.495+0000 7f22e4fd8700 1 --2- 172.21.15.83:0/1261194650 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22e0100ab0 0x7f22e0104860 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f22d0009990 tx=0x7f22d0009ca0 comp rx=0 tx=0).stop 2024-04-01T07:05:55.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.495+0000 7f22e4fd8700 1 -- 172.21.15.83:0/1261194650 shutdown_connections 2024-04-01T07:05:55.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.495+0000 7f22e4fd8700 1 --2- 172.21.15.83:0/1261194650 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f22e0104f40 0x7f22e010cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:55.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.495+0000 7f22e4fd8700 1 --2- 172.21.15.83:0/1261194650 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22e0100100 0x7f22e01004e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:55.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.495+0000 7f22e4fd8700 1 --2- 172.21.15.83:0/1261194650 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22e0100ab0 0x7f22e0104860 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:55.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.495+0000 7f22e4fd8700 1 -- 172.21.15.83:0/1261194650 >> 172.21.15.83:0/1261194650 conn(0x7f22e0076a10 msgr2=0x7f22e0076e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T07:05:55.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.495+0000 7f22e4fd8700 1 -- 172.21.15.83:0/1261194650 shutdown_connections 2024-04-01T07:05:55.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.495+0000 7f22e4fd8700 1 -- 172.21.15.83:0/1261194650 wait complete. 2024-04-01T07:05:55.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.496+0000 7f22e4fd8700 1 Processor -- start 2024-04-01T07:05:55.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.496+0000 7f22e4fd8700 1 -- start start 2024-04-01T07:05:55.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.496+0000 7f22e4fd8700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22e0100100 0x7f22e0196040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:05:55.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.496+0000 7f22e4fd8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22e0104f40 0x7f22e0196580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:05:55.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.496+0000 7f22e4fd8700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f22e019a8d0 0x7f22e019ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:05:55.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.496+0000 7f22e4fd8700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e019b350 con 0x7f22e0100100 2024-04-01T07:05:55.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.496+0000 7f22e4fd8700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e019b4c0 con 0x7f22e019a8d0 2024-04-01T07:05:55.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.496+0000 7f22e4fd8700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e019b680 con 0x7f22e0104f40 2024-04-01T07:05:55.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.496+0000 7f22de59c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22e0100100 0x7f22e0196040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:05:55.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.496+0000 7f22de59c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22e0100100 0x7f22e0196040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55888/0 (socket says 172.21.15.83:55888) 2024-04-01T07:05:55.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.496+0000 7f22de59c700 1 -- 172.21.15.83:0/3333417802 learned_addr learned my addr 172.21.15.83:0/3333417802 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T07:05:55.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.496+0000 7f22de59c700 1 -- 172.21.15.83:0/3333417802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22e0104f40 msgr2=0x7f22e0196580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:05:55.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.496+0000 7f22ddd9b700 1 --2- 172.21.15.83:0/3333417802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22e0104f40 0x7f22e0196580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:05:55.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.497+0000 7f22ded9d700 1 --2- 172.21.15.83:0/3333417802 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f22e019a8d0 0x7f22e019ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:05:55.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.497+0000 7f22de59c700 1 --2- 172.21.15.83:0/3333417802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22e0104f40 0x7f22e0196580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:55.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.497+0000 7f22de59c700 1 -- 172.21.15.83:0/3333417802 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f22e019a8d0 msgr2=0x7f22e019ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:05:55.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.497+0000 7f22de59c700 1 --2- 172.21.15.83:0/3333417802 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f22e019a8d0 0x7f22e019ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:55.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.497+0000 7f22de59c700 1 -- 172.21.15.83:0/3333417802 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d00095f0 con 0x7f22e0100100 2024-04-01T07:05:55.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.497+0000 7f22ded9d700 1 --2- 172.21.15.83:0/3333417802 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f22e019a8d0 0x7f22e019ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T07:05:55.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.497+0000 7f22ddd9b700 1 --2- 172.21.15.83:0/3333417802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22e0104f40 0x7f22e0196580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T07:05:55.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.497+0000 7f22de59c700 1 --2- 172.21.15.83:0/3333417802 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22e0100100 0x7f22e0196040 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f22d400c920 tx=0x7f22d400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T07:05:55.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.497+0000 7f22cf7fe700 1 -- 172.21.15.83:0/3333417802 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d4007b00 con 0x7f22e0100100 2024-04-01T07:05:55.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.497+0000 7f22cf7fe700 1 -- 172.21.15.83:0/3333417802 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f22d4004cf0 con 0x7f22e0100100 2024-04-01T07:05:55.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.497+0000 7f22e4fd8700 1 -- 172.21.15.83:0/3333417802 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22e01a2be0 con 0x7f22e0100100 2024-04-01T07:05:55.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.497+0000 7f22cf7fe700 1 -- 172.21.15.83:0/3333417802 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d4005610 con 0x7f22e0100100 2024-04-01T07:05:55.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.497+0000 7f22e4fd8700 1 -- 172.21.15.83:0/3333417802 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22e01a30c0 con 0x7f22e0100100 2024-04-01T07:05:55.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.498+0000 7f22e4fd8700 1 -- 172.21.15.83:0/3333417802 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22e0108100 con 0x7f22e0100100 2024-04-01T07:05:55.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.499+0000 7f22cf7fe700 1 -- 172.21.15.83:0/3333417802 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 25) v1 ==== 135996+0+0 (secure 0 0 0) 0x7f22d4004750 con 0x7f22e0100100 2024-04-01T07:05:55.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.499+0000 7f22cf7fe700 1 --2- 172.21.15.83:0/3333417802 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f22c80a1290 0x7f22c80a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:05:55.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.500+0000 7f22ddd9b700 1 --2- 172.21.15.83:0/3333417802 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f22c80a1290 0x7f22c80a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:05:55.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.500+0000 7f22cf7fe700 1 -- 172.21.15.83:0/3333417802 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f22d40cccb0 con 0x7f22e0100100 2024-04-01T07:05:55.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.500+0000 7f22ddd9b700 1 --2- 172.21.15.83:0/3333417802 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f22c80a1290 0x7f22c80a3750 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f22d000b5c0 tx=0x7f22d0005fb0 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T07:05:55.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.504+0000 7f22cf7fe700 1 -- 172.21.15.83:0/3333417802 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f22d40960d0 con 0x7f22e0100100 2024-04-01T07:05:55.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.730+0000 7f22e4fd8700 1 -- 172.21.15.83:0/3333417802 --> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) v1 -- 0x7f22e0100ab0 con 0x7f22c80a1290 2024-04-01T07:05:55.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.737+0000 7f22cf7fe700 1 -- 172.21.15.83:0/3333417802 <== mgr.15420 v2:172.21.15.83:6800/3294653546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+350 (secure 0 0 0) 0x7f22e0100ab0 con 0x7f22c80a1290 2024-04-01T07:05:55.737 INFO:teuthology.orchestra.run.smithi083.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-04-01T00:00:00", "created": "2024-04-01T06:55:54", "first": "2024-04-01T06:56:00", "last": "2024-04-01T07:05:01", "last_pruned": "2024-04-01T07:04:00", "created_count": 10, "pruned_count": 3, "active": true} 2024-04-01T07:05:55.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.739+0000 7f22e4fd8700 1 -- 172.21.15.83:0/3333417802 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f22c80a1290 msgr2=0x7f22c80a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:05:55.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.739+0000 7f22e4fd8700 1 --2- 172.21.15.83:0/3333417802 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f22c80a1290 0x7f22c80a3750 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f22d000b5c0 tx=0x7f22d0005fb0 comp rx=0 tx=0).stop 2024-04-01T07:05:55.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.739+0000 7f22e4fd8700 1 -- 172.21.15.83:0/3333417802 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22e0100100 msgr2=0x7f22e0196040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:05:55.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.739+0000 7f22e4fd8700 1 --2- 172.21.15.83:0/3333417802 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22e0100100 0x7f22e0196040 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f22d400c920 tx=0x7f22d400cce0 comp rx=0 tx=0).stop 2024-04-01T07:05:55.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.739+0000 7f22e4fd8700 1 -- 172.21.15.83:0/3333417802 shutdown_connections 2024-04-01T07:05:55.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.739+0000 7f22e4fd8700 1 --2- 172.21.15.83:0/3333417802 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f22c80a1290 0x7f22c80a3750 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:55.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.739+0000 7f22e4fd8700 1 --2- 172.21.15.83:0/3333417802 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22e0100100 0x7f22e0196040 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:55.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.739+0000 7f22e4fd8700 1 --2- 172.21.15.83:0/3333417802 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f22e019a8d0 0x7f22e019ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:55.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.739+0000 7f22e4fd8700 1 --2- 172.21.15.83:0/3333417802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22e0104f40 0x7f22e0196580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:55.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.739+0000 7f22e4fd8700 1 -- 172.21.15.83:0/3333417802 >> 172.21.15.83:0/3333417802 conn(0x7f22e0076a10 msgr2=0x7f22e0103bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T07:05:55.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.739+0000 7f22e4fd8700 1 -- 172.21.15.83:0/3333417802 shutdown_connections 2024-04-01T07:05:55.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.739+0000 7f22e4fd8700 1 -- 172.21.15.83:0/3333417802 wait complete. 2024-04-01T07:05:55.751 DEBUG:teuthology.orchestra.run.smithi083:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-04-01T07:05:55.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.874+0000 7f1c6dfc2700 1 -- 172.21.15.83:0/1695060275 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1c68068aa0 msgr2=0x7f1c6810dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:05:55.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.874+0000 7f1c6dfc2700 1 --2- 172.21.15.83:0/1695060275 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1c68068aa0 0x7f1c6810dab0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f1c6000b0a0 tx=0x7f1c6000b3b0 comp rx=0 tx=0).stop 2024-04-01T07:05:55.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.874+0000 7f1c6dfc2700 1 -- 172.21.15.83:0/1695060275 shutdown_connections 2024-04-01T07:05:55.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.874+0000 7f1c6dfc2700 1 --2- 172.21.15.83:0/1695060275 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1c68068aa0 0x7f1c6810dab0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:55.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.874+0000 7f1c6dfc2700 1 --2- 172.21.15.83:0/1695060275 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1c68106e10 0x7f1c681071f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:55.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.874+0000 7f1c6dfc2700 1 --2- 172.21.15.83:0/1695060275 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c680680e0 0x7f1c68068560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:55.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.874+0000 7f1c6dfc2700 1 -- 172.21.15.83:0/1695060275 >> 172.21.15.83:0/1695060275 conn(0x7f1c68076d50 msgr2=0x7f1c68077160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T07:05:55.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.874+0000 7f1c6dfc2700 1 -- 172.21.15.83:0/1695060275 shutdown_connections 2024-04-01T07:05:55.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.874+0000 7f1c6dfc2700 1 -- 172.21.15.83:0/1695060275 wait complete. 2024-04-01T07:05:55.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.875+0000 7f1c6dfc2700 1 Processor -- start 2024-04-01T07:05:55.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.875+0000 7f1c6dfc2700 1 -- start start 2024-04-01T07:05:55.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.875+0000 7f1c6dfc2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1c680680e0 0x7f1c68199450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:05:55.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.875+0000 7f1c6dfc2700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1c68068aa0 0x7f1c68199990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:05:55.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.875+0000 7f1c6dfc2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c68106e10 0x7f1c6819dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:05:55.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.875+0000 7f1c6dfc2700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6819e370 con 0x7f1c680680e0 2024-04-01T07:05:55.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.875+0000 7f1c6dfc2700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6819e4e0 con 0x7f1c68068aa0 2024-04-01T07:05:55.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.875+0000 7f1c6dfc2700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6819e6a0 con 0x7f1c68106e10 2024-04-01T07:05:55.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.875+0000 7f1c677fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1c680680e0 0x7f1c68199450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:05:55.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.875+0000 7f1c677fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1c680680e0 0x7f1c68199450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55914/0 (socket says 172.21.15.83:55914) 2024-04-01T07:05:55.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.875+0000 7f1c677fe700 1 -- 172.21.15.83:0/352094360 learned_addr learned my addr 172.21.15.83:0/352094360 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T07:05:55.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.875+0000 7f1c67fff700 1 --2- 172.21.15.83:0/352094360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c68106e10 0x7f1c6819dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:05:55.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.875+0000 7f1c677fe700 1 -- 172.21.15.83:0/352094360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c68106e10 msgr2=0x7f1c6819dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:05:55.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.875+0000 7f1c66ffd700 1 --2- 172.21.15.83:0/352094360 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1c68068aa0 0x7f1c68199990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:05:55.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.875+0000 7f1c677fe700 1 --2- 172.21.15.83:0/352094360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c68106e10 0x7f1c6819dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:55.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.875+0000 7f1c677fe700 1 -- 172.21.15.83:0/352094360 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1c68068aa0 msgr2=0x7f1c68199990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:05:55.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.875+0000 7f1c677fe700 1 --2- 172.21.15.83:0/352094360 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1c68068aa0 0x7f1c68199990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:55.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.875+0000 7f1c677fe700 1 -- 172.21.15.83:0/352094360 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c60009d00 con 0x7f1c680680e0 2024-04-01T07:05:55.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.876+0000 7f1c677fe700 1 --2- 172.21.15.83:0/352094360 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1c680680e0 0x7f1c68199450 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c00d980 tx=0x7f1c5c00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T07:05:55.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.876+0000 7f1c64ff9700 1 -- 172.21.15.83:0/352094360 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c00bb60 con 0x7f1c680680e0 2024-04-01T07:05:55.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.876+0000 7f1c6dfc2700 1 -- 172.21.15.83:0/352094360 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c6819e980 con 0x7f1c680680e0 2024-04-01T07:05:55.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.876+0000 7f1c64ff9700 1 -- 172.21.15.83:0/352094360 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1c5c007640 con 0x7f1c680680e0 2024-04-01T07:05:55.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.876+0000 7f1c64ff9700 1 -- 172.21.15.83:0/352094360 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c004e90 con 0x7f1c680680e0 2024-04-01T07:05:55.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.876+0000 7f1c6dfc2700 1 -- 172.21.15.83:0/352094360 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c681a61c0 con 0x7f1c680680e0 2024-04-01T07:05:55.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.877+0000 7f1c6dfc2700 1 -- 172.21.15.83:0/352094360 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c681023b0 con 0x7f1c680680e0 2024-04-01T07:05:55.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.878+0000 7f1c64ff9700 1 -- 172.21.15.83:0/352094360 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 25) v1 ==== 135996+0+0 (secure 0 0 0) 0x7f1c5c00bcc0 con 0x7f1c680680e0 2024-04-01T07:05:55.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.878+0000 7f1c64ff9700 1 --2- 172.21.15.83:0/352094360 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f1c500a1290 0x7f1c500a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:05:55.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.878+0000 7f1c64ff9700 1 -- 172.21.15.83:0/352094360 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f1c5c0ccfc0 con 0x7f1c680680e0 2024-04-01T07:05:55.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.878+0000 7f1c66ffd700 1 --2- 172.21.15.83:0/352094360 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f1c500a1290 0x7f1c500a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:05:55.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.879+0000 7f1c66ffd700 1 --2- 172.21.15.83:0/352094360 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f1c500a1290 0x7f1c500a3750 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1c58005950 tx=0x7f1c580058e0 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T07:05:55.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:55.882+0000 7f1c64ff9700 1 -- 172.21.15.83:0/352094360 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f1c5c096440 con 0x7f1c680680e0 2024-04-01T07:05:56.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.106+0000 7f1c6dfc2700 1 -- 172.21.15.83:0/352094360 --> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f1c68110c10 con 0x7f1c500a1290 2024-04-01T07:05:56.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.114+0000 7f1c64ff9700 1 -- 172.21.15.83:0/352094360 <== mgr.15420 v2:172.21.15.83:6800/3294653546 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+10 (secure 0 0 0) 0x7f1c68110c10 con 0x7f1c500a1290 2024-04-01T07:05:56.114 INFO:teuthology.orchestra.run.smithi083.stdout:/ 1m 6m3h 2024-04-01T07:05:56.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.116+0000 7f1c6dfc2700 1 -- 172.21.15.83:0/352094360 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f1c500a1290 msgr2=0x7f1c500a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:05:56.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.116+0000 7f1c6dfc2700 1 --2- 172.21.15.83:0/352094360 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f1c500a1290 0x7f1c500a3750 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1c58005950 tx=0x7f1c580058e0 comp rx=0 tx=0).stop 2024-04-01T07:05:56.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.116+0000 7f1c6dfc2700 1 -- 172.21.15.83:0/352094360 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1c680680e0 msgr2=0x7f1c68199450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:05:56.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.116+0000 7f1c6dfc2700 1 --2- 172.21.15.83:0/352094360 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1c680680e0 0x7f1c68199450 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c00d980 tx=0x7f1c5c00dd40 comp rx=0 tx=0).stop 2024-04-01T07:05:56.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.116+0000 7f1c6dfc2700 1 -- 172.21.15.83:0/352094360 shutdown_connections 2024-04-01T07:05:56.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.116+0000 7f1c6dfc2700 1 --2- 172.21.15.83:0/352094360 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f1c500a1290 0x7f1c500a3750 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:56.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.116+0000 7f1c6dfc2700 1 --2- 172.21.15.83:0/352094360 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1c680680e0 0x7f1c68199450 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:56.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.116+0000 7f1c6dfc2700 1 --2- 172.21.15.83:0/352094360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c68106e10 0x7f1c6819dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:56.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.116+0000 7f1c6dfc2700 1 --2- 172.21.15.83:0/352094360 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1c68068aa0 0x7f1c68199990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:56.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.116+0000 7f1c6dfc2700 1 -- 172.21.15.83:0/352094360 >> 172.21.15.83:0/352094360 conn(0x7f1c68076d50 msgr2=0x7f1c6810be00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T07:05:56.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.116+0000 7f1c6dfc2700 1 -- 172.21.15.83:0/352094360 shutdown_connections 2024-04-01T07:05:56.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.116+0000 7f1c6dfc2700 1 -- 172.21.15.83:0/352094360 wait complete. 2024-04-01T07:05:56.128 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-04-01T07:05:56.138 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-04-01T07:05:56.139 ERROR:teuthology.run_tasks:Manager failed: fwd_scrub Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_5df3435b30085cc9abc1eb282ab0f20651c8a39a/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph_5df3435b30085cc9abc1eb282ab0f20651c8a39a/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2024-04-01T07:05:56.140 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-04-01T07:05:56.177 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T07:05:56.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.299+0000 7fe0a0994700 1 -- 172.21.15.83:0/3303856875 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe09c105f80 msgr2=0x7fe09c10db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:05:56.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.299+0000 7fe0a0994700 1 --2- 172.21.15.83:0/3303856875 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe09c105f80 0x7fe09c10db00 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fe09400b0a0 tx=0x7fe09400b3b0 comp rx=0 tx=0).stop 2024-04-01T07:05:56.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.299+0000 7fe0a0994700 1 -- 172.21.15.83:0/3303856875 shutdown_connections 2024-04-01T07:05:56.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.299+0000 7fe0a0994700 1 --2- 172.21.15.83:0/3303856875 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe09c105f80 0x7fe09c10db00 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:56.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.299+0000 7fe0a0994700 1 --2- 172.21.15.83:0/3303856875 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe09c100e60 0x7fe09c101240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:56.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.299+0000 7fe0a0994700 1 --2- 172.21.15.83:0/3303856875 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe09c101810 0x7fe09c105850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:56.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.299+0000 7fe0a0994700 1 -- 172.21.15.83:0/3303856875 >> 172.21.15.83:0/3303856875 conn(0x7fe09c0fc760 msgr2=0x7fe09c0feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T07:05:56.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.299+0000 7fe0a0994700 1 -- 172.21.15.83:0/3303856875 shutdown_connections 2024-04-01T07:05:56.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.299+0000 7fe0a0994700 1 -- 172.21.15.83:0/3303856875 wait complete. 2024-04-01T07:05:56.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.300+0000 7fe0a0994700 1 Processor -- start 2024-04-01T07:05:56.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.300+0000 7fe0a0994700 1 -- start start 2024-04-01T07:05:56.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.300+0000 7fe0a0994700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe09c100e60 0x7fe09c197210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:05:56.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.300+0000 7fe0a0994700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe09c105f80 0x7fe09c197750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:05:56.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.300+0000 7fe0a0994700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe09c19baf0 0x7fe09c19bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:05:56.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.300+0000 7fe0a0994700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c19c570 con 0x7fe09c105f80 2024-04-01T07:05:56.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.300+0000 7fe0a0994700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c19c6e0 con 0x7fe09c19baf0 2024-04-01T07:05:56.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.300+0000 7fe0a0994700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c19c8a0 con 0x7fe09c100e60 2024-04-01T07:05:56.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.300+0000 7fe099d9b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe09c105f80 0x7fe09c197750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:05:56.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.300+0000 7fe099d9b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe09c105f80 0x7fe09c197750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55938/0 (socket says 172.21.15.83:55938) 2024-04-01T07:05:56.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.300+0000 7fe099d9b700 1 -- 172.21.15.83:0/2548141361 learned_addr learned my addr 172.21.15.83:0/2548141361 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T07:05:56.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.301+0000 7fe09ad9d700 1 --2- 172.21.15.83:0/2548141361 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe09c19baf0 0x7fe09c19bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:05:56.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.301+0000 7fe09a59c700 1 --2- 172.21.15.83:0/2548141361 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe09c100e60 0x7fe09c197210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:05:56.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.301+0000 7fe099d9b700 1 -- 172.21.15.83:0/2548141361 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe09c100e60 msgr2=0x7fe09c197210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:05:56.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.301+0000 7fe099d9b700 1 --2- 172.21.15.83:0/2548141361 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe09c100e60 0x7fe09c197210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:56.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.301+0000 7fe099d9b700 1 -- 172.21.15.83:0/2548141361 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe09c19baf0 msgr2=0x7fe09c19bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:05:56.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.301+0000 7fe099d9b700 1 --2- 172.21.15.83:0/2548141361 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe09c19baf0 0x7fe09c19bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:56.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.301+0000 7fe099d9b700 1 -- 172.21.15.83:0/2548141361 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe094009d00 con 0x7fe09c105f80 2024-04-01T07:05:56.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.301+0000 7fe09ad9d700 1 --2- 172.21.15.83:0/2548141361 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe09c19baf0 0x7fe09c19bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T07:05:56.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.301+0000 7fe099d9b700 1 --2- 172.21.15.83:0/2548141361 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe09c105f80 0x7fe09c197750 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fe08c00d980 tx=0x7fe08c00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T07:05:56.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.301+0000 7fe0937fe700 1 -- 172.21.15.83:0/2548141361 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08c009b40 con 0x7fe09c105f80 2024-04-01T07:05:56.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.301+0000 7fe0a0994700 1 -- 172.21.15.83:0/2548141361 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe09c1a3e00 con 0x7fe09c105f80 2024-04-01T07:05:56.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.301+0000 7fe0937fe700 1 -- 172.21.15.83:0/2548141361 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe08c00de60 con 0x7fe09c105f80 2024-04-01T07:05:56.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.301+0000 7fe0937fe700 1 -- 172.21.15.83:0/2548141361 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08c00f620 con 0x7fe09c105f80 2024-04-01T07:05:56.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.301+0000 7fe0a0994700 1 -- 172.21.15.83:0/2548141361 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe09c1a4280 con 0x7fe09c105f80 2024-04-01T07:05:56.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.302+0000 7fe0a0994700 1 -- 172.21.15.83:0/2548141361 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe09c109250 con 0x7fe09c105f80 2024-04-01T07:05:56.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.303+0000 7fe0937fe700 1 -- 172.21.15.83:0/2548141361 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 25) v1 ==== 135996+0+0 (secure 0 0 0) 0x7fe08c010460 con 0x7fe09c105f80 2024-04-01T07:05:56.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.304+0000 7fe0937fe700 1 --2- 172.21.15.83:0/2548141361 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fe0880a1290 0x7fe0880a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:05:56.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.304+0000 7fe0937fe700 1 -- 172.21.15.83:0/2548141361 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fe08c0cc7d0 con 0x7fe09c105f80 2024-04-01T07:05:56.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.304+0000 7fe09a59c700 1 --2- 172.21.15.83:0/2548141361 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fe0880a1290 0x7fe0880a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:05:56.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.304+0000 7fe09a59c700 1 --2- 172.21.15.83:0/2548141361 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fe0880a1290 0x7fe0880a3750 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe084005950 tx=0x7fe084005cf0 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T07:05:56.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.307+0000 7fe0937fe700 1 -- 172.21.15.83:0/2548141361 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7fe08c095c50 con 0x7fe09c105f80 2024-04-01T07:05:56.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.518+0000 7fe0a0994700 1 -- 172.21.15.83:0/2548141361 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe09c198540 con 0x7fe09c105f80 2024-04-01T07:05:56.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.519+0000 7fe0937fe700 1 -- 172.21.15.83:0/2548141361 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+22954 (secure 0 0 0) 0x7fe08c017090 con 0x7fe09c105f80 2024-04-01T07:05:56.520 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T07:05:56.520 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":90,"fsid":"c6f8eff4-eff3-11ee-b647-cb9ed24678a4","created":"2024-04-01T06:48:42.033382+0000","modified":"2024-04-01T07:04:20.829171+0000","last_up_change":"2024-04-01T06:53:55.791339+0000","last_in_change":"2024-04-01T06:53:39.777214+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T06:51:21.963996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T06:54:26.450403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T06:54:27.564928+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":13,"snap_epoch":89,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"90b761b0-b06c-4142-854d-38ee42aa6052","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6803","nonce":3253845390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6805","nonce":3253845390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6809","nonce":3253845390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6807","nonce":3253845390}]},"public_addr":"172.21.15.83:6803/3253845390","cluster_addr":"172.21.15.83:6805/3253845390","heartbeat_back_addr":"172.21.15.83:6809/3253845390","heartbeat_front_addr":"172.21.15.83:6807/3253845390","state":["exists","up"]},{"osd":1,"uuid":"4d6ab85b-7088-451e-a829-c9119f35dee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6801","nonce":515889759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6803","nonce":515889759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6807","nonce":515889759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6805","nonce":515889759}]},"public_addr":"172.21.15.145:6801/515889759","cluster_addr":"172.21.15.145:6803/515889759","heartbeat_back_addr":"172.21.15.145:6807/515889759","heartbeat_front_addr":"172.21.15.145:6805/515889759","state":["exists","up"]},{"osd":2,"uuid":"d04c27f3-4972-4061-8bfb-5060645e3883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6801","nonce":3318516728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6803","nonce":3318516728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6807","nonce":3318516728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6805","nonce":3318516728}]},"public_addr":"172.21.15.153:6801/3318516728","cluster_addr":"172.21.15.153:6803/3318516728","heartbeat_back_addr":"172.21.15.153:6807/3318516728","heartbeat_front_addr":"172.21.15.153:6805/3318516728","state":["exists","up"]},{"osd":3,"uuid":"899b6c90-8f2f-44dd-b807-49594aadb443","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6811","nonce":504690234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6813","nonce":504690234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6817","nonce":504690234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6815","nonce":504690234}]},"public_addr":"172.21.15.83:6811/504690234","cluster_addr":"172.21.15.83:6813/504690234","heartbeat_back_addr":"172.21.15.83:6817/504690234","heartbeat_front_addr":"172.21.15.83:6815/504690234","state":["exists","up"]},{"osd":4,"uuid":"5071dd81-804e-4358-bfb6-11e718e9cf4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6809","nonce":2099824730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6811","nonce":2099824730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6815","nonce":2099824730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6813","nonce":2099824730}]},"public_addr":"172.21.15.145:6809/2099824730","cluster_addr":"172.21.15.145:6811/2099824730","heartbeat_back_addr":"172.21.15.145:6815/2099824730","heartbeat_front_addr":"172.21.15.145:6813/2099824730","state":["exists","up"]},{"osd":5,"uuid":"b8442b71-c26e-467f-b0c3-ea9f636f5a00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6809","nonce":3340941443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6811","nonce":3340941443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6815","nonce":3340941443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6813","nonce":3340941443}]},"public_addr":"172.21.15.153:6809/3340941443","cluster_addr":"172.21.15.153:6811/3340941443","heartbeat_back_addr":"172.21.15.153:6815/3340941443","heartbeat_front_addr":"172.21.15.153:6813/3340941443","state":["exists","up"]},{"osd":6,"uuid":"c26bb8cb-ccee-4bfc-91eb-14e1ad8e04df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6819","nonce":2005485079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6821","nonce":2005485079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6825","nonce":2005485079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6823","nonce":2005485079}]},"public_addr":"172.21.15.83:6819/2005485079","cluster_addr":"172.21.15.83:6821/2005485079","heartbeat_back_addr":"172.21.15.83:6825/2005485079","heartbeat_front_addr":"172.21.15.83:6823/2005485079","state":["exists","up"]},{"osd":7,"uuid":"a8940da2-0e79-4606-8d1e-d425afbf5753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6817","nonce":3737505059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6819","nonce":3737505059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6823","nonce":3737505059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6821","nonce":3737505059}]},"public_addr":"172.21.15.145:6817/3737505059","cluster_addr":"172.21.15.145:6819/3737505059","heartbeat_back_addr":"172.21.15.145:6823/3737505059","heartbeat_front_addr":"172.21.15.145:6821/3737505059","state":["exists","up"]},{"osd":8,"uuid":"602d43ac-a189-4da3-9e38-7025d14e0dd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6817","nonce":1031545791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6819","nonce":1031545791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6823","nonce":1031545791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6821","nonce":1031545791}]},"public_addr":"172.21.15.153:6817/1031545791","cluster_addr":"172.21.15.153:6819/1031545791","heartbeat_back_addr":"172.21.15.153:6823/1031545791","heartbeat_front_addr":"172.21.15.153:6821/1031545791","state":["exists","up"]},{"osd":9,"uuid":"08b12d27-1247-45e4-9d09-cacc0fce4bd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6827","nonce":3720996673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6829","nonce":3720996673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6833","nonce":3720996673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6831","nonce":3720996673}]},"public_addr":"172.21.15.83:6827/3720996673","cluster_addr":"172.21.15.83:6829/3720996673","heartbeat_back_addr":"172.21.15.83:6833/3720996673","heartbeat_front_addr":"172.21.15.83:6831/3720996673","state":["exists","up"]},{"osd":10,"uuid":"dd986b50-d68f-446c-9c66-261535880879","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6825","nonce":2671529479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6827","nonce":2671529479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6831","nonce":2671529479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6829","nonce":2671529479}]},"public_addr":"172.21.15.145:6825/2671529479","cluster_addr":"172.21.15.145:6827/2671529479","heartbeat_back_addr":"172.21.15.145:6831/2671529479","heartbeat_front_addr":"172.21.15.145:6829/2671529479","state":["exists","up"]},{"osd":11,"uuid":"d20a49cd-6224-4424-8375-46da791d9931","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6825","nonce":2342548429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6827","nonce":2342548429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6831","nonce":2342548429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6829","nonce":2342548429}]},"public_addr":"172.21.15.153:6825/2342548429","cluster_addr":"172.21.15.153:6827/2342548429","heartbeat_back_addr":"172.21.15.153:6831/2342548429","heartbeat_front_addr":"172.21.15.153:6829/2342548429","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:50:44.539932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:01.990470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:19.054426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:36.616393+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:53.896705+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:10.667502+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:27.880849+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:45.276308+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:02.280615+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:19.555547+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:37.062881+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:54.191589+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.83:0/3082162092":"2024-04-02T06:55:53.508926+0000","172.21.15.83:0/2071592157":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/2222527447":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/785958951":"2024-04-02T06:49:33.656125+0000","172.21.15.83:6801/1644397953":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/690500472":"2024-04-02T06:49:13.456026+0000","172.21.15.83:6800/1644397953":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/2125339627":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/2596683931":"2024-04-02T06:49:33.656125+0000","172.21.15.83:6801/1867137261":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/4017737477":"2024-04-02T06:55:53.508926+0000","172.21.15.83:6800/3375372052":"2024-04-02T06:55:53.508926+0000","172.21.15.83:0/3245313698":"2024-04-02T06:55:53.508926+0000","172.21.15.83:6801/3375372052":"2024-04-02T06:55:53.508926+0000","172.21.15.83:0/223927839":"2024-04-02T06:55:53.508926+0000","172.21.15.83:6800/1867137261":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/1365273187":"2024-04-02T06:55:53.508926+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":4,"length":1},{"begin":13,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T07:05:56.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.522+0000 7fe0a0994700 1 -- 172.21.15.83:0/2548141361 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fe0880a1290 msgr2=0x7fe0880a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:05:56.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.522+0000 7fe0a0994700 1 --2- 172.21.15.83:0/2548141361 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fe0880a1290 0x7fe0880a3750 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe084005950 tx=0x7fe084005cf0 comp rx=0 tx=0).stop 2024-04-01T07:05:56.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.522+0000 7fe0a0994700 1 -- 172.21.15.83:0/2548141361 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe09c105f80 msgr2=0x7fe09c197750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:05:56.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.522+0000 7fe0a0994700 1 --2- 172.21.15.83:0/2548141361 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe09c105f80 0x7fe09c197750 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fe08c00d980 tx=0x7fe08c00dd40 comp rx=0 tx=0).stop 2024-04-01T07:05:56.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.522+0000 7fe0a0994700 1 -- 172.21.15.83:0/2548141361 shutdown_connections 2024-04-01T07:05:56.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.522+0000 7fe0a0994700 1 --2- 172.21.15.83:0/2548141361 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fe0880a1290 0x7fe0880a3750 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:56.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.522+0000 7fe0a0994700 1 --2- 172.21.15.83:0/2548141361 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe09c19baf0 0x7fe09c19bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:56.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.522+0000 7fe0a0994700 1 --2- 172.21.15.83:0/2548141361 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe09c100e60 0x7fe09c197210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:56.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.522+0000 7fe0a0994700 1 --2- 172.21.15.83:0/2548141361 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe09c105f80 0x7fe09c197750 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:56.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.522+0000 7fe0a0994700 1 -- 172.21.15.83:0/2548141361 >> 172.21.15.83:0/2548141361 conn(0x7fe09c0fc760 msgr2=0x7fe09c0fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T07:05:56.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.522+0000 7fe0a0994700 1 -- 172.21.15.83:0/2548141361 shutdown_connections 2024-04-01T07:05:56.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.522+0000 7fe0a0994700 1 -- 172.21.15.83:0/2548141361 wait complete. 2024-04-01T07:05:56.534 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-01T06:51:21.963996+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-01T06:54:26.450403+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-01T06:54:27.564928+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 13, 'snap_epoch': 89, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-01T07:05:56.535 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-01T07:05:56.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.659+0000 7f5b262c7700 1 -- 172.21.15.83:0/1783931827 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5b200ffe70 msgr2=0x7f5b20100250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:05:56.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.659+0000 7f5b262c7700 1 --2- 172.21.15.83:0/1783931827 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5b200ffe70 0x7f5b20100250 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f5b10009990 tx=0x7f5b10009ca0 comp rx=0 tx=0).stop 2024-04-01T07:05:56.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.659+0000 7f5b262c7700 1 -- 172.21.15.83:0/1783931827 shutdown_connections 2024-04-01T07:05:56.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.659+0000 7f5b262c7700 1 --2- 172.21.15.83:0/1783931827 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5b200ffe70 0x7f5b20100250 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:56.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.659+0000 7f5b262c7700 1 --2- 172.21.15.83:0/1783931827 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5b20104f70 0x7f5b2010caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:56.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.659+0000 7f5b262c7700 1 --2- 172.21.15.83:0/1783931827 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b20100820 0x7f5b20104840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:56.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.659+0000 7f5b262c7700 1 -- 172.21.15.83:0/1783931827 >> 172.21.15.83:0/1783931827 conn(0x7f5b20076d50 msgr2=0x7f5b20077160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T07:05:56.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.659+0000 7f5b262c7700 1 -- 172.21.15.83:0/1783931827 shutdown_connections 2024-04-01T07:05:56.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.659+0000 7f5b262c7700 1 -- 172.21.15.83:0/1783931827 wait complete. 2024-04-01T07:05:56.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.660+0000 7f5b262c7700 1 Processor -- start 2024-04-01T07:05:56.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.660+0000 7f5b262c7700 1 -- start start 2024-04-01T07:05:56.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.660+0000 7f5b262c7700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5b200ffe70 0x7f5b2010d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:05:56.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.660+0000 7f5b262c7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b20104f70 0x7f5b2010d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:05:56.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.660+0000 7f5b262c7700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5b2010deb0 0x7f5b201a5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:05:56.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.660+0000 7f5b262c7700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b201a5950 con 0x7f5b200ffe70 2024-04-01T07:05:56.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.660+0000 7f5b262c7700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b201a5ac0 con 0x7f5b2010deb0 2024-04-01T07:05:56.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.660+0000 7f5b262c7700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b201a5c80 con 0x7f5b20104f70 2024-04-01T07:05:56.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.660+0000 7f5b1ffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5b200ffe70 0x7f5b2010d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:05:56.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.660+0000 7f5b1ffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5b200ffe70 0x7f5b2010d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55952/0 (socket says 172.21.15.83:55952) 2024-04-01T07:05:56.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.660+0000 7f5b1ffff700 1 -- 172.21.15.83:0/2441472694 learned_addr learned my addr 172.21.15.83:0/2441472694 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T07:05:56.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.661+0000 7f5b24864700 1 --2- 172.21.15.83:0/2441472694 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5b2010deb0 0x7f5b201a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:05:56.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.661+0000 7f5b1f7fe700 1 --2- 172.21.15.83:0/2441472694 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b20104f70 0x7f5b2010d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:05:56.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.661+0000 7f5b1ffff700 1 -- 172.21.15.83:0/2441472694 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b20104f70 msgr2=0x7f5b2010d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:05:56.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.661+0000 7f5b1ffff700 1 --2- 172.21.15.83:0/2441472694 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b20104f70 0x7f5b2010d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:56.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.661+0000 7f5b1ffff700 1 -- 172.21.15.83:0/2441472694 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5b2010deb0 msgr2=0x7f5b201a5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:05:56.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.661+0000 7f5b1ffff700 1 --2- 172.21.15.83:0/2441472694 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5b2010deb0 0x7f5b201a5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:56.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.661+0000 7f5b1ffff700 1 -- 172.21.15.83:0/2441472694 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b100095f0 con 0x7f5b200ffe70 2024-04-01T07:05:56.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.661+0000 7f5b1ffff700 1 --2- 172.21.15.83:0/2441472694 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5b200ffe70 0x7f5b2010d430 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f5b10004760 tx=0x7f5b10004790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T07:05:56.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.661+0000 7f5b1d7fa700 1 -- 172.21.15.83:0/2441472694 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1001d070 con 0x7f5b200ffe70 2024-04-01T07:05:56.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.661+0000 7f5b262c7700 1 -- 172.21.15.83:0/2441472694 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b201a5f00 con 0x7f5b200ffe70 2024-04-01T07:05:56.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.661+0000 7f5b1d7fa700 1 -- 172.21.15.83:0/2441472694 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5b1000fbf0 con 0x7f5b200ffe70 2024-04-01T07:05:56.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.661+0000 7f5b1d7fa700 1 -- 172.21.15.83:0/2441472694 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b10022d50 con 0x7f5b200ffe70 2024-04-01T07:05:56.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.661+0000 7f5b262c7700 1 -- 172.21.15.83:0/2441472694 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b201a62d0 con 0x7f5b200ffe70 2024-04-01T07:05:56.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.662+0000 7f5b262c7700 1 -- 172.21.15.83:0/2441472694 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b201081e0 con 0x7f5b200ffe70 2024-04-01T07:05:56.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.663+0000 7f5b1d7fa700 1 -- 172.21.15.83:0/2441472694 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 25) v1 ==== 135996+0+0 (secure 0 0 0) 0x7f5b10022470 con 0x7f5b200ffe70 2024-04-01T07:05:56.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.664+0000 7f5b1d7fa700 1 --2- 172.21.15.83:0/2441472694 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f5b080a1290 0x7f5b080a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:05:56.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.664+0000 7f5b1d7fa700 1 -- 172.21.15.83:0/2441472694 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f5b100cddf0 con 0x7f5b200ffe70 2024-04-01T07:05:56.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.664+0000 7f5b1f7fe700 1 --2- 172.21.15.83:0/2441472694 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f5b080a1290 0x7f5b080a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:05:56.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.665+0000 7f5b1f7fe700 1 --2- 172.21.15.83:0/2441472694 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f5b080a1290 0x7f5b080a3750 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5b14005950 tx=0x7f5b140058e0 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T07:05:56.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.668+0000 7f5b1d7fa700 1 -- 172.21.15.83:0/2441472694 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f5b1005d9f0 con 0x7f5b200ffe70 2024-04-01T07:05:56.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.863+0000 7f5b262c7700 1 -- 172.21.15.83:0/2441472694 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5b2010e910 con 0x7f5b200ffe70 2024-04-01T07:05:56.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.863+0000 7f5b1d7fa700 1 -- 172.21.15.83:0/2441472694 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5b10097300 con 0x7f5b200ffe70 2024-04-01T07:05:56.863 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 1 2024-04-01T07:05:56.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.865+0000 7f5b262c7700 1 -- 172.21.15.83:0/2441472694 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f5b080a1290 msgr2=0x7f5b080a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:05:56.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.865+0000 7f5b262c7700 1 --2- 172.21.15.83:0/2441472694 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f5b080a1290 0x7f5b080a3750 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5b14005950 tx=0x7f5b140058e0 comp rx=0 tx=0).stop 2024-04-01T07:05:56.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.865+0000 7f5b262c7700 1 -- 172.21.15.83:0/2441472694 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5b200ffe70 msgr2=0x7f5b2010d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:05:56.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.865+0000 7f5b262c7700 1 --2- 172.21.15.83:0/2441472694 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5b200ffe70 0x7f5b2010d430 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f5b10004760 tx=0x7f5b10004790 comp rx=0 tx=0).stop 2024-04-01T07:05:56.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.865+0000 7f5b262c7700 1 -- 172.21.15.83:0/2441472694 shutdown_connections 2024-04-01T07:05:56.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.865+0000 7f5b262c7700 1 --2- 172.21.15.83:0/2441472694 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f5b080a1290 0x7f5b080a3750 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:56.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.865+0000 7f5b262c7700 1 --2- 172.21.15.83:0/2441472694 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5b200ffe70 0x7f5b2010d430 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:56.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.865+0000 7f5b262c7700 1 --2- 172.21.15.83:0/2441472694 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5b2010deb0 0x7f5b201a5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:56.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.865+0000 7f5b262c7700 1 --2- 172.21.15.83:0/2441472694 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b20104f70 0x7f5b2010d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:56.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.865+0000 7f5b262c7700 1 -- 172.21.15.83:0/2441472694 >> 172.21.15.83:0/2441472694 conn(0x7f5b20076d50 msgr2=0x7f5b201060f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T07:05:56.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.865+0000 7f5b262c7700 1 -- 172.21.15.83:0/2441472694 shutdown_connections 2024-04-01T07:05:56.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:56.865+0000 7f5b262c7700 1 -- 172.21.15.83:0/2441472694 wait complete. 2024-04-01T07:05:56.877 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-01T07:05:57.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.002+0000 7f0c57c76700 1 -- 172.21.15.83:0/849728248 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c50106050 msgr2=0x7f0c5010dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:05:57.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.002+0000 7f0c57c76700 1 --2- 172.21.15.83:0/849728248 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c50106050 0x7f0c5010dc20 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f0c4800b0a0 tx=0x7f0c4800b3b0 comp rx=0 tx=0).stop 2024-04-01T07:05:57.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.002+0000 7f0c57c76700 1 -- 172.21.15.83:0/849728248 shutdown_connections 2024-04-01T07:05:57.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.003+0000 7f0c57c76700 1 --2- 172.21.15.83:0/849728248 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c50106050 0x7f0c5010dc20 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:57.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.003+0000 7f0c57c76700 1 --2- 172.21.15.83:0/849728248 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0c500ff490 0x7f0c500ff870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:57.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.003+0000 7f0c57c76700 1 --2- 172.21.15.83:0/849728248 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c500ffe40 0x7f0c50105970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:57.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.003+0000 7f0c57c76700 1 -- 172.21.15.83:0/849728248 >> 172.21.15.83:0/849728248 conn(0x7f0c500761e0 msgr2=0x7f0c500fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T07:05:57.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.003+0000 7f0c57c76700 1 -- 172.21.15.83:0/849728248 shutdown_connections 2024-04-01T07:05:57.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.003+0000 7f0c57c76700 1 -- 172.21.15.83:0/849728248 wait complete. 2024-04-01T07:05:57.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.003+0000 7f0c57c76700 1 Processor -- start 2024-04-01T07:05:57.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.003+0000 7f0c57c76700 1 -- start start 2024-04-01T07:05:57.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.003+0000 7f0c57c76700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0c500ff490 0x7f0c501971a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:05:57.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.003+0000 7f0c57c76700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c50106050 0x7f0c501976e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:05:57.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.003+0000 7f0c57c76700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c5019ba80 0x7f0c5019bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:05:57.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.003+0000 7f0c57c76700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5019c500 con 0x7f0c50106050 2024-04-01T07:05:57.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.003+0000 7f0c57c76700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5019c670 con 0x7f0c500ff490 2024-04-01T07:05:57.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.003+0000 7f0c57c76700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5019c830 con 0x7f0c5019ba80 2024-04-01T07:05:57.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.003+0000 7f0c55211700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c50106050 0x7f0c501976e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:05:57.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.004+0000 7f0c55211700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c50106050 0x7f0c501976e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55966/0 (socket says 172.21.15.83:55966) 2024-04-01T07:05:57.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.004+0000 7f0c55211700 1 -- 172.21.15.83:0/2307748566 learned_addr learned my addr 172.21.15.83:0/2307748566 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T07:05:57.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.004+0000 7f0c55a12700 1 --2- 172.21.15.83:0/2307748566 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0c500ff490 0x7f0c501971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:05:57.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.004+0000 7f0c56213700 1 --2- 172.21.15.83:0/2307748566 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c5019ba80 0x7f0c5019bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:05:57.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.004+0000 7f0c55211700 1 -- 172.21.15.83:0/2307748566 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c5019ba80 msgr2=0x7f0c5019bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:05:57.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.004+0000 7f0c55211700 1 --2- 172.21.15.83:0/2307748566 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c5019ba80 0x7f0c5019bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:57.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.004+0000 7f0c55211700 1 -- 172.21.15.83:0/2307748566 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0c500ff490 msgr2=0x7f0c501971a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:05:57.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.004+0000 7f0c55211700 1 --2- 172.21.15.83:0/2307748566 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0c500ff490 0x7f0c501971a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:57.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.004+0000 7f0c55211700 1 -- 172.21.15.83:0/2307748566 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c48009d00 con 0x7f0c50106050 2024-04-01T07:05:57.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.004+0000 7f0c55a12700 1 --2- 172.21.15.83:0/2307748566 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0c500ff490 0x7f0c501971a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T07:05:57.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.004+0000 7f0c55211700 1 --2- 172.21.15.83:0/2307748566 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c50106050 0x7f0c501976e0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f0c4000b4d0 tx=0x7f0c4000b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T07:05:57.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.004+0000 7f0c46ffd700 1 -- 172.21.15.83:0/2307748566 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c40011830 con 0x7f0c50106050 2024-04-01T07:05:57.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.004+0000 7f0c46ffd700 1 -- 172.21.15.83:0/2307748566 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0c40011e50 con 0x7f0c50106050 2024-04-01T07:05:57.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.004+0000 7f0c46ffd700 1 -- 172.21.15.83:0/2307748566 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c40010e50 con 0x7f0c50106050 2024-04-01T07:05:57.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.004+0000 7f0c57c76700 1 -- 172.21.15.83:0/2307748566 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c501a3d90 con 0x7f0c50106050 2024-04-01T07:05:57.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.004+0000 7f0c57c76700 1 -- 172.21.15.83:0/2307748566 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c501a4210 con 0x7f0c50106050 2024-04-01T07:05:57.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.005+0000 7f0c57c76700 1 -- 172.21.15.83:0/2307748566 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c50109290 con 0x7f0c50106050 2024-04-01T07:05:57.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.006+0000 7f0c46ffd700 1 -- 172.21.15.83:0/2307748566 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 25) v1 ==== 135996+0+0 (secure 0 0 0) 0x7f0c400104f0 con 0x7f0c50106050 2024-04-01T07:05:57.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.007+0000 7f0c46ffd700 1 --2- 172.21.15.83:0/2307748566 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f0c3c0a1310 0x7f0c3c0a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:05:57.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.007+0000 7f0c55a12700 1 --2- 172.21.15.83:0/2307748566 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f0c3c0a1310 0x7f0c3c0a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:05:57.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.007+0000 7f0c46ffd700 1 -- 172.21.15.83:0/2307748566 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f0c400ccb70 con 0x7f0c50106050 2024-04-01T07:05:57.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.007+0000 7f0c55a12700 1 --2- 172.21.15.83:0/2307748566 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f0c3c0a1310 0x7f0c3c0a37d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c005fd0 tx=0x7f0c4c005e30 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T07:05:57.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.010+0000 7f0c46ffd700 1 -- 172.21.15.83:0/2307748566 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f0c40096100 con 0x7f0c50106050 2024-04-01T07:05:57.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:05:56 smithi153 ceph-mon[48187]: pgmap v312: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:05:57.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:05:56 smithi153 ceph-mon[48187]: from='client.16296 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T07:05:57.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:05:56 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/2548141361' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T07:05:57.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.207+0000 7f0c57c76700 1 -- 172.21.15.83:0/2307748566 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0c501984a0 con 0x7f0c50106050 2024-04-01T07:05:57.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.208+0000 7f0c46ffd700 1 -- 172.21.15.83:0/2307748566 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0c40015020 con 0x7f0c50106050 2024-04-01T07:05:57.208 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 32 2024-04-01T07:05:57.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.210+0000 7f0c57c76700 1 -- 172.21.15.83:0/2307748566 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f0c3c0a1310 msgr2=0x7f0c3c0a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:05:57.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.210+0000 7f0c57c76700 1 --2- 172.21.15.83:0/2307748566 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f0c3c0a1310 0x7f0c3c0a37d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c005fd0 tx=0x7f0c4c005e30 comp rx=0 tx=0).stop 2024-04-01T07:05:57.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.210+0000 7f0c57c76700 1 -- 172.21.15.83:0/2307748566 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c50106050 msgr2=0x7f0c501976e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:05:57.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.210+0000 7f0c57c76700 1 --2- 172.21.15.83:0/2307748566 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c50106050 0x7f0c501976e0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f0c4000b4d0 tx=0x7f0c4000b890 comp rx=0 tx=0).stop 2024-04-01T07:05:57.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.210+0000 7f0c57c76700 1 -- 172.21.15.83:0/2307748566 shutdown_connections 2024-04-01T07:05:57.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.210+0000 7f0c57c76700 1 --2- 172.21.15.83:0/2307748566 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f0c3c0a1310 0x7f0c3c0a37d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:57.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.210+0000 7f0c57c76700 1 --2- 172.21.15.83:0/2307748566 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c5019ba80 0x7f0c5019bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:57.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.210+0000 7f0c57c76700 1 --2- 172.21.15.83:0/2307748566 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0c500ff490 0x7f0c501971a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:57.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.210+0000 7f0c57c76700 1 --2- 172.21.15.83:0/2307748566 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0c50106050 0x7f0c501976e0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:57.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.210+0000 7f0c57c76700 1 -- 172.21.15.83:0/2307748566 >> 172.21.15.83:0/2307748566 conn(0x7f0c500761e0 msgr2=0x7f0c501042e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T07:05:57.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.210+0000 7f0c57c76700 1 -- 172.21.15.83:0/2307748566 shutdown_connections 2024-04-01T07:05:57.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.210+0000 7f0c57c76700 1 -- 172.21.15.83:0/2307748566 wait complete. 2024-04-01T07:05:57.220 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:05:56 smithi083 ceph-mon[43429]: pgmap v312: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:05:57.220 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:05:56 smithi083 ceph-mon[43429]: from='client.16296 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T07:05:57.221 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:05:56 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/2548141361' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T07:05:57.221 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-01T07:05:57.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:05:56 smithi145 ceph-mon[47816]: pgmap v312: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-04-01T07:05:57.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:05:56 smithi145 ceph-mon[47816]: from='client.16296 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T07:05:57.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:05:56 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/2548141361' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T07:05:57.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.346+0000 7fe3a44f3700 1 -- 172.21.15.83:0/3309408560 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe39c105ce0 msgr2=0x7fe39c1060c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:05:57.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.346+0000 7fe3a44f3700 1 --2- 172.21.15.83:0/3309408560 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe39c105ce0 0x7fe39c1060c0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fe390009990 tx=0x7fe390009ca0 comp rx=0 tx=0).stop 2024-04-01T07:05:57.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.346+0000 7fe3a44f3700 1 -- 172.21.15.83:0/3309408560 shutdown_connections 2024-04-01T07:05:57.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.346+0000 7fe3a44f3700 1 --2- 172.21.15.83:0/3309408560 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe39c105ce0 0x7fe39c1060c0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:57.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.346+0000 7fe3a44f3700 1 --2- 172.21.15.83:0/3309408560 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe39c0687f0 0x7fe39c10db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:57.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.346+0000 7fe3a44f3700 1 --2- 172.21.15.83:0/3309408560 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe39c067e30 0x7fe39c0682b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:57.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.346+0000 7fe3a44f3700 1 -- 172.21.15.83:0/3309408560 >> 172.21.15.83:0/3309408560 conn(0x7fe39c076d40 msgr2=0x7fe39c077150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T07:05:57.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.346+0000 7fe3a44f3700 1 -- 172.21.15.83:0/3309408560 shutdown_connections 2024-04-01T07:05:57.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.346+0000 7fe3a44f3700 1 -- 172.21.15.83:0/3309408560 wait complete. 2024-04-01T07:05:57.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.347+0000 7fe3a44f3700 1 Processor -- start 2024-04-01T07:05:57.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.347+0000 7fe3a44f3700 1 -- start start 2024-04-01T07:05:57.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.347+0000 7fe3a44f3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe39c067e30 0x7fe39c197130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:05:57.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.347+0000 7fe3a44f3700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe39c0687f0 0x7fe39c197670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:05:57.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.347+0000 7fe3a44f3700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe39c105ce0 0x7fe39c19ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:05:57.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.347+0000 7fe3a44f3700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c19c050 con 0x7fe39c0687f0 2024-04-01T07:05:57.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.347+0000 7fe3a44f3700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c19c1c0 con 0x7fe39c105ce0 2024-04-01T07:05:57.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.347+0000 7fe3a44f3700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c19c380 con 0x7fe39c067e30 2024-04-01T07:05:57.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.347+0000 7fe3a1a8e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe39c0687f0 0x7fe39c197670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:05:57.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.347+0000 7fe3a1a8e700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe39c0687f0 0x7fe39c197670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55976/0 (socket says 172.21.15.83:55976) 2024-04-01T07:05:57.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.347+0000 7fe3a1a8e700 1 -- 172.21.15.83:0/2071384766 learned_addr learned my addr 172.21.15.83:0/2071384766 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T07:05:57.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.347+0000 7fe3a228f700 1 --2- 172.21.15.83:0/2071384766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe39c067e30 0x7fe39c197130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:05:57.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.347+0000 7fe3a2a90700 1 --2- 172.21.15.83:0/2071384766 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe39c105ce0 0x7fe39c19ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:05:57.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.348+0000 7fe3a1a8e700 1 -- 172.21.15.83:0/2071384766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe39c067e30 msgr2=0x7fe39c197130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:05:57.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.348+0000 7fe3a1a8e700 1 --2- 172.21.15.83:0/2071384766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe39c067e30 0x7fe39c197130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:57.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.348+0000 7fe3a1a8e700 1 -- 172.21.15.83:0/2071384766 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe39c105ce0 msgr2=0x7fe39c19ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:05:57.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.348+0000 7fe3a1a8e700 1 --2- 172.21.15.83:0/2071384766 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe39c105ce0 0x7fe39c19ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:57.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.348+0000 7fe3a1a8e700 1 -- 172.21.15.83:0/2071384766 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3900095f0 con 0x7fe39c0687f0 2024-04-01T07:05:57.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.348+0000 7fe3a1a8e700 1 --2- 172.21.15.83:0/2071384766 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe39c0687f0 0x7fe39c197670 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fe39800c9b0 tx=0x7fe39800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T07:05:57.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.348+0000 7fe38f7fe700 1 -- 172.21.15.83:0/2071384766 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe398007b00 con 0x7fe39c0687f0 2024-04-01T07:05:57.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.348+0000 7fe38f7fe700 1 -- 172.21.15.83:0/2071384766 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe398007c60 con 0x7fe39c0687f0 2024-04-01T07:05:57.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.348+0000 7fe38f7fe700 1 -- 172.21.15.83:0/2071384766 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe398018660 con 0x7fe39c0687f0 2024-04-01T07:05:57.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.348+0000 7fe3a44f3700 1 -- 172.21.15.83:0/2071384766 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe39c19c660 con 0x7fe39c0687f0 2024-04-01T07:05:57.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.348+0000 7fe3a44f3700 1 -- 172.21.15.83:0/2071384766 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe39c1a3ea0 con 0x7fe39c0687f0 2024-04-01T07:05:57.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.349+0000 7fe3a44f3700 1 -- 172.21.15.83:0/2071384766 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe39c109280 con 0x7fe39c0687f0 2024-04-01T07:05:57.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.350+0000 7fe38f7fe700 1 -- 172.21.15.83:0/2071384766 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 25) v1 ==== 135996+0+0 (secure 0 0 0) 0x7fe398018880 con 0x7fe39c0687f0 2024-04-01T07:05:57.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.350+0000 7fe38f7fe700 1 --2- 172.21.15.83:0/2071384766 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fe3880a1290 0x7fe3880a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:05:57.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.350+0000 7fe3a228f700 1 --2- 172.21.15.83:0/2071384766 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fe3880a1290 0x7fe3880a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:05:57.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.350+0000 7fe38f7fe700 1 -- 172.21.15.83:0/2071384766 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fe3980ccd30 con 0x7fe39c0687f0 2024-04-01T07:05:57.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.351+0000 7fe3a228f700 1 --2- 172.21.15.83:0/2071384766 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fe3880a1290 0x7fe3880a3750 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe390006010 tx=0x7fe39001a040 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T07:05:57.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.355+0000 7fe38f7fe700 1 -- 172.21.15.83:0/2071384766 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7fe3980961b0 con 0x7fe39c0687f0 2024-04-01T07:05:57.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.552+0000 7fe3a44f3700 1 -- 172.21.15.83:0/2071384766 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe39c198430 con 0x7fe39c0687f0 2024-04-01T07:05:57.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.553+0000 7fe38f7fe700 1 -- 172.21.15.83:0/2071384766 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe3980997d0 con 0x7fe39c0687f0 2024-04-01T07:05:57.553 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 64 2024-04-01T07:05:57.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.555+0000 7fe3a44f3700 1 -- 172.21.15.83:0/2071384766 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fe3880a1290 msgr2=0x7fe3880a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:05:57.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.555+0000 7fe3a44f3700 1 --2- 172.21.15.83:0/2071384766 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fe3880a1290 0x7fe3880a3750 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe390006010 tx=0x7fe39001a040 comp rx=0 tx=0).stop 2024-04-01T07:05:57.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.555+0000 7fe3a44f3700 1 -- 172.21.15.83:0/2071384766 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe39c0687f0 msgr2=0x7fe39c197670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:05:57.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.555+0000 7fe3a44f3700 1 --2- 172.21.15.83:0/2071384766 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe39c0687f0 0x7fe39c197670 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fe39800c9b0 tx=0x7fe39800cd70 comp rx=0 tx=0).stop 2024-04-01T07:05:57.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.555+0000 7fe3a44f3700 1 -- 172.21.15.83:0/2071384766 shutdown_connections 2024-04-01T07:05:57.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.555+0000 7fe3a44f3700 1 --2- 172.21.15.83:0/2071384766 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fe3880a1290 0x7fe3880a3750 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:57.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.555+0000 7fe3a44f3700 1 --2- 172.21.15.83:0/2071384766 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe39c105ce0 0x7fe39c19ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:57.555 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.555+0000 7fe3a44f3700 1 --2- 172.21.15.83:0/2071384766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe39c067e30 0x7fe39c197130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:57.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.555+0000 7fe3a44f3700 1 --2- 172.21.15.83:0/2071384766 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe39c0687f0 0x7fe39c197670 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:57.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.555+0000 7fe3a44f3700 1 -- 172.21.15.83:0/2071384766 >> 172.21.15.83:0/2071384766 conn(0x7fe39c076d40 msgr2=0x7fe39c0fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T07:05:57.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.555+0000 7fe3a44f3700 1 -- 172.21.15.83:0/2071384766 shutdown_connections 2024-04-01T07:05:57.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.555+0000 7fe3a44f3700 1 -- 172.21.15.83:0/2071384766 wait complete. 2024-04-01T07:05:57.566 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-04-01T07:05:57.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.688+0000 7f4a7919f700 1 -- 172.21.15.83:0/2698740291 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4a74102710 msgr2=0x7f4a7410abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:05:57.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.688+0000 7f4a7919f700 1 --2- 172.21.15.83:0/2698740291 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4a74102710 0x7f4a7410abf0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f4a64009990 tx=0x7f4a64009ca0 comp rx=0 tx=0).stop 2024-04-01T07:05:57.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.689+0000 7f4a7919f700 1 -- 172.21.15.83:0/2698740291 shutdown_connections 2024-04-01T07:05:57.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.689+0000 7f4a7919f700 1 --2- 172.21.15.83:0/2698740291 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4a7410b210 0x7f4a7410d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:57.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.689+0000 7f4a7919f700 1 --2- 172.21.15.83:0/2698740291 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a74101df0 0x7f4a741021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:57.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.689+0000 7f4a7919f700 1 --2- 172.21.15.83:0/2698740291 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4a74102710 0x7f4a7410abf0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:57.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.689+0000 7f4a7919f700 1 -- 172.21.15.83:0/2698740291 >> 172.21.15.83:0/2698740291 conn(0x7f4a740fb5f0 msgr2=0x7f4a740fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T07:05:57.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.689+0000 7f4a7919f700 1 -- 172.21.15.83:0/2698740291 shutdown_connections 2024-04-01T07:05:57.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.689+0000 7f4a7919f700 1 -- 172.21.15.83:0/2698740291 wait complete. 2024-04-01T07:05:57.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.689+0000 7f4a7919f700 1 Processor -- start 2024-04-01T07:05:57.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.690+0000 7f4a7919f700 1 -- start start 2024-04-01T07:05:57.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.690+0000 7f4a7919f700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4a74101df0 0x7f4a741992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:05:57.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.690+0000 7f4a7919f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4a74102710 0x7f4a741997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:05:57.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.690+0000 7f4a7919f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a7410b210 0x7f4a7419db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:05:57.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.690+0000 7f4a7919f700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7419e1d0 con 0x7f4a74102710 2024-04-01T07:05:57.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.690+0000 7f4a7919f700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7419e340 con 0x7f4a74101df0 2024-04-01T07:05:57.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.690+0000 7f4a7919f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7419e500 con 0x7f4a7410b210 2024-04-01T07:05:57.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.690+0000 7f4a7259c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4a74102710 0x7f4a741997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:05:57.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.690+0000 7f4a7259c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4a74102710 0x7f4a741997f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:56004/0 (socket says 172.21.15.83:56004) 2024-04-01T07:05:57.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.690+0000 7f4a7259c700 1 -- 172.21.15.83:0/2713236444 learned_addr learned my addr 172.21.15.83:0/2713236444 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T07:05:57.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.690+0000 7f4a7359e700 1 --2- 172.21.15.83:0/2713236444 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a7410b210 0x7f4a7419db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:05:57.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.690+0000 7f4a72d9d700 1 --2- 172.21.15.83:0/2713236444 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4a74101df0 0x7f4a741992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:05:57.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.690+0000 7f4a7259c700 1 -- 172.21.15.83:0/2713236444 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a7410b210 msgr2=0x7f4a7419db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:05:57.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.690+0000 7f4a7259c700 1 --2- 172.21.15.83:0/2713236444 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a7410b210 0x7f4a7419db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:57.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.690+0000 7f4a7259c700 1 -- 172.21.15.83:0/2713236444 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4a74101df0 msgr2=0x7f4a741992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:05:57.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.690+0000 7f4a7259c700 1 --2- 172.21.15.83:0/2713236444 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4a74101df0 0x7f4a741992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:57.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.690+0000 7f4a7259c700 1 -- 172.21.15.83:0/2713236444 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a640095f0 con 0x7f4a74102710 2024-04-01T07:05:57.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.690+0000 7f4a7259c700 1 --2- 172.21.15.83:0/2713236444 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4a74102710 0x7f4a741997f0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f4a64000c00 tx=0x7f4a64005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T07:05:57.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.690+0000 7f4a5bfff700 1 -- 172.21.15.83:0/2713236444 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6401d070 con 0x7f4a74102710 2024-04-01T07:05:57.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.690+0000 7f4a7919f700 1 -- 172.21.15.83:0/2713236444 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a7419e780 con 0x7f4a74102710 2024-04-01T07:05:57.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.690+0000 7f4a5bfff700 1 -- 172.21.15.83:0/2713236444 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4a64022470 con 0x7f4a74102710 2024-04-01T07:05:57.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.690+0000 7f4a5bfff700 1 -- 172.21.15.83:0/2713236444 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a640175f0 con 0x7f4a74102710 2024-04-01T07:05:57.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.690+0000 7f4a7919f700 1 -- 172.21.15.83:0/2713236444 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a741a6020 con 0x7f4a74102710 2024-04-01T07:05:57.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.691+0000 7f4a7919f700 1 -- 172.21.15.83:0/2713236444 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a740698f0 con 0x7f4a74102710 2024-04-01T07:05:57.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.692+0000 7f4a5bfff700 1 -- 172.21.15.83:0/2713236444 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 25) v1 ==== 135996+0+0 (secure 0 0 0) 0x7f4a640225e0 con 0x7f4a74102710 2024-04-01T07:05:57.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.693+0000 7f4a5bfff700 1 --2- 172.21.15.83:0/2713236444 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f4a5c0a1290 0x7f4a5c0a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:05:57.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.693+0000 7f4a72d9d700 1 --2- 172.21.15.83:0/2713236444 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f4a5c0a1290 0x7f4a5c0a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:05:57.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.693+0000 7f4a5bfff700 1 -- 172.21.15.83:0/2713236444 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f4a640ce1d0 con 0x7f4a74102710 2024-04-01T07:05:57.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.694+0000 7f4a72d9d700 1 --2- 172.21.15.83:0/2713236444 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f4a5c0a1290 0x7f4a5c0a3750 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4a68005fd0 tx=0x7f4a6800a560 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T07:05:57.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.697+0000 7f4a5bfff700 1 -- 172.21.15.83:0/2713236444 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f4a640976e0 con 0x7f4a74102710 2024-04-01T07:05:57.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.954+0000 7f4a7919f700 1 -- 172.21.15.83:0/2713236444 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7f4a74067180 con 0x7f4a74102710 2024-04-01T07:05:57.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.962+0000 7f4a5bfff700 1 -- 172.21.15.83:0/2713236444 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v25) v1 ==== 81+0+733924 (secure 0 0 0) 0x7f4a6409ad00 con 0x7f4a74102710 2024-04-01T07:05:57.973 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T07:05:57.973 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-04-01T07:05:57.973 INFO:teuthology.orchestra.run.smithi083.stdout: "epoch": 25, 2024-04-01T07:05:57.973 INFO:teuthology.orchestra.run.smithi083.stdout: "active_gid": 15420, 2024-04-01T07:05:57.973 INFO:teuthology.orchestra.run.smithi083.stdout: "active_name": "x", 2024-04-01T07:05:57.973 INFO:teuthology.orchestra.run.smithi083.stdout: "active_addrs": { 2024-04-01T07:05:57.973 INFO:teuthology.orchestra.run.smithi083.stdout: "addrvec": [ 2024-04-01T07:05:57.973 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:57.973 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "v2", 2024-04-01T07:05:57.973 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": "172.21.15.83:6800", 2024-04-01T07:05:57.973 INFO:teuthology.orchestra.run.smithi083.stdout: "nonce": 3294653546 2024-04-01T07:05:57.973 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:57.974 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:57.974 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "v1", 2024-04-01T07:05:57.974 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": "172.21.15.83:6801", 2024-04-01T07:05:57.974 INFO:teuthology.orchestra.run.smithi083.stdout: "nonce": 3294653546 2024-04-01T07:05:57.974 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:57.974 INFO:teuthology.orchestra.run.smithi083.stdout: ] 2024-04-01T07:05:57.974 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:57.974 INFO:teuthology.orchestra.run.smithi083.stdout: "active_addr": "172.21.15.83:6801/3294653546", 2024-04-01T07:05:57.974 INFO:teuthology.orchestra.run.smithi083.stdout: "active_change": "2024-04-01T06:55:53.509117+0000", 2024-04-01T07:05:57.974 INFO:teuthology.orchestra.run.smithi083.stdout: "active_mgr_features": 4540138322906710015, 2024-04-01T07:05:57.974 INFO:teuthology.orchestra.run.smithi083.stdout: "available": true, 2024-04-01T07:05:57.974 INFO:teuthology.orchestra.run.smithi083.stdout: "standbys": [ 2024-04-01T07:05:57.974 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:57.974 INFO:teuthology.orchestra.run.smithi083.stdout: "gid": 15423, 2024-04-01T07:05:57.975 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "z", 2024-04-01T07:05:57.975 INFO:teuthology.orchestra.run.smithi083.stdout: "mgr_features": 4540138322906710015, 2024-04-01T07:05:57.975 INFO:teuthology.orchestra.run.smithi083.stdout: "available_modules": [ 2024-04-01T07:05:57.975 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:57.975 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "alerts", 2024-04-01T07:05:57.975 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:57.975 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:57.975 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:57.975 INFO:teuthology.orchestra.run.smithi083.stdout: "interval": { 2024-04-01T07:05:57.975 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "interval", 2024-04-01T07:05:57.975 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:57.975 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:57.975 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:57.975 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "60", 2024-04-01T07:05:57.976 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:57.976 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:57.976 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:57.976 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "How frequently to reexamine health status", 2024-04-01T07:05:57.976 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:57.976 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:57.976 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:57.976 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:57.976 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:57.976 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:57.976 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:57.976 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:57.976 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:57.976 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:57.977 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:57.977 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:57.977 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:57.977 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:57.977 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:57.977 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:57.977 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:57.977 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:57.977 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:57.977 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:57.977 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:57.977 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:57.977 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:57.977 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:57.978 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:57.978 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:57.978 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:57.978 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:57.978 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:57.978 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:57.978 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:57.978 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:57.978 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:57.978 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:57.978 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:57.978 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:57.978 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:57.978 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:57.979 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:57.979 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:57.979 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:57.979 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:57.979 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:57.979 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:57.979 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:57.979 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:57.979 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:57.979 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:57.979 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:57.979 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:57.979 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:57.979 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:57.980 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:57.980 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:57.980 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:57.980 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:57.980 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:57.980 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:57.980 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:57.980 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:57.980 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:57.980 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:57.980 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:57.980 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:57.980 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:57.980 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:57.980 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:57.980 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:57.981 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:57.981 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:57.981 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:57.981 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:57.981 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:57.981 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:57.981 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_destination": { 2024-04-01T07:05:57.981 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_destination", 2024-04-01T07:05:57.981 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:57.981 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:57.981 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:57.981 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:57.981 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:57.981 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:57.982 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:57.982 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Email address to send alerts to", 2024-04-01T07:05:57.982 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:57.982 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:57.982 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:57.982 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:57.982 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_from_name": { 2024-04-01T07:05:57.982 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_from_name", 2024-04-01T07:05:57.982 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:57.982 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:57.982 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:57.982 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "Ceph", 2024-04-01T07:05:57.982 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:57.982 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:57.982 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:57.983 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Email From: name", 2024-04-01T07:05:57.983 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:57.983 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:57.983 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:57.983 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:57.983 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_host": { 2024-04-01T07:05:57.983 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_host", 2024-04-01T07:05:57.983 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:57.983 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:57.983 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:57.983 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:57.983 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:57.983 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:57.983 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:57.984 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "SMTP server", 2024-04-01T07:05:57.984 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:57.984 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:57.984 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:57.984 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:57.984 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_password": { 2024-04-01T07:05:57.984 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_password", 2024-04-01T07:05:57.984 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:57.984 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:57.984 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:57.984 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:57.984 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:57.984 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:57.984 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:57.984 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Password to authenticate with", 2024-04-01T07:05:57.985 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:57.985 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:57.985 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:57.985 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:57.985 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_port": { 2024-04-01T07:05:57.985 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_port", 2024-04-01T07:05:57.985 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:57.985 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:57.985 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:57.985 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "465", 2024-04-01T07:05:57.985 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:57.985 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:57.985 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:57.985 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "SMTP port", 2024-04-01T07:05:57.985 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:57.986 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:57.986 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:57.986 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:57.986 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_sender": { 2024-04-01T07:05:57.986 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_sender", 2024-04-01T07:05:57.986 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:57.986 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:57.986 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:57.986 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:57.986 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:57.986 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:57.986 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:57.986 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "SMTP envelope sender", 2024-04-01T07:05:57.986 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:57.987 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:57.987 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:57.987 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:57.987 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_ssl": { 2024-04-01T07:05:57.987 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_ssl", 2024-04-01T07:05:57.987 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:57.987 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:57.987 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:57.987 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:57.987 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:57.987 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:57.987 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:57.987 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Use SSL to connect to SMTP server", 2024-04-01T07:05:57.988 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:57.988 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:57.988 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:57.988 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:57.988 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_user": { 2024-04-01T07:05:57.988 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_user", 2024-04-01T07:05:57.988 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:57.988 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:57.988 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:57.988 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:57.988 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:57.988 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:57.988 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:57.988 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "User to authenticate as", 2024-04-01T07:05:57.989 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:57.989 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:57.989 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:57.989 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:57.989 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:57.989 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:57.989 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:57.989 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "balancer", 2024-04-01T07:05:57.989 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:57.989 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:57.989 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:57.989 INFO:teuthology.orchestra.run.smithi083.stdout: "active": { 2024-04-01T07:05:57.989 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "active", 2024-04-01T07:05:57.989 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:57.990 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:57.990 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:57.990 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:57.990 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:57.990 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:57.990 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:57.990 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "automatically balance PGs across cluster", 2024-04-01T07:05:57.990 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:57.990 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:57.990 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:57.990 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:57.990 INFO:teuthology.orchestra.run.smithi083.stdout: "begin_time": { 2024-04-01T07:05:57.990 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "begin_time", 2024-04-01T07:05:57.990 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:57.990 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:57.991 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:57.991 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0000", 2024-04-01T07:05:57.991 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:57.991 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:57.991 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:57.991 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "beginning time of day to automatically balance", 2024-04-01T07:05:57.991 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-01T07:05:57.991 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:57.991 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:57.991 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:57.991 INFO:teuthology.orchestra.run.smithi083.stdout: "begin_weekday": { 2024-04-01T07:05:57.991 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "begin_weekday", 2024-04-01T07:05:57.991 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "uint", 2024-04-01T07:05:57.991 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:57.992 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:57.992 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-04-01T07:05:57.992 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "0", 2024-04-01T07:05:57.992 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "6", 2024-04-01T07:05:57.992 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:57.992 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-04-01T07:05:57.992 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-01T07:05:57.992 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:57.992 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:57.992 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:57.992 INFO:teuthology.orchestra.run.smithi083.stdout: "crush_compat_max_iterations": { 2024-04-01T07:05:57.992 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "crush_compat_max_iterations", 2024-04-01T07:05:57.992 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "uint", 2024-04-01T07:05:57.992 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:57.993 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:57.993 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "25", 2024-04-01T07:05:57.993 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "1", 2024-04-01T07:05:57.993 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "250", 2024-04-01T07:05:57.993 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:57.993 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-04-01T07:05:57.993 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:57.993 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:57.993 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:57.993 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:57.993 INFO:teuthology.orchestra.run.smithi083.stdout: "crush_compat_metrics": { 2024-04-01T07:05:57.993 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "crush_compat_metrics", 2024-04-01T07:05:57.993 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:57.993 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:57.993 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:57.994 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "pgs,objects,bytes", 2024-04-01T07:05:57.994 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:57.994 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:57.994 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:57.994 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-04-01T07:05:57.994 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-04-01T07:05:57.994 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:57.994 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:57.994 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:57.994 INFO:teuthology.orchestra.run.smithi083.stdout: "crush_compat_step": { 2024-04-01T07:05:57.994 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "crush_compat_step", 2024-04-01T07:05:57.994 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-04-01T07:05:57.994 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:57.994 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:57.995 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0.5", 2024-04-01T07:05:57.995 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "0.001", 2024-04-01T07:05:57.995 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "0.999", 2024-04-01T07:05:57.995 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:57.995 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "aggressiveness of optimization", 2024-04-01T07:05:57.995 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-04-01T07:05:57.995 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:57.995 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:57.995 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:57.995 INFO:teuthology.orchestra.run.smithi083.stdout: "end_time": { 2024-04-01T07:05:57.995 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "end_time", 2024-04-01T07:05:57.995 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:57.995 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:57.995 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:57.995 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "2359", 2024-04-01T07:05:57.996 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:57.996 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:57.996 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:57.996 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "ending time of day to automatically balance", 2024-04-01T07:05:57.996 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-01T07:05:57.996 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:57.996 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:57.996 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:57.996 INFO:teuthology.orchestra.run.smithi083.stdout: "end_weekday": { 2024-04-01T07:05:57.996 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "end_weekday", 2024-04-01T07:05:57.996 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "uint", 2024-04-01T07:05:57.996 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:57.996 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:57.996 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-04-01T07:05:57.996 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "0", 2024-04-01T07:05:57.997 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "6", 2024-04-01T07:05:57.997 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:57.997 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-04-01T07:05:57.997 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-01T07:05:57.997 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:57.997 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:57.997 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:57.997 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:57.997 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:57.997 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:57.997 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:57.997 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:57.997 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:57.997 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:57.998 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:57.998 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:57.998 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:57.998 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:57.998 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:57.998 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:57.998 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:57.998 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:57.998 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:57.998 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:57.998 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:57.998 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:57.998 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:57.998 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:57.999 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:57.999 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:57.999 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:57.999 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:57.999 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:57.999 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:57.999 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:57.999 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:57.999 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:57.999 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:57.999 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:57.999 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:57.999 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:57.999 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:57.999 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.000 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.000 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.000 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.000 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.000 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.000 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.000 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.000 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.000 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.000 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.000 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.000 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.000 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.001 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.001 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.001 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.001 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.001 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.001 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.001 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.001 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.001 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.001 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.001 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.001 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.001 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.001 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.001 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.002 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.002 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.002 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.002 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.002 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.002 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.002 INFO:teuthology.orchestra.run.smithi083.stdout: "min_score": { 2024-04-01T07:05:58.002 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "min_score", 2024-04-01T07:05:58.002 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-04-01T07:05:58.002 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.002 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.002 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-04-01T07:05:58.002 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.002 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.002 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.003 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-04-01T07:05:58.003 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.003 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.005 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.005 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.005 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": { 2024-04-01T07:05:58.005 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "mode", 2024-04-01T07:05:58.005 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.005 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.005 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.005 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "upmap", 2024-04-01T07:05:58.005 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.006 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.006 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.006 INFO:teuthology.orchestra.run.smithi083.stdout: "crush-compat", 2024-04-01T07:05:58.006 INFO:teuthology.orchestra.run.smithi083.stdout: "none", 2024-04-01T07:05:58.006 INFO:teuthology.orchestra.run.smithi083.stdout: "upmap" 2024-04-01T07:05:58.006 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.006 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Balancer mode", 2024-04-01T07:05:58.006 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.006 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.006 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.006 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.006 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_ids": { 2024-04-01T07:05:58.006 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "pool_ids", 2024-04-01T07:05:58.006 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.007 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.007 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.007 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.007 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.007 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.007 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.007 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-04-01T07:05:58.007 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.007 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.007 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.007 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.007 INFO:teuthology.orchestra.run.smithi083.stdout: "sleep_interval": { 2024-04-01T07:05:58.007 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sleep_interval", 2024-04-01T07:05:58.007 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:58.007 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.008 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.008 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "60", 2024-04-01T07:05:58.008 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.008 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.008 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.008 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-04-01T07:05:58.008 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.008 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.008 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.008 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.008 INFO:teuthology.orchestra.run.smithi083.stdout: "upmap_max_deviation": { 2024-04-01T07:05:58.008 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "upmap_max_deviation", 2024-04-01T07:05:58.008 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.008 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.009 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.009 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "5", 2024-04-01T07:05:58.009 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "1", 2024-04-01T07:05:58.009 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.009 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.009 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "deviation below which no optimization is attempted", 2024-04-01T07:05:58.009 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-04-01T07:05:58.009 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.009 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.009 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.009 INFO:teuthology.orchestra.run.smithi083.stdout: "upmap_max_optimizations": { 2024-04-01T07:05:58.009 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "upmap_max_optimizations", 2024-04-01T07:05:58.009 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "uint", 2024-04-01T07:05:58.009 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.009 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.010 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-04-01T07:05:58.010 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.010 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.010 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.010 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-04-01T07:05:58.010 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.010 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.010 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.010 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.010 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.010 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.010 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.010 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "cephadm", 2024-04-01T07:05:58.010 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.011 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.011 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.011 INFO:teuthology.orchestra.run.smithi083.stdout: "agent_down_multiplier": { 2024-04-01T07:05:58.011 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "agent_down_multiplier", 2024-04-01T07:05:58.011 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-04-01T07:05:58.011 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.011 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.011 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "3.0", 2024-04-01T07:05:58.011 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.011 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.011 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.011 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-04-01T07:05:58.011 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.011 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.011 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.012 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.012 INFO:teuthology.orchestra.run.smithi083.stdout: "agent_refresh_rate": { 2024-04-01T07:05:58.012 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "agent_refresh_rate", 2024-04-01T07:05:58.012 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:58.012 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.012 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.012 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "20", 2024-04-01T07:05:58.012 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.012 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.012 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.012 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-04-01T07:05:58.012 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.012 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.012 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.013 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.013 INFO:teuthology.orchestra.run.smithi083.stdout: "agent_starting_port": { 2024-04-01T07:05:58.013 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "agent_starting_port", 2024-04-01T07:05:58.013 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.013 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.013 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.013 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "4721", 2024-04-01T07:05:58.013 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.013 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.013 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.013 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-04-01T07:05:58.013 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.013 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.014 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.014 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.014 INFO:teuthology.orchestra.run.smithi083.stdout: "allow_ptrace": { 2024-04-01T07:05:58.014 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "allow_ptrace", 2024-04-01T07:05:58.014 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.014 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.014 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.014 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.014 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.014 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.014 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.015 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-04-01T07:05:58.015 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-04-01T07:05:58.015 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.015 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.015 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.015 INFO:teuthology.orchestra.run.smithi083.stdout: "autotune_interval": { 2024-04-01T07:05:58.015 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "autotune_interval", 2024-04-01T07:05:58.015 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:58.015 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.015 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.015 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "600", 2024-04-01T07:05:58.015 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.015 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.015 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.016 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how frequently to autotune daemon memory", 2024-04-01T07:05:58.016 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.016 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.016 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.016 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.016 INFO:teuthology.orchestra.run.smithi083.stdout: "autotune_memory_target_ratio": { 2024-04-01T07:05:58.016 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "autotune_memory_target_ratio", 2024-04-01T07:05:58.016 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-04-01T07:05:58.016 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.016 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.016 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0.7", 2024-04-01T07:05:58.016 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.016 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.016 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.016 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-04-01T07:05:58.016 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.017 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.017 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.017 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.017 INFO:teuthology.orchestra.run.smithi083.stdout: "cgroups_split": { 2024-04-01T07:05:58.017 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "cgroups_split", 2024-04-01T07:05:58.017 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.017 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.017 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.017 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.017 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.017 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.017 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.017 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-04-01T07:05:58.017 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.018 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.018 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.018 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.018 INFO:teuthology.orchestra.run.smithi083.stdout: "config_checks_enabled": { 2024-04-01T07:05:58.018 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "config_checks_enabled", 2024-04-01T07:05:58.018 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.018 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.018 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.018 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.018 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.018 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.018 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.018 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-04-01T07:05:58.018 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.019 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.019 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.019 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.019 INFO:teuthology.orchestra.run.smithi083.stdout: "config_dashboard": { 2024-04-01T07:05:58.019 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "config_dashboard", 2024-04-01T07:05:58.019 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.019 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.019 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.019 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.019 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.019 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.019 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.019 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-04-01T07:05:58.019 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.019 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.020 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.020 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.020 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_alertmanager": { 2024-04-01T07:05:58.020 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_alertmanager", 2024-04-01T07:05:58.020 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.020 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.020 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.020 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-04-01T07:05:58.020 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.020 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.020 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.020 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Prometheus container image", 2024-04-01T07:05:58.020 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.020 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.020 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.020 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.021 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_base": { 2024-04-01T07:05:58.021 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_base", 2024-04-01T07:05:58.021 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.021 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.021 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.021 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/ceph/ceph", 2024-04-01T07:05:58.021 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.021 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.021 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.021 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Container image name, without the tag", 2024-04-01T07:05:58.021 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.021 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.021 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.021 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.022 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_elasticsearch": { 2024-04-01T07:05:58.022 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_elasticsearch", 2024-04-01T07:05:58.022 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.022 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.022 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.022 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-04-01T07:05:58.022 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.022 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.022 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.022 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "elasticsearch container image", 2024-04-01T07:05:58.022 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.022 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.022 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.022 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.023 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_grafana": { 2024-04-01T07:05:58.023 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_grafana", 2024-04-01T07:05:58.023 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.023 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.023 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.023 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2024-04-01T07:05:58.023 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.023 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.023 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.023 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Prometheus container image", 2024-04-01T07:05:58.023 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.023 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.023 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.023 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.023 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_haproxy": { 2024-04-01T07:05:58.024 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_haproxy", 2024-04-01T07:05:58.024 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.024 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.024 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.024 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-04-01T07:05:58.024 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.024 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.024 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.024 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "HAproxy container image", 2024-04-01T07:05:58.024 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.024 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.024 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.024 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.024 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_jaeger_agent": { 2024-04-01T07:05:58.024 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_jaeger_agent", 2024-04-01T07:05:58.025 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.025 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.025 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.025 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-04-01T07:05:58.025 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.025 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.025 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.025 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Jaeger agent container image", 2024-04-01T07:05:58.025 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.025 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.025 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.025 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.025 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_jaeger_collector": { 2024-04-01T07:05:58.026 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_jaeger_collector", 2024-04-01T07:05:58.026 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.026 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.026 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.026 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-04-01T07:05:58.026 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.026 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.026 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.026 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Jaeger collector container image", 2024-04-01T07:05:58.026 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.026 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.026 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.026 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.026 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_jaeger_query": { 2024-04-01T07:05:58.027 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_jaeger_query", 2024-04-01T07:05:58.027 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.027 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.027 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.027 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-04-01T07:05:58.027 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.027 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.027 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.027 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Jaeger query container image", 2024-04-01T07:05:58.027 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.027 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.027 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.027 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.027 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_keepalived": { 2024-04-01T07:05:58.027 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_keepalived", 2024-04-01T07:05:58.028 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.028 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.028 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.028 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-04-01T07:05:58.028 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.028 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.028 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.028 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Keepalived container image", 2024-04-01T07:05:58.028 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.028 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.028 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.028 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.028 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_loki": { 2024-04-01T07:05:58.028 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_loki", 2024-04-01T07:05:58.029 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.029 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.029 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.029 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-04-01T07:05:58.029 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.029 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.029 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.029 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Loki container image", 2024-04-01T07:05:58.029 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.029 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.029 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.029 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.029 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_node_exporter": { 2024-04-01T07:05:58.029 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_node_exporter", 2024-04-01T07:05:58.029 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.030 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.030 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.030 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-04-01T07:05:58.030 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.030 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.030 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.030 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Prometheus container image", 2024-04-01T07:05:58.030 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.030 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.030 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.030 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.030 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_nvmeof": { 2024-04-01T07:05:58.030 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_nvmeof", 2024-04-01T07:05:58.030 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.030 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.030 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.031 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/ceph/nvmeof:1.0.0", 2024-04-01T07:05:58.031 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.031 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.031 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.031 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Nvme-of container image", 2024-04-01T07:05:58.031 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.031 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.031 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.031 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.031 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_prometheus": { 2024-04-01T07:05:58.031 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_prometheus", 2024-04-01T07:05:58.031 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.031 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.031 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.032 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-04-01T07:05:58.032 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.032 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.032 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.032 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Prometheus container image", 2024-04-01T07:05:58.032 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.032 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.032 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.032 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.032 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_promtail": { 2024-04-01T07:05:58.032 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_promtail", 2024-04-01T07:05:58.032 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.032 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.032 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.033 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-04-01T07:05:58.033 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.033 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.033 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.033 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Promtail container image", 2024-04-01T07:05:58.033 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.033 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.033 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.033 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.033 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_snmp_gateway": { 2024-04-01T07:05:58.033 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_snmp_gateway", 2024-04-01T07:05:58.033 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.033 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.033 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.033 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-04-01T07:05:58.034 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.034 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.034 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.034 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "SNMP Gateway container image", 2024-04-01T07:05:58.034 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.034 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.034 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.034 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.034 INFO:teuthology.orchestra.run.smithi083.stdout: "container_init": { 2024-04-01T07:05:58.034 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_init", 2024-04-01T07:05:58.034 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.034 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.034 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.035 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.035 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.035 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.035 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.035 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Run podman/docker with `--init`", 2024-04-01T07:05:58.035 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.035 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.035 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.035 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.035 INFO:teuthology.orchestra.run.smithi083.stdout: "daemon_cache_timeout": { 2024-04-01T07:05:58.035 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "daemon_cache_timeout", 2024-04-01T07:05:58.035 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:58.035 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.035 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.035 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "600", 2024-04-01T07:05:58.036 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.036 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.036 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.036 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-04-01T07:05:58.036 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.036 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.036 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.036 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.036 INFO:teuthology.orchestra.run.smithi083.stdout: "default_cephadm_command_timeout": { 2024-04-01T07:05:58.036 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "default_cephadm_command_timeout", 2024-04-01T07:05:58.036 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.036 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.036 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.036 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "900", 2024-04-01T07:05:58.036 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.037 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.037 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.037 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-04-01T07:05:58.037 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.037 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.037 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.037 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.037 INFO:teuthology.orchestra.run.smithi083.stdout: "default_registry": { 2024-04-01T07:05:58.037 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "default_registry", 2024-04-01T07:05:58.037 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.037 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.037 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.037 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "docker.io", 2024-04-01T07:05:58.038 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.038 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.038 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.038 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-04-01T07:05:58.038 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.038 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.038 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.038 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.038 INFO:teuthology.orchestra.run.smithi083.stdout: "device_cache_timeout": { 2024-04-01T07:05:58.038 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "device_cache_timeout", 2024-04-01T07:05:58.038 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:58.038 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.038 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.038 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "1800", 2024-04-01T07:05:58.039 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.039 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.039 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.039 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "seconds to cache device inventory", 2024-04-01T07:05:58.039 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.039 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.039 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.039 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.039 INFO:teuthology.orchestra.run.smithi083.stdout: "device_enhanced_scan": { 2024-04-01T07:05:58.039 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "device_enhanced_scan", 2024-04-01T07:05:58.039 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.039 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.039 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.039 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.039 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.040 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.040 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.040 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Use libstoragemgmt during device scans", 2024-04-01T07:05:58.040 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.040 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.040 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.040 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.040 INFO:teuthology.orchestra.run.smithi083.stdout: "facts_cache_timeout": { 2024-04-01T07:05:58.040 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "facts_cache_timeout", 2024-04-01T07:05:58.040 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:58.040 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.040 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.040 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "60", 2024-04-01T07:05:58.040 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.040 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.041 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.041 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "seconds to cache host facts data", 2024-04-01T07:05:58.041 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.041 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.041 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.041 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.041 INFO:teuthology.orchestra.run.smithi083.stdout: "host_check_interval": { 2024-04-01T07:05:58.041 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "host_check_interval", 2024-04-01T07:05:58.041 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:58.041 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.041 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.041 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "600", 2024-04-01T07:05:58.041 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.041 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.041 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.042 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how frequently to perform a host check", 2024-04-01T07:05:58.042 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.042 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.042 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.042 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.042 INFO:teuthology.orchestra.run.smithi083.stdout: "hw_monitoring": { 2024-04-01T07:05:58.042 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "hw_monitoring", 2024-04-01T07:05:58.042 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.042 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.042 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.042 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.042 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.042 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.042 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.043 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-04-01T07:05:58.043 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.043 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.043 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.043 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.043 INFO:teuthology.orchestra.run.smithi083.stdout: "inventory_list_all": { 2024-04-01T07:05:58.043 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "inventory_list_all", 2024-04-01T07:05:58.043 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.043 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.043 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.043 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.043 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.043 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.043 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.043 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-04-01T07:05:58.044 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.044 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.044 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.044 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.044 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.044 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.044 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.044 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.044 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.044 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.044 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.044 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.044 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.044 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.045 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.045 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.045 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.045 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.045 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.045 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.045 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.045 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.045 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.045 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.045 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.045 INFO:teuthology.orchestra.run.smithi083.stdout: "log_refresh_metadata": { 2024-04-01T07:05:58.045 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_refresh_metadata", 2024-04-01T07:05:58.045 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.046 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.046 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.046 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.046 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.046 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.046 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.046 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-04-01T07:05:58.046 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.046 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.046 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.046 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.046 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.046 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.046 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.047 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.047 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.047 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.047 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.047 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.047 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.047 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-04-01T07:05:58.047 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.047 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.047 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.047 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.047 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.047 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.047 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.048 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.048 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.048 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.048 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.048 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.048 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.048 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.048 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.048 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.048 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.048 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.048 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.048 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.048 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.048 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.049 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.049 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.049 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.049 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.049 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.049 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.049 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.049 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.049 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.049 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.049 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.049 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.049 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.049 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.049 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.050 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.050 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.050 INFO:teuthology.orchestra.run.smithi083.stdout: "manage_etc_ceph_ceph_conf": { 2024-04-01T07:05:58.050 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-04-01T07:05:58.050 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.050 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.050 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.050 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.050 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.050 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.050 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.050 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-04-01T07:05:58.050 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.050 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.051 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.051 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.051 INFO:teuthology.orchestra.run.smithi083.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-04-01T07:05:58.051 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-04-01T07:05:58.051 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.051 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.051 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.051 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "*", 2024-04-01T07:05:58.051 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.051 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.051 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.051 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-04-01T07:05:58.051 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.051 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.051 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.052 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.052 INFO:teuthology.orchestra.run.smithi083.stdout: "max_count_per_host": { 2024-04-01T07:05:58.052 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "max_count_per_host", 2024-04-01T07:05:58.052 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.052 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.052 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.052 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-04-01T07:05:58.052 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.052 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.052 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.052 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "max number of daemons per service per host", 2024-04-01T07:05:58.052 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.052 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.053 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.053 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.053 INFO:teuthology.orchestra.run.smithi083.stdout: "max_osd_draining_count": { 2024-04-01T07:05:58.053 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "max_osd_draining_count", 2024-04-01T07:05:58.053 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.053 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.053 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.053 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-04-01T07:05:58.053 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.053 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.053 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.053 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-04-01T07:05:58.053 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.053 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.054 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.054 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.054 INFO:teuthology.orchestra.run.smithi083.stdout: "migration_current": { 2024-04-01T07:05:58.054 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "migration_current", 2024-04-01T07:05:58.054 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.054 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.054 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.054 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.054 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.054 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.054 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.054 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "internal - do not modify", 2024-04-01T07:05:58.054 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.055 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.055 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.055 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.055 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": { 2024-04-01T07:05:58.055 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "mode", 2024-04-01T07:05:58.055 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.055 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.055 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.055 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "root", 2024-04-01T07:05:58.055 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.055 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.055 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.055 INFO:teuthology.orchestra.run.smithi083.stdout: "cephadm-package", 2024-04-01T07:05:58.055 INFO:teuthology.orchestra.run.smithi083.stdout: "root" 2024-04-01T07:05:58.056 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.056 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "mode for remote execution of cephadm", 2024-04-01T07:05:58.056 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.056 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.056 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.056 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.056 INFO:teuthology.orchestra.run.smithi083.stdout: "oob_default_addr": { 2024-04-01T07:05:58.056 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "oob_default_addr", 2024-04-01T07:05:58.056 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.056 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.056 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.056 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "169.254.1.1", 2024-04-01T07:05:58.056 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.056 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.056 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.057 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Default address for RedFish API (oob management).", 2024-04-01T07:05:58.057 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.057 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.057 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.057 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.057 INFO:teuthology.orchestra.run.smithi083.stdout: "prometheus_alerts_path": { 2024-04-01T07:05:58.057 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "prometheus_alerts_path", 2024-04-01T07:05:58.057 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.057 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.057 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.057 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-04-01T07:05:58.057 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.057 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.057 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.058 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-04-01T07:05:58.058 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.058 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.058 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.058 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.058 INFO:teuthology.orchestra.run.smithi083.stdout: "registry_insecure": { 2024-04-01T07:05:58.058 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "registry_insecure", 2024-04-01T07:05:58.058 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.058 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.058 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.058 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.058 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.058 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.058 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.059 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-04-01T07:05:58.059 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.059 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.059 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.059 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.059 INFO:teuthology.orchestra.run.smithi083.stdout: "registry_password": { 2024-04-01T07:05:58.059 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "registry_password", 2024-04-01T07:05:58.059 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.059 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.059 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.059 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.059 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.059 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.059 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.060 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-04-01T07:05:58.060 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.060 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.060 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.060 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.060 INFO:teuthology.orchestra.run.smithi083.stdout: "registry_url": { 2024-04-01T07:05:58.060 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "registry_url", 2024-04-01T07:05:58.060 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.060 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.060 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.060 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.060 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.060 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.060 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.060 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-04-01T07:05:58.061 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.061 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.061 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.061 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.061 INFO:teuthology.orchestra.run.smithi083.stdout: "registry_username": { 2024-04-01T07:05:58.061 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "registry_username", 2024-04-01T07:05:58.061 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.061 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.061 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.061 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.061 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.061 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.061 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.062 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-04-01T07:05:58.062 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.062 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.062 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.062 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.062 INFO:teuthology.orchestra.run.smithi083.stdout: "secure_monitoring_stack": { 2024-04-01T07:05:58.062 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "secure_monitoring_stack", 2024-04-01T07:05:58.062 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.062 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.062 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.062 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.062 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.062 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.063 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.063 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-04-01T07:05:58.063 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.063 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.063 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.063 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.063 INFO:teuthology.orchestra.run.smithi083.stdout: "service_discovery_port": { 2024-04-01T07:05:58.063 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "service_discovery_port", 2024-04-01T07:05:58.063 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.063 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.063 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.063 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "8765", 2024-04-01T07:05:58.063 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.063 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.064 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.064 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "cephadm service discovery port", 2024-04-01T07:05:58.064 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.064 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.064 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.064 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.064 INFO:teuthology.orchestra.run.smithi083.stdout: "ssh_config_file": { 2024-04-01T07:05:58.064 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ssh_config_file", 2024-04-01T07:05:58.064 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.064 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.064 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.064 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.064 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.064 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.065 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.065 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-04-01T07:05:58.065 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.065 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.065 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.065 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.065 INFO:teuthology.orchestra.run.smithi083.stdout: "use_agent": { 2024-04-01T07:05:58.065 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "use_agent", 2024-04-01T07:05:58.065 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.065 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.065 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.065 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.065 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.065 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.065 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.065 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-04-01T07:05:58.066 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.066 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.066 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.066 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.066 INFO:teuthology.orchestra.run.smithi083.stdout: "use_repo_digest": { 2024-04-01T07:05:58.066 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "use_repo_digest", 2024-04-01T07:05:58.066 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.066 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.066 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.066 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.066 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.066 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.066 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.067 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-04-01T07:05:58.067 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.067 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.067 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.067 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.067 INFO:teuthology.orchestra.run.smithi083.stdout: "warn_on_failed_host_check": { 2024-04-01T07:05:58.067 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "warn_on_failed_host_check", 2024-04-01T07:05:58.067 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.067 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.067 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.067 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.067 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.067 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.067 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.067 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "raise a health warning if the host check fails", 2024-04-01T07:05:58.067 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.068 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.068 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.068 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.068 INFO:teuthology.orchestra.run.smithi083.stdout: "warn_on_stray_daemons": { 2024-04-01T07:05:58.068 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "warn_on_stray_daemons", 2024-04-01T07:05:58.068 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.068 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.068 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.068 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.068 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.068 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.068 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.068 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-04-01T07:05:58.068 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.069 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.069 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.069 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.069 INFO:teuthology.orchestra.run.smithi083.stdout: "warn_on_stray_hosts": { 2024-04-01T07:05:58.069 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "warn_on_stray_hosts", 2024-04-01T07:05:58.069 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.069 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.069 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.069 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.069 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.069 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.069 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.069 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-04-01T07:05:58.069 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.069 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.070 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.070 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.070 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.070 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.070 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.070 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "crash", 2024-04-01T07:05:58.070 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.070 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.070 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.070 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.070 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.070 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.070 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.070 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.071 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.071 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.071 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.071 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.071 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.071 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.071 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.071 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.071 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.071 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.071 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.071 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.071 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.071 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.072 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.072 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.072 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.072 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.072 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.072 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.072 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.072 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.072 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.072 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.072 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.072 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.072 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.072 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.072 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.073 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.073 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.073 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.073 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.073 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.073 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.073 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.073 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.073 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.073 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.073 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.073 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.073 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.073 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.073 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.073 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.074 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.074 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.074 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.074 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.074 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.074 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.074 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.074 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.074 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.074 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.074 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.074 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.074 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.074 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.075 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.075 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.075 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.075 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.075 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.075 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.075 INFO:teuthology.orchestra.run.smithi083.stdout: "retain_interval": { 2024-04-01T07:05:58.075 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "retain_interval", 2024-04-01T07:05:58.075 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:58.075 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.075 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.075 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "31536000", 2024-04-01T07:05:58.075 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.075 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.076 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.076 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how long to retain crashes before pruning them", 2024-04-01T07:05:58.076 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.076 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.076 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.076 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.076 INFO:teuthology.orchestra.run.smithi083.stdout: "warn_recent_interval": { 2024-04-01T07:05:58.076 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "warn_recent_interval", 2024-04-01T07:05:58.076 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:58.076 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.076 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.076 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "1209600", 2024-04-01T07:05:58.076 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.076 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.077 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.077 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "time interval in which to warn about recent crashes", 2024-04-01T07:05:58.077 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.077 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.077 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.077 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.077 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.077 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.077 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.077 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "dashboard", 2024-04-01T07:05:58.077 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.077 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.077 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.077 INFO:teuthology.orchestra.run.smithi083.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-04-01T07:05:58.077 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-04-01T07:05:58.078 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.078 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.078 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.078 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-04-01T07:05:58.078 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.078 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.078 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.078 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.078 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.078 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.078 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.078 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.078 INFO:teuthology.orchestra.run.smithi083.stdout: "ALERTMANAGER_API_HOST": { 2024-04-01T07:05:58.078 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ALERTMANAGER_API_HOST", 2024-04-01T07:05:58.079 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.079 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.079 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.079 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.079 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.079 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.079 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.079 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.079 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.079 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.079 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.079 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.079 INFO:teuthology.orchestra.run.smithi083.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-04-01T07:05:58.079 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-04-01T07:05:58.080 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.080 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.080 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.080 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.080 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.080 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.080 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.080 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.080 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.080 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.080 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.080 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.080 INFO:teuthology.orchestra.run.smithi083.stdout: "AUDIT_API_ENABLED": { 2024-04-01T07:05:58.080 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "AUDIT_API_ENABLED", 2024-04-01T07:05:58.080 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.081 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.081 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.081 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.081 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.081 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.081 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.081 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.081 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.081 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.081 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.081 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.081 INFO:teuthology.orchestra.run.smithi083.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-04-01T07:05:58.081 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-04-01T07:05:58.081 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.082 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.082 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.082 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.082 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.082 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.082 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.082 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.082 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.082 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.082 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.082 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.082 INFO:teuthology.orchestra.run.smithi083.stdout: "ENABLE_BROWSABLE_API": { 2024-04-01T07:05:58.082 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ENABLE_BROWSABLE_API", 2024-04-01T07:05:58.082 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.083 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.083 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.083 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.083 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.083 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.083 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.083 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.083 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.083 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.083 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.083 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.083 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-04-01T07:05:58.083 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-04-01T07:05:58.083 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.083 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.084 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.084 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.084 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.084 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.084 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.084 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.084 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.084 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.084 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.084 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.084 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-04-01T07:05:58.084 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-04-01T07:05:58.084 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.084 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.084 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.085 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.085 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.085 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.085 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.085 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.085 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.085 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.085 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.085 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.085 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-04-01T07:05:58.085 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-04-01T07:05:58.085 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.085 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.085 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.086 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.086 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.086 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.086 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.086 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.086 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.086 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.086 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.086 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.086 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-04-01T07:05:58.086 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-04-01T07:05:58.086 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.086 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.086 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.086 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.087 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.087 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.087 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.087 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.087 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.087 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.087 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.087 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.087 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_NFS": { 2024-04-01T07:05:58.087 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-04-01T07:05:58.087 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.087 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.087 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.087 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.088 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.088 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.088 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.088 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.088 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.088 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.088 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.088 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.088 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_RBD": { 2024-04-01T07:05:58.088 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-04-01T07:05:58.088 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.088 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.088 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.089 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.089 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.089 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.089 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.089 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.089 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.089 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.089 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.089 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.089 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_RGW": { 2024-04-01T07:05:58.089 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-04-01T07:05:58.089 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.089 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.089 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.090 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.090 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.090 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.090 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.090 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.090 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.090 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.090 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.090 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.090 INFO:teuthology.orchestra.run.smithi083.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-04-01T07:05:58.090 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-04-01T07:05:58.090 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.090 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.090 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.091 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.091 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.091 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.091 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.091 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.091 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.091 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.091 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.091 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.091 INFO:teuthology.orchestra.run.smithi083.stdout: "GRAFANA_API_PASSWORD": { 2024-04-01T07:05:58.091 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GRAFANA_API_PASSWORD", 2024-04-01T07:05:58.091 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.091 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.091 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.092 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "admin", 2024-04-01T07:05:58.092 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.092 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.092 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.092 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.092 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.092 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.092 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.092 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.092 INFO:teuthology.orchestra.run.smithi083.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-04-01T07:05:58.092 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-04-01T07:05:58.092 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.092 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.092 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.092 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.093 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.093 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.093 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.093 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.093 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.093 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.093 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.093 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.093 INFO:teuthology.orchestra.run.smithi083.stdout: "GRAFANA_API_URL": { 2024-04-01T07:05:58.093 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GRAFANA_API_URL", 2024-04-01T07:05:58.093 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.093 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.093 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.093 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.094 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.094 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.094 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.094 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.094 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.094 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.094 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.094 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.094 INFO:teuthology.orchestra.run.smithi083.stdout: "GRAFANA_API_USERNAME": { 2024-04-01T07:05:58.094 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GRAFANA_API_USERNAME", 2024-04-01T07:05:58.094 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.094 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.094 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.095 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "admin", 2024-04-01T07:05:58.095 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.095 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.095 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.095 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.095 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.095 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.095 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.095 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.095 INFO:teuthology.orchestra.run.smithi083.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-04-01T07:05:58.095 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-04-01T07:05:58.095 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.095 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.095 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.095 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.096 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.096 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.096 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.096 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.096 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.096 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.096 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.096 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.096 INFO:teuthology.orchestra.run.smithi083.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-04-01T07:05:58.096 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-04-01T07:05:58.096 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.096 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.096 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.096 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.097 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.097 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.097 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.097 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.097 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.097 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.097 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.097 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.097 INFO:teuthology.orchestra.run.smithi083.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-04-01T07:05:58.097 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-04-01T07:05:58.097 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.097 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.097 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.098 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.098 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.098 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.098 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.098 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.098 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.098 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.098 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.098 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.098 INFO:teuthology.orchestra.run.smithi083.stdout: "ISSUE_TRACKER_API_KEY": { 2024-04-01T07:05:58.098 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-04-01T07:05:58.098 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.098 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.098 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.099 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.099 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.099 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.099 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.099 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.099 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.099 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.099 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.099 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.099 INFO:teuthology.orchestra.run.smithi083.stdout: "PROMETHEUS_API_HOST": { 2024-04-01T07:05:58.099 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PROMETHEUS_API_HOST", 2024-04-01T07:05:58.099 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.099 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.099 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.100 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.100 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.100 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.100 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.100 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.100 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.100 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.100 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.100 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.100 INFO:teuthology.orchestra.run.smithi083.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-04-01T07:05:58.100 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-04-01T07:05:58.100 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.100 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.101 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.101 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.101 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.101 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.101 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.101 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.101 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.101 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.101 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.101 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.101 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-04-01T07:05:58.101 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-04-01T07:05:58.101 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.101 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.102 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.102 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.102 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.102 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.102 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.102 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.102 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.102 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.102 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.102 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.102 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-04-01T07:05:58.102 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-04-01T07:05:58.102 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.102 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.103 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.103 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.103 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.103 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.103 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.103 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.103 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.103 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.103 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.103 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.103 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-04-01T07:05:58.103 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-04-01T07:05:58.103 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.103 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.104 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.104 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.104 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.104 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.104 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.104 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.104 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.104 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.104 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.104 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.104 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-04-01T07:05:58.104 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-04-01T07:05:58.104 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.104 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.105 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.105 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.105 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.105 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.105 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.105 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.105 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.105 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.105 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.105 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.105 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-04-01T07:05:58.105 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-04-01T07:05:58.105 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.105 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.106 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.106 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.106 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.106 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.106 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.106 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.106 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.106 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.106 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.106 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.106 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-04-01T07:05:58.106 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-04-01T07:05:58.107 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.107 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.107 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.107 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.107 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.107 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.107 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.107 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.107 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.107 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.107 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.107 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.107 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-04-01T07:05:58.107 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-04-01T07:05:58.108 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.108 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.108 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.108 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.108 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.108 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.108 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.108 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.108 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.108 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.108 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.108 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.108 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_ENABLED": { 2024-04-01T07:05:58.108 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_ENABLED", 2024-04-01T07:05:58.109 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.109 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.109 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.109 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.109 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.109 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.109 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.109 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.109 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.109 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.109 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.109 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.109 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-04-01T07:05:58.109 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-04-01T07:05:58.110 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.110 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.110 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.110 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-04-01T07:05:58.110 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.110 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.110 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.110 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.110 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.110 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.110 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.110 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.110 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-04-01T07:05:58.110 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-04-01T07:05:58.110 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.111 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.111 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.111 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-04-01T07:05:58.111 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.111 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.111 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.111 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.111 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.111 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.111 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.111 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.111 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-04-01T07:05:58.111 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-04-01T07:05:58.111 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.112 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.112 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.112 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "8", 2024-04-01T07:05:58.112 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.112 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.112 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.112 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.112 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.112 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.112 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.112 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.112 INFO:teuthology.orchestra.run.smithi083.stdout: "REST_REQUESTS_TIMEOUT": { 2024-04-01T07:05:58.112 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-04-01T07:05:58.112 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.112 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.113 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.113 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "45", 2024-04-01T07:05:58.113 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.113 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.113 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.113 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.113 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.113 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.113 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.113 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.113 INFO:teuthology.orchestra.run.smithi083.stdout: "RGW_API_ACCESS_KEY": { 2024-04-01T07:05:58.113 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "RGW_API_ACCESS_KEY", 2024-04-01T07:05:58.113 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.114 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.114 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.114 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.114 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.114 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.114 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.114 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.114 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.114 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.114 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.114 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.114 INFO:teuthology.orchestra.run.smithi083.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-04-01T07:05:58.114 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-04-01T07:05:58.114 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.114 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.115 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.115 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "admin", 2024-04-01T07:05:58.115 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.115 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.115 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.115 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.115 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.115 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.115 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.115 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.115 INFO:teuthology.orchestra.run.smithi083.stdout: "RGW_API_SECRET_KEY": { 2024-04-01T07:05:58.115 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "RGW_API_SECRET_KEY", 2024-04-01T07:05:58.115 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.115 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.116 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.116 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.116 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.116 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.116 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.116 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.116 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.116 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.116 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.116 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.116 INFO:teuthology.orchestra.run.smithi083.stdout: "RGW_API_SSL_VERIFY": { 2024-04-01T07:05:58.116 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "RGW_API_SSL_VERIFY", 2024-04-01T07:05:58.116 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.116 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.116 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.116 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.117 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.117 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.117 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.117 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.117 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.117 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.117 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.117 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.117 INFO:teuthology.orchestra.run.smithi083.stdout: "UNSAFE_TLS_v1_2": { 2024-04-01T07:05:58.117 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "UNSAFE_TLS_v1_2", 2024-04-01T07:05:58.117 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.117 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.117 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.118 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.118 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.118 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.118 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.118 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.118 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.118 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.118 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.118 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.118 INFO:teuthology.orchestra.run.smithi083.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-04-01T07:05:58.118 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-04-01T07:05:58.118 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.118 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.118 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.119 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-04-01T07:05:58.119 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.119 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.119 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.119 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.119 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.119 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.119 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.119 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.119 INFO:teuthology.orchestra.run.smithi083.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-04-01T07:05:58.119 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-04-01T07:05:58.119 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.119 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.119 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.119 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-04-01T07:05:58.120 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.120 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.120 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.120 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.120 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.120 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.120 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.120 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.120 INFO:teuthology.orchestra.run.smithi083.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-04-01T07:05:58.120 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-04-01T07:05:58.120 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.120 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.120 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.120 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "5", 2024-04-01T07:05:58.121 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.121 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.121 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.121 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.121 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.121 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.121 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.121 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.121 INFO:teuthology.orchestra.run.smithi083.stdout: "cross_origin_url": { 2024-04-01T07:05:58.121 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "cross_origin_url", 2024-04-01T07:05:58.121 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.121 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.121 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.121 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.122 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.122 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.122 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.122 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.122 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.122 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.122 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.122 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.122 INFO:teuthology.orchestra.run.smithi083.stdout: "crt_file": { 2024-04-01T07:05:58.122 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "crt_file", 2024-04-01T07:05:58.122 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.122 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.122 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.122 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.123 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.123 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.123 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.123 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.123 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.123 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.123 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.123 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.123 INFO:teuthology.orchestra.run.smithi083.stdout: "debug": { 2024-04-01T07:05:58.123 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "debug", 2024-04-01T07:05:58.123 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.123 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.123 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.123 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.123 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.124 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.124 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.124 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Enable/disable debug options", 2024-04-01T07:05:58.124 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.124 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.124 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.124 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.124 INFO:teuthology.orchestra.run.smithi083.stdout: "jwt_token_ttl": { 2024-04-01T07:05:58.124 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "jwt_token_ttl", 2024-04-01T07:05:58.124 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.124 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.124 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.124 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "28800", 2024-04-01T07:05:58.124 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.124 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.125 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.125 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.125 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.125 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.125 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.125 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.125 INFO:teuthology.orchestra.run.smithi083.stdout: "key_file": { 2024-04-01T07:05:58.125 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "key_file", 2024-04-01T07:05:58.125 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.125 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.125 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.125 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.125 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.125 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.125 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.125 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.126 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.126 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.126 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.126 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.126 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.126 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.126 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.126 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.126 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.126 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.126 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.126 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.126 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.126 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.127 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.127 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.127 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.127 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.127 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.127 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.127 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.127 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.127 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.127 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.127 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.127 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.127 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.127 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.127 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.128 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.128 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.128 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.128 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.128 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.128 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.128 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.128 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.128 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.128 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.128 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.128 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.128 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.128 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.128 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.128 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.129 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.129 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.129 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.129 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.129 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.129 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.129 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.129 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.129 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.129 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.129 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.129 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.129 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.129 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.129 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.129 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.130 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.130 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.130 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.130 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.130 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.130 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.130 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.130 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.130 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.130 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.130 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.130 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.130 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.130 INFO:teuthology.orchestra.run.smithi083.stdout: "motd": { 2024-04-01T07:05:58.130 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "motd", 2024-04-01T07:05:58.130 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.131 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.131 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.131 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.131 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.131 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.131 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.131 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "The message of the day", 2024-04-01T07:05:58.131 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.131 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.131 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.131 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.131 INFO:teuthology.orchestra.run.smithi083.stdout: "redirect_resolve_ip_addr": { 2024-04-01T07:05:58.131 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "redirect_resolve_ip_addr", 2024-04-01T07:05:58.131 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.131 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.132 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.132 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.132 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.132 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.132 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.132 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.132 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.132 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.132 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.132 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.132 INFO:teuthology.orchestra.run.smithi083.stdout: "server_addr": { 2024-04-01T07:05:58.132 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "server_addr", 2024-04-01T07:05:58.132 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.133 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.133 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.133 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "::", 2024-04-01T07:05:58.133 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.133 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.133 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.133 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.133 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.133 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.133 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.133 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.133 INFO:teuthology.orchestra.run.smithi083.stdout: "server_port": { 2024-04-01T07:05:58.133 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "server_port", 2024-04-01T07:05:58.133 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.134 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.134 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.134 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "8080", 2024-04-01T07:05:58.134 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.134 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.134 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.134 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.134 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.134 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.134 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.134 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.134 INFO:teuthology.orchestra.run.smithi083.stdout: "ssl": { 2024-04-01T07:05:58.134 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ssl", 2024-04-01T07:05:58.134 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.134 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.135 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.135 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.135 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.135 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.135 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.135 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.135 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.135 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.135 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.135 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.135 INFO:teuthology.orchestra.run.smithi083.stdout: "ssl_server_port": { 2024-04-01T07:05:58.135 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ssl_server_port", 2024-04-01T07:05:58.135 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.136 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.136 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.136 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "8443", 2024-04-01T07:05:58.136 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.136 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.136 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.136 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.136 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.136 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.136 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.136 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.136 INFO:teuthology.orchestra.run.smithi083.stdout: "standby_behaviour": { 2024-04-01T07:05:58.136 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "standby_behaviour", 2024-04-01T07:05:58.136 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.137 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.137 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.137 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "redirect", 2024-04-01T07:05:58.137 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.137 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.137 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.137 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.137 INFO:teuthology.orchestra.run.smithi083.stdout: "redirect" 2024-04-01T07:05:58.137 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.137 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.137 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.137 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.137 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.137 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.138 INFO:teuthology.orchestra.run.smithi083.stdout: "standby_error_status_code": { 2024-04-01T07:05:58.138 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "standby_error_status_code", 2024-04-01T07:05:58.138 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.138 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.138 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.138 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "500", 2024-04-01T07:05:58.138 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "400", 2024-04-01T07:05:58.138 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "599", 2024-04-01T07:05:58.138 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.138 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.138 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.138 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.138 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.138 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.138 INFO:teuthology.orchestra.run.smithi083.stdout: "url_prefix": { 2024-04-01T07:05:58.139 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "url_prefix", 2024-04-01T07:05:58.139 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.139 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.139 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.139 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.139 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.139 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.139 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.139 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.139 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.139 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.139 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.139 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.139 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.140 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.140 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.140 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "devicehealth", 2024-04-01T07:05:58.140 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.140 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.140 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.140 INFO:teuthology.orchestra.run.smithi083.stdout: "enable_monitoring": { 2024-04-01T07:05:58.140 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "enable_monitoring", 2024-04-01T07:05:58.140 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.140 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.140 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.140 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.140 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.140 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.141 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.141 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "monitor device health metrics", 2024-04-01T07:05:58.141 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.141 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.141 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.141 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.141 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.141 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.141 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.141 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.141 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.141 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.141 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.142 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.142 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.142 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.142 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.142 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.142 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.142 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.142 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.142 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.142 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.142 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.142 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.142 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.143 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.143 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.143 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.143 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.143 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.143 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.143 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.143 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.143 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.143 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.143 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.143 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.143 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.143 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.143 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.144 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.144 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.144 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.144 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.144 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.144 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.144 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.144 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.144 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.144 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.144 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.144 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.144 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.144 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.145 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.145 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.145 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.145 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.145 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.145 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.145 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.145 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.145 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.145 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.145 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.145 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.145 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.145 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.146 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.146 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.146 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.146 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.146 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.146 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.146 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.146 INFO:teuthology.orchestra.run.smithi083.stdout: "mark_out_threshold": { 2024-04-01T07:05:58.146 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "mark_out_threshold", 2024-04-01T07:05:58.146 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:58.146 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.146 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.146 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "2419200", 2024-04-01T07:05:58.146 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.147 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.147 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.147 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-04-01T07:05:58.147 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.147 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.147 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.147 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.147 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_name": { 2024-04-01T07:05:58.147 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "pool_name", 2024-04-01T07:05:58.147 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.147 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.147 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.147 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "device_health_metrics", 2024-04-01T07:05:58.147 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.148 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.148 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.148 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "name of pool in which to store device health metrics", 2024-04-01T07:05:58.148 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.148 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.148 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.148 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.148 INFO:teuthology.orchestra.run.smithi083.stdout: "retention_period": { 2024-04-01T07:05:58.148 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "retention_period", 2024-04-01T07:05:58.148 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:58.148 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.148 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.148 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "15552000", 2024-04-01T07:05:58.148 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.148 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.149 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.149 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how long to retain device health metrics", 2024-04-01T07:05:58.149 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.149 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.149 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.149 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.149 INFO:teuthology.orchestra.run.smithi083.stdout: "scrape_frequency": { 2024-04-01T07:05:58.149 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "scrape_frequency", 2024-04-01T07:05:58.149 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:58.149 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.149 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.149 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "86400", 2024-04-01T07:05:58.149 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.149 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.149 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.150 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how frequently to scrape device health metrics", 2024-04-01T07:05:58.150 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.150 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.150 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.150 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.150 INFO:teuthology.orchestra.run.smithi083.stdout: "self_heal": { 2024-04-01T07:05:58.150 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "self_heal", 2024-04-01T07:05:58.150 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.150 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.150 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.150 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.150 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.150 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.151 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.151 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-04-01T07:05:58.151 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.151 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.151 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.151 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.151 INFO:teuthology.orchestra.run.smithi083.stdout: "sleep_interval": { 2024-04-01T07:05:58.151 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sleep_interval", 2024-04-01T07:05:58.151 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:58.151 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.151 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.151 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "600", 2024-04-01T07:05:58.151 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.151 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.152 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.152 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how frequently to wake up and check device health", 2024-04-01T07:05:58.152 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.152 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.152 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.152 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.152 INFO:teuthology.orchestra.run.smithi083.stdout: "warn_threshold": { 2024-04-01T07:05:58.152 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "warn_threshold", 2024-04-01T07:05:58.152 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:58.152 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.152 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.152 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "7257600", 2024-04-01T07:05:58.152 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.153 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.153 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.153 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-04-01T07:05:58.153 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.153 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.153 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.153 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.153 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.153 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.153 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.153 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "diskprediction_local", 2024-04-01T07:05:58.153 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.153 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.153 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.154 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.154 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.154 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.154 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.154 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.154 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.154 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.154 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.154 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.154 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.154 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.154 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.154 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.154 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.155 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.155 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.155 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.155 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.155 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.155 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.155 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.155 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.155 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.155 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.155 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.155 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.155 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.156 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.156 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.156 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.156 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.156 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.156 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.156 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.156 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.156 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.156 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.156 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.156 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.156 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.156 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.156 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.157 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.157 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.157 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.157 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.157 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.157 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.157 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.157 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.157 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.157 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.157 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.157 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.157 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.157 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.157 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.157 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.158 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.158 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.158 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.158 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.158 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.158 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.158 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.158 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.158 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.158 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.158 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.158 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.158 INFO:teuthology.orchestra.run.smithi083.stdout: "predict_interval": { 2024-04-01T07:05:58.158 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "predict_interval", 2024-04-01T07:05:58.158 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.158 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.159 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.159 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "86400", 2024-04-01T07:05:58.159 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.159 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.159 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.159 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.159 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.159 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.159 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.159 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.159 INFO:teuthology.orchestra.run.smithi083.stdout: "predictor_model": { 2024-04-01T07:05:58.159 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "predictor_model", 2024-04-01T07:05:58.159 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.159 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.160 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.160 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "prophetstor", 2024-04-01T07:05:58.160 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.160 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.160 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.160 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.160 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.160 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.160 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.160 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.160 INFO:teuthology.orchestra.run.smithi083.stdout: "sleep_interval": { 2024-04-01T07:05:58.160 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sleep_interval", 2024-04-01T07:05:58.160 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.160 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.161 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.161 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "600", 2024-04-01T07:05:58.161 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.161 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.161 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.161 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.161 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.161 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.161 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.161 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.161 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.161 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.161 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.161 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "influx", 2024-04-01T07:05:58.161 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": false, 2024-04-01T07:05:58.162 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "influxdb python module not found", 2024-04-01T07:05:58.162 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.162 INFO:teuthology.orchestra.run.smithi083.stdout: "batch_size": { 2024-04-01T07:05:58.162 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "batch_size", 2024-04-01T07:05:58.162 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.162 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.162 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.162 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "5000", 2024-04-01T07:05:58.162 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.162 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.162 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.162 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-04-01T07:05:58.162 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.162 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.163 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.163 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.163 INFO:teuthology.orchestra.run.smithi083.stdout: "database": { 2024-04-01T07:05:58.163 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "database", 2024-04-01T07:05:58.163 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.163 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.163 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.163 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "ceph", 2024-04-01T07:05:58.163 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.163 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.163 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.163 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-04-01T07:05:58.163 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.163 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.164 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.164 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.164 INFO:teuthology.orchestra.run.smithi083.stdout: "hostname": { 2024-04-01T07:05:58.164 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "hostname", 2024-04-01T07:05:58.164 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.164 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.164 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.164 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.164 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.164 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.164 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.164 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "InfluxDB server hostname", 2024-04-01T07:05:58.164 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.164 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.164 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.164 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.164 INFO:teuthology.orchestra.run.smithi083.stdout: "interval": { 2024-04-01T07:05:58.165 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "interval", 2024-04-01T07:05:58.165 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:58.165 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.165 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.165 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "30", 2024-04-01T07:05:58.165 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "5", 2024-04-01T07:05:58.165 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.165 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.165 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-04-01T07:05:58.165 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.165 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.165 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.165 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.165 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.166 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.166 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.166 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.166 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.166 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.166 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.166 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.166 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.166 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.166 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.166 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.166 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.166 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.167 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.167 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.167 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.167 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.167 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.167 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.167 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.167 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.167 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.167 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.167 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.167 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.167 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.167 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.167 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.168 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.168 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.168 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.168 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.168 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.168 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.168 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.168 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.168 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.168 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.168 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.168 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.168 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.168 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.169 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.169 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.169 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.169 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.169 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.169 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.169 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.169 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.169 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.169 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.169 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.169 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.169 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.169 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.169 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.169 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.170 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.170 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.170 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.170 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.170 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.170 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.170 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.170 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.170 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.170 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.170 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.170 INFO:teuthology.orchestra.run.smithi083.stdout: "password": { 2024-04-01T07:05:58.170 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "password", 2024-04-01T07:05:58.170 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.170 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.171 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.171 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.171 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.171 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.171 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.171 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "password of InfluxDB server user", 2024-04-01T07:05:58.171 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.171 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.171 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.171 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.171 INFO:teuthology.orchestra.run.smithi083.stdout: "port": { 2024-04-01T07:05:58.171 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "port", 2024-04-01T07:05:58.171 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.171 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.171 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.171 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "8086", 2024-04-01T07:05:58.171 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.172 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.172 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.172 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "InfluxDB server port", 2024-04-01T07:05:58.172 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.172 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.172 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.172 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.172 INFO:teuthology.orchestra.run.smithi083.stdout: "ssl": { 2024-04-01T07:05:58.172 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ssl", 2024-04-01T07:05:58.172 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.172 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.172 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.172 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "false", 2024-04-01T07:05:58.172 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.172 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.173 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.173 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-04-01T07:05:58.173 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.173 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.173 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.173 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.173 INFO:teuthology.orchestra.run.smithi083.stdout: "threads": { 2024-04-01T07:05:58.173 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "threads", 2024-04-01T07:05:58.173 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.173 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.173 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.173 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "5", 2024-04-01T07:05:58.173 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "1", 2024-04-01T07:05:58.173 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "32", 2024-04-01T07:05:58.174 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.174 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-04-01T07:05:58.174 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.174 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.174 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.174 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.174 INFO:teuthology.orchestra.run.smithi083.stdout: "username": { 2024-04-01T07:05:58.174 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "username", 2024-04-01T07:05:58.174 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.174 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.174 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.174 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.174 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.174 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.175 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.175 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "username of InfluxDB server user", 2024-04-01T07:05:58.175 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.175 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.175 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.175 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.175 INFO:teuthology.orchestra.run.smithi083.stdout: "verify_ssl": { 2024-04-01T07:05:58.175 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "verify_ssl", 2024-04-01T07:05:58.175 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.175 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.175 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.175 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "true", 2024-04-01T07:05:58.175 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.175 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.175 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.175 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-04-01T07:05:58.176 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.176 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.176 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.176 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.176 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.176 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.176 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.176 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "insights", 2024-04-01T07:05:58.176 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.176 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.176 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.176 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.176 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.176 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.176 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.176 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.176 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.177 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.177 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.177 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.177 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.177 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.177 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.177 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.177 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.177 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.177 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.177 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.177 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.177 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.177 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.177 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.177 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.178 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.178 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.178 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.178 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.178 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.178 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.178 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.178 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.178 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.178 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.178 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.178 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.178 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.178 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.178 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.179 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.179 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.179 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.179 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.179 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.179 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.179 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.179 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.179 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.179 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.179 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.179 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.179 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.179 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.179 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.180 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.180 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.180 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.180 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.180 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.180 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.180 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.180 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.180 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.180 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.180 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.180 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.180 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.180 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.180 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.181 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.181 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.181 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.181 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.181 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.181 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.181 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "iostat", 2024-04-01T07:05:58.181 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.181 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.181 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.181 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.181 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.181 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.181 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.181 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.182 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.182 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.182 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.182 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.182 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.182 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.182 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.182 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.182 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.182 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.182 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.182 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.182 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.183 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.183 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.183 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.183 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.183 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.183 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.183 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.183 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.183 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.183 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.183 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.183 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.183 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.183 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.183 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.184 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.184 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.184 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.184 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.184 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.184 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.184 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.184 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.184 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.184 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.184 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.184 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.184 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.184 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.185 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.185 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.185 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.185 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.185 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.185 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.185 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.185 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.185 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.185 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.185 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.185 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.185 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.185 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.186 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.186 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.186 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.186 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.186 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.186 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.186 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.186 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.186 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.186 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.186 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.186 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.186 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "k8sevents", 2024-04-01T07:05:58.186 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.187 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.187 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.187 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_event_retention_days": { 2024-04-01T07:05:58.187 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ceph_event_retention_days", 2024-04-01T07:05:58.187 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.187 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.187 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.187 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "7", 2024-04-01T07:05:58.187 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.187 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.187 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.187 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Days to hold ceph event information within local cache", 2024-04-01T07:05:58.187 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.188 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.188 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.188 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.188 INFO:teuthology.orchestra.run.smithi083.stdout: "config_check_secs": { 2024-04-01T07:05:58.188 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "config_check_secs", 2024-04-01T07:05:58.188 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.188 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.188 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.188 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-04-01T07:05:58.188 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "10", 2024-04-01T07:05:58.188 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.188 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.188 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-04-01T07:05:58.188 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.189 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.189 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.189 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.189 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.189 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.189 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.189 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.189 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.189 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.189 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.189 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.189 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.189 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.189 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.189 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.190 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.190 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.190 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.190 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.190 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.190 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.190 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.190 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.190 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.190 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.190 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.190 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.190 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.190 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.190 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.191 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.191 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.191 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.191 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.191 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.191 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.191 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.191 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.191 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.191 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.191 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.191 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.191 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.191 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.191 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.192 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.192 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.192 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.192 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.192 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.192 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.192 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.192 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.192 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.192 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.192 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.192 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.192 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.192 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.192 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.192 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.193 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.193 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.193 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.193 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.193 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.193 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.193 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.193 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.193 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.193 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.193 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.193 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.193 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.193 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.193 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.194 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "localpool", 2024-04-01T07:05:58.194 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.194 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.194 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.194 INFO:teuthology.orchestra.run.smithi083.stdout: "failure_domain": { 2024-04-01T07:05:58.194 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "failure_domain", 2024-04-01T07:05:58.194 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.194 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.194 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.194 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "host", 2024-04-01T07:05:58.194 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.194 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.194 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.194 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "failure domain for any created local pool", 2024-04-01T07:05:58.195 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-04-01T07:05:58.195 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.195 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.195 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.195 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.195 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.195 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.195 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.195 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.195 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.195 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.195 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.195 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.196 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.196 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.196 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.196 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.196 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.196 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.196 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.196 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.196 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.196 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.196 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.196 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.196 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.196 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.197 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.197 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.197 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.197 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.197 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.197 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.197 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.197 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.197 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.197 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.197 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.197 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.197 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.197 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.198 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.198 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.198 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.198 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.198 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.198 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.198 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.198 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.198 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.198 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.198 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.198 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.198 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.198 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.199 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.199 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.199 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.199 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.199 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.199 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.199 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.199 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.199 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.199 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.199 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.199 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.199 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.199 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.200 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.200 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.200 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.200 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.200 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.200 INFO:teuthology.orchestra.run.smithi083.stdout: "min_size": { 2024-04-01T07:05:58.200 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "min_size", 2024-04-01T07:05:58.200 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.200 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.200 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.200 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.200 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.200 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.200 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.200 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "default min_size for any created local pool", 2024-04-01T07:05:58.201 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-04-01T07:05:58.201 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.201 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.201 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.201 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rep": { 2024-04-01T07:05:58.201 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "num_rep", 2024-04-01T07:05:58.201 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.201 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.201 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.201 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "3", 2024-04-01T07:05:58.201 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.201 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.201 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.201 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "default replica count for any created local pool", 2024-04-01T07:05:58.201 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.202 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.202 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.202 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.202 INFO:teuthology.orchestra.run.smithi083.stdout: "pg_num": { 2024-04-01T07:05:58.202 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "pg_num", 2024-04-01T07:05:58.202 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.202 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.202 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.202 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "128", 2024-04-01T07:05:58.202 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.202 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.202 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.202 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "default pg_num for any created local pool", 2024-04-01T07:05:58.202 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.203 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.203 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.203 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.203 INFO:teuthology.orchestra.run.smithi083.stdout: "prefix": { 2024-04-01T07:05:58.203 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "prefix", 2024-04-01T07:05:58.203 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.203 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.203 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.203 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.203 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.203 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.203 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.203 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "name prefix for any created local pool", 2024-04-01T07:05:58.203 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.203 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.203 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.204 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.204 INFO:teuthology.orchestra.run.smithi083.stdout: "subtree": { 2024-04-01T07:05:58.204 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "subtree", 2024-04-01T07:05:58.204 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.204 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.204 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.204 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "rack", 2024-04-01T07:05:58.204 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.204 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.204 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.204 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "CRUSH level for which to create a local pool", 2024-04-01T07:05:58.204 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-04-01T07:05:58.204 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.205 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.205 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.205 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.205 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.205 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.205 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "mds_autoscaler", 2024-04-01T07:05:58.205 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.205 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.205 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.205 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.205 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.205 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.205 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.205 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.205 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.206 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.206 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.206 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.206 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.206 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.206 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.206 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.206 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.206 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.206 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.206 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.206 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.206 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.207 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.207 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.207 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.207 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.207 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.207 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.207 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.207 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.207 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.207 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.207 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.207 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.207 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.207 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.207 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.208 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.208 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.208 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.208 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.208 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.208 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.208 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.208 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.208 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.208 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.208 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.208 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.208 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.209 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.209 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.209 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.209 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.209 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.209 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.209 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.209 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.209 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.209 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.209 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.209 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.209 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.209 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.210 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.210 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.210 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.210 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.210 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.210 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.210 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.210 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.210 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.210 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.210 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.210 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.210 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "mirroring", 2024-04-01T07:05:58.210 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.210 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.211 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.211 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.211 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.211 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.211 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.211 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.211 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.211 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.211 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.211 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.211 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.211 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.211 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.211 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.212 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.212 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.212 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.212 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.212 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.212 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.212 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.212 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.212 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.212 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.212 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.212 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.212 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.212 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.213 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.213 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.213 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.213 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.213 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.213 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.213 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.213 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.213 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.213 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.213 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.213 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.213 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.213 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.214 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.214 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.214 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.214 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.214 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.214 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.214 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.214 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.214 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.214 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.214 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.214 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.214 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.215 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.215 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.215 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.215 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.215 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.215 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.215 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.215 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.215 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.215 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.215 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.215 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.215 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.215 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.216 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.216 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.216 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.216 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.216 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.216 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "nfs", 2024-04-01T07:05:58.216 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.216 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.216 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.216 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.216 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.216 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.216 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.216 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.216 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.217 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.217 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.217 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.217 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.217 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.217 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.217 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.217 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.217 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.217 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.217 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.217 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.217 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.217 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.218 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.218 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.218 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.218 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.218 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.218 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.218 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.218 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.218 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.218 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.218 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.218 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.218 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.218 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.219 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.219 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.219 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.219 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.219 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.219 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.219 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.219 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.219 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.219 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.219 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.219 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.219 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.219 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.219 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.219 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.220 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.220 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.220 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.220 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.220 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.220 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.220 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.220 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.220 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.220 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.220 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.220 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.220 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.220 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.220 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.220 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.221 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.221 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.221 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.221 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.221 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.221 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.221 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.221 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "orchestrator", 2024-04-01T07:05:58.221 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.221 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.221 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.221 INFO:teuthology.orchestra.run.smithi083.stdout: "fail_fs": { 2024-04-01T07:05:58.221 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "fail_fs", 2024-04-01T07:05:58.221 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.221 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.222 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.222 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.222 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.222 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.222 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.222 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-04-01T07:05:58.222 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.222 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.222 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.222 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.222 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.222 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.223 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.223 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.223 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.223 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.223 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.223 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.223 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.223 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.223 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.223 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.223 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.223 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.223 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.223 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.224 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.224 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.224 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.224 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.224 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.224 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.224 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.224 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.224 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.224 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.224 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.224 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.224 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.224 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.224 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.225 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.225 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.225 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.225 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.225 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.225 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.225 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.225 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.225 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.225 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.225 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.225 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.225 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.225 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.226 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.226 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.226 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.226 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.226 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.226 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.226 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.226 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.226 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.226 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.226 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.226 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.226 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.227 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.227 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.227 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.227 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.227 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.227 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.227 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.227 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.227 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.227 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.227 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.227 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.227 INFO:teuthology.orchestra.run.smithi083.stdout: "orchestrator": { 2024-04-01T07:05:58.228 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "orchestrator", 2024-04-01T07:05:58.228 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.228 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.228 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.228 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.228 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.228 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.228 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.228 INFO:teuthology.orchestra.run.smithi083.stdout: "cephadm", 2024-04-01T07:05:58.228 INFO:teuthology.orchestra.run.smithi083.stdout: "rook", 2024-04-01T07:05:58.228 INFO:teuthology.orchestra.run.smithi083.stdout: "test_orchestrator" 2024-04-01T07:05:58.228 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.228 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Orchestrator backend", 2024-04-01T07:05:58.228 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.228 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.229 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.229 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.229 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.229 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.229 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.229 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "osd_perf_query", 2024-04-01T07:05:58.229 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.229 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.229 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.229 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.229 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.229 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.229 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.230 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.230 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.230 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.230 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.230 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.230 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.230 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.230 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.230 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.230 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.230 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.230 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.230 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.230 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.230 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.231 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.231 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.231 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.231 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.231 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.231 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.231 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.231 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.231 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.231 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.231 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.231 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.231 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.231 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.231 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.232 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.232 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.232 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.232 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.232 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.232 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.232 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.232 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.232 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.232 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.232 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.232 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.232 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.233 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.233 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.233 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.233 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.233 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.233 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.233 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.233 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.233 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.233 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.233 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.233 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.233 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.233 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.234 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.234 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.234 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.234 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.234 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.234 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.234 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.234 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.234 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.234 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.234 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.234 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.234 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "osd_support", 2024-04-01T07:05:58.234 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.235 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.235 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.235 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.235 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.235 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.235 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.235 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.235 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.235 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.235 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.235 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.235 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.235 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.235 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.236 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.236 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.236 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.236 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.236 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.236 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.236 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.236 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.236 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.236 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.236 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.236 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.236 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.236 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.236 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.237 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.237 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.237 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.237 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.237 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.237 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.237 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.237 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.237 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.237 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.237 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.237 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.237 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.237 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.237 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.238 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.238 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.238 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.238 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.238 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.238 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.238 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.238 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.238 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.238 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.238 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.238 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.238 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.238 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.239 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.239 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.239 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.239 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.239 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.239 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.239 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.239 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.239 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.239 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.239 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.239 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.239 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.239 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.239 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.240 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.240 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.240 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "pg_autoscaler", 2024-04-01T07:05:58.240 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.240 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.240 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.240 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.240 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.240 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.240 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.240 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.240 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.240 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.240 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.240 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.241 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.241 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.241 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.241 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.241 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.241 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.241 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.241 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.241 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.241 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.241 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.241 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.241 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.241 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.241 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.241 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.242 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.242 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.242 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.242 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.242 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.242 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.242 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.242 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.242 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.242 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.242 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.242 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.242 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.242 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.242 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.242 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.243 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.243 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.243 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.243 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.243 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.243 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.243 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.243 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.243 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.243 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.243 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.243 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.243 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.244 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.244 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.244 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.244 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.244 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.244 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.244 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.244 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.244 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.244 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.244 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.244 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.244 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.244 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.244 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.245 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.245 INFO:teuthology.orchestra.run.smithi083.stdout: "sleep_interval": { 2024-04-01T07:05:58.245 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sleep_interval", 2024-04-01T07:05:58.245 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:58.245 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.245 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.245 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "60", 2024-04-01T07:05:58.245 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.245 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.245 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.245 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.245 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.245 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.245 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.245 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.245 INFO:teuthology.orchestra.run.smithi083.stdout: "threshold": { 2024-04-01T07:05:58.246 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "threshold", 2024-04-01T07:05:58.246 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-04-01T07:05:58.246 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.246 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.246 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "3.0", 2024-04-01T07:05:58.246 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "1.0", 2024-04-01T07:05:58.246 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.246 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.246 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "scaling threshold", 2024-04-01T07:05:58.246 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-04-01T07:05:58.246 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.246 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.246 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.246 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.247 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.247 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.247 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "progress", 2024-04-01T07:05:58.247 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.247 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.247 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.247 INFO:teuthology.orchestra.run.smithi083.stdout: "allow_pg_recovery_event": { 2024-04-01T07:05:58.247 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "allow_pg_recovery_event", 2024-04-01T07:05:58.247 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.247 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.247 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.247 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.247 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.248 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.248 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.248 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "allow the module to show pg recovery progress", 2024-04-01T07:05:58.248 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.248 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.248 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.248 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.248 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": { 2024-04-01T07:05:58.248 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "enabled", 2024-04-01T07:05:58.248 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.248 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.248 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.248 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.248 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.248 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.248 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.249 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.249 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.249 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.249 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.249 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.249 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.249 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.249 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.249 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.249 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.249 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.249 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.249 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.249 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.249 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.249 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.250 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.250 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.250 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.250 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.250 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.250 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.250 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.250 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.250 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.250 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.250 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.250 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.250 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.250 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.250 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.250 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.251 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.251 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.251 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.251 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.251 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.251 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.251 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.251 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.251 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.251 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.251 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.251 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.251 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.251 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.251 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.251 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.251 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.252 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.252 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.252 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.252 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.252 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.252 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.252 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.252 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.252 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.252 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.252 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.252 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.252 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.252 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.252 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.253 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.253 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.253 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.253 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.253 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.253 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.253 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.253 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.253 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.253 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.253 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.253 INFO:teuthology.orchestra.run.smithi083.stdout: "max_completed_events": { 2024-04-01T07:05:58.253 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "max_completed_events", 2024-04-01T07:05:58.253 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.253 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.253 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.254 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "50", 2024-04-01T07:05:58.254 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.254 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.254 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.254 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "number of past completed events to remember", 2024-04-01T07:05:58.254 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.254 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.254 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.254 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.254 INFO:teuthology.orchestra.run.smithi083.stdout: "sleep_interval": { 2024-04-01T07:05:58.254 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sleep_interval", 2024-04-01T07:05:58.254 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:58.254 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.254 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.255 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "5", 2024-04-01T07:05:58.255 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.255 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.255 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.255 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how long the module is going to sleep", 2024-04-01T07:05:58.255 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.255 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.255 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.255 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.255 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.255 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.255 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.255 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "prometheus", 2024-04-01T07:05:58.255 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.255 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.255 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.256 INFO:teuthology.orchestra.run.smithi083.stdout: "cache": { 2024-04-01T07:05:58.256 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "cache", 2024-04-01T07:05:58.256 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.256 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.256 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.256 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.256 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.256 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.256 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.256 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.256 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.256 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.256 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.256 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.256 INFO:teuthology.orchestra.run.smithi083.stdout: "exclude_perf_counters": { 2024-04-01T07:05:58.256 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "exclude_perf_counters", 2024-04-01T07:05:58.256 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.257 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.257 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.257 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.257 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.257 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.257 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.257 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-04-01T07:05:58.257 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-04-01T07:05:58.257 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.257 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.257 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.257 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.257 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.257 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.258 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.258 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.258 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.258 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.258 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.258 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.258 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.258 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.258 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.258 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.258 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.258 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.258 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.258 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.259 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.259 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.259 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.259 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.259 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.259 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.259 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.259 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.259 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.259 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.259 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.259 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.259 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.259 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.259 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.259 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.260 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.260 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.260 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.260 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.260 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.260 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.260 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.260 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.260 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.260 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.260 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.260 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.260 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.261 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.261 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.261 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.261 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.261 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.261 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.261 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.261 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.261 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.261 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.261 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.261 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.261 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.261 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.261 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.261 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.262 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.262 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.262 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.262 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.262 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.262 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.262 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.262 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.262 INFO:teuthology.orchestra.run.smithi083.stdout: "rbd_stats_pools": { 2024-04-01T07:05:58.262 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rbd_stats_pools", 2024-04-01T07:05:58.262 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.262 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.262 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.263 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.263 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.263 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.263 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.263 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.263 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.263 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.263 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.263 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.263 INFO:teuthology.orchestra.run.smithi083.stdout: "rbd_stats_pools_refresh_interval": { 2024-04-01T07:05:58.263 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-04-01T07:05:58.263 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.263 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.263 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.263 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "300", 2024-04-01T07:05:58.263 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.264 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.264 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.264 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.264 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.264 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.264 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.264 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.264 INFO:teuthology.orchestra.run.smithi083.stdout: "scrape_interval": { 2024-04-01T07:05:58.264 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "scrape_interval", 2024-04-01T07:05:58.264 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-04-01T07:05:58.264 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.264 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.264 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "15.0", 2024-04-01T07:05:58.264 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.264 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.264 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.265 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.265 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.265 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.265 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.265 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.265 INFO:teuthology.orchestra.run.smithi083.stdout: "server_addr": { 2024-04-01T07:05:58.265 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "server_addr", 2024-04-01T07:05:58.265 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.265 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.265 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.265 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "::", 2024-04-01T07:05:58.265 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.265 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.265 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.265 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-04-01T07:05:58.265 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.266 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.266 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.266 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.266 INFO:teuthology.orchestra.run.smithi083.stdout: "server_port": { 2024-04-01T07:05:58.266 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "server_port", 2024-04-01T07:05:58.266 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.266 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.266 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.266 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "9283", 2024-04-01T07:05:58.266 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.266 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.266 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.266 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-04-01T07:05:58.266 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.266 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.267 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.267 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.267 INFO:teuthology.orchestra.run.smithi083.stdout: "stale_cache_strategy": { 2024-04-01T07:05:58.267 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "stale_cache_strategy", 2024-04-01T07:05:58.267 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.267 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.267 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.267 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "log", 2024-04-01T07:05:58.267 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.267 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.267 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.267 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.267 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.267 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.267 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.267 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.268 INFO:teuthology.orchestra.run.smithi083.stdout: "standby_behaviour": { 2024-04-01T07:05:58.268 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "standby_behaviour", 2024-04-01T07:05:58.268 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.268 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.268 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.268 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "default", 2024-04-01T07:05:58.268 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.268 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.268 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.268 INFO:teuthology.orchestra.run.smithi083.stdout: "default", 2024-04-01T07:05:58.268 INFO:teuthology.orchestra.run.smithi083.stdout: "error" 2024-04-01T07:05:58.268 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.268 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.268 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.268 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.269 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.269 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.269 INFO:teuthology.orchestra.run.smithi083.stdout: "standby_error_status_code": { 2024-04-01T07:05:58.269 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "standby_error_status_code", 2024-04-01T07:05:58.269 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.269 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.269 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.269 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "500", 2024-04-01T07:05:58.269 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "400", 2024-04-01T07:05:58.269 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "599", 2024-04-01T07:05:58.269 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.269 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.269 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.269 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.270 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.270 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.270 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.270 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.270 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.270 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rbd_support", 2024-04-01T07:05:58.270 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.270 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.270 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.270 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.270 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.270 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.270 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.270 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.271 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.271 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.271 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.271 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.271 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.271 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.271 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.271 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.271 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.271 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.271 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.271 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.271 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.271 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.272 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.272 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.272 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.272 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.272 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.272 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.272 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.272 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.272 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.272 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.272 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.272 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.272 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.273 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.273 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.273 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.273 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.273 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.273 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.273 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.273 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.273 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.273 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.273 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.274 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.274 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.274 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.274 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.274 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.274 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.274 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.274 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.274 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.274 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.274 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.274 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.274 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.275 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.275 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.275 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.275 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.275 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.275 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.275 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.275 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.275 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.275 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.275 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.275 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.275 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.275 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.276 INFO:teuthology.orchestra.run.smithi083.stdout: "max_concurrent_snap_create": { 2024-04-01T07:05:58.276 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "max_concurrent_snap_create", 2024-04-01T07:05:58.276 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.276 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.276 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.276 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-04-01T07:05:58.276 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.276 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.276 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.276 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.276 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.276 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.276 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.276 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.276 INFO:teuthology.orchestra.run.smithi083.stdout: "mirror_snapshot_schedule": { 2024-04-01T07:05:58.277 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "mirror_snapshot_schedule", 2024-04-01T07:05:58.277 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.277 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.277 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.277 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.277 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.277 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.277 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.277 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.277 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.277 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.277 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.278 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.278 INFO:teuthology.orchestra.run.smithi083.stdout: "trash_purge_schedule": { 2024-04-01T07:05:58.278 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "trash_purge_schedule", 2024-04-01T07:05:58.278 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.278 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.278 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.278 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.278 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.278 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.278 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.278 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.278 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.278 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.278 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.279 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.279 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.279 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.279 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.279 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "restful", 2024-04-01T07:05:58.279 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.279 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.279 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.279 INFO:teuthology.orchestra.run.smithi083.stdout: "enable_auth": { 2024-04-01T07:05:58.279 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "enable_auth", 2024-04-01T07:05:58.279 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.279 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.280 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.280 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.280 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.280 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.280 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.280 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.280 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.280 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.280 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.280 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.280 INFO:teuthology.orchestra.run.smithi083.stdout: "key_file": { 2024-04-01T07:05:58.280 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "key_file", 2024-04-01T07:05:58.280 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.281 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.281 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.281 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.281 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.281 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.281 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.281 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.281 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.281 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.281 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.281 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.281 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.281 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.282 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.282 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.282 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.282 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.282 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.282 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.282 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.282 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.282 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.282 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.282 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.282 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.283 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.283 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.283 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.283 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.283 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.283 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.283 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.283 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.283 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.283 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.283 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.283 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.283 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.283 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.284 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.284 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.284 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.284 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.284 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.284 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.284 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.284 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.284 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.284 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.284 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.284 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.284 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.285 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.285 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.285 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.285 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.285 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.285 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.285 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.285 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.285 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.285 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.285 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.285 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.285 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.285 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.285 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.285 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.286 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.286 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.286 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.286 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.286 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.286 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.286 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.286 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.286 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.286 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.286 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.286 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.286 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.286 INFO:teuthology.orchestra.run.smithi083.stdout: "server_addr": { 2024-04-01T07:05:58.287 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "server_addr", 2024-04-01T07:05:58.287 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.287 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.287 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.287 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.287 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.287 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.287 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.287 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.287 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.287 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.287 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.287 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.287 INFO:teuthology.orchestra.run.smithi083.stdout: "server_port": { 2024-04-01T07:05:58.287 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "server_port", 2024-04-01T07:05:58.288 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.288 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.288 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.288 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.288 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.288 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.288 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.288 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.288 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.288 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.288 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.288 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.288 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.288 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.289 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.289 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rgw", 2024-04-01T07:05:58.289 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.289 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.289 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.289 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.289 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.289 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.289 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.289 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.289 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.289 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.289 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.290 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.290 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.290 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.290 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.290 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.290 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.290 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.290 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.290 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.290 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.290 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.290 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.291 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.291 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.291 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.291 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.291 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.291 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.291 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.291 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.291 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.291 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.291 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.291 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.291 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.291 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.292 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.292 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.292 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.292 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.292 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.292 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.292 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.292 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.292 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.292 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.292 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.292 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.292 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.293 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.293 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.293 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.293 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.293 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.293 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.293 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.293 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.293 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.293 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.293 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.293 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.293 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.294 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.294 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.294 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.294 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.294 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.294 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.294 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.294 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.294 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.294 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.294 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.294 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.294 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.295 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rook", 2024-04-01T07:05:58.295 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.295 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.295 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.295 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.295 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.295 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.295 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.295 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.295 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.295 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.295 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.295 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.295 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.296 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.296 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.296 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.296 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.296 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.296 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.296 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.296 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.296 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.296 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.296 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.296 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.296 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.296 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.297 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.297 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.297 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.297 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.297 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.297 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.297 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.297 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.297 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.297 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.297 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.297 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.297 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.297 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.297 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.298 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.298 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.298 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.298 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.298 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.298 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.298 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.298 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.298 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.298 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.298 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.298 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.298 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.298 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.298 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.299 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.299 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.299 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.299 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.299 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.299 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.299 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.299 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.299 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.299 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.299 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.299 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.299 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.299 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.300 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.300 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.300 INFO:teuthology.orchestra.run.smithi083.stdout: "storage_class": { 2024-04-01T07:05:58.300 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "storage_class", 2024-04-01T07:05:58.300 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.300 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.300 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.300 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "local", 2024-04-01T07:05:58.300 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.300 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.300 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.300 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-04-01T07:05:58.300 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.300 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.301 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.301 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.301 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.301 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.301 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.301 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "selftest", 2024-04-01T07:05:58.301 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.301 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.301 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.301 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.301 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.301 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.301 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.301 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.302 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.302 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.302 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.302 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.302 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.302 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.302 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.302 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.302 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.302 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.302 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.302 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.302 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.302 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.303 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.303 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.303 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.303 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.303 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.303 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.303 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.303 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.303 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.303 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.303 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.303 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.303 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.303 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.303 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.304 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.304 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.304 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.304 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.304 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.304 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.304 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.304 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.304 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.304 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.304 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.304 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.304 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.304 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.304 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.305 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.305 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.305 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.305 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.305 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.305 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.305 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.305 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.305 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.305 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.305 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.305 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.305 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.305 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.306 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.306 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.306 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.306 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.306 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.306 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.306 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.306 INFO:teuthology.orchestra.run.smithi083.stdout: "roption1": { 2024-04-01T07:05:58.306 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "roption1", 2024-04-01T07:05:58.306 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.306 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.306 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.306 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.306 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.307 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.307 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.307 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.307 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.307 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.307 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.307 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.307 INFO:teuthology.orchestra.run.smithi083.stdout: "roption2": { 2024-04-01T07:05:58.307 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "roption2", 2024-04-01T07:05:58.307 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.307 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.307 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.307 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "xyz", 2024-04-01T07:05:58.308 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.308 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.308 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.308 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.308 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.308 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.308 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.308 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.308 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption1": { 2024-04-01T07:05:58.308 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption1", 2024-04-01T07:05:58.308 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.308 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.308 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.308 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.309 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.309 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.309 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.309 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.309 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.309 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.309 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.309 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.309 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption2": { 2024-04-01T07:05:58.309 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption2", 2024-04-01T07:05:58.309 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.309 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.309 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.309 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.310 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.310 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.310 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.310 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.310 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.310 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.310 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.310 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.310 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption3": { 2024-04-01T07:05:58.310 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption3", 2024-04-01T07:05:58.310 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-04-01T07:05:58.310 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.310 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.311 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.311 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.311 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.311 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.311 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.311 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.311 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.311 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.311 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.311 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption4": { 2024-04-01T07:05:58.311 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption4", 2024-04-01T07:05:58.311 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.311 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.311 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.311 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.312 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.312 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.312 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.312 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.312 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.312 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.312 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.312 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.312 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption5": { 2024-04-01T07:05:58.312 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption5", 2024-04-01T07:05:58.312 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.312 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.312 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.312 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.312 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.313 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.313 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.313 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.313 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.313 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.313 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.313 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.313 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption6": { 2024-04-01T07:05:58.313 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption6", 2024-04-01T07:05:58.313 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.313 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.313 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.313 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.313 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.313 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.314 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.314 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.314 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.314 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.314 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.314 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.314 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption7": { 2024-04-01T07:05:58.314 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption7", 2024-04-01T07:05:58.314 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.314 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.314 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.314 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.314 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "1", 2024-04-01T07:05:58.314 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "42", 2024-04-01T07:05:58.315 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.315 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.315 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.315 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.315 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.315 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.315 INFO:teuthology.orchestra.run.smithi083.stdout: "testkey": { 2024-04-01T07:05:58.315 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "testkey", 2024-04-01T07:05:58.315 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.315 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.315 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.315 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.315 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.315 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.315 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.316 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.316 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.316 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.316 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.316 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.316 INFO:teuthology.orchestra.run.smithi083.stdout: "testlkey": { 2024-04-01T07:05:58.316 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "testlkey", 2024-04-01T07:05:58.316 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.316 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.316 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.316 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.316 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.316 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.316 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.316 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.317 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.317 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.317 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.317 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.317 INFO:teuthology.orchestra.run.smithi083.stdout: "testnewline": { 2024-04-01T07:05:58.317 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "testnewline", 2024-04-01T07:05:58.317 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.317 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.317 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.317 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.317 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.317 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.317 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.317 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.317 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.318 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.318 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.318 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.318 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.318 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.318 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.318 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "snap_schedule", 2024-04-01T07:05:58.318 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.318 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.318 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.318 INFO:teuthology.orchestra.run.smithi083.stdout: "allow_m_granularity": { 2024-04-01T07:05:58.318 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "allow_m_granularity", 2024-04-01T07:05:58.318 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.319 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.319 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.319 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.319 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.319 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.319 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.319 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "allow minute scheduled snapshots", 2024-04-01T07:05:58.319 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.319 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.319 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.319 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.319 INFO:teuthology.orchestra.run.smithi083.stdout: "dump_on_update": { 2024-04-01T07:05:58.319 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "dump_on_update", 2024-04-01T07:05:58.319 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.319 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.320 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.320 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.320 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.320 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.320 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.320 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "dump database to debug log on update", 2024-04-01T07:05:58.320 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.320 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.320 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.320 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.320 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.320 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.320 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.320 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.320 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.321 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.321 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.321 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.321 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.321 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.321 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.321 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.321 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.321 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.321 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.321 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.321 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.321 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.321 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.321 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.321 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.322 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.322 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.322 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.322 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.322 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.322 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.322 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.322 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.322 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.322 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.322 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.322 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.322 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.322 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.323 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.323 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.323 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.323 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.323 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.323 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.323 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.323 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.323 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.323 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.323 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.323 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.323 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.324 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.324 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.324 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.324 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.324 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.324 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.324 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.324 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.324 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.324 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.324 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.324 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.324 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.324 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.324 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.325 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.325 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.325 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.325 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.325 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.325 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.325 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.325 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.325 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.325 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.325 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "stats", 2024-04-01T07:05:58.325 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.325 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.325 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.325 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.325 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.325 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.326 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.326 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.326 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.326 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.326 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.326 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.326 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.326 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.326 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.326 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.326 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.326 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.327 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.327 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.327 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.327 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.327 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.327 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.327 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.327 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.327 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.327 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.327 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.327 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.327 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.327 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.327 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.328 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.328 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.328 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.328 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.328 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.328 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.328 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.328 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.328 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.328 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.328 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.328 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.328 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.328 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.328 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.329 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.329 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.329 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.329 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.329 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.329 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.329 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.329 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.329 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.329 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.329 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.329 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.329 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.329 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.329 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.329 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.330 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.330 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.330 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.330 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.330 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.330 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.330 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.330 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.330 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.330 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.330 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.330 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.330 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "status", 2024-04-01T07:05:58.330 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.330 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.330 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.331 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.331 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.331 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.331 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.331 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.331 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.331 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.331 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.331 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.331 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.331 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.331 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.331 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.331 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.331 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.332 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.332 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.332 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.332 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.332 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.332 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.332 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.332 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.332 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.332 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.332 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.332 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.332 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.332 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.333 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.333 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.333 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.333 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.333 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.333 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.333 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.333 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.333 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.333 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.333 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.333 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.333 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.333 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.333 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.333 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.334 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.334 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.334 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.334 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.334 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.334 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.334 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.334 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.334 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.334 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.334 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.334 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.334 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.334 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.334 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.334 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.335 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.335 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.335 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.335 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.335 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.335 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.335 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.335 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.335 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.335 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.335 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.335 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.335 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "telegraf", 2024-04-01T07:05:58.335 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.335 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.335 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.336 INFO:teuthology.orchestra.run.smithi083.stdout: "address": { 2024-04-01T07:05:58.336 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "address", 2024-04-01T07:05:58.336 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.336 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.336 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.336 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-04-01T07:05:58.336 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.336 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.336 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.336 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.336 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.336 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.336 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.336 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.336 INFO:teuthology.orchestra.run.smithi083.stdout: "interval": { 2024-04-01T07:05:58.336 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "interval", 2024-04-01T07:05:58.336 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:58.337 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.337 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.337 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "15", 2024-04-01T07:05:58.337 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.337 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.337 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.337 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.337 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.337 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.337 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.337 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.337 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.337 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.337 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.337 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.337 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.337 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.338 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.338 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.338 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.338 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.338 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.338 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.338 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.338 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.338 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.338 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.338 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.338 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.338 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.338 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.338 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.339 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.339 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.339 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.339 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.339 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.339 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.339 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.339 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.339 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.339 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.339 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.339 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.339 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.339 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.339 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.340 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.340 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.340 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.340 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.340 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.340 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.340 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.340 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.340 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.340 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.340 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.340 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.340 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.340 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.340 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.341 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.341 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.341 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.341 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.341 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.341 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.341 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.341 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.341 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.341 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.341 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.341 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.341 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.342 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.342 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.342 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.342 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.342 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.342 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.342 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.342 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.342 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.342 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "telemetry", 2024-04-01T07:05:58.342 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.342 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.342 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.342 INFO:teuthology.orchestra.run.smithi083.stdout: "channel_basic": { 2024-04-01T07:05:58.342 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "channel_basic", 2024-04-01T07:05:58.342 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.343 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.343 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.343 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.343 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.343 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.343 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.343 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Share basic cluster information (size, version)", 2024-04-01T07:05:58.343 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.343 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.343 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.343 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.343 INFO:teuthology.orchestra.run.smithi083.stdout: "channel_crash": { 2024-04-01T07:05:58.343 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "channel_crash", 2024-04-01T07:05:58.344 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.344 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.344 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.344 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.344 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.344 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.344 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.344 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-04-01T07:05:58.344 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.344 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.344 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.344 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.344 INFO:teuthology.orchestra.run.smithi083.stdout: "channel_device": { 2024-04-01T07:05:58.344 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "channel_device", 2024-04-01T07:05:58.344 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.345 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.345 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.345 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.345 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.345 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.345 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.345 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-04-01T07:05:58.345 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.345 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.345 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.345 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.345 INFO:teuthology.orchestra.run.smithi083.stdout: "channel_ident": { 2024-04-01T07:05:58.345 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "channel_ident", 2024-04-01T07:05:58.345 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.346 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.346 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.346 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.346 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.346 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.346 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.346 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-04-01T07:05:58.346 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.346 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.346 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.346 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.346 INFO:teuthology.orchestra.run.smithi083.stdout: "channel_perf": { 2024-04-01T07:05:58.346 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "channel_perf", 2024-04-01T07:05:58.346 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.346 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.347 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.347 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.347 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.347 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.347 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.347 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Share various performance metrics of a cluster", 2024-04-01T07:05:58.347 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.347 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.347 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.347 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.347 INFO:teuthology.orchestra.run.smithi083.stdout: "contact": { 2024-04-01T07:05:58.347 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "contact", 2024-04-01T07:05:58.347 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.347 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.347 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.348 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.348 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.348 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.348 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.348 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.348 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.348 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.348 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.348 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.348 INFO:teuthology.orchestra.run.smithi083.stdout: "description": { 2024-04-01T07:05:58.348 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "description", 2024-04-01T07:05:58.348 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.348 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.348 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.348 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.349 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.349 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.349 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.349 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.349 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.349 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.349 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.349 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.349 INFO:teuthology.orchestra.run.smithi083.stdout: "device_url": { 2024-04-01T07:05:58.349 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "device_url", 2024-04-01T07:05:58.349 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.349 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.349 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.349 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-04-01T07:05:58.349 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.349 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.350 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.350 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.350 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.350 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.350 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.350 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.350 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": { 2024-04-01T07:05:58.350 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "enabled", 2024-04-01T07:05:58.350 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.350 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.350 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.350 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.350 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.350 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.350 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.350 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.350 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.351 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.351 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.351 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.351 INFO:teuthology.orchestra.run.smithi083.stdout: "interval": { 2024-04-01T07:05:58.351 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "interval", 2024-04-01T07:05:58.351 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.351 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.351 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.351 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "24", 2024-04-01T07:05:58.351 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "8", 2024-04-01T07:05:58.351 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.351 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.351 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.351 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.351 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.351 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.352 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.352 INFO:teuthology.orchestra.run.smithi083.stdout: "last_opt_revision": { 2024-04-01T07:05:58.352 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "last_opt_revision", 2024-04-01T07:05:58.352 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.352 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.352 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.352 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "1", 2024-04-01T07:05:58.352 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.352 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.352 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.352 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.352 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.352 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.352 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.353 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.353 INFO:teuthology.orchestra.run.smithi083.stdout: "leaderboard": { 2024-04-01T07:05:58.353 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "leaderboard", 2024-04-01T07:05:58.353 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.353 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.353 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.353 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.353 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.353 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.353 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.353 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.353 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.353 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.353 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.353 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.354 INFO:teuthology.orchestra.run.smithi083.stdout: "leaderboard_description": { 2024-04-01T07:05:58.354 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "leaderboard_description", 2024-04-01T07:05:58.354 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.354 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.354 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.354 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.354 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.354 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.354 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.354 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.354 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.354 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.354 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.354 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.354 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.355 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.355 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.355 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.355 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.355 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.355 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.355 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.355 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.355 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.355 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.355 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.355 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.355 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.355 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.355 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.355 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.356 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.356 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.356 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.356 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.356 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.356 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.356 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.356 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.356 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.356 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.356 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.356 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.356 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.356 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.356 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.357 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.357 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.357 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.357 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.357 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.357 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.357 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.357 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.357 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.357 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.357 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.357 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.357 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.358 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.358 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.358 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.358 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.358 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.358 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.358 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.358 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.358 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.358 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.358 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.358 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.358 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.358 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.358 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.359 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.359 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.359 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.359 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.359 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.359 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.359 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.359 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.359 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.359 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.359 INFO:teuthology.orchestra.run.smithi083.stdout: "organization": { 2024-04-01T07:05:58.359 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "organization", 2024-04-01T07:05:58.359 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.359 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.359 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.360 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.360 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.360 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.360 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.360 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.360 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.360 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.360 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.360 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.360 INFO:teuthology.orchestra.run.smithi083.stdout: "proxy": { 2024-04-01T07:05:58.360 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "proxy", 2024-04-01T07:05:58.360 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.360 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.360 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.361 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.361 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.361 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.361 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.361 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.361 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.361 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.361 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.361 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.361 INFO:teuthology.orchestra.run.smithi083.stdout: "url": { 2024-04-01T07:05:58.361 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "url", 2024-04-01T07:05:58.361 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.361 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.361 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.361 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-04-01T07:05:58.361 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.362 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.362 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.362 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.362 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.362 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.362 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.362 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.362 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.362 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.362 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.362 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "test_orchestrator", 2024-04-01T07:05:58.362 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.362 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.362 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.363 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.363 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.363 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.363 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.363 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.363 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.363 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.363 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.363 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.363 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.363 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.363 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.363 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.363 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.363 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.363 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.363 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.364 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.364 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.364 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.364 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.364 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.364 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.364 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.364 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.364 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.364 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.364 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.364 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.364 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.364 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.364 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.364 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.365 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.365 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.365 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.365 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.365 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.365 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.365 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.365 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.365 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.365 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.365 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.365 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.365 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.365 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.365 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.365 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.366 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.366 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.366 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.366 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.366 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.366 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.366 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.366 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.366 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.366 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.366 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.366 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.366 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.366 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.366 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.367 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.367 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.367 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.367 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.367 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.367 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.367 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.367 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.367 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.367 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "volumes", 2024-04-01T07:05:58.367 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.367 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.367 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.367 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.367 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.367 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.368 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.368 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.368 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.368 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.368 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.368 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.368 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.368 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.368 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.368 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.368 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.368 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.368 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.368 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.368 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.368 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.369 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.369 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.369 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.369 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.369 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.369 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.369 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.369 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.369 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.369 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.369 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.369 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.369 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.369 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.369 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.370 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.370 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.370 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.370 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.370 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.370 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.370 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.370 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.370 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.370 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.370 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.370 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.370 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.371 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.371 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.371 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.371 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.371 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.371 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.371 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.371 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.371 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.371 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.371 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.371 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.371 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.371 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.371 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.371 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.372 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.372 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.372 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.372 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.372 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.372 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.372 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.372 INFO:teuthology.orchestra.run.smithi083.stdout: "max_concurrent_clones": { 2024-04-01T07:05:58.372 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "max_concurrent_clones", 2024-04-01T07:05:58.372 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.372 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.372 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.372 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "4", 2024-04-01T07:05:58.372 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.372 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.373 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.373 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Number of asynchronous cloner threads", 2024-04-01T07:05:58.373 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.373 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.373 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.373 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.373 INFO:teuthology.orchestra.run.smithi083.stdout: "snapshot_clone_delay": { 2024-04-01T07:05:58.373 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "snapshot_clone_delay", 2024-04-01T07:05:58.373 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.373 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.373 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.373 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-04-01T07:05:58.373 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.374 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.374 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.374 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-04-01T07:05:58.374 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.374 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.374 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.374 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.374 INFO:teuthology.orchestra.run.smithi083.stdout: "snapshot_clone_no_wait": { 2024-04-01T07:05:58.374 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "snapshot_clone_no_wait", 2024-04-01T07:05:58.374 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.374 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.374 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.374 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.374 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.375 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.375 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.375 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-04-01T07:05:58.375 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.375 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.375 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.375 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.375 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.375 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.375 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.375 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "zabbix", 2024-04-01T07:05:58.375 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.375 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.375 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.376 INFO:teuthology.orchestra.run.smithi083.stdout: "discovery_interval": { 2024-04-01T07:05:58.376 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "discovery_interval", 2024-04-01T07:05:58.376 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "uint", 2024-04-01T07:05:58.376 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.376 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.376 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "100", 2024-04-01T07:05:58.376 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.376 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.376 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.376 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.376 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.376 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.376 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.376 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.376 INFO:teuthology.orchestra.run.smithi083.stdout: "identifier": { 2024-04-01T07:05:58.377 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "identifier", 2024-04-01T07:05:58.377 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.377 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.377 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.377 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.377 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.377 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.377 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.377 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.377 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.377 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.377 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.377 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.378 INFO:teuthology.orchestra.run.smithi083.stdout: "interval": { 2024-04-01T07:05:58.378 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "interval", 2024-04-01T07:05:58.378 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:58.378 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.378 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.378 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "60", 2024-04-01T07:05:58.378 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.378 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.378 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.378 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.378 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.378 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.378 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.378 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.378 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.379 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.379 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.379 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.379 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.379 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.379 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.379 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.379 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.379 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.379 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.379 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.379 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.379 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.379 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.379 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.379 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.380 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.380 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.380 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.380 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.380 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.380 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.380 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.380 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.380 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.380 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.380 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.380 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.380 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.380 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.380 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.380 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.381 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.381 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.381 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.381 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.381 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.381 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.381 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.381 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.381 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.381 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.381 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.381 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.381 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.381 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.381 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.382 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.382 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.382 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.382 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.382 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.382 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.382 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.382 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.382 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.382 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.382 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.382 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.382 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.382 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.382 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.383 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.383 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.383 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.383 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.383 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.383 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.383 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.383 INFO:teuthology.orchestra.run.smithi083.stdout: "zabbix_host": { 2024-04-01T07:05:58.383 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "zabbix_host", 2024-04-01T07:05:58.383 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.383 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.383 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.383 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.383 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.383 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.383 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.384 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.384 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.384 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.384 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.384 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.384 INFO:teuthology.orchestra.run.smithi083.stdout: "zabbix_port": { 2024-04-01T07:05:58.384 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "zabbix_port", 2024-04-01T07:05:58.384 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.384 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.384 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.384 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10051", 2024-04-01T07:05:58.384 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.384 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.384 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.384 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.384 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.385 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.385 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.385 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.385 INFO:teuthology.orchestra.run.smithi083.stdout: "zabbix_sender": { 2024-04-01T07:05:58.385 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "zabbix_sender", 2024-04-01T07:05:58.385 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.385 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.385 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.385 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-04-01T07:05:58.385 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.385 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.385 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.385 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.385 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.385 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.385 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.386 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.386 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.386 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.386 INFO:teuthology.orchestra.run.smithi083.stdout: ] 2024-04-01T07:05:58.386 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.386 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.386 INFO:teuthology.orchestra.run.smithi083.stdout: "gid": 24986, 2024-04-01T07:05:58.386 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "y", 2024-04-01T07:05:58.386 INFO:teuthology.orchestra.run.smithi083.stdout: "mgr_features": 4540138322906710015, 2024-04-01T07:05:58.386 INFO:teuthology.orchestra.run.smithi083.stdout: "available_modules": [ 2024-04-01T07:05:58.386 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.386 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "alerts", 2024-04-01T07:05:58.386 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.386 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.386 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.386 INFO:teuthology.orchestra.run.smithi083.stdout: "interval": { 2024-04-01T07:05:58.387 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "interval", 2024-04-01T07:05:58.387 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:58.387 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.387 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.387 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "60", 2024-04-01T07:05:58.387 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.387 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.387 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.387 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "How frequently to reexamine health status", 2024-04-01T07:05:58.387 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.387 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.387 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.387 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.387 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.387 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.387 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.388 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.388 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.388 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.388 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.388 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.388 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.388 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.388 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.388 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.388 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.388 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.388 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.388 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.388 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.388 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.388 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.389 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.389 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.389 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.389 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.389 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.389 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.389 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.389 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.389 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.389 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.389 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.389 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.389 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.389 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.389 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.390 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.390 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.390 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.390 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.390 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.390 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.390 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.390 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.390 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.390 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.390 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.390 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.390 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.390 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.390 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.390 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.391 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.391 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.391 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.391 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.391 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.391 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.391 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.391 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.391 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.391 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.391 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.391 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.391 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.391 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.391 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.392 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.392 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.392 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.392 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.392 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.392 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_destination": { 2024-04-01T07:05:58.392 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_destination", 2024-04-01T07:05:58.392 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.392 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.392 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.392 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.392 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.392 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.392 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.392 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Email address to send alerts to", 2024-04-01T07:05:58.392 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.393 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.393 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.393 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.393 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_from_name": { 2024-04-01T07:05:58.393 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_from_name", 2024-04-01T07:05:58.393 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.393 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.393 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.393 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "Ceph", 2024-04-01T07:05:58.393 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.393 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.393 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.393 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Email From: name", 2024-04-01T07:05:58.393 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.394 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.394 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.394 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.394 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_host": { 2024-04-01T07:05:58.394 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_host", 2024-04-01T07:05:58.394 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.394 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.394 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.394 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.394 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.394 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.395 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.395 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "SMTP server", 2024-04-01T07:05:58.395 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.395 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.395 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.395 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.395 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_password": { 2024-04-01T07:05:58.395 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_password", 2024-04-01T07:05:58.395 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.395 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.395 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.395 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.395 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.395 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.396 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.396 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Password to authenticate with", 2024-04-01T07:05:58.396 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.396 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.396 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.396 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.396 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_port": { 2024-04-01T07:05:58.396 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_port", 2024-04-01T07:05:58.396 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.396 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.396 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.396 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "465", 2024-04-01T07:05:58.396 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.396 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.397 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.397 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "SMTP port", 2024-04-01T07:05:58.397 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.397 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.397 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.397 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.397 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_sender": { 2024-04-01T07:05:58.397 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_sender", 2024-04-01T07:05:58.397 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.397 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.397 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.397 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.397 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.397 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.398 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.398 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "SMTP envelope sender", 2024-04-01T07:05:58.398 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.398 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.398 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.398 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.398 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_ssl": { 2024-04-01T07:05:58.398 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_ssl", 2024-04-01T07:05:58.398 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.398 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.398 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.398 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.398 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.398 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.399 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.399 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Use SSL to connect to SMTP server", 2024-04-01T07:05:58.399 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.399 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.399 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.399 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.399 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_user": { 2024-04-01T07:05:58.399 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_user", 2024-04-01T07:05:58.399 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.399 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.399 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.399 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.399 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.400 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.400 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.400 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "User to authenticate as", 2024-04-01T07:05:58.400 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.400 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.400 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.400 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.400 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.400 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.400 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.400 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "balancer", 2024-04-01T07:05:58.400 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.400 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.400 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.401 INFO:teuthology.orchestra.run.smithi083.stdout: "active": { 2024-04-01T07:05:58.401 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "active", 2024-04-01T07:05:58.401 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.401 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.401 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.401 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.401 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.401 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.401 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.401 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "automatically balance PGs across cluster", 2024-04-01T07:05:58.401 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.401 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.401 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.402 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.402 INFO:teuthology.orchestra.run.smithi083.stdout: "begin_time": { 2024-04-01T07:05:58.402 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "begin_time", 2024-04-01T07:05:58.402 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.402 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.402 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.402 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0000", 2024-04-01T07:05:58.402 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.402 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.402 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.402 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "beginning time of day to automatically balance", 2024-04-01T07:05:58.402 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-01T07:05:58.402 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.402 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.402 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.403 INFO:teuthology.orchestra.run.smithi083.stdout: "begin_weekday": { 2024-04-01T07:05:58.403 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "begin_weekday", 2024-04-01T07:05:58.403 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "uint", 2024-04-01T07:05:58.403 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.403 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.403 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-04-01T07:05:58.403 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "0", 2024-04-01T07:05:58.403 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "6", 2024-04-01T07:05:58.403 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.403 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-04-01T07:05:58.403 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-01T07:05:58.403 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.403 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.403 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.404 INFO:teuthology.orchestra.run.smithi083.stdout: "crush_compat_max_iterations": { 2024-04-01T07:05:58.404 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "crush_compat_max_iterations", 2024-04-01T07:05:58.404 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "uint", 2024-04-01T07:05:58.404 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.404 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.404 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "25", 2024-04-01T07:05:58.404 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "1", 2024-04-01T07:05:58.404 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "250", 2024-04-01T07:05:58.404 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.404 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-04-01T07:05:58.404 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.404 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.404 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.404 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.404 INFO:teuthology.orchestra.run.smithi083.stdout: "crush_compat_metrics": { 2024-04-01T07:05:58.405 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "crush_compat_metrics", 2024-04-01T07:05:58.405 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.405 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.405 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.405 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "pgs,objects,bytes", 2024-04-01T07:05:58.405 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.405 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.405 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.405 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-04-01T07:05:58.405 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-04-01T07:05:58.405 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.405 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.405 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.405 INFO:teuthology.orchestra.run.smithi083.stdout: "crush_compat_step": { 2024-04-01T07:05:58.405 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "crush_compat_step", 2024-04-01T07:05:58.405 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-04-01T07:05:58.406 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.406 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.406 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0.5", 2024-04-01T07:05:58.406 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "0.001", 2024-04-01T07:05:58.406 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "0.999", 2024-04-01T07:05:58.406 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.406 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "aggressiveness of optimization", 2024-04-01T07:05:58.406 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-04-01T07:05:58.406 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.406 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.406 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.406 INFO:teuthology.orchestra.run.smithi083.stdout: "end_time": { 2024-04-01T07:05:58.406 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "end_time", 2024-04-01T07:05:58.406 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.407 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.407 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.407 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "2359", 2024-04-01T07:05:58.407 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.407 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.407 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.407 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "ending time of day to automatically balance", 2024-04-01T07:05:58.407 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-01T07:05:58.407 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.407 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.407 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.407 INFO:teuthology.orchestra.run.smithi083.stdout: "end_weekday": { 2024-04-01T07:05:58.407 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "end_weekday", 2024-04-01T07:05:58.407 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "uint", 2024-04-01T07:05:58.407 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.407 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.408 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-04-01T07:05:58.408 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "0", 2024-04-01T07:05:58.408 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "6", 2024-04-01T07:05:58.408 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.408 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-04-01T07:05:58.408 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-01T07:05:58.408 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.408 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.408 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.408 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.408 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.408 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.408 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.408 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.408 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.409 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.409 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.409 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.409 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.409 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.409 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.409 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.409 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.409 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.409 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.409 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.409 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.409 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.409 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.409 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.409 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.410 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.410 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.410 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.410 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.410 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.410 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.410 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.410 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.410 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.410 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.410 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.410 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.410 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.410 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.410 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.411 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.411 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.411 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.411 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.411 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.411 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.411 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.411 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.411 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.411 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.411 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.411 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.411 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.411 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.412 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.412 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.412 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.412 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.412 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.412 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.412 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.412 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.412 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.412 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.412 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.412 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.412 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.412 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.412 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.413 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.413 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.413 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.413 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.413 INFO:teuthology.orchestra.run.smithi083.stdout: "min_score": { 2024-04-01T07:05:58.413 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "min_score", 2024-04-01T07:05:58.413 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-04-01T07:05:58.413 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.413 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.413 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-04-01T07:05:58.413 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.413 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.413 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.413 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-04-01T07:05:58.413 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.414 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.414 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.414 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.414 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": { 2024-04-01T07:05:58.414 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "mode", 2024-04-01T07:05:58.414 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.414 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.414 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.414 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "upmap", 2024-04-01T07:05:58.414 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.414 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.414 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.414 INFO:teuthology.orchestra.run.smithi083.stdout: "crush-compat", 2024-04-01T07:05:58.415 INFO:teuthology.orchestra.run.smithi083.stdout: "none", 2024-04-01T07:05:58.415 INFO:teuthology.orchestra.run.smithi083.stdout: "upmap" 2024-04-01T07:05:58.415 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.415 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Balancer mode", 2024-04-01T07:05:58.415 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.415 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.415 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.415 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.415 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_ids": { 2024-04-01T07:05:58.415 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "pool_ids", 2024-04-01T07:05:58.415 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.415 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.415 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.415 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.415 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.416 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.416 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.416 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-04-01T07:05:58.416 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.416 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.416 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.416 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.416 INFO:teuthology.orchestra.run.smithi083.stdout: "sleep_interval": { 2024-04-01T07:05:58.416 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sleep_interval", 2024-04-01T07:05:58.416 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:58.416 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.416 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.416 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "60", 2024-04-01T07:05:58.416 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.416 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.417 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.417 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-04-01T07:05:58.417 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.417 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.417 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.417 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.417 INFO:teuthology.orchestra.run.smithi083.stdout: "upmap_max_deviation": { 2024-04-01T07:05:58.417 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "upmap_max_deviation", 2024-04-01T07:05:58.417 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.417 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.417 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.417 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "5", 2024-04-01T07:05:58.417 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "1", 2024-04-01T07:05:58.417 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.417 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.417 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "deviation below which no optimization is attempted", 2024-04-01T07:05:58.418 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-04-01T07:05:58.418 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.418 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.418 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.418 INFO:teuthology.orchestra.run.smithi083.stdout: "upmap_max_optimizations": { 2024-04-01T07:05:58.418 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "upmap_max_optimizations", 2024-04-01T07:05:58.418 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "uint", 2024-04-01T07:05:58.418 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.418 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.418 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-04-01T07:05:58.418 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.418 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.418 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.418 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-04-01T07:05:58.419 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.419 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.419 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.419 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.419 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.419 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.419 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.419 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "cephadm", 2024-04-01T07:05:58.419 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.419 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.419 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.419 INFO:teuthology.orchestra.run.smithi083.stdout: "agent_down_multiplier": { 2024-04-01T07:05:58.419 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "agent_down_multiplier", 2024-04-01T07:05:58.419 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-04-01T07:05:58.419 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.419 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.420 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "3.0", 2024-04-01T07:05:58.420 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.420 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.420 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.420 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-04-01T07:05:58.420 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.420 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.420 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.420 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.420 INFO:teuthology.orchestra.run.smithi083.stdout: "agent_refresh_rate": { 2024-04-01T07:05:58.420 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "agent_refresh_rate", 2024-04-01T07:05:58.420 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:58.420 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.420 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.420 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "20", 2024-04-01T07:05:58.421 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.421 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.421 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.421 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-04-01T07:05:58.421 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.421 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.421 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.421 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.421 INFO:teuthology.orchestra.run.smithi083.stdout: "agent_starting_port": { 2024-04-01T07:05:58.421 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "agent_starting_port", 2024-04-01T07:05:58.421 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.421 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.421 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.421 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "4721", 2024-04-01T07:05:58.421 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.422 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.422 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.422 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-04-01T07:05:58.422 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.422 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.422 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.422 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.422 INFO:teuthology.orchestra.run.smithi083.stdout: "allow_ptrace": { 2024-04-01T07:05:58.422 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "allow_ptrace", 2024-04-01T07:05:58.422 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.422 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.422 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.422 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.423 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.423 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.423 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.423 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-04-01T07:05:58.423 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-04-01T07:05:58.423 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.423 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.423 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.423 INFO:teuthology.orchestra.run.smithi083.stdout: "autotune_interval": { 2024-04-01T07:05:58.423 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "autotune_interval", 2024-04-01T07:05:58.423 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:58.423 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.423 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.423 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "600", 2024-04-01T07:05:58.424 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.424 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.424 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.424 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how frequently to autotune daemon memory", 2024-04-01T07:05:58.424 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.424 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.424 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.424 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.424 INFO:teuthology.orchestra.run.smithi083.stdout: "autotune_memory_target_ratio": { 2024-04-01T07:05:58.424 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "autotune_memory_target_ratio", 2024-04-01T07:05:58.424 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-04-01T07:05:58.424 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.424 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.424 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0.7", 2024-04-01T07:05:58.424 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.425 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.425 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.425 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-04-01T07:05:58.425 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.425 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.425 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.425 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.425 INFO:teuthology.orchestra.run.smithi083.stdout: "cgroups_split": { 2024-04-01T07:05:58.425 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "cgroups_split", 2024-04-01T07:05:58.425 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.425 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.425 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.425 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.425 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.425 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.425 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.426 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-04-01T07:05:58.426 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.426 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.426 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.426 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.426 INFO:teuthology.orchestra.run.smithi083.stdout: "config_checks_enabled": { 2024-04-01T07:05:58.426 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "config_checks_enabled", 2024-04-01T07:05:58.426 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.426 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.426 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.426 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.426 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.426 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.426 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.426 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-04-01T07:05:58.427 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.427 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.427 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.427 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.427 INFO:teuthology.orchestra.run.smithi083.stdout: "config_dashboard": { 2024-04-01T07:05:58.427 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "config_dashboard", 2024-04-01T07:05:58.427 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.427 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.427 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.427 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.427 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.427 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.427 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.427 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-04-01T07:05:58.427 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.427 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.428 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.428 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.428 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_alertmanager": { 2024-04-01T07:05:58.428 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_alertmanager", 2024-04-01T07:05:58.428 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.428 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.428 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.428 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-04-01T07:05:58.428 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.428 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.428 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.428 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Prometheus container image", 2024-04-01T07:05:58.428 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.428 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.428 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.428 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.429 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_base": { 2024-04-01T07:05:58.429 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_base", 2024-04-01T07:05:58.429 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.429 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.429 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.429 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/ceph/ceph", 2024-04-01T07:05:58.429 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.429 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.429 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.429 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Container image name, without the tag", 2024-04-01T07:05:58.429 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.429 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.429 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.429 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.429 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_elasticsearch": { 2024-04-01T07:05:58.429 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_elasticsearch", 2024-04-01T07:05:58.430 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.430 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.430 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.430 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-04-01T07:05:58.430 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.430 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.430 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.430 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "elasticsearch container image", 2024-04-01T07:05:58.430 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.430 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.430 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.430 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.430 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_grafana": { 2024-04-01T07:05:58.430 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_grafana", 2024-04-01T07:05:58.431 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.431 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.431 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.431 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2024-04-01T07:05:58.431 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.431 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.431 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.431 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Prometheus container image", 2024-04-01T07:05:58.431 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.431 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.431 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.431 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.431 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_haproxy": { 2024-04-01T07:05:58.431 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_haproxy", 2024-04-01T07:05:58.431 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.432 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.432 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.432 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-04-01T07:05:58.432 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.432 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.432 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.432 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "HAproxy container image", 2024-04-01T07:05:58.432 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.432 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.432 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.432 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.432 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_jaeger_agent": { 2024-04-01T07:05:58.432 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_jaeger_agent", 2024-04-01T07:05:58.432 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.433 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.433 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.433 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-04-01T07:05:58.433 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.433 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.433 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.433 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Jaeger agent container image", 2024-04-01T07:05:58.433 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.433 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.433 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.433 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.433 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_jaeger_collector": { 2024-04-01T07:05:58.433 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_jaeger_collector", 2024-04-01T07:05:58.433 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.434 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.434 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.434 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-04-01T07:05:58.434 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.434 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.434 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.434 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Jaeger collector container image", 2024-04-01T07:05:58.434 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.434 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.434 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.434 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.434 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_jaeger_query": { 2024-04-01T07:05:58.434 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_jaeger_query", 2024-04-01T07:05:58.434 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.435 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.435 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.435 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-04-01T07:05:58.435 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.435 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.435 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.435 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Jaeger query container image", 2024-04-01T07:05:58.435 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.435 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.435 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.435 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.435 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_keepalived": { 2024-04-01T07:05:58.435 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_keepalived", 2024-04-01T07:05:58.435 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.435 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.436 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.436 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-04-01T07:05:58.436 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.436 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.436 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.436 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Keepalived container image", 2024-04-01T07:05:58.436 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.436 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.436 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.436 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.436 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_loki": { 2024-04-01T07:05:58.436 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_loki", 2024-04-01T07:05:58.436 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.436 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.436 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.437 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-04-01T07:05:58.437 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.437 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.437 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.437 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Loki container image", 2024-04-01T07:05:58.437 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.437 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.437 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.437 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.437 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_node_exporter": { 2024-04-01T07:05:58.437 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_node_exporter", 2024-04-01T07:05:58.437 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.437 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.438 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.438 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-04-01T07:05:58.438 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.438 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.438 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.438 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Prometheus container image", 2024-04-01T07:05:58.438 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.438 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.438 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.438 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.438 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_nvmeof": { 2024-04-01T07:05:58.438 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_nvmeof", 2024-04-01T07:05:58.438 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.439 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.439 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.439 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/ceph/nvmeof:1.0.0", 2024-04-01T07:05:58.439 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.439 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.439 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.439 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Nvme-of container image", 2024-04-01T07:05:58.439 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.439 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.439 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.439 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.439 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_prometheus": { 2024-04-01T07:05:58.439 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_prometheus", 2024-04-01T07:05:58.440 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.440 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.440 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.440 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-04-01T07:05:58.440 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.440 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.440 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.440 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Prometheus container image", 2024-04-01T07:05:58.440 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.440 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.440 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.440 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.440 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_promtail": { 2024-04-01T07:05:58.440 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_promtail", 2024-04-01T07:05:58.441 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.441 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.441 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.441 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-04-01T07:05:58.441 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.441 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.441 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.441 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Promtail container image", 2024-04-01T07:05:58.441 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.441 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.441 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.441 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.441 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_snmp_gateway": { 2024-04-01T07:05:58.441 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_snmp_gateway", 2024-04-01T07:05:58.441 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.442 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.442 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.442 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-04-01T07:05:58.442 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.442 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.442 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.442 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "SNMP Gateway container image", 2024-04-01T07:05:58.442 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.442 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.442 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.442 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.442 INFO:teuthology.orchestra.run.smithi083.stdout: "container_init": { 2024-04-01T07:05:58.442 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_init", 2024-04-01T07:05:58.442 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.443 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.443 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.443 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.443 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.443 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.443 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.443 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Run podman/docker with `--init`", 2024-04-01T07:05:58.443 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.443 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.443 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.443 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.443 INFO:teuthology.orchestra.run.smithi083.stdout: "daemon_cache_timeout": { 2024-04-01T07:05:58.443 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "daemon_cache_timeout", 2024-04-01T07:05:58.443 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:58.444 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.444 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.444 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "600", 2024-04-01T07:05:58.444 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.444 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.444 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.444 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-04-01T07:05:58.444 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.444 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.444 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.444 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.444 INFO:teuthology.orchestra.run.smithi083.stdout: "default_cephadm_command_timeout": { 2024-04-01T07:05:58.444 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "default_cephadm_command_timeout", 2024-04-01T07:05:58.444 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.444 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.445 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.445 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "900", 2024-04-01T07:05:58.445 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.445 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.445 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.445 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-04-01T07:05:58.445 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.445 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.445 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.445 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.445 INFO:teuthology.orchestra.run.smithi083.stdout: "default_registry": { 2024-04-01T07:05:58.445 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "default_registry", 2024-04-01T07:05:58.445 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.445 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.445 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.445 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "docker.io", 2024-04-01T07:05:58.446 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.446 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.446 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.446 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-04-01T07:05:58.446 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.446 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.446 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.446 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.446 INFO:teuthology.orchestra.run.smithi083.stdout: "device_cache_timeout": { 2024-04-01T07:05:58.446 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "device_cache_timeout", 2024-04-01T07:05:58.446 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:58.446 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.446 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.446 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "1800", 2024-04-01T07:05:58.446 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.446 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.447 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.447 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "seconds to cache device inventory", 2024-04-01T07:05:58.447 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.447 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.447 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.447 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.447 INFO:teuthology.orchestra.run.smithi083.stdout: "device_enhanced_scan": { 2024-04-01T07:05:58.447 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "device_enhanced_scan", 2024-04-01T07:05:58.447 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.447 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.447 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.447 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.447 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.447 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.447 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.447 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Use libstoragemgmt during device scans", 2024-04-01T07:05:58.448 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.448 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.448 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.448 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.448 INFO:teuthology.orchestra.run.smithi083.stdout: "facts_cache_timeout": { 2024-04-01T07:05:58.448 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "facts_cache_timeout", 2024-04-01T07:05:58.448 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:58.448 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.448 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.448 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "60", 2024-04-01T07:05:58.448 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.448 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.448 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.448 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "seconds to cache host facts data", 2024-04-01T07:05:58.448 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.449 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.449 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.449 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.449 INFO:teuthology.orchestra.run.smithi083.stdout: "host_check_interval": { 2024-04-01T07:05:58.449 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "host_check_interval", 2024-04-01T07:05:58.449 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:58.449 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.449 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.449 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "600", 2024-04-01T07:05:58.449 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.449 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.449 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.449 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how frequently to perform a host check", 2024-04-01T07:05:58.449 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.450 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.450 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.450 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.450 INFO:teuthology.orchestra.run.smithi083.stdout: "hw_monitoring": { 2024-04-01T07:05:58.450 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "hw_monitoring", 2024-04-01T07:05:58.450 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.450 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.450 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.450 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.450 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.450 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.450 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.450 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-04-01T07:05:58.450 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.451 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.451 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.451 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.451 INFO:teuthology.orchestra.run.smithi083.stdout: "inventory_list_all": { 2024-04-01T07:05:58.451 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "inventory_list_all", 2024-04-01T07:05:58.451 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.451 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.451 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.451 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.451 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.451 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.451 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.451 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-04-01T07:05:58.451 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.451 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.451 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.452 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.452 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.452 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.452 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.452 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.452 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.452 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.452 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.452 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.452 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.452 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.452 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.452 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.452 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.453 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.453 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.453 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.453 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.453 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.453 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.453 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.453 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.453 INFO:teuthology.orchestra.run.smithi083.stdout: "log_refresh_metadata": { 2024-04-01T07:05:58.453 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_refresh_metadata", 2024-04-01T07:05:58.453 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.453 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.453 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.453 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.454 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.454 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.454 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.454 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-04-01T07:05:58.454 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.454 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.454 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.454 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.454 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.454 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.454 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.454 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.454 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.454 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.454 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.455 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.455 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.455 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-04-01T07:05:58.455 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.455 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.455 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.455 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.455 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.455 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.455 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.455 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.455 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.455 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.455 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.455 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.455 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.455 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.456 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.456 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.456 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.456 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.456 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.456 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.456 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.456 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.456 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.456 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.456 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.456 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.456 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.456 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.456 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.456 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.457 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.457 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.457 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.457 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.457 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.457 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.457 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.457 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.457 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.457 INFO:teuthology.orchestra.run.smithi083.stdout: "manage_etc_ceph_ceph_conf": { 2024-04-01T07:05:58.457 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-04-01T07:05:58.457 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.457 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.457 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.457 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.458 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.458 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.458 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.458 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-04-01T07:05:58.458 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.458 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.458 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.458 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.458 INFO:teuthology.orchestra.run.smithi083.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-04-01T07:05:58.458 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-04-01T07:05:58.458 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.458 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.458 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.458 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "*", 2024-04-01T07:05:58.458 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.458 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.459 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.459 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-04-01T07:05:58.459 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.459 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.459 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.459 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.459 INFO:teuthology.orchestra.run.smithi083.stdout: "max_count_per_host": { 2024-04-01T07:05:58.459 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "max_count_per_host", 2024-04-01T07:05:58.459 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.459 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.459 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.459 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-04-01T07:05:58.459 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.459 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.459 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.459 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "max number of daemons per service per host", 2024-04-01T07:05:58.459 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.460 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.460 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.460 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.460 INFO:teuthology.orchestra.run.smithi083.stdout: "max_osd_draining_count": { 2024-04-01T07:05:58.460 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "max_osd_draining_count", 2024-04-01T07:05:58.460 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.460 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.460 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.460 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-04-01T07:05:58.460 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.460 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.460 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.460 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-04-01T07:05:58.460 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.460 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.461 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.461 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.461 INFO:teuthology.orchestra.run.smithi083.stdout: "migration_current": { 2024-04-01T07:05:58.461 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "migration_current", 2024-04-01T07:05:58.461 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.461 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.461 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.461 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.461 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.461 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.461 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.461 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "internal - do not modify", 2024-04-01T07:05:58.461 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.461 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.461 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.461 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.462 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": { 2024-04-01T07:05:58.462 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "mode", 2024-04-01T07:05:58.462 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.462 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.462 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.462 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "root", 2024-04-01T07:05:58.462 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.462 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.462 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.462 INFO:teuthology.orchestra.run.smithi083.stdout: "cephadm-package", 2024-04-01T07:05:58.462 INFO:teuthology.orchestra.run.smithi083.stdout: "root" 2024-04-01T07:05:58.462 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.462 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "mode for remote execution of cephadm", 2024-04-01T07:05:58.462 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.462 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.463 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.463 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.463 INFO:teuthology.orchestra.run.smithi083.stdout: "oob_default_addr": { 2024-04-01T07:05:58.463 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "oob_default_addr", 2024-04-01T07:05:58.463 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.463 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.463 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.463 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "169.254.1.1", 2024-04-01T07:05:58.463 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.463 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.463 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.463 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Default address for RedFish API (oob management).", 2024-04-01T07:05:58.463 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.463 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.464 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.464 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.464 INFO:teuthology.orchestra.run.smithi083.stdout: "prometheus_alerts_path": { 2024-04-01T07:05:58.464 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "prometheus_alerts_path", 2024-04-01T07:05:58.464 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.464 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.464 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.464 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-04-01T07:05:58.464 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.464 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.464 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.464 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-04-01T07:05:58.464 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.464 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.464 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.464 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.465 INFO:teuthology.orchestra.run.smithi083.stdout: "registry_insecure": { 2024-04-01T07:05:58.465 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "registry_insecure", 2024-04-01T07:05:58.465 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.465 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.465 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.465 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.465 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.465 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.465 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.465 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-04-01T07:05:58.465 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.465 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.465 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.465 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.465 INFO:teuthology.orchestra.run.smithi083.stdout: "registry_password": { 2024-04-01T07:05:58.465 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "registry_password", 2024-04-01T07:05:58.466 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.466 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.466 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.466 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.466 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.466 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.466 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.466 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-04-01T07:05:58.466 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.466 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.466 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.466 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.466 INFO:teuthology.orchestra.run.smithi083.stdout: "registry_url": { 2024-04-01T07:05:58.466 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "registry_url", 2024-04-01T07:05:58.466 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.466 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.467 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.467 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.467 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.467 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.467 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.467 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-04-01T07:05:58.467 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.467 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.467 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.467 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.467 INFO:teuthology.orchestra.run.smithi083.stdout: "registry_username": { 2024-04-01T07:05:58.467 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "registry_username", 2024-04-01T07:05:58.467 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.467 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.467 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.467 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.468 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.468 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.468 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.468 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-04-01T07:05:58.468 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.468 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.468 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.468 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.468 INFO:teuthology.orchestra.run.smithi083.stdout: "secure_monitoring_stack": { 2024-04-01T07:05:58.468 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "secure_monitoring_stack", 2024-04-01T07:05:58.468 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.468 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.468 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.468 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.469 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.469 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.469 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.469 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-04-01T07:05:58.469 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.469 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.469 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.469 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.469 INFO:teuthology.orchestra.run.smithi083.stdout: "service_discovery_port": { 2024-04-01T07:05:58.469 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "service_discovery_port", 2024-04-01T07:05:58.469 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.469 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.469 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.469 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "8765", 2024-04-01T07:05:58.470 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.470 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.470 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.470 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "cephadm service discovery port", 2024-04-01T07:05:58.470 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.470 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.470 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.470 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.470 INFO:teuthology.orchestra.run.smithi083.stdout: "ssh_config_file": { 2024-04-01T07:05:58.470 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ssh_config_file", 2024-04-01T07:05:58.470 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.470 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.470 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.471 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.471 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.471 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.471 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.471 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-04-01T07:05:58.471 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.471 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.471 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.471 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.471 INFO:teuthology.orchestra.run.smithi083.stdout: "use_agent": { 2024-04-01T07:05:58.471 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "use_agent", 2024-04-01T07:05:58.471 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.471 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.471 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.471 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.471 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.471 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.472 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.472 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-04-01T07:05:58.472 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.472 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.472 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.472 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.472 INFO:teuthology.orchestra.run.smithi083.stdout: "use_repo_digest": { 2024-04-01T07:05:58.472 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "use_repo_digest", 2024-04-01T07:05:58.472 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.472 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.472 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.472 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.472 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.473 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.473 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.473 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-04-01T07:05:58.473 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.473 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.473 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.473 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.473 INFO:teuthology.orchestra.run.smithi083.stdout: "warn_on_failed_host_check": { 2024-04-01T07:05:58.473 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "warn_on_failed_host_check", 2024-04-01T07:05:58.473 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.473 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.473 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.473 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.473 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.474 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.474 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.474 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "raise a health warning if the host check fails", 2024-04-01T07:05:58.474 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.474 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.474 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.474 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.474 INFO:teuthology.orchestra.run.smithi083.stdout: "warn_on_stray_daemons": { 2024-04-01T07:05:58.474 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "warn_on_stray_daemons", 2024-04-01T07:05:58.474 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.474 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.474 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.474 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.474 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.475 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.475 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.475 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-04-01T07:05:58.475 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.475 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.475 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.475 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.475 INFO:teuthology.orchestra.run.smithi083.stdout: "warn_on_stray_hosts": { 2024-04-01T07:05:58.475 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "warn_on_stray_hosts", 2024-04-01T07:05:58.475 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.475 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.475 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.475 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.475 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.475 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.475 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.476 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-04-01T07:05:58.476 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.476 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.476 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.476 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.476 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.476 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.476 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.476 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "crash", 2024-04-01T07:05:58.476 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.476 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.476 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.476 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.476 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.476 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.476 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.477 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.477 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.477 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.477 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.477 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.477 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.477 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.477 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.477 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.477 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.477 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.477 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.477 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.478 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.478 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.478 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.478 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.478 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.478 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.478 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.478 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.478 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.478 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.478 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.478 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.478 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.478 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.479 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.479 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.479 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.479 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.479 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.479 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.479 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.479 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.479 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.479 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.479 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.479 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.479 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.479 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.479 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.479 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.480 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.480 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.480 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.480 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.480 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.480 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.480 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.480 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.480 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.480 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.480 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.480 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.480 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.480 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.480 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.481 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.481 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.481 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.481 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.481 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.481 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.481 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.481 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.481 INFO:teuthology.orchestra.run.smithi083.stdout: "retain_interval": { 2024-04-01T07:05:58.481 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "retain_interval", 2024-04-01T07:05:58.481 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:58.481 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.481 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.481 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "31536000", 2024-04-01T07:05:58.481 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.481 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.481 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.482 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how long to retain crashes before pruning them", 2024-04-01T07:05:58.482 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.482 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.482 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.482 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.482 INFO:teuthology.orchestra.run.smithi083.stdout: "warn_recent_interval": { 2024-04-01T07:05:58.482 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "warn_recent_interval", 2024-04-01T07:05:58.482 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:58.482 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.482 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.482 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "1209600", 2024-04-01T07:05:58.482 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.482 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.482 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.482 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "time interval in which to warn about recent crashes", 2024-04-01T07:05:58.483 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.483 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.483 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.483 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.483 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.483 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.483 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.483 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "dashboard", 2024-04-01T07:05:58.483 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.483 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.483 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.483 INFO:teuthology.orchestra.run.smithi083.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-04-01T07:05:58.483 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-04-01T07:05:58.483 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.484 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.484 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.484 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-04-01T07:05:58.484 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.484 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.484 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.484 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.484 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.484 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.484 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.484 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.484 INFO:teuthology.orchestra.run.smithi083.stdout: "ALERTMANAGER_API_HOST": { 2024-04-01T07:05:58.484 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ALERTMANAGER_API_HOST", 2024-04-01T07:05:58.484 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.484 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.485 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.485 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.485 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.485 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.485 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.485 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.485 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.485 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.485 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.485 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.485 INFO:teuthology.orchestra.run.smithi083.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-04-01T07:05:58.485 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-04-01T07:05:58.485 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.485 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.485 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.486 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.486 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.486 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.486 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.486 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.486 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.486 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.486 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.486 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.486 INFO:teuthology.orchestra.run.smithi083.stdout: "AUDIT_API_ENABLED": { 2024-04-01T07:05:58.486 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "AUDIT_API_ENABLED", 2024-04-01T07:05:58.486 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.486 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.487 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.487 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.487 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.487 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.487 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.487 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.487 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.487 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.487 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.487 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.487 INFO:teuthology.orchestra.run.smithi083.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-04-01T07:05:58.487 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-04-01T07:05:58.487 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.487 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.487 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.488 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.488 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.488 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.488 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.488 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.488 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.488 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.488 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.488 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.488 INFO:teuthology.orchestra.run.smithi083.stdout: "ENABLE_BROWSABLE_API": { 2024-04-01T07:05:58.488 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ENABLE_BROWSABLE_API", 2024-04-01T07:05:58.488 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.488 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.488 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.489 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.489 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.489 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.489 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.489 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.489 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.489 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.489 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.489 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.489 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-04-01T07:05:58.489 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-04-01T07:05:58.489 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.489 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.490 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.490 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.490 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.490 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.490 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.490 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.490 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.490 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.490 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.490 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.490 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-04-01T07:05:58.490 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-04-01T07:05:58.490 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.490 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.491 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.491 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.491 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.491 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.491 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.491 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.491 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.491 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.491 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.491 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.491 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-04-01T07:05:58.491 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-04-01T07:05:58.491 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.491 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.492 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.492 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.492 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.492 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.492 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.492 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.492 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.492 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.492 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.492 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.492 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-04-01T07:05:58.492 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-04-01T07:05:58.492 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.492 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.493 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.493 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.493 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.493 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.493 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.493 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.493 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.493 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.493 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.493 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.493 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_NFS": { 2024-04-01T07:05:58.493 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-04-01T07:05:58.493 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.493 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.494 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.494 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.494 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.494 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.494 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.494 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.494 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.494 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.494 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.494 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.494 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_RBD": { 2024-04-01T07:05:58.494 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-04-01T07:05:58.494 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.494 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.495 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.495 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.495 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.495 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.495 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.495 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.495 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.495 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.495 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.495 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.495 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_RGW": { 2024-04-01T07:05:58.495 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-04-01T07:05:58.495 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.495 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.495 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.496 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.496 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.496 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.496 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.496 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.496 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.496 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.496 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.496 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.496 INFO:teuthology.orchestra.run.smithi083.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-04-01T07:05:58.496 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-04-01T07:05:58.496 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.496 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.496 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.496 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.496 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.497 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.497 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.497 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.497 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.497 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.497 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.497 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.497 INFO:teuthology.orchestra.run.smithi083.stdout: "GRAFANA_API_PASSWORD": { 2024-04-01T07:05:58.497 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GRAFANA_API_PASSWORD", 2024-04-01T07:05:58.497 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.497 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.497 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.497 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "admin", 2024-04-01T07:05:58.498 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.498 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.498 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.498 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.498 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.498 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.498 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.498 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.498 INFO:teuthology.orchestra.run.smithi083.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-04-01T07:05:58.498 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-04-01T07:05:58.498 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.498 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.498 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.498 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.499 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.499 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.499 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.499 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.499 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.499 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.499 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.499 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.499 INFO:teuthology.orchestra.run.smithi083.stdout: "GRAFANA_API_URL": { 2024-04-01T07:05:58.499 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GRAFANA_API_URL", 2024-04-01T07:05:58.499 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.499 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.499 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.499 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.499 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.500 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.500 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.500 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.500 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.500 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.500 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.500 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.500 INFO:teuthology.orchestra.run.smithi083.stdout: "GRAFANA_API_USERNAME": { 2024-04-01T07:05:58.500 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GRAFANA_API_USERNAME", 2024-04-01T07:05:58.500 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.500 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.500 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.500 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "admin", 2024-04-01T07:05:58.500 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.501 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.501 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.501 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.501 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.501 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.501 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.501 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.501 INFO:teuthology.orchestra.run.smithi083.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-04-01T07:05:58.501 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-04-01T07:05:58.501 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.501 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.501 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.501 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.501 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.502 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.502 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.502 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.502 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.502 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.502 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.502 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.502 INFO:teuthology.orchestra.run.smithi083.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-04-01T07:05:58.502 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-04-01T07:05:58.502 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.502 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.502 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.502 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.502 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.503 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.503 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.503 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.503 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.503 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.503 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.503 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.503 INFO:teuthology.orchestra.run.smithi083.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-04-01T07:05:58.503 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-04-01T07:05:58.503 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.503 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.503 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.503 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.503 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.504 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.504 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.504 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.504 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.504 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.504 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.504 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.504 INFO:teuthology.orchestra.run.smithi083.stdout: "ISSUE_TRACKER_API_KEY": { 2024-04-01T07:05:58.504 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-04-01T07:05:58.504 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.504 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.504 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.504 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.504 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.505 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.505 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.505 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.505 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.505 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.505 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.505 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.505 INFO:teuthology.orchestra.run.smithi083.stdout: "PROMETHEUS_API_HOST": { 2024-04-01T07:05:58.505 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PROMETHEUS_API_HOST", 2024-04-01T07:05:58.505 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.505 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.505 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.505 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.505 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.506 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.506 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.506 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.506 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.506 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.506 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.506 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.506 INFO:teuthology.orchestra.run.smithi083.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-04-01T07:05:58.506 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-04-01T07:05:58.506 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.506 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.506 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.506 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.507 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.507 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.507 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.507 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.507 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.507 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.507 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.507 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.507 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-04-01T07:05:58.507 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-04-01T07:05:58.507 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.507 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.507 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.507 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.508 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.508 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.508 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.508 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.508 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.508 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.508 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.508 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.508 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-04-01T07:05:58.508 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-04-01T07:05:58.508 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.508 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.508 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.508 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.509 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.509 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.509 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.509 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.509 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.509 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.509 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.509 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.509 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-04-01T07:05:58.509 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-04-01T07:05:58.509 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.509 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.509 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.509 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.509 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.510 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.510 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.510 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.510 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.510 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.510 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.510 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.510 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-04-01T07:05:58.510 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-04-01T07:05:58.510 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.510 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.510 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.510 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.510 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.511 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.511 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.511 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.511 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.511 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.511 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.511 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.511 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-04-01T07:05:58.511 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-04-01T07:05:58.511 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.511 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.511 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.511 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.511 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.512 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.512 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.512 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.512 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.512 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.512 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.512 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.512 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-04-01T07:05:58.512 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-04-01T07:05:58.512 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.512 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.512 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.512 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.513 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.513 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.513 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.513 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.513 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.513 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.513 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.513 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.513 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-04-01T07:05:58.513 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-04-01T07:05:58.513 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.513 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.513 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.513 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.514 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.514 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.514 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.514 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.514 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.514 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.514 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.514 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.514 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_ENABLED": { 2024-04-01T07:05:58.514 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_ENABLED", 2024-04-01T07:05:58.514 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.514 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.514 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.515 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.515 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.515 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.515 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.515 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.515 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.515 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.515 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.515 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.515 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-04-01T07:05:58.515 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-04-01T07:05:58.515 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.515 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.515 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.515 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-04-01T07:05:58.516 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.516 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.516 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.516 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.516 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.516 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.516 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.516 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.516 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-04-01T07:05:58.516 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-04-01T07:05:58.516 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.516 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.516 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.516 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-04-01T07:05:58.516 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.517 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.517 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.517 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.517 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.517 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.517 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.517 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.517 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-04-01T07:05:58.517 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-04-01T07:05:58.517 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.517 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.517 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.517 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "8", 2024-04-01T07:05:58.517 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.517 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.518 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.518 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.518 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.518 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.518 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.518 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.518 INFO:teuthology.orchestra.run.smithi083.stdout: "REST_REQUESTS_TIMEOUT": { 2024-04-01T07:05:58.518 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-04-01T07:05:58.518 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.518 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.518 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.518 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "45", 2024-04-01T07:05:58.518 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.518 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.518 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.519 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.519 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.519 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.519 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.519 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.519 INFO:teuthology.orchestra.run.smithi083.stdout: "RGW_API_ACCESS_KEY": { 2024-04-01T07:05:58.519 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "RGW_API_ACCESS_KEY", 2024-04-01T07:05:58.519 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.519 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.519 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.519 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.519 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.519 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.519 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.519 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.520 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.520 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.520 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.520 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.520 INFO:teuthology.orchestra.run.smithi083.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-04-01T07:05:58.520 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-04-01T07:05:58.520 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.520 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.520 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.520 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "admin", 2024-04-01T07:05:58.520 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.520 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.520 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.520 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.520 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.521 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.521 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.521 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.521 INFO:teuthology.orchestra.run.smithi083.stdout: "RGW_API_SECRET_KEY": { 2024-04-01T07:05:58.521 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "RGW_API_SECRET_KEY", 2024-04-01T07:05:58.521 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.521 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.521 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.521 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.521 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.521 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.521 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.521 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.521 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.522 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.522 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.522 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.522 INFO:teuthology.orchestra.run.smithi083.stdout: "RGW_API_SSL_VERIFY": { 2024-04-01T07:05:58.522 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "RGW_API_SSL_VERIFY", 2024-04-01T07:05:58.522 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.522 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.522 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.522 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.522 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.522 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.522 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.522 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.523 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.523 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.523 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.523 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.523 INFO:teuthology.orchestra.run.smithi083.stdout: "UNSAFE_TLS_v1_2": { 2024-04-01T07:05:58.523 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "UNSAFE_TLS_v1_2", 2024-04-01T07:05:58.523 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.523 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.523 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.523 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.523 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.523 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.523 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.523 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.523 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.523 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.524 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.524 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.524 INFO:teuthology.orchestra.run.smithi083.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-04-01T07:05:58.524 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-04-01T07:05:58.524 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.524 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.524 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.524 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-04-01T07:05:58.524 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.524 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.524 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.524 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.524 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.525 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.525 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.525 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.525 INFO:teuthology.orchestra.run.smithi083.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-04-01T07:05:58.525 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-04-01T07:05:58.525 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.525 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.525 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.525 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-04-01T07:05:58.525 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.525 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.525 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.525 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.525 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.525 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.525 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.525 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.526 INFO:teuthology.orchestra.run.smithi083.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-04-01T07:05:58.526 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-04-01T07:05:58.526 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.526 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.526 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.526 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "5", 2024-04-01T07:05:58.526 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.526 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.526 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.526 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.526 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.526 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.526 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.526 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.526 INFO:teuthology.orchestra.run.smithi083.stdout: "cross_origin_url": { 2024-04-01T07:05:58.527 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "cross_origin_url", 2024-04-01T07:05:58.527 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.527 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.527 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.527 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.527 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.527 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.527 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.527 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.527 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.527 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.527 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.527 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.527 INFO:teuthology.orchestra.run.smithi083.stdout: "crt_file": { 2024-04-01T07:05:58.527 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "crt_file", 2024-04-01T07:05:58.528 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.528 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.528 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.528 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.528 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.528 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.528 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.528 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.528 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.528 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.528 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.528 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.528 INFO:teuthology.orchestra.run.smithi083.stdout: "debug": { 2024-04-01T07:05:58.528 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "debug", 2024-04-01T07:05:58.528 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.529 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.529 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.529 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.529 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.529 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.529 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.529 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Enable/disable debug options", 2024-04-01T07:05:58.529 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.529 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.529 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.529 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.529 INFO:teuthology.orchestra.run.smithi083.stdout: "jwt_token_ttl": { 2024-04-01T07:05:58.529 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "jwt_token_ttl", 2024-04-01T07:05:58.529 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.529 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.529 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.530 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "28800", 2024-04-01T07:05:58.530 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.530 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.530 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.530 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.530 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.530 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.530 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.530 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.530 INFO:teuthology.orchestra.run.smithi083.stdout: "key_file": { 2024-04-01T07:05:58.530 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "key_file", 2024-04-01T07:05:58.530 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.530 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.530 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.530 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.530 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.531 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.531 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.531 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.531 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.531 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.531 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.531 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.531 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.531 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.531 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.531 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.531 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.531 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.531 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.531 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.531 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.532 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.532 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.532 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.532 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.532 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.532 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.532 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.532 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.532 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.532 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.532 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.532 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.532 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.532 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.532 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.532 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.533 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.533 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.533 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.533 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.533 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.533 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.533 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.533 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.533 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.533 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.533 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.533 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.533 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.533 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.533 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.534 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.534 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.534 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.534 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.534 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.534 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.534 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.534 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.534 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.534 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.534 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.534 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.534 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.534 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.534 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.534 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.535 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.535 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.535 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.535 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.535 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.535 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.535 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.535 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.535 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.535 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.535 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.535 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.535 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.535 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.536 INFO:teuthology.orchestra.run.smithi083.stdout: "motd": { 2024-04-01T07:05:58.536 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "motd", 2024-04-01T07:05:58.536 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.536 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.536 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.536 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.536 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.536 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.536 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.536 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "The message of the day", 2024-04-01T07:05:58.536 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.536 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.536 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.536 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.536 INFO:teuthology.orchestra.run.smithi083.stdout: "redirect_resolve_ip_addr": { 2024-04-01T07:05:58.536 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "redirect_resolve_ip_addr", 2024-04-01T07:05:58.537 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.537 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.537 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.537 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.537 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.537 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.537 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.537 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.537 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.537 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.537 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.537 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.537 INFO:teuthology.orchestra.run.smithi083.stdout: "server_addr": { 2024-04-01T07:05:58.537 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "server_addr", 2024-04-01T07:05:58.537 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.538 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.538 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.538 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "::", 2024-04-01T07:05:58.538 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.538 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.538 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.538 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.538 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.538 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.538 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.538 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.538 INFO:teuthology.orchestra.run.smithi083.stdout: "server_port": { 2024-04-01T07:05:58.538 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "server_port", 2024-04-01T07:05:58.538 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.538 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.538 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.539 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "8080", 2024-04-01T07:05:58.539 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.539 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.539 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.539 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.539 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.539 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.539 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.539 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.539 INFO:teuthology.orchestra.run.smithi083.stdout: "ssl": { 2024-04-01T07:05:58.539 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ssl", 2024-04-01T07:05:58.539 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.539 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.539 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.540 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.540 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.540 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.540 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.540 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.540 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.540 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.540 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.540 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.540 INFO:teuthology.orchestra.run.smithi083.stdout: "ssl_server_port": { 2024-04-01T07:05:58.540 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ssl_server_port", 2024-04-01T07:05:58.540 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.540 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.540 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.541 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "8443", 2024-04-01T07:05:58.541 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.541 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.541 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.541 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.541 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.541 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.541 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.541 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.541 INFO:teuthology.orchestra.run.smithi083.stdout: "standby_behaviour": { 2024-04-01T07:05:58.541 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "standby_behaviour", 2024-04-01T07:05:58.541 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.541 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.541 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.542 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "redirect", 2024-04-01T07:05:58.542 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.542 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.542 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.542 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.542 INFO:teuthology.orchestra.run.smithi083.stdout: "redirect" 2024-04-01T07:05:58.542 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.542 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.542 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.542 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.542 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.542 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.542 INFO:teuthology.orchestra.run.smithi083.stdout: "standby_error_status_code": { 2024-04-01T07:05:58.542 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "standby_error_status_code", 2024-04-01T07:05:58.543 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.543 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.543 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.543 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "500", 2024-04-01T07:05:58.543 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "400", 2024-04-01T07:05:58.543 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "599", 2024-04-01T07:05:58.543 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.543 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.543 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.543 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.543 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.543 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.543 INFO:teuthology.orchestra.run.smithi083.stdout: "url_prefix": { 2024-04-01T07:05:58.543 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "url_prefix", 2024-04-01T07:05:58.544 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.544 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.544 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.544 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.544 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.544 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.544 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.544 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.544 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.544 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.544 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.544 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.544 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.545 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.545 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.545 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "devicehealth", 2024-04-01T07:05:58.545 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.545 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.545 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.545 INFO:teuthology.orchestra.run.smithi083.stdout: "enable_monitoring": { 2024-04-01T07:05:58.545 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "enable_monitoring", 2024-04-01T07:05:58.545 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.545 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.545 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.545 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.545 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.545 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.545 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.546 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "monitor device health metrics", 2024-04-01T07:05:58.546 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.546 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.546 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.546 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.546 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.546 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.546 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.546 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.546 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.546 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.546 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.546 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.546 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.546 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.547 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.547 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.547 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.547 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.547 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.547 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.547 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.547 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.547 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.547 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.547 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.547 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.547 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.547 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.547 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.547 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.547 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.548 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.548 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.548 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.548 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.548 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.548 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.548 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.548 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.548 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.548 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.548 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.548 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.548 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.549 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.549 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.549 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.549 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.549 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.549 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.549 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.549 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.549 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.549 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.549 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.549 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.549 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.550 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.550 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.550 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.550 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.550 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.550 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.550 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.550 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.550 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.550 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.550 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.550 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.550 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.550 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.550 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.551 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.551 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.551 INFO:teuthology.orchestra.run.smithi083.stdout: "mark_out_threshold": { 2024-04-01T07:05:58.551 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "mark_out_threshold", 2024-04-01T07:05:58.551 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:58.551 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.551 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.551 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "2419200", 2024-04-01T07:05:58.551 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.551 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.551 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.551 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-04-01T07:05:58.551 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.551 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.551 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.551 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.552 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_name": { 2024-04-01T07:05:58.552 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "pool_name", 2024-04-01T07:05:58.552 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.552 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.552 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.552 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "device_health_metrics", 2024-04-01T07:05:58.552 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.552 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.552 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.552 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "name of pool in which to store device health metrics", 2024-04-01T07:05:58.552 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.552 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.552 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.552 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.552 INFO:teuthology.orchestra.run.smithi083.stdout: "retention_period": { 2024-04-01T07:05:58.552 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "retention_period", 2024-04-01T07:05:58.553 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:58.553 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.553 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.553 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "15552000", 2024-04-01T07:05:58.553 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.553 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.553 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.553 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how long to retain device health metrics", 2024-04-01T07:05:58.553 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.553 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.553 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.553 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.553 INFO:teuthology.orchestra.run.smithi083.stdout: "scrape_frequency": { 2024-04-01T07:05:58.553 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "scrape_frequency", 2024-04-01T07:05:58.553 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:58.554 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.554 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.554 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "86400", 2024-04-01T07:05:58.554 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.554 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.554 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.554 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how frequently to scrape device health metrics", 2024-04-01T07:05:58.554 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.554 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.554 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.554 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.554 INFO:teuthology.orchestra.run.smithi083.stdout: "self_heal": { 2024-04-01T07:05:58.554 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "self_heal", 2024-04-01T07:05:58.555 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.555 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.555 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.555 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.555 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.555 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.555 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.555 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-04-01T07:05:58.555 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.555 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.555 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.555 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.555 INFO:teuthology.orchestra.run.smithi083.stdout: "sleep_interval": { 2024-04-01T07:05:58.555 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sleep_interval", 2024-04-01T07:05:58.555 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:58.556 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.556 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.556 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "600", 2024-04-01T07:05:58.556 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.556 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.556 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.556 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how frequently to wake up and check device health", 2024-04-01T07:05:58.556 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.556 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.556 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.556 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.556 INFO:teuthology.orchestra.run.smithi083.stdout: "warn_threshold": { 2024-04-01T07:05:58.556 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "warn_threshold", 2024-04-01T07:05:58.556 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:58.556 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.557 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.557 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "7257600", 2024-04-01T07:05:58.557 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.557 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.557 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.557 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-04-01T07:05:58.557 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.557 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.557 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.557 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.557 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.557 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.557 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.557 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "diskprediction_local", 2024-04-01T07:05:58.557 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.557 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.557 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.558 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.558 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.558 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.558 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.558 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.558 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.558 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.558 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.558 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.558 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.558 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.558 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.558 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.559 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.559 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.559 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.559 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.559 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.559 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.559 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.559 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.559 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.559 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.559 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.559 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.559 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.559 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.559 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.559 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.560 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.560 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.560 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.560 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.560 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.560 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.560 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.560 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.560 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.560 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.560 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.560 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.561 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.561 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.561 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.561 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.561 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.561 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.561 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.561 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.561 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.561 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.561 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.561 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.561 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.561 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.562 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.562 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.562 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.562 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.562 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.562 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.562 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.562 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.562 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.562 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.562 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.562 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.562 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.563 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.563 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.563 INFO:teuthology.orchestra.run.smithi083.stdout: "predict_interval": { 2024-04-01T07:05:58.563 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "predict_interval", 2024-04-01T07:05:58.563 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.563 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.563 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.563 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "86400", 2024-04-01T07:05:58.563 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.563 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.563 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.563 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.563 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.563 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.564 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.564 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.564 INFO:teuthology.orchestra.run.smithi083.stdout: "predictor_model": { 2024-04-01T07:05:58.564 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "predictor_model", 2024-04-01T07:05:58.564 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.564 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.564 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.564 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "prophetstor", 2024-04-01T07:05:58.564 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.564 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.564 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.564 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.564 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.564 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.565 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.565 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.565 INFO:teuthology.orchestra.run.smithi083.stdout: "sleep_interval": { 2024-04-01T07:05:58.565 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sleep_interval", 2024-04-01T07:05:58.565 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.565 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.565 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.565 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "600", 2024-04-01T07:05:58.565 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.565 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.565 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.565 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.565 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.565 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.565 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.566 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.566 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.566 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.566 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.566 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "influx", 2024-04-01T07:05:58.566 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": false, 2024-04-01T07:05:58.566 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "influxdb python module not found", 2024-04-01T07:05:58.566 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.566 INFO:teuthology.orchestra.run.smithi083.stdout: "batch_size": { 2024-04-01T07:05:58.566 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "batch_size", 2024-04-01T07:05:58.566 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.566 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.566 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.566 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "5000", 2024-04-01T07:05:58.567 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.567 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.567 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.567 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-04-01T07:05:58.567 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.567 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.567 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.567 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.567 INFO:teuthology.orchestra.run.smithi083.stdout: "database": { 2024-04-01T07:05:58.567 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "database", 2024-04-01T07:05:58.567 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.567 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.567 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.567 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "ceph", 2024-04-01T07:05:58.567 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.568 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.568 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.568 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-04-01T07:05:58.568 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.568 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.568 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.568 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.568 INFO:teuthology.orchestra.run.smithi083.stdout: "hostname": { 2024-04-01T07:05:58.568 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "hostname", 2024-04-01T07:05:58.568 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.568 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.568 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.568 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.568 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.568 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.568 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.569 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "InfluxDB server hostname", 2024-04-01T07:05:58.569 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.569 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.569 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.569 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.569 INFO:teuthology.orchestra.run.smithi083.stdout: "interval": { 2024-04-01T07:05:58.569 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "interval", 2024-04-01T07:05:58.569 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:58.569 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.569 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.569 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "30", 2024-04-01T07:05:58.569 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "5", 2024-04-01T07:05:58.569 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.569 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.569 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-04-01T07:05:58.570 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.570 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.570 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.570 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.570 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.570 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.570 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.570 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.570 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.570 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.570 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.570 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.570 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.570 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.571 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.571 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.571 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.571 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.571 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.571 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.571 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.571 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.571 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.571 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.571 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.571 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.571 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.571 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.571 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.571 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.572 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.572 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.572 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.572 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.572 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.572 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.572 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.572 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.572 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.572 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.572 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.572 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.572 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.572 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.572 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.572 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.573 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.573 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.573 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.573 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.573 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.573 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.573 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.573 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.573 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.573 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.573 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.573 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.573 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.573 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.573 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.573 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.573 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.574 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.574 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.574 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.574 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.574 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.574 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.574 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.574 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.574 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.574 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.574 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.574 INFO:teuthology.orchestra.run.smithi083.stdout: "password": { 2024-04-01T07:05:58.574 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "password", 2024-04-01T07:05:58.574 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.575 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.575 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.575 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.575 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.575 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.575 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.575 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "password of InfluxDB server user", 2024-04-01T07:05:58.575 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.575 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.575 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.575 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.575 INFO:teuthology.orchestra.run.smithi083.stdout: "port": { 2024-04-01T07:05:58.575 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "port", 2024-04-01T07:05:58.575 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.575 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.576 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.576 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "8086", 2024-04-01T07:05:58.576 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.576 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.576 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.576 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "InfluxDB server port", 2024-04-01T07:05:58.576 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.576 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.576 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.576 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.576 INFO:teuthology.orchestra.run.smithi083.stdout: "ssl": { 2024-04-01T07:05:58.576 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ssl", 2024-04-01T07:05:58.576 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.577 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.577 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.577 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "false", 2024-04-01T07:05:58.577 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.577 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.577 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.577 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-04-01T07:05:58.577 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.577 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.577 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.577 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.577 INFO:teuthology.orchestra.run.smithi083.stdout: "threads": { 2024-04-01T07:05:58.577 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "threads", 2024-04-01T07:05:58.577 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.578 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.578 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.578 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "5", 2024-04-01T07:05:58.578 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "1", 2024-04-01T07:05:58.578 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "32", 2024-04-01T07:05:58.578 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.578 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-04-01T07:05:58.578 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.578 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.578 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.578 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.578 INFO:teuthology.orchestra.run.smithi083.stdout: "username": { 2024-04-01T07:05:58.578 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "username", 2024-04-01T07:05:58.578 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.578 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.579 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.579 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.579 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.579 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.579 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.579 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "username of InfluxDB server user", 2024-04-01T07:05:58.579 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.579 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.579 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.579 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.579 INFO:teuthology.orchestra.run.smithi083.stdout: "verify_ssl": { 2024-04-01T07:05:58.579 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "verify_ssl", 2024-04-01T07:05:58.579 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.579 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.579 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.579 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "true", 2024-04-01T07:05:58.580 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.580 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.580 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.580 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-04-01T07:05:58.580 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.580 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.580 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.580 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.580 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.580 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.580 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.580 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "insights", 2024-04-01T07:05:58.580 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.580 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.580 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.580 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.581 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.581 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.581 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.581 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.581 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.581 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.581 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.581 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.581 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.581 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.581 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.581 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.581 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.581 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.582 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.582 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.582 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.582 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.582 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.582 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.582 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.582 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.582 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.582 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.582 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.582 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.582 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.582 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.583 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.583 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.583 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.583 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.583 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.583 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.583 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.583 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.583 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.583 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.583 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.583 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.583 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.583 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.583 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.583 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.584 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.584 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.584 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.584 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.584 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.584 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.584 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.584 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.584 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.584 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.584 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.584 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.584 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.584 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.584 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.585 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.585 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.585 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.585 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.585 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.585 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.585 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.585 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.585 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.585 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.585 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.585 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.585 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.585 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "iostat", 2024-04-01T07:05:58.585 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.585 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.586 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.586 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.586 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.586 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.586 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.586 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.586 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.586 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.586 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.586 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.586 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.586 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.586 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.586 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.586 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.587 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.587 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.587 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.587 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.587 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.587 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.587 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.587 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.587 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.587 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.587 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.587 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.587 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.587 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.587 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.588 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.588 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.588 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.588 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.588 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.588 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.588 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.588 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.588 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.588 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.588 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.588 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.588 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.588 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.589 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.589 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.589 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.589 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.589 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.589 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.589 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.589 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.589 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.589 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.589 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.589 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.589 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.589 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.589 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.590 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.590 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.590 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.590 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.590 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.590 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.590 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.590 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.590 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.590 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.590 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.590 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.590 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.590 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.590 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.590 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "k8sevents", 2024-04-01T07:05:58.591 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.591 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.591 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.591 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_event_retention_days": { 2024-04-01T07:05:58.591 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ceph_event_retention_days", 2024-04-01T07:05:58.591 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.591 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.591 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.591 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "7", 2024-04-01T07:05:58.591 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.591 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.591 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.591 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Days to hold ceph event information within local cache", 2024-04-01T07:05:58.591 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.592 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.592 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.592 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.592 INFO:teuthology.orchestra.run.smithi083.stdout: "config_check_secs": { 2024-04-01T07:05:58.592 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "config_check_secs", 2024-04-01T07:05:58.592 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.592 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.592 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.592 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-04-01T07:05:58.592 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "10", 2024-04-01T07:05:58.592 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.592 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.592 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-04-01T07:05:58.592 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.593 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.593 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.593 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.593 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.593 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.593 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.593 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.593 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.593 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.593 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.593 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.593 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.593 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.594 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.594 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.594 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.594 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.594 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.594 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.594 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.594 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.594 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.594 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.594 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.594 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.594 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.595 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.595 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.595 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.595 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.595 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.595 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.595 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.595 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.595 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.595 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.595 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.595 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.595 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.595 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.596 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.596 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.596 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.596 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.596 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.596 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.596 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.596 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.596 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.596 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.596 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.596 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.596 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.596 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.597 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.597 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.597 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.597 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.597 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.597 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.597 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.597 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.597 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.597 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.597 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.597 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.597 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.597 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.597 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.598 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.598 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.598 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.598 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.598 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.598 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.598 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.598 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "localpool", 2024-04-01T07:05:58.598 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.598 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.598 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.598 INFO:teuthology.orchestra.run.smithi083.stdout: "failure_domain": { 2024-04-01T07:05:58.598 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "failure_domain", 2024-04-01T07:05:58.598 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.598 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.599 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.599 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "host", 2024-04-01T07:05:58.599 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.599 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.599 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.599 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "failure domain for any created local pool", 2024-04-01T07:05:58.599 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-04-01T07:05:58.599 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.599 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.599 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.599 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.599 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.599 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.599 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.599 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.599 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.599 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.600 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.600 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.600 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.600 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.600 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.600 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.600 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.600 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.600 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.600 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.600 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.600 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.600 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.600 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.600 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.601 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.601 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.601 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.601 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.601 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.601 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.601 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.601 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.601 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.601 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.601 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.601 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.601 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.602 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.602 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.602 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.602 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.602 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.602 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.602 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.602 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.602 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.602 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.602 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.602 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.602 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.602 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.603 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.603 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.603 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.603 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.603 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.603 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.603 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.603 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.603 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.603 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.603 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.603 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.603 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.603 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.603 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.604 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.604 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.604 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.604 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.604 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.604 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.604 INFO:teuthology.orchestra.run.smithi083.stdout: "min_size": { 2024-04-01T07:05:58.604 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "min_size", 2024-04-01T07:05:58.604 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.604 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.604 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.604 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.604 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.604 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.605 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.605 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "default min_size for any created local pool", 2024-04-01T07:05:58.605 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-04-01T07:05:58.605 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.605 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.605 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.605 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rep": { 2024-04-01T07:05:58.605 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "num_rep", 2024-04-01T07:05:58.605 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.605 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.605 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.605 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "3", 2024-04-01T07:05:58.606 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.606 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.606 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.606 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "default replica count for any created local pool", 2024-04-01T07:05:58.606 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.606 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.606 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.606 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.606 INFO:teuthology.orchestra.run.smithi083.stdout: "pg_num": { 2024-04-01T07:05:58.606 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "pg_num", 2024-04-01T07:05:58.606 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.606 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.606 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.606 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "128", 2024-04-01T07:05:58.607 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.607 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.607 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.607 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "default pg_num for any created local pool", 2024-04-01T07:05:58.607 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.607 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.607 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.607 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.607 INFO:teuthology.orchestra.run.smithi083.stdout: "prefix": { 2024-04-01T07:05:58.607 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "prefix", 2024-04-01T07:05:58.607 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.607 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.607 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.607 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.608 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.608 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.608 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.608 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "name prefix for any created local pool", 2024-04-01T07:05:58.608 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.608 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.608 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.608 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.608 INFO:teuthology.orchestra.run.smithi083.stdout: "subtree": { 2024-04-01T07:05:58.608 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "subtree", 2024-04-01T07:05:58.608 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.608 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.609 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.609 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "rack", 2024-04-01T07:05:58.609 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.609 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.609 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.609 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "CRUSH level for which to create a local pool", 2024-04-01T07:05:58.609 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-04-01T07:05:58.609 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.609 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.609 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.609 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.609 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.609 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.609 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "mds_autoscaler", 2024-04-01T07:05:58.610 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.610 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.610 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.610 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.610 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.610 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.610 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.610 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.610 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.610 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.610 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.610 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.610 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.610 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.610 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.611 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.611 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.611 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.611 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.611 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.611 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.611 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.611 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.611 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.611 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.611 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.611 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.611 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.611 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.612 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.612 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.612 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.612 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.612 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.612 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.612 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.612 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.612 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.612 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.612 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.612 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.612 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.612 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.612 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.613 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.613 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.613 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.613 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.613 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.613 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.613 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.613 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.613 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.613 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.614 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.614 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.614 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.614 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.614 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.614 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.614 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.614 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.614 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.614 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.614 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.614 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.614 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.615 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.615 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.615 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.615 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.615 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.615 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.615 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.615 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.615 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.617 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "mirroring", 2024-04-01T07:05:58.617 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.617 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.617 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.617 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.617 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.617 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.618 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.618 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.618 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.618 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.618 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.618 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.618 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.618 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.618 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.618 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.618 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.618 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.618 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.618 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.619 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.619 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.619 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.619 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.619 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.619 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.619 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.619 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.619 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.619 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.619 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.619 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.619 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.619 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.620 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.620 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.620 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.620 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.620 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.620 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.620 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.620 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.620 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.620 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.620 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.620 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.620 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.620 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.621 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.621 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.621 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.621 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.621 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.621 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.621 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.621 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.621 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.621 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.621 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.621 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.621 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.621 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.622 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.622 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.622 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.622 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.622 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.622 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.622 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.622 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.622 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.622 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.622 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.622 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.622 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.622 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.622 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "nfs", 2024-04-01T07:05:58.623 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.623 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.623 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.623 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.623 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.623 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.623 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.623 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.623 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.623 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.623 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.623 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.623 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.624 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.624 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.624 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.624 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.624 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.624 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.624 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.624 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.624 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.624 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.624 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.624 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.624 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.624 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.624 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.625 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.625 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.625 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.625 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.625 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.625 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.625 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.625 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.625 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.625 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.625 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.625 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.625 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.625 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.626 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.626 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.626 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.626 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.626 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.626 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.626 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.626 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.626 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.626 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.626 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.626 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.626 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.627 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.627 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.627 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.627 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.627 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.627 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.627 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.627 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.627 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.627 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.627 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.627 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.627 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.627 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.628 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.628 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.628 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.628 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.628 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.628 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.628 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.628 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "orchestrator", 2024-04-01T07:05:58.628 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.628 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.628 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.628 INFO:teuthology.orchestra.run.smithi083.stdout: "fail_fs": { 2024-04-01T07:05:58.628 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "fail_fs", 2024-04-01T07:05:58.628 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.628 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.628 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.629 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.629 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.629 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.629 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.629 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-04-01T07:05:58.629 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.629 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.629 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.629 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.629 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.629 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.629 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.629 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.629 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.630 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.630 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.630 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.630 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.630 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.630 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.630 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.630 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.630 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.630 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.630 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.630 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.630 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.630 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.631 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.631 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.631 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.631 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.631 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.631 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.631 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.631 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.631 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.631 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.631 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.631 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.631 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.631 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.631 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.632 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.632 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.632 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.632 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.632 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.632 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.632 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.632 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.632 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.632 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.632 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.632 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.632 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.632 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.633 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.633 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.633 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.633 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.633 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.633 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.633 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.633 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.633 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.633 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.633 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.633 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.633 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.633 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.633 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.634 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.634 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.634 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.634 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.634 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.634 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.634 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.634 INFO:teuthology.orchestra.run.smithi083.stdout: "orchestrator": { 2024-04-01T07:05:58.634 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "orchestrator", 2024-04-01T07:05:58.634 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.634 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.634 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.634 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.634 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.635 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.635 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.635 INFO:teuthology.orchestra.run.smithi083.stdout: "cephadm", 2024-04-01T07:05:58.635 INFO:teuthology.orchestra.run.smithi083.stdout: "rook", 2024-04-01T07:05:58.635 INFO:teuthology.orchestra.run.smithi083.stdout: "test_orchestrator" 2024-04-01T07:05:58.635 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.635 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Orchestrator backend", 2024-04-01T07:05:58.635 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.635 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.635 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.635 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.635 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.635 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.635 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.635 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "osd_perf_query", 2024-04-01T07:05:58.636 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.636 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.636 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.636 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.636 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.636 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.636 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.636 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.636 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.636 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.636 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.636 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.636 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.636 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.636 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.637 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.637 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.637 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.637 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.637 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.637 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.637 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.637 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.637 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.637 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.637 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.637 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.637 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.637 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.637 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.638 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.638 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.638 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.638 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.638 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.638 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.638 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.638 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.638 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.638 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.638 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.638 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.638 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.638 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.639 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.639 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.639 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.639 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.639 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.639 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.639 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.639 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.639 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.639 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.639 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.639 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.639 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.639 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.639 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.639 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.639 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.640 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.640 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.640 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.640 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.640 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.640 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.640 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.640 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.640 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.640 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.640 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.640 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.640 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.640 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.640 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.640 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "osd_support", 2024-04-01T07:05:58.641 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.641 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.641 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.641 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.641 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.641 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.641 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.641 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.641 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.641 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.641 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.641 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.641 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.641 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.641 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.641 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.642 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.642 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.642 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.642 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.642 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.642 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.642 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.642 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.642 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.642 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.642 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.642 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.642 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.643 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.643 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.643 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.643 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.643 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.643 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.643 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.643 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.643 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.643 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.643 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.643 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.643 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.643 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.643 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.644 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.644 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.644 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.644 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.644 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.644 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.644 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.644 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.644 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.644 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.644 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.644 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.644 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.644 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.644 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.644 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.645 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.645 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.645 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.645 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.645 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.645 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.645 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.645 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.645 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.645 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.645 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.645 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.645 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.645 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.645 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.645 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.646 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "pg_autoscaler", 2024-04-01T07:05:58.646 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.646 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.646 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.646 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.646 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.646 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.646 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.646 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.646 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.646 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.646 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.646 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.646 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.646 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.647 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.647 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.647 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.647 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.647 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.647 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.647 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.647 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.647 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.647 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.647 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.647 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.647 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.647 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.647 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.647 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.648 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.648 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.648 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.648 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.648 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.648 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.648 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.648 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.648 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.648 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.648 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.648 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.648 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.648 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.648 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.648 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.649 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.649 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.649 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.649 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.649 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.649 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.649 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.649 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.649 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.649 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.649 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.649 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.649 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.649 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.650 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.650 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.650 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.650 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.650 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.650 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.650 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.650 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.650 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.650 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.650 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.650 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.651 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.651 INFO:teuthology.orchestra.run.smithi083.stdout: "sleep_interval": { 2024-04-01T07:05:58.651 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sleep_interval", 2024-04-01T07:05:58.651 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:58.651 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.651 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.651 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "60", 2024-04-01T07:05:58.651 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.651 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.651 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.651 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.651 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.651 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.651 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.652 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.652 INFO:teuthology.orchestra.run.smithi083.stdout: "threshold": { 2024-04-01T07:05:58.652 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "threshold", 2024-04-01T07:05:58.652 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-04-01T07:05:58.652 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.652 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.652 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "3.0", 2024-04-01T07:05:58.652 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "1.0", 2024-04-01T07:05:58.652 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.652 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.652 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "scaling threshold", 2024-04-01T07:05:58.652 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-04-01T07:05:58.652 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.652 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.653 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.653 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.653 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.653 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.653 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "progress", 2024-04-01T07:05:58.653 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.653 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.653 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.653 INFO:teuthology.orchestra.run.smithi083.stdout: "allow_pg_recovery_event": { 2024-04-01T07:05:58.653 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "allow_pg_recovery_event", 2024-04-01T07:05:58.653 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.653 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.653 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.654 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.654 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.654 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.654 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.654 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "allow the module to show pg recovery progress", 2024-04-01T07:05:58.654 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.654 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.654 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.654 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.654 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": { 2024-04-01T07:05:58.654 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "enabled", 2024-04-01T07:05:58.654 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.654 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.654 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.654 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.655 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.655 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.655 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.655 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.655 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.655 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.655 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.655 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.655 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.655 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.655 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.655 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.655 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.655 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.655 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.656 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.656 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.656 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.656 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.656 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.656 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.656 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.656 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.656 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.656 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.656 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.656 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.656 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.656 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.657 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.657 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.657 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.657 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.657 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.657 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.657 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.657 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.657 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.657 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.657 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.657 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.657 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.658 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.658 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.658 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.658 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.658 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.658 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.658 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.658 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.658 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.658 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.658 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.658 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.658 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.658 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.659 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.659 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.659 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.659 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.659 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.659 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.659 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.659 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.659 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.659 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.659 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.659 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.659 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.659 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.660 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.660 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.660 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.660 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.660 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.660 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.660 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.660 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.660 INFO:teuthology.orchestra.run.smithi083.stdout: "max_completed_events": { 2024-04-01T07:05:58.660 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "max_completed_events", 2024-04-01T07:05:58.660 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.660 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.660 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.660 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "50", 2024-04-01T07:05:58.660 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.661 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.661 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.661 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "number of past completed events to remember", 2024-04-01T07:05:58.661 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.661 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.661 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.661 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.661 INFO:teuthology.orchestra.run.smithi083.stdout: "sleep_interval": { 2024-04-01T07:05:58.661 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sleep_interval", 2024-04-01T07:05:58.661 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:58.661 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.661 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.661 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "5", 2024-04-01T07:05:58.661 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.662 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.662 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.662 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how long the module is going to sleep", 2024-04-01T07:05:58.662 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.662 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.662 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.662 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.662 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.662 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.662 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.662 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "prometheus", 2024-04-01T07:05:58.662 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.662 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.662 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.663 INFO:teuthology.orchestra.run.smithi083.stdout: "cache": { 2024-04-01T07:05:58.663 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "cache", 2024-04-01T07:05:58.663 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.663 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.663 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.663 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.663 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.663 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.663 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.663 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.663 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.663 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.663 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.663 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.664 INFO:teuthology.orchestra.run.smithi083.stdout: "exclude_perf_counters": { 2024-04-01T07:05:58.664 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "exclude_perf_counters", 2024-04-01T07:05:58.664 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.664 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.664 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.664 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.664 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.664 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.664 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.664 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-04-01T07:05:58.664 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-04-01T07:05:58.664 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.664 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.664 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.665 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.665 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.665 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.665 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.665 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.665 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.665 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.665 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.665 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.665 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.665 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.665 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.665 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.665 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.665 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.665 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.666 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.666 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.666 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.666 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.666 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.666 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.666 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.666 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.666 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.666 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.666 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.666 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.666 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.666 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.666 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.667 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.667 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.667 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.667 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.667 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.667 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.667 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.667 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.667 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.667 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.667 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.667 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.667 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.667 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.667 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.667 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.667 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.668 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.668 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.668 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.668 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.668 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.668 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.668 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.668 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.668 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.668 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.668 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.668 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.668 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.668 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.668 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.669 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.669 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.669 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.669 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.669 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.669 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.669 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.669 INFO:teuthology.orchestra.run.smithi083.stdout: "rbd_stats_pools": { 2024-04-01T07:05:58.669 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rbd_stats_pools", 2024-04-01T07:05:58.669 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.669 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.669 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.669 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.669 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.670 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.670 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.670 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.670 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.670 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.670 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.670 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.670 INFO:teuthology.orchestra.run.smithi083.stdout: "rbd_stats_pools_refresh_interval": { 2024-04-01T07:05:58.670 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-04-01T07:05:58.670 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.670 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.670 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.670 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "300", 2024-04-01T07:05:58.670 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.671 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.671 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.671 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.671 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.671 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.671 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.671 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.671 INFO:teuthology.orchestra.run.smithi083.stdout: "scrape_interval": { 2024-04-01T07:05:58.671 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "scrape_interval", 2024-04-01T07:05:58.671 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-04-01T07:05:58.671 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.671 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.671 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "15.0", 2024-04-01T07:05:58.671 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.671 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.672 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.672 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.672 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.672 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.672 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.672 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.672 INFO:teuthology.orchestra.run.smithi083.stdout: "server_addr": { 2024-04-01T07:05:58.672 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "server_addr", 2024-04-01T07:05:58.672 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.672 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.672 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.672 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "::", 2024-04-01T07:05:58.672 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.672 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.672 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.673 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-04-01T07:05:58.673 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.673 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.673 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.673 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.673 INFO:teuthology.orchestra.run.smithi083.stdout: "server_port": { 2024-04-01T07:05:58.673 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "server_port", 2024-04-01T07:05:58.673 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.673 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.673 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.673 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "9283", 2024-04-01T07:05:58.673 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.673 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.673 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.673 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-04-01T07:05:58.673 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.674 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.674 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.674 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.674 INFO:teuthology.orchestra.run.smithi083.stdout: "stale_cache_strategy": { 2024-04-01T07:05:58.674 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "stale_cache_strategy", 2024-04-01T07:05:58.674 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.674 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.674 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.674 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "log", 2024-04-01T07:05:58.674 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.674 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.674 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.675 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.675 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.675 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.675 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.675 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.675 INFO:teuthology.orchestra.run.smithi083.stdout: "standby_behaviour": { 2024-04-01T07:05:58.675 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "standby_behaviour", 2024-04-01T07:05:58.675 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.675 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.675 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.675 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "default", 2024-04-01T07:05:58.675 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.675 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.675 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.676 INFO:teuthology.orchestra.run.smithi083.stdout: "default", 2024-04-01T07:05:58.676 INFO:teuthology.orchestra.run.smithi083.stdout: "error" 2024-04-01T07:05:58.676 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.676 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.676 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.676 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.676 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.676 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.676 INFO:teuthology.orchestra.run.smithi083.stdout: "standby_error_status_code": { 2024-04-01T07:05:58.676 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "standby_error_status_code", 2024-04-01T07:05:58.676 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.676 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.676 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.676 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "500", 2024-04-01T07:05:58.676 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "400", 2024-04-01T07:05:58.677 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "599", 2024-04-01T07:05:58.677 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.677 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.677 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.677 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.677 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.677 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.677 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.677 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.677 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.677 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rbd_support", 2024-04-01T07:05:58.677 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.677 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.677 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.678 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.678 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.678 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.678 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.678 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.678 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.678 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.678 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.678 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.678 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.678 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.678 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.678 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.678 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.679 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.679 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.679 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.679 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.679 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.679 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.679 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.679 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.679 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.679 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.679 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.679 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.679 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.679 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.679 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.680 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.680 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.680 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.680 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.680 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.680 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.680 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.680 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.680 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.680 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.680 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.680 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.680 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.680 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.680 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.681 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.681 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.681 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.681 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.681 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.681 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.681 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.681 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.681 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.681 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.681 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.681 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.681 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.681 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.681 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.681 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.682 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.682 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.682 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.682 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.682 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.682 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.682 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.682 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.682 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.682 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.682 INFO:teuthology.orchestra.run.smithi083.stdout: "max_concurrent_snap_create": { 2024-04-01T07:05:58.682 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "max_concurrent_snap_create", 2024-04-01T07:05:58.682 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.682 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.683 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.683 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-04-01T07:05:58.683 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.683 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.683 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.683 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.683 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.683 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.683 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.683 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.683 INFO:teuthology.orchestra.run.smithi083.stdout: "mirror_snapshot_schedule": { 2024-04-01T07:05:58.683 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "mirror_snapshot_schedule", 2024-04-01T07:05:58.683 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.683 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.683 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.684 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.684 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.684 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.684 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.684 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.684 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.684 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.684 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.684 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.684 INFO:teuthology.orchestra.run.smithi083.stdout: "trash_purge_schedule": { 2024-04-01T07:05:58.684 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "trash_purge_schedule", 2024-04-01T07:05:58.684 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.684 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.684 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.685 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.685 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.685 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.685 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.685 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.685 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.685 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.685 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.685 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.685 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.685 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.685 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.685 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "restful", 2024-04-01T07:05:58.685 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.685 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.686 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.686 INFO:teuthology.orchestra.run.smithi083.stdout: "enable_auth": { 2024-04-01T07:05:58.686 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "enable_auth", 2024-04-01T07:05:58.686 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.686 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.686 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.686 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.686 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.686 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.686 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.686 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.686 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.686 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.686 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.687 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.687 INFO:teuthology.orchestra.run.smithi083.stdout: "key_file": { 2024-04-01T07:05:58.687 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "key_file", 2024-04-01T07:05:58.687 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.687 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.687 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.687 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.687 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.687 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.687 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.687 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.687 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.687 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.688 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.688 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.688 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.688 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.688 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.688 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.688 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.688 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.688 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.688 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.688 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.688 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.688 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.688 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.689 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.689 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.689 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.689 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.689 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.689 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.689 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.689 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.689 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.689 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.689 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.689 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.689 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.689 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.689 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.689 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.689 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.690 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.690 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.690 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.690 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.690 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.690 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.690 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.690 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.690 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.690 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.690 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.690 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.690 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.690 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.690 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.691 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.691 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.691 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.691 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.691 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.691 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.691 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.691 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.691 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.691 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.691 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.691 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.691 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.691 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.691 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.691 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.692 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.692 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.692 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.692 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.692 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.692 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.692 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.692 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.692 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.692 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.692 INFO:teuthology.orchestra.run.smithi083.stdout: "server_addr": { 2024-04-01T07:05:58.692 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "server_addr", 2024-04-01T07:05:58.692 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.692 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.692 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.692 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.693 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.693 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.693 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.693 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.693 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.693 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.693 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.693 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.693 INFO:teuthology.orchestra.run.smithi083.stdout: "server_port": { 2024-04-01T07:05:58.693 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "server_port", 2024-04-01T07:05:58.693 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.693 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.693 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.693 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.693 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.693 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.694 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.694 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.694 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.694 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.694 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.694 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.694 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.694 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.694 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.694 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rgw", 2024-04-01T07:05:58.694 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.694 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.694 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.694 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.694 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.695 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.695 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.695 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.695 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.695 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.695 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.695 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.695 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.695 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.695 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.695 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.695 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.695 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.695 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.695 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.696 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.696 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.696 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.696 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.696 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.696 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.696 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.696 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.696 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.696 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.696 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.696 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.696 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.696 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.696 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.697 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.697 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.697 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.697 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.697 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.697 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.697 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.697 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.697 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.697 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.697 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.697 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.697 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.697 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.697 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.697 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.697 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.698 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.698 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.698 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.698 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.698 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.698 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.698 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.698 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.698 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.698 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.698 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.698 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.698 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.698 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.698 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.699 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.699 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.699 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.699 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.699 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.699 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.699 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.699 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.699 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.699 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rook", 2024-04-01T07:05:58.699 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.699 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.699 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.699 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.700 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.700 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.700 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.700 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.700 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.700 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.700 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.700 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.700 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.700 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.700 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.700 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.700 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.700 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.700 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.701 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.701 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.701 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.701 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.701 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.701 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.701 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.701 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.701 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.701 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.701 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.701 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.701 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.701 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.701 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.702 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.702 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.702 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.702 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.702 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.702 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.702 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.702 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.702 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.702 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.702 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.702 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.702 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.702 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.702 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.703 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.703 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.703 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.703 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.703 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.703 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.703 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.703 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.703 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.703 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.703 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.703 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.703 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.703 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.703 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.704 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.704 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.704 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.704 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.704 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.704 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.704 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.704 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.704 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.704 INFO:teuthology.orchestra.run.smithi083.stdout: "storage_class": { 2024-04-01T07:05:58.704 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "storage_class", 2024-04-01T07:05:58.704 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.704 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.704 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.705 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "local", 2024-04-01T07:05:58.705 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.705 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.705 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.705 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-04-01T07:05:58.705 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.705 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.705 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.705 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.705 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.705 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.705 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.705 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "selftest", 2024-04-01T07:05:58.705 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.706 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.706 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.706 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.706 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.706 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.706 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.706 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.706 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.706 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.706 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.706 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.706 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.706 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.706 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.706 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.707 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.707 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.707 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.707 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.707 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.707 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.707 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.707 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.707 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.707 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.707 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.707 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.707 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.707 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.707 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.707 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.708 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.708 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.708 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.708 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.708 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.708 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.708 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.708 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.708 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.708 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.708 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.708 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.708 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.709 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.709 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.709 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.709 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.709 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.709 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.709 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.709 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.709 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.709 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.709 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.709 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.709 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.710 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.710 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.710 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.710 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.710 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.710 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.710 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.710 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.710 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.710 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.710 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.710 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.710 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.710 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.710 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.711 INFO:teuthology.orchestra.run.smithi083.stdout: "roption1": { 2024-04-01T07:05:58.711 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "roption1", 2024-04-01T07:05:58.711 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.711 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.711 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.711 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.711 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.711 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.711 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.711 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.711 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.711 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.711 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.711 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.711 INFO:teuthology.orchestra.run.smithi083.stdout: "roption2": { 2024-04-01T07:05:58.712 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "roption2", 2024-04-01T07:05:58.712 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.712 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.712 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.712 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "xyz", 2024-04-01T07:05:58.712 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.712 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.712 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.712 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.712 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.712 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.712 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.712 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.712 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption1": { 2024-04-01T07:05:58.712 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption1", 2024-04-01T07:05:58.712 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.713 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.713 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.713 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.713 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.713 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.713 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.713 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.713 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.713 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.713 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.713 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.713 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption2": { 2024-04-01T07:05:58.713 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption2", 2024-04-01T07:05:58.714 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.714 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.714 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.714 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.714 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.714 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.714 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.714 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.714 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.714 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.714 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.714 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.714 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption3": { 2024-04-01T07:05:58.714 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption3", 2024-04-01T07:05:58.714 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-04-01T07:05:58.715 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.715 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.715 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.715 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.715 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.715 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.715 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.715 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.715 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.715 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.715 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.715 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption4": { 2024-04-01T07:05:58.715 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption4", 2024-04-01T07:05:58.715 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.715 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.715 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.716 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.716 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.716 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.716 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.716 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.716 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.716 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.716 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.716 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.716 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption5": { 2024-04-01T07:05:58.716 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption5", 2024-04-01T07:05:58.716 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.716 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.716 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.717 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.717 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.717 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.717 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.717 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.717 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.717 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.717 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.717 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.717 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption6": { 2024-04-01T07:05:58.717 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption6", 2024-04-01T07:05:58.717 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.717 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.717 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.717 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.717 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.718 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.718 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.718 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.718 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.718 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.718 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.718 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.718 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption7": { 2024-04-01T07:05:58.718 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption7", 2024-04-01T07:05:58.718 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.718 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.718 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.718 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.718 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "1", 2024-04-01T07:05:58.719 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "42", 2024-04-01T07:05:58.719 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.719 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.719 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.719 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.719 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.719 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.719 INFO:teuthology.orchestra.run.smithi083.stdout: "testkey": { 2024-04-01T07:05:58.719 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "testkey", 2024-04-01T07:05:58.719 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.719 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.719 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.719 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.719 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.719 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.720 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.720 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.720 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.720 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.720 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.720 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.720 INFO:teuthology.orchestra.run.smithi083.stdout: "testlkey": { 2024-04-01T07:05:58.720 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "testlkey", 2024-04-01T07:05:58.720 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.720 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.720 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.720 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.720 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.720 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.720 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.721 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.721 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.721 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.721 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.721 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.721 INFO:teuthology.orchestra.run.smithi083.stdout: "testnewline": { 2024-04-01T07:05:58.721 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "testnewline", 2024-04-01T07:05:58.721 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.721 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.721 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.721 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.721 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.721 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.721 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.722 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.722 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.722 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.722 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.722 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.722 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.722 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.722 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.722 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "snap_schedule", 2024-04-01T07:05:58.722 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.722 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.722 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.722 INFO:teuthology.orchestra.run.smithi083.stdout: "allow_m_granularity": { 2024-04-01T07:05:58.722 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "allow_m_granularity", 2024-04-01T07:05:58.723 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.723 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.723 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.723 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.723 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.723 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.723 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.723 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "allow minute scheduled snapshots", 2024-04-01T07:05:58.723 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.723 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.723 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.723 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.723 INFO:teuthology.orchestra.run.smithi083.stdout: "dump_on_update": { 2024-04-01T07:05:58.724 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "dump_on_update", 2024-04-01T07:05:58.724 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.724 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.724 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.724 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.724 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.724 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.724 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.724 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "dump database to debug log on update", 2024-04-01T07:05:58.724 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.724 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.724 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.724 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.724 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.725 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.725 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.725 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.725 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.725 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.725 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.725 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.725 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.725 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.725 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.725 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.725 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.725 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.726 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.726 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.726 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.726 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.726 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.726 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.726 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.726 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.726 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.726 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.726 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.726 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.726 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.726 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.727 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.727 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.727 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.727 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.727 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.727 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.727 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.727 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.727 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.727 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.727 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.727 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.727 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.727 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.727 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.727 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.728 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.728 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.728 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.728 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.728 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.728 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.728 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.728 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.728 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.728 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.728 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.728 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.728 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.728 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.728 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.728 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.729 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.729 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.729 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.729 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.729 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.729 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.729 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.729 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.729 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.729 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.729 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.729 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.729 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.729 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "stats", 2024-04-01T07:05:58.730 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.730 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.730 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.730 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.730 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.730 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.730 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.730 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.730 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.730 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.730 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.730 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.730 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.730 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.730 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.731 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.731 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.731 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.731 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.731 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.731 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.731 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.731 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.731 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.731 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.731 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.731 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.731 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.731 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.732 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.732 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.732 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.732 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.732 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.732 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.732 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.732 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.732 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.732 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.732 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.732 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.732 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.732 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.732 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.732 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.733 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.733 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.733 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.733 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.733 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.733 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.733 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.733 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.733 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.733 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.733 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.733 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.733 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.733 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.733 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.733 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.734 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.734 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.734 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.734 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.734 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.734 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.734 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.734 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.734 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.734 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.734 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.734 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.734 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.734 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.734 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.735 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "status", 2024-04-01T07:05:58.735 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.735 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.735 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.735 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.735 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.735 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.735 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.735 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.735 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.735 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.735 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.735 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.735 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.735 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.735 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.736 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.736 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.736 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.736 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.736 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.736 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.736 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.736 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.736 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.736 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.736 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.736 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.736 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.736 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.736 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.736 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.737 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.737 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.737 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.737 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.737 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.737 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.737 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.737 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.737 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.737 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.737 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.737 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.737 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.737 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.737 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.737 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.738 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.738 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.738 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.738 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.738 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.738 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.738 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.738 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.738 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.738 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.738 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.738 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.738 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.738 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.738 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.739 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.739 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.739 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.739 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.739 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.739 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.739 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.739 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.739 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.739 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.739 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.739 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.739 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.740 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.740 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "telegraf", 2024-04-01T07:05:58.740 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.740 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.740 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.740 INFO:teuthology.orchestra.run.smithi083.stdout: "address": { 2024-04-01T07:05:58.740 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "address", 2024-04-01T07:05:58.740 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.740 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.740 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.740 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-04-01T07:05:58.740 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.740 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.740 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.740 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.741 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.741 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.741 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.741 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.741 INFO:teuthology.orchestra.run.smithi083.stdout: "interval": { 2024-04-01T07:05:58.741 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "interval", 2024-04-01T07:05:58.741 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:58.741 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.741 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.741 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "15", 2024-04-01T07:05:58.741 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.741 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.741 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.741 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.741 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.742 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.742 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.742 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.742 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.742 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.742 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.742 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.742 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.742 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.742 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.742 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.742 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.742 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.742 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.742 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.743 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.743 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.743 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.743 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.743 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.743 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.743 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.743 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.743 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.743 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.743 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.743 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.743 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.743 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.744 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.744 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.744 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.744 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.744 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.744 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.744 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.744 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.744 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.744 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.744 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.744 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.744 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.744 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.744 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.744 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.745 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.745 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.745 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.745 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.745 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.745 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.745 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.745 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.745 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.745 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.745 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.745 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.745 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.745 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.745 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.745 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.746 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.746 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.746 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.746 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.746 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.746 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.746 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.746 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.746 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.746 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.746 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.746 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.746 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.746 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.746 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.746 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "telemetry", 2024-04-01T07:05:58.746 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.747 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.747 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.747 INFO:teuthology.orchestra.run.smithi083.stdout: "channel_basic": { 2024-04-01T07:05:58.747 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "channel_basic", 2024-04-01T07:05:58.747 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.747 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.747 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.747 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.747 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.747 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.747 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.747 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Share basic cluster information (size, version)", 2024-04-01T07:05:58.747 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.747 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.747 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.748 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.748 INFO:teuthology.orchestra.run.smithi083.stdout: "channel_crash": { 2024-04-01T07:05:58.748 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "channel_crash", 2024-04-01T07:05:58.748 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.748 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.748 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.748 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.748 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.748 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.748 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.748 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-04-01T07:05:58.748 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.748 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.748 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.748 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.749 INFO:teuthology.orchestra.run.smithi083.stdout: "channel_device": { 2024-04-01T07:05:58.749 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "channel_device", 2024-04-01T07:05:58.749 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.749 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.749 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.749 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.749 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.749 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.749 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.749 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-04-01T07:05:58.749 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.749 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.749 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.750 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.750 INFO:teuthology.orchestra.run.smithi083.stdout: "channel_ident": { 2024-04-01T07:05:58.750 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "channel_ident", 2024-04-01T07:05:58.750 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.750 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.750 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.750 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.750 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.750 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.750 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.750 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-04-01T07:05:58.750 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.750 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.751 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.751 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.751 INFO:teuthology.orchestra.run.smithi083.stdout: "channel_perf": { 2024-04-01T07:05:58.751 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "channel_perf", 2024-04-01T07:05:58.751 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.751 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.751 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.751 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.751 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.751 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.751 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.751 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Share various performance metrics of a cluster", 2024-04-01T07:05:58.751 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.751 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.751 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.752 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.752 INFO:teuthology.orchestra.run.smithi083.stdout: "contact": { 2024-04-01T07:05:58.752 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "contact", 2024-04-01T07:05:58.752 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.752 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.752 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.752 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.752 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.752 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.752 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.752 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.752 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.752 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.753 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.753 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.753 INFO:teuthology.orchestra.run.smithi083.stdout: "description": { 2024-04-01T07:05:58.753 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "description", 2024-04-01T07:05:58.753 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.753 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.753 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.753 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.753 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.753 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.753 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.753 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.753 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.753 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.753 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.754 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.754 INFO:teuthology.orchestra.run.smithi083.stdout: "device_url": { 2024-04-01T07:05:58.754 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "device_url", 2024-04-01T07:05:58.754 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.754 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.754 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.754 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-04-01T07:05:58.754 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.754 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.754 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.754 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.754 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.754 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.755 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.755 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.755 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": { 2024-04-01T07:05:58.755 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "enabled", 2024-04-01T07:05:58.755 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.755 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.755 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.755 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.755 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.755 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.755 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.755 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.755 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.755 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.756 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.756 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.756 INFO:teuthology.orchestra.run.smithi083.stdout: "interval": { 2024-04-01T07:05:58.756 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "interval", 2024-04-01T07:05:58.756 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.756 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.756 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.756 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "24", 2024-04-01T07:05:58.756 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "8", 2024-04-01T07:05:58.756 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.756 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.756 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.756 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.756 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.757 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.757 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.757 INFO:teuthology.orchestra.run.smithi083.stdout: "last_opt_revision": { 2024-04-01T07:05:58.757 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "last_opt_revision", 2024-04-01T07:05:58.757 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.757 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.757 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.757 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "1", 2024-04-01T07:05:58.757 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.757 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.757 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.757 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.757 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.757 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.757 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.758 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.758 INFO:teuthology.orchestra.run.smithi083.stdout: "leaderboard": { 2024-04-01T07:05:58.758 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "leaderboard", 2024-04-01T07:05:58.758 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.758 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.758 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.758 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.758 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.758 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.758 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.758 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.758 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.758 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.758 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.759 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.759 INFO:teuthology.orchestra.run.smithi083.stdout: "leaderboard_description": { 2024-04-01T07:05:58.759 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "leaderboard_description", 2024-04-01T07:05:58.759 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.759 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.759 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.759 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.759 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.759 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.759 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.759 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.759 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.759 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.759 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.759 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.760 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.760 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.760 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.760 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.760 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.760 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.760 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.760 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.760 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.760 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.760 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.760 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.760 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.760 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.761 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.761 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.761 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.761 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.761 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.761 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.761 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.761 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.761 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.761 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.761 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.761 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.761 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.762 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.762 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.762 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.762 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.762 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.762 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.762 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.762 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.762 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.762 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.762 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.762 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.762 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.763 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.763 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.763 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.763 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.763 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.763 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.763 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.763 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.763 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.763 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.763 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.763 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.763 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.763 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.764 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.764 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.764 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.764 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.764 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.764 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.764 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.764 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.764 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.764 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.764 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.764 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.764 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.764 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.764 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.765 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.765 INFO:teuthology.orchestra.run.smithi083.stdout: "organization": { 2024-04-01T07:05:58.765 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "organization", 2024-04-01T07:05:58.765 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.765 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.765 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.765 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.765 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.765 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.765 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.765 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.765 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.765 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.765 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.766 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.766 INFO:teuthology.orchestra.run.smithi083.stdout: "proxy": { 2024-04-01T07:05:58.766 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "proxy", 2024-04-01T07:05:58.766 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.766 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.766 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.766 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.766 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.766 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.766 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.766 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.766 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.766 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.767 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.767 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.767 INFO:teuthology.orchestra.run.smithi083.stdout: "url": { 2024-04-01T07:05:58.767 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "url", 2024-04-01T07:05:58.767 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.767 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.767 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.767 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-04-01T07:05:58.767 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.767 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.767 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.767 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.767 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.767 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.768 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.768 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.768 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.768 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.768 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.768 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "test_orchestrator", 2024-04-01T07:05:58.768 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.768 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.768 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.768 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.768 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.768 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.768 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.768 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.768 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.769 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.769 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.769 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.769 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.769 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.769 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.769 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.769 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.769 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.769 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.769 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.769 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.769 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.769 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.770 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.770 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.770 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.770 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.770 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.770 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.770 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.770 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.770 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.770 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.770 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.770 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.770 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.771 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.771 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.771 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.771 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.771 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.771 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.771 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.771 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.771 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.771 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.771 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.771 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.771 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.771 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.771 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.771 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.771 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.772 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.772 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.772 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.772 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.772 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.772 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.772 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.772 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.772 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.772 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.772 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.772 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.772 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.772 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.772 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.773 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.773 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.773 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.773 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.773 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.773 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.773 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.773 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.773 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "volumes", 2024-04-01T07:05:58.773 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.773 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.773 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.773 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.773 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.773 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.774 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.774 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.774 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.774 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.774 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.774 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.774 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.774 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.774 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.774 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.774 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.774 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.774 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.774 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.775 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.775 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.775 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.775 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.775 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.775 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.775 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.775 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.775 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.775 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.775 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.775 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.775 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.775 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.776 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.776 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.776 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.776 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.776 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.776 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.776 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.776 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.776 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.776 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.776 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.776 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.776 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.776 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.776 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.776 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.777 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.777 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.777 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.777 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.777 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.777 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.777 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.777 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.777 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.777 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.777 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.777 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.777 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.777 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.777 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.777 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.778 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.778 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.778 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.778 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.778 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.778 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.778 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.778 INFO:teuthology.orchestra.run.smithi083.stdout: "max_concurrent_clones": { 2024-04-01T07:05:58.778 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "max_concurrent_clones", 2024-04-01T07:05:58.778 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.778 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.778 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.778 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "4", 2024-04-01T07:05:58.778 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.779 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.779 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.779 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Number of asynchronous cloner threads", 2024-04-01T07:05:58.779 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.779 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.779 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.779 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.779 INFO:teuthology.orchestra.run.smithi083.stdout: "snapshot_clone_delay": { 2024-04-01T07:05:58.779 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "snapshot_clone_delay", 2024-04-01T07:05:58.779 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.779 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.779 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.779 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-04-01T07:05:58.779 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.779 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.780 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.780 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-04-01T07:05:58.780 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.780 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.780 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.780 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.780 INFO:teuthology.orchestra.run.smithi083.stdout: "snapshot_clone_no_wait": { 2024-04-01T07:05:58.780 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "snapshot_clone_no_wait", 2024-04-01T07:05:58.780 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.780 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.780 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.780 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.780 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.780 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.780 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.780 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-04-01T07:05:58.780 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.781 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.781 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.781 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.781 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.781 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.781 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.781 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "zabbix", 2024-04-01T07:05:58.781 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.781 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.781 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.781 INFO:teuthology.orchestra.run.smithi083.stdout: "discovery_interval": { 2024-04-01T07:05:58.781 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "discovery_interval", 2024-04-01T07:05:58.781 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "uint", 2024-04-01T07:05:58.781 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.781 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.782 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "100", 2024-04-01T07:05:58.782 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.782 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.782 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.782 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.782 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.782 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.782 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.782 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.782 INFO:teuthology.orchestra.run.smithi083.stdout: "identifier": { 2024-04-01T07:05:58.782 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "identifier", 2024-04-01T07:05:58.782 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.782 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.783 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.783 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.783 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.783 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.783 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.783 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.783 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.783 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.783 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.783 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.783 INFO:teuthology.orchestra.run.smithi083.stdout: "interval": { 2024-04-01T07:05:58.783 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "interval", 2024-04-01T07:05:58.783 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:58.783 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.783 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.784 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "60", 2024-04-01T07:05:58.784 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.784 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.784 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.784 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.784 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.784 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.784 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.784 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.784 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.784 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.784 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.784 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.784 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.784 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.785 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.785 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.785 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.785 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.785 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.785 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.785 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.785 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.785 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.785 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.785 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.785 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.785 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.785 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.785 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.785 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.786 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.786 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.786 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.786 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.786 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.786 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.786 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.786 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.786 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.786 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.786 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.786 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.786 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.786 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.786 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.787 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.787 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.787 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.787 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.787 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.787 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.787 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.787 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.787 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.787 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.787 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.787 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.787 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.788 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.788 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.788 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.788 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.788 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.788 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.788 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.788 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.788 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.788 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.788 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.788 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.788 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.789 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.789 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.789 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.789 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.789 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.789 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.789 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.789 INFO:teuthology.orchestra.run.smithi083.stdout: "zabbix_host": { 2024-04-01T07:05:58.789 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "zabbix_host", 2024-04-01T07:05:58.789 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.790 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.790 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.790 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.790 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.790 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.790 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.790 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.790 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.790 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.790 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.790 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.790 INFO:teuthology.orchestra.run.smithi083.stdout: "zabbix_port": { 2024-04-01T07:05:58.790 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "zabbix_port", 2024-04-01T07:05:58.791 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.791 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.791 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.791 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10051", 2024-04-01T07:05:58.791 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.791 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.791 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.791 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.791 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.791 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.791 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.791 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.792 INFO:teuthology.orchestra.run.smithi083.stdout: "zabbix_sender": { 2024-04-01T07:05:58.792 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "zabbix_sender", 2024-04-01T07:05:58.792 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.792 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.792 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.792 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-04-01T07:05:58.792 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.792 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.792 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.792 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.792 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.792 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.792 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.792 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.792 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.793 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.793 INFO:teuthology.orchestra.run.smithi083.stdout: ] 2024-04-01T07:05:58.793 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.793 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.793 INFO:teuthology.orchestra.run.smithi083.stdout: "modules": [ 2024-04-01T07:05:58.793 INFO:teuthology.orchestra.run.smithi083.stdout: "cephadm", 2024-04-01T07:05:58.793 INFO:teuthology.orchestra.run.smithi083.stdout: "dashboard", 2024-04-01T07:05:58.793 INFO:teuthology.orchestra.run.smithi083.stdout: "iostat", 2024-04-01T07:05:58.793 INFO:teuthology.orchestra.run.smithi083.stdout: "nfs", 2024-04-01T07:05:58.793 INFO:teuthology.orchestra.run.smithi083.stdout: "restful", 2024-04-01T07:05:58.793 INFO:teuthology.orchestra.run.smithi083.stdout: "snap_schedule" 2024-04-01T07:05:58.793 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.794 INFO:teuthology.orchestra.run.smithi083.stdout: "available_modules": [ 2024-04-01T07:05:58.794 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.794 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "alerts", 2024-04-01T07:05:58.794 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.794 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.794 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.794 INFO:teuthology.orchestra.run.smithi083.stdout: "interval": { 2024-04-01T07:05:58.794 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "interval", 2024-04-01T07:05:58.794 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:58.794 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.794 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.794 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "60", 2024-04-01T07:05:58.795 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.795 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.795 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.795 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "How frequently to reexamine health status", 2024-04-01T07:05:58.795 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.795 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.795 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.795 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.795 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.795 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.795 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.795 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.795 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.795 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.795 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.796 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.796 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.796 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.796 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.796 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.796 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.796 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.796 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.796 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.796 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.796 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.797 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.797 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.797 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.797 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.797 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.797 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.797 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.797 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.797 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.797 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.797 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.797 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.797 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.797 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.798 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.798 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.798 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.798 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.798 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.798 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.798 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.798 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.798 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.798 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.798 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.798 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.798 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.798 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.799 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.799 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.799 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.799 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.799 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.799 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.799 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.799 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.799 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.799 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.799 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.799 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.799 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.799 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.800 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.800 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.800 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.800 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.800 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.800 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.800 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.800 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.800 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.800 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.800 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_destination": { 2024-04-01T07:05:58.800 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_destination", 2024-04-01T07:05:58.800 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.800 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.800 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.801 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.801 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.801 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.801 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.801 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Email address to send alerts to", 2024-04-01T07:05:58.801 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.801 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.801 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.801 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.801 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_from_name": { 2024-04-01T07:05:58.801 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_from_name", 2024-04-01T07:05:58.801 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.801 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.801 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.802 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "Ceph", 2024-04-01T07:05:58.802 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.802 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.802 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.802 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Email From: name", 2024-04-01T07:05:58.802 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.802 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.802 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.802 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.802 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_host": { 2024-04-01T07:05:58.802 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_host", 2024-04-01T07:05:58.802 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.802 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.802 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.802 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.803 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.803 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.803 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.803 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "SMTP server", 2024-04-01T07:05:58.803 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.803 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.803 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.803 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.803 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_password": { 2024-04-01T07:05:58.803 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_password", 2024-04-01T07:05:58.803 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.803 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.803 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.804 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.804 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.804 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.804 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.804 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Password to authenticate with", 2024-04-01T07:05:58.804 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.804 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.804 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.804 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.804 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_port": { 2024-04-01T07:05:58.804 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_port", 2024-04-01T07:05:58.804 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.804 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.805 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.805 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "465", 2024-04-01T07:05:58.805 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.805 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.805 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.805 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "SMTP port", 2024-04-01T07:05:58.805 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.805 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.805 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.805 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.805 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_sender": { 2024-04-01T07:05:58.805 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_sender", 2024-04-01T07:05:58.805 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.805 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.806 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.806 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.806 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.806 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.806 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.806 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "SMTP envelope sender", 2024-04-01T07:05:58.806 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.806 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.806 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.806 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.806 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_ssl": { 2024-04-01T07:05:58.806 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_ssl", 2024-04-01T07:05:58.806 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.806 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.807 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.807 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.807 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.807 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.807 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.807 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Use SSL to connect to SMTP server", 2024-04-01T07:05:58.807 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.807 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.807 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.807 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.807 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_user": { 2024-04-01T07:05:58.807 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_user", 2024-04-01T07:05:58.807 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.808 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.808 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.808 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.808 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.808 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.808 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.808 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "User to authenticate as", 2024-04-01T07:05:58.808 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.808 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.808 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.808 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.808 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.808 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.808 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.809 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "balancer", 2024-04-01T07:05:58.809 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.809 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.809 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.809 INFO:teuthology.orchestra.run.smithi083.stdout: "active": { 2024-04-01T07:05:58.809 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "active", 2024-04-01T07:05:58.809 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.809 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.809 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.809 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.809 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.809 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.809 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.809 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "automatically balance PGs across cluster", 2024-04-01T07:05:58.809 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.810 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.810 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.810 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.810 INFO:teuthology.orchestra.run.smithi083.stdout: "begin_time": { 2024-04-01T07:05:58.810 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "begin_time", 2024-04-01T07:05:58.810 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.810 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.810 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.810 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0000", 2024-04-01T07:05:58.810 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.810 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.810 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.810 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "beginning time of day to automatically balance", 2024-04-01T07:05:58.811 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-01T07:05:58.811 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.811 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.811 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.811 INFO:teuthology.orchestra.run.smithi083.stdout: "begin_weekday": { 2024-04-01T07:05:58.811 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "begin_weekday", 2024-04-01T07:05:58.811 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "uint", 2024-04-01T07:05:58.811 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.811 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.811 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-04-01T07:05:58.811 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "0", 2024-04-01T07:05:58.811 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "6", 2024-04-01T07:05:58.811 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.811 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-04-01T07:05:58.812 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-01T07:05:58.812 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.812 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.812 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.812 INFO:teuthology.orchestra.run.smithi083.stdout: "crush_compat_max_iterations": { 2024-04-01T07:05:58.812 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "crush_compat_max_iterations", 2024-04-01T07:05:58.812 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "uint", 2024-04-01T07:05:58.812 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.812 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.812 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "25", 2024-04-01T07:05:58.812 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "1", 2024-04-01T07:05:58.812 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "250", 2024-04-01T07:05:58.812 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.813 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-04-01T07:05:58.813 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.813 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.813 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.813 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.813 INFO:teuthology.orchestra.run.smithi083.stdout: "crush_compat_metrics": { 2024-04-01T07:05:58.813 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "crush_compat_metrics", 2024-04-01T07:05:58.813 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.813 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.813 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.813 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "pgs,objects,bytes", 2024-04-01T07:05:58.813 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.813 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.814 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.814 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-04-01T07:05:58.814 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-04-01T07:05:58.814 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.814 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.814 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.814 INFO:teuthology.orchestra.run.smithi083.stdout: "crush_compat_step": { 2024-04-01T07:05:58.814 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "crush_compat_step", 2024-04-01T07:05:58.814 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-04-01T07:05:58.814 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.814 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.814 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0.5", 2024-04-01T07:05:58.814 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "0.001", 2024-04-01T07:05:58.814 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "0.999", 2024-04-01T07:05:58.815 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.815 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "aggressiveness of optimization", 2024-04-01T07:05:58.815 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-04-01T07:05:58.815 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.815 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.815 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.815 INFO:teuthology.orchestra.run.smithi083.stdout: "end_time": { 2024-04-01T07:05:58.815 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "end_time", 2024-04-01T07:05:58.815 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.815 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.815 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.815 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "2359", 2024-04-01T07:05:58.815 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.816 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.816 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.816 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "ending time of day to automatically balance", 2024-04-01T07:05:58.816 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-01T07:05:58.816 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.816 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.816 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.816 INFO:teuthology.orchestra.run.smithi083.stdout: "end_weekday": { 2024-04-01T07:05:58.816 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "end_weekday", 2024-04-01T07:05:58.816 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "uint", 2024-04-01T07:05:58.816 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.816 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.816 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-04-01T07:05:58.816 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "0", 2024-04-01T07:05:58.816 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "6", 2024-04-01T07:05:58.817 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.817 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-04-01T07:05:58.817 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-01T07:05:58.817 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.817 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.817 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.817 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.817 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.817 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.817 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.817 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.817 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.817 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.817 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.818 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.818 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.818 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.818 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.818 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.818 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.818 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.818 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.818 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.818 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.818 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.818 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.818 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.818 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.819 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.819 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.819 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.819 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.819 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.819 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.819 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.819 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.819 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.819 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.819 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.819 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.819 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.819 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.819 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.820 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.820 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.820 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.820 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.820 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.820 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.820 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.820 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.820 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.820 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.820 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.820 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.820 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.820 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.820 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.821 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.821 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.821 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.821 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.821 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.821 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.821 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.821 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.821 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.821 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.821 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.821 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.821 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.821 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.822 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.822 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.822 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.822 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.822 INFO:teuthology.orchestra.run.smithi083.stdout: "min_score": { 2024-04-01T07:05:58.822 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "min_score", 2024-04-01T07:05:58.822 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-04-01T07:05:58.822 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.822 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.822 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-04-01T07:05:58.822 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.822 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.823 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.823 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-04-01T07:05:58.823 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.823 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.823 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.823 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.823 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": { 2024-04-01T07:05:58.823 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "mode", 2024-04-01T07:05:58.823 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.823 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.823 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.823 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "upmap", 2024-04-01T07:05:58.823 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.823 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.823 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.824 INFO:teuthology.orchestra.run.smithi083.stdout: "crush-compat", 2024-04-01T07:05:58.824 INFO:teuthology.orchestra.run.smithi083.stdout: "none", 2024-04-01T07:05:58.824 INFO:teuthology.orchestra.run.smithi083.stdout: "upmap" 2024-04-01T07:05:58.824 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.824 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Balancer mode", 2024-04-01T07:05:58.824 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.824 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.824 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.824 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.824 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_ids": { 2024-04-01T07:05:58.824 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "pool_ids", 2024-04-01T07:05:58.824 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.824 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.824 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.824 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.824 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.825 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.825 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.825 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-04-01T07:05:58.825 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.825 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.825 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.825 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.825 INFO:teuthology.orchestra.run.smithi083.stdout: "sleep_interval": { 2024-04-01T07:05:58.825 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sleep_interval", 2024-04-01T07:05:58.825 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:58.825 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.825 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.825 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "60", 2024-04-01T07:05:58.825 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.825 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.825 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.826 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-04-01T07:05:58.826 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.826 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.826 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.826 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.826 INFO:teuthology.orchestra.run.smithi083.stdout: "upmap_max_deviation": { 2024-04-01T07:05:58.826 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "upmap_max_deviation", 2024-04-01T07:05:58.826 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.826 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.826 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.826 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "5", 2024-04-01T07:05:58.826 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "1", 2024-04-01T07:05:58.826 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.826 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.826 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "deviation below which no optimization is attempted", 2024-04-01T07:05:58.827 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-04-01T07:05:58.827 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.827 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.827 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.827 INFO:teuthology.orchestra.run.smithi083.stdout: "upmap_max_optimizations": { 2024-04-01T07:05:58.827 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "upmap_max_optimizations", 2024-04-01T07:05:58.827 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "uint", 2024-04-01T07:05:58.827 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.827 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.827 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-04-01T07:05:58.827 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.827 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.827 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.827 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-04-01T07:05:58.827 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.827 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.828 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.828 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.828 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.828 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.828 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.828 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "cephadm", 2024-04-01T07:05:58.828 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.828 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.828 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.828 INFO:teuthology.orchestra.run.smithi083.stdout: "agent_down_multiplier": { 2024-04-01T07:05:58.828 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "agent_down_multiplier", 2024-04-01T07:05:58.828 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-04-01T07:05:58.828 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.829 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.829 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "3.0", 2024-04-01T07:05:58.829 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.829 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.829 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.829 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-04-01T07:05:58.829 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.829 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.829 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.829 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.829 INFO:teuthology.orchestra.run.smithi083.stdout: "agent_refresh_rate": { 2024-04-01T07:05:58.829 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "agent_refresh_rate", 2024-04-01T07:05:58.829 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:58.830 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.830 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.830 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "20", 2024-04-01T07:05:58.830 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.830 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.830 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.830 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-04-01T07:05:58.830 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.830 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.830 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.830 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.830 INFO:teuthology.orchestra.run.smithi083.stdout: "agent_starting_port": { 2024-04-01T07:05:58.830 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "agent_starting_port", 2024-04-01T07:05:58.830 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.830 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.830 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.831 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "4721", 2024-04-01T07:05:58.831 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.831 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.831 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.831 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-04-01T07:05:58.831 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.831 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.831 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.831 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.831 INFO:teuthology.orchestra.run.smithi083.stdout: "allow_ptrace": { 2024-04-01T07:05:58.831 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "allow_ptrace", 2024-04-01T07:05:58.831 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.831 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.831 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.832 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.832 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.832 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.832 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.832 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-04-01T07:05:58.832 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-04-01T07:05:58.832 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.832 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.832 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.832 INFO:teuthology.orchestra.run.smithi083.stdout: "autotune_interval": { 2024-04-01T07:05:58.832 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "autotune_interval", 2024-04-01T07:05:58.832 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:58.832 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.832 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.832 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "600", 2024-04-01T07:05:58.833 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.833 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.833 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.833 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how frequently to autotune daemon memory", 2024-04-01T07:05:58.833 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.833 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.833 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.833 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.833 INFO:teuthology.orchestra.run.smithi083.stdout: "autotune_memory_target_ratio": { 2024-04-01T07:05:58.833 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "autotune_memory_target_ratio", 2024-04-01T07:05:58.833 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-04-01T07:05:58.833 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.833 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.833 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0.7", 2024-04-01T07:05:58.834 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.834 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.834 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.834 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-04-01T07:05:58.834 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.834 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.834 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.834 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.834 INFO:teuthology.orchestra.run.smithi083.stdout: "cgroups_split": { 2024-04-01T07:05:58.834 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "cgroups_split", 2024-04-01T07:05:58.834 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.834 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.834 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.835 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.835 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.835 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.835 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.835 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-04-01T07:05:58.835 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.835 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.835 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.835 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.835 INFO:teuthology.orchestra.run.smithi083.stdout: "config_checks_enabled": { 2024-04-01T07:05:58.835 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "config_checks_enabled", 2024-04-01T07:05:58.835 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.835 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.835 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.835 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.836 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.836 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.836 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.836 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-04-01T07:05:58.836 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.836 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.836 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.836 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.836 INFO:teuthology.orchestra.run.smithi083.stdout: "config_dashboard": { 2024-04-01T07:05:58.836 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "config_dashboard", 2024-04-01T07:05:58.836 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.836 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.836 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.836 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.837 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.837 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.837 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.837 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-04-01T07:05:58.837 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.837 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.837 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.837 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.837 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_alertmanager": { 2024-04-01T07:05:58.837 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_alertmanager", 2024-04-01T07:05:58.837 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.837 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.837 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.837 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-04-01T07:05:58.838 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.838 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.838 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.838 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Prometheus container image", 2024-04-01T07:05:58.838 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.838 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.838 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.838 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.838 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_base": { 2024-04-01T07:05:58.838 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_base", 2024-04-01T07:05:58.838 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.838 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.838 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.839 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/ceph/ceph", 2024-04-01T07:05:58.839 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.839 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.839 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.839 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Container image name, without the tag", 2024-04-01T07:05:58.839 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.839 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.839 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.839 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.839 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_elasticsearch": { 2024-04-01T07:05:58.839 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_elasticsearch", 2024-04-01T07:05:58.839 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.839 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.839 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.840 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-04-01T07:05:58.840 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.840 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.840 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.840 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "elasticsearch container image", 2024-04-01T07:05:58.840 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.840 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.840 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.840 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.840 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_grafana": { 2024-04-01T07:05:58.840 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_grafana", 2024-04-01T07:05:58.840 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.840 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.840 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.841 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2024-04-01T07:05:58.841 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.841 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.841 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.841 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Prometheus container image", 2024-04-01T07:05:58.841 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.841 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.841 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.841 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.841 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_haproxy": { 2024-04-01T07:05:58.841 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_haproxy", 2024-04-01T07:05:58.841 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.841 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.842 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.842 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-04-01T07:05:58.842 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.842 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.842 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.842 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "HAproxy container image", 2024-04-01T07:05:58.842 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.842 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.842 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.842 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.842 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_jaeger_agent": { 2024-04-01T07:05:58.842 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_jaeger_agent", 2024-04-01T07:05:58.842 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.842 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.843 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.843 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-04-01T07:05:58.843 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.843 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.843 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.843 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Jaeger agent container image", 2024-04-01T07:05:58.843 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.843 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.843 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.843 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.843 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_jaeger_collector": { 2024-04-01T07:05:58.843 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_jaeger_collector", 2024-04-01T07:05:58.843 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.843 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.844 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.844 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-04-01T07:05:58.844 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.844 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.844 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.844 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Jaeger collector container image", 2024-04-01T07:05:58.844 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.844 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.844 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.844 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.844 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_jaeger_query": { 2024-04-01T07:05:58.844 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_jaeger_query", 2024-04-01T07:05:58.844 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.844 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.844 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.845 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-04-01T07:05:58.845 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.845 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.845 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.845 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Jaeger query container image", 2024-04-01T07:05:58.845 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.845 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.845 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.845 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.845 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_keepalived": { 2024-04-01T07:05:58.845 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_keepalived", 2024-04-01T07:05:58.845 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.845 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.845 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.845 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-04-01T07:05:58.846 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.846 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.846 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.846 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Keepalived container image", 2024-04-01T07:05:58.846 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.846 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.846 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.846 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.846 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_loki": { 2024-04-01T07:05:58.846 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_loki", 2024-04-01T07:05:58.846 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.846 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.846 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.846 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-04-01T07:05:58.847 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.847 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.847 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.847 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Loki container image", 2024-04-01T07:05:58.847 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.847 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.847 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.847 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.847 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_node_exporter": { 2024-04-01T07:05:58.847 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_node_exporter", 2024-04-01T07:05:58.847 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.847 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.847 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.847 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-04-01T07:05:58.847 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.848 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.848 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.848 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Prometheus container image", 2024-04-01T07:05:58.848 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.848 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.848 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.848 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.848 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_nvmeof": { 2024-04-01T07:05:58.848 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_nvmeof", 2024-04-01T07:05:58.848 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.848 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.848 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.848 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/ceph/nvmeof:1.0.0", 2024-04-01T07:05:58.848 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.849 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.849 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.849 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Nvme-of container image", 2024-04-01T07:05:58.849 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.849 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.849 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.849 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.849 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_prometheus": { 2024-04-01T07:05:58.849 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_prometheus", 2024-04-01T07:05:58.849 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.849 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.849 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.849 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-04-01T07:05:58.849 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.850 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.850 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.850 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Prometheus container image", 2024-04-01T07:05:58.850 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.850 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.850 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.850 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.850 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_promtail": { 2024-04-01T07:05:58.850 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_promtail", 2024-04-01T07:05:58.850 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.850 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.850 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.850 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-04-01T07:05:58.851 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.851 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.851 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.851 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Promtail container image", 2024-04-01T07:05:58.851 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.851 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.851 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.851 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.851 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_snmp_gateway": { 2024-04-01T07:05:58.851 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_snmp_gateway", 2024-04-01T07:05:58.851 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.851 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.851 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.851 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-04-01T07:05:58.852 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.852 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.852 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.852 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "SNMP Gateway container image", 2024-04-01T07:05:58.852 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.852 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.852 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.852 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.852 INFO:teuthology.orchestra.run.smithi083.stdout: "container_init": { 2024-04-01T07:05:58.852 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_init", 2024-04-01T07:05:58.852 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.852 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.852 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.852 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.852 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.852 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.853 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.853 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Run podman/docker with `--init`", 2024-04-01T07:05:58.853 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.853 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.853 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.853 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.853 INFO:teuthology.orchestra.run.smithi083.stdout: "daemon_cache_timeout": { 2024-04-01T07:05:58.853 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "daemon_cache_timeout", 2024-04-01T07:05:58.853 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:58.853 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.853 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.853 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "600", 2024-04-01T07:05:58.853 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.853 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.854 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.854 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-04-01T07:05:58.854 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.854 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.854 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.854 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.854 INFO:teuthology.orchestra.run.smithi083.stdout: "default_cephadm_command_timeout": { 2024-04-01T07:05:58.854 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "default_cephadm_command_timeout", 2024-04-01T07:05:58.854 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.854 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.854 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.854 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "900", 2024-04-01T07:05:58.854 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.854 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.855 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.855 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-04-01T07:05:58.855 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.855 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.855 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.855 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.855 INFO:teuthology.orchestra.run.smithi083.stdout: "default_registry": { 2024-04-01T07:05:58.855 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "default_registry", 2024-04-01T07:05:58.855 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.855 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.855 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.855 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "docker.io", 2024-04-01T07:05:58.855 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.855 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.856 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.856 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-04-01T07:05:58.856 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.856 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.856 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.856 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.856 INFO:teuthology.orchestra.run.smithi083.stdout: "device_cache_timeout": { 2024-04-01T07:05:58.856 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "device_cache_timeout", 2024-04-01T07:05:58.856 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:58.856 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.856 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.856 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "1800", 2024-04-01T07:05:58.856 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.856 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.857 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.857 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "seconds to cache device inventory", 2024-04-01T07:05:58.857 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.857 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.857 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.857 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.857 INFO:teuthology.orchestra.run.smithi083.stdout: "device_enhanced_scan": { 2024-04-01T07:05:58.857 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "device_enhanced_scan", 2024-04-01T07:05:58.857 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.857 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.857 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.857 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.857 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.857 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.857 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.857 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Use libstoragemgmt during device scans", 2024-04-01T07:05:58.858 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.858 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.858 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.858 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.858 INFO:teuthology.orchestra.run.smithi083.stdout: "facts_cache_timeout": { 2024-04-01T07:05:58.858 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "facts_cache_timeout", 2024-04-01T07:05:58.858 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:58.858 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.858 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.858 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "60", 2024-04-01T07:05:58.858 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.858 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.858 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.858 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "seconds to cache host facts data", 2024-04-01T07:05:58.858 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.858 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.859 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.859 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.859 INFO:teuthology.orchestra.run.smithi083.stdout: "host_check_interval": { 2024-04-01T07:05:58.859 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "host_check_interval", 2024-04-01T07:05:58.859 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:58.859 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.859 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.859 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "600", 2024-04-01T07:05:58.859 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.859 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.859 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.859 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how frequently to perform a host check", 2024-04-01T07:05:58.859 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.859 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.860 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.860 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.860 INFO:teuthology.orchestra.run.smithi083.stdout: "hw_monitoring": { 2024-04-01T07:05:58.860 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "hw_monitoring", 2024-04-01T07:05:58.860 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.860 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.860 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.860 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.860 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.860 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.860 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.860 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-04-01T07:05:58.860 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.860 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.861 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.861 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.861 INFO:teuthology.orchestra.run.smithi083.stdout: "inventory_list_all": { 2024-04-01T07:05:58.861 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "inventory_list_all", 2024-04-01T07:05:58.861 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.861 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.861 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.861 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.861 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.861 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.861 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.861 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-04-01T07:05:58.861 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.861 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.861 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.861 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.861 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.862 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.862 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.862 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.862 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.862 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.862 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.862 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.862 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.862 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.862 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.862 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.862 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.862 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.862 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.862 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.862 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.863 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.863 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.863 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.863 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.863 INFO:teuthology.orchestra.run.smithi083.stdout: "log_refresh_metadata": { 2024-04-01T07:05:58.863 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_refresh_metadata", 2024-04-01T07:05:58.863 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.863 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.863 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.863 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.863 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.863 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.863 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.863 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-04-01T07:05:58.863 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.864 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.864 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.864 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.864 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.864 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.864 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.864 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.864 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.864 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.864 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.864 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.864 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.864 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-04-01T07:05:58.864 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.864 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.865 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.865 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.865 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.865 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.865 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.865 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.865 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.865 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.865 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.865 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.865 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.865 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.865 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.865 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.865 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.865 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.865 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.866 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.866 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.866 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.866 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.866 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.866 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.866 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.866 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.866 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.866 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.866 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.866 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.866 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.866 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.867 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.867 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.867 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.867 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.867 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.867 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.867 INFO:teuthology.orchestra.run.smithi083.stdout: "manage_etc_ceph_ceph_conf": { 2024-04-01T07:05:58.867 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-04-01T07:05:58.867 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.867 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.867 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.867 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.867 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.867 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.867 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.868 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-04-01T07:05:58.868 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.868 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.868 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.868 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.868 INFO:teuthology.orchestra.run.smithi083.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-04-01T07:05:58.868 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-04-01T07:05:58.868 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.868 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.868 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.868 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "*", 2024-04-01T07:05:58.868 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.868 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.868 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.869 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-04-01T07:05:58.869 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.869 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.869 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.869 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.869 INFO:teuthology.orchestra.run.smithi083.stdout: "max_count_per_host": { 2024-04-01T07:05:58.869 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "max_count_per_host", 2024-04-01T07:05:58.869 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.869 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.869 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.869 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-04-01T07:05:58.869 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.869 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.870 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.870 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "max number of daemons per service per host", 2024-04-01T07:05:58.870 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.870 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.870 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.870 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.870 INFO:teuthology.orchestra.run.smithi083.stdout: "max_osd_draining_count": { 2024-04-01T07:05:58.870 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "max_osd_draining_count", 2024-04-01T07:05:58.870 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.870 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.870 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.870 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-04-01T07:05:58.871 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.871 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.871 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.871 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-04-01T07:05:58.871 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.871 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.871 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.871 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.871 INFO:teuthology.orchestra.run.smithi083.stdout: "migration_current": { 2024-04-01T07:05:58.871 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "migration_current", 2024-04-01T07:05:58.871 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.871 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.871 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.871 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.871 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.871 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.872 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.872 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "internal - do not modify", 2024-04-01T07:05:58.872 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.872 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.872 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.872 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.872 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": { 2024-04-01T07:05:58.872 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "mode", 2024-04-01T07:05:58.872 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.872 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.872 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.872 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "root", 2024-04-01T07:05:58.872 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.872 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.872 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.872 INFO:teuthology.orchestra.run.smithi083.stdout: "cephadm-package", 2024-04-01T07:05:58.873 INFO:teuthology.orchestra.run.smithi083.stdout: "root" 2024-04-01T07:05:58.873 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.873 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "mode for remote execution of cephadm", 2024-04-01T07:05:58.873 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.873 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.873 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.873 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.873 INFO:teuthology.orchestra.run.smithi083.stdout: "oob_default_addr": { 2024-04-01T07:05:58.873 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "oob_default_addr", 2024-04-01T07:05:58.873 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.873 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.873 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.873 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "169.254.1.1", 2024-04-01T07:05:58.873 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.873 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.874 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.874 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Default address for RedFish API (oob management).", 2024-04-01T07:05:58.874 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.874 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.874 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.874 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.874 INFO:teuthology.orchestra.run.smithi083.stdout: "prometheus_alerts_path": { 2024-04-01T07:05:58.874 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "prometheus_alerts_path", 2024-04-01T07:05:58.874 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.874 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.874 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.874 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-04-01T07:05:58.874 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.874 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.875 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.875 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-04-01T07:05:58.875 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.875 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.875 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.875 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.875 INFO:teuthology.orchestra.run.smithi083.stdout: "registry_insecure": { 2024-04-01T07:05:58.875 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "registry_insecure", 2024-04-01T07:05:58.875 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.875 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.875 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.875 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.875 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.875 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.875 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.875 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-04-01T07:05:58.876 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.876 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.876 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.876 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.876 INFO:teuthology.orchestra.run.smithi083.stdout: "registry_password": { 2024-04-01T07:05:58.876 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "registry_password", 2024-04-01T07:05:58.876 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.876 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.876 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.876 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.876 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.876 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.876 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.877 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-04-01T07:05:58.877 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.877 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.877 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.877 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.877 INFO:teuthology.orchestra.run.smithi083.stdout: "registry_url": { 2024-04-01T07:05:58.877 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "registry_url", 2024-04-01T07:05:58.877 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.877 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.877 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.877 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.877 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.877 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.877 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.878 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-04-01T07:05:58.878 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.878 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.878 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.878 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.878 INFO:teuthology.orchestra.run.smithi083.stdout: "registry_username": { 2024-04-01T07:05:58.878 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "registry_username", 2024-04-01T07:05:58.878 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.878 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.878 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.878 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.878 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.878 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.879 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.879 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-04-01T07:05:58.879 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.879 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.879 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.879 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.879 INFO:teuthology.orchestra.run.smithi083.stdout: "secure_monitoring_stack": { 2024-04-01T07:05:58.879 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "secure_monitoring_stack", 2024-04-01T07:05:58.879 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.879 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.879 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.879 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.879 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.879 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.879 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.880 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-04-01T07:05:58.880 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.880 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.880 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.880 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.880 INFO:teuthology.orchestra.run.smithi083.stdout: "service_discovery_port": { 2024-04-01T07:05:58.880 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "service_discovery_port", 2024-04-01T07:05:58.880 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.880 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.880 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.880 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "8765", 2024-04-01T07:05:58.880 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.880 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.880 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.880 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "cephadm service discovery port", 2024-04-01T07:05:58.880 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.881 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.881 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.881 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.881 INFO:teuthology.orchestra.run.smithi083.stdout: "ssh_config_file": { 2024-04-01T07:05:58.881 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ssh_config_file", 2024-04-01T07:05:58.881 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.881 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.881 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.881 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.881 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.881 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.881 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.881 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-04-01T07:05:58.881 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.881 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.882 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.882 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.882 INFO:teuthology.orchestra.run.smithi083.stdout: "use_agent": { 2024-04-01T07:05:58.882 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "use_agent", 2024-04-01T07:05:58.882 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.882 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.882 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.882 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.882 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.882 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.882 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.882 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-04-01T07:05:58.882 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.882 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.883 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.883 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.883 INFO:teuthology.orchestra.run.smithi083.stdout: "use_repo_digest": { 2024-04-01T07:05:58.883 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "use_repo_digest", 2024-04-01T07:05:58.883 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.883 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.883 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.883 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.883 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.883 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.883 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.883 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-04-01T07:05:58.883 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.883 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.883 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.884 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.884 INFO:teuthology.orchestra.run.smithi083.stdout: "warn_on_failed_host_check": { 2024-04-01T07:05:58.884 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "warn_on_failed_host_check", 2024-04-01T07:05:58.884 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.884 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.884 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.884 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.884 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.884 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.884 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.884 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "raise a health warning if the host check fails", 2024-04-01T07:05:58.884 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.884 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.884 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.884 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.884 INFO:teuthology.orchestra.run.smithi083.stdout: "warn_on_stray_daemons": { 2024-04-01T07:05:58.885 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "warn_on_stray_daemons", 2024-04-01T07:05:58.885 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.885 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.885 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.885 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.885 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.885 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.885 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.885 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-04-01T07:05:58.885 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.885 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.885 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.885 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.885 INFO:teuthology.orchestra.run.smithi083.stdout: "warn_on_stray_hosts": { 2024-04-01T07:05:58.885 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "warn_on_stray_hosts", 2024-04-01T07:05:58.886 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.886 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.886 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.886 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.886 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.886 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.886 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.886 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-04-01T07:05:58.886 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.886 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.886 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.886 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.886 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.886 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.887 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.887 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "crash", 2024-04-01T07:05:58.887 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.887 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.887 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.887 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.887 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.887 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.887 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.887 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.887 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.887 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.887 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.888 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.888 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.888 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.888 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.888 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.888 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.888 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.888 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.888 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.888 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.888 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.888 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.888 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.888 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.888 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.889 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.889 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.889 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.889 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.889 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.889 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.889 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.889 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.889 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.889 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.889 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.889 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.889 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.889 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.890 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.890 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.890 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.890 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.890 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.890 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.890 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.890 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.890 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.890 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.890 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.890 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.890 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.890 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.891 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.891 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.891 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.891 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.891 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.891 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.891 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.891 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.891 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.891 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.891 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.891 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.891 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.891 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.891 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.891 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.892 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.892 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.892 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.892 INFO:teuthology.orchestra.run.smithi083.stdout: "retain_interval": { 2024-04-01T07:05:58.892 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "retain_interval", 2024-04-01T07:05:58.892 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:58.892 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.892 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.892 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "31536000", 2024-04-01T07:05:58.892 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.892 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.892 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.892 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how long to retain crashes before pruning them", 2024-04-01T07:05:58.892 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.893 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.893 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.893 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.893 INFO:teuthology.orchestra.run.smithi083.stdout: "warn_recent_interval": { 2024-04-01T07:05:58.893 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "warn_recent_interval", 2024-04-01T07:05:58.893 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:58.893 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.893 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.893 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "1209600", 2024-04-01T07:05:58.893 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.893 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.893 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.893 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "time interval in which to warn about recent crashes", 2024-04-01T07:05:58.894 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.894 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.894 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.894 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.894 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.894 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.894 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.894 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "dashboard", 2024-04-01T07:05:58.894 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.894 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.894 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.894 INFO:teuthology.orchestra.run.smithi083.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-04-01T07:05:58.894 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-04-01T07:05:58.894 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.895 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.895 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.895 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-04-01T07:05:58.895 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.895 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.895 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.895 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.895 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.895 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.895 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.895 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.895 INFO:teuthology.orchestra.run.smithi083.stdout: "ALERTMANAGER_API_HOST": { 2024-04-01T07:05:58.895 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ALERTMANAGER_API_HOST", 2024-04-01T07:05:58.895 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.895 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.895 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.896 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.896 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.896 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.896 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.896 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.896 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.896 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.896 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.896 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.896 INFO:teuthology.orchestra.run.smithi083.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-04-01T07:05:58.896 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-04-01T07:05:58.896 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.896 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.897 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.897 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.897 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.897 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.897 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.897 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.897 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.897 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.897 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.897 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.898 INFO:teuthology.orchestra.run.smithi083.stdout: "AUDIT_API_ENABLED": { 2024-04-01T07:05:58.898 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "AUDIT_API_ENABLED", 2024-04-01T07:05:58.898 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.898 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.898 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.898 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.898 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.898 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.898 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.898 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.898 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.898 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.898 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.899 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.899 INFO:teuthology.orchestra.run.smithi083.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-04-01T07:05:58.899 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-04-01T07:05:58.899 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.899 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.899 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.899 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.899 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.899 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.899 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.899 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.899 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.900 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.900 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.900 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.900 INFO:teuthology.orchestra.run.smithi083.stdout: "ENABLE_BROWSABLE_API": { 2024-04-01T07:05:58.900 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ENABLE_BROWSABLE_API", 2024-04-01T07:05:58.900 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.900 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.900 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.900 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.900 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.900 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.900 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.900 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.900 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.901 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.901 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.901 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.901 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-04-01T07:05:58.901 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-04-01T07:05:58.901 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.901 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.901 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.901 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.901 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.901 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.901 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.901 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.901 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.901 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.902 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.902 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.902 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-04-01T07:05:58.902 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-04-01T07:05:58.902 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.902 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.902 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.902 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.902 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.902 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.902 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.902 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.902 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.902 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.902 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.903 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.903 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-04-01T07:05:58.903 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-04-01T07:05:58.903 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.903 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.903 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.903 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.903 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.903 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.903 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.903 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.903 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.903 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.903 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.903 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.904 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-04-01T07:05:58.904 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-04-01T07:05:58.904 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.904 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.904 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.904 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.904 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.904 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.904 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.904 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.904 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.904 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.904 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.904 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.905 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_NFS": { 2024-04-01T07:05:58.905 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-04-01T07:05:58.905 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.905 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.905 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.905 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.905 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.905 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.905 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.905 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.905 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.905 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.905 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.905 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.905 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_RBD": { 2024-04-01T07:05:58.906 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-04-01T07:05:58.906 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.906 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.906 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.906 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.906 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.906 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.906 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.906 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.906 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.906 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.906 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.906 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.906 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_RGW": { 2024-04-01T07:05:58.907 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-04-01T07:05:58.907 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.907 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.907 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.907 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.907 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.907 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.907 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.907 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.907 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.907 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.907 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.907 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.908 INFO:teuthology.orchestra.run.smithi083.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-04-01T07:05:58.908 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-04-01T07:05:58.908 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.908 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.908 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.908 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.908 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.908 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.908 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.908 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.908 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.908 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.908 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.909 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.909 INFO:teuthology.orchestra.run.smithi083.stdout: "GRAFANA_API_PASSWORD": { 2024-04-01T07:05:58.909 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GRAFANA_API_PASSWORD", 2024-04-01T07:05:58.909 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.909 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.909 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.909 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "admin", 2024-04-01T07:05:58.909 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.909 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.909 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.909 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.909 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.909 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.910 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.910 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.910 INFO:teuthology.orchestra.run.smithi083.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-04-01T07:05:58.910 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-04-01T07:05:58.910 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.910 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.910 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.910 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.910 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.910 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.910 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.910 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.910 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.910 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.911 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.911 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.911 INFO:teuthology.orchestra.run.smithi083.stdout: "GRAFANA_API_URL": { 2024-04-01T07:05:58.911 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GRAFANA_API_URL", 2024-04-01T07:05:58.911 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.911 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.911 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.911 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.911 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.911 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.911 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.911 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.911 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.911 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.911 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.912 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.912 INFO:teuthology.orchestra.run.smithi083.stdout: "GRAFANA_API_USERNAME": { 2024-04-01T07:05:58.912 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GRAFANA_API_USERNAME", 2024-04-01T07:05:58.912 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.912 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.912 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.912 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "admin", 2024-04-01T07:05:58.912 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.912 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.912 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.912 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.912 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.912 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.913 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.913 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.913 INFO:teuthology.orchestra.run.smithi083.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-04-01T07:05:58.913 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-04-01T07:05:58.913 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.913 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.913 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.913 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.913 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.913 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.913 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.913 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.913 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.913 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.913 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.914 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.914 INFO:teuthology.orchestra.run.smithi083.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-04-01T07:05:58.914 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-04-01T07:05:58.914 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.914 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.914 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.914 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.914 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.914 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.914 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.914 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.914 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.914 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.915 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.915 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.915 INFO:teuthology.orchestra.run.smithi083.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-04-01T07:05:58.915 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-04-01T07:05:58.915 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.915 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.915 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.915 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.915 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.915 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.915 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.915 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.915 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.915 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.915 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.916 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.916 INFO:teuthology.orchestra.run.smithi083.stdout: "ISSUE_TRACKER_API_KEY": { 2024-04-01T07:05:58.916 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-04-01T07:05:58.916 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.916 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.916 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.916 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.916 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.916 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.916 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.916 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.916 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.916 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.916 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.917 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.917 INFO:teuthology.orchestra.run.smithi083.stdout: "PROMETHEUS_API_HOST": { 2024-04-01T07:05:58.917 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PROMETHEUS_API_HOST", 2024-04-01T07:05:58.917 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.917 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.917 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.917 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.917 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.917 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.917 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.917 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.917 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.917 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.917 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.918 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.918 INFO:teuthology.orchestra.run.smithi083.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-04-01T07:05:58.918 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-04-01T07:05:58.918 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.918 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.918 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.918 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.918 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.918 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.918 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.918 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.918 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.918 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.918 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.919 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.919 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-04-01T07:05:58.919 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-04-01T07:05:58.919 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.919 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.919 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.919 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.919 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.919 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.919 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.919 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.919 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.919 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.920 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.920 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.920 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-04-01T07:05:58.920 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-04-01T07:05:58.920 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.920 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.920 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.920 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.920 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.920 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.920 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.920 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.920 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.920 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.921 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.921 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.921 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-04-01T07:05:58.921 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-04-01T07:05:58.921 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.921 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.921 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.921 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.921 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.921 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.921 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.921 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.921 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.921 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.922 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.922 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.922 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-04-01T07:05:58.922 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-04-01T07:05:58.922 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.922 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.922 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.922 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.922 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.922 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.922 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.922 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.922 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.923 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.923 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.923 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.923 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-04-01T07:05:58.923 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-04-01T07:05:58.923 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.923 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.923 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.923 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.923 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.923 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.923 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.923 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.923 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.923 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.924 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.924 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.924 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-04-01T07:05:58.924 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-04-01T07:05:58.924 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.924 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.924 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.924 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.924 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.924 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.924 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.924 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.924 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.925 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.925 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.925 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.925 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-04-01T07:05:58.925 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-04-01T07:05:58.925 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.925 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.925 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.925 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.925 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.925 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.925 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.925 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.925 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.926 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.926 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.926 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.926 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_ENABLED": { 2024-04-01T07:05:58.926 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_ENABLED", 2024-04-01T07:05:58.926 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.926 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.926 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.926 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.926 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.926 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.926 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.926 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.926 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.927 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.927 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.927 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.927 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-04-01T07:05:58.927 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-04-01T07:05:58.927 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.927 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.927 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.927 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-04-01T07:05:58.927 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.927 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.927 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.927 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.927 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.927 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.927 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.928 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.928 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-04-01T07:05:58.928 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-04-01T07:05:58.928 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.928 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.928 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.928 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-04-01T07:05:58.928 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.928 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.928 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.928 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.928 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.928 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.928 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.928 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.929 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-04-01T07:05:58.929 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-04-01T07:05:58.929 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.929 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.929 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.929 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "8", 2024-04-01T07:05:58.929 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.929 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.929 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.929 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.929 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.929 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.929 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.929 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.929 INFO:teuthology.orchestra.run.smithi083.stdout: "REST_REQUESTS_TIMEOUT": { 2024-04-01T07:05:58.929 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-04-01T07:05:58.930 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.930 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.930 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.930 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "45", 2024-04-01T07:05:58.930 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.930 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.930 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.930 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.930 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.930 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.930 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.930 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.930 INFO:teuthology.orchestra.run.smithi083.stdout: "RGW_API_ACCESS_KEY": { 2024-04-01T07:05:58.931 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "RGW_API_ACCESS_KEY", 2024-04-01T07:05:58.931 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.931 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.931 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.931 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.931 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.931 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.931 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.931 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.931 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.931 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.931 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.931 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.931 INFO:teuthology.orchestra.run.smithi083.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-04-01T07:05:58.931 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-04-01T07:05:58.931 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.932 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.932 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.932 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "admin", 2024-04-01T07:05:58.932 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.932 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.932 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.932 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.932 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.932 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.932 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.932 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.932 INFO:teuthology.orchestra.run.smithi083.stdout: "RGW_API_SECRET_KEY": { 2024-04-01T07:05:58.932 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "RGW_API_SECRET_KEY", 2024-04-01T07:05:58.932 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.932 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.932 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.933 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.933 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.933 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.933 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.933 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.933 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.933 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.933 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.933 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.933 INFO:teuthology.orchestra.run.smithi083.stdout: "RGW_API_SSL_VERIFY": { 2024-04-01T07:05:58.933 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "RGW_API_SSL_VERIFY", 2024-04-01T07:05:58.933 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.933 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.933 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.934 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.934 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.934 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.934 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.934 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.934 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.934 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.934 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.934 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.934 INFO:teuthology.orchestra.run.smithi083.stdout: "UNSAFE_TLS_v1_2": { 2024-04-01T07:05:58.934 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "UNSAFE_TLS_v1_2", 2024-04-01T07:05:58.934 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.934 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.934 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.934 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.935 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.935 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.935 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.935 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.935 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.935 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.935 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.935 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.935 INFO:teuthology.orchestra.run.smithi083.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-04-01T07:05:58.935 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-04-01T07:05:58.935 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.935 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.935 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.935 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-04-01T07:05:58.935 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.936 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.936 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.936 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.936 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.936 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.936 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.936 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.936 INFO:teuthology.orchestra.run.smithi083.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-04-01T07:05:58.936 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-04-01T07:05:58.936 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.936 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.936 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.936 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-04-01T07:05:58.936 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.936 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.937 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.937 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.937 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.937 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.937 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.937 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.937 INFO:teuthology.orchestra.run.smithi083.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-04-01T07:05:58.937 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-04-01T07:05:58.937 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.937 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.937 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.937 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "5", 2024-04-01T07:05:58.937 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.937 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.938 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.938 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.938 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.938 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.938 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.938 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.938 INFO:teuthology.orchestra.run.smithi083.stdout: "cross_origin_url": { 2024-04-01T07:05:58.938 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "cross_origin_url", 2024-04-01T07:05:58.938 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.938 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.938 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.938 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.938 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.939 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.939 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.939 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.939 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.939 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.939 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.939 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.939 INFO:teuthology.orchestra.run.smithi083.stdout: "crt_file": { 2024-04-01T07:05:58.939 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "crt_file", 2024-04-01T07:05:58.939 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.939 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.939 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.939 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.939 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.939 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.940 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.940 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.940 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.940 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.940 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.940 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.940 INFO:teuthology.orchestra.run.smithi083.stdout: "debug": { 2024-04-01T07:05:58.940 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "debug", 2024-04-01T07:05:58.940 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.940 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.940 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.940 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.940 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.941 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.941 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.941 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Enable/disable debug options", 2024-04-01T07:05:58.941 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.941 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.941 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.941 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.941 INFO:teuthology.orchestra.run.smithi083.stdout: "jwt_token_ttl": { 2024-04-01T07:05:58.941 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "jwt_token_ttl", 2024-04-01T07:05:58.941 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.941 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.941 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.941 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "28800", 2024-04-01T07:05:58.941 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.941 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.942 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.942 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.942 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.942 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.942 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.942 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.942 INFO:teuthology.orchestra.run.smithi083.stdout: "key_file": { 2024-04-01T07:05:58.942 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "key_file", 2024-04-01T07:05:58.942 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.942 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.942 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.942 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.942 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.942 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.943 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.943 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.943 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.943 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.943 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.943 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.943 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.943 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.943 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.943 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.943 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.943 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.943 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.943 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.943 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.944 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.944 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.944 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.944 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.944 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.944 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.944 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.944 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.944 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.944 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.944 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.944 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.944 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.944 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.945 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.945 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.945 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.945 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.945 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.945 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.945 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.945 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.945 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.945 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.945 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.945 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.945 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.946 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.946 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.946 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.946 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.946 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.946 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.946 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.946 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.946 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.946 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.946 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.946 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.946 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.947 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.947 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.947 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.947 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.947 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.947 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.947 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.947 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.947 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.947 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.947 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.947 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.947 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.947 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.948 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.948 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.948 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.948 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.948 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.948 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.948 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.948 INFO:teuthology.orchestra.run.smithi083.stdout: "motd": { 2024-04-01T07:05:58.948 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "motd", 2024-04-01T07:05:58.948 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.948 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.948 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.948 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.948 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.948 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.949 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.949 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "The message of the day", 2024-04-01T07:05:58.949 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.949 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.949 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.949 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.949 INFO:teuthology.orchestra.run.smithi083.stdout: "redirect_resolve_ip_addr": { 2024-04-01T07:05:58.949 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "redirect_resolve_ip_addr", 2024-04-01T07:05:58.949 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.949 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.949 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.949 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.949 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.949 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.950 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.950 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.950 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.950 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.950 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.950 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.950 INFO:teuthology.orchestra.run.smithi083.stdout: "server_addr": { 2024-04-01T07:05:58.950 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "server_addr", 2024-04-01T07:05:58.950 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.950 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.950 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.950 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "::", 2024-04-01T07:05:58.950 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.950 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.951 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.951 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.951 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.951 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.951 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.951 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.951 INFO:teuthology.orchestra.run.smithi083.stdout: "server_port": { 2024-04-01T07:05:58.951 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "server_port", 2024-04-01T07:05:58.951 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.951 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.951 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.951 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "8080", 2024-04-01T07:05:58.951 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.951 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.952 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.952 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.952 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.952 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.952 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.952 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.952 INFO:teuthology.orchestra.run.smithi083.stdout: "ssl": { 2024-04-01T07:05:58.952 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ssl", 2024-04-01T07:05:58.952 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.952 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.952 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.952 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.952 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.952 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.953 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.953 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.953 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.953 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.953 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.953 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.953 INFO:teuthology.orchestra.run.smithi083.stdout: "ssl_server_port": { 2024-04-01T07:05:58.953 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ssl_server_port", 2024-04-01T07:05:58.953 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.953 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.953 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.953 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "8443", 2024-04-01T07:05:58.953 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.954 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.954 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.954 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.954 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.954 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.954 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.954 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.954 INFO:teuthology.orchestra.run.smithi083.stdout: "standby_behaviour": { 2024-04-01T07:05:58.954 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "standby_behaviour", 2024-04-01T07:05:58.954 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.954 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.954 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.954 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "redirect", 2024-04-01T07:05:58.954 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.955 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.955 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.955 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.955 INFO:teuthology.orchestra.run.smithi083.stdout: "redirect" 2024-04-01T07:05:58.955 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.955 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.955 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.955 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.955 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.955 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.955 INFO:teuthology.orchestra.run.smithi083.stdout: "standby_error_status_code": { 2024-04-01T07:05:58.955 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "standby_error_status_code", 2024-04-01T07:05:58.955 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.955 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.955 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.956 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "500", 2024-04-01T07:05:58.956 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "400", 2024-04-01T07:05:58.956 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "599", 2024-04-01T07:05:58.956 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.956 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.956 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.956 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.956 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.956 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.956 INFO:teuthology.orchestra.run.smithi083.stdout: "url_prefix": { 2024-04-01T07:05:58.956 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "url_prefix", 2024-04-01T07:05:58.956 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.956 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.956 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.956 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.957 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.957 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.957 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.957 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.957 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.957 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.957 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.957 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.957 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.957 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.957 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.957 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "devicehealth", 2024-04-01T07:05:58.957 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.957 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.957 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.958 INFO:teuthology.orchestra.run.smithi083.stdout: "enable_monitoring": { 2024-04-01T07:05:58.958 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "enable_monitoring", 2024-04-01T07:05:58.958 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.958 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.958 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.958 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.958 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.958 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.958 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.958 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "monitor device health metrics", 2024-04-01T07:05:58.958 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.958 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.958 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.958 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.958 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.959 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.959 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.959 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.959 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.959 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.959 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.959 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.959 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.959 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.959 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.959 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.959 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.959 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.959 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.959 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.959 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.960 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.960 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.960 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.960 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.960 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.960 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.960 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.960 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.960 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.960 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.960 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.960 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.960 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.960 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.961 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.961 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.961 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.961 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.961 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.961 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.961 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.961 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.961 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.961 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.961 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.961 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.961 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.961 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.961 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.962 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.962 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.962 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.962 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.962 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.962 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.962 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.962 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.962 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.962 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.962 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.962 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.962 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.962 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.962 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.963 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.963 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.963 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.963 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.963 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.963 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.963 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.963 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.963 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.963 INFO:teuthology.orchestra.run.smithi083.stdout: "mark_out_threshold": { 2024-04-01T07:05:58.963 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "mark_out_threshold", 2024-04-01T07:05:58.963 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:58.963 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.963 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.963 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "2419200", 2024-04-01T07:05:58.964 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.964 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.964 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.964 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-04-01T07:05:58.964 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.964 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.964 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.964 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.964 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_name": { 2024-04-01T07:05:58.964 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "pool_name", 2024-04-01T07:05:58.964 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.964 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.964 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.964 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "device_health_metrics", 2024-04-01T07:05:58.964 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.965 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.965 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.965 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "name of pool in which to store device health metrics", 2024-04-01T07:05:58.965 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.965 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.965 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.965 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.965 INFO:teuthology.orchestra.run.smithi083.stdout: "retention_period": { 2024-04-01T07:05:58.965 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "retention_period", 2024-04-01T07:05:58.965 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:58.965 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.965 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.965 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "15552000", 2024-04-01T07:05:58.965 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.966 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.966 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.966 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how long to retain device health metrics", 2024-04-01T07:05:58.966 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.966 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.966 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.966 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.966 INFO:teuthology.orchestra.run.smithi083.stdout: "scrape_frequency": { 2024-04-01T07:05:58.966 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "scrape_frequency", 2024-04-01T07:05:58.966 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:58.966 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.966 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.966 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "86400", 2024-04-01T07:05:58.966 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.966 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.967 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.967 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how frequently to scrape device health metrics", 2024-04-01T07:05:58.967 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.967 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.967 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.967 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.967 INFO:teuthology.orchestra.run.smithi083.stdout: "self_heal": { 2024-04-01T07:05:58.967 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "self_heal", 2024-04-01T07:05:58.967 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.967 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.967 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.967 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:58.967 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.967 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.967 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.968 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-04-01T07:05:58.968 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.968 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.968 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.968 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.968 INFO:teuthology.orchestra.run.smithi083.stdout: "sleep_interval": { 2024-04-01T07:05:58.968 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sleep_interval", 2024-04-01T07:05:58.968 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:58.968 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.968 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.968 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "600", 2024-04-01T07:05:58.968 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.968 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.968 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.968 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how frequently to wake up and check device health", 2024-04-01T07:05:58.969 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.969 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.969 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.969 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.969 INFO:teuthology.orchestra.run.smithi083.stdout: "warn_threshold": { 2024-04-01T07:05:58.969 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "warn_threshold", 2024-04-01T07:05:58.969 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:58.969 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.969 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.969 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "7257600", 2024-04-01T07:05:58.969 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.969 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.969 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.969 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-04-01T07:05:58.969 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.970 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.970 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.970 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.970 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.970 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.970 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.970 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "diskprediction_local", 2024-04-01T07:05:58.970 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.970 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.970 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.970 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.970 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.970 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.970 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.971 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.971 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.971 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.971 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.971 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.971 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.971 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.971 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.971 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.971 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.971 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.971 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.971 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.971 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.971 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.972 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.972 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.972 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.972 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.972 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.972 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.972 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.972 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.972 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.972 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.972 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.972 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.972 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.972 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.973 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.973 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.973 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.973 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.973 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.973 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.973 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.973 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.973 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.973 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.973 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.973 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.974 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.974 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.974 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.974 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.974 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.974 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.974 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.974 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.974 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.974 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.974 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.974 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.974 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.974 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.975 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.975 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.975 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.975 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.975 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.975 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.975 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.975 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.975 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.975 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.975 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.975 INFO:teuthology.orchestra.run.smithi083.stdout: "predict_interval": { 2024-04-01T07:05:58.975 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "predict_interval", 2024-04-01T07:05:58.976 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.976 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.976 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.976 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "86400", 2024-04-01T07:05:58.976 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.976 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.976 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.976 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.976 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.976 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.976 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.976 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.976 INFO:teuthology.orchestra.run.smithi083.stdout: "predictor_model": { 2024-04-01T07:05:58.976 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "predictor_model", 2024-04-01T07:05:58.976 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.977 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.977 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.977 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "prophetstor", 2024-04-01T07:05:58.977 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.977 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.977 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.977 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.977 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.977 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.977 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.977 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.977 INFO:teuthology.orchestra.run.smithi083.stdout: "sleep_interval": { 2024-04-01T07:05:58.977 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sleep_interval", 2024-04-01T07:05:58.977 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.977 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.977 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.978 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "600", 2024-04-01T07:05:58.978 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.978 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.978 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.978 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.978 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.978 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.978 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.978 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.978 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.978 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.978 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.978 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "influx", 2024-04-01T07:05:58.978 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": false, 2024-04-01T07:05:58.979 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "influxdb python module not found", 2024-04-01T07:05:58.979 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.979 INFO:teuthology.orchestra.run.smithi083.stdout: "batch_size": { 2024-04-01T07:05:58.979 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "batch_size", 2024-04-01T07:05:58.979 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.979 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.979 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.979 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "5000", 2024-04-01T07:05:58.979 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.979 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.979 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.979 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-04-01T07:05:58.979 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.979 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.980 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.980 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.980 INFO:teuthology.orchestra.run.smithi083.stdout: "database": { 2024-04-01T07:05:58.980 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "database", 2024-04-01T07:05:58.980 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.980 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.980 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.980 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "ceph", 2024-04-01T07:05:58.980 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.980 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.980 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.980 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-04-01T07:05:58.980 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.980 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.980 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.980 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.981 INFO:teuthology.orchestra.run.smithi083.stdout: "hostname": { 2024-04-01T07:05:58.981 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "hostname", 2024-04-01T07:05:58.981 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.981 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.981 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.981 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.981 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.981 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.981 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.981 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "InfluxDB server hostname", 2024-04-01T07:05:58.981 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.981 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.981 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.981 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.981 INFO:teuthology.orchestra.run.smithi083.stdout: "interval": { 2024-04-01T07:05:58.981 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "interval", 2024-04-01T07:05:58.982 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:58.982 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.982 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.982 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "30", 2024-04-01T07:05:58.982 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "5", 2024-04-01T07:05:58.982 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.982 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.982 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-04-01T07:05:58.982 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.982 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.982 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.982 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.982 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.982 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.982 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.983 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.983 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.983 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.983 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.983 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.983 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.983 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.983 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.983 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.983 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.983 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.983 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.983 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.983 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.984 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.984 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.984 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.984 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.984 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.984 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.984 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.984 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.984 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.984 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.984 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.984 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.984 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.984 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.984 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.984 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.985 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.985 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.985 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.985 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.985 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.985 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.985 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.985 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.985 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.985 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.985 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.985 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.985 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.985 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.985 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.985 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.986 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.986 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.986 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.986 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.986 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.986 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.986 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.986 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.986 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.986 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.986 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.986 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.986 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.986 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.986 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.987 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.987 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.987 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.987 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.987 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.987 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.987 INFO:teuthology.orchestra.run.smithi083.stdout: "password": { 2024-04-01T07:05:58.987 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "password", 2024-04-01T07:05:58.987 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.987 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.987 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.988 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.988 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.988 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.988 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.988 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "password of InfluxDB server user", 2024-04-01T07:05:58.988 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.988 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.988 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.988 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.988 INFO:teuthology.orchestra.run.smithi083.stdout: "port": { 2024-04-01T07:05:58.988 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "port", 2024-04-01T07:05:58.988 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.988 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.988 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.988 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "8086", 2024-04-01T07:05:58.988 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.989 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.989 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.989 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "InfluxDB server port", 2024-04-01T07:05:58.989 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.989 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.989 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.989 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.989 INFO:teuthology.orchestra.run.smithi083.stdout: "ssl": { 2024-04-01T07:05:58.989 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ssl", 2024-04-01T07:05:58.989 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.989 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.989 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.989 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "false", 2024-04-01T07:05:58.989 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.990 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.990 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.990 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-04-01T07:05:58.990 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.990 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.990 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.990 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.990 INFO:teuthology.orchestra.run.smithi083.stdout: "threads": { 2024-04-01T07:05:58.990 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "threads", 2024-04-01T07:05:58.990 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:58.990 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.990 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.990 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "5", 2024-04-01T07:05:58.991 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "1", 2024-04-01T07:05:58.991 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "32", 2024-04-01T07:05:58.991 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.991 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-04-01T07:05:58.991 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.991 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.991 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.991 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.991 INFO:teuthology.orchestra.run.smithi083.stdout: "username": { 2024-04-01T07:05:58.991 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "username", 2024-04-01T07:05:58.991 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.991 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.991 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.991 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.992 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.992 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.992 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.992 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "username of InfluxDB server user", 2024-04-01T07:05:58.992 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.992 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.992 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.992 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.992 INFO:teuthology.orchestra.run.smithi083.stdout: "verify_ssl": { 2024-04-01T07:05:58.992 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "verify_ssl", 2024-04-01T07:05:58.992 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.992 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.992 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:58.992 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "true", 2024-04-01T07:05:58.993 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.993 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.993 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.993 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-04-01T07:05:58.993 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.993 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.993 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.993 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.993 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.993 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.993 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.993 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "insights", 2024-04-01T07:05:58.993 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.994 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.994 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.994 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.994 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.994 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.994 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.994 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.994 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.994 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.994 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.994 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.994 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.994 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.994 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.995 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.995 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.995 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.995 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.995 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.995 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.995 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.995 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.995 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.995 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:58.995 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:58.995 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.995 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.995 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.995 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.996 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.996 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.996 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.996 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.996 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.996 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.996 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.996 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.996 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:58.996 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:58.996 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.996 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.996 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.997 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:58.997 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.997 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.997 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:58.997 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:58.997 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:58.997 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:58.997 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:58.997 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:58.997 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:58.997 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:58.997 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.997 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.997 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.997 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.997 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.998 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:58.998 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:58.998 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:58.998 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.998 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.998 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:58.998 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.998 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.998 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:58.998 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:58.998 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:58.998 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:58.998 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:58.998 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.999 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:58.999 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:58.999 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:58.999 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "iostat", 2024-04-01T07:05:58.999 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:58.999 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:58.999 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:58.999 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:58.999 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:58.999 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:58.999 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:58.999 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:58.999 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:58.999 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:58.999 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:58.999 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:59.000 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:59.000 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:59.000 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:59.000 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:59.000 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:59.000 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:59.000 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:59.000 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.000 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.000 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.000 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.000 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.000 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:59.000 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:59.000 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.000 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.001 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.001 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.001 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.001 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.001 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.001 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.001 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.001 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.001 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.001 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.001 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:59.001 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:59.001 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.001 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.001 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.002 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:59.002 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.002 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.002 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:59.002 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:59.002 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:59.002 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:59.002 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:59.002 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:59.002 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:59.002 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:59.002 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.002 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.002 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.003 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.003 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.003 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:59.003 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:59.003 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.003 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.003 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.003 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.003 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.003 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.003 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.003 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.003 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.003 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.004 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.004 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.004 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.004 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.004 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:59.004 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "k8sevents", 2024-04-01T07:05:59.004 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:59.004 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:59.004 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:59.004 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_event_retention_days": { 2024-04-01T07:05:59.004 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ceph_event_retention_days", 2024-04-01T07:05:59.004 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:59.004 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.004 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.005 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "7", 2024-04-01T07:05:59.005 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.005 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.005 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.005 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Days to hold ceph event information within local cache", 2024-04-01T07:05:59.005 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.005 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.005 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.005 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.005 INFO:teuthology.orchestra.run.smithi083.stdout: "config_check_secs": { 2024-04-01T07:05:59.005 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "config_check_secs", 2024-04-01T07:05:59.005 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:59.005 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.005 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.006 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-04-01T07:05:59.006 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "10", 2024-04-01T07:05:59.006 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.006 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.006 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-04-01T07:05:59.006 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.006 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.006 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.006 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.006 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:59.006 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:59.006 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.006 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.006 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.007 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:59.007 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.007 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.007 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:59.007 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:59.007 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:59.007 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:59.007 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:59.007 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:59.007 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:59.007 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:59.007 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.007 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.007 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.007 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.007 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.008 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:59.008 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:59.008 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.008 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.008 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.008 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.008 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.008 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.008 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.008 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.008 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.008 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.008 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.008 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.008 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:59.008 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:59.009 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.009 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.009 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.009 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:59.009 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.009 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.009 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:59.009 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:59.009 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:59.009 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:59.009 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:59.009 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:59.009 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:59.009 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:59.009 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.010 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.010 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.010 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.010 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.010 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:59.010 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:59.010 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.010 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.010 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.010 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.010 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.010 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.010 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.010 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.010 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.011 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.011 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.011 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.011 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.011 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.011 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:59.011 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "localpool", 2024-04-01T07:05:59.011 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:59.011 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:59.011 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:59.011 INFO:teuthology.orchestra.run.smithi083.stdout: "failure_domain": { 2024-04-01T07:05:59.011 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "failure_domain", 2024-04-01T07:05:59.011 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.011 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.012 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.012 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "host", 2024-04-01T07:05:59.012 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.012 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.012 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.012 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "failure domain for any created local pool", 2024-04-01T07:05:59.012 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-04-01T07:05:59.012 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.012 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.012 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.012 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:59.012 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:59.012 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.012 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.013 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.013 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:59.013 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.013 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.013 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:59.013 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:59.013 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:59.013 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:59.013 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:59.013 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:59.013 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:59.013 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:59.013 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.013 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.013 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.014 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.014 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.014 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:59.014 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:59.014 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.014 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.014 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.014 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.014 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.014 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.014 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.014 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.014 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.014 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.014 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.015 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.015 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:59.015 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:59.015 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.015 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.015 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.015 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:59.015 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.015 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.015 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:59.015 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:59.015 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:59.015 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:59.015 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:59.016 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:59.016 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:59.016 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:59.016 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.016 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.016 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.016 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.016 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.016 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:59.016 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:59.016 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.016 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.016 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.016 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.016 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.016 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.016 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.017 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.017 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.017 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.017 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.017 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.017 INFO:teuthology.orchestra.run.smithi083.stdout: "min_size": { 2024-04-01T07:05:59.017 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "min_size", 2024-04-01T07:05:59.017 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:59.017 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.017 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.017 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:59.017 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.017 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.017 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.017 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "default min_size for any created local pool", 2024-04-01T07:05:59.017 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-04-01T07:05:59.017 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.018 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.018 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.018 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rep": { 2024-04-01T07:05:59.018 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "num_rep", 2024-04-01T07:05:59.018 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:59.018 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.018 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.018 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "3", 2024-04-01T07:05:59.018 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.018 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.018 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.018 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "default replica count for any created local pool", 2024-04-01T07:05:59.018 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.018 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.018 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.018 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.019 INFO:teuthology.orchestra.run.smithi083.stdout: "pg_num": { 2024-04-01T07:05:59.019 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "pg_num", 2024-04-01T07:05:59.019 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:59.019 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.019 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.019 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "128", 2024-04-01T07:05:59.019 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.019 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.019 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.019 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "default pg_num for any created local pool", 2024-04-01T07:05:59.019 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.019 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.019 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.020 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.020 INFO:teuthology.orchestra.run.smithi083.stdout: "prefix": { 2024-04-01T07:05:59.020 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "prefix", 2024-04-01T07:05:59.020 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.020 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.020 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.020 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:59.020 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.020 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.020 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.020 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "name prefix for any created local pool", 2024-04-01T07:05:59.020 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.020 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.020 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.020 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.021 INFO:teuthology.orchestra.run.smithi083.stdout: "subtree": { 2024-04-01T07:05:59.021 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "subtree", 2024-04-01T07:05:59.021 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.021 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.021 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.021 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "rack", 2024-04-01T07:05:59.021 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.021 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.021 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.021 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "CRUSH level for which to create a local pool", 2024-04-01T07:05:59.021 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-04-01T07:05:59.021 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.021 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.021 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.021 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.022 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.022 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:59.022 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "mds_autoscaler", 2024-04-01T07:05:59.022 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:59.022 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:59.022 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:59.022 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:59.022 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:59.022 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.022 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.022 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.022 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:59.022 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.022 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.023 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:59.023 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:59.023 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:59.023 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:59.023 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:59.023 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:59.023 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:59.023 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:59.023 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.023 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.023 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.023 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.023 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.023 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:59.023 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:59.024 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.024 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.024 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.024 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.024 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.024 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.024 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.024 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.024 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.024 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.024 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.024 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.024 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:59.024 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:59.024 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.025 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.025 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.025 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:59.025 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.025 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.025 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:59.025 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:59.025 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:59.025 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:59.025 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:59.025 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:59.025 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:59.025 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:59.025 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.025 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.026 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.026 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.026 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.026 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:59.026 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:59.026 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.026 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.026 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.026 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.026 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.026 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.026 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.026 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.026 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.027 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.027 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.027 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.027 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.027 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.027 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:59.027 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "mirroring", 2024-04-01T07:05:59.027 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:59.027 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:59.027 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:59.027 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:59.027 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:59.027 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.027 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.027 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.028 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:59.028 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.028 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.028 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:59.028 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:59.028 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:59.028 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:59.028 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:59.028 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:59.028 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:59.028 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:59.028 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.028 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.029 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.029 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.029 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.029 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:59.029 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:59.029 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.029 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.029 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.029 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.029 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.029 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.029 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.029 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.029 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.029 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.030 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.030 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.030 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:59.030 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:59.030 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.030 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.030 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.030 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:59.030 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.030 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.030 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:59.030 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:59.030 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:59.030 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:59.031 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:59.031 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:59.031 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:59.031 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:59.031 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.031 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.031 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.031 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.031 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.031 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:59.031 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:59.031 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.031 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.031 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.032 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.032 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.032 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.032 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.032 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.032 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.032 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.032 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.032 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.032 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.032 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.032 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:59.032 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "nfs", 2024-04-01T07:05:59.032 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:59.032 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:59.033 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:59.033 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:59.033 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:59.033 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.033 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.033 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.033 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:59.033 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.033 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.033 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:59.033 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:59.033 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:59.033 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:59.033 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:59.033 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:59.033 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:59.034 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:59.034 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.034 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.034 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.034 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.034 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.034 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:59.034 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:59.034 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.034 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.034 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.034 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.034 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.034 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.034 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.035 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.035 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.035 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.035 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.035 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.035 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:59.035 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:59.035 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.035 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.035 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.035 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:59.035 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.035 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.035 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:59.035 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:59.036 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:59.036 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:59.036 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:59.036 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:59.036 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:59.036 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:59.036 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.036 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.036 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.036 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.036 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.036 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:59.036 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:59.036 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.036 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.037 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.037 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.037 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.037 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.037 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.037 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.037 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.037 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.037 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.037 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.037 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.037 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.037 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:59.037 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "orchestrator", 2024-04-01T07:05:59.037 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:59.038 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:59.038 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:59.038 INFO:teuthology.orchestra.run.smithi083.stdout: "fail_fs": { 2024-04-01T07:05:59.038 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "fail_fs", 2024-04-01T07:05:59.038 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.038 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.038 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.038 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.038 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.038 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.038 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.038 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-04-01T07:05:59.038 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.038 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.038 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.039 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.039 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:59.039 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:59.039 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.039 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.039 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.039 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:59.039 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.039 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.039 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:59.039 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:59.039 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:59.039 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:59.040 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:59.040 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:59.040 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:59.040 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:59.040 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.040 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.040 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.040 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.040 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.040 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:59.040 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:59.040 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.040 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.040 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.040 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.041 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.041 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.041 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.041 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.041 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.041 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.041 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.041 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.041 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:59.041 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:59.041 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.041 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.041 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.041 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:59.041 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.042 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.042 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:59.042 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:59.042 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:59.042 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:59.042 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:59.042 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:59.042 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:59.042 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:59.042 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.042 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.042 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.042 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.043 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.043 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:59.043 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:59.043 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.043 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.043 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.043 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.043 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.043 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.043 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.043 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.043 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.043 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.043 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.043 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.044 INFO:teuthology.orchestra.run.smithi083.stdout: "orchestrator": { 2024-04-01T07:05:59.044 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "orchestrator", 2024-04-01T07:05:59.044 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.044 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.044 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.044 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:59.044 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.044 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.044 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:59.044 INFO:teuthology.orchestra.run.smithi083.stdout: "cephadm", 2024-04-01T07:05:59.044 INFO:teuthology.orchestra.run.smithi083.stdout: "rook", 2024-04-01T07:05:59.044 INFO:teuthology.orchestra.run.smithi083.stdout: "test_orchestrator" 2024-04-01T07:05:59.044 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:59.044 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Orchestrator backend", 2024-04-01T07:05:59.044 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.044 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.045 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.045 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.045 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.045 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.045 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:59.045 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "osd_perf_query", 2024-04-01T07:05:59.045 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:59.045 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:59.045 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:59.045 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:59.045 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:59.045 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.045 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.045 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.045 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:59.046 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.046 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.046 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:59.046 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:59.046 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:59.046 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:59.046 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:59.046 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:59.046 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:59.046 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:59.046 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.046 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.046 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.046 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.047 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.047 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:59.047 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:59.047 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.047 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.047 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.047 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.047 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.047 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.047 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.047 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.047 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.047 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.047 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.047 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.047 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:59.047 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:59.048 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.048 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.048 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.048 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:59.048 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.048 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.048 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:59.048 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:59.048 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:59.048 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:59.048 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:59.048 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:59.048 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:59.048 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:59.048 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.049 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.049 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.049 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.049 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.049 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:59.049 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:59.049 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.049 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.049 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.049 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.049 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.049 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.049 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.049 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.049 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.049 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.049 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.050 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.050 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.050 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.050 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:59.050 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "osd_support", 2024-04-01T07:05:59.050 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:59.050 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:59.050 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:59.050 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:59.050 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:59.050 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.050 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.050 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.050 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:59.050 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.051 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.051 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:59.051 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:59.051 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:59.051 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:59.051 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:59.051 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:59.051 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:59.051 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:59.051 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.051 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.051 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.051 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.051 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.051 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:59.051 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:59.051 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.052 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.052 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.052 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.052 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.052 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.052 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.052 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.052 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.052 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.052 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.052 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.052 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:59.052 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:59.053 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.053 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.053 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.053 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:59.053 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.053 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.053 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:59.053 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:59.053 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:59.053 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:59.053 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:59.053 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:59.053 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:59.054 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:59.054 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.054 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.054 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.054 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.054 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.054 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:59.054 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:59.054 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.054 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.054 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.054 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.054 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.054 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.055 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.055 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.055 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.055 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.055 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.055 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.055 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.055 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.055 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:59.055 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "pg_autoscaler", 2024-04-01T07:05:59.055 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:59.055 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:59.055 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:59.056 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:59.056 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:59.056 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.056 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.056 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.056 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:59.056 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.056 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.056 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:59.056 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:59.056 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:59.056 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:59.056 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:59.057 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:59.057 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:59.057 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:59.057 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.057 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.057 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.057 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.057 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.057 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:59.057 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:59.057 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.057 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.057 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.057 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.057 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.058 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.058 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.058 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.058 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.058 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.058 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.058 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.058 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:59.058 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:59.058 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.058 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.058 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.058 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:59.059 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.059 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.059 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:59.059 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:59.059 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:59.059 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:59.059 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:59.059 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:59.059 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:59.059 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:59.059 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.059 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.059 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.059 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.059 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.060 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:59.060 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:59.060 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.060 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.060 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.060 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.060 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.060 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.060 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.060 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.060 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.060 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.060 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.060 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.061 INFO:teuthology.orchestra.run.smithi083.stdout: "sleep_interval": { 2024-04-01T07:05:59.061 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sleep_interval", 2024-04-01T07:05:59.061 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:59.061 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.061 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.061 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "60", 2024-04-01T07:05:59.061 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.061 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.061 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.061 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.061 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.061 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.061 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.061 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.062 INFO:teuthology.orchestra.run.smithi083.stdout: "threshold": { 2024-04-01T07:05:59.062 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "threshold", 2024-04-01T07:05:59.062 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-04-01T07:05:59.062 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.062 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.062 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "3.0", 2024-04-01T07:05:59.062 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "1.0", 2024-04-01T07:05:59.062 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.062 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.062 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "scaling threshold", 2024-04-01T07:05:59.062 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-04-01T07:05:59.062 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.063 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.063 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.063 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.063 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.063 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:59.063 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "progress", 2024-04-01T07:05:59.063 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:59.063 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:59.063 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:59.063 INFO:teuthology.orchestra.run.smithi083.stdout: "allow_pg_recovery_event": { 2024-04-01T07:05:59.063 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "allow_pg_recovery_event", 2024-04-01T07:05:59.063 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.063 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.063 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.064 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.064 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.064 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.064 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.064 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "allow the module to show pg recovery progress", 2024-04-01T07:05:59.064 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.064 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.064 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.064 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.064 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": { 2024-04-01T07:05:59.064 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "enabled", 2024-04-01T07:05:59.064 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.064 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.064 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.064 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:59.065 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.065 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.065 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.065 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.065 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.065 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.065 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.065 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.065 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:59.065 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:59.065 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.065 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.065 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.065 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:59.065 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.066 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.066 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:59.066 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:59.066 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:59.066 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:59.066 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:59.066 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:59.066 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:59.066 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:59.066 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.066 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.066 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.066 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.066 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.067 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:59.067 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:59.067 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.067 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.067 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.067 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.067 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.067 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.067 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.067 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.067 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.067 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.067 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.067 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.067 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:59.068 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:59.068 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.068 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.068 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.068 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:59.068 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.068 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.068 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:59.068 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:59.068 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:59.068 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:59.068 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:59.068 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:59.068 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:59.068 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:59.069 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.069 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.069 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.069 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.069 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.069 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:59.069 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:59.069 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.069 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.069 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.069 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.069 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.069 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.069 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.070 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.070 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.070 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.070 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.070 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.070 INFO:teuthology.orchestra.run.smithi083.stdout: "max_completed_events": { 2024-04-01T07:05:59.070 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "max_completed_events", 2024-04-01T07:05:59.070 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:59.070 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.070 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.070 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "50", 2024-04-01T07:05:59.070 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.070 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.070 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.071 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "number of past completed events to remember", 2024-04-01T07:05:59.071 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.071 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.071 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.071 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.071 INFO:teuthology.orchestra.run.smithi083.stdout: "sleep_interval": { 2024-04-01T07:05:59.071 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sleep_interval", 2024-04-01T07:05:59.071 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:59.071 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.071 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.071 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "5", 2024-04-01T07:05:59.071 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.071 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.071 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.071 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how long the module is going to sleep", 2024-04-01T07:05:59.072 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.072 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.072 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.072 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.072 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.072 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.072 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:59.072 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "prometheus", 2024-04-01T07:05:59.072 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:59.072 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:59.072 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:59.072 INFO:teuthology.orchestra.run.smithi083.stdout: "cache": { 2024-04-01T07:05:59.072 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "cache", 2024-04-01T07:05:59.072 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.073 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.073 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.073 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:59.073 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.073 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.073 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.073 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.073 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.073 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.073 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.073 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.073 INFO:teuthology.orchestra.run.smithi083.stdout: "exclude_perf_counters": { 2024-04-01T07:05:59.073 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "exclude_perf_counters", 2024-04-01T07:05:59.073 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.074 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.074 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.074 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:59.074 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.074 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.074 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.074 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-04-01T07:05:59.074 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-04-01T07:05:59.074 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.074 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.074 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.074 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:59.075 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:59.075 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.075 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.075 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.075 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:59.075 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.075 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.075 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:59.075 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:59.075 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:59.075 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:59.075 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:59.075 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:59.075 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:59.075 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:59.076 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.076 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.076 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.076 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.076 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.076 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:59.076 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:59.076 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.076 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.076 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.076 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.076 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.076 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.076 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.077 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.077 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.077 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.077 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.077 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.077 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:59.077 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:59.077 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.077 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.077 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.077 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:59.077 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.077 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.077 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:59.077 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:59.077 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:59.078 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:59.078 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:59.078 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:59.078 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:59.078 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:59.078 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.078 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.078 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.078 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.078 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.078 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:59.078 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:59.078 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.078 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.079 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.079 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.079 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.079 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.079 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.079 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.079 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.079 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.079 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.079 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.079 INFO:teuthology.orchestra.run.smithi083.stdout: "rbd_stats_pools": { 2024-04-01T07:05:59.079 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rbd_stats_pools", 2024-04-01T07:05:59.079 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.079 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.079 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.079 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:59.080 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.080 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.080 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.080 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.080 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.080 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.080 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.080 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.080 INFO:teuthology.orchestra.run.smithi083.stdout: "rbd_stats_pools_refresh_interval": { 2024-04-01T07:05:59.080 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-04-01T07:05:59.080 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:59.080 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.080 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.080 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "300", 2024-04-01T07:05:59.080 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.081 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.081 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.081 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.081 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.081 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.081 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.081 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.081 INFO:teuthology.orchestra.run.smithi083.stdout: "scrape_interval": { 2024-04-01T07:05:59.081 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "scrape_interval", 2024-04-01T07:05:59.081 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-04-01T07:05:59.081 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.081 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.081 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "15.0", 2024-04-01T07:05:59.081 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.081 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.081 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.082 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.082 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.082 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.082 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.082 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.082 INFO:teuthology.orchestra.run.smithi083.stdout: "server_addr": { 2024-04-01T07:05:59.082 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "server_addr", 2024-04-01T07:05:59.082 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.082 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.082 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.082 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "::", 2024-04-01T07:05:59.082 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.082 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.082 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.083 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-04-01T07:05:59.083 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.083 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.083 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.083 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.083 INFO:teuthology.orchestra.run.smithi083.stdout: "server_port": { 2024-04-01T07:05:59.083 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "server_port", 2024-04-01T07:05:59.083 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:59.083 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.083 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.083 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "9283", 2024-04-01T07:05:59.083 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.083 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.083 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.083 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-04-01T07:05:59.083 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.083 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.084 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.084 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.084 INFO:teuthology.orchestra.run.smithi083.stdout: "stale_cache_strategy": { 2024-04-01T07:05:59.084 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "stale_cache_strategy", 2024-04-01T07:05:59.084 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.084 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.084 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.084 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "log", 2024-04-01T07:05:59.084 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.084 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.084 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.084 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.084 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.084 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.084 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.084 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.085 INFO:teuthology.orchestra.run.smithi083.stdout: "standby_behaviour": { 2024-04-01T07:05:59.085 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "standby_behaviour", 2024-04-01T07:05:59.085 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.085 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.085 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.085 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "default", 2024-04-01T07:05:59.085 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.085 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.085 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:59.085 INFO:teuthology.orchestra.run.smithi083.stdout: "default", 2024-04-01T07:05:59.085 INFO:teuthology.orchestra.run.smithi083.stdout: "error" 2024-04-01T07:05:59.085 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:59.085 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.085 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.085 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.085 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.086 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.086 INFO:teuthology.orchestra.run.smithi083.stdout: "standby_error_status_code": { 2024-04-01T07:05:59.086 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "standby_error_status_code", 2024-04-01T07:05:59.086 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:59.086 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.086 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.086 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "500", 2024-04-01T07:05:59.086 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "400", 2024-04-01T07:05:59.086 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "599", 2024-04-01T07:05:59.086 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.086 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.086 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.086 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.086 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.086 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.087 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.087 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.087 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:59.087 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rbd_support", 2024-04-01T07:05:59.087 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:59.087 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:59.087 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:59.087 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:59.087 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:59.087 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.087 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.087 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.087 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:59.087 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.087 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.088 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:59.088 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:59.088 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:59.088 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:59.088 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:59.088 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:59.088 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:59.088 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:59.088 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.088 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.088 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.088 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.088 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.088 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:59.089 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:59.089 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.089 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.089 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.089 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.089 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.089 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.089 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.089 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.089 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.089 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.089 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.089 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.090 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:59.090 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:59.090 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.090 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.090 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.090 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:59.090 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.090 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.090 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:59.090 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:59.090 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:59.090 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:59.090 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:59.090 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:59.091 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:59.091 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:59.091 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.091 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.091 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.091 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.091 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.091 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:59.091 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:59.091 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.091 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.091 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.091 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.092 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.092 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.092 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.092 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.092 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.092 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.092 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.092 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.092 INFO:teuthology.orchestra.run.smithi083.stdout: "max_concurrent_snap_create": { 2024-04-01T07:05:59.092 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "max_concurrent_snap_create", 2024-04-01T07:05:59.092 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:59.092 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.092 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.093 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-04-01T07:05:59.093 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.093 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.093 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.093 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.093 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.093 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.093 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.093 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.093 INFO:teuthology.orchestra.run.smithi083.stdout: "mirror_snapshot_schedule": { 2024-04-01T07:05:59.093 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "mirror_snapshot_schedule", 2024-04-01T07:05:59.093 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.093 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.093 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.094 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:59.094 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.094 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.094 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.094 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.094 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.094 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.094 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.094 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.094 INFO:teuthology.orchestra.run.smithi083.stdout: "trash_purge_schedule": { 2024-04-01T07:05:59.094 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "trash_purge_schedule", 2024-04-01T07:05:59.094 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.094 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.094 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.094 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:59.095 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.095 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.095 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.095 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.095 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.095 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.095 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.095 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.095 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.095 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.095 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:59.095 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "restful", 2024-04-01T07:05:59.095 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:59.095 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:59.095 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:59.095 INFO:teuthology.orchestra.run.smithi083.stdout: "enable_auth": { 2024-04-01T07:05:59.096 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "enable_auth", 2024-04-01T07:05:59.096 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.096 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.096 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.096 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:59.096 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.096 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.096 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.096 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.096 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.096 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.096 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.096 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.096 INFO:teuthology.orchestra.run.smithi083.stdout: "key_file": { 2024-04-01T07:05:59.096 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "key_file", 2024-04-01T07:05:59.096 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.097 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.097 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.097 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:59.097 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.097 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.097 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.097 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.097 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.097 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.097 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.097 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.097 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:59.097 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:59.097 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.097 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.097 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.098 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:59.098 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.098 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.098 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:59.098 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:59.098 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:59.098 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:59.098 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:59.098 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:59.098 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:59.098 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:59.098 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.098 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.098 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.098 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.099 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.099 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:59.099 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:59.099 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.099 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.099 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.099 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.099 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.099 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.099 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.099 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.099 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.099 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.099 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.099 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.099 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:59.100 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:59.100 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.100 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.100 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.100 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:59.100 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.100 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.100 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:59.100 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:59.100 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:59.100 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:59.100 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:59.100 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:59.100 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:59.100 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:59.100 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.101 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.101 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.101 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.101 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.101 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:59.101 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:59.101 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.101 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.101 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.101 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.101 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.101 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.101 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.101 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.101 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.101 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.102 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.102 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.102 INFO:teuthology.orchestra.run.smithi083.stdout: "server_addr": { 2024-04-01T07:05:59.102 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "server_addr", 2024-04-01T07:05:59.102 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.102 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.102 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.102 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:59.102 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.102 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.102 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.102 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.102 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.103 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.103 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.103 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.103 INFO:teuthology.orchestra.run.smithi083.stdout: "server_port": { 2024-04-01T07:05:59.103 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "server_port", 2024-04-01T07:05:59.103 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.103 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.103 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.103 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:59.103 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.103 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.103 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.103 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.103 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.103 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.104 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.104 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.104 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.104 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.104 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:59.104 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rgw", 2024-04-01T07:05:59.104 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:59.104 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:59.104 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:59.104 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:59.104 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:59.104 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.104 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.104 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.104 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:59.104 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.105 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.105 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:59.105 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:59.105 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:59.105 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:59.105 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:59.105 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:59.105 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:59.105 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:59.105 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.105 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.105 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.105 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.105 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.106 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:59.106 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:59.106 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.106 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.106 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.106 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.106 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.106 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.106 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.106 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.106 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.106 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.106 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.106 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.107 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:59.107 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:59.107 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.107 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.107 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.107 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:59.107 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.107 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.107 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:59.107 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:59.107 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:59.107 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:59.107 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:59.107 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:59.107 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:59.107 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:59.108 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.108 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.108 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.108 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.108 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.108 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:59.108 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:59.108 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.108 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.108 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.108 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.108 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.108 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.108 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.109 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.109 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.109 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.109 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.109 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.109 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.109 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.109 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:59.109 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rook", 2024-04-01T07:05:59.109 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:59.109 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:59.109 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:59.109 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:59.109 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:59.109 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.110 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.110 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.110 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:59.110 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.110 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.110 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:59.110 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:59.110 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:59.110 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:59.110 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:59.110 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:59.110 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:59.110 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:59.110 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.111 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.111 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.111 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.111 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.111 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:59.111 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:59.111 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.111 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.111 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.111 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.111 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.111 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.111 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.111 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.111 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.112 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.112 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.112 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.112 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:59.112 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:59.112 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.112 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.112 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.112 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:59.112 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.112 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.112 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:59.112 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:59.112 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:59.112 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:59.112 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:59.113 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:59.113 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:59.113 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:59.113 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.113 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.113 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.113 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.113 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.113 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:59.113 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:59.113 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.113 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.114 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.114 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.114 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.114 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.114 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.114 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.114 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.114 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.114 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.114 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.114 INFO:teuthology.orchestra.run.smithi083.stdout: "storage_class": { 2024-04-01T07:05:59.114 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "storage_class", 2024-04-01T07:05:59.114 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.114 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.115 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.115 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "local", 2024-04-01T07:05:59.115 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.115 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.115 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.115 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-04-01T07:05:59.115 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.115 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.115 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.115 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.115 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.115 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.115 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:59.115 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "selftest", 2024-04-01T07:05:59.115 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:59.115 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:59.116 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:59.116 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:59.116 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:59.116 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.116 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.116 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.116 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:59.116 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.116 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.116 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:59.116 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:59.116 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:59.116 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:59.116 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:59.117 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:59.117 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:59.117 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:59.117 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.117 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.117 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.117 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.117 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.117 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:59.117 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:59.117 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.117 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.117 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.117 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.118 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.118 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.118 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.118 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.118 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.118 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.118 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.118 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.118 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:59.118 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:59.118 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.118 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.118 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.118 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:59.119 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.119 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.119 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:59.119 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:59.119 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:59.119 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:59.119 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:59.119 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:59.119 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:59.119 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:59.119 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.119 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.119 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.119 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.120 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.120 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:59.120 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:59.120 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.120 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.120 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.120 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.120 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.120 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.120 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.120 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.120 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.120 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.120 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.121 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.121 INFO:teuthology.orchestra.run.smithi083.stdout: "roption1": { 2024-04-01T07:05:59.121 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "roption1", 2024-04-01T07:05:59.121 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.121 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.121 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.121 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:59.121 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.121 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.121 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.121 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.121 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.121 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.121 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.122 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.122 INFO:teuthology.orchestra.run.smithi083.stdout: "roption2": { 2024-04-01T07:05:59.122 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "roption2", 2024-04-01T07:05:59.122 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.122 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.122 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.122 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "xyz", 2024-04-01T07:05:59.122 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.122 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.122 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.122 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.122 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.122 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.122 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.123 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.123 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption1": { 2024-04-01T07:05:59.123 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption1", 2024-04-01T07:05:59.123 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.123 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.123 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.123 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:59.123 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.123 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.123 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.123 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.123 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.123 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.123 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.124 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.124 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption2": { 2024-04-01T07:05:59.124 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption2", 2024-04-01T07:05:59.124 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:59.124 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.124 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.124 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:59.124 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.124 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.124 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.124 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.124 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.125 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.125 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.125 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.125 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption3": { 2024-04-01T07:05:59.125 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption3", 2024-04-01T07:05:59.125 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-04-01T07:05:59.125 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.125 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.125 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:59.125 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.125 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.125 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.125 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.125 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.125 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.126 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.126 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.126 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption4": { 2024-04-01T07:05:59.126 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption4", 2024-04-01T07:05:59.126 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.126 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.126 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.126 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:59.126 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.126 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.126 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.126 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.126 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.126 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.127 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.127 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.127 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption5": { 2024-04-01T07:05:59.127 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption5", 2024-04-01T07:05:59.127 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.127 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.127 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.127 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:59.127 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.127 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.127 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.127 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.127 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.127 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.128 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.128 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.128 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption6": { 2024-04-01T07:05:59.128 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption6", 2024-04-01T07:05:59.128 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.128 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.128 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.128 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:59.128 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.128 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.128 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.128 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.128 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.128 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.128 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.129 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.129 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption7": { 2024-04-01T07:05:59.129 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption7", 2024-04-01T07:05:59.129 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:59.129 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.129 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.129 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:59.129 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "1", 2024-04-01T07:05:59.129 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "42", 2024-04-01T07:05:59.129 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.129 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.129 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.129 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.129 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.129 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.130 INFO:teuthology.orchestra.run.smithi083.stdout: "testkey": { 2024-04-01T07:05:59.130 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "testkey", 2024-04-01T07:05:59.130 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.130 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.130 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.130 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:59.130 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.130 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.130 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.130 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.130 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.130 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.130 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.130 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.130 INFO:teuthology.orchestra.run.smithi083.stdout: "testlkey": { 2024-04-01T07:05:59.131 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "testlkey", 2024-04-01T07:05:59.131 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.131 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.131 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.131 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:59.131 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.131 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.131 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.131 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.131 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.131 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.131 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.131 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.131 INFO:teuthology.orchestra.run.smithi083.stdout: "testnewline": { 2024-04-01T07:05:59.131 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "testnewline", 2024-04-01T07:05:59.131 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.131 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.132 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.132 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:59.132 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.132 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.132 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.132 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.132 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.132 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.132 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.132 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.132 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.132 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.132 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:59.132 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "snap_schedule", 2024-04-01T07:05:59.132 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:59.132 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:59.132 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:59.133 INFO:teuthology.orchestra.run.smithi083.stdout: "allow_m_granularity": { 2024-04-01T07:05:59.133 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "allow_m_granularity", 2024-04-01T07:05:59.133 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.133 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.133 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.133 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.133 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.133 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.133 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.133 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "allow minute scheduled snapshots", 2024-04-01T07:05:59.133 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.133 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.133 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.133 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.134 INFO:teuthology.orchestra.run.smithi083.stdout: "dump_on_update": { 2024-04-01T07:05:59.134 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "dump_on_update", 2024-04-01T07:05:59.134 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.134 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.134 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.134 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.134 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.134 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.134 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.134 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "dump database to debug log on update", 2024-04-01T07:05:59.134 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.134 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.134 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.134 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.135 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:59.135 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:59.135 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.135 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.135 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.135 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:59.135 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.135 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.135 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:59.135 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:59.135 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:59.135 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:59.135 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:59.135 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:59.136 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:59.136 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:59.136 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.136 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.136 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.136 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.136 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.136 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:59.136 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:59.136 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.136 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.136 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.136 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.136 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.137 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.137 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.137 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.137 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.137 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.137 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.137 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.137 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:59.137 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:59.137 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.137 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.137 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.137 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:59.137 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.137 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.138 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:59.138 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:59.138 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:59.138 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:59.138 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:59.138 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:59.138 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:59.138 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:59.138 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.138 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.138 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.138 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.138 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.138 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:59.139 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:59.139 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.139 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.139 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.139 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.139 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.139 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.139 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.139 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.139 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.139 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.139 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.139 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.139 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.140 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.140 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:59.140 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "stats", 2024-04-01T07:05:59.140 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:59.140 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:59.140 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:59.140 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:59.140 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:59.140 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.140 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.140 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.140 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:59.140 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.140 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.141 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:59.141 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:59.141 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:59.141 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:59.141 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:59.141 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:59.141 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:59.141 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:59.141 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.141 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.141 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.141 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.141 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.141 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:59.142 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:59.142 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.142 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.142 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.142 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.142 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.142 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.142 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.142 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.142 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.142 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.142 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.142 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.142 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:59.143 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:59.143 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.143 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.143 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.143 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:59.143 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.143 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.143 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:59.143 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:59.143 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:59.143 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:59.143 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:59.143 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:59.143 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:59.144 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:59.144 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.144 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.144 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.144 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.144 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.144 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:59.144 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:59.144 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.144 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.144 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.144 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.144 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.144 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.145 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.145 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.145 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.145 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.145 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.145 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.145 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.145 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.145 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:59.145 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "status", 2024-04-01T07:05:59.145 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:59.145 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:59.145 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:59.145 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:59.145 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:59.146 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.146 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.146 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.146 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:59.146 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.146 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.146 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:59.146 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:59.146 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:59.146 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:59.146 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:59.146 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:59.146 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:59.147 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:59.147 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.147 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.147 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.147 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.147 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.147 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:59.147 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:59.147 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.147 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.147 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.147 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.147 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.147 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.147 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.148 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.148 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.148 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.148 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.148 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.148 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:59.148 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:59.148 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.148 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.148 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.148 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:59.148 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.148 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.148 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:59.148 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:59.149 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:59.149 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:59.149 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:59.149 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:59.149 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:59.149 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:59.149 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.149 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.149 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.149 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.149 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.149 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:59.149 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:59.149 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.149 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.150 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.150 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.150 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.150 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.150 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.150 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.150 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.150 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.150 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.150 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.150 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.150 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.150 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:59.150 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "telegraf", 2024-04-01T07:05:59.151 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:59.151 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:59.151 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:59.151 INFO:teuthology.orchestra.run.smithi083.stdout: "address": { 2024-04-01T07:05:59.151 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "address", 2024-04-01T07:05:59.151 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.151 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.151 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.151 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-04-01T07:05:59.151 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.151 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.151 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.151 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.151 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.152 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.152 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.152 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.152 INFO:teuthology.orchestra.run.smithi083.stdout: "interval": { 2024-04-01T07:05:59.152 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "interval", 2024-04-01T07:05:59.152 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:59.152 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.152 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.152 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "15", 2024-04-01T07:05:59.152 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.152 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.152 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.152 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.152 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.152 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.153 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.153 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.153 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:59.153 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:59.153 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.153 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.153 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.153 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:59.153 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.153 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.153 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:59.153 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:59.153 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:59.153 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:59.153 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:59.154 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:59.154 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:59.154 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:59.154 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.154 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.154 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.154 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.154 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.154 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:59.154 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:59.154 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.154 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.154 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.154 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.155 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.155 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.155 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.155 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.155 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.155 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.155 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.155 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.155 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:59.155 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:59.155 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.155 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.155 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.155 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:59.155 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.156 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.156 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:59.156 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:59.156 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:59.156 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:59.156 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:59.156 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:59.156 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:59.156 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:59.156 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.156 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.156 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.156 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.156 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.156 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:59.157 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:59.157 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.157 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.157 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.157 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.157 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.157 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.157 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.157 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.157 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.157 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.157 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.157 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.157 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.157 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.157 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:59.158 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "telemetry", 2024-04-01T07:05:59.158 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:59.158 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:59.158 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:59.158 INFO:teuthology.orchestra.run.smithi083.stdout: "channel_basic": { 2024-04-01T07:05:59.158 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "channel_basic", 2024-04-01T07:05:59.158 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.158 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.158 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.158 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:59.158 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.158 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.158 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.158 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Share basic cluster information (size, version)", 2024-04-01T07:05:59.158 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.158 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.159 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.159 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.159 INFO:teuthology.orchestra.run.smithi083.stdout: "channel_crash": { 2024-04-01T07:05:59.159 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "channel_crash", 2024-04-01T07:05:59.159 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.159 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.159 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.159 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:59.159 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.159 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.159 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.159 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-04-01T07:05:59.159 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.159 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.159 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.159 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.160 INFO:teuthology.orchestra.run.smithi083.stdout: "channel_device": { 2024-04-01T07:05:59.160 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "channel_device", 2024-04-01T07:05:59.160 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.160 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.160 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.160 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:59.160 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.160 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.160 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.160 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-04-01T07:05:59.160 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.160 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.160 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.160 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.160 INFO:teuthology.orchestra.run.smithi083.stdout: "channel_ident": { 2024-04-01T07:05:59.160 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "channel_ident", 2024-04-01T07:05:59.161 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.161 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.161 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.161 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.161 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.161 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.161 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.161 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-04-01T07:05:59.161 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.161 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.161 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.161 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.161 INFO:teuthology.orchestra.run.smithi083.stdout: "channel_perf": { 2024-04-01T07:05:59.162 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "channel_perf", 2024-04-01T07:05:59.162 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.162 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.162 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.162 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.162 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.162 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.162 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.162 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Share various performance metrics of a cluster", 2024-04-01T07:05:59.162 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.162 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.162 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.162 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.162 INFO:teuthology.orchestra.run.smithi083.stdout: "contact": { 2024-04-01T07:05:59.163 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "contact", 2024-04-01T07:05:59.163 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.163 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.163 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.163 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:59.163 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.163 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.163 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.163 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.163 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.163 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.163 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.163 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.163 INFO:teuthology.orchestra.run.smithi083.stdout: "description": { 2024-04-01T07:05:59.163 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "description", 2024-04-01T07:05:59.163 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.164 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.164 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.164 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:59.164 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.164 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.164 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.164 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.164 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.164 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.164 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.164 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.164 INFO:teuthology.orchestra.run.smithi083.stdout: "device_url": { 2024-04-01T07:05:59.164 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "device_url", 2024-04-01T07:05:59.164 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.165 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.165 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.165 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-04-01T07:05:59.165 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.165 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.165 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.165 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.165 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.165 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.165 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.165 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.165 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": { 2024-04-01T07:05:59.165 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "enabled", 2024-04-01T07:05:59.165 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.165 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.165 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.165 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.166 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.166 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.166 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.166 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.166 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.166 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.166 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.166 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.166 INFO:teuthology.orchestra.run.smithi083.stdout: "interval": { 2024-04-01T07:05:59.166 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "interval", 2024-04-01T07:05:59.166 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:59.166 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.166 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.166 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "24", 2024-04-01T07:05:59.166 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "8", 2024-04-01T07:05:59.167 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.167 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.167 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.167 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.167 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.167 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.167 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.167 INFO:teuthology.orchestra.run.smithi083.stdout: "last_opt_revision": { 2024-04-01T07:05:59.167 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "last_opt_revision", 2024-04-01T07:05:59.167 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:59.167 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.167 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.167 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "1", 2024-04-01T07:05:59.167 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.167 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.167 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.168 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.168 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.168 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.168 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.168 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.168 INFO:teuthology.orchestra.run.smithi083.stdout: "leaderboard": { 2024-04-01T07:05:59.168 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "leaderboard", 2024-04-01T07:05:59.168 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.168 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.168 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.168 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.168 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.168 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.168 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.168 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.169 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.169 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.169 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.169 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.169 INFO:teuthology.orchestra.run.smithi083.stdout: "leaderboard_description": { 2024-04-01T07:05:59.169 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "leaderboard_description", 2024-04-01T07:05:59.169 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.169 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.169 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.169 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:59.169 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.169 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.169 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.169 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.169 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.170 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.170 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.170 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.170 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:59.170 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:59.170 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.170 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.170 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.170 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:59.170 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.170 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.170 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:59.170 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:59.171 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:59.171 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:59.171 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:59.171 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:59.171 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:59.171 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:59.171 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.171 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.171 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.171 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.171 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.171 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:59.171 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:59.171 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.171 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.172 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.172 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.172 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.172 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.172 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.172 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.172 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.172 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.172 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.172 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.172 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:59.172 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:59.172 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.172 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.173 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.173 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:59.173 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.173 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.173 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:59.173 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:59.173 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:59.173 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:59.173 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:59.173 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:59.173 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:59.173 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:59.173 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.173 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.173 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.174 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.174 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.174 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:59.174 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:59.174 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.174 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.174 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.174 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.174 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.174 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.174 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.174 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.174 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.174 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.174 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.175 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.175 INFO:teuthology.orchestra.run.smithi083.stdout: "organization": { 2024-04-01T07:05:59.175 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "organization", 2024-04-01T07:05:59.175 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.175 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.175 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.175 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:59.175 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.175 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.175 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.175 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.175 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.175 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.175 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.175 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.176 INFO:teuthology.orchestra.run.smithi083.stdout: "proxy": { 2024-04-01T07:05:59.176 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "proxy", 2024-04-01T07:05:59.176 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.176 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.176 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.176 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:59.176 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.176 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.176 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.176 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.176 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.176 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.176 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.176 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.176 INFO:teuthology.orchestra.run.smithi083.stdout: "url": { 2024-04-01T07:05:59.177 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "url", 2024-04-01T07:05:59.177 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.177 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.177 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.177 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-04-01T07:05:59.177 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.177 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.177 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.177 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.177 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.177 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.177 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.177 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.177 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.177 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.178 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:59.178 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "test_orchestrator", 2024-04-01T07:05:59.178 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:59.178 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:59.178 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:59.178 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:59.178 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:59.178 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.178 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.178 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.178 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:59.178 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.178 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.178 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:59.178 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:59.179 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:59.179 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:59.179 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:59.179 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:59.179 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:59.179 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:59.179 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.179 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.179 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.179 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.179 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.179 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:59.179 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:59.179 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.179 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.180 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.180 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.180 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.180 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.180 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.180 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.180 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.180 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.180 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.180 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.180 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:59.180 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:59.180 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.180 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.180 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.180 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:59.181 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.181 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.181 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:59.181 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:59.181 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:59.181 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:59.181 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:59.181 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:59.181 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:59.181 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:59.181 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.181 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.181 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.181 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.181 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.181 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:59.182 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:59.182 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.182 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.182 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.182 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.182 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.182 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.182 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.182 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.182 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.182 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.182 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.182 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.182 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.182 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.183 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:59.183 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "volumes", 2024-04-01T07:05:59.183 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:59.183 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:59.183 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:59.183 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:59.183 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:59.183 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.183 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.183 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.183 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:59.183 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.183 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.183 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:59.184 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:59.184 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:59.184 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:59.184 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:59.184 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:59.184 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:59.184 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:59.184 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.184 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.184 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.184 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.184 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.184 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:59.184 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:59.184 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.184 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.185 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.185 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.185 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.185 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.185 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.185 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.185 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.185 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.185 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.185 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.185 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:59.185 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:59.185 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.185 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.185 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.185 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:59.186 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.186 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.186 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:59.186 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:59.186 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:59.186 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:59.186 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:59.186 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:59.186 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:59.186 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:59.186 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.186 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.186 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.186 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.187 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.187 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:59.187 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:59.187 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.187 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.187 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.187 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.187 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.187 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.187 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.187 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.187 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.187 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.187 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.187 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.187 INFO:teuthology.orchestra.run.smithi083.stdout: "max_concurrent_clones": { 2024-04-01T07:05:59.188 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "max_concurrent_clones", 2024-04-01T07:05:59.188 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:59.188 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.188 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.188 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "4", 2024-04-01T07:05:59.188 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.188 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.188 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.188 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Number of asynchronous cloner threads", 2024-04-01T07:05:59.188 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.188 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.188 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.188 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.188 INFO:teuthology.orchestra.run.smithi083.stdout: "snapshot_clone_delay": { 2024-04-01T07:05:59.188 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "snapshot_clone_delay", 2024-04-01T07:05:59.189 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:59.189 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.189 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.189 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-04-01T07:05:59.189 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.189 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.189 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.189 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-04-01T07:05:59.189 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.189 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.189 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.189 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.189 INFO:teuthology.orchestra.run.smithi083.stdout: "snapshot_clone_no_wait": { 2024-04-01T07:05:59.189 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "snapshot_clone_no_wait", 2024-04-01T07:05:59.189 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.190 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.190 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.190 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-04-01T07:05:59.190 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.190 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.190 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.190 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-04-01T07:05:59.190 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.190 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.190 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.190 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.190 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.190 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.190 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:59.191 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "zabbix", 2024-04-01T07:05:59.191 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-04-01T07:05:59.191 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-04-01T07:05:59.191 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-04-01T07:05:59.191 INFO:teuthology.orchestra.run.smithi083.stdout: "discovery_interval": { 2024-04-01T07:05:59.191 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "discovery_interval", 2024-04-01T07:05:59.191 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "uint", 2024-04-01T07:05:59.191 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.191 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.191 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "100", 2024-04-01T07:05:59.191 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.191 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.191 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.191 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.192 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.192 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.192 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.192 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.192 INFO:teuthology.orchestra.run.smithi083.stdout: "identifier": { 2024-04-01T07:05:59.192 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "identifier", 2024-04-01T07:05:59.192 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.192 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.192 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.192 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:59.192 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.192 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.192 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.192 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.192 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.193 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.193 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.193 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.193 INFO:teuthology.orchestra.run.smithi083.stdout: "interval": { 2024-04-01T07:05:59.193 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "interval", 2024-04-01T07:05:59.193 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-04-01T07:05:59.193 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.193 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.193 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "60", 2024-04-01T07:05:59.193 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.193 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.193 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.193 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.193 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.194 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.194 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.194 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.194 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-04-01T07:05:59.194 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-04-01T07:05:59.194 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.194 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.194 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.194 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:59.194 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.194 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.194 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:59.194 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:59.194 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:59.195 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:59.195 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:59.195 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:59.195 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:59.195 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:59.195 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.195 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.195 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.195 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.195 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.195 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-04-01T07:05:59.195 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-04-01T07:05:59.195 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.195 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.196 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.196 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.196 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.196 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.196 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.196 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.196 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.196 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.196 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.196 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.196 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-04-01T07:05:59.196 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-04-01T07:05:59.196 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.196 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.196 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.196 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-04-01T07:05:59.197 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.197 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.197 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-04-01T07:05:59.197 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-04-01T07:05:59.197 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-04-01T07:05:59.197 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-04-01T07:05:59.197 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-04-01T07:05:59.197 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-04-01T07:05:59.197 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-04-01T07:05:59.197 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:59.197 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.197 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.197 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.197 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.198 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.198 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-04-01T07:05:59.198 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-04-01T07:05:59.198 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-04-01T07:05:59.198 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.198 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-04-01T07:05:59.198 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-04-01T07:05:59.198 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.198 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.198 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.198 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.198 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.198 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.198 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.199 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.199 INFO:teuthology.orchestra.run.smithi083.stdout: "zabbix_host": { 2024-04-01T07:05:59.199 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "zabbix_host", 2024-04-01T07:05:59.199 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.199 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.199 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.199 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-04-01T07:05:59.199 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.199 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.199 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.199 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.199 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.199 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.199 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.199 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.200 INFO:teuthology.orchestra.run.smithi083.stdout: "zabbix_port": { 2024-04-01T07:05:59.200 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "zabbix_port", 2024-04-01T07:05:59.200 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-04-01T07:05:59.200 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.200 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.200 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10051", 2024-04-01T07:05:59.200 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.200 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.200 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.200 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.200 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.200 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.200 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.200 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.200 INFO:teuthology.orchestra.run.smithi083.stdout: "zabbix_sender": { 2024-04-01T07:05:59.201 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "zabbix_sender", 2024-04-01T07:05:59.201 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-04-01T07:05:59.201 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-04-01T07:05:59.201 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-04-01T07:05:59.201 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-04-01T07:05:59.201 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-04-01T07:05:59.201 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-04-01T07:05:59.201 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-04-01T07:05:59.201 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-04-01T07:05:59.201 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-04-01T07:05:59.201 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-04-01T07:05:59.201 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-04-01T07:05:59.201 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.201 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.201 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.202 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:59.202 INFO:teuthology.orchestra.run.smithi083.stdout: "services": { 2024-04-01T07:05:59.202 INFO:teuthology.orchestra.run.smithi083.stdout: "dashboard": "https://172.21.15.83:8443/" 2024-04-01T07:05:59.202 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.202 INFO:teuthology.orchestra.run.smithi083.stdout: "always_on_modules": { 2024-04-01T07:05:59.202 INFO:teuthology.orchestra.run.smithi083.stdout: "octopus": [ 2024-04-01T07:05:59.202 INFO:teuthology.orchestra.run.smithi083.stdout: "balancer", 2024-04-01T07:05:59.202 INFO:teuthology.orchestra.run.smithi083.stdout: "crash", 2024-04-01T07:05:59.202 INFO:teuthology.orchestra.run.smithi083.stdout: "devicehealth", 2024-04-01T07:05:59.202 INFO:teuthology.orchestra.run.smithi083.stdout: "orchestrator", 2024-04-01T07:05:59.202 INFO:teuthology.orchestra.run.smithi083.stdout: "pg_autoscaler", 2024-04-01T07:05:59.202 INFO:teuthology.orchestra.run.smithi083.stdout: "progress", 2024-04-01T07:05:59.202 INFO:teuthology.orchestra.run.smithi083.stdout: "rbd_support", 2024-04-01T07:05:59.202 INFO:teuthology.orchestra.run.smithi083.stdout: "status", 2024-04-01T07:05:59.203 INFO:teuthology.orchestra.run.smithi083.stdout: "telemetry", 2024-04-01T07:05:59.203 INFO:teuthology.orchestra.run.smithi083.stdout: "volumes" 2024-04-01T07:05:59.203 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:59.203 INFO:teuthology.orchestra.run.smithi083.stdout: "pacific": [ 2024-04-01T07:05:59.203 INFO:teuthology.orchestra.run.smithi083.stdout: "balancer", 2024-04-01T07:05:59.203 INFO:teuthology.orchestra.run.smithi083.stdout: "crash", 2024-04-01T07:05:59.203 INFO:teuthology.orchestra.run.smithi083.stdout: "devicehealth", 2024-04-01T07:05:59.203 INFO:teuthology.orchestra.run.smithi083.stdout: "orchestrator", 2024-04-01T07:05:59.203 INFO:teuthology.orchestra.run.smithi083.stdout: "pg_autoscaler", 2024-04-01T07:05:59.203 INFO:teuthology.orchestra.run.smithi083.stdout: "progress", 2024-04-01T07:05:59.203 INFO:teuthology.orchestra.run.smithi083.stdout: "rbd_support", 2024-04-01T07:05:59.203 INFO:teuthology.orchestra.run.smithi083.stdout: "status", 2024-04-01T07:05:59.203 INFO:teuthology.orchestra.run.smithi083.stdout: "telemetry", 2024-04-01T07:05:59.203 INFO:teuthology.orchestra.run.smithi083.stdout: "volumes" 2024-04-01T07:05:59.204 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:59.204 INFO:teuthology.orchestra.run.smithi083.stdout: "quincy": [ 2024-04-01T07:05:59.204 INFO:teuthology.orchestra.run.smithi083.stdout: "balancer", 2024-04-01T07:05:59.204 INFO:teuthology.orchestra.run.smithi083.stdout: "crash", 2024-04-01T07:05:59.204 INFO:teuthology.orchestra.run.smithi083.stdout: "devicehealth", 2024-04-01T07:05:59.204 INFO:teuthology.orchestra.run.smithi083.stdout: "orchestrator", 2024-04-01T07:05:59.204 INFO:teuthology.orchestra.run.smithi083.stdout: "pg_autoscaler", 2024-04-01T07:05:59.204 INFO:teuthology.orchestra.run.smithi083.stdout: "progress", 2024-04-01T07:05:59.204 INFO:teuthology.orchestra.run.smithi083.stdout: "rbd_support", 2024-04-01T07:05:59.204 INFO:teuthology.orchestra.run.smithi083.stdout: "status", 2024-04-01T07:05:59.204 INFO:teuthology.orchestra.run.smithi083.stdout: "telemetry", 2024-04-01T07:05:59.204 INFO:teuthology.orchestra.run.smithi083.stdout: "volumes" 2024-04-01T07:05:59.204 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-04-01T07:05:59.204 INFO:teuthology.orchestra.run.smithi083.stdout: "reef": [ 2024-04-01T07:05:59.204 INFO:teuthology.orchestra.run.smithi083.stdout: "balancer", 2024-04-01T07:05:59.205 INFO:teuthology.orchestra.run.smithi083.stdout: "crash", 2024-04-01T07:05:59.205 INFO:teuthology.orchestra.run.smithi083.stdout: "devicehealth", 2024-04-01T07:05:59.205 INFO:teuthology.orchestra.run.smithi083.stdout: "orchestrator", 2024-04-01T07:05:59.205 INFO:teuthology.orchestra.run.smithi083.stdout: "pg_autoscaler", 2024-04-01T07:05:59.205 INFO:teuthology.orchestra.run.smithi083.stdout: "progress", 2024-04-01T07:05:59.205 INFO:teuthology.orchestra.run.smithi083.stdout: "rbd_support", 2024-04-01T07:05:59.205 INFO:teuthology.orchestra.run.smithi083.stdout: "status", 2024-04-01T07:05:59.205 INFO:teuthology.orchestra.run.smithi083.stdout: "telemetry", 2024-04-01T07:05:59.205 INFO:teuthology.orchestra.run.smithi083.stdout: "volumes" 2024-04-01T07:05:59.205 INFO:teuthology.orchestra.run.smithi083.stdout: ] 2024-04-01T07:05:59.205 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.205 INFO:teuthology.orchestra.run.smithi083.stdout: "last_failure_osd_epoch": 82, 2024-04-01T07:05:59.205 INFO:teuthology.orchestra.run.smithi083.stdout: "active_clients": [ 2024-04-01T07:05:59.205 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:59.206 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "devicehealth", 2024-04-01T07:05:59.206 INFO:teuthology.orchestra.run.smithi083.stdout: "addrvec": [ 2024-04-01T07:05:59.206 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:59.206 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "v2", 2024-04-01T07:05:59.206 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": "172.21.15.83:0", 2024-04-01T07:05:59.206 INFO:teuthology.orchestra.run.smithi083.stdout: "nonce": 549152720 2024-04-01T07:05:59.206 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.206 INFO:teuthology.orchestra.run.smithi083.stdout: ] 2024-04-01T07:05:59.206 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.206 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:59.206 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "libcephsqlite", 2024-04-01T07:05:59.206 INFO:teuthology.orchestra.run.smithi083.stdout: "addrvec": [ 2024-04-01T07:05:59.206 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:59.207 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "v2", 2024-04-01T07:05:59.207 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": "172.21.15.83:0", 2024-04-01T07:05:59.207 INFO:teuthology.orchestra.run.smithi083.stdout: "nonce": 465963511 2024-04-01T07:05:59.207 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.207 INFO:teuthology.orchestra.run.smithi083.stdout: ] 2024-04-01T07:05:59.207 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.207 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:59.207 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rbd_support", 2024-04-01T07:05:59.207 INFO:teuthology.orchestra.run.smithi083.stdout: "addrvec": [ 2024-04-01T07:05:59.207 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:59.207 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "v2", 2024-04-01T07:05:59.207 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": "172.21.15.83:0", 2024-04-01T07:05:59.207 INFO:teuthology.orchestra.run.smithi083.stdout: "nonce": 2494756602 2024-04-01T07:05:59.207 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.207 INFO:teuthology.orchestra.run.smithi083.stdout: ] 2024-04-01T07:05:59.207 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.208 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:59.208 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "snap_schedule", 2024-04-01T07:05:59.208 INFO:teuthology.orchestra.run.smithi083.stdout: "addrvec": [ 2024-04-01T07:05:59.208 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:59.208 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "v2", 2024-04-01T07:05:59.208 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": "172.21.15.83:0", 2024-04-01T07:05:59.208 INFO:teuthology.orchestra.run.smithi083.stdout: "nonce": 2422012016 2024-04-01T07:05:59.208 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.208 INFO:teuthology.orchestra.run.smithi083.stdout: ] 2024-04-01T07:05:59.208 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.208 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:59.208 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "snap_schedule", 2024-04-01T07:05:59.208 INFO:teuthology.orchestra.run.smithi083.stdout: "addrvec": [ 2024-04-01T07:05:59.208 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:59.208 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "v2", 2024-04-01T07:05:59.208 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": "172.21.15.83:0", 2024-04-01T07:05:59.209 INFO:teuthology.orchestra.run.smithi083.stdout: "nonce": 3545650544 2024-04-01T07:05:59.209 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.209 INFO:teuthology.orchestra.run.smithi083.stdout: ] 2024-04-01T07:05:59.209 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:05:59.209 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:59.209 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "volumes", 2024-04-01T07:05:59.209 INFO:teuthology.orchestra.run.smithi083.stdout: "addrvec": [ 2024-04-01T07:05:59.209 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-04-01T07:05:59.209 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "v2", 2024-04-01T07:05:59.209 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": "172.21.15.83:0", 2024-04-01T07:05:59.209 INFO:teuthology.orchestra.run.smithi083.stdout: "nonce": 1648201089 2024-04-01T07:05:59.209 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.209 INFO:teuthology.orchestra.run.smithi083.stdout: ] 2024-04-01T07:05:59.209 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:05:59.209 INFO:teuthology.orchestra.run.smithi083.stdout: ] 2024-04-01T07:05:59.209 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-04-01T07:05:59.211 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:05:57 smithi145 ceph-mon[47816]: from='client.16302 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T07:05:59.211 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:05:57 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/2441472694' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-01T07:05:59.211 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:05:57 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/2307748566' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-01T07:05:59.211 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:05:57 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/2071384766' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-01T07:05:59.211 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:05:57 smithi153 ceph-mon[48187]: from='client.16302 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T07:05:59.211 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:05:57 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/2441472694' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-01T07:05:59.211 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:05:57 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/2307748566' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-01T07:05:59.212 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:05:57 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/2071384766' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-01T07:05:59.212 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:05:58 smithi153 ceph-mon[48187]: pgmap v313: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-01T07:05:59.212 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:05:58 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/2713236444' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-04-01T07:05:59.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.967+0000 7f4a7919f700 1 -- 172.21.15.83:0/2713236444 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f4a5c0a1290 msgr2=0x7f4a5c0a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:05:59.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.967+0000 7f4a7919f700 1 --2- 172.21.15.83:0/2713236444 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f4a5c0a1290 0x7f4a5c0a3750 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4a68005fd0 tx=0x7f4a6800a560 comp rx=0 tx=0).stop 2024-04-01T07:05:59.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.967+0000 7f4a7919f700 1 -- 172.21.15.83:0/2713236444 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4a74102710 msgr2=0x7f4a741997f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:05:59.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.967+0000 7f4a7919f700 1 --2- 172.21.15.83:0/2713236444 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4a74102710 0x7f4a741997f0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f4a64000c00 tx=0x7f4a64005e80 comp rx=0 tx=0).stop 2024-04-01T07:05:59.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.967+0000 7f4a7919f700 1 -- 172.21.15.83:0/2713236444 shutdown_connections 2024-04-01T07:05:59.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.967+0000 7f4a7919f700 1 --2- 172.21.15.83:0/2713236444 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f4a5c0a1290 0x7f4a5c0a3750 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:59.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.967+0000 7f4a7919f700 1 --2- 172.21.15.83:0/2713236444 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a7410b210 0x7f4a7419db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:59.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.967+0000 7f4a7919f700 1 --2- 172.21.15.83:0/2713236444 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4a74101df0 0x7f4a741992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:59.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.967+0000 7f4a7919f700 1 --2- 172.21.15.83:0/2713236444 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4a74102710 0x7f4a741997f0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:05:59.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.967+0000 7f4a7919f700 1 -- 172.21.15.83:0/2713236444 >> 172.21.15.83:0/2713236444 conn(0x7f4a740fb5f0 msgr2=0x7f4a74100b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T07:05:59.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.968+0000 7f4a7919f700 1 -- 172.21.15.83:0/2713236444 shutdown_connections 2024-04-01T07:05:59.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:05:57.968+0000 7f4a7919f700 1 -- 172.21.15.83:0/2713236444 wait complete. 2024-04-01T07:05:59.218 DEBUG:tasks.check_counter:Getting stats from a 2024-04-01T07:05:59.219 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph daemon mds.a perf dump 2024-04-01T07:05:59.219 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:05:57 smithi083 ceph-mon[43429]: from='client.16302 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-01T07:05:59.219 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:05:57 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/2441472694' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-01T07:05:59.219 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:05:57 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/2307748566' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-01T07:05:59.219 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:05:57 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/2071384766' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-01T07:05:59.248 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:05:58 smithi083 ceph-mon[43429]: pgmap v313: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-01T07:05:59.248 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:05:58 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/2713236444' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-04-01T07:05:59.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:05:58 smithi145 ceph-mon[47816]: pgmap v313: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-04-01T07:05:59.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:05:58 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/2713236444' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-04-01T07:05:59.450 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T07:06:00.464 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-04-01T07:06:00.464 INFO:teuthology.orchestra.run.smithi083.stdout: "AsyncMessenger::Worker-0": { 2024-04-01T07:06:00.464 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_messages": 202, 2024-04-01T07:06:00.464 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages": 190, 2024-04-01T07:06:00.464 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_bytes": 1419232, 2024-04-01T07:06:00.464 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_bytes": 107424, 2024-04-01T07:06:00.464 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_created_connections": 4, 2024-04-01T07:06:00.464 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_active_connections": 0, 2024-04-01T07:06:00.464 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_total_time": 0.037602351, 2024-04-01T07:06:00.464 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_send_time": 0.011694517, 2024-04-01T07:06:00.464 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_recv_time": 0.028329871, 2024-04-01T07:06:00.464 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_fast_dispatch_time": 0.004007167, 2024-04-01T07:06:00.464 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages_queue_lat": { 2024-04-01T07:06:00.465 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 190, 2024-04-01T07:06:00.465 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.012639820, 2024-04-01T07:06:00.465 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000066525 2024-04-01T07:06:00.465 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:06:00.465 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_handle_ack_lat": { 2024-04-01T07:06:00.465 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-04-01T07:06:00.465 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-04-01T07:06:00.465 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-04-01T07:06:00.465 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:06:00.465 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_encrypted_bytes": 1419232, 2024-04-01T07:06:00.465 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_encrypted_bytes": 107424 2024-04-01T07:06:00.465 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:06:00.465 INFO:teuthology.orchestra.run.smithi083.stdout: "AsyncMessenger::Worker-1": { 2024-04-01T07:06:00.465 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_messages": 2, 2024-04-01T07:06:00.465 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages": 145, 2024-04-01T07:06:00.466 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_bytes": 320, 2024-04-01T07:06:00.466 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_bytes": 177728, 2024-04-01T07:06:00.466 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_created_connections": 5, 2024-04-01T07:06:00.466 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_active_connections": 3, 2024-04-01T07:06:00.466 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_total_time": 0.011703939, 2024-04-01T07:06:00.466 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_send_time": 0.007630247, 2024-04-01T07:06:00.466 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_recv_time": 0.001970202, 2024-04-01T07:06:00.466 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-01T07:06:00.466 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages_queue_lat": { 2024-04-01T07:06:00.466 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 142, 2024-04-01T07:06:00.466 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.010046151, 2024-04-01T07:06:00.466 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000070747 2024-04-01T07:06:00.466 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:06:00.467 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_handle_ack_lat": { 2024-04-01T07:06:00.467 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-04-01T07:06:00.467 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-04-01T07:06:00.467 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-04-01T07:06:00.467 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:06:00.467 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_encrypted_bytes": 320, 2024-04-01T07:06:00.467 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_encrypted_bytes": 177728 2024-04-01T07:06:00.467 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:06:00.467 INFO:teuthology.orchestra.run.smithi083.stdout: "AsyncMessenger::Worker-2": { 2024-04-01T07:06:00.467 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_messages": 0, 2024-04-01T07:06:00.467 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages": 2, 2024-04-01T07:06:00.467 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_bytes": 0, 2024-04-01T07:06:00.467 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_bytes": 0, 2024-04-01T07:06:00.467 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_created_connections": 2, 2024-04-01T07:06:00.467 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_active_connections": 1, 2024-04-01T07:06:00.467 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_total_time": 0.000384528, 2024-04-01T07:06:00.468 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_send_time": 0.000000000, 2024-04-01T07:06:00.468 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_recv_time": 0.000309823, 2024-04-01T07:06:00.468 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-01T07:06:00.468 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages_queue_lat": { 2024-04-01T07:06:00.468 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-04-01T07:06:00.468 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-04-01T07:06:00.468 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-04-01T07:06:00.468 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:06:00.468 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_handle_ack_lat": { 2024-04-01T07:06:00.468 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-04-01T07:06:00.468 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-04-01T07:06:00.468 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-04-01T07:06:00.468 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:06:00.468 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-01T07:06:00.468 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_encrypted_bytes": 0 2024-04-01T07:06:00.469 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:06:00.469 INFO:teuthology.orchestra.run.smithi083.stdout: "cct": { 2024-04-01T07:06:00.469 INFO:teuthology.orchestra.run.smithi083.stdout: "total_workers": 0, 2024-04-01T07:06:00.469 INFO:teuthology.orchestra.run.smithi083.stdout: "unhealthy_workers": 0 2024-04-01T07:06:00.469 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:06:00.469 INFO:teuthology.orchestra.run.smithi083.stdout: "mempool": { 2024-04-01T07:06:00.469 INFO:teuthology.orchestra.run.smithi083.stdout: "bloom_filter_bytes": 0, 2024-04-01T07:06:00.469 INFO:teuthology.orchestra.run.smithi083.stdout: "bloom_filter_items": 0, 2024-04-01T07:06:00.469 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_alloc_bytes": 0, 2024-04-01T07:06:00.469 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_alloc_items": 0, 2024-04-01T07:06:00.469 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_data_bytes": 0, 2024-04-01T07:06:00.469 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_data_items": 0, 2024-04-01T07:06:00.470 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-01T07:06:00.470 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_onode_items": 0, 2024-04-01T07:06:00.470 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-01T07:06:00.470 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_meta_items": 0, 2024-04-01T07:06:00.470 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_other_bytes": 0, 2024-04-01T07:06:00.470 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_other_items": 0, 2024-04-01T07:06:00.470 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-01T07:06:00.470 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_buffer_items": 0, 2024-04-01T07:06:00.470 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_extent_bytes": 0, 2024-04-01T07:06:00.470 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_extent_items": 0, 2024-04-01T07:06:00.470 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_blob_bytes": 0, 2024-04-01T07:06:00.470 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_blob_items": 0, 2024-04-01T07:06:00.470 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-01T07:06:00.470 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_shared_blob_items": 0, 2024-04-01T07:06:00.470 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-01T07:06:00.470 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_inline_bl_items": 0, 2024-04-01T07:06:00.471 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_fsck_bytes": 0, 2024-04-01T07:06:00.471 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_fsck_items": 0, 2024-04-01T07:06:00.471 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_txc_bytes": 0, 2024-04-01T07:06:00.471 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_txc_items": 0, 2024-04-01T07:06:00.471 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-01T07:06:00.471 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_deferred_items": 0, 2024-04-01T07:06:00.471 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_bytes": 0, 2024-04-01T07:06:00.471 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_items": 0, 2024-04-01T07:06:00.471 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_bytes": 0, 2024-04-01T07:06:00.471 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_items": 0, 2024-04-01T07:06:00.471 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_reader_bytes": 0, 2024-04-01T07:06:00.471 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_reader_items": 0, 2024-04-01T07:06:00.471 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_writer_bytes": 0, 2024-04-01T07:06:00.471 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_writer_items": 0, 2024-04-01T07:06:00.472 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_anon_bytes": 149057, 2024-04-01T07:06:00.472 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_anon_items": 32, 2024-04-01T07:06:00.472 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_meta_bytes": 0, 2024-04-01T07:06:00.472 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_meta_items": 0, 2024-04-01T07:06:00.472 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_bytes": 0, 2024-04-01T07:06:00.472 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_items": 0, 2024-04-01T07:06:00.472 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_mapbl_bytes": 0, 2024-04-01T07:06:00.472 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_mapbl_items": 0, 2024-04-01T07:06:00.472 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_pglog_bytes": 0, 2024-04-01T07:06:00.472 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_pglog_items": 0, 2024-04-01T07:06:00.472 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_bytes": 0, 2024-04-01T07:06:00.472 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_items": 0, 2024-04-01T07:06:00.472 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_mapping_bytes": 0, 2024-04-01T07:06:00.472 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_mapping_items": 0, 2024-04-01T07:06:00.472 INFO:teuthology.orchestra.run.smithi083.stdout: "pgmap_bytes": 0, 2024-04-01T07:06:00.472 INFO:teuthology.orchestra.run.smithi083.stdout: "pgmap_items": 0, 2024-04-01T07:06:00.472 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_co_bytes": 928, 2024-04-01T07:06:00.473 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_co_items": 2, 2024-04-01T07:06:00.473 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_1_bytes": 0, 2024-04-01T07:06:00.473 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_1_items": 0, 2024-04-01T07:06:00.473 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_2_bytes": 0, 2024-04-01T07:06:00.473 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_2_items": 0 2024-04-01T07:06:00.473 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:06:00.473 INFO:teuthology.orchestra.run.smithi083.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-01T07:06:00.473 INFO:teuthology.orchestra.run.smithi083.stdout: "val": 0, 2024-04-01T07:06:00.473 INFO:teuthology.orchestra.run.smithi083.stdout: "max": 104857600, 2024-04-01T07:06:00.473 INFO:teuthology.orchestra.run.smithi083.stdout: "get_started": 0, 2024-04-01T07:06:00.473 INFO:teuthology.orchestra.run.smithi083.stdout: "get": 200, 2024-04-01T07:06:00.473 INFO:teuthology.orchestra.run.smithi083.stdout: "get_sum": 1388342, 2024-04-01T07:06:00.473 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_fail": 0, 2024-04-01T07:06:00.473 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_success": 200, 2024-04-01T07:06:00.473 INFO:teuthology.orchestra.run.smithi083.stdout: "take": 0, 2024-04-01T07:06:00.473 INFO:teuthology.orchestra.run.smithi083.stdout: "take_sum": 0, 2024-04-01T07:06:00.473 INFO:teuthology.orchestra.run.smithi083.stdout: "put": 200, 2024-04-01T07:06:00.474 INFO:teuthology.orchestra.run.smithi083.stdout: "put_sum": 1388342, 2024-04-01T07:06:00.474 INFO:teuthology.orchestra.run.smithi083.stdout: "wait": { 2024-04-01T07:06:00.474 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-04-01T07:06:00.474 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-04-01T07:06:00.474 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-04-01T07:06:00.474 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:06:00.474 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:06:00.474 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-04-01T07:06:00.833 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-04-01T07:06:00.833 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-04-01T07:06:00.834 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.a 2024-04-01T07:06:00.834 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.a 2024-04-01T07:06:00.834 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.a 2024-04-01T07:06:00.834 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.a 2024-04-01T07:06:00.834 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.a 2024-04-01T07:06:00.834 DEBUG:tasks.check_counter:Getting stats from d 2024-04-01T07:06:00.834 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph daemon mds.d perf dump 2024-04-01T07:06:00.901 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:00 smithi083 ceph-mon[43429]: pgmap v314: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 0 B/s wr, 9 op/s 2024-04-01T07:06:01.096 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T07:06:01.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:00 smithi153 ceph-mon[48187]: pgmap v314: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 0 B/s wr, 9 op/s 2024-04-01T07:06:01.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:00 smithi145 ceph-mon[47816]: pgmap v314: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 0 B/s wr, 9 op/s 2024-04-01T07:06:02.077 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-04-01T07:06:02.077 INFO:teuthology.orchestra.run.smithi083.stdout: "AsyncMessenger::Worker-0": { 2024-04-01T07:06:02.077 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_messages": 0, 2024-04-01T07:06:02.077 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages": 2, 2024-04-01T07:06:02.077 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_bytes": 0, 2024-04-01T07:06:02.077 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_bytes": 0, 2024-04-01T07:06:02.077 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_created_connections": 4, 2024-04-01T07:06:02.077 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_active_connections": 0, 2024-04-01T07:06:02.077 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_total_time": 0.001322689, 2024-04-01T07:06:02.077 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_send_time": 0.000000000, 2024-04-01T07:06:02.077 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_recv_time": 0.000272505, 2024-04-01T07:06:02.078 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-01T07:06:02.078 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages_queue_lat": { 2024-04-01T07:06:02.078 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-04-01T07:06:02.078 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-04-01T07:06:02.078 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-04-01T07:06:02.078 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:06:02.078 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_handle_ack_lat": { 2024-04-01T07:06:02.078 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-04-01T07:06:02.078 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-04-01T07:06:02.078 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-04-01T07:06:02.078 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:06:02.078 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-01T07:06:02.078 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_encrypted_bytes": 0 2024-04-01T07:06:02.078 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:06:02.079 INFO:teuthology.orchestra.run.smithi083.stdout: "AsyncMessenger::Worker-1": { 2024-04-01T07:06:02.079 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_messages": 206, 2024-04-01T07:06:02.079 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages": 194, 2024-04-01T07:06:02.079 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_bytes": 1420320, 2024-04-01T07:06:02.079 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_bytes": 109792, 2024-04-01T07:06:02.079 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_created_connections": 2, 2024-04-01T07:06:02.079 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_active_connections": 1, 2024-04-01T07:06:02.079 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_total_time": 0.037221348, 2024-04-01T07:06:02.079 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_send_time": 0.011976374, 2024-04-01T07:06:02.079 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_recv_time": 0.028618183, 2024-04-01T07:06:02.079 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_fast_dispatch_time": 0.004039653, 2024-04-01T07:06:02.079 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages_queue_lat": { 2024-04-01T07:06:02.079 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 194, 2024-04-01T07:06:02.079 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.009700049, 2024-04-01T07:06:02.079 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000050000 2024-04-01T07:06:02.080 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:06:02.080 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_handle_ack_lat": { 2024-04-01T07:06:02.080 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-04-01T07:06:02.080 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-04-01T07:06:02.080 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-04-01T07:06:02.080 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:06:02.080 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_encrypted_bytes": 1420320, 2024-04-01T07:06:02.080 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_encrypted_bytes": 109792 2024-04-01T07:06:02.080 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:06:02.080 INFO:teuthology.orchestra.run.smithi083.stdout: "AsyncMessenger::Worker-2": { 2024-04-01T07:06:02.080 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_messages": 2, 2024-04-01T07:06:02.080 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages": 147, 2024-04-01T07:06:02.080 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_bytes": 320, 2024-04-01T07:06:02.080 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_bytes": 178080, 2024-04-01T07:06:02.080 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_created_connections": 5, 2024-04-01T07:06:02.081 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_active_connections": 3, 2024-04-01T07:06:02.081 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_total_time": 0.012108488, 2024-04-01T07:06:02.081 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_send_time": 0.008097347, 2024-04-01T07:06:02.081 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_recv_time": 0.001787303, 2024-04-01T07:06:02.081 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-01T07:06:02.081 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages_queue_lat": { 2024-04-01T07:06:02.081 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 144, 2024-04-01T07:06:02.081 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.009372832, 2024-04-01T07:06:02.081 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000065089 2024-04-01T07:06:02.081 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:06:02.081 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_handle_ack_lat": { 2024-04-01T07:06:02.081 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-04-01T07:06:02.081 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-04-01T07:06:02.081 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-04-01T07:06:02.081 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:06:02.082 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_encrypted_bytes": 320, 2024-04-01T07:06:02.082 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_encrypted_bytes": 178080 2024-04-01T07:06:02.082 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:06:02.082 INFO:teuthology.orchestra.run.smithi083.stdout: "cct": { 2024-04-01T07:06:02.082 INFO:teuthology.orchestra.run.smithi083.stdout: "total_workers": 0, 2024-04-01T07:06:02.082 INFO:teuthology.orchestra.run.smithi083.stdout: "unhealthy_workers": 0 2024-04-01T07:06:02.082 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:06:02.082 INFO:teuthology.orchestra.run.smithi083.stdout: "mempool": { 2024-04-01T07:06:02.082 INFO:teuthology.orchestra.run.smithi083.stdout: "bloom_filter_bytes": 0, 2024-04-01T07:06:02.082 INFO:teuthology.orchestra.run.smithi083.stdout: "bloom_filter_items": 0, 2024-04-01T07:06:02.082 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_alloc_bytes": 0, 2024-04-01T07:06:02.082 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_alloc_items": 0, 2024-04-01T07:06:02.082 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_data_bytes": 0, 2024-04-01T07:06:02.082 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_data_items": 0, 2024-04-01T07:06:02.082 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-01T07:06:02.082 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_onode_items": 0, 2024-04-01T07:06:02.083 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-01T07:06:02.083 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_meta_items": 0, 2024-04-01T07:06:02.083 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_other_bytes": 0, 2024-04-01T07:06:02.083 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_other_items": 0, 2024-04-01T07:06:02.083 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-01T07:06:02.083 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_buffer_items": 0, 2024-04-01T07:06:02.083 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_extent_bytes": 0, 2024-04-01T07:06:02.083 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_extent_items": 0, 2024-04-01T07:06:02.083 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_blob_bytes": 0, 2024-04-01T07:06:02.083 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_blob_items": 0, 2024-04-01T07:06:02.083 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-01T07:06:02.083 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_shared_blob_items": 0, 2024-04-01T07:06:02.083 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-01T07:06:02.083 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_inline_bl_items": 0, 2024-04-01T07:06:02.083 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_fsck_bytes": 0, 2024-04-01T07:06:02.083 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_fsck_items": 0, 2024-04-01T07:06:02.084 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_txc_bytes": 0, 2024-04-01T07:06:02.084 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_txc_items": 0, 2024-04-01T07:06:02.084 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-01T07:06:02.084 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_deferred_items": 0, 2024-04-01T07:06:02.084 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_bytes": 0, 2024-04-01T07:06:02.084 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_items": 0, 2024-04-01T07:06:02.084 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_bytes": 0, 2024-04-01T07:06:02.084 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_items": 0, 2024-04-01T07:06:02.084 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_reader_bytes": 0, 2024-04-01T07:06:02.084 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_reader_items": 0, 2024-04-01T07:06:02.084 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_writer_bytes": 0, 2024-04-01T07:06:02.084 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_writer_items": 0, 2024-04-01T07:06:02.084 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_anon_bytes": 149034, 2024-04-01T07:06:02.084 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_anon_items": 32, 2024-04-01T07:06:02.084 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_meta_bytes": 0, 2024-04-01T07:06:02.084 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_meta_items": 0, 2024-04-01T07:06:02.085 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_bytes": 0, 2024-04-01T07:06:02.085 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_items": 0, 2024-04-01T07:06:02.085 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_mapbl_bytes": 0, 2024-04-01T07:06:02.085 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_mapbl_items": 0, 2024-04-01T07:06:02.085 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_pglog_bytes": 0, 2024-04-01T07:06:02.085 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_pglog_items": 0, 2024-04-01T07:06:02.085 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_bytes": 0, 2024-04-01T07:06:02.085 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_items": 0, 2024-04-01T07:06:02.085 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_mapping_bytes": 0, 2024-04-01T07:06:02.085 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_mapping_items": 0, 2024-04-01T07:06:02.085 INFO:teuthology.orchestra.run.smithi083.stdout: "pgmap_bytes": 0, 2024-04-01T07:06:02.085 INFO:teuthology.orchestra.run.smithi083.stdout: "pgmap_items": 0, 2024-04-01T07:06:02.085 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_co_bytes": 928, 2024-04-01T07:06:02.085 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_co_items": 2, 2024-04-01T07:06:02.085 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_1_bytes": 0, 2024-04-01T07:06:02.085 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_1_items": 0, 2024-04-01T07:06:02.085 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_2_bytes": 0, 2024-04-01T07:06:02.086 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_2_items": 0 2024-04-01T07:06:02.086 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:06:02.086 INFO:teuthology.orchestra.run.smithi083.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-01T07:06:02.086 INFO:teuthology.orchestra.run.smithi083.stdout: "val": 0, 2024-04-01T07:06:02.086 INFO:teuthology.orchestra.run.smithi083.stdout: "max": 104857600, 2024-04-01T07:06:02.086 INFO:teuthology.orchestra.run.smithi083.stdout: "get_started": 0, 2024-04-01T07:06:02.086 INFO:teuthology.orchestra.run.smithi083.stdout: "get": 204, 2024-04-01T07:06:02.086 INFO:teuthology.orchestra.run.smithi083.stdout: "get_sum": 1388862, 2024-04-01T07:06:02.086 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_fail": 0, 2024-04-01T07:06:02.086 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_success": 204, 2024-04-01T07:06:02.086 INFO:teuthology.orchestra.run.smithi083.stdout: "take": 0, 2024-04-01T07:06:02.086 INFO:teuthology.orchestra.run.smithi083.stdout: "take_sum": 0, 2024-04-01T07:06:02.086 INFO:teuthology.orchestra.run.smithi083.stdout: "put": 204, 2024-04-01T07:06:02.086 INFO:teuthology.orchestra.run.smithi083.stdout: "put_sum": 1388862, 2024-04-01T07:06:02.086 INFO:teuthology.orchestra.run.smithi083.stdout: "wait": { 2024-04-01T07:06:02.087 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-04-01T07:06:02.087 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-04-01T07:06:02.087 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-04-01T07:06:02.087 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:06:02.087 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:06:02.087 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-04-01T07:06:02.458 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-04-01T07:06:02.458 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-04-01T07:06:02.459 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-04-01T07:06:02.459 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-04-01T07:06:02.459 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-04-01T07:06:02.459 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-04-01T07:06:02.459 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-04-01T07:06:02.459 DEBUG:tasks.check_counter:Getting stats from g 2024-04-01T07:06:02.459 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph daemon mds.g perf dump 2024-04-01T07:06:02.719 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T07:06:03.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:02 smithi153 ceph-mon[48187]: pgmap v315: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-04-01T07:06:03.216 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:02 smithi083 ceph-mon[43429]: pgmap v315: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-04-01T07:06:03.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:02 smithi145 ceph-mon[47816]: pgmap v315: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-04-01T07:06:03.944 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-04-01T07:06:03.945 INFO:teuthology.orchestra.run.smithi083.stdout: "AsyncMessenger::Worker-0": { 2024-04-01T07:06:03.945 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_messages": 0, 2024-04-01T07:06:03.945 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages": 2, 2024-04-01T07:06:03.945 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_bytes": 0, 2024-04-01T07:06:03.945 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_bytes": 0, 2024-04-01T07:06:03.945 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_created_connections": 4, 2024-04-01T07:06:03.945 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_active_connections": 0, 2024-04-01T07:06:03.945 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_total_time": 0.001165917, 2024-04-01T07:06:03.945 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_send_time": 0.000000000, 2024-04-01T07:06:03.945 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_recv_time": 0.000165588, 2024-04-01T07:06:03.945 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-01T07:06:03.945 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages_queue_lat": { 2024-04-01T07:06:03.945 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-04-01T07:06:03.946 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-04-01T07:06:03.946 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-04-01T07:06:03.946 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:06:03.946 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_handle_ack_lat": { 2024-04-01T07:06:03.946 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-04-01T07:06:03.946 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-04-01T07:06:03.946 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-04-01T07:06:03.946 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:06:03.946 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-01T07:06:03.946 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_encrypted_bytes": 0 2024-04-01T07:06:03.946 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:06:03.946 INFO:teuthology.orchestra.run.smithi083.stdout: "AsyncMessenger::Worker-1": { 2024-04-01T07:06:03.946 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_messages": 200, 2024-04-01T07:06:03.947 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages": 190, 2024-04-01T07:06:03.947 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_bytes": 1416784, 2024-04-01T07:06:03.947 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_bytes": 108160, 2024-04-01T07:06:03.947 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_created_connections": 2, 2024-04-01T07:06:03.947 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_active_connections": 1, 2024-04-01T07:06:03.947 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_total_time": 0.036906666, 2024-04-01T07:06:03.947 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_send_time": 0.011671386, 2024-04-01T07:06:03.947 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_recv_time": 0.029476042, 2024-04-01T07:06:03.947 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_fast_dispatch_time": 0.003911680, 2024-04-01T07:06:03.947 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages_queue_lat": { 2024-04-01T07:06:03.947 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 189, 2024-04-01T07:06:03.947 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.010433657, 2024-04-01T07:06:03.947 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000055204 2024-04-01T07:06:03.947 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:06:03.948 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_handle_ack_lat": { 2024-04-01T07:06:03.948 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-04-01T07:06:03.948 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-04-01T07:06:03.948 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-04-01T07:06:03.948 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:06:03.948 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_encrypted_bytes": 1416784, 2024-04-01T07:06:03.948 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_encrypted_bytes": 108160 2024-04-01T07:06:03.948 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:06:03.948 INFO:teuthology.orchestra.run.smithi083.stdout: "AsyncMessenger::Worker-2": { 2024-04-01T07:06:03.948 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_messages": 6, 2024-04-01T07:06:03.948 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages": 147, 2024-04-01T07:06:03.948 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_bytes": 3312, 2024-04-01T07:06:03.948 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_bytes": 178176, 2024-04-01T07:06:03.948 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_created_connections": 5, 2024-04-01T07:06:03.948 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_active_connections": 3, 2024-04-01T07:06:03.948 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_total_time": 0.012149737, 2024-04-01T07:06:03.949 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_send_time": 0.007940588, 2024-04-01T07:06:03.949 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_recv_time": 0.002048260, 2024-04-01T07:06:03.949 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-01T07:06:03.949 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages_queue_lat": { 2024-04-01T07:06:03.949 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 145, 2024-04-01T07:06:03.949 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.014830101, 2024-04-01T07:06:03.949 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000102276 2024-04-01T07:06:03.949 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:06:03.949 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_handle_ack_lat": { 2024-04-01T07:06:03.949 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-04-01T07:06:03.949 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-04-01T07:06:03.949 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-04-01T07:06:03.949 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:06:03.949 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-04-01T07:06:03.949 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_encrypted_bytes": 178176 2024-04-01T07:06:03.950 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:06:03.950 INFO:teuthology.orchestra.run.smithi083.stdout: "cct": { 2024-04-01T07:06:03.950 INFO:teuthology.orchestra.run.smithi083.stdout: "total_workers": 0, 2024-04-01T07:06:03.950 INFO:teuthology.orchestra.run.smithi083.stdout: "unhealthy_workers": 0 2024-04-01T07:06:03.950 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:06:03.950 INFO:teuthology.orchestra.run.smithi083.stdout: "mempool": { 2024-04-01T07:06:03.950 INFO:teuthology.orchestra.run.smithi083.stdout: "bloom_filter_bytes": 0, 2024-04-01T07:06:03.950 INFO:teuthology.orchestra.run.smithi083.stdout: "bloom_filter_items": 0, 2024-04-01T07:06:03.950 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_alloc_bytes": 0, 2024-04-01T07:06:03.950 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_alloc_items": 0, 2024-04-01T07:06:03.950 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_data_bytes": 0, 2024-04-01T07:06:03.950 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_data_items": 0, 2024-04-01T07:06:03.950 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-01T07:06:03.950 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_onode_items": 0, 2024-04-01T07:06:03.951 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-01T07:06:03.951 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_meta_items": 0, 2024-04-01T07:06:03.951 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_other_bytes": 0, 2024-04-01T07:06:03.951 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_other_items": 0, 2024-04-01T07:06:03.951 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-01T07:06:03.951 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_buffer_items": 0, 2024-04-01T07:06:03.951 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_extent_bytes": 0, 2024-04-01T07:06:03.951 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_extent_items": 0, 2024-04-01T07:06:03.951 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_blob_bytes": 0, 2024-04-01T07:06:03.951 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_blob_items": 0, 2024-04-01T07:06:03.951 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-01T07:06:03.951 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_shared_blob_items": 0, 2024-04-01T07:06:03.951 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-01T07:06:03.951 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_inline_bl_items": 0, 2024-04-01T07:06:03.951 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_fsck_bytes": 0, 2024-04-01T07:06:03.952 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_fsck_items": 0, 2024-04-01T07:06:03.952 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_txc_bytes": 0, 2024-04-01T07:06:03.952 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_txc_items": 0, 2024-04-01T07:06:03.952 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-01T07:06:03.952 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_deferred_items": 0, 2024-04-01T07:06:03.952 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_bytes": 0, 2024-04-01T07:06:03.952 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_items": 0, 2024-04-01T07:06:03.952 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_bytes": 0, 2024-04-01T07:06:03.952 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_items": 0, 2024-04-01T07:06:03.952 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_reader_bytes": 0, 2024-04-01T07:06:03.952 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_reader_items": 0, 2024-04-01T07:06:03.952 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_writer_bytes": 0, 2024-04-01T07:06:03.952 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_writer_items": 0, 2024-04-01T07:06:03.952 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_anon_bytes": 148977, 2024-04-01T07:06:03.952 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_anon_items": 30, 2024-04-01T07:06:03.953 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_meta_bytes": 0, 2024-04-01T07:06:03.953 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_meta_items": 0, 2024-04-01T07:06:03.953 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_bytes": 0, 2024-04-01T07:06:03.953 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_items": 0, 2024-04-01T07:06:03.953 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_mapbl_bytes": 0, 2024-04-01T07:06:03.953 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_mapbl_items": 0, 2024-04-01T07:06:03.953 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_pglog_bytes": 0, 2024-04-01T07:06:03.953 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_pglog_items": 0, 2024-04-01T07:06:03.953 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_bytes": 0, 2024-04-01T07:06:03.953 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_items": 0, 2024-04-01T07:06:03.953 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_mapping_bytes": 0, 2024-04-01T07:06:03.953 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_mapping_items": 0, 2024-04-01T07:06:03.953 INFO:teuthology.orchestra.run.smithi083.stdout: "pgmap_bytes": 0, 2024-04-01T07:06:03.953 INFO:teuthology.orchestra.run.smithi083.stdout: "pgmap_items": 0, 2024-04-01T07:06:03.953 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_co_bytes": 928, 2024-04-01T07:06:03.954 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_co_items": 2, 2024-04-01T07:06:03.954 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_1_bytes": 0, 2024-04-01T07:06:03.954 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_1_items": 0, 2024-04-01T07:06:03.954 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_2_bytes": 0, 2024-04-01T07:06:03.954 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_2_items": 0 2024-04-01T07:06:03.954 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:06:03.954 INFO:teuthology.orchestra.run.smithi083.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-01T07:06:03.954 INFO:teuthology.orchestra.run.smithi083.stdout: "val": 0, 2024-04-01T07:06:03.954 INFO:teuthology.orchestra.run.smithi083.stdout: "max": 104857600, 2024-04-01T07:06:03.954 INFO:teuthology.orchestra.run.smithi083.stdout: "get_started": 0, 2024-04-01T07:06:03.954 INFO:teuthology.orchestra.run.smithi083.stdout: "get": 202, 2024-04-01T07:06:03.954 INFO:teuthology.orchestra.run.smithi083.stdout: "get_sum": 1388602, 2024-04-01T07:06:03.954 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_fail": 0, 2024-04-01T07:06:03.954 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_success": 202, 2024-04-01T07:06:03.954 INFO:teuthology.orchestra.run.smithi083.stdout: "take": 0, 2024-04-01T07:06:03.955 INFO:teuthology.orchestra.run.smithi083.stdout: "take_sum": 0, 2024-04-01T07:06:03.955 INFO:teuthology.orchestra.run.smithi083.stdout: "put": 202, 2024-04-01T07:06:03.955 INFO:teuthology.orchestra.run.smithi083.stdout: "put_sum": 1388602, 2024-04-01T07:06:03.955 INFO:teuthology.orchestra.run.smithi083.stdout: "wait": { 2024-04-01T07:06:03.955 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-04-01T07:06:03.955 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-04-01T07:06:03.955 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-04-01T07:06:03.955 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:06:03.955 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:06:03.955 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-04-01T07:06:04.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:03 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T07:06:04.154 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:03 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T07:06:04.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:03 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-01T07:06:04.294 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-04-01T07:06:04.294 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-04-01T07:06:04.294 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.g 2024-04-01T07:06:04.294 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.g 2024-04-01T07:06:04.294 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2024-04-01T07:06:04.294 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2024-04-01T07:06:04.294 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2024-04-01T07:06:04.294 DEBUG:tasks.check_counter:Getting stats from j 2024-04-01T07:06:04.294 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph daemon mds.j perf dump 2024-04-01T07:06:04.550 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.a/config 2024-04-01T07:06:05.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:04 smithi083 ceph-mon[43429]: pgmap v316: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-04-01T07:06:05.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:04 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T07:06:05.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:04 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T07:06:05.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:04 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T07:06:05.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:04 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T07:06:05.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:04 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-01T07:06:05.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:04 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-01T07:06:05.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:04 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-01T07:06:05.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:04 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-01T07:06:05.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:04 smithi083 ceph-mon[43429]: Adjusting osd_memory_target on smithi153 to 182.5M 2024-04-01T07:06:05.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:04 smithi083 ceph-mon[43429]: Unable to set osd_memory_target on smithi153 to 191374848: error parsing value: Value '191374848' is below minimum 939524096 2024-04-01T07:06:05.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:04 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-01T07:06:05.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:04 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-01T07:06:05.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:04 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-01T07:06:05.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:04 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-01T07:06:05.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:04 smithi083 ceph-mon[43429]: Adjusting osd_memory_target on smithi145 to 182.4M 2024-04-01T07:06:05.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:04 smithi083 ceph-mon[43429]: Unable to set osd_memory_target on smithi145 to 191356928: error parsing value: Value '191356928' is below minimum 939524096 2024-04-01T07:06:05.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:04 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T07:06:05.014 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:04 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T07:06:05.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:04 smithi153 ceph-mon[48187]: pgmap v316: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-04-01T07:06:05.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:04 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T07:06:05.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:04 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T07:06:05.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:04 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T07:06:05.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:04 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T07:06:05.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:04 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-01T07:06:05.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:04 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-01T07:06:05.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:04 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-01T07:06:05.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:04 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-01T07:06:05.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:04 smithi153 ceph-mon[48187]: Adjusting osd_memory_target on smithi153 to 182.5M 2024-04-01T07:06:05.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:04 smithi153 ceph-mon[48187]: Unable to set osd_memory_target on smithi153 to 191374848: error parsing value: Value '191374848' is below minimum 939524096 2024-04-01T07:06:05.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:04 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-01T07:06:05.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:04 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-01T07:06:05.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:04 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-01T07:06:05.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:04 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-01T07:06:05.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:04 smithi153 ceph-mon[48187]: Adjusting osd_memory_target on smithi145 to 182.4M 2024-04-01T07:06:05.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:04 smithi153 ceph-mon[48187]: Unable to set osd_memory_target on smithi145 to 191356928: error parsing value: Value '191356928' is below minimum 939524096 2024-04-01T07:06:05.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:04 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T07:06:05.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:04 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T07:06:05.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:04 smithi145 ceph-mon[47816]: pgmap v316: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-04-01T07:06:05.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:04 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T07:06:05.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:04 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T07:06:05.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:04 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T07:06:05.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:04 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T07:06:05.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:04 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-01T07:06:05.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:04 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-01T07:06:05.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:04 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-01T07:06:05.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:04 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-01T07:06:05.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:04 smithi145 ceph-mon[47816]: Adjusting osd_memory_target on smithi153 to 182.5M 2024-04-01T07:06:05.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:04 smithi145 ceph-mon[47816]: Unable to set osd_memory_target on smithi153 to 191374848: error parsing value: Value '191374848' is below minimum 939524096 2024-04-01T07:06:05.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:04 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-01T07:06:05.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:04 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-01T07:06:05.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:04 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-01T07:06:05.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:04 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-01T07:06:05.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:04 smithi145 ceph-mon[47816]: Adjusting osd_memory_target on smithi145 to 182.4M 2024-04-01T07:06:05.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:04 smithi145 ceph-mon[47816]: Unable to set osd_memory_target on smithi145 to 191356928: error parsing value: Value '191356928' is below minimum 939524096 2024-04-01T07:06:05.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:04 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T07:06:05.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:04 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T07:06:05.593 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-04-01T07:06:05.593 INFO:teuthology.orchestra.run.smithi083.stdout: "AsyncMessenger::Worker-0": { 2024-04-01T07:06:05.593 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_messages": 0, 2024-04-01T07:06:05.594 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages": 2, 2024-04-01T07:06:05.594 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_bytes": 0, 2024-04-01T07:06:05.594 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_bytes": 0, 2024-04-01T07:06:05.594 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_created_connections": 4, 2024-04-01T07:06:05.594 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_active_connections": 0, 2024-04-01T07:06:05.594 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_total_time": 0.001344758, 2024-04-01T07:06:05.594 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_send_time": 0.000000000, 2024-04-01T07:06:05.594 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_recv_time": 0.000348130, 2024-04-01T07:06:05.594 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-01T07:06:05.594 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages_queue_lat": { 2024-04-01T07:06:05.594 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-04-01T07:06:05.594 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-04-01T07:06:05.594 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-04-01T07:06:05.595 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:06:05.595 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_handle_ack_lat": { 2024-04-01T07:06:05.595 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-04-01T07:06:05.595 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-04-01T07:06:05.595 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-04-01T07:06:05.595 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:06:05.595 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-01T07:06:05.595 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_encrypted_bytes": 0 2024-04-01T07:06:05.595 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:06:05.595 INFO:teuthology.orchestra.run.smithi083.stdout: "AsyncMessenger::Worker-1": { 2024-04-01T07:06:05.595 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_messages": 207, 2024-04-01T07:06:05.595 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages": 195, 2024-04-01T07:06:05.595 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_bytes": 1420592, 2024-04-01T07:06:05.595 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_bytes": 110384, 2024-04-01T07:06:05.595 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_created_connections": 2, 2024-04-01T07:06:05.596 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_active_connections": 1, 2024-04-01T07:06:05.596 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_total_time": 0.038296504, 2024-04-01T07:06:05.596 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_send_time": 0.012197379, 2024-04-01T07:06:05.596 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_recv_time": 0.030111073, 2024-04-01T07:06:05.596 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_fast_dispatch_time": 0.004106169, 2024-04-01T07:06:05.596 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages_queue_lat": { 2024-04-01T07:06:05.596 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 195, 2024-04-01T07:06:05.596 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.009845582, 2024-04-01T07:06:05.596 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000050490 2024-04-01T07:06:05.596 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:06:05.596 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_handle_ack_lat": { 2024-04-01T07:06:05.596 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-04-01T07:06:05.596 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-04-01T07:06:05.596 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-04-01T07:06:05.596 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:06:05.597 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_encrypted_bytes": 1420592, 2024-04-01T07:06:05.597 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_encrypted_bytes": 110384 2024-04-01T07:06:05.597 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:06:05.597 INFO:teuthology.orchestra.run.smithi083.stdout: "AsyncMessenger::Worker-2": { 2024-04-01T07:06:05.597 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_messages": 2, 2024-04-01T07:06:05.597 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages": 148, 2024-04-01T07:06:05.597 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_bytes": 320, 2024-04-01T07:06:05.597 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_bytes": 178256, 2024-04-01T07:06:05.597 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_created_connections": 5, 2024-04-01T07:06:05.597 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_active_connections": 3, 2024-04-01T07:06:05.597 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_total_time": 0.012484295, 2024-04-01T07:06:05.597 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_send_time": 0.008690782, 2024-04-01T07:06:05.597 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_recv_time": 0.001569067, 2024-04-01T07:06:05.597 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-01T07:06:05.597 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages_queue_lat": { 2024-04-01T07:06:05.598 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 145, 2024-04-01T07:06:05.598 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.011854193, 2024-04-01T07:06:05.598 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000081753 2024-04-01T07:06:05.598 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:06:05.598 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_handle_ack_lat": { 2024-04-01T07:06:05.598 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-04-01T07:06:05.598 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-04-01T07:06:05.598 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-04-01T07:06:05.598 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:06:05.598 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_encrypted_bytes": 320, 2024-04-01T07:06:05.598 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_encrypted_bytes": 178256 2024-04-01T07:06:05.598 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:06:05.598 INFO:teuthology.orchestra.run.smithi083.stdout: "cct": { 2024-04-01T07:06:05.598 INFO:teuthology.orchestra.run.smithi083.stdout: "total_workers": 0, 2024-04-01T07:06:05.598 INFO:teuthology.orchestra.run.smithi083.stdout: "unhealthy_workers": 0 2024-04-01T07:06:05.599 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:06:05.599 INFO:teuthology.orchestra.run.smithi083.stdout: "mempool": { 2024-04-01T07:06:05.599 INFO:teuthology.orchestra.run.smithi083.stdout: "bloom_filter_bytes": 0, 2024-04-01T07:06:05.599 INFO:teuthology.orchestra.run.smithi083.stdout: "bloom_filter_items": 0, 2024-04-01T07:06:05.599 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_alloc_bytes": 0, 2024-04-01T07:06:05.599 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_alloc_items": 0, 2024-04-01T07:06:05.599 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_data_bytes": 0, 2024-04-01T07:06:05.599 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_data_items": 0, 2024-04-01T07:06:05.599 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-01T07:06:05.599 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_onode_items": 0, 2024-04-01T07:06:05.599 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-01T07:06:05.599 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_meta_items": 0, 2024-04-01T07:06:05.600 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_other_bytes": 0, 2024-04-01T07:06:05.600 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_other_items": 0, 2024-04-01T07:06:05.600 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-01T07:06:05.600 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_buffer_items": 0, 2024-04-01T07:06:05.600 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_extent_bytes": 0, 2024-04-01T07:06:05.600 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_extent_items": 0, 2024-04-01T07:06:05.600 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_blob_bytes": 0, 2024-04-01T07:06:05.600 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_blob_items": 0, 2024-04-01T07:06:05.600 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-01T07:06:05.600 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_shared_blob_items": 0, 2024-04-01T07:06:05.600 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-01T07:06:05.600 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_inline_bl_items": 0, 2024-04-01T07:06:05.600 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_fsck_bytes": 0, 2024-04-01T07:06:05.601 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_fsck_items": 0, 2024-04-01T07:06:05.601 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_txc_bytes": 0, 2024-04-01T07:06:05.601 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_txc_items": 0, 2024-04-01T07:06:05.601 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-01T07:06:05.601 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_deferred_items": 0, 2024-04-01T07:06:05.601 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_bytes": 0, 2024-04-01T07:06:05.601 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_items": 0, 2024-04-01T07:06:05.601 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_bytes": 0, 2024-04-01T07:06:05.601 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_items": 0, 2024-04-01T07:06:05.601 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_reader_bytes": 0, 2024-04-01T07:06:05.601 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_reader_items": 0, 2024-04-01T07:06:05.601 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_writer_bytes": 0, 2024-04-01T07:06:05.601 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_writer_items": 0, 2024-04-01T07:06:05.601 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_anon_bytes": 149007, 2024-04-01T07:06:05.602 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_anon_items": 30, 2024-04-01T07:06:05.602 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_meta_bytes": 0, 2024-04-01T07:06:05.602 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_meta_items": 0, 2024-04-01T07:06:05.602 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_bytes": 0, 2024-04-01T07:06:05.602 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_items": 0, 2024-04-01T07:06:05.602 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_mapbl_bytes": 0, 2024-04-01T07:06:05.602 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_mapbl_items": 0, 2024-04-01T07:06:05.602 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_pglog_bytes": 0, 2024-04-01T07:06:05.602 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_pglog_items": 0, 2024-04-01T07:06:05.602 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_bytes": 0, 2024-04-01T07:06:05.602 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_items": 0, 2024-04-01T07:06:05.602 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_mapping_bytes": 0, 2024-04-01T07:06:05.602 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_mapping_items": 0, 2024-04-01T07:06:05.602 INFO:teuthology.orchestra.run.smithi083.stdout: "pgmap_bytes": 0, 2024-04-01T07:06:05.602 INFO:teuthology.orchestra.run.smithi083.stdout: "pgmap_items": 0, 2024-04-01T07:06:05.603 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_co_bytes": 928, 2024-04-01T07:06:05.603 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_co_items": 2, 2024-04-01T07:06:05.603 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_1_bytes": 0, 2024-04-01T07:06:05.603 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_1_items": 0, 2024-04-01T07:06:05.603 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_2_bytes": 0, 2024-04-01T07:06:05.603 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_2_items": 0 2024-04-01T07:06:05.603 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-04-01T07:06:05.603 INFO:teuthology.orchestra.run.smithi083.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-01T07:06:05.603 INFO:teuthology.orchestra.run.smithi083.stdout: "val": 0, 2024-04-01T07:06:05.603 INFO:teuthology.orchestra.run.smithi083.stdout: "max": 104857600, 2024-04-01T07:06:05.603 INFO:teuthology.orchestra.run.smithi083.stdout: "get_started": 0, 2024-04-01T07:06:05.603 INFO:teuthology.orchestra.run.smithi083.stdout: "get": 205, 2024-04-01T07:06:05.603 INFO:teuthology.orchestra.run.smithi083.stdout: "get_sum": 1388992, 2024-04-01T07:06:05.604 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_fail": 0, 2024-04-01T07:06:05.604 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_success": 205, 2024-04-01T07:06:05.604 INFO:teuthology.orchestra.run.smithi083.stdout: "take": 0, 2024-04-01T07:06:05.604 INFO:teuthology.orchestra.run.smithi083.stdout: "take_sum": 0, 2024-04-01T07:06:05.604 INFO:teuthology.orchestra.run.smithi083.stdout: "put": 205, 2024-04-01T07:06:05.604 INFO:teuthology.orchestra.run.smithi083.stdout: "put_sum": 1388992, 2024-04-01T07:06:05.604 INFO:teuthology.orchestra.run.smithi083.stdout: "wait": { 2024-04-01T07:06:05.604 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-04-01T07:06:05.604 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-04-01T07:06:05.604 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-04-01T07:06:05.604 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:06:05.604 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-04-01T07:06:05.604 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-04-01T07:06:05.966 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-04-01T07:06:05.966 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-04-01T07:06:05.966 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-04-01T07:06:05.966 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-04-01T07:06:05.966 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-04-01T07:06:05.966 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-04-01T07:06:05.966 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-04-01T07:06:05.969 DEBUG:tasks.check_counter:Getting stats from b 2024-04-01T07:06:05.969 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph daemon mds.b perf dump 2024-04-01T07:06:06.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:05 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-01T07:06:06.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:05 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-01T07:06:06.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:05 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-01T07:06:06.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:05 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-01T07:06:06.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:05 smithi083 ceph-mon[43429]: Adjusting osd_memory_target on smithi083 to 182.5M 2024-04-01T07:06:06.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:05 smithi083 ceph-mon[43429]: Unable to set osd_memory_target on smithi083 to 191370547: error parsing value: Value '191370547' is below minimum 939524096 2024-04-01T07:06:06.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:05 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T07:06:06.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:05 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T07:06:06.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:05 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T07:06:06.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:05 smithi083 ceph-mon[43429]: pgmap v317: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-04-01T07:06:06.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:05 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-01T07:06:06.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:05 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-01T07:06:06.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:05 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-01T07:06:06.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:05 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-01T07:06:06.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:05 smithi153 ceph-mon[48187]: Adjusting osd_memory_target on smithi083 to 182.5M 2024-04-01T07:06:06.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:05 smithi153 ceph-mon[48187]: Unable to set osd_memory_target on smithi083 to 191370547: error parsing value: Value '191370547' is below minimum 939524096 2024-04-01T07:06:06.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:05 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T07:06:06.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:05 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T07:06:06.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:05 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T07:06:06.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:05 smithi153 ceph-mon[48187]: pgmap v317: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-04-01T07:06:06.216 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T07:06:06.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:05 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-01T07:06:06.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:05 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-01T07:06:06.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:05 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-01T07:06:06.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:05 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-01T07:06:06.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:05 smithi145 ceph-mon[47816]: Adjusting osd_memory_target on smithi083 to 182.5M 2024-04-01T07:06:06.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:05 smithi145 ceph-mon[47816]: Unable to set osd_memory_target on smithi083 to 191370547: error parsing value: Value '191370547' is below minimum 939524096 2024-04-01T07:06:06.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:05 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-01T07:06:06.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:05 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-01T07:06:06.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:05 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' 2024-04-01T07:06:06.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:05 smithi145 ceph-mon[47816]: pgmap v317: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-04-01T07:06:07.168 INFO:teuthology.orchestra.run.smithi145.stdout:{ 2024-04-01T07:06:07.168 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-0": { 2024-04-01T07:06:07.168 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 27740, 2024-04-01T07:06:07.168 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 30972, 2024-04-01T07:06:07.168 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 11334851, 2024-04-01T07:06:07.168 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 53622372, 2024-04-01T07:06:07.168 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 80, 2024-04-01T07:06:07.168 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 5, 2024-04-01T07:06:07.168 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 1.917972875, 2024-04-01T07:06:07.168 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 0.769586645, 2024-04-01T07:06:07.168 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 0.918926459, 2024-04-01T07:06:07.169 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.347040454, 2024-04-01T07:06:07.169 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2024-04-01T07:06:07.169 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 30973, 2024-04-01T07:06:07.169 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 15.277551189, 2024-04-01T07:06:07.169 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000493253 2024-04-01T07:06:07.169 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.169 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2024-04-01T07:06:07.169 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 40792, 2024-04-01T07:06:07.169 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.007658431, 2024-04-01T07:06:07.169 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000187 2024-04-01T07:06:07.169 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.169 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_encrypted_bytes": 1565328, 2024-04-01T07:06:07.169 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_encrypted_bytes": 125568 2024-04-01T07:06:07.169 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.170 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-1": { 2024-04-01T07:06:07.170 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 16185, 2024-04-01T07:06:07.170 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 16179, 2024-04-01T07:06:07.170 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 6470261, 2024-04-01T07:06:07.170 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 72918788, 2024-04-01T07:06:07.170 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 12, 2024-04-01T07:06:07.170 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 5, 2024-04-01T07:06:07.170 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 0.995898152, 2024-04-01T07:06:07.170 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 0.344982555, 2024-04-01T07:06:07.170 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 0.172326221, 2024-04-01T07:06:07.170 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.437500356, 2024-04-01T07:06:07.170 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2024-04-01T07:06:07.170 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 16178, 2024-04-01T07:06:07.171 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 27.502164444, 2024-04-01T07:06:07.171 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.001699973 2024-04-01T07:06:07.171 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.171 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2024-04-01T07:06:07.171 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 285, 2024-04-01T07:06:07.171 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000044456, 2024-04-01T07:06:07.171 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000155 2024-04-01T07:06:07.171 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.171 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_encrypted_bytes": 97072, 2024-04-01T07:06:07.171 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_encrypted_bytes": 449968 2024-04-01T07:06:07.171 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.171 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-2": { 2024-04-01T07:06:07.171 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 86400, 2024-04-01T07:06:07.171 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 144859, 2024-04-01T07:06:07.172 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 38613771, 2024-04-01T07:06:07.172 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 107579713, 2024-04-01T07:06:07.172 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 14, 2024-04-01T07:06:07.172 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 8, 2024-04-01T07:06:07.172 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 4.702359471, 2024-04-01T07:06:07.172 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 2.256802546, 2024-04-01T07:06:07.172 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 35.616345450, 2024-04-01T07:06:07.172 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.347287046, 2024-04-01T07:06:07.172 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2024-04-01T07:06:07.172 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 144854, 2024-04-01T07:06:07.172 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 15.969215310, 2024-04-01T07:06:07.172 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000110243 2024-04-01T07:06:07.172 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.172 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2024-04-01T07:06:07.173 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 154018, 2024-04-01T07:06:07.173 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.030480873, 2024-04-01T07:06:07.173 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000197 2024-04-01T07:06:07.173 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.173 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_encrypted_bytes": 321808, 2024-04-01T07:06:07.173 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_encrypted_bytes": 98464 2024-04-01T07:06:07.173 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.173 INFO:teuthology.orchestra.run.smithi145.stdout: "cct": { 2024-04-01T07:06:07.173 INFO:teuthology.orchestra.run.smithi145.stdout: "total_workers": 1, 2024-04-01T07:06:07.173 INFO:teuthology.orchestra.run.smithi145.stdout: "unhealthy_workers": 0 2024-04-01T07:06:07.173 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.173 INFO:teuthology.orchestra.run.smithi145.stdout: "finisher-MDSRank": { 2024-04-01T07:06:07.173 INFO:teuthology.orchestra.run.smithi145.stdout: "queue_len": 0, 2024-04-01T07:06:07.173 INFO:teuthology.orchestra.run.smithi145.stdout: "complete_latency": { 2024-04-01T07:06:07.173 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 7936, 2024-04-01T07:06:07.174 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 38.032239285, 2024-04-01T07:06:07.174 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.004792368 2024-04-01T07:06:07.174 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-04-01T07:06:07.174 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.174 INFO:teuthology.orchestra.run.smithi145.stdout: "finisher-PurgeQueue": { 2024-04-01T07:06:07.174 INFO:teuthology.orchestra.run.smithi145.stdout: "queue_len": 0, 2024-04-01T07:06:07.174 INFO:teuthology.orchestra.run.smithi145.stdout: "complete_latency": { 2024-04-01T07:06:07.174 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 11076, 2024-04-01T07:06:07.174 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 2.175651584, 2024-04-01T07:06:07.174 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000196429 2024-04-01T07:06:07.174 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-04-01T07:06:07.174 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.174 INFO:teuthology.orchestra.run.smithi145.stdout: "mds": { 2024-04-01T07:06:07.174 INFO:teuthology.orchestra.run.smithi145.stdout: "request": 29029, 2024-04-01T07:06:07.174 INFO:teuthology.orchestra.run.smithi145.stdout: "reply": 29014, 2024-04-01T07:06:07.175 INFO:teuthology.orchestra.run.smithi145.stdout: "reply_latency": { 2024-04-01T07:06:07.175 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 29014, 2024-04-01T07:06:07.175 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 153.669846400, 2024-04-01T07:06:07.175 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.005296403 2024-04-01T07:06:07.175 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.175 INFO:teuthology.orchestra.run.smithi145.stdout: "slow_reply": 0, 2024-04-01T07:06:07.175 INFO:teuthology.orchestra.run.smithi145.stdout: "forward": 15, 2024-04-01T07:06:07.175 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_fetch_complete": 7, 2024-04-01T07:06:07.175 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_fetch_keys": 1, 2024-04-01T07:06:07.175 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_commit": 2148, 2024-04-01T07:06:07.175 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_split": 9, 2024-04-01T07:06:07.175 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_merge": 0, 2024-04-01T07:06:07.175 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes": 9771, 2024-04-01T07:06:07.175 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_top": 6417, 2024-04-01T07:06:07.176 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_bottom": 2916, 2024-04-01T07:06:07.176 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_pin_tail": 438, 2024-04-01T07:06:07.176 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_pinned": 602, 2024-04-01T07:06:07.176 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_expired": 16324, 2024-04-01T07:06:07.176 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_with_caps": 2, 2024-04-01T07:06:07.176 INFO:teuthology.orchestra.run.smithi145.stdout: "caps": 3, 2024-04-01T07:06:07.176 INFO:teuthology.orchestra.run.smithi145.stdout: "subtrees": 4, 2024-04-01T07:06:07.176 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse": 37048, 2024-04-01T07:06:07.176 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_hit": 35058, 2024-04-01T07:06:07.176 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_forward": 4, 2024-04-01T07:06:07.176 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_discover": 573, 2024-04-01T07:06:07.176 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_dir_fetch": 3, 2024-04-01T07:06:07.176 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_remote_ino": 0, 2024-04-01T07:06:07.177 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_lock": 7, 2024-04-01T07:06:07.177 INFO:teuthology.orchestra.run.smithi145.stdout: "load_cent": 0, 2024-04-01T07:06:07.177 INFO:teuthology.orchestra.run.smithi145.stdout: "q": 0, 2024-04-01T07:06:07.177 INFO:teuthology.orchestra.run.smithi145.stdout: "exported": 24, 2024-04-01T07:06:07.177 INFO:teuthology.orchestra.run.smithi145.stdout: "exported_inodes": 14415, 2024-04-01T07:06:07.177 INFO:teuthology.orchestra.run.smithi145.stdout: "imported": 15, 2024-04-01T07:06:07.177 INFO:teuthology.orchestra.run.smithi145.stdout: "imported_inodes": 6598, 2024-04-01T07:06:07.177 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_dir_fetch": 0, 2024-04-01T07:06:07.177 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_backtrace_fetch": 4669, 2024-04-01T07:06:07.177 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_peer_discover": 0, 2024-04-01T07:06:07.177 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rfiles": 4, 2024-04-01T07:06:07.177 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rbytes": 234, 2024-04-01T07:06:07.177 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rsnaps": 7, 2024-04-01T07:06:07.177 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_backtrace_fetch": 4669, 2024-04-01T07:06:07.177 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_set_tag": 0, 2024-04-01T07:06:07.178 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_backtrace_repaired": 0, 2024-04-01T07:06:07.178 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_inotable_repaired": 0, 2024-04-01T07:06:07.178 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_dir_inodes": 562, 2024-04-01T07:06:07.178 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_dir_base_inodes": 5, 2024-04-01T07:06:07.178 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_dirfrag_rstats": 557, 2024-04-01T07:06:07.178 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_file_inodes": 4107, 2024-04-01T07:06:07.178 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_inode_file_caps": 6, 2024-04-01T07:06:07.178 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_cap_op_revoke": 3804, 2024-04-01T07:06:07.178 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_cap_op_grant": 22000, 2024-04-01T07:06:07.178 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_cap_op_trunc": 237, 2024-04-01T07:06:07.178 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-01T07:06:07.178 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-01T07:06:07.178 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_caps": 20544, 2024-04-01T07:06:07.178 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_caps_dirty": 14190, 2024-04-01T07:06:07.178 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_cap_release": 147, 2024-04-01T07:06:07.179 INFO:teuthology.orchestra.run.smithi145.stdout: "process_request_cap_release": 12285 2024-04-01T07:06:07.179 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.179 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_cache": { 2024-04-01T07:06:07.179 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_update": 1547, 2024-04-01T07:06:07.179 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_update_receipt": 1691, 2024-04-01T07:06:07.179 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_try_discover": 1129, 2024-04-01T07:06:07.179 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_send_discover": 1122, 2024-04-01T07:06:07.179 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_handle_discover": 3075, 2024-04-01T07:06:07.179 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays": 435, 2024-04-01T07:06:07.179 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays_delayed": 0, 2024-04-01T07:06:07.179 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays_enqueuing": 0, 2024-04-01T07:06:07.179 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_created": 7383, 2024-04-01T07:06:07.179 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_enqueued": 6835, 2024-04-01T07:06:07.179 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_reintegrated": 119, 2024-04-01T07:06:07.179 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_migrated": 0, 2024-04-01T07:06:07.179 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_processing": 0, 2024-04-01T07:06:07.180 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_enqueued": 0, 2024-04-01T07:06:07.180 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_prioritized": 0, 2024-04-01T07:06:07.180 INFO:teuthology.orchestra.run.smithi145.stdout: "recovery_started": 0, 2024-04-01T07:06:07.180 INFO:teuthology.orchestra.run.smithi145.stdout: "recovery_completed": 0, 2024-04-01T07:06:07.180 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_enqueue_scrub": 5, 2024-04-01T07:06:07.180 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_exportdir": 24, 2024-04-01T07:06:07.180 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_flush": 0, 2024-04-01T07:06:07.180 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_fragmentdir": 9, 2024-04-01T07:06:07.180 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_fragstats": 0, 2024-04-01T07:06:07.180 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_inodestats": 0 2024-04-01T07:06:07.180 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.180 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_log": { 2024-04-01T07:06:07.180 INFO:teuthology.orchestra.run.smithi145.stdout: "evadd": 49220, 2024-04-01T07:06:07.180 INFO:teuthology.orchestra.run.smithi145.stdout: "evex": 48759, 2024-04-01T07:06:07.180 INFO:teuthology.orchestra.run.smithi145.stdout: "evtrm": 48759, 2024-04-01T07:06:07.180 INFO:teuthology.orchestra.run.smithi145.stdout: "ev": 461, 2024-04-01T07:06:07.181 INFO:teuthology.orchestra.run.smithi145.stdout: "evexg": 0, 2024-04-01T07:06:07.181 INFO:teuthology.orchestra.run.smithi145.stdout: "evexd": 9, 2024-04-01T07:06:07.181 INFO:teuthology.orchestra.run.smithi145.stdout: "segadd": 71, 2024-04-01T07:06:07.181 INFO:teuthology.orchestra.run.smithi145.stdout: "segex": 70, 2024-04-01T07:06:07.181 INFO:teuthology.orchestra.run.smithi145.stdout: "segtrm": 70, 2024-04-01T07:06:07.181 INFO:teuthology.orchestra.run.smithi145.stdout: "seg": 2, 2024-04-01T07:06:07.181 INFO:teuthology.orchestra.run.smithi145.stdout: "segexg": 0, 2024-04-01T07:06:07.181 INFO:teuthology.orchestra.run.smithi145.stdout: "segexd": 1, 2024-04-01T07:06:07.181 INFO:teuthology.orchestra.run.smithi145.stdout: "expos": 124714776, 2024-04-01T07:06:07.181 INFO:teuthology.orchestra.run.smithi145.stdout: "wrpos": 125804502, 2024-04-01T07:06:07.181 INFO:teuthology.orchestra.run.smithi145.stdout: "rdpos": 0, 2024-04-01T07:06:07.181 INFO:teuthology.orchestra.run.smithi145.stdout: "jlat": { 2024-04-01T07:06:07.181 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 3928, 2024-04-01T07:06:07.181 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 184.784235057, 2024-04-01T07:06:07.181 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.047042829 2024-04-01T07:06:07.181 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.182 INFO:teuthology.orchestra.run.smithi145.stdout: "replayed": 0 2024-04-01T07:06:07.182 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.182 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_mem": { 2024-04-01T07:06:07.182 INFO:teuthology.orchestra.run.smithi145.stdout: "ino": 4641, 2024-04-01T07:06:07.182 INFO:teuthology.orchestra.run.smithi145.stdout: "ino+": 25739, 2024-04-01T07:06:07.182 INFO:teuthology.orchestra.run.smithi145.stdout: "ino-": 21098, 2024-04-01T07:06:07.182 INFO:teuthology.orchestra.run.smithi145.stdout: "dir": 494, 2024-04-01T07:06:07.182 INFO:teuthology.orchestra.run.smithi145.stdout: "dir+": 2798, 2024-04-01T07:06:07.182 INFO:teuthology.orchestra.run.smithi145.stdout: "dir-": 2304, 2024-04-01T07:06:07.182 INFO:teuthology.orchestra.run.smithi145.stdout: "dn": 9771, 2024-04-01T07:06:07.182 INFO:teuthology.orchestra.run.smithi145.stdout: "dn+": 36031, 2024-04-01T07:06:07.182 INFO:teuthology.orchestra.run.smithi145.stdout: "dn-": 26260, 2024-04-01T07:06:07.182 INFO:teuthology.orchestra.run.smithi145.stdout: "cap": 3, 2024-04-01T07:06:07.182 INFO:teuthology.orchestra.run.smithi145.stdout: "cap+": 21274, 2024-04-01T07:06:07.182 INFO:teuthology.orchestra.run.smithi145.stdout: "cap-": 21271, 2024-04-01T07:06:07.182 INFO:teuthology.orchestra.run.smithi145.stdout: "rss": 163732, 2024-04-01T07:06:07.183 INFO:teuthology.orchestra.run.smithi145.stdout: "heap": 207156 2024-04-01T07:06:07.183 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.183 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_server": { 2024-04-01T07:06:07.183 INFO:teuthology.orchestra.run.smithi145.stdout: "dispatch_client_request": 35465, 2024-04-01T07:06:07.183 INFO:teuthology.orchestra.run.smithi145.stdout: "dispatch_server_request": 20, 2024-04-01T07:06:07.183 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_request": 29029, 2024-04-01T07:06:07.183 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_session": 48, 2024-04-01T07:06:07.183 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_peer_request": 200, 2024-04-01T07:06:07.183 INFO:teuthology.orchestra.run.smithi145.stdout: "req_create_latency": { 2024-04-01T07:06:07.183 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 11687, 2024-04-01T07:06:07.183 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 49.675215565, 2024-04-01T07:06:07.183 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.004250467 2024-04-01T07:06:07.183 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.183 INFO:teuthology.orchestra.run.smithi145.stdout: "req_getattr_latency": { 2024-04-01T07:06:07.183 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 303, 2024-04-01T07:06:07.184 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.331172211, 2024-04-01T07:06:07.184 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.001092977 2024-04-01T07:06:07.184 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.184 INFO:teuthology.orchestra.run.smithi145.stdout: "req_getfilelock_latency": { 2024-04-01T07:06:07.184 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:07.184 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:07.184 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:07.184 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.184 INFO:teuthology.orchestra.run.smithi145.stdout: "req_link_latency": { 2024-04-01T07:06:07.184 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 267, 2024-04-01T07:06:07.184 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 2.409339130, 2024-04-01T07:06:07.184 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.009023742 2024-04-01T07:06:07.184 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.184 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookup_latency": { 2024-04-01T07:06:07.184 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 4140, 2024-04-01T07:06:07.185 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 4.624462996, 2024-04-01T07:06:07.185 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.001117020 2024-04-01T07:06:07.185 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.185 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookuphash_latency": { 2024-04-01T07:06:07.185 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:07.185 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:07.185 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:07.185 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.185 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupino_latency": { 2024-04-01T07:06:07.185 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 1, 2024-04-01T07:06:07.185 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000206106, 2024-04-01T07:06:07.185 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000206106 2024-04-01T07:06:07.185 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.185 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupname_latency": { 2024-04-01T07:06:07.185 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:07.185 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:07.185 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:07.186 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.186 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupparent_latency": { 2024-04-01T07:06:07.186 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:07.186 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:07.186 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:07.186 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.186 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupsnap_latency": { 2024-04-01T07:06:07.186 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:07.186 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:07.186 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:07.186 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.186 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lssnap_latency": { 2024-04-01T07:06:07.186 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 11, 2024-04-01T07:06:07.186 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.001756510, 2024-04-01T07:06:07.186 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000159682 2024-04-01T07:06:07.187 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.187 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mkdir_latency": { 2024-04-01T07:06:07.187 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 1852, 2024-04-01T07:06:07.187 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 11.624905409, 2024-04-01T07:06:07.187 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.006276946 2024-04-01T07:06:07.187 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.187 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mknod_latency": { 2024-04-01T07:06:07.187 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 525, 2024-04-01T07:06:07.187 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 3.753178416, 2024-04-01T07:06:07.187 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.007148911 2024-04-01T07:06:07.187 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.187 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mksnap_latency": { 2024-04-01T07:06:07.187 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 11, 2024-04-01T07:06:07.187 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 2.331780548, 2024-04-01T07:06:07.187 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.211980049 2024-04-01T07:06:07.187 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.187 INFO:teuthology.orchestra.run.smithi145.stdout: "req_open_latency": { 2024-04-01T07:06:07.188 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 42, 2024-04-01T07:06:07.188 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.029759677, 2024-04-01T07:06:07.188 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000708563 2024-04-01T07:06:07.188 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.188 INFO:teuthology.orchestra.run.smithi145.stdout: "req_readdir_latency": { 2024-04-01T07:06:07.188 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 1059, 2024-04-01T07:06:07.188 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 7.133760811, 2024-04-01T07:06:07.188 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.006736318 2024-04-01T07:06:07.188 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.188 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rename_latency": { 2024-04-01T07:06:07.188 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 625, 2024-04-01T07:06:07.188 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 15.750157616, 2024-04-01T07:06:07.188 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.025200252 2024-04-01T07:06:07.188 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.188 INFO:teuthology.orchestra.run.smithi145.stdout: "req_renamesnap_latency": { 2024-04-01T07:06:07.188 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:07.189 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:07.189 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:07.189 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.189 INFO:teuthology.orchestra.run.smithi145.stdout: "req_snapdiff_latency": { 2024-04-01T07:06:07.189 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:07.189 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:07.189 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:07.189 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.189 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmdir_latency": { 2024-04-01T07:06:07.189 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 1132, 2024-04-01T07:06:07.189 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 29.605472661, 2024-04-01T07:06:07.189 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.026153244 2024-04-01T07:06:07.190 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.190 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmsnap_latency": { 2024-04-01T07:06:07.190 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 4, 2024-04-01T07:06:07.190 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.018577251, 2024-04-01T07:06:07.190 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.004644312 2024-04-01T07:06:07.190 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.190 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmxattr_latency": { 2024-04-01T07:06:07.190 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:07.190 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:07.190 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:07.190 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.190 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setattr_latency": { 2024-04-01T07:06:07.190 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 238, 2024-04-01T07:06:07.190 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 3.780076954, 2024-04-01T07:06:07.191 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.015882676 2024-04-01T07:06:07.191 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.191 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setdirlayout_latency": { 2024-04-01T07:06:07.191 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:07.191 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:07.191 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:07.191 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.191 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setfilelock_latency": { 2024-04-01T07:06:07.191 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:07.191 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:07.191 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:07.191 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.191 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setlayout_latency": { 2024-04-01T07:06:07.191 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:07.191 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:07.191 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:07.192 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.192 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setxattr_latency": { 2024-04-01T07:06:07.192 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 7, 2024-04-01T07:06:07.192 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.018703659, 2024-04-01T07:06:07.192 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.002671951 2024-04-01T07:06:07.192 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.192 INFO:teuthology.orchestra.run.smithi145.stdout: "req_symlink_latency": { 2024-04-01T07:06:07.192 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 488, 2024-04-01T07:06:07.192 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 4.230620865, 2024-04-01T07:06:07.192 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.008669305 2024-04-01T07:06:07.192 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.192 INFO:teuthology.orchestra.run.smithi145.stdout: "req_unlink_latency": { 2024-04-01T07:06:07.192 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 6622, 2024-04-01T07:06:07.192 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 18.350700015, 2024-04-01T07:06:07.192 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.002771171 2024-04-01T07:06:07.193 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.193 INFO:teuthology.orchestra.run.smithi145.stdout: "cap_revoke_eviction": 0, 2024-04-01T07:06:07.193 INFO:teuthology.orchestra.run.smithi145.stdout: "cap_acquisition_throttle": 0, 2024-04-01T07:06:07.193 INFO:teuthology.orchestra.run.smithi145.stdout: "req_getvxattr_latency": { 2024-04-01T07:06:07.193 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:07.193 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:07.193 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:07.193 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-04-01T07:06:07.193 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.193 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_sessions": { 2024-04-01T07:06:07.193 INFO:teuthology.orchestra.run.smithi145.stdout: "session_count": 2, 2024-04-01T07:06:07.193 INFO:teuthology.orchestra.run.smithi145.stdout: "session_add": 5, 2024-04-01T07:06:07.193 INFO:teuthology.orchestra.run.smithi145.stdout: "session_remove": 3, 2024-04-01T07:06:07.193 INFO:teuthology.orchestra.run.smithi145.stdout: "sessions_open": 2, 2024-04-01T07:06:07.193 INFO:teuthology.orchestra.run.smithi145.stdout: "sessions_stale": 0, 2024-04-01T07:06:07.193 INFO:teuthology.orchestra.run.smithi145.stdout: "total_load": 136, 2024-04-01T07:06:07.194 INFO:teuthology.orchestra.run.smithi145.stdout: "average_load": 68, 2024-04-01T07:06:07.194 INFO:teuthology.orchestra.run.smithi145.stdout: "avg_session_uptime": 613, 2024-04-01T07:06:07.194 INFO:teuthology.orchestra.run.smithi145.stdout: "mdthresh_evicted": 0 2024-04-01T07:06:07.194 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.194 INFO:teuthology.orchestra.run.smithi145.stdout: "mempool": { 2024-04-01T07:06:07.194 INFO:teuthology.orchestra.run.smithi145.stdout: "bloom_filter_bytes": 120, 2024-04-01T07:06:07.194 INFO:teuthology.orchestra.run.smithi145.stdout: "bloom_filter_items": 120, 2024-04-01T07:06:07.194 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_alloc_bytes": 0, 2024-04-01T07:06:07.194 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_alloc_items": 0, 2024-04-01T07:06:07.194 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_data_bytes": 0, 2024-04-01T07:06:07.194 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_data_items": 0, 2024-04-01T07:06:07.194 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-01T07:06:07.194 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_onode_items": 0, 2024-04-01T07:06:07.194 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-01T07:06:07.195 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_meta_items": 0, 2024-04-01T07:06:07.195 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_other_bytes": 0, 2024-04-01T07:06:07.195 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_other_items": 0, 2024-04-01T07:06:07.195 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-01T07:06:07.195 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_buffer_items": 0, 2024-04-01T07:06:07.195 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_extent_bytes": 0, 2024-04-01T07:06:07.195 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_extent_items": 0, 2024-04-01T07:06:07.195 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_blob_bytes": 0, 2024-04-01T07:06:07.195 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_blob_items": 0, 2024-04-01T07:06:07.195 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-01T07:06:07.195 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_shared_blob_items": 0, 2024-04-01T07:06:07.195 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-01T07:06:07.195 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_inline_bl_items": 0, 2024-04-01T07:06:07.195 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_bytes": 0, 2024-04-01T07:06:07.196 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_items": 0, 2024-04-01T07:06:07.197 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_txc_bytes": 0, 2024-04-01T07:06:07.197 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_txc_items": 0, 2024-04-01T07:06:07.197 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-01T07:06:07.197 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_deferred_items": 0, 2024-04-01T07:06:07.197 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_bytes": 0, 2024-04-01T07:06:07.197 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_items": 0, 2024-04-01T07:06:07.197 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_bytes": 0, 2024-04-01T07:06:07.197 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_items": 0, 2024-04-01T07:06:07.198 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_reader_bytes": 0, 2024-04-01T07:06:07.198 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_reader_items": 0, 2024-04-01T07:06:07.198 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_writer_bytes": 0, 2024-04-01T07:06:07.198 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_writer_items": 0, 2024-04-01T07:06:07.198 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_anon_bytes": 3901339, 2024-04-01T07:06:07.198 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_anon_items": 5583, 2024-04-01T07:06:07.198 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_meta_bytes": 704, 2024-04-01T07:06:07.198 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_meta_items": 8, 2024-04-01T07:06:07.198 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_bytes": 0, 2024-04-01T07:06:07.198 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_items": 0, 2024-04-01T07:06:07.198 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mapbl_bytes": 0, 2024-04-01T07:06:07.198 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mapbl_items": 0, 2024-04-01T07:06:07.198 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pglog_bytes": 0, 2024-04-01T07:06:07.198 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pglog_items": 0, 2024-04-01T07:06:07.199 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_bytes": 7968, 2024-04-01T07:06:07.199 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_items": 182, 2024-04-01T07:06:07.199 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_mapping_bytes": 0, 2024-04-01T07:06:07.199 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_mapping_items": 0, 2024-04-01T07:06:07.199 INFO:teuthology.orchestra.run.smithi145.stdout: "pgmap_bytes": 0, 2024-04-01T07:06:07.199 INFO:teuthology.orchestra.run.smithi145.stdout: "pgmap_items": 0, 2024-04-01T07:06:07.199 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_co_bytes": 18994070, 2024-04-01T07:06:07.199 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_co_items": 380372, 2024-04-01T07:06:07.199 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_1_bytes": 0, 2024-04-01T07:06:07.199 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_1_items": 0, 2024-04-01T07:06:07.199 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_2_bytes": 0, 2024-04-01T07:06:07.199 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_2_items": 0 2024-04-01T07:06:07.199 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.199 INFO:teuthology.orchestra.run.smithi145.stdout: "objecter": { 2024-04-01T07:06:07.199 INFO:teuthology.orchestra.run.smithi145.stdout: "op_active": 0, 2024-04-01T07:06:07.200 INFO:teuthology.orchestra.run.smithi145.stdout: "op_laggy": 0, 2024-04-01T07:06:07.200 INFO:teuthology.orchestra.run.smithi145.stdout: "op_send": 31306, 2024-04-01T07:06:07.200 INFO:teuthology.orchestra.run.smithi145.stdout: "op_send_bytes": 144615174, 2024-04-01T07:06:07.200 INFO:teuthology.orchestra.run.smithi145.stdout: "op_resend": 36, 2024-04-01T07:06:07.200 INFO:teuthology.orchestra.run.smithi145.stdout: "op_reply": 31306, 2024-04-01T07:06:07.200 INFO:teuthology.orchestra.run.smithi145.stdout: "op_latency": { 2024-04-01T07:06:07.200 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 31306, 2024-04-01T07:06:07.200 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 2914.405705222, 2024-04-01T07:06:07.200 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.093094157 2024-04-01T07:06:07.200 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.200 INFO:teuthology.orchestra.run.smithi145.stdout: "op_inflight": 0, 2024-04-01T07:06:07.200 INFO:teuthology.orchestra.run.smithi145.stdout: "oplen_avg": { 2024-04-01T07:06:07.200 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 31306, 2024-04-01T07:06:07.200 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 58090 2024-04-01T07:06:07.200 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.200 INFO:teuthology.orchestra.run.smithi145.stdout: "op": 31306, 2024-04-01T07:06:07.201 INFO:teuthology.orchestra.run.smithi145.stdout: "op_r": 4845, 2024-04-01T07:06:07.201 INFO:teuthology.orchestra.run.smithi145.stdout: "op_w": 26461, 2024-04-01T07:06:07.201 INFO:teuthology.orchestra.run.smithi145.stdout: "op_rmw": 0, 2024-04-01T07:06:07.201 INFO:teuthology.orchestra.run.smithi145.stdout: "op_pg": 0, 2024-04-01T07:06:07.201 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_stat": 903, 2024-04-01T07:06:07.201 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_create": 11340, 2024-04-01T07:06:07.201 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_read": 163, 2024-04-01T07:06:07.201 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_write": 4086, 2024-04-01T07:06:07.201 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_writefull": 135, 2024-04-01T07:06:07.201 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_writesame": 0, 2024-04-01T07:06:07.201 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_append": 0, 2024-04-01T07:06:07.201 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_zero": 3, 2024-04-01T07:06:07.201 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_truncate": 9, 2024-04-01T07:06:07.201 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_delete": 8393, 2024-04-01T07:06:07.201 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_mapext": 0, 2024-04-01T07:06:07.202 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_sparse_read": 0, 2024-04-01T07:06:07.202 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_clonerange": 0, 2024-04-01T07:06:07.202 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_getxattr": 4682, 2024-04-01T07:06:07.202 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_setxattr": 23123, 2024-04-01T07:06:07.202 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_cmpxattr": 0, 2024-04-01T07:06:07.202 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_rmxattr": 0, 2024-04-01T07:06:07.202 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_resetxattrs": 0, 2024-04-01T07:06:07.202 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_call": 0, 2024-04-01T07:06:07.202 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_watch": 0, 2024-04-01T07:06:07.202 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_notify": 0, 2024-04-01T07:06:07.202 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_src_cmpxattr": 0, 2024-04-01T07:06:07.202 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_pgls": 0, 2024-04-01T07:06:07.202 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_pgls_filter": 0, 2024-04-01T07:06:07.202 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_other": 286, 2024-04-01T07:06:07.202 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_active": 0, 2024-04-01T07:06:07.203 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_send": 0, 2024-04-01T07:06:07.203 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_resend": 0, 2024-04-01T07:06:07.203 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_ping": 0, 2024-04-01T07:06:07.203 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_active": 0, 2024-04-01T07:06:07.203 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_send": 0, 2024-04-01T07:06:07.203 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_resend": 0, 2024-04-01T07:06:07.203 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_active": 0, 2024-04-01T07:06:07.203 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_send": 0, 2024-04-01T07:06:07.203 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_resend": 0, 2024-04-01T07:06:07.203 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_active": 0, 2024-04-01T07:06:07.203 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_send": 0, 2024-04-01T07:06:07.203 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_resend": 0, 2024-04-01T07:06:07.203 INFO:teuthology.orchestra.run.smithi145.stdout: "command_active": 0, 2024-04-01T07:06:07.203 INFO:teuthology.orchestra.run.smithi145.stdout: "command_send": 0, 2024-04-01T07:06:07.203 INFO:teuthology.orchestra.run.smithi145.stdout: "command_resend": 0, 2024-04-01T07:06:07.203 INFO:teuthology.orchestra.run.smithi145.stdout: "map_epoch": 90, 2024-04-01T07:06:07.203 INFO:teuthology.orchestra.run.smithi145.stdout: "map_full": 0, 2024-04-01T07:06:07.204 INFO:teuthology.orchestra.run.smithi145.stdout: "map_inc": 12, 2024-04-01T07:06:07.204 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_sessions": 12, 2024-04-01T07:06:07.204 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_session_open": 12, 2024-04-01T07:06:07.204 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_session_close": 0, 2024-04-01T07:06:07.204 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_laggy": 0, 2024-04-01T07:06:07.204 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_wr": 4207, 2024-04-01T07:06:07.204 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_rd": 16, 2024-04-01T07:06:07.204 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_del": 744 2024-04-01T07:06:07.204 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.204 INFO:teuthology.orchestra.run.smithi145.stdout: "oft": { 2024-04-01T07:06:07.204 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_objs": 1, 2024-04-01T07:06:07.204 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_kv_pairs": 0, 2024-04-01T07:06:07.204 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_updates": 0, 2024-04-01T07:06:07.204 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_removes": 0 2024-04-01T07:06:07.204 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.205 INFO:teuthology.orchestra.run.smithi145.stdout: "osd-slow-ops": { 2024-04-01T07:06:07.205 INFO:teuthology.orchestra.run.smithi145.stdout: "slow_ops_count": 29093 2024-04-01T07:06:07.205 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.205 INFO:teuthology.orchestra.run.smithi145.stdout: "purge_queue": { 2024-04-01T07:06:07.205 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_ops": 0, 2024-04-01T07:06:07.205 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_ops_high_water": 15, 2024-04-01T07:06:07.205 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing": 0, 2024-04-01T07:06:07.205 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_high_water": 10, 2024-04-01T07:06:07.205 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executed": 6835, 2024-04-01T07:06:07.205 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_item_in_journal": 0 2024-04-01T07:06:07.205 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.205 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-01T07:06:07.205 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2024-04-01T07:06:07.205 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 104857600, 2024-04-01T07:06:07.205 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2024-04-01T07:06:07.205 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 130321, 2024-04-01T07:06:07.205 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 45425819, 2024-04-01T07:06:07.206 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2024-04-01T07:06:07.206 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 130321, 2024-04-01T07:06:07.206 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2024-04-01T07:06:07.206 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2024-04-01T07:06:07.206 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 130321, 2024-04-01T07:06:07.206 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 45425819, 2024-04-01T07:06:07.206 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2024-04-01T07:06:07.206 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:07.206 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:07.206 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:07.206 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-04-01T07:06:07.206 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.206 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-objecter_bytes": { 2024-04-01T07:06:07.206 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2024-04-01T07:06:07.207 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 104857600, 2024-04-01T07:06:07.207 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2024-04-01T07:06:07.207 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 0, 2024-04-01T07:06:07.207 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 0, 2024-04-01T07:06:07.207 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2024-04-01T07:06:07.207 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 0, 2024-04-01T07:06:07.207 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 31306, 2024-04-01T07:06:07.207 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 145342473, 2024-04-01T07:06:07.207 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 31306, 2024-04-01T07:06:07.207 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 145342473, 2024-04-01T07:06:07.207 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2024-04-01T07:06:07.207 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:07.207 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:07.207 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:07.207 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-04-01T07:06:07.207 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.208 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-objecter_ops": { 2024-04-01T07:06:07.208 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2024-04-01T07:06:07.208 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 1024, 2024-04-01T07:06:07.208 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2024-04-01T07:06:07.208 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 0, 2024-04-01T07:06:07.208 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 0, 2024-04-01T07:06:07.208 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2024-04-01T07:06:07.208 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 0, 2024-04-01T07:06:07.208 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 31306, 2024-04-01T07:06:07.208 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 31306, 2024-04-01T07:06:07.208 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 31306, 2024-04-01T07:06:07.208 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 31306, 2024-04-01T07:06:07.208 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2024-04-01T07:06:07.208 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:07.208 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:07.208 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:07.209 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-04-01T07:06:07.209 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.209 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-write_buf_throttle": { 2024-04-01T07:06:07.209 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2024-04-01T07:06:07.209 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 3758096384, 2024-04-01T07:06:07.209 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2024-04-01T07:06:07.209 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 6835, 2024-04-01T07:06:07.209 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 727415, 2024-04-01T07:06:07.209 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2024-04-01T07:06:07.209 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 6835, 2024-04-01T07:06:07.209 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2024-04-01T07:06:07.209 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2024-04-01T07:06:07.209 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 158, 2024-04-01T07:06:07.209 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 727415, 2024-04-01T07:06:07.209 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2024-04-01T07:06:07.209 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:07.209 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:07.210 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:07.210 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-04-01T07:06:07.210 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:07.210 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-write_buf_throttle-0x55aee5c2a0a0": { 2024-04-01T07:06:07.210 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 60, 2024-04-01T07:06:07.210 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 3758096384, 2024-04-01T07:06:07.210 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2024-04-01T07:06:07.210 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 49220, 2024-04-01T07:06:07.210 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 121610198, 2024-04-01T07:06:07.210 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2024-04-01T07:06:07.210 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 49220, 2024-04-01T07:06:07.210 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2024-04-01T07:06:07.210 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2024-04-01T07:06:07.210 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 3928, 2024-04-01T07:06:07.210 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 121610138, 2024-04-01T07:06:07.210 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2024-04-01T07:06:07.211 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:07.211 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:07.211 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:07.211 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-04-01T07:06:07.211 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-04-01T07:06:07.211 INFO:teuthology.orchestra.run.smithi145.stdout:} 2024-04-01T07:06:07.533 INFO:tasks.check_counter:Daemon mds.b mds.exported=24 2024-04-01T07:06:07.533 INFO:tasks.check_counter:Daemon mds.b mds.imported=15 2024-04-01T07:06:07.533 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=1547 2024-04-01T07:06:07.533 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=1691 2024-04-01T07:06:07.533 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=7 2024-04-01T07:06:07.533 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=11 2024-04-01T07:06:07.533 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=4 2024-04-01T07:06:07.533 DEBUG:tasks.check_counter:Getting stats from e 2024-04-01T07:06:07.534 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph daemon mds.e perf dump 2024-04-01T07:06:07.762 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T07:06:08.776 INFO:teuthology.orchestra.run.smithi145.stdout:{ 2024-04-01T07:06:08.776 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-0": { 2024-04-01T07:06:08.777 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 42411, 2024-04-01T07:06:08.777 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 47831, 2024-04-01T07:06:08.777 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 29074323, 2024-04-01T07:06:08.777 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 49147258, 2024-04-01T07:06:08.777 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 10, 2024-04-01T07:06:08.777 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 3, 2024-04-01T07:06:08.777 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 2.392138703, 2024-04-01T07:06:08.777 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 1.085694488, 2024-04-01T07:06:08.777 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 1.496106672, 2024-04-01T07:06:08.777 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.092405062, 2024-04-01T07:06:08.777 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2024-04-01T07:06:08.777 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 47833, 2024-04-01T07:06:08.777 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 1.746048306, 2024-04-01T07:06:08.777 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000036503 2024-04-01T07:06:08.777 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.778 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2024-04-01T07:06:08.778 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 80052, 2024-04-01T07:06:08.778 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.011798885, 2024-04-01T07:06:08.778 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000147 2024-04-01T07:06:08.778 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.778 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-01T07:06:08.778 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_encrypted_bytes": 0 2024-04-01T07:06:08.778 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.778 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-1": { 2024-04-01T07:06:08.778 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 14914, 2024-04-01T07:06:08.778 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 42744, 2024-04-01T07:06:08.778 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 7147690, 2024-04-01T07:06:08.778 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 31740052, 2024-04-01T07:06:08.778 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 15, 2024-04-01T07:06:08.778 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 8, 2024-04-01T07:06:08.779 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 1.070481932, 2024-04-01T07:06:08.779 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 0.541464098, 2024-04-01T07:06:08.779 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 0.421999585, 2024-04-01T07:06:08.779 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.097389369, 2024-04-01T07:06:08.779 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2024-04-01T07:06:08.779 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 42744, 2024-04-01T07:06:08.779 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 2.535038168, 2024-04-01T07:06:08.779 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000059307 2024-04-01T07:06:08.779 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.779 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2024-04-01T07:06:08.779 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 30257, 2024-04-01T07:06:08.779 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.006796795, 2024-04-01T07:06:08.779 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000224 2024-04-01T07:06:08.779 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.779 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_encrypted_bytes": 1518320, 2024-04-01T07:06:08.780 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_encrypted_bytes": 162432 2024-04-01T07:06:08.780 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.780 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-2": { 2024-04-01T07:06:08.780 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 9118, 2024-04-01T07:06:08.780 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 9276, 2024-04-01T07:06:08.780 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 5921804, 2024-04-01T07:06:08.780 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 11884368, 2024-04-01T07:06:08.780 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 21, 2024-04-01T07:06:08.780 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 8, 2024-04-01T07:06:08.780 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 0.483764496, 2024-04-01T07:06:08.780 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 0.169459949, 2024-04-01T07:06:08.780 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 0.120437108, 2024-04-01T07:06:08.780 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.158543844, 2024-04-01T07:06:08.780 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2024-04-01T07:06:08.780 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 9269, 2024-04-01T07:06:08.780 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.833012244, 2024-04-01T07:06:08.781 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000089870 2024-04-01T07:06:08.781 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.781 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2024-04-01T07:06:08.781 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 50, 2024-04-01T07:06:08.781 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000006854, 2024-04-01T07:06:08.781 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000137 2024-04-01T07:06:08.781 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.781 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_encrypted_bytes": 5696, 2024-04-01T07:06:08.781 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_encrypted_bytes": 420704 2024-04-01T07:06:08.781 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.781 INFO:teuthology.orchestra.run.smithi145.stdout: "cct": { 2024-04-01T07:06:08.781 INFO:teuthology.orchestra.run.smithi145.stdout: "total_workers": 1, 2024-04-01T07:06:08.781 INFO:teuthology.orchestra.run.smithi145.stdout: "unhealthy_workers": 0 2024-04-01T07:06:08.781 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.781 INFO:teuthology.orchestra.run.smithi145.stdout: "finisher-MDSRank": { 2024-04-01T07:06:08.781 INFO:teuthology.orchestra.run.smithi145.stdout: "queue_len": 0, 2024-04-01T07:06:08.782 INFO:teuthology.orchestra.run.smithi145.stdout: "complete_latency": { 2024-04-01T07:06:08.782 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 9740, 2024-04-01T07:06:08.782 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 17.830869800, 2024-04-01T07:06:08.782 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.001830684 2024-04-01T07:06:08.782 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-04-01T07:06:08.782 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.782 INFO:teuthology.orchestra.run.smithi145.stdout: "finisher-PurgeQueue": { 2024-04-01T07:06:08.782 INFO:teuthology.orchestra.run.smithi145.stdout: "queue_len": 0, 2024-04-01T07:06:08.782 INFO:teuthology.orchestra.run.smithi145.stdout: "complete_latency": { 2024-04-01T07:06:08.782 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 6574, 2024-04-01T07:06:08.782 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.970616722, 2024-04-01T07:06:08.782 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000147644 2024-04-01T07:06:08.782 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-04-01T07:06:08.782 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.783 INFO:teuthology.orchestra.run.smithi145.stdout: "mds": { 2024-04-01T07:06:08.783 INFO:teuthology.orchestra.run.smithi145.stdout: "request": 8278, 2024-04-01T07:06:08.783 INFO:teuthology.orchestra.run.smithi145.stdout: "reply": 8212, 2024-04-01T07:06:08.783 INFO:teuthology.orchestra.run.smithi145.stdout: "reply_latency": { 2024-04-01T07:06:08.783 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 8212, 2024-04-01T07:06:08.783 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 38.919117436, 2024-04-01T07:06:08.783 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.004739298 2024-04-01T07:06:08.783 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.783 INFO:teuthology.orchestra.run.smithi145.stdout: "slow_reply": 0, 2024-04-01T07:06:08.783 INFO:teuthology.orchestra.run.smithi145.stdout: "forward": 66, 2024-04-01T07:06:08.783 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_fetch_complete": 0, 2024-04-01T07:06:08.783 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_fetch_keys": 0, 2024-04-01T07:06:08.783 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_commit": 11, 2024-04-01T07:06:08.783 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_split": 0, 2024-04-01T07:06:08.784 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_merge": 0, 2024-04-01T07:06:08.784 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes": 10211, 2024-04-01T07:06:08.784 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_top": 74, 2024-04-01T07:06:08.784 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_bottom": 260, 2024-04-01T07:06:08.784 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_pin_tail": 9877, 2024-04-01T07:06:08.784 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_pinned": 10104, 2024-04-01T07:06:08.784 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_expired": 9374, 2024-04-01T07:06:08.784 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_with_caps": 1, 2024-04-01T07:06:08.784 INFO:teuthology.orchestra.run.smithi145.stdout: "caps": 1, 2024-04-01T07:06:08.784 INFO:teuthology.orchestra.run.smithi145.stdout: "subtrees": 4, 2024-04-01T07:06:08.784 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse": 15032, 2024-04-01T07:06:08.784 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_hit": 12394, 2024-04-01T07:06:08.784 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_forward": 46, 2024-04-01T07:06:08.784 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_discover": 1276, 2024-04-01T07:06:08.784 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_dir_fetch": 0, 2024-04-01T07:06:08.784 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_remote_ino": 0, 2024-04-01T07:06:08.785 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_lock": 6, 2024-04-01T07:06:08.785 INFO:teuthology.orchestra.run.smithi145.stdout: "load_cent": 0, 2024-04-01T07:06:08.785 INFO:teuthology.orchestra.run.smithi145.stdout: "q": 0, 2024-04-01T07:06:08.785 INFO:teuthology.orchestra.run.smithi145.stdout: "exported": 20, 2024-04-01T07:06:08.785 INFO:teuthology.orchestra.run.smithi145.stdout: "exported_inodes": 6872, 2024-04-01T07:06:08.785 INFO:teuthology.orchestra.run.smithi145.stdout: "imported": 29, 2024-04-01T07:06:08.785 INFO:teuthology.orchestra.run.smithi145.stdout: "imported_inodes": 11997, 2024-04-01T07:06:08.785 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_dir_fetch": 0, 2024-04-01T07:06:08.785 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_backtrace_fetch": 13146, 2024-04-01T07:06:08.785 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_peer_discover": 0, 2024-04-01T07:06:08.785 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rfiles": 11356, 2024-04-01T07:06:08.785 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rbytes": 894100753, 2024-04-01T07:06:08.785 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rsnaps": 2, 2024-04-01T07:06:08.785 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_backtrace_fetch": 13146, 2024-04-01T07:06:08.785 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_set_tag": 0, 2024-04-01T07:06:08.786 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_backtrace_repaired": 0, 2024-04-01T07:06:08.786 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_inotable_repaired": 0, 2024-04-01T07:06:08.786 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_dir_inodes": 1188, 2024-04-01T07:06:08.786 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_dir_base_inodes": 0, 2024-04-01T07:06:08.786 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_dirfrag_rstats": 1188, 2024-04-01T07:06:08.786 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_file_inodes": 11958, 2024-04-01T07:06:08.786 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_inode_file_caps": 30, 2024-04-01T07:06:08.786 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_cap_op_revoke": 1136, 2024-04-01T07:06:08.786 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_cap_op_grant": 5754, 2024-04-01T07:06:08.786 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_cap_op_trunc": 0, 2024-04-01T07:06:08.786 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-01T07:06:08.786 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-01T07:06:08.786 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_caps": 1348, 2024-04-01T07:06:08.786 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_caps_dirty": 0, 2024-04-01T07:06:08.786 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_cap_release": 54, 2024-04-01T07:06:08.787 INFO:teuthology.orchestra.run.smithi145.stdout: "process_request_cap_release": 5914 2024-04-01T07:06:08.787 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.787 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_cache": { 2024-04-01T07:06:08.787 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_update": 788, 2024-04-01T07:06:08.787 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_update_receipt": 3588, 2024-04-01T07:06:08.787 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_try_discover": 2421, 2024-04-01T07:06:08.787 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_send_discover": 2333, 2024-04-01T07:06:08.787 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_handle_discover": 1593, 2024-04-01T07:06:08.787 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays": 508, 2024-04-01T07:06:08.787 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays_delayed": 0, 2024-04-01T07:06:08.787 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays_enqueuing": 0, 2024-04-01T07:06:08.787 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_created": 4743, 2024-04-01T07:06:08.787 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_enqueued": 4234, 2024-04-01T07:06:08.787 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_reintegrated": 1, 2024-04-01T07:06:08.787 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_migrated": 0, 2024-04-01T07:06:08.788 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_processing": 0, 2024-04-01T07:06:08.788 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_enqueued": 0, 2024-04-01T07:06:08.788 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_prioritized": 0, 2024-04-01T07:06:08.788 INFO:teuthology.orchestra.run.smithi145.stdout: "recovery_started": 0, 2024-04-01T07:06:08.788 INFO:teuthology.orchestra.run.smithi145.stdout: "recovery_completed": 0, 2024-04-01T07:06:08.788 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_enqueue_scrub": 0, 2024-04-01T07:06:08.788 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_exportdir": 20, 2024-04-01T07:06:08.788 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_flush": 0, 2024-04-01T07:06:08.788 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_fragmentdir": 0, 2024-04-01T07:06:08.788 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_fragstats": 0, 2024-04-01T07:06:08.788 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_inodestats": 0 2024-04-01T07:06:08.788 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.788 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_log": { 2024-04-01T07:06:08.788 INFO:teuthology.orchestra.run.smithi145.stdout: "evadd": 13481, 2024-04-01T07:06:08.788 INFO:teuthology.orchestra.run.smithi145.stdout: "evex": 0, 2024-04-01T07:06:08.788 INFO:teuthology.orchestra.run.smithi145.stdout: "evtrm": 0, 2024-04-01T07:06:08.788 INFO:teuthology.orchestra.run.smithi145.stdout: "ev": 13481, 2024-04-01T07:06:08.789 INFO:teuthology.orchestra.run.smithi145.stdout: "evexg": 0, 2024-04-01T07:06:08.789 INFO:teuthology.orchestra.run.smithi145.stdout: "evexd": 0, 2024-04-01T07:06:08.789 INFO:teuthology.orchestra.run.smithi145.stdout: "segadd": 19, 2024-04-01T07:06:08.789 INFO:teuthology.orchestra.run.smithi145.stdout: "segex": 0, 2024-04-01T07:06:08.789 INFO:teuthology.orchestra.run.smithi145.stdout: "segtrm": 0, 2024-04-01T07:06:08.789 INFO:teuthology.orchestra.run.smithi145.stdout: "seg": 19, 2024-04-01T07:06:08.789 INFO:teuthology.orchestra.run.smithi145.stdout: "segexg": 0, 2024-04-01T07:06:08.789 INFO:teuthology.orchestra.run.smithi145.stdout: "segexd": 0, 2024-04-01T07:06:08.789 INFO:teuthology.orchestra.run.smithi145.stdout: "expos": 4194304, 2024-04-01T07:06:08.789 INFO:teuthology.orchestra.run.smithi145.stdout: "wrpos": 46942714, 2024-04-01T07:06:08.789 INFO:teuthology.orchestra.run.smithi145.stdout: "rdpos": 0, 2024-04-01T07:06:08.789 INFO:teuthology.orchestra.run.smithi145.stdout: "jlat": { 2024-04-01T07:06:08.789 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 790, 2024-04-01T07:06:08.789 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 5.923550957, 2024-04-01T07:06:08.789 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.007498165 2024-04-01T07:06:08.790 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.790 INFO:teuthology.orchestra.run.smithi145.stdout: "replayed": 0 2024-04-01T07:06:08.790 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.790 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_mem": { 2024-04-01T07:06:08.790 INFO:teuthology.orchestra.run.smithi145.stdout: "ino": 4920, 2024-04-01T07:06:08.790 INFO:teuthology.orchestra.run.smithi145.stdout: "ino+": 17002, 2024-04-01T07:06:08.790 INFO:teuthology.orchestra.run.smithi145.stdout: "ino-": 12082, 2024-04-01T07:06:08.790 INFO:teuthology.orchestra.run.smithi145.stdout: "dir": 550, 2024-04-01T07:06:08.790 INFO:teuthology.orchestra.run.smithi145.stdout: "dir+": 2519, 2024-04-01T07:06:08.790 INFO:teuthology.orchestra.run.smithi145.stdout: "dir-": 1969, 2024-04-01T07:06:08.790 INFO:teuthology.orchestra.run.smithi145.stdout: "dn": 10211, 2024-04-01T07:06:08.790 INFO:teuthology.orchestra.run.smithi145.stdout: "dn+": 23953, 2024-04-01T07:06:08.790 INFO:teuthology.orchestra.run.smithi145.stdout: "dn-": 13742, 2024-04-01T07:06:08.790 INFO:teuthology.orchestra.run.smithi145.stdout: "cap": 1, 2024-04-01T07:06:08.790 INFO:teuthology.orchestra.run.smithi145.stdout: "cap+": 11243, 2024-04-01T07:06:08.790 INFO:teuthology.orchestra.run.smithi145.stdout: "cap-": 11242, 2024-04-01T07:06:08.791 INFO:teuthology.orchestra.run.smithi145.stdout: "rss": 103968, 2024-04-01T07:06:08.791 INFO:teuthology.orchestra.run.smithi145.stdout: "heap": 198964 2024-04-01T07:06:08.791 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.791 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_server": { 2024-04-01T07:06:08.791 INFO:teuthology.orchestra.run.smithi145.stdout: "dispatch_client_request": 13777, 2024-04-01T07:06:08.791 INFO:teuthology.orchestra.run.smithi145.stdout: "dispatch_server_request": 104, 2024-04-01T07:06:08.791 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_request": 8278, 2024-04-01T07:06:08.791 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_session": 42, 2024-04-01T07:06:08.791 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_peer_request": 212, 2024-04-01T07:06:08.791 INFO:teuthology.orchestra.run.smithi145.stdout: "req_create_latency": { 2024-04-01T07:06:08.791 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:08.791 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:08.791 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:08.791 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.791 INFO:teuthology.orchestra.run.smithi145.stdout: "req_getattr_latency": { 2024-04-01T07:06:08.791 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 17, 2024-04-01T07:06:08.792 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.063120866, 2024-04-01T07:06:08.792 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.003712992 2024-04-01T07:06:08.792 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.792 INFO:teuthology.orchestra.run.smithi145.stdout: "req_getfilelock_latency": { 2024-04-01T07:06:08.792 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:08.792 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:08.792 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:08.792 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.792 INFO:teuthology.orchestra.run.smithi145.stdout: "req_link_latency": { 2024-04-01T07:06:08.792 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:08.792 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:08.792 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:08.792 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.792 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookup_latency": { 2024-04-01T07:06:08.792 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 2914, 2024-04-01T07:06:08.793 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 1.296569054, 2024-04-01T07:06:08.793 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000444944 2024-04-01T07:06:08.793 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.793 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookuphash_latency": { 2024-04-01T07:06:08.793 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:08.793 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:08.793 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:08.793 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.793 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupino_latency": { 2024-04-01T07:06:08.793 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 1, 2024-04-01T07:06:08.793 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000150053, 2024-04-01T07:06:08.793 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000150053 2024-04-01T07:06:08.793 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.793 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupname_latency": { 2024-04-01T07:06:08.793 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:08.793 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:08.793 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:08.794 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.794 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupparent_latency": { 2024-04-01T07:06:08.794 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:08.794 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:08.794 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:08.794 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.794 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupsnap_latency": { 2024-04-01T07:06:08.794 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:08.794 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:08.794 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:08.794 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.794 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lssnap_latency": { 2024-04-01T07:06:08.794 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:08.794 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:08.794 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:08.794 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.795 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mkdir_latency": { 2024-04-01T07:06:08.795 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:08.795 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:08.795 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:08.795 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.795 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mknod_latency": { 2024-04-01T07:06:08.795 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:08.795 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:08.795 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:08.795 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.795 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mksnap_latency": { 2024-04-01T07:06:08.795 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:08.795 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:08.795 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:08.795 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.796 INFO:teuthology.orchestra.run.smithi145.stdout: "req_open_latency": { 2024-04-01T07:06:08.796 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:08.796 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:08.796 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:08.796 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.796 INFO:teuthology.orchestra.run.smithi145.stdout: "req_readdir_latency": { 2024-04-01T07:06:08.796 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 534, 2024-04-01T07:06:08.796 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.390906204, 2024-04-01T07:06:08.796 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000732034 2024-04-01T07:06:08.796 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.796 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rename_latency": { 2024-04-01T07:06:08.796 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 1, 2024-04-01T07:06:08.796 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.015836821, 2024-04-01T07:06:08.796 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.015836821 2024-04-01T07:06:08.796 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.797 INFO:teuthology.orchestra.run.smithi145.stdout: "req_renamesnap_latency": { 2024-04-01T07:06:08.797 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:08.797 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:08.797 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:08.797 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.797 INFO:teuthology.orchestra.run.smithi145.stdout: "req_snapdiff_latency": { 2024-04-01T07:06:08.797 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:08.797 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:08.797 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:08.797 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.797 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmdir_latency": { 2024-04-01T07:06:08.797 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 539, 2024-04-01T07:06:08.797 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 30.615393331, 2024-04-01T07:06:08.797 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.056800358 2024-04-01T07:06:08.798 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.798 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmsnap_latency": { 2024-04-01T07:06:08.798 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:08.798 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:08.798 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:08.798 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.798 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmxattr_latency": { 2024-04-01T07:06:08.798 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:08.798 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:08.798 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:08.798 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.798 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setattr_latency": { 2024-04-01T07:06:08.798 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:08.798 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:08.798 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:08.799 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.799 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setdirlayout_latency": { 2024-04-01T07:06:08.799 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:08.799 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:08.799 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:08.799 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.799 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setfilelock_latency": { 2024-04-01T07:06:08.799 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:08.799 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:08.799 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:08.799 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.799 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setlayout_latency": { 2024-04-01T07:06:08.799 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:08.799 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:08.799 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:08.799 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.800 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setxattr_latency": { 2024-04-01T07:06:08.800 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:08.800 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:08.800 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:08.800 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.800 INFO:teuthology.orchestra.run.smithi145.stdout: "req_symlink_latency": { 2024-04-01T07:06:08.800 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:08.800 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:08.800 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:08.800 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.800 INFO:teuthology.orchestra.run.smithi145.stdout: "req_unlink_latency": { 2024-04-01T07:06:08.800 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 4206, 2024-04-01T07:06:08.800 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 6.537141107, 2024-04-01T07:06:08.800 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.001554241 2024-04-01T07:06:08.801 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.801 INFO:teuthology.orchestra.run.smithi145.stdout: "cap_revoke_eviction": 0, 2024-04-01T07:06:08.801 INFO:teuthology.orchestra.run.smithi145.stdout: "cap_acquisition_throttle": 0, 2024-04-01T07:06:08.801 INFO:teuthology.orchestra.run.smithi145.stdout: "req_getvxattr_latency": { 2024-04-01T07:06:08.801 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:08.801 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:08.801 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:08.801 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-04-01T07:06:08.801 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.801 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_sessions": { 2024-04-01T07:06:08.801 INFO:teuthology.orchestra.run.smithi145.stdout: "session_count": 2, 2024-04-01T07:06:08.801 INFO:teuthology.orchestra.run.smithi145.stdout: "session_add": 5, 2024-04-01T07:06:08.801 INFO:teuthology.orchestra.run.smithi145.stdout: "session_remove": 3, 2024-04-01T07:06:08.801 INFO:teuthology.orchestra.run.smithi145.stdout: "sessions_open": 2, 2024-04-01T07:06:08.801 INFO:teuthology.orchestra.run.smithi145.stdout: "sessions_stale": 0, 2024-04-01T07:06:08.801 INFO:teuthology.orchestra.run.smithi145.stdout: "total_load": 4813, 2024-04-01T07:06:08.802 INFO:teuthology.orchestra.run.smithi145.stdout: "average_load": 2406, 2024-04-01T07:06:08.802 INFO:teuthology.orchestra.run.smithi145.stdout: "avg_session_uptime": 616, 2024-04-01T07:06:08.802 INFO:teuthology.orchestra.run.smithi145.stdout: "mdthresh_evicted": 0 2024-04-01T07:06:08.802 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.802 INFO:teuthology.orchestra.run.smithi145.stdout: "mempool": { 2024-04-01T07:06:08.802 INFO:teuthology.orchestra.run.smithi145.stdout: "bloom_filter_bytes": 0, 2024-04-01T07:06:08.802 INFO:teuthology.orchestra.run.smithi145.stdout: "bloom_filter_items": 0, 2024-04-01T07:06:08.802 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_alloc_bytes": 0, 2024-04-01T07:06:08.802 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_alloc_items": 0, 2024-04-01T07:06:08.802 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_data_bytes": 0, 2024-04-01T07:06:08.802 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_data_items": 0, 2024-04-01T07:06:08.802 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-01T07:06:08.802 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_onode_items": 0, 2024-04-01T07:06:08.802 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-01T07:06:08.802 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_meta_items": 0, 2024-04-01T07:06:08.802 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_other_bytes": 0, 2024-04-01T07:06:08.803 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_other_items": 0, 2024-04-01T07:06:08.803 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-01T07:06:08.803 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_buffer_items": 0, 2024-04-01T07:06:08.803 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_extent_bytes": 0, 2024-04-01T07:06:08.803 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_extent_items": 0, 2024-04-01T07:06:08.803 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_blob_bytes": 0, 2024-04-01T07:06:08.803 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_blob_items": 0, 2024-04-01T07:06:08.803 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-01T07:06:08.803 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_shared_blob_items": 0, 2024-04-01T07:06:08.803 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-01T07:06:08.803 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_inline_bl_items": 0, 2024-04-01T07:06:08.803 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_bytes": 0, 2024-04-01T07:06:08.803 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_items": 0, 2024-04-01T07:06:08.803 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_txc_bytes": 0, 2024-04-01T07:06:08.803 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_txc_items": 0, 2024-04-01T07:06:08.803 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-01T07:06:08.804 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_deferred_items": 0, 2024-04-01T07:06:08.804 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_bytes": 0, 2024-04-01T07:06:08.804 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_items": 0, 2024-04-01T07:06:08.804 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_bytes": 0, 2024-04-01T07:06:08.804 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_items": 0, 2024-04-01T07:06:08.804 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_reader_bytes": 0, 2024-04-01T07:06:08.804 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_reader_items": 0, 2024-04-01T07:06:08.804 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_writer_bytes": 0, 2024-04-01T07:06:08.804 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_writer_items": 0, 2024-04-01T07:06:08.804 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_anon_bytes": 4534924, 2024-04-01T07:06:08.804 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_anon_items": 6188, 2024-04-01T07:06:08.804 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_meta_bytes": 0, 2024-04-01T07:06:08.804 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_meta_items": 0, 2024-04-01T07:06:08.804 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_bytes": 0, 2024-04-01T07:06:08.804 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_items": 0, 2024-04-01T07:06:08.804 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mapbl_bytes": 0, 2024-04-01T07:06:08.805 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mapbl_items": 0, 2024-04-01T07:06:08.805 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pglog_bytes": 0, 2024-04-01T07:06:08.805 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pglog_items": 0, 2024-04-01T07:06:08.805 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_bytes": 7968, 2024-04-01T07:06:08.805 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_items": 182, 2024-04-01T07:06:08.805 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_mapping_bytes": 0, 2024-04-01T07:06:08.805 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_mapping_items": 0, 2024-04-01T07:06:08.805 INFO:teuthology.orchestra.run.smithi145.stdout: "pgmap_bytes": 0, 2024-04-01T07:06:08.805 INFO:teuthology.orchestra.run.smithi145.stdout: "pgmap_items": 0, 2024-04-01T07:06:08.805 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_co_bytes": 19935947, 2024-04-01T07:06:08.805 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_co_items": 300628, 2024-04-01T07:06:08.805 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_1_bytes": 0, 2024-04-01T07:06:08.805 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_1_items": 0, 2024-04-01T07:06:08.805 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_2_bytes": 0, 2024-04-01T07:06:08.805 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_2_items": 0 2024-04-01T07:06:08.806 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.806 INFO:teuthology.orchestra.run.smithi145.stdout: "objecter": { 2024-04-01T07:06:08.806 INFO:teuthology.orchestra.run.smithi145.stdout: "op_active": 0, 2024-04-01T07:06:08.806 INFO:teuthology.orchestra.run.smithi145.stdout: "op_laggy": 0, 2024-04-01T07:06:08.806 INFO:teuthology.orchestra.run.smithi145.stdout: "op_send": 18637, 2024-04-01T07:06:08.806 INFO:teuthology.orchestra.run.smithi145.stdout: "op_send_bytes": 43916618, 2024-04-01T07:06:08.806 INFO:teuthology.orchestra.run.smithi145.stdout: "op_resend": 33, 2024-04-01T07:06:08.806 INFO:teuthology.orchestra.run.smithi145.stdout: "op_reply": 18637, 2024-04-01T07:06:08.806 INFO:teuthology.orchestra.run.smithi145.stdout: "op_latency": { 2024-04-01T07:06:08.806 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 18637, 2024-04-01T07:06:08.806 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 26.703420401, 2024-04-01T07:06:08.806 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.001432817 2024-04-01T07:06:08.806 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.806 INFO:teuthology.orchestra.run.smithi145.stdout: "op_inflight": 0, 2024-04-01T07:06:08.806 INFO:teuthology.orchestra.run.smithi145.stdout: "oplen_avg": { 2024-04-01T07:06:08.807 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 18637, 2024-04-01T07:06:08.807 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 18696 2024-04-01T07:06:08.807 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.807 INFO:teuthology.orchestra.run.smithi145.stdout: "op": 18637, 2024-04-01T07:06:08.807 INFO:teuthology.orchestra.run.smithi145.stdout: "op_r": 13278, 2024-04-01T07:06:08.807 INFO:teuthology.orchestra.run.smithi145.stdout: "op_w": 5359, 2024-04-01T07:06:08.807 INFO:teuthology.orchestra.run.smithi145.stdout: "op_rmw": 0, 2024-04-01T07:06:08.807 INFO:teuthology.orchestra.run.smithi145.stdout: "op_pg": 0, 2024-04-01T07:06:08.807 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_stat": 0, 2024-04-01T07:06:08.807 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_create": 10, 2024-04-01T07:06:08.807 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_read": 132, 2024-04-01T07:06:08.807 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_write": 922, 2024-04-01T07:06:08.807 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_writefull": 70, 2024-04-01T07:06:08.807 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_writesame": 0, 2024-04-01T07:06:08.807 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_append": 0, 2024-04-01T07:06:08.807 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_zero": 0, 2024-04-01T07:06:08.807 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_truncate": 0, 2024-04-01T07:06:08.808 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_delete": 4320, 2024-04-01T07:06:08.808 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_mapext": 0, 2024-04-01T07:06:08.808 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_sparse_read": 0, 2024-04-01T07:06:08.808 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_clonerange": 0, 2024-04-01T07:06:08.808 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_getxattr": 13146, 2024-04-01T07:06:08.808 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_setxattr": 20, 2024-04-01T07:06:08.808 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_cmpxattr": 0, 2024-04-01T07:06:08.808 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_rmxattr": 0, 2024-04-01T07:06:08.808 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_resetxattrs": 0, 2024-04-01T07:06:08.808 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_call": 0, 2024-04-01T07:06:08.808 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_watch": 0, 2024-04-01T07:06:08.808 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_notify": 0, 2024-04-01T07:06:08.808 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_src_cmpxattr": 0, 2024-04-01T07:06:08.808 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_pgls": 0, 2024-04-01T07:06:08.808 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_pgls_filter": 0, 2024-04-01T07:06:08.809 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_other": 0, 2024-04-01T07:06:08.809 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_active": 0, 2024-04-01T07:06:08.809 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_send": 0, 2024-04-01T07:06:08.809 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_resend": 0, 2024-04-01T07:06:08.809 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_ping": 0, 2024-04-01T07:06:08.809 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_active": 0, 2024-04-01T07:06:08.809 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_send": 0, 2024-04-01T07:06:08.809 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_resend": 0, 2024-04-01T07:06:08.809 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_active": 0, 2024-04-01T07:06:08.809 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_send": 0, 2024-04-01T07:06:08.809 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_resend": 0, 2024-04-01T07:06:08.809 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_active": 0, 2024-04-01T07:06:08.809 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_send": 0, 2024-04-01T07:06:08.809 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_resend": 0, 2024-04-01T07:06:08.809 INFO:teuthology.orchestra.run.smithi145.stdout: "command_active": 0, 2024-04-01T07:06:08.809 INFO:teuthology.orchestra.run.smithi145.stdout: "command_send": 0, 2024-04-01T07:06:08.809 INFO:teuthology.orchestra.run.smithi145.stdout: "command_resend": 0, 2024-04-01T07:06:08.810 INFO:teuthology.orchestra.run.smithi145.stdout: "map_epoch": 91, 2024-04-01T07:06:08.810 INFO:teuthology.orchestra.run.smithi145.stdout: "map_full": 0, 2024-04-01T07:06:08.810 INFO:teuthology.orchestra.run.smithi145.stdout: "map_inc": 12, 2024-04-01T07:06:08.810 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_sessions": 12, 2024-04-01T07:06:08.810 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_session_open": 12, 2024-04-01T07:06:08.810 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_session_close": 0, 2024-04-01T07:06:08.810 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_laggy": 0, 2024-04-01T07:06:08.810 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_wr": 58, 2024-04-01T07:06:08.810 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_rd": 0, 2024-04-01T07:06:08.810 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_del": 18 2024-04-01T07:06:08.810 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.810 INFO:teuthology.orchestra.run.smithi145.stdout: "oft": { 2024-04-01T07:06:08.810 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_objs": 1, 2024-04-01T07:06:08.810 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_kv_pairs": 0, 2024-04-01T07:06:08.810 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_updates": 0, 2024-04-01T07:06:08.810 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_removes": 0 2024-04-01T07:06:08.811 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.811 INFO:teuthology.orchestra.run.smithi145.stdout: "osd-slow-ops": { 2024-04-01T07:06:08.811 INFO:teuthology.orchestra.run.smithi145.stdout: "slow_ops_count": 8373 2024-04-01T07:06:08.811 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.811 INFO:teuthology.orchestra.run.smithi145.stdout: "purge_queue": { 2024-04-01T07:06:08.811 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_ops": 0, 2024-04-01T07:06:08.811 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_ops_high_water": 16, 2024-04-01T07:06:08.811 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing": 0, 2024-04-01T07:06:08.811 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_high_water": 10, 2024-04-01T07:06:08.811 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executed": 4234, 2024-04-01T07:06:08.811 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_item_in_journal": 0 2024-04-01T07:06:08.811 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.811 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-01T07:06:08.811 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2024-04-01T07:06:08.811 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 104857600, 2024-04-01T07:06:08.811 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2024-04-01T07:06:08.811 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 66439, 2024-04-01T07:06:08.812 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 36301316, 2024-04-01T07:06:08.812 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2024-04-01T07:06:08.812 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 66439, 2024-04-01T07:06:08.812 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2024-04-01T07:06:08.812 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2024-04-01T07:06:08.812 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 66439, 2024-04-01T07:06:08.812 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 36301316, 2024-04-01T07:06:08.812 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2024-04-01T07:06:08.812 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:08.812 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:08.812 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:08.812 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-04-01T07:06:08.812 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.812 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-objecter_bytes": { 2024-04-01T07:06:08.812 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2024-04-01T07:06:08.812 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 104857600, 2024-04-01T07:06:08.812 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2024-04-01T07:06:08.813 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 0, 2024-04-01T07:06:08.813 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 0, 2024-04-01T07:06:08.813 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2024-04-01T07:06:08.813 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 0, 2024-04-01T07:06:08.813 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 18637, 2024-04-01T07:06:08.813 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 44385428, 2024-04-01T07:06:08.813 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 18637, 2024-04-01T07:06:08.813 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 44385428, 2024-04-01T07:06:08.813 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2024-04-01T07:06:08.813 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:08.813 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:08.813 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:08.813 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-04-01T07:06:08.813 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.813 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-objecter_ops": { 2024-04-01T07:06:08.813 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2024-04-01T07:06:08.814 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 1024, 2024-04-01T07:06:08.814 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2024-04-01T07:06:08.814 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 0, 2024-04-01T07:06:08.814 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 0, 2024-04-01T07:06:08.814 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2024-04-01T07:06:08.814 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 0, 2024-04-01T07:06:08.814 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 18637, 2024-04-01T07:06:08.814 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 18637, 2024-04-01T07:06:08.814 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 18637, 2024-04-01T07:06:08.814 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 18637, 2024-04-01T07:06:08.814 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2024-04-01T07:06:08.814 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:08.814 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:08.814 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:08.814 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-04-01T07:06:08.814 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.814 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-write_buf_throttle": { 2024-04-01T07:06:08.815 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2024-04-01T07:06:08.815 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 3758096384, 2024-04-01T07:06:08.815 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2024-04-01T07:06:08.815 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 4234, 2024-04-01T07:06:08.815 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 468810, 2024-04-01T07:06:08.815 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2024-04-01T07:06:08.815 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 4234, 2024-04-01T07:06:08.815 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2024-04-01T07:06:08.815 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2024-04-01T07:06:08.815 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 132, 2024-04-01T07:06:08.815 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 468810, 2024-04-01T07:06:08.815 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2024-04-01T07:06:08.815 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:08.815 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:08.815 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:08.815 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-04-01T07:06:08.815 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:08.816 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-write_buf_throttle-0x56288ee120a0": { 2024-04-01T07:06:08.816 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2024-04-01T07:06:08.816 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 3758096384, 2024-04-01T07:06:08.816 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2024-04-01T07:06:08.816 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 13481, 2024-04-01T07:06:08.816 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 42748410, 2024-04-01T07:06:08.816 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2024-04-01T07:06:08.816 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 13481, 2024-04-01T07:06:08.816 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2024-04-01T07:06:08.816 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2024-04-01T07:06:08.816 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 790, 2024-04-01T07:06:08.816 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 42748410, 2024-04-01T07:06:08.816 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2024-04-01T07:06:08.816 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:08.816 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:08.816 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:08.817 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-04-01T07:06:08.817 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-04-01T07:06:08.817 INFO:teuthology.orchestra.run.smithi145.stdout:} 2024-04-01T07:06:08.890 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:08 smithi153 ceph-mon[48187]: osdmap e91: 12 total, 12 up, 12 in 2024-04-01T07:06:08.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:08 smithi153 ceph-mon[48187]: pgmap v319: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 29 op/s 2024-04-01T07:06:08.927 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:08 smithi145 ceph-mon[47816]: osdmap e91: 12 total, 12 up, 12 in 2024-04-01T07:06:08.927 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:08 smithi145 ceph-mon[47816]: pgmap v319: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 29 op/s 2024-04-01T07:06:09.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:08 smithi083 ceph-mon[43429]: osdmap e91: 12 total, 12 up, 12 in 2024-04-01T07:06:09.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:08 smithi083 ceph-mon[43429]: pgmap v319: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 29 op/s 2024-04-01T07:06:09.149 INFO:tasks.check_counter:Daemon mds.e mds.exported=20 2024-04-01T07:06:09.149 INFO:tasks.check_counter:Daemon mds.e mds.imported=29 2024-04-01T07:06:09.149 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=788 2024-04-01T07:06:09.149 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=3588 2024-04-01T07:06:09.149 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=2 2024-04-01T07:06:09.149 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-04-01T07:06:09.149 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-04-01T07:06:09.149 DEBUG:tasks.check_counter:Getting stats from h 2024-04-01T07:06:09.150 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph daemon mds.h perf dump 2024-04-01T07:06:09.370 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T07:06:10.360 INFO:teuthology.orchestra.run.smithi145.stdout:{ 2024-04-01T07:06:10.360 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-0": { 2024-04-01T07:06:10.360 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 25545, 2024-04-01T07:06:10.360 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 22319, 2024-04-01T07:06:10.361 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 13095253, 2024-04-01T07:06:10.361 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 22860401, 2024-04-01T07:06:10.361 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 11, 2024-04-01T07:06:10.361 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 4, 2024-04-01T07:06:10.361 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 1.443665288, 2024-04-01T07:06:10.361 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 0.643490544, 2024-04-01T07:06:10.361 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 0.904440669, 2024-04-01T07:06:10.361 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.075017884, 2024-04-01T07:06:10.361 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2024-04-01T07:06:10.361 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 22318, 2024-04-01T07:06:10.361 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 1.049709732, 2024-04-01T07:06:10.361 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000047034 2024-04-01T07:06:10.361 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.361 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2024-04-01T07:06:10.361 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 40963, 2024-04-01T07:06:10.362 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.006689209, 2024-04-01T07:06:10.362 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000163 2024-04-01T07:06:10.362 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.362 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-04-01T07:06:10.362 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_encrypted_bytes": 302384 2024-04-01T07:06:10.362 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.362 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-1": { 2024-04-01T07:06:10.362 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 4044, 2024-04-01T07:06:10.362 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 4034, 2024-04-01T07:06:10.362 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 2471668, 2024-04-01T07:06:10.362 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 5584357, 2024-04-01T07:06:10.362 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 14, 2024-04-01T07:06:10.362 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 7, 2024-04-01T07:06:10.362 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 0.255536257, 2024-04-01T07:06:10.363 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 0.083768462, 2024-04-01T07:06:10.363 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 0.086012592, 2024-04-01T07:06:10.363 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.080682411, 2024-04-01T07:06:10.363 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2024-04-01T07:06:10.363 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 4033, 2024-04-01T07:06:10.363 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.502494234, 2024-04-01T07:06:10.363 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000124595 2024-04-01T07:06:10.363 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.363 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2024-04-01T07:06:10.363 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 52, 2024-04-01T07:06:10.363 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000010436, 2024-04-01T07:06:10.363 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000200 2024-04-01T07:06:10.363 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.363 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_encrypted_bytes": 1520112, 2024-04-01T07:06:10.364 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_encrypted_bytes": 127632 2024-04-01T07:06:10.364 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.364 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-2": { 2024-04-01T07:06:10.364 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 25103, 2024-04-01T07:06:10.364 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 31119, 2024-04-01T07:06:10.364 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 9850591, 2024-04-01T07:06:10.364 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 20971524, 2024-04-01T07:06:10.364 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 21, 2024-04-01T07:06:10.364 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 6, 2024-04-01T07:06:10.364 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 1.276728850, 2024-04-01T07:06:10.364 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 0.591736827, 2024-04-01T07:06:10.364 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 0.990922915, 2024-04-01T07:06:10.364 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.061923747, 2024-04-01T07:06:10.364 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2024-04-01T07:06:10.364 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 31116, 2024-04-01T07:06:10.365 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 1.109361224, 2024-04-01T07:06:10.365 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000035652 2024-04-01T07:06:10.365 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.365 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2024-04-01T07:06:10.365 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 39851, 2024-04-01T07:06:10.365 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.006837386, 2024-04-01T07:06:10.365 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000171 2024-04-01T07:06:10.365 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.365 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_encrypted_bytes": 1072, 2024-04-01T07:06:10.365 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_encrypted_bytes": 113520 2024-04-01T07:06:10.365 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.365 INFO:teuthology.orchestra.run.smithi145.stdout: "cct": { 2024-04-01T07:06:10.365 INFO:teuthology.orchestra.run.smithi145.stdout: "total_workers": 1, 2024-04-01T07:06:10.365 INFO:teuthology.orchestra.run.smithi145.stdout: "unhealthy_workers": 0 2024-04-01T07:06:10.365 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.365 INFO:teuthology.orchestra.run.smithi145.stdout: "finisher-MDSRank": { 2024-04-01T07:06:10.365 INFO:teuthology.orchestra.run.smithi145.stdout: "queue_len": 0, 2024-04-01T07:06:10.366 INFO:teuthology.orchestra.run.smithi145.stdout: "complete_latency": { 2024-04-01T07:06:10.366 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 5217, 2024-04-01T07:06:10.366 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 7.445810774, 2024-04-01T07:06:10.366 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.001427220 2024-04-01T07:06:10.366 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-04-01T07:06:10.366 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.366 INFO:teuthology.orchestra.run.smithi145.stdout: "finisher-PurgeQueue": { 2024-04-01T07:06:10.366 INFO:teuthology.orchestra.run.smithi145.stdout: "queue_len": 0, 2024-04-01T07:06:10.366 INFO:teuthology.orchestra.run.smithi145.stdout: "complete_latency": { 2024-04-01T07:06:10.366 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 3191, 2024-04-01T07:06:10.366 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.573025293, 2024-04-01T07:06:10.366 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000179575 2024-04-01T07:06:10.366 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-04-01T07:06:10.366 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.367 INFO:teuthology.orchestra.run.smithi145.stdout: "mds": { 2024-04-01T07:06:10.367 INFO:teuthology.orchestra.run.smithi145.stdout: "request": 4658, 2024-04-01T07:06:10.367 INFO:teuthology.orchestra.run.smithi145.stdout: "reply": 4594, 2024-04-01T07:06:10.367 INFO:teuthology.orchestra.run.smithi145.stdout: "reply_latency": { 2024-04-01T07:06:10.367 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 4594, 2024-04-01T07:06:10.367 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 12.081738211, 2024-04-01T07:06:10.367 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.002629895 2024-04-01T07:06:10.367 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.367 INFO:teuthology.orchestra.run.smithi145.stdout: "slow_reply": 0, 2024-04-01T07:06:10.367 INFO:teuthology.orchestra.run.smithi145.stdout: "forward": 64, 2024-04-01T07:06:10.367 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_fetch_complete": 0, 2024-04-01T07:06:10.367 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_fetch_keys": 0, 2024-04-01T07:06:10.367 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_commit": 11, 2024-04-01T07:06:10.367 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_split": 0, 2024-04-01T07:06:10.367 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_merge": 0, 2024-04-01T07:06:10.368 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes": 5624, 2024-04-01T07:06:10.368 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_top": 3, 2024-04-01T07:06:10.368 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_bottom": 91, 2024-04-01T07:06:10.368 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_pin_tail": 5530, 2024-04-01T07:06:10.368 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_pinned": 5619, 2024-04-01T07:06:10.368 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_expired": 3869, 2024-04-01T07:06:10.368 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_with_caps": 0, 2024-04-01T07:06:10.368 INFO:teuthology.orchestra.run.smithi145.stdout: "caps": 0, 2024-04-01T07:06:10.368 INFO:teuthology.orchestra.run.smithi145.stdout: "subtrees": 4, 2024-04-01T07:06:10.368 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse": 9638, 2024-04-01T07:06:10.368 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_hit": 7612, 2024-04-01T07:06:10.368 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_forward": 61, 2024-04-01T07:06:10.368 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_discover": 1413, 2024-04-01T07:06:10.368 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_dir_fetch": 0, 2024-04-01T07:06:10.368 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_remote_ino": 0, 2024-04-01T07:06:10.368 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_lock": 7, 2024-04-01T07:06:10.369 INFO:teuthology.orchestra.run.smithi145.stdout: "load_cent": 0, 2024-04-01T07:06:10.369 INFO:teuthology.orchestra.run.smithi145.stdout: "q": 0, 2024-04-01T07:06:10.369 INFO:teuthology.orchestra.run.smithi145.stdout: "exported": 6, 2024-04-01T07:06:10.369 INFO:teuthology.orchestra.run.smithi145.stdout: "exported_inodes": 1091, 2024-04-01T07:06:10.369 INFO:teuthology.orchestra.run.smithi145.stdout: "imported": 6, 2024-04-01T07:06:10.369 INFO:teuthology.orchestra.run.smithi145.stdout: "imported_inodes": 3783, 2024-04-01T07:06:10.369 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_dir_fetch": 0, 2024-04-01T07:06:10.369 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_backtrace_fetch": 6964, 2024-04-01T07:06:10.369 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_peer_discover": 0, 2024-04-01T07:06:10.369 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rfiles": 11356, 2024-04-01T07:06:10.369 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rbytes": 894100753, 2024-04-01T07:06:10.369 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rsnaps": 2, 2024-04-01T07:06:10.369 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_backtrace_fetch": 6964, 2024-04-01T07:06:10.369 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_set_tag": 0, 2024-04-01T07:06:10.369 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_backtrace_repaired": 0, 2024-04-01T07:06:10.370 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_inotable_repaired": 0, 2024-04-01T07:06:10.370 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_dir_inodes": 1093, 2024-04-01T07:06:10.370 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_dir_base_inodes": 0, 2024-04-01T07:06:10.370 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_dirfrag_rstats": 1093, 2024-04-01T07:06:10.370 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_file_inodes": 5871, 2024-04-01T07:06:10.370 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_inode_file_caps": 4, 2024-04-01T07:06:10.370 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_cap_op_revoke": 808, 2024-04-01T07:06:10.370 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_cap_op_grant": 3294, 2024-04-01T07:06:10.370 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_cap_op_trunc": 0, 2024-04-01T07:06:10.370 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-01T07:06:10.370 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-01T07:06:10.371 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_caps": 2748, 2024-04-01T07:06:10.371 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_caps_dirty": 0, 2024-04-01T07:06:10.371 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_cap_release": 21, 2024-04-01T07:06:10.371 INFO:teuthology.orchestra.run.smithi145.stdout: "process_request_cap_release": 3495 2024-04-01T07:06:10.371 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.371 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_cache": { 2024-04-01T07:06:10.371 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_update": 703, 2024-04-01T07:06:10.371 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_update_receipt": 3988, 2024-04-01T07:06:10.371 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_try_discover": 2692, 2024-04-01T07:06:10.371 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_send_discover": 2594, 2024-04-01T07:06:10.371 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_handle_discover": 1391, 2024-04-01T07:06:10.371 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays": 398, 2024-04-01T07:06:10.371 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays_delayed": 0, 2024-04-01T07:06:10.371 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays_enqueuing": 0, 2024-04-01T07:06:10.371 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_created": 2533, 2024-04-01T07:06:10.371 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_enqueued": 2135, 2024-04-01T07:06:10.372 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_reintegrated": 0, 2024-04-01T07:06:10.372 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_migrated": 0, 2024-04-01T07:06:10.372 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_processing": 0, 2024-04-01T07:06:10.372 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_enqueued": 0, 2024-04-01T07:06:10.372 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_prioritized": 0, 2024-04-01T07:06:10.372 INFO:teuthology.orchestra.run.smithi145.stdout: "recovery_started": 0, 2024-04-01T07:06:10.372 INFO:teuthology.orchestra.run.smithi145.stdout: "recovery_completed": 0, 2024-04-01T07:06:10.372 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_enqueue_scrub": 0, 2024-04-01T07:06:10.372 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_exportdir": 8, 2024-04-01T07:06:10.372 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_flush": 0, 2024-04-01T07:06:10.372 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_fragmentdir": 0, 2024-04-01T07:06:10.372 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_fragstats": 0, 2024-04-01T07:06:10.372 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_inodestats": 0 2024-04-01T07:06:10.372 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.372 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_log": { 2024-04-01T07:06:10.372 INFO:teuthology.orchestra.run.smithi145.stdout: "evadd": 8793, 2024-04-01T07:06:10.373 INFO:teuthology.orchestra.run.smithi145.stdout: "evex": 0, 2024-04-01T07:06:10.373 INFO:teuthology.orchestra.run.smithi145.stdout: "evtrm": 0, 2024-04-01T07:06:10.373 INFO:teuthology.orchestra.run.smithi145.stdout: "ev": 8793, 2024-04-01T07:06:10.373 INFO:teuthology.orchestra.run.smithi145.stdout: "evexg": 0, 2024-04-01T07:06:10.373 INFO:teuthology.orchestra.run.smithi145.stdout: "evexd": 0, 2024-04-01T07:06:10.373 INFO:teuthology.orchestra.run.smithi145.stdout: "segadd": 12, 2024-04-01T07:06:10.373 INFO:teuthology.orchestra.run.smithi145.stdout: "segex": 0, 2024-04-01T07:06:10.373 INFO:teuthology.orchestra.run.smithi145.stdout: "segtrm": 0, 2024-04-01T07:06:10.373 INFO:teuthology.orchestra.run.smithi145.stdout: "seg": 12, 2024-04-01T07:06:10.373 INFO:teuthology.orchestra.run.smithi145.stdout: "segexg": 0, 2024-04-01T07:06:10.373 INFO:teuthology.orchestra.run.smithi145.stdout: "segexd": 0, 2024-04-01T07:06:10.373 INFO:teuthology.orchestra.run.smithi145.stdout: "expos": 4194304, 2024-04-01T07:06:10.373 INFO:teuthology.orchestra.run.smithi145.stdout: "wrpos": 30226247, 2024-04-01T07:06:10.373 INFO:teuthology.orchestra.run.smithi145.stdout: "rdpos": 0, 2024-04-01T07:06:10.373 INFO:teuthology.orchestra.run.smithi145.stdout: "jlat": { 2024-04-01T07:06:10.373 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 542, 2024-04-01T07:06:10.373 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 1.828096003, 2024-04-01T07:06:10.374 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.003372870 2024-04-01T07:06:10.374 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.374 INFO:teuthology.orchestra.run.smithi145.stdout: "replayed": 0 2024-04-01T07:06:10.374 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.374 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_mem": { 2024-04-01T07:06:10.374 INFO:teuthology.orchestra.run.smithi145.stdout: "ino": 2556, 2024-04-01T07:06:10.374 INFO:teuthology.orchestra.run.smithi145.stdout: "ino+": 7031, 2024-04-01T07:06:10.374 INFO:teuthology.orchestra.run.smithi145.stdout: "ino-": 4475, 2024-04-01T07:06:10.374 INFO:teuthology.orchestra.run.smithi145.stdout: "dir": 434, 2024-04-01T07:06:10.374 INFO:teuthology.orchestra.run.smithi145.stdout: "dir+": 2022, 2024-04-01T07:06:10.374 INFO:teuthology.orchestra.run.smithi145.stdout: "dir-": 1588, 2024-04-01T07:06:10.374 INFO:teuthology.orchestra.run.smithi145.stdout: "dn": 5624, 2024-04-01T07:06:10.374 INFO:teuthology.orchestra.run.smithi145.stdout: "dn+": 11628, 2024-04-01T07:06:10.374 INFO:teuthology.orchestra.run.smithi145.stdout: "dn-": 6004, 2024-04-01T07:06:10.374 INFO:teuthology.orchestra.run.smithi145.stdout: "cap": 0, 2024-04-01T07:06:10.374 INFO:teuthology.orchestra.run.smithi145.stdout: "cap+": 3621, 2024-04-01T07:06:10.375 INFO:teuthology.orchestra.run.smithi145.stdout: "cap-": 3621, 2024-04-01T07:06:10.375 INFO:teuthology.orchestra.run.smithi145.stdout: "rss": 87748, 2024-04-01T07:06:10.375 INFO:teuthology.orchestra.run.smithi145.stdout: "heap": 198964 2024-04-01T07:06:10.375 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.375 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_server": { 2024-04-01T07:06:10.375 INFO:teuthology.orchestra.run.smithi145.stdout: "dispatch_client_request": 7478, 2024-04-01T07:06:10.375 INFO:teuthology.orchestra.run.smithi145.stdout: "dispatch_server_request": 77, 2024-04-01T07:06:10.375 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_request": 4658, 2024-04-01T07:06:10.375 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_session": 31, 2024-04-01T07:06:10.375 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_peer_request": 111, 2024-04-01T07:06:10.375 INFO:teuthology.orchestra.run.smithi145.stdout: "req_create_latency": { 2024-04-01T07:06:10.375 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:10.375 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:10.375 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:10.375 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.376 INFO:teuthology.orchestra.run.smithi145.stdout: "req_getattr_latency": { 2024-04-01T07:06:10.376 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 2, 2024-04-01T07:06:10.376 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.001420201, 2024-04-01T07:06:10.376 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000710100 2024-04-01T07:06:10.376 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.376 INFO:teuthology.orchestra.run.smithi145.stdout: "req_getfilelock_latency": { 2024-04-01T07:06:10.376 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:10.376 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:10.376 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:10.376 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.376 INFO:teuthology.orchestra.run.smithi145.stdout: "req_link_latency": { 2024-04-01T07:06:10.376 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:10.376 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:10.376 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:10.376 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.376 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookup_latency": { 2024-04-01T07:06:10.377 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 1649, 2024-04-01T07:06:10.377 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.737608017, 2024-04-01T07:06:10.377 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000447306 2024-04-01T07:06:10.377 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.377 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookuphash_latency": { 2024-04-01T07:06:10.377 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:10.377 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:10.377 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:10.377 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.377 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupino_latency": { 2024-04-01T07:06:10.377 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:10.377 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:10.377 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:10.377 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.377 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupname_latency": { 2024-04-01T07:06:10.378 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:10.378 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:10.378 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:10.378 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.378 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupparent_latency": { 2024-04-01T07:06:10.378 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:10.378 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:10.378 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:10.378 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.378 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupsnap_latency": { 2024-04-01T07:06:10.378 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:10.378 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:10.378 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:10.378 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.378 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lssnap_latency": { 2024-04-01T07:06:10.378 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:10.379 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:10.379 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:10.379 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.379 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mkdir_latency": { 2024-04-01T07:06:10.379 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:10.379 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:10.379 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:10.379 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.379 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mknod_latency": { 2024-04-01T07:06:10.379 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:10.379 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:10.379 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:10.379 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.379 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mksnap_latency": { 2024-04-01T07:06:10.379 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:10.380 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:10.380 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:10.380 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.380 INFO:teuthology.orchestra.run.smithi145.stdout: "req_open_latency": { 2024-04-01T07:06:10.380 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:10.380 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:10.380 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:10.380 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.380 INFO:teuthology.orchestra.run.smithi145.stdout: "req_readdir_latency": { 2024-04-01T07:06:10.380 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 410, 2024-04-01T07:06:10.380 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.252648394, 2024-04-01T07:06:10.380 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000616215 2024-04-01T07:06:10.380 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.380 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rename_latency": { 2024-04-01T07:06:10.380 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:10.380 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:10.381 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:10.381 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.381 INFO:teuthology.orchestra.run.smithi145.stdout: "req_renamesnap_latency": { 2024-04-01T07:06:10.381 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:10.381 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:10.381 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:10.381 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.381 INFO:teuthology.orchestra.run.smithi145.stdout: "req_snapdiff_latency": { 2024-04-01T07:06:10.381 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:10.381 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:10.381 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:10.381 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.381 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmdir_latency": { 2024-04-01T07:06:10.381 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 398, 2024-04-01T07:06:10.381 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 8.335690027, 2024-04-01T07:06:10.381 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.020943944 2024-04-01T07:06:10.382 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.382 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmsnap_latency": { 2024-04-01T07:06:10.382 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:10.382 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:10.382 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:10.382 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.382 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmxattr_latency": { 2024-04-01T07:06:10.382 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:10.382 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:10.382 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:10.382 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.382 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setattr_latency": { 2024-04-01T07:06:10.382 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:10.382 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:10.382 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:10.383 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.383 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setdirlayout_latency": { 2024-04-01T07:06:10.383 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:10.383 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:10.383 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:10.383 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.383 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setfilelock_latency": { 2024-04-01T07:06:10.383 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:10.383 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:10.383 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:10.383 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.383 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setlayout_latency": { 2024-04-01T07:06:10.383 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:10.383 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:10.383 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:10.384 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.384 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setxattr_latency": { 2024-04-01T07:06:10.384 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:10.384 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:10.384 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:10.384 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.384 INFO:teuthology.orchestra.run.smithi145.stdout: "req_symlink_latency": { 2024-04-01T07:06:10.384 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:10.384 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:10.384 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:10.384 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.384 INFO:teuthology.orchestra.run.smithi145.stdout: "req_unlink_latency": { 2024-04-01T07:06:10.384 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 2135, 2024-04-01T07:06:10.384 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 2.754371572, 2024-04-01T07:06:10.384 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.001290103 2024-04-01T07:06:10.384 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.385 INFO:teuthology.orchestra.run.smithi145.stdout: "cap_revoke_eviction": 0, 2024-04-01T07:06:10.385 INFO:teuthology.orchestra.run.smithi145.stdout: "cap_acquisition_throttle": 0, 2024-04-01T07:06:10.385 INFO:teuthology.orchestra.run.smithi145.stdout: "req_getvxattr_latency": { 2024-04-01T07:06:10.385 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:10.385 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:10.385 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:10.385 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-04-01T07:06:10.385 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.385 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_sessions": { 2024-04-01T07:06:10.385 INFO:teuthology.orchestra.run.smithi145.stdout: "session_count": 2, 2024-04-01T07:06:10.385 INFO:teuthology.orchestra.run.smithi145.stdout: "session_add": 5, 2024-04-01T07:06:10.385 INFO:teuthology.orchestra.run.smithi145.stdout: "session_remove": 3, 2024-04-01T07:06:10.385 INFO:teuthology.orchestra.run.smithi145.stdout: "sessions_open": 2, 2024-04-01T07:06:10.385 INFO:teuthology.orchestra.run.smithi145.stdout: "sessions_stale": 0, 2024-04-01T07:06:10.385 INFO:teuthology.orchestra.run.smithi145.stdout: "total_load": 3829, 2024-04-01T07:06:10.386 INFO:teuthology.orchestra.run.smithi145.stdout: "average_load": 1914, 2024-04-01T07:06:10.386 INFO:teuthology.orchestra.run.smithi145.stdout: "avg_session_uptime": 564, 2024-04-01T07:06:10.386 INFO:teuthology.orchestra.run.smithi145.stdout: "mdthresh_evicted": 0 2024-04-01T07:06:10.386 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.386 INFO:teuthology.orchestra.run.smithi145.stdout: "mempool": { 2024-04-01T07:06:10.386 INFO:teuthology.orchestra.run.smithi145.stdout: "bloom_filter_bytes": 0, 2024-04-01T07:06:10.386 INFO:teuthology.orchestra.run.smithi145.stdout: "bloom_filter_items": 0, 2024-04-01T07:06:10.386 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_alloc_bytes": 0, 2024-04-01T07:06:10.386 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_alloc_items": 0, 2024-04-01T07:06:10.386 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_data_bytes": 0, 2024-04-01T07:06:10.386 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_data_items": 0, 2024-04-01T07:06:10.386 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-01T07:06:10.386 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_onode_items": 0, 2024-04-01T07:06:10.386 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-01T07:06:10.387 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_meta_items": 0, 2024-04-01T07:06:10.387 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_other_bytes": 0, 2024-04-01T07:06:10.387 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_other_items": 0, 2024-04-01T07:06:10.387 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-01T07:06:10.387 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_buffer_items": 0, 2024-04-01T07:06:10.387 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_extent_bytes": 0, 2024-04-01T07:06:10.387 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_extent_items": 0, 2024-04-01T07:06:10.387 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_blob_bytes": 0, 2024-04-01T07:06:10.387 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_blob_items": 0, 2024-04-01T07:06:10.387 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-01T07:06:10.387 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_shared_blob_items": 0, 2024-04-01T07:06:10.387 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-01T07:06:10.387 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_inline_bl_items": 0, 2024-04-01T07:06:10.387 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_bytes": 0, 2024-04-01T07:06:10.387 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_items": 0, 2024-04-01T07:06:10.388 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_txc_bytes": 0, 2024-04-01T07:06:10.388 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_txc_items": 0, 2024-04-01T07:06:10.388 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-01T07:06:10.388 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_deferred_items": 0, 2024-04-01T07:06:10.388 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_bytes": 0, 2024-04-01T07:06:10.388 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_items": 0, 2024-04-01T07:06:10.388 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_bytes": 0, 2024-04-01T07:06:10.388 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_items": 0, 2024-04-01T07:06:10.388 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_reader_bytes": 0, 2024-04-01T07:06:10.388 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_reader_items": 0, 2024-04-01T07:06:10.388 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_writer_bytes": 0, 2024-04-01T07:06:10.388 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_writer_items": 0, 2024-04-01T07:06:10.388 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_anon_bytes": 3575868, 2024-04-01T07:06:10.388 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_anon_items": 3451, 2024-04-01T07:06:10.388 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_meta_bytes": 0, 2024-04-01T07:06:10.388 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_meta_items": 0, 2024-04-01T07:06:10.389 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_bytes": 0, 2024-04-01T07:06:10.389 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_items": 0, 2024-04-01T07:06:10.389 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mapbl_bytes": 0, 2024-04-01T07:06:10.389 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mapbl_items": 0, 2024-04-01T07:06:10.389 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pglog_bytes": 0, 2024-04-01T07:06:10.389 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pglog_items": 0, 2024-04-01T07:06:10.389 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_bytes": 7968, 2024-04-01T07:06:10.389 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_items": 182, 2024-04-01T07:06:10.389 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_mapping_bytes": 0, 2024-04-01T07:06:10.389 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_mapping_items": 0, 2024-04-01T07:06:10.389 INFO:teuthology.orchestra.run.smithi145.stdout: "pgmap_bytes": 0, 2024-04-01T07:06:10.389 INFO:teuthology.orchestra.run.smithi145.stdout: "pgmap_items": 0, 2024-04-01T07:06:10.389 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_co_bytes": 11138166, 2024-04-01T07:06:10.389 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_co_items": 186812, 2024-04-01T07:06:10.389 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_1_bytes": 0, 2024-04-01T07:06:10.389 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_1_items": 0, 2024-04-01T07:06:10.390 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_2_bytes": 0, 2024-04-01T07:06:10.390 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_2_items": 0 2024-04-01T07:06:10.390 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.390 INFO:teuthology.orchestra.run.smithi145.stdout: "objecter": { 2024-04-01T07:06:10.390 INFO:teuthology.orchestra.run.smithi145.stdout: "op_active": 0, 2024-04-01T07:06:10.390 INFO:teuthology.orchestra.run.smithi145.stdout: "op_laggy": 0, 2024-04-01T07:06:10.390 INFO:teuthology.orchestra.run.smithi145.stdout: "op_send": 9830, 2024-04-01T07:06:10.390 INFO:teuthology.orchestra.run.smithi145.stdout: "op_send_bytes": 26543714, 2024-04-01T07:06:10.390 INFO:teuthology.orchestra.run.smithi145.stdout: "op_resend": 33, 2024-04-01T07:06:10.390 INFO:teuthology.orchestra.run.smithi145.stdout: "op_reply": 9830, 2024-04-01T07:06:10.390 INFO:teuthology.orchestra.run.smithi145.stdout: "op_latency": { 2024-04-01T07:06:10.390 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 9830, 2024-04-01T07:06:10.390 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 14.369688180, 2024-04-01T07:06:10.390 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.001461819 2024-04-01T07:06:10.390 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.391 INFO:teuthology.orchestra.run.smithi145.stdout: "op_inflight": 0, 2024-04-01T07:06:10.391 INFO:teuthology.orchestra.run.smithi145.stdout: "oplen_avg": { 2024-04-01T07:06:10.391 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 9830, 2024-04-01T07:06:10.391 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 9868 2024-04-01T07:06:10.391 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.391 INFO:teuthology.orchestra.run.smithi145.stdout: "op": 9830, 2024-04-01T07:06:10.391 INFO:teuthology.orchestra.run.smithi145.stdout: "op_r": 7016, 2024-04-01T07:06:10.391 INFO:teuthology.orchestra.run.smithi145.stdout: "op_w": 2814, 2024-04-01T07:06:10.391 INFO:teuthology.orchestra.run.smithi145.stdout: "op_rmw": 0, 2024-04-01T07:06:10.391 INFO:teuthology.orchestra.run.smithi145.stdout: "op_pg": 0, 2024-04-01T07:06:10.391 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_stat": 0, 2024-04-01T07:06:10.391 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_create": 10, 2024-04-01T07:06:10.391 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_read": 52, 2024-04-01T07:06:10.391 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_write": 594, 2024-04-01T07:06:10.391 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_writefull": 34, 2024-04-01T07:06:10.391 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_writesame": 0, 2024-04-01T07:06:10.392 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_append": 0, 2024-04-01T07:06:10.392 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_zero": 0, 2024-04-01T07:06:10.392 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_truncate": 0, 2024-04-01T07:06:10.392 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_delete": 2153, 2024-04-01T07:06:10.392 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_mapext": 0, 2024-04-01T07:06:10.392 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_sparse_read": 0, 2024-04-01T07:06:10.392 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_clonerange": 0, 2024-04-01T07:06:10.392 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_getxattr": 6964, 2024-04-01T07:06:10.392 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_setxattr": 20, 2024-04-01T07:06:10.392 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_cmpxattr": 0, 2024-04-01T07:06:10.392 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_rmxattr": 0, 2024-04-01T07:06:10.392 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_resetxattrs": 0, 2024-04-01T07:06:10.392 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_call": 0, 2024-04-01T07:06:10.392 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_watch": 0, 2024-04-01T07:06:10.392 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_notify": 0, 2024-04-01T07:06:10.392 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_src_cmpxattr": 0, 2024-04-01T07:06:10.393 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_pgls": 0, 2024-04-01T07:06:10.393 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_pgls_filter": 0, 2024-04-01T07:06:10.393 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_other": 0, 2024-04-01T07:06:10.393 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_active": 0, 2024-04-01T07:06:10.393 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_send": 0, 2024-04-01T07:06:10.393 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_resend": 0, 2024-04-01T07:06:10.393 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_ping": 0, 2024-04-01T07:06:10.393 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_active": 0, 2024-04-01T07:06:10.393 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_send": 0, 2024-04-01T07:06:10.393 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_resend": 0, 2024-04-01T07:06:10.393 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_active": 0, 2024-04-01T07:06:10.393 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_send": 0, 2024-04-01T07:06:10.393 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_resend": 0, 2024-04-01T07:06:10.393 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_active": 0, 2024-04-01T07:06:10.393 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_send": 0, 2024-04-01T07:06:10.394 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_resend": 0, 2024-04-01T07:06:10.394 INFO:teuthology.orchestra.run.smithi145.stdout: "command_active": 0, 2024-04-01T07:06:10.394 INFO:teuthology.orchestra.run.smithi145.stdout: "command_send": 0, 2024-04-01T07:06:10.394 INFO:teuthology.orchestra.run.smithi145.stdout: "command_resend": 0, 2024-04-01T07:06:10.394 INFO:teuthology.orchestra.run.smithi145.stdout: "map_epoch": 91, 2024-04-01T07:06:10.394 INFO:teuthology.orchestra.run.smithi145.stdout: "map_full": 0, 2024-04-01T07:06:10.394 INFO:teuthology.orchestra.run.smithi145.stdout: "map_inc": 12, 2024-04-01T07:06:10.394 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_sessions": 12, 2024-04-01T07:06:10.394 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_session_open": 12, 2024-04-01T07:06:10.394 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_session_close": 0, 2024-04-01T07:06:10.394 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_laggy": 0, 2024-04-01T07:06:10.394 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_wr": 31, 2024-04-01T07:06:10.394 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_rd": 0, 2024-04-01T07:06:10.394 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_del": 10 2024-04-01T07:06:10.394 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.394 INFO:teuthology.orchestra.run.smithi145.stdout: "oft": { 2024-04-01T07:06:10.395 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_objs": 1, 2024-04-01T07:06:10.395 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_kv_pairs": 0, 2024-04-01T07:06:10.395 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_updates": 0, 2024-04-01T07:06:10.395 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_removes": 0 2024-04-01T07:06:10.395 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.395 INFO:teuthology.orchestra.run.smithi145.stdout: "osd-slow-ops": { 2024-04-01T07:06:10.395 INFO:teuthology.orchestra.run.smithi145.stdout: "slow_ops_count": 4715 2024-04-01T07:06:10.395 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.395 INFO:teuthology.orchestra.run.smithi145.stdout: "purge_queue": { 2024-04-01T07:06:10.395 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_ops": 0, 2024-04-01T07:06:10.395 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_ops_high_water": 10, 2024-04-01T07:06:10.395 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing": 0, 2024-04-01T07:06:10.395 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_high_water": 10, 2024-04-01T07:06:10.395 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executed": 2135, 2024-04-01T07:06:10.395 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_item_in_journal": 0 2024-04-01T07:06:10.395 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.396 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-01T07:06:10.396 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2024-04-01T07:06:10.396 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 104857600, 2024-04-01T07:06:10.396 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2024-04-01T07:06:10.396 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 54688, 2024-04-01T07:06:10.396 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 20596941, 2024-04-01T07:06:10.396 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2024-04-01T07:06:10.396 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 54688, 2024-04-01T07:06:10.396 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2024-04-01T07:06:10.396 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2024-04-01T07:06:10.396 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 54688, 2024-04-01T07:06:10.396 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 20596941, 2024-04-01T07:06:10.396 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2024-04-01T07:06:10.396 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:10.396 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:10.396 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:10.396 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-04-01T07:06:10.397 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.397 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-objecter_bytes": { 2024-04-01T07:06:10.397 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2024-04-01T07:06:10.397 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 104857600, 2024-04-01T07:06:10.397 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2024-04-01T07:06:10.397 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 0, 2024-04-01T07:06:10.397 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 0, 2024-04-01T07:06:10.397 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2024-04-01T07:06:10.397 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 0, 2024-04-01T07:06:10.397 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 9830, 2024-04-01T07:06:10.397 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 26791101, 2024-04-01T07:06:10.397 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 9830, 2024-04-01T07:06:10.397 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 26791101, 2024-04-01T07:06:10.397 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2024-04-01T07:06:10.398 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:10.398 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:10.398 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:10.398 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-04-01T07:06:10.398 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.398 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-objecter_ops": { 2024-04-01T07:06:10.398 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2024-04-01T07:06:10.398 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 1024, 2024-04-01T07:06:10.398 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2024-04-01T07:06:10.398 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 0, 2024-04-01T07:06:10.398 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 0, 2024-04-01T07:06:10.398 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2024-04-01T07:06:10.398 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 0, 2024-04-01T07:06:10.398 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 9830, 2024-04-01T07:06:10.399 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 9830, 2024-04-01T07:06:10.399 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 9830, 2024-04-01T07:06:10.399 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 9830, 2024-04-01T07:06:10.399 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2024-04-01T07:06:10.399 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:10.399 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:10.399 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:10.399 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-04-01T07:06:10.399 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.399 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-write_buf_throttle": { 2024-04-01T07:06:10.399 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2024-04-01T07:06:10.399 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 3758096384, 2024-04-01T07:06:10.399 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2024-04-01T07:06:10.399 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 2135, 2024-04-01T07:06:10.399 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 247387, 2024-04-01T07:06:10.399 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2024-04-01T07:06:10.400 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 2135, 2024-04-01T07:06:10.400 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2024-04-01T07:06:10.400 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2024-04-01T07:06:10.400 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 52, 2024-04-01T07:06:10.400 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 247387, 2024-04-01T07:06:10.400 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2024-04-01T07:06:10.400 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:10.400 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:10.400 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:10.400 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-04-01T07:06:10.400 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:10.400 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-write_buf_throttle-0x55d43b7fe0a0": { 2024-04-01T07:06:10.400 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2024-04-01T07:06:10.400 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 3758096384, 2024-04-01T07:06:10.400 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2024-04-01T07:06:10.400 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 8793, 2024-04-01T07:06:10.400 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 26031943, 2024-04-01T07:06:10.400 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2024-04-01T07:06:10.401 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 8793, 2024-04-01T07:06:10.401 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2024-04-01T07:06:10.401 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2024-04-01T07:06:10.401 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 542, 2024-04-01T07:06:10.401 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 26031943, 2024-04-01T07:06:10.401 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2024-04-01T07:06:10.401 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:10.401 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:10.401 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:10.401 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-04-01T07:06:10.401 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-04-01T07:06:10.401 INFO:teuthology.orchestra.run.smithi145.stdout:} 2024-04-01T07:06:10.748 INFO:tasks.check_counter:Daemon mds.h mds.exported=6 2024-04-01T07:06:10.749 INFO:tasks.check_counter:Daemon mds.h mds.imported=6 2024-04-01T07:06:10.749 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=703 2024-04-01T07:06:10.749 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=3988 2024-04-01T07:06:10.749 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=2 2024-04-01T07:06:10.749 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-04-01T07:06:10.749 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-04-01T07:06:10.749 DEBUG:tasks.check_counter:Getting stats from k 2024-04-01T07:06:10.749 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph daemon mds.k perf dump 2024-04-01T07:06:10.975 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.b/config 2024-04-01T07:06:11.002 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:10 smithi145 ceph-mon[47816]: pgmap v320: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-01T07:06:11.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:10 smithi083 ceph-mon[43429]: pgmap v320: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-01T07:06:11.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:10 smithi153 ceph-mon[48187]: pgmap v320: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-04-01T07:06:11.977 INFO:teuthology.orchestra.run.smithi145.stdout:{ 2024-04-01T07:06:11.977 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-0": { 2024-04-01T07:06:11.977 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 258, 2024-04-01T07:06:11.977 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 260, 2024-04-01T07:06:11.977 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 12650747, 2024-04-01T07:06:11.977 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 80302, 2024-04-01T07:06:11.977 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 7, 2024-04-01T07:06:11.977 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 3, 2024-04-01T07:06:11.977 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 0.029563304, 2024-04-01T07:06:11.978 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 0.008060780, 2024-04-01T07:06:11.978 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 0.012654268, 2024-04-01T07:06:11.978 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.005795033, 2024-04-01T07:06:11.978 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2024-04-01T07:06:11.978 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 258, 2024-04-01T07:06:11.978 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.012221603, 2024-04-01T07:06:11.978 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000047370 2024-04-01T07:06:11.978 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:11.978 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2024-04-01T07:06:11.978 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:11.978 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:11.978 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:11.978 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:11.978 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-01T07:06:11.979 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_encrypted_bytes": 0 2024-04-01T07:06:11.979 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:11.979 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-1": { 2024-04-01T07:06:11.979 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 912, 2024-04-01T07:06:11.979 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 883, 2024-04-01T07:06:11.979 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 18451393, 2024-04-01T07:06:11.979 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 322466, 2024-04-01T07:06:11.979 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 5, 2024-04-01T07:06:11.979 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 4, 2024-04-01T07:06:11.979 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 0.115024068, 2024-04-01T07:06:11.979 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 0.027849841, 2024-04-01T07:06:11.979 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 0.060529767, 2024-04-01T07:06:11.979 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.029829616, 2024-04-01T07:06:11.980 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2024-04-01T07:06:11.980 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 883, 2024-04-01T07:06:11.980 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.041380188, 2024-04-01T07:06:11.980 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000046863 2024-04-01T07:06:11.980 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:11.980 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2024-04-01T07:06:11.980 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:11.980 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:11.980 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:11.980 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:11.980 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_encrypted_bytes": 1507680, 2024-04-01T07:06:11.980 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_encrypted_bytes": 115024 2024-04-01T07:06:11.980 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:11.980 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-2": { 2024-04-01T07:06:11.981 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 1223, 2024-04-01T07:06:11.981 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 1371, 2024-04-01T07:06:11.981 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 13759156, 2024-04-01T07:06:11.981 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 794179, 2024-04-01T07:06:11.981 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 8, 2024-04-01T07:06:11.981 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 6, 2024-04-01T07:06:11.981 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 0.144162495, 2024-04-01T07:06:11.981 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 0.041786721, 2024-04-01T07:06:11.981 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 0.043186007, 2024-04-01T07:06:11.981 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.045299525, 2024-04-01T07:06:11.981 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2024-04-01T07:06:11.981 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 1368, 2024-04-01T07:06:11.981 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.062039188, 2024-04-01T07:06:11.981 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000045350 2024-04-01T07:06:11.982 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:11.982 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2024-04-01T07:06:11.982 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:11.982 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:11.982 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:11.982 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:11.982 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_encrypted_bytes": 320, 2024-04-01T07:06:11.982 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_encrypted_bytes": 414448 2024-04-01T07:06:11.982 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:11.982 INFO:teuthology.orchestra.run.smithi145.stdout: "cct": { 2024-04-01T07:06:11.982 INFO:teuthology.orchestra.run.smithi145.stdout: "total_workers": 1, 2024-04-01T07:06:11.982 INFO:teuthology.orchestra.run.smithi145.stdout: "unhealthy_workers": 0 2024-04-01T07:06:11.982 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:11.983 INFO:teuthology.orchestra.run.smithi145.stdout: "finisher-MDSRank": { 2024-04-01T07:06:11.983 INFO:teuthology.orchestra.run.smithi145.stdout: "queue_len": 0, 2024-04-01T07:06:11.983 INFO:teuthology.orchestra.run.smithi145.stdout: "complete_latency": { 2024-04-01T07:06:11.983 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 3558, 2024-04-01T07:06:11.983 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.105881960, 2024-04-01T07:06:11.983 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000029758 2024-04-01T07:06:11.983 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-04-01T07:06:11.983 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:11.983 INFO:teuthology.orchestra.run.smithi145.stdout: "finisher-PurgeQueue": { 2024-04-01T07:06:11.983 INFO:teuthology.orchestra.run.smithi145.stdout: "queue_len": 0, 2024-04-01T07:06:11.983 INFO:teuthology.orchestra.run.smithi145.stdout: "complete_latency": { 2024-04-01T07:06:11.983 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:11.983 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:11.983 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:11.984 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-04-01T07:06:11.984 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:11.984 INFO:teuthology.orchestra.run.smithi145.stdout: "mds": { 2024-04-01T07:06:11.984 INFO:teuthology.orchestra.run.smithi145.stdout: "request": 0, 2024-04-01T07:06:11.984 INFO:teuthology.orchestra.run.smithi145.stdout: "reply": 0, 2024-04-01T07:06:11.984 INFO:teuthology.orchestra.run.smithi145.stdout: "reply_latency": { 2024-04-01T07:06:11.984 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:11.984 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:11.984 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:11.984 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:11.984 INFO:teuthology.orchestra.run.smithi145.stdout: "slow_reply": 0, 2024-04-01T07:06:11.984 INFO:teuthology.orchestra.run.smithi145.stdout: "forward": 0, 2024-04-01T07:06:11.984 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_fetch_complete": 0, 2024-04-01T07:06:11.984 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_fetch_keys": 0, 2024-04-01T07:06:11.985 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_commit": 0, 2024-04-01T07:06:11.985 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_split": 0, 2024-04-01T07:06:11.985 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_merge": 0, 2024-04-01T07:06:11.985 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes": 14467, 2024-04-01T07:06:11.985 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_top": 92, 2024-04-01T07:06:11.985 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_bottom": 14375, 2024-04-01T07:06:11.985 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_pin_tail": 0, 2024-04-01T07:06:11.985 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_pinned": 14335, 2024-04-01T07:06:11.985 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_expired": 0, 2024-04-01T07:06:11.985 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_with_caps": 0, 2024-04-01T07:06:11.985 INFO:teuthology.orchestra.run.smithi145.stdout: "caps": 0, 2024-04-01T07:06:11.985 INFO:teuthology.orchestra.run.smithi145.stdout: "subtrees": 1, 2024-04-01T07:06:11.985 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse": 0, 2024-04-01T07:06:11.985 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_hit": 0, 2024-04-01T07:06:11.986 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_forward": 0, 2024-04-01T07:06:11.986 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_discover": 0, 2024-04-01T07:06:11.986 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_dir_fetch": 0, 2024-04-01T07:06:11.986 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_remote_ino": 0, 2024-04-01T07:06:11.986 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_lock": 0, 2024-04-01T07:06:11.986 INFO:teuthology.orchestra.run.smithi145.stdout: "load_cent": 0, 2024-04-01T07:06:11.986 INFO:teuthology.orchestra.run.smithi145.stdout: "q": 0, 2024-04-01T07:06:11.986 INFO:teuthology.orchestra.run.smithi145.stdout: "exported": 0, 2024-04-01T07:06:11.986 INFO:teuthology.orchestra.run.smithi145.stdout: "exported_inodes": 0, 2024-04-01T07:06:11.986 INFO:teuthology.orchestra.run.smithi145.stdout: "imported": 0, 2024-04-01T07:06:11.986 INFO:teuthology.orchestra.run.smithi145.stdout: "imported_inodes": 0, 2024-04-01T07:06:11.986 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_dir_fetch": 0, 2024-04-01T07:06:11.986 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_backtrace_fetch": 0, 2024-04-01T07:06:11.986 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_peer_discover": 0, 2024-04-01T07:06:11.987 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rfiles": 0, 2024-04-01T07:06:11.987 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rbytes": 0, 2024-04-01T07:06:11.987 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rsnaps": 0, 2024-04-01T07:06:11.987 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_backtrace_fetch": 0, 2024-04-01T07:06:11.987 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_set_tag": 0, 2024-04-01T07:06:11.987 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_backtrace_repaired": 0, 2024-04-01T07:06:11.987 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_inotable_repaired": 0, 2024-04-01T07:06:11.987 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_dir_inodes": 0, 2024-04-01T07:06:11.987 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_dir_base_inodes": 0, 2024-04-01T07:06:11.987 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_dirfrag_rstats": 0, 2024-04-01T07:06:11.987 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_file_inodes": 0, 2024-04-01T07:06:11.987 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_inode_file_caps": 0, 2024-04-01T07:06:11.987 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_cap_op_revoke": 0, 2024-04-01T07:06:11.987 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_cap_op_grant": 0, 2024-04-01T07:06:11.987 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_cap_op_trunc": 0, 2024-04-01T07:06:11.988 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-01T07:06:11.988 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-01T07:06:11.988 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_caps": 0, 2024-04-01T07:06:11.988 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_caps_dirty": 0, 2024-04-01T07:06:11.988 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_cap_release": 0, 2024-04-01T07:06:11.988 INFO:teuthology.orchestra.run.smithi145.stdout: "process_request_cap_release": 0 2024-04-01T07:06:11.988 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:11.988 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_cache": { 2024-04-01T07:06:11.988 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_update": 0, 2024-04-01T07:06:11.988 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_update_receipt": 0, 2024-04-01T07:06:11.988 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_try_discover": 0, 2024-04-01T07:06:11.988 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_send_discover": 0, 2024-04-01T07:06:11.988 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_handle_discover": 0, 2024-04-01T07:06:11.988 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays": 0, 2024-04-01T07:06:11.988 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays_delayed": 0, 2024-04-01T07:06:11.988 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays_enqueuing": 0, 2024-04-01T07:06:11.989 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_created": 0, 2024-04-01T07:06:11.989 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_enqueued": 0, 2024-04-01T07:06:11.989 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_reintegrated": 0, 2024-04-01T07:06:11.989 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_migrated": 0, 2024-04-01T07:06:11.989 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_processing": 0, 2024-04-01T07:06:11.989 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_enqueued": 0, 2024-04-01T07:06:11.989 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_prioritized": 0, 2024-04-01T07:06:11.989 INFO:teuthology.orchestra.run.smithi145.stdout: "recovery_started": 0, 2024-04-01T07:06:11.989 INFO:teuthology.orchestra.run.smithi145.stdout: "recovery_completed": 0, 2024-04-01T07:06:11.989 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_enqueue_scrub": 0, 2024-04-01T07:06:11.989 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_exportdir": 0, 2024-04-01T07:06:11.989 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_flush": 0, 2024-04-01T07:06:11.989 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_fragmentdir": 0, 2024-04-01T07:06:11.990 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_fragstats": 0, 2024-04-01T07:06:11.990 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_inodestats": 0 2024-04-01T07:06:11.990 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:11.990 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_log": { 2024-04-01T07:06:11.990 INFO:teuthology.orchestra.run.smithi145.stdout: "evadd": 0, 2024-04-01T07:06:11.990 INFO:teuthology.orchestra.run.smithi145.stdout: "evex": 0, 2024-04-01T07:06:11.990 INFO:teuthology.orchestra.run.smithi145.stdout: "evtrm": 0, 2024-04-01T07:06:11.990 INFO:teuthology.orchestra.run.smithi145.stdout: "ev": 13481, 2024-04-01T07:06:11.990 INFO:teuthology.orchestra.run.smithi145.stdout: "evexg": 0, 2024-04-01T07:06:11.990 INFO:teuthology.orchestra.run.smithi145.stdout: "evexd": 0, 2024-04-01T07:06:11.990 INFO:teuthology.orchestra.run.smithi145.stdout: "segadd": 0, 2024-04-01T07:06:11.990 INFO:teuthology.orchestra.run.smithi145.stdout: "segex": 0, 2024-04-01T07:06:11.991 INFO:teuthology.orchestra.run.smithi145.stdout: "segtrm": 0, 2024-04-01T07:06:11.991 INFO:teuthology.orchestra.run.smithi145.stdout: "seg": 19, 2024-04-01T07:06:11.991 INFO:teuthology.orchestra.run.smithi145.stdout: "segexg": 0, 2024-04-01T07:06:11.991 INFO:teuthology.orchestra.run.smithi145.stdout: "segexd": 0, 2024-04-01T07:06:11.991 INFO:teuthology.orchestra.run.smithi145.stdout: "expos": 4194304, 2024-04-01T07:06:11.991 INFO:teuthology.orchestra.run.smithi145.stdout: "wrpos": 46942714, 2024-04-01T07:06:11.991 INFO:teuthology.orchestra.run.smithi145.stdout: "rdpos": 46940153, 2024-04-01T07:06:11.991 INFO:teuthology.orchestra.run.smithi145.stdout: "jlat": { 2024-04-01T07:06:11.991 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:11.991 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:11.991 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:11.991 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:11.991 INFO:teuthology.orchestra.run.smithi145.stdout: "replayed": 13481 2024-04-01T07:06:11.992 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:11.992 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_mem": { 2024-04-01T07:06:11.992 INFO:teuthology.orchestra.run.smithi145.stdout: "ino": 4920, 2024-04-01T07:06:11.992 INFO:teuthology.orchestra.run.smithi145.stdout: "ino+": 15769, 2024-04-01T07:06:11.992 INFO:teuthology.orchestra.run.smithi145.stdout: "ino-": 10849, 2024-04-01T07:06:11.992 INFO:teuthology.orchestra.run.smithi145.stdout: "dir": 540, 2024-04-01T07:06:11.992 INFO:teuthology.orchestra.run.smithi145.stdout: "dir+": 1245, 2024-04-01T07:06:11.992 INFO:teuthology.orchestra.run.smithi145.stdout: "dir-": 705, 2024-04-01T07:06:11.992 INFO:teuthology.orchestra.run.smithi145.stdout: "dn": 14467, 2024-04-01T07:06:11.992 INFO:teuthology.orchestra.run.smithi145.stdout: "dn+": 21513, 2024-04-01T07:06:11.992 INFO:teuthology.orchestra.run.smithi145.stdout: "dn-": 7046, 2024-04-01T07:06:11.992 INFO:teuthology.orchestra.run.smithi145.stdout: "cap": 0, 2024-04-01T07:06:11.992 INFO:teuthology.orchestra.run.smithi145.stdout: "cap+": 0, 2024-04-01T07:06:11.992 INFO:teuthology.orchestra.run.smithi145.stdout: "cap-": 0, 2024-04-01T07:06:11.992 INFO:teuthology.orchestra.run.smithi145.stdout: "rss": 79464, 2024-04-01T07:06:11.993 INFO:teuthology.orchestra.run.smithi145.stdout: "heap": 207156 2024-04-01T07:06:11.993 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:11.993 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_server": { 2024-04-01T07:06:11.993 INFO:teuthology.orchestra.run.smithi145.stdout: "dispatch_client_request": 0, 2024-04-01T07:06:11.993 INFO:teuthology.orchestra.run.smithi145.stdout: "dispatch_server_request": 0, 2024-04-01T07:06:11.993 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_request": 0, 2024-04-01T07:06:11.993 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_session": 0, 2024-04-01T07:06:11.993 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_peer_request": 0, 2024-04-01T07:06:11.993 INFO:teuthology.orchestra.run.smithi145.stdout: "req_create_latency": { 2024-04-01T07:06:11.993 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:11.993 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:11.993 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:11.993 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:11.993 INFO:teuthology.orchestra.run.smithi145.stdout: "req_getattr_latency": { 2024-04-01T07:06:11.993 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:11.994 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:11.994 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:11.994 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:11.994 INFO:teuthology.orchestra.run.smithi145.stdout: "req_getfilelock_latency": { 2024-04-01T07:06:11.994 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:11.994 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:11.994 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:11.994 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:11.994 INFO:teuthology.orchestra.run.smithi145.stdout: "req_link_latency": { 2024-04-01T07:06:11.994 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:11.994 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:11.994 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:11.994 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:11.994 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookup_latency": { 2024-04-01T07:06:11.995 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:11.995 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:11.995 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:11.995 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:11.995 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookuphash_latency": { 2024-04-01T07:06:11.995 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:11.995 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:11.996 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:11.996 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:11.996 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupino_latency": { 2024-04-01T07:06:11.996 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:11.996 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:11.996 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:11.996 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:11.996 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupname_latency": { 2024-04-01T07:06:11.996 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:11.996 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:11.996 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:11.996 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:11.996 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupparent_latency": { 2024-04-01T07:06:11.996 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:11.996 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:11.997 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:11.997 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:11.997 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupsnap_latency": { 2024-04-01T07:06:11.997 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:11.997 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:11.997 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:11.997 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:11.997 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lssnap_latency": { 2024-04-01T07:06:11.997 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:11.997 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:11.997 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:11.997 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:11.997 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mkdir_latency": { 2024-04-01T07:06:11.997 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:11.997 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:11.997 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:11.998 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:11.998 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mknod_latency": { 2024-04-01T07:06:11.998 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:11.998 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:11.998 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:11.998 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:11.998 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mksnap_latency": { 2024-04-01T07:06:11.998 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:11.998 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:11.998 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:11.998 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:11.998 INFO:teuthology.orchestra.run.smithi145.stdout: "req_open_latency": { 2024-04-01T07:06:11.999 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:11.999 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:11.999 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:11.999 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:11.999 INFO:teuthology.orchestra.run.smithi145.stdout: "req_readdir_latency": { 2024-04-01T07:06:11.999 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:11.999 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:11.999 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:11.999 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:11.999 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rename_latency": { 2024-04-01T07:06:11.999 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:11.999 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:11.999 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:11.999 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:11.999 INFO:teuthology.orchestra.run.smithi145.stdout: "req_renamesnap_latency": { 2024-04-01T07:06:11.999 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:12.000 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:12.000 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:12.000 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:12.000 INFO:teuthology.orchestra.run.smithi145.stdout: "req_snapdiff_latency": { 2024-04-01T07:06:12.000 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:12.000 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:12.000 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:12.000 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:12.000 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmdir_latency": { 2024-04-01T07:06:12.000 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:12.000 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:12.000 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:12.000 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:12.000 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmsnap_latency": { 2024-04-01T07:06:12.000 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:12.000 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:12.001 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:12.001 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:12.001 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmxattr_latency": { 2024-04-01T07:06:12.001 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:12.001 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:12.001 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:12.001 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:12.001 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setattr_latency": { 2024-04-01T07:06:12.001 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:12.001 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:12.001 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:12.001 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:12.001 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setdirlayout_latency": { 2024-04-01T07:06:12.001 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:12.001 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:12.001 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:12.002 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:12.002 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setfilelock_latency": { 2024-04-01T07:06:12.002 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:12.002 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:12.002 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:12.002 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:12.002 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setlayout_latency": { 2024-04-01T07:06:12.002 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:12.002 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:12.002 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:12.002 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:12.002 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setxattr_latency": { 2024-04-01T07:06:12.002 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:12.002 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:12.003 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:12.003 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:12.003 INFO:teuthology.orchestra.run.smithi145.stdout: "req_symlink_latency": { 2024-04-01T07:06:12.003 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:12.003 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:12.003 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:12.003 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:12.003 INFO:teuthology.orchestra.run.smithi145.stdout: "req_unlink_latency": { 2024-04-01T07:06:12.003 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:12.003 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:12.004 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:12.004 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:12.004 INFO:teuthology.orchestra.run.smithi145.stdout: "cap_revoke_eviction": 0, 2024-04-01T07:06:12.004 INFO:teuthology.orchestra.run.smithi145.stdout: "cap_acquisition_throttle": 0, 2024-04-01T07:06:12.004 INFO:teuthology.orchestra.run.smithi145.stdout: "req_getvxattr_latency": { 2024-04-01T07:06:12.004 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:12.004 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:12.004 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:12.004 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-04-01T07:06:12.004 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:12.004 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_sessions": { 2024-04-01T07:06:12.004 INFO:teuthology.orchestra.run.smithi145.stdout: "session_count": 2, 2024-04-01T07:06:12.004 INFO:teuthology.orchestra.run.smithi145.stdout: "session_add": 5, 2024-04-01T07:06:12.004 INFO:teuthology.orchestra.run.smithi145.stdout: "session_remove": 3, 2024-04-01T07:06:12.005 INFO:teuthology.orchestra.run.smithi145.stdout: "sessions_open": 4, 2024-04-01T07:06:12.005 INFO:teuthology.orchestra.run.smithi145.stdout: "sessions_stale": 0, 2024-04-01T07:06:12.005 INFO:teuthology.orchestra.run.smithi145.stdout: "total_load": 0, 2024-04-01T07:06:12.005 INFO:teuthology.orchestra.run.smithi145.stdout: "average_load": 0, 2024-04-01T07:06:12.005 INFO:teuthology.orchestra.run.smithi145.stdout: "avg_session_uptime": 5563, 2024-04-01T07:06:12.005 INFO:teuthology.orchestra.run.smithi145.stdout: "mdthresh_evicted": 0 2024-04-01T07:06:12.005 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:12.005 INFO:teuthology.orchestra.run.smithi145.stdout: "mempool": { 2024-04-01T07:06:12.006 INFO:teuthology.orchestra.run.smithi145.stdout: "bloom_filter_bytes": 0, 2024-04-01T07:06:12.006 INFO:teuthology.orchestra.run.smithi145.stdout: "bloom_filter_items": 0, 2024-04-01T07:06:12.006 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_alloc_bytes": 0, 2024-04-01T07:06:12.006 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_alloc_items": 0, 2024-04-01T07:06:12.006 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_data_bytes": 0, 2024-04-01T07:06:12.006 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_data_items": 0, 2024-04-01T07:06:12.006 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-01T07:06:12.006 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_onode_items": 0, 2024-04-01T07:06:12.006 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-01T07:06:12.006 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_meta_items": 0, 2024-04-01T07:06:12.006 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_other_bytes": 0, 2024-04-01T07:06:12.007 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_other_items": 0, 2024-04-01T07:06:12.007 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-01T07:06:12.007 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_buffer_items": 0, 2024-04-01T07:06:12.007 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_extent_bytes": 0, 2024-04-01T07:06:12.007 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_extent_items": 0, 2024-04-01T07:06:12.007 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_blob_bytes": 0, 2024-04-01T07:06:12.007 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_blob_items": 0, 2024-04-01T07:06:12.007 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-01T07:06:12.007 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_shared_blob_items": 0, 2024-04-01T07:06:12.007 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-01T07:06:12.007 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_inline_bl_items": 0, 2024-04-01T07:06:12.007 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_bytes": 0, 2024-04-01T07:06:12.007 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_items": 0, 2024-04-01T07:06:12.007 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_txc_bytes": 0, 2024-04-01T07:06:12.008 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_txc_items": 0, 2024-04-01T07:06:12.008 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-01T07:06:12.008 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_deferred_items": 0, 2024-04-01T07:06:12.008 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_bytes": 0, 2024-04-01T07:06:12.008 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_items": 0, 2024-04-01T07:06:12.008 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_bytes": 0, 2024-04-01T07:06:12.008 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_items": 0, 2024-04-01T07:06:12.008 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_reader_bytes": 0, 2024-04-01T07:06:12.008 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_reader_items": 0, 2024-04-01T07:06:12.008 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_writer_bytes": 0, 2024-04-01T07:06:12.008 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_writer_items": 0, 2024-04-01T07:06:12.008 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_anon_bytes": 412841, 2024-04-01T07:06:12.008 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_anon_items": 5668, 2024-04-01T07:06:12.008 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_meta_bytes": 0, 2024-04-01T07:06:12.008 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_meta_items": 0, 2024-04-01T07:06:12.008 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_bytes": 0, 2024-04-01T07:06:12.009 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_items": 0, 2024-04-01T07:06:12.009 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mapbl_bytes": 0, 2024-04-01T07:06:12.009 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mapbl_items": 0, 2024-04-01T07:06:12.009 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pglog_bytes": 0, 2024-04-01T07:06:12.009 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pglog_items": 0, 2024-04-01T07:06:12.009 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_bytes": 8088, 2024-04-01T07:06:12.009 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_items": 185, 2024-04-01T07:06:12.009 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_mapping_bytes": 0, 2024-04-01T07:06:12.009 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_mapping_items": 0, 2024-04-01T07:06:12.009 INFO:teuthology.orchestra.run.smithi145.stdout: "pgmap_bytes": 0, 2024-04-01T07:06:12.009 INFO:teuthology.orchestra.run.smithi145.stdout: "pgmap_items": 0, 2024-04-01T07:06:12.009 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_co_bytes": 22590446, 2024-04-01T07:06:12.009 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_co_items": 277496, 2024-04-01T07:06:12.009 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_1_bytes": 0, 2024-04-01T07:06:12.009 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_1_items": 0, 2024-04-01T07:06:12.009 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_2_bytes": 0, 2024-04-01T07:06:12.010 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_2_items": 0 2024-04-01T07:06:12.010 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:12.010 INFO:teuthology.orchestra.run.smithi145.stdout: "objecter": { 2024-04-01T07:06:12.010 INFO:teuthology.orchestra.run.smithi145.stdout: "op_active": 0, 2024-04-01T07:06:12.010 INFO:teuthology.orchestra.run.smithi145.stdout: "op_laggy": 0, 2024-04-01T07:06:12.010 INFO:teuthology.orchestra.run.smithi145.stdout: "op_send": 2146, 2024-04-01T07:06:12.010 INFO:teuthology.orchestra.run.smithi145.stdout: "op_send_bytes": 21, 2024-04-01T07:06:12.010 INFO:teuthology.orchestra.run.smithi145.stdout: "op_resend": 3, 2024-04-01T07:06:12.010 INFO:teuthology.orchestra.run.smithi145.stdout: "op_reply": 2146, 2024-04-01T07:06:12.010 INFO:teuthology.orchestra.run.smithi145.stdout: "op_latency": { 2024-04-01T07:06:12.010 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 2146, 2024-04-01T07:06:12.010 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 2.707941469, 2024-04-01T07:06:12.010 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.001261855 2024-04-01T07:06:12.010 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:12.010 INFO:teuthology.orchestra.run.smithi145.stdout: "op_inflight": 0, 2024-04-01T07:06:12.011 INFO:teuthology.orchestra.run.smithi145.stdout: "oplen_avg": { 2024-04-01T07:06:12.011 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 2146, 2024-04-01T07:06:12.011 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 2147 2024-04-01T07:06:12.011 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:12.011 INFO:teuthology.orchestra.run.smithi145.stdout: "op": 2146, 2024-04-01T07:06:12.011 INFO:teuthology.orchestra.run.smithi145.stdout: "op_r": 2146, 2024-04-01T07:06:12.011 INFO:teuthology.orchestra.run.smithi145.stdout: "op_w": 0, 2024-04-01T07:06:12.011 INFO:teuthology.orchestra.run.smithi145.stdout: "op_rmw": 0, 2024-04-01T07:06:12.011 INFO:teuthology.orchestra.run.smithi145.stdout: "op_pg": 0, 2024-04-01T07:06:12.011 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_stat": 1362, 2024-04-01T07:06:12.011 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_create": 0, 2024-04-01T07:06:12.011 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_read": 782, 2024-04-01T07:06:12.011 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_write": 0, 2024-04-01T07:06:12.011 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_writefull": 0, 2024-04-01T07:06:12.011 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_writesame": 0, 2024-04-01T07:06:12.011 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_append": 0, 2024-04-01T07:06:12.012 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_zero": 0, 2024-04-01T07:06:12.012 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_truncate": 0, 2024-04-01T07:06:12.012 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_delete": 0, 2024-04-01T07:06:12.012 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_mapext": 0, 2024-04-01T07:06:12.012 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_sparse_read": 0, 2024-04-01T07:06:12.012 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_clonerange": 0, 2024-04-01T07:06:12.012 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_getxattr": 1, 2024-04-01T07:06:12.012 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_setxattr": 0, 2024-04-01T07:06:12.012 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_cmpxattr": 0, 2024-04-01T07:06:12.012 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_rmxattr": 0, 2024-04-01T07:06:12.012 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_resetxattrs": 0, 2024-04-01T07:06:12.012 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_call": 0, 2024-04-01T07:06:12.012 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_watch": 0, 2024-04-01T07:06:12.012 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_notify": 0, 2024-04-01T07:06:12.012 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_src_cmpxattr": 0, 2024-04-01T07:06:12.012 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_pgls": 0, 2024-04-01T07:06:12.013 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_pgls_filter": 0, 2024-04-01T07:06:12.013 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_other": 0, 2024-04-01T07:06:12.013 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_active": 0, 2024-04-01T07:06:12.013 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_send": 0, 2024-04-01T07:06:12.013 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_resend": 0, 2024-04-01T07:06:12.013 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_ping": 0, 2024-04-01T07:06:12.013 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_active": 0, 2024-04-01T07:06:12.013 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_send": 0, 2024-04-01T07:06:12.013 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_resend": 0, 2024-04-01T07:06:12.013 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_active": 0, 2024-04-01T07:06:12.014 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_send": 0, 2024-04-01T07:06:12.014 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_resend": 0, 2024-04-01T07:06:12.015 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_active": 0, 2024-04-01T07:06:12.015 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_send": 0, 2024-04-01T07:06:12.015 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_resend": 0, 2024-04-01T07:06:12.015 INFO:teuthology.orchestra.run.smithi145.stdout: "command_active": 0, 2024-04-01T07:06:12.015 INFO:teuthology.orchestra.run.smithi145.stdout: "command_send": 0, 2024-04-01T07:06:12.015 INFO:teuthology.orchestra.run.smithi145.stdout: "command_resend": 0, 2024-04-01T07:06:12.015 INFO:teuthology.orchestra.run.smithi145.stdout: "map_epoch": 92, 2024-04-01T07:06:12.015 INFO:teuthology.orchestra.run.smithi145.stdout: "map_full": 0, 2024-04-01T07:06:12.015 INFO:teuthology.orchestra.run.smithi145.stdout: "map_inc": 13, 2024-04-01T07:06:12.015 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_sessions": 9, 2024-04-01T07:06:12.015 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_session_open": 9, 2024-04-01T07:06:12.015 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_session_close": 0, 2024-04-01T07:06:12.016 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_laggy": 0, 2024-04-01T07:06:12.016 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_wr": 0, 2024-04-01T07:06:12.016 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_rd": 2, 2024-04-01T07:06:12.016 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_del": 0 2024-04-01T07:06:12.016 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:12.016 INFO:teuthology.orchestra.run.smithi145.stdout: "oft": { 2024-04-01T07:06:12.016 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_objs": 0, 2024-04-01T07:06:12.016 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_kv_pairs": 0, 2024-04-01T07:06:12.016 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_updates": 0, 2024-04-01T07:06:12.016 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_removes": 0 2024-04-01T07:06:12.016 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:12.016 INFO:teuthology.orchestra.run.smithi145.stdout: "osd-slow-ops": { 2024-04-01T07:06:12.016 INFO:teuthology.orchestra.run.smithi145.stdout: "slow_ops_count": 0 2024-04-01T07:06:12.016 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:12.017 INFO:teuthology.orchestra.run.smithi145.stdout: "purge_queue": { 2024-04-01T07:06:12.017 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_ops": 0, 2024-04-01T07:06:12.017 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_ops_high_water": 0, 2024-04-01T07:06:12.017 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing": 0, 2024-04-01T07:06:12.017 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_high_water": 0, 2024-04-01T07:06:12.017 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executed": 0, 2024-04-01T07:06:12.017 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_item_in_journal": 0 2024-04-01T07:06:12.017 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:12.017 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-01T07:06:12.017 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2024-04-01T07:06:12.017 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 104857600, 2024-04-01T07:06:12.017 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2024-04-01T07:06:12.017 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 2389, 2024-04-01T07:06:12.017 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 44631068, 2024-04-01T07:06:12.017 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2024-04-01T07:06:12.017 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 2389, 2024-04-01T07:06:12.018 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2024-04-01T07:06:12.018 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2024-04-01T07:06:12.018 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 2389, 2024-04-01T07:06:12.018 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 44631068, 2024-04-01T07:06:12.018 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2024-04-01T07:06:12.018 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:12.018 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:12.018 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:12.018 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-04-01T07:06:12.018 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:12.018 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-objecter_bytes": { 2024-04-01T07:06:12.018 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2024-04-01T07:06:12.018 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 104857600, 2024-04-01T07:06:12.018 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2024-04-01T07:06:12.018 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 0, 2024-04-01T07:06:12.018 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 0, 2024-04-01T07:06:12.018 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2024-04-01T07:06:12.019 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 0, 2024-04-01T07:06:12.019 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 2146, 2024-04-01T07:06:12.019 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 42749288, 2024-04-01T07:06:12.019 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 2146, 2024-04-01T07:06:12.019 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 42749288, 2024-04-01T07:06:12.019 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2024-04-01T07:06:12.019 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:12.019 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:12.019 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:12.019 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-04-01T07:06:12.019 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:12.019 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-objecter_ops": { 2024-04-01T07:06:12.019 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2024-04-01T07:06:12.019 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 1024, 2024-04-01T07:06:12.019 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2024-04-01T07:06:12.019 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 0, 2024-04-01T07:06:12.020 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 0, 2024-04-01T07:06:12.020 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2024-04-01T07:06:12.020 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 0, 2024-04-01T07:06:12.020 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 2146, 2024-04-01T07:06:12.020 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 2146, 2024-04-01T07:06:12.020 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 2146, 2024-04-01T07:06:12.020 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 2146, 2024-04-01T07:06:12.020 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2024-04-01T07:06:12.020 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:12.020 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:12.020 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:12.020 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-04-01T07:06:12.020 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:12.020 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-write_buf_throttle": { 2024-04-01T07:06:12.020 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2024-04-01T07:06:12.021 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 3758096384, 2024-04-01T07:06:12.021 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2024-04-01T07:06:12.021 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 0, 2024-04-01T07:06:12.021 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 0, 2024-04-01T07:06:12.021 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2024-04-01T07:06:12.021 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 0, 2024-04-01T07:06:12.021 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2024-04-01T07:06:12.021 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2024-04-01T07:06:12.021 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 0, 2024-04-01T07:06:12.021 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 0, 2024-04-01T07:06:12.021 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2024-04-01T07:06:12.021 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:12.021 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:12.021 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:12.021 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-04-01T07:06:12.021 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-04-01T07:06:12.022 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-write_buf_throttle-0x55e7b62165a0": { 2024-04-01T07:06:12.022 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2024-04-01T07:06:12.022 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 3758096384, 2024-04-01T07:06:12.022 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2024-04-01T07:06:12.022 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 0, 2024-04-01T07:06:12.022 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 0, 2024-04-01T07:06:12.022 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2024-04-01T07:06:12.022 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 0, 2024-04-01T07:06:12.022 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2024-04-01T07:06:12.022 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2024-04-01T07:06:12.022 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 0, 2024-04-01T07:06:12.022 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 0, 2024-04-01T07:06:12.022 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2024-04-01T07:06:12.022 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-04-01T07:06:12.023 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-04-01T07:06:12.023 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-04-01T07:06:12.023 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-04-01T07:06:12.023 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-04-01T07:06:12.023 INFO:teuthology.orchestra.run.smithi145.stdout:} 2024-04-01T07:06:12.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:11 smithi153 ceph-mon[48187]: osdmap e92: 12 total, 12 up, 12 in 2024-04-01T07:06:12.144 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:11 smithi145 ceph-mon[47816]: osdmap e92: 12 total, 12 up, 12 in 2024-04-01T07:06:12.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:11 smithi083 ceph-mon[43429]: osdmap e92: 12 total, 12 up, 12 in 2024-04-01T07:06:12.293 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-04-01T07:06:12.293 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-04-01T07:06:12.293 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update=0 2024-04-01T07:06:12.293 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update_receipt=0 2024-04-01T07:06:12.293 INFO:tasks.check_counter:Daemon mds.k mds.root_rsnaps=0 2024-04-01T07:06:12.294 INFO:tasks.check_counter:Daemon mds.k mds_server.req_mksnap_latency.avgcount=0 2024-04-01T07:06:12.294 INFO:tasks.check_counter:Daemon mds.k mds_server.req_rmsnap_latency.avgcount=0 2024-04-01T07:06:12.294 DEBUG:tasks.check_counter:Getting stats from c 2024-04-01T07:06:12.294 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph daemon mds.c perf dump 2024-04-01T07:06:12.543 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T07:06:12.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:12 smithi153 ceph-mon[48187]: pgmap v322: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-01T07:06:13.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:12 smithi145 ceph-mon[47816]: pgmap v322: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-01T07:06:13.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:12 smithi083 ceph-mon[43429]: pgmap v322: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-04-01T07:06:13.459 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-01T07:06:13.460 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-0": { 2024-04-01T07:06:13.460 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 1631, 2024-04-01T07:06:13.460 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 1633, 2024-04-01T07:06:13.460 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 17248389, 2024-04-01T07:06:13.460 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 507248, 2024-04-01T07:06:13.460 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 6, 2024-04-01T07:06:13.460 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 2, 2024-04-01T07:06:13.460 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 0.167845594, 2024-04-01T07:06:13.460 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 0.047374656, 2024-04-01T07:06:13.460 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 0.047159172, 2024-04-01T07:06:13.460 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.057791892, 2024-04-01T07:06:13.460 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2024-04-01T07:06:13.460 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 1631, 2024-04-01T07:06:13.461 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.069994864, 2024-04-01T07:06:13.461 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000042915 2024-04-01T07:06:13.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.461 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2024-04-01T07:06:13.461 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:13.461 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:13.461 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:13.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.461 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-01T07:06:13.461 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 0 2024-04-01T07:06:13.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.461 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-1": { 2024-04-01T07:06:13.461 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 685, 2024-04-01T07:06:13.461 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 658, 2024-04-01T07:06:13.462 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 6680609, 2024-04-01T07:06:13.462 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 252151, 2024-04-01T07:06:13.462 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 4, 2024-04-01T07:06:13.462 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 3, 2024-04-01T07:06:13.462 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 0.091279902, 2024-04-01T07:06:13.462 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 0.027257103, 2024-04-01T07:06:13.462 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 0.047758018, 2024-04-01T07:06:13.462 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.019530222, 2024-04-01T07:06:13.462 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2024-04-01T07:06:13.462 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 657, 2024-04-01T07:06:13.462 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.033271260, 2024-04-01T07:06:13.462 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000050641 2024-04-01T07:06:13.462 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.462 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2024-04-01T07:06:13.463 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:13.463 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:13.463 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:13.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.463 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 1503248, 2024-04-01T07:06:13.463 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 113072 2024-04-01T07:06:13.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.463 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-2": { 2024-04-01T07:06:13.463 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 19, 2024-04-01T07:06:13.463 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 163, 2024-04-01T07:06:13.463 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 4200964, 2024-04-01T07:06:13.463 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 418587, 2024-04-01T07:06:13.463 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 7, 2024-04-01T07:06:13.463 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 5, 2024-04-01T07:06:13.464 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 0.013729901, 2024-04-01T07:06:13.464 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 0.005761356, 2024-04-01T07:06:13.464 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 0.005702572, 2024-04-01T07:06:13.464 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.000298048, 2024-04-01T07:06:13.464 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2024-04-01T07:06:13.464 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 161, 2024-04-01T07:06:13.464 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.016676528, 2024-04-01T07:06:13.464 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000103580 2024-04-01T07:06:13.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.464 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2024-04-01T07:06:13.464 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:13.464 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:13.464 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:13.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.465 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-04-01T07:06:13.465 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 414544 2024-04-01T07:06:13.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.465 INFO:teuthology.orchestra.run.smithi153.stdout: "cct": { 2024-04-01T07:06:13.465 INFO:teuthology.orchestra.run.smithi153.stdout: "total_workers": 1, 2024-04-01T07:06:13.465 INFO:teuthology.orchestra.run.smithi153.stdout: "unhealthy_workers": 0 2024-04-01T07:06:13.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.465 INFO:teuthology.orchestra.run.smithi153.stdout: "finisher-MDSRank": { 2024-04-01T07:06:13.465 INFO:teuthology.orchestra.run.smithi153.stdout: "queue_len": 0, 2024-04-01T07:06:13.465 INFO:teuthology.orchestra.run.smithi153.stdout: "complete_latency": { 2024-04-01T07:06:13.465 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 3421, 2024-04-01T07:06:13.465 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.104564235, 2024-04-01T07:06:13.465 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000030565 2024-04-01T07:06:13.465 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-01T07:06:13.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.466 INFO:teuthology.orchestra.run.smithi153.stdout: "finisher-PurgeQueue": { 2024-04-01T07:06:13.466 INFO:teuthology.orchestra.run.smithi153.stdout: "queue_len": 0, 2024-04-01T07:06:13.466 INFO:teuthology.orchestra.run.smithi153.stdout: "complete_latency": { 2024-04-01T07:06:13.466 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:13.466 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:13.466 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:13.466 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-01T07:06:13.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.466 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": { 2024-04-01T07:06:13.466 INFO:teuthology.orchestra.run.smithi153.stdout: "request": 0, 2024-04-01T07:06:13.466 INFO:teuthology.orchestra.run.smithi153.stdout: "reply": 0, 2024-04-01T07:06:13.466 INFO:teuthology.orchestra.run.smithi153.stdout: "reply_latency": { 2024-04-01T07:06:13.466 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:13.466 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:13.466 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:13.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.467 INFO:teuthology.orchestra.run.smithi153.stdout: "slow_reply": 0, 2024-04-01T07:06:13.467 INFO:teuthology.orchestra.run.smithi153.stdout: "forward": 0, 2024-04-01T07:06:13.467 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_fetch_complete": 0, 2024-04-01T07:06:13.467 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_fetch_keys": 0, 2024-04-01T07:06:13.467 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_commit": 0, 2024-04-01T07:06:13.467 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_split": 0, 2024-04-01T07:06:13.467 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_merge": 0, 2024-04-01T07:06:13.467 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes": 7768, 2024-04-01T07:06:13.467 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_top": 12, 2024-04-01T07:06:13.467 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_bottom": 7756, 2024-04-01T07:06:13.467 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_pin_tail": 0, 2024-04-01T07:06:13.467 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_pinned": 7751, 2024-04-01T07:06:13.467 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_expired": 0, 2024-04-01T07:06:13.467 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_with_caps": 0, 2024-04-01T07:06:13.467 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": 0, 2024-04-01T07:06:13.467 INFO:teuthology.orchestra.run.smithi153.stdout: "subtrees": 1, 2024-04-01T07:06:13.468 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse": 0, 2024-04-01T07:06:13.468 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_hit": 0, 2024-04-01T07:06:13.468 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_forward": 0, 2024-04-01T07:06:13.468 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_discover": 0, 2024-04-01T07:06:13.468 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_dir_fetch": 0, 2024-04-01T07:06:13.468 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_remote_ino": 0, 2024-04-01T07:06:13.468 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_lock": 0, 2024-04-01T07:06:13.468 INFO:teuthology.orchestra.run.smithi153.stdout: "load_cent": 0, 2024-04-01T07:06:13.468 INFO:teuthology.orchestra.run.smithi153.stdout: "q": 0, 2024-04-01T07:06:13.468 INFO:teuthology.orchestra.run.smithi153.stdout: "exported": 0, 2024-04-01T07:06:13.468 INFO:teuthology.orchestra.run.smithi153.stdout: "exported_inodes": 0, 2024-04-01T07:06:13.468 INFO:teuthology.orchestra.run.smithi153.stdout: "imported": 0, 2024-04-01T07:06:13.468 INFO:teuthology.orchestra.run.smithi153.stdout: "imported_inodes": 0, 2024-04-01T07:06:13.468 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_dir_fetch": 0, 2024-04-01T07:06:13.469 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_backtrace_fetch": 0, 2024-04-01T07:06:13.469 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_peer_discover": 0, 2024-04-01T07:06:13.469 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rfiles": 0, 2024-04-01T07:06:13.469 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rbytes": 0, 2024-04-01T07:06:13.469 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rsnaps": 0, 2024-04-01T07:06:13.469 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_backtrace_fetch": 0, 2024-04-01T07:06:13.469 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_set_tag": 0, 2024-04-01T07:06:13.469 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_backtrace_repaired": 0, 2024-04-01T07:06:13.469 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_inotable_repaired": 0, 2024-04-01T07:06:13.469 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dir_inodes": 0, 2024-04-01T07:06:13.469 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dir_base_inodes": 0, 2024-04-01T07:06:13.469 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dirfrag_rstats": 0, 2024-04-01T07:06:13.469 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_file_inodes": 0, 2024-04-01T07:06:13.469 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_inode_file_caps": 0, 2024-04-01T07:06:13.469 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_revoke": 0, 2024-04-01T07:06:13.470 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_grant": 0, 2024-04-01T07:06:13.470 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_trunc": 0, 2024-04-01T07:06:13.470 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-01T07:06:13.470 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-01T07:06:13.470 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_caps": 0, 2024-04-01T07:06:13.470 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_caps_dirty": 0, 2024-04-01T07:06:13.470 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_cap_release": 0, 2024-04-01T07:06:13.470 INFO:teuthology.orchestra.run.smithi153.stdout: "process_request_cap_release": 0 2024-04-01T07:06:13.470 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.470 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_cache": { 2024-04-01T07:06:13.470 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_update": 0, 2024-04-01T07:06:13.470 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_update_receipt": 0, 2024-04-01T07:06:13.470 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_try_discover": 0, 2024-04-01T07:06:13.470 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_send_discover": 0, 2024-04-01T07:06:13.471 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_handle_discover": 0, 2024-04-01T07:06:13.471 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays": 0, 2024-04-01T07:06:13.471 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays_delayed": 0, 2024-04-01T07:06:13.471 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays_enqueuing": 0, 2024-04-01T07:06:13.471 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_created": 0, 2024-04-01T07:06:13.471 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_enqueued": 0, 2024-04-01T07:06:13.471 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_reintegrated": 0, 2024-04-01T07:06:13.471 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_migrated": 0, 2024-04-01T07:06:13.471 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_processing": 0, 2024-04-01T07:06:13.471 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_enqueued": 0, 2024-04-01T07:06:13.471 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_prioritized": 0, 2024-04-01T07:06:13.471 INFO:teuthology.orchestra.run.smithi153.stdout: "recovery_started": 0, 2024-04-01T07:06:13.471 INFO:teuthology.orchestra.run.smithi153.stdout: "recovery_completed": 0, 2024-04-01T07:06:13.471 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_enqueue_scrub": 0, 2024-04-01T07:06:13.471 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_exportdir": 0, 2024-04-01T07:06:13.471 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_flush": 0, 2024-04-01T07:06:13.472 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_fragmentdir": 0, 2024-04-01T07:06:13.472 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_fragstats": 0, 2024-04-01T07:06:13.472 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_inodestats": 0 2024-04-01T07:06:13.472 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.472 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_log": { 2024-04-01T07:06:13.472 INFO:teuthology.orchestra.run.smithi153.stdout: "evadd": 0, 2024-04-01T07:06:13.472 INFO:teuthology.orchestra.run.smithi153.stdout: "evex": 0, 2024-04-01T07:06:13.472 INFO:teuthology.orchestra.run.smithi153.stdout: "evtrm": 0, 2024-04-01T07:06:13.472 INFO:teuthology.orchestra.run.smithi153.stdout: "ev": 8793, 2024-04-01T07:06:13.472 INFO:teuthology.orchestra.run.smithi153.stdout: "evexg": 0, 2024-04-01T07:06:13.472 INFO:teuthology.orchestra.run.smithi153.stdout: "evexd": 0, 2024-04-01T07:06:13.472 INFO:teuthology.orchestra.run.smithi153.stdout: "segadd": 0, 2024-04-01T07:06:13.472 INFO:teuthology.orchestra.run.smithi153.stdout: "segex": 0, 2024-04-01T07:06:13.472 INFO:teuthology.orchestra.run.smithi153.stdout: "segtrm": 0, 2024-04-01T07:06:13.473 INFO:teuthology.orchestra.run.smithi153.stdout: "seg": 12, 2024-04-01T07:06:13.473 INFO:teuthology.orchestra.run.smithi153.stdout: "segexg": 0, 2024-04-01T07:06:13.473 INFO:teuthology.orchestra.run.smithi153.stdout: "segexd": 0, 2024-04-01T07:06:13.473 INFO:teuthology.orchestra.run.smithi153.stdout: "expos": 4194304, 2024-04-01T07:06:13.473 INFO:teuthology.orchestra.run.smithi153.stdout: "wrpos": 30226247, 2024-04-01T07:06:13.473 INFO:teuthology.orchestra.run.smithi153.stdout: "rdpos": 30223642, 2024-04-01T07:06:13.473 INFO:teuthology.orchestra.run.smithi153.stdout: "jlat": { 2024-04-01T07:06:13.473 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:13.473 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:13.473 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:13.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.473 INFO:teuthology.orchestra.run.smithi153.stdout: "replayed": 8793 2024-04-01T07:06:13.473 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.473 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_mem": { 2024-04-01T07:06:13.473 INFO:teuthology.orchestra.run.smithi153.stdout: "ino": 2546, 2024-04-01T07:06:13.473 INFO:teuthology.orchestra.run.smithi153.stdout: "ino+": 5658, 2024-04-01T07:06:13.473 INFO:teuthology.orchestra.run.smithi153.stdout: "ino-": 3112, 2024-04-01T07:06:13.474 INFO:teuthology.orchestra.run.smithi153.stdout: "dir": 423, 2024-04-01T07:06:13.474 INFO:teuthology.orchestra.run.smithi153.stdout: "dir+": 600, 2024-04-01T07:06:13.474 INFO:teuthology.orchestra.run.smithi153.stdout: "dir-": 177, 2024-04-01T07:06:13.474 INFO:teuthology.orchestra.run.smithi153.stdout: "dn": 7768, 2024-04-01T07:06:13.474 INFO:teuthology.orchestra.run.smithi153.stdout: "dn+": 8876, 2024-04-01T07:06:13.474 INFO:teuthology.orchestra.run.smithi153.stdout: "dn-": 1108, 2024-04-01T07:06:13.474 INFO:teuthology.orchestra.run.smithi153.stdout: "cap": 0, 2024-04-01T07:06:13.474 INFO:teuthology.orchestra.run.smithi153.stdout: "cap+": 0, 2024-04-01T07:06:13.474 INFO:teuthology.orchestra.run.smithi153.stdout: "cap-": 0, 2024-04-01T07:06:13.474 INFO:teuthology.orchestra.run.smithi153.stdout: "rss": 64844, 2024-04-01T07:06:13.474 INFO:teuthology.orchestra.run.smithi153.stdout: "heap": 207156 2024-04-01T07:06:13.474 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.474 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_server": { 2024-04-01T07:06:13.474 INFO:teuthology.orchestra.run.smithi153.stdout: "dispatch_client_request": 0, 2024-04-01T07:06:13.475 INFO:teuthology.orchestra.run.smithi153.stdout: "dispatch_server_request": 0, 2024-04-01T07:06:13.475 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_request": 0, 2024-04-01T07:06:13.475 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_session": 0, 2024-04-01T07:06:13.475 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_peer_request": 0, 2024-04-01T07:06:13.475 INFO:teuthology.orchestra.run.smithi153.stdout: "req_create_latency": { 2024-04-01T07:06:13.475 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:13.475 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:13.475 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:13.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.475 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getattr_latency": { 2024-04-01T07:06:13.475 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:13.475 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:13.475 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:13.475 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.475 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getfilelock_latency": { 2024-04-01T07:06:13.475 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:13.476 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:13.476 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:13.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.476 INFO:teuthology.orchestra.run.smithi153.stdout: "req_link_latency": { 2024-04-01T07:06:13.476 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:13.476 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:13.476 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:13.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.476 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookup_latency": { 2024-04-01T07:06:13.476 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:13.476 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:13.476 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:13.476 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.476 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookuphash_latency": { 2024-04-01T07:06:13.476 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:13.477 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:13.477 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:13.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.477 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupino_latency": { 2024-04-01T07:06:13.477 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:13.477 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:13.477 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:13.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.477 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupname_latency": { 2024-04-01T07:06:13.477 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:13.477 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:13.477 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:13.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.477 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupparent_latency": { 2024-04-01T07:06:13.477 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:13.477 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:13.477 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:13.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.478 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupsnap_latency": { 2024-04-01T07:06:13.478 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:13.478 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:13.478 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:13.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.478 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lssnap_latency": { 2024-04-01T07:06:13.478 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:13.478 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:13.478 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:13.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.478 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mkdir_latency": { 2024-04-01T07:06:13.478 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:13.478 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:13.479 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:13.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.479 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mknod_latency": { 2024-04-01T07:06:13.479 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:13.479 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:13.479 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:13.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.479 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mksnap_latency": { 2024-04-01T07:06:13.479 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:13.479 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:13.479 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:13.479 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.479 INFO:teuthology.orchestra.run.smithi153.stdout: "req_open_latency": { 2024-04-01T07:06:13.479 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:13.480 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:13.480 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:13.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.480 INFO:teuthology.orchestra.run.smithi153.stdout: "req_readdir_latency": { 2024-04-01T07:06:13.480 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:13.480 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:13.480 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:13.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.480 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rename_latency": { 2024-04-01T07:06:13.480 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:13.480 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:13.480 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:13.480 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.480 INFO:teuthology.orchestra.run.smithi153.stdout: "req_renamesnap_latency": { 2024-04-01T07:06:13.481 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:13.481 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:13.481 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:13.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.481 INFO:teuthology.orchestra.run.smithi153.stdout: "req_snapdiff_latency": { 2024-04-01T07:06:13.481 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:13.481 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:13.481 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:13.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.481 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmdir_latency": { 2024-04-01T07:06:13.481 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:13.481 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:13.481 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:13.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.482 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmsnap_latency": { 2024-04-01T07:06:13.482 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:13.482 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:13.482 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:13.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.482 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmxattr_latency": { 2024-04-01T07:06:13.482 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:13.482 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:13.482 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:13.482 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.482 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setattr_latency": { 2024-04-01T07:06:13.482 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:13.482 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:13.482 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:13.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.483 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setdirlayout_latency": { 2024-04-01T07:06:13.483 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:13.483 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:13.483 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:13.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.483 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setfilelock_latency": { 2024-04-01T07:06:13.483 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:13.483 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:13.483 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:13.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.483 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setlayout_latency": { 2024-04-01T07:06:13.483 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:13.483 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:13.483 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:13.483 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.484 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setxattr_latency": { 2024-04-01T07:06:13.484 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:13.484 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:13.484 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:13.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.484 INFO:teuthology.orchestra.run.smithi153.stdout: "req_symlink_latency": { 2024-04-01T07:06:13.484 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:13.484 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:13.484 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:13.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.484 INFO:teuthology.orchestra.run.smithi153.stdout: "req_unlink_latency": { 2024-04-01T07:06:13.484 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:13.484 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:13.484 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:13.484 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.485 INFO:teuthology.orchestra.run.smithi153.stdout: "cap_revoke_eviction": 0, 2024-04-01T07:06:13.485 INFO:teuthology.orchestra.run.smithi153.stdout: "cap_acquisition_throttle": 0, 2024-04-01T07:06:13.485 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getvxattr_latency": { 2024-04-01T07:06:13.485 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:13.485 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:13.485 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:13.485 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-01T07:06:13.485 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.485 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_sessions": { 2024-04-01T07:06:13.485 INFO:teuthology.orchestra.run.smithi153.stdout: "session_count": 2, 2024-04-01T07:06:13.485 INFO:teuthology.orchestra.run.smithi153.stdout: "session_add": 5, 2024-04-01T07:06:13.485 INFO:teuthology.orchestra.run.smithi153.stdout: "session_remove": 3, 2024-04-01T07:06:13.485 INFO:teuthology.orchestra.run.smithi153.stdout: "sessions_open": 4, 2024-04-01T07:06:13.485 INFO:teuthology.orchestra.run.smithi153.stdout: "sessions_stale": 0, 2024-04-01T07:06:13.486 INFO:teuthology.orchestra.run.smithi153.stdout: "total_load": 0, 2024-04-01T07:06:13.486 INFO:teuthology.orchestra.run.smithi153.stdout: "average_load": 0, 2024-04-01T07:06:13.486 INFO:teuthology.orchestra.run.smithi153.stdout: "avg_session_uptime": 3111, 2024-04-01T07:06:13.486 INFO:teuthology.orchestra.run.smithi153.stdout: "mdthresh_evicted": 0 2024-04-01T07:06:13.486 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.486 INFO:teuthology.orchestra.run.smithi153.stdout: "mempool": { 2024-04-01T07:06:13.486 INFO:teuthology.orchestra.run.smithi153.stdout: "bloom_filter_bytes": 0, 2024-04-01T07:06:13.486 INFO:teuthology.orchestra.run.smithi153.stdout: "bloom_filter_items": 0, 2024-04-01T07:06:13.486 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_alloc_bytes": 0, 2024-04-01T07:06:13.486 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_alloc_items": 0, 2024-04-01T07:06:13.486 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_data_bytes": 0, 2024-04-01T07:06:13.486 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_data_items": 0, 2024-04-01T07:06:13.486 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-01T07:06:13.486 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_onode_items": 0, 2024-04-01T07:06:13.486 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-01T07:06:13.487 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_meta_items": 0, 2024-04-01T07:06:13.487 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_other_bytes": 0, 2024-04-01T07:06:13.487 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_other_items": 0, 2024-04-01T07:06:13.487 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-01T07:06:13.487 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_buffer_items": 0, 2024-04-01T07:06:13.487 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_extent_bytes": 0, 2024-04-01T07:06:13.487 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_extent_items": 0, 2024-04-01T07:06:13.487 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_blob_bytes": 0, 2024-04-01T07:06:13.487 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_blob_items": 0, 2024-04-01T07:06:13.487 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-01T07:06:13.487 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_shared_blob_items": 0, 2024-04-01T07:06:13.487 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-01T07:06:13.487 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_inline_bl_items": 0, 2024-04-01T07:06:13.487 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_fsck_bytes": 0, 2024-04-01T07:06:13.487 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_fsck_items": 0, 2024-04-01T07:06:13.487 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_txc_bytes": 0, 2024-04-01T07:06:13.488 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_txc_items": 0, 2024-04-01T07:06:13.488 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-01T07:06:13.488 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_deferred_items": 0, 2024-04-01T07:06:13.488 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_bytes": 0, 2024-04-01T07:06:13.488 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_items": 0, 2024-04-01T07:06:13.488 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_bytes": 0, 2024-04-01T07:06:13.488 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_items": 0, 2024-04-01T07:06:13.488 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_reader_bytes": 0, 2024-04-01T07:06:13.488 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_reader_items": 0, 2024-04-01T07:06:13.488 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_writer_bytes": 0, 2024-04-01T07:06:13.488 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_writer_items": 0, 2024-04-01T07:06:13.488 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_anon_bytes": 308111, 2024-04-01T07:06:13.488 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_anon_items": 3288, 2024-04-01T07:06:13.488 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_meta_bytes": 0, 2024-04-01T07:06:13.488 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_meta_items": 0, 2024-04-01T07:06:13.489 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_bytes": 0, 2024-04-01T07:06:13.489 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_items": 0, 2024-04-01T07:06:13.489 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_mapbl_bytes": 0, 2024-04-01T07:06:13.489 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_mapbl_items": 0, 2024-04-01T07:06:13.489 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_pglog_bytes": 0, 2024-04-01T07:06:13.489 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_pglog_items": 0, 2024-04-01T07:06:13.489 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_bytes": 8088, 2024-04-01T07:06:13.489 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_items": 185, 2024-04-01T07:06:13.489 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_mapping_bytes": 0, 2024-04-01T07:06:13.489 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_mapping_items": 0, 2024-04-01T07:06:13.489 INFO:teuthology.orchestra.run.smithi153.stdout: "pgmap_bytes": 0, 2024-04-01T07:06:13.489 INFO:teuthology.orchestra.run.smithi153.stdout: "pgmap_items": 0, 2024-04-01T07:06:13.489 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_co_bytes": 12408593, 2024-04-01T07:06:13.489 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_co_items": 171183, 2024-04-01T07:06:13.490 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_1_bytes": 0, 2024-04-01T07:06:13.490 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_1_items": 0, 2024-04-01T07:06:13.490 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_2_bytes": 0, 2024-04-01T07:06:13.490 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_2_items": 0 2024-04-01T07:06:13.490 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.490 INFO:teuthology.orchestra.run.smithi153.stdout: "objecter": { 2024-04-01T07:06:13.490 INFO:teuthology.orchestra.run.smithi153.stdout: "op_active": 0, 2024-04-01T07:06:13.490 INFO:teuthology.orchestra.run.smithi153.stdout: "op_laggy": 0, 2024-04-01T07:06:13.490 INFO:teuthology.orchestra.run.smithi153.stdout: "op_send": 2091, 2024-04-01T07:06:13.490 INFO:teuthology.orchestra.run.smithi153.stdout: "op_send_bytes": 21, 2024-04-01T07:06:13.490 INFO:teuthology.orchestra.run.smithi153.stdout: "op_resend": 3, 2024-04-01T07:06:13.490 INFO:teuthology.orchestra.run.smithi153.stdout: "op_reply": 2091, 2024-04-01T07:06:13.490 INFO:teuthology.orchestra.run.smithi153.stdout: "op_latency": { 2024-04-01T07:06:13.490 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 2091, 2024-04-01T07:06:13.491 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 1.369975157, 2024-04-01T07:06:13.491 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000655177 2024-04-01T07:06:13.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.491 INFO:teuthology.orchestra.run.smithi153.stdout: "op_inflight": 0, 2024-04-01T07:06:13.491 INFO:teuthology.orchestra.run.smithi153.stdout: "oplen_avg": { 2024-04-01T07:06:13.491 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 2091, 2024-04-01T07:06:13.491 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 2092 2024-04-01T07:06:13.491 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.491 INFO:teuthology.orchestra.run.smithi153.stdout: "op": 2091, 2024-04-01T07:06:13.491 INFO:teuthology.orchestra.run.smithi153.stdout: "op_r": 2091, 2024-04-01T07:06:13.491 INFO:teuthology.orchestra.run.smithi153.stdout: "op_w": 0, 2024-04-01T07:06:13.491 INFO:teuthology.orchestra.run.smithi153.stdout: "op_rmw": 0, 2024-04-01T07:06:13.491 INFO:teuthology.orchestra.run.smithi153.stdout: "op_pg": 0, 2024-04-01T07:06:13.491 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_stat": 1340, 2024-04-01T07:06:13.491 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_create": 0, 2024-04-01T07:06:13.491 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_read": 749, 2024-04-01T07:06:13.491 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_write": 0, 2024-04-01T07:06:13.492 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_writefull": 0, 2024-04-01T07:06:13.492 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_writesame": 0, 2024-04-01T07:06:13.492 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_append": 0, 2024-04-01T07:06:13.492 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_zero": 0, 2024-04-01T07:06:13.492 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_truncate": 0, 2024-04-01T07:06:13.492 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_delete": 0, 2024-04-01T07:06:13.492 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_mapext": 0, 2024-04-01T07:06:13.492 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_sparse_read": 0, 2024-04-01T07:06:13.492 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_clonerange": 0, 2024-04-01T07:06:13.492 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_getxattr": 1, 2024-04-01T07:06:13.492 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_setxattr": 0, 2024-04-01T07:06:13.492 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_cmpxattr": 0, 2024-04-01T07:06:13.492 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_rmxattr": 0, 2024-04-01T07:06:13.492 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_resetxattrs": 0, 2024-04-01T07:06:13.492 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_call": 0, 2024-04-01T07:06:13.493 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_watch": 0, 2024-04-01T07:06:13.493 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_notify": 0, 2024-04-01T07:06:13.493 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_src_cmpxattr": 0, 2024-04-01T07:06:13.493 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_pgls": 0, 2024-04-01T07:06:13.493 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_pgls_filter": 0, 2024-04-01T07:06:13.493 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_other": 0, 2024-04-01T07:06:13.493 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_active": 0, 2024-04-01T07:06:13.493 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_send": 0, 2024-04-01T07:06:13.493 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_resend": 0, 2024-04-01T07:06:13.493 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_ping": 0, 2024-04-01T07:06:13.493 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_active": 0, 2024-04-01T07:06:13.493 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_send": 0, 2024-04-01T07:06:13.493 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_resend": 0, 2024-04-01T07:06:13.493 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_active": 0, 2024-04-01T07:06:13.493 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_send": 0, 2024-04-01T07:06:13.494 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_resend": 0, 2024-04-01T07:06:13.494 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_active": 0, 2024-04-01T07:06:13.494 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_send": 0, 2024-04-01T07:06:13.494 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_resend": 0, 2024-04-01T07:06:13.494 INFO:teuthology.orchestra.run.smithi153.stdout: "command_active": 0, 2024-04-01T07:06:13.494 INFO:teuthology.orchestra.run.smithi153.stdout: "command_send": 0, 2024-04-01T07:06:13.494 INFO:teuthology.orchestra.run.smithi153.stdout: "command_resend": 0, 2024-04-01T07:06:13.494 INFO:teuthology.orchestra.run.smithi153.stdout: "map_epoch": 92, 2024-04-01T07:06:13.494 INFO:teuthology.orchestra.run.smithi153.stdout: "map_full": 0, 2024-04-01T07:06:13.494 INFO:teuthology.orchestra.run.smithi153.stdout: "map_inc": 13, 2024-04-01T07:06:13.494 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_sessions": 6, 2024-04-01T07:06:13.494 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_session_open": 6, 2024-04-01T07:06:13.494 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_session_close": 0, 2024-04-01T07:06:13.494 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_laggy": 0, 2024-04-01T07:06:13.495 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_wr": 0, 2024-04-01T07:06:13.495 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_rd": 2, 2024-04-01T07:06:13.495 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_del": 0 2024-04-01T07:06:13.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.495 INFO:teuthology.orchestra.run.smithi153.stdout: "oft": { 2024-04-01T07:06:13.495 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_objs": 0, 2024-04-01T07:06:13.495 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_kv_pairs": 0, 2024-04-01T07:06:13.495 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_updates": 0, 2024-04-01T07:06:13.495 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_removes": 0 2024-04-01T07:06:13.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.495 INFO:teuthology.orchestra.run.smithi153.stdout: "osd-slow-ops": { 2024-04-01T07:06:13.495 INFO:teuthology.orchestra.run.smithi153.stdout: "slow_ops_count": 0 2024-04-01T07:06:13.495 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.495 INFO:teuthology.orchestra.run.smithi153.stdout: "purge_queue": { 2024-04-01T07:06:13.495 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_ops": 0, 2024-04-01T07:06:13.495 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_ops_high_water": 0, 2024-04-01T07:06:13.495 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing": 0, 2024-04-01T07:06:13.496 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_high_water": 0, 2024-04-01T07:06:13.496 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executed": 0, 2024-04-01T07:06:13.496 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_item_in_journal": 0 2024-04-01T07:06:13.496 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.496 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-01T07:06:13.496 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-04-01T07:06:13.496 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 104857600, 2024-04-01T07:06:13.496 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-04-01T07:06:13.496 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 2331, 2024-04-01T07:06:13.496 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 27905097, 2024-04-01T07:06:13.496 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-04-01T07:06:13.496 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 2331, 2024-04-01T07:06:13.496 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2024-04-01T07:06:13.496 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2024-04-01T07:06:13.496 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 2331, 2024-04-01T07:06:13.496 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 27905097, 2024-04-01T07:06:13.496 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-04-01T07:06:13.497 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:13.497 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:13.497 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:13.497 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-01T07:06:13.497 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.497 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-objecter_bytes": { 2024-04-01T07:06:13.497 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-04-01T07:06:13.497 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 104857600, 2024-04-01T07:06:13.497 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-04-01T07:06:13.497 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2024-04-01T07:06:13.497 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2024-04-01T07:06:13.497 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-04-01T07:06:13.497 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2024-04-01T07:06:13.497 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 2091, 2024-04-01T07:06:13.497 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 26033460, 2024-04-01T07:06:13.497 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 2091, 2024-04-01T07:06:13.497 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 26033460, 2024-04-01T07:06:13.498 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-04-01T07:06:13.498 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:13.498 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:13.498 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:13.498 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-01T07:06:13.498 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.498 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-objecter_ops": { 2024-04-01T07:06:13.498 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-04-01T07:06:13.498 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 1024, 2024-04-01T07:06:13.498 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-04-01T07:06:13.498 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2024-04-01T07:06:13.498 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2024-04-01T07:06:13.498 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-04-01T07:06:13.498 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2024-04-01T07:06:13.499 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 2091, 2024-04-01T07:06:13.499 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 2091, 2024-04-01T07:06:13.499 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 2091, 2024-04-01T07:06:13.499 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 2091, 2024-04-01T07:06:13.499 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-04-01T07:06:13.499 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:13.499 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:13.499 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:13.499 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-01T07:06:13.499 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.499 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-write_buf_throttle": { 2024-04-01T07:06:13.499 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-04-01T07:06:13.499 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 3758096384, 2024-04-01T07:06:13.499 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-04-01T07:06:13.499 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2024-04-01T07:06:13.500 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2024-04-01T07:06:13.500 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-04-01T07:06:13.500 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2024-04-01T07:06:13.500 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2024-04-01T07:06:13.500 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2024-04-01T07:06:13.500 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 0, 2024-04-01T07:06:13.500 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 0, 2024-04-01T07:06:13.500 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-04-01T07:06:13.500 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:13.500 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:13.500 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:13.500 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-01T07:06:13.500 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:13.500 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-write_buf_throttle-0x55aa0fb6a5a0": { 2024-04-01T07:06:13.500 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-04-01T07:06:13.500 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 3758096384, 2024-04-01T07:06:13.501 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-04-01T07:06:13.501 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2024-04-01T07:06:13.501 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2024-04-01T07:06:13.501 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-04-01T07:06:13.501 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2024-04-01T07:06:13.501 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2024-04-01T07:06:13.501 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2024-04-01T07:06:13.501 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 0, 2024-04-01T07:06:13.501 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 0, 2024-04-01T07:06:13.501 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-04-01T07:06:13.501 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:13.501 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:13.501 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:13.501 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-01T07:06:13.501 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-01T07:06:13.501 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-01T07:06:13.815 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-04-01T07:06:13.815 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-04-01T07:06:13.815 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2024-04-01T07:06:13.815 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=0 2024-04-01T07:06:13.815 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=0 2024-04-01T07:06:13.815 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-04-01T07:06:13.815 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-04-01T07:06:13.815 DEBUG:tasks.check_counter:Getting stats from f 2024-04-01T07:06:13.816 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph daemon mds.f perf dump 2024-04-01T07:06:14.040 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T07:06:14.976 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-01T07:06:14.976 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-0": { 2024-04-01T07:06:14.976 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 205, 2024-04-01T07:06:14.977 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 195, 2024-04-01T07:06:14.977 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 1418768, 2024-04-01T07:06:14.977 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 110880, 2024-04-01T07:06:14.977 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 4, 2024-04-01T07:06:14.977 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 0, 2024-04-01T07:06:14.977 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 0.043310296, 2024-04-01T07:06:14.977 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 0.013092550, 2024-04-01T07:06:14.977 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 0.032269593, 2024-04-01T07:06:14.977 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.005031807, 2024-04-01T07:06:14.977 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2024-04-01T07:06:14.977 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 194, 2024-04-01T07:06:14.977 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.010341310, 2024-04-01T07:06:14.977 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000053305 2024-04-01T07:06:14.977 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:14.977 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2024-04-01T07:06:14.978 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:14.978 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:14.978 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:14.978 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:14.978 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 1418768, 2024-04-01T07:06:14.978 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 110880 2024-04-01T07:06:14.978 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:14.978 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-1": { 2024-04-01T07:06:14.978 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 6, 2024-04-01T07:06:14.978 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 151, 2024-04-01T07:06:14.978 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 3312, 2024-04-01T07:06:14.978 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 178880, 2024-04-01T07:06:14.978 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 5, 2024-04-01T07:06:14.978 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 3, 2024-04-01T07:06:14.978 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 0.009668563, 2024-04-01T07:06:14.979 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 0.006103582, 2024-04-01T07:06:14.979 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 0.001370936, 2024-04-01T07:06:14.979 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-01T07:06:14.979 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2024-04-01T07:06:14.979 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 149, 2024-04-01T07:06:14.979 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.017059203, 2024-04-01T07:06:14.979 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000114491 2024-04-01T07:06:14.979 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:14.979 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2024-04-01T07:06:14.979 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:14.979 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:14.979 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:14.979 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:14.979 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-04-01T07:06:14.979 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 178880 2024-04-01T07:06:14.980 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:14.980 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-2": { 2024-04-01T07:06:14.980 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 0, 2024-04-01T07:06:14.980 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 2, 2024-04-01T07:06:14.980 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 0, 2024-04-01T07:06:14.980 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 0, 2024-04-01T07:06:14.980 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 2, 2024-04-01T07:06:14.980 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 1, 2024-04-01T07:06:14.980 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 0.000342590, 2024-04-01T07:06:14.980 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 0.000000000, 2024-04-01T07:06:14.980 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 0.000268284, 2024-04-01T07:06:14.980 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-01T07:06:14.980 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2024-04-01T07:06:14.980 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:14.981 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:14.981 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:14.981 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:14.981 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2024-04-01T07:06:14.981 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:14.981 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:14.981 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:14.981 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:14.981 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-01T07:06:14.981 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 0 2024-04-01T07:06:14.981 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:14.981 INFO:teuthology.orchestra.run.smithi153.stdout: "cct": { 2024-04-01T07:06:14.981 INFO:teuthology.orchestra.run.smithi153.stdout: "total_workers": 0, 2024-04-01T07:06:14.981 INFO:teuthology.orchestra.run.smithi153.stdout: "unhealthy_workers": 0 2024-04-01T07:06:14.981 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:14.981 INFO:teuthology.orchestra.run.smithi153.stdout: "mempool": { 2024-04-01T07:06:14.981 INFO:teuthology.orchestra.run.smithi153.stdout: "bloom_filter_bytes": 0, 2024-04-01T07:06:14.982 INFO:teuthology.orchestra.run.smithi153.stdout: "bloom_filter_items": 0, 2024-04-01T07:06:14.982 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_alloc_bytes": 0, 2024-04-01T07:06:14.982 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_alloc_items": 0, 2024-04-01T07:06:14.982 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_data_bytes": 0, 2024-04-01T07:06:14.982 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_data_items": 0, 2024-04-01T07:06:14.982 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-01T07:06:14.982 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_onode_items": 0, 2024-04-01T07:06:14.982 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-01T07:06:14.982 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_meta_items": 0, 2024-04-01T07:06:14.982 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_other_bytes": 0, 2024-04-01T07:06:14.982 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_other_items": 0, 2024-04-01T07:06:14.982 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-01T07:06:14.982 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_buffer_items": 0, 2024-04-01T07:06:14.982 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_extent_bytes": 0, 2024-04-01T07:06:14.982 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_extent_items": 0, 2024-04-01T07:06:14.983 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_blob_bytes": 0, 2024-04-01T07:06:14.983 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_blob_items": 0, 2024-04-01T07:06:14.983 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-01T07:06:14.983 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_shared_blob_items": 0, 2024-04-01T07:06:14.983 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-01T07:06:14.983 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_inline_bl_items": 0, 2024-04-01T07:06:14.983 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_fsck_bytes": 0, 2024-04-01T07:06:14.983 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_fsck_items": 0, 2024-04-01T07:06:14.983 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_txc_bytes": 0, 2024-04-01T07:06:14.983 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_txc_items": 0, 2024-04-01T07:06:14.983 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-01T07:06:14.983 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_deferred_items": 0, 2024-04-01T07:06:14.983 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_bytes": 0, 2024-04-01T07:06:14.983 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_items": 0, 2024-04-01T07:06:14.983 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_bytes": 0, 2024-04-01T07:06:14.984 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_items": 0, 2024-04-01T07:06:14.984 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_reader_bytes": 0, 2024-04-01T07:06:14.984 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_reader_items": 0, 2024-04-01T07:06:14.984 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_writer_bytes": 0, 2024-04-01T07:06:14.984 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_writer_items": 0, 2024-04-01T07:06:14.984 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_anon_bytes": 149001, 2024-04-01T07:06:14.984 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_anon_items": 31, 2024-04-01T07:06:14.984 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_meta_bytes": 0, 2024-04-01T07:06:14.984 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_meta_items": 0, 2024-04-01T07:06:14.984 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_bytes": 0, 2024-04-01T07:06:14.984 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_items": 0, 2024-04-01T07:06:14.984 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_mapbl_bytes": 0, 2024-04-01T07:06:14.984 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_mapbl_items": 0, 2024-04-01T07:06:14.984 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_pglog_bytes": 0, 2024-04-01T07:06:14.984 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_pglog_items": 0, 2024-04-01T07:06:14.984 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_bytes": 0, 2024-04-01T07:06:14.984 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_items": 0, 2024-04-01T07:06:14.985 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_mapping_bytes": 0, 2024-04-01T07:06:14.985 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_mapping_items": 0, 2024-04-01T07:06:14.985 INFO:teuthology.orchestra.run.smithi153.stdout: "pgmap_bytes": 0, 2024-04-01T07:06:14.985 INFO:teuthology.orchestra.run.smithi153.stdout: "pgmap_items": 0, 2024-04-01T07:06:14.985 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_co_bytes": 928, 2024-04-01T07:06:14.985 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_co_items": 2, 2024-04-01T07:06:14.985 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_1_bytes": 0, 2024-04-01T07:06:14.985 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_1_items": 0, 2024-04-01T07:06:14.985 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_2_bytes": 0, 2024-04-01T07:06:14.985 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_2_items": 0 2024-04-01T07:06:14.985 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:14.985 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-01T07:06:14.985 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-04-01T07:06:14.985 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 104857600, 2024-04-01T07:06:14.985 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-04-01T07:06:14.985 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 207, 2024-04-01T07:06:14.985 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 1389889, 2024-04-01T07:06:14.985 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-04-01T07:06:14.986 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 207, 2024-04-01T07:06:14.986 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2024-04-01T07:06:14.986 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2024-04-01T07:06:14.986 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 207, 2024-04-01T07:06:14.986 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 1389889, 2024-04-01T07:06:14.986 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-04-01T07:06:14.986 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:14.986 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:14.986 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:14.986 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-01T07:06:14.986 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-01T07:06:14.986 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-01T07:06:15.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:14 smithi153 ceph-mon[48187]: pgmap v323: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-04-01T07:06:15.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:14 smithi145 ceph-mon[47816]: pgmap v323: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-04-01T07:06:15.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:14 smithi083 ceph-mon[43429]: pgmap v323: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-04-01T07:06:15.324 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.f 2024-04-01T07:06:15.324 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.f 2024-04-01T07:06:15.324 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.f 2024-04-01T07:06:15.324 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.f 2024-04-01T07:06:15.325 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.f 2024-04-01T07:06:15.325 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.f 2024-04-01T07:06:15.325 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.f 2024-04-01T07:06:15.325 DEBUG:tasks.check_counter:Getting stats from i 2024-04-01T07:06:15.325 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph daemon mds.i perf dump 2024-04-01T07:06:15.548 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T07:06:16.550 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-01T07:06:16.551 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-0": { 2024-04-01T07:06:16.551 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 939, 2024-04-01T07:06:16.551 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 939, 2024-04-01T07:06:16.551 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 12365618, 2024-04-01T07:06:16.551 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 291243, 2024-04-01T07:06:16.551 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 7, 2024-04-01T07:06:16.551 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 3, 2024-04-01T07:06:16.551 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 0.104108253, 2024-04-01T07:06:16.551 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 0.027382777, 2024-04-01T07:06:16.551 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 0.031259361, 2024-04-01T07:06:16.551 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.034960881, 2024-04-01T07:06:16.551 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2024-04-01T07:06:16.552 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 938, 2024-04-01T07:06:16.552 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.042043943, 2024-04-01T07:06:16.552 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000044822 2024-04-01T07:06:16.552 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.552 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2024-04-01T07:06:16.552 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:16.552 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:16.552 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:16.552 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.552 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-04-01T07:06:16.552 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 448 2024-04-01T07:06:16.552 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.552 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-1": { 2024-04-01T07:06:16.552 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 505, 2024-04-01T07:06:16.552 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 599, 2024-04-01T07:06:16.553 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 8498359, 2024-04-01T07:06:16.553 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 402746, 2024-04-01T07:06:16.553 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 5, 2024-04-01T07:06:16.553 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 4, 2024-04-01T07:06:16.553 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 0.054567016, 2024-04-01T07:06:16.553 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 0.022065332, 2024-04-01T07:06:16.553 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 0.014562772, 2024-04-01T07:06:16.553 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.012044436, 2024-04-01T07:06:16.553 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2024-04-01T07:06:16.553 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 597, 2024-04-01T07:06:16.553 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.028609910, 2024-04-01T07:06:16.553 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000047922 2024-04-01T07:06:16.553 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.553 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2024-04-01T07:06:16.554 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:16.554 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:16.554 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:16.554 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.554 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 160, 2024-04-01T07:06:16.554 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 245936 2024-04-01T07:06:16.554 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.554 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-2": { 2024-04-01T07:06:16.554 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 156, 2024-04-01T07:06:16.554 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 149, 2024-04-01T07:06:16.554 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 4413088, 2024-04-01T07:06:16.554 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 76183, 2024-04-01T07:06:16.554 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 4, 2024-04-01T07:06:16.554 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 3, 2024-04-01T07:06:16.555 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 0.024404951, 2024-04-01T07:06:16.555 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 0.008455995, 2024-04-01T07:06:16.555 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 0.011171502, 2024-04-01T07:06:16.555 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.003463989, 2024-04-01T07:06:16.555 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2024-04-01T07:06:16.555 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 148, 2024-04-01T07:06:16.555 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.009083957, 2024-04-01T07:06:16.555 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000061378 2024-04-01T07:06:16.555 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.555 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2024-04-01T07:06:16.555 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:16.555 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:16.555 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:16.555 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.555 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 215936, 2024-04-01T07:06:16.556 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 73072 2024-04-01T07:06:16.556 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.556 INFO:teuthology.orchestra.run.smithi153.stdout: "cct": { 2024-04-01T07:06:16.556 INFO:teuthology.orchestra.run.smithi153.stdout: "total_workers": 1, 2024-04-01T07:06:16.556 INFO:teuthology.orchestra.run.smithi153.stdout: "unhealthy_workers": 0 2024-04-01T07:06:16.556 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.556 INFO:teuthology.orchestra.run.smithi153.stdout: "finisher-MDSRank": { 2024-04-01T07:06:16.556 INFO:teuthology.orchestra.run.smithi153.stdout: "queue_len": 0, 2024-04-01T07:06:16.556 INFO:teuthology.orchestra.run.smithi153.stdout: "complete_latency": { 2024-04-01T07:06:16.556 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 2350, 2024-04-01T07:06:16.556 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.107208602, 2024-04-01T07:06:16.556 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000045620 2024-04-01T07:06:16.556 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-01T07:06:16.556 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.556 INFO:teuthology.orchestra.run.smithi153.stdout: "finisher-PurgeQueue": { 2024-04-01T07:06:16.556 INFO:teuthology.orchestra.run.smithi153.stdout: "queue_len": 0, 2024-04-01T07:06:16.557 INFO:teuthology.orchestra.run.smithi153.stdout: "complete_latency": { 2024-04-01T07:06:16.557 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:16.557 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:16.557 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:16.557 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-01T07:06:16.557 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.557 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": { 2024-04-01T07:06:16.557 INFO:teuthology.orchestra.run.smithi153.stdout: "request": 0, 2024-04-01T07:06:16.557 INFO:teuthology.orchestra.run.smithi153.stdout: "reply": 0, 2024-04-01T07:06:16.557 INFO:teuthology.orchestra.run.smithi153.stdout: "reply_latency": { 2024-04-01T07:06:16.557 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:16.557 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:16.557 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:16.557 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.557 INFO:teuthology.orchestra.run.smithi153.stdout: "slow_reply": 0, 2024-04-01T07:06:16.558 INFO:teuthology.orchestra.run.smithi153.stdout: "forward": 0, 2024-04-01T07:06:16.558 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_fetch_complete": 0, 2024-04-01T07:06:16.558 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_fetch_keys": 0, 2024-04-01T07:06:16.558 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_commit": 0, 2024-04-01T07:06:16.558 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_split": 0, 2024-04-01T07:06:16.558 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_merge": 0, 2024-04-01T07:06:16.558 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes": 12347, 2024-04-01T07:06:16.558 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_top": 8157, 2024-04-01T07:06:16.558 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_bottom": 4190, 2024-04-01T07:06:16.558 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_pin_tail": 0, 2024-04-01T07:06:16.558 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_pinned": 694, 2024-04-01T07:06:16.558 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_expired": 0, 2024-04-01T07:06:16.558 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_with_caps": 0, 2024-04-01T07:06:16.558 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": 0, 2024-04-01T07:06:16.558 INFO:teuthology.orchestra.run.smithi153.stdout: "subtrees": 2, 2024-04-01T07:06:16.559 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse": 0, 2024-04-01T07:06:16.559 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_hit": 0, 2024-04-01T07:06:16.559 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_forward": 0, 2024-04-01T07:06:16.559 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_discover": 0, 2024-04-01T07:06:16.559 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_dir_fetch": 0, 2024-04-01T07:06:16.559 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_remote_ino": 0, 2024-04-01T07:06:16.559 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_lock": 0, 2024-04-01T07:06:16.559 INFO:teuthology.orchestra.run.smithi153.stdout: "load_cent": 0, 2024-04-01T07:06:16.559 INFO:teuthology.orchestra.run.smithi153.stdout: "q": 0, 2024-04-01T07:06:16.559 INFO:teuthology.orchestra.run.smithi153.stdout: "exported": 0, 2024-04-01T07:06:16.559 INFO:teuthology.orchestra.run.smithi153.stdout: "exported_inodes": 0, 2024-04-01T07:06:16.559 INFO:teuthology.orchestra.run.smithi153.stdout: "imported": 0, 2024-04-01T07:06:16.559 INFO:teuthology.orchestra.run.smithi153.stdout: "imported_inodes": 0, 2024-04-01T07:06:16.559 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_dir_fetch": 0, 2024-04-01T07:06:16.559 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_backtrace_fetch": 0, 2024-04-01T07:06:16.560 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_peer_discover": 0, 2024-04-01T07:06:16.560 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rfiles": 4, 2024-04-01T07:06:16.560 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rbytes": 234, 2024-04-01T07:06:16.560 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rsnaps": 7, 2024-04-01T07:06:16.560 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_backtrace_fetch": 0, 2024-04-01T07:06:16.560 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_set_tag": 0, 2024-04-01T07:06:16.560 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_backtrace_repaired": 0, 2024-04-01T07:06:16.560 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_inotable_repaired": 0, 2024-04-01T07:06:16.560 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dir_inodes": 0, 2024-04-01T07:06:16.560 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dir_base_inodes": 0, 2024-04-01T07:06:16.560 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dirfrag_rstats": 0, 2024-04-01T07:06:16.560 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_file_inodes": 0, 2024-04-01T07:06:16.560 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_inode_file_caps": 0, 2024-04-01T07:06:16.560 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_revoke": 0, 2024-04-01T07:06:16.560 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_grant": 0, 2024-04-01T07:06:16.561 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_trunc": 0, 2024-04-01T07:06:16.561 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-01T07:06:16.561 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-01T07:06:16.561 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_caps": 0, 2024-04-01T07:06:16.561 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_caps_dirty": 0, 2024-04-01T07:06:16.561 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_cap_release": 0, 2024-04-01T07:06:16.561 INFO:teuthology.orchestra.run.smithi153.stdout: "process_request_cap_release": 0 2024-04-01T07:06:16.561 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.561 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_cache": { 2024-04-01T07:06:16.561 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_update": 0, 2024-04-01T07:06:16.561 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_update_receipt": 0, 2024-04-01T07:06:16.561 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_try_discover": 0, 2024-04-01T07:06:16.561 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_send_discover": 0, 2024-04-01T07:06:16.561 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_handle_discover": 0, 2024-04-01T07:06:16.561 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays": 0, 2024-04-01T07:06:16.561 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays_delayed": 0, 2024-04-01T07:06:16.562 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays_enqueuing": 0, 2024-04-01T07:06:16.562 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_created": 0, 2024-04-01T07:06:16.562 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_enqueued": 0, 2024-04-01T07:06:16.562 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_reintegrated": 0, 2024-04-01T07:06:16.562 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_migrated": 0, 2024-04-01T07:06:16.562 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_processing": 0, 2024-04-01T07:06:16.562 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_enqueued": 0, 2024-04-01T07:06:16.562 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_prioritized": 0, 2024-04-01T07:06:16.562 INFO:teuthology.orchestra.run.smithi153.stdout: "recovery_started": 0, 2024-04-01T07:06:16.562 INFO:teuthology.orchestra.run.smithi153.stdout: "recovery_completed": 0, 2024-04-01T07:06:16.562 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_enqueue_scrub": 0, 2024-04-01T07:06:16.562 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_exportdir": 0, 2024-04-01T07:06:16.562 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_flush": 0, 2024-04-01T07:06:16.562 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_fragmentdir": 0, 2024-04-01T07:06:16.562 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_fragstats": 0, 2024-04-01T07:06:16.562 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_inodestats": 0 2024-04-01T07:06:16.563 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.563 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_log": { 2024-04-01T07:06:16.563 INFO:teuthology.orchestra.run.smithi153.stdout: "evadd": 0, 2024-04-01T07:06:16.563 INFO:teuthology.orchestra.run.smithi153.stdout: "evex": 0, 2024-04-01T07:06:16.563 INFO:teuthology.orchestra.run.smithi153.stdout: "evtrm": 0, 2024-04-01T07:06:16.563 INFO:teuthology.orchestra.run.smithi153.stdout: "ev": 9034, 2024-04-01T07:06:16.563 INFO:teuthology.orchestra.run.smithi153.stdout: "evexg": 0, 2024-04-01T07:06:16.563 INFO:teuthology.orchestra.run.smithi153.stdout: "evexd": 0, 2024-04-01T07:06:16.563 INFO:teuthology.orchestra.run.smithi153.stdout: "segadd": 0, 2024-04-01T07:06:16.563 INFO:teuthology.orchestra.run.smithi153.stdout: "segex": 0, 2024-04-01T07:06:16.563 INFO:teuthology.orchestra.run.smithi153.stdout: "segtrm": 0, 2024-04-01T07:06:16.563 INFO:teuthology.orchestra.run.smithi153.stdout: "seg": 2, 2024-04-01T07:06:16.563 INFO:teuthology.orchestra.run.smithi153.stdout: "segexg": 0, 2024-04-01T07:06:16.563 INFO:teuthology.orchestra.run.smithi153.stdout: "segexd": 0, 2024-04-01T07:06:16.563 INFO:teuthology.orchestra.run.smithi153.stdout: "expos": 124714776, 2024-04-01T07:06:16.564 INFO:teuthology.orchestra.run.smithi153.stdout: "wrpos": 125804726, 2024-04-01T07:06:16.564 INFO:teuthology.orchestra.run.smithi153.stdout: "rdpos": 125804614, 2024-04-01T07:06:16.564 INFO:teuthology.orchestra.run.smithi153.stdout: "jlat": { 2024-04-01T07:06:16.564 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:16.564 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:16.564 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:16.564 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.564 INFO:teuthology.orchestra.run.smithi153.stdout: "replayed": 9034 2024-04-01T07:06:16.564 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.564 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_mem": { 2024-04-01T07:06:16.564 INFO:teuthology.orchestra.run.smithi153.stdout: "ino": 3972, 2024-04-01T07:06:16.564 INFO:teuthology.orchestra.run.smithi153.stdout: "ino+": 8000, 2024-04-01T07:06:16.564 INFO:teuthology.orchestra.run.smithi153.stdout: "ino-": 4028, 2024-04-01T07:06:16.564 INFO:teuthology.orchestra.run.smithi153.stdout: "dir": 400, 2024-04-01T07:06:16.564 INFO:teuthology.orchestra.run.smithi153.stdout: "dir+": 434, 2024-04-01T07:06:16.564 INFO:teuthology.orchestra.run.smithi153.stdout: "dir-": 34, 2024-04-01T07:06:16.564 INFO:teuthology.orchestra.run.smithi153.stdout: "dn": 12347, 2024-04-01T07:06:16.565 INFO:teuthology.orchestra.run.smithi153.stdout: "dn+": 12802, 2024-04-01T07:06:16.565 INFO:teuthology.orchestra.run.smithi153.stdout: "dn-": 455, 2024-04-01T07:06:16.565 INFO:teuthology.orchestra.run.smithi153.stdout: "cap": 0, 2024-04-01T07:06:16.565 INFO:teuthology.orchestra.run.smithi153.stdout: "cap+": 0, 2024-04-01T07:06:16.565 INFO:teuthology.orchestra.run.smithi153.stdout: "cap-": 0, 2024-04-01T07:06:16.565 INFO:teuthology.orchestra.run.smithi153.stdout: "rss": 69620, 2024-04-01T07:06:16.565 INFO:teuthology.orchestra.run.smithi153.stdout: "heap": 207132 2024-04-01T07:06:16.565 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.565 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_server": { 2024-04-01T07:06:16.565 INFO:teuthology.orchestra.run.smithi153.stdout: "dispatch_client_request": 0, 2024-04-01T07:06:16.565 INFO:teuthology.orchestra.run.smithi153.stdout: "dispatch_server_request": 0, 2024-04-01T07:06:16.565 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_request": 0, 2024-04-01T07:06:16.565 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_session": 0, 2024-04-01T07:06:16.565 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_peer_request": 0, 2024-04-01T07:06:16.565 INFO:teuthology.orchestra.run.smithi153.stdout: "req_create_latency": { 2024-04-01T07:06:16.565 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:16.566 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:16.566 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:16.566 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.566 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getattr_latency": { 2024-04-01T07:06:16.566 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:16.566 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:16.566 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:16.566 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.566 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getfilelock_latency": { 2024-04-01T07:06:16.566 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:16.566 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:16.566 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:16.566 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.566 INFO:teuthology.orchestra.run.smithi153.stdout: "req_link_latency": { 2024-04-01T07:06:16.567 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:16.567 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:16.567 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:16.567 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.567 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookup_latency": { 2024-04-01T07:06:16.567 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:16.567 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:16.567 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:16.567 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.567 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookuphash_latency": { 2024-04-01T07:06:16.567 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:16.567 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:16.567 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:16.567 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.568 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupino_latency": { 2024-04-01T07:06:16.568 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:16.568 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:16.568 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:16.568 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.568 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupname_latency": { 2024-04-01T07:06:16.568 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:16.568 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:16.568 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:16.568 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.568 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupparent_latency": { 2024-04-01T07:06:16.568 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:16.568 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:16.568 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:16.568 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.568 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupsnap_latency": { 2024-04-01T07:06:16.568 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:16.569 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:16.569 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:16.569 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.569 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lssnap_latency": { 2024-04-01T07:06:16.569 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:16.569 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:16.569 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:16.569 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.569 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mkdir_latency": { 2024-04-01T07:06:16.569 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:16.569 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:16.569 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:16.569 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.569 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mknod_latency": { 2024-04-01T07:06:16.569 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:16.570 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:16.570 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:16.570 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.570 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mksnap_latency": { 2024-04-01T07:06:16.570 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:16.570 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:16.570 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:16.570 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.570 INFO:teuthology.orchestra.run.smithi153.stdout: "req_open_latency": { 2024-04-01T07:06:16.570 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:16.570 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:16.570 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:16.570 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.570 INFO:teuthology.orchestra.run.smithi153.stdout: "req_readdir_latency": { 2024-04-01T07:06:16.570 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:16.571 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:16.571 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:16.571 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.571 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rename_latency": { 2024-04-01T07:06:16.571 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:16.571 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:16.571 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:16.571 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.571 INFO:teuthology.orchestra.run.smithi153.stdout: "req_renamesnap_latency": { 2024-04-01T07:06:16.571 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:16.571 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:16.571 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:16.571 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.571 INFO:teuthology.orchestra.run.smithi153.stdout: "req_snapdiff_latency": { 2024-04-01T07:06:16.571 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:16.572 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:16.572 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:16.572 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.572 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmdir_latency": { 2024-04-01T07:06:16.572 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:16.572 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:16.572 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:16.572 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.572 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmsnap_latency": { 2024-04-01T07:06:16.572 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:16.572 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:16.572 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:16.572 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.572 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmxattr_latency": { 2024-04-01T07:06:16.572 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:16.572 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:16.573 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:16.573 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.573 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setattr_latency": { 2024-04-01T07:06:16.573 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:16.573 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:16.573 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:16.573 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.573 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setdirlayout_latency": { 2024-04-01T07:06:16.573 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:16.573 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:16.573 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:16.573 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.573 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setfilelock_latency": { 2024-04-01T07:06:16.573 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:16.573 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:16.574 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:16.574 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.574 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setlayout_latency": { 2024-04-01T07:06:16.574 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:16.574 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:16.574 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:16.574 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.574 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setxattr_latency": { 2024-04-01T07:06:16.574 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:16.574 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:16.574 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:16.574 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.574 INFO:teuthology.orchestra.run.smithi153.stdout: "req_symlink_latency": { 2024-04-01T07:06:16.574 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:16.574 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:16.575 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:16.575 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.575 INFO:teuthology.orchestra.run.smithi153.stdout: "req_unlink_latency": { 2024-04-01T07:06:16.575 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:16.575 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:16.575 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:16.575 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.575 INFO:teuthology.orchestra.run.smithi153.stdout: "cap_revoke_eviction": 0, 2024-04-01T07:06:16.575 INFO:teuthology.orchestra.run.smithi153.stdout: "cap_acquisition_throttle": 0, 2024-04-01T07:06:16.575 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getvxattr_latency": { 2024-04-01T07:06:16.575 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:16.575 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:16.575 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:16.575 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-01T07:06:16.575 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.576 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_sessions": { 2024-04-01T07:06:16.576 INFO:teuthology.orchestra.run.smithi153.stdout: "session_count": 2, 2024-04-01T07:06:16.576 INFO:teuthology.orchestra.run.smithi153.stdout: "session_add": 2, 2024-04-01T07:06:16.576 INFO:teuthology.orchestra.run.smithi153.stdout: "session_remove": 0, 2024-04-01T07:06:16.576 INFO:teuthology.orchestra.run.smithi153.stdout: "sessions_open": 0, 2024-04-01T07:06:16.576 INFO:teuthology.orchestra.run.smithi153.stdout: "sessions_stale": 0, 2024-04-01T07:06:16.576 INFO:teuthology.orchestra.run.smithi153.stdout: "total_load": 0, 2024-04-01T07:06:16.576 INFO:teuthology.orchestra.run.smithi153.stdout: "average_load": 0, 2024-04-01T07:06:16.576 INFO:teuthology.orchestra.run.smithi153.stdout: "avg_session_uptime": 1868, 2024-04-01T07:06:16.576 INFO:teuthology.orchestra.run.smithi153.stdout: "mdthresh_evicted": 0 2024-04-01T07:06:16.576 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.576 INFO:teuthology.orchestra.run.smithi153.stdout: "mempool": { 2024-04-01T07:06:16.576 INFO:teuthology.orchestra.run.smithi153.stdout: "bloom_filter_bytes": 0, 2024-04-01T07:06:16.576 INFO:teuthology.orchestra.run.smithi153.stdout: "bloom_filter_items": 0, 2024-04-01T07:06:16.576 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_alloc_bytes": 0, 2024-04-01T07:06:16.576 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_alloc_items": 0, 2024-04-01T07:06:16.577 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_data_bytes": 0, 2024-04-01T07:06:16.577 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_data_items": 0, 2024-04-01T07:06:16.577 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-01T07:06:16.577 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_onode_items": 0, 2024-04-01T07:06:16.577 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-01T07:06:16.577 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_meta_items": 0, 2024-04-01T07:06:16.577 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_other_bytes": 0, 2024-04-01T07:06:16.577 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_other_items": 0, 2024-04-01T07:06:16.577 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-01T07:06:16.577 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_buffer_items": 0, 2024-04-01T07:06:16.577 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_extent_bytes": 0, 2024-04-01T07:06:16.577 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_extent_items": 0, 2024-04-01T07:06:16.577 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_blob_bytes": 0, 2024-04-01T07:06:16.577 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_blob_items": 0, 2024-04-01T07:06:16.577 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-01T07:06:16.578 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_shared_blob_items": 0, 2024-04-01T07:06:16.578 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-01T07:06:16.578 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_inline_bl_items": 0, 2024-04-01T07:06:16.578 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_fsck_bytes": 0, 2024-04-01T07:06:16.578 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_fsck_items": 0, 2024-04-01T07:06:16.578 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_txc_bytes": 0, 2024-04-01T07:06:16.578 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_txc_items": 0, 2024-04-01T07:06:16.578 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-01T07:06:16.578 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_deferred_items": 0, 2024-04-01T07:06:16.578 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_bytes": 0, 2024-04-01T07:06:16.578 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_items": 0, 2024-04-01T07:06:16.578 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_bytes": 0, 2024-04-01T07:06:16.578 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_items": 0, 2024-04-01T07:06:16.578 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_reader_bytes": 0, 2024-04-01T07:06:16.578 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_reader_items": 0, 2024-04-01T07:06:16.579 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_writer_bytes": 0, 2024-04-01T07:06:16.579 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_writer_items": 0, 2024-04-01T07:06:16.579 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_anon_bytes": 352823, 2024-04-01T07:06:16.579 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_anon_items": 4392, 2024-04-01T07:06:16.579 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_meta_bytes": 0, 2024-04-01T07:06:16.579 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_meta_items": 0, 2024-04-01T07:06:16.579 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_bytes": 0, 2024-04-01T07:06:16.579 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_items": 0, 2024-04-01T07:06:16.579 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_mapbl_bytes": 0, 2024-04-01T07:06:16.579 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_mapbl_items": 0, 2024-04-01T07:06:16.579 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_pglog_bytes": 0, 2024-04-01T07:06:16.579 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_pglog_items": 0, 2024-04-01T07:06:16.579 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_bytes": 7968, 2024-04-01T07:06:16.579 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_items": 182, 2024-04-01T07:06:16.579 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_mapping_bytes": 0, 2024-04-01T07:06:16.580 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_mapping_items": 0, 2024-04-01T07:06:16.580 INFO:teuthology.orchestra.run.smithi153.stdout: "pgmap_bytes": 0, 2024-04-01T07:06:16.580 INFO:teuthology.orchestra.run.smithi153.stdout: "pgmap_items": 0, 2024-04-01T07:06:16.580 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_co_bytes": 18724667, 2024-04-01T07:06:16.580 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_co_items": 292368, 2024-04-01T07:06:16.580 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_1_bytes": 0, 2024-04-01T07:06:16.580 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_1_items": 0, 2024-04-01T07:06:16.580 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_2_bytes": 0, 2024-04-01T07:06:16.580 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_2_items": 0 2024-04-01T07:06:16.580 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.580 INFO:teuthology.orchestra.run.smithi153.stdout: "objecter": { 2024-04-01T07:06:16.580 INFO:teuthology.orchestra.run.smithi153.stdout: "op_active": 0, 2024-04-01T07:06:16.580 INFO:teuthology.orchestra.run.smithi153.stdout: "op_laggy": 0, 2024-04-01T07:06:16.580 INFO:teuthology.orchestra.run.smithi153.stdout: "op_send": 1449, 2024-04-01T07:06:16.580 INFO:teuthology.orchestra.run.smithi153.stdout: "op_send_bytes": 26, 2024-04-01T07:06:16.581 INFO:teuthology.orchestra.run.smithi153.stdout: "op_resend": 4, 2024-04-01T07:06:16.581 INFO:teuthology.orchestra.run.smithi153.stdout: "op_reply": 1449, 2024-04-01T07:06:16.581 INFO:teuthology.orchestra.run.smithi153.stdout: "op_latency": { 2024-04-01T07:06:16.581 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 1449, 2024-04-01T07:06:16.581 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.719986924, 2024-04-01T07:06:16.581 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000496885 2024-04-01T07:06:16.581 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.581 INFO:teuthology.orchestra.run.smithi153.stdout: "op_inflight": 0, 2024-04-01T07:06:16.581 INFO:teuthology.orchestra.run.smithi153.stdout: "oplen_avg": { 2024-04-01T07:06:16.581 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 1449, 2024-04-01T07:06:16.581 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 1450 2024-04-01T07:06:16.581 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.581 INFO:teuthology.orchestra.run.smithi153.stdout: "op": 1449, 2024-04-01T07:06:16.581 INFO:teuthology.orchestra.run.smithi153.stdout: "op_r": 1449, 2024-04-01T07:06:16.581 INFO:teuthology.orchestra.run.smithi153.stdout: "op_w": 0, 2024-04-01T07:06:16.581 INFO:teuthology.orchestra.run.smithi153.stdout: "op_rmw": 0, 2024-04-01T07:06:16.582 INFO:teuthology.orchestra.run.smithi153.stdout: "op_pg": 0, 2024-04-01T07:06:16.582 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_stat": 924, 2024-04-01T07:06:16.582 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_create": 0, 2024-04-01T07:06:16.582 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_read": 522, 2024-04-01T07:06:16.582 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_write": 0, 2024-04-01T07:06:16.582 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_writefull": 0, 2024-04-01T07:06:16.582 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_writesame": 0, 2024-04-01T07:06:16.582 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_append": 0, 2024-04-01T07:06:16.582 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_zero": 0, 2024-04-01T07:06:16.582 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_truncate": 0, 2024-04-01T07:06:16.582 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_delete": 0, 2024-04-01T07:06:16.582 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_mapext": 0, 2024-04-01T07:06:16.582 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_sparse_read": 0, 2024-04-01T07:06:16.582 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_clonerange": 0, 2024-04-01T07:06:16.582 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_getxattr": 2, 2024-04-01T07:06:16.583 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_setxattr": 0, 2024-04-01T07:06:16.583 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_cmpxattr": 0, 2024-04-01T07:06:16.583 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_rmxattr": 0, 2024-04-01T07:06:16.583 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_resetxattrs": 0, 2024-04-01T07:06:16.583 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_call": 0, 2024-04-01T07:06:16.583 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_watch": 0, 2024-04-01T07:06:16.583 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_notify": 0, 2024-04-01T07:06:16.583 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_src_cmpxattr": 0, 2024-04-01T07:06:16.583 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_pgls": 0, 2024-04-01T07:06:16.583 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_pgls_filter": 0, 2024-04-01T07:06:16.583 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_other": 0, 2024-04-01T07:06:16.583 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_active": 0, 2024-04-01T07:06:16.583 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_send": 0, 2024-04-01T07:06:16.583 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_resend": 0, 2024-04-01T07:06:16.583 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_ping": 0, 2024-04-01T07:06:16.584 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_active": 0, 2024-04-01T07:06:16.584 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_send": 0, 2024-04-01T07:06:16.584 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_resend": 0, 2024-04-01T07:06:16.584 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_active": 0, 2024-04-01T07:06:16.584 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_send": 0, 2024-04-01T07:06:16.584 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_resend": 0, 2024-04-01T07:06:16.584 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_active": 0, 2024-04-01T07:06:16.584 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_send": 0, 2024-04-01T07:06:16.584 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_resend": 0, 2024-04-01T07:06:16.584 INFO:teuthology.orchestra.run.smithi153.stdout: "command_active": 0, 2024-04-01T07:06:16.584 INFO:teuthology.orchestra.run.smithi153.stdout: "command_send": 0, 2024-04-01T07:06:16.584 INFO:teuthology.orchestra.run.smithi153.stdout: "command_resend": 0, 2024-04-01T07:06:16.584 INFO:teuthology.orchestra.run.smithi153.stdout: "map_epoch": 92, 2024-04-01T07:06:16.584 INFO:teuthology.orchestra.run.smithi153.stdout: "map_full": 0, 2024-04-01T07:06:16.584 INFO:teuthology.orchestra.run.smithi153.stdout: "map_inc": 8, 2024-04-01T07:06:16.585 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_sessions": 7, 2024-04-01T07:06:16.585 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_session_open": 7, 2024-04-01T07:06:16.585 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_session_close": 0, 2024-04-01T07:06:16.585 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_laggy": 0, 2024-04-01T07:06:16.585 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_wr": 0, 2024-04-01T07:06:16.585 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_rd": 2, 2024-04-01T07:06:16.585 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_del": 0 2024-04-01T07:06:16.585 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.585 INFO:teuthology.orchestra.run.smithi153.stdout: "oft": { 2024-04-01T07:06:16.585 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_objs": 0, 2024-04-01T07:06:16.585 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_kv_pairs": 0, 2024-04-01T07:06:16.585 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_updates": 0, 2024-04-01T07:06:16.585 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_removes": 0 2024-04-01T07:06:16.585 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.585 INFO:teuthology.orchestra.run.smithi153.stdout: "osd-slow-ops": { 2024-04-01T07:06:16.586 INFO:teuthology.orchestra.run.smithi153.stdout: "slow_ops_count": 0 2024-04-01T07:06:16.586 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.586 INFO:teuthology.orchestra.run.smithi153.stdout: "purge_queue": { 2024-04-01T07:06:16.586 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_ops": 0, 2024-04-01T07:06:16.586 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_ops_high_water": 0, 2024-04-01T07:06:16.586 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing": 0, 2024-04-01T07:06:16.586 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_high_water": 0, 2024-04-01T07:06:16.586 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executed": 0, 2024-04-01T07:06:16.586 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_item_in_journal": 0 2024-04-01T07:06:16.586 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.586 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-01T07:06:16.586 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-04-01T07:06:16.586 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 104857600, 2024-04-01T07:06:16.586 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-04-01T07:06:16.586 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 1596, 2024-04-01T07:06:16.587 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 25122986, 2024-04-01T07:06:16.587 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-04-01T07:06:16.587 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 1596, 2024-04-01T07:06:16.587 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2024-04-01T07:06:16.587 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2024-04-01T07:06:16.587 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 1596, 2024-04-01T07:06:16.587 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 25122986, 2024-04-01T07:06:16.587 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-04-01T07:06:16.587 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:16.587 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:16.587 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:16.587 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-01T07:06:16.587 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.587 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-objecter_bytes": { 2024-04-01T07:06:16.587 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-04-01T07:06:16.587 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 104857600, 2024-04-01T07:06:16.587 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-04-01T07:06:16.588 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2024-04-01T07:06:16.588 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2024-04-01T07:06:16.588 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-04-01T07:06:16.588 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2024-04-01T07:06:16.588 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 1449, 2024-04-01T07:06:16.588 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 24648751, 2024-04-01T07:06:16.588 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 1449, 2024-04-01T07:06:16.588 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 24648751, 2024-04-01T07:06:16.588 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-04-01T07:06:16.588 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:16.588 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:16.588 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:16.588 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-01T07:06:16.588 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.588 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-objecter_ops": { 2024-04-01T07:06:16.588 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-04-01T07:06:16.589 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 1024, 2024-04-01T07:06:16.589 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-04-01T07:06:16.589 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2024-04-01T07:06:16.589 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2024-04-01T07:06:16.589 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-04-01T07:06:16.589 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2024-04-01T07:06:16.589 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 1449, 2024-04-01T07:06:16.589 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 1449, 2024-04-01T07:06:16.589 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 1449, 2024-04-01T07:06:16.589 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 1449, 2024-04-01T07:06:16.589 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-04-01T07:06:16.589 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:16.589 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:16.589 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:16.589 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-01T07:06:16.589 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.590 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-write_buf_throttle": { 2024-04-01T07:06:16.590 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-04-01T07:06:16.590 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 3758096384, 2024-04-01T07:06:16.590 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-04-01T07:06:16.590 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2024-04-01T07:06:16.590 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2024-04-01T07:06:16.590 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-04-01T07:06:16.590 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2024-04-01T07:06:16.590 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2024-04-01T07:06:16.590 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2024-04-01T07:06:16.590 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 0, 2024-04-01T07:06:16.590 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 0, 2024-04-01T07:06:16.590 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-04-01T07:06:16.590 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:16.590 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:16.590 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:16.591 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-01T07:06:16.591 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:16.591 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-write_buf_throttle-0x558e1bf06640": { 2024-04-01T07:06:16.591 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-04-01T07:06:16.591 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 3758096384, 2024-04-01T07:06:16.591 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-04-01T07:06:16.591 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2024-04-01T07:06:16.591 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2024-04-01T07:06:16.591 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-04-01T07:06:16.591 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2024-04-01T07:06:16.591 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2024-04-01T07:06:16.591 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2024-04-01T07:06:16.591 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 0, 2024-04-01T07:06:16.591 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 0, 2024-04-01T07:06:16.591 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-04-01T07:06:16.592 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:16.592 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:16.592 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:16.592 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-01T07:06:16.592 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-01T07:06:16.592 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-01T07:06:16.957 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2024-04-01T07:06:16.957 INFO:tasks.check_counter:Daemon mds.i mds.imported=0 2024-04-01T07:06:16.957 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=0 2024-04-01T07:06:16.957 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=0 2024-04-01T07:06:16.957 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=7 2024-04-01T07:06:16.957 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-04-01T07:06:16.957 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-04-01T07:06:16.957 DEBUG:tasks.check_counter:Getting stats from l 2024-04-01T07:06:16.957 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9d2ee692f5a7771b6f28f4467ab0ee05cf8e7a12 shell --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 -- ceph daemon mds.l perf dump 2024-04-01T07:06:17.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:16 smithi153 ceph-mon[48187]: pgmap v324: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 252 B/s wr, 7 op/s 2024-04-01T07:06:17.177 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/mon.c/config 2024-04-01T07:06:17.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:16 smithi145 ceph-mon[47816]: pgmap v324: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 252 B/s wr, 7 op/s 2024-04-01T07:06:17.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:16 smithi083 ceph-mon[43429]: pgmap v324: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 252 B/s wr, 7 op/s 2024-04-01T07:06:18.208 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-04-01T07:06:18.208 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-0": { 2024-04-01T07:06:18.208 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 0, 2024-04-01T07:06:18.208 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 2, 2024-04-01T07:06:18.208 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 0, 2024-04-01T07:06:18.209 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 0, 2024-04-01T07:06:18.209 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 4, 2024-04-01T07:06:18.209 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 0, 2024-04-01T07:06:18.209 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 0.001358025, 2024-04-01T07:06:18.209 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 0.000000000, 2024-04-01T07:06:18.209 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 0.000361042, 2024-04-01T07:06:18.209 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-01T07:06:18.209 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2024-04-01T07:06:18.209 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:18.209 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:18.209 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:18.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:18.209 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2024-04-01T07:06:18.209 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:18.210 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:18.210 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:18.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:18.210 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-01T07:06:18.210 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 0 2024-04-01T07:06:18.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:18.210 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-1": { 2024-04-01T07:06:18.210 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 212, 2024-04-01T07:06:18.210 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 200, 2024-04-01T07:06:18.210 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 1422576, 2024-04-01T07:06:18.210 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 113104, 2024-04-01T07:06:18.210 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 2, 2024-04-01T07:06:18.210 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 1, 2024-04-01T07:06:18.210 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 0.042095346, 2024-04-01T07:06:18.211 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 0.012280878, 2024-04-01T07:06:18.211 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 0.032234044, 2024-04-01T07:06:18.211 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.005346335, 2024-04-01T07:06:18.211 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2024-04-01T07:06:18.211 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 200, 2024-04-01T07:06:18.211 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.012571405, 2024-04-01T07:06:18.211 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000062857 2024-04-01T07:06:18.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:18.211 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2024-04-01T07:06:18.211 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:18.211 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:18.211 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:18.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:18.212 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 1422576, 2024-04-01T07:06:18.212 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 113104 2024-04-01T07:06:18.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:18.212 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-2": { 2024-04-01T07:06:18.212 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 2, 2024-04-01T07:06:18.212 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 151, 2024-04-01T07:06:18.212 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 320, 2024-04-01T07:06:18.212 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 178784, 2024-04-01T07:06:18.212 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 5, 2024-04-01T07:06:18.212 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 3, 2024-04-01T07:06:18.212 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 0.010335038, 2024-04-01T07:06:18.212 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 0.006533768, 2024-04-01T07:06:18.212 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 0.001508932, 2024-04-01T07:06:18.212 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-01T07:06:18.212 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2024-04-01T07:06:18.213 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 148, 2024-04-01T07:06:18.213 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.012253606, 2024-04-01T07:06:18.213 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000082794 2024-04-01T07:06:18.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:18.213 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2024-04-01T07:06:18.213 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:18.213 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:18.213 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:18.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:18.213 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 320, 2024-04-01T07:06:18.213 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 178784 2024-04-01T07:06:18.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:18.213 INFO:teuthology.orchestra.run.smithi153.stdout: "cct": { 2024-04-01T07:06:18.213 INFO:teuthology.orchestra.run.smithi153.stdout: "total_workers": 0, 2024-04-01T07:06:18.213 INFO:teuthology.orchestra.run.smithi153.stdout: "unhealthy_workers": 0 2024-04-01T07:06:18.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:18.214 INFO:teuthology.orchestra.run.smithi153.stdout: "mempool": { 2024-04-01T07:06:18.214 INFO:teuthology.orchestra.run.smithi153.stdout: "bloom_filter_bytes": 0, 2024-04-01T07:06:18.214 INFO:teuthology.orchestra.run.smithi153.stdout: "bloom_filter_items": 0, 2024-04-01T07:06:18.214 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_alloc_bytes": 0, 2024-04-01T07:06:18.214 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_alloc_items": 0, 2024-04-01T07:06:18.214 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_data_bytes": 0, 2024-04-01T07:06:18.214 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_data_items": 0, 2024-04-01T07:06:18.214 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-01T07:06:18.214 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_onode_items": 0, 2024-04-01T07:06:18.214 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-01T07:06:18.214 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_meta_items": 0, 2024-04-01T07:06:18.214 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_other_bytes": 0, 2024-04-01T07:06:18.214 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_other_items": 0, 2024-04-01T07:06:18.215 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-01T07:06:18.215 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_buffer_items": 0, 2024-04-01T07:06:18.215 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_extent_bytes": 0, 2024-04-01T07:06:18.215 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_extent_items": 0, 2024-04-01T07:06:18.215 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_blob_bytes": 0, 2024-04-01T07:06:18.215 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_blob_items": 0, 2024-04-01T07:06:18.215 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-01T07:06:18.215 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_shared_blob_items": 0, 2024-04-01T07:06:18.215 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-01T07:06:18.215 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_inline_bl_items": 0, 2024-04-01T07:06:18.215 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_fsck_bytes": 0, 2024-04-01T07:06:18.215 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_fsck_items": 0, 2024-04-01T07:06:18.215 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_txc_bytes": 0, 2024-04-01T07:06:18.215 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_txc_items": 0, 2024-04-01T07:06:18.215 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-01T07:06:18.215 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_deferred_items": 0, 2024-04-01T07:06:18.216 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_bytes": 0, 2024-04-01T07:06:18.216 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_items": 0, 2024-04-01T07:06:18.216 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_bytes": 0, 2024-04-01T07:06:18.216 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_items": 0, 2024-04-01T07:06:18.216 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_reader_bytes": 0, 2024-04-01T07:06:18.216 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_reader_items": 0, 2024-04-01T07:06:18.216 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_writer_bytes": 0, 2024-04-01T07:06:18.216 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_writer_items": 0, 2024-04-01T07:06:18.216 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_anon_bytes": 149017, 2024-04-01T07:06:18.216 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_anon_items": 31, 2024-04-01T07:06:18.216 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_meta_bytes": 0, 2024-04-01T07:06:18.216 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_meta_items": 0, 2024-04-01T07:06:18.216 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_bytes": 0, 2024-04-01T07:06:18.216 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_items": 0, 2024-04-01T07:06:18.217 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_mapbl_bytes": 0, 2024-04-01T07:06:18.217 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_mapbl_items": 0, 2024-04-01T07:06:18.217 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_pglog_bytes": 0, 2024-04-01T07:06:18.217 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_pglog_items": 0, 2024-04-01T07:06:18.217 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_bytes": 0, 2024-04-01T07:06:18.217 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_items": 0, 2024-04-01T07:06:18.217 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_mapping_bytes": 0, 2024-04-01T07:06:18.217 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_mapping_items": 0, 2024-04-01T07:06:18.217 INFO:teuthology.orchestra.run.smithi153.stdout: "pgmap_bytes": 0, 2024-04-01T07:06:18.217 INFO:teuthology.orchestra.run.smithi153.stdout: "pgmap_items": 0, 2024-04-01T07:06:18.217 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_co_bytes": 928, 2024-04-01T07:06:18.217 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_co_items": 2, 2024-04-01T07:06:18.217 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_1_bytes": 0, 2024-04-01T07:06:18.217 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_1_items": 0, 2024-04-01T07:06:18.217 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_2_bytes": 0, 2024-04-01T07:06:18.218 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_2_items": 0 2024-04-01T07:06:18.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-04-01T07:06:18.218 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-01T07:06:18.218 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-04-01T07:06:18.218 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 104857600, 2024-04-01T07:06:18.218 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-04-01T07:06:18.218 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 210, 2024-04-01T07:06:18.218 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 1390279, 2024-04-01T07:06:18.218 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-04-01T07:06:18.218 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 210, 2024-04-01T07:06:18.218 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2024-04-01T07:06:18.218 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2024-04-01T07:06:18.218 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 210, 2024-04-01T07:06:18.218 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 1390279, 2024-04-01T07:06:18.219 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-04-01T07:06:18.219 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-04-01T07:06:18.219 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-04-01T07:06:18.219 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-04-01T07:06:18.219 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-01T07:06:18.219 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-04-01T07:06:18.219 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-04-01T07:06:18.574 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-04-01T07:06:18.574 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-04-01T07:06:18.574 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.l 2024-04-01T07:06:18.574 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.l 2024-04-01T07:06:18.574 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.l 2024-04-01T07:06:18.574 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.l 2024-04-01T07:06:18.574 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.l 2024-04-01T07:06:18.575 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-01T07:06:18.587 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-01T07:06:18.588 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-04-01T07:06:18.588 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-01T07:06:18.612 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-04-01T07:06:18.612 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-01T07:06:18.672 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T07:06:18.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:18.845+0000 7f799f537700 1 -- 172.21.15.83:0/3167466096 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7998105b80 msgr2=0x7f7998105f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:18.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:18.845+0000 7f799f537700 1 --2- 172.21.15.83:0/3167466096 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7998105b80 0x7f7998105f60 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f7994009990 tx=0x7f7994009ca0 comp rx=0 tx=0).stop 2024-04-01T07:06:18.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:18.845+0000 7f799f537700 1 -- 172.21.15.83:0/3167466096 shutdown_connections 2024-04-01T07:06:18.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:18.845+0000 7f799f537700 1 --2- 172.21.15.83:0/3167466096 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7998105b80 0x7f7998105f60 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:18.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:18.845+0000 7f799f537700 1 --2- 172.21.15.83:0/3167466096 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f79981004a0 0x7f799810c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:18.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:18.845+0000 7f799f537700 1 --2- 172.21.15.83:0/3167466096 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79980ffae0 0x7f79980fff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:18.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:18.845+0000 7f799f537700 1 -- 172.21.15.83:0/3167466096 >> 172.21.15.83:0/3167466096 conn(0x7f79980fb590 msgr2=0x7f79980fd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T07:06:18.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:18.846+0000 7f799f537700 1 -- 172.21.15.83:0/3167466096 shutdown_connections 2024-04-01T07:06:18.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:18.846+0000 7f799f537700 1 -- 172.21.15.83:0/3167466096 wait complete. 2024-04-01T07:06:18.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:18.846+0000 7f799f537700 1 Processor -- start 2024-04-01T07:06:18.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:18.846+0000 7f799f537700 1 -- start start 2024-04-01T07:06:18.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:18.846+0000 7f799f537700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f79980ffae0 0x7f7998197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:06:18.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:18.846+0000 7f799f537700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79981004a0 0x7f79981983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:06:18.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:18.846+0000 7f799f537700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7998105b80 0x7f79981a2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:06:18.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:18.846+0000 7f799f537700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7998198c30 con 0x7f7998105b80 2024-04-01T07:06:18.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:18.846+0000 7f799f537700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79981a3440 con 0x7f79980ffae0 2024-04-01T07:06:18.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:18.846+0000 7f799f537700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79981a3580 con 0x7f79981004a0 2024-04-01T07:06:18.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:18.846+0000 7f799dad4700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7998105b80 0x7f79981a2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:06:18.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:18.847+0000 7f799dad4700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7998105b80 0x7f79981a2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59172/0 (socket says 172.21.15.83:59172) 2024-04-01T07:06:18.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:18.847+0000 7f799dad4700 1 -- 172.21.15.83:0/3218462535 learned_addr learned my addr 172.21.15.83:0/3218462535 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T07:06:18.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:18.847+0000 7f799d2d3700 1 --2- 172.21.15.83:0/3218462535 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f79980ffae0 0x7f7998197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:06:18.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:18.847+0000 7f799cad2700 1 --2- 172.21.15.83:0/3218462535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79981004a0 0x7f79981983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:06:18.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:18.847+0000 7f799dad4700 1 -- 172.21.15.83:0/3218462535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79981004a0 msgr2=0x7f79981983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:18.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:18.847+0000 7f799dad4700 1 --2- 172.21.15.83:0/3218462535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79981004a0 0x7f79981983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:18.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:18.847+0000 7f799dad4700 1 -- 172.21.15.83:0/3218462535 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f79980ffae0 msgr2=0x7f7998197e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:18.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:18.847+0000 7f799dad4700 1 --2- 172.21.15.83:0/3218462535 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f79980ffae0 0x7f7998197e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:18.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:18.847+0000 7f799dad4700 1 -- 172.21.15.83:0/3218462535 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79940095f0 con 0x7f7998105b80 2024-04-01T07:06:18.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:18.847+0000 7f799cad2700 1 --2- 172.21.15.83:0/3218462535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79981004a0 0x7f79981983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T07:06:18.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:18.847+0000 7f799dad4700 1 --2- 172.21.15.83:0/3218462535 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7998105b80 0x7f79981a2f00 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f7990007ee0 tx=0x7f799000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T07:06:18.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:18.847+0000 7f798e7fc700 1 -- 172.21.15.83:0/3218462535 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7990017070 con 0x7f7998105b80 2024-04-01T07:06:18.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:18.847+0000 7f798e7fc700 1 -- 172.21.15.83:0/3218462535 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f799000f040 con 0x7f7998105b80 2024-04-01T07:06:18.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:18.847+0000 7f799f537700 1 -- 172.21.15.83:0/3218462535 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79981a3810 con 0x7f7998105b80 2024-04-01T07:06:18.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:18.847+0000 7f798e7fc700 1 -- 172.21.15.83:0/3218462535 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7990005740 con 0x7f7998105b80 2024-04-01T07:06:18.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:18.847+0000 7f799f537700 1 -- 172.21.15.83:0/3218462535 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79981a3cd0 con 0x7f7998105b80 2024-04-01T07:06:18.853 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:18.848+0000 7f799f537700 1 -- 172.21.15.83:0/3218462535 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7998108070 con 0x7f7998105b80 2024-04-01T07:06:18.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:18.849+0000 7f798e7fc700 1 -- 172.21.15.83:0/3218462535 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 25) v1 ==== 135996+0+0 (secure 0 0 0) 0x7f799000dc60 con 0x7f7998105b80 2024-04-01T07:06:18.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:18.850+0000 7f798e7fc700 1 --2- 172.21.15.83:0/3218462535 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f79840a1290 0x7f79840a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:06:18.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:18.850+0000 7f798e7fc700 1 -- 172.21.15.83:0/3218462535 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f79900ccab0 con 0x7f7998105b80 2024-04-01T07:06:18.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:18.850+0000 7f799d2d3700 1 --2- 172.21.15.83:0/3218462535 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f79840a1290 0x7f79840a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:06:18.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:18.850+0000 7f799d2d3700 1 --2- 172.21.15.83:0/3218462535 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f79840a1290 0x7f79840a3750 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f799400b5c0 tx=0x7f7994005960 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T07:06:18.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:18.853+0000 7f798e7fc700 1 -- 172.21.15.83:0/3218462535 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f7990095f30 con 0x7f7998105b80 2024-04-01T07:06:19.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:18 smithi083 ceph-mon[43429]: pgmap v325: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-01T07:06:19.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.067+0000 7f799f537700 1 -- 172.21.15.83:0/3218462535 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7998069850 con 0x7f7998105b80 2024-04-01T07:06:19.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.069+0000 7f798e7fc700 1 -- 172.21.15.83:0/3218462535 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+22954 (secure 0 0 0) 0x7f7990099550 con 0x7f7998105b80 2024-04-01T07:06:19.069 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T07:06:19.069 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":92,"fsid":"c6f8eff4-eff3-11ee-b647-cb9ed24678a4","created":"2024-04-01T06:48:42.033382+0000","modified":"2024-04-01T07:06:10.859673+0000","last_up_change":"2024-04-01T06:53:55.791339+0000","last_in_change":"2024-04-01T06:53:39.777214+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T06:51:21.963996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T06:54:26.450403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T06:54:27.564928+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":16,"snap_epoch":91,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"90b761b0-b06c-4142-854d-38ee42aa6052","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6803","nonce":3253845390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6805","nonce":3253845390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6809","nonce":3253845390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6807","nonce":3253845390}]},"public_addr":"172.21.15.83:6803/3253845390","cluster_addr":"172.21.15.83:6805/3253845390","heartbeat_back_addr":"172.21.15.83:6809/3253845390","heartbeat_front_addr":"172.21.15.83:6807/3253845390","state":["exists","up"]},{"osd":1,"uuid":"4d6ab85b-7088-451e-a829-c9119f35dee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6801","nonce":515889759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6803","nonce":515889759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6807","nonce":515889759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6805","nonce":515889759}]},"public_addr":"172.21.15.145:6801/515889759","cluster_addr":"172.21.15.145:6803/515889759","heartbeat_back_addr":"172.21.15.145:6807/515889759","heartbeat_front_addr":"172.21.15.145:6805/515889759","state":["exists","up"]},{"osd":2,"uuid":"d04c27f3-4972-4061-8bfb-5060645e3883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6801","nonce":3318516728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6803","nonce":3318516728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6807","nonce":3318516728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6805","nonce":3318516728}]},"public_addr":"172.21.15.153:6801/3318516728","cluster_addr":"172.21.15.153:6803/3318516728","heartbeat_back_addr":"172.21.15.153:6807/3318516728","heartbeat_front_addr":"172.21.15.153:6805/3318516728","state":["exists","up"]},{"osd":3,"uuid":"899b6c90-8f2f-44dd-b807-49594aadb443","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6811","nonce":504690234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6813","nonce":504690234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6817","nonce":504690234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6815","nonce":504690234}]},"public_addr":"172.21.15.83:6811/504690234","cluster_addr":"172.21.15.83:6813/504690234","heartbeat_back_addr":"172.21.15.83:6817/504690234","heartbeat_front_addr":"172.21.15.83:6815/504690234","state":["exists","up"]},{"osd":4,"uuid":"5071dd81-804e-4358-bfb6-11e718e9cf4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6809","nonce":2099824730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6811","nonce":2099824730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6815","nonce":2099824730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6813","nonce":2099824730}]},"public_addr":"172.21.15.145:6809/2099824730","cluster_addr":"172.21.15.145:6811/2099824730","heartbeat_back_addr":"172.21.15.145:6815/2099824730","heartbeat_front_addr":"172.21.15.145:6813/2099824730","state":["exists","up"]},{"osd":5,"uuid":"b8442b71-c26e-467f-b0c3-ea9f636f5a00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6809","nonce":3340941443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6811","nonce":3340941443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6815","nonce":3340941443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6813","nonce":3340941443}]},"public_addr":"172.21.15.153:6809/3340941443","cluster_addr":"172.21.15.153:6811/3340941443","heartbeat_back_addr":"172.21.15.153:6815/3340941443","heartbeat_front_addr":"172.21.15.153:6813/3340941443","state":["exists","up"]},{"osd":6,"uuid":"c26bb8cb-ccee-4bfc-91eb-14e1ad8e04df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6819","nonce":2005485079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6821","nonce":2005485079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6825","nonce":2005485079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6823","nonce":2005485079}]},"public_addr":"172.21.15.83:6819/2005485079","cluster_addr":"172.21.15.83:6821/2005485079","heartbeat_back_addr":"172.21.15.83:6825/2005485079","heartbeat_front_addr":"172.21.15.83:6823/2005485079","state":["exists","up"]},{"osd":7,"uuid":"a8940da2-0e79-4606-8d1e-d425afbf5753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6817","nonce":3737505059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6819","nonce":3737505059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6823","nonce":3737505059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6821","nonce":3737505059}]},"public_addr":"172.21.15.145:6817/3737505059","cluster_addr":"172.21.15.145:6819/3737505059","heartbeat_back_addr":"172.21.15.145:6823/3737505059","heartbeat_front_addr":"172.21.15.145:6821/3737505059","state":["exists","up"]},{"osd":8,"uuid":"602d43ac-a189-4da3-9e38-7025d14e0dd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6817","nonce":1031545791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6819","nonce":1031545791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6823","nonce":1031545791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6821","nonce":1031545791}]},"public_addr":"172.21.15.153:6817/1031545791","cluster_addr":"172.21.15.153:6819/1031545791","heartbeat_back_addr":"172.21.15.153:6823/1031545791","heartbeat_front_addr":"172.21.15.153:6821/1031545791","state":["exists","up"]},{"osd":9,"uuid":"08b12d27-1247-45e4-9d09-cacc0fce4bd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6827","nonce":3720996673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6829","nonce":3720996673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6833","nonce":3720996673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6831","nonce":3720996673}]},"public_addr":"172.21.15.83:6827/3720996673","cluster_addr":"172.21.15.83:6829/3720996673","heartbeat_back_addr":"172.21.15.83:6833/3720996673","heartbeat_front_addr":"172.21.15.83:6831/3720996673","state":["exists","up"]},{"osd":10,"uuid":"dd986b50-d68f-446c-9c66-261535880879","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6825","nonce":2671529479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6827","nonce":2671529479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6831","nonce":2671529479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6829","nonce":2671529479}]},"public_addr":"172.21.15.145:6825/2671529479","cluster_addr":"172.21.15.145:6827/2671529479","heartbeat_back_addr":"172.21.15.145:6831/2671529479","heartbeat_front_addr":"172.21.15.145:6829/2671529479","state":["exists","up"]},{"osd":11,"uuid":"d20a49cd-6224-4424-8375-46da791d9931","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6825","nonce":2342548429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6827","nonce":2342548429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6831","nonce":2342548429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6829","nonce":2342548429}]},"public_addr":"172.21.15.153:6825/2342548429","cluster_addr":"172.21.15.153:6827/2342548429","heartbeat_back_addr":"172.21.15.153:6831/2342548429","heartbeat_front_addr":"172.21.15.153:6829/2342548429","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:50:44.539932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:01.990470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:19.054426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:36.616393+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:53.896705+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:10.667502+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:27.880849+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:45.276308+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:02.280615+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:19.555547+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:37.062881+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:54.191589+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.83:0/3082162092":"2024-04-02T06:55:53.508926+0000","172.21.15.83:0/2071592157":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/2222527447":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/785958951":"2024-04-02T06:49:33.656125+0000","172.21.15.83:6801/1644397953":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/690500472":"2024-04-02T06:49:13.456026+0000","172.21.15.83:6800/1644397953":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/2125339627":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/2596683931":"2024-04-02T06:49:33.656125+0000","172.21.15.83:6801/1867137261":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/4017737477":"2024-04-02T06:55:53.508926+0000","172.21.15.83:6800/3375372052":"2024-04-02T06:55:53.508926+0000","172.21.15.83:0/3245313698":"2024-04-02T06:55:53.508926+0000","172.21.15.83:6801/3375372052":"2024-04-02T06:55:53.508926+0000","172.21.15.83:0/223927839":"2024-04-02T06:55:53.508926+0000","172.21.15.83:6800/1867137261":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/1365273187":"2024-04-02T06:55:53.508926+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":16,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T07:06:19.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.071+0000 7f799f537700 1 -- 172.21.15.83:0/3218462535 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f79840a1290 msgr2=0x7f79840a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:19.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.071+0000 7f799f537700 1 --2- 172.21.15.83:0/3218462535 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f79840a1290 0x7f79840a3750 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f799400b5c0 tx=0x7f7994005960 comp rx=0 tx=0).stop 2024-04-01T07:06:19.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.071+0000 7f799f537700 1 -- 172.21.15.83:0/3218462535 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7998105b80 msgr2=0x7f79981a2f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:19.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.071+0000 7f799f537700 1 --2- 172.21.15.83:0/3218462535 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7998105b80 0x7f79981a2f00 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f7990007ee0 tx=0x7f799000d3b0 comp rx=0 tx=0).stop 2024-04-01T07:06:19.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.071+0000 7f799f537700 1 -- 172.21.15.83:0/3218462535 shutdown_connections 2024-04-01T07:06:19.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.071+0000 7f799f537700 1 --2- 172.21.15.83:0/3218462535 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f79840a1290 0x7f79840a3750 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:19.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.071+0000 7f799f537700 1 --2- 172.21.15.83:0/3218462535 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7998105b80 0x7f79981a2f00 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:19.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.071+0000 7f799f537700 1 --2- 172.21.15.83:0/3218462535 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f79980ffae0 0x7f7998197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:19.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.071+0000 7f799f537700 1 --2- 172.21.15.83:0/3218462535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79981004a0 0x7f79981983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:19.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.071+0000 7f799f537700 1 -- 172.21.15.83:0/3218462535 >> 172.21.15.83:0/3218462535 conn(0x7f79980fb590 msgr2=0x7f79980fbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T07:06:19.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.071+0000 7f799f537700 1 -- 172.21.15.83:0/3218462535 shutdown_connections 2024-04-01T07:06:19.072 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.072+0000 7f799f537700 1 -- 172.21.15.83:0/3218462535 wait complete. 2024-04-01T07:06:19.084 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-01T06:51:21.963996+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-01T06:54:26.450403+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-01T06:54:27.564928+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '91', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 16, 'snap_epoch': 91, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-01T07:06:19.084 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-01T07:06:19.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:18 smithi153 ceph-mon[48187]: pgmap v325: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-01T07:06:19.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.210+0000 7f0a76a0b700 1 -- 172.21.15.83:0/3534919513 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0a700ffe50 msgr2=0x7f0a70100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:19.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.210+0000 7f0a76a0b700 1 --2- 172.21.15.83:0/3534919513 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0a700ffe50 0x7f0a70100230 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f0a60009990 tx=0x7f0a60009ca0 comp rx=0 tx=0).stop 2024-04-01T07:06:19.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.210+0000 7f0a76a0b700 1 -- 172.21.15.83:0/3534919513 shutdown_connections 2024-04-01T07:06:19.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.210+0000 7f0a76a0b700 1 --2- 172.21.15.83:0/3534919513 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0a700ffe50 0x7f0a70100230 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:19.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.210+0000 7f0a76a0b700 1 --2- 172.21.15.83:0/3534919513 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0a70104f60 0x7f0a7010cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:19.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.210+0000 7f0a76a0b700 1 --2- 172.21.15.83:0/3534919513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a70100800 0x7f0a70104830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:19.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.211+0000 7f0a76a0b700 1 -- 172.21.15.83:0/3534919513 >> 172.21.15.83:0/3534919513 conn(0x7f0a70076d40 msgr2=0x7f0a70077150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T07:06:19.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.211+0000 7f0a76a0b700 1 -- 172.21.15.83:0/3534919513 shutdown_connections 2024-04-01T07:06:19.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.211+0000 7f0a76a0b700 1 -- 172.21.15.83:0/3534919513 wait complete. 2024-04-01T07:06:19.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.211+0000 7f0a76a0b700 1 Processor -- start 2024-04-01T07:06:19.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.211+0000 7f0a76a0b700 1 -- start start 2024-04-01T07:06:19.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.211+0000 7f0a76a0b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a700ffe50 0x7f0a70198030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:06:19.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.212+0000 7f0a76a0b700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0a70104f60 0x7f0a70198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:06:19.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.212+0000 7f0a76a0b700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0a70198ab0 0x7f0a701a30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:06:19.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.212+0000 7f0a76a0b700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a701a3750 con 0x7f0a70198ab0 2024-04-01T07:06:19.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.212+0000 7f0a76a0b700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a701a38c0 con 0x7f0a70104f60 2024-04-01T07:06:19.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.212+0000 7f0a76a0b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a701a3a80 con 0x7f0a700ffe50 2024-04-01T07:06:19.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.212+0000 7f0a74fa8700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0a70198ab0 0x7f0a701a30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:06:19.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.212+0000 7f0a74fa8700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0a70198ab0 0x7f0a701a30b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59192/0 (socket says 172.21.15.83:59192) 2024-04-01T07:06:19.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.212+0000 7f0a74fa8700 1 -- 172.21.15.83:0/43471546 learned_addr learned my addr 172.21.15.83:0/43471546 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T07:06:19.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.212+0000 7f0a6ffff700 1 --2- 172.21.15.83:0/43471546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a700ffe50 0x7f0a70198030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:06:19.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.212+0000 7f0a74fa8700 1 -- 172.21.15.83:0/43471546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a700ffe50 msgr2=0x7f0a70198030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:19.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.212+0000 7f0a74fa8700 1 --2- 172.21.15.83:0/43471546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a700ffe50 0x7f0a70198030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:19.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.212+0000 7f0a6f7fe700 1 --2- 172.21.15.83:0/43471546 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0a70104f60 0x7f0a70198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:06:19.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.212+0000 7f0a74fa8700 1 -- 172.21.15.83:0/43471546 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0a70104f60 msgr2=0x7f0a70198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:19.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.212+0000 7f0a74fa8700 1 --2- 172.21.15.83:0/43471546 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0a70104f60 0x7f0a70198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:19.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.212+0000 7f0a74fa8700 1 -- 172.21.15.83:0/43471546 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a600095f0 con 0x7f0a70198ab0 2024-04-01T07:06:19.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.212+0000 7f0a6f7fe700 1 --2- 172.21.15.83:0/43471546 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0a70104f60 0x7f0a70198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T07:06:19.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.212+0000 7f0a74fa8700 1 --2- 172.21.15.83:0/43471546 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0a70198ab0 0x7f0a701a30b0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f0a6800ada0 tx=0x7f0a6800c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T07:06:19.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.212+0000 7f0a6d7fa700 1 -- 172.21.15.83:0/43471546 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6800f070 con 0x7f0a70198ab0 2024-04-01T07:06:19.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.212+0000 7f0a6d7fa700 1 -- 172.21.15.83:0/43471546 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0a68007b30 con 0x7f0a70198ab0 2024-04-01T07:06:19.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.212+0000 7f0a76a0b700 1 -- 172.21.15.83:0/43471546 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a701a3d60 con 0x7f0a70198ab0 2024-04-01T07:06:19.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.212+0000 7f0a6d7fa700 1 -- 172.21.15.83:0/43471546 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a680053e0 con 0x7f0a70198ab0 2024-04-01T07:06:19.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.212+0000 7f0a76a0b700 1 -- 172.21.15.83:0/43471546 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a701a4270 con 0x7f0a70198ab0 2024-04-01T07:06:19.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.213+0000 7f0a76a0b700 1 -- 172.21.15.83:0/43471546 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a701081d0 con 0x7f0a70198ab0 2024-04-01T07:06:19.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.214+0000 7f0a6d7fa700 1 -- 172.21.15.83:0/43471546 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 25) v1 ==== 135996+0+0 (secure 0 0 0) 0x7f0a6800c980 con 0x7f0a70198ab0 2024-04-01T07:06:19.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.215+0000 7f0a6d7fa700 1 --2- 172.21.15.83:0/43471546 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f0a580a1290 0x7f0a580a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:06:19.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.215+0000 7f0a6ffff700 1 --2- 172.21.15.83:0/43471546 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f0a580a1290 0x7f0a580a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:06:19.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.215+0000 7f0a6d7fa700 1 -- 172.21.15.83:0/43471546 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f0a680cc1e0 con 0x7f0a70198ab0 2024-04-01T07:06:19.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.216+0000 7f0a6ffff700 1 --2- 172.21.15.83:0/43471546 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f0a580a1290 0x7f0a580a3750 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0a6000b5c0 tx=0x7f0a60005960 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T07:06:19.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.220+0000 7f0a6d7fa700 1 -- 172.21.15.83:0/43471546 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f0a680956f0 con 0x7f0a70198ab0 2024-04-01T07:06:19.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:18 smithi145 ceph-mon[47816]: pgmap v325: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-04-01T07:06:19.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.415+0000 7f0a76a0b700 1 -- 172.21.15.83:0/43471546 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0a70068390 con 0x7f0a70198ab0 2024-04-01T07:06:19.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.415+0000 7f0a6d7fa700 1 -- 172.21.15.83:0/43471546 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v92) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0a68098d10 con 0x7f0a70198ab0 2024-04-01T07:06:19.415 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 1 2024-04-01T07:06:19.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.417+0000 7f0a76a0b700 1 -- 172.21.15.83:0/43471546 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f0a580a1290 msgr2=0x7f0a580a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:19.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.417+0000 7f0a76a0b700 1 --2- 172.21.15.83:0/43471546 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f0a580a1290 0x7f0a580a3750 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0a6000b5c0 tx=0x7f0a60005960 comp rx=0 tx=0).stop 2024-04-01T07:06:19.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.417+0000 7f0a76a0b700 1 -- 172.21.15.83:0/43471546 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0a70198ab0 msgr2=0x7f0a701a30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:19.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.417+0000 7f0a76a0b700 1 --2- 172.21.15.83:0/43471546 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0a70198ab0 0x7f0a701a30b0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f0a6800ada0 tx=0x7f0a6800c330 comp rx=0 tx=0).stop 2024-04-01T07:06:19.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.417+0000 7f0a76a0b700 1 -- 172.21.15.83:0/43471546 shutdown_connections 2024-04-01T07:06:19.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.417+0000 7f0a76a0b700 1 --2- 172.21.15.83:0/43471546 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f0a580a1290 0x7f0a580a3750 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:19.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.417+0000 7f0a76a0b700 1 --2- 172.21.15.83:0/43471546 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0a70198ab0 0x7f0a701a30b0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:19.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.417+0000 7f0a76a0b700 1 --2- 172.21.15.83:0/43471546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a700ffe50 0x7f0a70198030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:19.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.417+0000 7f0a76a0b700 1 --2- 172.21.15.83:0/43471546 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0a70104f60 0x7f0a70198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:19.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.417+0000 7f0a76a0b700 1 -- 172.21.15.83:0/43471546 >> 172.21.15.83:0/43471546 conn(0x7f0a70076d40 msgr2=0x7f0a700fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T07:06:19.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.417+0000 7f0a76a0b700 1 -- 172.21.15.83:0/43471546 shutdown_connections 2024-04-01T07:06:19.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.417+0000 7f0a76a0b700 1 -- 172.21.15.83:0/43471546 wait complete. 2024-04-01T07:06:19.429 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-01T07:06:19.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.554+0000 7fc5d51a8700 1 -- 172.21.15.83:0/59692087 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5d00fffd0 msgr2=0x7fc5d0103fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:19.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.554+0000 7fc5d51a8700 1 --2- 172.21.15.83:0/59692087 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5d00fffd0 0x7fc5d0103fc0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fc5c000aaa0 tx=0x7fc5c000adb0 comp rx=0 tx=0).stop 2024-04-01T07:06:19.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.554+0000 7fc5d51a8700 1 -- 172.21.15.83:0/59692087 shutdown_connections 2024-04-01T07:06:19.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.554+0000 7fc5d51a8700 1 --2- 172.21.15.83:0/59692087 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc5d01046f0 0x7fc5d010c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:19.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.554+0000 7fc5d51a8700 1 --2- 172.21.15.83:0/59692087 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5d00ff620 0x7fc5d00ffa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:19.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.554+0000 7fc5d51a8700 1 --2- 172.21.15.83:0/59692087 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5d00fffd0 0x7fc5d0103fc0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:19.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.554+0000 7fc5d51a8700 1 -- 172.21.15.83:0/59692087 >> 172.21.15.83:0/59692087 conn(0x7fc5d00761e0 msgr2=0x7fc5d00fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T07:06:19.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.554+0000 7fc5d51a8700 1 -- 172.21.15.83:0/59692087 shutdown_connections 2024-04-01T07:06:19.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.554+0000 7fc5d51a8700 1 -- 172.21.15.83:0/59692087 wait complete. 2024-04-01T07:06:19.557 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.555+0000 7fc5d51a8700 1 Processor -- start 2024-04-01T07:06:19.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.555+0000 7fc5d51a8700 1 -- start start 2024-04-01T07:06:19.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.555+0000 7fc5d51a8700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc5d00ff620 0x7fc5d0199480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:06:19.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.555+0000 7fc5d51a8700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5d01046f0 0x7fc5d01999c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:06:19.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.555+0000 7fc5d51a8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5d019dd60 0x7fc5d019e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:06:19.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.555+0000 7fc5d51a8700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d019e7e0 con 0x7fc5d01046f0 2024-04-01T07:06:19.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.555+0000 7fc5d51a8700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d019e950 con 0x7fc5d00ff620 2024-04-01T07:06:19.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.555+0000 7fc5d51a8700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d019eb10 con 0x7fc5d019dd60 2024-04-01T07:06:19.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.555+0000 7fc5ce59c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5d01046f0 0x7fc5d01999c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:06:19.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.555+0000 7fc5ce59c700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5d01046f0 0x7fc5d01999c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59210/0 (socket says 172.21.15.83:59210) 2024-04-01T07:06:19.558 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.555+0000 7fc5ce59c700 1 -- 172.21.15.83:0/2402858776 learned_addr learned my addr 172.21.15.83:0/2402858776 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T07:06:19.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.555+0000 7fc5ced9d700 1 --2- 172.21.15.83:0/2402858776 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc5d00ff620 0x7fc5d0199480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:06:19.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.556+0000 7fc5cf59e700 1 --2- 172.21.15.83:0/2402858776 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5d019dd60 0x7fc5d019e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:06:19.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.556+0000 7fc5ce59c700 1 -- 172.21.15.83:0/2402858776 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5d019dd60 msgr2=0x7fc5d019e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:19.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.556+0000 7fc5ce59c700 1 --2- 172.21.15.83:0/2402858776 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5d019dd60 0x7fc5d019e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:19.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.556+0000 7fc5ce59c700 1 -- 172.21.15.83:0/2402858776 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc5d00ff620 msgr2=0x7fc5d0199480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:19.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.556+0000 7fc5ce59c700 1 --2- 172.21.15.83:0/2402858776 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc5d00ff620 0x7fc5d0199480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:19.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.556+0000 7fc5ce59c700 1 -- 172.21.15.83:0/2402858776 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c000a700 con 0x7fc5d01046f0 2024-04-01T07:06:19.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.556+0000 7fc5ce59c700 1 --2- 172.21.15.83:0/2402858776 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5d01046f0 0x7fc5d01999c0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0000c00 tx=0x7fc5c0003c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T07:06:19.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.556+0000 7fc5c7fff700 1 -- 172.21.15.83:0/2402858776 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c0004210 con 0x7fc5d01046f0 2024-04-01T07:06:19.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.556+0000 7fc5c7fff700 1 -- 172.21.15.83:0/2402858776 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc5c000e450 con 0x7fc5d01046f0 2024-04-01T07:06:19.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.556+0000 7fc5d51a8700 1 -- 172.21.15.83:0/2402858776 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5d01a6010 con 0x7fc5d01046f0 2024-04-01T07:06:19.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.556+0000 7fc5c7fff700 1 -- 172.21.15.83:0/2402858776 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c0016680 con 0x7fc5d01046f0 2024-04-01T07:06:19.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.556+0000 7fc5d51a8700 1 -- 172.21.15.83:0/2402858776 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5d01a6430 con 0x7fc5d01046f0 2024-04-01T07:06:19.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.557+0000 7fc5d51a8700 1 -- 172.21.15.83:0/2402858776 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5d0100aa0 con 0x7fc5d01046f0 2024-04-01T07:06:19.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.558+0000 7fc5c7fff700 1 -- 172.21.15.83:0/2402858776 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 25) v1 ==== 135996+0+0 (secure 0 0 0) 0x7fc5c000e5c0 con 0x7fc5d01046f0 2024-04-01T07:06:19.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.559+0000 7fc5c7fff700 1 --2- 172.21.15.83:0/2402858776 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fc5bc0a1290 0x7fc5bc0a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:06:19.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.559+0000 7fc5ced9d700 1 --2- 172.21.15.83:0/2402858776 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fc5bc0a1290 0x7fc5bc0a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:06:19.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.559+0000 7fc5c7fff700 1 -- 172.21.15.83:0/2402858776 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fc5c0012070 con 0x7fc5d01046f0 2024-04-01T07:06:19.561 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.559+0000 7fc5ced9d700 1 --2- 172.21.15.83:0/2402858776 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fc5bc0a1290 0x7fc5bc0a3750 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc5b8009a10 tx=0x7fc5b8009190 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T07:06:19.562 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.562+0000 7fc5c7fff700 1 -- 172.21.15.83:0/2402858776 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7fc5c0098250 con 0x7fc5d01046f0 2024-04-01T07:06:19.760 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.761+0000 7fc5d51a8700 1 -- 172.21.15.83:0/2402858776 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc5d00fffd0 con 0x7fc5d01046f0 2024-04-01T07:06:19.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.761+0000 7fc5c7fff700 1 -- 172.21.15.83:0/2402858776 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v92) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc5c009b870 con 0x7fc5d01046f0 2024-04-01T07:06:19.761 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 32 2024-04-01T07:06:19.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.763+0000 7fc5d51a8700 1 -- 172.21.15.83:0/2402858776 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fc5bc0a1290 msgr2=0x7fc5bc0a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:19.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.763+0000 7fc5d51a8700 1 --2- 172.21.15.83:0/2402858776 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fc5bc0a1290 0x7fc5bc0a3750 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc5b8009a10 tx=0x7fc5b8009190 comp rx=0 tx=0).stop 2024-04-01T07:06:19.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.763+0000 7fc5d51a8700 1 -- 172.21.15.83:0/2402858776 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5d01046f0 msgr2=0x7fc5d01999c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:19.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.763+0000 7fc5d51a8700 1 --2- 172.21.15.83:0/2402858776 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5d01046f0 0x7fc5d01999c0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0000c00 tx=0x7fc5c0003c30 comp rx=0 tx=0).stop 2024-04-01T07:06:19.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.763+0000 7fc5d51a8700 1 -- 172.21.15.83:0/2402858776 shutdown_connections 2024-04-01T07:06:19.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.763+0000 7fc5d51a8700 1 --2- 172.21.15.83:0/2402858776 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fc5bc0a1290 0x7fc5bc0a3750 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:19.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.763+0000 7fc5d51a8700 1 --2- 172.21.15.83:0/2402858776 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5d019dd60 0x7fc5d019e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:19.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.763+0000 7fc5d51a8700 1 --2- 172.21.15.83:0/2402858776 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc5d00ff620 0x7fc5d0199480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:19.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.763+0000 7fc5d51a8700 1 --2- 172.21.15.83:0/2402858776 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc5d01046f0 0x7fc5d01999c0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:19.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.763+0000 7fc5d51a8700 1 -- 172.21.15.83:0/2402858776 >> 172.21.15.83:0/2402858776 conn(0x7fc5d00761e0 msgr2=0x7fc5d010b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T07:06:19.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.763+0000 7fc5d51a8700 1 -- 172.21.15.83:0/2402858776 shutdown_connections 2024-04-01T07:06:19.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.763+0000 7fc5d51a8700 1 -- 172.21.15.83:0/2402858776 wait complete. 2024-04-01T07:06:19.775 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-01T07:06:19.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.904+0000 7f48e70f2700 1 -- 172.21.15.83:0/561062401 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48e0105ce0 msgr2=0x7f48e01060c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:19.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.904+0000 7f48e70f2700 1 --2- 172.21.15.83:0/561062401 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48e0105ce0 0x7f48e01060c0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f48d4009990 tx=0x7f48d4009ca0 comp rx=0 tx=0).stop 2024-04-01T07:06:19.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.904+0000 7f48e70f2700 1 -- 172.21.15.83:0/561062401 shutdown_connections 2024-04-01T07:06:19.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.904+0000 7f48e70f2700 1 --2- 172.21.15.83:0/561062401 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48e0105ce0 0x7f48e01060c0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:19.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.904+0000 7f48e70f2700 1 --2- 172.21.15.83:0/561062401 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f48e00687f0 0x7f48e010db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:19.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.904+0000 7f48e70f2700 1 --2- 172.21.15.83:0/561062401 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48e0067e30 0x7f48e00682b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:19.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.904+0000 7f48e70f2700 1 -- 172.21.15.83:0/561062401 >> 172.21.15.83:0/561062401 conn(0x7f48e0076d40 msgr2=0x7f48e0077150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T07:06:19.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.904+0000 7f48e70f2700 1 -- 172.21.15.83:0/561062401 shutdown_connections 2024-04-01T07:06:19.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.904+0000 7f48e70f2700 1 -- 172.21.15.83:0/561062401 wait complete. 2024-04-01T07:06:19.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.904+0000 7f48e70f2700 1 Processor -- start 2024-04-01T07:06:19.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.904+0000 7f48e70f2700 1 -- start start 2024-04-01T07:06:19.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.905+0000 7f48e70f2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48e0067e30 0x7f48e01971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:06:19.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.905+0000 7f48e70f2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48e00687f0 0x7f48e01976f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:06:19.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.905+0000 7f48e70f2700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f48e0105ce0 0x7f48e019ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:06:19.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.905+0000 7f48e70f2700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e019c0d0 con 0x7f48e00687f0 2024-04-01T07:06:19.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.905+0000 7f48e70f2700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e019c240 con 0x7f48e0105ce0 2024-04-01T07:06:19.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.905+0000 7f48e70f2700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e019c400 con 0x7f48e0067e30 2024-04-01T07:06:19.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.905+0000 7f48dffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48e00687f0 0x7f48e01976f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:06:19.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.905+0000 7f48dffff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48e00687f0 0x7f48e01976f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59234/0 (socket says 172.21.15.83:59234) 2024-04-01T07:06:19.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.905+0000 7f48dffff700 1 -- 172.21.15.83:0/3223581962 learned_addr learned my addr 172.21.15.83:0/3223581962 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T07:06:19.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.905+0000 7f48e568f700 1 --2- 172.21.15.83:0/3223581962 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f48e0105ce0 0x7f48e019ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:06:19.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.905+0000 7f48dffff700 1 -- 172.21.15.83:0/3223581962 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48e0067e30 msgr2=0x7f48e01971b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:19.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.905+0000 7f48dffff700 1 --2- 172.21.15.83:0/3223581962 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48e0067e30 0x7f48e01971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:19.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.905+0000 7f48dffff700 1 -- 172.21.15.83:0/3223581962 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f48e0105ce0 msgr2=0x7f48e019ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:19.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.905+0000 7f48dffff700 1 --2- 172.21.15.83:0/3223581962 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f48e0105ce0 0x7f48e019ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:19.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.905+0000 7f48dffff700 1 -- 172.21.15.83:0/3223581962 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d40095f0 con 0x7f48e00687f0 2024-04-01T07:06:19.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.905+0000 7f48e568f700 1 --2- 172.21.15.83:0/3223581962 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f48e0105ce0 0x7f48e019ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-01T07:06:19.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.905+0000 7f48dffff700 1 --2- 172.21.15.83:0/3223581962 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48e00687f0 0x7f48e01976f0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f48cc00d950 tx=0x7f48cc00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T07:06:19.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.905+0000 7f48ddffb700 1 -- 172.21.15.83:0/3223581962 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48cc009b40 con 0x7f48e00687f0 2024-04-01T07:06:19.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.905+0000 7f48ddffb700 1 -- 172.21.15.83:0/3223581962 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f48cc009ca0 con 0x7f48e00687f0 2024-04-01T07:06:19.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.905+0000 7f48e70f2700 1 -- 172.21.15.83:0/3223581962 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48e019c6e0 con 0x7f48e00687f0 2024-04-01T07:06:19.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.905+0000 7f48ddffb700 1 -- 172.21.15.83:0/3223581962 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48cc00f620 con 0x7f48e00687f0 2024-04-01T07:06:19.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.906+0000 7f48e70f2700 1 -- 172.21.15.83:0/3223581962 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48e01a3f20 con 0x7f48e00687f0 2024-04-01T07:06:19.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.906+0000 7f48e70f2700 1 -- 172.21.15.83:0/3223581962 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48e0109280 con 0x7f48e00687f0 2024-04-01T07:06:19.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.907+0000 7f48ddffb700 1 -- 172.21.15.83:0/3223581962 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 25) v1 ==== 135996+0+0 (secure 0 0 0) 0x7f48cc010460 con 0x7f48e00687f0 2024-04-01T07:06:19.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.908+0000 7f48ddffb700 1 --2- 172.21.15.83:0/3223581962 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f48d00a1290 0x7f48d00a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:06:19.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.908+0000 7f48e4e8e700 1 --2- 172.21.15.83:0/3223581962 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f48d00a1290 0x7f48d00a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:06:19.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.908+0000 7f48ddffb700 1 -- 172.21.15.83:0/3223581962 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f48cc0cd0b0 con 0x7f48e00687f0 2024-04-01T07:06:19.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.908+0000 7f48e4e8e700 1 --2- 172.21.15.83:0/3223581962 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f48d00a1290 0x7f48d00a3750 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f48d40098e0 tx=0x7f48d4005fb0 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T07:06:19.912 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:19.912+0000 7f48ddffb700 1 -- 172.21.15.83:0/3223581962 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f48cc0964d0 con 0x7f48e00687f0 2024-04-01T07:06:20.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.109+0000 7f48e70f2700 1 -- 172.21.15.83:0/3223581962 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f48e01984b0 con 0x7f48e00687f0 2024-04-01T07:06:20.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.110+0000 7f48ddffb700 1 -- 172.21.15.83:0/3223581962 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v92) v1 ==== 100+0+11 (secure 0 0 0) 0x7f48cc099af0 con 0x7f48e00687f0 2024-04-01T07:06:20.110 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 64 2024-04-01T07:06:20.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.112+0000 7f48e70f2700 1 -- 172.21.15.83:0/3223581962 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f48d00a1290 msgr2=0x7f48d00a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:20.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.112+0000 7f48e70f2700 1 --2- 172.21.15.83:0/3223581962 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f48d00a1290 0x7f48d00a3750 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f48d40098e0 tx=0x7f48d4005fb0 comp rx=0 tx=0).stop 2024-04-01T07:06:20.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.112+0000 7f48e70f2700 1 -- 172.21.15.83:0/3223581962 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48e00687f0 msgr2=0x7f48e01976f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:20.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.112+0000 7f48e70f2700 1 --2- 172.21.15.83:0/3223581962 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48e00687f0 0x7f48e01976f0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f48cc00d950 tx=0x7f48cc00dd10 comp rx=0 tx=0).stop 2024-04-01T07:06:20.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.112+0000 7f48e70f2700 1 -- 172.21.15.83:0/3223581962 shutdown_connections 2024-04-01T07:06:20.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.112+0000 7f48e70f2700 1 --2- 172.21.15.83:0/3223581962 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f48d00a1290 0x7f48d00a3750 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:20.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.112+0000 7f48e70f2700 1 --2- 172.21.15.83:0/3223581962 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f48e0105ce0 0x7f48e019ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:20.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.112+0000 7f48e70f2700 1 --2- 172.21.15.83:0/3223581962 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48e0067e30 0x7f48e01971b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:20.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.112+0000 7f48e70f2700 1 --2- 172.21.15.83:0/3223581962 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48e00687f0 0x7f48e01976f0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:20.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.112+0000 7f48e70f2700 1 -- 172.21.15.83:0/3223581962 >> 172.21.15.83:0/3223581962 conn(0x7f48e0076d40 msgr2=0x7f48e00fd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T07:06:20.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.112+0000 7f48e70f2700 1 -- 172.21.15.83:0/3223581962 shutdown_connections 2024-04-01T07:06:20.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.112+0000 7f48e70f2700 1 -- 172.21.15.83:0/3223581962 wait complete. 2024-04-01T07:06:20.123 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:19 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/3218462535' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T07:06:20.123 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:19 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/43471546' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-01T07:06:20.123 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:19 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/2402858776' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-01T07:06:20.124 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-01T07:06:20.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:19 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/3218462535' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T07:06:20.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:19 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/43471546' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-01T07:06:20.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:19 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/2402858776' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-01T07:06:20.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.246+0000 7f4963850700 1 -- 172.21.15.83:0/815875929 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f495c0ff490 msgr2=0x7f495c0ff870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:20.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.246+0000 7f4963850700 1 --2- 172.21.15.83:0/815875929 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f495c0ff490 0x7f495c0ff870 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f494c009990 tx=0x7f494c009ca0 comp rx=0 tx=0).stop 2024-04-01T07:06:20.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.247+0000 7f4963850700 1 -- 172.21.15.83:0/815875929 shutdown_connections 2024-04-01T07:06:20.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.247+0000 7f4963850700 1 --2- 172.21.15.83:0/815875929 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f495c0ff490 0x7f495c0ff870 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:20.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.247+0000 7f4963850700 1 --2- 172.21.15.83:0/815875929 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f495c106050 0x7f495c10dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:20.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.247+0000 7f4963850700 1 --2- 172.21.15.83:0/815875929 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f495c0ffe40 0x7f495c105970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:20.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.247+0000 7f4963850700 1 -- 172.21.15.83:0/815875929 >> 172.21.15.83:0/815875929 conn(0x7f495c0761e0 msgr2=0x7f495c0fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T07:06:20.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.247+0000 7f4963850700 1 -- 172.21.15.83:0/815875929 shutdown_connections 2024-04-01T07:06:20.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.247+0000 7f4963850700 1 -- 172.21.15.83:0/815875929 wait complete. 2024-04-01T07:06:20.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.247+0000 7f4963850700 1 Processor -- start 2024-04-01T07:06:20.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.247+0000 7f4963850700 1 -- start start 2024-04-01T07:06:20.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.247+0000 7f4963850700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f495c0ff490 0x7f495c197140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:06:20.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.247+0000 7f4963850700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f495c106050 0x7f495c197680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:06:20.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.247+0000 7f4963850700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f495c19ba20 0x7f495c19bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:06:20.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.247+0000 7f4963850700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f495c19c4a0 con 0x7f495c19ba20 2024-04-01T07:06:20.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.247+0000 7f4963850700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f495c19c610 con 0x7f495c106050 2024-04-01T07:06:20.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.247+0000 7f4963850700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f495c19c7d0 con 0x7f495c0ff490 2024-04-01T07:06:20.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.248+0000 7f4961ded700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f495c19ba20 0x7f495c19bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:06:20.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.248+0000 7f4961ded700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f495c19ba20 0x7f495c19bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59254/0 (socket says 172.21.15.83:59254) 2024-04-01T07:06:20.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.248+0000 7f4961ded700 1 -- 172.21.15.83:0/3108722530 learned_addr learned my addr 172.21.15.83:0/3108722530 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T07:06:20.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.248+0000 7f4960deb700 1 --2- 172.21.15.83:0/3108722530 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f495c106050 0x7f495c197680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:06:20.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.248+0000 7f49615ec700 1 --2- 172.21.15.83:0/3108722530 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f495c0ff490 0x7f495c197140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:06:20.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.248+0000 7f4961ded700 1 -- 172.21.15.83:0/3108722530 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f495c0ff490 msgr2=0x7f495c197140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:20.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.248+0000 7f4961ded700 1 --2- 172.21.15.83:0/3108722530 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f495c0ff490 0x7f495c197140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:20.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.248+0000 7f4961ded700 1 -- 172.21.15.83:0/3108722530 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f495c106050 msgr2=0x7f495c197680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:20.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.248+0000 7f4961ded700 1 --2- 172.21.15.83:0/3108722530 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f495c106050 0x7f495c197680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:20.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.248+0000 7f4961ded700 1 -- 172.21.15.83:0/3108722530 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f494c0095f0 con 0x7f495c19ba20 2024-04-01T07:06:20.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.248+0000 7f4960deb700 1 --2- 172.21.15.83:0/3108722530 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f495c106050 0x7f495c197680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T07:06:20.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.248+0000 7f4961ded700 1 --2- 172.21.15.83:0/3108722530 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f495c19ba20 0x7f495c19bea0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f495400ada0 tx=0x7f495400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T07:06:20.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.248+0000 7f49527fc700 1 -- 172.21.15.83:0/3108722530 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495400f070 con 0x7f495c19ba20 2024-04-01T07:06:20.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.248+0000 7f4963850700 1 -- 172.21.15.83:0/3108722530 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f495c1a3d30 con 0x7f495c19ba20 2024-04-01T07:06:20.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.248+0000 7f49527fc700 1 -- 172.21.15.83:0/3108722530 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4954007b30 con 0x7f495c19ba20 2024-04-01T07:06:20.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.248+0000 7f49527fc700 1 -- 172.21.15.83:0/3108722530 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4954005440 con 0x7f495c19ba20 2024-04-01T07:06:20.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.248+0000 7f4963850700 1 -- 172.21.15.83:0/3108722530 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f495c1a41c0 con 0x7f495c19ba20 2024-04-01T07:06:20.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.249+0000 7f4963850700 1 -- 172.21.15.83:0/3108722530 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f495c109290 con 0x7f495c19ba20 2024-04-01T07:06:20.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.250+0000 7f49527fc700 1 -- 172.21.15.83:0/3108722530 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 25) v1 ==== 135996+0+0 (secure 0 0 0) 0x7f4954004ad0 con 0x7f495c19ba20 2024-04-01T07:06:20.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.251+0000 7f49527fc700 1 --2- 172.21.15.83:0/3108722530 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f49480a1310 0x7f49480a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:06:20.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.251+0000 7f49615ec700 1 --2- 172.21.15.83:0/3108722530 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f49480a1310 0x7f49480a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:06:20.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.251+0000 7f49527fc700 1 -- 172.21.15.83:0/3108722530 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f49540cc8f0 con 0x7f495c19ba20 2024-04-01T07:06:20.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.251+0000 7f49615ec700 1 --2- 172.21.15.83:0/3108722530 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f49480a1310 0x7f49480a37d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f494c00b5c0 tx=0x7f494c005fb0 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T07:06:20.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:19 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/3218462535' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T07:06:20.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:19 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/43471546' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-01T07:06:20.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:19 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/2402858776' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-01T07:06:20.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.254+0000 7f49527fc700 1 -- 172.21.15.83:0/3108722530 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f4954095da0 con 0x7f495c19ba20 2024-04-01T07:06:20.480 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.480+0000 7f4963850700 1 -- 172.21.15.83:0/3108722530 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f495c198440 con 0x7f495c19ba20 2024-04-01T07:06:20.481 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.481+0000 7f49527fc700 1 -- 172.21.15.83:0/3108722530 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 17 entries v92) v1 ==== 81+0+1001 (secure 0 0 0) 0x7f49540993c0 con 0x7f495c19ba20 2024-04-01T07:06:20.481 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/3082162092 2024-04-02T06:55:53.508926+0000 2024-04-01T07:06:20.481 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/2071592157 2024-04-02T06:49:13.456026+0000 2024-04-01T07:06:20.481 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/2222527447 2024-04-02T06:49:13.456026+0000 2024-04-01T07:06:20.481 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/785958951 2024-04-02T06:49:33.656125+0000 2024-04-01T07:06:20.481 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:6801/1644397953 2024-04-02T06:49:13.456026+0000 2024-04-01T07:06:20.481 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/690500472 2024-04-02T06:49:13.456026+0000 2024-04-01T07:06:20.481 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:6800/1644397953 2024-04-02T06:49:13.456026+0000 2024-04-01T07:06:20.481 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/2125339627 2024-04-02T06:49:33.656125+0000 2024-04-01T07:06:20.481 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/2596683931 2024-04-02T06:49:33.656125+0000 2024-04-01T07:06:20.481 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:6801/1867137261 2024-04-02T06:49:33.656125+0000 2024-04-01T07:06:20.481 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/4017737477 2024-04-02T06:55:53.508926+0000 2024-04-01T07:06:20.482 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:6800/3375372052 2024-04-02T06:55:53.508926+0000 2024-04-01T07:06:20.482 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/3245313698 2024-04-02T06:55:53.508926+0000 2024-04-01T07:06:20.482 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:6801/3375372052 2024-04-02T06:55:53.508926+0000 2024-04-01T07:06:20.482 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/223927839 2024-04-02T06:55:53.508926+0000 2024-04-01T07:06:20.482 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:6800/1867137261 2024-04-02T06:49:33.656125+0000 2024-04-01T07:06:20.482 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/1365273187 2024-04-02T06:55:53.508926+0000 2024-04-01T07:06:20.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.483+0000 7f4963850700 1 -- 172.21.15.83:0/3108722530 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f49480a1310 msgr2=0x7f49480a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:20.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.483+0000 7f4963850700 1 --2- 172.21.15.83:0/3108722530 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f49480a1310 0x7f49480a37d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f494c00b5c0 tx=0x7f494c005fb0 comp rx=0 tx=0).stop 2024-04-01T07:06:20.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.483+0000 7f4963850700 1 -- 172.21.15.83:0/3108722530 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f495c19ba20 msgr2=0x7f495c19bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:20.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.483+0000 7f4963850700 1 --2- 172.21.15.83:0/3108722530 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f495c19ba20 0x7f495c19bea0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f495400ada0 tx=0x7f495400c330 comp rx=0 tx=0).stop 2024-04-01T07:06:20.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.483+0000 7f4963850700 1 -- 172.21.15.83:0/3108722530 shutdown_connections 2024-04-01T07:06:20.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.483+0000 7f4963850700 1 --2- 172.21.15.83:0/3108722530 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f49480a1310 0x7f49480a37d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:20.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.483+0000 7f4963850700 1 --2- 172.21.15.83:0/3108722530 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f495c19ba20 0x7f495c19bea0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:20.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.483+0000 7f4963850700 1 --2- 172.21.15.83:0/3108722530 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f495c0ff490 0x7f495c197140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:20.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.483+0000 7f4963850700 1 --2- 172.21.15.83:0/3108722530 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f495c106050 0x7f495c197680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:20.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.483+0000 7f4963850700 1 -- 172.21.15.83:0/3108722530 >> 172.21.15.83:0/3108722530 conn(0x7f495c0761e0 msgr2=0x7f495c1042d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T07:06:20.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.483+0000 7f4963850700 1 -- 172.21.15.83:0/3108722530 shutdown_connections 2024-04-01T07:06:20.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:20.483+0000 7f4963850700 1 -- 172.21.15.83:0/3108722530 wait complete. 2024-04-01T07:06:20.487 INFO:teuthology.orchestra.run.smithi083.stderr:listed 17 entries 2024-04-01T07:06:20.495 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-01T07:06:20.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T07:06:20.495 DEBUG:teuthology.orchestra.run.smithi083:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-01T07:06:20.549 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi083.front.sepia.ceph.com 2024-04-01T07:06:20.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T07:06:20.550 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-01T07:06:20.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T07:06:20.623 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2024-04-01T07:06:20.641 INFO:teuthology.orchestra.run.smithi083.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-01T07:06:20.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T07:06:20.641 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-01T07:06:20.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T07:06:20.723 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link delete ceph-brx 2024-04-01T07:06:20.822 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-01T07:06:20.822 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-04-01T07:06:20.822 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-01T07:06:20.840 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16244168k,nr_inodes=4061042,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=38,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1437 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3252516k,mode=700,uid=1000,gid=1304 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/sda1 /var/lib/containers/storage/overlay ext4 rw,seclabel,relatime 0 0 overlay /var/lib/containers/storage/overlay/0ad47379a56bffcc601d3f17e4b6c2df3438acdfe7524c6b25a90df12b8d2549/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/AOEQ3D24IAE7KSJLTNPM4VKDKQ:/var/lib/containers/storage/overlay/l/QVLBPADANHTJPDE3DBKUX6VTC7,upperdir=/var/lib/containers/storage/overlay/0ad47379a56bffcc601d3f17e4b6c2df3438acdfe7524c6b25a90df12b8d2549/diff,workdir=/var/lib/containers/storage/overlay/0ad47379a56bffcc601d3f17e4b6c2df3438acdfe7524c6b25a90df12b8d2549/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/dbd412a3bccaefaba911a87400637b49095611fca1ea51b2806cdd4891c0d404/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/AOEQ3D24IAE7KSJLTNPM4VKDKQ:/var/lib/containers/storage/overlay/l/QVLBPADANHTJPDE3DBKUX6VTC7,upperdir=/var/lib/containers/storage/overlay/dbd412a3bccaefaba911a87400637b49095611fca1ea51b2806cdd4891c0d404/diff,workdir=/var/lib/containers/storage/overlay/dbd412a3bccaefaba911a87400637b49095611fca1ea51b2806cdd4891c0d404/work,metacopy=on,volatile 0 0 tmpfs /run/user/0 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3252516k,mode=700 0 0 binfmt_misc /proc/sys/fs/binfmt_misc binfmt_misc rw,relatime 0 0 overlay /var/lib/containers/storage/overlay/fef7aba6d35ab9a7d7fc097b17c018f7cf0cd7de8f4e74def3d304f1087a1fe1/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/AOEQ3D24IAE7KSJLTNPM4VKDKQ:/var/lib/containers/storage/overlay/l/QVLBPADANHTJPDE3DBKUX6VTC7,upperdir=/var/lib/containers/storage/overlay/fef7aba6d35ab9a7d7fc097b17c018f7cf0cd7de8f4e74def3d304f1087a1fe1/diff,workdir=/var/lib/containers/storage/overlay/fef7aba6d35ab9a7d7fc097b17c018f7cf0cd7de8f4e74def3d304f1087a1fe1/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/40e637d9b33fabce2e2ca13b50e760dc5726fa054d351f363cb7214da6d7f25f/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/AOEQ3D24IAE7KSJLTNPM4VKDKQ:/var/lib/containers/storage/overlay/l/QVLBPADANHTJPDE3DBKUX6VTC7,upperdir=/var/lib/containers/storage/overlay/40e637d9b33fabce2e2ca13b50e760dc5726fa054d351f363cb7214da6d7f25f/diff,workdir=/var/lib/containers/storage/overlay/40e637d9b33fabce2e2ca13b50e760dc5726fa054d351f363cb7214da6d7f25f/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/5aa28e5308b83d3b7a7a6a872d5b469c9e2686f7e1a200ecd3b826b9b74b8f0b/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/AOEQ3D24IAE7KSJLTNPM4VKDKQ:/var/lib/containers/storage/overlay/l/QVLBPADANHTJPDE3DBKUX6VTC7,upperdir=/var/lib/containers/storage/overlay/5aa28e5308b83d3b7a7a6a872d5b469c9e2686f7e1a200ecd3b826b9b74b8f0b/diff,workdir=/var/lib/containers/storage/overlay/5aa28e5308b83d3b7a7a6a872d5b469c9e2686f7e1a200ecd3b826b9b74b8f0b/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/dabbd665c5ea70e232afb99824066a11ca7791fa8bcb91ecceb8aa365695c79c/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/AOEQ3D24IAE7KSJLTNPM4VKDKQ:/var/lib/containers/storage/overlay/l/QVLBPADANHTJPDE3DBKUX6VTC7,upperdir=/var/lib/containers/storage/overlay/dabbd665c5ea70e232afb99824066a11ca7791fa8bcb91ecceb8aa365695c79c/diff,workdir=/var/lib/containers/storage/overlay/dabbd665c5ea70e232afb99824066a11ca7791fa8bcb91ecceb8aa365695c79c/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/fe5e167a97aef6c3a8085db7bf61442fb9d02194d43df7e1ed34f4d5937b959b/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/AOEQ3D24IAE7KSJLTNPM4VKDKQ:/var/lib/containers/storage/overlay/l/QVLBPADANHTJPDE3DBKUX6VTC7,upperdir=/var/lib/containers/storage/overlay/fe5e167a97aef6c3a8085db7bf61442fb9d02194d43df7e1ed34f4d5937b959b/diff,workdir=/var/lib/containers/storage/overlay/fe5e167a97aef6c3a8085db7bf61442fb9d02194d43df7e1ed34f4d5937b959b/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/ea936103407c798455706b372d542cbf7ec24d0fa425402effce42c973d78147/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/AOEQ3D24IAE7KSJLTNPM4VKDKQ:/var/lib/containers/storage/overlay/l/QVLBPADANHTJPDE3DBKUX6VTC7,upperdir=/var/lib/containers/storage/overlay/ea936103407c798455706b372d542cbf7ec24d0fa425402effce42c973d78147/diff,workdir=/var/lib/containers/storage/overlay/ea936103407c798455706b372d542cbf7ec24d0fa425402effce42c973d78147/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/dec2ad3b00f7dc894f11b4f7d1d860a51b3ffc1817cf170f4f3831bf91718aeb/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/AOEQ3D24IAE7KSJLTNPM4VKDKQ:/var/lib/containers/storage/overlay/l/QVLBPADANHTJPDE3DBKUX6VTC7,upperdir=/var/lib/containers/storage/overlay/dec2ad3b00f7dc894f11b4f7d1d860a51b3ffc1817cf170f4f3831bf91718aeb/diff,workdir=/var/lib/containers/storage/overlay/dec2ad3b00f7dc894f11b4f7d1d860a51b3ffc1817cf170f4f3831bf91718aeb/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/706e1b7254d6d9fe4b7549f4a1e5db74a18355ae56f7f8538d96f513defd9daf/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/AOEQ3D24IAE7KSJLTNPM4VKDKQ:/var/lib/containers/storage/overlay/l/QVLBPADANHTJPDE3DBKUX6VTC7,upperdir=/var/lib/containers/storage/overlay/706e1b7254d6d9fe4b7549f4a1e5db74a18355ae56f7f8538d96f513defd9daf/diff,workdir=/var/lib/containers/storage/overlay/706e1b7254d6d9fe4b7549f4a1e5db74a18355ae56f7f8538d96f513defd9daf/work,metacopy=on,volatile 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 2024-04-01T07:06:20.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T07:06:20.841 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2024-04-01T07:06:20.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-01T07:06:20.898 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link delete ceph-brx 2024-04-01T07:06:20.969 INFO:teuthology.orchestra.run.smithi083.stderr:Cannot find device "ceph-brx" 2024-04-01T07:06:20.971 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T07:06:20.971 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-04-01T07:06:20.982 INFO:tasks.cephadm:Teardown begin 2024-04-01T07:06:20.982 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-01T07:06:20.982 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T07:06:21.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:20 smithi083 ceph-mon[43429]: pgmap v326: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-01T07:06:21.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:20 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/3223581962' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-01T07:06:21.013 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:20 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/3108722530' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-01T07:06:21.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.134+0000 7f832b904700 1 -- 172.21.15.83:0/370155055 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83240ffae0 msgr2=0x7f83240fff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:21.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.134+0000 7f832b904700 1 --2- 172.21.15.83:0/370155055 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83240ffae0 0x7f83240fff60 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f8314009990 tx=0x7f8314009ca0 comp rx=0 tx=0).stop 2024-04-01T07:06:21.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.134+0000 7f832b904700 1 -- 172.21.15.83:0/370155055 shutdown_connections 2024-04-01T07:06:21.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.134+0000 7f832b904700 1 --2- 172.21.15.83:0/370155055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83241004a0 0x7f832410c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:21.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.134+0000 7f832b904700 1 --2- 172.21.15.83:0/370155055 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8324105b80 0x7f8324105f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:21.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.134+0000 7f832b904700 1 --2- 172.21.15.83:0/370155055 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83240ffae0 0x7f83240fff60 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:21.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.134+0000 7f832b904700 1 -- 172.21.15.83:0/370155055 >> 172.21.15.83:0/370155055 conn(0x7f83240fb5f0 msgr2=0x7f83240fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T07:06:21.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.134+0000 7f832b904700 1 -- 172.21.15.83:0/370155055 shutdown_connections 2024-04-01T07:06:21.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.134+0000 7f832b904700 1 -- 172.21.15.83:0/370155055 wait complete. 2024-04-01T07:06:21.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.135+0000 7f832b904700 1 Processor -- start 2024-04-01T07:06:21.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.135+0000 7f832b904700 1 -- start start 2024-04-01T07:06:21.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.135+0000 7f832b904700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83240ffae0 0x7f8324195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:06:21.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.135+0000 7f832b904700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83241004a0 0x7f8324196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:06:21.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.135+0000 7f832b904700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8324105b80 0x7f832419a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:06:21.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.135+0000 7f832b904700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f832419adc0 con 0x7f83241004a0 2024-04-01T07:06:21.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.135+0000 7f832b904700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f832419af30 con 0x7f8324105b80 2024-04-01T07:06:21.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.135+0000 7f832b904700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f832419b0f0 con 0x7f83240ffae0 2024-04-01T07:06:21.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.135+0000 7f8328e9f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83241004a0 0x7f8324196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:06:21.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.135+0000 7f8328e9f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83241004a0 0x7f8324196430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59278/0 (socket says 172.21.15.83:59278) 2024-04-01T07:06:21.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.135+0000 7f8328e9f700 1 -- 172.21.15.83:0/2280119352 learned_addr learned my addr 172.21.15.83:0/2280119352 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T07:06:21.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.135+0000 7f83296a0700 1 --2- 172.21.15.83:0/2280119352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83240ffae0 0x7f8324195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:06:21.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.135+0000 7f8329ea1700 1 --2- 172.21.15.83:0/2280119352 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8324105b80 0x7f832419a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:06:21.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.136+0000 7f8328e9f700 1 -- 172.21.15.83:0/2280119352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83240ffae0 msgr2=0x7f8324195ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:21.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.136+0000 7f8328e9f700 1 --2- 172.21.15.83:0/2280119352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83240ffae0 0x7f8324195ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:21.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.136+0000 7f8328e9f700 1 -- 172.21.15.83:0/2280119352 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8324105b80 msgr2=0x7f832419a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:21.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.136+0000 7f8328e9f700 1 --2- 172.21.15.83:0/2280119352 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8324105b80 0x7f832419a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:21.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.136+0000 7f8328e9f700 1 -- 172.21.15.83:0/2280119352 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83140095f0 con 0x7f83241004a0 2024-04-01T07:06:21.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.136+0000 7f8329ea1700 1 --2- 172.21.15.83:0/2280119352 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8324105b80 0x7f832419a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T07:06:21.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.136+0000 7f8328e9f700 1 --2- 172.21.15.83:0/2280119352 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83241004a0 0x7f8324196430 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f83140098e0 tx=0x7f831400f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T07:06:21.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.136+0000 7f831a7fc700 1 -- 172.21.15.83:0/2280119352 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831401d070 con 0x7f83241004a0 2024-04-01T07:06:21.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.136+0000 7f831a7fc700 1 -- 172.21.15.83:0/2280119352 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8314022470 con 0x7f83241004a0 2024-04-01T07:06:21.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.136+0000 7f832b904700 1 -- 172.21.15.83:0/2280119352 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f832419b370 con 0x7f83241004a0 2024-04-01T07:06:21.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.136+0000 7f831a7fc700 1 -- 172.21.15.83:0/2280119352 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8314017650 con 0x7f83241004a0 2024-04-01T07:06:21.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.136+0000 7f832b904700 1 -- 172.21.15.83:0/2280119352 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83241a2c10 con 0x7f83241004a0 2024-04-01T07:06:21.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.137+0000 7f832b904700 1 -- 172.21.15.83:0/2280119352 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8324108100 con 0x7f83241004a0 2024-04-01T07:06:21.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.139+0000 7f831a7fc700 1 -- 172.21.15.83:0/2280119352 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 25) v1 ==== 135996+0+0 (secure 0 0 0) 0x7f83140225e0 con 0x7f83241004a0 2024-04-01T07:06:21.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.139+0000 7f831a7fc700 1 --2- 172.21.15.83:0/2280119352 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f83100a1290 0x7f83100a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:06:21.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.139+0000 7f83296a0700 1 --2- 172.21.15.83:0/2280119352 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f83100a1290 0x7f83100a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:06:21.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.139+0000 7f831a7fc700 1 -- 172.21.15.83:0/2280119352 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f83140ce050 con 0x7f83241004a0 2024-04-01T07:06:21.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.140+0000 7f83296a0700 1 --2- 172.21.15.83:0/2280119352 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f83100a1290 0x7f83100a3750 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f832000abd0 tx=0x7f832000a380 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T07:06:21.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:20 smithi153 ceph-mon[48187]: pgmap v326: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-01T07:06:21.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:20 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/3223581962' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-01T07:06:21.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:20 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/3108722530' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-01T07:06:21.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.143+0000 7f831a7fc700 1 -- 172.21.15.83:0/2280119352 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f8314097560 con 0x7f83241004a0 2024-04-01T07:06:21.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:20 smithi145 ceph-mon[47816]: pgmap v326: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-01T07:06:21.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:20 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/3223581962' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-01T07:06:21.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:20 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/3108722530' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-01T07:06:21.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.385+0000 7f832b904700 1 -- 172.21.15.83:0/2280119352 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f83241971a0 con 0x7f83241004a0 2024-04-01T07:06:21.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.385+0000 7f831a7fc700 1 -- 172.21.15.83:0/2280119352 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+10877 (secure 0 0 0) 0x7f831409ab80 con 0x7f83241004a0 2024-04-01T07:06:21.385 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T07:06:21.386 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":40,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1271130478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1271130478},{"type":"v1","addr":"172.21.15.83:6835","nonce":1271130478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2412682983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2412682983},{"type":"v1","addr":"172.21.15.83:6837","nonce":2412682983}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6839/3348145990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":3348145990},{"type":"v1","addr":"172.21.15.83:6839","nonce":3348145990}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6841/1191267445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6840","nonce":1191267445},{"type":"v1","addr":"172.21.15.83:6841","nonce":1191267445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2467459028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2467459028},{"type":"v1","addr":"172.21.15.153:6833","nonce":2467459028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24448,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4092629042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":4092629042},{"type":"v1","addr":"172.21.15.153:6835","nonce":4092629042}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":40,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-01T06:54:28.397062+0000","modified":"2024-04-01T07:02:07.823075+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24524,"mds_1":24494,"mds_2":24473},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6833/647005844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":647005844},{"type":"v1","addr":"172.21.15.145:6833","nonce":647005844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24454":{"gid":24454,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6837/1993816527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1993816527},{"type":"v1","addr":"172.21.15.153:6837","nonce":1993816527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24473":{"gid":24473,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":59,"addr":"172.21.15.145:6835/3104241497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":3104241497},{"type":"v1","addr":"172.21.15.145:6835","nonce":3104241497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24494":{"gid":24494,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.145:6837/2687798317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2687798317},{"type":"v1","addr":"172.21.15.145:6837","nonce":2687798317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6839/3886435411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3886435411},{"type":"v1","addr":"172.21.15.145:6839","nonce":3886435411}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_25600":{"gid":25600,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6839/2714928335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":2714928335},{"type":"v1","addr":"172.21.15.153:6839","nonce":2714928335}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-01T07:06:21.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.387+0000 7f832b904700 1 -- 172.21.15.83:0/2280119352 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f83100a1290 msgr2=0x7f83100a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:21.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.387+0000 7f832b904700 1 --2- 172.21.15.83:0/2280119352 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f83100a1290 0x7f83100a3750 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f832000abd0 tx=0x7f832000a380 comp rx=0 tx=0).stop 2024-04-01T07:06:21.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.388+0000 7f832b904700 1 -- 172.21.15.83:0/2280119352 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83241004a0 msgr2=0x7f8324196430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:21.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.388+0000 7f832b904700 1 --2- 172.21.15.83:0/2280119352 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83241004a0 0x7f8324196430 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f83140098e0 tx=0x7f831400f670 comp rx=0 tx=0).stop 2024-04-01T07:06:21.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.388+0000 7f832b904700 1 -- 172.21.15.83:0/2280119352 shutdown_connections 2024-04-01T07:06:21.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.388+0000 7f832b904700 1 --2- 172.21.15.83:0/2280119352 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f83100a1290 0x7f83100a3750 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:21.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.388+0000 7f832b904700 1 --2- 172.21.15.83:0/2280119352 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8324105b80 0x7f832419a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:21.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.388+0000 7f832b904700 1 --2- 172.21.15.83:0/2280119352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83240ffae0 0x7f8324195ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:21.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.388+0000 7f832b904700 1 --2- 172.21.15.83:0/2280119352 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83241004a0 0x7f8324196430 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:21.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.388+0000 7f832b904700 1 -- 172.21.15.83:0/2280119352 >> 172.21.15.83:0/2280119352 conn(0x7f83240fb5f0 msgr2=0x7f83240fbc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T07:06:21.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.388+0000 7f832b904700 1 -- 172.21.15.83:0/2280119352 shutdown_connections 2024-04-01T07:06:21.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.388+0000 7f832b904700 1 -- 172.21.15.83:0/2280119352 wait complete. 2024-04-01T07:06:21.389 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 40 2024-04-01T07:06:21.400 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-01T07:06:21.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.521+0000 7f65328f3700 1 -- 172.21.15.83:0/4220539 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f652c101db0 msgr2=0x7f652c102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:21.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.521+0000 7f65328f3700 1 --2- 172.21.15.83:0/4220539 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f652c101db0 0x7f652c102190 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f651c009990 tx=0x7f651c009ca0 comp rx=0 tx=0).stop 2024-04-01T07:06:21.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.521+0000 7f65328f3700 1 -- 172.21.15.83:0/4220539 shutdown_connections 2024-04-01T07:06:21.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.521+0000 7f65328f3700 1 --2- 172.21.15.83:0/4220539 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f652c101db0 0x7f652c102190 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:21.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.521+0000 7f65328f3700 1 --2- 172.21.15.83:0/4220539 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f652c10b1d0 0x7f652c10d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:21.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.521+0000 7f65328f3700 1 --2- 172.21.15.83:0/4220539 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f652c1026d0 0x7f652c10abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:21.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.521+0000 7f65328f3700 1 -- 172.21.15.83:0/4220539 >> 172.21.15.83:0/4220539 conn(0x7f652c0fb5f0 msgr2=0x7f652c0fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T07:06:21.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.521+0000 7f65328f3700 1 -- 172.21.15.83:0/4220539 shutdown_connections 2024-04-01T07:06:21.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.521+0000 7f65328f3700 1 -- 172.21.15.83:0/4220539 wait complete. 2024-04-01T07:06:21.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.522+0000 7f65328f3700 1 Processor -- start 2024-04-01T07:06:21.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.522+0000 7f65328f3700 1 -- start start 2024-04-01T07:06:21.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.522+0000 7f65328f3700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f652c101db0 0x7f652c197070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:06:21.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.522+0000 7f65328f3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f652c1026d0 0x7f652c1975b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:06:21.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.522+0000 7f65328f3700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f652c10b1d0 0x7f652c19b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:06:21.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.522+0000 7f65328f3700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f652c19bf90 con 0x7f652c101db0 2024-04-01T07:06:21.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.522+0000 7f65328f3700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f652c19c100 con 0x7f652c10b1d0 2024-04-01T07:06:21.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.522+0000 7f65328f3700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f652c19c2c0 con 0x7f652c1026d0 2024-04-01T07:06:21.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.522+0000 7f652bfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f652c101db0 0x7f652c197070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:06:21.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.522+0000 7f652bfff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f652c101db0 0x7f652c197070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59302/0 (socket says 172.21.15.83:59302) 2024-04-01T07:06:21.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.522+0000 7f652bfff700 1 -- 172.21.15.83:0/1998198762 learned_addr learned my addr 172.21.15.83:0/1998198762 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T07:06:21.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.522+0000 7f652b7fe700 1 --2- 172.21.15.83:0/1998198762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f652c1026d0 0x7f652c1975b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:06:21.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.522+0000 7f6530e90700 1 --2- 172.21.15.83:0/1998198762 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f652c10b1d0 0x7f652c19b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:06:21.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.522+0000 7f652bfff700 1 -- 172.21.15.83:0/1998198762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f652c1026d0 msgr2=0x7f652c1975b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:21.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.522+0000 7f652bfff700 1 --2- 172.21.15.83:0/1998198762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f652c1026d0 0x7f652c1975b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:21.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.522+0000 7f652bfff700 1 -- 172.21.15.83:0/1998198762 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f652c10b1d0 msgr2=0x7f652c19b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:21.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.522+0000 7f652bfff700 1 --2- 172.21.15.83:0/1998198762 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f652c10b1d0 0x7f652c19b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:21.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.522+0000 7f652bfff700 1 -- 172.21.15.83:0/1998198762 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f651c0095f0 con 0x7f652c101db0 2024-04-01T07:06:21.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.523+0000 7f652bfff700 1 --2- 172.21.15.83:0/1998198762 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f652c101db0 0x7f652c197070 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f651c0098e0 tx=0x7f651c00f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T07:06:21.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.523+0000 7f65297fa700 1 -- 172.21.15.83:0/1998198762 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f651c01d070 con 0x7f652c101db0 2024-04-01T07:06:21.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.523+0000 7f65328f3700 1 -- 172.21.15.83:0/1998198762 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f652c19c540 con 0x7f652c101db0 2024-04-01T07:06:21.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.523+0000 7f65297fa700 1 -- 172.21.15.83:0/1998198762 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f651c022470 con 0x7f652c101db0 2024-04-01T07:06:21.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.523+0000 7f65297fa700 1 -- 172.21.15.83:0/1998198762 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f651c017650 con 0x7f652c101db0 2024-04-01T07:06:21.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.523+0000 7f65328f3700 1 -- 172.21.15.83:0/1998198762 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f652c1a3de0 con 0x7f652c101db0 2024-04-01T07:06:21.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.524+0000 7f65328f3700 1 -- 172.21.15.83:0/1998198762 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f652c106300 con 0x7f652c101db0 2024-04-01T07:06:21.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.525+0000 7f65297fa700 1 -- 172.21.15.83:0/1998198762 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 25) v1 ==== 135996+0+0 (secure 0 0 0) 0x7f651c0225e0 con 0x7f652c101db0 2024-04-01T07:06:21.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.525+0000 7f65297fa700 1 --2- 172.21.15.83:0/1998198762 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f65140a1290 0x7f65140a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:06:21.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.525+0000 7f652b7fe700 1 --2- 172.21.15.83:0/1998198762 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f65140a1290 0x7f65140a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:06:21.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.525+0000 7f65297fa700 1 -- 172.21.15.83:0/1998198762 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f651c0cdfe0 con 0x7f652c101db0 2024-04-01T07:06:21.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.526+0000 7f652b7fe700 1 --2- 172.21.15.83:0/1998198762 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f65140a1290 0x7f65140a3750 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f652c1985c0 tx=0x7f652000b360 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T07:06:21.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.528+0000 7f65297fa700 1 -- 172.21.15.83:0/1998198762 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f651c097610 con 0x7f652c101db0 2024-04-01T07:06:21.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.770+0000 7f65328f3700 1 -- 172.21.15.83:0/1998198762 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f652c0686d0 con 0x7f652c101db0 2024-04-01T07:06:21.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.770+0000 7f65297fa700 1 -- 172.21.15.83:0/1998198762 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+10877 (secure 0 0 0) 0x7f651c09ac30 con 0x7f652c101db0 2024-04-01T07:06:21.770 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T07:06:21.771 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":40,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1271130478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1271130478},{"type":"v1","addr":"172.21.15.83:6835","nonce":1271130478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2412682983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2412682983},{"type":"v1","addr":"172.21.15.83:6837","nonce":2412682983}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6839/3348145990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":3348145990},{"type":"v1","addr":"172.21.15.83:6839","nonce":3348145990}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6841/1191267445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6840","nonce":1191267445},{"type":"v1","addr":"172.21.15.83:6841","nonce":1191267445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24427,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2467459028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2467459028},{"type":"v1","addr":"172.21.15.153:6833","nonce":2467459028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24448,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4092629042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":4092629042},{"type":"v1","addr":"172.21.15.153:6835","nonce":4092629042}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":40,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-01T06:54:28.397062+0000","modified":"2024-04-01T07:02:07.823075+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24524,"mds_1":24494,"mds_2":24473},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24449":{"gid":24449,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6833/647005844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":647005844},{"type":"v1","addr":"172.21.15.145:6833","nonce":647005844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24454":{"gid":24454,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6837/1993816527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1993816527},{"type":"v1","addr":"172.21.15.153:6837","nonce":1993816527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24473":{"gid":24473,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":59,"addr":"172.21.15.145:6835/3104241497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":3104241497},{"type":"v1","addr":"172.21.15.145:6835","nonce":3104241497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24494":{"gid":24494,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.145:6837/2687798317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":2687798317},{"type":"v1","addr":"172.21.15.145:6837","nonce":2687798317}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.145:6839/3886435411","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":3886435411},{"type":"v1","addr":"172.21.15.145:6839","nonce":3886435411}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_25600":{"gid":25600,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6839/2714928335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":2714928335},{"type":"v1","addr":"172.21.15.153:6839","nonce":2714928335}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-01T07:06:21.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.772+0000 7f65328f3700 1 -- 172.21.15.83:0/1998198762 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f65140a1290 msgr2=0x7f65140a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:21.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.772+0000 7f65328f3700 1 --2- 172.21.15.83:0/1998198762 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f65140a1290 0x7f65140a3750 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f652c1985c0 tx=0x7f652000b360 comp rx=0 tx=0).stop 2024-04-01T07:06:21.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.772+0000 7f65328f3700 1 -- 172.21.15.83:0/1998198762 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f652c101db0 msgr2=0x7f652c197070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:21.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.772+0000 7f65328f3700 1 --2- 172.21.15.83:0/1998198762 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f652c101db0 0x7f652c197070 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f651c0098e0 tx=0x7f651c00f670 comp rx=0 tx=0).stop 2024-04-01T07:06:21.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.772+0000 7f65328f3700 1 -- 172.21.15.83:0/1998198762 shutdown_connections 2024-04-01T07:06:21.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.772+0000 7f65328f3700 1 --2- 172.21.15.83:0/1998198762 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f65140a1290 0x7f65140a3750 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:21.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.772+0000 7f65328f3700 1 --2- 172.21.15.83:0/1998198762 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f652c101db0 0x7f652c197070 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:21.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.772+0000 7f65328f3700 1 --2- 172.21.15.83:0/1998198762 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f652c10b1d0 0x7f652c19b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:21.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.772+0000 7f65328f3700 1 --2- 172.21.15.83:0/1998198762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f652c1026d0 0x7f652c1975b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:21.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.773+0000 7f65328f3700 1 -- 172.21.15.83:0/1998198762 >> 172.21.15.83:0/1998198762 conn(0x7f652c0fb5f0 msgr2=0x7f652c0fcfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T07:06:21.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.773+0000 7f65328f3700 1 -- 172.21.15.83:0/1998198762 shutdown_connections 2024-04-01T07:06:21.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.773+0000 7f65328f3700 1 -- 172.21.15.83:0/1998198762 wait complete. 2024-04-01T07:06:21.774 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 40 2024-04-01T07:06:21.785 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-01T07:06:21.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.908+0000 7f64ed749700 1 -- 172.21.15.83:0/563950340 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64e81004a0 msgr2=0x7f64e810c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:21.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.908+0000 7f64ed749700 1 --2- 172.21.15.83:0/563950340 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64e81004a0 0x7f64e810c9b0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f64e000b0a0 tx=0x7f64e000b3b0 comp rx=0 tx=0).stop 2024-04-01T07:06:21.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.908+0000 7f64ed749700 1 -- 172.21.15.83:0/563950340 shutdown_connections 2024-04-01T07:06:21.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.908+0000 7f64ed749700 1 --2- 172.21.15.83:0/563950340 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64e81004a0 0x7f64e810c9b0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:21.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.908+0000 7f64ed749700 1 --2- 172.21.15.83:0/563950340 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f64e8105b80 0x7f64e8105f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:21.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.908+0000 7f64ed749700 1 --2- 172.21.15.83:0/563950340 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64e80ffae0 0x7f64e80fff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:21.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.908+0000 7f64ed749700 1 -- 172.21.15.83:0/563950340 >> 172.21.15.83:0/563950340 conn(0x7f64e80fb5f0 msgr2=0x7f64e80fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T07:06:21.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.908+0000 7f64ed749700 1 -- 172.21.15.83:0/563950340 shutdown_connections 2024-04-01T07:06:21.910 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.908+0000 7f64ed749700 1 -- 172.21.15.83:0/563950340 wait complete. 2024-04-01T07:06:21.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.908+0000 7f64ed749700 1 Processor -- start 2024-04-01T07:06:21.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.909+0000 7f64ed749700 1 -- start start 2024-04-01T07:06:21.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.909+0000 7f64ed749700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f64e80ffae0 0x7f64e8197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:06:21.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.909+0000 7f64ed749700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64e81004a0 0x7f64e8198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:06:21.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.909+0000 7f64ed749700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64e8105b80 0x7f64e81a2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:06:21.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.909+0000 7f64ed749700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e8198bb0 con 0x7f64e8105b80 2024-04-01T07:06:21.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.909+0000 7f64ed749700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e81a33c0 con 0x7f64e80ffae0 2024-04-01T07:06:21.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.909+0000 7f64ed749700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e81a3500 con 0x7f64e81004a0 2024-04-01T07:06:21.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.909+0000 7f64e77fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64e8105b80 0x7f64e81a2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:06:21.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.909+0000 7f64e77fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64e8105b80 0x7f64e81a2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59314/0 (socket says 172.21.15.83:59314) 2024-04-01T07:06:21.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.909+0000 7f64e77fe700 1 -- 172.21.15.83:0/1817818904 learned_addr learned my addr 172.21.15.83:0/1817818904 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T07:06:21.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.909+0000 7f64e67fc700 1 --2- 172.21.15.83:0/1817818904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64e81004a0 0x7f64e8198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:06:21.914 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.909+0000 7f64e77fe700 1 -- 172.21.15.83:0/1817818904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64e81004a0 msgr2=0x7f64e8198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:21.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.909+0000 7f64e6ffd700 1 --2- 172.21.15.83:0/1817818904 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f64e80ffae0 0x7f64e8197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:06:21.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.909+0000 7f64e77fe700 1 --2- 172.21.15.83:0/1817818904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64e81004a0 0x7f64e8198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:21.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.909+0000 7f64e77fe700 1 -- 172.21.15.83:0/1817818904 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f64e80ffae0 msgr2=0x7f64e8197e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:21.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.909+0000 7f64e77fe700 1 --2- 172.21.15.83:0/1817818904 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f64e80ffae0 0x7f64e8197e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:21.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.909+0000 7f64e77fe700 1 -- 172.21.15.83:0/1817818904 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e0009d00 con 0x7f64e8105b80 2024-04-01T07:06:21.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.909+0000 7f64e77fe700 1 --2- 172.21.15.83:0/1817818904 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64e8105b80 0x7f64e81a2e80 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f64e000b070 tx=0x7f64e0007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T07:06:21.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.909+0000 7f64cffff700 1 -- 172.21.15.83:0/1817818904 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e000e040 con 0x7f64e8105b80 2024-04-01T07:06:21.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.910+0000 7f64ed749700 1 -- 172.21.15.83:0/1817818904 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64e81a3730 con 0x7f64e8105b80 2024-04-01T07:06:21.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.910+0000 7f64cffff700 1 -- 172.21.15.83:0/1817818904 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f64e0004e60 con 0x7f64e8105b80 2024-04-01T07:06:21.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.910+0000 7f64cffff700 1 -- 172.21.15.83:0/1817818904 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e00052a0 con 0x7f64e8105b80 2024-04-01T07:06:21.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.910+0000 7f64ed749700 1 -- 172.21.15.83:0/1817818904 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64e81a3c00 con 0x7f64e8105b80 2024-04-01T07:06:21.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.910+0000 7f64ed749700 1 -- 172.21.15.83:0/1817818904 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64e8108100 con 0x7f64e8105b80 2024-04-01T07:06:21.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.912+0000 7f64cffff700 1 -- 172.21.15.83:0/1817818904 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 25) v1 ==== 135996+0+0 (secure 0 0 0) 0x7f64e001d470 con 0x7f64e8105b80 2024-04-01T07:06:21.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.913+0000 7f64cffff700 1 --2- 172.21.15.83:0/1817818904 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f64d00a1290 0x7f64d00a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:06:21.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.913+0000 7f64cffff700 1 -- 172.21.15.83:0/1817818904 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f64e00cebd0 con 0x7f64e8105b80 2024-04-01T07:06:21.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.913+0000 7f64e6ffd700 1 --2- 172.21.15.83:0/1817818904 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f64d00a1290 0x7f64d00a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:06:21.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.913+0000 7f64e6ffd700 1 --2- 172.21.15.83:0/1817818904 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f64d00a1290 0x7f64d00a3750 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f64dc009b10 tx=0x7f64dc009260 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T07:06:21.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:21.916+0000 7f64cffff700 1 -- 172.21.15.83:0/1817818904 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f64e0098080 con 0x7f64e8105b80 2024-04-01T07:06:22.124 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.124+0000 7f64ed749700 1 -- 172.21.15.83:0/1817818904 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f64e80683b0 con 0x7f64e8105b80 2024-04-01T07:06:22.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.125+0000 7f64cffff700 1 -- 172.21.15.83:0/1817818904 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+22954 (secure 0 0 0) 0x7f64e009b6a0 con 0x7f64e8105b80 2024-04-01T07:06:22.126 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-04-01T07:06:22.126 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":92,"fsid":"c6f8eff4-eff3-11ee-b647-cb9ed24678a4","created":"2024-04-01T06:48:42.033382+0000","modified":"2024-04-01T07:06:10.859673+0000","last_up_change":"2024-04-01T06:53:55.791339+0000","last_in_change":"2024-04-01T06:53:39.777214+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-01T06:51:21.963996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-01T06:54:26.450403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-01T06:54:27.564928+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":16,"snap_epoch":91,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"90b761b0-b06c-4142-854d-38ee42aa6052","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6803","nonce":3253845390}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6805","nonce":3253845390}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6809","nonce":3253845390}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":3253845390},{"type":"v1","addr":"172.21.15.83:6807","nonce":3253845390}]},"public_addr":"172.21.15.83:6803/3253845390","cluster_addr":"172.21.15.83:6805/3253845390","heartbeat_back_addr":"172.21.15.83:6809/3253845390","heartbeat_front_addr":"172.21.15.83:6807/3253845390","state":["exists","up"]},{"osd":1,"uuid":"4d6ab85b-7088-451e-a829-c9119f35dee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6801","nonce":515889759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6803","nonce":515889759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6807","nonce":515889759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":515889759},{"type":"v1","addr":"172.21.15.145:6805","nonce":515889759}]},"public_addr":"172.21.15.145:6801/515889759","cluster_addr":"172.21.15.145:6803/515889759","heartbeat_back_addr":"172.21.15.145:6807/515889759","heartbeat_front_addr":"172.21.15.145:6805/515889759","state":["exists","up"]},{"osd":2,"uuid":"d04c27f3-4972-4061-8bfb-5060645e3883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6801","nonce":3318516728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6803","nonce":3318516728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6807","nonce":3318516728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":3318516728},{"type":"v1","addr":"172.21.15.153:6805","nonce":3318516728}]},"public_addr":"172.21.15.153:6801/3318516728","cluster_addr":"172.21.15.153:6803/3318516728","heartbeat_back_addr":"172.21.15.153:6807/3318516728","heartbeat_front_addr":"172.21.15.153:6805/3318516728","state":["exists","up"]},{"osd":3,"uuid":"899b6c90-8f2f-44dd-b807-49594aadb443","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6811","nonce":504690234}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6813","nonce":504690234}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6817","nonce":504690234}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":504690234},{"type":"v1","addr":"172.21.15.83:6815","nonce":504690234}]},"public_addr":"172.21.15.83:6811/504690234","cluster_addr":"172.21.15.83:6813/504690234","heartbeat_back_addr":"172.21.15.83:6817/504690234","heartbeat_front_addr":"172.21.15.83:6815/504690234","state":["exists","up"]},{"osd":4,"uuid":"5071dd81-804e-4358-bfb6-11e718e9cf4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6809","nonce":2099824730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6811","nonce":2099824730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6815","nonce":2099824730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":2099824730},{"type":"v1","addr":"172.21.15.145:6813","nonce":2099824730}]},"public_addr":"172.21.15.145:6809/2099824730","cluster_addr":"172.21.15.145:6811/2099824730","heartbeat_back_addr":"172.21.15.145:6815/2099824730","heartbeat_front_addr":"172.21.15.145:6813/2099824730","state":["exists","up"]},{"osd":5,"uuid":"b8442b71-c26e-467f-b0c3-ea9f636f5a00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6809","nonce":3340941443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6811","nonce":3340941443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6815","nonce":3340941443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":3340941443},{"type":"v1","addr":"172.21.15.153:6813","nonce":3340941443}]},"public_addr":"172.21.15.153:6809/3340941443","cluster_addr":"172.21.15.153:6811/3340941443","heartbeat_back_addr":"172.21.15.153:6815/3340941443","heartbeat_front_addr":"172.21.15.153:6813/3340941443","state":["exists","up"]},{"osd":6,"uuid":"c26bb8cb-ccee-4bfc-91eb-14e1ad8e04df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6819","nonce":2005485079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6821","nonce":2005485079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6825","nonce":2005485079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":2005485079},{"type":"v1","addr":"172.21.15.83:6823","nonce":2005485079}]},"public_addr":"172.21.15.83:6819/2005485079","cluster_addr":"172.21.15.83:6821/2005485079","heartbeat_back_addr":"172.21.15.83:6825/2005485079","heartbeat_front_addr":"172.21.15.83:6823/2005485079","state":["exists","up"]},{"osd":7,"uuid":"a8940da2-0e79-4606-8d1e-d425afbf5753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6817","nonce":3737505059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6819","nonce":3737505059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6823","nonce":3737505059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3737505059},{"type":"v1","addr":"172.21.15.145:6821","nonce":3737505059}]},"public_addr":"172.21.15.145:6817/3737505059","cluster_addr":"172.21.15.145:6819/3737505059","heartbeat_back_addr":"172.21.15.145:6823/3737505059","heartbeat_front_addr":"172.21.15.145:6821/3737505059","state":["exists","up"]},{"osd":8,"uuid":"602d43ac-a189-4da3-9e38-7025d14e0dd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6817","nonce":1031545791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6819","nonce":1031545791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6823","nonce":1031545791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":1031545791},{"type":"v1","addr":"172.21.15.153:6821","nonce":1031545791}]},"public_addr":"172.21.15.153:6817/1031545791","cluster_addr":"172.21.15.153:6819/1031545791","heartbeat_back_addr":"172.21.15.153:6823/1031545791","heartbeat_front_addr":"172.21.15.153:6821/1031545791","state":["exists","up"]},{"osd":9,"uuid":"08b12d27-1247-45e4-9d09-cacc0fce4bd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6827","nonce":3720996673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6829","nonce":3720996673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6833","nonce":3720996673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3720996673},{"type":"v1","addr":"172.21.15.83:6831","nonce":3720996673}]},"public_addr":"172.21.15.83:6827/3720996673","cluster_addr":"172.21.15.83:6829/3720996673","heartbeat_back_addr":"172.21.15.83:6833/3720996673","heartbeat_front_addr":"172.21.15.83:6831/3720996673","state":["exists","up"]},{"osd":10,"uuid":"dd986b50-d68f-446c-9c66-261535880879","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6825","nonce":2671529479}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6827","nonce":2671529479}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6831","nonce":2671529479}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":2671529479},{"type":"v1","addr":"172.21.15.145:6829","nonce":2671529479}]},"public_addr":"172.21.15.145:6825/2671529479","cluster_addr":"172.21.15.145:6827/2671529479","heartbeat_back_addr":"172.21.15.145:6831/2671529479","heartbeat_front_addr":"172.21.15.145:6829/2671529479","state":["exists","up"]},{"osd":11,"uuid":"d20a49cd-6224-4424-8375-46da791d9931","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6825","nonce":2342548429}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6827","nonce":2342548429}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6831","nonce":2342548429}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2342548429},{"type":"v1","addr":"172.21.15.153:6829","nonce":2342548429}]},"public_addr":"172.21.15.153:6825/2342548429","cluster_addr":"172.21.15.153:6827/2342548429","heartbeat_back_addr":"172.21.15.153:6831/2342548429","heartbeat_front_addr":"172.21.15.153:6829/2342548429","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:50:44.539932+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:01.990470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:19.054426+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:36.616393+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:51:53.896705+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:10.667502+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:27.880849+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:52:45.276308+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:02.280615+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:19.555547+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:37.062881+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-01T06:53:54.191589+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.83:0/3082162092":"2024-04-02T06:55:53.508926+0000","172.21.15.83:0/2071592157":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/2222527447":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/785958951":"2024-04-02T06:49:33.656125+0000","172.21.15.83:6801/1644397953":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/690500472":"2024-04-02T06:49:13.456026+0000","172.21.15.83:6800/1644397953":"2024-04-02T06:49:13.456026+0000","172.21.15.83:0/2125339627":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/2596683931":"2024-04-02T06:49:33.656125+0000","172.21.15.83:6801/1867137261":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/4017737477":"2024-04-02T06:55:53.508926+0000","172.21.15.83:6800/3375372052":"2024-04-02T06:55:53.508926+0000","172.21.15.83:0/3245313698":"2024-04-02T06:55:53.508926+0000","172.21.15.83:6801/3375372052":"2024-04-02T06:55:53.508926+0000","172.21.15.83:0/223927839":"2024-04-02T06:55:53.508926+0000","172.21.15.83:6800/1867137261":"2024-04-02T06:49:33.656125+0000","172.21.15.83:0/1365273187":"2024-04-02T06:55:53.508926+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":16,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-01T07:06:22.128 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.128+0000 7f64ed749700 1 -- 172.21.15.83:0/1817818904 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f64d00a1290 msgr2=0x7f64d00a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:22.128 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.128+0000 7f64ed749700 1 --2- 172.21.15.83:0/1817818904 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f64d00a1290 0x7f64d00a3750 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f64dc009b10 tx=0x7f64dc009260 comp rx=0 tx=0).stop 2024-04-01T07:06:22.128 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.128+0000 7f64ed749700 1 -- 172.21.15.83:0/1817818904 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64e8105b80 msgr2=0x7f64e81a2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:22.128 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.128+0000 7f64ed749700 1 --2- 172.21.15.83:0/1817818904 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64e8105b80 0x7f64e81a2e80 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f64e000b070 tx=0x7f64e0007870 comp rx=0 tx=0).stop 2024-04-01T07:06:22.128 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.128+0000 7f64ed749700 1 -- 172.21.15.83:0/1817818904 shutdown_connections 2024-04-01T07:06:22.128 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.128+0000 7f64ed749700 1 --2- 172.21.15.83:0/1817818904 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f64d00a1290 0x7f64d00a3750 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:22.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.128+0000 7f64ed749700 1 --2- 172.21.15.83:0/1817818904 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f64e8105b80 0x7f64e81a2e80 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:22.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.128+0000 7f64ed749700 1 --2- 172.21.15.83:0/1817818904 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f64e80ffae0 0x7f64e8197e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:22.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.128+0000 7f64ed749700 1 --2- 172.21.15.83:0/1817818904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64e81004a0 0x7f64e8198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:22.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.128+0000 7f64ed749700 1 -- 172.21.15.83:0/1817818904 >> 172.21.15.83:0/1817818904 conn(0x7f64e80fb5f0 msgr2=0x7f64e80fbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T07:06:22.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.128+0000 7f64ed749700 1 -- 172.21.15.83:0/1817818904 shutdown_connections 2024-04-01T07:06:22.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.128+0000 7f64ed749700 1 -- 172.21.15.83:0/1817818904 wait complete. 2024-04-01T07:06:22.138 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:21 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/2280119352' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T07:06:22.139 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:21 smithi083 ceph-mon[43429]: pgmap v327: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-01T07:06:22.139 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:21 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/1998198762' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T07:06:22.140 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-01T07:06:22.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:21 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/2280119352' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T07:06:22.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:21 smithi153 ceph-mon[48187]: pgmap v327: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-01T07:06:22.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:21 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/1998198762' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T07:06:22.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:21 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/2280119352' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T07:06:22.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:21 smithi145 ceph-mon[47816]: pgmap v327: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 94 B/s wr, 5 op/s 2024-04-01T07:06:22.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:21 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/1998198762' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-01T07:06:22.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.263+0000 7f08f1eac700 1 -- 172.21.15.83:0/2260808838 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08ec0ffe50 msgr2=0x7f08ec100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:22.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.263+0000 7f08f1eac700 1 --2- 172.21.15.83:0/2260808838 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08ec0ffe50 0x7f08ec100230 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f08dc009990 tx=0x7f08dc009ca0 comp rx=0 tx=0).stop 2024-04-01T07:06:22.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.263+0000 7f08f1eac700 1 -- 172.21.15.83:0/2260808838 shutdown_connections 2024-04-01T07:06:22.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.263+0000 7f08f1eac700 1 --2- 172.21.15.83:0/2260808838 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08ec0ffe50 0x7f08ec100230 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:22.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.263+0000 7f08f1eac700 1 --2- 172.21.15.83:0/2260808838 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f08ec104f60 0x7f08ec10cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:22.263 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.263+0000 7f08f1eac700 1 --2- 172.21.15.83:0/2260808838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08ec100800 0x7f08ec104830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:22.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.263+0000 7f08f1eac700 1 -- 172.21.15.83:0/2260808838 >> 172.21.15.83:0/2260808838 conn(0x7f08ec076d40 msgr2=0x7f08ec077150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T07:06:22.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.263+0000 7f08f1eac700 1 -- 172.21.15.83:0/2260808838 shutdown_connections 2024-04-01T07:06:22.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.263+0000 7f08f1eac700 1 -- 172.21.15.83:0/2260808838 wait complete. 2024-04-01T07:06:22.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.263+0000 7f08f1eac700 1 Processor -- start 2024-04-01T07:06:22.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.264+0000 7f08f1eac700 1 -- start start 2024-04-01T07:06:22.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.264+0000 7f08f1eac700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08ec0ffe50 0x7f08ec199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:06:22.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.264+0000 7f08f1eac700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f08ec104f60 0x7f08ec199970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:06:22.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.264+0000 7f08f1eac700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08ec19dd10 0x7f08ec19e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:06:22.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.264+0000 7f08f1eac700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ec19e790 con 0x7f08ec0ffe50 2024-04-01T07:06:22.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.264+0000 7f08f1eac700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ec19e900 con 0x7f08ec104f60 2024-04-01T07:06:22.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.264+0000 7f08f1eac700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ec19eac0 con 0x7f08ec19dd10 2024-04-01T07:06:22.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.264+0000 7f08eb7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08ec0ffe50 0x7f08ec199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:06:22.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.264+0000 7f08eb7fe700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08ec0ffe50 0x7f08ec199430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59338/0 (socket says 172.21.15.83:59338) 2024-04-01T07:06:22.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.264+0000 7f08eb7fe700 1 -- 172.21.15.83:0/2414391927 learned_addr learned my addr 172.21.15.83:0/2414391927 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T07:06:22.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.264+0000 7f08ebfff700 1 --2- 172.21.15.83:0/2414391927 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08ec19dd10 0x7f08ec19e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:06:22.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.264+0000 7f08eaffd700 1 --2- 172.21.15.83:0/2414391927 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f08ec104f60 0x7f08ec199970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:06:22.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.264+0000 7f08eb7fe700 1 -- 172.21.15.83:0/2414391927 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08ec19dd10 msgr2=0x7f08ec19e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:22.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.264+0000 7f08eb7fe700 1 --2- 172.21.15.83:0/2414391927 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08ec19dd10 0x7f08ec19e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:22.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.264+0000 7f08eb7fe700 1 -- 172.21.15.83:0/2414391927 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f08ec104f60 msgr2=0x7f08ec199970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:22.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.264+0000 7f08eb7fe700 1 --2- 172.21.15.83:0/2414391927 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f08ec104f60 0x7f08ec199970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:22.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.264+0000 7f08eb7fe700 1 -- 172.21.15.83:0/2414391927 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08dc0095f0 con 0x7f08ec0ffe50 2024-04-01T07:06:22.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.264+0000 7f08eb7fe700 1 --2- 172.21.15.83:0/2414391927 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08ec0ffe50 0x7f08ec199430 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f08dc005910 tx=0x7f08dc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T07:06:22.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.265+0000 7f08e8ff9700 1 -- 172.21.15.83:0/2414391927 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08dc01d070 con 0x7f08ec0ffe50 2024-04-01T07:06:22.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.265+0000 7f08e8ff9700 1 -- 172.21.15.83:0/2414391927 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f08dc00fb30 con 0x7f08ec0ffe50 2024-04-01T07:06:22.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.265+0000 7f08e8ff9700 1 -- 172.21.15.83:0/2414391927 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08dc022c50 con 0x7f08ec0ffe50 2024-04-01T07:06:22.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.265+0000 7f08f1eac700 1 -- 172.21.15.83:0/2414391927 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08ec1a5fc0 con 0x7f08ec0ffe50 2024-04-01T07:06:22.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.265+0000 7f08f1eac700 1 -- 172.21.15.83:0/2414391927 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08ec1a6330 con 0x7f08ec0ffe50 2024-04-01T07:06:22.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.266+0000 7f08f1eac700 1 -- 172.21.15.83:0/2414391927 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08ec102fa0 con 0x7f08ec0ffe50 2024-04-01T07:06:22.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.267+0000 7f08e8ff9700 1 -- 172.21.15.83:0/2414391927 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 25) v1 ==== 135996+0+0 (secure 0 0 0) 0x7f08dc00fca0 con 0x7f08ec0ffe50 2024-04-01T07:06:22.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.267+0000 7f08e8ff9700 1 --2- 172.21.15.83:0/2414391927 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f08d40a1290 0x7f08d40a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:06:22.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.268+0000 7f08eaffd700 1 --2- 172.21.15.83:0/2414391927 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f08d40a1290 0x7f08d40a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:06:22.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.268+0000 7f08e8ff9700 1 -- 172.21.15.83:0/2414391927 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f08dc0ce510 con 0x7f08ec0ffe50 2024-04-01T07:06:22.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.268+0000 7f08eaffd700 1 --2- 172.21.15.83:0/2414391927 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f08d40a1290 0x7f08d40a3750 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f08ec19a980 tx=0x7f08e000b410 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T07:06:22.271 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.271+0000 7f08e8ff9700 1 -- 172.21.15.83:0/2414391927 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f08dc0979c0 con 0x7f08ec0ffe50 2024-04-01T07:06:22.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.514+0000 7f08f1eac700 1 -- 172.21.15.83:0/2414391927 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f08ec101310 con 0x7f08ec0ffe50 2024-04-01T07:06:22.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.527+0000 7f08e8ff9700 1 -- 172.21.15.83:0/2414391927 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v41) v1 ==== 161+0+0 (secure 0 0 0) 0x7f08dc09afe0 con 0x7f08ec0ffe50 2024-04-01T07:06:22.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.529+0000 7f08f1eac700 1 -- 172.21.15.83:0/2414391927 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f08d40a1290 msgr2=0x7f08d40a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:22.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.529+0000 7f08f1eac700 1 --2- 172.21.15.83:0/2414391927 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f08d40a1290 0x7f08d40a3750 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f08ec19a980 tx=0x7f08e000b410 comp rx=0 tx=0).stop 2024-04-01T07:06:22.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.529+0000 7f08f1eac700 1 -- 172.21.15.83:0/2414391927 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08ec0ffe50 msgr2=0x7f08ec199430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:22.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.529+0000 7f08f1eac700 1 --2- 172.21.15.83:0/2414391927 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08ec0ffe50 0x7f08ec199430 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f08dc005910 tx=0x7f08dc004730 comp rx=0 tx=0).stop 2024-04-01T07:06:22.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.529+0000 7f08f1eac700 1 -- 172.21.15.83:0/2414391927 shutdown_connections 2024-04-01T07:06:22.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.529+0000 7f08f1eac700 1 --2- 172.21.15.83:0/2414391927 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f08d40a1290 0x7f08d40a3750 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:22.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.529+0000 7f08f1eac700 1 --2- 172.21.15.83:0/2414391927 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08ec0ffe50 0x7f08ec199430 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:22.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.529+0000 7f08f1eac700 1 --2- 172.21.15.83:0/2414391927 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08ec19dd10 0x7f08ec19e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:22.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.529+0000 7f08f1eac700 1 --2- 172.21.15.83:0/2414391927 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f08ec104f60 0x7f08ec199970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:22.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.529+0000 7f08f1eac700 1 -- 172.21.15.83:0/2414391927 >> 172.21.15.83:0/2414391927 conn(0x7f08ec076d40 msgr2=0x7f08ec0fee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T07:06:22.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.529+0000 7f08f1eac700 1 -- 172.21.15.83:0/2414391927 shutdown_connections 2024-04-01T07:06:22.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.529+0000 7f08f1eac700 1 -- 172.21.15.83:0/2414391927 wait complete. 2024-04-01T07:06:22.530 INFO:teuthology.orchestra.run.smithi083.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-01T07:06:22.541 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-01T07:06:22.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.669+0000 7febeb175700 1 -- 172.21.15.83:0/1912666065 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7febe40ffe50 msgr2=0x7febe4100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:22.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.669+0000 7febeb175700 1 --2- 172.21.15.83:0/1912666065 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7febe40ffe50 0x7febe4100230 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7febd8009990 tx=0x7febd8009ca0 comp rx=0 tx=0).stop 2024-04-01T07:06:22.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.669+0000 7febeb175700 1 -- 172.21.15.83:0/1912666065 shutdown_connections 2024-04-01T07:06:22.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.669+0000 7febeb175700 1 --2- 172.21.15.83:0/1912666065 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7febe40ffe50 0x7febe4100230 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:22.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.669+0000 7febeb175700 1 --2- 172.21.15.83:0/1912666065 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febe4104f60 0x7febe410cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:22.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.669+0000 7febeb175700 1 --2- 172.21.15.83:0/1912666065 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7febe4100800 0x7febe4104830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:22.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.669+0000 7febeb175700 1 -- 172.21.15.83:0/1912666065 >> 172.21.15.83:0/1912666065 conn(0x7febe4076d40 msgr2=0x7febe4077150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T07:06:22.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.669+0000 7febeb175700 1 -- 172.21.15.83:0/1912666065 shutdown_connections 2024-04-01T07:06:22.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.669+0000 7febeb175700 1 -- 172.21.15.83:0/1912666065 wait complete. 2024-04-01T07:06:22.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.670+0000 7febeb175700 1 Processor -- start 2024-04-01T07:06:22.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.670+0000 7febeb175700 1 -- start start 2024-04-01T07:06:22.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.670+0000 7febeb175700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7febe40ffe50 0x7febe4197260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:06:22.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.670+0000 7febeb175700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7febe4104f60 0x7febe41977a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:06:22.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.670+0000 7febeb175700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febe419baf0 0x7febe419bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:06:22.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.670+0000 7febeb175700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe419c570 con 0x7febe4104f60 2024-04-01T07:06:22.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.670+0000 7febeb175700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe419c6e0 con 0x7febe40ffe50 2024-04-01T07:06:22.672 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.670+0000 7febeb175700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe419c8a0 con 0x7febe419baf0 2024-04-01T07:06:22.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.670+0000 7febe3fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7febe4104f60 0x7febe41977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:06:22.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.670+0000 7febe3fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7febe4104f60 0x7febe41977a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59344/0 (socket says 172.21.15.83:59344) 2024-04-01T07:06:22.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.670+0000 7febe3fff700 1 -- 172.21.15.83:0/2065345690 learned_addr learned my addr 172.21.15.83:0/2065345690 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T07:06:22.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.670+0000 7febe8f11700 1 --2- 172.21.15.83:0/2065345690 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7febe40ffe50 0x7febe4197260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:06:22.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.670+0000 7febe9712700 1 --2- 172.21.15.83:0/2065345690 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febe419baf0 0x7febe419bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:06:22.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.670+0000 7febe3fff700 1 -- 172.21.15.83:0/2065345690 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febe419baf0 msgr2=0x7febe419bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:22.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.670+0000 7febe3fff700 1 --2- 172.21.15.83:0/2065345690 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febe419baf0 0x7febe419bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:22.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.670+0000 7febe3fff700 1 -- 172.21.15.83:0/2065345690 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7febe40ffe50 msgr2=0x7febe4197260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:22.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.670+0000 7febe3fff700 1 --2- 172.21.15.83:0/2065345690 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7febe40ffe50 0x7febe4197260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:22.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.670+0000 7febe3fff700 1 -- 172.21.15.83:0/2065345690 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd80095f0 con 0x7febe4104f60 2024-04-01T07:06:22.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.671+0000 7febe3fff700 1 --2- 172.21.15.83:0/2065345690 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7febe4104f60 0x7febe41977a0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7febd000d980 tx=0x7febd000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T07:06:22.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.671+0000 7febe1ffb700 1 -- 172.21.15.83:0/2065345690 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd000f890 con 0x7febe4104f60 2024-04-01T07:06:22.673 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.671+0000 7febe1ffb700 1 -- 172.21.15.83:0/2065345690 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7febd0010460 con 0x7febe4104f60 2024-04-01T07:06:22.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.671+0000 7febe1ffb700 1 -- 172.21.15.83:0/2065345690 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd000e610 con 0x7febe4104f60 2024-04-01T07:06:22.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.671+0000 7febeb175700 1 -- 172.21.15.83:0/2065345690 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febe41a3e00 con 0x7febe4104f60 2024-04-01T07:06:22.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.671+0000 7febeb175700 1 -- 172.21.15.83:0/2065345690 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febe41a4230 con 0x7febe4104f60 2024-04-01T07:06:22.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.672+0000 7febeb175700 1 -- 172.21.15.83:0/2065345690 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febe41091e0 con 0x7febe4104f60 2024-04-01T07:06:22.674 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.673+0000 7febe1ffb700 1 -- 172.21.15.83:0/2065345690 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 25) v1 ==== 135996+0+0 (secure 0 0 0) 0x7febd00105d0 con 0x7febe4104f60 2024-04-01T07:06:22.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.673+0000 7febe1ffb700 1 --2- 172.21.15.83:0/2065345690 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7febd40a1290 0x7febd40a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:06:22.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.674+0000 7febe8f11700 1 --2- 172.21.15.83:0/2065345690 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7febd40a1290 0x7febd40a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:06:22.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.674+0000 7febe1ffb700 1 -- 172.21.15.83:0/2065345690 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8683+0+0 (secure 0 0 0) 0x7febd00cc770 con 0x7febe4104f60 2024-04-01T07:06:22.675 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.674+0000 7febe8f11700 1 --2- 172.21.15.83:0/2065345690 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7febd40a1290 0x7febd40a3750 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7febd800b5c0 tx=0x7febd8005960 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T07:06:22.677 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.678+0000 7febe1ffb700 1 -- 172.21.15.83:0/2065345690 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7febd0095b20 con 0x7febe4104f60 2024-04-01T07:06:22.880 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:22 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mon-a[43406]: 2024-04-01T07:06:22.515+0000 7fc4c002a700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-01T07:06:22.881 INFO:journalctl@ceph.mds.b.smithi145.stdout:Apr 01 07:06:22 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-b[84548]: ignoring --setuser ceph since I am not root 2024-04-01T07:06:22.881 INFO:journalctl@ceph.mds.b.smithi145.stdout:Apr 01 07:06:22 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-b[84548]: ignoring --setgroup ceph since I am not root 2024-04-01T07:06:22.881 INFO:journalctl@ceph.mds.b.smithi145.stdout:Apr 01 07:06:22 smithi145 ceph-mds[84571]: -- 172.21.15.145:0/4064610984 <== mon.0 v2:172.21.15.83:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e52ce161a0 con 0x55e52cdec800 2024-04-01T07:06:22.881 INFO:journalctl@ceph.mds.b.smithi145.stdout:Apr 01 07:06:22 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-b[84548]: starting mds.b at 2024-04-01T07:06:22.881 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 07:06:22 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: ignoring --setuser ceph since I am not root 2024-04-01T07:06:22.882 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 07:06:22 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: ignoring --setgroup ceph since I am not root 2024-04-01T07:06:22.882 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 07:06:22 smithi145 ceph-mds[83883]: -- 172.21.15.145:0/2377969704 <== mon.0 v2:172.21.15.83:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x560e100d01a0 con 0x560e100a7000 2024-04-01T07:06:22.882 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 07:06:22 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: starting mds.e at 2024-04-01T07:06:22.882 INFO:journalctl@ceph.mds.h.smithi145.stdout:Apr 01 07:06:22 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-h[84203]: ignoring --setuser ceph since I am not root 2024-04-01T07:06:22.882 INFO:journalctl@ceph.mds.h.smithi145.stdout:Apr 01 07:06:22 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-h[84203]: ignoring --setgroup ceph since I am not root 2024-04-01T07:06:22.882 INFO:journalctl@ceph.mds.h.smithi145.stdout:Apr 01 07:06:22 smithi145 ceph-mds[84227]: -- 172.21.15.145:0/2993034447 <== mon.1 v2:172.21.15.153:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556b16dcc1a0 con 0x556b16da3000 2024-04-01T07:06:22.883 INFO:journalctl@ceph.mds.h.smithi145.stdout:Apr 01 07:06:22 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-h[84203]: starting mds.h at 2024-04-01T07:06:22.883 INFO:journalctl@ceph.mds.k.smithi145.stdout:Apr 01 07:06:22 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-k[83514]: ignoring --setuser ceph since I am not root 2024-04-01T07:06:22.883 INFO:journalctl@ceph.mds.k.smithi145.stdout:Apr 01 07:06:22 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-k[83514]: ignoring --setgroup ceph since I am not root 2024-04-01T07:06:22.883 INFO:journalctl@ceph.mds.k.smithi145.stdout:Apr 01 07:06:22 smithi145 ceph-mds[83537]: -- 172.21.15.145:0/1475339241 <== mon.1 v2:172.21.15.153:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5637b89b01a0 con 0x5637b8987000 2024-04-01T07:06:22.883 INFO:journalctl@ceph.mds.k.smithi145.stdout:Apr 01 07:06:22 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-k[83514]: starting mds.k at 2024-04-01T07:06:22.884 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 07:06:22 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[88867]: ignoring --setuser ceph since I am not root 2024-04-01T07:06:22.884 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 07:06:22 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[88867]: ignoring --setgroup ceph since I am not root 2024-04-01T07:06:22.884 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 07:06:22 smithi153 ceph-mds[88898]: -- 172.21.15.153:0/3773746992 <== mon.1 v2:172.21.15.153:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d0f27041a0 con 0x55d0f26dac00 2024-04-01T07:06:22.884 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 07:06:22 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[88867]: starting mds.i at 2024-04-01T07:06:22.885 INFO:journalctl@ceph.mds.c.smithi153.stdout:Apr 01 07:06:22 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-c[85342]: ignoring --setuser ceph since I am not root 2024-04-01T07:06:22.885 INFO:journalctl@ceph.mds.c.smithi153.stdout:Apr 01 07:06:22 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-c[85342]: ignoring --setgroup ceph since I am not root 2024-04-01T07:06:22.885 INFO:journalctl@ceph.mds.c.smithi153.stdout:Apr 01 07:06:22 smithi153 ceph-mds[85365]: -- 172.21.15.153:0/2859500002 <== mon.0 v2:172.21.15.83:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a7271361a0 con 0x55a72710cc00 2024-04-01T07:06:22.885 INFO:journalctl@ceph.mds.c.smithi153.stdout:Apr 01 07:06:22 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-c[85342]: starting mds.c at 2024-04-01T07:06:22.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:22.922+0000 7febeb175700 1 -- 172.21.15.83:0/2065345690 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7febe4100800 con 0x7febe4104f60 2024-04-01T07:06:23.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:22 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/1817818904' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T07:06:23.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:22 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/2414391927' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-04-01T07:06:23.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:22 smithi153 ceph-mon[48187]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-01T07:06:23.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:22 smithi153 ceph-mon[48187]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-01T07:06:23.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:22 smithi153 ceph-mon[48187]: Health check cleared: MDS_DAMAGE (was: 1 MDSs report damaged metadata) 2024-04-01T07:06:23.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:22 smithi153 ceph-mon[48187]: osdmap e93: 12 total, 12 up, 12 in 2024-04-01T07:06:23.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:22 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/2414391927' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-04-01T07:06:23.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:22 smithi153 ceph-mon[48187]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-04-01T07:06:23.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:22 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/1817818904' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T07:06:23.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:22 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/2414391927' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-04-01T07:06:23.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:22 smithi145 ceph-mon[47816]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-01T07:06:23.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:22 smithi145 ceph-mon[47816]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-01T07:06:23.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:22 smithi145 ceph-mon[47816]: Health check cleared: MDS_DAMAGE (was: 1 MDSs report damaged metadata) 2024-04-01T07:06:23.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:22 smithi145 ceph-mon[47816]: osdmap e93: 12 total, 12 up, 12 in 2024-04-01T07:06:23.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:22 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/2414391927' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-04-01T07:06:23.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:22 smithi145 ceph-mon[47816]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-04-01T07:06:23.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:22 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/1817818904' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-01T07:06:23.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:22 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/2414391927' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-04-01T07:06:23.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:22 smithi083 ceph-mon[43429]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-01T07:06:23.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:22 smithi083 ceph-mon[43429]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-01T07:06:23.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:22 smithi083 ceph-mon[43429]: Health check cleared: MDS_DAMAGE (was: 1 MDSs report damaged metadata) 2024-04-01T07:06:23.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:22 smithi083 ceph-mon[43429]: osdmap e93: 12 total, 12 up, 12 in 2024-04-01T07:06:23.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:22 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/2414391927' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-04-01T07:06:23.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:22 smithi083 ceph-mon[43429]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-04-01T07:06:23.529 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:23.529+0000 7febe1ffb700 1 -- 172.21.15.83:0/2065345690 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v42) v1 ==== 104+0+0 (secure 0 0 0) 0x7febd0099140 con 0x7febe4104f60 2024-04-01T07:06:23.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:23.532+0000 7febeb175700 1 -- 172.21.15.83:0/2065345690 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7febd40a1290 msgr2=0x7febd40a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:23.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:23.532+0000 7febeb175700 1 --2- 172.21.15.83:0/2065345690 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7febd40a1290 0x7febd40a3750 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7febd800b5c0 tx=0x7febd8005960 comp rx=0 tx=0).stop 2024-04-01T07:06:23.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:23.532+0000 7febeb175700 1 -- 172.21.15.83:0/2065345690 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7febe4104f60 msgr2=0x7febe41977a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:23.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:23.532+0000 7febeb175700 1 --2- 172.21.15.83:0/2065345690 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7febe4104f60 0x7febe41977a0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7febd000d980 tx=0x7febd000dc90 comp rx=0 tx=0).stop 2024-04-01T07:06:23.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:23.532+0000 7febeb175700 1 -- 172.21.15.83:0/2065345690 shutdown_connections 2024-04-01T07:06:23.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:23.533+0000 7febeb175700 1 --2- 172.21.15.83:0/2065345690 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7febd40a1290 0x7febd40a3750 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:23.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:23.533+0000 7febeb175700 1 --2- 172.21.15.83:0/2065345690 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febe419baf0 0x7febe419bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:23.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:23.533+0000 7febeb175700 1 --2- 172.21.15.83:0/2065345690 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7febe40ffe50 0x7febe4197260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:23.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:23.533+0000 7febeb175700 1 --2- 172.21.15.83:0/2065345690 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7febe4104f60 0x7febe41977a0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:23.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:23.533+0000 7febeb175700 1 -- 172.21.15.83:0/2065345690 >> 172.21.15.83:0/2065345690 conn(0x7febe4076d40 msgr2=0x7febe40681d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T07:06:23.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:23.533+0000 7febeb175700 1 -- 172.21.15.83:0/2065345690 shutdown_connections 2024-04-01T07:06:23.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:23.533+0000 7febeb175700 1 -- 172.21.15.83:0/2065345690 wait complete. 2024-04-01T07:06:23.548 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-01T07:06:23.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:23.680+0000 7f53fea28700 1 -- 172.21.15.83:0/3130720255 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f53f8100d90 msgr2=0x7f53f810cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:23.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:23.680+0000 7f53fea28700 1 --2- 172.21.15.83:0/3130720255 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f53f8100d90 0x7f53f810cab0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f53f000b0d0 tx=0x7f53f000b3e0 comp rx=0 tx=0).stop 2024-04-01T07:06:23.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:23.680+0000 7f53fea28700 1 -- 172.21.15.83:0/3130720255 shutdown_connections 2024-04-01T07:06:23.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:23.680+0000 7f53fea28700 1 --2- 172.21.15.83:0/3130720255 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f53f8100d90 0x7f53f810cab0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:23.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:23.680+0000 7f53fea28700 1 --2- 172.21.15.83:0/3130720255 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f53f8104c20 0x7f53f8105000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:23.680 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:23.680+0000 7f53fea28700 1 --2- 172.21.15.83:0/3130720255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53f81003d0 0x7f53f8100850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:23.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:23.680+0000 7f53fea28700 1 -- 172.21.15.83:0/3130720255 >> 172.21.15.83:0/3130720255 conn(0x7f53f80761e0 msgr2=0x7f53f80fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T07:06:23.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:23.680+0000 7f53fea28700 1 -- 172.21.15.83:0/3130720255 shutdown_connections 2024-04-01T07:06:23.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:23.680+0000 7f53fea28700 1 -- 172.21.15.83:0/3130720255 wait complete. 2024-04-01T07:06:23.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:23.681+0000 7f53fea28700 1 Processor -- start 2024-04-01T07:06:23.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:23.681+0000 7f53fea28700 1 -- start start 2024-04-01T07:06:23.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:23.681+0000 7f53fea28700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f53f81003d0 0x7f53f81960f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:06:23.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:23.681+0000 7f53fea28700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f53f8100d90 0x7f53f8196630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:06:23.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:23.681+0000 7f53fea28700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53f8104c20 0x7f53f819a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:06:23.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:23.681+0000 7f53fea28700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f819b010 con 0x7f53f81003d0 2024-04-01T07:06:23.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:23.681+0000 7f53fea28700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f819b180 con 0x7f53f8100d90 2024-04-01T07:06:23.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:23.681+0000 7f53fea28700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f819b340 con 0x7f53f8104c20 2024-04-01T07:06:23.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:23.681+0000 7f53f7fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f53f81003d0 0x7f53f81960f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:06:23.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:23.681+0000 7f53f7fff700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f53f81003d0 0x7f53f81960f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:41768/0 (socket says 172.21.15.83:41768) 2024-04-01T07:06:23.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:23.681+0000 7f53f7fff700 1 -- 172.21.15.83:0/3797546198 learned_addr learned my addr 172.21.15.83:0/3797546198 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T07:06:23.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:23.681+0000 7f53effff700 1 --2- 172.21.15.83:0/3797546198 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f53f8100d90 0x7f53f8196630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:06:23.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:23.682+0000 7f53fcfc5700 1 --2- 172.21.15.83:0/3797546198 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53f8104c20 0x7f53f819a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:06:23.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:23.682+0000 7f53f7fff700 1 -- 172.21.15.83:0/3797546198 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53f8104c20 msgr2=0x7f53f819a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:23.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:23.682+0000 7f53f7fff700 1 --2- 172.21.15.83:0/3797546198 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53f8104c20 0x7f53f819a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:23.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:23.682+0000 7f53f7fff700 1 -- 172.21.15.83:0/3797546198 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f53f8100d90 msgr2=0x7f53f8196630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:23.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:23.682+0000 7f53f7fff700 1 --2- 172.21.15.83:0/3797546198 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f53f8100d90 0x7f53f8196630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:23.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:23.682+0000 7f53f7fff700 1 -- 172.21.15.83:0/3797546198 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f0009d00 con 0x7f53f81003d0 2024-04-01T07:06:23.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:23.682+0000 7f53effff700 1 --2- 172.21.15.83:0/3797546198 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f53f8100d90 0x7f53f8196630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-01T07:06:23.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:23.682+0000 7f53f7fff700 1 --2- 172.21.15.83:0/3797546198 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f53f81003d0 0x7f53f81960f0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f53e800d950 tx=0x7f53e800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T07:06:23.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:23.682+0000 7f53f5ffb700 1 -- 172.21.15.83:0/3797546198 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e8009b40 con 0x7f53f81003d0 2024-04-01T07:06:23.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:23.682+0000 7f53fea28700 1 -- 172.21.15.83:0/3797546198 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53f819b620 con 0x7f53f81003d0 2024-04-01T07:06:23.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:23.682+0000 7f53f5ffb700 1 -- 172.21.15.83:0/3797546198 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f53e8009ca0 con 0x7f53f81003d0 2024-04-01T07:06:23.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:23.682+0000 7f53f5ffb700 1 -- 172.21.15.83:0/3797546198 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e800f620 con 0x7f53f81003d0 2024-04-01T07:06:23.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:23.682+0000 7f53fea28700 1 -- 172.21.15.83:0/3797546198 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53f81a2e60 con 0x7f53f81003d0 2024-04-01T07:06:23.685 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:23.683+0000 7f53fea28700 1 -- 172.21.15.83:0/3797546198 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53f8108200 con 0x7f53f81003d0 2024-04-01T07:06:23.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:23.684+0000 7f53f5ffb700 1 -- 172.21.15.83:0/3797546198 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 25) v1 ==== 135996+0+0 (secure 0 0 0) 0x7f53e8010460 con 0x7f53f81003d0 2024-04-01T07:06:23.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:23.684+0000 7f53f5ffb700 1 --2- 172.21.15.83:0/3797546198 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f53e40a1290 0x7f53e40a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:06:23.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:23.685+0000 7f53effff700 1 --2- 172.21.15.83:0/3797546198 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f53e40a1290 0x7f53e40a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:06:23.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:23.685+0000 7f53f5ffb700 1 -- 172.21.15.83:0/3797546198 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8683+0+0 (secure 0 0 0) 0x7f53e80cd100 con 0x7f53f81003d0 2024-04-01T07:06:23.686 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:23.685+0000 7f53effff700 1 --2- 172.21.15.83:0/3797546198 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f53e40a1290 0x7f53e40a3750 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f53e0005950 tx=0x7f53e00058e0 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T07:06:23.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:23.689+0000 7f53f5ffb700 1 -- 172.21.15.83:0/3797546198 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7f53e80964b0 con 0x7f53f81003d0 2024-04-01T07:06:23.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:23.890+0000 7f53fea28700 1 -- 172.21.15.83:0/3797546198 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f53f81013e0 con 0x7f53f81003d0 2024-04-01T07:06:24.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:23 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/2065345690' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-04-01T07:06:24.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:23 smithi153 ceph-mon[48187]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-01T07:06:24.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:23 smithi153 ceph-mon[48187]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-01T07:06:24.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:23 smithi153 ceph-mon[48187]: Cluster is now healthy 2024-04-01T07:06:24.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:23 smithi153 ceph-mon[48187]: mds.? [v2:172.21.15.145:6833/4218315593,v1:172.21.15.145:6835/4218315593] up:boot 2024-04-01T07:06:24.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:23 smithi153 ceph-mon[48187]: mds.? [v2:172.21.15.153:6836/2230528783,v1:172.21.15.153:6838/2230528783] up:boot 2024-04-01T07:06:24.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:23 smithi153 ceph-mon[48187]: mds.? [v2:172.21.15.153:6837/3758689510,v1:172.21.15.153:6839/3758689510] up:boot 2024-04-01T07:06:24.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:23 smithi153 ceph-mon[48187]: mds.? [v2:172.21.15.145:6832/57698512,v1:172.21.15.145:6834/57698512] up:boot 2024-04-01T07:06:24.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:23 smithi153 ceph-mon[48187]: mds.? [v2:172.21.15.145:6838/253292420,v1:172.21.15.145:6839/253292420] up:boot 2024-04-01T07:06:24.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:23 smithi153 ceph-mon[48187]: mds.? [v2:172.21.15.145:6836/2896758511,v1:172.21.15.145:6837/2896758511] up:boot 2024-04-01T07:06:24.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:23 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/2065345690' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-04-01T07:06:24.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:23 smithi153 ceph-mon[48187]: fsmap 12 up:standby 2024-04-01T07:06:24.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:23 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-01T07:06:24.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:23 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-01T07:06:24.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:23 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-01T07:06:24.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:23 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-01T07:06:24.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:23 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-01T07:06:24.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:23 smithi153 ceph-mon[48187]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-01T07:06:24.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:23 smithi153 ceph-mon[48187]: pgmap v329: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-01T07:06:24.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:23 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/2065345690' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-04-01T07:06:24.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:23 smithi145 ceph-mon[47816]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-01T07:06:24.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:23 smithi145 ceph-mon[47816]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-01T07:06:24.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:23 smithi145 ceph-mon[47816]: Cluster is now healthy 2024-04-01T07:06:24.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:23 smithi145 ceph-mon[47816]: mds.? [v2:172.21.15.145:6833/4218315593,v1:172.21.15.145:6835/4218315593] up:boot 2024-04-01T07:06:24.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:23 smithi145 ceph-mon[47816]: mds.? [v2:172.21.15.153:6836/2230528783,v1:172.21.15.153:6838/2230528783] up:boot 2024-04-01T07:06:24.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:23 smithi145 ceph-mon[47816]: mds.? [v2:172.21.15.153:6837/3758689510,v1:172.21.15.153:6839/3758689510] up:boot 2024-04-01T07:06:24.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:23 smithi145 ceph-mon[47816]: mds.? [v2:172.21.15.145:6832/57698512,v1:172.21.15.145:6834/57698512] up:boot 2024-04-01T07:06:24.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:23 smithi145 ceph-mon[47816]: mds.? [v2:172.21.15.145:6838/253292420,v1:172.21.15.145:6839/253292420] up:boot 2024-04-01T07:06:24.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:23 smithi145 ceph-mon[47816]: mds.? [v2:172.21.15.145:6836/2896758511,v1:172.21.15.145:6837/2896758511] up:boot 2024-04-01T07:06:24.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:23 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/2065345690' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-04-01T07:06:24.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:23 smithi145 ceph-mon[47816]: fsmap 12 up:standby 2024-04-01T07:06:24.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:23 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-01T07:06:24.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:23 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-01T07:06:24.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:23 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-01T07:06:24.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:23 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-01T07:06:24.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:23 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-01T07:06:24.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:23 smithi145 ceph-mon[47816]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-01T07:06:24.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:23 smithi145 ceph-mon[47816]: pgmap v329: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-01T07:06:24.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:23 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/2065345690' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-04-01T07:06:24.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:23 smithi083 ceph-mon[43429]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-01T07:06:24.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:23 smithi083 ceph-mon[43429]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-01T07:06:24.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:23 smithi083 ceph-mon[43429]: Cluster is now healthy 2024-04-01T07:06:24.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:23 smithi083 ceph-mon[43429]: mds.? [v2:172.21.15.145:6833/4218315593,v1:172.21.15.145:6835/4218315593] up:boot 2024-04-01T07:06:24.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:23 smithi083 ceph-mon[43429]: mds.? [v2:172.21.15.153:6836/2230528783,v1:172.21.15.153:6838/2230528783] up:boot 2024-04-01T07:06:24.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:23 smithi083 ceph-mon[43429]: mds.? [v2:172.21.15.153:6837/3758689510,v1:172.21.15.153:6839/3758689510] up:boot 2024-04-01T07:06:24.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:23 smithi083 ceph-mon[43429]: mds.? [v2:172.21.15.145:6832/57698512,v1:172.21.15.145:6834/57698512] up:boot 2024-04-01T07:06:24.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:23 smithi083 ceph-mon[43429]: mds.? [v2:172.21.15.145:6838/253292420,v1:172.21.15.145:6839/253292420] up:boot 2024-04-01T07:06:24.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:23 smithi083 ceph-mon[43429]: mds.? [v2:172.21.15.145:6836/2896758511,v1:172.21.15.145:6837/2896758511] up:boot 2024-04-01T07:06:24.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:23 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/2065345690' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-04-01T07:06:24.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:23 smithi083 ceph-mon[43429]: fsmap 12 up:standby 2024-04-01T07:06:24.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:23 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-01T07:06:24.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:23 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-01T07:06:24.264 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:23 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-01T07:06:24.264 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:23 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-01T07:06:24.264 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:23 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-01T07:06:24.264 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:23 smithi083 ceph-mon[43429]: from='mgr.15420 172.21.15.83:0/1007566042' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-01T07:06:24.264 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:23 smithi083 ceph-mon[43429]: pgmap v329: 97 pgs: 97 active+clean; 93 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-04-01T07:06:24.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:24.890+0000 7f53f5ffb700 1 -- 172.21.15.83:0/3797546198 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v94) v1 ==== 181+0+0 (secure 0 0 0) 0x7f53e8099ad0 con 0x7f53f81003d0 2024-04-01T07:06:24.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:24.894+0000 7f53fea28700 1 -- 172.21.15.83:0/3797546198 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f53e40a1290 msgr2=0x7f53e40a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:24.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:24.894+0000 7f53fea28700 1 --2- 172.21.15.83:0/3797546198 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f53e40a1290 0x7f53e40a3750 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f53e0005950 tx=0x7f53e00058e0 comp rx=0 tx=0).stop 2024-04-01T07:06:24.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:24.894+0000 7f53fea28700 1 -- 172.21.15.83:0/3797546198 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f53f81003d0 msgr2=0x7f53f81960f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:24.894 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:24.894+0000 7f53fea28700 1 --2- 172.21.15.83:0/3797546198 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f53f81003d0 0x7f53f81960f0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f53e800d950 tx=0x7f53e800dd10 comp rx=0 tx=0).stop 2024-04-01T07:06:24.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:24.895+0000 7f53fea28700 1 -- 172.21.15.83:0/3797546198 shutdown_connections 2024-04-01T07:06:24.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:24.895+0000 7f53fea28700 1 --2- 172.21.15.83:0/3797546198 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7f53e40a1290 0x7f53e40a3750 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:24.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:24.895+0000 7f53fea28700 1 --2- 172.21.15.83:0/3797546198 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f53f81003d0 0x7f53f81960f0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:24.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:24.895+0000 7f53fea28700 1 --2- 172.21.15.83:0/3797546198 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53f8104c20 0x7f53f819a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:24.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:24.895+0000 7f53fea28700 1 --2- 172.21.15.83:0/3797546198 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f53f8100d90 0x7f53f8196630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:24.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:24.895+0000 7f53fea28700 1 -- 172.21.15.83:0/3797546198 >> 172.21.15.83:0/3797546198 conn(0x7f53f80761e0 msgr2=0x7f53f8102b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T07:06:24.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:24.895+0000 7f53fea28700 1 -- 172.21.15.83:0/3797546198 shutdown_connections 2024-04-01T07:06:24.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:24.895+0000 7f53fea28700 1 -- 172.21.15.83:0/3797546198 wait complete. 2024-04-01T07:06:24.896 INFO:teuthology.orchestra.run.smithi083.stderr:pool 'cephfs_metadata' removed 2024-04-01T07:06:24.916 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-01T07:06:25.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:25.054+0000 7fe07b5f2700 1 -- 172.21.15.83:0/3798632208 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0740ff8e0 msgr2=0x7fe0740ffcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:25.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:25.054+0000 7fe07b5f2700 1 --2- 172.21.15.83:0/3798632208 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0740ff8e0 0x7fe0740ffcc0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fe064009990 tx=0x7fe064009ca0 comp rx=0 tx=0).stop 2024-04-01T07:06:25.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:25.054+0000 7fe07b5f2700 1 -- 172.21.15.83:0/3798632208 shutdown_connections 2024-04-01T07:06:25.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:25.054+0000 7fe07b5f2700 1 --2- 172.21.15.83:0/3798632208 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0740ff8e0 0x7fe0740ffcc0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:25.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:25.054+0000 7fe07b5f2700 1 --2- 172.21.15.83:0/3798632208 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe0741060f0 0x7fe07410dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:25.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:25.054+0000 7fe07b5f2700 1 --2- 172.21.15.83:0/3798632208 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe074100290 0x7fe0741059c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:25.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:25.054+0000 7fe07b5f2700 1 -- 172.21.15.83:0/3798632208 >> 172.21.15.83:0/3798632208 conn(0x7fe074074f00 msgr2=0x7fe074075310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T07:06:25.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:25.054+0000 7fe07b5f2700 1 -- 172.21.15.83:0/3798632208 shutdown_connections 2024-04-01T07:06:25.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:25.054+0000 7fe07b5f2700 1 -- 172.21.15.83:0/3798632208 wait complete. 2024-04-01T07:06:25.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:25.055+0000 7fe07b5f2700 1 Processor -- start 2024-04-01T07:06:25.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:25.055+0000 7fe07b5f2700 1 -- start start 2024-04-01T07:06:25.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:25.055+0000 7fe07b5f2700 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe0740ff8e0 0x7fe074199410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:06:25.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:25.055+0000 7fe07b5f2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0741060f0 0x7fe074199950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:06:25.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:25.055+0000 7fe07b5f2700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe07419dcf0 0x7fe07419e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:06:25.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:25.055+0000 7fe07b5f2700 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07419e770 con 0x7fe07419dcf0 2024-04-01T07:06:25.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:25.055+0000 7fe07b5f2700 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07419e8e0 con 0x7fe0740ff8e0 2024-04-01T07:06:25.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:25.055+0000 7fe07b5f2700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07419eaa0 con 0x7fe0741060f0 2024-04-01T07:06:25.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:25.055+0000 7fe079b8f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe07419dcf0 0x7fe07419e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:06:25.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:25.055+0000 7fe079b8f700 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe07419dcf0 0x7fe07419e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:41774/0 (socket says 172.21.15.83:41774) 2024-04-01T07:06:25.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:25.055+0000 7fe079b8f700 1 -- 172.21.15.83:0/770960834 learned_addr learned my addr 172.21.15.83:0/770960834 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-04-01T07:06:25.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:25.055+0000 7fe078b8d700 1 --2- 172.21.15.83:0/770960834 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0741060f0 0x7fe074199950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:06:25.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:25.055+0000 7fe07938e700 1 --2- 172.21.15.83:0/770960834 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe0740ff8e0 0x7fe074199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:06:25.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:25.055+0000 7fe079b8f700 1 -- 172.21.15.83:0/770960834 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0741060f0 msgr2=0x7fe074199950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:25.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:25.055+0000 7fe079b8f700 1 --2- 172.21.15.83:0/770960834 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0741060f0 0x7fe074199950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:25.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:25.055+0000 7fe079b8f700 1 -- 172.21.15.83:0/770960834 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe0740ff8e0 msgr2=0x7fe074199410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:25.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:25.055+0000 7fe079b8f700 1 --2- 172.21.15.83:0/770960834 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe0740ff8e0 0x7fe074199410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:25.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:25.055+0000 7fe079b8f700 1 -- 172.21.15.83:0/770960834 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0640095f0 con 0x7fe07419dcf0 2024-04-01T07:06:25.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:25.055+0000 7fe079b8f700 1 --2- 172.21.15.83:0/770960834 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe07419dcf0 0x7fe07419e170 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fe06c00b970 tx=0x7fe06c00bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T07:06:25.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:25.056+0000 7fe06a7fc700 1 -- 172.21.15.83:0/770960834 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06c00c930 con 0x7fe07419dcf0 2024-04-01T07:06:25.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:25.056+0000 7fe06a7fc700 1 -- 172.21.15.83:0/770960834 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe06c014440 con 0x7fe07419dcf0 2024-04-01T07:06:25.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:25.056+0000 7fe07b5f2700 1 -- 172.21.15.83:0/770960834 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0741a6000 con 0x7fe07419dcf0 2024-04-01T07:06:25.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:25.056+0000 7fe06a7fc700 1 -- 172.21.15.83:0/770960834 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06c0075d0 con 0x7fe07419dcf0 2024-04-01T07:06:25.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:25.056+0000 7fe07b5f2700 1 -- 172.21.15.83:0/770960834 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0741a6490 con 0x7fe07419dcf0 2024-04-01T07:06:25.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:25.057+0000 7fe07b5f2700 1 -- 172.21.15.83:0/770960834 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe074102f30 con 0x7fe07419dcf0 2024-04-01T07:06:25.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:25.059+0000 7fe06a7fc700 1 -- 172.21.15.83:0/770960834 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 25) v1 ==== 135996+0+0 (secure 0 0 0) 0x7fe06c0145b0 con 0x7fe07419dcf0 2024-04-01T07:06:25.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:25.059+0000 7fe06a7fc700 1 --2- 172.21.15.83:0/770960834 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fe0600a1290 0x7fe0600a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-01T07:06:25.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:25.059+0000 7fe06a7fc700 1 -- 172.21.15.83:0/770960834 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8187+0+0 (secure 0 0 0) 0x7fe06c006e40 con 0x7fe07419dcf0 2024-04-01T07:06:25.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:25.059+0000 7fe07938e700 1 --2- 172.21.15.83:0/770960834 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fe0600a1290 0x7fe0600a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-01T07:06:25.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:25.060+0000 7fe07938e700 1 --2- 172.21.15.83:0/770960834 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fe0600a1290 0x7fe0600a3750 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe064005b40 tx=0x7fe064005a90 comp rx=0 tx=0).ready entity=mgr.15420 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-01T07:06:25.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:25.062+0000 7fe06a7fc700 1 -- 172.21.15.83:0/770960834 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182738 (secure 0 0 0) 0x7fe06c095c20 con 0x7fe07419dcf0 2024-04-01T07:06:25.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:24 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/3797546198' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-01T07:06:25.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:24 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/3797546198' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-01T07:06:25.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:25.259+0000 7fe07b5f2700 1 -- 172.21.15.83:0/770960834 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe074068de0 con 0x7fe07419dcf0 2024-04-01T07:06:25.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:24 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/3797546198' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-01T07:06:25.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:25.901+0000 7fe06a7fc700 1 -- 172.21.15.83:0/770960834 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v95) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe06c099240 con 0x7fe07419dcf0 2024-04-01T07:06:25.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:25.905+0000 7fe07b5f2700 1 -- 172.21.15.83:0/770960834 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fe0600a1290 msgr2=0x7fe0600a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:25.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:25.905+0000 7fe07b5f2700 1 --2- 172.21.15.83:0/770960834 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fe0600a1290 0x7fe0600a3750 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe064005b40 tx=0x7fe064005a90 comp rx=0 tx=0).stop 2024-04-01T07:06:25.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:25.905+0000 7fe07b5f2700 1 -- 172.21.15.83:0/770960834 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe07419dcf0 msgr2=0x7fe07419e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-01T07:06:25.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:25.905+0000 7fe07b5f2700 1 --2- 172.21.15.83:0/770960834 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe07419dcf0 0x7fe07419e170 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fe06c00b970 tx=0x7fe06c00bc80 comp rx=0 tx=0).stop 2024-04-01T07:06:25.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:25.905+0000 7fe07b5f2700 1 -- 172.21.15.83:0/770960834 shutdown_connections 2024-04-01T07:06:25.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:25.905+0000 7fe07b5f2700 1 --2- 172.21.15.83:0/770960834 >> [v2:172.21.15.83:6800/3294653546,v1:172.21.15.83:6801/3294653546] conn(0x7fe0600a1290 0x7fe0600a3750 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:25.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:25.905+0000 7fe07b5f2700 1 --2- 172.21.15.83:0/770960834 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe07419dcf0 0x7fe07419e170 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:25.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:25.905+0000 7fe07b5f2700 1 --2- 172.21.15.83:0/770960834 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe0740ff8e0 0x7fe074199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:25.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:25.905+0000 7fe07b5f2700 1 --2- 172.21.15.83:0/770960834 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0741060f0 0x7fe074199950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-01T07:06:25.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:25.905+0000 7fe07b5f2700 1 -- 172.21.15.83:0/770960834 >> 172.21.15.83:0/770960834 conn(0x7fe074074f00 msgr2=0x7fe0740fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-01T07:06:25.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:25.906+0000 7fe07b5f2700 1 -- 172.21.15.83:0/770960834 shutdown_connections 2024-04-01T07:06:25.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-04-01T07:06:25.906+0000 7fe07b5f2700 1 -- 172.21.15.83:0/770960834 wait complete. 2024-04-01T07:06:25.908 INFO:teuthology.orchestra.run.smithi083.stderr:pool 'cephfs_data' removed 2024-04-01T07:06:25.925 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-01T07:06:25.964 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-01T07:06:26.002 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-01T07:06:26.040 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-04-01T07:06:26.040 DEBUG:teuthology.orchestra.run.smithi083:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-01T07:06:26.058 DEBUG:teuthology.orchestra.run.smithi145:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-01T07:06:26.078 DEBUG:teuthology.orchestra.run.smithi153:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-01T07:06:26.098 INFO:tasks.cephadm:Stopping all daemons... 2024-04-01T07:06:26.098 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-04-01T07:06:26.098 DEBUG:teuthology.orchestra.run.smithi083:> sudo systemctl stop ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mon.a 2024-04-01T07:06:26.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:25 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/3797546198' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-04-01T07:06:26.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:25 smithi145 ceph-mon[47816]: osdmap e94: 12 total, 12 up, 12 in 2024-04-01T07:06:26.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:25 smithi145 ceph-mon[47816]: from='client.? 172.21.15.83:0/770960834' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-01T07:06:26.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:25 smithi145 ceph-mon[47816]: pgmap v331: 65 pgs: 65 active+clean; 22 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T07:06:26.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:25 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/3797546198' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-04-01T07:06:26.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:25 smithi083 ceph-mon[43429]: osdmap e94: 12 total, 12 up, 12 in 2024-04-01T07:06:26.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:25 smithi083 ceph-mon[43429]: from='client.? 172.21.15.83:0/770960834' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-01T07:06:26.262 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:25 smithi083 ceph-mon[43429]: pgmap v331: 65 pgs: 65 active+clean; 22 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T07:06:26.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:26 smithi083 systemd[1]: Stopping Ceph mon.a for c6f8eff4-eff3-11ee-b647-cb9ed24678a4... 2024-04-01T07:06:26.390 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:25 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/3797546198' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-04-01T07:06:26.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:25 smithi153 ceph-mon[48187]: osdmap e94: 12 total, 12 up, 12 in 2024-04-01T07:06:26.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:25 smithi153 ceph-mon[48187]: from='client.? 172.21.15.83:0/770960834' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-01T07:06:26.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:25 smithi153 ceph-mon[48187]: pgmap v331: 65 pgs: 65 active+clean; 22 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-04-01T07:06:26.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:26 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mon-a[43406]: 2024-04-01T07:06:26.360+0000 7fc4c5835700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-01T07:06:26.711 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:26 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mon-a[43406]: 2024-04-01T07:06:26.360+0000 7fc4c5835700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-04-01T07:06:27.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Apr 01 07:06:26 smithi083 bash[118170]: ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mon-a 2024-04-01T07:06:27.067 DEBUG:teuthology.orchestra.run.smithi083:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mon.a.service' 2024-04-01T07:06:27.113 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-01T07:06:27.113 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-04-01T07:06:27.114 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-04-01T07:06:27.114 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mon.b 2024-04-01T07:06:27.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:27 smithi145 systemd[1]: Stopping Ceph mon.b for c6f8eff4-eff3-11ee-b647-cb9ed24678a4... 2024-04-01T07:06:27.504 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:27 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mon-b[47793]: 2024-04-01T07:06:27.345+0000 7fefaf0fe700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-01T07:06:27.504 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:27 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mon-b[47793]: 2024-04-01T07:06:27.345+0000 7fefaf0fe700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-04-01T07:06:27.861 INFO:journalctl@ceph.mon.b.smithi145.stdout:Apr 01 07:06:27 smithi145 bash[90419]: ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mon-b 2024-04-01T07:06:27.868 DEBUG:teuthology.orchestra.run.smithi145:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mon.b.service' 2024-04-01T07:06:27.922 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-01T07:06:27.923 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-04-01T07:06:27.923 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-04-01T07:06:27.923 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mon.c 2024-04-01T07:06:28.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:27 smithi153 systemd[1]: Stopping Ceph mon.c for c6f8eff4-eff3-11ee-b647-cb9ed24678a4... 2024-04-01T07:06:28.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:28 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mon-c[48164]: 2024-04-01T07:06:28.179+0000 7f023bc76700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-01T07:06:28.391 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:28 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mon-c[48164]: 2024-04-01T07:06:28.179+0000 7f023bc76700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-04-01T07:06:28.890 INFO:journalctl@ceph.mon.c.smithi153.stdout:Apr 01 07:06:28 smithi153 bash[91690]: ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mon-c 2024-04-01T07:06:28.903 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mon.c.service' 2024-04-01T07:06:28.946 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-01T07:06:28.946 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-04-01T07:06:28.946 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-04-01T07:06:28.946 DEBUG:teuthology.orchestra.run.smithi083:> sudo systemctl stop ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mgr.x 2024-04-01T07:06:29.263 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 07:06:28 smithi083 systemd[1]: Stopping Ceph mgr.x for c6f8eff4-eff3-11ee-b647-cb9ed24678a4... 2024-04-01T07:06:29.263 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 07:06:29 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x[43677]: 2024-04-01T07:06:29.196+0000 7f572e72c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-01T07:06:29.709 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Apr 01 07:06:29 smithi083 bash[118308]: ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-x 2024-04-01T07:06:29.715 DEBUG:teuthology.orchestra.run.smithi083:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mgr.x.service' 2024-04-01T07:06:29.752 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-01T07:06:29.752 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-04-01T07:06:29.752 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-04-01T07:06:29.752 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mgr.y 2024-04-01T07:06:30.124 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 07:06:29 smithi145 systemd[1]: Stopping Ceph mgr.y for c6f8eff4-eff3-11ee-b647-cb9ed24678a4... 2024-04-01T07:06:30.432 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 07:06:30 smithi145 bash[90560]: ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-y 2024-04-01T07:06:30.432 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Apr 01 07:06:30 smithi145 systemd[1]: ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-04-01T07:06:30.438 DEBUG:teuthology.orchestra.run.smithi145:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mgr.y.service' 2024-04-01T07:06:30.476 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-01T07:06:30.477 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-04-01T07:06:30.477 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-04-01T07:06:30.477 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mgr.z 2024-04-01T07:06:30.866 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 07:06:30 smithi153 systemd[1]: Stopping Ceph mgr.z for c6f8eff4-eff3-11ee-b647-cb9ed24678a4... 2024-04-01T07:06:31.141 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 07:06:30 smithi153 bash[91830]: ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mgr-z 2024-04-01T07:06:31.141 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Apr 01 07:06:30 smithi153 systemd[1]: ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-04-01T07:06:31.179 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mgr.z.service' 2024-04-01T07:06:31.216 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-01T07:06:31.216 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-04-01T07:06:31.217 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-04-01T07:06:31.217 DEBUG:teuthology.orchestra.run.smithi083:> sudo systemctl stop ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@osd.0 2024-04-01T07:06:31.513 INFO:journalctl@ceph.osd.0.smithi083.stdout:Apr 01 07:06:31 smithi083 systemd[1]: Stopping Ceph osd.0 for c6f8eff4-eff3-11ee-b647-cb9ed24678a4... 2024-04-01T07:06:31.513 INFO:journalctl@ceph.osd.0.smithi083.stdout:Apr 01 07:06:31 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-0[62084]: 2024-04-01T07:06:31.454+0000 7f9157232700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-01T07:06:31.513 INFO:journalctl@ceph.osd.0.smithi083.stdout:Apr 01 07:06:31 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-0[62084]: 2024-04-01T07:06:31.454+0000 7f9157232700 -1 osd.0 95 *** Got signal Terminated *** 2024-04-01T07:06:31.513 INFO:journalctl@ceph.osd.0.smithi083.stdout:Apr 01 07:06:31 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-0[62084]: 2024-04-01T07:06:31.454+0000 7f9157232700 -1 osd.0 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-01T07:06:37.512 INFO:journalctl@ceph.osd.0.smithi083.stdout:Apr 01 07:06:37 smithi083 bash[118448]: ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-0 2024-04-01T07:06:38.313 DEBUG:teuthology.orchestra.run.smithi083:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@osd.0.service' 2024-04-01T07:06:38.354 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-01T07:06:38.354 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-04-01T07:06:38.355 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-04-01T07:06:38.355 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@osd.1 2024-04-01T07:06:38.753 INFO:journalctl@ceph.osd.1.smithi145.stdout:Apr 01 07:06:38 smithi145 systemd[1]: Stopping Ceph osd.1 for c6f8eff4-eff3-11ee-b647-cb9ed24678a4... 2024-04-01T07:06:38.753 INFO:journalctl@ceph.osd.1.smithi145.stdout:Apr 01 07:06:38 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-1[52825]: 2024-04-01T07:06:38.592+0000 7f35b79a0700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-01T07:06:38.753 INFO:journalctl@ceph.osd.1.smithi145.stdout:Apr 01 07:06:38 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-1[52825]: 2024-04-01T07:06:38.592+0000 7f35b79a0700 -1 osd.1 95 *** Got signal Terminated *** 2024-04-01T07:06:38.753 INFO:journalctl@ceph.osd.1.smithi145.stdout:Apr 01 07:06:38 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-1[52825]: 2024-04-01T07:06:38.592+0000 7f35b79a0700 -1 osd.1 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-01T07:06:44.503 INFO:journalctl@ceph.osd.1.smithi145.stdout:Apr 01 07:06:44 smithi145 bash[90700]: ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-1 2024-04-01T07:06:45.380 DEBUG:teuthology.orchestra.run.smithi145:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@osd.1.service' 2024-04-01T07:06:45.421 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-01T07:06:45.421 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-04-01T07:06:45.421 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-04-01T07:06:45.421 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@osd.2 2024-04-01T07:06:45.891 INFO:journalctl@ceph.osd.2.smithi153.stdout:Apr 01 07:06:45 smithi153 systemd[1]: Stopping Ceph osd.2 for c6f8eff4-eff3-11ee-b647-cb9ed24678a4... 2024-04-01T07:06:45.891 INFO:journalctl@ceph.osd.2.smithi153.stdout:Apr 01 07:06:45 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-2[53974]: 2024-04-01T07:06:45.660+0000 7f53a454b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-01T07:06:45.891 INFO:journalctl@ceph.osd.2.smithi153.stdout:Apr 01 07:06:45 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-2[53974]: 2024-04-01T07:06:45.660+0000 7f53a454b700 -1 osd.2 95 *** Got signal Terminated *** 2024-04-01T07:06:45.891 INFO:journalctl@ceph.osd.2.smithi153.stdout:Apr 01 07:06:45 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-2[53974]: 2024-04-01T07:06:45.660+0000 7f53a454b700 -1 osd.2 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-01T07:06:51.391 INFO:journalctl@ceph.osd.2.smithi153.stdout:Apr 01 07:06:51 smithi153 bash[91975]: ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-2 2024-04-01T07:06:52.305 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@osd.2.service' 2024-04-01T07:06:52.345 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-01T07:06:52.346 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-04-01T07:06:52.346 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-04-01T07:06:52.346 DEBUG:teuthology.orchestra.run.smithi083:> sudo systemctl stop ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@osd.3 2024-04-01T07:06:52.763 INFO:journalctl@ceph.osd.3.smithi083.stdout:Apr 01 07:06:52 smithi083 systemd[1]: Stopping Ceph osd.3 for c6f8eff4-eff3-11ee-b647-cb9ed24678a4... 2024-04-01T07:06:52.763 INFO:journalctl@ceph.osd.3.smithi083.stdout:Apr 01 07:06:52 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-3[70184]: 2024-04-01T07:06:52.594+0000 7f0d15a1d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-01T07:06:52.763 INFO:journalctl@ceph.osd.3.smithi083.stdout:Apr 01 07:06:52 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-3[70184]: 2024-04-01T07:06:52.594+0000 7f0d15a1d700 -1 osd.3 95 *** Got signal Terminated *** 2024-04-01T07:06:52.763 INFO:journalctl@ceph.osd.3.smithi083.stdout:Apr 01 07:06:52 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-3[70184]: 2024-04-01T07:06:52.594+0000 7f0d15a1d700 -1 osd.3 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-01T07:06:58.391 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:06:58 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:06:58.130+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.010250+0000 front 2024-04-01T07:06:34.010446+0000 (oldest deadline 2024-04-01T07:06:57.510323+0000) 2024-04-01T07:06:58.391 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:06:58 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:06:58.029+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.346120+0000 front 2024-04-01T07:06:34.346258+0000 (oldest deadline 2024-04-01T07:06:57.846204+0000) 2024-04-01T07:06:58.512 INFO:journalctl@ceph.osd.3.smithi083.stdout:Apr 01 07:06:58 smithi083 bash[118716]: ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-3 2024-04-01T07:06:58.513 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:06:58 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:06:58.185+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.703525+0000 front 2024-04-01T07:06:30.703502+0000 (oldest deadline 2024-04-01T07:06:57.704368+0000) 2024-04-01T07:06:59.391 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:06:59 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:06:59.081+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.010250+0000 front 2024-04-01T07:06:34.010446+0000 (oldest deadline 2024-04-01T07:06:57.510323+0000) 2024-04-01T07:06:59.391 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:06:59 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:06:59.063+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.346120+0000 front 2024-04-01T07:06:34.346258+0000 (oldest deadline 2024-04-01T07:06:57.846204+0000) 2024-04-01T07:06:59.498 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:06:59 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:06:59.168+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.703525+0000 front 2024-04-01T07:06:30.703502+0000 (oldest deadline 2024-04-01T07:06:57.704368+0000) 2024-04-01T07:06:59.506 DEBUG:teuthology.orchestra.run.smithi083:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@osd.3.service' 2024-04-01T07:06:59.546 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-01T07:06:59.547 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-04-01T07:06:59.547 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-04-01T07:06:59.547 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@osd.4 2024-04-01T07:06:59.931 INFO:journalctl@ceph.osd.4.smithi145.stdout:Apr 01 07:06:59 smithi145 systemd[1]: Stopping Ceph osd.4 for c6f8eff4-eff3-11ee-b647-cb9ed24678a4... 2024-04-01T07:06:59.931 INFO:journalctl@ceph.osd.4.smithi145.stdout:Apr 01 07:06:59 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-4[61529]: 2024-04-01T07:06:59.796+0000 7f1656ce5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-01T07:06:59.931 INFO:journalctl@ceph.osd.4.smithi145.stdout:Apr 01 07:06:59 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-4[61529]: 2024-04-01T07:06:59.796+0000 7f1656ce5700 -1 osd.4 95 *** Got signal Terminated *** 2024-04-01T07:06:59.932 INFO:journalctl@ceph.osd.4.smithi145.stdout:Apr 01 07:06:59 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-4[61529]: 2024-04-01T07:06:59.796+0000 7f1656ce5700 -1 osd.4 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-01T07:07:00.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:06:59 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:06:59.930+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.924722+0000 front 2024-04-01T07:06:30.924835+0000 (oldest deadline 2024-04-01T07:06:59.725293+0000) 2024-04-01T07:07:00.391 INFO:journalctl@ceph.osd.5.smithi153.stdout:Apr 01 07:07:00 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-5[62405]: 2024-04-01T07:07:00.175+0000 7fbc40164700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:35.450963+0000 front 2024-04-01T07:06:35.451212+0000 (oldest deadline 2024-04-01T07:07:00.051415+0000) 2024-04-01T07:07:00.391 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:00 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:00.123+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.010250+0000 front 2024-04-01T07:06:34.010446+0000 (oldest deadline 2024-04-01T07:06:57.510323+0000) 2024-04-01T07:07:00.391 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:00 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:00.070+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.346120+0000 front 2024-04-01T07:06:34.346258+0000 (oldest deadline 2024-04-01T07:06:57.846204+0000) 2024-04-01T07:07:00.512 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:00 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:00.178+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.703525+0000 front 2024-04-01T07:06:30.703502+0000 (oldest deadline 2024-04-01T07:06:57.704368+0000) 2024-04-01T07:07:01.252 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:00 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:00.890+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.924722+0000 front 2024-04-01T07:06:30.924835+0000 (oldest deadline 2024-04-01T07:06:59.725293+0000) 2024-04-01T07:07:01.390 INFO:journalctl@ceph.osd.5.smithi153.stdout:Apr 01 07:07:01 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-5[62405]: 2024-04-01T07:07:01.131+0000 7fbc40164700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:35.450963+0000 front 2024-04-01T07:06:35.451212+0000 (oldest deadline 2024-04-01T07:07:00.051415+0000) 2024-04-01T07:07:01.391 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:01 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:01.151+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.010250+0000 front 2024-04-01T07:06:34.010446+0000 (oldest deadline 2024-04-01T07:06:57.510323+0000) 2024-04-01T07:07:01.391 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:01 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:01.045+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.346120+0000 front 2024-04-01T07:06:34.346258+0000 (oldest deadline 2024-04-01T07:06:57.846204+0000) 2024-04-01T07:07:01.512 INFO:journalctl@ceph.osd.6.smithi083.stdout:Apr 01 07:07:01 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-6[78927]: 2024-04-01T07:07:01.126+0000 7fac3176c700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:35.990742+0000 front 2024-04-01T07:06:35.990568+0000 (oldest deadline 2024-04-01T07:07:00.690757+0000) 2024-04-01T07:07:01.513 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:01 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:01.129+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.703525+0000 front 2024-04-01T07:06:30.703502+0000 (oldest deadline 2024-04-01T07:06:57.704368+0000) 2024-04-01T07:07:02.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:01 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:01.901+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.924722+0000 front 2024-04-01T07:06:30.924835+0000 (oldest deadline 2024-04-01T07:06:59.725293+0000) 2024-04-01T07:07:02.391 INFO:journalctl@ceph.osd.5.smithi153.stdout:Apr 01 07:07:02 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-5[62405]: 2024-04-01T07:07:02.137+0000 7fbc40164700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:35.450963+0000 front 2024-04-01T07:06:35.451212+0000 (oldest deadline 2024-04-01T07:07:00.051415+0000) 2024-04-01T07:07:02.391 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:02 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:02.133+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.010250+0000 front 2024-04-01T07:06:34.010446+0000 (oldest deadline 2024-04-01T07:06:57.510323+0000) 2024-04-01T07:07:02.391 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:02 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:02.004+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.346120+0000 front 2024-04-01T07:06:34.346258+0000 (oldest deadline 2024-04-01T07:06:57.846204+0000) 2024-04-01T07:07:02.512 INFO:journalctl@ceph.osd.6.smithi083.stdout:Apr 01 07:07:02 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-6[78927]: 2024-04-01T07:07:02.156+0000 7fac3176c700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:35.990742+0000 front 2024-04-01T07:06:35.990568+0000 (oldest deadline 2024-04-01T07:07:00.690757+0000) 2024-04-01T07:07:02.513 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:02 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:02.108+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.703525+0000 front 2024-04-01T07:06:30.703502+0000 (oldest deadline 2024-04-01T07:06:57.704368+0000) 2024-04-01T07:07:03.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:02 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:02.909+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.924722+0000 front 2024-04-01T07:06:30.924835+0000 (oldest deadline 2024-04-01T07:06:59.725293+0000) 2024-04-01T07:07:03.390 INFO:journalctl@ceph.osd.5.smithi153.stdout:Apr 01 07:07:03 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-5[62405]: 2024-04-01T07:07:03.184+0000 7fbc40164700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:35.450963+0000 front 2024-04-01T07:06:35.451212+0000 (oldest deadline 2024-04-01T07:07:00.051415+0000) 2024-04-01T07:07:03.391 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:03 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:03.179+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.010250+0000 front 2024-04-01T07:06:34.010446+0000 (oldest deadline 2024-04-01T07:06:57.510323+0000) 2024-04-01T07:07:03.391 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:02 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:02.981+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.346120+0000 front 2024-04-01T07:06:34.346258+0000 (oldest deadline 2024-04-01T07:06:57.846204+0000) 2024-04-01T07:07:03.512 INFO:journalctl@ceph.osd.6.smithi083.stdout:Apr 01 07:07:03 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-6[78927]: 2024-04-01T07:07:03.145+0000 7fac3176c700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:35.990742+0000 front 2024-04-01T07:06:35.990568+0000 (oldest deadline 2024-04-01T07:07:00.690757+0000) 2024-04-01T07:07:03.513 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:03 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:03.148+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.703525+0000 front 2024-04-01T07:06:30.703502+0000 (oldest deadline 2024-04-01T07:06:57.704368+0000) 2024-04-01T07:07:04.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:03 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:03.898+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.924722+0000 front 2024-04-01T07:06:30.924835+0000 (oldest deadline 2024-04-01T07:06:59.725293+0000) 2024-04-01T07:07:04.391 INFO:journalctl@ceph.osd.5.smithi153.stdout:Apr 01 07:07:04 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-5[62405]: 2024-04-01T07:07:04.214+0000 7fbc40164700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:35.450963+0000 front 2024-04-01T07:06:35.451212+0000 (oldest deadline 2024-04-01T07:07:00.051415+0000) 2024-04-01T07:07:04.391 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:03 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:03.985+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.346120+0000 front 2024-04-01T07:06:34.346258+0000 (oldest deadline 2024-04-01T07:06:57.846204+0000) 2024-04-01T07:07:04.391 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:04 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:04.226+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.010250+0000 front 2024-04-01T07:06:34.010446+0000 (oldest deadline 2024-04-01T07:06:57.510323+0000) 2024-04-01T07:07:04.512 INFO:journalctl@ceph.osd.6.smithi083.stdout:Apr 01 07:07:04 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-6[78927]: 2024-04-01T07:07:04.123+0000 7fac3176c700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:35.990742+0000 front 2024-04-01T07:06:35.990568+0000 (oldest deadline 2024-04-01T07:07:00.690757+0000) 2024-04-01T07:07:04.513 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:04 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:04.108+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.703525+0000 front 2024-04-01T07:06:30.703502+0000 (oldest deadline 2024-04-01T07:06:57.704368+0000) 2024-04-01T07:07:04.879 INFO:journalctl@ceph.osd.7.smithi145.stdout:Apr 01 07:07:04 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-7[70262]: 2024-04-01T07:07:04.550+0000 7f733adfa700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:41.469716+0000 front 2024-04-01T07:06:41.469693+0000 (oldest deadline 2024-04-01T07:07:04.369836+0000) 2024-04-01T07:07:05.232 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:04 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:04.959+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.346120+0000 front 2024-04-01T07:06:34.346258+0000 (oldest deadline 2024-04-01T07:06:57.846204+0000) 2024-04-01T07:07:05.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:04 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:04.878+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.924722+0000 front 2024-04-01T07:06:30.924835+0000 (oldest deadline 2024-04-01T07:06:59.725293+0000) 2024-04-01T07:07:05.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:04 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:04.878+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:43.126859+0000 front 2024-04-01T07:06:43.126953+0000 (oldest deadline 2024-04-01T07:07:04.226993+0000) 2024-04-01T07:07:05.512 INFO:journalctl@ceph.osd.6.smithi083.stdout:Apr 01 07:07:05 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-6[78927]: 2024-04-01T07:07:05.144+0000 7fac3176c700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:35.990742+0000 front 2024-04-01T07:06:35.990568+0000 (oldest deadline 2024-04-01T07:07:00.690757+0000) 2024-04-01T07:07:05.513 INFO:journalctl@ceph.osd.6.smithi083.stdout:Apr 01 07:07:05 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-6[78927]: 2024-04-01T07:07:05.144+0000 7fac3176c700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:40.691296+0000 front 2024-04-01T07:06:40.691327+0000 (oldest deadline 2024-04-01T07:07:04.791152+0000) 2024-04-01T07:07:05.513 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:05 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:05.152+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.703525+0000 front 2024-04-01T07:06:30.703502+0000 (oldest deadline 2024-04-01T07:06:57.704368+0000) 2024-04-01T07:07:05.513 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:05 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:05.152+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:40.005521+0000 front 2024-04-01T07:06:40.005539+0000 (oldest deadline 2024-04-01T07:07:04.705500+0000) 2024-04-01T07:07:05.601 INFO:journalctl@ceph.osd.4.smithi145.stdout:Apr 01 07:07:05 smithi145 bash[90962]: ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-4 2024-04-01T07:07:05.640 INFO:journalctl@ceph.osd.5.smithi153.stdout:Apr 01 07:07:05 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-5[62405]: 2024-04-01T07:07:05.232+0000 7fbc40164700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:35.450963+0000 front 2024-04-01T07:06:35.451212+0000 (oldest deadline 2024-04-01T07:07:00.051415+0000) 2024-04-01T07:07:05.641 INFO:journalctl@ceph.osd.5.smithi153.stdout:Apr 01 07:07:05 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-5[62405]: 2024-04-01T07:07:05.232+0000 7fbc40164700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:40.052076+0000 front 2024-04-01T07:06:40.052143+0000 (oldest deadline 2024-04-01T07:07:04.752043+0000) 2024-04-01T07:07:05.641 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:05 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:05.255+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.010250+0000 front 2024-04-01T07:06:34.010446+0000 (oldest deadline 2024-04-01T07:06:57.510323+0000) 2024-04-01T07:07:05.910 INFO:journalctl@ceph.osd.7.smithi145.stdout:Apr 01 07:07:05 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-7[70262]: 2024-04-01T07:07:05.600+0000 7f733adfa700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:41.469716+0000 front 2024-04-01T07:06:41.469693+0000 (oldest deadline 2024-04-01T07:07:04.369836+0000) 2024-04-01T07:07:06.250 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:05 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:05.968+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.346120+0000 front 2024-04-01T07:06:34.346258+0000 (oldest deadline 2024-04-01T07:06:57.846204+0000) 2024-04-01T07:07:06.251 INFO:journalctl@ceph.osd.5.smithi153.stdout:Apr 01 07:07:06 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-5[62405]: 2024-04-01T07:07:06.201+0000 7fbc40164700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:35.450963+0000 front 2024-04-01T07:06:35.451212+0000 (oldest deadline 2024-04-01T07:07:00.051415+0000) 2024-04-01T07:07:06.251 INFO:journalctl@ceph.osd.5.smithi153.stdout:Apr 01 07:07:06 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-5[62405]: 2024-04-01T07:07:06.201+0000 7fbc40164700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:40.052076+0000 front 2024-04-01T07:06:40.052143+0000 (oldest deadline 2024-04-01T07:07:04.752043+0000) 2024-04-01T07:07:06.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:05 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:05.910+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.924722+0000 front 2024-04-01T07:06:30.924835+0000 (oldest deadline 2024-04-01T07:06:59.725293+0000) 2024-04-01T07:07:06.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:05 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:05.910+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:43.126859+0000 front 2024-04-01T07:06:43.126953+0000 (oldest deadline 2024-04-01T07:07:04.226993+0000) 2024-04-01T07:07:06.513 INFO:journalctl@ceph.osd.6.smithi083.stdout:Apr 01 07:07:06 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-6[78927]: 2024-04-01T07:07:06.167+0000 7fac3176c700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:35.990742+0000 front 2024-04-01T07:06:35.990568+0000 (oldest deadline 2024-04-01T07:07:00.690757+0000) 2024-04-01T07:07:06.513 INFO:journalctl@ceph.osd.6.smithi083.stdout:Apr 01 07:07:06 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-6[78927]: 2024-04-01T07:07:06.167+0000 7fac3176c700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:40.691296+0000 front 2024-04-01T07:06:40.691327+0000 (oldest deadline 2024-04-01T07:07:04.791152+0000) 2024-04-01T07:07:06.513 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:06 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:06.190+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.703525+0000 front 2024-04-01T07:06:30.703502+0000 (oldest deadline 2024-04-01T07:06:57.704368+0000) 2024-04-01T07:07:06.513 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:06 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:06.190+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:40.005521+0000 front 2024-04-01T07:06:40.005539+0000 (oldest deadline 2024-04-01T07:07:04.705500+0000) 2024-04-01T07:07:06.640 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:06 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:06.250+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.010250+0000 front 2024-04-01T07:06:34.010446+0000 (oldest deadline 2024-04-01T07:06:57.510323+0000) 2024-04-01T07:07:06.659 DEBUG:teuthology.orchestra.run.smithi145:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@osd.4.service' 2024-04-01T07:07:06.700 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-01T07:07:06.700 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-04-01T07:07:06.701 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-04-01T07:07:06.701 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@osd.5 2024-04-01T07:07:06.956 INFO:journalctl@ceph.osd.7.smithi145.stdout:Apr 01 07:07:06 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-7[70262]: 2024-04-01T07:07:06.641+0000 7f733adfa700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:41.469716+0000 front 2024-04-01T07:06:41.469693+0000 (oldest deadline 2024-04-01T07:07:04.369836+0000) 2024-04-01T07:07:06.995 INFO:journalctl@ceph.osd.5.smithi153.stdout:Apr 01 07:07:06 smithi153 systemd[1]: Stopping Ceph osd.5 for c6f8eff4-eff3-11ee-b647-cb9ed24678a4... 2024-04-01T07:07:06.995 INFO:journalctl@ceph.osd.5.smithi153.stdout:Apr 01 07:07:06 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-5[62405]: 2024-04-01T07:07:06.947+0000 7fbc47b76700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-01T07:07:06.995 INFO:journalctl@ceph.osd.5.smithi153.stdout:Apr 01 07:07:06 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-5[62405]: 2024-04-01T07:07:06.947+0000 7fbc47b76700 -1 osd.5 95 *** Got signal Terminated *** 2024-04-01T07:07:06.995 INFO:journalctl@ceph.osd.5.smithi153.stdout:Apr 01 07:07:06 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-5[62405]: 2024-04-01T07:07:06.947+0000 7fbc47b76700 -1 osd.5 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-01T07:07:07.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:06 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:06.955+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.924722+0000 front 2024-04-01T07:06:30.924835+0000 (oldest deadline 2024-04-01T07:06:59.725293+0000) 2024-04-01T07:07:07.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:06 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:06.955+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:43.126859+0000 front 2024-04-01T07:06:43.126953+0000 (oldest deadline 2024-04-01T07:07:04.226993+0000) 2024-04-01T07:07:07.255 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:06 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:06.994+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.346120+0000 front 2024-04-01T07:06:34.346258+0000 (oldest deadline 2024-04-01T07:06:57.846204+0000) 2024-04-01T07:07:07.255 INFO:journalctl@ceph.osd.5.smithi153.stdout:Apr 01 07:07:07 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-5[62405]: 2024-04-01T07:07:07.225+0000 7fbc40164700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:35.450963+0000 front 2024-04-01T07:06:35.451212+0000 (oldest deadline 2024-04-01T07:07:00.051415+0000) 2024-04-01T07:07:07.255 INFO:journalctl@ceph.osd.5.smithi153.stdout:Apr 01 07:07:07 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-5[62405]: 2024-04-01T07:07:07.225+0000 7fbc40164700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:40.052076+0000 front 2024-04-01T07:06:40.052143+0000 (oldest deadline 2024-04-01T07:07:04.752043+0000) 2024-04-01T07:07:07.513 INFO:journalctl@ceph.osd.6.smithi083.stdout:Apr 01 07:07:07 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-6[78927]: 2024-04-01T07:07:07.190+0000 7fac3176c700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:35.990742+0000 front 2024-04-01T07:06:35.990568+0000 (oldest deadline 2024-04-01T07:07:00.690757+0000) 2024-04-01T07:07:07.513 INFO:journalctl@ceph.osd.6.smithi083.stdout:Apr 01 07:07:07 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-6[78927]: 2024-04-01T07:07:07.190+0000 7fac3176c700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:40.691296+0000 front 2024-04-01T07:06:40.691327+0000 (oldest deadline 2024-04-01T07:07:04.791152+0000) 2024-04-01T07:07:07.513 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:07 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:07.170+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.703525+0000 front 2024-04-01T07:06:30.703502+0000 (oldest deadline 2024-04-01T07:06:57.704368+0000) 2024-04-01T07:07:07.513 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:07 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:07.170+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:40.005521+0000 front 2024-04-01T07:06:40.005539+0000 (oldest deadline 2024-04-01T07:07:04.705500+0000) 2024-04-01T07:07:07.641 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:07 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:07.255+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.010250+0000 front 2024-04-01T07:06:34.010446+0000 (oldest deadline 2024-04-01T07:06:57.510323+0000) 2024-04-01T07:07:07.999 INFO:journalctl@ceph.osd.7.smithi145.stdout:Apr 01 07:07:07 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-7[70262]: 2024-04-01T07:07:07.623+0000 7f733adfa700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:41.469716+0000 front 2024-04-01T07:06:41.469693+0000 (oldest deadline 2024-04-01T07:07:04.369836+0000) 2024-04-01T07:07:08.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:08 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:07.999+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.924722+0000 front 2024-04-01T07:06:30.924835+0000 (oldest deadline 2024-04-01T07:06:59.725293+0000) 2024-04-01T07:07:08.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:08 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:07.999+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:43.126859+0000 front 2024-04-01T07:06:43.126953+0000 (oldest deadline 2024-04-01T07:07:04.226993+0000) 2024-04-01T07:07:08.279 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:08 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:08.016+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.346120+0000 front 2024-04-01T07:06:34.346258+0000 (oldest deadline 2024-04-01T07:06:57.846204+0000) 2024-04-01T07:07:08.279 INFO:journalctl@ceph.osd.5.smithi153.stdout:Apr 01 07:07:08 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-5[62405]: 2024-04-01T07:07:08.181+0000 7fbc40164700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:35.450963+0000 front 2024-04-01T07:06:35.451212+0000 (oldest deadline 2024-04-01T07:07:00.051415+0000) 2024-04-01T07:07:08.279 INFO:journalctl@ceph.osd.5.smithi153.stdout:Apr 01 07:07:08 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-5[62405]: 2024-04-01T07:07:08.181+0000 7fbc40164700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:40.052076+0000 front 2024-04-01T07:06:40.052143+0000 (oldest deadline 2024-04-01T07:07:04.752043+0000) 2024-04-01T07:07:08.512 INFO:journalctl@ceph.osd.6.smithi083.stdout:Apr 01 07:07:08 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-6[78927]: 2024-04-01T07:07:08.235+0000 7fac3176c700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:35.990742+0000 front 2024-04-01T07:06:35.990568+0000 (oldest deadline 2024-04-01T07:07:00.690757+0000) 2024-04-01T07:07:08.513 INFO:journalctl@ceph.osd.6.smithi083.stdout:Apr 01 07:07:08 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-6[78927]: 2024-04-01T07:07:08.235+0000 7fac3176c700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:40.691296+0000 front 2024-04-01T07:06:40.691327+0000 (oldest deadline 2024-04-01T07:07:04.791152+0000) 2024-04-01T07:07:08.513 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:08 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:08.172+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.703525+0000 front 2024-04-01T07:06:30.703502+0000 (oldest deadline 2024-04-01T07:06:57.704368+0000) 2024-04-01T07:07:08.513 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:08 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:08.172+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:40.005521+0000 front 2024-04-01T07:06:40.005539+0000 (oldest deadline 2024-04-01T07:07:04.705500+0000) 2024-04-01T07:07:08.640 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:08 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:08.279+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.010250+0000 front 2024-04-01T07:06:34.010446+0000 (oldest deadline 2024-04-01T07:06:57.510323+0000) 2024-04-01T07:07:09.003 INFO:journalctl@ceph.osd.7.smithi145.stdout:Apr 01 07:07:08 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-7[70262]: 2024-04-01T07:07:08.592+0000 7f733adfa700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:41.469716+0000 front 2024-04-01T07:06:41.469693+0000 (oldest deadline 2024-04-01T07:07:04.369836+0000) 2024-04-01T07:07:09.304 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:09 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:09.029+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.346120+0000 front 2024-04-01T07:06:34.346258+0000 (oldest deadline 2024-04-01T07:06:57.846204+0000) 2024-04-01T07:07:09.304 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:09 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:09.029+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:42.547512+0000 front 2024-04-01T07:06:42.547305+0000 (oldest deadline 2024-04-01T07:07:08.447338+0000) 2024-04-01T07:07:09.304 INFO:journalctl@ceph.osd.5.smithi153.stdout:Apr 01 07:07:09 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-5[62405]: 2024-04-01T07:07:09.146+0000 7fbc40164700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:35.450963+0000 front 2024-04-01T07:06:35.451212+0000 (oldest deadline 2024-04-01T07:07:00.051415+0000) 2024-04-01T07:07:09.304 INFO:journalctl@ceph.osd.5.smithi153.stdout:Apr 01 07:07:09 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-5[62405]: 2024-04-01T07:07:09.146+0000 7fbc40164700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:40.052076+0000 front 2024-04-01T07:06:40.052143+0000 (oldest deadline 2024-04-01T07:07:04.752043+0000) 2024-04-01T07:07:09.503 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:09 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:09.040+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.924722+0000 front 2024-04-01T07:06:30.924835+0000 (oldest deadline 2024-04-01T07:06:59.725293+0000) 2024-04-01T07:07:09.503 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:09 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:09.040+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:43.126859+0000 front 2024-04-01T07:06:43.126953+0000 (oldest deadline 2024-04-01T07:07:04.226993+0000) 2024-04-01T07:07:09.512 INFO:journalctl@ceph.osd.6.smithi083.stdout:Apr 01 07:07:09 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-6[78927]: 2024-04-01T07:07:09.227+0000 7fac3176c700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:35.990742+0000 front 2024-04-01T07:06:35.990568+0000 (oldest deadline 2024-04-01T07:07:00.690757+0000) 2024-04-01T07:07:09.513 INFO:journalctl@ceph.osd.6.smithi083.stdout:Apr 01 07:07:09 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-6[78927]: 2024-04-01T07:07:09.227+0000 7fac3176c700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:40.691296+0000 front 2024-04-01T07:06:40.691327+0000 (oldest deadline 2024-04-01T07:07:04.791152+0000) 2024-04-01T07:07:09.513 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:09 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:09.220+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.703525+0000 front 2024-04-01T07:06:30.703502+0000 (oldest deadline 2024-04-01T07:06:57.704368+0000) 2024-04-01T07:07:09.513 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:09 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:09.220+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:40.005521+0000 front 2024-04-01T07:06:40.005539+0000 (oldest deadline 2024-04-01T07:07:04.705500+0000) 2024-04-01T07:07:09.640 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:09 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:09.304+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.010250+0000 front 2024-04-01T07:06:34.010446+0000 (oldest deadline 2024-04-01T07:06:57.510323+0000) 2024-04-01T07:07:10.003 INFO:journalctl@ceph.osd.7.smithi145.stdout:Apr 01 07:07:09 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-7[70262]: 2024-04-01T07:07:09.637+0000 7f733adfa700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:41.469716+0000 front 2024-04-01T07:06:41.469693+0000 (oldest deadline 2024-04-01T07:07:04.369836+0000) 2024-04-01T07:07:10.290 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:10 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:10.013+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.346120+0000 front 2024-04-01T07:06:34.346258+0000 (oldest deadline 2024-04-01T07:06:57.846204+0000) 2024-04-01T07:07:10.290 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:10 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:10.013+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:42.547512+0000 front 2024-04-01T07:06:42.547305+0000 (oldest deadline 2024-04-01T07:07:08.447338+0000) 2024-04-01T07:07:10.291 INFO:journalctl@ceph.osd.5.smithi153.stdout:Apr 01 07:07:10 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-5[62405]: 2024-04-01T07:07:10.125+0000 7fbc40164700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:35.450963+0000 front 2024-04-01T07:06:35.451212+0000 (oldest deadline 2024-04-01T07:07:00.051415+0000) 2024-04-01T07:07:10.291 INFO:journalctl@ceph.osd.5.smithi153.stdout:Apr 01 07:07:10 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-5[62405]: 2024-04-01T07:07:10.125+0000 7fbc40164700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:40.052076+0000 front 2024-04-01T07:06:40.052143+0000 (oldest deadline 2024-04-01T07:07:04.752043+0000) 2024-04-01T07:07:10.502 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:10 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:10.065+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.924722+0000 front 2024-04-01T07:06:30.924835+0000 (oldest deadline 2024-04-01T07:06:59.725293+0000) 2024-04-01T07:07:10.503 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:10 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:10.065+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:43.126859+0000 front 2024-04-01T07:06:43.126953+0000 (oldest deadline 2024-04-01T07:07:04.226993+0000) 2024-04-01T07:07:10.512 INFO:journalctl@ceph.osd.6.smithi083.stdout:Apr 01 07:07:10 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-6[78927]: 2024-04-01T07:07:10.207+0000 7fac3176c700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:35.990742+0000 front 2024-04-01T07:06:35.990568+0000 (oldest deadline 2024-04-01T07:07:00.690757+0000) 2024-04-01T07:07:10.513 INFO:journalctl@ceph.osd.6.smithi083.stdout:Apr 01 07:07:10 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-6[78927]: 2024-04-01T07:07:10.207+0000 7fac3176c700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:40.691296+0000 front 2024-04-01T07:06:40.691327+0000 (oldest deadline 2024-04-01T07:07:04.791152+0000) 2024-04-01T07:07:10.513 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:10 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:10.191+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.703525+0000 front 2024-04-01T07:06:30.703502+0000 (oldest deadline 2024-04-01T07:06:57.704368+0000) 2024-04-01T07:07:10.513 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:10 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:10.191+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:40.005521+0000 front 2024-04-01T07:06:40.005539+0000 (oldest deadline 2024-04-01T07:07:04.705500+0000) 2024-04-01T07:07:10.641 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:10 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:10.290+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.010250+0000 front 2024-04-01T07:06:34.010446+0000 (oldest deadline 2024-04-01T07:06:57.510323+0000) 2024-04-01T07:07:11.003 INFO:journalctl@ceph.osd.7.smithi145.stdout:Apr 01 07:07:10 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-7[70262]: 2024-04-01T07:07:10.617+0000 7f733adfa700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:41.469716+0000 front 2024-04-01T07:06:41.469693+0000 (oldest deadline 2024-04-01T07:07:04.369836+0000) 2024-04-01T07:07:11.391 INFO:journalctl@ceph.osd.5.smithi153.stdout:Apr 01 07:07:11 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-5[62405]: 2024-04-01T07:07:11.154+0000 7fbc40164700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:35.450963+0000 front 2024-04-01T07:06:35.451212+0000 (oldest deadline 2024-04-01T07:07:00.051415+0000) 2024-04-01T07:07:11.391 INFO:journalctl@ceph.osd.5.smithi153.stdout:Apr 01 07:07:11 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-5[62405]: 2024-04-01T07:07:11.154+0000 7fbc40164700 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:40.052076+0000 front 2024-04-01T07:06:40.052143+0000 (oldest deadline 2024-04-01T07:07:04.752043+0000) 2024-04-01T07:07:11.391 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:11 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:11.254+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.010250+0000 front 2024-04-01T07:06:34.010446+0000 (oldest deadline 2024-04-01T07:06:57.510323+0000) 2024-04-01T07:07:11.391 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:11 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:11.055+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.346120+0000 front 2024-04-01T07:06:34.346258+0000 (oldest deadline 2024-04-01T07:06:57.846204+0000) 2024-04-01T07:07:11.392 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:11 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:11.055+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:42.547512+0000 front 2024-04-01T07:06:42.547305+0000 (oldest deadline 2024-04-01T07:07:08.447338+0000) 2024-04-01T07:07:11.503 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:11 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:11.061+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.924722+0000 front 2024-04-01T07:06:30.924835+0000 (oldest deadline 2024-04-01T07:06:59.725293+0000) 2024-04-01T07:07:11.503 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:11 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:11.061+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:43.126859+0000 front 2024-04-01T07:06:43.126953+0000 (oldest deadline 2024-04-01T07:07:04.226993+0000) 2024-04-01T07:07:11.512 INFO:journalctl@ceph.osd.6.smithi083.stdout:Apr 01 07:07:11 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-6[78927]: 2024-04-01T07:07:11.186+0000 7fac3176c700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:35.990742+0000 front 2024-04-01T07:06:35.990568+0000 (oldest deadline 2024-04-01T07:07:00.690757+0000) 2024-04-01T07:07:11.513 INFO:journalctl@ceph.osd.6.smithi083.stdout:Apr 01 07:07:11 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-6[78927]: 2024-04-01T07:07:11.186+0000 7fac3176c700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:40.691296+0000 front 2024-04-01T07:06:40.691327+0000 (oldest deadline 2024-04-01T07:07:04.791152+0000) 2024-04-01T07:07:11.513 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:11 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:11.228+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.703525+0000 front 2024-04-01T07:06:30.703502+0000 (oldest deadline 2024-04-01T07:06:57.704368+0000) 2024-04-01T07:07:11.513 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:11 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:11.228+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:40.005521+0000 front 2024-04-01T07:06:40.005539+0000 (oldest deadline 2024-04-01T07:07:04.705500+0000) 2024-04-01T07:07:12.003 INFO:journalctl@ceph.osd.7.smithi145.stdout:Apr 01 07:07:11 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-7[70262]: 2024-04-01T07:07:11.610+0000 7f733adfa700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:41.469716+0000 front 2024-04-01T07:06:41.469693+0000 (oldest deadline 2024-04-01T07:07:04.369836+0000) 2024-04-01T07:07:12.391 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:12 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:12.225+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.010250+0000 front 2024-04-01T07:06:34.010446+0000 (oldest deadline 2024-04-01T07:06:57.510323+0000) 2024-04-01T07:07:12.391 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:12 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:12.058+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.346120+0000 front 2024-04-01T07:06:34.346258+0000 (oldest deadline 2024-04-01T07:06:57.846204+0000) 2024-04-01T07:07:12.391 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:12 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:12.058+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:42.547512+0000 front 2024-04-01T07:06:42.547305+0000 (oldest deadline 2024-04-01T07:07:08.447338+0000) 2024-04-01T07:07:12.503 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:12 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:12.027+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.924722+0000 front 2024-04-01T07:06:30.924835+0000 (oldest deadline 2024-04-01T07:06:59.725293+0000) 2024-04-01T07:07:12.503 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:12 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:12.027+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:43.126859+0000 front 2024-04-01T07:06:43.126953+0000 (oldest deadline 2024-04-01T07:07:04.226993+0000) 2024-04-01T07:07:12.512 INFO:journalctl@ceph.osd.6.smithi083.stdout:Apr 01 07:07:12 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-6[78927]: 2024-04-01T07:07:12.148+0000 7fac3176c700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:35.990742+0000 front 2024-04-01T07:06:35.990568+0000 (oldest deadline 2024-04-01T07:07:00.690757+0000) 2024-04-01T07:07:12.512 INFO:journalctl@ceph.osd.6.smithi083.stdout:Apr 01 07:07:12 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-6[78927]: 2024-04-01T07:07:12.148+0000 7fac3176c700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:40.691296+0000 front 2024-04-01T07:06:40.691327+0000 (oldest deadline 2024-04-01T07:07:04.791152+0000) 2024-04-01T07:07:12.513 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:12 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:12.255+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.703525+0000 front 2024-04-01T07:06:30.703502+0000 (oldest deadline 2024-04-01T07:06:57.704368+0000) 2024-04-01T07:07:12.513 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:12 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:12.255+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:40.005521+0000 front 2024-04-01T07:06:40.005539+0000 (oldest deadline 2024-04-01T07:07:04.705500+0000) 2024-04-01T07:07:12.513 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:12 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:12.255+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:47.006770+0000 front 2024-04-01T07:06:47.006861+0000 (oldest deadline 2024-04-01T07:07:11.706594+0000) 2024-04-01T07:07:12.890 INFO:journalctl@ceph.osd.5.smithi153.stdout:Apr 01 07:07:12 smithi153 bash[92232]: ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-5 2024-04-01T07:07:12.982 INFO:journalctl@ceph.osd.7.smithi145.stdout:Apr 01 07:07:12 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-7[70262]: 2024-04-01T07:07:12.632+0000 7f733adfa700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:41.469716+0000 front 2024-04-01T07:06:41.469693+0000 (oldest deadline 2024-04-01T07:07:04.369836+0000) 2024-04-01T07:07:12.982 INFO:journalctl@ceph.osd.7.smithi145.stdout:Apr 01 07:07:12 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-7[70262]: 2024-04-01T07:07:12.632+0000 7f733adfa700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:47.771476+0000 front 2024-04-01T07:06:47.771405+0000 (oldest deadline 2024-04-01T07:07:12.471470+0000) 2024-04-01T07:07:13.252 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:12 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:12.982+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.924722+0000 front 2024-04-01T07:06:30.924835+0000 (oldest deadline 2024-04-01T07:06:59.725293+0000) 2024-04-01T07:07:13.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:12 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:12.982+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:43.126859+0000 front 2024-04-01T07:06:43.126953+0000 (oldest deadline 2024-04-01T07:07:04.226993+0000) 2024-04-01T07:07:13.391 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:13 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:13.226+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.010250+0000 front 2024-04-01T07:06:34.010446+0000 (oldest deadline 2024-04-01T07:06:57.510323+0000) 2024-04-01T07:07:13.391 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:13 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:13.097+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.346120+0000 front 2024-04-01T07:06:34.346258+0000 (oldest deadline 2024-04-01T07:06:57.846204+0000) 2024-04-01T07:07:13.391 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:13 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:13.097+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:42.547512+0000 front 2024-04-01T07:06:42.547305+0000 (oldest deadline 2024-04-01T07:07:08.447338+0000) 2024-04-01T07:07:13.391 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:13 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:13.097+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.148326+0000 front 2024-04-01T07:06:50.148134+0000 (oldest deadline 2024-04-01T07:07:12.448250+0000) 2024-04-01T07:07:13.512 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:13 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:13.214+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.703525+0000 front 2024-04-01T07:06:30.703502+0000 (oldest deadline 2024-04-01T07:06:57.704368+0000) 2024-04-01T07:07:13.513 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:13 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:13.214+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:40.005521+0000 front 2024-04-01T07:06:40.005539+0000 (oldest deadline 2024-04-01T07:07:04.705500+0000) 2024-04-01T07:07:13.513 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:13 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:13.214+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:47.006770+0000 front 2024-04-01T07:06:47.006861+0000 (oldest deadline 2024-04-01T07:07:11.706594+0000) 2024-04-01T07:07:13.513 INFO:journalctl@ceph.osd.6.smithi083.stdout:Apr 01 07:07:13 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-6[78927]: 2024-04-01T07:07:13.161+0000 7fac3176c700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:35.990742+0000 front 2024-04-01T07:06:35.990568+0000 (oldest deadline 2024-04-01T07:07:00.690757+0000) 2024-04-01T07:07:13.513 INFO:journalctl@ceph.osd.6.smithi083.stdout:Apr 01 07:07:13 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-6[78927]: 2024-04-01T07:07:13.161+0000 7fac3176c700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:40.691296+0000 front 2024-04-01T07:06:40.691327+0000 (oldest deadline 2024-04-01T07:07:04.791152+0000) 2024-04-01T07:07:13.884 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@osd.5.service' 2024-04-01T07:07:13.926 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-01T07:07:13.926 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-04-01T07:07:13.926 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-04-01T07:07:13.927 DEBUG:teuthology.orchestra.run.smithi083:> sudo systemctl stop ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@osd.6 2024-04-01T07:07:13.988 INFO:journalctl@ceph.osd.7.smithi145.stdout:Apr 01 07:07:13 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-7[70262]: 2024-04-01T07:07:13.635+0000 7f733adfa700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:41.469716+0000 front 2024-04-01T07:06:41.469693+0000 (oldest deadline 2024-04-01T07:07:04.369836+0000) 2024-04-01T07:07:13.988 INFO:journalctl@ceph.osd.7.smithi145.stdout:Apr 01 07:07:13 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-7[70262]: 2024-04-01T07:07:13.635+0000 7f733adfa700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:47.771476+0000 front 2024-04-01T07:06:47.771405+0000 (oldest deadline 2024-04-01T07:07:12.471470+0000) 2024-04-01T07:07:14.140 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:14 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:14.108+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.346120+0000 front 2024-04-01T07:06:34.346258+0000 (oldest deadline 2024-04-01T07:06:57.846204+0000) 2024-04-01T07:07:14.141 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:14 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:14.108+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:42.547512+0000 front 2024-04-01T07:06:42.547305+0000 (oldest deadline 2024-04-01T07:07:08.447338+0000) 2024-04-01T07:07:14.141 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:14 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:14.108+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.148326+0000 front 2024-04-01T07:06:50.148134+0000 (oldest deadline 2024-04-01T07:07:12.448250+0000) 2024-04-01T07:07:14.245 INFO:journalctl@ceph.osd.6.smithi083.stdout:Apr 01 07:07:13 smithi083 systemd[1]: Stopping Ceph osd.6 for c6f8eff4-eff3-11ee-b647-cb9ed24678a4... 2024-04-01T07:07:14.245 INFO:journalctl@ceph.osd.6.smithi083.stdout:Apr 01 07:07:14 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-6[78927]: 2024-04-01T07:07:14.154+0000 7fac3176c700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:35.990742+0000 front 2024-04-01T07:06:35.990568+0000 (oldest deadline 2024-04-01T07:07:00.690757+0000) 2024-04-01T07:07:14.245 INFO:journalctl@ceph.osd.6.smithi083.stdout:Apr 01 07:07:14 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-6[78927]: 2024-04-01T07:07:14.154+0000 7fac3176c700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:40.691296+0000 front 2024-04-01T07:06:40.691327+0000 (oldest deadline 2024-04-01T07:07:04.791152+0000) 2024-04-01T07:07:14.245 INFO:journalctl@ceph.osd.6.smithi083.stdout:Apr 01 07:07:14 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-6[78927]: 2024-04-01T07:07:14.154+0000 7fac3176c700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.592975+0000 front 2024-04-01T07:06:50.592910+0000 (oldest deadline 2024-04-01T07:07:14.092763+0000) 2024-04-01T07:07:14.245 INFO:journalctl@ceph.osd.6.smithi083.stdout:Apr 01 07:07:14 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-6[78927]: 2024-04-01T07:07:14.165+0000 7fac35176700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-01T07:07:14.245 INFO:journalctl@ceph.osd.6.smithi083.stdout:Apr 01 07:07:14 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-6[78927]: 2024-04-01T07:07:14.165+0000 7fac35176700 -1 osd.6 95 *** Got signal Terminated *** 2024-04-01T07:07:14.245 INFO:journalctl@ceph.osd.6.smithi083.stdout:Apr 01 07:07:14 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-6[78927]: 2024-04-01T07:07:14.165+0000 7fac35176700 -1 osd.6 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-01T07:07:14.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:13 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:13.988+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.924722+0000 front 2024-04-01T07:06:30.924835+0000 (oldest deadline 2024-04-01T07:06:59.725293+0000) 2024-04-01T07:07:14.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:13 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:13.988+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:43.126859+0000 front 2024-04-01T07:06:43.126953+0000 (oldest deadline 2024-04-01T07:07:04.226993+0000) 2024-04-01T07:07:14.512 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:14 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:14.244+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.703525+0000 front 2024-04-01T07:06:30.703502+0000 (oldest deadline 2024-04-01T07:06:57.704368+0000) 2024-04-01T07:07:14.513 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:14 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:14.244+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:40.005521+0000 front 2024-04-01T07:06:40.005539+0000 (oldest deadline 2024-04-01T07:07:04.705500+0000) 2024-04-01T07:07:14.513 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:14 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:14.244+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:47.006770+0000 front 2024-04-01T07:06:47.006861+0000 (oldest deadline 2024-04-01T07:07:11.706594+0000) 2024-04-01T07:07:14.641 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:14 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:14.202+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.010250+0000 front 2024-04-01T07:06:34.010446+0000 (oldest deadline 2024-04-01T07:06:57.510323+0000) 2024-04-01T07:07:14.980 INFO:journalctl@ceph.osd.7.smithi145.stdout:Apr 01 07:07:14 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-7[70262]: 2024-04-01T07:07:14.650+0000 7f733adfa700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:41.469716+0000 front 2024-04-01T07:06:41.469693+0000 (oldest deadline 2024-04-01T07:07:04.369836+0000) 2024-04-01T07:07:14.980 INFO:journalctl@ceph.osd.7.smithi145.stdout:Apr 01 07:07:14 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-7[70262]: 2024-04-01T07:07:14.650+0000 7f733adfa700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:47.771476+0000 front 2024-04-01T07:06:47.771405+0000 (oldest deadline 2024-04-01T07:07:12.471470+0000) 2024-04-01T07:07:15.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:14 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:14.980+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.924722+0000 front 2024-04-01T07:06:30.924835+0000 (oldest deadline 2024-04-01T07:06:59.725293+0000) 2024-04-01T07:07:15.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:14 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:14.980+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:43.126859+0000 front 2024-04-01T07:06:43.126953+0000 (oldest deadline 2024-04-01T07:07:04.226993+0000) 2024-04-01T07:07:15.391 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:15 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:15.194+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.010250+0000 front 2024-04-01T07:06:34.010446+0000 (oldest deadline 2024-04-01T07:06:57.510323+0000) 2024-04-01T07:07:15.391 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:15 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:15.194+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:48.513144+0000 front 2024-04-01T07:06:48.513170+0000 (oldest deadline 2024-04-01T07:07:14.413356+0000) 2024-04-01T07:07:15.391 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:15 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:15.105+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.346120+0000 front 2024-04-01T07:06:34.346258+0000 (oldest deadline 2024-04-01T07:06:57.846204+0000) 2024-04-01T07:07:15.391 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:15 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:15.105+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:42.547512+0000 front 2024-04-01T07:06:42.547305+0000 (oldest deadline 2024-04-01T07:07:08.447338+0000) 2024-04-01T07:07:15.391 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:15 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:15.105+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.148326+0000 front 2024-04-01T07:06:50.148134+0000 (oldest deadline 2024-04-01T07:07:12.448250+0000) 2024-04-01T07:07:15.513 INFO:journalctl@ceph.osd.6.smithi083.stdout:Apr 01 07:07:15 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-6[78927]: 2024-04-01T07:07:15.202+0000 7fac3176c700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:35.990742+0000 front 2024-04-01T07:06:35.990568+0000 (oldest deadline 2024-04-01T07:07:00.690757+0000) 2024-04-01T07:07:15.513 INFO:journalctl@ceph.osd.6.smithi083.stdout:Apr 01 07:07:15 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-6[78927]: 2024-04-01T07:07:15.202+0000 7fac3176c700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:40.691296+0000 front 2024-04-01T07:06:40.691327+0000 (oldest deadline 2024-04-01T07:07:04.791152+0000) 2024-04-01T07:07:15.513 INFO:journalctl@ceph.osd.6.smithi083.stdout:Apr 01 07:07:15 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-6[78927]: 2024-04-01T07:07:15.202+0000 7fac3176c700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.592975+0000 front 2024-04-01T07:06:50.592910+0000 (oldest deadline 2024-04-01T07:07:14.092763+0000) 2024-04-01T07:07:15.513 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:15 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:15.260+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.703525+0000 front 2024-04-01T07:06:30.703502+0000 (oldest deadline 2024-04-01T07:06:57.704368+0000) 2024-04-01T07:07:15.513 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:15 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:15.260+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:40.005521+0000 front 2024-04-01T07:06:40.005539+0000 (oldest deadline 2024-04-01T07:07:04.705500+0000) 2024-04-01T07:07:15.513 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:15 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:15.260+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:47.006770+0000 front 2024-04-01T07:06:47.006861+0000 (oldest deadline 2024-04-01T07:07:11.706594+0000) 2024-04-01T07:07:15.972 INFO:journalctl@ceph.osd.7.smithi145.stdout:Apr 01 07:07:15 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-7[70262]: 2024-04-01T07:07:15.666+0000 7f733adfa700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:41.469716+0000 front 2024-04-01T07:06:41.469693+0000 (oldest deadline 2024-04-01T07:07:04.369836+0000) 2024-04-01T07:07:15.972 INFO:journalctl@ceph.osd.7.smithi145.stdout:Apr 01 07:07:15 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-7[70262]: 2024-04-01T07:07:15.666+0000 7f733adfa700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:47.771476+0000 front 2024-04-01T07:06:47.771405+0000 (oldest deadline 2024-04-01T07:07:12.471470+0000) 2024-04-01T07:07:16.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:15 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:15.973+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.924722+0000 front 2024-04-01T07:06:30.924835+0000 (oldest deadline 2024-04-01T07:06:59.725293+0000) 2024-04-01T07:07:16.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:15 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:15.973+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:43.126859+0000 front 2024-04-01T07:06:43.126953+0000 (oldest deadline 2024-04-01T07:07:04.226993+0000) 2024-04-01T07:07:16.391 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:16 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:16.157+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.010250+0000 front 2024-04-01T07:06:34.010446+0000 (oldest deadline 2024-04-01T07:06:57.510323+0000) 2024-04-01T07:07:16.391 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:16 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:16.157+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:48.513144+0000 front 2024-04-01T07:06:48.513170+0000 (oldest deadline 2024-04-01T07:07:14.413356+0000) 2024-04-01T07:07:16.391 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:16 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:16.101+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.346120+0000 front 2024-04-01T07:06:34.346258+0000 (oldest deadline 2024-04-01T07:06:57.846204+0000) 2024-04-01T07:07:16.391 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:16 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:16.101+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:42.547512+0000 front 2024-04-01T07:06:42.547305+0000 (oldest deadline 2024-04-01T07:07:08.447338+0000) 2024-04-01T07:07:16.391 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:16 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:16.101+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.148326+0000 front 2024-04-01T07:06:50.148134+0000 (oldest deadline 2024-04-01T07:07:12.448250+0000) 2024-04-01T07:07:16.512 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:16 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:16.282+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.703525+0000 front 2024-04-01T07:06:30.703502+0000 (oldest deadline 2024-04-01T07:06:57.704368+0000) 2024-04-01T07:07:16.513 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:16 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:16.282+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:40.005521+0000 front 2024-04-01T07:06:40.005539+0000 (oldest deadline 2024-04-01T07:07:04.705500+0000) 2024-04-01T07:07:16.513 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:16 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:16.282+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:47.006770+0000 front 2024-04-01T07:06:47.006861+0000 (oldest deadline 2024-04-01T07:07:11.706594+0000) 2024-04-01T07:07:16.513 INFO:journalctl@ceph.osd.6.smithi083.stdout:Apr 01 07:07:16 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-6[78927]: 2024-04-01T07:07:16.183+0000 7fac3176c700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:35.990742+0000 front 2024-04-01T07:06:35.990568+0000 (oldest deadline 2024-04-01T07:07:00.690757+0000) 2024-04-01T07:07:16.513 INFO:journalctl@ceph.osd.6.smithi083.stdout:Apr 01 07:07:16 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-6[78927]: 2024-04-01T07:07:16.183+0000 7fac3176c700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:40.691296+0000 front 2024-04-01T07:06:40.691327+0000 (oldest deadline 2024-04-01T07:07:04.791152+0000) 2024-04-01T07:07:16.513 INFO:journalctl@ceph.osd.6.smithi083.stdout:Apr 01 07:07:16 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-6[78927]: 2024-04-01T07:07:16.183+0000 7fac3176c700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.592975+0000 front 2024-04-01T07:06:50.592910+0000 (oldest deadline 2024-04-01T07:07:14.092763+0000) 2024-04-01T07:07:16.989 INFO:journalctl@ceph.osd.7.smithi145.stdout:Apr 01 07:07:16 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-7[70262]: 2024-04-01T07:07:16.685+0000 7f733adfa700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:41.469716+0000 front 2024-04-01T07:06:41.469693+0000 (oldest deadline 2024-04-01T07:07:04.369836+0000) 2024-04-01T07:07:16.989 INFO:journalctl@ceph.osd.7.smithi145.stdout:Apr 01 07:07:16 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-7[70262]: 2024-04-01T07:07:16.685+0000 7f733adfa700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:47.771476+0000 front 2024-04-01T07:06:47.771405+0000 (oldest deadline 2024-04-01T07:07:12.471470+0000) 2024-04-01T07:07:17.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:16 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:16.989+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.924722+0000 front 2024-04-01T07:06:30.924835+0000 (oldest deadline 2024-04-01T07:06:59.725293+0000) 2024-04-01T07:07:17.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:16 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:16.989+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:43.126859+0000 front 2024-04-01T07:06:43.126953+0000 (oldest deadline 2024-04-01T07:07:04.226993+0000) 2024-04-01T07:07:17.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:16 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:16.989+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.230698+0000 front 2024-04-01T07:06:50.230866+0000 (oldest deadline 2024-04-01T07:07:16.130734+0000) 2024-04-01T07:07:17.391 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:17 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:17.137+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.010250+0000 front 2024-04-01T07:06:34.010446+0000 (oldest deadline 2024-04-01T07:06:57.510323+0000) 2024-04-01T07:07:17.391 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:17 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:17.137+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:48.513144+0000 front 2024-04-01T07:06:48.513170+0000 (oldest deadline 2024-04-01T07:07:14.413356+0000) 2024-04-01T07:07:17.391 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:17 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:17.150+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.346120+0000 front 2024-04-01T07:06:34.346258+0000 (oldest deadline 2024-04-01T07:06:57.846204+0000) 2024-04-01T07:07:17.391 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:17 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:17.150+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:42.547512+0000 front 2024-04-01T07:06:42.547305+0000 (oldest deadline 2024-04-01T07:07:08.447338+0000) 2024-04-01T07:07:17.391 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:17 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:17.150+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.148326+0000 front 2024-04-01T07:06:50.148134+0000 (oldest deadline 2024-04-01T07:07:12.448250+0000) 2024-04-01T07:07:17.512 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:17 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:17.307+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.703525+0000 front 2024-04-01T07:06:30.703502+0000 (oldest deadline 2024-04-01T07:06:57.704368+0000) 2024-04-01T07:07:17.513 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:17 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:17.307+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:40.005521+0000 front 2024-04-01T07:06:40.005539+0000 (oldest deadline 2024-04-01T07:07:04.705500+0000) 2024-04-01T07:07:17.513 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:17 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:17.307+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:47.006770+0000 front 2024-04-01T07:06:47.006861+0000 (oldest deadline 2024-04-01T07:07:11.706594+0000) 2024-04-01T07:07:17.513 INFO:journalctl@ceph.osd.6.smithi083.stdout:Apr 01 07:07:17 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-6[78927]: 2024-04-01T07:07:17.134+0000 7fac3176c700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:35.990742+0000 front 2024-04-01T07:06:35.990568+0000 (oldest deadline 2024-04-01T07:07:00.690757+0000) 2024-04-01T07:07:17.513 INFO:journalctl@ceph.osd.6.smithi083.stdout:Apr 01 07:07:17 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-6[78927]: 2024-04-01T07:07:17.134+0000 7fac3176c700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:40.691296+0000 front 2024-04-01T07:06:40.691327+0000 (oldest deadline 2024-04-01T07:07:04.791152+0000) 2024-04-01T07:07:17.513 INFO:journalctl@ceph.osd.6.smithi083.stdout:Apr 01 07:07:17 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-6[78927]: 2024-04-01T07:07:17.134+0000 7fac3176c700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.592975+0000 front 2024-04-01T07:06:50.592910+0000 (oldest deadline 2024-04-01T07:07:14.092763+0000) 2024-04-01T07:07:18.003 INFO:journalctl@ceph.osd.7.smithi145.stdout:Apr 01 07:07:17 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-7[70262]: 2024-04-01T07:07:17.640+0000 7f733adfa700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:41.469716+0000 front 2024-04-01T07:06:41.469693+0000 (oldest deadline 2024-04-01T07:07:04.369836+0000) 2024-04-01T07:07:18.003 INFO:journalctl@ceph.osd.7.smithi145.stdout:Apr 01 07:07:17 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-7[70262]: 2024-04-01T07:07:17.640+0000 7f733adfa700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:47.771476+0000 front 2024-04-01T07:06:47.771405+0000 (oldest deadline 2024-04-01T07:07:12.471470+0000) 2024-04-01T07:07:18.391 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:18 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:18.103+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.010250+0000 front 2024-04-01T07:06:34.010446+0000 (oldest deadline 2024-04-01T07:06:57.510323+0000) 2024-04-01T07:07:18.391 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:18 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:18.103+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:48.513144+0000 front 2024-04-01T07:06:48.513170+0000 (oldest deadline 2024-04-01T07:07:14.413356+0000) 2024-04-01T07:07:18.391 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:18 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:18.155+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.346120+0000 front 2024-04-01T07:06:34.346258+0000 (oldest deadline 2024-04-01T07:06:57.846204+0000) 2024-04-01T07:07:18.391 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:18 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:18.155+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:42.547512+0000 front 2024-04-01T07:06:42.547305+0000 (oldest deadline 2024-04-01T07:07:08.447338+0000) 2024-04-01T07:07:18.391 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:18 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:18.155+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.148326+0000 front 2024-04-01T07:06:50.148134+0000 (oldest deadline 2024-04-01T07:07:12.448250+0000) 2024-04-01T07:07:18.502 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:18 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:18.009+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.924722+0000 front 2024-04-01T07:06:30.924835+0000 (oldest deadline 2024-04-01T07:06:59.725293+0000) 2024-04-01T07:07:18.503 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:18 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:18.009+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:43.126859+0000 front 2024-04-01T07:06:43.126953+0000 (oldest deadline 2024-04-01T07:07:04.226993+0000) 2024-04-01T07:07:18.503 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:18 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:18.009+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.230698+0000 front 2024-04-01T07:06:50.230866+0000 (oldest deadline 2024-04-01T07:07:16.130734+0000) 2024-04-01T07:07:18.512 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:18 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:18.334+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.703525+0000 front 2024-04-01T07:06:30.703502+0000 (oldest deadline 2024-04-01T07:06:57.704368+0000) 2024-04-01T07:07:18.512 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:18 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:18.334+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:40.005521+0000 front 2024-04-01T07:06:40.005539+0000 (oldest deadline 2024-04-01T07:07:04.705500+0000) 2024-04-01T07:07:18.513 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:18 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:18.334+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:47.006770+0000 front 2024-04-01T07:06:47.006861+0000 (oldest deadline 2024-04-01T07:07:11.706594+0000) 2024-04-01T07:07:18.513 INFO:journalctl@ceph.osd.6.smithi083.stdout:Apr 01 07:07:18 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-6[78927]: 2024-04-01T07:07:18.162+0000 7fac3176c700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:35.990742+0000 front 2024-04-01T07:06:35.990568+0000 (oldest deadline 2024-04-01T07:07:00.690757+0000) 2024-04-01T07:07:18.513 INFO:journalctl@ceph.osd.6.smithi083.stdout:Apr 01 07:07:18 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-6[78927]: 2024-04-01T07:07:18.162+0000 7fac3176c700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:40.691296+0000 front 2024-04-01T07:06:40.691327+0000 (oldest deadline 2024-04-01T07:07:04.791152+0000) 2024-04-01T07:07:18.513 INFO:journalctl@ceph.osd.6.smithi083.stdout:Apr 01 07:07:18 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-6[78927]: 2024-04-01T07:07:18.162+0000 7fac3176c700 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.592975+0000 front 2024-04-01T07:06:50.592910+0000 (oldest deadline 2024-04-01T07:07:14.092763+0000) 2024-04-01T07:07:18.977 INFO:journalctl@ceph.osd.7.smithi145.stdout:Apr 01 07:07:18 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-7[70262]: 2024-04-01T07:07:18.679+0000 7f733adfa700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:41.469716+0000 front 2024-04-01T07:06:41.469693+0000 (oldest deadline 2024-04-01T07:07:04.369836+0000) 2024-04-01T07:07:18.978 INFO:journalctl@ceph.osd.7.smithi145.stdout:Apr 01 07:07:18 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-7[70262]: 2024-04-01T07:07:18.679+0000 7f733adfa700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:47.771476+0000 front 2024-04-01T07:06:47.771405+0000 (oldest deadline 2024-04-01T07:07:12.471470+0000) 2024-04-01T07:07:19.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:18 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:18.978+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.924722+0000 front 2024-04-01T07:06:30.924835+0000 (oldest deadline 2024-04-01T07:06:59.725293+0000) 2024-04-01T07:07:19.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:18 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:18.978+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:43.126859+0000 front 2024-04-01T07:06:43.126953+0000 (oldest deadline 2024-04-01T07:07:04.226993+0000) 2024-04-01T07:07:19.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:18 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:18.978+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.230698+0000 front 2024-04-01T07:06:50.230866+0000 (oldest deadline 2024-04-01T07:07:16.130734+0000) 2024-04-01T07:07:19.391 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:19 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:19.117+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.010250+0000 front 2024-04-01T07:06:34.010446+0000 (oldest deadline 2024-04-01T07:06:57.510323+0000) 2024-04-01T07:07:19.391 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:19 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:19.117+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:48.513144+0000 front 2024-04-01T07:06:48.513170+0000 (oldest deadline 2024-04-01T07:07:14.413356+0000) 2024-04-01T07:07:19.391 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:19 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:19.117+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:54.414028+0000 front 2024-04-01T07:06:54.414017+0000 (oldest deadline 2024-04-01T07:07:19.113836+0000) 2024-04-01T07:07:19.391 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:19 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:19.165+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.346120+0000 front 2024-04-01T07:06:34.346258+0000 (oldest deadline 2024-04-01T07:06:57.846204+0000) 2024-04-01T07:07:19.391 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:19 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:19.165+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:42.547512+0000 front 2024-04-01T07:06:42.547305+0000 (oldest deadline 2024-04-01T07:07:08.447338+0000) 2024-04-01T07:07:19.391 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:19 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:19.165+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.148326+0000 front 2024-04-01T07:06:50.148134+0000 (oldest deadline 2024-04-01T07:07:12.448250+0000) 2024-04-01T07:07:19.645 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:19 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:19.297+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.703525+0000 front 2024-04-01T07:06:30.703502+0000 (oldest deadline 2024-04-01T07:06:57.704368+0000) 2024-04-01T07:07:19.645 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:19 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:19.297+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:40.005521+0000 front 2024-04-01T07:06:40.005539+0000 (oldest deadline 2024-04-01T07:07:04.705500+0000) 2024-04-01T07:07:19.645 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:19 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:19.297+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:47.006770+0000 front 2024-04-01T07:06:47.006861+0000 (oldest deadline 2024-04-01T07:07:11.706594+0000) 2024-04-01T07:07:19.988 INFO:journalctl@ceph.osd.7.smithi145.stdout:Apr 01 07:07:19 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-7[70262]: 2024-04-01T07:07:19.670+0000 7f733adfa700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:41.469716+0000 front 2024-04-01T07:06:41.469693+0000 (oldest deadline 2024-04-01T07:07:04.369836+0000) 2024-04-01T07:07:19.988 INFO:journalctl@ceph.osd.7.smithi145.stdout:Apr 01 07:07:19 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-7[70262]: 2024-04-01T07:07:19.670+0000 7f733adfa700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:47.771476+0000 front 2024-04-01T07:06:47.771405+0000 (oldest deadline 2024-04-01T07:07:12.471470+0000) 2024-04-01T07:07:20.012 INFO:journalctl@ceph.osd.6.smithi083.stdout:Apr 01 07:07:19 smithi083 bash[118972]: ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-6 2024-04-01T07:07:20.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:19 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:19.989+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.924722+0000 front 2024-04-01T07:06:30.924835+0000 (oldest deadline 2024-04-01T07:06:59.725293+0000) 2024-04-01T07:07:20.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:19 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:19.989+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:43.126859+0000 front 2024-04-01T07:06:43.126953+0000 (oldest deadline 2024-04-01T07:07:04.226993+0000) 2024-04-01T07:07:20.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:19 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:19.989+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.230698+0000 front 2024-04-01T07:06:50.230866+0000 (oldest deadline 2024-04-01T07:07:16.130734+0000) 2024-04-01T07:07:20.513 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:20 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:20.335+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.703525+0000 front 2024-04-01T07:06:30.703502+0000 (oldest deadline 2024-04-01T07:06:57.704368+0000) 2024-04-01T07:07:20.513 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:20 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:20.335+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:40.005521+0000 front 2024-04-01T07:06:40.005539+0000 (oldest deadline 2024-04-01T07:07:04.705500+0000) 2024-04-01T07:07:20.513 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:20 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:20.335+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:47.006770+0000 front 2024-04-01T07:06:47.006861+0000 (oldest deadline 2024-04-01T07:07:11.706594+0000) 2024-04-01T07:07:20.640 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:20 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:20.165+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.010250+0000 front 2024-04-01T07:06:34.010446+0000 (oldest deadline 2024-04-01T07:06:57.510323+0000) 2024-04-01T07:07:20.641 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:20 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:20.166+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:48.513144+0000 front 2024-04-01T07:06:48.513170+0000 (oldest deadline 2024-04-01T07:07:14.413356+0000) 2024-04-01T07:07:20.641 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:20 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:20.166+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:54.414028+0000 front 2024-04-01T07:06:54.414017+0000 (oldest deadline 2024-04-01T07:07:19.113836+0000) 2024-04-01T07:07:20.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:20 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:20.149+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.346120+0000 front 2024-04-01T07:06:34.346258+0000 (oldest deadline 2024-04-01T07:06:57.846204+0000) 2024-04-01T07:07:20.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:20 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:20.149+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:42.547512+0000 front 2024-04-01T07:06:42.547305+0000 (oldest deadline 2024-04-01T07:07:08.447338+0000) 2024-04-01T07:07:20.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:20 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:20.149+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.148326+0000 front 2024-04-01T07:06:50.148134+0000 (oldest deadline 2024-04-01T07:07:12.448250+0000) 2024-04-01T07:07:20.911 DEBUG:teuthology.orchestra.run.smithi083:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@osd.6.service' 2024-04-01T07:07:20.952 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-01T07:07:20.952 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-04-01T07:07:20.952 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-04-01T07:07:20.952 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@osd.7 2024-04-01T07:07:20.955 INFO:journalctl@ceph.osd.7.smithi145.stdout:Apr 01 07:07:20 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-7[70262]: 2024-04-01T07:07:20.665+0000 7f733adfa700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:41.469716+0000 front 2024-04-01T07:06:41.469693+0000 (oldest deadline 2024-04-01T07:07:04.369836+0000) 2024-04-01T07:07:20.955 INFO:journalctl@ceph.osd.7.smithi145.stdout:Apr 01 07:07:20 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-7[70262]: 2024-04-01T07:07:20.665+0000 7f733adfa700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:47.771476+0000 front 2024-04-01T07:06:47.771405+0000 (oldest deadline 2024-04-01T07:07:12.471470+0000) 2024-04-01T07:07:21.218 INFO:journalctl@ceph.osd.7.smithi145.stdout:Apr 01 07:07:20 smithi145 systemd[1]: Stopping Ceph osd.7 for c6f8eff4-eff3-11ee-b647-cb9ed24678a4... 2024-04-01T07:07:21.218 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:20 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:20.954+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.924722+0000 front 2024-04-01T07:06:30.924835+0000 (oldest deadline 2024-04-01T07:06:59.725293+0000) 2024-04-01T07:07:21.218 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:20 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:20.955+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:43.126859+0000 front 2024-04-01T07:06:43.126953+0000 (oldest deadline 2024-04-01T07:07:04.226993+0000) 2024-04-01T07:07:21.218 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:20 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:20.955+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.230698+0000 front 2024-04-01T07:06:50.230866+0000 (oldest deadline 2024-04-01T07:07:16.130734+0000) 2024-04-01T07:07:21.219 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:20 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:20.955+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:56.131462+0000 front 2024-04-01T07:06:56.131400+0000 (oldest deadline 2024-04-01T07:07:20.231303+0000) 2024-04-01T07:07:21.503 INFO:journalctl@ceph.osd.7.smithi145.stdout:Apr 01 07:07:21 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-7[70262]: 2024-04-01T07:07:21.218+0000 7f734280c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-01T07:07:21.503 INFO:journalctl@ceph.osd.7.smithi145.stdout:Apr 01 07:07:21 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-7[70262]: 2024-04-01T07:07:21.218+0000 7f734280c700 -1 osd.7 95 *** Got signal Terminated *** 2024-04-01T07:07:21.503 INFO:journalctl@ceph.osd.7.smithi145.stdout:Apr 01 07:07:21 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-7[70262]: 2024-04-01T07:07:21.218+0000 7f734280c700 -1 osd.7 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-01T07:07:21.641 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:21 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:21.181+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.010250+0000 front 2024-04-01T07:06:34.010446+0000 (oldest deadline 2024-04-01T07:06:57.510323+0000) 2024-04-01T07:07:21.641 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:21 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:21.181+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:48.513144+0000 front 2024-04-01T07:06:48.513170+0000 (oldest deadline 2024-04-01T07:07:14.413356+0000) 2024-04-01T07:07:21.641 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:21 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:21.181+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:54.414028+0000 front 2024-04-01T07:06:54.414017+0000 (oldest deadline 2024-04-01T07:07:19.113836+0000) 2024-04-01T07:07:21.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:21 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:21.169+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.346120+0000 front 2024-04-01T07:06:34.346258+0000 (oldest deadline 2024-04-01T07:06:57.846204+0000) 2024-04-01T07:07:21.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:21 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:21.169+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:42.547512+0000 front 2024-04-01T07:06:42.547305+0000 (oldest deadline 2024-04-01T07:07:08.447338+0000) 2024-04-01T07:07:21.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:21 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:21.169+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.148326+0000 front 2024-04-01T07:06:50.148134+0000 (oldest deadline 2024-04-01T07:07:12.448250+0000) 2024-04-01T07:07:21.762 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:21 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:21.341+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.703525+0000 front 2024-04-01T07:06:30.703502+0000 (oldest deadline 2024-04-01T07:06:57.704368+0000) 2024-04-01T07:07:21.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:21 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:21.341+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:40.005521+0000 front 2024-04-01T07:06:40.005539+0000 (oldest deadline 2024-04-01T07:07:04.705500+0000) 2024-04-01T07:07:21.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:21 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:21.341+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:47.006770+0000 front 2024-04-01T07:06:47.006861+0000 (oldest deadline 2024-04-01T07:07:11.706594+0000) 2024-04-01T07:07:22.003 INFO:journalctl@ceph.osd.7.smithi145.stdout:Apr 01 07:07:21 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-7[70262]: 2024-04-01T07:07:21.690+0000 7f733adfa700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:41.469716+0000 front 2024-04-01T07:06:41.469693+0000 (oldest deadline 2024-04-01T07:07:04.369836+0000) 2024-04-01T07:07:22.003 INFO:journalctl@ceph.osd.7.smithi145.stdout:Apr 01 07:07:21 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-7[70262]: 2024-04-01T07:07:21.690+0000 7f733adfa700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:47.771476+0000 front 2024-04-01T07:06:47.771405+0000 (oldest deadline 2024-04-01T07:07:12.471470+0000) 2024-04-01T07:07:22.003 INFO:journalctl@ceph.osd.7.smithi145.stdout:Apr 01 07:07:21 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-7[70262]: 2024-04-01T07:07:21.690+0000 7f733adfa700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:52.471938+0000 front 2024-04-01T07:06:52.471953+0000 (oldest deadline 2024-04-01T07:07:20.672637+0000) 2024-04-01T07:07:22.391 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:22 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:22.186+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.010250+0000 front 2024-04-01T07:06:34.010446+0000 (oldest deadline 2024-04-01T07:06:57.510323+0000) 2024-04-01T07:07:22.391 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:22 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:22.186+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:48.513144+0000 front 2024-04-01T07:06:48.513170+0000 (oldest deadline 2024-04-01T07:07:14.413356+0000) 2024-04-01T07:07:22.391 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:22 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:22.186+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:54.414028+0000 front 2024-04-01T07:06:54.414017+0000 (oldest deadline 2024-04-01T07:07:19.113836+0000) 2024-04-01T07:07:22.391 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:22 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:22.134+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.346120+0000 front 2024-04-01T07:06:34.346258+0000 (oldest deadline 2024-04-01T07:06:57.846204+0000) 2024-04-01T07:07:22.391 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:22 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:22.134+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:42.547512+0000 front 2024-04-01T07:06:42.547305+0000 (oldest deadline 2024-04-01T07:07:08.447338+0000) 2024-04-01T07:07:22.391 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:22 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:22.134+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.148326+0000 front 2024-04-01T07:06:50.148134+0000 (oldest deadline 2024-04-01T07:07:12.448250+0000) 2024-04-01T07:07:22.503 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:22 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:22.004+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.924722+0000 front 2024-04-01T07:06:30.924835+0000 (oldest deadline 2024-04-01T07:06:59.725293+0000) 2024-04-01T07:07:22.503 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:22 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:22.004+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:43.126859+0000 front 2024-04-01T07:06:43.126953+0000 (oldest deadline 2024-04-01T07:07:04.226993+0000) 2024-04-01T07:07:22.503 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:22 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:22.004+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.230698+0000 front 2024-04-01T07:06:50.230866+0000 (oldest deadline 2024-04-01T07:07:16.130734+0000) 2024-04-01T07:07:22.503 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:22 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:22.004+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:56.131462+0000 front 2024-04-01T07:06:56.131400+0000 (oldest deadline 2024-04-01T07:07:20.231303+0000) 2024-04-01T07:07:22.762 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:22 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:22.341+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.703525+0000 front 2024-04-01T07:06:30.703502+0000 (oldest deadline 2024-04-01T07:06:57.704368+0000) 2024-04-01T07:07:22.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:22 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:22.341+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:40.005521+0000 front 2024-04-01T07:06:40.005539+0000 (oldest deadline 2024-04-01T07:07:04.705500+0000) 2024-04-01T07:07:22.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:22 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:22.341+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:47.006770+0000 front 2024-04-01T07:06:47.006861+0000 (oldest deadline 2024-04-01T07:07:11.706594+0000) 2024-04-01T07:07:22.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:22 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:22.341+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:56.709246+0000 front 2024-04-01T07:06:56.709262+0000 (oldest deadline 2024-04-01T07:07:21.409350+0000) 2024-04-01T07:07:22.980 INFO:journalctl@ceph.osd.7.smithi145.stdout:Apr 01 07:07:22 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-7[70262]: 2024-04-01T07:07:22.693+0000 7f733adfa700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:41.469716+0000 front 2024-04-01T07:06:41.469693+0000 (oldest deadline 2024-04-01T07:07:04.369836+0000) 2024-04-01T07:07:22.981 INFO:journalctl@ceph.osd.7.smithi145.stdout:Apr 01 07:07:22 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-7[70262]: 2024-04-01T07:07:22.693+0000 7f733adfa700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:47.771476+0000 front 2024-04-01T07:06:47.771405+0000 (oldest deadline 2024-04-01T07:07:12.471470+0000) 2024-04-01T07:07:22.981 INFO:journalctl@ceph.osd.7.smithi145.stdout:Apr 01 07:07:22 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-7[70262]: 2024-04-01T07:07:22.694+0000 7f733adfa700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:52.471938+0000 front 2024-04-01T07:06:52.471953+0000 (oldest deadline 2024-04-01T07:07:20.672637+0000) 2024-04-01T07:07:23.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:22 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:22.981+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.924722+0000 front 2024-04-01T07:06:30.924835+0000 (oldest deadline 2024-04-01T07:06:59.725293+0000) 2024-04-01T07:07:23.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:22 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:22.981+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:43.126859+0000 front 2024-04-01T07:06:43.126953+0000 (oldest deadline 2024-04-01T07:07:04.226993+0000) 2024-04-01T07:07:23.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:22 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:22.981+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.230698+0000 front 2024-04-01T07:06:50.230866+0000 (oldest deadline 2024-04-01T07:07:16.130734+0000) 2024-04-01T07:07:23.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:22 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:22.981+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:56.131462+0000 front 2024-04-01T07:06:56.131400+0000 (oldest deadline 2024-04-01T07:07:20.231303+0000) 2024-04-01T07:07:23.641 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:23 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:23.168+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.010250+0000 front 2024-04-01T07:06:34.010446+0000 (oldest deadline 2024-04-01T07:06:57.510323+0000) 2024-04-01T07:07:23.641 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:23 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:23.168+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:48.513144+0000 front 2024-04-01T07:06:48.513170+0000 (oldest deadline 2024-04-01T07:07:14.413356+0000) 2024-04-01T07:07:23.641 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:23 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:23.168+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:54.414028+0000 front 2024-04-01T07:06:54.414017+0000 (oldest deadline 2024-04-01T07:07:19.113836+0000) 2024-04-01T07:07:23.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:23 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:23.155+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.346120+0000 front 2024-04-01T07:06:34.346258+0000 (oldest deadline 2024-04-01T07:06:57.846204+0000) 2024-04-01T07:07:23.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:23 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:23.155+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:42.547512+0000 front 2024-04-01T07:06:42.547305+0000 (oldest deadline 2024-04-01T07:07:08.447338+0000) 2024-04-01T07:07:23.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:23 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:23.155+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.148326+0000 front 2024-04-01T07:06:50.148134+0000 (oldest deadline 2024-04-01T07:07:12.448250+0000) 2024-04-01T07:07:23.762 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:23 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:23.351+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.703525+0000 front 2024-04-01T07:06:30.703502+0000 (oldest deadline 2024-04-01T07:06:57.704368+0000) 2024-04-01T07:07:23.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:23 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:23.351+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:40.005521+0000 front 2024-04-01T07:06:40.005539+0000 (oldest deadline 2024-04-01T07:07:04.705500+0000) 2024-04-01T07:07:23.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:23 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:23.351+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:47.006770+0000 front 2024-04-01T07:06:47.006861+0000 (oldest deadline 2024-04-01T07:07:11.706594+0000) 2024-04-01T07:07:23.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:23 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:23.351+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:56.709246+0000 front 2024-04-01T07:06:56.709262+0000 (oldest deadline 2024-04-01T07:07:21.409350+0000) 2024-04-01T07:07:23.948 INFO:journalctl@ceph.osd.7.smithi145.stdout:Apr 01 07:07:23 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-7[70262]: 2024-04-01T07:07:23.691+0000 7f733adfa700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:41.469716+0000 front 2024-04-01T07:06:41.469693+0000 (oldest deadline 2024-04-01T07:07:04.369836+0000) 2024-04-01T07:07:23.948 INFO:journalctl@ceph.osd.7.smithi145.stdout:Apr 01 07:07:23 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-7[70262]: 2024-04-01T07:07:23.691+0000 7f733adfa700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:47.771476+0000 front 2024-04-01T07:06:47.771405+0000 (oldest deadline 2024-04-01T07:07:12.471470+0000) 2024-04-01T07:07:23.949 INFO:journalctl@ceph.osd.7.smithi145.stdout:Apr 01 07:07:23 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-7[70262]: 2024-04-01T07:07:23.691+0000 7f733adfa700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:52.471938+0000 front 2024-04-01T07:06:52.471953+0000 (oldest deadline 2024-04-01T07:07:20.672637+0000) 2024-04-01T07:07:24.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:23 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:23.948+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.924722+0000 front 2024-04-01T07:06:30.924835+0000 (oldest deadline 2024-04-01T07:06:59.725293+0000) 2024-04-01T07:07:24.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:23 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:23.948+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:43.126859+0000 front 2024-04-01T07:06:43.126953+0000 (oldest deadline 2024-04-01T07:07:04.226993+0000) 2024-04-01T07:07:24.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:23 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:23.948+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.230698+0000 front 2024-04-01T07:06:50.230866+0000 (oldest deadline 2024-04-01T07:07:16.130734+0000) 2024-04-01T07:07:24.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:23 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:23.948+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:56.131462+0000 front 2024-04-01T07:06:56.131400+0000 (oldest deadline 2024-04-01T07:07:20.231303+0000) 2024-04-01T07:07:24.391 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:24 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:24.136+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.010250+0000 front 2024-04-01T07:06:34.010446+0000 (oldest deadline 2024-04-01T07:06:57.510323+0000) 2024-04-01T07:07:24.391 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:24 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:24.136+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:48.513144+0000 front 2024-04-01T07:06:48.513170+0000 (oldest deadline 2024-04-01T07:07:14.413356+0000) 2024-04-01T07:07:24.391 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:24 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:24.136+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:54.414028+0000 front 2024-04-01T07:06:54.414017+0000 (oldest deadline 2024-04-01T07:07:19.113836+0000) 2024-04-01T07:07:24.391 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:24 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:24.183+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.346120+0000 front 2024-04-01T07:06:34.346258+0000 (oldest deadline 2024-04-01T07:06:57.846204+0000) 2024-04-01T07:07:24.391 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:24 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:24.183+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:42.547512+0000 front 2024-04-01T07:06:42.547305+0000 (oldest deadline 2024-04-01T07:07:08.447338+0000) 2024-04-01T07:07:24.391 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:24 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:24.183+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.148326+0000 front 2024-04-01T07:06:50.148134+0000 (oldest deadline 2024-04-01T07:07:12.448250+0000) 2024-04-01T07:07:24.762 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:24 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:24.344+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.703525+0000 front 2024-04-01T07:06:30.703502+0000 (oldest deadline 2024-04-01T07:06:57.704368+0000) 2024-04-01T07:07:24.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:24 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:24.344+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:40.005521+0000 front 2024-04-01T07:06:40.005539+0000 (oldest deadline 2024-04-01T07:07:04.705500+0000) 2024-04-01T07:07:24.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:24 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:24.344+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:47.006770+0000 front 2024-04-01T07:06:47.006861+0000 (oldest deadline 2024-04-01T07:07:11.706594+0000) 2024-04-01T07:07:24.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:24 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:24.344+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:56.709246+0000 front 2024-04-01T07:06:56.709262+0000 (oldest deadline 2024-04-01T07:07:21.409350+0000) 2024-04-01T07:07:25.003 INFO:journalctl@ceph.osd.7.smithi145.stdout:Apr 01 07:07:24 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-7[70262]: 2024-04-01T07:07:24.690+0000 7f733adfa700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:41.469716+0000 front 2024-04-01T07:06:41.469693+0000 (oldest deadline 2024-04-01T07:07:04.369836+0000) 2024-04-01T07:07:25.003 INFO:journalctl@ceph.osd.7.smithi145.stdout:Apr 01 07:07:24 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-7[70262]: 2024-04-01T07:07:24.690+0000 7f733adfa700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:47.771476+0000 front 2024-04-01T07:06:47.771405+0000 (oldest deadline 2024-04-01T07:07:12.471470+0000) 2024-04-01T07:07:25.003 INFO:journalctl@ceph.osd.7.smithi145.stdout:Apr 01 07:07:24 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-7[70262]: 2024-04-01T07:07:24.690+0000 7f733adfa700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:52.471938+0000 front 2024-04-01T07:06:52.471953+0000 (oldest deadline 2024-04-01T07:07:20.672637+0000) 2024-04-01T07:07:25.003 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:24 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:24.929+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.924722+0000 front 2024-04-01T07:06:30.924835+0000 (oldest deadline 2024-04-01T07:06:59.725293+0000) 2024-04-01T07:07:25.003 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:24 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:24.929+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:43.126859+0000 front 2024-04-01T07:06:43.126953+0000 (oldest deadline 2024-04-01T07:07:04.226993+0000) 2024-04-01T07:07:25.003 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:24 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:24.929+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.230698+0000 front 2024-04-01T07:06:50.230866+0000 (oldest deadline 2024-04-01T07:07:16.130734+0000) 2024-04-01T07:07:25.003 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:24 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:24.929+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:56.131462+0000 front 2024-04-01T07:06:56.131400+0000 (oldest deadline 2024-04-01T07:07:20.231303+0000) 2024-04-01T07:07:25.641 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:25 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:25.149+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.010250+0000 front 2024-04-01T07:06:34.010446+0000 (oldest deadline 2024-04-01T07:06:57.510323+0000) 2024-04-01T07:07:25.641 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:25 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:25.149+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:48.513144+0000 front 2024-04-01T07:06:48.513170+0000 (oldest deadline 2024-04-01T07:07:14.413356+0000) 2024-04-01T07:07:25.641 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:25 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:25.149+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:54.414028+0000 front 2024-04-01T07:06:54.414017+0000 (oldest deadline 2024-04-01T07:07:19.113836+0000) 2024-04-01T07:07:25.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:25 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:25.191+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.346120+0000 front 2024-04-01T07:06:34.346258+0000 (oldest deadline 2024-04-01T07:06:57.846204+0000) 2024-04-01T07:07:25.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:25 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:25.191+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:42.547512+0000 front 2024-04-01T07:06:42.547305+0000 (oldest deadline 2024-04-01T07:07:08.447338+0000) 2024-04-01T07:07:25.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:25 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:25.191+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.148326+0000 front 2024-04-01T07:06:50.148134+0000 (oldest deadline 2024-04-01T07:07:12.448250+0000) 2024-04-01T07:07:25.762 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:25 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:25.379+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.703525+0000 front 2024-04-01T07:06:30.703502+0000 (oldest deadline 2024-04-01T07:06:57.704368+0000) 2024-04-01T07:07:25.762 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:25 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:25.379+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:40.005521+0000 front 2024-04-01T07:06:40.005539+0000 (oldest deadline 2024-04-01T07:07:04.705500+0000) 2024-04-01T07:07:25.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:25 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:25.379+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:47.006770+0000 front 2024-04-01T07:06:47.006861+0000 (oldest deadline 2024-04-01T07:07:11.706594+0000) 2024-04-01T07:07:25.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:25 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:25.379+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:56.709246+0000 front 2024-04-01T07:06:56.709262+0000 (oldest deadline 2024-04-01T07:07:21.409350+0000) 2024-04-01T07:07:25.919 INFO:journalctl@ceph.osd.7.smithi145.stdout:Apr 01 07:07:25 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-7[70262]: 2024-04-01T07:07:25.645+0000 7f733adfa700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:41.469716+0000 front 2024-04-01T07:06:41.469693+0000 (oldest deadline 2024-04-01T07:07:04.369836+0000) 2024-04-01T07:07:25.919 INFO:journalctl@ceph.osd.7.smithi145.stdout:Apr 01 07:07:25 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-7[70262]: 2024-04-01T07:07:25.645+0000 7f733adfa700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:47.771476+0000 front 2024-04-01T07:06:47.771405+0000 (oldest deadline 2024-04-01T07:07:12.471470+0000) 2024-04-01T07:07:25.919 INFO:journalctl@ceph.osd.7.smithi145.stdout:Apr 01 07:07:25 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-7[70262]: 2024-04-01T07:07:25.645+0000 7f733adfa700 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:52.471938+0000 front 2024-04-01T07:06:52.471953+0000 (oldest deadline 2024-04-01T07:07:20.672637+0000) 2024-04-01T07:07:26.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:25 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:25.919+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.924722+0000 front 2024-04-01T07:06:30.924835+0000 (oldest deadline 2024-04-01T07:06:59.725293+0000) 2024-04-01T07:07:26.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:25 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:25.919+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:43.126859+0000 front 2024-04-01T07:06:43.126953+0000 (oldest deadline 2024-04-01T07:07:04.226993+0000) 2024-04-01T07:07:26.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:25 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:25.919+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.230698+0000 front 2024-04-01T07:06:50.230866+0000 (oldest deadline 2024-04-01T07:07:16.130734+0000) 2024-04-01T07:07:26.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:25 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:25.919+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:56.131462+0000 front 2024-04-01T07:06:56.131400+0000 (oldest deadline 2024-04-01T07:07:20.231303+0000) 2024-04-01T07:07:26.641 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:26 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:26.167+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.010250+0000 front 2024-04-01T07:06:34.010446+0000 (oldest deadline 2024-04-01T07:06:57.510323+0000) 2024-04-01T07:07:26.641 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:26 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:26.167+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:48.513144+0000 front 2024-04-01T07:06:48.513170+0000 (oldest deadline 2024-04-01T07:07:14.413356+0000) 2024-04-01T07:07:26.641 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:26 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:26.167+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:54.414028+0000 front 2024-04-01T07:06:54.414017+0000 (oldest deadline 2024-04-01T07:07:19.113836+0000) 2024-04-01T07:07:26.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:26 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:26.159+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.346120+0000 front 2024-04-01T07:06:34.346258+0000 (oldest deadline 2024-04-01T07:06:57.846204+0000) 2024-04-01T07:07:26.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:26 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:26.159+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:42.547512+0000 front 2024-04-01T07:06:42.547305+0000 (oldest deadline 2024-04-01T07:07:08.447338+0000) 2024-04-01T07:07:26.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:26 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:26.159+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.148326+0000 front 2024-04-01T07:06:50.148134+0000 (oldest deadline 2024-04-01T07:07:12.448250+0000) 2024-04-01T07:07:26.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:26 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:26.159+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:02.950323+0000 front 2024-04-01T07:07:02.950381+0000 (oldest deadline 2024-04-01T07:07:25.250345+0000) 2024-04-01T07:07:26.762 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:26 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:26.368+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.703525+0000 front 2024-04-01T07:06:30.703502+0000 (oldest deadline 2024-04-01T07:06:57.704368+0000) 2024-04-01T07:07:26.762 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:26 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:26.368+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:40.005521+0000 front 2024-04-01T07:06:40.005539+0000 (oldest deadline 2024-04-01T07:07:04.705500+0000) 2024-04-01T07:07:26.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:26 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:26.368+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:47.006770+0000 front 2024-04-01T07:06:47.006861+0000 (oldest deadline 2024-04-01T07:07:11.706594+0000) 2024-04-01T07:07:26.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:26 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:26.368+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:56.709246+0000 front 2024-04-01T07:06:56.709262+0000 (oldest deadline 2024-04-01T07:07:21.409350+0000) 2024-04-01T07:07:27.253 INFO:journalctl@ceph.osd.7.smithi145.stdout:Apr 01 07:07:26 smithi145 bash[91225]: ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-7 2024-04-01T07:07:27.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:26 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:26.918+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.924722+0000 front 2024-04-01T07:06:30.924835+0000 (oldest deadline 2024-04-01T07:06:59.725293+0000) 2024-04-01T07:07:27.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:26 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:26.918+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:43.126859+0000 front 2024-04-01T07:06:43.126953+0000 (oldest deadline 2024-04-01T07:07:04.226993+0000) 2024-04-01T07:07:27.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:26 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:26.918+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.230698+0000 front 2024-04-01T07:06:50.230866+0000 (oldest deadline 2024-04-01T07:07:16.130734+0000) 2024-04-01T07:07:27.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:26 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:26.918+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:56.131462+0000 front 2024-04-01T07:06:56.131400+0000 (oldest deadline 2024-04-01T07:07:20.231303+0000) 2024-04-01T07:07:27.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:26 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:26.918+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:00.231790+0000 front 2024-04-01T07:07:00.231808+0000 (oldest deadline 2024-04-01T07:07:26.131918+0000) 2024-04-01T07:07:27.641 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:27 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:27.154+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.010250+0000 front 2024-04-01T07:06:34.010446+0000 (oldest deadline 2024-04-01T07:06:57.510323+0000) 2024-04-01T07:07:27.641 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:27 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:27.154+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:48.513144+0000 front 2024-04-01T07:06:48.513170+0000 (oldest deadline 2024-04-01T07:07:14.413356+0000) 2024-04-01T07:07:27.641 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:27 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:27.154+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:54.414028+0000 front 2024-04-01T07:06:54.414017+0000 (oldest deadline 2024-04-01T07:07:19.113836+0000) 2024-04-01T07:07:27.641 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:27 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:27.154+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:03.516482+0000 front 2024-04-01T07:07:03.516630+0000 (oldest deadline 2024-04-01T07:07:27.016498+0000) 2024-04-01T07:07:27.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:27 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:27.148+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.346120+0000 front 2024-04-01T07:06:34.346258+0000 (oldest deadline 2024-04-01T07:06:57.846204+0000) 2024-04-01T07:07:27.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:27 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:27.148+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:42.547512+0000 front 2024-04-01T07:06:42.547305+0000 (oldest deadline 2024-04-01T07:07:08.447338+0000) 2024-04-01T07:07:27.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:27 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:27.148+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.148326+0000 front 2024-04-01T07:06:50.148134+0000 (oldest deadline 2024-04-01T07:07:12.448250+0000) 2024-04-01T07:07:27.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:27 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:27.148+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:02.950323+0000 front 2024-04-01T07:07:02.950381+0000 (oldest deadline 2024-04-01T07:07:25.250345+0000) 2024-04-01T07:07:27.762 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:27 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:27.395+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.703525+0000 front 2024-04-01T07:06:30.703502+0000 (oldest deadline 2024-04-01T07:06:57.704368+0000) 2024-04-01T07:07:27.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:27 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:27.395+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:40.005521+0000 front 2024-04-01T07:06:40.005539+0000 (oldest deadline 2024-04-01T07:07:04.705500+0000) 2024-04-01T07:07:27.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:27 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:27.395+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:47.006770+0000 front 2024-04-01T07:06:47.006861+0000 (oldest deadline 2024-04-01T07:07:11.706594+0000) 2024-04-01T07:07:27.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:27 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:27.395+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:56.709246+0000 front 2024-04-01T07:06:56.709262+0000 (oldest deadline 2024-04-01T07:07:21.409350+0000) 2024-04-01T07:07:27.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:27 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:27.395+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:01.409980+0000 front 2024-04-01T07:07:01.410102+0000 (oldest deadline 2024-04-01T07:07:27.309883+0000) 2024-04-01T07:07:28.165 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:27 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:27.869+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.924722+0000 front 2024-04-01T07:06:30.924835+0000 (oldest deadline 2024-04-01T07:06:59.725293+0000) 2024-04-01T07:07:28.165 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:27 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:27.869+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:43.126859+0000 front 2024-04-01T07:06:43.126953+0000 (oldest deadline 2024-04-01T07:07:04.226993+0000) 2024-04-01T07:07:28.165 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:27 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:27.870+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.230698+0000 front 2024-04-01T07:06:50.230866+0000 (oldest deadline 2024-04-01T07:07:16.130734+0000) 2024-04-01T07:07:28.165 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:27 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:27.870+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:56.131462+0000 front 2024-04-01T07:06:56.131400+0000 (oldest deadline 2024-04-01T07:07:20.231303+0000) 2024-04-01T07:07:28.165 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:27 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:27.870+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:00.231790+0000 front 2024-04-01T07:07:00.231808+0000 (oldest deadline 2024-04-01T07:07:26.131918+0000) 2024-04-01T07:07:28.171 DEBUG:teuthology.orchestra.run.smithi145:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@osd.7.service' 2024-04-01T07:07:28.211 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-01T07:07:28.211 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-04-01T07:07:28.211 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-04-01T07:07:28.211 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@osd.8 2024-04-01T07:07:28.391 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:28 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:28.175+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.346120+0000 front 2024-04-01T07:06:34.346258+0000 (oldest deadline 2024-04-01T07:06:57.846204+0000) 2024-04-01T07:07:28.391 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:28 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:28.175+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:42.547512+0000 front 2024-04-01T07:06:42.547305+0000 (oldest deadline 2024-04-01T07:07:08.447338+0000) 2024-04-01T07:07:28.391 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:28 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:28.175+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.148326+0000 front 2024-04-01T07:06:50.148134+0000 (oldest deadline 2024-04-01T07:07:12.448250+0000) 2024-04-01T07:07:28.391 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:28 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:28.175+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:02.950323+0000 front 2024-04-01T07:07:02.950381+0000 (oldest deadline 2024-04-01T07:07:25.250345+0000) 2024-04-01T07:07:28.391 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:28 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:28.132+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.010250+0000 front 2024-04-01T07:06:34.010446+0000 (oldest deadline 2024-04-01T07:06:57.510323+0000) 2024-04-01T07:07:28.391 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:28 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:28.132+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:48.513144+0000 front 2024-04-01T07:06:48.513170+0000 (oldest deadline 2024-04-01T07:07:14.413356+0000) 2024-04-01T07:07:28.391 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:28 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:28.132+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:54.414028+0000 front 2024-04-01T07:06:54.414017+0000 (oldest deadline 2024-04-01T07:07:19.113836+0000) 2024-04-01T07:07:28.391 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:28 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:28.132+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:03.516482+0000 front 2024-04-01T07:07:03.516630+0000 (oldest deadline 2024-04-01T07:07:27.016498+0000) 2024-04-01T07:07:28.391 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:28 smithi153 systemd[1]: Stopping Ceph osd.8 for c6f8eff4-eff3-11ee-b647-cb9ed24678a4... 2024-04-01T07:07:28.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:28 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:28.398+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.703525+0000 front 2024-04-01T07:06:30.703502+0000 (oldest deadline 2024-04-01T07:06:57.704368+0000) 2024-04-01T07:07:28.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:28 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:28.398+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:40.005521+0000 front 2024-04-01T07:06:40.005539+0000 (oldest deadline 2024-04-01T07:07:04.705500+0000) 2024-04-01T07:07:28.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:28 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:28.398+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:47.006770+0000 front 2024-04-01T07:06:47.006861+0000 (oldest deadline 2024-04-01T07:07:11.706594+0000) 2024-04-01T07:07:28.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:28 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:28.398+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:56.709246+0000 front 2024-04-01T07:06:56.709262+0000 (oldest deadline 2024-04-01T07:07:21.409350+0000) 2024-04-01T07:07:28.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:28 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:28.398+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:01.409980+0000 front 2024-04-01T07:07:01.410102+0000 (oldest deadline 2024-04-01T07:07:27.309883+0000) 2024-04-01T07:07:28.890 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:28 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:28.436+0000 7f803e091700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-01T07:07:28.891 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:28 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:28.436+0000 7f803e091700 -1 osd.8 95 *** Got signal Terminated *** 2024-04-01T07:07:28.891 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:28 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:28.436+0000 7f803e091700 -1 osd.8 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-01T07:07:29.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:28 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:28.868+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.924722+0000 front 2024-04-01T07:06:30.924835+0000 (oldest deadline 2024-04-01T07:06:59.725293+0000) 2024-04-01T07:07:29.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:28 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:28.868+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:43.126859+0000 front 2024-04-01T07:06:43.126953+0000 (oldest deadline 2024-04-01T07:07:04.226993+0000) 2024-04-01T07:07:29.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:28 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:28.868+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.230698+0000 front 2024-04-01T07:06:50.230866+0000 (oldest deadline 2024-04-01T07:07:16.130734+0000) 2024-04-01T07:07:29.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:28 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:28.868+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:56.131462+0000 front 2024-04-01T07:06:56.131400+0000 (oldest deadline 2024-04-01T07:07:20.231303+0000) 2024-04-01T07:07:29.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:28 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:28.868+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:00.231790+0000 front 2024-04-01T07:07:00.231808+0000 (oldest deadline 2024-04-01T07:07:26.131918+0000) 2024-04-01T07:07:29.641 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:29 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:29.148+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.010250+0000 front 2024-04-01T07:06:34.010446+0000 (oldest deadline 2024-04-01T07:06:57.510323+0000) 2024-04-01T07:07:29.641 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:29 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:29.148+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:48.513144+0000 front 2024-04-01T07:06:48.513170+0000 (oldest deadline 2024-04-01T07:07:14.413356+0000) 2024-04-01T07:07:29.641 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:29 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:29.148+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:54.414028+0000 front 2024-04-01T07:06:54.414017+0000 (oldest deadline 2024-04-01T07:07:19.113836+0000) 2024-04-01T07:07:29.641 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:29 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:29.148+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:03.516482+0000 front 2024-04-01T07:07:03.516630+0000 (oldest deadline 2024-04-01T07:07:27.016498+0000) 2024-04-01T07:07:29.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:29 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:29.205+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.346120+0000 front 2024-04-01T07:06:34.346258+0000 (oldest deadline 2024-04-01T07:06:57.846204+0000) 2024-04-01T07:07:29.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:29 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:29.205+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:42.547512+0000 front 2024-04-01T07:06:42.547305+0000 (oldest deadline 2024-04-01T07:07:08.447338+0000) 2024-04-01T07:07:29.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:29 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:29.205+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.148326+0000 front 2024-04-01T07:06:50.148134+0000 (oldest deadline 2024-04-01T07:07:12.448250+0000) 2024-04-01T07:07:29.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:29 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:29.205+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:02.950323+0000 front 2024-04-01T07:07:02.950381+0000 (oldest deadline 2024-04-01T07:07:25.250345+0000) 2024-04-01T07:07:29.762 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:29 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:29.395+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.703525+0000 front 2024-04-01T07:06:30.703502+0000 (oldest deadline 2024-04-01T07:06:57.704368+0000) 2024-04-01T07:07:29.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:29 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:29.395+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:40.005521+0000 front 2024-04-01T07:06:40.005539+0000 (oldest deadline 2024-04-01T07:07:04.705500+0000) 2024-04-01T07:07:29.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:29 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:29.395+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:47.006770+0000 front 2024-04-01T07:06:47.006861+0000 (oldest deadline 2024-04-01T07:07:11.706594+0000) 2024-04-01T07:07:29.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:29 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:29.395+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:56.709246+0000 front 2024-04-01T07:06:56.709262+0000 (oldest deadline 2024-04-01T07:07:21.409350+0000) 2024-04-01T07:07:29.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:29 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:29.395+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:01.409980+0000 front 2024-04-01T07:07:01.410102+0000 (oldest deadline 2024-04-01T07:07:27.309883+0000) 2024-04-01T07:07:30.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:29 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:29.901+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.924722+0000 front 2024-04-01T07:06:30.924835+0000 (oldest deadline 2024-04-01T07:06:59.725293+0000) 2024-04-01T07:07:30.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:29 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:29.901+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:43.126859+0000 front 2024-04-01T07:06:43.126953+0000 (oldest deadline 2024-04-01T07:07:04.226993+0000) 2024-04-01T07:07:30.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:29 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:29.901+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.230698+0000 front 2024-04-01T07:06:50.230866+0000 (oldest deadline 2024-04-01T07:07:16.130734+0000) 2024-04-01T07:07:30.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:29 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:29.901+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:56.131462+0000 front 2024-04-01T07:06:56.131400+0000 (oldest deadline 2024-04-01T07:07:20.231303+0000) 2024-04-01T07:07:30.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:29 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:29.901+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:00.231790+0000 front 2024-04-01T07:07:00.231808+0000 (oldest deadline 2024-04-01T07:07:26.131918+0000) 2024-04-01T07:07:30.641 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:30 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:30.146+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.010250+0000 front 2024-04-01T07:06:34.010446+0000 (oldest deadline 2024-04-01T07:06:57.510323+0000) 2024-04-01T07:07:30.641 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:30 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:30.146+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:48.513144+0000 front 2024-04-01T07:06:48.513170+0000 (oldest deadline 2024-04-01T07:07:14.413356+0000) 2024-04-01T07:07:30.641 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:30 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:30.146+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:54.414028+0000 front 2024-04-01T07:06:54.414017+0000 (oldest deadline 2024-04-01T07:07:19.113836+0000) 2024-04-01T07:07:30.641 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:30 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:30.146+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:03.516482+0000 front 2024-04-01T07:07:03.516630+0000 (oldest deadline 2024-04-01T07:07:27.016498+0000) 2024-04-01T07:07:30.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:30 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:30.156+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.346120+0000 front 2024-04-01T07:06:34.346258+0000 (oldest deadline 2024-04-01T07:06:57.846204+0000) 2024-04-01T07:07:30.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:30 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:30.156+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:42.547512+0000 front 2024-04-01T07:06:42.547305+0000 (oldest deadline 2024-04-01T07:07:08.447338+0000) 2024-04-01T07:07:30.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:30 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:30.156+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.148326+0000 front 2024-04-01T07:06:50.148134+0000 (oldest deadline 2024-04-01T07:07:12.448250+0000) 2024-04-01T07:07:30.642 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:30 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:30.156+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:02.950323+0000 front 2024-04-01T07:07:02.950381+0000 (oldest deadline 2024-04-01T07:07:25.250345+0000) 2024-04-01T07:07:30.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:30 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:30.384+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.703525+0000 front 2024-04-01T07:06:30.703502+0000 (oldest deadline 2024-04-01T07:06:57.704368+0000) 2024-04-01T07:07:30.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:30 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:30.384+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:40.005521+0000 front 2024-04-01T07:06:40.005539+0000 (oldest deadline 2024-04-01T07:07:04.705500+0000) 2024-04-01T07:07:30.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:30 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:30.384+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:47.006770+0000 front 2024-04-01T07:06:47.006861+0000 (oldest deadline 2024-04-01T07:07:11.706594+0000) 2024-04-01T07:07:30.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:30 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:30.384+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:56.709246+0000 front 2024-04-01T07:06:56.709262+0000 (oldest deadline 2024-04-01T07:07:21.409350+0000) 2024-04-01T07:07:30.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:30 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:30.384+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:01.409980+0000 front 2024-04-01T07:07:01.410102+0000 (oldest deadline 2024-04-01T07:07:27.309883+0000) 2024-04-01T07:07:31.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:30 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:30.945+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.924722+0000 front 2024-04-01T07:06:30.924835+0000 (oldest deadline 2024-04-01T07:06:59.725293+0000) 2024-04-01T07:07:31.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:30 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:30.945+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:43.126859+0000 front 2024-04-01T07:06:43.126953+0000 (oldest deadline 2024-04-01T07:07:04.226993+0000) 2024-04-01T07:07:31.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:30 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:30.945+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.230698+0000 front 2024-04-01T07:06:50.230866+0000 (oldest deadline 2024-04-01T07:07:16.130734+0000) 2024-04-01T07:07:31.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:30 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:30.945+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:56.131462+0000 front 2024-04-01T07:06:56.131400+0000 (oldest deadline 2024-04-01T07:07:20.231303+0000) 2024-04-01T07:07:31.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:30 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:30.945+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:00.231790+0000 front 2024-04-01T07:07:00.231808+0000 (oldest deadline 2024-04-01T07:07:26.131918+0000) 2024-04-01T07:07:31.641 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:31 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:31.192+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.010250+0000 front 2024-04-01T07:06:34.010446+0000 (oldest deadline 2024-04-01T07:06:57.510323+0000) 2024-04-01T07:07:31.641 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:31 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:31.192+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:48.513144+0000 front 2024-04-01T07:06:48.513170+0000 (oldest deadline 2024-04-01T07:07:14.413356+0000) 2024-04-01T07:07:31.641 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:31 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:31.192+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:54.414028+0000 front 2024-04-01T07:06:54.414017+0000 (oldest deadline 2024-04-01T07:07:19.113836+0000) 2024-04-01T07:07:31.641 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:31 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:31.192+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:03.516482+0000 front 2024-04-01T07:07:03.516630+0000 (oldest deadline 2024-04-01T07:07:27.016498+0000) 2024-04-01T07:07:31.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:31 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:31.162+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.346120+0000 front 2024-04-01T07:06:34.346258+0000 (oldest deadline 2024-04-01T07:06:57.846204+0000) 2024-04-01T07:07:31.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:31 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:31.162+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:42.547512+0000 front 2024-04-01T07:06:42.547305+0000 (oldest deadline 2024-04-01T07:07:08.447338+0000) 2024-04-01T07:07:31.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:31 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:31.162+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.148326+0000 front 2024-04-01T07:06:50.148134+0000 (oldest deadline 2024-04-01T07:07:12.448250+0000) 2024-04-01T07:07:31.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:31 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:31.162+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:02.950323+0000 front 2024-04-01T07:07:02.950381+0000 (oldest deadline 2024-04-01T07:07:25.250345+0000) 2024-04-01T07:07:31.762 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:31 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:31.422+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.703525+0000 front 2024-04-01T07:06:30.703502+0000 (oldest deadline 2024-04-01T07:06:57.704368+0000) 2024-04-01T07:07:31.762 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:31 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:31.422+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:40.005521+0000 front 2024-04-01T07:06:40.005539+0000 (oldest deadline 2024-04-01T07:07:04.705500+0000) 2024-04-01T07:07:31.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:31 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:31.422+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:47.006770+0000 front 2024-04-01T07:06:47.006861+0000 (oldest deadline 2024-04-01T07:07:11.706594+0000) 2024-04-01T07:07:31.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:31 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:31.422+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:56.709246+0000 front 2024-04-01T07:06:56.709262+0000 (oldest deadline 2024-04-01T07:07:21.409350+0000) 2024-04-01T07:07:31.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:31 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:31.422+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:01.409980+0000 front 2024-04-01T07:07:01.410102+0000 (oldest deadline 2024-04-01T07:07:27.309883+0000) 2024-04-01T07:07:32.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:31 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:31.919+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.924722+0000 front 2024-04-01T07:06:30.924835+0000 (oldest deadline 2024-04-01T07:06:59.725293+0000) 2024-04-01T07:07:32.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:31 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:31.919+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:43.126859+0000 front 2024-04-01T07:06:43.126953+0000 (oldest deadline 2024-04-01T07:07:04.226993+0000) 2024-04-01T07:07:32.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:31 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:31.919+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.230698+0000 front 2024-04-01T07:06:50.230866+0000 (oldest deadline 2024-04-01T07:07:16.130734+0000) 2024-04-01T07:07:32.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:31 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:31.919+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:56.131462+0000 front 2024-04-01T07:06:56.131400+0000 (oldest deadline 2024-04-01T07:07:20.231303+0000) 2024-04-01T07:07:32.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:31 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:31.919+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:00.231790+0000 front 2024-04-01T07:07:00.231808+0000 (oldest deadline 2024-04-01T07:07:26.131918+0000) 2024-04-01T07:07:32.641 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:32 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:32.229+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.010250+0000 front 2024-04-01T07:06:34.010446+0000 (oldest deadline 2024-04-01T07:06:57.510323+0000) 2024-04-01T07:07:32.641 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:32 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:32.229+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:48.513144+0000 front 2024-04-01T07:06:48.513170+0000 (oldest deadline 2024-04-01T07:07:14.413356+0000) 2024-04-01T07:07:32.641 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:32 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:32.229+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:54.414028+0000 front 2024-04-01T07:06:54.414017+0000 (oldest deadline 2024-04-01T07:07:19.113836+0000) 2024-04-01T07:07:32.641 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:32 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:32.229+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:03.516482+0000 front 2024-04-01T07:07:03.516630+0000 (oldest deadline 2024-04-01T07:07:27.016498+0000) 2024-04-01T07:07:32.642 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:32 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:32.185+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.346120+0000 front 2024-04-01T07:06:34.346258+0000 (oldest deadline 2024-04-01T07:06:57.846204+0000) 2024-04-01T07:07:32.642 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:32 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:32.186+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:42.547512+0000 front 2024-04-01T07:06:42.547305+0000 (oldest deadline 2024-04-01T07:07:08.447338+0000) 2024-04-01T07:07:32.642 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:32 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:32.186+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.148326+0000 front 2024-04-01T07:06:50.148134+0000 (oldest deadline 2024-04-01T07:07:12.448250+0000) 2024-04-01T07:07:32.642 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:32 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:32.186+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:02.950323+0000 front 2024-04-01T07:07:02.950381+0000 (oldest deadline 2024-04-01T07:07:25.250345+0000) 2024-04-01T07:07:32.762 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:32 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:32.405+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.703525+0000 front 2024-04-01T07:06:30.703502+0000 (oldest deadline 2024-04-01T07:06:57.704368+0000) 2024-04-01T07:07:32.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:32 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:32.405+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:40.005521+0000 front 2024-04-01T07:06:40.005539+0000 (oldest deadline 2024-04-01T07:07:04.705500+0000) 2024-04-01T07:07:32.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:32 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:32.405+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:47.006770+0000 front 2024-04-01T07:06:47.006861+0000 (oldest deadline 2024-04-01T07:07:11.706594+0000) 2024-04-01T07:07:32.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:32 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:32.405+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:56.709246+0000 front 2024-04-01T07:06:56.709262+0000 (oldest deadline 2024-04-01T07:07:21.409350+0000) 2024-04-01T07:07:32.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:32 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:32.405+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:01.409980+0000 front 2024-04-01T07:07:01.410102+0000 (oldest deadline 2024-04-01T07:07:27.309883+0000) 2024-04-01T07:07:33.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:32 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:32.877+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.924722+0000 front 2024-04-01T07:06:30.924835+0000 (oldest deadline 2024-04-01T07:06:59.725293+0000) 2024-04-01T07:07:33.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:32 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:32.877+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:43.126859+0000 front 2024-04-01T07:06:43.126953+0000 (oldest deadline 2024-04-01T07:07:04.226993+0000) 2024-04-01T07:07:33.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:32 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:32.877+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.230698+0000 front 2024-04-01T07:06:50.230866+0000 (oldest deadline 2024-04-01T07:07:16.130734+0000) 2024-04-01T07:07:33.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:32 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:32.877+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:56.131462+0000 front 2024-04-01T07:06:56.131400+0000 (oldest deadline 2024-04-01T07:07:20.231303+0000) 2024-04-01T07:07:33.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:32 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:32.877+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:00.231790+0000 front 2024-04-01T07:07:00.231808+0000 (oldest deadline 2024-04-01T07:07:26.131918+0000) 2024-04-01T07:07:33.641 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:33 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:33.187+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.010250+0000 front 2024-04-01T07:06:34.010446+0000 (oldest deadline 2024-04-01T07:06:57.510323+0000) 2024-04-01T07:07:33.641 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:33 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:33.187+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:48.513144+0000 front 2024-04-01T07:06:48.513170+0000 (oldest deadline 2024-04-01T07:07:14.413356+0000) 2024-04-01T07:07:33.641 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:33 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:33.187+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:54.414028+0000 front 2024-04-01T07:06:54.414017+0000 (oldest deadline 2024-04-01T07:07:19.113836+0000) 2024-04-01T07:07:33.641 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:33 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8[71121]: 2024-04-01T07:07:33.187+0000 7f803667f700 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:03.516482+0000 front 2024-04-01T07:07:03.516630+0000 (oldest deadline 2024-04-01T07:07:27.016498+0000) 2024-04-01T07:07:33.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:33 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:33.155+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.346120+0000 front 2024-04-01T07:06:34.346258+0000 (oldest deadline 2024-04-01T07:06:57.846204+0000) 2024-04-01T07:07:33.642 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:33 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:33.155+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:42.547512+0000 front 2024-04-01T07:06:42.547305+0000 (oldest deadline 2024-04-01T07:07:08.447338+0000) 2024-04-01T07:07:33.642 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:33 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:33.155+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.148326+0000 front 2024-04-01T07:06:50.148134+0000 (oldest deadline 2024-04-01T07:07:12.448250+0000) 2024-04-01T07:07:33.642 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:33 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:33.155+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:02.950323+0000 front 2024-04-01T07:07:02.950381+0000 (oldest deadline 2024-04-01T07:07:25.250345+0000) 2024-04-01T07:07:33.762 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:33 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:33.452+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.703525+0000 front 2024-04-01T07:06:30.703502+0000 (oldest deadline 2024-04-01T07:06:57.704368+0000) 2024-04-01T07:07:33.762 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:33 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:33.452+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:40.005521+0000 front 2024-04-01T07:06:40.005539+0000 (oldest deadline 2024-04-01T07:07:04.705500+0000) 2024-04-01T07:07:33.762 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:33 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:33.452+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:47.006770+0000 front 2024-04-01T07:06:47.006861+0000 (oldest deadline 2024-04-01T07:07:11.706594+0000) 2024-04-01T07:07:33.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:33 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:33.452+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:56.709246+0000 front 2024-04-01T07:06:56.709262+0000 (oldest deadline 2024-04-01T07:07:21.409350+0000) 2024-04-01T07:07:33.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:33 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:33.452+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:01.409980+0000 front 2024-04-01T07:07:01.410102+0000 (oldest deadline 2024-04-01T07:07:27.309883+0000) 2024-04-01T07:07:33.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:33 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:33.452+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-04-01T07:07:07.310501+0000 front 2024-04-01T07:07:07.310574+0000 (oldest deadline 2024-04-01T07:07:33.210602+0000) 2024-04-01T07:07:34.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:33 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:33.833+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.924722+0000 front 2024-04-01T07:06:30.924835+0000 (oldest deadline 2024-04-01T07:06:59.725293+0000) 2024-04-01T07:07:34.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:33 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:33.833+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:43.126859+0000 front 2024-04-01T07:06:43.126953+0000 (oldest deadline 2024-04-01T07:07:04.226993+0000) 2024-04-01T07:07:34.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:33 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:33.833+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.230698+0000 front 2024-04-01T07:06:50.230866+0000 (oldest deadline 2024-04-01T07:07:16.130734+0000) 2024-04-01T07:07:34.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:33 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:33.833+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:56.131462+0000 front 2024-04-01T07:06:56.131400+0000 (oldest deadline 2024-04-01T07:07:20.231303+0000) 2024-04-01T07:07:34.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:33 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:33.833+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:00.231790+0000 front 2024-04-01T07:07:00.231808+0000 (oldest deadline 2024-04-01T07:07:26.131918+0000) 2024-04-01T07:07:34.391 INFO:journalctl@ceph.osd.8.smithi153.stdout:Apr 01 07:07:34 smithi153 bash[92494]: ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-8 2024-04-01T07:07:34.391 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:34 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:34.185+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.346120+0000 front 2024-04-01T07:06:34.346258+0000 (oldest deadline 2024-04-01T07:06:57.846204+0000) 2024-04-01T07:07:34.391 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:34 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:34.186+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:42.547512+0000 front 2024-04-01T07:06:42.547305+0000 (oldest deadline 2024-04-01T07:07:08.447338+0000) 2024-04-01T07:07:34.391 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:34 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:34.186+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.148326+0000 front 2024-04-01T07:06:50.148134+0000 (oldest deadline 2024-04-01T07:07:12.448250+0000) 2024-04-01T07:07:34.391 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:34 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:34.186+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:02.950323+0000 front 2024-04-01T07:07:02.950381+0000 (oldest deadline 2024-04-01T07:07:25.250345+0000) 2024-04-01T07:07:34.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:34 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:34.403+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.703525+0000 front 2024-04-01T07:06:30.703502+0000 (oldest deadline 2024-04-01T07:06:57.704368+0000) 2024-04-01T07:07:34.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:34 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:34.403+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:40.005521+0000 front 2024-04-01T07:06:40.005539+0000 (oldest deadline 2024-04-01T07:07:04.705500+0000) 2024-04-01T07:07:34.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:34 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:34.403+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:47.006770+0000 front 2024-04-01T07:06:47.006861+0000 (oldest deadline 2024-04-01T07:07:11.706594+0000) 2024-04-01T07:07:34.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:34 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:34.403+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:56.709246+0000 front 2024-04-01T07:06:56.709262+0000 (oldest deadline 2024-04-01T07:07:21.409350+0000) 2024-04-01T07:07:34.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:34 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:34.403+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:01.409980+0000 front 2024-04-01T07:07:01.410102+0000 (oldest deadline 2024-04-01T07:07:27.309883+0000) 2024-04-01T07:07:34.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:34 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:34.403+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-04-01T07:07:07.310501+0000 front 2024-04-01T07:07:07.310574+0000 (oldest deadline 2024-04-01T07:07:33.210602+0000) 2024-04-01T07:07:35.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:34 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:34.804+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.924722+0000 front 2024-04-01T07:06:30.924835+0000 (oldest deadline 2024-04-01T07:06:59.725293+0000) 2024-04-01T07:07:35.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:34 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:34.804+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:43.126859+0000 front 2024-04-01T07:06:43.126953+0000 (oldest deadline 2024-04-01T07:07:04.226993+0000) 2024-04-01T07:07:35.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:34 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:34.804+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.230698+0000 front 2024-04-01T07:06:50.230866+0000 (oldest deadline 2024-04-01T07:07:16.130734+0000) 2024-04-01T07:07:35.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:34 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:34.804+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:56.131462+0000 front 2024-04-01T07:06:56.131400+0000 (oldest deadline 2024-04-01T07:07:20.231303+0000) 2024-04-01T07:07:35.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:34 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:34.804+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:00.231790+0000 front 2024-04-01T07:07:00.231808+0000 (oldest deadline 2024-04-01T07:07:26.131918+0000) 2024-04-01T07:07:35.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:34 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:34.804+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-04-01T07:07:08.333608+0000 front 2024-04-01T07:07:08.333493+0000 (oldest deadline 2024-04-01T07:07:34.233443+0000) 2024-04-01T07:07:35.339 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:35 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:35.218+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.346120+0000 front 2024-04-01T07:06:34.346258+0000 (oldest deadline 2024-04-01T07:06:57.846204+0000) 2024-04-01T07:07:35.339 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:35 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:35.218+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:42.547512+0000 front 2024-04-01T07:06:42.547305+0000 (oldest deadline 2024-04-01T07:07:08.447338+0000) 2024-04-01T07:07:35.340 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:35 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:35.218+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.148326+0000 front 2024-04-01T07:06:50.148134+0000 (oldest deadline 2024-04-01T07:07:12.448250+0000) 2024-04-01T07:07:35.340 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:35 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:35.218+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:02.950323+0000 front 2024-04-01T07:07:02.950381+0000 (oldest deadline 2024-04-01T07:07:25.250345+0000) 2024-04-01T07:07:35.346 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@osd.8.service' 2024-04-01T07:07:35.388 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-01T07:07:35.388 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-04-01T07:07:35.388 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-04-01T07:07:35.388 DEBUG:teuthology.orchestra.run.smithi083:> sudo systemctl stop ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@osd.9 2024-04-01T07:07:35.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:35 smithi083 systemd[1]: Stopping Ceph osd.9 for c6f8eff4-eff3-11ee-b647-cb9ed24678a4... 2024-04-01T07:07:35.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:35 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:35.431+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.703525+0000 front 2024-04-01T07:06:30.703502+0000 (oldest deadline 2024-04-01T07:06:57.704368+0000) 2024-04-01T07:07:35.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:35 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:35.431+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:40.005521+0000 front 2024-04-01T07:06:40.005539+0000 (oldest deadline 2024-04-01T07:07:04.705500+0000) 2024-04-01T07:07:35.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:35 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:35.431+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:47.006770+0000 front 2024-04-01T07:06:47.006861+0000 (oldest deadline 2024-04-01T07:07:11.706594+0000) 2024-04-01T07:07:35.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:35 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:35.431+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:56.709246+0000 front 2024-04-01T07:06:56.709262+0000 (oldest deadline 2024-04-01T07:07:21.409350+0000) 2024-04-01T07:07:35.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:35 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:35.431+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:01.409980+0000 front 2024-04-01T07:07:01.410102+0000 (oldest deadline 2024-04-01T07:07:27.309883+0000) 2024-04-01T07:07:35.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:35 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:35.431+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-04-01T07:07:07.310501+0000 front 2024-04-01T07:07:07.310574+0000 (oldest deadline 2024-04-01T07:07:33.210602+0000) 2024-04-01T07:07:35.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:35 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:35.629+0000 7fa7219f6700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-01T07:07:35.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:35 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:35.629+0000 7fa7219f6700 -1 osd.9 95 *** Got signal Terminated *** 2024-04-01T07:07:35.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:35 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:35.629+0000 7fa7219f6700 -1 osd.9 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-01T07:07:36.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:35 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:35.793+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.924722+0000 front 2024-04-01T07:06:30.924835+0000 (oldest deadline 2024-04-01T07:06:59.725293+0000) 2024-04-01T07:07:36.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:35 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:35.793+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:43.126859+0000 front 2024-04-01T07:06:43.126953+0000 (oldest deadline 2024-04-01T07:07:04.226993+0000) 2024-04-01T07:07:36.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:35 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:35.793+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.230698+0000 front 2024-04-01T07:06:50.230866+0000 (oldest deadline 2024-04-01T07:07:16.130734+0000) 2024-04-01T07:07:36.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:35 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:35.793+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:56.131462+0000 front 2024-04-01T07:06:56.131400+0000 (oldest deadline 2024-04-01T07:07:20.231303+0000) 2024-04-01T07:07:36.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:35 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:35.793+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:00.231790+0000 front 2024-04-01T07:07:00.231808+0000 (oldest deadline 2024-04-01T07:07:26.131918+0000) 2024-04-01T07:07:36.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:35 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:35.793+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-04-01T07:07:08.333608+0000 front 2024-04-01T07:07:08.333493+0000 (oldest deadline 2024-04-01T07:07:34.233443+0000) 2024-04-01T07:07:36.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:36 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:36.224+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.346120+0000 front 2024-04-01T07:06:34.346258+0000 (oldest deadline 2024-04-01T07:06:57.846204+0000) 2024-04-01T07:07:36.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:36 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:36.224+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:42.547512+0000 front 2024-04-01T07:06:42.547305+0000 (oldest deadline 2024-04-01T07:07:08.447338+0000) 2024-04-01T07:07:36.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:36 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:36.224+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.148326+0000 front 2024-04-01T07:06:50.148134+0000 (oldest deadline 2024-04-01T07:07:12.448250+0000) 2024-04-01T07:07:36.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:36 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:36.224+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:02.950323+0000 front 2024-04-01T07:07:02.950381+0000 (oldest deadline 2024-04-01T07:07:25.250345+0000) 2024-04-01T07:07:36.762 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:36 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:36.450+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.703525+0000 front 2024-04-01T07:06:30.703502+0000 (oldest deadline 2024-04-01T07:06:57.704368+0000) 2024-04-01T07:07:36.762 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:36 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:36.450+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:40.005521+0000 front 2024-04-01T07:06:40.005539+0000 (oldest deadline 2024-04-01T07:07:04.705500+0000) 2024-04-01T07:07:36.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:36 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:36.450+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:47.006770+0000 front 2024-04-01T07:06:47.006861+0000 (oldest deadline 2024-04-01T07:07:11.706594+0000) 2024-04-01T07:07:36.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:36 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:36.450+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:56.709246+0000 front 2024-04-01T07:06:56.709262+0000 (oldest deadline 2024-04-01T07:07:21.409350+0000) 2024-04-01T07:07:36.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:36 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:36.450+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:01.409980+0000 front 2024-04-01T07:07:01.410102+0000 (oldest deadline 2024-04-01T07:07:27.309883+0000) 2024-04-01T07:07:36.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:36 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:36.450+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-04-01T07:07:07.310501+0000 front 2024-04-01T07:07:07.310574+0000 (oldest deadline 2024-04-01T07:07:33.210602+0000) 2024-04-01T07:07:37.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:36 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:36.825+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.924722+0000 front 2024-04-01T07:06:30.924835+0000 (oldest deadline 2024-04-01T07:06:59.725293+0000) 2024-04-01T07:07:37.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:36 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:36.825+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:43.126859+0000 front 2024-04-01T07:06:43.126953+0000 (oldest deadline 2024-04-01T07:07:04.226993+0000) 2024-04-01T07:07:37.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:36 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:36.825+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.230698+0000 front 2024-04-01T07:06:50.230866+0000 (oldest deadline 2024-04-01T07:07:16.130734+0000) 2024-04-01T07:07:37.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:36 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:36.825+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:56.131462+0000 front 2024-04-01T07:06:56.131400+0000 (oldest deadline 2024-04-01T07:07:20.231303+0000) 2024-04-01T07:07:37.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:36 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:36.825+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:00.231790+0000 front 2024-04-01T07:07:00.231808+0000 (oldest deadline 2024-04-01T07:07:26.131918+0000) 2024-04-01T07:07:37.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:36 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:36.825+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-04-01T07:07:08.333608+0000 front 2024-04-01T07:07:08.333493+0000 (oldest deadline 2024-04-01T07:07:34.233443+0000) 2024-04-01T07:07:37.640 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:37 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:37.254+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.346120+0000 front 2024-04-01T07:06:34.346258+0000 (oldest deadline 2024-04-01T07:06:57.846204+0000) 2024-04-01T07:07:37.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:37 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:37.254+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:42.547512+0000 front 2024-04-01T07:06:42.547305+0000 (oldest deadline 2024-04-01T07:07:08.447338+0000) 2024-04-01T07:07:37.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:37 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:37.254+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.148326+0000 front 2024-04-01T07:06:50.148134+0000 (oldest deadline 2024-04-01T07:07:12.448250+0000) 2024-04-01T07:07:37.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:37 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:37.254+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:02.950323+0000 front 2024-04-01T07:07:02.950381+0000 (oldest deadline 2024-04-01T07:07:25.250345+0000) 2024-04-01T07:07:37.762 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:37 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:37.444+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.703525+0000 front 2024-04-01T07:06:30.703502+0000 (oldest deadline 2024-04-01T07:06:57.704368+0000) 2024-04-01T07:07:37.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:37 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:37.444+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:40.005521+0000 front 2024-04-01T07:06:40.005539+0000 (oldest deadline 2024-04-01T07:07:04.705500+0000) 2024-04-01T07:07:37.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:37 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:37.444+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:47.006770+0000 front 2024-04-01T07:06:47.006861+0000 (oldest deadline 2024-04-01T07:07:11.706594+0000) 2024-04-01T07:07:37.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:37 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:37.444+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:56.709246+0000 front 2024-04-01T07:06:56.709262+0000 (oldest deadline 2024-04-01T07:07:21.409350+0000) 2024-04-01T07:07:37.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:37 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:37.444+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:01.409980+0000 front 2024-04-01T07:07:01.410102+0000 (oldest deadline 2024-04-01T07:07:27.309883+0000) 2024-04-01T07:07:37.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:37 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:37.444+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-04-01T07:07:07.310501+0000 front 2024-04-01T07:07:07.310574+0000 (oldest deadline 2024-04-01T07:07:33.210602+0000) 2024-04-01T07:07:38.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:37 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:37.813+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.924722+0000 front 2024-04-01T07:06:30.924835+0000 (oldest deadline 2024-04-01T07:06:59.725293+0000) 2024-04-01T07:07:38.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:37 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:37.813+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:43.126859+0000 front 2024-04-01T07:06:43.126953+0000 (oldest deadline 2024-04-01T07:07:04.226993+0000) 2024-04-01T07:07:38.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:37 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:37.813+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.230698+0000 front 2024-04-01T07:06:50.230866+0000 (oldest deadline 2024-04-01T07:07:16.130734+0000) 2024-04-01T07:07:38.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:37 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:37.813+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:56.131462+0000 front 2024-04-01T07:06:56.131400+0000 (oldest deadline 2024-04-01T07:07:20.231303+0000) 2024-04-01T07:07:38.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:37 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:37.813+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:00.231790+0000 front 2024-04-01T07:07:00.231808+0000 (oldest deadline 2024-04-01T07:07:26.131918+0000) 2024-04-01T07:07:38.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:37 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:37.813+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-04-01T07:07:08.333608+0000 front 2024-04-01T07:07:08.333493+0000 (oldest deadline 2024-04-01T07:07:34.233443+0000) 2024-04-01T07:07:38.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:38 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:38.267+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.346120+0000 front 2024-04-01T07:06:34.346258+0000 (oldest deadline 2024-04-01T07:06:57.846204+0000) 2024-04-01T07:07:38.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:38 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:38.267+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:42.547512+0000 front 2024-04-01T07:06:42.547305+0000 (oldest deadline 2024-04-01T07:07:08.447338+0000) 2024-04-01T07:07:38.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:38 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:38.267+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.148326+0000 front 2024-04-01T07:06:50.148134+0000 (oldest deadline 2024-04-01T07:07:12.448250+0000) 2024-04-01T07:07:38.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:38 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:38.267+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:02.950323+0000 front 2024-04-01T07:07:02.950381+0000 (oldest deadline 2024-04-01T07:07:25.250345+0000) 2024-04-01T07:07:38.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:38 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:38.267+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-04-01T07:07:08.751404+0000 front 2024-04-01T07:07:08.751497+0000 (oldest deadline 2024-04-01T07:07:37.551922+0000) 2024-04-01T07:07:38.762 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:38 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:38.475+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.703525+0000 front 2024-04-01T07:06:30.703502+0000 (oldest deadline 2024-04-01T07:06:57.704368+0000) 2024-04-01T07:07:38.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:38 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:38.475+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:40.005521+0000 front 2024-04-01T07:06:40.005539+0000 (oldest deadline 2024-04-01T07:07:04.705500+0000) 2024-04-01T07:07:38.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:38 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:38.475+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:47.006770+0000 front 2024-04-01T07:06:47.006861+0000 (oldest deadline 2024-04-01T07:07:11.706594+0000) 2024-04-01T07:07:38.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:38 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:38.475+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:56.709246+0000 front 2024-04-01T07:06:56.709262+0000 (oldest deadline 2024-04-01T07:07:21.409350+0000) 2024-04-01T07:07:38.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:38 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:38.475+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:01.409980+0000 front 2024-04-01T07:07:01.410102+0000 (oldest deadline 2024-04-01T07:07:27.309883+0000) 2024-04-01T07:07:38.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:38 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:38.475+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-04-01T07:07:07.310501+0000 front 2024-04-01T07:07:07.310574+0000 (oldest deadline 2024-04-01T07:07:33.210602+0000) 2024-04-01T07:07:39.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:38 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:38.836+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.924722+0000 front 2024-04-01T07:06:30.924835+0000 (oldest deadline 2024-04-01T07:06:59.725293+0000) 2024-04-01T07:07:39.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:38 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:38.836+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:43.126859+0000 front 2024-04-01T07:06:43.126953+0000 (oldest deadline 2024-04-01T07:07:04.226993+0000) 2024-04-01T07:07:39.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:38 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:38.836+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.230698+0000 front 2024-04-01T07:06:50.230866+0000 (oldest deadline 2024-04-01T07:07:16.130734+0000) 2024-04-01T07:07:39.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:38 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:38.836+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:56.131462+0000 front 2024-04-01T07:06:56.131400+0000 (oldest deadline 2024-04-01T07:07:20.231303+0000) 2024-04-01T07:07:39.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:38 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:38.836+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:00.231790+0000 front 2024-04-01T07:07:00.231808+0000 (oldest deadline 2024-04-01T07:07:26.131918+0000) 2024-04-01T07:07:39.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:38 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:38.836+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-04-01T07:07:08.333608+0000 front 2024-04-01T07:07:08.333493+0000 (oldest deadline 2024-04-01T07:07:34.233443+0000) 2024-04-01T07:07:39.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:39 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:39.285+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.346120+0000 front 2024-04-01T07:06:34.346258+0000 (oldest deadline 2024-04-01T07:06:57.846204+0000) 2024-04-01T07:07:39.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:39 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:39.285+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:42.547512+0000 front 2024-04-01T07:06:42.547305+0000 (oldest deadline 2024-04-01T07:07:08.447338+0000) 2024-04-01T07:07:39.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:39 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:39.285+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.148326+0000 front 2024-04-01T07:06:50.148134+0000 (oldest deadline 2024-04-01T07:07:12.448250+0000) 2024-04-01T07:07:39.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:39 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:39.285+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:02.950323+0000 front 2024-04-01T07:07:02.950381+0000 (oldest deadline 2024-04-01T07:07:25.250345+0000) 2024-04-01T07:07:39.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:39 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:39.285+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-04-01T07:07:08.751404+0000 front 2024-04-01T07:07:08.751497+0000 (oldest deadline 2024-04-01T07:07:37.551922+0000) 2024-04-01T07:07:39.762 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:39 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:39.443+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.703525+0000 front 2024-04-01T07:06:30.703502+0000 (oldest deadline 2024-04-01T07:06:57.704368+0000) 2024-04-01T07:07:39.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:39 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:39.443+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:40.005521+0000 front 2024-04-01T07:06:40.005539+0000 (oldest deadline 2024-04-01T07:07:04.705500+0000) 2024-04-01T07:07:39.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:39 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:39.443+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:47.006770+0000 front 2024-04-01T07:06:47.006861+0000 (oldest deadline 2024-04-01T07:07:11.706594+0000) 2024-04-01T07:07:39.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:39 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:39.443+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:56.709246+0000 front 2024-04-01T07:06:56.709262+0000 (oldest deadline 2024-04-01T07:07:21.409350+0000) 2024-04-01T07:07:39.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:39 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:39.443+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:01.409980+0000 front 2024-04-01T07:07:01.410102+0000 (oldest deadline 2024-04-01T07:07:27.309883+0000) 2024-04-01T07:07:39.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:39 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:39.443+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-04-01T07:07:07.310501+0000 front 2024-04-01T07:07:07.310574+0000 (oldest deadline 2024-04-01T07:07:33.210602+0000) 2024-04-01T07:07:40.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:39 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:39.842+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.924722+0000 front 2024-04-01T07:06:30.924835+0000 (oldest deadline 2024-04-01T07:06:59.725293+0000) 2024-04-01T07:07:40.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:39 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:39.842+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:43.126859+0000 front 2024-04-01T07:06:43.126953+0000 (oldest deadline 2024-04-01T07:07:04.226993+0000) 2024-04-01T07:07:40.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:39 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:39.842+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.230698+0000 front 2024-04-01T07:06:50.230866+0000 (oldest deadline 2024-04-01T07:07:16.130734+0000) 2024-04-01T07:07:40.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:39 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:39.842+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:56.131462+0000 front 2024-04-01T07:06:56.131400+0000 (oldest deadline 2024-04-01T07:07:20.231303+0000) 2024-04-01T07:07:40.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:39 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:39.842+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:00.231790+0000 front 2024-04-01T07:07:00.231808+0000 (oldest deadline 2024-04-01T07:07:26.131918+0000) 2024-04-01T07:07:40.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:39 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:39.842+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-04-01T07:07:08.333608+0000 front 2024-04-01T07:07:08.333493+0000 (oldest deadline 2024-04-01T07:07:34.233443+0000) 2024-04-01T07:07:40.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:40 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:40.311+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.346120+0000 front 2024-04-01T07:06:34.346258+0000 (oldest deadline 2024-04-01T07:06:57.846204+0000) 2024-04-01T07:07:40.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:40 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:40.311+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:42.547512+0000 front 2024-04-01T07:06:42.547305+0000 (oldest deadline 2024-04-01T07:07:08.447338+0000) 2024-04-01T07:07:40.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:40 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:40.311+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.148326+0000 front 2024-04-01T07:06:50.148134+0000 (oldest deadline 2024-04-01T07:07:12.448250+0000) 2024-04-01T07:07:40.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:40 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:40.311+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:02.950323+0000 front 2024-04-01T07:07:02.950381+0000 (oldest deadline 2024-04-01T07:07:25.250345+0000) 2024-04-01T07:07:40.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:40 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:40.311+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-04-01T07:07:08.751404+0000 front 2024-04-01T07:07:08.751497+0000 (oldest deadline 2024-04-01T07:07:37.551922+0000) 2024-04-01T07:07:40.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:40 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:40.433+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.703525+0000 front 2024-04-01T07:06:30.703502+0000 (oldest deadline 2024-04-01T07:06:57.704368+0000) 2024-04-01T07:07:40.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:40 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:40.433+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:40.005521+0000 front 2024-04-01T07:06:40.005539+0000 (oldest deadline 2024-04-01T07:07:04.705500+0000) 2024-04-01T07:07:40.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:40 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:40.433+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:47.006770+0000 front 2024-04-01T07:06:47.006861+0000 (oldest deadline 2024-04-01T07:07:11.706594+0000) 2024-04-01T07:07:40.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:40 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:40.433+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:56.709246+0000 front 2024-04-01T07:06:56.709262+0000 (oldest deadline 2024-04-01T07:07:21.409350+0000) 2024-04-01T07:07:40.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:40 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:40.433+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:01.409980+0000 front 2024-04-01T07:07:01.410102+0000 (oldest deadline 2024-04-01T07:07:27.309883+0000) 2024-04-01T07:07:40.763 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:40 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9[86903]: 2024-04-01T07:07:40.433+0000 7fa719fe4700 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-04-01T07:07:07.310501+0000 front 2024-04-01T07:07:07.310574+0000 (oldest deadline 2024-04-01T07:07:33.210602+0000) 2024-04-01T07:07:41.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:40 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:40.864+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.924722+0000 front 2024-04-01T07:06:30.924835+0000 (oldest deadline 2024-04-01T07:06:59.725293+0000) 2024-04-01T07:07:41.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:40 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:40.864+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:43.126859+0000 front 2024-04-01T07:06:43.126953+0000 (oldest deadline 2024-04-01T07:07:04.226993+0000) 2024-04-01T07:07:41.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:40 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:40.864+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.230698+0000 front 2024-04-01T07:06:50.230866+0000 (oldest deadline 2024-04-01T07:07:16.130734+0000) 2024-04-01T07:07:41.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:40 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:40.864+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:56.131462+0000 front 2024-04-01T07:06:56.131400+0000 (oldest deadline 2024-04-01T07:07:20.231303+0000) 2024-04-01T07:07:41.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:40 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:40.864+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:00.231790+0000 front 2024-04-01T07:07:00.231808+0000 (oldest deadline 2024-04-01T07:07:26.131918+0000) 2024-04-01T07:07:41.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:40 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:40.864+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-04-01T07:07:08.333608+0000 front 2024-04-01T07:07:08.333493+0000 (oldest deadline 2024-04-01T07:07:34.233443+0000) 2024-04-01T07:07:41.512 INFO:journalctl@ceph.osd.9.smithi083.stdout:Apr 01 07:07:41 smithi083 bash[119226]: ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-9 2024-04-01T07:07:41.640 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:41 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:41.275+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.346120+0000 front 2024-04-01T07:06:34.346258+0000 (oldest deadline 2024-04-01T07:06:57.846204+0000) 2024-04-01T07:07:41.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:41 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:41.275+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:42.547512+0000 front 2024-04-01T07:06:42.547305+0000 (oldest deadline 2024-04-01T07:07:08.447338+0000) 2024-04-01T07:07:41.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:41 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:41.275+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.148326+0000 front 2024-04-01T07:06:50.148134+0000 (oldest deadline 2024-04-01T07:07:12.448250+0000) 2024-04-01T07:07:41.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:41 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:41.275+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:02.950323+0000 front 2024-04-01T07:07:02.950381+0000 (oldest deadline 2024-04-01T07:07:25.250345+0000) 2024-04-01T07:07:41.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:41 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:41.275+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-04-01T07:07:08.751404+0000 front 2024-04-01T07:07:08.751497+0000 (oldest deadline 2024-04-01T07:07:37.551922+0000) 2024-04-01T07:07:42.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:41 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:41.853+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.924722+0000 front 2024-04-01T07:06:30.924835+0000 (oldest deadline 2024-04-01T07:06:59.725293+0000) 2024-04-01T07:07:42.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:41 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:41.853+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:43.126859+0000 front 2024-04-01T07:06:43.126953+0000 (oldest deadline 2024-04-01T07:07:04.226993+0000) 2024-04-01T07:07:42.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:41 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:41.853+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.230698+0000 front 2024-04-01T07:06:50.230866+0000 (oldest deadline 2024-04-01T07:07:16.130734+0000) 2024-04-01T07:07:42.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:41 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:41.853+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:56.131462+0000 front 2024-04-01T07:06:56.131400+0000 (oldest deadline 2024-04-01T07:07:20.231303+0000) 2024-04-01T07:07:42.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:41 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:41.853+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:00.231790+0000 front 2024-04-01T07:07:00.231808+0000 (oldest deadline 2024-04-01T07:07:26.131918+0000) 2024-04-01T07:07:42.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:41 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:41.853+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-04-01T07:07:08.333608+0000 front 2024-04-01T07:07:08.333493+0000 (oldest deadline 2024-04-01T07:07:34.233443+0000) 2024-04-01T07:07:42.425 DEBUG:teuthology.orchestra.run.smithi083:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@osd.9.service' 2024-04-01T07:07:42.465 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-01T07:07:42.466 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-04-01T07:07:42.466 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-04-01T07:07:42.466 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@osd.10 2024-04-01T07:07:42.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:42 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:42.294+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.346120+0000 front 2024-04-01T07:06:34.346258+0000 (oldest deadline 2024-04-01T07:06:57.846204+0000) 2024-04-01T07:07:42.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:42 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:42.294+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:42.547512+0000 front 2024-04-01T07:06:42.547305+0000 (oldest deadline 2024-04-01T07:07:08.447338+0000) 2024-04-01T07:07:42.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:42 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:42.294+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.148326+0000 front 2024-04-01T07:06:50.148134+0000 (oldest deadline 2024-04-01T07:07:12.448250+0000) 2024-04-01T07:07:42.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:42 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:42.294+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:02.950323+0000 front 2024-04-01T07:07:02.950381+0000 (oldest deadline 2024-04-01T07:07:25.250345+0000) 2024-04-01T07:07:42.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:42 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:42.294+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-04-01T07:07:08.751404+0000 front 2024-04-01T07:07:08.751497+0000 (oldest deadline 2024-04-01T07:07:37.551922+0000) 2024-04-01T07:07:42.753 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:42 smithi145 systemd[1]: Stopping Ceph osd.10 for c6f8eff4-eff3-11ee-b647-cb9ed24678a4... 2024-04-01T07:07:42.753 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:42 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:42.729+0000 7fcf57e6f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-01T07:07:42.753 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:42 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:42.729+0000 7fcf57e6f700 -1 osd.10 95 *** Got signal Terminated *** 2024-04-01T07:07:42.753 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:42 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:42.729+0000 7fcf57e6f700 -1 osd.10 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-01T07:07:43.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:42 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:42.819+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.924722+0000 front 2024-04-01T07:06:30.924835+0000 (oldest deadline 2024-04-01T07:06:59.725293+0000) 2024-04-01T07:07:43.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:42 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:42.819+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:43.126859+0000 front 2024-04-01T07:06:43.126953+0000 (oldest deadline 2024-04-01T07:07:04.226993+0000) 2024-04-01T07:07:43.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:42 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:42.819+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.230698+0000 front 2024-04-01T07:06:50.230866+0000 (oldest deadline 2024-04-01T07:07:16.130734+0000) 2024-04-01T07:07:43.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:42 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:42.819+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:56.131462+0000 front 2024-04-01T07:06:56.131400+0000 (oldest deadline 2024-04-01T07:07:20.231303+0000) 2024-04-01T07:07:43.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:42 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:42.819+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:00.231790+0000 front 2024-04-01T07:07:00.231808+0000 (oldest deadline 2024-04-01T07:07:26.131918+0000) 2024-04-01T07:07:43.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:42 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:42.819+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-04-01T07:07:08.333608+0000 front 2024-04-01T07:07:08.333493+0000 (oldest deadline 2024-04-01T07:07:34.233443+0000) 2024-04-01T07:07:43.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:43 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:43.312+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.346120+0000 front 2024-04-01T07:06:34.346258+0000 (oldest deadline 2024-04-01T07:06:57.846204+0000) 2024-04-01T07:07:43.642 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:43 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:43.312+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:42.547512+0000 front 2024-04-01T07:06:42.547305+0000 (oldest deadline 2024-04-01T07:07:08.447338+0000) 2024-04-01T07:07:43.642 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:43 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:43.312+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.148326+0000 front 2024-04-01T07:06:50.148134+0000 (oldest deadline 2024-04-01T07:07:12.448250+0000) 2024-04-01T07:07:43.642 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:43 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:43.312+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:02.950323+0000 front 2024-04-01T07:07:02.950381+0000 (oldest deadline 2024-04-01T07:07:25.250345+0000) 2024-04-01T07:07:43.642 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:43 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:43.312+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-04-01T07:07:08.751404+0000 front 2024-04-01T07:07:08.751497+0000 (oldest deadline 2024-04-01T07:07:37.551922+0000) 2024-04-01T07:07:43.642 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:43 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:43.312+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6822 osd.6 since back 2024-04-01T07:07:17.552523+0000 front 2024-04-01T07:07:17.552575+0000 (oldest deadline 2024-04-01T07:07:42.852254+0000) 2024-04-01T07:07:44.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:43 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:43.803+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.924722+0000 front 2024-04-01T07:06:30.924835+0000 (oldest deadline 2024-04-01T07:06:59.725293+0000) 2024-04-01T07:07:44.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:43 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:43.803+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:43.126859+0000 front 2024-04-01T07:06:43.126953+0000 (oldest deadline 2024-04-01T07:07:04.226993+0000) 2024-04-01T07:07:44.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:43 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:43.803+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.230698+0000 front 2024-04-01T07:06:50.230866+0000 (oldest deadline 2024-04-01T07:07:16.130734+0000) 2024-04-01T07:07:44.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:43 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:43.803+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:56.131462+0000 front 2024-04-01T07:06:56.131400+0000 (oldest deadline 2024-04-01T07:07:20.231303+0000) 2024-04-01T07:07:44.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:43 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:43.803+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:00.231790+0000 front 2024-04-01T07:07:00.231808+0000 (oldest deadline 2024-04-01T07:07:26.131918+0000) 2024-04-01T07:07:44.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:43 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:43.803+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-04-01T07:07:08.333608+0000 front 2024-04-01T07:07:08.333493+0000 (oldest deadline 2024-04-01T07:07:34.233443+0000) 2024-04-01T07:07:44.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:44 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:44.315+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.346120+0000 front 2024-04-01T07:06:34.346258+0000 (oldest deadline 2024-04-01T07:06:57.846204+0000) 2024-04-01T07:07:44.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:44 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:44.315+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:42.547512+0000 front 2024-04-01T07:06:42.547305+0000 (oldest deadline 2024-04-01T07:07:08.447338+0000) 2024-04-01T07:07:44.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:44 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:44.315+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.148326+0000 front 2024-04-01T07:06:50.148134+0000 (oldest deadline 2024-04-01T07:07:12.448250+0000) 2024-04-01T07:07:44.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:44 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:44.315+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:02.950323+0000 front 2024-04-01T07:07:02.950381+0000 (oldest deadline 2024-04-01T07:07:25.250345+0000) 2024-04-01T07:07:44.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:44 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:44.315+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-04-01T07:07:08.751404+0000 front 2024-04-01T07:07:08.751497+0000 (oldest deadline 2024-04-01T07:07:37.551922+0000) 2024-04-01T07:07:44.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:44 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:44.315+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6822 osd.6 since back 2024-04-01T07:07:17.552523+0000 front 2024-04-01T07:07:17.552575+0000 (oldest deadline 2024-04-01T07:07:42.852254+0000) 2024-04-01T07:07:45.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:44 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:44.846+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.924722+0000 front 2024-04-01T07:06:30.924835+0000 (oldest deadline 2024-04-01T07:06:59.725293+0000) 2024-04-01T07:07:45.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:44 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:44.846+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:43.126859+0000 front 2024-04-01T07:06:43.126953+0000 (oldest deadline 2024-04-01T07:07:04.226993+0000) 2024-04-01T07:07:45.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:44 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:44.846+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.230698+0000 front 2024-04-01T07:06:50.230866+0000 (oldest deadline 2024-04-01T07:07:16.130734+0000) 2024-04-01T07:07:45.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:44 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:44.846+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:56.131462+0000 front 2024-04-01T07:06:56.131400+0000 (oldest deadline 2024-04-01T07:07:20.231303+0000) 2024-04-01T07:07:45.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:44 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:44.846+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:00.231790+0000 front 2024-04-01T07:07:00.231808+0000 (oldest deadline 2024-04-01T07:07:26.131918+0000) 2024-04-01T07:07:45.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:44 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:44.846+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-04-01T07:07:08.333608+0000 front 2024-04-01T07:07:08.333493+0000 (oldest deadline 2024-04-01T07:07:34.233443+0000) 2024-04-01T07:07:45.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:44 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:44.846+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6822 osd.6 since back 2024-04-01T07:07:15.934370+0000 front 2024-04-01T07:07:15.934399+0000 (oldest deadline 2024-04-01T07:07:44.134791+0000) 2024-04-01T07:07:45.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:45 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:45.342+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.346120+0000 front 2024-04-01T07:06:34.346258+0000 (oldest deadline 2024-04-01T07:06:57.846204+0000) 2024-04-01T07:07:45.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:45 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:45.342+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:42.547512+0000 front 2024-04-01T07:06:42.547305+0000 (oldest deadline 2024-04-01T07:07:08.447338+0000) 2024-04-01T07:07:45.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:45 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:45.342+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.148326+0000 front 2024-04-01T07:06:50.148134+0000 (oldest deadline 2024-04-01T07:07:12.448250+0000) 2024-04-01T07:07:45.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:45 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:45.342+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:02.950323+0000 front 2024-04-01T07:07:02.950381+0000 (oldest deadline 2024-04-01T07:07:25.250345+0000) 2024-04-01T07:07:45.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:45 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:45.342+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-04-01T07:07:08.751404+0000 front 2024-04-01T07:07:08.751497+0000 (oldest deadline 2024-04-01T07:07:37.551922+0000) 2024-04-01T07:07:45.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:45 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:45.342+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6822 osd.6 since back 2024-04-01T07:07:17.552523+0000 front 2024-04-01T07:07:17.552575+0000 (oldest deadline 2024-04-01T07:07:42.852254+0000) 2024-04-01T07:07:46.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:45 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:45.843+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.924722+0000 front 2024-04-01T07:06:30.924835+0000 (oldest deadline 2024-04-01T07:06:59.725293+0000) 2024-04-01T07:07:46.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:45 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:45.843+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:43.126859+0000 front 2024-04-01T07:06:43.126953+0000 (oldest deadline 2024-04-01T07:07:04.226993+0000) 2024-04-01T07:07:46.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:45 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:45.843+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.230698+0000 front 2024-04-01T07:06:50.230866+0000 (oldest deadline 2024-04-01T07:07:16.130734+0000) 2024-04-01T07:07:46.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:45 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:45.843+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:56.131462+0000 front 2024-04-01T07:06:56.131400+0000 (oldest deadline 2024-04-01T07:07:20.231303+0000) 2024-04-01T07:07:46.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:45 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:45.843+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:00.231790+0000 front 2024-04-01T07:07:00.231808+0000 (oldest deadline 2024-04-01T07:07:26.131918+0000) 2024-04-01T07:07:46.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:45 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:45.843+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-04-01T07:07:08.333608+0000 front 2024-04-01T07:07:08.333493+0000 (oldest deadline 2024-04-01T07:07:34.233443+0000) 2024-04-01T07:07:46.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:45 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:45.843+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6822 osd.6 since back 2024-04-01T07:07:15.934370+0000 front 2024-04-01T07:07:15.934399+0000 (oldest deadline 2024-04-01T07:07:44.134791+0000) 2024-04-01T07:07:46.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:46 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:46.322+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.346120+0000 front 2024-04-01T07:06:34.346258+0000 (oldest deadline 2024-04-01T07:06:57.846204+0000) 2024-04-01T07:07:46.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:46 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:46.322+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:42.547512+0000 front 2024-04-01T07:06:42.547305+0000 (oldest deadline 2024-04-01T07:07:08.447338+0000) 2024-04-01T07:07:46.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:46 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:46.322+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.148326+0000 front 2024-04-01T07:06:50.148134+0000 (oldest deadline 2024-04-01T07:07:12.448250+0000) 2024-04-01T07:07:46.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:46 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:46.322+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:02.950323+0000 front 2024-04-01T07:07:02.950381+0000 (oldest deadline 2024-04-01T07:07:25.250345+0000) 2024-04-01T07:07:46.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:46 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:46.322+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-04-01T07:07:08.751404+0000 front 2024-04-01T07:07:08.751497+0000 (oldest deadline 2024-04-01T07:07:37.551922+0000) 2024-04-01T07:07:46.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:46 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:46.322+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6822 osd.6 since back 2024-04-01T07:07:17.552523+0000 front 2024-04-01T07:07:17.552575+0000 (oldest deadline 2024-04-01T07:07:42.852254+0000) 2024-04-01T07:07:47.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:46 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:46.821+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:30.924722+0000 front 2024-04-01T07:06:30.924835+0000 (oldest deadline 2024-04-01T07:06:59.725293+0000) 2024-04-01T07:07:47.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:46 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:46.821+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:43.126859+0000 front 2024-04-01T07:06:43.126953+0000 (oldest deadline 2024-04-01T07:07:04.226993+0000) 2024-04-01T07:07:47.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:46 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:46.821+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.230698+0000 front 2024-04-01T07:06:50.230866+0000 (oldest deadline 2024-04-01T07:07:16.130734+0000) 2024-04-01T07:07:47.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:46 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:46.821+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-04-01T07:06:56.131462+0000 front 2024-04-01T07:06:56.131400+0000 (oldest deadline 2024-04-01T07:07:20.231303+0000) 2024-04-01T07:07:47.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:46 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:46.821+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:00.231790+0000 front 2024-04-01T07:07:00.231808+0000 (oldest deadline 2024-04-01T07:07:26.131918+0000) 2024-04-01T07:07:47.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:46 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:46.821+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-04-01T07:07:08.333608+0000 front 2024-04-01T07:07:08.333493+0000 (oldest deadline 2024-04-01T07:07:34.233443+0000) 2024-04-01T07:07:47.253 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:46 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10[78267]: 2024-04-01T07:07:46.821+0000 7fcf54465700 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.83:6822 osd.6 since back 2024-04-01T07:07:15.934370+0000 front 2024-04-01T07:07:15.934399+0000 (oldest deadline 2024-04-01T07:07:44.134791+0000) 2024-04-01T07:07:47.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:47 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:47.293+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.346120+0000 front 2024-04-01T07:06:34.346258+0000 (oldest deadline 2024-04-01T07:06:57.846204+0000) 2024-04-01T07:07:47.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:47 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:47.293+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:42.547512+0000 front 2024-04-01T07:06:42.547305+0000 (oldest deadline 2024-04-01T07:07:08.447338+0000) 2024-04-01T07:07:47.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:47 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:47.293+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.148326+0000 front 2024-04-01T07:06:50.148134+0000 (oldest deadline 2024-04-01T07:07:12.448250+0000) 2024-04-01T07:07:47.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:47 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:47.293+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:02.950323+0000 front 2024-04-01T07:07:02.950381+0000 (oldest deadline 2024-04-01T07:07:25.250345+0000) 2024-04-01T07:07:47.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:47 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:47.293+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-04-01T07:07:08.751404+0000 front 2024-04-01T07:07:08.751497+0000 (oldest deadline 2024-04-01T07:07:37.551922+0000) 2024-04-01T07:07:47.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:47 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:47.293+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6822 osd.6 since back 2024-04-01T07:07:17.552523+0000 front 2024-04-01T07:07:17.552575+0000 (oldest deadline 2024-04-01T07:07:42.852254+0000) 2024-04-01T07:07:48.503 INFO:journalctl@ceph.osd.10.smithi145.stdout:Apr 01 07:07:48 smithi145 bash[91480]: ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-10 2024-04-01T07:07:48.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:48 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:48.295+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.346120+0000 front 2024-04-01T07:06:34.346258+0000 (oldest deadline 2024-04-01T07:06:57.846204+0000) 2024-04-01T07:07:48.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:48 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:48.295+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:42.547512+0000 front 2024-04-01T07:06:42.547305+0000 (oldest deadline 2024-04-01T07:07:08.447338+0000) 2024-04-01T07:07:48.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:48 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:48.295+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.148326+0000 front 2024-04-01T07:06:50.148134+0000 (oldest deadline 2024-04-01T07:07:12.448250+0000) 2024-04-01T07:07:48.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:48 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:48.295+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:02.950323+0000 front 2024-04-01T07:07:02.950381+0000 (oldest deadline 2024-04-01T07:07:25.250345+0000) 2024-04-01T07:07:48.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:48 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:48.295+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-04-01T07:07:08.751404+0000 front 2024-04-01T07:07:08.751497+0000 (oldest deadline 2024-04-01T07:07:37.551922+0000) 2024-04-01T07:07:48.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:48 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:48.295+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6822 osd.6 since back 2024-04-01T07:07:17.552523+0000 front 2024-04-01T07:07:17.552575+0000 (oldest deadline 2024-04-01T07:07:42.852254+0000) 2024-04-01T07:07:49.533 DEBUG:teuthology.orchestra.run.smithi145:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@osd.10.service' 2024-04-01T07:07:49.573 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-01T07:07:49.573 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-04-01T07:07:49.573 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-04-01T07:07:49.573 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@osd.11 2024-04-01T07:07:49.603 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:49 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:49.298+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.346120+0000 front 2024-04-01T07:06:34.346258+0000 (oldest deadline 2024-04-01T07:06:57.846204+0000) 2024-04-01T07:07:49.603 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:49 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:49.298+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:42.547512+0000 front 2024-04-01T07:06:42.547305+0000 (oldest deadline 2024-04-01T07:07:08.447338+0000) 2024-04-01T07:07:49.604 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:49 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:49.298+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.148326+0000 front 2024-04-01T07:06:50.148134+0000 (oldest deadline 2024-04-01T07:07:12.448250+0000) 2024-04-01T07:07:49.604 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:49 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:49.298+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:02.950323+0000 front 2024-04-01T07:07:02.950381+0000 (oldest deadline 2024-04-01T07:07:25.250345+0000) 2024-04-01T07:07:49.604 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:49 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:49.298+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-04-01T07:07:08.751404+0000 front 2024-04-01T07:07:08.751497+0000 (oldest deadline 2024-04-01T07:07:37.551922+0000) 2024-04-01T07:07:49.604 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:49 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:49.298+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6822 osd.6 since back 2024-04-01T07:07:17.552523+0000 front 2024-04-01T07:07:17.552575+0000 (oldest deadline 2024-04-01T07:07:42.852254+0000) 2024-04-01T07:07:49.891 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:49 smithi153 systemd[1]: Stopping Ceph osd.11 for c6f8eff4-eff3-11ee-b647-cb9ed24678a4... 2024-04-01T07:07:49.891 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:49 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:49.823+0000 7f520f318700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-01T07:07:49.891 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:49 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:49.823+0000 7f520f318700 -1 osd.11 95 *** Got signal Terminated *** 2024-04-01T07:07:49.891 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:49 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:49.823+0000 7f520f318700 -1 osd.11 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-01T07:07:50.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:50 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:50.276+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.346120+0000 front 2024-04-01T07:06:34.346258+0000 (oldest deadline 2024-04-01T07:06:57.846204+0000) 2024-04-01T07:07:50.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:50 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:50.276+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:42.547512+0000 front 2024-04-01T07:06:42.547305+0000 (oldest deadline 2024-04-01T07:07:08.447338+0000) 2024-04-01T07:07:50.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:50 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:50.276+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.148326+0000 front 2024-04-01T07:06:50.148134+0000 (oldest deadline 2024-04-01T07:07:12.448250+0000) 2024-04-01T07:07:50.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:50 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:50.276+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:02.950323+0000 front 2024-04-01T07:07:02.950381+0000 (oldest deadline 2024-04-01T07:07:25.250345+0000) 2024-04-01T07:07:50.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:50 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:50.276+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-04-01T07:07:08.751404+0000 front 2024-04-01T07:07:08.751497+0000 (oldest deadline 2024-04-01T07:07:37.551922+0000) 2024-04-01T07:07:50.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:50 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:50.276+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6822 osd.6 since back 2024-04-01T07:07:17.552523+0000 front 2024-04-01T07:07:17.552575+0000 (oldest deadline 2024-04-01T07:07:42.852254+0000) 2024-04-01T07:07:51.640 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:51 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:51.288+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.346120+0000 front 2024-04-01T07:06:34.346258+0000 (oldest deadline 2024-04-01T07:06:57.846204+0000) 2024-04-01T07:07:51.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:51 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:51.288+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:42.547512+0000 front 2024-04-01T07:06:42.547305+0000 (oldest deadline 2024-04-01T07:07:08.447338+0000) 2024-04-01T07:07:51.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:51 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:51.288+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.148326+0000 front 2024-04-01T07:06:50.148134+0000 (oldest deadline 2024-04-01T07:07:12.448250+0000) 2024-04-01T07:07:51.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:51 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:51.288+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:02.950323+0000 front 2024-04-01T07:07:02.950381+0000 (oldest deadline 2024-04-01T07:07:25.250345+0000) 2024-04-01T07:07:51.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:51 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:51.288+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-04-01T07:07:08.751404+0000 front 2024-04-01T07:07:08.751497+0000 (oldest deadline 2024-04-01T07:07:37.551922+0000) 2024-04-01T07:07:51.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:51 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:51.288+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6822 osd.6 since back 2024-04-01T07:07:17.552523+0000 front 2024-04-01T07:07:17.552575+0000 (oldest deadline 2024-04-01T07:07:42.852254+0000) 2024-04-01T07:07:51.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:51 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:51.288+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6820 osd.7 since back 2024-04-01T07:07:24.553215+0000 front 2024-04-01T07:07:24.553288+0000 (oldest deadline 2024-04-01T07:07:50.953541+0000) 2024-04-01T07:07:52.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:52 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:52.338+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.346120+0000 front 2024-04-01T07:06:34.346258+0000 (oldest deadline 2024-04-01T07:06:57.846204+0000) 2024-04-01T07:07:52.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:52 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:52.338+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:42.547512+0000 front 2024-04-01T07:06:42.547305+0000 (oldest deadline 2024-04-01T07:07:08.447338+0000) 2024-04-01T07:07:52.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:52 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:52.338+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.148326+0000 front 2024-04-01T07:06:50.148134+0000 (oldest deadline 2024-04-01T07:07:12.448250+0000) 2024-04-01T07:07:52.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:52 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:52.338+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:02.950323+0000 front 2024-04-01T07:07:02.950381+0000 (oldest deadline 2024-04-01T07:07:25.250345+0000) 2024-04-01T07:07:52.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:52 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:52.338+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-04-01T07:07:08.751404+0000 front 2024-04-01T07:07:08.751497+0000 (oldest deadline 2024-04-01T07:07:37.551922+0000) 2024-04-01T07:07:52.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:52 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:52.338+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6822 osd.6 since back 2024-04-01T07:07:17.552523+0000 front 2024-04-01T07:07:17.552575+0000 (oldest deadline 2024-04-01T07:07:42.852254+0000) 2024-04-01T07:07:52.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:52 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:52.338+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6820 osd.7 since back 2024-04-01T07:07:24.553215+0000 front 2024-04-01T07:07:24.553288+0000 (oldest deadline 2024-04-01T07:07:50.953541+0000) 2024-04-01T07:07:53.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:53 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:53.378+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.346120+0000 front 2024-04-01T07:06:34.346258+0000 (oldest deadline 2024-04-01T07:06:57.846204+0000) 2024-04-01T07:07:53.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:53 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:53.378+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:42.547512+0000 front 2024-04-01T07:06:42.547305+0000 (oldest deadline 2024-04-01T07:07:08.447338+0000) 2024-04-01T07:07:53.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:53 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:53.378+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.148326+0000 front 2024-04-01T07:06:50.148134+0000 (oldest deadline 2024-04-01T07:07:12.448250+0000) 2024-04-01T07:07:53.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:53 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:53.378+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:02.950323+0000 front 2024-04-01T07:07:02.950381+0000 (oldest deadline 2024-04-01T07:07:25.250345+0000) 2024-04-01T07:07:53.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:53 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:53.378+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-04-01T07:07:08.751404+0000 front 2024-04-01T07:07:08.751497+0000 (oldest deadline 2024-04-01T07:07:37.551922+0000) 2024-04-01T07:07:53.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:53 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:53.378+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6822 osd.6 since back 2024-04-01T07:07:17.552523+0000 front 2024-04-01T07:07:17.552575+0000 (oldest deadline 2024-04-01T07:07:42.852254+0000) 2024-04-01T07:07:53.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:53 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:53.378+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6820 osd.7 since back 2024-04-01T07:07:24.553215+0000 front 2024-04-01T07:07:24.553288+0000 (oldest deadline 2024-04-01T07:07:50.953541+0000) 2024-04-01T07:07:54.891 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:54 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:54.428+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-04-01T07:06:34.346120+0000 front 2024-04-01T07:06:34.346258+0000 (oldest deadline 2024-04-01T07:06:57.846204+0000) 2024-04-01T07:07:54.891 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:54 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:54.428+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-04-01T07:06:42.547512+0000 front 2024-04-01T07:06:42.547305+0000 (oldest deadline 2024-04-01T07:07:08.447338+0000) 2024-04-01T07:07:54.891 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:54 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:54.428+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-04-01T07:06:50.148326+0000 front 2024-04-01T07:06:50.148134+0000 (oldest deadline 2024-04-01T07:07:12.448250+0000) 2024-04-01T07:07:54.891 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:54 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:54.428+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-04-01T07:07:02.950323+0000 front 2024-04-01T07:07:02.950381+0000 (oldest deadline 2024-04-01T07:07:25.250345+0000) 2024-04-01T07:07:54.891 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:54 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:54.428+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-04-01T07:07:08.751404+0000 front 2024-04-01T07:07:08.751497+0000 (oldest deadline 2024-04-01T07:07:37.551922+0000) 2024-04-01T07:07:54.891 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:54 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:54.428+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.83:6822 osd.6 since back 2024-04-01T07:07:17.552523+0000 front 2024-04-01T07:07:17.552575+0000 (oldest deadline 2024-04-01T07:07:42.852254+0000) 2024-04-01T07:07:54.891 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:54 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11[79270]: 2024-04-01T07:07:54.428+0000 7f520b90e700 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.145:6820 osd.7 since back 2024-04-01T07:07:24.553215+0000 front 2024-04-01T07:07:24.553288+0000 (oldest deadline 2024-04-01T07:07:50.953541+0000) 2024-04-01T07:07:55.641 INFO:journalctl@ceph.osd.11.smithi153.stdout:Apr 01 07:07:55 smithi153 bash[92749]: ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-osd-11 2024-04-01T07:07:56.537 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@osd.11.service' 2024-04-01T07:07:56.618 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-01T07:07:56.618 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-04-01T07:07:56.618 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-04-01T07:07:56.618 DEBUG:teuthology.orchestra.run.smithi083:> sudo systemctl stop ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mds.a 2024-04-01T07:07:57.013 INFO:journalctl@ceph.mds.a.smithi083.stdout:Apr 01 07:07:56 smithi083 systemd[1]: Stopping Ceph mds.a for c6f8eff4-eff3-11ee-b647-cb9ed24678a4... 2024-04-01T07:07:57.013 INFO:journalctl@ceph.mds.a.smithi083.stdout:Apr 01 07:07:56 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-a[95412]: 2024-04-01T07:07:56.860+0000 7f78d665e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-01T07:07:57.013 INFO:journalctl@ceph.mds.a.smithi083.stdout:Apr 01 07:07:56 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-a[95412]: 2024-04-01T07:07:56.860+0000 7f78d665e700 -1 mds.a *** got signal Terminated *** 2024-04-01T07:08:01.197 INFO:journalctl@ceph.mds.a.smithi083.stdout:Apr 01 07:08:00 smithi083 bash[119486]: ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-a 2024-04-01T07:08:01.204 DEBUG:teuthology.orchestra.run.smithi083:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mds.a.service' 2024-04-01T07:08:01.241 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-01T07:08:01.241 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-04-01T07:08:01.241 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-04-01T07:08:01.241 DEBUG:teuthology.orchestra.run.smithi083:> sudo systemctl stop ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mds.d 2024-04-01T07:08:01.512 INFO:journalctl@ceph.mds.d.smithi083.stdout:Apr 01 07:08:01 smithi083 systemd[1]: Stopping Ceph mds.d for c6f8eff4-eff3-11ee-b647-cb9ed24678a4... 2024-04-01T07:08:02.013 INFO:journalctl@ceph.mds.d.smithi083.stdout:Apr 01 07:08:01 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-d[94504]: 2024-04-01T07:08:01.517+0000 7ff59bf2b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-01T07:08:02.013 INFO:journalctl@ceph.mds.d.smithi083.stdout:Apr 01 07:08:01 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-d[94504]: 2024-04-01T07:08:01.517+0000 7ff59bf2b700 -1 mds.d *** got signal Terminated *** 2024-04-01T07:08:04.926 INFO:journalctl@ceph.mds.d.smithi083.stdout:Apr 01 07:08:04 smithi083 bash[119625]: ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-d 2024-04-01T07:08:04.931 DEBUG:teuthology.orchestra.run.smithi083:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mds.d.service' 2024-04-01T07:08:04.965 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-01T07:08:04.965 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-04-01T07:08:04.965 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-04-01T07:08:04.966 DEBUG:teuthology.orchestra.run.smithi083:> sudo systemctl stop ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mds.g 2024-04-01T07:08:05.225 INFO:journalctl@ceph.mds.g.smithi083.stdout:Apr 01 07:08:05 smithi083 systemd[1]: Stopping Ceph mds.g for c6f8eff4-eff3-11ee-b647-cb9ed24678a4... 2024-04-01T07:08:05.512 INFO:journalctl@ceph.mds.g.smithi083.stdout:Apr 01 07:08:05 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-g[95027]: 2024-04-01T07:08:05.224+0000 7f5995f14700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-01T07:08:05.513 INFO:journalctl@ceph.mds.g.smithi083.stdout:Apr 01 07:08:05 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-g[95027]: 2024-04-01T07:08:05.224+0000 7f5995f14700 -1 mds.g *** got signal Terminated *** 2024-04-01T07:08:07.373 INFO:journalctl@ceph.mds.g.smithi083.stdout:Apr 01 07:08:07 smithi083 bash[119764]: ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-g 2024-04-01T07:08:07.378 DEBUG:teuthology.orchestra.run.smithi083:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mds.g.service' 2024-04-01T07:08:07.411 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-01T07:08:07.412 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-04-01T07:08:07.412 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-04-01T07:08:07.412 DEBUG:teuthology.orchestra.run.smithi083:> sudo systemctl stop ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mds.j 2024-04-01T07:08:07.674 INFO:journalctl@ceph.mds.j.smithi083.stdout:Apr 01 07:08:07 smithi083 systemd[1]: Stopping Ceph mds.j for c6f8eff4-eff3-11ee-b647-cb9ed24678a4... 2024-04-01T07:08:08.012 INFO:journalctl@ceph.mds.j.smithi083.stdout:Apr 01 07:08:07 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-j[94116]: 2024-04-01T07:08:07.674+0000 7f0096e5f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-01T07:08:08.012 INFO:journalctl@ceph.mds.j.smithi083.stdout:Apr 01 07:08:07 smithi083 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-j[94116]: 2024-04-01T07:08:07.674+0000 7f0096e5f700 -1 mds.j *** got signal Terminated *** 2024-04-01T07:08:11.174 INFO:journalctl@ceph.mds.j.smithi083.stdout:Apr 01 07:08:10 smithi083 bash[119904]: ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-j 2024-04-01T07:08:11.179 DEBUG:teuthology.orchestra.run.smithi083:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mds.j.service' 2024-04-01T07:08:11.212 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-01T07:08:11.213 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-04-01T07:08:11.213 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-04-01T07:08:11.213 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mds.b 2024-04-01T07:08:11.503 INFO:journalctl@ceph.mds.b.smithi145.stdout:Apr 01 07:08:11 smithi145 systemd[1]: Stopping Ceph mds.b for c6f8eff4-eff3-11ee-b647-cb9ed24678a4... 2024-04-01T07:08:11.503 INFO:journalctl@ceph.mds.b.smithi145.stdout:Apr 01 07:08:11 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-b[84548]: 2024-04-01T07:08:11.450+0000 7f7ad94e9700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-01T07:08:11.503 INFO:journalctl@ceph.mds.b.smithi145.stdout:Apr 01 07:08:11 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-b[84548]: 2024-04-01T07:08:11.450+0000 7f7ad94e9700 -1 mds.b *** got signal Terminated *** 2024-04-01T07:08:15.003 INFO:journalctl@ceph.mds.b.smithi145.stdout:Apr 01 07:08:14 smithi145 bash[91743]: ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-b 2024-04-01T07:08:15.098 DEBUG:teuthology.orchestra.run.smithi145:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mds.b.service' 2024-04-01T07:08:15.134 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-01T07:08:15.134 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-04-01T07:08:15.134 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-04-01T07:08:15.135 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mds.e 2024-04-01T07:08:15.408 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 07:08:15 smithi145 systemd[1]: Stopping Ceph mds.e for c6f8eff4-eff3-11ee-b647-cb9ed24678a4... 2024-04-01T07:08:15.752 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 07:08:15 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T07:08:15.408+0000 7f34f6bea700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-01T07:08:15.753 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 07:08:15 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e[83860]: 2024-04-01T07:08:15.408+0000 7f34f6bea700 -1 mds.e *** got signal Terminated *** 2024-04-01T07:08:19.003 INFO:journalctl@ceph.mds.e.smithi145.stdout:Apr 01 07:08:18 smithi145 bash[91885]: ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-e 2024-04-01T07:08:19.086 DEBUG:teuthology.orchestra.run.smithi145:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mds.e.service' 2024-04-01T07:08:19.122 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-01T07:08:19.122 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-04-01T07:08:19.122 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-04-01T07:08:19.122 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mds.h 2024-04-01T07:08:19.390 INFO:journalctl@ceph.mds.h.smithi145.stdout:Apr 01 07:08:19 smithi145 systemd[1]: Stopping Ceph mds.h for c6f8eff4-eff3-11ee-b647-cb9ed24678a4... 2024-04-01T07:08:19.753 INFO:journalctl@ceph.mds.h.smithi145.stdout:Apr 01 07:08:19 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-h[84203]: 2024-04-01T07:08:19.390+0000 7fa28f943700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-01T07:08:19.753 INFO:journalctl@ceph.mds.h.smithi145.stdout:Apr 01 07:08:19 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-h[84203]: 2024-04-01T07:08:19.390+0000 7fa28f943700 -1 mds.h *** got signal Terminated *** 2024-04-01T07:08:23.113 INFO:journalctl@ceph.mds.h.smithi145.stdout:Apr 01 07:08:22 smithi145 bash[92024]: ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-h 2024-04-01T07:08:23.118 DEBUG:teuthology.orchestra.run.smithi145:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mds.h.service' 2024-04-01T07:08:23.152 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-01T07:08:23.152 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-04-01T07:08:23.152 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-04-01T07:08:23.152 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mds.k 2024-04-01T07:08:23.422 INFO:journalctl@ceph.mds.k.smithi145.stdout:Apr 01 07:08:23 smithi145 systemd[1]: Stopping Ceph mds.k for c6f8eff4-eff3-11ee-b647-cb9ed24678a4... 2024-04-01T07:08:23.752 INFO:journalctl@ceph.mds.k.smithi145.stdout:Apr 01 07:08:23 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-k[83514]: 2024-04-01T07:08:23.422+0000 7f6531436700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-01T07:08:23.753 INFO:journalctl@ceph.mds.k.smithi145.stdout:Apr 01 07:08:23 smithi145 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-k[83514]: 2024-04-01T07:08:23.422+0000 7f6531436700 -1 mds.k *** got signal Terminated *** 2024-04-01T07:08:27.003 INFO:journalctl@ceph.mds.k.smithi145.stdout:Apr 01 07:08:26 smithi145 bash[92163]: ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-k 2024-04-01T07:08:27.046 DEBUG:teuthology.orchestra.run.smithi145:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mds.k.service' 2024-04-01T07:08:27.078 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-01T07:08:27.079 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-04-01T07:08:27.079 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-04-01T07:08:27.079 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mds.c 2024-04-01T07:08:27.391 INFO:journalctl@ceph.mds.c.smithi153.stdout:Apr 01 07:08:27 smithi153 systemd[1]: Stopping Ceph mds.c for c6f8eff4-eff3-11ee-b647-cb9ed24678a4... 2024-04-01T07:08:27.391 INFO:journalctl@ceph.mds.c.smithi153.stdout:Apr 01 07:08:27 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-c[85342]: 2024-04-01T07:08:27.359+0000 7f74c3d81700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-01T07:08:27.391 INFO:journalctl@ceph.mds.c.smithi153.stdout:Apr 01 07:08:27 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-c[85342]: 2024-04-01T07:08:27.359+0000 7f74c3d81700 -1 mds.c *** got signal Terminated *** 2024-04-01T07:08:31.043 INFO:journalctl@ceph.mds.c.smithi153.stdout:Apr 01 07:08:30 smithi153 bash[93013]: ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-c 2024-04-01T07:08:31.050 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mds.c.service' 2024-04-01T07:08:31.089 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-01T07:08:31.089 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-04-01T07:08:31.089 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-04-01T07:08:31.089 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mds.f 2024-04-01T07:08:31.359 INFO:journalctl@ceph.mds.f.smithi153.stdout:Apr 01 07:08:31 smithi153 systemd[1]: Stopping Ceph mds.f for c6f8eff4-eff3-11ee-b647-cb9ed24678a4... 2024-04-01T07:08:31.640 INFO:journalctl@ceph.mds.f.smithi153.stdout:Apr 01 07:08:31 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-f[85003]: 2024-04-01T07:08:31.359+0000 7f474612c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-01T07:08:31.641 INFO:journalctl@ceph.mds.f.smithi153.stdout:Apr 01 07:08:31 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-f[85003]: 2024-04-01T07:08:31.359+0000 7f474612c700 -1 mds.f *** got signal Terminated *** 2024-04-01T07:08:35.758 INFO:journalctl@ceph.mds.f.smithi153.stdout:Apr 01 07:08:35 smithi153 bash[93152]: ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-f 2024-04-01T07:08:35.763 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mds.f.service' 2024-04-01T07:08:35.798 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-01T07:08:35.798 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-04-01T07:08:35.798 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-04-01T07:08:35.798 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mds.i 2024-04-01T07:08:36.058 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 07:08:35 smithi153 systemd[1]: Stopping Ceph mds.i for c6f8eff4-eff3-11ee-b647-cb9ed24678a4... 2024-04-01T07:08:36.391 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 07:08:36 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[88867]: 2024-04-01T07:08:36.058+0000 7fcd45b62700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-01T07:08:36.391 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 07:08:36 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i[88867]: 2024-04-01T07:08:36.058+0000 7fcd45b62700 -1 mds.i *** got signal Terminated *** 2024-04-01T07:08:39.022 INFO:journalctl@ceph.mds.i.smithi153.stdout:Apr 01 07:08:38 smithi153 bash[93291]: ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-i 2024-04-01T07:08:39.027 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mds.i.service' 2024-04-01T07:08:39.061 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-01T07:08:39.061 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-04-01T07:08:39.062 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-04-01T07:08:39.062 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mds.l 2024-04-01T07:08:39.332 INFO:journalctl@ceph.mds.l.smithi153.stdout:Apr 01 07:08:39 smithi153 systemd[1]: Stopping Ceph mds.l for c6f8eff4-eff3-11ee-b647-cb9ed24678a4... 2024-04-01T07:08:39.640 INFO:journalctl@ceph.mds.l.smithi153.stdout:Apr 01 07:08:39 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-l[84664]: 2024-04-01T07:08:39.331+0000 7ff7b9844700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-01T07:08:39.641 INFO:journalctl@ceph.mds.l.smithi153.stdout:Apr 01 07:08:39 smithi153 ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-l[84664]: 2024-04-01T07:08:39.331+0000 7ff7b9844700 -1 mds.l *** got signal Terminated *** 2024-04-01T07:08:43.891 INFO:journalctl@ceph.mds.l.smithi153.stdout:Apr 01 07:08:43 smithi153 bash[93429]: ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4-mds-l 2024-04-01T07:08:43.924 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c6f8eff4-eff3-11ee-b647-cb9ed24678a4@mds.l.service' 2024-04-01T07:08:43.958 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-01T07:08:43.958 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-04-01T07:08:43.958 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 --force --keep-logs 2024-04-01T07:08:44.144 INFO:teuthology.orchestra.run.smithi083.stdout:Deleting cluster with fsid: c6f8eff4-eff3-11ee-b647-cb9ed24678a4 2024-04-01T07:08:45.526 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 --force --keep-logs 2024-04-01T07:08:45.714 INFO:teuthology.orchestra.run.smithi145.stdout:Deleting cluster with fsid: c6f8eff4-eff3-11ee-b647-cb9ed24678a4 2024-04-01T07:08:47.081 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 --force --keep-logs 2024-04-01T07:08:47.266 INFO:teuthology.orchestra.run.smithi153.stdout:Deleting cluster with fsid: c6f8eff4-eff3-11ee-b647-cb9ed24678a4 2024-04-01T07:08:48.681 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-01T07:08:48.718 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-01T07:08:48.755 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-01T07:08:48.785 INFO:tasks.cephadm:Archiving crash dumps... 2024-04-01T07:08:48.787 DEBUG:teuthology.misc:Transferring archived files from smithi083:/var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/crash to /home/teuthworker/archive/teuthology-2024-03-27_22:24:02-fs-reef-distro-default-smithi/7627463/remote/smithi083/crash 2024-04-01T07:08:48.788 DEBUG:teuthology.orchestra.run.smithi083:> sudo tar c -f - -C /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/crash -- . 2024-04-01T07:08:48.819 INFO:teuthology.orchestra.run.smithi083.stderr:tar: /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/crash: Cannot open: No such file or directory 2024-04-01T07:08:48.819 INFO:teuthology.orchestra.run.smithi083.stderr:tar: Error is not recoverable: exiting now 2024-04-01T07:08:48.821 DEBUG:teuthology.misc:Transferring archived files from smithi145:/var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/crash to /home/teuthworker/archive/teuthology-2024-03-27_22:24:02-fs-reef-distro-default-smithi/7627463/remote/smithi145/crash 2024-04-01T07:08:48.821 DEBUG:teuthology.orchestra.run.smithi145:> sudo tar c -f - -C /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/crash -- . 2024-04-01T07:08:48.883 INFO:teuthology.orchestra.run.smithi145.stderr:tar: /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/crash: Cannot open: No such file or directory 2024-04-01T07:08:48.883 INFO:teuthology.orchestra.run.smithi145.stderr:tar: Error is not recoverable: exiting now 2024-04-01T07:08:48.885 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/crash to /home/teuthworker/archive/teuthology-2024-03-27_22:24:02-fs-reef-distro-default-smithi/7627463/remote/smithi153/crash 2024-04-01T07:08:48.886 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/crash -- . 2024-04-01T07:08:48.920 INFO:teuthology.orchestra.run.smithi153.stderr:tar: /var/lib/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/crash: Cannot open: No such file or directory 2024-04-01T07:08:48.920 INFO:teuthology.orchestra.run.smithi153.stderr:tar: Error is not recoverable: exiting now 2024-04-01T07:08:48.922 INFO:tasks.cephadm:Checking cluster log for badness... 2024-04-01T07:08:48.922 DEBUG:teuthology.orchestra.run.smithi083:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-04-01T07:08:48.956 INFO:teuthology.orchestra.run.smithi083.stderr:grep: /var/log/ceph/c6f8eff4-eff3-11ee-b647-cb9ed24678a4/ceph.log: No such file or directory 2024-04-01T07:08:48.959 INFO:tasks.cephadm:Compressing logs... 2024-04-01T07:08:48.959 DEBUG:teuthology.orchestra.run.smithi083:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-01T07:08:49.001 DEBUG:teuthology.orchestra.run.smithi145:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-01T07:08:49.003 DEBUG:teuthology.orchestra.run.smithi153:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-01T07:08:49.027 INFO:teuthology.orchestra.run.smithi083.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-04-01T07:08:49.030 INFO:teuthology.orchestra.run.smithi153.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-04-01T07:08:49.033 INFO:teuthology.orchestra.run.smithi145.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-04-01T07:10:53.431 INFO:tasks.cephadm:Archiving logs... 2024-04-01T07:10:53.432 DEBUG:teuthology.misc:Transferring archived files from smithi083:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-03-27_22:24:02-fs-reef-distro-default-smithi/7627463/remote/smithi083/log 2024-04-01T07:10:53.433 DEBUG:teuthology.orchestra.run.smithi083:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-01T07:10:57.173 DEBUG:teuthology.misc:Transferring archived files from smithi145:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-03-27_22:24:02-fs-reef-distro-default-smithi/7627463/remote/smithi145/log 2024-04-01T07:10:57.174 DEBUG:teuthology.orchestra.run.smithi145:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-01T07:11:12.908 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-03-27_22:24:02-fs-reef-distro-default-smithi/7627463/remote/smithi153/log 2024-04-01T07:11:12.909 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-01T07:11:16.980 INFO:tasks.cephadm:Removing cluster... 2024-04-01T07:11:16.981 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 --force 2024-04-01T07:11:17.181 INFO:teuthology.orchestra.run.smithi083.stdout:Deleting cluster with fsid: c6f8eff4-eff3-11ee-b647-cb9ed24678a4 2024-04-01T07:11:17.444 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 --force 2024-04-01T07:11:17.644 INFO:teuthology.orchestra.run.smithi145.stdout:Deleting cluster with fsid: c6f8eff4-eff3-11ee-b647-cb9ed24678a4 2024-04-01T07:11:18.014 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c6f8eff4-eff3-11ee-b647-cb9ed24678a4 --force 2024-04-01T07:11:18.210 INFO:teuthology.orchestra.run.smithi153.stdout:Deleting cluster with fsid: c6f8eff4-eff3-11ee-b647-cb9ed24678a4 2024-04-01T07:11:18.480 INFO:tasks.cephadm:Removing cephadm ... 2024-04-01T07:11:18.480 DEBUG:teuthology.orchestra.run.smithi083:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-01T07:11:18.502 DEBUG:teuthology.orchestra.run.smithi145:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-01T07:11:18.520 DEBUG:teuthology.orchestra.run.smithi153:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-01T07:11:18.539 INFO:tasks.cephadm:Teardown complete 2024-04-01T07:11:18.539 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-01T07:11:18.554 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-01T07:11:18.555 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-01T07:11:18.557 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-01T07:11:18.563 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-01T07:11:18.680 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-01T07:11:18.691 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-01T07:11:18.692 DEBUG:teuthology.orchestra.run.smithi083:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-01T07:11:18.694 DEBUG:teuthology.orchestra.run.smithi145:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-01T07:11:18.697 DEBUG:teuthology.orchestra.run.smithi153:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-01T07:11:18.711 INFO:teuthology.orchestra.run.smithi083.stderr:bash: ntpq: command not found 2024-04-01T07:11:18.711 INFO:teuthology.orchestra.run.smithi145.stderr:bash: ntpq: command not found 2024-04-01T07:11:18.712 INFO:teuthology.orchestra.run.smithi153.stderr:bash: ntpq: command not found 2024-04-01T07:11:18.715 INFO:teuthology.orchestra.run.smithi083.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-01T07:11:18.715 INFO:teuthology.orchestra.run.smithi083.stdout:=============================================================================== 2024-04-01T07:11:18.715 INFO:teuthology.orchestra.run.smithi083.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 42 +16us[ +16us] +/- 84ms 2024-04-01T07:11:18.715 INFO:teuthology.orchestra.run.smithi083.stdout:^* hv02.front.sepia.ceph.com 3 6 377 45 -351us[ -343us] +/- 57ms 2024-04-01T07:11:18.715 INFO:teuthology.orchestra.run.smithi083.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 44 +511us[ +511us] +/- 76ms 2024-04-01T07:11:18.715 INFO:teuthology.orchestra.run.smithi083.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T07:11:18.717 INFO:teuthology.orchestra.run.smithi145.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-01T07:11:18.717 INFO:teuthology.orchestra.run.smithi145.stdout:=============================================================================== 2024-04-01T07:11:18.717 INFO:teuthology.orchestra.run.smithi145.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 42 +7380ns[+7380ns] +/- 84ms 2024-04-01T07:11:18.717 INFO:teuthology.orchestra.run.smithi145.stdout:^* hv02.front.sepia.ceph.com 3 6 377 45 -337us[ -321us] +/- 57ms 2024-04-01T07:11:18.717 INFO:teuthology.orchestra.run.smithi145.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 46 +482us[ +498us] +/- 76ms 2024-04-01T07:11:18.717 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T07:11:18.718 INFO:teuthology.orchestra.run.smithi153.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-01T07:11:18.718 INFO:teuthology.orchestra.run.smithi153.stdout:=============================================================================== 2024-04-01T07:11:18.718 INFO:teuthology.orchestra.run.smithi153.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 46 -1470ns[-2935ns] +/- 84ms 2024-04-01T07:11:18.718 INFO:teuthology.orchestra.run.smithi153.stdout:^* hv02.front.sepia.ceph.com 3 6 377 42 -373us[ -375us] +/- 58ms 2024-04-01T07:11:18.718 INFO:teuthology.orchestra.run.smithi153.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 45 +476us[ +474us] +/- 76ms 2024-04-01T07:11:18.718 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-01T07:11:18.719 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-01T07:11:18.730 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-01T07:11:18.730 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-01T07:11:18.753 DEBUG:teuthology.orchestra.run.smithi083:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-01T07:11:18.837 DEBUG:teuthology.orchestra.run.smithi145:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-01T07:11:18.908 DEBUG:teuthology.orchestra.run.smithi153:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-01T07:11:18.976 DEBUG:teuthology.orchestra.run.smithi083:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-01T07:11:19.011 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T07:11:19.011 DEBUG:teuthology.orchestra.run.smithi145:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-01T07:11:19.042 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T07:11:19.043 DEBUG:teuthology.orchestra.run.smithi153:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-04-01T07:11:19.072 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T07:11:19.073 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-01T07:11:19.088 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-01T07:11:19.109 INFO:teuthology.task.internal:Duration was 2106.334509 seconds 2024-04-01T07:11:19.110 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-01T07:11:19.142 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-01T07:11:19.142 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-01T07:11:19.145 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-01T07:11:19.147 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-01T07:11:19.192 INFO:teuthology.orchestra.run.smithi145.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-01T07:11:19.193 INFO:teuthology.orchestra.run.smithi153.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-01T07:11:19.194 INFO:teuthology.orchestra.run.smithi083.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-01T07:11:19.515 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-01T07:11:19.515 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi083.front.sepia.ceph.com 2024-04-01T07:11:19.515 DEBUG:teuthology.orchestra.run.smithi083:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-01T07:11:19.539 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi145.front.sepia.ceph.com 2024-04-01T07:11:19.539 DEBUG:teuthology.orchestra.run.smithi145:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-01T07:11:19.561 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi153.front.sepia.ceph.com 2024-04-01T07:11:19.562 DEBUG:teuthology.orchestra.run.smithi153:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-01T07:11:19.586 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-01T07:11:19.586 DEBUG:teuthology.orchestra.run.smithi083:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-01T07:11:19.590 DEBUG:teuthology.orchestra.run.smithi145:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-01T07:11:19.604 DEBUG:teuthology.orchestra.run.smithi153:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-01T07:11:19.680 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-01T07:11:19.680 DEBUG:teuthology.orchestra.run.smithi083:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-01T07:11:19.683 DEBUG:teuthology.orchestra.run.smithi145:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-01T07:11:19.687 DEBUG:teuthology.orchestra.run.smithi153:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-01T07:11:19.791 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-01T07:11:19.807 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-01T07:11:19.807 DEBUG:teuthology.orchestra.run.smithi083:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-01T07:11:19.834 DEBUG:teuthology.orchestra.run.smithi145:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-01T07:11:19.862 DEBUG:teuthology.orchestra.run.smithi153:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-01T07:11:19.889 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-01T07:11:19.901 DEBUG:teuthology.orchestra.run.smithi083:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-01T07:11:19.904 DEBUG:teuthology.orchestra.run.smithi145:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-01T07:11:19.906 DEBUG:teuthology.orchestra.run.smithi153:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-01T07:11:19.928 INFO:teuthology.orchestra.run.smithi083.stdout:kernel.core_pattern = core 2024-04-01T07:11:19.930 INFO:teuthology.orchestra.run.smithi145.stdout:kernel.core_pattern = core 2024-04-01T07:11:19.955 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern = core 2024-04-01T07:11:20.054 DEBUG:teuthology.orchestra.run.smithi083:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-01T07:11:20.069 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T07:11:20.070 DEBUG:teuthology.orchestra.run.smithi145:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-01T07:11:20.085 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T07:11:20.086 DEBUG:teuthology.orchestra.run.smithi153:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-01T07:11:20.110 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-01T07:11:20.111 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-01T07:11:20.123 INFO:teuthology.task.internal:Transferring archived files... 2024-04-01T07:11:20.124 DEBUG:teuthology.misc:Transferring archived files from smithi083:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-03-27_22:24:02-fs-reef-distro-default-smithi/7627463/remote/smithi083 2024-04-01T07:11:20.124 DEBUG:teuthology.orchestra.run.smithi083:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-01T07:11:20.169 DEBUG:teuthology.misc:Transferring archived files from smithi145:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-03-27_22:24:02-fs-reef-distro-default-smithi/7627463/remote/smithi145 2024-04-01T07:11:20.169 DEBUG:teuthology.orchestra.run.smithi145:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-01T07:11:20.217 DEBUG:teuthology.misc:Transferring archived files from smithi153:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-03-27_22:24:02-fs-reef-distro-default-smithi/7627463/remote/smithi153 2024-04-01T07:11:20.217 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-01T07:11:20.262 INFO:teuthology.task.internal:Removing archive directory... 2024-04-01T07:11:20.263 DEBUG:teuthology.orchestra.run.smithi083:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-01T07:11:20.265 DEBUG:teuthology.orchestra.run.smithi145:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-01T07:11:20.268 DEBUG:teuthology.orchestra.run.smithi153:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-01T07:11:20.312 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-01T07:11:20.326 INFO:teuthology.task.internal:Not uploading archives. 2024-04-01T07:11:20.326 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-01T07:11:20.351 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-01T07:11:20.352 DEBUG:teuthology.orchestra.run.smithi083:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-01T07:11:20.354 DEBUG:teuthology.orchestra.run.smithi145:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-01T07:11:20.357 DEBUG:teuthology.orchestra.run.smithi153:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-01T07:11:20.368 INFO:teuthology.orchestra.run.smithi083.stdout: 262158 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 1 07:11 /home/ubuntu/cephtest 2024-04-01T07:11:20.372 INFO:teuthology.orchestra.run.smithi145.stdout: 262157 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 1 07:11 /home/ubuntu/cephtest 2024-04-01T07:11:20.374 INFO:teuthology.orchestra.run.smithi153.stdout: 262164 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 1 07:11 /home/ubuntu/cephtest 2024-04-01T07:11:20.375 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-01T07:11:20.387 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-01T07:11:20.451 INFO:teuthology.nuke:Checking targets against current locks 2024-04-01T07:11:20.481 DEBUG:teuthology.nuke:shortname: smithi083 2024-04-01T07:11:20.481 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-01T07:11:20.508 DEBUG:teuthology.nuke:shortname: smithi145 2024-04-01T07:11:20.508 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-01T07:11:20.516 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi083.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-03-27_22:24:02-fs-reef-distro-default-smithi/7627463', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-01 06:30:40.138253', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAGyF08WtiWnGUBakqONA4TOCeh6PVpT0lJmG2rm3bNrsQPIetpD7OAVbiazDg3hRo6VYkFwwa/SY7oLHnshQpU='} 2024-04-01T07:11:20.537 DEBUG:teuthology.nuke:shortname: smithi153 2024-04-01T07:11:20.537 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-01T07:11:20.542 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi145.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-03-27_22:24:02-fs-reef-distro-default-smithi/7627463', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-01 06:30:40.136909', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHj28tnHIvFd5C6CE3UCvX7UOj/3KFM58N9y/2CNusXrJ3PqRLVRaqMzrEba0sCz7TReoaw48hKmAXeAf/zZDIU='} 2024-04-01T07:11:20.568 INFO:teuthology.orchestra.console.smithi083:Power off 2024-04-01T07:11:20.568 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-01T07:11:20.584 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-03-27_22:24:02-fs-reef-distro-default-smithi/7627463', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-01 06:30:40.139346', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDC6r6S2VhmCQQ10q04+DpxUxLkvdoivR3GSJdraq4MXQ7gzT9dZiroNpqeZ8Fboj3MFB4VSnIeAH6QPwlcHa6w='} 2024-04-01T07:11:20.597 DEBUG:teuthology.orchestra.console.smithi083:power off output: Chassis Power Control: Down/Off 2024-04-01T07:11:20.597 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T07:11:20.616 INFO:teuthology.orchestra.console.smithi145:Power off 2024-04-01T07:11:20.617 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-01T07:11:20.630 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is on 2024-04-01T07:11:20.640 DEBUG:teuthology.orchestra.console.smithi145:power off output: Chassis Power Control: Down/Off 2024-04-01T07:11:20.640 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T07:11:20.660 INFO:teuthology.orchestra.console.smithi153:Power off 2024-04-01T07:11:20.660 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-01T07:11:20.673 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on 2024-04-01T07:11:20.687 DEBUG:teuthology.orchestra.console.smithi153:power off output: Chassis Power Control: Down/Off 2024-04-01T07:11:20.688 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T07:11:20.716 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2024-04-01T07:11:24.632 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T07:11:24.674 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T07:11:24.717 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T07:11:24.744 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is on 2024-04-01T07:11:24.786 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on 2024-04-01T07:11:24.827 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2024-04-01T07:11:28.746 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T07:11:28.787 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T07:11:28.828 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T07:11:28.862 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is off 2024-04-01T07:11:28.898 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is off 2024-04-01T07:11:28.939 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off 2024-04-01T07:11:28.963 INFO:teuthology.orchestra.console.smithi083:Power off completed 2024-04-01T07:11:28.999 INFO:teuthology.orchestra.console.smithi145:Power off completed 2024-04-01T07:11:29.040 INFO:teuthology.orchestra.console.smithi153:Power off completed 2024-04-01T07:11:29.145 INFO:teuthology.run:Summary data: description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/fsstress}} duration: 2106.334508895874 failure_reason: 'error during scrub thrashing: rank damage found: {''backtrace''}' flavor: default owner: scheduled_teuthology@teuthology status: fail success: false 2024-04-01T07:11:29.145 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T07:11:29.268 INFO:teuthology.run:FAIL